2023-10-14T18:49:03.269 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T18:49:03.271 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801 --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/orig.config.yaml 2023-10-14T18:49:03.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:49:03.420 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801 branch: quincy-release description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: yweinste@redhat.com first_in_suite: false job_id: '7425801' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: quincy-release ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: quincy-release sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2462 sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: quincy-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSrqygswVfZqG7JEM590EKL6zyqWL7FCIxqREpoASKF/ctYhAS8olNztrKutEskPm4iqVRXef2yhvWSFIbDF14= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0hM9VEJyt4NHND840BB2PAXjFUrr1hPb5VcsjvHz7QWnK7eJEa7OV3IpOxovMjNchmTIL1tOVIUSMCCVAT7wk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_20:07:38 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T18:49:03.420 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa; will attempt to use it 2023-10-14T18:49:03.421 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks 2023-10-14T18:49:03.422 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T18:49:03.423 INFO:teuthology.task.internal:Checking packages... 2023-10-14T18:49:03.450 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586' 2023-10-14T18:49:03.451 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T18:49:03.452 INFO:teuthology.packaging:ref: None 2023-10-14T18:49:03.452 INFO:teuthology.packaging:tag: None 2023-10-14T18:49:03.453 INFO:teuthology.packaging:branch: quincy-release 2023-10-14T18:49:03.453 INFO:teuthology.packaging:sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:49:03.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy-release 2023-10-14T18:49:03.610 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1415.g9d6d32bb 2023-10-14T18:49:03.610 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T18:49:03.617 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T18:49:03.617 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T18:49:03.654 INFO:teuthology.task.internal:Saving configuration 2023-10-14T18:49:03.671 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T18:49:03.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T18:49:03.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:43:46.834511', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSrqygswVfZqG7JEM590EKL6zyqWL7FCIxqREpoASKF/ctYhAS8olNztrKutEskPm4iqVRXef2yhvWSFIbDF14='} 2023-10-14T18:49:03.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:43:46.835929', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0hM9VEJyt4NHND840BB2PAXjFUrr1hPb5VcsjvHz7QWnK7eJEa7OV3IpOxovMjNchmTIL1tOVIUSMCCVAT7wk='} 2023-10-14T18:49:03.729 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T18:49:03.741 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T18:49:03.741 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T18:49:03.742 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T18:49:03.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4eb9536af0>, signals=[15]) 2023-10-14T18:49:03.815 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T18:49:03.826 INFO:teuthology.task.internal:Opening connections... 2023-10-14T18:49:03.826 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T18:49:03.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:49:03.896 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T18:49:03.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:49:03.962 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T18:49:03.971 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-10-14T18:49:03.989 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-10-14T18:49:03.989 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-10-14T18:49:04.046 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T18:49:04.047 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T18:49:04.047 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-10-14T18:49:04.047 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-10-14T18:49:04.047 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.4" 2023-10-14T18:49:04.048 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-10-14T18:49:04.048 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T18:49:04.049 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-10-14T18:49:04.049 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T18:49:04.049 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T18:49:04.049 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T18:49:04.050 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T18:49:04.050 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T18:49:04.050 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T18:49:04.050 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T18:49:04.050 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T18:49:04.051 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T18:49:04.051 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-10-14T18:49:04.084 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-10-14T18:49:04.101 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-10-14T18:49:04.102 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-14T18:49:04.158 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T18:49:04.159 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T18:49:04.159 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-10-14T18:49:04.159 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-10-14T18:49:04.159 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.4" 2023-10-14T18:49:04.159 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-14T18:49:04.160 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T18:49:04.160 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-14T18:49:04.160 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T18:49:04.160 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T18:49:04.160 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T18:49:04.161 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T18:49:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T18:49:04.161 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T18:49:04.161 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T18:49:04.161 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T18:49:04.162 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T18:49:04.162 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-14T18:49:04.193 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T18:49:04.205 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T18:49:04.218 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T18:49:04.219 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2023-10-14T18:49:04.221 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2023-10-14T18:49:04.237 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T18:49:04.247 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T18:49:04.248 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2023-10-14T18:49:04.278 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2023-10-14T18:49:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T18:49:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T18:49:04.295 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T18:49:04.353 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T18:49:04.369 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-14T18:49:04.370 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-14T18:49:04.370 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-14T18:49:04.371 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T18:49:04.372 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T18:49:04.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:49:04.388 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-10-14T18:49:04.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:49:04.390 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-10-14T18:49:04.444 INFO:teuthology.orchestra.run.smithi148.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:49:04.444 INFO:teuthology.task.kernel:Running kernel on smithi148: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:49:04.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2023-10-14T18:49:04.447 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:49:04.447 INFO:teuthology.task.kernel:Running kernel on smithi007: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:49:04.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2023-10-14T18:49:05.906 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-14T18:49:05.907 INFO:teuthology.orchestra.run.smithi148.stdout:Unable to read consumer identity 2023-10-14T18:49:05.913 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-10-14T18:49:05.914 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-10-14T18:49:07.274 INFO:teuthology.orchestra.run.smithi148.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-14T18:49:07.333 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-14T18:49:08.864 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-14T18:49:09.638 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 16 MB 00:02 2023-10-14T18:49:12.520 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-14T18:49:12.936 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-14T18:49:13.263 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T18:49:13.264 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T18:49:13.264 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T18:49:13.429 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-10-14T18:49:13.430 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-10-14T18:49:13.430 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-10-14T18:49:13.538 DEBUG:teuthology.orchestra.run.smithi007:> echo no | sudo yum reinstall kernel || true 2023-10-14T18:49:13.685 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T18:49:13.685 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T18:49:13.685 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T18:49:13.835 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-10-14T18:49:13.836 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2023-10-14T18:49:13.836 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-10-14T18:49:13.906 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-10-14T18:49:13.906 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-10-14T18:49:13.959 DEBUG:teuthology.orchestra.run.smithi148:> echo no | sudo yum reinstall kernel || true 2023-10-14T18:49:14.219 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 06:49:12 PM UTC. 2023-10-14T18:49:14.304 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-14T18:49:14.304 INFO:teuthology.orchestra.run.smithi148.stdout:Unable to read consumer identity 2023-10-14T18:49:14.382 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:49:14.382 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:14.382 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:Error: No packages marked for reinstall. 2023-10-14T18:49:14.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum reinstall -y kernel || true 2023-10-14T18:49:14.596 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 06:49:12 PM UTC. 2023-10-14T18:49:14.764 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:49:14.764 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:14.764 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:14.786 INFO:teuthology.orchestra.run.smithi148.stderr:Error: No packages marked for reinstall. 2023-10-14T18:49:14.823 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-10-14T18:49:14.823 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-10-14T18:49:14.835 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum reinstall -y kernel || true 2023-10-14T18:49:15.129 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:03 ago on Sat 14 Oct 2023 06:49:12 PM UTC. 2023-10-14T18:49:15.180 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-14T18:49:15.180 INFO:teuthology.orchestra.run.smithi148.stdout:Unable to read consumer identity 2023-10-14T18:49:15.256 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:49:15.256 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:15.257 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:15.270 INFO:teuthology.orchestra.run.smithi007.stderr:Error: No packages marked for reinstall. 2023-10-14T18:49:15.323 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:49:15.454 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.454 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.455 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.455 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T18:49:15.455 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T18:49:15.455 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-14T18:49:15.455 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T18:49:15.456 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:49:15.464 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:03 ago on Sat 14 Oct 2023 06:49:12 PM UTC. 2023-10-14T18:49:15.586 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.587 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2023-10-14T18:49:15.615 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2023-10-14T18:49:15.615 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2023-10-14T18:49:15.615 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.02 2023-10-14T18:49:15.616 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 99.el8_4.1 2023-10-14T18:49:15.616 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2023-10-14T18:49:15.616 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T18:49:15.616 INFO:teuthology.orchestra.run.smithi007.stdout:Group : System Environment/Base 2023-10-14T18:49:15.616 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 9264631 2023-10-14T18:49:15.617 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2023-10-14T18:49:15.617 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T18:49:15.617 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T18:49:15.617 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T18:49:15.617 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T18:49:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:Relocations : (not relocatable) 2023-10-14T18:49:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : Red Hat, Inc. 2023-10-14T18:49:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : Red Hat, Inc. 2023-10-14T18:49:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T18:49:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2023-10-14T18:49:15.619 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2023-10-14T18:49:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T18:49:15.619 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T18:49:15.619 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T18:49:15.619 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T18:49:15.620 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2023-10-14T18:49:15.620 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T18:49:15.620 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T18:49:15.621 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:49:15.621 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:15.622 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:49:15.622 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T18:49:15.622 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.623 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T18:49:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:Error: No packages marked for reinstall. 2023-10-14T18:49:15.682 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:49:15.806 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.807 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.807 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.807 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T18:49:15.807 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T18:49:15.808 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-14T18:49:15.808 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T18:49:15.808 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:49:15.932 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.933 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2023-10-14T18:49:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2023-10-14T18:49:15.961 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2023-10-14T18:49:15.961 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.02 2023-10-14T18:49:15.961 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 99.el8_4.1 2023-10-14T18:49:15.961 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2023-10-14T18:49:15.962 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T18:49:15.962 INFO:teuthology.orchestra.run.smithi148.stdout:Group : System Environment/Base 2023-10-14T18:49:15.962 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 9264631 2023-10-14T18:49:15.963 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2023-10-14T18:49:15.963 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T18:49:15.964 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T18:49:15.964 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T18:49:15.964 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T18:49:15.964 INFO:teuthology.orchestra.run.smithi148.stdout:Relocations : (not relocatable) 2023-10-14T18:49:15.965 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : Red Hat, Inc. 2023-10-14T18:49:15.965 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : Red Hat, Inc. 2023-10-14T18:49:15.965 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T18:49:15.965 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2023-10-14T18:49:15.966 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2023-10-14T18:49:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T18:49:15.966 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T18:49:15.967 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T18:49:15.967 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T18:49:15.967 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2023-10-14T18:49:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T18:49:15.968 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T18:49:15.969 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T18:49:15.969 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:15.969 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T18:49:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2023-10-14T18:49:17.421 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-10-14T18:49:19.062 INFO:teuthology.orchestra.run.smithi007.stderr:done 2023-10-14T18:49:19.063 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-10-14T18:49:19.078 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.FOymcVnFod 2023-10-14T18:49:19.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FOymcVnFod 2023-10-14T18:49:19.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.FOymcVnFod 2023-10-14T18:49:19.307 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.FOymcVnFod is 6KB 2023-10-14T18:49:19.356 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.FOymcVnFod 2023-10-14T18:49:19.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T18:49:19.433 INFO:teuthology.orchestra.run.smithi007.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T18:49:19.434 INFO:teuthology.orchestra.run.smithi007.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T18:49:19.434 INFO:teuthology.orchestra.run.smithi007.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T18:49:19.434 INFO:teuthology.orchestra.run.smithi007.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T18:49:19.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:19.601 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2023-10-14T18:49:19.640 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-10-14T18:49:19.641 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-10-14T18:49:19.656 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.iM4siXhpqI 2023-10-14T18:49:19.656 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iM4siXhpqI 2023-10-14T18:49:19.729 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.iM4siXhpqI 2023-10-14T18:49:19.896 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.iM4siXhpqI is 6KB 2023-10-14T18:49:19.944 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.iM4siXhpqI 2023-10-14T18:49:19.958 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T18:49:20.043 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T18:49:20.043 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T18:49:20.044 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T18:49:20.044 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T18:49:20.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:49:20.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2023-10-14T18:49:49.628 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-14T18:49:49.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-14T18:49:49.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:49:50.167 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-14T18:49:50.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:49:50.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:50:08.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-14T18:50:08.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-14T18:50:17.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:50:17.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:50:17.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:50:20.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-14T18:50:32.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:50:32.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:50:51.130 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-14T18:51:06.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:51:06.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:51:06.523 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-14T18:51:06.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:51:06.819 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T18:51:06.820 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-10-14T18:51:06.834 INFO:teuthology.orchestra.run.smithi148.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T18:51:06.834 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:51:06.835 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T18:51:06.835 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T18:51:07.836 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:17.134 DEBUG:teuthology.orchestra.remote:timed out 2023-10-14T18:51:29.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-14T18:51:29.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:51:29.462 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-10-14T18:51:29.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-14T18:51:29.741 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T18:51:29.741 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-10-14T18:51:29.796 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T18:51:29.797 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:51:29.797 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T18:51:29.797 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T18:51:30.799 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:30.799 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T18:51:30.806 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T18:51:30.807 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T18:51:30.809 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T18:51:30.828 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T18:51:30.869 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T18:51:30.879 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T18:51:30.879 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T18:51:30.881 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T18:51:30.919 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T18:51:30.926 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T18:51:30.927 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T18:51:30.944 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T18:51:31.040 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:51:31.061 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:51:31.064 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:51:31.085 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:51:31.086 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T18:51:31.093 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T18:51:31.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T18:51:31.097 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T18:51:31.123 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T18:51:31.134 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T18:51:31.134 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T18:51:31.166 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T18:51:31.181 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:51:31.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:51:31.308 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:51:31.390 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:51:31.433 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T18:51:31.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T18:51:31.498 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:51:31.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:51:31.582 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:51:31.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:51:31.702 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T18:51:31.703 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T18:51:31.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2023-10-14T18:51:31.770 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2023-10-14T18:51:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T18:51:31.872 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T18:51:32.260 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T18:51:32.268 INFO:teuthology.task.internal:Starting timer... 2023-10-14T18:51:32.268 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T18:51:32.282 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T18:51:32.295 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T18:51:32.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2023-10-14T18:51:32.377 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: [ OK ] 2023-10-14T18:51:32.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2023-10-14T18:51:32.437 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: [ OK ] 2023-10-14T18:51:32.438 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T18:51:32.439 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2023-10-14T18:51:32.463 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2023-10-14T18:51:32.464 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2023-10-14T18:51:32.488 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2023-10-14T18:51:32.488 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2023-10-14T18:51:32.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T18:51:32.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:51:32.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T18:51:32.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:51:32.557 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T18:51:32.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2023-10-14T18:51:32.602 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2023-10-14T18:51:32.628 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T18:51:32.638 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T18:51:32.639 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T18:51:32.657 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T18:51:32.658 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T18:59:58.822 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2023-10-14T18:59:58.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-14T18:59:58.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:59:58.895 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-10-14T18:59:58.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-10-14T18:59:58.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:59:58.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:59:58.988 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-14T18:59:59.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-14T18:59:59.054 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T18:59:59.064 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T18:59:59.065 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T18:59:59.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T18:59:59.069 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T18:59:59.069 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T18:59:59.098 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T18:59:59.114 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T18:59:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T18:59:59.137 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T18:59:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2023-10-14T18:59:59.160 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2023-10-14T18:59:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2023-10-14T18:59:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T18:59:59.180 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2023-10-14T18:59:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T18:59:59.195 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T18:59:59.208 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T18:59:59.271 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-10-14T18:59:59.274 INFO:teuthology.orchestra.run.smithi007.stdout:210 Number of sources = 4 2023-10-14T18:59:59.274 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T18:59:59.275 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-10-14T18:59:59.275 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.275 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.275 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.275 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.283 INFO:teuthology.orchestra.run.smithi148.stderr:bash: ntpq: command not found 2023-10-14T18:59:59.286 INFO:teuthology.orchestra.run.smithi148.stdout:210 Number of sources = 4 2023-10-14T18:59:59.286 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T18:59:59.286 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-10-14T18:59:59.287 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.287 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.287 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.287 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:59:59.288 INFO:teuthology.run_tasks:Running task install... 2023-10-14T18:59:59.297 DEBUG:teuthology.task.install:project ceph 2023-10-14T18:59:59.297 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}} 2023-10-14T18:59:59.298 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'} 2023-10-14T18:59:59.298 INFO:teuthology.task.install:Using flavor: default 2023-10-14T18:59:59.303 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T18:59:59.304 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T18:59:59.304 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T18:59:59.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:59:59.307 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T18:59:59.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:59:59.460 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T18:59:59.461 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T18:59:59.536 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T18:59:59.536 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T18:59:59.671 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T18:59:59.672 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T18:59:59.672 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T18:59:59.699 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-14T18:59:59.699 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T18:59:59.730 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T18:59:59.731 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T18:59:59.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T18:59:59.758 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-14T18:59:59.759 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T18:59:59.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T18:59:59.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T18:59:59.838 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T18:59:59.902 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2023-10-14T18:59:59.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2023-10-14T18:59:59.905 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T18:59:59.969 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2023-10-14T18:59:59.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2023-10-14T19:00:00.295 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-14T19:00:00.381 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-10-14T19:00:00.596 INFO:teuthology.orchestra.run.smithi148.stdout:44 files removed 2023-10-14T19:00:00.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-14T19:00:00.772 INFO:teuthology.orchestra.run.smithi007.stdout:44 files removed 2023-10-14T19:00:00.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-14T19:00:00.999 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-14T19:00:01.194 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-10-14T19:00:01.783 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 217 kB/s | 78 kB 00:00 2023-10-14T19:00:02.072 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 272 kB/s | 78 kB 00:00 2023-10-14T19:00:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 37 kB/s | 9.1 kB 00:00 2023-10-14T19:00:02.361 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-10-14T19:00:02.378 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 35 kB/s | 9.1 kB 00:00 2023-10-14T19:00:02.497 INFO:teuthology.orchestra.run.smithi148.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2023-10-14T19:00:02.672 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-10-14T19:00:02.800 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 36 kB/s | 3.5 kB 00:00 2023-10-14T19:00:04.383 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-14T19:00:07.843 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-14T19:00:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 105 MB/s | 38 MB 00:00 2023-10-14T19:00:14.212 INFO:teuthology.orchestra.run.smithi007.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 MB/s | 33 MB 00:00 2023-10-14T19:00:20.968 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 882 kB/s | 16 MB 00:18 2023-10-14T19:00:22.906 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T19:00:22.907 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T19:00:22.918 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-14T19:00:22.919 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-14T19:00:22.920 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-14T19:00:22.921 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T19:00:22.922 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T19:00:22.925 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-14T19:00:22.926 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-14T19:00:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-10-14T19:00:23.455 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================================== 2023-10-14T19:00:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-10-14T19:00:23.456 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================================== 2023-10-14T19:00:23.457 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-10-14T19:00:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T19:00:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T19:00:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T19:00:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T19:00:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T19:00:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T19:00:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T19:00:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T19:00:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T19:00:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T19:00:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T19:00:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T19:00:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T19:00:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T19:00:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 255 k 2023-10-14T19:00:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 18 k 2023-10-14T19:00:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-14T19:00:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T19:00:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T19:00:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T19:00:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T19:00:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T19:00:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T19:00:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-14T19:00:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T19:00:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T19:00:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T19:00:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T19:00:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T19:00:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T19:00:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T19:00:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T19:00:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-14T19:00:23.465 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2023-10-14T19:00:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T19:00:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T19:00:23.466 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-10-14T19:00:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T19:00:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T19:00:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T19:00:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T19:00:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T19:00:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T19:00:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T19:00:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T19:00:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T19:00:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T19:00:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T19:00:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T19:00:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T19:00:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T19:00:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T19:00:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-14T19:00:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T19:00:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T19:00:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T19:00:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T19:00:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T19:00:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T19:00:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T19:00:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T19:00:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-14T19:00:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T19:00:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T19:00:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T19:00:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T19:00:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T19:00:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T19:00:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T19:00:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T19:00:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T19:00:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T19:00:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T19:00:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T19:00:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T19:00:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T19:00:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T19:00:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T19:00:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T19:00:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T19:00:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T19:00:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T19:00:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T19:00:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T19:00:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T19:00:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T19:00:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T19:00:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T19:00:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T19:00:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T19:00:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T19:00:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T19:00:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T19:00:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T19:00:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T19:00:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T19:00:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T19:00:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T19:00:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T19:00:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T19:00:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T19:00:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T19:00:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T19:00:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T19:00:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T19:00:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T19:00:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T19:00:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T19:00:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T19:00:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T19:00:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T19:00:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T19:00:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T19:00:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T19:00:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T19:00:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T19:00:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T19:00:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T19:00:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T19:00:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T19:00:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T19:00:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T19:00:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:00:23.488 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-10-14T19:00:23.488 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================================== 2023-10-14T19:00:23.489 INFO:teuthology.orchestra.run.smithi007.stdout:Install 118 Packages 2023-10-14T19:00:23.489 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 2 Packages 2023-10-14T19:00:23.489 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:00:23.491 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 202 M 2023-10-14T19:00:23.491 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-10-14T19:00:23.712 INFO:teuthology.orchestra.run.smithi007.stdout:(1/120): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64. 70 kB/s | 6.4 kB 00:00 2023-10-14T19:00:23.880 INFO:teuthology.orchestra.run.smithi007.stdout:(2/120): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x8 5.1 MB/s | 876 kB 00:00 2023-10-14T19:00:23.902 INFO:teuthology.orchestra.run.smithi007.stdout:(3/120): ceph-immutable-object-cache-17.2.6-141 7.1 MB/s | 161 kB 00:00 2023-10-14T19:00:24.083 INFO:teuthology.orchestra.run.smithi007.stdout:(4/120): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86 13 MB/s | 2.3 MB 00:00 2023-10-14T19:00:24.197 INFO:teuthology.orchestra.run.smithi007.stdout:(5/120): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86 14 MB/s | 1.6 MB 00:00 2023-10-14T19:00:24.295 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-14T19:00:24.480 INFO:teuthology.orchestra.run.smithi007.stdout:(6/120): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86 14 MB/s | 3.9 MB 00:00 2023-10-14T19:00:24.602 INFO:teuthology.orchestra.run.smithi007.stdout:(7/120): ceph-base-17.2.6-1415.g9d6d32bb.el8.x8 5.3 MB/s | 5.2 MB 00:00 2023-10-14T19:00:24.687 INFO:teuthology.orchestra.run.smithi148.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 38 MB 00:00 2023-10-14T19:00:25.726 INFO:teuthology.orchestra.run.smithi007.stdout:(8/120): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x86 13 MB/s | 17 MB 00:01 2023-10-14T19:00:25.770 INFO:teuthology.orchestra.run.smithi007.stdout:(9/120): ceph-selinux-17.2.6-1415.g9d6d32bb.el8 557 kB/s | 24 kB 00:00 2023-10-14T19:00:26.584 INFO:teuthology.orchestra.run.smithi007.stdout:(10/120): ceph-radosgw-17.2.6-1415.g9d6d32bb.el 8.5 MB/s | 17 MB 00:01 2023-10-14T19:00:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:(11/120): cephfs-mirror-17.2.6-1415.g9d6d32bb.e 3.1 MB/s | 255 kB 00:00 2023-10-14T19:00:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:(12/120): libcephfs-devel-17.2.6-1415.g9d6d32bb 458 kB/s | 25 kB 00:00 2023-10-14T19:00:26.801 INFO:teuthology.orchestra.run.smithi007.stdout:(13/120): libcephfs2-17.2.6-1415.g9d6d32bb.el8. 9.5 MB/s | 797 kB 00:00 2023-10-14T19:00:26.866 INFO:teuthology.orchestra.run.smithi007.stdout:(14/120): libcephsqlite-17.2.6-1415.g9d6d32bb.e 2.6 MB/s | 174 kB 00:00 2023-10-14T19:00:26.927 INFO:teuthology.orchestra.run.smithi007.stdout:(15/120): librados-devel-17.2.6-1415.g9d6d32bb. 2.1 MB/s | 130 kB 00:00 2023-10-14T19:00:26.998 INFO:teuthology.orchestra.run.smithi007.stdout:(16/120): libradosstriper1-17.2.6-1415.g9d6d32b 7.0 MB/s | 506 kB 00:00 2023-10-14T19:00:27.173 INFO:teuthology.orchestra.run.smithi007.stdout:(17/120): ceph-common-17.2.6-1415.g9d6d32bb.el8 6.6 MB/s | 23 MB 00:03 2023-10-14T19:00:27.242 INFO:teuthology.orchestra.run.smithi007.stdout:(18/120): python3-ceph-argparse-17.2.6-1415.g9d 652 kB/s | 45 kB 00:00 2023-10-14T19:00:27.301 INFO:teuthology.orchestra.run.smithi007.stdout:(19/120): python3-ceph-common-17.2.6-1415.g9d6d 1.9 MB/s | 115 kB 00:00 2023-10-14T19:00:27.367 INFO:teuthology.orchestra.run.smithi007.stdout:(20/120): python3-cephfs-17.2.6-1415.g9d6d32bb. 2.8 MB/s | 190 kB 00:00 2023-10-14T19:00:27.442 INFO:teuthology.orchestra.run.smithi007.stdout:(21/120): python3-rados-17.2.6-1415.g9d6d32bb.e 4.9 MB/s | 370 kB 00:00 2023-10-14T19:00:27.498 INFO:teuthology.orchestra.run.smithi007.stdout:(22/120): librgw2-17.2.6-1415.g9d6d32bb.el8.x86 11 MB/s | 5.6 MB 00:00 2023-10-14T19:00:27.506 INFO:teuthology.orchestra.run.smithi007.stdout:(23/120): python3-rbd-17.2.6-1415.g9d6d32bb.el8 5.4 MB/s | 359 kB 00:00 2023-10-14T19:00:27.543 INFO:teuthology.orchestra.run.smithi007.stdout:(24/120): python3-rgw-17.2.6-1415.g9d6d32bb.el8 2.4 MB/s | 107 kB 00:00 2023-10-14T19:00:27.554 INFO:teuthology.orchestra.run.smithi007.stdout:(25/120): rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x8 1.9 MB/s | 90 kB 00:00 2023-10-14T19:00:27.629 INFO:teuthology.orchestra.run.smithi007.stdout:(26/120): rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86 2.3 MB/s | 174 kB 00:00 2023-10-14T19:00:27.697 INFO:teuthology.orchestra.run.smithi007.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1415.g 338 kB/s | 23 kB 00:00 2023-10-14T19:00:27.766 INFO:teuthology.orchestra.run.smithi007.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1415.g9d6d32b 1.7 MB/s | 121 kB 00:00 2023-10-14T19:00:27.837 INFO:teuthology.orchestra.run.smithi007.stdout:(29/120): rbd-mirror-17.2.6-1415.g9d6d32bb.el8. 12 MB/s | 3.5 MB 00:00 2023-10-14T19:00:28.022 INFO:teuthology.orchestra.run.smithi007.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1415.g9d6d3 6.6 MB/s | 1.7 MB 00:00 2023-10-14T19:00:28.096 INFO:teuthology.orchestra.run.smithi007.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1415.g9d 3.2 MB/s | 238 kB 00:00 2023-10-14T19:00:28.158 INFO:teuthology.orchestra.run.smithi007.stdout:(32/120): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.e 755 kB/s | 47 kB 00:00 2023-10-14T19:00:28.222 INFO:teuthology.orchestra.run.smithi007.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1415.g9 228 kB/s | 14 kB 00:00 2023-10-14T19:00:28.296 INFO:teuthology.orchestra.run.smithi007.stdout:(34/120): ceph-volume-17.2.6-1415.g9d6d32bb.el8 3.5 MB/s | 267 kB 00:00 2023-10-14T19:00:28.363 INFO:teuthology.orchestra.run.smithi007.stdout:(35/120): cephadm-17.2.6-1415.g9d6d32bb.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-14T19:00:28.430 INFO:teuthology.orchestra.run.smithi007.stdout:(36/120): cephfs-top-17.2.6-1415.g9d6d32bb.el8. 271 kB/s | 18 kB 00:00 2023-10-14T19:00:28.466 INFO:teuthology.orchestra.run.smithi007.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 12 MB/s | 7.4 MB 00:00 2023-10-14T19:00:28.716 INFO:teuthology.orchestra.run.smithi007.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 236 kB/s | 59 kB 00:00 2023-10-14T19:00:28.798 INFO:teuthology.orchestra.run.smithi007.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 923 kB/s | 75 kB 00:00 2023-10-14T19:00:28.800 INFO:teuthology.orchestra.run.smithi007.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 827 kB/s | 306 kB 00:00 2023-10-14T19:00:28.854 INFO:teuthology.orchestra.run.smithi007.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 818 kB/s | 44 kB 00:00 2023-10-14T19:00:28.922 INFO:teuthology.orchestra.run.smithi007.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-10-14T19:00:29.363 INFO:teuthology.orchestra.run.smithi007.stdout:(43/120): ceph-test-17.2.6-1415.g9d6d32bb.el8.x 14 MB/s | 52 MB 00:03 2023-10-14T19:00:29.364 INFO:teuthology.orchestra.run.smithi007.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 75 kB/s | 33 kB 00:00 2023-10-14T19:00:29.366 INFO:teuthology.orchestra.run.smithi007.stdout:(45/120): python3-asyncssh-2.7.0-2.el8.noarch.r 837 kB/s | 476 kB 00:00 2023-10-14T19:00:29.431 INFO:teuthology.orchestra.run.smithi007.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-10-14T19:00:29.441 INFO:teuthology.orchestra.run.smithi007.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-10-14T19:00:29.488 INFO:teuthology.orchestra.run.smithi007.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-14T19:00:29.490 INFO:teuthology.orchestra.run.smithi007.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 229 kB/s | 11 kB 00:00 2023-10-14T19:00:29.538 INFO:teuthology.orchestra.run.smithi007.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 352 kB/s | 18 kB 00:00 2023-10-14T19:00:29.563 INFO:teuthology.orchestra.run.smithi007.stdout:(51/120): python3-certifi-2018.10.15-7.el8.noar 82 kB/s | 16 kB 00:00 2023-10-14T19:00:29.592 INFO:teuthology.orchestra.run.smithi007.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 909 kB/s | 49 kB 00:00 2023-10-14T19:00:29.619 INFO:teuthology.orchestra.run.smithi007.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 9.1 MB/s | 1.2 MB 00:00 2023-10-14T19:00:29.647 INFO:teuthology.orchestra.run.smithi007.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.1 MB/s | 60 kB 00:00 2023-10-14T19:00:29.674 INFO:teuthology.orchestra.run.smithi007.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 5.1 MB/s | 283 kB 00:00 2023-10-14T19:00:29.678 INFO:teuthology.orchestra.run.smithi007.stdout:(56/120): python3-more-itertools-7.2.0-3.el8.no 508 kB/s | 59 kB 00:00 2023-10-14T19:00:29.696 INFO:teuthology.orchestra.run.smithi007.stdout:(57/120): python3-portend-2.6-1.el8.noarch.rpm 320 kB/s | 16 kB 00:00 2023-10-14T19:00:29.723 INFO:teuthology.orchestra.run.smithi007.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 691 kB/s | 34 kB 00:00 2023-10-14T19:00:29.751 INFO:teuthology.orchestra.run.smithi007.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-14T19:00:29.772 INFO:teuthology.orchestra.run.smithi007.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 386 kB/s | 19 kB 00:00 2023-10-14T19:00:29.801 INFO:teuthology.orchestra.run.smithi007.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 482 kB/s | 24 kB 00:00 2023-10-14T19:00:29.814 INFO:teuthology.orchestra.run.smithi007.stdout:(62/120): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-10-14T19:00:29.821 INFO:teuthology.orchestra.run.smithi007.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 600 kB/s | 29 kB 00:00 2023-10-14T19:00:29.852 INFO:teuthology.orchestra.run.smithi007.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 541 kB/s | 27 kB 00:00 2023-10-14T19:00:29.875 INFO:teuthology.orchestra.run.smithi007.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.5 MB/s | 251 kB 00:00 2023-10-14T19:00:29.905 INFO:teuthology.orchestra.run.smithi007.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 2.8 MB/s | 255 kB 00:00 2023-10-14T19:00:29.906 INFO:teuthology.orchestra.run.smithi007.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.1 MB/s | 61 kB 00:00 2023-10-14T19:00:29.926 INFO:teuthology.orchestra.run.smithi007.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-14T19:00:29.956 INFO:teuthology.orchestra.run.smithi007.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 454 kB/s | 23 kB 00:00 2023-10-14T19:00:29.957 INFO:teuthology.orchestra.run.smithi007.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.2 MB/s | 70 kB 00:00 2023-10-14T19:00:29.991 INFO:teuthology.orchestra.run.smithi007.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 543 kB/s | 19 kB 00:00 2023-10-14T19:00:30.000 INFO:teuthology.orchestra.run.smithi007.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-14T19:00:30.010 INFO:teuthology.orchestra.run.smithi007.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.9 MB/s | 155 kB 00:00 2023-10-14T19:00:30.018 INFO:teuthology.orchestra.run.smithi007.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 12 MB/s | 220 kB 00:00 2023-10-14T19:00:30.030 INFO:teuthology.orchestra.run.smithi007.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.4 MB/s | 48 kB 00:00 2023-10-14T19:00:30.045 INFO:teuthology.orchestra.run.smithi007.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.5 MB/s | 229 kB 00:00 2023-10-14T19:00:30.046 INFO:teuthology.orchestra.run.smithi007.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.7 MB/s | 43 kB 00:00 2023-10-14T19:00:30.065 INFO:teuthology.orchestra.run.smithi007.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 972 kB/s | 18 kB 00:00 2023-10-14T19:00:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2023-10-14T19:00:30.099 INFO:teuthology.orchestra.run.smithi007.stdout:(80/120): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2023-10-14T19:00:30.108 INFO:teuthology.orchestra.run.smithi007.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 37 MB/s | 2.3 MB 00:00 2023-10-14T19:00:30.118 INFO:teuthology.orchestra.run.smithi007.stdout:(82/120): fuse-2.9.7-12.el8.x86_64.rpm 3.1 MB/s | 83 kB 00:00 2023-10-14T19:00:30.127 INFO:teuthology.orchestra.run.smithi007.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.3 MB/s | 169 kB 00:00 2023-10-14T19:00:30.135 INFO:teuthology.orchestra.run.smithi007.stdout:(84/120): elfutils-libelf-devel-0.182-3.el8.x86 1.6 MB/s | 59 kB 00:00 2023-10-14T19:00:30.137 INFO:teuthology.orchestra.run.smithi007.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.1 MB/s | 38 kB 00:00 2023-10-14T19:00:30.147 INFO:teuthology.orchestra.run.smithi007.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.0 MB/s | 86 kB 00:00 2023-10-14T19:00:30.150 INFO:teuthology.orchestra.run.smithi007.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.4 MB/s | 47 kB 00:00 2023-10-14T19:00:30.151 INFO:teuthology.orchestra.run.smithi007.stdout:(88/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.5 MB/s | 58 kB 00:00 2023-10-14T19:00:30.166 INFO:teuthology.orchestra.run.smithi007.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.7 MB/s | 70 kB 00:00 2023-10-14T19:00:30.173 INFO:teuthology.orchestra.run.smithi007.stdout:(90/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 21 MB/s | 559 kB 00:00 2023-10-14T19:00:30.178 INFO:teuthology.orchestra.run.smithi007.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2023-10-14T19:00:30.182 INFO:teuthology.orchestra.run.smithi007.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2023-10-14T19:00:30.192 INFO:teuthology.orchestra.run.smithi007.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.3 MB/s | 97 kB 00:00 2023-10-14T19:00:30.200 INFO:teuthology.orchestra.run.smithi007.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-10-14T19:00:30.208 INFO:teuthology.orchestra.run.smithi007.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2023-10-14T19:00:30.216 INFO:teuthology.orchestra.run.smithi007.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 9.4 MB/s | 161 kB 00:00 2023-10-14T19:00:30.227 INFO:teuthology.orchestra.run.smithi007.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-14T19:00:30.237 INFO:teuthology.orchestra.run.smithi007.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-10-14T19:00:30.250 INFO:teuthology.orchestra.run.smithi007.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-14T19:00:30.275 INFO:teuthology.orchestra.run.smithi007.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 27 MB/s | 688 kB 00:00 2023-10-14T19:00:30.277 INFO:teuthology.orchestra.run.smithi148.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 119 MB/s | 33 MB 00:00 2023-10-14T19:00:30.293 INFO:teuthology.orchestra.run.smithi007.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-10-14T19:00:30.309 INFO:teuthology.orchestra.run.smithi007.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2023-10-14T19:00:30.327 INFO:teuthology.orchestra.run.smithi007.stdout:(103/120): python3-babel-2.5.1-5.el8.noarch.rpm 48 MB/s | 4.8 MB 00:00 2023-10-14T19:00:30.329 INFO:teuthology.orchestra.run.smithi007.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.1 MB/s | 126 kB 00:00 2023-10-14T19:00:30.345 INFO:teuthology.orchestra.run.smithi007.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-14T19:00:30.368 INFO:teuthology.orchestra.run.smithi007.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-10-14T19:00:30.386 INFO:teuthology.orchestra.run.smithi007.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-10-14T19:00:30.407 INFO:teuthology.orchestra.run.smithi007.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 47 MB/s | 3.7 MB 00:00 2023-10-14T19:00:30.410 INFO:teuthology.orchestra.run.smithi007.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.5 MB/s | 157 kB 00:00 2023-10-14T19:00:30.426 INFO:teuthology.orchestra.run.smithi007.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.0 MB/s | 110 kB 00:00 2023-10-14T19:00:30.523 INFO:teuthology.orchestra.run.smithi007.stdout:(111/120): python3-scipy-1.0.0-20.module+el8.1. 42 MB/s | 15 MB 00:00 2023-10-14T19:00:30.523 INFO:teuthology.orchestra.run.smithi007.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 199 kB/s | 20 kB 00:00 2023-10-14T19:00:30.527 INFO:teuthology.orchestra.run.smithi007.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 2.9 MB/s | 353 kB 00:00 2023-10-14T19:00:30.541 INFO:teuthology.orchestra.run.smithi007.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.1 MB/s | 54 kB 00:00 2023-10-14T19:00:30.546 INFO:teuthology.orchestra.run.smithi007.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-14T19:00:30.576 INFO:teuthology.orchestra.run.smithi007.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 24 MB/s | 713 kB 00:00 2023-10-14T19:00:30.624 INFO:teuthology.orchestra.run.smithi007.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 49 MB/s | 4.7 MB 00:00 2023-10-14T19:00:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 45 MB/s | 4.6 MB 00:00 2023-10-14T19:00:30.822 INFO:teuthology.orchestra.run.smithi007.stdout:(119/120): librados2-17.2.6-1415.g9d6d32bb.el8. 14 MB/s | 3.5 MB 00:00 2023-10-14T19:00:31.019 INFO:teuthology.orchestra.run.smithi007.stdout:(120/120): librbd1-17.2.6-1415.g9d6d32bb.el8.x8 9.1 MB/s | 3.6 MB 00:00 2023-10-14T19:00:31.024 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-10-14T19:00:31.025 INFO:teuthology.orchestra.run.smithi007.stdout:Total 27 MB/s | 202 MB 00:07 2023-10-14T19:00:31.077 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-10-14T19:00:31.201 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-10-14T19:00:31.202 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-10-14T19:00:32.898 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-10-14T19:00:32.904 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-10-14T19:00:37.698 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-10-14T19:00:37.963 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-14T19:00:38.179 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-14T19:00:38.242 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T19:00:38.243 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T19:00:38.254 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-14T19:00:38.255 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-14T19:00:38.256 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-14T19:00:38.257 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T19:00:38.258 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T19:00:38.261 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-14T19:00:38.262 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-14T19:00:38.319 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-14T19:00:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-14T19:00:38.746 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-10-14T19:00:38.757 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================================== 2023-10-14T19:00:38.757 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2023-10-14T19:00:38.757 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================================== 2023-10-14T19:00:38.758 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2023-10-14T19:00:38.758 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T19:00:38.758 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T19:00:38.758 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T19:00:38.759 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T19:00:38.759 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T19:00:38.759 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T19:00:38.759 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T19:00:38.759 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T19:00:38.759 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T19:00:38.760 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T19:00:38.760 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T19:00:38.760 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T19:00:38.760 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T19:00:38.760 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T19:00:38.761 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 255 k 2023-10-14T19:00:38.761 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 18 k 2023-10-14T19:00:38.761 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-14T19:00:38.761 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T19:00:38.762 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T19:00:38.762 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T19:00:38.762 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T19:00:38.762 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T19:00:38.762 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T19:00:38.763 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-14T19:00:38.763 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T19:00:38.763 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T19:00:38.763 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T19:00:38.763 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T19:00:38.763 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T19:00:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T19:00:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T19:00:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T19:00:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-14T19:00:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2023-10-14T19:00:38.765 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T19:00:38.765 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T19:00:38.765 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2023-10-14T19:00:38.765 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T19:00:38.765 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T19:00:38.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T19:00:38.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T19:00:38.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T19:00:38.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T19:00:38.767 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T19:00:38.767 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T19:00:38.768 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T19:00:38.768 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T19:00:38.768 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T19:00:38.768 INFO:teuthology.orchestra.run.smithi148.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T19:00:38.769 INFO:teuthology.orchestra.run.smithi148.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T19:00:38.769 INFO:teuthology.orchestra.run.smithi148.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T19:00:38.769 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T19:00:38.769 INFO:teuthology.orchestra.run.smithi148.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-14T19:00:38.769 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T19:00:38.770 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T19:00:38.770 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T19:00:38.770 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T19:00:38.770 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T19:00:38.771 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T19:00:38.771 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T19:00:38.771 INFO:teuthology.orchestra.run.smithi148.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T19:00:38.771 INFO:teuthology.orchestra.run.smithi148.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-14T19:00:38.771 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T19:00:38.772 INFO:teuthology.orchestra.run.smithi148.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T19:00:38.772 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T19:00:38.772 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T19:00:38.772 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T19:00:38.773 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T19:00:38.773 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T19:00:38.773 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T19:00:38.773 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T19:00:38.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T19:00:38.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T19:00:38.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T19:00:38.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T19:00:38.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T19:00:38.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T19:00:38.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T19:00:38.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T19:00:38.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T19:00:38.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T19:00:38.776 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T19:00:38.776 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T19:00:38.776 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T19:00:38.776 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T19:00:38.776 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T19:00:38.777 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T19:00:38.777 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T19:00:38.777 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T19:00:38.777 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T19:00:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T19:00:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T19:00:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T19:00:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T19:00:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T19:00:38.779 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T19:00:38.779 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T19:00:38.779 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T19:00:38.779 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T19:00:38.779 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T19:00:38.780 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T19:00:38.780 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T19:00:38.780 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T19:00:38.780 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T19:00:38.781 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T19:00:38.781 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T19:00:38.781 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T19:00:38.781 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T19:00:38.782 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T19:00:38.782 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T19:00:38.782 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T19:00:38.782 INFO:teuthology.orchestra.run.smithi148.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T19:00:38.783 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T19:00:38.783 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T19:00:38.783 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T19:00:38.783 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T19:00:38.784 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T19:00:38.784 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T19:00:38.784 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T19:00:38.784 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T19:00:38.785 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T19:00:38.785 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T19:00:38.785 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:00:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2023-10-14T19:00:38.786 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================================== 2023-10-14T19:00:38.786 INFO:teuthology.orchestra.run.smithi148.stdout:Install 118 Packages 2023-10-14T19:00:38.786 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2023-10-14T19:00:38.786 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:00:38.787 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 202 M 2023-10-14T19:00:38.787 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2023-10-14T19:00:38.946 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-14T19:00:39.135 INFO:teuthology.orchestra.run.smithi148.stdout:(1/120): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2023-10-14T19:00:39.195 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T19:00:39.495 INFO:teuthology.orchestra.run.smithi148.stdout:(2/120): ceph-base-17.2.6-1415.g9d6d32bb.el8.x8 10 MB/s | 5.2 MB 00:00 2023-10-14T19:00:39.527 INFO:teuthology.orchestra.run.smithi148.stdout:(3/120): ceph-immutable-object-cache-17.2.6-141 5.0 MB/s | 161 kB 00:00 2023-10-14T19:00:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T19:00:39.726 INFO:teuthology.orchestra.run.smithi148.stdout:(4/120): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-14T19:00:39.812 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T19:00:39.854 INFO:teuthology.orchestra.run.smithi148.stdout:(5/120): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86 12 MB/s | 1.6 MB 00:00 2023-10-14T19:00:39.947 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T19:00:40.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T19:00:40.200 INFO:teuthology.orchestra.run.smithi148.stdout:(6/120): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86 11 MB/s | 3.9 MB 00:00 2023-10-14T19:00:40.240 INFO:teuthology.orchestra.run.smithi148.stdout:(7/120): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x8 793 kB/s | 876 kB 00:01 2023-10-14T19:00:40.257 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T19:00:40.450 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T19:00:40.729 INFO:teuthology.orchestra.run.smithi148.stdout:(8/120): ceph-common-17.2.6-1415.g9d6d32bb.el8. 13 MB/s | 23 MB 00:01 2023-10-14T19:00:40.770 INFO:teuthology.orchestra.run.smithi148.stdout:(9/120): ceph-selinux-17.2.6-1415.g9d6d32bb.el8 605 kB/s | 24 kB 00:00 2023-10-14T19:00:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-14T19:00:41.541 INFO:teuthology.orchestra.run.smithi148.stdout:(10/120): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x8 12 MB/s | 17 MB 00:01 2023-10-14T19:00:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:(11/120): cephfs-mirror-17.2.6-1415.g9d6d32bb.e 6.1 MB/s | 255 kB 00:00 2023-10-14T19:00:41.623 INFO:teuthology.orchestra.run.smithi148.stdout:(12/120): libcephfs-devel-17.2.6-1415.g9d6d32bb 619 kB/s | 25 kB 00:00 2023-10-14T19:00:41.691 INFO:teuthology.orchestra.run.smithi148.stdout:(13/120): libcephfs2-17.2.6-1415.g9d6d32bb.el8. 12 MB/s | 797 kB 00:00 2023-10-14T19:00:41.738 INFO:teuthology.orchestra.run.smithi148.stdout:(14/120): libcephsqlite-17.2.6-1415.g9d6d32bb.e 3.6 MB/s | 174 kB 00:00 2023-10-14T19:00:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-14T19:00:41.783 INFO:teuthology.orchestra.run.smithi148.stdout:(15/120): librados-devel-17.2.6-1415.g9d6d32bb. 2.8 MB/s | 130 kB 00:00 2023-10-14T19:00:41.842 INFO:teuthology.orchestra.run.smithi148.stdout:(16/120): libradosstriper1-17.2.6-1415.g9d6d32b 8.4 MB/s | 506 kB 00:00 2023-10-14T19:00:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T19:00:42.059 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T19:00:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-14T19:00:42.331 INFO:teuthology.orchestra.run.smithi148.stdout:(17/120): librgw2-17.2.6-1415.g9d6d32bb.el8.x86 11 MB/s | 5.6 MB 00:00 2023-10-14T19:00:42.376 INFO:teuthology.orchestra.run.smithi148.stdout:(18/120): python3-ceph-argparse-17.2.6-1415.g9d 1.0 MB/s | 45 kB 00:00 2023-10-14T19:00:42.423 INFO:teuthology.orchestra.run.smithi148.stdout:(19/120): python3-ceph-common-17.2.6-1415.g9d6d 2.4 MB/s | 115 kB 00:00 2023-10-14T19:00:42.469 INFO:teuthology.orchestra.run.smithi148.stdout:(20/120): python3-cephfs-17.2.6-1415.g9d6d32bb. 4.0 MB/s | 190 kB 00:00 2023-10-14T19:00:42.519 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-14T19:00:42.525 INFO:teuthology.orchestra.run.smithi148.stdout:(21/120): python3-rados-17.2.6-1415.g9d6d32bb.e 6.5 MB/s | 370 kB 00:00 2023-10-14T19:00:42.582 INFO:teuthology.orchestra.run.smithi148.stdout:(22/120): python3-rbd-17.2.6-1415.g9d6d32bb.el8 6.2 MB/s | 359 kB 00:00 2023-10-14T19:00:42.628 INFO:teuthology.orchestra.run.smithi148.stdout:(23/120): python3-rgw-17.2.6-1415.g9d6d32bb.el8 2.3 MB/s | 107 kB 00:00 2023-10-14T19:00:42.674 INFO:teuthology.orchestra.run.smithi148.stdout:(24/120): rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x8 2.0 MB/s | 90 kB 00:00 2023-10-14T19:00:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T19:00:42.849 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T19:00:42.973 INFO:teuthology.orchestra.run.smithi148.stdout:(25/120): rbd-mirror-17.2.6-1415.g9d6d32bb.el8. 12 MB/s | 3.5 MB 00:00 2023-10-14T19:00:43.024 INFO:teuthology.orchestra.run.smithi148.stdout:(26/120): rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86 3.4 MB/s | 174 kB 00:00 2023-10-14T19:00:43.066 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T19:00:43.068 INFO:teuthology.orchestra.run.smithi148.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1415.g 517 kB/s | 23 kB 00:00 2023-10-14T19:00:43.114 INFO:teuthology.orchestra.run.smithi148.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1415.g9d6d32b 2.6 MB/s | 121 kB 00:00 2023-10-14T19:00:43.130 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T19:00:43.267 INFO:teuthology.orchestra.run.smithi148.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1415.g9d6d3 11 MB/s | 1.7 MB 00:00 2023-10-14T19:00:43.353 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-14T19:00:43.607 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-14T19:00:43.827 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-14T19:00:43.932 INFO:teuthology.orchestra.run.smithi148.stdout:(30/120): ceph-test-17.2.6-1415.g9d6d32bb.el8.x 16 MB/s | 52 MB 00:03 2023-10-14T19:00:43.961 INFO:teuthology.orchestra.run.smithi148.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1415.g9d 9.0 MB/s | 238 kB 00:00 2023-10-14T19:00:43.996 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-14T19:00:44.002 INFO:teuthology.orchestra.run.smithi148.stdout:(32/120): ceph-mgr-diskprediction-local-17.2.6- 10 MB/s | 7.4 MB 00:00 2023-10-14T19:00:44.003 INFO:teuthology.orchestra.run.smithi148.stdout:(33/120): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.e 1.0 MB/s | 47 kB 00:00 2023-10-14T19:00:44.025 INFO:teuthology.orchestra.run.smithi148.stdout:(34/120): ceph-prometheus-alerts-17.2.6-1415.g9 660 kB/s | 14 kB 00:00 2023-10-14T19:00:44.026 INFO:teuthology.orchestra.run.smithi148.stdout:(35/120): ceph-volume-17.2.6-1415.g9d6d32bb.el8 11 MB/s | 267 kB 00:00 2023-10-14T19:00:44.046 INFO:teuthology.orchestra.run.smithi148.stdout:(36/120): cephadm-17.2.6-1415.g9d6d32bb.el8.noa 3.7 MB/s | 80 kB 00:00 2023-10-14T19:00:44.048 INFO:teuthology.orchestra.run.smithi148.stdout:(37/120): cephfs-top-17.2.6-1415.g9d6d32bb.el8. 861 kB/s | 18 kB 00:00 2023-10-14T19:00:44.120 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-14T19:00:44.272 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-14T19:00:44.329 INFO:teuthology.orchestra.run.smithi148.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 209 kB/s | 59 kB 00:00 2023-10-14T19:00:44.428 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-14T19:00:44.470 INFO:teuthology.orchestra.run.smithi148.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 534 kB/s | 75 kB 00:00 2023-10-14T19:00:44.471 INFO:teuthology.orchestra.run.smithi148.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 721 kB/s | 306 kB 00:00 2023-10-14T19:00:44.551 INFO:teuthology.orchestra.run.smithi148.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 544 kB/s | 44 kB 00:00 2023-10-14T19:00:44.624 INFO:teuthology.orchestra.run.smithi148.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.5 MB/s | 185 kB 00:00 2023-10-14T19:00:44.691 INFO:teuthology.orchestra.run.smithi148.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-14T19:00:44.695 INFO:teuthology.orchestra.run.smithi148.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 463 kB/s | 33 kB 00:00 2023-10-14T19:00:44.761 INFO:teuthology.orchestra.run.smithi148.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 232 kB/s | 16 kB 00:00 2023-10-14T19:00:44.769 INFO:teuthology.orchestra.run.smithi148.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.3 MB/s | 173 kB 00:00 2023-10-14T19:00:44.840 INFO:teuthology.orchestra.run.smithi148.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-14T19:00:44.904 INFO:teuthology.orchestra.run.smithi148.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-10-14T19:00:44.911 INFO:teuthology.orchestra.run.smithi148.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 157 kB/s | 11 kB 00:00 2023-10-14T19:00:44.975 INFO:teuthology.orchestra.run.smithi148.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 250 kB/s | 18 kB 00:00 2023-10-14T19:00:45.035 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-14T19:00:45.046 INFO:teuthology.orchestra.run.smithi148.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 681 kB/s | 49 kB 00:00 2023-10-14T19:00:45.117 INFO:teuthology.orchestra.run.smithi148.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 830 kB/s | 59 kB 00:00 2023-10-14T19:00:45.193 INFO:teuthology.orchestra.run.smithi148.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 794 kB/s | 60 kB 00:00 2023-10-14T19:00:45.198 INFO:teuthology.orchestra.run.smithi148.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 4.1 MB/s | 1.2 MB 00:00 2023-10-14T19:00:45.236 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-14T19:00:45.279 INFO:teuthology.orchestra.run.smithi148.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 194 kB/s | 16 kB 00:00 2023-10-14T19:00:45.347 INFO:teuthology.orchestra.run.smithi148.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-14T19:00:45.358 INFO:teuthology.orchestra.run.smithi148.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 427 kB/s | 34 kB 00:00 2023-10-14T19:00:45.420 INFO:teuthology.orchestra.run.smithi148.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-10-14T19:00:45.429 INFO:teuthology.orchestra.run.smithi148.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 901 kB/s | 64 kB 00:00 2023-10-14T19:00:45.498 INFO:teuthology.orchestra.run.smithi148.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 240 kB/s | 19 kB 00:00 2023-10-14T19:00:45.500 INFO:teuthology.orchestra.run.smithi148.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 337 kB/s | 24 kB 00:00 2023-10-14T19:00:45.569 INFO:teuthology.orchestra.run.smithi148.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 414 kB/s | 29 kB 00:00 2023-10-14T19:00:45.571 INFO:teuthology.orchestra.run.smithi148.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 389 kB/s | 27 kB 00:00 2023-10-14T19:00:45.655 INFO:teuthology.orchestra.run.smithi148.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.0 MB/s | 251 kB 00:00 2023-10-14T19:00:45.713 INFO:teuthology.orchestra.run.smithi148.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-10-14T19:00:45.726 INFO:teuthology.orchestra.run.smithi148.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 863 kB/s | 61 kB 00:00 2023-10-14T19:00:45.785 INFO:teuthology.orchestra.run.smithi148.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-10-14T19:00:45.797 INFO:teuthology.orchestra.run.smithi148.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 326 kB/s | 23 kB 00:00 2023-10-14T19:00:45.799 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-14T19:00:45.801 INFO:teuthology.orchestra.run.smithi148.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-14T19:00:45.833 INFO:teuthology.orchestra.run.smithi148.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 597 kB/s | 19 kB 00:00 2023-10-14T19:00:45.848 INFO:teuthology.orchestra.run.smithi148.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.9 MB/s | 43 kB 00:00 2023-10-14T19:00:45.864 INFO:teuthology.orchestra.run.smithi148.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.5 MB/s | 155 kB 00:00 2023-10-14T19:00:45.880 INFO:teuthology.orchestra.run.smithi148.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-10-14T19:00:45.894 INFO:teuthology.orchestra.run.smithi148.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.3 MB/s | 48 kB 00:00 2023-10-14T19:00:45.910 INFO:teuthology.orchestra.run.smithi148.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-14T19:00:45.924 INFO:teuthology.orchestra.run.smithi148.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.1 MB/s | 43 kB 00:00 2023-10-14T19:00:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 57 MB/s | 2.3 MB 00:00 2023-10-14T19:00:45.978 INFO:teuthology.orchestra.run.smithi148.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-10-14T19:00:45.997 INFO:teuthology.orchestra.run.smithi148.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 32 MB/s | 605 kB 00:00 2023-10-14T19:00:46.010 INFO:teuthology.orchestra.run.smithi148.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 6.2 MB/s | 83 kB 00:00 2023-10-14T19:00:46.023 INFO:teuthology.orchestra.run.smithi148.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 4.8 MB/s | 59 kB 00:00 2023-10-14T19:00:46.027 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-14T19:00:46.036 INFO:teuthology.orchestra.run.smithi148.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 13 MB/s | 169 kB 00:00 2023-10-14T19:00:46.048 INFO:teuthology.orchestra.run.smithi148.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.3 MB/s | 38 kB 00:00 2023-10-14T19:00:46.060 INFO:teuthology.orchestra.run.smithi148.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.9 MB/s | 86 kB 00:00 2023-10-14T19:00:46.072 INFO:teuthology.orchestra.run.smithi148.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.8 MB/s | 58 kB 00:00 2023-10-14T19:00:46.084 INFO:teuthology.orchestra.run.smithi148.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 4.0 MB/s | 47 kB 00:00 2023-10-14T19:00:46.101 INFO:teuthology.orchestra.run.smithi148.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 32 MB/s | 559 kB 00:00 2023-10-14T19:00:46.121 INFO:teuthology.orchestra.run.smithi148.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 32 MB/s | 639 kB 00:00 2023-10-14T19:00:46.134 INFO:teuthology.orchestra.run.smithi148.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.3 MB/s | 70 kB 00:00 2023-10-14T19:00:46.148 INFO:teuthology.orchestra.run.smithi148.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 15 MB/s | 200 kB 00:00 2023-10-14T19:00:46.160 INFO:teuthology.orchestra.run.smithi148.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.9 MB/s | 97 kB 00:00 2023-10-14T19:00:46.283 INFO:teuthology.orchestra.run.smithi148.stdout:(92/120): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2023-10-14T19:00:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:(93/120): python3-scipy-1.0.0-20.module+el8.1.0 58 MB/s | 15 MB 00:00 2023-10-14T19:00:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 341 kB/s | 44 kB 00:00 2023-10-14T19:00:46.426 INFO:teuthology.orchestra.run.smithi148.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-14T19:00:46.427 INFO:teuthology.orchestra.run.smithi148.stdout:(96/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2023-10-14T19:00:46.446 INFO:teuthology.orchestra.run.smithi148.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-14T19:00:46.448 INFO:teuthology.orchestra.run.smithi148.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-14T19:00:46.466 INFO:teuthology.orchestra.run.smithi148.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2023-10-14T19:00:46.487 INFO:teuthology.orchestra.run.smithi148.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 32 MB/s | 688 kB 00:00 2023-10-14T19:00:46.504 INFO:teuthology.orchestra.run.smithi148.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-10-14T19:00:46.519 INFO:teuthology.orchestra.run.smithi148.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 66 MB/s | 4.8 MB 00:00 2023-10-14T19:00:46.521 INFO:teuthology.orchestra.run.smithi148.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 12 MB/s | 225 kB 00:00 2023-10-14T19:00:46.534 INFO:teuthology.orchestra.run.smithi148.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.4 MB/s | 126 kB 00:00 2023-10-14T19:00:46.551 INFO:teuthology.orchestra.run.smithi148.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-14T19:00:46.569 INFO:teuthology.orchestra.run.smithi148.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 28 MB/s | 538 kB 00:00 2023-10-14T19:00:46.579 INFO:teuthology.orchestra.run.smithi148.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 65 MB/s | 3.7 MB 00:00 2023-10-14T19:00:46.585 INFO:teuthology.orchestra.run.smithi148.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-10-14T19:00:46.594 INFO:teuthology.orchestra.run.smithi148.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-14T19:00:46.601 INFO:teuthology.orchestra.run.smithi148.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.9 MB/s | 110 kB 00:00 2023-10-14T19:00:46.612 INFO:teuthology.orchestra.run.smithi148.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 19 MB/s | 353 kB 00:00 2023-10-14T19:00:46.615 INFO:teuthology.orchestra.run.smithi148.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-14T19:00:46.628 INFO:teuthology.orchestra.run.smithi148.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-14T19:00:46.634 INFO:teuthology.orchestra.run.smithi148.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 32 MB/s | 709 kB 00:00 2023-10-14T19:00:46.703 INFO:teuthology.orchestra.run.smithi148.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 63 MB/s | 4.7 MB 00:00 2023-10-14T19:00:46.721 INFO:teuthology.orchestra.run.smithi148.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 53 MB/s | 4.6 MB 00:00 2023-10-14T19:00:46.729 INFO:teuthology.orchestra.run.smithi148.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 28 MB/s | 713 kB 00:00 2023-10-14T19:00:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-14T19:00:47.039 INFO:teuthology.orchestra.run.smithi148.stdout:(118/120): librados2-17.2.6-1415.g9d6d32bb.el8. 11 MB/s | 3.5 MB 00:00 2023-10-14T19:00:47.068 INFO:teuthology.orchestra.run.smithi148.stdout:(119/120): librbd1-17.2.6-1415.g9d6d32bb.el8.x8 11 MB/s | 3.6 MB 00:00 2023-10-14T19:00:47.108 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-14T19:00:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-14T19:00:47.659 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-14T19:00:47.834 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 26/122 2023-10-14T19:00:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 27/122 2023-10-14T19:00:48.203 INFO:teuthology.orchestra.run.smithi148.stdout:(120/120): ceph-radosgw-17.2.6-1415.g9d6d32bb.e 2.1 MB/s | 17 MB 00:07 2023-10-14T19:00:48.207 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2023-10-14T19:00:48.207 INFO:teuthology.orchestra.run.smithi148.stdout:Total 21 MB/s | 202 MB 00:09 2023-10-14T19:00:48.262 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2023-10-14T19:00:48.276 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 28/122 2023-10-14T19:00:48.374 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2023-10-14T19:00:48.374 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2023-10-14T19:00:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-14T19:00:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-14T19:00:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-14T19:00:50.032 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2023-10-14T19:00:50.037 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2023-10-14T19:00:51.162 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-14T19:00:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-14T19:00:52.603 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-14T19:00:52.938 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-14T19:00:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-14T19:00:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-14T19:00:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-14T19:00:53.830 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 38/122 2023-10-14T19:00:54.058 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 39/122 2023-10-14T19:00:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 40/122 2023-10-14T19:00:54.589 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2023-10-14T19:00:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-14T19:00:54.792 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-14T19:00:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-14T19:00:54.992 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-14T19:00:54.997 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-14T19:00:55.135 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-14T19:00:55.206 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-14T19:00:55.355 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-14T19:00:55.368 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-14T19:00:55.468 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-14T19:00:55.652 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-14T19:00:55.722 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-14T19:00:55.845 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-14T19:00:55.971 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T19:00:56.065 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-14T19:00:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-14T19:00:56.373 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T19:00:56.454 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-14T19:00:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T19:00:56.654 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-14T19:00:56.720 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T19:00:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-14T19:00:56.922 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T19:00:57.020 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-14T19:00:57.023 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T19:00:57.173 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-14T19:00:57.243 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T19:00:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-14T19:00:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-14T19:00:57.788 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-14T19:00:58.055 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-14T19:00:58.236 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-14T19:00:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-14T19:00:58.522 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T19:00:58.561 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-14T19:00:58.632 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T19:00:58.758 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-14T19:00:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-14T19:00:59.007 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-14T19:00:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-14T19:00:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-14T19:00:59.296 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T19:00:59.406 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T19:00:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-14T19:00:59.568 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T19:00:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-14T19:00:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T19:00:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-14T19:00:59.842 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-14T19:01:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-14T19:01:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-14T19:01:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-14T19:01:00.295 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-14T19:01:00.456 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-14T19:01:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-14T19:01:00.596 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-14T19:01:00.721 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-14T19:01:00.727 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-14T19:01:00.879 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-14T19:01:00.953 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-14T19:01:01.233 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-14T19:01:01.431 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-14T19:01:01.490 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-14T19:01:01.604 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-14T19:01:01.778 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-14T19:01:02.095 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-14T19:01:02.163 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-14T19:01:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-14T19:01:02.359 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-14T19:01:02.544 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-14T19:01:02.860 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-14T19:01:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-14T19:01:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-14T19:01:04.076 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-14T19:01:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-14T19:01:04.411 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-14T19:01:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-14T19:01:04.594 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 26/122 2023-10-14T19:01:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-14T19:01:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 27/122 2023-10-14T19:01:05.022 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 28/122 2023-10-14T19:01:05.064 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-14T19:01:05.302 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-14T19:01:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-14T19:01:05.579 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-14T19:01:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-14T19:01:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-14T19:01:05.968 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-14T19:01:06.177 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-14T19:01:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-14T19:01:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-14T19:01:08.252 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-14T19:01:09.259 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-14T19:01:09.650 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-14T19:01:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-14T19:01:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-14T19:01:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-14T19:01:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 38/122 2023-10-14T19:01:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 39/122 2023-10-14T19:01:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 40/122 2023-10-14T19:01:11.192 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-14T19:01:11.368 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-14T19:01:11.566 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-14T19:01:11.764 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-14T19:01:11.840 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T19:01:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-14T19:01:12.001 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-14T19:01:12.074 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T19:01:12.186 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-14T19:01:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-14T19:01:12.527 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-14T19:01:12.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-14T19:01:12.727 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T19:01:12.918 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-14T19:01:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-14T19:01:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-14T19:01:13.456 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-14T19:01:13.639 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-14T19:01:13.740 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T19:01:13.930 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-14T19:01:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-14T19:01:14.235 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T19:01:14.422 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T19:01:14.766 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-14T19:01:15.086 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-14T19:01:15.236 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-14T19:01:15.416 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-14T19:01:15.707 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-14T19:01:15.927 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-14T19:01:16.159 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-14T19:01:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-14T19:01:16.478 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-14T19:01:16.695 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-14T19:01:16.898 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-14T19:01:17.121 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-14T19:01:17.305 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-14T19:01:17.513 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-14T19:01:17.751 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-14T19:01:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-14T19:01:18.183 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-14T19:01:18.472 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-14T19:01:18.727 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-14T19:01:18.910 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-14T19:01:19.176 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-14T19:01:20.300 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-14T19:01:20.624 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-14T19:01:20.835 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-14T19:01:21.193 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-14T19:01:21.486 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-14T19:01:21.824 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-14T19:01:22.053 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-14T19:01:22.244 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-14T19:01:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-14T19:01:27.687 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T19:01:27.975 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T19:01:28.574 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T19:01:28.860 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T19:01:28.949 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T19:01:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T19:01:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T19:01:32.899 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2023-10-14T19:01:32.899 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2023-10-14T19:01:32.899 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-10-14T19:01:32.899 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /run 2023-10-14T19:01:32.899 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2023-10-14T19:01:32.900 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2023-10-14T19:01:32.900 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2023-10-14T19:01:32.900 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2023-10-14T19:01:32.900 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-10-14T19:01:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:01:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T19:01:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T19:01:35.073 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T19:01:35.315 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T19:01:35.486 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T19:01:35.903 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T19:01:36.087 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T19:01:36.104 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T19:01:39.200 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T19:01:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T19:01:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 95/122 2023-10-14T19:01:39.801 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 96/122 2023-10-14T19:01:40.002 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T19:01:40.232 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T19:01:40.447 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T19:01:41.481 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T19:01:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T19:01:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T19:01:42.120 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 100/122 2023-10-14T19:01:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T19:01:42.368 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T19:01:42.518 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T19:01:42.530 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T19:01:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 103/122 2023-10-14T19:01:44.489 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T19:01:44.583 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T19:01:44.751 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T19:01:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T19:01:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T19:01:45.296 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T19:01:45.476 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T19:01:46.984 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T19:01:46.985 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2023-10-14T19:01:46.985 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2023-10-14T19:01:46.985 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /dev 2023-10-14T19:01:46.985 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /run 2023-10-14T19:01:46.986 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2023-10-14T19:01:46.986 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2023-10-14T19:01:46.986 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2023-10-14T19:01:46.986 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2023-10-14T19:01:46.987 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /dev 2023-10-14T19:01:46.987 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:01:47.389 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T19:01:48.881 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T19:01:49.082 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T19:01:49.307 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T19:01:49.480 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T19:01:49.875 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T19:01:50.072 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T19:01:50.089 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T19:01:50.746 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T19:01:51.907 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 108/122 2023-10-14T19:01:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-14T19:01:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 110/122 2023-10-14T19:01:52.662 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-14T19:01:52.858 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-14T19:01:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-14T19:01:53.046 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 113/122 2023-10-14T19:01:53.068 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T19:01:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T19:01:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-14T19:01:53.409 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 115/122 2023-10-14T19:01:53.436 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 95/122 2023-10-14T19:01:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 116/122 2023-10-14T19:01:53.632 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 96/122 2023-10-14T19:01:53.813 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T19:01:53.854 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 117/122 2023-10-14T19:01:54.028 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T19:01:54.166 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-14T19:01:54.231 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T19:01:54.232 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-14T19:01:54.441 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-14T19:01:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-14T19:01:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-14T19:01:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T19:01:54.787 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T19:01:54.787 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T19:01:55.201 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T19:01:55.413 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T19:01:55.511 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T19:01:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T19:01:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/122 2023-10-14T19:01:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/122 2023-10-14T19:01:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/122 2023-10-14T19:01:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T19:01:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 5/122 2023-10-14T19:01:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T19:01:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T19:01:55.748 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 8/122 2023-10-14T19:01:55.748 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 9/122 2023-10-14T19:01:55.748 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T19:01:55.748 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/122 2023-10-14T19:01:55.749 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/122 2023-10-14T19:01:55.749 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T19:01:55.749 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 14/122 2023-10-14T19:01:55.750 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 15/122 2023-10-14T19:01:55.750 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/122 2023-10-14T19:01:55.750 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 17/122 2023-10-14T19:01:55.750 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 18/122 2023-10-14T19:01:55.751 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 19/122 2023-10-14T19:01:55.751 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 20/122 2023-10-14T19:01:55.751 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 21/122 2023-10-14T19:01:55.751 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 22/122 2023-10-14T19:01:55.751 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/122 2023-10-14T19:01:55.752 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/122 2023-10-14T19:01:55.752 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/122 2023-10-14T19:01:55.752 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/122 2023-10-14T19:01:55.752 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/122 2023-10-14T19:01:55.753 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/122 2023-10-14T19:01:55.762 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 29/122 2023-10-14T19:01:55.762 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 30/122 2023-10-14T19:01:55.763 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 31/122 2023-10-14T19:01:55.763 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 32/122 2023-10-14T19:01:55.763 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 33/122 2023-10-14T19:01:55.763 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 34/122 2023-10-14T19:01:55.763 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 35/122 2023-10-14T19:01:55.764 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 36/122 2023-10-14T19:01:55.764 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 37/122 2023-10-14T19:01:55.764 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 38/122 2023-10-14T19:01:55.764 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-14T19:01:55.764 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-14T19:01:55.765 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-14T19:01:55.765 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-14T19:01:55.765 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-14T19:01:55.765 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-14T19:01:55.765 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-14T19:01:55.766 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-14T19:01:55.766 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-14T19:01:55.766 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-14T19:01:55.766 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-14T19:01:55.766 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-14T19:01:55.767 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-14T19:01:55.767 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-14T19:01:55.767 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-14T19:01:55.767 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-14T19:01:55.767 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-14T19:01:55.768 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-14T19:01:55.768 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-14T19:01:55.768 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-14T19:01:55.768 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-14T19:01:55.768 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-14T19:01:55.769 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-14T19:01:55.769 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-14T19:01:55.769 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-14T19:01:55.769 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-14T19:01:55.769 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-14T19:01:55.770 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-14T19:01:55.770 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-14T19:01:55.770 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-14T19:01:55.770 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-14T19:01:55.770 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-14T19:01:55.770 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-14T19:01:55.771 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-14T19:01:55.771 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-14T19:01:55.771 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-14T19:01:55.771 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-14T19:01:55.771 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-14T19:01:55.772 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-14T19:01:55.772 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-14T19:01:55.772 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-14T19:01:55.772 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-14T19:01:55.772 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-14T19:01:55.773 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-14T19:01:55.773 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-14T19:01:55.773 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-14T19:01:55.773 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-14T19:01:55.773 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-14T19:01:55.774 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-14T19:01:55.774 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-14T19:01:55.774 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-14T19:01:55.774 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-14T19:01:55.774 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-14T19:01:55.775 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-14T19:01:55.775 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-14T19:01:55.775 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-14T19:01:55.775 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-14T19:01:55.776 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-14T19:01:55.776 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-14T19:01:55.776 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-14T19:01:55.776 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-14T19:01:55.777 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-14T19:01:55.777 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-14T19:01:55.777 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-14T19:01:55.777 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-14T19:01:55.778 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-14T19:01:55.778 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-14T19:01:55.778 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-14T19:01:55.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-14T19:01:55.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-14T19:01:55.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-14T19:01:55.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-14T19:01:55.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-14T19:01:55.780 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-14T19:01:55.780 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-14T19:01:55.780 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-14T19:01:55.780 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-14T19:01:55.781 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-14T19:01:55.781 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-14T19:01:55.781 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-14T19:01:55.781 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 119/122 2023-10-14T19:01:55.781 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-14T19:01:55.782 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 121/122 2023-10-14T19:01:55.904 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 100/122 2023-10-14T19:01:56.098 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T19:01:56.134 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T19:01:56.337 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T19:01:56.348 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T19:01:57.947 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 103/122 2023-10-14T19:01:58.019 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T19:01:58.019 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Oct 2023 07:00:14 PM UTC. 2023-10-14T19:01:58.164 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T19:01:58.282 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T19:01:58.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T19:01:58.513 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T19:01:58.654 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T19:01:59.002 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T19:01:59.220 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T19:02:00.484 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-10-14T19:02:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:00.635 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2023-10-14T19:02:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.636 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-10-14T19:02:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T19:02:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T19:02:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.638 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.638 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.638 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.638 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.638 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.638 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.639 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.639 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.639 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.639 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.639 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.640 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.640 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.640 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.640 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.641 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:00.641 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-14T19:02:00.641 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T19:02:00.641 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-14T19:02:00.641 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T19:02:00.641 INFO:teuthology.orchestra.run.smithi007.stdout: jq-1.5-12.el8.x86_64 2023-10-14T19:02:00.642 INFO:teuthology.orchestra.run.smithi007.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-14T19:02:00.642 INFO:teuthology.orchestra.run.smithi007.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-14T19:02:00.642 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T19:02:00.642 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.642 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.643 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.643 INFO:teuthology.orchestra.run.smithi007.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-14T19:02:00.643 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T19:02:00.643 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T19:02:00.643 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T19:02:00.644 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T19:02:00.644 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.644 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.644 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T19:02:00.644 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.644 INFO:teuthology.orchestra.run.smithi007.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T19:02:00.645 INFO:teuthology.orchestra.run.smithi007.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-14T19:02:00.645 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T19:02:00.645 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T19:02:00.645 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-14T19:02:00.645 INFO:teuthology.orchestra.run.smithi007.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T19:02:00.646 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T19:02:00.646 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T19:02:00.646 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T19:02:00.646 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T19:02:00.646 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-14T19:02:00.647 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T19:02:00.647 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T19:02:00.647 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T19:02:00.647 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T19:02:00.647 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T19:02:00.647 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T19:02:00.648 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T19:02:00.648 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T19:02:00.648 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.648 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.648 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.649 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T19:02:00.649 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T19:02:00.649 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T19:02:00.649 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T19:02:00.649 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T19:02:00.649 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T19:02:00.650 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T19:02:00.650 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T19:02:00.650 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T19:02:00.650 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T19:02:00.650 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T19:02:00.651 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T19:02:00.651 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T19:02:00.651 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T19:02:00.651 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T19:02:00.651 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T19:02:00.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T19:02:00.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T19:02:00.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T19:02:00.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T19:02:00.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T19:02:00.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T19:02:00.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T19:02:00.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T19:02:00.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T19:02:00.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T19:02:00.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T19:02:00.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T19:02:00.654 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T19:02:00.655 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T19:02:00.655 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T19:02:00.655 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T19:02:00.655 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T19:02:00.655 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T19:02:00.656 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T19:02:00.656 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T19:02:00.656 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T19:02:00.656 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T19:02:00.656 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T19:02:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T19:02:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T19:02:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T19:02:00.658 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-14T19:02:00.658 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T19:02:00.658 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-14T19:02:00.659 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:00.659 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-10-14T19:02:00.940 DEBUG:teuthology.parallel:result is None 2023-10-14T19:02:04.197 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T19:02:05.143 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 108/122 2023-10-14T19:02:05.471 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-14T19:02:05.696 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 110/122 2023-10-14T19:02:05.913 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-14T19:02:06.111 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-14T19:02:06.122 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-14T19:02:06.290 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 113/122 2023-10-14T19:02:06.449 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-14T19:02:06.644 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 115/122 2023-10-14T19:02:06.819 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 116/122 2023-10-14T19:02:07.078 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 117/122 2023-10-14T19:02:07.261 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-14T19:02:07.313 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-14T19:02:07.502 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-14T19:02:07.528 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-14T19:02:07.629 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-14T19:02:07.630 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T19:02:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T19:02:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T19:02:08.770 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T19:02:08.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/122 2023-10-14T19:02:08.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/122 2023-10-14T19:02:08.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/122 2023-10-14T19:02:08.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T19:02:08.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 5/122 2023-10-14T19:02:08.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T19:02:08.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T19:02:08.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 8/122 2023-10-14T19:02:08.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 9/122 2023-10-14T19:02:08.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T19:02:08.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/122 2023-10-14T19:02:08.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/122 2023-10-14T19:02:08.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T19:02:08.774 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 14/122 2023-10-14T19:02:08.774 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 15/122 2023-10-14T19:02:08.774 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/122 2023-10-14T19:02:08.774 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 17/122 2023-10-14T19:02:08.774 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 18/122 2023-10-14T19:02:08.775 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 19/122 2023-10-14T19:02:08.775 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 20/122 2023-10-14T19:02:08.775 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 21/122 2023-10-14T19:02:08.775 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 22/122 2023-10-14T19:02:08.776 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/122 2023-10-14T19:02:08.776 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/122 2023-10-14T19:02:08.776 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/122 2023-10-14T19:02:08.776 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/122 2023-10-14T19:02:08.777 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/122 2023-10-14T19:02:08.777 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/122 2023-10-14T19:02:08.777 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 29/122 2023-10-14T19:02:08.777 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 30/122 2023-10-14T19:02:08.777 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 31/122 2023-10-14T19:02:08.778 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 32/122 2023-10-14T19:02:08.778 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 33/122 2023-10-14T19:02:08.778 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 34/122 2023-10-14T19:02:08.778 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 35/122 2023-10-14T19:02:08.778 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 36/122 2023-10-14T19:02:08.779 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 37/122 2023-10-14T19:02:08.779 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 38/122 2023-10-14T19:02:08.779 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-14T19:02:08.779 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-14T19:02:08.779 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-14T19:02:08.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-14T19:02:08.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-14T19:02:08.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-14T19:02:08.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-14T19:02:08.781 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-14T19:02:08.782 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-14T19:02:08.783 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-14T19:02:08.783 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-14T19:02:08.783 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-14T19:02:08.783 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-14T19:02:08.783 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-14T19:02:08.784 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-14T19:02:08.784 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-14T19:02:08.784 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-14T19:02:08.784 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-14T19:02:08.784 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-14T19:02:08.785 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-14T19:02:08.785 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-14T19:02:08.785 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-14T19:02:08.785 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-14T19:02:08.785 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-14T19:02:08.786 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-14T19:02:08.786 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-14T19:02:08.786 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-14T19:02:08.786 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-14T19:02:08.787 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-14T19:02:08.787 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-14T19:02:08.787 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-14T19:02:08.787 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-14T19:02:08.788 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-14T19:02:08.788 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-14T19:02:08.788 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-14T19:02:08.788 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-14T19:02:08.789 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-14T19:02:08.789 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-14T19:02:08.789 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-14T19:02:08.789 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-14T19:02:08.789 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-14T19:02:08.790 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-14T19:02:08.790 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-14T19:02:08.790 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-14T19:02:08.790 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-14T19:02:08.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-14T19:02:08.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-14T19:02:08.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-14T19:02:08.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-14T19:02:08.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-14T19:02:08.792 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-14T19:02:08.792 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-14T19:02:08.792 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-14T19:02:08.792 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-14T19:02:08.793 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-14T19:02:08.793 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-14T19:02:08.793 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-14T19:02:08.793 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-14T19:02:08.794 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-14T19:02:08.794 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-14T19:02:08.794 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-14T19:02:08.794 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-14T19:02:08.794 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-14T19:02:08.795 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-14T19:02:08.795 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-14T19:02:08.795 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-14T19:02:08.795 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-14T19:02:08.795 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-14T19:02:08.796 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-14T19:02:08.796 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-14T19:02:08.796 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-14T19:02:08.796 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-14T19:02:08.796 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-14T19:02:08.796 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-14T19:02:08.797 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-14T19:02:08.797 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-14T19:02:08.797 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-14T19:02:08.797 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-14T19:02:08.797 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-14T19:02:08.798 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-14T19:02:08.798 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 119/122 2023-10-14T19:02:08.798 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-14T19:02:08.798 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 121/122 2023-10-14T19:02:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T19:02:10.959 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:40 ago on Sat 14 Oct 2023 07:00:30 PM UTC. 2023-10-14T19:02:15.672 INFO:teuthology.orchestra.run.smithi148.stdout:Installed products updated. 2023-10-14T19:02:15.801 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:15.801 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2023-10-14T19:02:15.802 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.802 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.802 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2023-10-14T19:02:15.802 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T19:02:15.803 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T19:02:15.803 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.803 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.803 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.804 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.804 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.804 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.804 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.804 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.805 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.805 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.805 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.805 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.805 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.806 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.806 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.806 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.806 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.806 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.807 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.807 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.807 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.808 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.808 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T19:02:15.808 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-14T19:02:15.808 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T19:02:15.808 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-14T19:02:15.809 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T19:02:15.809 INFO:teuthology.orchestra.run.smithi148.stdout: jq-1.5-12.el8.x86_64 2023-10-14T19:02:15.809 INFO:teuthology.orchestra.run.smithi148.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-14T19:02:15.809 INFO:teuthology.orchestra.run.smithi148.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-14T19:02:15.810 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T19:02:15.810 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.810 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.810 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.811 INFO:teuthology.orchestra.run.smithi148.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-14T19:02:15.811 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T19:02:15.811 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T19:02:15.811 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T19:02:15.812 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T19:02:15.812 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.812 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.812 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T19:02:15.812 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T19:02:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-14T19:02:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T19:02:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T19:02:15.814 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-14T19:02:15.814 INFO:teuthology.orchestra.run.smithi148.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T19:02:15.814 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T19:02:15.814 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T19:02:15.815 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T19:02:15.815 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T19:02:15.815 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-14T19:02:15.815 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T19:02:15.815 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T19:02:15.815 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T19:02:15.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T19:02:15.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T19:02:15.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T19:02:15.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T19:02:15.817 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T19:02:15.817 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.817 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.817 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.817 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T19:02:15.818 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T19:02:15.818 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T19:02:15.818 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T19:02:15.818 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T19:02:15.818 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T19:02:15.819 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T19:02:15.819 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T19:02:15.819 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T19:02:15.819 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T19:02:15.820 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T19:02:15.820 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T19:02:15.820 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T19:02:15.820 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T19:02:15.820 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T19:02:15.821 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T19:02:15.821 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T19:02:15.821 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T19:02:15.821 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T19:02:15.822 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T19:02:15.822 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T19:02:15.822 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T19:02:15.822 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T19:02:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T19:02:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T19:02:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T19:02:15.824 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T19:02:15.824 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.824 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T19:02:15.825 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T19:02:15.825 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T19:02:15.826 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T19:02:15.826 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T19:02:15.826 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T19:02:15.826 INFO:teuthology.orchestra.run.smithi148.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T19:02:15.826 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T19:02:15.827 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T19:02:15.827 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T19:02:15.827 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T19:02:15.827 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T19:02:15.827 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T19:02:15.828 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.828 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.828 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T19:02:15.828 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T19:02:15.828 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T19:02:15.829 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-14T19:02:15.829 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T19:02:15.829 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-14T19:02:15.830 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:15.830 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-10-14T19:02:15.994 DEBUG:teuthology.parallel:result is None 2023-10-14T19:02:15.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T19:02:16.169 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T19:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T19:02:16.199 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T19:02:16.199 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T19:02:16.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T19:02:16.424 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T19:02:16.446 INFO:teuthology.orchestra.run.smithi148.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T19:02:16.446 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T19:02:16.447 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T19:02:16.447 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T19:02:16.448 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:16.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T19:02:16.495 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:16.496 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T19:02:16.534 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T19:02:16.535 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:16.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T19:02:16.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T19:02:16.635 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:16.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T19:02:16.660 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T19:02:16.725 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T19:02:16.726 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:16.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T19:02:16.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T19:02:16.823 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:16.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T19:02:16.848 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T19:02:16.913 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T19:02:16.913 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:16.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T19:02:16.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T19:02:17.008 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:17.008 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T19:02:17.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T19:02:17.097 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T19:02:17.167 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T19:02:17.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2023-10-14T19:02:17.171 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2023-10-14T19:02:17.196 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T19:02:17.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T19:02:17.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T19:02:17.263 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T19:02:17.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T19:02:17.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T19:02:17.336 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T19:02:17.336 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T19:02:17.336 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T19:02:17.337 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:17.337 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T19:02:17.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:17.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:17.526 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:17.526 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T19:02:17.541 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:17.649 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:17.679 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T19:02:17.680 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T19:02:17.680 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801', 'branch': 'quincy-release', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7425801', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'quincy-release'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'quincy-release', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2462, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'quincy-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSrqygswVfZqG7JEM590EKL6zyqWL7FCIxqREpoASKF/ctYhAS8olNztrKutEskPm4iqVRXef2yhvWSFIbDF14=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0hM9VEJyt4NHND840BB2PAXjFUrr1hPb5VcsjvHz7QWnK7eJEa7OV3IpOxovMjNchmTIL1tOVIUSMCCVAT7wk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_20:07:38', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T19:02:17.681 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T19:02:17.683 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T19:02:17.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T19:02:17.739 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T19:02:17.793 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:17.793 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T19:02:17.818 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T19:02:17.818 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2023-10-14T19:02:17.873 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T19:02:17.873 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:17.874 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 220338 Links: 1 2023-10-14T19:02:17.874 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:17.874 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:17.874 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-14 19:01:55.283553661 +0000 2023-10-14T19:02:17.875 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-14 18:59:29.442470019 +0000 2023-10-14T19:02:17.875 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-14 18:59:29.442470019 +0000 2023-10-14T19:02:17.875 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-14T19:02:17.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T19:02:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-14T19:02:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-14T19:02:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000123607 s, 4.1 MB/s 2023-10-14T19:02:17.940 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T19:02:17.998 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2023-10-14T19:02:18.054 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T19:02:18.055 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:18.055 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 216735 Links: 1 2023-10-14T19:02:18.055 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:18.055 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:18.055 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-14 19:01:55.283553661 +0000 2023-10-14T19:02:18.056 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-14 18:59:29.933462548 +0000 2023-10-14T19:02:18.056 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-14 18:59:29.933462548 +0000 2023-10-14T19:02:18.056 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-14T19:02:18.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T19:02:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-14T19:02:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-14T19:02:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000113798 s, 4.5 MB/s 2023-10-14T19:02:18.120 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T19:02:18.177 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2023-10-14T19:02:18.232 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T19:02:18.233 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:18.233 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 219779 Links: 1 2023-10-14T19:02:18.233 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:18.233 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:18.234 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-14 19:01:55.283553661 +0000 2023-10-14T19:02:18.234 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-14 18:59:30.435454910 +0000 2023-10-14T19:02:18.234 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-14 18:59:30.435454910 +0000 2023-10-14T19:02:18.234 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-14T19:02:18.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T19:02:18.296 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-14T19:02:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-14T19:02:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000102574 s, 5.0 MB/s 2023-10-14T19:02:18.298 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T19:02:18.355 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2023-10-14T19:02:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T19:02:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:18.412 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 221643 Links: 1 2023-10-14T19:02:18.412 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:18.412 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:18.412 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-10-14 19:01:55.283553661 +0000 2023-10-14T19:02:18.413 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-10-14 18:59:30.959446935 +0000 2023-10-14T19:02:18.413 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-10-14 18:59:30.959446935 +0000 2023-10-14T19:02:18.413 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-10-14T19:02:18.414 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T19:02:18.476 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-10-14T19:02:18.476 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-10-14T19:02:18.476 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.56e-05 s, 5.4 MB/s 2023-10-14T19:02:18.477 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T19:02:18.534 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:18.534 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:18.535 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T19:02:18.551 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T19:02:18.552 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2023-10-14T19:02:18.608 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T19:02:18.608 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:18.609 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 219431 Links: 1 2023-10-14T19:02:18.609 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:18.609 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:18.609 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-14 19:02:08.321989561 +0000 2023-10-14T19:02:18.610 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-14 18:59:12.236304100 +0000 2023-10-14T19:02:18.610 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-14 18:59:12.236304100 +0000 2023-10-14T19:02:18.610 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-14T19:02:18.611 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T19:02:18.673 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-14T19:02:18.673 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-14T19:02:18.673 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000253434 s, 2.0 MB/s 2023-10-14T19:02:18.675 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T19:02:18.731 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2023-10-14T19:02:18.787 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T19:02:18.787 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:18.788 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 214899 Links: 1 2023-10-14T19:02:18.788 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:18.788 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:18.788 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-14 19:02:08.321989561 +0000 2023-10-14T19:02:18.788 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-14 18:59:12.719292366 +0000 2023-10-14T19:02:18.789 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-14 18:59:12.719292366 +0000 2023-10-14T19:02:18.789 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-14T19:02:18.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T19:02:18.851 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-14T19:02:18.852 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-14T19:02:18.852 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000233209 s, 2.2 MB/s 2023-10-14T19:02:18.853 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T19:02:18.909 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2023-10-14T19:02:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T19:02:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:18.965 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 222500 Links: 1 2023-10-14T19:02:18.965 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:18.965 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:18.966 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-14 19:02:08.321989561 +0000 2023-10-14T19:02:18.966 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-14 18:59:13.187280997 +0000 2023-10-14T19:02:18.966 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-14 18:59:13.187280997 +0000 2023-10-14T19:02:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-14T19:02:18.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T19:02:19.028 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-14T19:02:19.028 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-14T19:02:19.029 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000213377 s, 2.4 MB/s 2023-10-14T19:02:19.030 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T19:02:19.085 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2023-10-14T19:02:19.140 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T19:02:19.141 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T19:02:19.141 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 222595 Links: 1 2023-10-14T19:02:19.141 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T19:02:19.142 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T19:02:19.142 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-14 19:02:08.321989561 +0000 2023-10-14T19:02:19.142 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-14 18:59:13.679269044 +0000 2023-10-14T19:02:19.142 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-14 18:59:13.679269044 +0000 2023-10-14T19:02:19.142 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-14T19:02:19.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T19:02:19.204 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-14T19:02:19.204 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-14T19:02:19.205 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000192701 s, 2.7 MB/s 2023-10-14T19:02:19.206 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T19:02:19.262 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:19.263 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T19:02:19.263 INFO:tasks.ceph:Generating config... 2023-10-14T19:02:19.265 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T19:02:19.265 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T19:02:19.266 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T19:02:19.266 INFO:tasks.ceph:[client] pid file = 2023-10-14T19:02:19.266 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T19:02:19.267 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T19:02:19.267 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T19:02:19.267 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T19:02:19.268 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T19:02:19.268 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T19:02:19.268 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T19:02:19.268 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T19:02:19.269 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T19:02:19.269 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T19:02:19.270 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T19:02:19.270 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T19:02:19.270 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-14T19:02:19.271 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-14T19:02:19.271 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T19:02:19.272 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T19:02:19.272 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T19:02:19.272 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T19:02:19.272 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T19:02:19.273 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T19:02:19.273 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T19:02:19.273 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T19:02:19.274 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T19:02:19.274 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T19:02:19.274 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T19:02:19.275 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-14T19:02:19.275 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-14T19:02:19.275 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T19:02:19.276 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T19:02:19.276 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-14T19:02:19.276 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T19:02:19.277 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T19:02:19.277 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T19:02:19.278 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T19:02:19.278 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T19:02:19.278 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T19:02:19.279 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T19:02:19.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T19:02:19.339 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T19:02:19.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T19:02:19.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T19:02:19.453 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '172.21.15.148'), ('mon.c', '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]')] 2023-10-14T19:02:19.454 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T19:02:19.455 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:19.456 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T19:02:19.509 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --add b 172.21.15.148 --addv c '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:19.594 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:19.595 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 409612cc-2479-4e31-9e57-8fa34eb20ae0 2023-10-14T19:02:19.595 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = octopus 2023-10-14T19:02:19.595 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2023-10-14T19:02:19.596 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 409612cc-2479-4e31-9e57-8fa34eb20ae0 2023-10-14T19:02:19.596 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2023-10-14T19:02:19.595293+0000 2023-10-14T19:02:19.596 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-10-14T19:02:19.595293+0000 2023-10-14T19:02:19.597 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 15 (octopus) 2023-10-14T19:02:19.597 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2023-10-14T19:02:19.597 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2023-10-14T19:02:19.597 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-10-14T19:02:19.598 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2023-10-14T19:02:19.598 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T19:02:19.599 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T19:02:19.614 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 409612cc-2479-4e31-9e57-8fa34eb20ae0... 2023-10-14T19:02:19.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T19:02:19.657 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T19:02:19.699 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2023-10-14T19:02:19.699 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2023-10-14T19:02:19.699 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T19:02:19.700 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2023-10-14T19:02:19.700 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.700 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2023-10-14T19:02:19.701 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.701 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2023-10-14T19:02:19.701 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.701 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2023-10-14T19:02:19.702 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2023-10-14T19:02:19.702 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.702 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2023-10-14T19:02:19.702 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2023-10-14T19:02:19.702 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.703 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T19:02:19.703 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2023-10-14T19:02:19.703 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.703 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T19:02:19.703 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T19:02:19.703 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.704 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2023-10-14T19:02:19.704 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.704 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2023-10-14T19:02:19.704 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2023-10-14T19:02:19.705 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2023-10-14T19:02:19.705 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2023-10-14T19:02:19.705 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2023-10-14T19:02:19.705 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2023-10-14T19:02:19.706 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2023-10-14T19:02:19.706 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T19:02:19.706 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T19:02:19.706 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2023-10-14T19:02:19.707 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.707 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T19:02:19.707 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.707 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2023-10-14T19:02:19.707 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.708 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2023-10-14T19:02:19.708 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.708 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2023-10-14T19:02:19.708 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2023-10-14T19:02:19.708 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2023-10-14T19:02:19.709 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]" 2023-10-14T19:02:19.709 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2023-10-14T19:02:19.709 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 409612cc-2479-4e31-9e57-8fa34eb20ae0 2023-10-14T19:02:19.709 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.709 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2023-10-14T19:02:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2023-10-14T19:02:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2023-10-14T19:02:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2023-10-14T19:02:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2023-10-14T19:02:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2023-10-14T19:02:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2023-10-14T19:02:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2023-10-14T19:02:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2023-10-14T19:02:19.712 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2023-10-14T19:02:19.712 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.712 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2023-10-14T19:02:19.712 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2023-10-14T19:02:19.713 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.713 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2023-10-14T19:02:19.713 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.713 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2023-10-14T19:02:19.713 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.714 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2023-10-14T19:02:19.714 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.714 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2023-10-14T19:02:19.714 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2023-10-14T19:02:19.714 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.715 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2023-10-14T19:02:19.715 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2023-10-14T19:02:19.715 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2023-10-14T19:02:19.715 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2023-10-14T19:02:19.715 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = bitmap 2023-10-14T19:02:19.715 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2023-10-14T19:02:19.716 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2023-10-14T19:02:19.716 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2023-10-14T19:02:19.717 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2023-10-14T19:02:19.717 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-14T19:02:19.717 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2023-10-14T19:02:19.718 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2023-10-14T19:02:19.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T19:02:19.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2023-10-14T19:02:19.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2023-10-14T19:02:19.719 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2023-10-14T19:02:19.719 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2023-10-14T19:02:19.719 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2023-10-14T19:02:19.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.719 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2023-10-14T19:02:19.720 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-14T19:02:19.720 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2023-10-14T19:02:19.720 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-10-14T19:02:19.720 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-10-14T19:02:19.720 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-10-14T19:02:19.721 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-10-14T19:02:19.721 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2023-10-14T19:02:19.721 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2023-10-14T19:02:19.721 INFO:teuthology.orchestra.run.smithi007.stdout: debug finisher = 20 2023-10-14T19:02:19.721 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.722 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2023-10-14T19:02:19.722 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-14T19:02:19.722 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-10-14T19:02:19.722 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2023-10-14T19:02:19.722 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-10-14T19:02:19.723 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2023-10-14T19:02:19.723 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2023-10-14T19:02:19.723 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-10-14T19:02:19.723 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2023-10-14T19:02:19.723 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2023-10-14T19:02:19.724 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-10-14T19:02:19.724 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.724 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T19:02:19.724 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T19:02:19.724 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T19:02:19.724 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.725 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T19:02:19.725 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T19:02:19.725 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T19:02:19.725 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.725 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2023-10-14T19:02:19.726 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2023-10-14T19:02:19.726 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.726 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2023-10-14T19:02:19.727 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2023-10-14T19:02:19.727 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:19.727 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2023-10-14T19:02:19.727 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2023-10-14T19:02:19.727 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2023-10-14T19:02:19.728 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2023-10-14T19:02:19.728 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T19:02:19.728 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T19:02:19.728 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2023-10-14T19:02:19.728 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2023-10-14T19:02:19.729 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-14T19:02:19.729 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2023-10-14T19:02:19.729 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2023-10-14T19:02:19.729 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2023-10-14T19:02:19.729 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2023-10-14T19:02:19.729 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2023-10-14T19:02:19.730 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2023-10-14T19:02:19.730 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2023-10-14T19:02:19.730 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2023-10-14T19:02:19.730 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2023-10-14T19:02:19.731 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2023-10-14T19:02:19.731 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2023-10-14T19:02:19.731 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2023-10-14T19:02:19.731 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-10-14T19:02:19.732 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2023-10-14T19:02:19.732 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2023-10-14T19:02:19.732 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2023-10-14T19:02:19.732 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2023-10-14T19:02:19.732 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2023-10-14T19:02:19.732 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2023-10-14T19:02:19.733 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2023-10-14T19:02:19.734 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2023-10-14T19:02:19.735 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2023-10-14T19:02:19.735 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T19:02:19.735 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2023-10-14T19:02:19.735 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.735 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2023-10-14T19:02:19.736 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.736 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2023-10-14T19:02:19.736 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.737 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2023-10-14T19:02:19.737 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2023-10-14T19:02:19.737 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.737 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2023-10-14T19:02:19.737 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2023-10-14T19:02:19.738 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.738 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T19:02:19.738 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2023-10-14T19:02:19.738 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.738 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T19:02:19.739 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T19:02:19.739 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.739 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2023-10-14T19:02:19.739 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.740 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2023-10-14T19:02:19.740 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2023-10-14T19:02:19.740 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2023-10-14T19:02:19.740 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2023-10-14T19:02:19.740 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2023-10-14T19:02:19.740 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2023-10-14T19:02:19.741 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2023-10-14T19:02:19.741 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T19:02:19.741 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T19:02:19.742 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2023-10-14T19:02:19.742 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.742 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T19:02:19.742 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.742 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2023-10-14T19:02:19.743 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.743 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2023-10-14T19:02:19.743 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.743 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2023-10-14T19:02:19.743 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2023-10-14T19:02:19.743 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2023-10-14T19:02:19.744 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.7,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]" 2023-10-14T19:02:19.744 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on skipped message = False 2023-10-14T19:02:19.744 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 409612cc-2479-4e31-9e57-8fa34eb20ae0 2023-10-14T19:02:19.744 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.744 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2023-10-14T19:02:19.745 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2023-10-14T19:02:19.745 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.745 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2023-10-14T19:02:19.745 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2023-10-14T19:02:19.745 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2023-10-14T19:02:19.746 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.746 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2023-10-14T19:02:19.746 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2023-10-14T19:02:19.746 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.747 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2023-10-14T19:02:19.747 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2023-10-14T19:02:19.747 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2023-10-14T19:02:19.747 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.748 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2023-10-14T19:02:19.748 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2023-10-14T19:02:19.748 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.748 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2023-10-14T19:02:19.748 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.749 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2023-10-14T19:02:19.749 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.749 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2023-10-14T19:02:19.749 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.749 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2023-10-14T19:02:19.750 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2023-10-14T19:02:19.750 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.750 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2023-10-14T19:02:19.750 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2023-10-14T19:02:19.750 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2023-10-14T19:02:19.751 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2023-10-14T19:02:19.751 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2023-10-14T19:02:19.751 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2023-10-14T19:02:19.751 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2023-10-14T19:02:19.751 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2023-10-14T19:02:19.751 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2023-10-14T19:02:19.752 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-14T19:02:19.752 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2023-10-14T19:02:19.752 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2023-10-14T19:02:19.752 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T19:02:19.752 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2023-10-14T19:02:19.753 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2023-10-14T19:02:19.753 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2023-10-14T19:02:19.753 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2023-10-14T19:02:19.753 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-10-14T19:02:19.753 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.754 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2023-10-14T19:02:19.754 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-14T19:02:19.754 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2023-10-14T19:02:19.754 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-10-14T19:02:19.754 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-10-14T19:02:19.755 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-10-14T19:02:19.755 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-10-14T19:02:19.755 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2023-10-14T19:02:19.755 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-10-14T19:02:19.755 INFO:teuthology.orchestra.run.smithi148.stdout: debug finisher = 20 2023-10-14T19:02:19.755 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.756 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2023-10-14T19:02:19.756 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-14T19:02:19.756 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-10-14T19:02:19.756 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2023-10-14T19:02:19.756 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-10-14T19:02:19.757 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2023-10-14T19:02:19.757 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2023-10-14T19:02:19.757 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-10-14T19:02:19.757 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2023-10-14T19:02:19.757 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2023-10-14T19:02:19.758 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-10-14T19:02:19.758 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.758 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T19:02:19.758 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T19:02:19.758 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T19:02:19.758 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.759 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T19:02:19.759 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T19:02:19.759 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T19:02:19.759 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.759 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2023-10-14T19:02:19.760 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2023-10-14T19:02:19.760 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.760 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2023-10-14T19:02:19.760 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2023-10-14T19:02:19.760 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-14T19:02:19.761 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2023-10-14T19:02:19.761 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2023-10-14T19:02:19.761 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2023-10-14T19:02:19.761 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2023-10-14T19:02:19.761 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T19:02:19.761 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T19:02:19.762 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2023-10-14T19:02:19.762 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-10-14T19:02:19.762 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-14T19:02:19.762 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = "" 2023-10-14T19:02:19.762 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-10-14T19:02:19.763 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-10-14T19:02:19.763 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2023-10-14T19:02:19.763 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2023-10-14T19:02:19.763 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2023-10-14T19:02:19.763 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-10-14T19:02:19.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-10-14T19:02:19.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-10-14T19:02:19.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-10-14T19:02:19.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2023-10-14T19:02:19.764 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2023-10-14T19:02:19.764 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-14T19:02:19.765 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2023-10-14T19:02:19.765 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2023-10-14T19:02:19.765 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2023-10-14T19:02:19.765 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2023-10-14T19:02:19.765 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-10-14T19:02:19.766 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-10-14T19:02:19.766 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-10-14T19:02:19.766 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T19:02:19.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T19:02:19.839 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T19:02:19.840 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:19.840 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T19:02:19.857 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:19.858 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T19:02:19.912 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:02:19.913 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:19.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T19:02:19.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T19:02:20.162 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:20.162 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:20.181 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:02:20.181 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:20.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T19:02:20.182 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T19:02:20.218 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:20.218 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:20.273 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T19:02:20.274 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T19:02:20.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T19:02:20.324 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T19:02:20.326 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T19:02:20.395 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T19:02:20.398 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T19:02:20.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T19:02:20.450 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T19:02:20.452 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T19:02:20.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T19:02:20.567 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T19:02:20.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T19:02:20.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T19:02:20.643 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T19:02:20.645 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T19:02:20.669 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T19:02:20.757 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T19:02:20.759 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T19:02:20.784 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T19:02:20.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T19:02:20.823 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T19:02:20.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T19:02:20.915 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T19:02:20.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T19:02:20.966 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T19:02:20.979 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T19:02:21.057 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T19:02:21.069 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T19:02:21.070 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T19:02:21.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T19:02:21.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:21.097 INFO:tasks.ceph:role: osd.0 2023-10-14T19:02:21.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:02:21.098 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T19:02:21.162 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:21.162 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:21.162 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:21.163 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-10-14T19:02:21.163 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:21.163 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:21.163 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:21.163 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:21.164 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:21.164 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:21.185 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-14T19:02:21.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-14T19:02:21.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T19:02:21.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T19:02:21.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T19:02:21.430 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:21.430 INFO:tasks.ceph:role: osd.1 2023-10-14T19:02:21.431 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:02:21.431 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T19:02:21.495 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-10-14T19:02:21.497 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:21.498 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:21.498 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:21.499 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:21.517 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-14T19:02:21.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-14T19:02:21.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T19:02:21.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T19:02:21.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T19:02:21.732 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:21.732 INFO:tasks.ceph:role: osd.2 2023-10-14T19:02:21.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:02:21.733 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T19:02:21.796 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-10-14T19:02:21.797 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:21.797 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:21.797 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:21.798 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:21.818 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-14T19:02:21.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-14T19:02:21.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T19:02:21.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T19:02:21.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T19:02:22.033 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:22.033 INFO:tasks.ceph:role: osd.3 2023-10-14T19:02:22.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:02:22.034 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T19:02:22.098 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-10-14T19:02:22.099 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:22.100 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:22.100 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:22.100 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:22.121 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-10-14T19:02:22.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-10-14T19:02:22.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T19:02:22.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T19:02:22.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.365+0000 7faf65a72540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T19:02:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.366+0000 7faf65a72540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T19:02:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.366+0000 7faf65a72540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T19:02:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.366+0000 7faf65a72540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T19:02:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.366+0000 7faf65a72540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T19:02:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.366+0000 7faf65a72540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T19:02:22.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:22.891+0000 7faf65a72540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:23.656+0000 7faf65a72540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:24.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:24.419+0000 7faf65a72540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:25.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T19:02:25.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:25.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.332+0000 7f981a762540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T19:02:25.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.332+0000 7f981a762540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T19:02:25.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.333+0000 7f981a762540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T19:02:25.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.333+0000 7f981a762540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T19:02:25.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.333+0000 7f981a762540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T19:02:25.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.333+0000 7f981a762540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T19:02:25.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:25.855+0000 7f981a762540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:26.620+0000 7f981a762540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:27.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:27.383+0000 7f981a762540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:28.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T19:02:28.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:28.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.298+0000 7f5340efc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T19:02:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.298+0000 7f5340efc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T19:02:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.298+0000 7f5340efc540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T19:02:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.298+0000 7f5340efc540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T19:02:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.298+0000 7f5340efc540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T19:02:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.298+0000 7f5340efc540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T19:02:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:28.821+0000 7f5340efc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:29.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:29.582+0000 7f5340efc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:30.345+0000 7f5340efc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:31.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T19:02:31.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:31.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.256+0000 7fac384e5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T19:02:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.256+0000 7fac384e5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T19:02:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.256+0000 7fac384e5540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T19:02:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.256+0000 7fac384e5540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T19:02:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.257+0000 7fac384e5540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T19:02:31.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.257+0000 7fac384e5540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T19:02:31.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:31.783+0000 7fac384e5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:32.551+0000 7fac384e5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:33.313+0000 7fac384e5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:34.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T19:02:34.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T19:02:34.174 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:34.174 INFO:tasks.ceph:role: osd.4 2023-10-14T19:02:34.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:02:34.175 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T19:02:34.250 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-14T19:02:34.251 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:34.252 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:34.252 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:34.252 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:34.679 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-14T19:02:34.681 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-14T19:02:34.682 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T19:02:34.871 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T19:02:34.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T19:02:34.976 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:34.976 INFO:tasks.ceph:role: osd.5 2023-10-14T19:02:34.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:02:34.977 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T19:02:35.050 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:35.050 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:35.051 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:35.051 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-14T19:02:35.051 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:35.051 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:35.051 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:35.052 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:35.052 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:35.052 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:35.469 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-14T19:02:35.471 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-14T19:02:35.472 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T19:02:35.575 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T19:02:35.606 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T19:02:35.672 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:35.673 INFO:tasks.ceph:role: osd.6 2023-10-14T19:02:35.673 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:02:35.674 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T19:02:35.745 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:35.745 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:35.746 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:35.746 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-14T19:02:35.746 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:35.746 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:35.746 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:35.747 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:35.747 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:35.747 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:36.195 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-14T19:02:36.198 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-14T19:02:36.198 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T19:02:36.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T19:02:36.397 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T19:02:36.465 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T19:02:36.466 INFO:tasks.ceph:role: osd.7 2023-10-14T19:02:36.466 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:02:36.466 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T19:02:36.540 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T19:02:36.540 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T19:02:36.540 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T19:02:36.541 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-14T19:02:36.541 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T19:02:36.541 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-14T19:02:36.541 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T19:02:36.541 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T19:02:36.542 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T19:02:36.542 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T19:02:36.980 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-14T19:02:36.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-14T19:02:36.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T19:02:37.154 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T19:02:37.188 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.281+0000 7faeaac84540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T19:02:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.281+0000 7faeaac84540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T19:02:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.281+0000 7faeaac84540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T19:02:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.281+0000 7faeaac84540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T19:02:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.281+0000 7faeaac84540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T19:02:37.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.283+0000 7faeaac84540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T19:02:37.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:37.810+0000 7faeaac84540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:38.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:38.575+0000 7faeaac84540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:39.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:39.337+0000 7faeaac84540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:40.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T19:02:40.175 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:40.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.256+0000 7f72d5b62540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T19:02:40.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.257+0000 7f72d5b62540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T19:02:40.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.257+0000 7f72d5b62540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T19:02:40.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.257+0000 7f72d5b62540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T19:02:40.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.257+0000 7f72d5b62540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T19:02:40.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.257+0000 7f72d5b62540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T19:02:40.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:40.783+0000 7f72d5b62540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:41.554+0000 7f72d5b62540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:42.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:42.315+0000 7f72d5b62540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:43.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T19:02:43.182 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:43.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.266+0000 7f7b29bd7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T19:02:43.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.266+0000 7f7b29bd7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T19:02:43.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.266+0000 7f7b29bd7540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T19:02:43.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.266+0000 7f7b29bd7540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T19:02:43.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.266+0000 7f7b29bd7540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T19:02:43.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.267+0000 7f7b29bd7540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T19:02:43.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:43.797+0000 7f7b29bd7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:44.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:44.560+0000 7f7b29bd7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:45.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:45.322+0000 7f7b29bd7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:46.121 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T19:02:46.150 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:46.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.235+0000 7fe107416540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T19:02:46.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.235+0000 7fe107416540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T19:02:46.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.235+0000 7fe107416540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T19:02:46.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.235+0000 7fe107416540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T19:02:46.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.235+0000 7fe107416540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T19:02:46.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.236+0000 7fe107416540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T19:02:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:46.761+0000 7fe107416540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:47.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:47.527+0000 7fe107416540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:47.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:47.685 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:48.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:48.290+0000 7fe107416540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T19:02:49.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T19:02:49.115 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T19:02:49.116 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T19:02:49.152 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T19:02:49.221 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T19:02:49.289 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T19:02:49.357 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.357 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T19:02:49.426 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T19:02:49.493 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T19:02:49.560 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T19:02:49.589 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.589 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T19:02:49.656 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.656 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T19:02:49.722 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.723 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T19:02:49.788 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.788 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T19:02:49.852 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T19:02:49.917 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:49.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T19:02:49.981 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.982 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T19:02:49.997 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:49.998 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T19:02:50.053 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:50.053 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T19:02:50.070 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:50.071 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T19:02:50.125 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T19:02:50.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T19:02:50.127 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T19:02:50.170 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2023-10-14T19:02:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg== 2023-10-14T19:02:50.171 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2023-10-14T19:02:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w== 2023-10-14T19:02:50.171 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2023-10-14T19:02:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA== 2023-10-14T19:02:50.171 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2023-10-14T19:02:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA== 2023-10-14T19:02:50.172 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2023-10-14T19:02:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg== 2023-10-14T19:02:50.172 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2023-10-14T19:02:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w== 2023-10-14T19:02:50.173 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2023-10-14T19:02:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA== 2023-10-14T19:02:50.173 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2023-10-14T19:02:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ== 2023-10-14T19:02:50.173 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2023-10-14T19:02:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA== 2023-10-14T19:02:50.174 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2023-10-14T19:02:50.174 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q== 2023-10-14T19:02:50.174 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2023-10-14T19:02:50.174 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g== 2023-10-14T19:02:50.175 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2023-10-14T19:02:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA== 2023-10-14T19:02:50.175 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2023-10-14T19:02:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g== 2023-10-14T19:02:50.176 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2023-10-14T19:02:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg== 2023-10-14T19:02:50.176 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2023-10-14T19:02:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g== 2023-10-14T19:02:50.176 INFO:teuthology.orchestra.run.smithi007.stdout:[client.2] 2023-10-14T19:02:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g== 2023-10-14T19:02:50.177 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2023-10-14T19:02:50.177 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA== 2023-10-14T19:02:50.177 INFO:teuthology.orchestra.run.smithi007.stdout:[client.3] 2023-10-14T19:02:50.177 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg== 2023-10-14T19:02:50.187 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2023-10-14T19:02:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg== 2023-10-14T19:02:50.188 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-10-14T19:02:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w== 2023-10-14T19:02:50.188 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-10-14T19:02:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA== 2023-10-14T19:02:50.188 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2023-10-14T19:02:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA== 2023-10-14T19:02:50.189 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2023-10-14T19:02:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg== 2023-10-14T19:02:50.189 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2023-10-14T19:02:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w== 2023-10-14T19:02:50.190 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2023-10-14T19:02:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA== 2023-10-14T19:02:50.190 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2023-10-14T19:02:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ== 2023-10-14T19:02:50.191 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-10-14T19:02:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA== 2023-10-14T19:02:50.191 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-10-14T19:02:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q== 2023-10-14T19:02:50.191 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2023-10-14T19:02:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g== 2023-10-14T19:02:50.192 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2023-10-14T19:02:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA== 2023-10-14T19:02:50.192 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2023-10-14T19:02:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g== 2023-10-14T19:02:50.193 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2023-10-14T19:02:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg== 2023-10-14T19:02:50.193 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-10-14T19:02:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g== 2023-10-14T19:02:50.194 INFO:teuthology.orchestra.run.smithi148.stdout:[client.2] 2023-10-14T19:02:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g== 2023-10-14T19:02:50.194 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-10-14T19:02:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA== 2023-10-14T19:02:50.195 INFO:teuthology.orchestra.run.smithi148.stdout:[client.3] 2023-10-14T19:02:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg== 2023-10-14T19:02:50.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T19:02:50.221 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T19:02:50.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.286 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.338 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.440 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.490 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.541 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T19:02:50.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T19:02:50.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T19:02:50.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.747 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.797 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.847 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.896 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T19:02:50.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:50.946 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:50.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:51.000 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:51.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:51.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:51.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:51.105 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T19:02:51.155 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T19:02:51.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T19:02:51.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T19:02:51.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T19:02:51.299 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T19:02:51.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T19:02:51.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T19:02:51.439 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T19:02:51.504 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T19:02:51.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T19:02:51.619 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:51.621 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T19:02:51.674 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T19:02:51.674 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T19:02:51.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T19:02:51.677 INFO:tasks.ceph.mon.a:Started 2023-10-14T19:02:51.678 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T19:02:51.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T19:02:51.716 INFO:tasks.ceph.mon.b:Started 2023-10-14T19:02:51.716 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T19:02:51.717 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T19:02:51.719 INFO:tasks.ceph.mon.c:Started 2023-10-14T19:02:51.719 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T19:02:51.720 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T19:02:51.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T19:02:51.722 INFO:tasks.ceph.mgr.y:Started 2023-10-14T19:02:51.723 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T19:02:51.723 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T19:02:51.725 INFO:tasks.ceph.mgr.x:Started 2023-10-14T19:02:51.725 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T19:02:51.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T19:02:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.845+0000 7fc4b4ad4700 1 Processor -- start 2023-10-14T19:02:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.846+0000 7fc4b4ad4700 1 -- start start 2023-10-14T19:02:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.846+0000 7fc4b4ad4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 0x7fc4b00ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4b4ad4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc4b01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4b4ad4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00cddf0 con 0x7fc4b00675a0 2023-10-14T19:02:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4b4ad4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b00b0360 con 0x7fc4b01508b0 2023-10-14T19:02:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4b4ad4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00cd550 con 0x7fc4b0150c80 2023-10-14T19:02:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 0x7fc4b00ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 0x7fc4b00ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35582/0 (socket says 172.21.15.7:35582) 2023-10-14T19:02:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 -- 172.21.15.7:0/2280114507 learned_addr learned my addr 172.21.15.7:0/2280114507 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:02:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 -- 172.21.15.7:0/2280114507 >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 msgr2=0x7fc4b00ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T19:02:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 -- 172.21.15.7:0/2280114507 >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 msgr2=0x7fc4b00ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T19:02:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 --2- 172.21.15.7:0/2280114507 >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 0x7fc4b00ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T19:02:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4add9b700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc4b01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4ae59c700 1 --2- 172.21.15.7:0/2280114507 >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 0x7fc4b00ccec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T19:02:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4add9b700 1 -- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 msgr2=0x7fc4b01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T19:02:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4add9b700 1 -- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 msgr2=0x7fc4b01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T19:02:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4add9b700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc4b01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T19:02:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:51.847+0000 7fc4add9b700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc4b01573e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T19:02:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.031+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845020582 0 0) 0x7fc4b00cddf0 con 0x7fc4b00675a0 2023-10-14T19:02:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.031+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc498003570 con 0x7fc4b00675a0 2023-10-14T19:02:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986233471 0 0) 0x7fc498003570 con 0x7fc4b00675a0 2023-10-14T19:02:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 msgr2=0x7fc4b01573e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T19:02:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc4b01573e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 msgr2=0x7fc4b00ccec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T19:02:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 --2- 172.21.15.7:0/2280114507 >> v2:172.21.15.7:3300/0 conn(0x7fc4b01508b0 0x7fc4b00ccec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00cd830 con 0x7fc4b00675a0 2023-10-14T19:02:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fc4a80017f0 con 0x7fc4b00675a0 2023-10-14T19:02:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 >> v1:172.21.15.148:6789/0 conn(0x7fc4b00675a0 legacy=0x7fc4b00c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc498003ae0 0x7fc498003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc498004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498004d50 0x7fc4980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00b0360 con 0x7fc498004d50 2023-10-14T19:02:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00cd550 con 0x7fc498003ae0 2023-10-14T19:02:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49800bcc0 con 0x7fc4b0150c80 2023-10-14T19:02:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498004d50 0x7fc4980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4add9b700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc498004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.039+0000 7fc4ae59c700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc498003ae0 0x7fc498003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.040+0000 7fc4aed9d700 1 -- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 msgr2=0x7fc498004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.040+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4b0150c80 0x7fc498004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.040+0000 7fc4aed9d700 1 -- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc498003ae0 msgr2=0x7fc498003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.040+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc498003ae0 0x7fc498003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.040+0000 7fc4aed9d700 1 -- 172.21.15.7:0/2280114507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498003570 con 0x7fc498004d50 2023-10-14T19:02:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.040+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498004d50 0x7fc4980051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c500 tx=0x7fc4b00b02d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8857b192c939a33e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8016070 con 0x7fc498004d50 2023-10-14T19:02:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800ce30 con 0x7fc498004d50 2023-10-14T19:02:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4ad59a700 1 -- 172.21.15.7:0/2280114507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8003040 con 0x7fc498004d50 2023-10-14T19:02:52.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/2280114507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498004d50 msgr2=0x7fc4980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4b4ad4700 1 --2- 172.21.15.7:0/2280114507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498004d50 0x7fc4980051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c500 tx=0x7fc4b00b02d0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4aed9d700 1 -- 172.21.15.7:0/2280114507 reap_dead start 2023-10-14T19:02:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/2280114507 shutdown_connections 2023-10-14T19:02:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/2280114507 >> 172.21.15.7:0/2280114507 conn(0x7fc4b006d7b0 msgr2=0x7fc4b006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/2280114507 shutdown_connections 2023-10-14T19:02:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.041+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/2280114507 wait complete. 2023-10-14T19:02:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 Processor -- start 2023-10-14T19:02:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 -- start start 2023-10-14T19:02:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc498004d50 0x7fc4b01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4b0155cf0 0x7fc4b00cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 0x7fc4b00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0152060 con 0x7fc4b00cc370 2023-10-14T19:02:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0151450 con 0x7fc4b0155cf0 2023-10-14T19:02:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.043+0000 7fc4b4ad4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0151730 con 0x7fc498004d50 2023-10-14T19:02:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 0x7fc4b00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 0x7fc4b00c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35620/0 (socket says 172.21.15.7:35620) 2023-10-14T19:02:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 -- 172.21.15.7:0/364368730 learned_addr learned my addr 172.21.15.7:0/364368730 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:02:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4add9b700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4b0155cf0 0x7fc4b00cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4ae59c700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc498004d50 0x7fc4b01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 -- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc498004d50 msgr2=0x7fc4b01557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc498004d50 0x7fc4b01557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 -- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4b0155cf0 msgr2=0x7fc4b00cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4b0155cf0 0x7fc4b00cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 -- 172.21.15.7:0/364368730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0151a10 con 0x7fc4b00cc370 2023-10-14T19:02:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4add9b700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4b0155cf0 0x7fc4b00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:02:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4aed9d700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 0x7fc4b00c9550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000f80 tx=0x7fc4a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8022a60 con 0x7fc4b00cc370 2023-10-14T19:02:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a8022be0 con 0x7fc4b00cc370 2023-10-14T19:02:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.044+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b0151cf0 con 0x7fc4b00cc370 2023-10-14T19:02:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.045+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80127e0 con 0x7fc4b00cc370 2023-10-14T19:02:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.045+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b00c9a90 con 0x7fc4b00cc370 2023-10-14T19:02:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.045+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc4a8028070 con 0x7fc4b00cc370 2023-10-14T19:02:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.045+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc4a802b8b0 con 0x7fc4b00cc370 2023-10-14T19:02:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.045+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b004c3c0 con 0x7fc4b00cc370 2023-10-14T19:02:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.048+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc4a8004030 con 0x7fc4b00cc370 2023-10-14T19:02:52.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.123+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc4b00cdb10 con 0x7fc4b00cc370 2023-10-14T19:02:52.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.126+0000 7fc49e7fc700 1 -- 172.21.15.7:0/364368730 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc4a802bac0 con 0x7fc4b00cc370 2023-10-14T19:02:52.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 msgr2=0x7fc4b00c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 0x7fc4b00c9550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000f80 tx=0x7fc4a8016000 comp rx=0 tx=0).stop 2023-10-14T19:02:52.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 shutdown_connections 2023-10-14T19:02:52.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b00cc370 0x7fc4b00c9550 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc498004d50 0x7fc4b01557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 --2- 172.21.15.7:0/364368730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4b0155cf0 0x7fc4b00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 >> 172.21.15.7:0/364368730 conn(0x7fc4b006d7b0 msgr2=0x7fc4b0157090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:52.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 shutdown_connections 2023-10-14T19:02:52.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:52.127+0000 7fc4b4ad4700 1 -- 172.21.15.7:0/364368730 wait complete. 2023-10-14T19:02:52.130 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2023-10-14T19:02:52.139 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T19:02:52.140 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:52.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T19:02:52.165 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:52.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T19:02:52.230 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:52.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T19:02:52.295 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-10-14T19:02:52.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T19:02:52.360 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:52.360 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T19:02:52.385 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:52.386 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T19:02:52.450 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:52.451 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T19:02:52.516 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-14T19:02:52.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T19:02:52.580 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 942cc2af-e672-44bb-89b8-f9b68cee6fff 0 2023-10-14T19:02:52.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 Processor -- start 2023-10-14T19:02:52.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 -- start start 2023-10-14T19:02:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c156520 0x7f5d4c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5d4c06c6a0 0x7f5d4c06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c15aaf0 con 0x7f5d4c0af320 2023-10-14T19:02:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c15b2f0 con 0x7f5d4c06c6a0 2023-10-14T19:02:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d529e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c15ad30 con 0x7f5d4c156520 2023-10-14T19:02:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.737+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c156520 0x7f5d4c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d50f7e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5d4c06c6a0 0x7f5d4c06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5d4c0af320 0x7f5d4c15a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36316/0 (socket says 172.21.15.148:36316) 2023-10-14T19:02:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4b7fe700 1 -- 172.21.15.148:0/189348269 learned_addr learned my addr 172.21.15.148:0/189348269 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-14T19:02:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4bfff700 1 -- 172.21.15.148:0/189348269 >> v2:172.21.15.148:3300/0 conn(0x7f5d4c06c6a0 msgr2=0x7f5d4c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4bfff700 1 --2- 172.21.15.148:0/189348269 >> v2:172.21.15.148:3300/0 conn(0x7f5d4c06c6a0 0x7f5d4c06cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4bfff700 1 -- 172.21.15.148:0/189348269 >> v1:172.21.15.148:6789/0 conn(0x7f5d4c0af320 legacy=0x7f5d4c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4bfff700 1 -- 172.21.15.148:0/189348269 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c15b010 con 0x7f5d4c156520 2023-10-14T19:02:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4affd700 1 -- 172.21.15.148:0/189348269 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090724778 0 0) 0x7f5d3c001110 con 0x7f5d4c0af320 2023-10-14T19:02:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d50f7e700 1 --2- 172.21.15.148:0/189348269 >> v2:172.21.15.148:3300/0 conn(0x7f5d4c06c6a0 0x7f5d4c06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:02:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4bfff700 1 --2- 172.21.15.148:0/189348269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c156520 0x7f5d4c1568f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000b9a0 tx=0x7f5d400090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e17ffa97ac61134 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4affd700 1 -- 172.21.15.148:0/189348269 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000be90 con 0x7f5d4c156520 2023-10-14T19:02:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4affd700 1 -- 172.21.15.148:0/189348269 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000ca60 con 0x7f5d4c156520 2023-10-14T19:02:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.738+0000 7f5d4affd700 1 -- 172.21.15.148:0/189348269 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000ce20 con 0x7f5d4c156520 2023-10-14T19:02:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 -- 172.21.15.148:0/189348269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c156520 msgr2=0x7f5d4c1568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 --2- 172.21.15.148:0/189348269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c156520 0x7f5d4c1568f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000b9a0 tx=0x7f5d400090f0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 -- 172.21.15.148:0/189348269 shutdown_connections 2023-10-14T19:02:52.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 --2- 172.21.15.148:0/189348269 >> v2:172.21.15.148:3300/0 conn(0x7f5d4c06c6a0 0x7f5d4c06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 --2- 172.21.15.148:0/189348269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c156520 0x7f5d4c1568f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 -- 172.21.15.148:0/189348269 >> 172.21.15.148:0/189348269 conn(0x7f5d4c0675a0 msgr2=0x7f5d4c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:52.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 -- 172.21.15.148:0/189348269 shutdown_connections 2023-10-14T19:02:52.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.739+0000 7f5d529e1700 1 -- 172.21.15.148:0/189348269 wait complete. 2023-10-14T19:02:52.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.740+0000 7f5d529e1700 1 Processor -- start 2023-10-14T19:02:52.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.740+0000 7f5d529e1700 1 -- start start 2023-10-14T19:02:52.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d529e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c06c6a0 0x7f5d4c0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d529e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 0x7f5d4c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d529e1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4c156520 0x7f5d4c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d529e1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b2530 con 0x7f5d4c156520 2023-10-14T19:02:52.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d529e1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b2810 con 0x7f5d4c06c6a0 2023-10-14T19:02:52.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d529e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c165990 con 0x7f5d4c0af320 2023-10-14T19:02:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c06c6a0 0x7f5d4c0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 0x7f5d4c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 0x7f5d4c0b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36600/0 (socket says 172.21.15.148:36600) 2023-10-14T19:02:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 -- 172.21.15.148:0/57531550 learned_addr learned my addr 172.21.15.148:0/57531550 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d50f7e700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4c156520 0x7f5d4c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 -- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c06c6a0 msgr2=0x7f5d4c0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c06c6a0 0x7f5d4c0afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 -- 172.21.15.148:0/57531550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4c156520 msgr2=0x7f5d4c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4c156520 0x7f5d4c154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d4b7fe700 1 -- 172.21.15.148:0/57531550 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4400de30 con 0x7f5d4c0af320 2023-10-14T19:02:52.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.741+0000 7f5d50f7e700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4c156520 0x7f5d4c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:02:52.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d4b7fe700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 0x7f5d4c0b1b10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c7e0 tx=0x7f5d3c007c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:52.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c005b30 con 0x7f5d4c0af320 2023-10-14T19:02:52.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c005c90 con 0x7f5d4c0af320 2023-10-14T19:02:52.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4000b4e0 con 0x7f5d4c0af320 2023-10-14T19:02:52.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0072e0 con 0x7f5d4c0af320 2023-10-14T19:02:52.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c165660 con 0x7f5d4c0af320 2023-10-14T19:02:52.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5d3c01c6c0 con 0x7f5d4c0af320 2023-10-14T19:02:52.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.742+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5d3c012750 con 0x7f5d4c0af320 2023-10-14T19:02:52.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.743+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c165eb0 con 0x7f5d4c0af320 2023-10-14T19:02:52.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.745+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5d4c165eb0 con 0x7f5d4c0af320 2023-10-14T19:02:52.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.828+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "942cc2af-e672-44bb-89b8-f9b68cee6fff", "id": 0} v 0) v1 -- 0x7f5d4c04c3c0 con 0x7f5d4c0af320 2023-10-14T19:02:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.831+0000 7f5d33fff700 1 -- 172.21.15.148:0/57531550 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "942cc2af-e672-44bb-89b8-f9b68cee6fff", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d3c021060 con 0x7f5d4c0af320 2023-10-14T19:02:52.832 INFO:teuthology.orchestra.run.smithi148.stdout:0 2023-10-14T19:02:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 msgr2=0x7f5d4c0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 0x7f5d4c0b1b10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c7e0 tx=0x7f5d3c007c30 comp rx=0 tx=0).stop 2023-10-14T19:02:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 shutdown_connections 2023-10-14T19:02:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c06c6a0 0x7f5d4c0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4c156520 0x7f5d4c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 --2- 172.21.15.148:0/57531550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d4c0af320 0x7f5d4c0b1b10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 >> 172.21.15.148:0/57531550 conn(0x7f5d4c0675a0 msgr2=0x7f5d4c155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 shutdown_connections 2023-10-14T19:02:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.832+0000 7f5d529e1700 1 -- 172.21.15.148:0/57531550 wait complete. 2023-10-14T19:02:52.844 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 1d243c76-21f1-47ba-a948-2609db830d73 1 2023-10-14T19:02:52.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.959+0000 7f39a216e700 1 Processor -- start 2023-10-14T19:02:52.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.959+0000 7f39a216e700 1 -- start start 2023-10-14T19:02:52.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f39a216e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f39a216e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f399c06e0e0 0x7f399c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f39a216e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0ccfd0 con 0x7f399c06dc70 2023-10-14T19:02:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f39a216e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c0cf0e0 con 0x7f399c06e0e0 2023-10-14T19:02:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f39a216e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15a3d0 con 0x7f399c159530 2023-10-14T19:02:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f399c06e0e0 0x7f399c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f399c06e0e0 0x7f399c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55882/0 (socket says 172.21.15.148:55882) 2023-10-14T19:02:52.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36610/0 (socket says 172.21.15.148:36610) 2023-10-14T19:02:52.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f399c06dc70 0x7f399c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36328/0 (socket says 172.21.15.148:36328) 2023-10-14T19:02:52.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 -- 172.21.15.148:0/2602132905 learned_addr learned my addr 172.21.15.148:0/2602132905 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:52.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 -- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 msgr2=0x7f399c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:52.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 --2- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 -- 172.21.15.148:0/2602132905 >> v1:172.21.15.148:6789/0 conn(0x7f399c06dc70 legacy=0x7f399c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 -- 172.21.15.148:0/2602132905 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c15a6b0 con 0x7f399c06e0e0 2023-10-14T19:02:52.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399a7fc700 1 -- 172.21.15.148:0/2602132905 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583181356 0 0) 0x7f399c0ccfd0 con 0x7f399c06dc70 2023-10-14T19:02:52.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399bfff700 1 --2- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06e0e0 0x7f399c0cb6f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3994009f20 tx=0x7f3994009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d20e5cc41328d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:52.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399a7fc700 1 -- 172.21.15.148:0/2602132905 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400e070 con 0x7f399c06e0e0 2023-10-14T19:02:52.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399a7fc700 1 -- 172.21.15.148:0/2602132905 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399400b9d0 con 0x7f399c06e0e0 2023-10-14T19:02:52.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.960+0000 7f399a7fc700 1 -- 172.21.15.148:0/2602132905 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940092e0 con 0x7f399c06e0e0 2023-10-14T19:02:52.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 -- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06e0e0 msgr2=0x7f399c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 --2- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06e0e0 0x7f399c0cb6f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3994009f20 tx=0x7f3994009840 comp rx=0 tx=0).stop 2023-10-14T19:02:52.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 -- 172.21.15.148:0/2602132905 shutdown_connections 2023-10-14T19:02:52.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 --2- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06e0e0 0x7f399c0cb6f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 --2- 172.21.15.148:0/2602132905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 -- 172.21.15.148:0/2602132905 >> 172.21.15.148:0/2602132905 conn(0x7f399c0703a0 msgr2=0x7f399c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:52.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 -- 172.21.15.148:0/2602132905 shutdown_connections 2023-10-14T19:02:52.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.961+0000 7f39a216e700 1 -- 172.21.15.148:0/2602132905 wait complete. 2023-10-14T19:02:52.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.962+0000 7f39a216e700 1 Processor -- start 2023-10-14T19:02:52.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.962+0000 7f39a216e700 1 -- start start 2023-10-14T19:02:52.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f39a216e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 0x7f399c143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f39a216e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c06e0e0 0x7f399c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f39a216e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:52.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f39a216e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15de70 con 0x7f399c06e0e0 2023-10-14T19:02:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f39a216e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15db90 con 0x7f399c06dc70 2023-10-14T19:02:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f39a216e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0c7a40 con 0x7f399c159530 2023-10-14T19:02:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 0x7f399c143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 0x7f399c143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55886/0 (socket says 172.21.15.148:55886) 2023-10-14T19:02:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 -- 172.21.15.148:0/3265827785 learned_addr learned my addr 172.21.15.148:0/3265827785 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399bfff700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 -- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 msgr2=0x7f399c0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 -- 172.21.15.148:0/3265827785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c06e0e0 msgr2=0x7f399c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c06e0e0 0x7f399c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.963+0000 7f399b7fe700 1 -- 172.21.15.148:0/3265827785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994009ae0 con 0x7f399c06dc70 2023-10-14T19:02:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.964+0000 7f399b7fe700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 0x7f399c143700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f398c00e930 tx=0x7f398c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.964+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00c700 con 0x7f399c06dc70 2023-10-14T19:02:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.964+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c00c860 con 0x7f399c06dc70 2023-10-14T19:02:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.964+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00cc00 con 0x7f399c06dc70 2023-10-14T19:02:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.964+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c0c7d20 con 0x7f399c06dc70 2023-10-14T19:02:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.964+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c143c40 con 0x7f399c06dc70 2023-10-14T19:02:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.965+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f398c005c80 con 0x7f399c06dc70 2023-10-14T19:02:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.965+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f398c013470 con 0x7f399c06dc70 2023-10-14T19:02:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.965+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c04c3c0 con 0x7f399c06dc70 2023-10-14T19:02:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:52.967+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f398c021060 con 0x7f399c06dc70 2023-10-14T19:02:53.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.050+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d243c76-21f1-47ba-a948-2609db830d73", "id": 1} v 0) v1 -- 0x7f399c15a990 con 0x7f399c06dc70 2023-10-14T19:02:53.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.053+0000 7f39837fe700 1 -- 172.21.15.148:0/3265827785 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d243c76-21f1-47ba-a948-2609db830d73", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f398c02a0b0 con 0x7f399c06dc70 2023-10-14T19:02:53.054 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:02:53.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 msgr2=0x7f399c143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 0x7f399c143700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f398c00e930 tx=0x7f398c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 shutdown_connections 2023-10-14T19:02:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c06dc70 0x7f399c143700 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f399c159530 0x7f399c0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 --2- 172.21.15.148:0/3265827785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c06e0e0 0x7f399c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 >> 172.21.15.148:0/3265827785 conn(0x7f399c0703a0 msgr2=0x7f399c0c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 shutdown_connections 2023-10-14T19:02:53.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.054+0000 7f39a216e700 1 -- 172.21.15.148:0/3265827785 wait complete. 2023-10-14T19:02:53.067 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 75461d6c-1c54-48cf-beff-81c9b75e17e4 2 2023-10-14T19:02:53.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.183+0000 7fe92cbdf700 1 Processor -- start 2023-10-14T19:02:53.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.183+0000 7fe92cbdf700 1 -- start start 2023-10-14T19:02:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92cbdf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9281508b0 0x7fe9280ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92cbdf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280cddf0 con 0x7fe9280675a0 2023-10-14T19:02:53.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92cbdf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280b0360 con 0x7fe928150c80 2023-10-14T19:02:53.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92cbdf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cd550 con 0x7fe9281508b0 2023-10-14T19:02:53.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe925d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe928150c80 0x7fe9281573e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36336/0 (socket says 172.21.15.148:36336) 2023-10-14T19:02:53.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe925d9b700 1 -- 172.21.15.148:0/3373766583 learned_addr learned my addr 172.21.15.148:0/3373766583 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-14T19:02:53.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92659c700 1 --2- 172.21.15.148:0/3373766583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9281508b0 0x7fe9280ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92559a700 1 -- 172.21.15.148:0/3373766583 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388056595 0 0) 0x7fe9280b0360 con 0x7fe928150c80 2023-10-14T19:02:53.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92659c700 1 -- 172.21.15.148:0/3373766583 >> v1:172.21.15.148:6789/0 conn(0x7fe928150c80 legacy=0x7fe9281573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92659c700 1 -- 172.21.15.148:0/3373766583 >> v1:172.21.15.7:6789/0 conn(0x7fe9280675a0 legacy=0x7fe9280c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.184+0000 7fe92659c700 1 -- 172.21.15.148:0/3373766583 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280cd830 con 0x7fe9281508b0 2023-10-14T19:02:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92659c700 1 --2- 172.21.15.148:0/3373766583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9281508b0 0x7fe9280ccec0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009910 tx=0x7fe91c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=654d591edcf80e78 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92559a700 1 -- 172.21.15.148:0/3373766583 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00b860 con 0x7fe9281508b0 2023-10-14T19:02:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92559a700 1 -- 172.21.15.148:0/3373766583 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00b9c0 con 0x7fe9281508b0 2023-10-14T19:02:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92559a700 1 -- 172.21.15.148:0/3373766583 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00bd60 con 0x7fe9281508b0 2023-10-14T19:02:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 -- 172.21.15.148:0/3373766583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9281508b0 msgr2=0x7fe9280ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 --2- 172.21.15.148:0/3373766583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9281508b0 0x7fe9280ccec0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009910 tx=0x7fe91c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 -- 172.21.15.148:0/3373766583 shutdown_connections 2023-10-14T19:02:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 --2- 172.21.15.148:0/3373766583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9281508b0 0x7fe9280ccec0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 -- 172.21.15.148:0/3373766583 >> 172.21.15.148:0/3373766583 conn(0x7fe92806d7b0 msgr2=0x7fe92806dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 -- 172.21.15.148:0/3373766583 shutdown_connections 2023-10-14T19:02:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.185+0000 7fe92cbdf700 1 -- 172.21.15.148:0/3373766583 wait complete. 2023-10-14T19:02:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.186+0000 7fe92cbdf700 1 Processor -- start 2023-10-14T19:02:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.186+0000 7fe92cbdf700 1 -- start start 2023-10-14T19:02:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92cbdf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9280675a0 0x7fe928143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92cbdf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 0x7fe928169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92cbdf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 0x7fe928158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92cbdf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92816acf0 con 0x7fe9280675a0 2023-10-14T19:02:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92cbdf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe928144420 con 0x7fe9281508b0 2023-10-14T19:02:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92cbdf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281525e0 con 0x7fe928150c80 2023-10-14T19:02:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 0x7fe928158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe925d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 0x7fe928169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 0x7fe928158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36630/0 (socket says 172.21.15.148:36630) 2023-10-14T19:02:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe926d9d700 1 -- 172.21.15.148:0/1389191652 learned_addr learned my addr 172.21.15.148:0/1389191652 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe925d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 0x7fe928169d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55894/0 (socket says 172.21.15.148:55894) 2023-10-14T19:02:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.187+0000 7fe92659c700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9280675a0 0x7fe928143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe926d9d700 1 -- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 msgr2=0x7fe928169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe926d9d700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 0x7fe928169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe926d9d700 1 -- 172.21.15.148:0/1389191652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9280675a0 msgr2=0x7fe928143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe926d9d700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9280675a0 0x7fe928143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe926d9d700 1 -- 172.21.15.148:0/1389191652 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c009420 con 0x7fe928150c80 2023-10-14T19:02:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe925d9b700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 0x7fe928169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:02:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe926d9d700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 0x7fe928158ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe92000c8e0 tx=0x7fe920001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920012630 con 0x7fe928150c80 2023-10-14T19:02:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920012790 con 0x7fe928150c80 2023-10-14T19:02:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920012b50 con 0x7fe928150c80 2023-10-14T19:02:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92816a730 con 0x7fe928150c80 2023-10-14T19:02:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe928152270 con 0x7fe928150c80 2023-10-14T19:02:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe92001b400 con 0x7fe928150c80 2023-10-14T19:02:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.188+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fe92001a7d0 con 0x7fe928150c80 2023-10-14T19:02:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.189+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9281520d0 con 0x7fe928150c80 2023-10-14T19:02:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.191+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe9281520d0 con 0x7fe928150c80 2023-10-14T19:02:53.240 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:53.236+0000 7f5446d70180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T19:02:53.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.291+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "75461d6c-1c54-48cf-beff-81c9b75e17e4", "id": 2} v 0) v1 -- 0x7fe92804c3c0 con 0x7fe928150c80 2023-10-14T19:02:53.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.294+0000 7fe9167fc700 1 -- 172.21.15.148:0/1389191652 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "75461d6c-1c54-48cf-beff-81c9b75e17e4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe92001b890 con 0x7fe928150c80 2023-10-14T19:02:53.295 INFO:teuthology.orchestra.run.smithi148.stdout:2 2023-10-14T19:02:53.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 msgr2=0x7fe928158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 0x7fe928158ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe92000c8e0 tx=0x7fe920001710 comp rx=0 tx=0).stop 2023-10-14T19:02:53.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 shutdown_connections 2023-10-14T19:02:53.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe928150c80 0x7fe928158ea0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9280675a0 0x7fe928143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 --2- 172.21.15.148:0/1389191652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9281508b0 0x7fe928169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 >> 172.21.15.148:0/1389191652 conn(0x7fe92806d7b0 msgr2=0x7fe9280b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 shutdown_connections 2023-10-14T19:02:53.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.295+0000 7fe92cbdf700 1 -- 172.21.15.148:0/1389191652 wait complete. 2023-10-14T19:02:53.307 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 74248640-1684-49b9-8f38-46aa25877152 3 2023-10-14T19:02:53.375 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:53.374+0000 7f5446d70180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T19:02:53.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.423+0000 7f0867a07700 1 Processor -- start 2023-10-14T19:02:53.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.423+0000 7f0867a07700 1 -- start start 2023-10-14T19:02:53.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0867a07700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f086006dc70 0x7f0860159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0867a07700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006e0e0 0x7f08600cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0867a07700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08600ccfd0 con 0x7f0860159530 2023-10-14T19:02:53.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0867a07700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086015a3d0 con 0x7f086006dc70 2023-10-14T19:02:53.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0867a07700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086015a6b0 con 0x7f086006e0e0 2023-10-14T19:02:53.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0865fa4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006e0e0 0x7f08600cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f08657a3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0860159530 0x7f08600ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36346/0 (socket says 172.21.15.148:36346) 2023-10-14T19:02:53.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f08657a3700 1 -- 172.21.15.148:0/157815072 learned_addr learned my addr 172.21.15.148:0/157815072 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-14T19:02:53.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0864fa2700 1 --2- 172.21.15.148:0/157815072 >> v2:172.21.15.7:3300/0 conn(0x7f086006dc70 0x7f0860159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0865fa4700 1 -- 172.21.15.148:0/157815072 >> v2:172.21.15.7:3300/0 conn(0x7f086006dc70 msgr2=0x7f0860159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:53.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0865fa4700 1 --2- 172.21.15.148:0/157815072 >> v2:172.21.15.7:3300/0 conn(0x7f086006dc70 0x7f0860159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0857fff700 1 -- 172.21.15.148:0/157815072 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231263903 0 0) 0x7f08600ccfd0 con 0x7f0860159530 2023-10-14T19:02:53.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0865fa4700 1 -- 172.21.15.148:0/157815072 >> v1:172.21.15.148:6789/0 conn(0x7f0860159530 legacy=0x7f08600ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0865fa4700 1 -- 172.21.15.148:0/157815072 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086015a990 con 0x7f086006e0e0 2023-10-14T19:02:53.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0865fa4700 1 --2- 172.21.15.148:0/157815072 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006e0e0 0x7f08600cb6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e60 tx=0x7f0858009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f265a6fe15da0a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.424+0000 7f0857fff700 1 -- 172.21.15.148:0/157815072 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800e070 con 0x7f086006e0e0 2023-10-14T19:02:53.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0857fff700 1 -- 172.21.15.148:0/157815072 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800bb60 con 0x7f086006e0e0 2023-10-14T19:02:53.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0857fff700 1 -- 172.21.15.148:0/157815072 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858012430 con 0x7f086006e0e0 2023-10-14T19:02:53.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 -- 172.21.15.148:0/157815072 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006e0e0 msgr2=0x7f08600cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 --2- 172.21.15.148:0/157815072 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006e0e0 0x7f08600cb6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e60 tx=0x7f0858009780 comp rx=0 tx=0).stop 2023-10-14T19:02:53.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 -- 172.21.15.148:0/157815072 shutdown_connections 2023-10-14T19:02:53.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 --2- 172.21.15.148:0/157815072 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006e0e0 0x7f08600cb6f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 --2- 172.21.15.148:0/157815072 >> v2:172.21.15.7:3300/0 conn(0x7f086006dc70 0x7f0860159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 -- 172.21.15.148:0/157815072 >> 172.21.15.148:0/157815072 conn(0x7f08600703a0 msgr2=0x7f08600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 -- 172.21.15.148:0/157815072 shutdown_connections 2023-10-14T19:02:53.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.425+0000 7f0867a07700 1 -- 172.21.15.148:0/157815072 wait complete. 2023-10-14T19:02:53.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.426+0000 7f0867a07700 1 Processor -- start 2023-10-14T19:02:53.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.426+0000 7f0867a07700 1 -- start start 2023-10-14T19:02:53.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0867a07700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 0x7f086015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0867a07700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 0x7f086016cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0867a07700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0860159530 0x7f086016d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0867a07700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b4240 con 0x7f0860159530 2023-10-14T19:02:53.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0867a07700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0860151900 con 0x7f086006e0e0 2023-10-14T19:02:53.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0867a07700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086016db30 con 0x7f086006dc70 2023-10-14T19:02:53.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f08657a3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 0x7f086015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0864fa2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 0x7f086016cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0864fa2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 0x7f086016cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55908/0 (socket says 172.21.15.148:55908) 2023-10-14T19:02:53.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f08657a3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 0x7f086015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36646/0 (socket says 172.21.15.148:36646) 2023-10-14T19:02:53.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0864fa2700 1 -- 172.21.15.148:0/3848635231 learned_addr learned my addr 172.21.15.148:0/3848635231 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:53.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.427+0000 7f0865fa4700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0860159530 0x7f086016d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0864fa2700 1 -- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 msgr2=0x7f086015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0864fa2700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 0x7f086015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0864fa2700 1 -- 172.21.15.148:0/3848635231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0860159530 msgr2=0x7f086016d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0864fa2700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0860159530 0x7f086016d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0864fa2700 1 -- 172.21.15.148:0/3848635231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858009a20 con 0x7f086006e0e0 2023-10-14T19:02:53.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f08657a3700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 0x7f086015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:02:53.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0865fa4700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0860159530 0x7f086016d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:02:53.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0864fa2700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 0x7f086016cf90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f085000ec80 tx=0x7f08500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000c850 con 0x7f086006e0e0 2023-10-14T19:02:53.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000c9b0 con 0x7f086006e0e0 2023-10-14T19:02:53.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08600b3bf0 con 0x7f086006e0e0 2023-10-14T19:02:53.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000cd50 con 0x7f086006e0e0 2023-10-14T19:02:53.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086015dd60 con 0x7f086006e0e0 2023-10-14T19:02:53.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0850005c80 con 0x7f086006e0e0 2023-10-14T19:02:53.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.428+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f0850013680 con 0x7f086006e0e0 2023-10-14T19:02:53.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.429+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086015e040 con 0x7f086006e0e0 2023-10-14T19:02:53.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.431+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f086015e040 con 0x7f086006e0e0 2023-10-14T19:02:53.455 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:53.454+0000 7f5446d70180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T19:02:53.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.514+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74248640-1684-49b9-8f38-46aa25877152", "id": 3} v 0) v1 -- 0x7f086004c3c0 con 0x7f086006e0e0 2023-10-14T19:02:53.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.517+0000 7f08557fa700 1 -- 172.21.15.148:0/3848635231 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74248640-1684-49b9-8f38-46aa25877152", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0850021060 con 0x7f086006e0e0 2023-10-14T19:02:53.518 INFO:teuthology.orchestra.run.smithi148.stdout:3 2023-10-14T19:02:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 msgr2=0x7f086016cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 0x7f086016cf90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f085000ec80 tx=0x7f08500091a0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 shutdown_connections 2023-10-14T19:02:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0860159530 0x7f086016d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086006dc70 0x7f086015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 --2- 172.21.15.148:0/3848635231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086006e0e0 0x7f086016cf90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 >> 172.21.15.148:0/3848635231 conn(0x7f08600703a0 msgr2=0x7f08600cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 shutdown_connections 2023-10-14T19:02:53.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.518+0000 7f0867a07700 1 -- 172.21.15.148:0/3848635231 wait complete. 2023-10-14T19:02:53.531 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 6101231d-58ec-4867-a108-6ca74cbce304 4 2023-10-14T19:02:53.614 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:53.613+0000 7fba24ffc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T19:02:53.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.646+0000 7f2a49d0c700 1 Processor -- start 2023-10-14T19:02:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.646+0000 7f2a49d0c700 1 -- start start 2023-10-14T19:02:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.647+0000 7f2a49d0c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a44153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.647+0000 7f2a49d0c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 0x7f2a4415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.647+0000 7f2a49d0c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4415af60 con 0x7f2a440cea00 2023-10-14T19:02:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a49d0c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4415d010 con 0x7f2a4415de50 2023-10-14T19:02:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a49d0c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4415b240 con 0x7f2a44153a00 2023-10-14T19:02:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a43fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 0x7f2a4415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a44153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a43fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 0x7f2a4415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55920/0 (socket says 172.21.15.148:55920) 2023-10-14T19:02:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a4950b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2a440cea00 0x7f2a440cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36362/0 (socket says 172.21.15.148:36362) 2023-10-14T19:02:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a44153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36650/0 (socket says 172.21.15.148:36650) 2023-10-14T19:02:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a43fff700 1 -- 172.21.15.148:0/1183551036 learned_addr learned my addr 172.21.15.148:0/1183551036 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 -- 172.21.15.148:0/1183551036 >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 msgr2=0x7f2a4415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 --2- 172.21.15.148:0/1183551036 >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 0x7f2a4415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 -- 172.21.15.148:0/1183551036 >> v1:172.21.15.148:6789/0 conn(0x7f2a440cea00 legacy=0x7f2a440cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 -- 172.21.15.148:0/1183551036 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4415b520 con 0x7f2a44153a00 2023-10-14T19:02:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a43fff700 1 --2- 172.21.15.148:0/1183551036 >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 0x7f2a4415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:02:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a48d0a700 1 --2- 172.21.15.148:0/1183551036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a44153dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2a380098e0 tx=0x7f2a380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ed1e4ef7109cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.655 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f5446d70180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T19:02:53.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a437fe700 1 -- 172.21.15.148:0/1183551036 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38011630 con 0x7f2a44153a00 2023-10-14T19:02:53.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a437fe700 1 -- 172.21.15.148:0/1183551036 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a38011790 con 0x7f2a44153a00 2023-10-14T19:02:53.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.648+0000 7f2a437fe700 1 -- 172.21.15.148:0/1183551036 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38011b30 con 0x7f2a44153a00 2023-10-14T19:02:53.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 -- 172.21.15.148:0/1183551036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 msgr2=0x7f2a44153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/1183551036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a44153dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2a380098e0 tx=0x7f2a380091a0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 -- 172.21.15.148:0/1183551036 shutdown_connections 2023-10-14T19:02:53.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/1183551036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a44153dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/1183551036 >> v2:172.21.15.148:3300/0 conn(0x7f2a4415de50 0x7f2a4415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 -- 172.21.15.148:0/1183551036 >> 172.21.15.148:0/1183551036 conn(0x7f2a440703a0 msgr2=0x7f2a440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 -- 172.21.15.148:0/1183551036 shutdown_connections 2023-10-14T19:02:53.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.649+0000 7f2a49d0c700 1 -- 172.21.15.148:0/1183551036 wait complete. 2023-10-14T19:02:53.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.650+0000 7f2a49d0c700 1 Processor -- start 2023-10-14T19:02:53.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.650+0000 7f2a49d0c700 1 -- start start 2023-10-14T19:02:53.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a49d0c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440cea00 0x7f2a440cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a49d0c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a440b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a49d0c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 0x7f2a4414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a49d0c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b16c0 con 0x7f2a440cea00 2023-10-14T19:02:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a49d0c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b18d0 con 0x7f2a4415de50 2023-10-14T19:02:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a49d0c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b1bb0 con 0x7f2a44153a00 2023-10-14T19:02:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a43fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a440b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a4950b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 0x7f2a4414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a43fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a440b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36666/0 (socket says 172.21.15.148:36666) 2023-10-14T19:02:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a4950b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 0x7f2a4414b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55926/0 (socket says 172.21.15.148:55926) 2023-10-14T19:02:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a43fff700 1 -- 172.21.15.148:0/2915023165 learned_addr learned my addr 172.21.15.148:0/2915023165 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.651+0000 7f2a48d0a700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440cea00 0x7f2a440cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a4950b700 1 -- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 msgr2=0x7f2a440b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a4950b700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a440b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a4950b700 1 -- 172.21.15.148:0/2915023165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440cea00 msgr2=0x7f2a440cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a4950b700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440cea00 0x7f2a440cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a4950b700 1 -- 172.21.15.148:0/2915023165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300094f0 con 0x7f2a4415de50 2023-10-14T19:02:53.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a4950b700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 0x7f2a4414b100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00cda0 tx=0x7f2a3c001b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c005df0 con 0x7f2a4415de50 2023-10-14T19:02:53.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c00a870 con 0x7f2a4415de50 2023-10-14T19:02:53.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a38009420 con 0x7f2a4415de50 2023-10-14T19:02:53.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00ac30 con 0x7f2a4415de50 2023-10-14T19:02:53.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a440b2170 con 0x7f2a4415de50 2023-10-14T19:02:53.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2a3c007300 con 0x7f2a4415de50 2023-10-14T19:02:53.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.652+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f2a3c00ad90 con 0x7f2a4415de50 2023-10-14T19:02:53.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.653+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4404c3c0 con 0x7f2a4415de50 2023-10-14T19:02:53.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.655+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2a3c0077e0 con 0x7f2a4415de50 2023-10-14T19:02:53.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.738+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6101231d-58ec-4867-a108-6ca74cbce304", "id": 4} v 0) v1 -- 0x7f2a4415b800 con 0x7f2a4415de50 2023-10-14T19:02:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.741+0000 7f2a40ff9700 1 -- 172.21.15.148:0/2915023165 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6101231d-58ec-4867-a108-6ca74cbce304", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a3c0079a0 con 0x7f2a4415de50 2023-10-14T19:02:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:4 2023-10-14T19:02:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 msgr2=0x7f2a4414b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 0x7f2a4414b100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00cda0 tx=0x7f2a3c001b70 comp rx=0 tx=0).stop 2023-10-14T19:02:53.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 shutdown_connections 2023-10-14T19:02:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a4415de50 0x7f2a4414b100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440cea00 0x7f2a440cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 --2- 172.21.15.148:0/2915023165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a44153a00 0x7f2a440b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 >> 172.21.15.148:0/2915023165 conn(0x7f2a440703a0 msgr2=0x7f2a440d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 shutdown_connections 2023-10-14T19:02:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.742+0000 7f2a49d0c700 1 -- 172.21.15.148:0/2915023165 wait complete. 2023-10-14T19:02:53.752 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:53.752+0000 7fba24ffc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T19:02:53.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 70cdb79d-3d6d-4284-9841-90031af10c69 5 2023-10-14T19:02:53.829 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:53.829+0000 7f5446d70180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T19:02:53.831 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:53.830+0000 7fba24ffc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T19:02:53.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.867+0000 7f14bc8e1700 1 Processor -- start 2023-10-14T19:02:53.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.867+0000 7f14bc8e1700 1 -- start start 2023-10-14T19:02:53.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.868+0000 7f14bc8e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b8159530 0x7f14b80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.868+0000 7f14bc8e1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f14b806dc70 0x7f14b8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.868+0000 7f14bc8e1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80ccfd0 con 0x7f14b806e0e0 2023-10-14T19:02:53.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.868+0000 7f14bc8e1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80cf0e0 con 0x7f14b806dc70 2023-10-14T19:02:53.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.868+0000 7f14bc8e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b815a3d0 con 0x7f14b8159530 2023-10-14T19:02:53.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b5d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f14b806dc70 0x7f14b8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b6d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f14b806e0e0 0x7f14b80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36370/0 (socket says 172.21.15.148:36370) 2023-10-14T19:02:53.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b6d9d700 1 -- 172.21.15.148:0/3019555117 learned_addr learned my addr 172.21.15.148:0/3019555117 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-14T19:02:53.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b8159530 0x7f14b80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b659c700 1 -- 172.21.15.148:0/3019555117 >> v2:172.21.15.148:3300/0 conn(0x7f14b806dc70 msgr2=0x7f14b8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:53.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b659c700 1 --2- 172.21.15.148:0/3019555117 >> v2:172.21.15.148:3300/0 conn(0x7f14b806dc70 0x7f14b8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b659c700 1 -- 172.21.15.148:0/3019555117 >> v1:172.21.15.148:6789/0 conn(0x7f14b806e0e0 legacy=0x7f14b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b659c700 1 -- 172.21.15.148:0/3019555117 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b815a6b0 con 0x7f14b8159530 2023-10-14T19:02:53.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b559a700 1 -- 172.21.15.148:0/3019555117 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805290087 0 0) 0x7f14b80ccfd0 con 0x7f14b806e0e0 2023-10-14T19:02:53.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b5d9b700 1 --2- 172.21.15.148:0/3019555117 >> v2:172.21.15.148:3300/0 conn(0x7f14b806dc70 0x7f14b8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:02:53.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b659c700 1 --2- 172.21.15.148:0/3019555117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b8159530 0x7f14b80ceba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0098e0 tx=0x7f14ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc17e2e09837533 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b559a700 1 -- 172.21.15.148:0/3019555117 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00b640 con 0x7f14b8159530 2023-10-14T19:02:53.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b559a700 1 -- 172.21.15.148:0/3019555117 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00b7a0 con 0x7f14b8159530 2023-10-14T19:02:53.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.869+0000 7f14b559a700 1 -- 172.21.15.148:0/3019555117 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00bb40 con 0x7f14b8159530 2023-10-14T19:02:53.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 -- 172.21.15.148:0/3019555117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b8159530 msgr2=0x7f14b80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/3019555117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b8159530 0x7f14b80ceba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0098e0 tx=0x7f14ac0091a0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 -- 172.21.15.148:0/3019555117 shutdown_connections 2023-10-14T19:02:53.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/3019555117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b8159530 0x7f14b80ceba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/3019555117 >> v2:172.21.15.148:3300/0 conn(0x7f14b806dc70 0x7f14b8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 -- 172.21.15.148:0/3019555117 >> 172.21.15.148:0/3019555117 conn(0x7f14b80703a0 msgr2=0x7f14b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 -- 172.21.15.148:0/3019555117 shutdown_connections 2023-10-14T19:02:53.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.870+0000 7f14bc8e1700 1 -- 172.21.15.148:0/3019555117 wait complete. 2023-10-14T19:02:53.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.871+0000 7f14bc8e1700 1 Processor -- start 2023-10-14T19:02:53.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.871+0000 7f14bc8e1700 1 -- start start 2023-10-14T19:02:53.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14bc8e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 0x7f14b816a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14bc8e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b806e0e0 0x7f14b815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14bc8e1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b8159530 0x7f14b815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:53.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14bc8e1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80b6170 con 0x7f14b8159530 2023-10-14T19:02:53.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14bc8e1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b816ab80 con 0x7f14b806e0e0 2023-10-14T19:02:53.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14bc8e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80b5560 con 0x7f14b806dc70 2023-10-14T19:02:53.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 0x7f14b816a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 0x7f14b816a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36694/0 (socket says 172.21.15.148:36694) 2023-10-14T19:02:53.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 -- 172.21.15.148:0/2242026544 learned_addr learned my addr 172.21.15.148:0/2242026544 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:53.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b5d9b700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b806e0e0 0x7f14b815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b6d9d700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b8159530 0x7f14b815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:53.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 -- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b806e0e0 msgr2=0x7f14b815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b806e0e0 0x7f14b815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 -- 172.21.15.148:0/2242026544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b8159530 msgr2=0x7f14b815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b8159530 0x7f14b815e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 -- 172.21.15.148:0/2242026544 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009420 con 0x7f14b806dc70 2023-10-14T19:02:53.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b6d9d700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b8159530 0x7f14b815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:02:53.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14b659c700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 0x7f14b816a640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0093f0 tx=0x7f14ac017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:53.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.872+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00bb20 con 0x7f14b806dc70 2023-10-14T19:02:53.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac011420 con 0x7f14b806dc70 2023-10-14T19:02:53.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac009420 con 0x7f14b806dc70 2023-10-14T19:02:53.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0117c0 con 0x7f14b806dc70 2023-10-14T19:02:53.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b80b5b20 con 0x7f14b806dc70 2023-10-14T19:02:53.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f14ac02e3f0 con 0x7f14b806dc70 2023-10-14T19:02:53.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f14ac025970 con 0x7f14b806dc70 2023-10-14T19:02:53.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.873+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b804c3c0 con 0x7f14b806dc70 2023-10-14T19:02:53.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.875+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f14ac033060 con 0x7f14b806dc70 2023-10-14T19:02:53.910 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:53.909+0000 7f5446d70180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T19:02:53.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.958+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70cdb79d-3d6d-4284-9841-90031af10c69", "id": 5} v 0) v1 -- 0x7f14b815a990 con 0x7f14b806dc70 2023-10-14T19:02:53.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.962+0000 7f14a67fc700 1 -- 172.21.15.148:0/2242026544 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70cdb79d-3d6d-4284-9841-90031af10c69", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14ac015020 con 0x7f14b806dc70 2023-10-14T19:02:53.963 INFO:teuthology.orchestra.run.smithi148.stdout:5 2023-10-14T19:02:53.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.962+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 msgr2=0x7f14b816a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:53.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.962+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 0x7f14b816a640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0093f0 tx=0x7f14ac017000 comp rx=0 tx=0).stop 2023-10-14T19:02:53.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 shutdown_connections 2023-10-14T19:02:53.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b8159530 0x7f14b815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b806dc70 0x7f14b816a640 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 --2- 172.21.15.148:0/2242026544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b806e0e0 0x7f14b815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:53.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 >> 172.21.15.148:0/2242026544 conn(0x7f14b80703a0 msgr2=0x7f14b80b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:53.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 shutdown_connections 2023-10-14T19:02:53.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:53.963+0000 7f14bc8e1700 1 -- 172.21.15.148:0/2242026544 wait complete. 2023-10-14T19:02:53.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 76e33f44-085a-4b77-87e5-2cbc8c5c1783 6 2023-10-14T19:02:54.025 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:54.023+0000 7fba24ffc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T19:02:54.054 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:54.053+0000 7f5446d70180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T19:02:54.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.092+0000 7fab037fe700 1 Processor -- start 2023-10-14T19:02:54.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.092+0000 7fab037fe700 1 -- start start 2023-10-14T19:02:54.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab037fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc0c9ab0 0x7faafc1645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab037fe700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc068350 con 0x7faafc159970 2023-10-14T19:02:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab037fe700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc068db0 con 0x7faafc0cbbc0 2023-10-14T19:02:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab037fe700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc067740 con 0x7faafc0c9ab0 2023-10-14T19:02:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab01d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc0c9ab0 0x7faafc1645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab00d99700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faafc0cbbc0 0x7faafc0c93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36382/0 (socket says 172.21.15.148:36382) 2023-10-14T19:02:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab00d99700 1 -- 172.21.15.148:0/2665478727 learned_addr learned my addr 172.21.15.148:0/2665478727 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-14T19:02:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7faaf3fff700 1 -- 172.21.15.148:0/2665478727 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155453049 0 0) 0x7faafc068db0 con 0x7faafc0cbbc0 2023-10-14T19:02:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7faaf3fff700 1 -- 172.21.15.148:0/2665478727 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae8003570 con 0x7faafc0cbbc0 2023-10-14T19:02:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab01d9b700 1 -- 172.21.15.148:0/2665478727 >> v1:172.21.15.148:6789/0 conn(0x7faafc0cbbc0 legacy=0x7faafc0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab01d9b700 1 -- 172.21.15.148:0/2665478727 >> v1:172.21.15.7:6789/0 conn(0x7faafc159970 legacy=0x7faafc0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab01d9b700 1 -- 172.21.15.148:0/2665478727 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc067a20 con 0x7faafc0c9ab0 2023-10-14T19:02:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7fab01d9b700 1 --2- 172.21.15.148:0/2665478727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc0c9ab0 0x7faafc1645b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009e90 tx=0x7faaf4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5343eed7d4dcee72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7faaf3fff700 1 -- 172.21.15.148:0/2665478727 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf400e070 con 0x7faafc0c9ab0 2023-10-14T19:02:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7faaf3fff700 1 -- 172.21.15.148:0/2665478727 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf400bc30 con 0x7faafc0c9ab0 2023-10-14T19:02:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.093+0000 7faaf3fff700 1 -- 172.21.15.148:0/2665478727 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4012430 con 0x7faafc0c9ab0 2023-10-14T19:02:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 -- 172.21.15.148:0/2665478727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc0c9ab0 msgr2=0x7faafc1645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 --2- 172.21.15.148:0/2665478727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc0c9ab0 0x7faafc1645b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009e90 tx=0x7faaf4009780 comp rx=0 tx=0).stop 2023-10-14T19:02:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 -- 172.21.15.148:0/2665478727 shutdown_connections 2023-10-14T19:02:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 --2- 172.21.15.148:0/2665478727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc0c9ab0 0x7faafc1645b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 -- 172.21.15.148:0/2665478727 >> 172.21.15.148:0/2665478727 conn(0x7faafc06e250 msgr2=0x7faafc0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 -- 172.21.15.148:0/2665478727 shutdown_connections 2023-10-14T19:02:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.094+0000 7fab037fe700 1 -- 172.21.15.148:0/2665478727 wait complete. 2023-10-14T19:02:54.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.095+0000 7fab037fe700 1 Processor -- start 2023-10-14T19:02:54.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.095+0000 7fab037fe700 1 -- start start 2023-10-14T19:02:54.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab037fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faafc0c9ab0 0x7faafc1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab037fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faafc0cbbc0 0x7faafc0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab037fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 0x7faafc152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab037fe700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc15e750 con 0x7faafc0c9ab0 2023-10-14T19:02:54.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab037fe700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc15d6b0 con 0x7faafc0cbbc0 2023-10-14T19:02:54.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab037fe700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc15d990 con 0x7faafc159970 2023-10-14T19:02:54.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab01d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 0x7faafc152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab01d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 0x7faafc152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36718/0 (socket says 172.21.15.148:36718) 2023-10-14T19:02:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab00d99700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faafc0cbbc0 0x7faafc0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab01d9b700 1 -- 172.21.15.148:0/1219968646 learned_addr learned my addr 172.21.15.148:0/1219968646 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.096+0000 7fab0159a700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faafc0c9ab0 0x7faafc1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab01d9b700 1 -- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faafc0cbbc0 msgr2=0x7faafc0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab01d9b700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faafc0cbbc0 0x7faafc0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab01d9b700 1 -- 172.21.15.148:0/1219968646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faafc0c9ab0 msgr2=0x7faafc1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab01d9b700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faafc0c9ab0 0x7faafc1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab01d9b700 1 -- 172.21.15.148:0/1219968646 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4009a20 con 0x7faafc159970 2023-10-14T19:02:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab01d9b700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 0x7faafc152520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faaf4013000 tx=0x7faaf4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4027470 con 0x7faafc159970 2023-10-14T19:02:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40275d0 con 0x7faafc159970 2023-10-14T19:02:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4027970 con 0x7faafc159970 2023-10-14T19:02:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc15dc70 con 0x7faafc159970 2023-10-14T19:02:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc15e230 con 0x7faafc159970 2023-10-14T19:02:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faaf4024070 con 0x7faafc159970 2023-10-14T19:02:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.097+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7faaf401dcf0 con 0x7faafc159970 2023-10-14T19:02:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.098+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc04c3c0 con 0x7faafc159970 2023-10-14T19:02:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.101+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faaf40476d0 con 0x7faafc159970 2023-10-14T19:02:54.154 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:54.154+0000 7f5446d70180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T19:02:54.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.185+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "76e33f44-085a-4b77-87e5-2cbc8c5c1783", "id": 6} v 0) v1 -- 0x7faafc15dad0 con 0x7faafc159970 2023-10-14T19:02:54.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.191+0000 7faaf17fa700 1 -- 172.21.15.148:0/1219968646 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76e33f44-085a-4b77-87e5-2cbc8c5c1783", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7faafc15dad0 con 0x7faafc159970 2023-10-14T19:02:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:6 2023-10-14T19:02:54.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 msgr2=0x7faafc152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 0x7faafc152520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faaf4013000 tx=0x7faaf4019000 comp rx=0 tx=0).stop 2023-10-14T19:02:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 shutdown_connections 2023-10-14T19:02:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faafc159970 0x7faafc152520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faafc0c9ab0 0x7faafc1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 --2- 172.21.15.148:0/1219968646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faafc0cbbc0 0x7faafc0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 >> 172.21.15.148:0/1219968646 conn(0x7faafc06e250 msgr2=0x7faafc0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:54.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 shutdown_connections 2023-10-14T19:02:54.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.192+0000 7fab037fe700 1 -- 172.21.15.148:0/1219968646 wait complete. 2023-10-14T19:02:54.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new e6355a8a-7e5d-4807-91f9-eda538dfd32a 7 2023-10-14T19:02:54.206 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:54.205+0000 7fba24ffc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T19:02:54.286 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:54.286+0000 7fba24ffc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T19:02:54.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.320+0000 7f2ecffff700 1 Processor -- start 2023-10-14T19:02:54.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.320+0000 7f2ecffff700 1 -- start start 2023-10-14T19:02:54.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.320+0000 7f2ecffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ed0159b00 0x7f2ed006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed00cea30 0x7f2ed00b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecffff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00cf0b0 con 0x7f2ed006e3d0 2023-10-14T19:02:54.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecffff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed00ceed0 con 0x7f2ed0159b00 2023-10-14T19:02:54.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed006d520 con 0x7f2ed00cea30 2023-10-14T19:02:54.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2eceffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2ed006e3d0 0x7f2ed01593f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36390/0 (socket says 172.21.15.148:36390) 2023-10-14T19:02:54.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecf7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed00cea30 0x7f2ed00b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2eceffd700 1 -- 172.21.15.148:0/1125215142 learned_addr learned my addr 172.21.15.148:0/1125215142 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-14T19:02:54.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/1125215142 >> v2:172.21.15.7:3300/0 conn(0x7f2ed0159b00 0x7f2ed006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecdffb700 1 -- 172.21.15.148:0/1125215142 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169440965 0 0) 0x7f2ed00cf0b0 con 0x7f2ed006e3d0 2023-10-14T19:02:54.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecdffb700 1 -- 172.21.15.148:0/1125215142 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc003570 con 0x7f2ed006e3d0 2023-10-14T19:02:54.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/1125215142 >> v2:172.21.15.7:3300/0 conn(0x7f2ed0159b00 msgr2=0x7f2ed006e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecf7fe700 1 --2- 172.21.15.148:0/1125215142 >> v2:172.21.15.7:3300/0 conn(0x7f2ed0159b00 0x7f2ed006e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/1125215142 >> v1:172.21.15.148:6789/0 conn(0x7f2ed006e3d0 legacy=0x7f2ed01593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/1125215142 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00b1ce0 con 0x7f2ed00cea30 2023-10-14T19:02:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/1125215142 >> v2:172.21.15.7:3300/0 conn(0x7f2ed0159b00 0x7f2ed006e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:02:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecf7fe700 1 --2- 172.21.15.148:0/1125215142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed00cea30 0x7f2ed00b06b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00098e0 tx=0x7f2ec00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b05fd92c07d90ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecdffb700 1 -- 172.21.15.148:0/1125215142 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000b640 con 0x7f2ed00cea30 2023-10-14T19:02:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecdffb700 1 -- 172.21.15.148:0/1125215142 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000b7a0 con 0x7f2ed00cea30 2023-10-14T19:02:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.321+0000 7f2ecdffb700 1 -- 172.21.15.148:0/1125215142 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000bb40 con 0x7f2ed00cea30 2023-10-14T19:02:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 -- 172.21.15.148:0/1125215142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed00cea30 msgr2=0x7f2ed00b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 --2- 172.21.15.148:0/1125215142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed00cea30 0x7f2ed00b06b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00098e0 tx=0x7f2ec00091a0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 -- 172.21.15.148:0/1125215142 shutdown_connections 2023-10-14T19:02:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 --2- 172.21.15.148:0/1125215142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed00cea30 0x7f2ed00b06b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 --2- 172.21.15.148:0/1125215142 >> v2:172.21.15.7:3300/0 conn(0x7f2ed0159b00 0x7f2ed006e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 -- 172.21.15.148:0/1125215142 >> 172.21.15.148:0/1125215142 conn(0x7f2ed006ce80 msgr2=0x7f2ed00ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 -- 172.21.15.148:0/1125215142 shutdown_connections 2023-10-14T19:02:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.322+0000 7f2ecffff700 1 -- 172.21.15.148:0/1125215142 wait complete. 2023-10-14T19:02:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.323+0000 7f2ecffff700 1 Processor -- start 2023-10-14T19:02:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.323+0000 7f2ecffff700 1 -- start start 2023-10-14T19:02:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 0x7f2ed015f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed00cea30 0x7f2ed015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0159b00 0x7f2ed0169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecffff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015eb80 con 0x7f2ed00cea30 2023-10-14T19:02:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015df70 con 0x7f2ed0159b00 2023-10-14T19:02:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015e250 con 0x7f2ed006e3d0 2023-10-14T19:02:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 0x7f2ed015f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 0x7f2ed015f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:36746/0 (socket says 172.21.15.148:36746) 2023-10-14T19:02:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 -- 172.21.15.148:0/855620669 learned_addr learned my addr 172.21.15.148:0/855620669 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-14T19:02:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ecf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0159b00 0x7f2ed0169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed00cea30 0x7f2ed015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 -- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0159b00 msgr2=0x7f2ed0169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0159b00 0x7f2ed0169090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 -- 172.21.15.148:0/855620669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed00cea30 msgr2=0x7f2ed015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed00cea30 0x7f2ed015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 -- 172.21.15.148:0/855620669 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009420 con 0x7f2ed006e3d0 2023-10-14T19:02:54.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.324+0000 7f2eceffd700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 0x7f2ed015f010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800cb10 tx=0x7f2ec80027e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:54.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800ce20 con 0x7f2ed006e3d0 2023-10-14T19:02:54.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8005d80 con 0x7f2ed006e3d0 2023-10-14T19:02:54.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800a7e0 con 0x7f2ed006e3d0 2023-10-14T19:02:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed015e530 con 0x7f2ed006e3d0 2023-10-14T19:02:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed00b0590 con 0x7f2ed006e3d0 2023-10-14T19:02:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2ec800ac10 con 0x7f2ed006e3d0 2023-10-14T19:02:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.325+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f2ec801b400 con 0x7f2ed006e3d0 2023-10-14T19:02:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.326+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed015ee60 con 0x7f2ed006e3d0 2023-10-14T19:02:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.328+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2ec80070f0 con 0x7f2ed006e3d0 2023-10-14T19:02:54.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.409+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e6355a8a-7e5d-4807-91f9-eda538dfd32a", "id": 7} v 0) v1 -- 0x7f2ed0063230 con 0x7f2ed006e3d0 2023-10-14T19:02:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.417+0000 7f2ec6ffd700 1 -- 172.21.15.148:0/855620669 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6355a8a-7e5d-4807-91f9-eda538dfd32a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ec8007500 con 0x7f2ed006e3d0 2023-10-14T19:02:54.419 INFO:teuthology.orchestra.run.smithi148.stdout:7 2023-10-14T19:02:54.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 msgr2=0x7f2ed015f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 0x7f2ed015f010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800cb10 tx=0x7f2ec80027e0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 shutdown_connections 2023-10-14T19:02:54.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0159b00 0x7f2ed0169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed006e3d0 0x7f2ed015f010 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 --2- 172.21.15.148:0/855620669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed00cea30 0x7f2ed015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 >> 172.21.15.148:0/855620669 conn(0x7f2ed006ce80 msgr2=0x7f2ed01576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:54.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 shutdown_connections 2023-10-14T19:02:54.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-14T19:02:54.418+0000 7f2ecffff700 1 -- 172.21.15.148:0/855620669 wait complete. 2023-10-14T19:02:54.427 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:54.426+0000 7fba24ffc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T19:02:54.430 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T19:02:54.431 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T19:02:54.433 INFO:tasks.ceph.osd.0:Started 2023-10-14T19:02:54.434 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T19:02:54.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T19:02:54.436 INFO:tasks.ceph.osd.1:Started 2023-10-14T19:02:54.437 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T19:02:54.437 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T19:02:54.439 INFO:tasks.ceph.osd.2:Started 2023-10-14T19:02:54.440 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T19:02:54.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T19:02:54.442 INFO:tasks.ceph.osd.3:Started 2023-10-14T19:02:54.443 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T19:02:54.443 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T19:02:54.446 INFO:tasks.ceph.osd.4:Started 2023-10-14T19:02:54.447 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T19:02:54.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T19:02:54.450 INFO:tasks.ceph.osd.5:Started 2023-10-14T19:02:54.450 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T19:02:54.451 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T19:02:54.454 INFO:tasks.ceph.osd.6:Started 2023-10-14T19:02:54.455 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T19:02:54.456 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T19:02:54.458 INFO:tasks.ceph.osd.7:Started 2023-10-14T19:02:54.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:02:54.565 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:54.565+0000 7fba24ffc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T19:02:54.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.593+0000 7efec2209700 1 Processor -- start 2023-10-14T19:02:54.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.593+0000 7efec2209700 1 -- start start 2023-10-14T19:02:54.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efec2209700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efebc0a8be0 0x7efebc0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efec2209700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efebc0aee90 0x7efebc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efec2209700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0ce1a0 con 0x7efebc06d280 2023-10-14T19:02:54.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efec2209700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc0cd5d0 con 0x7efebc0a8be0 2023-10-14T19:02:54.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efec2209700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc0cd870 con 0x7efebc0aee90 2023-10-14T19:02:54.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efebb7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efebc0a8be0 0x7efebc0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efebaffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efebc06d280 0x7efebc0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52776/0 (socket says 172.21.15.7:52776) 2023-10-14T19:02:54.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efebaffd700 1 -- 172.21.15.7:0/4099341269 learned_addr learned my addr 172.21.15.7:0/4099341269 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:02:54.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.594+0000 7efebbfff700 1 --2- 172.21.15.7:0/4099341269 >> v2:172.21.15.148:3300/0 conn(0x7efebc0aee90 0x7efebc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efebb7fe700 1 -- 172.21.15.7:0/4099341269 >> v2:172.21.15.148:3300/0 conn(0x7efebc0aee90 msgr2=0x7efebc0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:54.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efebb7fe700 1 --2- 172.21.15.7:0/4099341269 >> v2:172.21.15.148:3300/0 conn(0x7efebc0aee90 0x7efebc0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efebb7fe700 1 -- 172.21.15.7:0/4099341269 >> v1:172.21.15.7:6789/0 conn(0x7efebc06d280 legacy=0x7efebc0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efebb7fe700 1 -- 172.21.15.7:0/4099341269 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0cdb50 con 0x7efebc0a8be0 2023-10-14T19:02:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efebbfff700 1 --2- 172.21.15.7:0/4099341269 >> v2:172.21.15.148:3300/0 conn(0x7efebc0aee90 0x7efebc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:02:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efebb7fe700 1 --2- 172.21.15.7:0/4099341269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0a8be0 0x7efebc0a8fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efebc06be40 tx=0x7efeac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ac2b6cea00ce88 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efeba7fc700 1 -- 172.21.15.7:0/4099341269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac005c10 con 0x7efebc0a8be0 2023-10-14T19:02:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efeba7fc700 1 -- 172.21.15.7:0/4099341269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac005d70 con 0x7efebc0a8be0 2023-10-14T19:02:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efeba7fc700 1 -- 172.21.15.7:0/4099341269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac006260 con 0x7efebc0a8be0 2023-10-14T19:02:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efec2209700 1 -- 172.21.15.7:0/4099341269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0a8be0 msgr2=0x7efebc0a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.595+0000 7efec2209700 1 --2- 172.21.15.7:0/4099341269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0a8be0 0x7efebc0a8fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efebc06be40 tx=0x7efeac009120 comp rx=0 tx=0).stop 2023-10-14T19:02:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.596+0000 7efec2209700 1 -- 172.21.15.7:0/4099341269 shutdown_connections 2023-10-14T19:02:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.596+0000 7efec2209700 1 --2- 172.21.15.7:0/4099341269 >> v2:172.21.15.148:3300/0 conn(0x7efebc0aee90 0x7efebc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.596+0000 7efec2209700 1 --2- 172.21.15.7:0/4099341269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0a8be0 0x7efebc0a8fb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.596+0000 7efec2209700 1 -- 172.21.15.7:0/4099341269 >> 172.21.15.7:0/4099341269 conn(0x7efebc06ce80 msgr2=0x7efebc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:54.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.596+0000 7efec2209700 1 -- 172.21.15.7:0/4099341269 shutdown_connections 2023-10-14T19:02:54.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.596+0000 7efec2209700 1 -- 172.21.15.7:0/4099341269 wait complete. 2023-10-14T19:02:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.597+0000 7efec2209700 1 Processor -- start 2023-10-14T19:02:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.597+0000 7efec2209700 1 -- start start 2023-10-14T19:02:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efebc06d280 0x7efebc0aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efebc0a8be0 0x7efebc0980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 0x7efebc0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc099370 con 0x7efebc0aee90 2023-10-14T19:02:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0987f0 con 0x7efebc06d280 2023-10-14T19:02:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc098ad0 con 0x7efebc0a8be0 2023-10-14T19:02:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 0x7efebc0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 0x7efebc0cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35666/0 (socket says 172.21.15.7:35666) 2023-10-14T19:02:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 -- 172.21.15.7:0/178939953 learned_addr learned my addr 172.21.15.7:0/178939953 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:02:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebb7fe700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efebc06d280 0x7efebc0aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebaffd700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efebc0a8be0 0x7efebc0980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 -- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efebc0a8be0 msgr2=0x7efebc0980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efebc0a8be0 0x7efebc0980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 -- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efebc06d280 msgr2=0x7efebc0aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efebc06d280 0x7efebc0aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 -- 172.21.15.7:0/178939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0093c0 con 0x7efebc0aee90 2023-10-14T19:02:54.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efebbfff700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 0x7efebc0cb9f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efeb400d150 tx=0x7efeb4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:54.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400dc90 con 0x7efebc0aee90 2023-10-14T19:02:54.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400f040 con 0x7efebc0aee90 2023-10-14T19:02:54.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc098db0 con 0x7efebc0aee90 2023-10-14T19:02:54.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.598+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4015690 con 0x7efebc0aee90 2023-10-14T19:02:54.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.599+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0cbf30 con 0x7efebc0aee90 2023-10-14T19:02:54.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.599+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efeb4015ac0 con 0x7efebc0aee90 2023-10-14T19:02:54.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.599+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7efeb401ea90 con 0x7efebc0aee90 2023-10-14T19:02:54.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.599+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc04c3c0 con 0x7efebc0aee90 2023-10-14T19:02:54.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.603+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7efeb401a070 con 0x7efebc0aee90 2023-10-14T19:02:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.673+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efebc067b20 con 0x7efebc0aee90 2023-10-14T19:02:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.674+0000 7efea37fe700 1 -- 172.21.15.7:0/178939953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7efeb401ed20 con 0x7efebc0aee90 2023-10-14T19:02:54.675 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:02:54.675 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:02:54.411483+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:02:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 msgr2=0x7efebc0cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 0x7efebc0cb9f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efeb400d150 tx=0x7efeb4009a50 comp rx=0 tx=0).stop 2023-10-14T19:02:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 shutdown_connections 2023-10-14T19:02:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efebc06d280 0x7efebc0aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efebc0aee90 0x7efebc0cb9f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 --2- 172.21.15.7:0/178939953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efebc0a8be0 0x7efebc0980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:54.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 >> 172.21.15.7:0/178939953 conn(0x7efebc06ce80 msgr2=0x7efebc0ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:54.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 shutdown_connections 2023-10-14T19:02:54.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:02:54.675+0000 7efec2209700 1 -- 172.21.15.7:0/178939953 wait complete. 2023-10-14T19:02:54.688 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T19:02:54.689 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T19:02:54.706 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:54.705+0000 7f5446d70180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T19:02:54.784 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:54.783+0000 7f5446d70180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T19:02:54.864 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:54.863+0000 7f5446d70180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T19:02:55.044 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-10-14T19:02:55.043+0000 7f8e96f85540 -1 Falling back to public interface 2023-10-14T19:02:55.046 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-10-14T19:02:55.045+0000 7fee17839540 -1 Falling back to public interface 2023-10-14T19:02:55.050 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-14T19:02:55.049+0000 7faabbc6c540 -1 Falling back to public interface 2023-10-14T19:02:55.050 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-14T19:02:55.050+0000 7f154a7a5540 -1 Falling back to public interface 2023-10-14T19:02:55.051 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-14T19:02:55.050+0000 7faab6095700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-10-14T19:02:55.054 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-14T19:02:55.053+0000 7f24e4f46540 -1 Falling back to public interface 2023-10-14T19:02:55.055 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-10-14T19:02:55.054+0000 7f59a53b3540 -1 Falling back to public interface 2023-10-14T19:02:55.064 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-14T19:02:55.063+0000 7fb757f3f540 -1 Falling back to public interface 2023-10-14T19:02:55.071 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-10-14T19:02:55.070+0000 7fb283ffe540 -1 Falling back to public interface 2023-10-14T19:02:55.116 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:55.116+0000 7fba24ffc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T19:02:55.197 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:55.197+0000 7fba24ffc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T19:02:55.279 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:55.278+0000 7fba24ffc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T19:02:55.437 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:55.436+0000 7f5446d70180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T19:02:55.495 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T19:02:55.574 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:55.573+0000 7f5446d70180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T19:02:55.604 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 Processor -- start 2023-10-14T19:02:55.605 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 -- start start 2023-10-14T19:02:55.607 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee980cd350 0x7fee9815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:55.607 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fee980caf50 0x7fee9815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:55.608 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980cc2b0 con 0x7fee980cd720 2023-10-14T19:02:55.608 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980cb6a0 con 0x7fee980cd350 2023-10-14T19:02:55.608 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.604+0000 7fee9e770700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980cb980 con 0x7fee980caf50 2023-10-14T19:02:55.608 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee97fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee980cd350 0x7fee9815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:55.608 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee977fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fee980cd720 0x7fee980ce580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52782/0 (socket says 172.21.15.7:52782) 2023-10-14T19:02:55.609 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee977fe700 1 -- 172.21.15.7:0/3301741020 learned_addr learned my addr 172.21.15.7:0/3301741020 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:02:55.609 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee9cd0d700 1 --2- 172.21.15.7:0/3301741020 >> v2:172.21.15.148:3300/0 conn(0x7fee980caf50 0x7fee9815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:55.609 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee97fff700 1 -- 172.21.15.7:0/3301741020 >> v2:172.21.15.148:3300/0 conn(0x7fee980caf50 msgr2=0x7fee9815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:02:55.609 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee97fff700 1 --2- 172.21.15.7:0/3301741020 >> v2:172.21.15.148:3300/0 conn(0x7fee980caf50 0x7fee9815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.609 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee97fff700 1 -- 172.21.15.7:0/3301741020 >> v1:172.21.15.7:6789/0 conn(0x7fee980cd720 legacy=0x7fee980ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:55.610 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee97fff700 1 -- 172.21.15.7:0/3301741020 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980cbc60 con 0x7fee980cd350 2023-10-14T19:02:55.610 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee96ffd700 1 -- 172.21.15.7:0/3301741020 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097324169 0 0) 0x7fee980cc2b0 con 0x7fee980cd720 2023-10-14T19:02:55.610 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee97fff700 1 --2- 172.21.15.7:0/3301741020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980cd350 0x7fee9815dfd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fee9815afc0 tx=0x7fee88009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216f0667fa5fb7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:55.610 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee96ffd700 1 -- 172.21.15.7:0/3301741020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88005c10 con 0x7fee980cd350 2023-10-14T19:02:55.610 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee96ffd700 1 -- 172.21.15.7:0/3301741020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88005d70 con 0x7fee980cd350 2023-10-14T19:02:55.611 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.605+0000 7fee96ffd700 1 -- 172.21.15.7:0/3301741020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88006260 con 0x7fee980cd350 2023-10-14T19:02:55.611 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 -- 172.21.15.7:0/3301741020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980cd350 msgr2=0x7fee9815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:55.611 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 --2- 172.21.15.7:0/3301741020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980cd350 0x7fee9815dfd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fee9815afc0 tx=0x7fee88009120 comp rx=0 tx=0).stop 2023-10-14T19:02:55.611 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 -- 172.21.15.7:0/3301741020 shutdown_connections 2023-10-14T19:02:55.611 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 --2- 172.21.15.7:0/3301741020 >> v2:172.21.15.148:3300/0 conn(0x7fee980caf50 0x7fee9815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.612 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 --2- 172.21.15.7:0/3301741020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980cd350 0x7fee9815dfd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.612 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 -- 172.21.15.7:0/3301741020 >> 172.21.15.7:0/3301741020 conn(0x7fee98099a70 msgr2=0x7fee9806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:55.612 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 -- 172.21.15.7:0/3301741020 shutdown_connections 2023-10-14T19:02:55.612 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.606+0000 7fee9e770700 1 -- 172.21.15.7:0/3301741020 wait complete. 2023-10-14T19:02:55.615 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.607+0000 7fee9e770700 1 Processor -- start 2023-10-14T19:02:55.615 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 -- start start 2023-10-14T19:02:55.615 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 0x7fee980c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:55.615 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980cd350 0x7fee9806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:55.615 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee980cd720 0x7fee9806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:02:55.616 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee980b3e00 con 0x7fee980caf50 2023-10-14T19:02:55.616 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9816d520 con 0x7fee980cd350 2023-10-14T19:02:55.616 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee9e770700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9816d800 con 0x7fee980cd720 2023-10-14T19:02:55.616 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee97fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 0x7fee980c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:55.616 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee97fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 0x7fee980c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35684/0 (socket says 172.21.15.7:35684) 2023-10-14T19:02:55.617 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.608+0000 7fee97fff700 1 -- 172.21.15.7:0/2002357553 learned_addr learned my addr 172.21.15.7:0/2002357553 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:02:55.617 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee977fe700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980cd350 0x7fee9806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:55.617 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee9cd0d700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee980cd720 0x7fee9806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:02:55.617 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee97fff700 1 -- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee980cd720 msgr2=0x7fee9806ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:55.618 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee97fff700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee980cd720 0x7fee9806ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.618 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee97fff700 1 -- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980cd350 msgr2=0x7fee9806ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:55.618 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee97fff700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980cd350 0x7fee9806ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.618 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee97fff700 1 -- 172.21.15.7:0/2002357553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880093c0 con 0x7fee980caf50 2023-10-14T19:02:55.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee97fff700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 0x7fee980c62e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fee88009f40 tx=0x7fee88016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:02:55.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8801a700 con 0x7fee980caf50 2023-10-14T19:02:55.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8801a860 con 0x7fee980caf50 2023-10-14T19:02:55.620 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8801ac20 con 0x7fee980caf50 2023-10-14T19:02:55.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9816dae0 con 0x7fee980caf50 2023-10-14T19:02:55.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9816e0a0 con 0x7fee980caf50 2023-10-14T19:02:55.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fee88011630 con 0x7fee980caf50 2023-10-14T19:02:55.621 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.609+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fee88026b10 con 0x7fee980caf50 2023-10-14T19:02:55.622 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.610+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9804c3c0 con 0x7fee980caf50 2023-10-14T19:02:55.622 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.612+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fee8802b060 con 0x7fee980caf50 2023-10-14T19:02:55.664 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:55.663+0000 7f5446d70180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T19:02:55.682 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.682+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee9816e290 con 0x7fee980caf50 2023-10-14T19:02:55.683 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.682+0000 7fee7ffff700 1 -- 172.21.15.7:0/2002357553 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fee88011a70 con 0x7fee980caf50 2023-10-14T19:02:55.684 INFO:teuthology.misc.health.smithi007.stdout: 2023-10-14T19:02:55.684 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:02:54.411483+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:02:55.685 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 msgr2=0x7fee980c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:02:55.685 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 0x7fee980c62e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fee88009f40 tx=0x7fee88016000 comp rx=0 tx=0).stop 2023-10-14T19:02:55.685 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 shutdown_connections 2023-10-14T19:02:55.685 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee980cd720 0x7fee9806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.686 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee980caf50 0x7fee980c62e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.686 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 --2- 172.21.15.7:0/2002357553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980cd350 0x7fee9806ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:02:55.686 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 >> 172.21.15.7:0/2002357553 conn(0x7fee98099a70 msgr2=0x7fee98158090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:02:55.686 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 shutdown_connections 2023-10-14T19:02:55.686 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:02:55.683+0000 7fee9e770700 1 -- 172.21.15.7:0/2002357553 wait complete. 2023-10-14T19:02:55.695 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T19:02:55.903 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:55.903+0000 7fba24ffc180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T19:02:55.914 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:55.913+0000 7f5446d70180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T19:02:55.991 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:55.990+0000 7f5446d70180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T19:02:56.047 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:56.047+0000 7fba24ffc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T19:02:56.142 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:56.142+0000 7fba24ffc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T19:02:56.401 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:56.400+0000 7fba24ffc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T19:02:56.482 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:56.481+0000 7fba24ffc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T19:02:56.848 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:56.847+0000 7f5446d70180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T19:02:56.921 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:56.921+0000 7f5446d70180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T19:02:56.996 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:56.995+0000 7f5446d70180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T19:02:57.129 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:57.129+0000 7f5446d70180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T19:02:57.214 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:57.213+0000 7f5446d70180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T19:02:57.346 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:57.346+0000 7fba24ffc180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T19:02:57.366 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:57.365+0000 7f5446d70180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T19:02:57.423 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:57.423+0000 7fba24ffc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T19:02:57.443 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:57.443+0000 7f5446d70180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T19:02:57.501 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:57.501+0000 7fba24ffc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T19:02:57.519 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:57.518+0000 7f5446d70180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T19:02:57.600 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:57.599+0000 7f5446d70180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T19:02:57.649 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:57.648+0000 7fba24ffc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T19:02:57.737 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:57.737+0000 7fba24ffc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T19:02:57.938 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:57.938+0000 7fba24ffc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T19:02:58.020 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:58.020+0000 7fba24ffc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T19:02:58.099 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:58.098+0000 7fba24ffc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T19:02:58.177 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-10-14T19:02:58.177+0000 7fba24ffc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T19:02:58.550 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-14T19:02:58.549+0000 7f154a7a5540 -1 osd.0 0 log_to_monitors true 2023-10-14T19:02:58.554 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-14T19:02:58.553+0000 7faabbc6c540 -1 osd.2 0 log_to_monitors true 2023-10-14T19:02:58.577 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-10-14T19:02:58.576+0000 7f8e96f85540 -1 osd.4 0 log_to_monitors true 2023-10-14T19:02:58.587 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-14T19:02:58.586+0000 7fb757f3f540 -1 osd.3 0 log_to_monitors true 2023-10-14T19:02:58.588 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-14T19:02:58.586+0000 7f24e4f46540 -1 osd.1 0 log_to_monitors true 2023-10-14T19:02:58.610 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-10-14T19:02:58.609+0000 7fee17839540 -1 osd.5 0 log_to_monitors true 2023-10-14T19:02:58.618 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-10-14T19:02:58.617+0000 7fb283ffe540 -1 osd.6 0 log_to_monitors true 2023-10-14T19:02:58.625 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:58.624+0000 7f540016f700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T19:02:58.626 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:02:58.625+0000 7f540016f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T19:02:58.628 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-10-14T19:02:58.627+0000 7f59a53b3540 -1 osd.7 0 log_to_monitors true 2023-10-14T19:03:01.103 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-14T19:03:01.102+0000 7f15413c7700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T19:03:01.108 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-10-14T19:03:01.107+0000 7f153a1be700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.123 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-14T19:03:01.122+0000 7faab4091700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T19:03:01.126 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-10-14T19:03:01.125+0000 7faaab685700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.151 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-14T19:03:01.150+0000 7fb74eb61700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T19:03:01.155 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-10-14T19:03:01.155+0000 7fb747958700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.160 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-14T19:03:01.159+0000 7f24dbb68700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T19:03:01.163 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-10-14T19:03:01.163+0000 7f24d495f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.777 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-10-14T19:03:01.776+0000 7fb27c423700 -1 osd.6 0 waiting for initial osdmap 2023-10-14T19:03:01.783 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-10-14T19:03:01.782+0000 7fb273a17700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.791 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-10-14T19:03:01.791+0000 7fee0e45b700 -1 osd.5 0 waiting for initial osdmap 2023-10-14T19:03:01.796 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-10-14T19:03:01.795+0000 7f8e8dba7700 -1 osd.4 0 waiting for initial osdmap 2023-10-14T19:03:01.798 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-10-14T19:03:01.795+0000 7fee07252700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.802 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-10-14T19:03:01.802+0000 7f8e8699e700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:01.812 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-10-14T19:03:01.811+0000 7f599bfd5700 -1 osd.7 0 waiting for initial osdmap 2023-10-14T19:03:01.815 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-10-14T19:03:01.815+0000 7f5994dcc700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T19:03:02.500 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:02.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.624+0000 7eff87a7b700 1 Processor -- start 2023-10-14T19:03:02.625 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.624+0000 7eff87a7b700 1 -- start start 2023-10-14T19:03:02.627 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff87a7b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff800cd350 0x7eff8015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.628 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff87a7b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff8015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.628 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff87a7b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800cc2b0 con 0x7eff800cd720 2023-10-14T19:03:02.628 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff87a7b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800cb3d0 con 0x7eff800cd350 2023-10-14T19:03:02.628 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff87a7b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff800cb6a0 con 0x7eff800caf50 2023-10-14T19:03:02.629 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff800cd350 0x7eff8015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.629 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff800cd350 0x7eff8015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50484/0 (socket says 172.21.15.7:50484) 2023-10-14T19:03:02.629 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 -- 172.21.15.7:0/4203675264 learned_addr learned my addr 172.21.15.7:0/4203675264 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:02.629 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff86018700 1 --2- 172.21.15.7:0/4203675264 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff8015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.630 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 -- 172.21.15.7:0/4203675264 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 msgr2=0x7eff8015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:02.630 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 --2- 172.21.15.7:0/4203675264 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff8015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.630 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 -- 172.21.15.7:0/4203675264 >> v1:172.21.15.148:6789/0 conn(0x7eff800cd720 legacy=0x7eff800ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.630 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 -- 172.21.15.7:0/4203675264 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800cb980 con 0x7eff800cd350 2023-10-14T19:03:02.631 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff85817700 1 --2- 172.21.15.7:0/4203675264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd350 0x7eff8015dfd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009f70 tx=0x7eff7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd4679a046b7b78 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:02.631 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.625+0000 7eff84815700 1 -- 172.21.15.7:0/4203675264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00e070 con 0x7eff800cd350 2023-10-14T19:03:02.631 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff84815700 1 -- 172.21.15.7:0/4203675264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c00ba20 con 0x7eff800cd350 2023-10-14T19:03:02.632 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff84815700 1 -- 172.21.15.7:0/4203675264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0092e0 con 0x7eff800cd350 2023-10-14T19:03:02.632 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 -- 172.21.15.7:0/4203675264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd350 msgr2=0x7eff8015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.632 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 --2- 172.21.15.7:0/4203675264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd350 0x7eff8015dfd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009f70 tx=0x7eff7c009840 comp rx=0 tx=0).stop 2023-10-14T19:03:02.632 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 -- 172.21.15.7:0/4203675264 shutdown_connections 2023-10-14T19:03:02.633 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 --2- 172.21.15.7:0/4203675264 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff8015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.633 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 --2- 172.21.15.7:0/4203675264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd350 0x7eff8015dfd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.633 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 -- 172.21.15.7:0/4203675264 >> 172.21.15.7:0/4203675264 conn(0x7eff80099a70 msgr2=0x7eff8006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:02.633 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 -- 172.21.15.7:0/4203675264 shutdown_connections 2023-10-14T19:03:02.633 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.626+0000 7eff87a7b700 1 -- 172.21.15.7:0/4203675264 wait complete. 2023-10-14T19:03:02.636 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.627+0000 7eff87a7b700 1 Processor -- start 2023-10-14T19:03:02.637 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.627+0000 7eff87a7b700 1 -- start start 2023-10-14T19:03:02.637 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff87a7b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff80157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.637 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff87a7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cd350 0x7eff800b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.637 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff87a7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 0x7eff800adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.638 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff87a7b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800b1a00 con 0x7eff800cd720 2023-10-14T19:03:02.638 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff87a7b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800b0be0 con 0x7eff800cd350 2023-10-14T19:03:02.638 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff87a7b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff800b0ec0 con 0x7eff800caf50 2023-10-14T19:03:02.638 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 0x7eff800adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.639 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 0x7eff800adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50500/0 (socket says 172.21.15.7:50500) 2023-10-14T19:03:02.639 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 -- 172.21.15.7:0/2979939720 learned_addr learned my addr 172.21.15.7:0/2979939720 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:02.639 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff85817700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff80157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.639 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff85016700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cd350 0x7eff800b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.640 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 -- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 msgr2=0x7eff80157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.640 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff80157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.640 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 -- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cd350 msgr2=0x7eff800b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.640 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cd350 0x7eff800b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.640 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.628+0000 7eff86018700 1 -- 172.21.15.7:0/2979939720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c009ae0 con 0x7eff800cd720 2023-10-14T19:03:02.641 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.629+0000 7eff86018700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 0x7eff800adeb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff7800ea50 tx=0x7eff780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:02.641 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.629+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800ee90 con 0x7eff800cd720 2023-10-14T19:03:02.641 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.629+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800c850 con 0x7eff800cd720 2023-10-14T19:03:02.641 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.629+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800cc10 con 0x7eff800cd720 2023-10-14T19:03:02.642 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.629+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff800b11a0 con 0x7eff800cd720 2023-10-14T19:03:02.642 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.629+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff801580e0 con 0x7eff800cd720 2023-10-14T19:03:02.642 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.630+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800b1bb0 con 0x7eff800cd720 2023-10-14T19:03:02.642 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.630+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7eff78013470 con 0x7eff800cd720 2023-10-14T19:03:02.642 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.631+0000 7eff75ffb700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff64066ea0 0x7eff64069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.643 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.631+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7eff780841a0 con 0x7eff800cd720 2023-10-14T19:03:02.643 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.631+0000 7eff85817700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff64066ea0 0x7eff64069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.643 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.631+0000 7eff85817700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff64066ea0 0x7eff64069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009880 tx=0x7eff7c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:02.643 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.635+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff800b1bb0 con 0x7eff800cd720 2023-10-14T19:03:02.831 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.831+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff8004c3c0 con 0x7eff800cd720 2023-10-14T19:03:02.832 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.831+0000 7eff75ffb700 1 -- 172.21.15.7:0/2979939720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7eff780553b0 con 0x7eff800cd720 2023-10-14T19:03:02.832 INFO:teuthology.misc.health.smithi007.stdout: 2023-10-14T19:03:02.833 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":13,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:01.948191+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:02.834 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff64066ea0 msgr2=0x7eff64069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.834 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff64066ea0 0x7eff64069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009880 tx=0x7eff7c018000 comp rx=0 tx=0).stop 2023-10-14T19:03:02.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 msgr2=0x7eff800adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 0x7eff800adeb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff7800ea50 tx=0x7eff780091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 shutdown_connections 2023-10-14T19:03:02.835 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff64066ea0 0x7eff64069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.836 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff800cd720 0x7eff800adeb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.836 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff800caf50 0x7eff80157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.836 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 --2- 172.21.15.7:0/2979939720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cd350 0x7eff800b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.836 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 >> 172.21.15.7:0/2979939720 conn(0x7eff80099a70 msgr2=0x7eff80158450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:02.836 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 shutdown_connections 2023-10-14T19:03:02.837 INFO:teuthology.misc.health.smithi007.stderr:2023-10-14T19:03:02.833+0000 7eff87a7b700 1 -- 172.21.15.7:0/2979939720 wait complete. 2023-10-14T19:03:02.845 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T19:03:02.845 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T19:03:02.846 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:03:02.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:03:02.848 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:03:02.849 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:03:02.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:03:02.851 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:03:02.852 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:03:02.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:03:02.855 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:03:02.855 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:03:02.855 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:03:02.857 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:03:02.858 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T19:03:02.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:02.924 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:03:02.925 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:03:02.931 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:03:02.932 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:03:02.932 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-10-14T19:03:02.932+0000 7f79e1789700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T19:03:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.982+0000 7f093dbe4700 1 Processor -- start 2023-10-14T19:03:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.982+0000 7f093dbe4700 1 -- start start 2023-10-14T19:03:02.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f093dbe4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09380c29b0 0x7f0938156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f093dbe4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09380c3a30 con 0x7f0938070410 2023-10-14T19:03:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f093dbe4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09380c2e20 con 0x7f093813fcc0 2023-10-14T19:03:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f093dbe4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09380c3100 con 0x7f09380c29b0 2023-10-14T19:03:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f0937fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0938070410 0x7f0938160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35690/0 (socket says 172.21.15.7:35690) 2023-10-14T19:03:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f0937fff700 1 -- 172.21.15.7:0/2078420640 learned_addr learned my addr 172.21.15.7:0/2078420640 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f0936ffd700 1 --2- 172.21.15.7:0/2078420640 >> v2:172.21.15.148:3300/0 conn(0x7f09380c29b0 0x7f0938156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535161695 0 0) 0x7f09380c3a30 con 0x7f0938070410 2023-10-14T19:03:02.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0920003570 con 0x7f0938070410 2023-10-14T19:03:02.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101175876 0 0) 0x7f09380c2e20 con 0x7f093813fcc0 2023-10-14T19:03:02.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09380c3a30 con 0x7f093813fcc0 2023-10-14T19:03:02.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.983+0000 7f0936ffd700 1 -- 172.21.15.7:0/2078420640 >> v1:172.21.15.148:6789/0 conn(0x7f093813fcc0 legacy=0x7f09380c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f0936ffd700 1 -- 172.21.15.7:0/2078420640 >> v1:172.21.15.7:6789/0 conn(0x7f0938070410 legacy=0x7f0938160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f0936ffd700 1 -- 172.21.15.7:0/2078420640 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380c33e0 con 0x7f09380c29b0 2023-10-14T19:03:02.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f0936ffd700 1 --2- 172.21.15.7:0/2078420640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f0938156af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f092c0098e0 tx=0x7f092c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3339748bb5400c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:02.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c011630 con 0x7f09380c29b0 2023-10-14T19:03:02.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c011790 con 0x7f09380c29b0 2023-10-14T19:03:02.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f09367fc700 1 -- 172.21.15.7:0/2078420640 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c011b30 con 0x7f09380c29b0 2023-10-14T19:03:02.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 -- 172.21.15.7:0/2078420640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 msgr2=0x7f0938156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 --2- 172.21.15.7:0/2078420640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f0938156af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f092c0098e0 tx=0x7f092c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 -- 172.21.15.7:0/2078420640 shutdown_connections 2023-10-14T19:03:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 --2- 172.21.15.7:0/2078420640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f0938156af0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 -- 172.21.15.7:0/2078420640 >> 172.21.15.7:0/2078420640 conn(0x7f09380ccb60 msgr2=0x7f09380ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 -- 172.21.15.7:0/2078420640 shutdown_connections 2023-10-14T19:03:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.984+0000 7f093dbe4700 1 -- 172.21.15.7:0/2078420640 wait complete. 2023-10-14T19:03:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 Processor -- start 2023-10-14T19:03:02.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 -- start start 2023-10-14T19:03:02.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 0x7f093813ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f09381595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f093813fcc0 0x7f093806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:02.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938159ae0 con 0x7f0938070410 2023-10-14T19:03:02.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938169570 con 0x7f09380c29b0 2023-10-14T19:03:02.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f093dbe4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0938169850 con 0x7f093813fcc0 2023-10-14T19:03:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f09377fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 0x7f093813ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f09377fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 0x7f093813ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50534/0 (socket says 172.21.15.7:50534) 2023-10-14T19:03:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f09377fe700 1 -- 172.21.15.7:0/165766841 learned_addr learned my addr 172.21.15.7:0/165766841 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.986+0000 7f0936ffd700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f09381595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f0937fff700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f093813fcc0 0x7f093806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:02.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f09377fe700 1 -- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f093813fcc0 msgr2=0x7f093806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f09377fe700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f093813fcc0 0x7f093806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f09377fe700 1 -- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 msgr2=0x7f09381595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:02.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f09377fe700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f09381595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:02.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f09377fe700 1 -- 172.21.15.7:0/165766841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c009420 con 0x7f0938070410 2023-10-14T19:03:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f09377fe700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 0x7f093813ca60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f092800c580 tx=0x7f0928007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928010510 con 0x7f0938070410 2023-10-14T19:03:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928010670 con 0x7f0938070410 2023-10-14T19:03:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0938169b30 con 0x7f0938070410 2023-10-14T19:03:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928010a30 con 0x7f0938070410 2023-10-14T19:03:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.987+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093816a0f0 con 0x7f0938070410 2023-10-14T19:03:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.988+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093804c3c0 con 0x7f0938070410 2023-10-14T19:03:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.988+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f092801b400 con 0x7f0938070410 2023-10-14T19:03:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.989+0000 7f091f7fe700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0924066ea0 0x7f0924069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.989+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f0928083be0 con 0x7f0938070410 2023-10-14T19:03:03.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.989+0000 7f0936ffd700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0924066ea0 0x7f0924069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.989+0000 7f0936ffd700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0924066ea0 0x7f0924069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f092c0093f0 tx=0x7f092c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:03.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:02.993+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0928051400 con 0x7f0938070410 2023-10-14T19:03:03.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.187+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09380c36c0 con 0x7f0938070410 2023-10-14T19:03:03.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.187+0000 7f091f7fe700 1 -- 172.21.15.7:0/165766841 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f0928054a20 con 0x7f0938070410 2023-10-14T19:03:03.188 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:03.189 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":14,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:03.172072+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.189+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0924066ea0 msgr2=0x7f0924069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.189+0000 7f093dbe4700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0924066ea0 0x7f0924069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f092c0093f0 tx=0x7f092c017000 comp rx=0 tx=0).stop 2023-10-14T19:03:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 msgr2=0x7f093813ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 0x7f093813ca60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f092800c580 tx=0x7f0928007e10 comp rx=0 tx=0).stop 2023-10-14T19:03:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 shutdown_connections 2023-10-14T19:03:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0924066ea0 0x7f0924069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f093813fcc0 0x7f093806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0938070410 0x7f093813ca60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 --2- 172.21.15.7:0/165766841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09380c29b0 0x7f09381595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 >> 172.21.15.7:0/165766841 conn(0x7f09380ccb60 msgr2=0x7f093813e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:03.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 shutdown_connections 2023-10-14T19:03:03.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.190+0000 7f093dbe4700 1 -- 172.21.15.7:0/165766841 wait complete. 2023-10-14T19:03:03.203 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-14T19:03:03.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:03.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.321+0000 7f623d117700 1 Processor -- start 2023-10-14T19:03:03.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.321+0000 7f623d117700 1 -- start start 2023-10-14T19:03:03.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.322+0000 7f623d117700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62380c3250 0x7f623815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.322+0000 7f623d117700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f623815aa20 0x7f6238163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.322+0000 7f623d117700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623806c7d0 con 0x7f6238143200 2023-10-14T19:03:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.322+0000 7f623d117700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62381171e0 con 0x7f623815aa20 2023-10-14T19:03:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.322+0000 7f623d117700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62380c37a0 con 0x7f62380c3250 2023-10-14T19:03:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f623815aa20 0x7f6238163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62380c3250 0x7f623815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6236d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6238143200 0x7f6238159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:59460/0 (socket says 172.21.15.7:59460) 2023-10-14T19:03:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6236d9d700 1 -- 172.21.15.7:0/2372075085 learned_addr learned my addr 172.21.15.7:0/2372075085 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6235d9b700 1 -- 172.21.15.7:0/2372075085 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188399466 0 0) 0x7f623806c7d0 con 0x7f6238143200 2023-10-14T19:03:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6235d9b700 1 -- 172.21.15.7:0/2372075085 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6224003570 con 0x7f6238143200 2023-10-14T19:03:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623659c700 1 -- 172.21.15.7:0/2372075085 >> v2:172.21.15.148:3300/0 conn(0x7f623815aa20 msgr2=0x7f6238163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623659c700 1 --2- 172.21.15.7:0/2372075085 >> v2:172.21.15.148:3300/0 conn(0x7f623815aa20 0x7f6238163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623659c700 1 -- 172.21.15.7:0/2372075085 >> v1:172.21.15.148:6789/0 conn(0x7f6238143200 legacy=0x7f6238159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623659c700 1 -- 172.21.15.7:0/2372075085 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380cc090 con 0x7f62380c3250 2023-10-14T19:03:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623759e700 1 --2- 172.21.15.7:0/2372075085 >> v2:172.21.15.148:3300/0 conn(0x7f623815aa20 0x7f6238163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f623659c700 1 --2- 172.21.15.7:0/2372075085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62380c3250 0x7f623815a4e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62200098e0 tx=0x7f62200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75cd5b2a230664d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6235d9b700 1 -- 172.21.15.7:0/2372075085 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220011630 con 0x7f62380c3250 2023-10-14T19:03:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6235d9b700 1 -- 172.21.15.7:0/2372075085 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220011790 con 0x7f62380c3250 2023-10-14T19:03:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.323+0000 7f6235d9b700 1 -- 172.21.15.7:0/2372075085 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220011b30 con 0x7f62380c3250 2023-10-14T19:03:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 -- 172.21.15.7:0/2372075085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62380c3250 msgr2=0x7f623815a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 --2- 172.21.15.7:0/2372075085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62380c3250 0x7f623815a4e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62200098e0 tx=0x7f62200091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 -- 172.21.15.7:0/2372075085 shutdown_connections 2023-10-14T19:03:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 --2- 172.21.15.7:0/2372075085 >> v2:172.21.15.148:3300/0 conn(0x7f623815aa20 0x7f6238163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 --2- 172.21.15.7:0/2372075085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62380c3250 0x7f623815a4e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 -- 172.21.15.7:0/2372075085 >> 172.21.15.7:0/2372075085 conn(0x7f62380ccb60 msgr2=0x7f62380ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 -- 172.21.15.7:0/2372075085 shutdown_connections 2023-10-14T19:03:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.324+0000 7f623d117700 1 -- 172.21.15.7:0/2372075085 wait complete. 2023-10-14T19:03:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.325+0000 7f623d117700 1 Processor -- start 2023-10-14T19:03:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.325+0000 7f623d117700 1 -- start start 2023-10-14T19:03:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623d117700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62380c3250 0x7f6238140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623d117700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 0x7f6238141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623d117700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f623815aa20 0x7f623816d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623d117700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623815cea0 con 0x7f6238143200 2023-10-14T19:03:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623d117700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623816df30 con 0x7f62380c3250 2023-10-14T19:03:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623d117700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623816a460 con 0x7f623815aa20 2023-10-14T19:03:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 0x7f6238141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 0x7f6238141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50546/0 (socket says 172.21.15.7:50546) 2023-10-14T19:03:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 -- 172.21.15.7:0/2945026374 learned_addr learned my addr 172.21.15.7:0/2945026374 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f6236d9d700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62380c3250 0x7f6238140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623759e700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f623815aa20 0x7f623816d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 -- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f623815aa20 msgr2=0x7f623816d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f623815aa20 0x7f623816d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 -- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62380c3250 msgr2=0x7f6238140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62380c3250 0x7f6238140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.326+0000 7f623659c700 1 -- 172.21.15.7:0/2945026374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230009420 con 0x7f6238143200 2023-10-14T19:03:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.327+0000 7f623659c700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 0x7f6238141070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6220009ed0 tx=0x7f6220017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.327+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220000d10 con 0x7f6238143200 2023-10-14T19:03:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.327+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220011b10 con 0x7f6238143200 2023-10-14T19:03:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.327+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6220009420 con 0x7f6238143200 2023-10-14T19:03:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.327+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220025640 con 0x7f6238143200 2023-10-14T19:03:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.327+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6238169e10 con 0x7f6238143200 2023-10-14T19:03:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.328+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623804c3c0 con 0x7f6238143200 2023-10-14T19:03:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.328+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6220025a30 con 0x7f6238143200 2023-10-14T19:03:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.328+0000 7f622effd700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6218066ea0 0x7f6218069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.329+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f6220085630 con 0x7f6238143200 2023-10-14T19:03:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.329+0000 7f6236d9d700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6218066ea0 0x7f6218069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.329+0000 7f6236d9d700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6218066ea0 0x7f6218069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f623813aa70 tx=0x7f6228009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.333+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6220052f10 con 0x7f6238143200 2023-10-14T19:03:03.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.573+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f623816a5a0 con 0x7f6238143200 2023-10-14T19:03:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.574+0000 7f622effd700 1 -- 172.21.15.7:0/2945026374 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f6220015090 con 0x7f6238143200 2023-10-14T19:03:03.575 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:03.575 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-14T19:03:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6218066ea0 msgr2=0x7f6218069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6218066ea0 0x7f6218069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f623813aa70 tx=0x7f6228009040 comp rx=0 tx=0).stop 2023-10-14T19:03:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 msgr2=0x7f6238141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 0x7f6238141070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6220009ed0 tx=0x7f6220017000 comp rx=0 tx=0).stop 2023-10-14T19:03:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 shutdown_connections 2023-10-14T19:03:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6218066ea0 0x7f6218069350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62380c3250 0x7f6238140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f623815aa20 0x7f623816d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 --2- 172.21.15.7:0/2945026374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6238143200 0x7f6238141070 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 >> 172.21.15.7:0/2945026374 conn(0x7f62380ccb60 msgr2=0x7f623806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 shutdown_connections 2023-10-14T19:03:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:03.576+0000 7f623d117700 1 -- 172.21.15.7:0/2945026374 wait complete. 2023-10-14T19:03:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2023-10-14T19:03:05.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:05.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.713+0000 7f2798665700 1 Processor -- start 2023-10-14T19:03:05.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.713+0000 7f2798665700 1 -- start start 2023-10-14T19:03:05.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2798665700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27900a8be0 0x7f27900a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:05.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2798665700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f279006d280 0x7f27900b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2798665700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900ce1a0 con 0x7f27900ae780 2023-10-14T19:03:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2798665700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27900cd5d0 con 0x7f279006d280 2023-10-14T19:03:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2798665700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900cd870 con 0x7f27900a8be0 2023-10-14T19:03:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f279006d280 0x7f27900b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f279006d280 0x7f27900b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50548/0 (socket says 172.21.15.7:50548) 2023-10-14T19:03:05.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 -- 172.21.15.7:0/4182578861 learned_addr learned my addr 172.21.15.7:0/4182578861 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:05.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2796401700 1 --2- 172.21.15.7:0/4182578861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27900a8be0 0x7f27900a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:05.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 -- 172.21.15.7:0/4182578861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27900a8be0 msgr2=0x7f27900a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:05.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 --2- 172.21.15.7:0/4182578861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27900a8be0 0x7f27900a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 -- 172.21.15.7:0/4182578861 >> v1:172.21.15.7:6789/0 conn(0x7f27900ae780 legacy=0x7f27900cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:05.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f27953ff700 1 -- 172.21.15.7:0/4182578861 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303391390 0 0) 0x7f27900ce1a0 con 0x7f27900ae780 2023-10-14T19:03:05.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 -- 172.21.15.7:0/4182578861 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900cdb50 con 0x7f279006d280 2023-10-14T19:03:05.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.714+0000 7f2795c00700 1 --2- 172.21.15.7:0/4182578861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279006d280 0x7f27900b08c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2780009990 tx=0x7f2780009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3358569d0bdc1859 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:05.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f27953ff700 1 -- 172.21.15.7:0/4182578861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780009e80 con 0x7f279006d280 2023-10-14T19:03:05.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f27953ff700 1 -- 172.21.15.7:0/4182578861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2780005c10 con 0x7f279006d280 2023-10-14T19:03:05.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f27953ff700 1 -- 172.21.15.7:0/4182578861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000b6e0 con 0x7f279006d280 2023-10-14T19:03:05.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f2798665700 1 -- 172.21.15.7:0/4182578861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279006d280 msgr2=0x7f27900b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:05.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f2798665700 1 --2- 172.21.15.7:0/4182578861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279006d280 0x7f27900b08c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2780009990 tx=0x7f2780009220 comp rx=0 tx=0).stop 2023-10-14T19:03:05.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f2798665700 1 -- 172.21.15.7:0/4182578861 shutdown_connections 2023-10-14T19:03:05.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f2798665700 1 --2- 172.21.15.7:0/4182578861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27900a8be0 0x7f27900a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f2798665700 1 --2- 172.21.15.7:0/4182578861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279006d280 0x7f27900b08c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.715+0000 7f2798665700 1 -- 172.21.15.7:0/4182578861 >> 172.21.15.7:0/4182578861 conn(0x7f279006ce80 msgr2=0x7f27900ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:05.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.716+0000 7f2798665700 1 -- 172.21.15.7:0/4182578861 shutdown_connections 2023-10-14T19:03:05.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.716+0000 7f2798665700 1 -- 172.21.15.7:0/4182578861 wait complete. 2023-10-14T19:03:05.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 Processor -- start 2023-10-14T19:03:05.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 -- start start 2023-10-14T19:03:05.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279006d280 0x7f2790099800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:05.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27900a8be0 0x7f279006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:05.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 0x7f27900c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:05.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790099ec0 con 0x7f27900ae780 2023-10-14T19:03:05.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279009a1a0 con 0x7f27900a8be0 2023-10-14T19:03:05.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.717+0000 7f2798665700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279009a480 con 0x7f279006d280 2023-10-14T19:03:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 0x7f27900c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 0x7f27900c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50558/0 (socket says 172.21.15.7:50558) 2023-10-14T19:03:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 -- 172.21.15.7:0/1776393144 learned_addr learned my addr 172.21.15.7:0/1776393144 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2795c00700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27900a8be0 0x7f279006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796401700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279006d280 0x7f2790099800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 -- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279006d280 msgr2=0x7f2790099800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279006d280 0x7f2790099800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 -- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27900a8be0 msgr2=0x7f279006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27900a8be0 0x7f279006e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 -- 172.21.15.7:0/1776393144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780009480 con 0x7f27900ae780 2023-10-14T19:03:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2796c02700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 0x7f27900c9910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f278800c890 tx=0x7f2788001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788012630 con 0x7f27900ae780 2023-10-14T19:03:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2788012790 con 0x7f27900ae780 2023-10-14T19:03:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279009a760 con 0x7f27900ae780 2023-10-14T19:03:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788012b50 con 0x7f27900ae780 2023-10-14T19:03:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.718+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27900ca010 con 0x7f27900ae780 2023-10-14T19:03:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.719+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279009aab0 con 0x7f27900ae780 2023-10-14T19:03:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.720+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f278801a3a0 con 0x7f27900ae780 2023-10-14T19:03:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.720+0000 7f27867fc700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2774066ea0 0x7f2774069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.720+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2788084220 con 0x7f27900ae780 2023-10-14T19:03:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.724+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27880518c0 con 0x7f27900ae780 2023-10-14T19:03:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.730+0000 7f2796401700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2774066ea0 0x7f2774069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:05.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.730+0000 7f2796401700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2774066ea0 0x7f2774069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f278c009da0 tx=0x7f278c009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.970+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2790067830 con 0x7f27900ae780 2023-10-14T19:03:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.970+0000 7f27867fc700 1 -- 172.21.15.7:0/1776393144 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f2788054ee0 con 0x7f27900ae780 2023-10-14T19:03:05.972 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:05.972 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-14T19:03:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.972+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2774066ea0 msgr2=0x7f2774069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.972+0000 7f2798665700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2774066ea0 0x7f2774069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f278c009da0 tx=0x7f278c009120 comp rx=0 tx=0).stop 2023-10-14T19:03:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.972+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 msgr2=0x7f27900c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.972+0000 7f2798665700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 0x7f27900c9910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f278800c890 tx=0x7f2788001670 comp rx=0 tx=0).stop 2023-10-14T19:03:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 shutdown_connections 2023-10-14T19:03:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2774066ea0 0x7f2774069350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27900ae780 0x7f27900c9910 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279006d280 0x7f2790099800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 --2- 172.21.15.7:0/1776393144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27900a8be0 0x7f279006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 >> 172.21.15.7:0/1776393144 conn(0x7f279006ce80 msgr2=0x7f27900b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 shutdown_connections 2023-10-14T19:03:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:05.973+0000 7f2798665700 1 -- 172.21.15.7:0/1776393144 wait complete. 2023-10-14T19:03:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2023-10-14T19:03:05.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:06.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.107+0000 7f64f42b2700 1 Processor -- start 2023-10-14T19:03:06.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.107+0000 7f64f42b2700 1 -- start start 2023-10-14T19:03:06.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f42b2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64ec0cb5a0 0x7f64ec0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f42b2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64ec0cd9e0 0x7f64ec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f42b2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec15ae40 con 0x7f64ec15a400 2023-10-14T19:03:06.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f42b2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec0d13f0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f42b2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec15ab60 con 0x7f64ec0cd9e0 2023-10-14T19:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f204e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64ec0cb5a0 0x7f64ec0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f284f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f64ec15a400 0x7f64ec156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35716/0 (socket says 172.21.15.7:35716) 2023-10-14T19:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f284f700 1 -- 172.21.15.7:0/224971942 learned_addr learned my addr 172.21.15.7:0/224971942 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.108+0000 7f64f184d700 1 --2- 172.21.15.7:0/224971942 >> v2:172.21.15.148:3300/0 conn(0x7f64ec0cd9e0 0x7f64ec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f204e700 1 -- 172.21.15.7:0/224971942 >> v2:172.21.15.148:3300/0 conn(0x7f64ec0cd9e0 msgr2=0x7f64ec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f204e700 1 --2- 172.21.15.7:0/224971942 >> v2:172.21.15.148:3300/0 conn(0x7f64ec0cd9e0 0x7f64ec159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f204e700 1 -- 172.21.15.7:0/224971942 >> v1:172.21.15.7:6789/0 conn(0x7f64ec15a400 legacy=0x7f64ec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f204e700 1 -- 172.21.15.7:0/224971942 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0ccf00 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f104c700 1 -- 172.21.15.7:0/224971942 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628463477 0 0) 0x7f64ec15ae40 con 0x7f64ec15a400 2023-10-14T19:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f204e700 1 --2- 172.21.15.7:0/224971942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec0cb970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009e60 tx=0x7f64dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28003025a8e8ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f104c700 1 -- 172.21.15.7:0/224971942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00e070 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f104c700 1 -- 172.21.15.7:0/224971942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc00bb20 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f104c700 1 -- 172.21.15.7:0/224971942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc012430 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f42b2700 1 -- 172.21.15.7:0/224971942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 msgr2=0x7f64ec0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.109+0000 7f64f42b2700 1 --2- 172.21.15.7:0/224971942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec0cb970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009e60 tx=0x7f64dc009780 comp rx=0 tx=0).stop 2023-10-14T19:03:06.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.110+0000 7f64f42b2700 1 -- 172.21.15.7:0/224971942 shutdown_connections 2023-10-14T19:03:06.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.110+0000 7f64f42b2700 1 --2- 172.21.15.7:0/224971942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec0cb970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.110+0000 7f64f42b2700 1 --2- 172.21.15.7:0/224971942 >> v2:172.21.15.148:3300/0 conn(0x7f64ec0cd9e0 0x7f64ec159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.110+0000 7f64f42b2700 1 -- 172.21.15.7:0/224971942 >> 172.21.15.7:0/224971942 conn(0x7f64ec070e30 msgr2=0x7f64ec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:06.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.110+0000 7f64f42b2700 1 -- 172.21.15.7:0/224971942 shutdown_connections 2023-10-14T19:03:06.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.110+0000 7f64f42b2700 1 -- 172.21.15.7:0/224971942 wait complete. 2023-10-14T19:03:06.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 Processor -- start 2023-10-14T19:03:06.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 -- start start 2023-10-14T19:03:06.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64ec0cd9e0 0x7f64ec1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64ec15a400 0x7f64ec0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec159ce0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0b4420 con 0x7f64ec15a400 2023-10-14T19:03:06.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.111+0000 7f64f42b2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec155740 con 0x7f64ec0cd9e0 2023-10-14T19:03:06.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50586/0 (socket says 172.21.15.7:50586) 2023-10-14T19:03:06.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 -- 172.21.15.7:0/4121674885 learned_addr learned my addr 172.21.15.7:0/4121674885 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:06.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f284f700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64ec15a400 0x7f64ec0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f184d700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64ec0cd9e0 0x7f64ec1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 -- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64ec0cd9e0 msgr2=0x7f64ec1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64ec0cd9e0 0x7f64ec1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 -- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64ec15a400 msgr2=0x7f64ec0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64ec15a400 0x7f64ec0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 -- 172.21.15.7:0/4121674885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc009a20 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f204e700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec155040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64ec06ea60 tx=0x7f64dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc012c80 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc012e40 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec155a20 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0266d0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.112+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec155fe0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.113+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec04c3c0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.114+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f64dc026a40 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.114+0000 7f64ea7fc700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f64d8066ea0 0x7f64d8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.114+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f64dc085e60 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.114+0000 7f64f184d700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f64d8066ea0 0x7f64d8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.115+0000 7f64f184d700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f64d8066ea0 0x7f64d8069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b2f50 tx=0x7f64e00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.119+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64dc053500 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.186+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64dc026cf0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.314+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64ec0cd1e0 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.403+0000 7f64ea7fc700 1 -- 172.21.15.7:0/4121674885 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f64dc056f90 con 0x7f64ec0cb5a0 2023-10-14T19:03:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:06.405 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:06.180069+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:06.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f64d8066ea0 msgr2=0x7f64d8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f64d8066ea0 0x7f64d8069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b2f50 tx=0x7f64e00091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 msgr2=0x7f64ec155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec155040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64ec06ea60 tx=0x7f64dc019000 comp rx=0 tx=0).stop 2023-10-14T19:03:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 shutdown_connections 2023-10-14T19:03:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f64d8066ea0 0x7f64d8069350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64ec15a400 0x7f64ec0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0cb5a0 0x7f64ec155040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 --2- 172.21.15.7:0/4121674885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64ec0cd9e0 0x7f64ec1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 >> 172.21.15.7:0/4121674885 conn(0x7f64ec070e30 msgr2=0x7f64ec0cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 shutdown_connections 2023-10-14T19:03:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.405+0000 7f64f42b2700 1 -- 172.21.15.7:0/4121674885 wait complete. 2023-10-14T19:03:06.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:03:06.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:06.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.540+0000 7f4915956700 1 Processor -- start 2023-10-14T19:03:06.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.540+0000 7f4915956700 1 -- start start 2023-10-14T19:03:06.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f4915956700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f491006d490 0x7f491006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f4915956700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491006c740 con 0x7f49100703a0 2023-10-14T19:03:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f4915956700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491006c9b0 con 0x7f4910159790 2023-10-14T19:03:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f4915956700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491006de30 con 0x7f491006d490 2023-10-14T19:03:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f490e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49100703a0 0x7f49100c7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35724/0 (socket says 172.21.15.7:35724) 2023-10-14T19:03:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f490e7fc700 1 -- 172.21.15.7:0/2847864920 learned_addr learned my addr 172.21.15.7:0/2847864920 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:06.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.541+0000 7f490f7fe700 1 --2- 172.21.15.7:0/2847864920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f491006d490 0x7f491006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484215193 0 0) 0x7f491006c740 con 0x7f49100703a0 2023-10-14T19:03:06.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f8003570 con 0x7f49100703a0 2023-10-14T19:03:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555640716 0 0) 0x7f491006c9b0 con 0x7f4910159790 2023-10-14T19:03:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f491006c740 con 0x7f4910159790 2023-10-14T19:03:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490f7fe700 1 -- 172.21.15.7:0/2847864920 >> v1:172.21.15.148:6789/0 conn(0x7f4910159790 legacy=0x7f491006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490f7fe700 1 -- 172.21.15.7:0/2847864920 >> v1:172.21.15.7:6789/0 conn(0x7f49100703a0 legacy=0x7f49100c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490f7fe700 1 -- 172.21.15.7:0/2847864920 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491006cc90 con 0x7f491006d490 2023-10-14T19:03:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490f7fe700 1 --2- 172.21.15.7:0/2847864920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f491006d490 0x7f491006d8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4908009e90 tx=0x7f4908009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a4a7a4cb645e40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490800e070 con 0x7f491006d490 2023-10-14T19:03:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490800bb80 con 0x7f491006d490 2023-10-14T19:03:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.542+0000 7f490dffb700 1 -- 172.21.15.7:0/2847864920 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908012430 con 0x7f491006d490 2023-10-14T19:03:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 -- 172.21.15.7:0/2847864920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f491006d490 msgr2=0x7f491006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 --2- 172.21.15.7:0/2847864920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f491006d490 0x7f491006d8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4908009e90 tx=0x7f4908009780 comp rx=0 tx=0).stop 2023-10-14T19:03:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 -- 172.21.15.7:0/2847864920 shutdown_connections 2023-10-14T19:03:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 --2- 172.21.15.7:0/2847864920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f491006d490 0x7f491006d8f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 -- 172.21.15.7:0/2847864920 >> 172.21.15.7:0/2847864920 conn(0x7f491006ecd0 msgr2=0x7f491006f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 -- 172.21.15.7:0/2847864920 shutdown_connections 2023-10-14T19:03:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.543+0000 7f4915956700 1 -- 172.21.15.7:0/2847864920 wait complete. 2023-10-14T19:03:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.544+0000 7f4915956700 1 Processor -- start 2023-10-14T19:03:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.544+0000 7f4915956700 1 -- start start 2023-10-14T19:03:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f4915956700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f491006d490 0x7f49101467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f4915956700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49100703a0 0x7f491014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f4915956700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 0x7f49100c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f4915956700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910152670 con 0x7f4910159790 2023-10-14T19:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f4915956700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910150270 con 0x7f491006d490 2023-10-14T19:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f4915956700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4910151090 con 0x7f49100703a0 2023-10-14T19:03:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f490f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 0x7f49100c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f490f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 0x7f49100c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50600/0 (socket says 172.21.15.7:50600) 2023-10-14T19:03:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f490f7fe700 1 -- 172.21.15.7:0/1956144130 learned_addr learned my addr 172.21.15.7:0/1956144130 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f490e7fc700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49100703a0 0x7f491014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.545+0000 7f490effd700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f491006d490 0x7f49101467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490f7fe700 1 -- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49100703a0 msgr2=0x7f491014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490f7fe700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49100703a0 0x7f491014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490f7fe700 1 -- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f491006d490 msgr2=0x7f49101467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490f7fe700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f491006d490 0x7f49101467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490f7fe700 1 -- 172.21.15.7:0/1956144130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009a20 con 0x7f4910159790 2023-10-14T19:03:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490e7fc700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49100703a0 0x7f491014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f490f7fe700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 0x7f49100c1790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4910069c00 tx=0x7f4908019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908027470 con 0x7f4910159790 2023-10-14T19:03:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49080275f0 con 0x7f4910159790 2023-10-14T19:03:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4910146d20 con 0x7f4910159790 2023-10-14T19:03:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49080279b0 con 0x7f4910159790 2023-10-14T19:03:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.546+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4910150760 con 0x7f4910159790 2023-10-14T19:03:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.547+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910151420 con 0x7f4910159790 2023-10-14T19:03:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.548+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4908024070 con 0x7f4910159790 2023-10-14T19:03:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.548+0000 7f48f6ffd700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.548+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4908086960 con 0x7f4910159790 2023-10-14T19:03:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.548+0000 7f490effd700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.549+0000 7f490effd700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f48fc066f30 0x7f48fc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4900007fd0 tx=0x7f4900007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.553+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4908053f20 con 0x7f4910159790 2023-10-14T19:03:06.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.745+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f491004c3c0 con 0x7f4910159790 2023-10-14T19:03:06.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.746+0000 7f48f6ffd700 1 -- 172.21.15.7:0/1956144130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4908057540 con 0x7f4910159790 2023-10-14T19:03:06.747 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:06.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f48fc066f30 msgr2=0x7f48fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f48fc066f30 0x7f48fc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4900007fd0 tx=0x7f4900007d10 comp rx=0 tx=0).stop 2023-10-14T19:03:06.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 msgr2=0x7f49100c1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 0x7f49100c1790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4910069c00 tx=0x7f4908019000 comp rx=0 tx=0).stop 2023-10-14T19:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 shutdown_connections 2023-10-14T19:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f491006d490 0x7f49101467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4910159790 0x7f49100c1790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 --2- 172.21.15.7:0/1956144130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49100703a0 0x7f491014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 >> 172.21.15.7:0/1956144130 conn(0x7f491006ecd0 msgr2=0x7f491006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 shutdown_connections 2023-10-14T19:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.748+0000 7f4915956700 1 -- 172.21.15.7:0/1956144130 wait complete. 2023-10-14T19:03:06.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:03:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.878+0000 7fe16a834700 1 Processor -- start 2023-10-14T19:03:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.878+0000 7fe16a834700 1 -- start start 2023-10-14T19:03:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.879+0000 7fe16a834700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe1640a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.879+0000 7fe16a834700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1640ce1a0 con 0x7fe16406d280 2023-10-14T19:03:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.879+0000 7fe16a834700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1640cd5d0 con 0x7fe1640a8be0 2023-10-14T19:03:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.879+0000 7fe16a834700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1640cd870 con 0x7fe1640aee90 2023-10-14T19:03:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.879+0000 7fe168dd1700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe16406d280 0x7fe1640b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47334/0 (socket says 172.21.15.7:47334) 2023-10-14T19:03:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.879+0000 7fe168dd1700 1 -- 172.21.15.7:0/3043914948 learned_addr learned my addr 172.21.15.7:0/3043914948 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe1637fe700 1 --2- 172.21.15.7:0/3043914948 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe1640a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782996253 0 0) 0x7fe1640ce1a0 con 0x7fe16406d280 2023-10-14T19:03:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe150003570 con 0x7fe16406d280 2023-10-14T19:03:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414343298 0 0) 0x7fe1640cd5d0 con 0x7fe1640a8be0 2023-10-14T19:03:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1640ce1a0 con 0x7fe1640a8be0 2023-10-14T19:03:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe1637fe700 1 -- 172.21.15.7:0/3043914948 >> v1:172.21.15.148:6789/0 conn(0x7fe1640a8be0 legacy=0x7fe1640ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe1637fe700 1 -- 172.21.15.7:0/3043914948 >> v1:172.21.15.7:6789/0 conn(0x7fe16406d280 legacy=0x7fe1640b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe1637fe700 1 -- 172.21.15.7:0/3043914948 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640cdb50 con 0x7fe1640aee90 2023-10-14T19:03:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe1637fe700 1 --2- 172.21.15.7:0/3043914948 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe1640a8fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009900 tx=0x7fe14c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f90408250b7cc07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c005c10 con 0x7fe1640aee90 2023-10-14T19:03:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c005d70 con 0x7fe1640aee90 2023-10-14T19:03:06.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.880+0000 7fe162ffd700 1 -- 172.21.15.7:0/3043914948 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c006260 con 0x7fe1640aee90 2023-10-14T19:03:06.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 -- 172.21.15.7:0/3043914948 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 msgr2=0x7fe1640a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 --2- 172.21.15.7:0/3043914948 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe1640a8fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009900 tx=0x7fe14c009120 comp rx=0 tx=0).stop 2023-10-14T19:03:06.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 -- 172.21.15.7:0/3043914948 shutdown_connections 2023-10-14T19:03:06.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 --2- 172.21.15.7:0/3043914948 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe1640a8fb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 -- 172.21.15.7:0/3043914948 >> 172.21.15.7:0/3043914948 conn(0x7fe16406ce80 msgr2=0x7fe1640ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:06.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 -- 172.21.15.7:0/3043914948 shutdown_connections 2023-10-14T19:03:06.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.881+0000 7fe16a834700 1 -- 172.21.15.7:0/3043914948 wait complete. 2023-10-14T19:03:06.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.882+0000 7fe16a834700 1 Processor -- start 2023-10-14T19:03:06.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.882+0000 7fe16a834700 1 -- start start 2023-10-14T19:03:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe16a834700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 0x7fe164145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe16a834700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1640a8be0 0x7fe164146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe16a834700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe164147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe16a834700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe164145990 con 0x7fe16406d280 2023-10-14T19:03:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe16a834700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe164144d80 con 0x7fe1640a8be0 2023-10-14T19:03:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe16a834700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe164145060 con 0x7fe1640aee90 2023-10-14T19:03:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 0x7fe164145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 0x7fe164145e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37068/0 (socket says 172.21.15.7:37068) 2023-10-14T19:03:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 -- 172.21.15.7:0/2553111492 learned_addr learned my addr 172.21.15.7:0/2553111492 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe1637fe700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1640a8be0 0x7fe164146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe168dd1700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe164147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 -- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 msgr2=0x7fe164147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe164147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 -- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1640a8be0 msgr2=0x7fe164146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1640a8be0 0x7fe164146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 -- 172.21.15.7:0/2553111492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0093c0 con 0x7fe16406d280 2023-10-14T19:03:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe1637fe700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1640a8be0 0x7fe164146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.883+0000 7fe163fff700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 0x7fe164145e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c7c0 tx=0x7fe154007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.884+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154011680 con 0x7fe16406d280 2023-10-14T19:03:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.884+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1540117e0 con 0x7fe16406d280 2023-10-14T19:03:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.884+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154011ba0 con 0x7fe16406d280 2023-10-14T19:03:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.884+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe164145340 con 0x7fe16406d280 2023-10-14T19:03:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.884+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe164146360 con 0x7fe16406d280 2023-10-14T19:03:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.884+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe164145c70 con 0x7fe16406d280 2023-10-14T19:03:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.885+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe154012440 con 0x7fe16406d280 2023-10-14T19:03:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.885+0000 7fe15bfff700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe144066f30 0x7fe1440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.886+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe154084170 con 0x7fe16406d280 2023-10-14T19:03:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.886+0000 7fe1637fe700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe144066f30 0x7fe1440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.886+0000 7fe1637fe700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe144066f30 0x7fe1440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009160 tx=0x7fe14c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:06.890+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe154051730 con 0x7fe16406d280 2023-10-14T19:03:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.086+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe16404c3c0 con 0x7fe16406d280 2023-10-14T19:03:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.086+0000 7fe15bfff700 1 -- 172.21.15.7:0/2553111492 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe154054d50 con 0x7fe16406d280 2023-10-14T19:03:07.087 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:07.088 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:03:07.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:07.088 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:03:07.088 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:03:07.088 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:07.089 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:03:07.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe144066f30 msgr2=0x7fe1440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe144066f30 0x7fe1440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009160 tx=0x7fe14c016000 comp rx=0 tx=0).stop 2023-10-14T19:03:07.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 msgr2=0x7fe164145e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 0x7fe164145e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c7c0 tx=0x7fe154007e00 comp rx=0 tx=0).stop 2023-10-14T19:03:07.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 shutdown_connections 2023-10-14T19:03:07.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe144066f30 0x7fe1440693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1640aee90 0x7fe164147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe16406d280 0x7fe164145e20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 --2- 172.21.15.7:0/2553111492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1640a8be0 0x7fe164146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 >> 172.21.15.7:0/2553111492 conn(0x7fe16406ce80 msgr2=0x7fe164159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:07.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 shutdown_connections 2023-10-14T19:03:07.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.088+0000 7fe16a834700 1 -- 172.21.15.7:0/2553111492 wait complete. 2023-10-14T19:03:07.101 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:03:07.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:03:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.223+0000 7f529d8c5700 1 Processor -- start 2023-10-14T19:03:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.223+0000 7f529d8c5700 1 -- start start 2023-10-14T19:03:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f529d8c5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5298142f70 0x7f52980cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f529d8c5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52980b5610 con 0x7f52980d0a80 2023-10-14T19:03:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f529d8c5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52980b58f0 con 0x7f52980cc9f0 2023-10-14T19:03:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f529d8c5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980b6500 con 0x7f5298142f70 2023-10-14T19:03:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f52977fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f52980d0a80 0x7f52980b09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47342/0 (socket says 172.21.15.7:47342) 2023-10-14T19:03:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f52977fe700 1 -- 172.21.15.7:0/4140132037 learned_addr learned my addr 172.21.15.7:0/4140132037 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5296ffd700 1 --2- 172.21.15.7:0/4140132037 >> v2:172.21.15.148:3300/0 conn(0x7f5298142f70 0x7f52980cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5295ffb700 1 -- 172.21.15.7:0/4140132037 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379969049 0 0) 0x7f52980b5610 con 0x7f52980d0a80 2023-10-14T19:03:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5295ffb700 1 -- 172.21.15.7:0/4140132037 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5284003570 con 0x7f52980d0a80 2023-10-14T19:03:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5296ffd700 1 -- 172.21.15.7:0/4140132037 >> v1:172.21.15.148:6789/0 conn(0x7f52980cc9f0 legacy=0x7f52980d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5295ffb700 1 -- 172.21.15.7:0/4140132037 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982283083 0 0) 0x7f52980b58f0 con 0x7f52980cc9f0 2023-10-14T19:03:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5296ffd700 1 -- 172.21.15.7:0/4140132037 >> v1:172.21.15.7:6789/0 conn(0x7f52980d0a80 legacy=0x7f52980b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.224+0000 7f5296ffd700 1 -- 172.21.15.7:0/4140132037 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980b5bd0 con 0x7f5298142f70 2023-10-14T19:03:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f5296ffd700 1 --2- 172.21.15.7:0/4140132037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f52980cc4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f52900098e0 tx=0x7f52900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87640b76d4cb4a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f5295ffb700 1 -- 172.21.15.7:0/4140132037 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000b640 con 0x7f5298142f70 2023-10-14T19:03:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f5295ffb700 1 -- 172.21.15.7:0/4140132037 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000b7a0 con 0x7f5298142f70 2023-10-14T19:03:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f5295ffb700 1 -- 172.21.15.7:0/4140132037 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000bb40 con 0x7f5298142f70 2023-10-14T19:03:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 -- 172.21.15.7:0/4140132037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 msgr2=0x7f52980cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 --2- 172.21.15.7:0/4140132037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f52980cc4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f52900098e0 tx=0x7f52900091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 -- 172.21.15.7:0/4140132037 shutdown_connections 2023-10-14T19:03:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 --2- 172.21.15.7:0/4140132037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f52980cc4b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 -- 172.21.15.7:0/4140132037 >> 172.21.15.7:0/4140132037 conn(0x7f52980703a0 msgr2=0x7f52980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 -- 172.21.15.7:0/4140132037 shutdown_connections 2023-10-14T19:03:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.225+0000 7f529d8c5700 1 -- 172.21.15.7:0/4140132037 wait complete. 2023-10-14T19:03:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 Processor -- start 2023-10-14T19:03:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 -- start start 2023-10-14T19:03:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 0x7f529815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:07.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52980d0a80 0x7f529814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:07.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f529813eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:07.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5298159ca0 con 0x7f52980cc9f0 2023-10-14T19:03:07.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529815a540 con 0x7f5298142f70 2023-10-14T19:03:07.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f529d8c5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529813f950 con 0x7f52980d0a80 2023-10-14T19:03:07.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f5296ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 0x7f529815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:07.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f5296ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 0x7f529815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37084/0 (socket says 172.21.15.7:37084) 2023-10-14T19:03:07.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.227+0000 7f5296ffd700 1 -- 172.21.15.7:0/3704286756 learned_addr learned my addr 172.21.15.7:0/3704286756 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:07.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f52977fe700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f529813eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:07.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f52967fc700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52980d0a80 0x7f529814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:07.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f5296ffd700 1 -- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52980d0a80 msgr2=0x7f529814ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f5296ffd700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52980d0a80 0x7f529814ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f5296ffd700 1 -- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 msgr2=0x7f529813eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f5296ffd700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f529813eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f5296ffd700 1 -- 172.21.15.7:0/3704286756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290009420 con 0x7f52980cc9f0 2023-10-14T19:03:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f52977fe700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f529813eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f52967fc700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52980d0a80 0x7f529814ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f5296ffd700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 0x7f529815a960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5290009f80 tx=0x7f5290017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529001f070 con 0x7f52980cc9f0 2023-10-14T19:03:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000b910 con 0x7f52980cc9f0 2023-10-14T19:03:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290011420 con 0x7f52980cc9f0 2023-10-14T19:03:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5298159e80 con 0x7f52980cc9f0 2023-10-14T19:03:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.228+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5298157330 con 0x7f52980cc9f0 2023-10-14T19:03:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.229+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5298142ad0 con 0x7f52980cc9f0 2023-10-14T19:03:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.229+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52900117d0 con 0x7f52980cc9f0 2023-10-14T19:03:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.230+0000 7f528effd700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5278066f30 0x7f52780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.230+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5290085600 con 0x7f52980cc9f0 2023-10-14T19:03:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.230+0000 7f52967fc700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5278066f30 0x7f52780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.230+0000 7f52967fc700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5278066f30 0x7f52780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52800011e0 tx=0x7f5280009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.234+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5290052bc0 con 0x7f52980cc9f0 2023-10-14T19:03:07.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:07.427+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f529804c3c0 con 0x7f52980cc9f0 2023-10-14T19:03:08.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.191+0000 7f528effd700 1 -- 172.21.15.7:0/3704286756 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f52900561e0 con 0x7f52980cc9f0 2023-10-14T19:03:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.194+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5278066f30 msgr2=0x7f52780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.194+0000 7f529d8c5700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5278066f30 0x7f52780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52800011e0 tx=0x7f5280009040 comp rx=0 tx=0).stop 2023-10-14T19:03:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.194+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 msgr2=0x7f529815a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.194+0000 7f529d8c5700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 0x7f529815a960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5290009f80 tx=0x7f5290017000 comp rx=0 tx=0).stop 2023-10-14T19:03:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.194+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 shutdown_connections 2023-10-14T19:03:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5278066f30 0x7f52780693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5298142f70 0x7f529813eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52980cc9f0 0x7f529815a960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 --2- 172.21.15.7:0/3704286756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52980d0a80 0x7f529814ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 >> 172.21.15.7:0/3704286756 conn(0x7f52980703a0 msgr2=0x7f52980b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 shutdown_connections 2023-10-14T19:03:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.195+0000 7f529d8c5700 1 -- 172.21.15.7:0/3704286756 wait complete. 2023-10-14T19:03:08.199 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:03:08.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:03:08.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.346+0000 7fabc7c89700 1 Processor -- start 2023-10-14T19:03:08.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.346+0000 7fabc7c89700 1 -- start start 2023-10-14T19:03:08.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc7c89700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabc0159530 0x7fabc00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:08.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc7c89700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc7c89700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc00ccfd0 con 0x7fabc006dc70 2023-10-14T19:03:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc7c89700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc00cf0e0 con 0x7fabc0159530 2023-10-14T19:03:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc7c89700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc015a3d0 con 0x7fabc006e0e0 2023-10-14T19:03:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabc0159530 0x7fabc00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5224700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fabc006dc70 0x7fabc0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47350/0 (socket says 172.21.15.7:47350) 2023-10-14T19:03:08.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabc0159530 0x7fabc00ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37096/0 (socket says 172.21.15.7:37096) 2023-10-14T19:03:08.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5224700 1 -- 172.21.15.7:0/848552005 learned_addr learned my addr 172.21.15.7:0/848552005 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:08.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc6226700 1 --2- 172.21.15.7:0/848552005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:08.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 -- 172.21.15.7:0/848552005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 msgr2=0x7fabc00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:08.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 --2- 172.21.15.7:0/848552005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 -- 172.21.15.7:0/848552005 >> v1:172.21.15.7:6789/0 conn(0x7fabc006dc70 legacy=0x7fabc0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:08.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc4a23700 1 -- 172.21.15.7:0/848552005 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130534225 0 0) 0x7fabc00ccfd0 con 0x7fabc006dc70 2023-10-14T19:03:08.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 -- 172.21.15.7:0/848552005 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc015a6b0 con 0x7fabc0159530 2023-10-14T19:03:08.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.347+0000 7fabc5a25700 1 --2- 172.21.15.7:0/848552005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc0159530 0x7fabc00ceba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0098e0 tx=0x7fabbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4184b487d96958 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc4a23700 1 -- 172.21.15.7:0/848552005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc009e80 con 0x7fabc0159530 2023-10-14T19:03:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc4a23700 1 -- 172.21.15.7:0/848552005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00b860 con 0x7fabc0159530 2023-10-14T19:03:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc4a23700 1 -- 172.21.15.7:0/848552005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bbe0 con 0x7fabc0159530 2023-10-14T19:03:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 -- 172.21.15.7:0/848552005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc0159530 msgr2=0x7fabc00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 --2- 172.21.15.7:0/848552005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc0159530 0x7fabc00ceba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0098e0 tx=0x7fabbc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 -- 172.21.15.7:0/848552005 shutdown_connections 2023-10-14T19:03:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 --2- 172.21.15.7:0/848552005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc0159530 0x7fabc00ceba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 --2- 172.21.15.7:0/848552005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 -- 172.21.15.7:0/848552005 >> 172.21.15.7:0/848552005 conn(0x7fabc00703a0 msgr2=0x7fabc00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 -- 172.21.15.7:0/848552005 shutdown_connections 2023-10-14T19:03:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.348+0000 7fabc7c89700 1 -- 172.21.15.7:0/848552005 wait complete. 2023-10-14T19:03:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.349+0000 7fabc7c89700 1 Processor -- start 2023-10-14T19:03:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.349+0000 7fabc7c89700 1 -- start start 2023-10-14T19:03:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc7c89700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 0x7fabc00b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc7c89700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc7c89700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0159530 0x7fabc00b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc7c89700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc00b6000 con 0x7fabc006dc70 2023-10-14T19:03:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc7c89700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc00c8260 con 0x7fabc0159530 2023-10-14T19:03:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc7c89700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc016e2f0 con 0x7fabc006e0e0 2023-10-14T19:03:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 0x7fabc00b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 0x7fabc00b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37110/0 (socket says 172.21.15.7:37110) 2023-10-14T19:03:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 -- 172.21.15.7:0/3491928247 learned_addr learned my addr 172.21.15.7:0/3491928247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc6226700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0159530 0x7fabc00b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5224700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 -- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 msgr2=0x7fabc00b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 -- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0159530 msgr2=0x7fabc00b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.350+0000 7fabc5a25700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0159530 0x7fabc00b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:08.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabc5a25700 1 -- 172.21.15.7:0/3491928247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc009420 con 0x7fabc006dc70 2023-10-14T19:03:08.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabc6226700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0159530 0x7fabc00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:08.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabc5a25700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 0x7fabc00b1eb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabc0089650 tx=0x7fabbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:08.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bbe0 con 0x7fabc006dc70 2023-10-14T19:03:08.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc011420 con 0x7fabc006dc70 2023-10-14T19:03:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc00c7930 con 0x7fabc006dc70 2023-10-14T19:03:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0117e0 con 0x7fabc006dc70 2023-10-14T19:03:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.351+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc00c7ef0 con 0x7fabc006dc70 2023-10-14T19:03:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.352+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc004c3c0 con 0x7fabc006dc70 2023-10-14T19:03:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.352+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabbc011bd0 con 0x7fabc006dc70 2023-10-14T19:03:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.353+0000 7fabb5ffb700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faba4066f30 0x7faba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.353+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fabbc085ec0 con 0x7fabc006dc70 2023-10-14T19:03:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.353+0000 7fabc5224700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faba4066f30 0x7faba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.354+0000 7fabc5224700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faba4066f30 0x7faba40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fabc00b2920 tx=0x7fabb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.357+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabbc053270 con 0x7fabc006dc70 2023-10-14T19:03:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:08.549+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fabc015a990 con 0x7fabc006dc70 2023-10-14T19:03:09.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.194+0000 7fabb5ffb700 1 -- 172.21.15.7:0/3491928247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fabbc056890 con 0x7fabc006dc70 2023-10-14T19:03:09.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.208+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faba4066f30 msgr2=0x7faba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:09.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.208+0000 7fabc7c89700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faba4066f30 0x7faba40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fabc00b2920 tx=0x7fabb0009040 comp rx=0 tx=0).stop 2023-10-14T19:03:09.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.208+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 msgr2=0x7fabc00b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:09.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.208+0000 7fabc7c89700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 0x7fabc00b1eb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabc0089650 tx=0x7fabbc017000 comp rx=0 tx=0).stop 2023-10-14T19:03:09.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.209+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 shutdown_connections 2023-10-14T19:03:09.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.209+0000 7fabc7c89700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faba4066f30 0x7faba40693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.209+0000 7fabc7c89700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0159530 0x7fabc00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.209+0000 7fabc7c89700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabc006dc70 0x7fabc00b1eb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.209+0000 7fabc7c89700 1 --2- 172.21.15.7:0/3491928247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabc006e0e0 0x7fabc00b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.209+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 >> 172.21.15.7:0/3491928247 conn(0x7fabc00703a0 msgr2=0x7fabc0153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:09.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.210+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 shutdown_connections 2023-10-14T19:03:09.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.210+0000 7fabc7c89700 1 -- 172.21.15.7:0/3491928247 wait complete. 2023-10-14T19:03:09.215 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:03:09.228 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:03:09.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.352+0000 7f9d8a239700 1 Processor -- start 2023-10-14T19:03:09.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.352+0000 7f9d8a239700 1 -- start start 2023-10-14T19:03:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d8a239700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d8406dc70 0x7f9d84159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d8a239700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d8406e0e0 0x7f9d840cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d8a239700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840ccfd0 con 0x7f9d84159530 2023-10-14T19:03:09.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d8a239700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8415a3d0 con 0x7f9d8406e0e0 2023-10-14T19:03:09.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d8a239700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8415a6b0 con 0x7f9d8406dc70 2023-10-14T19:03:09.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d83fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d8406e0e0 0x7f9d840cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:09.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d83fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d8406e0e0 0x7f9d840cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37112/0 (socket says 172.21.15.7:37112) 2023-10-14T19:03:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d83fff700 1 -- 172.21.15.7:0/3753271957 learned_addr learned my addr 172.21.15.7:0/3753271957 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.353+0000 7f9d82ffd700 1 --2- 172.21.15.7:0/3753271957 >> v2:172.21.15.148:3300/0 conn(0x7f9d8406dc70 0x7f9d84159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d83fff700 1 -- 172.21.15.7:0/3753271957 >> v2:172.21.15.148:3300/0 conn(0x7f9d8406dc70 msgr2=0x7f9d84159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d83fff700 1 --2- 172.21.15.7:0/3753271957 >> v2:172.21.15.148:3300/0 conn(0x7f9d8406dc70 0x7f9d84159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d83fff700 1 -- 172.21.15.7:0/3753271957 >> v1:172.21.15.148:6789/0 conn(0x7f9d84159530 legacy=0x7f9d840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d83fff700 1 -- 172.21.15.7:0/3753271957 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8415a990 con 0x7f9d8406e0e0 2023-10-14T19:03:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d83fff700 1 --2- 172.21.15.7:0/3753271957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8406e0e0 0x7f9d840cb6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d840b66e0 tx=0x7f9d7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5c7c8470779169 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d827fc700 1 -- 172.21.15.7:0/3753271957 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00e070 con 0x7f9d8406e0e0 2023-10-14T19:03:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d827fc700 1 -- 172.21.15.7:0/3753271957 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00ba20 con 0x7f9d8406e0e0 2023-10-14T19:03:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d827fc700 1 -- 172.21.15.7:0/3753271957 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0092e0 con 0x7f9d8406e0e0 2023-10-14T19:03:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d8a239700 1 -- 172.21.15.7:0/3753271957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8406e0e0 msgr2=0x7f9d840cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d8a239700 1 --2- 172.21.15.7:0/3753271957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8406e0e0 0x7f9d840cb6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d840b66e0 tx=0x7f9d7c009840 comp rx=0 tx=0).stop 2023-10-14T19:03:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.354+0000 7f9d8a239700 1 -- 172.21.15.7:0/3753271957 shutdown_connections 2023-10-14T19:03:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.355+0000 7f9d8a239700 1 --2- 172.21.15.7:0/3753271957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8406e0e0 0x7f9d840cb6f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.355+0000 7f9d8a239700 1 --2- 172.21.15.7:0/3753271957 >> v2:172.21.15.148:3300/0 conn(0x7f9d8406dc70 0x7f9d84159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.355+0000 7f9d8a239700 1 -- 172.21.15.7:0/3753271957 >> 172.21.15.7:0/3753271957 conn(0x7f9d840703a0 msgr2=0x7f9d840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.355+0000 7f9d8a239700 1 -- 172.21.15.7:0/3753271957 shutdown_connections 2023-10-14T19:03:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.355+0000 7f9d8a239700 1 -- 172.21.15.7:0/3753271957 wait complete. 2023-10-14T19:03:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.356+0000 7f9d8a239700 1 Processor -- start 2023-10-14T19:03:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.356+0000 7f9d8a239700 1 -- start start 2023-10-14T19:03:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.356+0000 7f9d8a239700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d8406dc70 0x7f9d8415e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d8406e0e0 0x7f9d840b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 0x7f9d8414e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840b23c0 con 0x7f9d84159530 2023-10-14T19:03:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840b17b0 con 0x7f9d8406dc70 2023-10-14T19:03:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840b1a90 con 0x7f9d8406e0e0 2023-10-14T19:03:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 0x7f9d8414e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 0x7f9d8414e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37124/0 (socket says 172.21.15.7:37124) 2023-10-14T19:03:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 -- 172.21.15.7:0/2764464363 learned_addr learned my addr 172.21.15.7:0/2764464363 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d837fe700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d8406dc70 0x7f9d8415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d82ffd700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d8406e0e0 0x7f9d840b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 -- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d8406e0e0 msgr2=0x7f9d840b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d8406e0e0 0x7f9d840b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 -- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d8406dc70 msgr2=0x7f9d8415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d8406dc70 0x7f9d8415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 -- 172.21.15.7:0/2764464363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009ae0 con 0x7f9d84159530 2023-10-14T19:03:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d83fff700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 0x7f9d8414e1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009880 tx=0x7f9d7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c008a80 con 0x7f9d84159530 2023-10-14T19:03:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c008c00 con 0x7f9d84159530 2023-10-14T19:03:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d840b1d70 con 0x7f9d84159530 2023-10-14T19:03:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c026460 con 0x7f9d84159530 2023-10-14T19:03:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.357+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d840b2850 con 0x7f9d84159530 2023-10-14T19:03:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.358+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d840b2530 con 0x7f9d84159530 2023-10-14T19:03:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.359+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d7c003040 con 0x7f9d84159530 2023-10-14T19:03:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.359+0000 7f9d6b7fe700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d70066f30 0x7f9d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.359+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9d7c085e20 con 0x7f9d84159530 2023-10-14T19:03:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.359+0000 7f9d837fe700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d70066f30 0x7f9d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.360+0000 7f9d837fe700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d70066f30 0x7f9d700693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d740039e0 tx=0x7f9d74007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.364+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d7c053050 con 0x7f9d84159530 2023-10-14T19:03:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:09.606+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9d8404c3c0 con 0x7f9d84159530 2023-10-14T19:03:10.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.216+0000 7f9d6b7fe700 1 -- 172.21.15.7:0/2764464363 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9d7c056670 con 0x7f9d84159530 2023-10-14T19:03:10.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.221+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d70066f30 msgr2=0x7f9d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.221+0000 7f9d8a239700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d70066f30 0x7f9d700693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d740039e0 tx=0x7f9d74007ec0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.221+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 msgr2=0x7f9d8414e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.221+0000 7f9d8a239700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 0x7f9d8414e1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009880 tx=0x7f9d7c018000 comp rx=0 tx=0).stop 2023-10-14T19:03:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 shutdown_connections 2023-10-14T19:03:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d70066f30 0x7f9d700693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d8406dc70 0x7f9d8415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d84159530 0x7f9d8414e1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 --2- 172.21.15.7:0/2764464363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d8406e0e0 0x7f9d840b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 >> 172.21.15.7:0/2764464363 conn(0x7f9d840703a0 msgr2=0x7f9d840cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 shutdown_connections 2023-10-14T19:03:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.222+0000 7f9d8a239700 1 -- 172.21.15.7:0/2764464363 wait complete. 2023-10-14T19:03:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T19:03:10.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.391+0000 7f9261ee0700 1 Processor -- start 2023-10-14T19:03:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f9261ee0700 1 -- start start 2023-10-14T19:03:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f9261ee0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f925c06d280 0x7f925c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f9261ee0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0ce1a0 con 0x7f925c0a8be0 2023-10-14T19:03:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f9261ee0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0cd5d0 con 0x7f925c0aee90 2023-10-14T19:03:10.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f9261ee0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c0cd870 con 0x7f925c06d280 2023-10-14T19:03:10.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f925bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f925c06d280 0x7f925c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f925b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f925c0a8be0 0x7f925c0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47352/0 (socket says 172.21.15.7:47352) 2023-10-14T19:03:10.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.392+0000 7f925bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f925c06d280 0x7f925c0a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37126/0 (socket says 172.21.15.7:37126) 2023-10-14T19:03:10.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925b7fe700 1 -- 172.21.15.7:0/251250527 learned_addr learned my addr 172.21.15.7:0/251250527 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925bfff700 1 -- 172.21.15.7:0/251250527 >> v1:172.21.15.148:6789/0 conn(0x7f925c0aee90 legacy=0x7f925c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925bfff700 1 -- 172.21.15.7:0/251250527 >> v1:172.21.15.7:6789/0 conn(0x7f925c0a8be0 legacy=0x7f925c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925bfff700 1 -- 172.21.15.7:0/251250527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0cdb50 con 0x7f925c06d280 2023-10-14T19:03:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925bfff700 1 --2- 172.21.15.7:0/251250527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c06d280 0x7f925c0a8fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9254009e60 tx=0x7f9254009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4068d6944461c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925a7fc700 1 -- 172.21.15.7:0/251250527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400e070 con 0x7f925c06d280 2023-10-14T19:03:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925a7fc700 1 -- 172.21.15.7:0/251250527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925400bcc0 con 0x7f925c06d280 2023-10-14T19:03:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f925a7fc700 1 -- 172.21.15.7:0/251250527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9254012680 con 0x7f925c06d280 2023-10-14T19:03:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f9261ee0700 1 -- 172.21.15.7:0/251250527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c06d280 msgr2=0x7f925c0a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.393+0000 7f9261ee0700 1 --2- 172.21.15.7:0/251250527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c06d280 0x7f925c0a8fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9254009e60 tx=0x7f9254009780 comp rx=0 tx=0).stop 2023-10-14T19:03:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.394+0000 7f9261ee0700 1 -- 172.21.15.7:0/251250527 shutdown_connections 2023-10-14T19:03:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.394+0000 7f9261ee0700 1 --2- 172.21.15.7:0/251250527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c06d280 0x7f925c0a8fb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.394+0000 7f9261ee0700 1 -- 172.21.15.7:0/251250527 >> 172.21.15.7:0/251250527 conn(0x7f925c06ce80 msgr2=0x7f925c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.394+0000 7f9261ee0700 1 -- 172.21.15.7:0/251250527 shutdown_connections 2023-10-14T19:03:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.394+0000 7f9261ee0700 1 -- 172.21.15.7:0/251250527 wait complete. 2023-10-14T19:03:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.395+0000 7f9261ee0700 1 Processor -- start 2023-10-14T19:03:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.395+0000 7f9261ee0700 1 -- start start 2023-10-14T19:03:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.395+0000 7f9261ee0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c06d280 0x7f925c09bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 0x7f925c06ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c0aee90 0x7f925c159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c06f190 con 0x7f925c0a8be0 2023-10-14T19:03:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c06efa0 con 0x7f925c0aee90 2023-10-14T19:03:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c1596d0 con 0x7f925c06d280 2023-10-14T19:03:10.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 0x7f925c06ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 0x7f925c06ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37128/0 (socket says 172.21.15.7:37128) 2023-10-14T19:03:10.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 -- 172.21.15.7:0/3923522180 learned_addr learned my addr 172.21.15.7:0/3923522180 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:10.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925bfff700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c0aee90 0x7f925c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925b7fe700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c06d280 0x7f925c09bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 -- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c06d280 msgr2=0x7f925c09bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c06d280 0x7f925c09bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 -- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c0aee90 msgr2=0x7f925c159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c0aee90 0x7f925c159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 -- 172.21.15.7:0/3923522180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254009a20 con 0x7f925c0a8be0 2023-10-14T19:03:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925bfff700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c0aee90 0x7f925c159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f925affd700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 0x7f925c06ea60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f925000c4b0 tx=0x7f9250007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011590 con 0x7f925c0a8be0 2023-10-14T19:03:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500116f0 con 0x7f925c0a8be0 2023-10-14T19:03:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c06e280 con 0x7f925c0a8be0 2023-10-14T19:03:10.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011ab0 con 0x7f925c0a8be0 2023-10-14T19:03:10.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.396+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c06dc30 con 0x7f925c0a8be0 2023-10-14T19:03:10.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.397+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c06e410 con 0x7f925c0a8be0 2023-10-14T19:03:10.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.398+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f925001b3b0 con 0x7f925c0a8be0 2023-10-14T19:03:10.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.398+0000 7f92437fe700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9248066f60 0x7f9248069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.398+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92500838b0 con 0x7f925c0a8be0 2023-10-14T19:03:10.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.398+0000 7f925b7fe700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9248066f60 0x7f9248069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.399+0000 7f925b7fe700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9248066f60 0x7f9248069410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f924c000c00 tx=0x7f924c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:10.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.402+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9250050bd0 con 0x7f925c0a8be0 2023-10-14T19:03:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.594+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f925c04c3c0 con 0x7f925c0a8be0 2023-10-14T19:03:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.595+0000 7f92437fe700 1 -- 172.21.15.7:0/3923522180 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f9250017070 con 0x7f925c0a8be0 2023-10-14T19:03:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:10.596 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:09.608017+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9248066f60 msgr2=0x7f9248069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9248066f60 0x7f9248069410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f924c000c00 tx=0x7f924c009040 comp rx=0 tx=0).stop 2023-10-14T19:03:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 msgr2=0x7f925c06ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 0x7f925c06ea60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f925000c4b0 tx=0x7f9250007f40 comp rx=0 tx=0).stop 2023-10-14T19:03:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 shutdown_connections 2023-10-14T19:03:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9248066f60 0x7f9248069410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c0aee90 0x7f925c159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c06d280 0x7f925c09bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 --2- 172.21.15.7:0/3923522180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925c0a8be0 0x7f925c06ea60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 >> 172.21.15.7:0/3923522180 conn(0x7f925c06ce80 msgr2=0x7f925c0b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 shutdown_connections 2023-10-14T19:03:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.597+0000 7f9261ee0700 1 -- 172.21.15.7:0/3923522180 wait complete. 2023-10-14T19:03:10.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:10.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.728+0000 7ff1b4c9c700 1 Processor -- start 2023-10-14T19:03:10.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.728+0000 7ff1b4c9c700 1 -- start start 2023-10-14T19:03:10.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1b4c9c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff1b0143200 0x7ff1b0159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1b4c9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b015a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1b4c9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1b015a850 0x7ff1b006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1b4c9c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b01171e0 con 0x7ff1b0143200 2023-10-14T19:03:10.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1b4c9c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b006c7d0 con 0x7ff1b015a850 2023-10-14T19:03:10.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1b4c9c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b015ac90 con 0x7ff1b00c3250 2023-10-14T19:03:10.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1ae59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff1b0143200 0x7ff1b0159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1ae59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff1b0143200 0x7ff1b0159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37136/0 (socket says 172.21.15.7:37136) 2023-10-14T19:03:10.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.729+0000 7ff1ae59c700 1 -- 172.21.15.7:0/1871744195 learned_addr learned my addr 172.21.15.7:0/1871744195 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:10.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1add9b700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1aed9d700 1 --2- 172.21.15.7:0/1871744195 >> v2:172.21.15.148:3300/0 conn(0x7ff1b015a850 0x7ff1b006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ae59c700 1 -- 172.21.15.7:0/1871744195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 msgr2=0x7ff1b015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:10.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ae59c700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ae59c700 1 -- 172.21.15.7:0/1871744195 >> v2:172.21.15.148:3300/0 conn(0x7ff1b015a850 msgr2=0x7ff1b006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ae59c700 1 --2- 172.21.15.7:0/1871744195 >> v2:172.21.15.148:3300/0 conn(0x7ff1b015a850 0x7ff1b006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ae59c700 1 -- 172.21.15.7:0/1871744195 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00c37a0 con 0x7ff1b0143200 2023-10-14T19:03:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1add9b700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1aed9d700 1 --2- 172.21.15.7:0/1871744195 >> v2:172.21.15.148:3300/0 conn(0x7ff1b015a850 0x7ff1b006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:10.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ae59c700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b0159dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00c36b0 tx=0x7ff1a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e225b42eaa25cfd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:10.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ad59a700 1 -- 172.21.15.7:0/1871744195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800b860 con 0x7ff1b0143200 2023-10-14T19:03:10.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ad59a700 1 -- 172.21.15.7:0/1871744195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a800b9c0 con 0x7ff1b0143200 2023-10-14T19:03:10.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.730+0000 7ff1ad59a700 1 -- 172.21.15.7:0/1871744195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800bd60 con 0x7ff1b0143200 2023-10-14T19:03:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/1871744195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 msgr2=0x7ff1b0159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b0159dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00c36b0 tx=0x7ff1a8009250 comp rx=0 tx=0).stop 2023-10-14T19:03:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/1871744195 shutdown_connections 2023-10-14T19:03:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/1871744195 >> v2:172.21.15.148:3300/0 conn(0x7ff1b015a850 0x7ff1b006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b0159dd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/1871744195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/1871744195 >> 172.21.15.7:0/1871744195 conn(0x7ff1b00ccb60 msgr2=0x7ff1b00ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:10.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/1871744195 shutdown_connections 2023-10-14T19:03:10.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.731+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/1871744195 wait complete. 2023-10-14T19:03:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 Processor -- start 2023-10-14T19:03:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 -- start start 2023-10-14T19:03:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1b015a850 0x7ff1b0129e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01442d0 con 0x7ff1b0143200 2023-10-14T19:03:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01445b0 con 0x7ff1b015a850 2023-10-14T19:03:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.732+0000 7ff1b4c9c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0144890 con 0x7ff1b00c3250 2023-10-14T19:03:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37152/0 (socket says 172.21.15.7:37152) 2023-10-14T19:03:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 -- 172.21.15.7:0/420001142 learned_addr learned my addr 172.21.15.7:0/420001142 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1ae59c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1aed9d700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1b015a850 0x7ff1b0129e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 -- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 msgr2=0x7ff1b0146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b0146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 -- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1b015a850 msgr2=0x7ff1b0129e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1b015a850 0x7ff1b0129e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 -- 172.21.15.7:0/420001142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80094f0 con 0x7ff1b0143200 2023-10-14T19:03:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1add9b700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b015e030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c880 tx=0x7ff198008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011600 con 0x7ff1b0143200 2023-10-14T19:03:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198011760 con 0x7ff1b0143200 2023-10-14T19:03:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b0144b70 con 0x7ff1b0143200 2023-10-14T19:03:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011ae0 con 0x7ff1b0143200 2023-10-14T19:03:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.733+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b0143ef0 con 0x7ff1b0143200 2023-10-14T19:03:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.734+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b0145090 con 0x7ff1b0143200 2023-10-14T19:03:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.735+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff198018350 con 0x7ff1b0143200 2023-10-14T19:03:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.735+0000 7ff1a67fc700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff190066f30 0x7ff1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.735+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1980843d0 con 0x7ff1b0143200 2023-10-14T19:03:10.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.735+0000 7ff1ae59c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff190066f30 0x7ff1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:10.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.736+0000 7ff1ae59c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff190066f30 0x7ff1900693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00c36b0 tx=0x7ff1a8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:10.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.739+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1b0145090 con 0x7ff1b0143200 2023-10-14T19:03:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.932+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1b0145090 con 0x7ff1b0143200 2023-10-14T19:03:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.933+0000 7ff1a67fc700 1 -- 172.21.15.7:0/420001142 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7ff1b0145090 con 0x7ff1b0143200 2023-10-14T19:03:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:10.934 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:09.608017+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:10.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff190066f30 msgr2=0x7ff1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff190066f30 0x7ff1900693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00c36b0 tx=0x7ff1a8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:10.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 msgr2=0x7ff1b015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:10.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b015e030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c880 tx=0x7ff198008040 comp rx=0 tx=0).stop 2023-10-14T19:03:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 shutdown_connections 2023-10-14T19:03:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff190066f30 0x7ff1900693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1b015a850 0x7ff1b0129e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1b00c3250 0x7ff1b0146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 --2- 172.21.15.7:0/420001142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1b0143200 0x7ff1b015e030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 >> 172.21.15.7:0/420001142 conn(0x7ff1b00ccb60 msgr2=0x7ff1b00c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 shutdown_connections 2023-10-14T19:03:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:10.935+0000 7ff1b4c9c700 1 -- 172.21.15.7:0/420001142 wait complete. 2023-10-14T19:03:10.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:03:11.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.069+0000 7ff07b083700 1 Processor -- start 2023-10-14T19:03:11.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.069+0000 7ff07b083700 1 -- start start 2023-10-14T19:03:11.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff07b083700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff074159530 0x7ff0740ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:11.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff07b083700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 0x7ff074159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:11.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff07b083700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740ccfd0 con 0x7ff07406e0e0 2023-10-14T19:03:11.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff07b083700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0740cf0e0 con 0x7ff074159530 2023-10-14T19:03:11.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff07b083700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07415a3d0 con 0x7ff07406dc70 2023-10-14T19:03:11.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 0x7ff074159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:11.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 0x7ff074159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38580/0 (socket says 172.21.15.7:38580) 2023-10-14T19:03:11.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 -- 172.21.15.7:0/1518096234 learned_addr learned my addr 172.21.15.7:0/1518096234 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:11.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff078e1f700 1 --2- 172.21.15.7:0/1518096234 >> v2:172.21.15.148:3300/0 conn(0x7ff074159530 0x7ff0740ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:11.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 -- 172.21.15.7:0/1518096234 >> v2:172.21.15.148:3300/0 conn(0x7ff074159530 msgr2=0x7ff0740ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:11.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 --2- 172.21.15.7:0/1518096234 >> v2:172.21.15.148:3300/0 conn(0x7ff074159530 0x7ff0740ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:11.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 -- 172.21.15.7:0/1518096234 >> v1:172.21.15.148:6789/0 conn(0x7ff07406e0e0 legacy=0x7ff0740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:11.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 -- 172.21.15.7:0/1518096234 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07415a6b0 con 0x7ff07406dc70 2023-10-14T19:03:11.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.070+0000 7ff073fff700 1 --2- 172.21.15.7:0/1518096234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 0x7ff074159900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0600099b0 tx=0x7ff060009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5171da5cd0248c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:11.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff0737fe700 1 -- 172.21.15.7:0/1518096234 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060009ea0 con 0x7ff07406dc70 2023-10-14T19:03:11.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff0737fe700 1 -- 172.21.15.7:0/1518096234 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000b860 con 0x7ff07406dc70 2023-10-14T19:03:11.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff0737fe700 1 -- 172.21.15.7:0/1518096234 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000bc00 con 0x7ff07406dc70 2023-10-14T19:03:11.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 -- 172.21.15.7:0/1518096234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 msgr2=0x7ff074159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:11.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 --2- 172.21.15.7:0/1518096234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 0x7ff074159900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0600099b0 tx=0x7ff060009250 comp rx=0 tx=0).stop 2023-10-14T19:03:11.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 -- 172.21.15.7:0/1518096234 shutdown_connections 2023-10-14T19:03:11.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 --2- 172.21.15.7:0/1518096234 >> v2:172.21.15.148:3300/0 conn(0x7ff074159530 0x7ff0740ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:11.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 --2- 172.21.15.7:0/1518096234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406dc70 0x7ff074159900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:11.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 -- 172.21.15.7:0/1518096234 >> 172.21.15.7:0/1518096234 conn(0x7ff0740703a0 msgr2=0x7ff0740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:11.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 -- 172.21.15.7:0/1518096234 shutdown_connections 2023-10-14T19:03:11.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.071+0000 7ff07b083700 1 -- 172.21.15.7:0/1518096234 wait complete. 2023-10-14T19:03:11.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.072+0000 7ff07b083700 1 Processor -- start 2023-10-14T19:03:11.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.072+0000 7ff07b083700 1 -- start start 2023-10-14T19:03:11.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff07b083700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 0x7ff0740b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:11.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff07b083700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406e0e0 0x7ff07416d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:11.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff07b083700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074159530 0x7ff07414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:11.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff07b083700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07415da70 con 0x7ff07406dc70 2023-10-14T19:03:11.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff07b083700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07415d460 con 0x7ff074159530 2023-10-14T19:03:11.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff07b083700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b4480 con 0x7ff07406e0e0 2023-10-14T19:03:11.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 0x7ff0740b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:11.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 0x7ff0740b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37158/0 (socket says 172.21.15.7:37158) 2023-10-14T19:03:11.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 -- 172.21.15.7:0/984800213 learned_addr learned my addr 172.21.15.7:0/984800213 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:11.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff079620700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074159530 0x7ff07414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:11.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff073fff700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406e0e0 0x7ff07416d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:11.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 -- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406e0e0 msgr2=0x7ff07416d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:11.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406e0e0 0x7ff07416d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:11.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 -- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074159530 msgr2=0x7ff07414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:11.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074159530 0x7ff07414bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:11.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff078e1f700 1 -- 172.21.15.7:0/984800213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094f0 con 0x7ff07406dc70 2023-10-14T19:03:11.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.073+0000 7ff079620700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074159530 0x7ff07414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:11.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.074+0000 7ff078e1f700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 0x7ff0740b5d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff06800e930 tx=0x7ff0680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:11.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.074+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800eed0 con 0x7ff07406dc70 2023-10-14T19:03:11.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.074+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800c850 con 0x7ff07406dc70 2023-10-14T19:03:11.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.074+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07415d700 con 0x7ff07406dc70 2023-10-14T19:03:11.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.074+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800cbf0 con 0x7ff07406dc70 2023-10-14T19:03:11.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.074+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0741504b0 con 0x7ff07406dc70 2023-10-14T19:03:11.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.075+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07415dd50 con 0x7ff07406dc70 2023-10-14T19:03:11.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.075+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff068013470 con 0x7ff07406dc70 2023-10-14T19:03:11.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.076+0000 7ff070ff9700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff058066f30 0x7ff0580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:11.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.076+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff068084760 con 0x7ff07406dc70 2023-10-14T19:03:11.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.076+0000 7ff073fff700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff058066f30 0x7ff0580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:11.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.076+0000 7ff073fff700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff058066f30 0x7ff0580693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0600099b0 tx=0x7ff060017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:11.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.080+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0680519d0 con 0x7ff07406dc70 2023-10-14T19:03:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:11.320+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff07404c3c0 con 0x7ff07406dc70 2023-10-14T19:03:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.232+0000 7ff070ff9700 1 -- 172.21.15.7:0/984800213 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff068054ff0 con 0x7ff07406dc70 2023-10-14T19:03:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff058066f30 msgr2=0x7ff0580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff058066f30 0x7ff0580693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0600099b0 tx=0x7ff060017000 comp rx=0 tx=0).stop 2023-10-14T19:03:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 msgr2=0x7ff0740b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 0x7ff0740b5d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff06800e930 tx=0x7ff0680091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 shutdown_connections 2023-10-14T19:03:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff058066f30 0x7ff0580693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074159530 0x7ff07414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff07406dc70 0x7ff0740b5d00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 --2- 172.21.15.7:0/984800213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff07406e0e0 0x7ff07416d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 >> 172.21.15.7:0/984800213 conn(0x7ff0740703a0 msgr2=0x7ff07415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:12.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 shutdown_connections 2023-10-14T19:03:12.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.235+0000 7ff07b083700 1 -- 172.21.15.7:0/984800213 wait complete. 2023-10-14T19:03:12.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:03:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.379+0000 7fc17d55c700 1 Processor -- start 2023-10-14T19:03:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.379+0000 7fc17d55c700 1 -- start start 2023-10-14T19:03:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc17d55c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780c9530 0x7fc1780c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc17d55c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc178088470 0x7fc1780c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc17d55c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1780c3de0 con 0x7fc1780aaee0 2023-10-14T19:03:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc17d55c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1780c31d0 con 0x7fc178088470 2023-10-14T19:03:12.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc17d55c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780c34b0 con 0x7fc1780c9530 2023-10-14T19:03:12.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc1767fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc178088470 0x7fc1780c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:12.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc1777fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc1780aaee0 0x7fc1780c47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47368/0 (socket says 172.21.15.7:47368) 2023-10-14T19:03:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc1777fe700 1 -- 172.21.15.7:0/3016622748 learned_addr learned my addr 172.21.15.7:0/3016622748 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc176ffd700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780c9530 0x7fc1780c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc1767fc700 1 -- 172.21.15.7:0/3016622748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780c9530 msgr2=0x7fc1780c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.380+0000 7fc1767fc700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780c9530 0x7fc1780c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc1767fc700 1 -- 172.21.15.7:0/3016622748 >> v1:172.21.15.7:6789/0 conn(0x7fc1780aaee0 legacy=0x7fc1780c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc1767fc700 1 -- 172.21.15.7:0/3016622748 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780c3790 con 0x7fc178088470 2023-10-14T19:03:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc175ffb700 1 -- 172.21.15.7:0/3016622748 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149999860 0 0) 0x7fc1780c3de0 con 0x7fc1780aaee0 2023-10-14T19:03:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc176ffd700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780c9530 0x7fc1780c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc1767fc700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc178088470 0x7fc1780c4270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1600098d0 tx=0x7fc160009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9b8013378020db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc175ffb700 1 -- 172.21.15.7:0/3016622748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160009e70 con 0x7fc178088470 2023-10-14T19:03:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc175ffb700 1 -- 172.21.15.7:0/3016622748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160005c10 con 0x7fc178088470 2023-10-14T19:03:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc175ffb700 1 -- 172.21.15.7:0/3016622748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000b650 con 0x7fc178088470 2023-10-14T19:03:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 -- 172.21.15.7:0/3016622748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc178088470 msgr2=0x7fc1780c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc178088470 0x7fc1780c4270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1600098d0 tx=0x7fc160009120 comp rx=0 tx=0).stop 2023-10-14T19:03:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 -- 172.21.15.7:0/3016622748 shutdown_connections 2023-10-14T19:03:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780c9530 0x7fc1780c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 --2- 172.21.15.7:0/3016622748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc178088470 0x7fc1780c4270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 -- 172.21.15.7:0/3016622748 >> 172.21.15.7:0/3016622748 conn(0x7fc178088000 msgr2=0x7fc1780ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 -- 172.21.15.7:0/3016622748 shutdown_connections 2023-10-14T19:03:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.381+0000 7fc17d55c700 1 -- 172.21.15.7:0/3016622748 wait complete. 2023-10-14T19:03:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 Processor -- start 2023-10-14T19:03:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 -- start start 2023-10-14T19:03:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc178088470 0x7fc178150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780aaee0 0x7fc178155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 0x7fc1781558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1781689a0 con 0x7fc1780c9530 2023-10-14T19:03:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178167b20 con 0x7fc178088470 2023-10-14T19:03:12.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc17d55c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1781507c0 con 0x7fc1780aaee0 2023-10-14T19:03:12.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc1777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 0x7fc1781558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:12.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc1777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 0x7fc1781558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37176/0 (socket says 172.21.15.7:37176) 2023-10-14T19:03:12.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.383+0000 7fc1777fe700 1 -- 172.21.15.7:0/4053060360 learned_addr learned my addr 172.21.15.7:0/4053060360 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:12.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc176ffd700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc178088470 0x7fc178150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:12.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1767fc700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780aaee0 0x7fc178155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:12.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1777fe700 1 -- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780aaee0 msgr2=0x7fc178155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1777fe700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780aaee0 0x7fc178155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1777fe700 1 -- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc178088470 msgr2=0x7fc178150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1777fe700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc178088470 0x7fc178150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1777fe700 1 -- 172.21.15.7:0/4053060360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1600093c0 con 0x7fc1780c9530 2023-10-14T19:03:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc176ffd700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc178088470 0x7fc178150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc1777fe700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 0x7fc1781558c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc16800ccc0 tx=0x7fc168001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16800ab30 con 0x7fc1780c9530 2023-10-14T19:03:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16800ac90 con 0x7fc1780c9530 2023-10-14T19:03:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc178167d90 con 0x7fc1780c9530 2023-10-14T19:03:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168007340 con 0x7fc1780c9530 2023-10-14T19:03:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.384+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc178168350 con 0x7fc1780c9530 2023-10-14T19:03:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.385+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc178168b50 con 0x7fc1780c9530 2023-10-14T19:03:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.386+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1680076f0 con 0x7fc1780c9530 2023-10-14T19:03:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.386+0000 7fc16effd700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc158066f30 0x7fc1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.386+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1680849e0 con 0x7fc1780c9530 2023-10-14T19:03:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.386+0000 7fc176ffd700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc158066f30 0x7fc1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.387+0000 7fc176ffd700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc158066f30 0x7fc1580693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc170006ea0 tx=0x7fc170008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.391+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc168051cd0 con 0x7fc1780c9530 2023-10-14T19:03:12.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:12.630+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc17804c3c0 con 0x7fc1780c9530 2023-10-14T19:03:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.234+0000 7fc16effd700 1 -- 172.21.15.7:0/4053060360 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc1680552f0 con 0x7fc1780c9530 2023-10-14T19:03:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc158066f30 msgr2=0x7fc1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc158066f30 0x7fc1580693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc170006ea0 tx=0x7fc170008040 comp rx=0 tx=0).stop 2023-10-14T19:03:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 msgr2=0x7fc1781558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 0x7fc1781558c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc16800ccc0 tx=0x7fc168001a80 comp rx=0 tx=0).stop 2023-10-14T19:03:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 shutdown_connections 2023-10-14T19:03:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc158066f30 0x7fc1580693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc178088470 0x7fc178150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780c9530 0x7fc1781558c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 --2- 172.21.15.7:0/4053060360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1780aaee0 0x7fc178155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 >> 172.21.15.7:0/4053060360 conn(0x7fc178088000 msgr2=0x7fc1780690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 shutdown_connections 2023-10-14T19:03:13.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.236+0000 7fc17d55c700 1 -- 172.21.15.7:0/4053060360 wait complete. 2023-10-14T19:03:13.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.376+0000 7fe951df0700 1 Processor -- start 2023-10-14T19:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.376+0000 7fe951df0700 1 -- start start 2023-10-14T19:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.376+0000 7fe951df0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe94c0cb5a0 0x7fe94c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.376+0000 7fe951df0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c15ae40 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe951df0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c15ab60 con 0x7fe94c15a5d0 2023-10-14T19:03:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe951df0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c0d13f0 con 0x7fe94c0cb5a0 2023-10-14T19:03:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe94c0cb5a0 0x7fe94c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe94c0cd9e0 0x7fe94c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47376/0 (socket says 172.21.15.7:47376) 2023-10-14T19:03:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94affd700 1 -- 172.21.15.7:0/3787310739 learned_addr learned my addr 172.21.15.7:0/3787310739 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94b7fe700 1 -- 172.21.15.7:0/3787310739 >> v1:172.21.15.148:6789/0 conn(0x7fe94c15a5d0 legacy=0x7fe94c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94b7fe700 1 -- 172.21.15.7:0/3787310739 >> v1:172.21.15.7:6789/0 conn(0x7fe94c0cd9e0 legacy=0x7fe94c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94b7fe700 1 -- 172.21.15.7:0/3787310739 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0ccf00 con 0x7fe94c0cb5a0 2023-10-14T19:03:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94a7fc700 1 -- 172.21.15.7:0/3787310739 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990174918 0 0) 0x7fe94c15ae40 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94b7fe700 1 --2- 172.21.15.7:0/3787310739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c0cb970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009910 tx=0x7fe93c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0ada5434ded3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94a7fc700 1 -- 172.21.15.7:0/3787310739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00b7e0 con 0x7fe94c0cb5a0 2023-10-14T19:03:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94a7fc700 1 -- 172.21.15.7:0/3787310739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00b940 con 0x7fe94c0cb5a0 2023-10-14T19:03:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.377+0000 7fe94a7fc700 1 -- 172.21.15.7:0/3787310739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00bce0 con 0x7fe94c0cb5a0 2023-10-14T19:03:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 -- 172.21.15.7:0/3787310739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cb5a0 msgr2=0x7fe94c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 --2- 172.21.15.7:0/3787310739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c0cb970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009910 tx=0x7fe93c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 -- 172.21.15.7:0/3787310739 shutdown_connections 2023-10-14T19:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 --2- 172.21.15.7:0/3787310739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c0cb970 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 -- 172.21.15.7:0/3787310739 >> 172.21.15.7:0/3787310739 conn(0x7fe94c070e30 msgr2=0x7fe94c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 -- 172.21.15.7:0/3787310739 shutdown_connections 2023-10-14T19:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.378+0000 7fe951df0700 1 -- 172.21.15.7:0/3787310739 wait complete. 2023-10-14T19:03:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.379+0000 7fe951df0700 1 Processor -- start 2023-10-14T19:03:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.379+0000 7fe951df0700 1 -- start start 2023-10-14T19:03:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 0x7fe94c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe94c15a5d0 0x7fe94c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c158120 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c158f40 con 0x7fe94c0cb5a0 2023-10-14T19:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c158330 con 0x7fe94c15a5d0 2023-10-14T19:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 0x7fe94c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 0x7fe94c1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37186/0 (socket says 172.21.15.7:37186) 2023-10-14T19:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 -- 172.21.15.7:0/1992839979 learned_addr learned my addr 172.21.15.7:0/1992839979 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94b7fe700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94bfff700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe94c15a5d0 0x7fe94c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 -- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe94c15a5d0 msgr2=0x7fe94c155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe94c15a5d0 0x7fe94c155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 -- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe94c0cb5a0 msgr2=0x7fe94c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 -- 172.21.15.7:0/1992839979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c009420 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94bfff700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe94c15a5d0 0x7fe94c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe94affd700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 0x7fe94c1593d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c7e0 tx=0x7fe940007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940005b30 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe940005c90 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.380+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c158610 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.381+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940007300 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.381+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c158bd0 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.381+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c04c3c0 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.382+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe94001b400 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.382+0000 7fe9337fe700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe938066f30 0x7fe9380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.382+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9400840b0 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.383+0000 7fe94b7fe700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe938066f30 0x7fe9380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.383+0000 7fe94b7fe700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe938066f30 0x7fe9380693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0030c0 tx=0x7fe93c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.387+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9400513a0 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.627+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe94c0cd1e0 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.627+0000 7fe9337fe700 1 -- 172.21.15.7:0/1992839979 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fe9400549c0 con 0x7fe94c0cd9e0 2023-10-14T19:03:13.629 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:13.629 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.629+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe938066f30 msgr2=0x7fe9380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.629+0000 7fe951df0700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe938066f30 0x7fe9380693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0030c0 tx=0x7fe93c016000 comp rx=0 tx=0).stop 2023-10-14T19:03:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.629+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 msgr2=0x7fe94c1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.629+0000 7fe951df0700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 0x7fe94c1593d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c7e0 tx=0x7fe940007df0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 shutdown_connections 2023-10-14T19:03:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe938066f30 0x7fe9380693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe94c0cb5a0 0x7fe94c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe94c15a5d0 0x7fe94c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 --2- 172.21.15.7:0/1992839979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe94c0cd9e0 0x7fe94c1593d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 >> 172.21.15.7:0/1992839979 conn(0x7fe94c070e30 msgr2=0x7fe94c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 shutdown_connections 2023-10-14T19:03:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.630+0000 7fe951df0700 1 -- 172.21.15.7:0/1992839979 wait complete. 2023-10-14T19:03:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:13.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.761+0000 7f58df18e700 1 Processor -- start 2023-10-14T19:03:13.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.761+0000 7f58df18e700 1 -- start start 2023-10-14T19:03:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.762+0000 7f58df18e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58d806ae50 0x7f58d80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.762+0000 7f58df18e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d815acd0 0x7f58d80c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.762+0000 7f58df18e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58d806b220 0x7f58d8155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.762+0000 7f58df18e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d80c8320 con 0x7f58d806b220 2023-10-14T19:03:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.762+0000 7f58df18e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d815a840 con 0x7f58d806ae50 2023-10-14T19:03:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.762+0000 7f58df18e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80c8520 con 0x7f58d815acd0 2023-10-14T19:03:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58d806b220 0x7f58d8155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58d806b220 0x7f58d8155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37188/0 (socket says 172.21.15.7:37188) 2023-10-14T19:03:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 -- 172.21.15.7:0/321158689 learned_addr learned my addr 172.21.15.7:0/321158689 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58dd98b700 1 --2- 172.21.15.7:0/321158689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d815acd0 0x7f58d80c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de18c700 1 --2- 172.21.15.7:0/321158689 >> v2:172.21.15.148:3300/0 conn(0x7f58d806ae50 0x7f58d80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 -- 172.21.15.7:0/321158689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d815acd0 msgr2=0x7f58d80c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 --2- 172.21.15.7:0/321158689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d815acd0 0x7f58d80c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 -- 172.21.15.7:0/321158689 >> v2:172.21.15.148:3300/0 conn(0x7f58d806ae50 msgr2=0x7f58d80c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 --2- 172.21.15.7:0/321158689 >> v2:172.21.15.148:3300/0 conn(0x7f58d806ae50 0x7f58d80c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 -- 172.21.15.7:0/321158689 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d815a1f0 con 0x7f58d806b220 2023-10-14T19:03:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de18c700 1 --2- 172.21.15.7:0/321158689 >> v2:172.21.15.148:3300/0 conn(0x7f58d806ae50 0x7f58d80c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58de98d700 1 --2- 172.21.15.7:0/321158689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d806b220 0x7f58d8155eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58c80099b0 tx=0x7f58c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c5cd23f128c664 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58dd18a700 1 -- 172.21.15.7:0/321158689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800b820 con 0x7f58d806b220 2023-10-14T19:03:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58dd18a700 1 -- 172.21.15.7:0/321158689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c800b980 con 0x7f58d806b220 2023-10-14T19:03:13.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.763+0000 7f58dd18a700 1 -- 172.21.15.7:0/321158689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800bd20 con 0x7f58d806b220 2023-10-14T19:03:13.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 -- 172.21.15.7:0/321158689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d806b220 msgr2=0x7f58d8155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 --2- 172.21.15.7:0/321158689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d806b220 0x7f58d8155eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58c80099b0 tx=0x7f58c8009250 comp rx=0 tx=0).stop 2023-10-14T19:03:13.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 -- 172.21.15.7:0/321158689 shutdown_connections 2023-10-14T19:03:13.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 --2- 172.21.15.7:0/321158689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d806b220 0x7f58d8155eb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 --2- 172.21.15.7:0/321158689 >> v2:172.21.15.148:3300/0 conn(0x7f58d806ae50 0x7f58d80c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 --2- 172.21.15.7:0/321158689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d815acd0 0x7f58d80c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 -- 172.21.15.7:0/321158689 >> 172.21.15.7:0/321158689 conn(0x7f58d806e280 msgr2=0x7f58d80cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:13.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 -- 172.21.15.7:0/321158689 shutdown_connections 2023-10-14T19:03:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.764+0000 7f58df18e700 1 -- 172.21.15.7:0/321158689 wait complete. 2023-10-14T19:03:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.765+0000 7f58df18e700 1 Processor -- start 2023-10-14T19:03:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.765+0000 7f58df18e700 1 -- start start 2023-10-14T19:03:13.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d806ae50 0x7f58d8166780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d806b220 0x7f58d80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 0x7f58d80c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8167f00 con 0x7f58d815acd0 2023-10-14T19:03:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8168a10 con 0x7f58d806b220 2023-10-14T19:03:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81680e0 con 0x7f58d806ae50 2023-10-14T19:03:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 0x7f58d80c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 0x7f58d80c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37196/0 (socket says 172.21.15.7:37196) 2023-10-14T19:03:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 -- 172.21.15.7:0/212826288 learned_addr learned my addr 172.21.15.7:0/212826288 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de18c700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d806ae50 0x7f58d8166780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58dd98b700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d806b220 0x7f58d80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 -- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d806ae50 msgr2=0x7f58d8166780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d806ae50 0x7f58d8166780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 -- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d806b220 msgr2=0x7f58d80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d806b220 0x7f58d80c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 -- 172.21.15.7:0/212826288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80094f0 con 0x7f58d815acd0 2023-10-14T19:03:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58de98d700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 0x7f58d80c6ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009290 tx=0x7f58c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8011e80 con 0x7f58d815acd0 2023-10-14T19:03:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c801a630 con 0x7f58d815acd0 2023-10-14T19:03:13.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d81683c0 con 0x7f58d815acd0 2023-10-14T19:03:13.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c801a9d0 con 0x7f58d815acd0 2023-10-14T19:03:13.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.766+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8166cc0 con 0x7f58d815acd0 2023-10-14T19:03:13.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.767+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d8168b80 con 0x7f58d815acd0 2023-10-14T19:03:13.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.768+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58c801ad40 con 0x7f58d815acd0 2023-10-14T19:03:13.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.768+0000 7f58d67fc700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f58c4066f30 0x7f58c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:13.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.768+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58c8085f10 con 0x7f58d815acd0 2023-10-14T19:03:13.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.768+0000 7f58de18c700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f58c4066f30 0x7f58c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:13.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.769+0000 7f58de18c700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f58c4066f30 0x7f58c40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f58d000f600 tx=0x7f58d00077b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:13.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.772+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58c8053180 con 0x7f58d815acd0 2023-10-14T19:03:13.948 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-10-14T19:03:13.947+0000 7ffafd2a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:03:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.964+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58d804c3c0 con 0x7f58d815acd0 2023-10-14T19:03:13.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.965+0000 7f58d67fc700 1 -- 172.21.15.7:0/212826288 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f58c8029090 con 0x7f58d815acd0 2023-10-14T19:03:13.966 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:13.966 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f58c4066f30 msgr2=0x7f58c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f58c4066f30 0x7f58c40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f58d000f600 tx=0x7f58d00077b0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 msgr2=0x7f58d80c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 0x7f58d80c6ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009290 tx=0x7f58c8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 shutdown_connections 2023-10-14T19:03:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f58c4066f30 0x7f58c40693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d815acd0 0x7f58d80c6ae0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58d806ae50 0x7f58d8166780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 --2- 172.21.15.7:0/212826288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d806b220 0x7f58d80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:13.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 >> 172.21.15.7:0/212826288 conn(0x7f58d806e280 msgr2=0x7f58d8068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:13.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 shutdown_connections 2023-10-14T19:03:13.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:13.967+0000 7f58df18e700 1 -- 172.21.15.7:0/212826288 wait complete. 2023-10-14T19:03:13.980 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:03:13.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:14.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.098+0000 7f4445719700 1 Processor -- start 2023-10-14T19:03:14.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.098+0000 7f4445719700 1 -- start start 2023-10-14T19:03:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.099+0000 7f4445719700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44400cb970 0x7f4440159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.099+0000 7f4445719700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444015a400 0x7f4440156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.099+0000 7f4445719700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444015ae40 con 0x7f44400cb5a0 2023-10-14T19:03:14.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.099+0000 7f4445719700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400ce0f0 con 0x7f44400cb970 2023-10-14T19:03:14.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.099+0000 7f4445719700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400d13f0 con 0x7f444015a400 2023-10-14T19:03:14.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444015a400 0x7f4440156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44400cb970 0x7f4440159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f44400cb5a0 0x7f44400cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45550/0 (socket says 172.21.15.7:45550) 2023-10-14T19:03:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444015a400 0x7f4440156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38660/0 (socket says 172.21.15.7:38660) 2023-10-14T19:03:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443effd700 1 -- 172.21.15.7:0/2891853493 learned_addr learned my addr 172.21.15.7:0/2891853493 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443e7fc700 1 -- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444015a400 msgr2=0x7f4440156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443e7fc700 1 --2- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444015a400 0x7f4440156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443e7fc700 1 -- 172.21.15.7:0/2891853493 >> v1:172.21.15.148:6789/0 conn(0x7f44400cb5a0 legacy=0x7f44400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443e7fc700 1 -- 172.21.15.7:0/2891853493 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444015ab60 con 0x7f44400cb970 2023-10-14T19:03:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443dffb700 1 -- 172.21.15.7:0/2891853493 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63634775 0 0) 0x7f444015ae40 con 0x7f44400cb5a0 2023-10-14T19:03:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443e7fc700 1 --2- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44400cb970 0x7f4440159ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44280098e0 tx=0x7f44280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b34f2d5f591dc139 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443dffb700 1 -- 172.21.15.7:0/2891853493 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800b640 con 0x7f44400cb970 2023-10-14T19:03:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443dffb700 1 -- 172.21.15.7:0/2891853493 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800b7a0 con 0x7f44400cb970 2023-10-14T19:03:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.100+0000 7f443dffb700 1 -- 172.21.15.7:0/2891853493 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800bb40 con 0x7f44400cb970 2023-10-14T19:03:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 -- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44400cb970 msgr2=0x7f4440159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 --2- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44400cb970 0x7f4440159ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44280098e0 tx=0x7f44280091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 -- 172.21.15.7:0/2891853493 shutdown_connections 2023-10-14T19:03:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 --2- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444015a400 0x7f4440156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 --2- 172.21.15.7:0/2891853493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44400cb970 0x7f4440159ec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 -- 172.21.15.7:0/2891853493 >> 172.21.15.7:0/2891853493 conn(0x7f4440070e30 msgr2=0x7f44400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 -- 172.21.15.7:0/2891853493 shutdown_connections 2023-10-14T19:03:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.101+0000 7f4445719700 1 -- 172.21.15.7:0/2891853493 wait complete. 2023-10-14T19:03:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.102+0000 7f4445719700 1 Processor -- start 2023-10-14T19:03:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.102+0000 7f4445719700 1 -- start start 2023-10-14T19:03:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f4445719700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44400cb5a0 0x7f44401694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f4445719700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 0x7f4440152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f4445719700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444015a400 0x7f44400c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f4445719700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c98e0 con 0x7f44400cb970 2023-10-14T19:03:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f4445719700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440152ac0 con 0x7f444015a400 2023-10-14T19:03:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f4445719700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c8cd0 con 0x7f44400cb5a0 2023-10-14T19:03:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 0x7f4440152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 0x7f4440152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37208/0 (socket says 172.21.15.7:37208) 2023-10-14T19:03:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 -- 172.21.15.7:0/2259756887 learned_addr learned my addr 172.21.15.7:0/2259756887 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443f7fe700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444015a400 0x7f44400c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443effd700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44400cb5a0 0x7f44401694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 -- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44400cb5a0 msgr2=0x7f44401694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44400cb5a0 0x7f44401694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 -- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444015a400 msgr2=0x7f44400c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444015a400 0x7f44400c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.103+0000 7f443e7fc700 1 -- 172.21.15.7:0/2259756887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428009420 con 0x7f44400cb970 2023-10-14T19:03:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.104+0000 7f443e7fc700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 0x7f4440152580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4428009f80 tx=0x7f4428017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.104+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800bb20 con 0x7f44400cb970 2023-10-14T19:03:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.104+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4428000c90 con 0x7f44400cb970 2023-10-14T19:03:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.104+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44400c8fb0 con 0x7f44400cb970 2023-10-14T19:03:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.104+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428011650 con 0x7f44400cb970 2023-10-14T19:03:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.104+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44400c9570 con 0x7f44400cb970 2023-10-14T19:03:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.105+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44400c9a50 con 0x7f44400cb970 2023-10-14T19:03:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.105+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4428011a40 con 0x7f44400cb970 2023-10-14T19:03:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.105+0000 7f4436ffd700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.106+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4428085f50 con 0x7f44400cb970 2023-10-14T19:03:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.106+0000 7f443effd700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.106+0000 7f443effd700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4420066f30 0x7f44200693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4438007240 tx=0x7f4438001970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.110+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44280531c0 con 0x7f44400cb970 2023-10-14T19:03:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.301+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f444004c3c0 con 0x7f4420066f30 2023-10-14T19:03:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.309+0000 7f4436ffd700 1 -- 172.21.15.7:0/2259756887 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264672 (secure 0 0 0) 0x7f444004c3c0 con 0x7f4420066f30 2023-10-14T19:03:14.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4420066f30 msgr2=0x7f44200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4420066f30 0x7f44200693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4438007240 tx=0x7f4438001970 comp rx=0 tx=0).stop 2023-10-14T19:03:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 msgr2=0x7f4440152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 0x7f4440152580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4428009f80 tx=0x7f4428017000 comp rx=0 tx=0).stop 2023-10-14T19:03:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 shutdown_connections 2023-10-14T19:03:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444015a400 0x7f44400c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44400cb5a0 0x7f44401694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 --2- 172.21.15.7:0/2259756887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44400cb970 0x7f4440152580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 >> 172.21.15.7:0/2259756887 conn(0x7f4440070e30 msgr2=0x7f44400ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 shutdown_connections 2023-10-14T19:03:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.312+0000 7f4445719700 1 -- 172.21.15.7:0/2259756887 wait complete. 2023-10-14T19:03:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:14.325 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T19:03:13.621774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426863"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236802+0000","last_change":"2023-10-14T19:03:10.230691+0000","last_active":"2023-10-14T19:03:10.236802+0000","last_peered":"2023-10-14T19:03:10.236802+0000","last_clean":"2023-10-14T19:03:10.236802+0000","last_became_active":"2023-10-14T19:03:10.230421+0000","last_became_peered":"2023-10-14T19:03:10.230421+0000","last_unstale":"2023-10-14T19:03:10.236802+0000","last_undegraded":"2023-10-14T19:03:10.236802+0000","last_fullsized":"2023-10-14T19:03:10.236802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220866+0000","last_change":"2023-10-14T19:03:10.218785+0000","last_active":"2023-10-14T19:03:10.220866+0000","last_peered":"2023-10-14T19:03:10.220866+0000","last_clean":"2023-10-14T19:03:10.220866+0000","last_became_active":"2023-10-14T19:03:10.218518+0000","last_became_peered":"2023-10-14T19:03:10.218518+0000","last_unstale":"2023-10-14T19:03:10.220866+0000","last_undegraded":"2023-10-14T19:03:10.220866+0000","last_fullsized":"2023-10-14T19:03:10.220866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.218469+0000","last_change":"2023-10-14T19:03:10.212986+0000","last_active":"2023-10-14T19:03:10.218469+0000","last_peered":"2023-10-14T19:03:10.218469+0000","last_clean":"2023-10-14T19:03:10.218469+0000","last_became_active":"2023-10-14T19:03:10.212712+0000","last_became_peered":"2023-10-14T19:03:10.212712+0000","last_unstale":"2023-10-14T19:03:10.218469+0000","last_undegraded":"2023-10-14T19:03:10.218469+0000","last_fullsized":"2023-10-14T19:03:10.218469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226118+0000","last_change":"2023-10-14T19:03:10.222522+0000","last_active":"2023-10-14T19:03:10.226118+0000","last_peered":"2023-10-14T19:03:10.226118+0000","last_clean":"2023-10-14T19:03:10.226118+0000","last_became_active":"2023-10-14T19:03:10.222033+0000","last_became_peered":"2023-10-14T19:03:10.222033+0000","last_unstale":"2023-10-14T19:03:10.226118+0000","last_undegraded":"2023-10-14T19:03:10.226118+0000","last_fullsized":"2023-10-14T19:03:10.226118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233555+0000","last_change":"2023-10-14T19:03:10.227209+0000","last_active":"2023-10-14T19:03:10.233555+0000","last_peered":"2023-10-14T19:03:10.233555+0000","last_clean":"2023-10-14T19:03:10.233555+0000","last_became_active":"2023-10-14T19:03:10.226848+0000","last_became_peered":"2023-10-14T19:03:10.226848+0000","last_unstale":"2023-10-14T19:03:10.233555+0000","last_undegraded":"2023-10-14T19:03:10.233555+0000","last_fullsized":"2023-10-14T19:03:10.233555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231156+0000","last_change":"2023-10-14T19:03:10.226159+0000","last_active":"2023-10-14T19:03:10.231156+0000","last_peered":"2023-10-14T19:03:10.231156+0000","last_clean":"2023-10-14T19:03:10.231156+0000","last_became_active":"2023-10-14T19:03:10.225860+0000","last_became_peered":"2023-10-14T19:03:10.225860+0000","last_unstale":"2023-10-14T19:03:10.231156+0000","last_undegraded":"2023-10-14T19:03:10.231156+0000","last_fullsized":"2023-10-14T19:03:10.231156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229437+0000","last_change":"2023-10-14T19:03:10.222973+0000","last_active":"2023-10-14T19:03:10.229437+0000","last_peered":"2023-10-14T19:03:10.229437+0000","last_clean":"2023-10-14T19:03:10.229437+0000","last_became_active":"2023-10-14T19:03:10.222694+0000","last_became_peered":"2023-10-14T19:03:10.222694+0000","last_unstale":"2023-10-14T19:03:10.229437+0000","last_undegraded":"2023-10-14T19:03:10.229437+0000","last_fullsized":"2023-10-14T19:03:10.229437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227789+0000","last_change":"2023-10-14T19:03:10.226142+0000","last_active":"2023-10-14T19:03:10.227789+0000","last_peered":"2023-10-14T19:03:10.227789+0000","last_clean":"2023-10-14T19:03:10.227789+0000","last_became_active":"2023-10-14T19:03:10.225807+0000","last_became_peered":"2023-10-14T19:03:10.225807+0000","last_unstale":"2023-10-14T19:03:10.227789+0000","last_undegraded":"2023-10-14T19:03:10.227789+0000","last_fullsized":"2023-10-14T19:03:10.227789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239732+0000","last_change":"2023-10-14T19:03:10.234612+0000","last_active":"2023-10-14T19:03:10.239732+0000","last_peered":"2023-10-14T19:03:10.239732+0000","last_clean":"2023-10-14T19:03:10.239732+0000","last_became_active":"2023-10-14T19:03:10.234121+0000","last_became_peered":"2023-10-14T19:03:10.234121+0000","last_unstale":"2023-10-14T19:03:10.239732+0000","last_undegraded":"2023-10-14T19:03:10.239732+0000","last_fullsized":"2023-10-14T19:03:10.239732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:05:02.219977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.232472+0000","last_change":"2023-10-14T19:03:10.227725+0000","last_active":"2023-10-14T19:03:10.232472+0000","last_peered":"2023-10-14T19:03:10.232472+0000","last_clean":"2023-10-14T19:03:10.232472+0000","last_became_active":"2023-10-14T19:03:10.227514+0000","last_became_peered":"2023-10-14T19:03:10.227514+0000","last_unstale":"2023-10-14T19:03:10.232472+0000","last_undegraded":"2023-10-14T19:03:10.232472+0000","last_fullsized":"2023-10-14T19:03:10.232472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230503+0000","last_change":"2023-10-14T19:03:10.225519+0000","last_active":"2023-10-14T19:03:10.230503+0000","last_peered":"2023-10-14T19:03:10.230503+0000","last_clean":"2023-10-14T19:03:10.230503+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230503+0000","last_undegraded":"2023-10-14T19:03:10.230503+0000","last_fullsized":"2023-10-14T19:03:10.230503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226243+0000","last_change":"2023-10-14T19:03:10.222180+0000","last_active":"2023-10-14T19:03:10.226243+0000","last_peered":"2023-10-14T19:03:10.226243+0000","last_clean":"2023-10-14T19:03:10.226243+0000","last_became_active":"2023-10-14T19:03:10.221860+0000","last_became_peered":"2023-10-14T19:03:10.221860+0000","last_unstale":"2023-10-14T19:03:10.226243+0000","last_undegraded":"2023-10-14T19:03:10.226243+0000","last_fullsized":"2023-10-14T19:03:10.226243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:06.624716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224317+0000","last_change":"2023-10-14T19:03:10.221789+0000","last_active":"2023-10-14T19:03:10.224317+0000","last_peered":"2023-10-14T19:03:10.224317+0000","last_clean":"2023-10-14T19:03:10.224317+0000","last_became_active":"2023-10-14T19:03:10.221495+0000","last_became_peered":"2023-10-14T19:03:10.221495+0000","last_unstale":"2023-10-14T19:03:10.224317+0000","last_undegraded":"2023-10-14T19:03:10.224317+0000","last_fullsized":"2023-10-14T19:03:10.224317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223791+0000","last_change":"2023-10-14T19:03:10.220586+0000","last_active":"2023-10-14T19:03:10.223791+0000","last_peered":"2023-10-14T19:03:10.223791+0000","last_clean":"2023-10-14T19:03:10.223791+0000","last_became_active":"2023-10-14T19:03:10.220319+0000","last_became_peered":"2023-10-14T19:03:10.220319+0000","last_unstale":"2023-10-14T19:03:10.223791+0000","last_undegraded":"2023-10-14T19:03:10.223791+0000","last_fullsized":"2023-10-14T19:03:10.223791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219497+0000","last_change":"2023-10-14T19:03:10.216808+0000","last_active":"2023-10-14T19:03:10.219497+0000","last_peered":"2023-10-14T19:03:10.219497+0000","last_clean":"2023-10-14T19:03:10.219497+0000","last_became_active":"2023-10-14T19:03:10.215467+0000","last_became_peered":"2023-10-14T19:03:10.215467+0000","last_unstale":"2023-10-14T19:03:10.219497+0000","last_undegraded":"2023-10-14T19:03:10.219497+0000","last_fullsized":"2023-10-14T19:03:10.219497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231936+0000","last_change":"2023-10-14T19:03:10.226710+0000","last_active":"2023-10-14T19:03:10.231936+0000","last_peered":"2023-10-14T19:03:10.231936+0000","last_clean":"2023-10-14T19:03:10.231936+0000","last_became_active":"2023-10-14T19:03:10.226470+0000","last_became_peered":"2023-10-14T19:03:10.226470+0000","last_unstale":"2023-10-14T19:03:10.231936+0000","last_undegraded":"2023-10-14T19:03:10.231936+0000","last_fullsized":"2023-10-14T19:03:10.231936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230949+0000","last_change":"2023-10-14T19:03:10.227805+0000","last_active":"2023-10-14T19:03:10.230949+0000","last_peered":"2023-10-14T19:03:10.230949+0000","last_clean":"2023-10-14T19:03:10.230949+0000","last_became_active":"2023-10-14T19:03:10.227530+0000","last_became_peered":"2023-10-14T19:03:10.227530+0000","last_unstale":"2023-10-14T19:03:10.230949+0000","last_undegraded":"2023-10-14T19:03:10.230949+0000","last_fullsized":"2023-10-14T19:03:10.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212844+0000","last_change":"2023-10-14T19:03:10.211421+0000","last_active":"2023-10-14T19:03:10.212844+0000","last_peered":"2023-10-14T19:03:10.212844+0000","last_clean":"2023-10-14T19:03:10.212844+0000","last_became_active":"2023-10-14T19:03:10.211127+0000","last_became_peered":"2023-10-14T19:03:10.211127+0000","last_unstale":"2023-10-14T19:03:10.212844+0000","last_undegraded":"2023-10-14T19:03:10.212844+0000","last_fullsized":"2023-10-14T19:03:10.212844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:47.109849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233763+0000","last_change":"2023-10-14T19:03:10.227239+0000","last_active":"2023-10-14T19:03:10.233763+0000","last_peered":"2023-10-14T19:03:10.233763+0000","last_clean":"2023-10-14T19:03:10.233763+0000","last_became_active":"2023-10-14T19:03:10.226914+0000","last_became_peered":"2023-10-14T19:03:10.226914+0000","last_unstale":"2023-10-14T19:03:10.233763+0000","last_undegraded":"2023-10-14T19:03:10.233763+0000","last_fullsized":"2023-10-14T19:03:10.233763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236969+0000","last_change":"2023-10-14T19:03:09.214413+0000","last_active":"2023-10-14T19:03:10.236969+0000","last_peered":"2023-10-14T19:03:10.236969+0000","last_clean":"2023-10-14T19:03:10.236969+0000","last_became_active":"2023-10-14T19:03:09.214117+0000","last_became_peered":"2023-10-14T19:03:09.214117+0000","last_unstale":"2023-10-14T19:03:10.236969+0000","last_undegraded":"2023-10-14T19:03:10.236969+0000","last_fullsized":"2023-10-14T19:03:10.236969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:55.947066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231800+0000","last_change":"2023-10-14T19:03:10.231111+0000","last_active":"2023-10-14T19:03:10.231800+0000","last_peered":"2023-10-14T19:03:10.231800+0000","last_clean":"2023-10-14T19:03:10.231800+0000","last_became_active":"2023-10-14T19:03:10.230749+0000","last_became_peered":"2023-10-14T19:03:10.230749+0000","last_unstale":"2023-10-14T19:03:10.231800+0000","last_undegraded":"2023-10-14T19:03:10.231800+0000","last_fullsized":"2023-10-14T19:03:10.231800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230362+0000","last_change":"2023-10-14T19:03:09.209057+0000","last_active":"2023-10-14T19:03:10.230362+0000","last_peered":"2023-10-14T19:03:10.230362+0000","last_clean":"2023-10-14T19:03:10.230362+0000","last_became_active":"2023-10-14T19:03:09.208250+0000","last_became_peered":"2023-10-14T19:03:09.208250+0000","last_unstale":"2023-10-14T19:03:10.230362+0000","last_undegraded":"2023-10-14T19:03:10.230362+0000","last_fullsized":"2023-10-14T19:03:10.230362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229580+0000","last_change":"2023-10-14T19:03:10.227667+0000","last_active":"2023-10-14T19:03:10.229580+0000","last_peered":"2023-10-14T19:03:10.229580+0000","last_clean":"2023-10-14T19:03:10.229580+0000","last_became_active":"2023-10-14T19:03:10.227114+0000","last_became_peered":"2023-10-14T19:03:10.227114+0000","last_unstale":"2023-10-14T19:03:10.229580+0000","last_undegraded":"2023-10-14T19:03:10.229580+0000","last_fullsized":"2023-10-14T19:03:10.229580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236879+0000","last_change":"2023-10-14T19:03:09.215258+0000","last_active":"2023-10-14T19:03:10.236879+0000","last_peered":"2023-10-14T19:03:10.236879+0000","last_clean":"2023-10-14T19:03:10.236879+0000","last_became_active":"2023-10-14T19:03:09.214984+0000","last_became_peered":"2023-10-14T19:03:09.214984+0000","last_unstale":"2023-10-14T19:03:10.236879+0000","last_undegraded":"2023-10-14T19:03:10.236879+0000","last_fullsized":"2023-10-14T19:03:10.236879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230515+0000","last_change":"2023-10-14T19:03:10.225703+0000","last_active":"2023-10-14T19:03:10.230515+0000","last_peered":"2023-10-14T19:03:10.230515+0000","last_clean":"2023-10-14T19:03:10.230515+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230515+0000","last_undegraded":"2023-10-14T19:03:10.230515+0000","last_fullsized":"2023-10-14T19:03:10.230515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239608+0000","last_change":"2023-10-14T19:03:09.211764+0000","last_active":"2023-10-14T19:03:10.239608+0000","last_peered":"2023-10-14T19:03:10.239608+0000","last_clean":"2023-10-14T19:03:10.239608+0000","last_became_active":"2023-10-14T19:03:09.211476+0000","last_became_peered":"2023-10-14T19:03:09.211476+0000","last_unstale":"2023-10-14T19:03:10.239608+0000","last_undegraded":"2023-10-14T19:03:10.239608+0000","last_fullsized":"2023-10-14T19:03:10.239608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:46.105558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230389+0000","last_change":"2023-10-14T19:03:10.224871+0000","last_active":"2023-10-14T19:03:10.230389+0000","last_peered":"2023-10-14T19:03:10.230389+0000","last_clean":"2023-10-14T19:03:10.230389+0000","last_became_active":"2023-10-14T19:03:10.224578+0000","last_became_peered":"2023-10-14T19:03:10.224578+0000","last_unstale":"2023-10-14T19:03:10.230389+0000","last_undegraded":"2023-10-14T19:03:10.230389+0000","last_fullsized":"2023-10-14T19:03:10.230389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.234024+0000","last_change":"2023-10-14T19:03:09.211558+0000","last_active":"2023-10-14T19:03:10.234024+0000","last_peered":"2023-10-14T19:03:10.234024+0000","last_clean":"2023-10-14T19:03:10.234024+0000","last_became_active":"2023-10-14T19:03:09.211048+0000","last_became_peered":"2023-10-14T19:03:09.211048+0000","last_unstale":"2023-10-14T19:03:10.234024+0000","last_undegraded":"2023-10-14T19:03:10.234024+0000","last_fullsized":"2023-10-14T19:03:10.234024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.215674+0000","last_change":"2023-10-14T19:03:10.210948+0000","last_active":"2023-10-14T19:03:10.215674+0000","last_peered":"2023-10-14T19:03:10.215674+0000","last_clean":"2023-10-14T19:03:10.215674+0000","last_became_active":"2023-10-14T19:03:10.210692+0000","last_became_peered":"2023-10-14T19:03:10.210692+0000","last_unstale":"2023-10-14T19:03:10.215674+0000","last_undegraded":"2023-10-14T19:03:10.215674+0000","last_fullsized":"2023-10-14T19:03:10.215674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241934+0000","last_change":"2023-10-14T19:03:09.212235+0000","last_active":"2023-10-14T19:03:10.241934+0000","last_peered":"2023-10-14T19:03:10.241934+0000","last_clean":"2023-10-14T19:03:10.241934+0000","last_became_active":"2023-10-14T19:03:09.209044+0000","last_became_peered":"2023-10-14T19:03:09.209044+0000","last_unstale":"2023-10-14T19:03:10.241934+0000","last_undegraded":"2023-10-14T19:03:10.241934+0000","last_fullsized":"2023-10-14T19:03:10.241934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219586+0000","last_change":"2023-10-14T19:03:10.216947+0000","last_active":"2023-10-14T19:03:10.219586+0000","last_peered":"2023-10-14T19:03:10.219586+0000","last_clean":"2023-10-14T19:03:10.219586+0000","last_became_active":"2023-10-14T19:03:10.216625+0000","last_became_peered":"2023-10-14T19:03:10.216625+0000","last_unstale":"2023-10-14T19:03:10.219586+0000","last_undegraded":"2023-10-14T19:03:10.219586+0000","last_fullsized":"2023-10-14T19:03:10.219586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.208754+0000","last_change":"2023-10-14T19:03:09.210714+0000","last_active":"2023-10-14T19:03:10.208754+0000","last_peered":"2023-10-14T19:03:10.208754+0000","last_clean":"2023-10-14T19:03:10.208754+0000","last_became_active":"2023-10-14T19:03:09.210471+0000","last_became_peered":"2023-10-14T19:03:09.210471+0000","last_unstale":"2023-10-14T19:03:10.208754+0000","last_undegraded":"2023-10-14T19:03:10.208754+0000","last_fullsized":"2023-10-14T19:03:10.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224023+0000","last_change":"2023-10-14T19:03:10.220661+0000","last_active":"2023-10-14T19:03:10.224023+0000","last_peered":"2023-10-14T19:03:10.224023+0000","last_clean":"2023-10-14T19:03:10.224023+0000","last_became_active":"2023-10-14T19:03:10.220323+0000","last_became_peered":"2023-10-14T19:03:10.220323+0000","last_unstale":"2023-10-14T19:03:10.224023+0000","last_undegraded":"2023-10-14T19:03:10.224023+0000","last_fullsized":"2023-10-14T19:03:10.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.210972+0000","last_change":"2023-10-14T19:03:09.209100+0000","last_active":"2023-10-14T19:03:10.210972+0000","last_peered":"2023-10-14T19:03:10.210972+0000","last_clean":"2023-10-14T19:03:10.210972+0000","last_became_active":"2023-10-14T19:03:09.208831+0000","last_became_peered":"2023-10-14T19:03:09.208831+0000","last_unstale":"2023-10-14T19:03:10.210972+0000","last_undegraded":"2023-10-14T19:03:10.210972+0000","last_fullsized":"2023-10-14T19:03:10.210972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219475+0000","last_change":"2023-10-14T19:03:10.216390+0000","last_active":"2023-10-14T19:03:10.219475+0000","last_peered":"2023-10-14T19:03:10.219475+0000","last_clean":"2023-10-14T19:03:10.219475+0000","last_became_active":"2023-10-14T19:03:10.215498+0000","last_became_peered":"2023-10-14T19:03:10.215498+0000","last_unstale":"2023-10-14T19:03:10.219475+0000","last_undegraded":"2023-10-14T19:03:10.219475+0000","last_fullsized":"2023-10-14T19:03:10.219475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220845+0000","last_change":"2023-10-14T19:03:09.211585+0000","last_active":"2023-10-14T19:03:10.220845+0000","last_peered":"2023-10-14T19:03:10.220845+0000","last_clean":"2023-10-14T19:03:10.220845+0000","last_became_active":"2023-10-14T19:03:09.211314+0000","last_became_peered":"2023-10-14T19:03:09.211314+0000","last_unstale":"2023-10-14T19:03:10.220845+0000","last_undegraded":"2023-10-14T19:03:10.220845+0000","last_fullsized":"2023-10-14T19:03:10.220845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.225113+0000","last_change":"2023-10-14T19:03:10.220371+0000","last_active":"2023-10-14T19:03:10.225113+0000","last_peered":"2023-10-14T19:03:10.225113+0000","last_clean":"2023-10-14T19:03:10.225113+0000","last_became_active":"2023-10-14T19:03:10.220030+0000","last_became_peered":"2023-10-14T19:03:10.220030+0000","last_unstale":"2023-10-14T19:03:10.225113+0000","last_undegraded":"2023-10-14T19:03:10.225113+0000","last_fullsized":"2023-10-14T19:03:10.225113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212066+0000","last_change":"2023-10-14T19:03:09.213906+0000","last_active":"2023-10-14T19:03:10.212066+0000","last_peered":"2023-10-14T19:03:10.212066+0000","last_clean":"2023-10-14T19:03:10.212066+0000","last_became_active":"2023-10-14T19:03:09.213622+0000","last_became_peered":"2023-10-14T19:03:09.213622+0000","last_unstale":"2023-10-14T19:03:10.212066+0000","last_undegraded":"2023-10-14T19:03:10.212066+0000","last_fullsized":"2023-10-14T19:03:10.212066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230062+0000","last_change":"2023-10-14T19:03:10.229217+0000","last_active":"2023-10-14T19:03:10.230062+0000","last_peered":"2023-10-14T19:03:10.230062+0000","last_clean":"2023-10-14T19:03:10.230062+0000","last_became_active":"2023-10-14T19:03:10.228955+0000","last_became_peered":"2023-10-14T19:03:10.228955+0000","last_unstale":"2023-10-14T19:03:10.230062+0000","last_undegraded":"2023-10-14T19:03:10.230062+0000","last_fullsized":"2023-10-14T19:03:10.230062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233544+0000","last_change":"2023-10-14T19:03:09.212292+0000","last_active":"2023-10-14T19:03:10.233544+0000","last_peered":"2023-10-14T19:03:10.233544+0000","last_clean":"2023-10-14T19:03:10.233544+0000","last_became_active":"2023-10-14T19:03:09.211886+0000","last_became_peered":"2023-10-14T19:03:09.211886+0000","last_unstale":"2023-10-14T19:03:10.233544+0000","last_undegraded":"2023-10-14T19:03:10.233544+0000","last_fullsized":"2023-10-14T19:03:10.233544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241806+0000","last_change":"2023-10-14T19:03:10.232172+0000","last_active":"2023-10-14T19:03:10.241806+0000","last_peered":"2023-10-14T19:03:10.241806+0000","last_clean":"2023-10-14T19:03:10.241806+0000","last_became_active":"2023-10-14T19:03:10.231839+0000","last_became_peered":"2023-10-14T19:03:10.231839+0000","last_unstale":"2023-10-14T19:03:10.241806+0000","last_undegraded":"2023-10-14T19:03:10.241806+0000","last_fullsized":"2023-10-14T19:03:10.241806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242055+0000","last_change":"2023-10-14T19:03:09.213629+0000","last_active":"2023-10-14T19:03:10.242055+0000","last_peered":"2023-10-14T19:03:10.242055+0000","last_clean":"2023-10-14T19:03:10.242055+0000","last_became_active":"2023-10-14T19:03:09.213380+0000","last_became_peered":"2023-10-14T19:03:09.213380+0000","last_unstale":"2023-10-14T19:03:10.242055+0000","last_undegraded":"2023-10-14T19:03:10.242055+0000","last_fullsized":"2023-10-14T19:03:10.242055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233796+0000","last_change":"2023-10-14T19:03:10.227726+0000","last_active":"2023-10-14T19:03:10.233796+0000","last_peered":"2023-10-14T19:03:10.233796+0000","last_clean":"2023-10-14T19:03:10.233796+0000","last_became_active":"2023-10-14T19:03:10.227442+0000","last_became_peered":"2023-10-14T19:03:10.227442+0000","last_unstale":"2023-10-14T19:03:10.233796+0000","last_undegraded":"2023-10-14T19:03:10.233796+0000","last_fullsized":"2023-10-14T19:03:10.233796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239821+0000","last_change":"2023-10-14T19:03:09.206678+0000","last_active":"2023-10-14T19:03:10.239821+0000","last_peered":"2023-10-14T19:03:10.239821+0000","last_clean":"2023-10-14T19:03:10.239821+0000","last_became_active":"2023-10-14T19:03:09.206186+0000","last_became_peered":"2023-10-14T19:03:09.206186+0000","last_unstale":"2023-10-14T19:03:10.239821+0000","last_undegraded":"2023-10-14T19:03:10.239821+0000","last_fullsized":"2023-10-14T19:03:10.239821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219137+0000","last_change":"2023-10-14T19:03:10.216802+0000","last_active":"2023-10-14T19:03:10.219137+0000","last_peered":"2023-10-14T19:03:10.219137+0000","last_clean":"2023-10-14T19:03:10.219137+0000","last_became_active":"2023-10-14T19:03:10.216416+0000","last_became_peered":"2023-10-14T19:03:10.216416+0000","last_unstale":"2023-10-14T19:03:10.219137+0000","last_undegraded":"2023-10-14T19:03:10.219137+0000","last_fullsized":"2023-10-14T19:03:10.219137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211294+0000","last_change":"2023-10-14T19:03:09.211236+0000","last_active":"2023-10-14T19:03:10.211294+0000","last_peered":"2023-10-14T19:03:10.211294+0000","last_clean":"2023-10-14T19:03:10.211294+0000","last_became_active":"2023-10-14T19:03:09.210972+0000","last_became_peered":"2023-10-14T19:03:09.210972+0000","last_unstale":"2023-10-14T19:03:10.211294+0000","last_undegraded":"2023-10-14T19:03:10.211294+0000","last_fullsized":"2023-10-14T19:03:10.211294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241921+0000","last_change":"2023-10-14T19:03:10.236770+0000","last_active":"2023-10-14T19:03:10.241921+0000","last_peered":"2023-10-14T19:03:10.241921+0000","last_clean":"2023-10-14T19:03:10.241921+0000","last_became_active":"2023-10-14T19:03:10.235368+0000","last_became_peered":"2023-10-14T19:03:10.235368+0000","last_unstale":"2023-10-14T19:03:10.241921+0000","last_undegraded":"2023-10-14T19:03:10.241921+0000","last_fullsized":"2023-10-14T19:03:10.241921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212724+0000","last_change":"2023-10-14T19:03:09.214552+0000","last_active":"2023-10-14T19:03:10.212724+0000","last_peered":"2023-10-14T19:03:10.212724+0000","last_clean":"2023-10-14T19:03:10.212724+0000","last_became_active":"2023-10-14T19:03:09.214229+0000","last_became_peered":"2023-10-14T19:03:09.214229+0000","last_unstale":"2023-10-14T19:03:10.212724+0000","last_undegraded":"2023-10-14T19:03:10.212724+0000","last_fullsized":"2023-10-14T19:03:10.212724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220484+0000","last_change":"2023-10-14T19:03:10.215197+0000","last_active":"2023-10-14T19:03:10.220484+0000","last_peered":"2023-10-14T19:03:10.220484+0000","last_clean":"2023-10-14T19:03:10.220484+0000","last_became_active":"2023-10-14T19:03:10.214896+0000","last_became_peered":"2023-10-14T19:03:10.214896+0000","last_unstale":"2023-10-14T19:03:10.220484+0000","last_undegraded":"2023-10-14T19:03:10.220484+0000","last_fullsized":"2023-10-14T19:03:10.220484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233697+0000","last_change":"2023-10-14T19:03:09.212453+0000","last_active":"2023-10-14T19:03:10.233697+0000","last_peered":"2023-10-14T19:03:10.233697+0000","last_clean":"2023-10-14T19:03:10.233697+0000","last_became_active":"2023-10-14T19:03:09.212138+0000","last_became_peered":"2023-10-14T19:03:09.212138+0000","last_unstale":"2023-10-14T19:03:10.233697+0000","last_undegraded":"2023-10-14T19:03:10.233697+0000","last_fullsized":"2023-10-14T19:03:10.233697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233462+0000","last_change":"2023-10-14T19:03:10.227505+0000","last_active":"2023-10-14T19:03:10.233462+0000","last_peered":"2023-10-14T19:03:10.233462+0000","last_clean":"2023-10-14T19:03:10.233462+0000","last_became_active":"2023-10-14T19:03:10.227226+0000","last_became_peered":"2023-10-14T19:03:10.227226+0000","last_unstale":"2023-10-14T19:03:10.233462+0000","last_undegraded":"2023-10-14T19:03:10.233462+0000","last_fullsized":"2023-10-14T19:03:10.233462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239242+0000","last_change":"2023-10-14T19:03:09.210288+0000","last_active":"2023-10-14T19:03:10.239242+0000","last_peered":"2023-10-14T19:03:10.239242+0000","last_clean":"2023-10-14T19:03:10.239242+0000","last_became_active":"2023-10-14T19:03:09.210053+0000","last_became_peered":"2023-10-14T19:03:09.210053+0000","last_unstale":"2023-10-14T19:03:10.239242+0000","last_undegraded":"2023-10-14T19:03:10.239242+0000","last_fullsized":"2023-10-14T19:03:10.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:39.004888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241891+0000","last_change":"2023-10-14T19:03:10.236537+0000","last_active":"2023-10-14T19:03:10.241891+0000","last_peered":"2023-10-14T19:03:10.241891+0000","last_clean":"2023-10-14T19:03:10.241891+0000","last_became_active":"2023-10-14T19:03:10.236256+0000","last_became_peered":"2023-10-14T19:03:10.236256+0000","last_unstale":"2023-10-14T19:03:10.241891+0000","last_undegraded":"2023-10-14T19:03:10.241891+0000","last_fullsized":"2023-10-14T19:03:10.241891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205718+0000","last_change":"2023-10-14T19:03:09.212576+0000","last_active":"2023-10-14T19:03:10.205718+0000","last_peered":"2023-10-14T19:03:10.205718+0000","last_clean":"2023-10-14T19:03:10.205718+0000","last_became_active":"2023-10-14T19:03:09.212291+0000","last_became_peered":"2023-10-14T19:03:09.212291+0000","last_unstale":"2023-10-14T19:03:10.205718+0000","last_undegraded":"2023-10-14T19:03:10.205718+0000","last_fullsized":"2023-10-14T19:03:10.205718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230366+0000","last_change":"2023-10-14T19:03:10.224600+0000","last_active":"2023-10-14T19:03:10.230366+0000","last_peered":"2023-10-14T19:03:10.230366+0000","last_clean":"2023-10-14T19:03:10.230366+0000","last_became_active":"2023-10-14T19:03:10.222507+0000","last_became_peered":"2023-10-14T19:03:10.222507+0000","last_unstale":"2023-10-14T19:03:10.230366+0000","last_undegraded":"2023-10-14T19:03:10.230366+0000","last_fullsized":"2023-10-14T19:03:10.230366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211190+0000","last_change":"2023-10-14T19:03:09.214386+0000","last_active":"2023-10-14T19:03:10.211190+0000","last_peered":"2023-10-14T19:03:10.211190+0000","last_clean":"2023-10-14T19:03:10.211190+0000","last_became_active":"2023-10-14T19:03:09.214062+0000","last_became_peered":"2023-10-14T19:03:09.214062+0000","last_unstale":"2023-10-14T19:03:10.211190+0000","last_undegraded":"2023-10-14T19:03:10.211190+0000","last_fullsized":"2023-10-14T19:03:10.211190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228871+0000","last_change":"2023-10-14T19:03:10.222746+0000","last_active":"2023-10-14T19:03:10.228871+0000","last_peered":"2023-10-14T19:03:10.228871+0000","last_clean":"2023-10-14T19:03:10.228871+0000","last_became_active":"2023-10-14T19:03:10.221548+0000","last_became_peered":"2023-10-14T19:03:10.221548+0000","last_unstale":"2023-10-14T19:03:10.228871+0000","last_undegraded":"2023-10-14T19:03:10.228871+0000","last_fullsized":"2023-10-14T19:03:10.228871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213873+0000","last_change":"2023-10-14T19:03:10.211030+0000","last_active":"2023-10-14T19:03:10.213873+0000","last_peered":"2023-10-14T19:03:10.213873+0000","last_clean":"2023-10-14T19:03:10.213873+0000","last_became_active":"2023-10-14T19:03:10.210612+0000","last_became_peered":"2023-10-14T19:03:10.210612+0000","last_unstale":"2023-10-14T19:03:10.213873+0000","last_undegraded":"2023-10-14T19:03:10.213873+0000","last_fullsized":"2023-10-14T19:03:10.213873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.203993+0000","last_change":"2023-10-14T19:03:09.207759+0000","last_active":"2023-10-14T19:03:10.203993+0000","last_peered":"2023-10-14T19:03:10.203993+0000","last_clean":"2023-10-14T19:03:10.203993+0000","last_became_active":"2023-10-14T19:03:09.207466+0000","last_became_peered":"2023-10-14T19:03:09.207466+0000","last_unstale":"2023-10-14T19:03:10.203993+0000","last_undegraded":"2023-10-14T19:03:10.203993+0000","last_fullsized":"2023-10-14T19:03:10.203993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227804+0000","last_change":"2023-10-14T19:03:10.226423+0000","last_active":"2023-10-14T19:03:10.227804+0000","last_peered":"2023-10-14T19:03:10.227804+0000","last_clean":"2023-10-14T19:03:10.227804+0000","last_became_active":"2023-10-14T19:03:10.226147+0000","last_became_peered":"2023-10-14T19:03:10.226147+0000","last_unstale":"2023-10-14T19:03:10.227804+0000","last_undegraded":"2023-10-14T19:03:10.227804+0000","last_fullsized":"2023-10-14T19:03:10.227804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211113+0000","last_change":"2023-10-14T19:03:09.200879+0000","last_active":"2023-10-14T19:03:10.211113+0000","last_peered":"2023-10-14T19:03:10.211113+0000","last_clean":"2023-10-14T19:03:10.211113+0000","last_became_active":"2023-10-14T19:03:09.200600+0000","last_became_peered":"2023-10-14T19:03:09.200600+0000","last_unstale":"2023-10-14T19:03:10.211113+0000","last_undegraded":"2023-10-14T19:03:10.211113+0000","last_fullsized":"2023-10-14T19:03:10.211113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214084+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:10.214084+0000","last_peered":"2023-10-14T19:03:10.214084+0000","last_clean":"2023-10-14T19:03:10.214084+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:10.214084+0000","last_undegraded":"2023-10-14T19:03:10.214084+0000","last_fullsized":"2023-10-14T19:03:10.214084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224176+0000","last_change":"2023-10-14T19:03:10.222157+0000","last_active":"2023-10-14T19:03:10.224176+0000","last_peered":"2023-10-14T19:03:10.224176+0000","last_clean":"2023-10-14T19:03:10.224176+0000","last_became_active":"2023-10-14T19:03:10.221908+0000","last_became_peered":"2023-10-14T19:03:10.221908+0000","last_unstale":"2023-10-14T19:03:10.224176+0000","last_undegraded":"2023-10-14T19:03:10.224176+0000","last_fullsized":"2023-10-14T19:03:10.224176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214197+0000","last_change":"2023-10-14T19:03:09.213139+0000","last_active":"2023-10-14T19:03:10.214197+0000","last_peered":"2023-10-14T19:03:10.214197+0000","last_clean":"2023-10-14T19:03:10.214197+0000","last_became_active":"2023-10-14T19:03:09.212808+0000","last_became_peered":"2023-10-14T19:03:09.212808+0000","last_unstale":"2023-10-14T19:03:10.214197+0000","last_undegraded":"2023-10-14T19:03:10.214197+0000","last_fullsized":"2023-10-14T19:03:10.214197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:57.697128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.217896+0000","last_change":"2023-10-14T19:03:09.211906+0000","last_active":"2023-10-14T19:03:10.217896+0000","last_peered":"2023-10-14T19:03:10.217896+0000","last_clean":"2023-10-14T19:03:10.217896+0000","last_became_active":"2023-10-14T19:03:09.211587+0000","last_became_peered":"2023-10-14T19:03:09.211587+0000","last_unstale":"2023-10-14T19:03:10.217896+0000","last_undegraded":"2023-10-14T19:03:10.217896+0000","last_fullsized":"2023-10-14T19:03:10.217896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213831+0000","last_change":"2023-10-14T19:03:10.210444+0000","last_active":"2023-10-14T19:03:10.213831+0000","last_peered":"2023-10-14T19:03:10.213831+0000","last_clean":"2023-10-14T19:03:10.213831+0000","last_became_active":"2023-10-14T19:03:10.210175+0000","last_became_peered":"2023-10-14T19:03:10.210175+0000","last_unstale":"2023-10-14T19:03:10.213831+0000","last_undegraded":"2023-10-14T19:03:10.213831+0000","last_fullsized":"2023-10-14T19:03:10.213831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204989+0000","last_change":"2023-10-14T19:03:09.213704+0000","last_active":"2023-10-14T19:03:10.204989+0000","last_peered":"2023-10-14T19:03:10.204989+0000","last_clean":"2023-10-14T19:03:10.204989+0000","last_became_active":"2023-10-14T19:03:09.213422+0000","last_became_peered":"2023-10-14T19:03:09.213422+0000","last_unstale":"2023-10-14T19:03:10.204989+0000","last_undegraded":"2023-10-14T19:03:10.204989+0000","last_fullsized":"2023-10-14T19:03:10.204989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229985+0000","last_change":"2023-10-14T19:03:10.227711+0000","last_active":"2023-10-14T19:03:10.229985+0000","last_peered":"2023-10-14T19:03:10.229985+0000","last_clean":"2023-10-14T19:03:10.229985+0000","last_became_active":"2023-10-14T19:03:10.227271+0000","last_became_peered":"2023-10-14T19:03:10.227271+0000","last_unstale":"2023-10-14T19:03:10.229985+0000","last_undegraded":"2023-10-14T19:03:10.229985+0000","last_fullsized":"2023-10-14T19:03:10.229985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.237073+0000","last_change":"2023-10-14T19:03:09.214397+0000","last_active":"2023-10-14T19:03:10.237073+0000","last_peered":"2023-10-14T19:03:10.237073+0000","last_clean":"2023-10-14T19:03:10.237073+0000","last_became_active":"2023-10-14T19:03:09.214100+0000","last_became_peered":"2023-10-14T19:03:09.214100+0000","last_unstale":"2023-10-14T19:03:10.237073+0000","last_undegraded":"2023-10-14T19:03:10.237073+0000","last_fullsized":"2023-10-14T19:03:10.237073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223211+0000","last_change":"2023-10-14T19:03:10.220584+0000","last_active":"2023-10-14T19:03:10.223211+0000","last_peered":"2023-10-14T19:03:10.223211+0000","last_clean":"2023-10-14T19:03:10.223211+0000","last_became_active":"2023-10-14T19:03:10.220310+0000","last_became_peered":"2023-10-14T19:03:10.220310+0000","last_unstale":"2023-10-14T19:03:10.223211+0000","last_undegraded":"2023-10-14T19:03:10.223211+0000","last_fullsized":"2023-10-14T19:03:10.223211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213993+0000","last_change":"2023-10-14T19:03:09.211690+0000","last_active":"2023-10-14T19:03:10.213993+0000","last_peered":"2023-10-14T19:03:10.213993+0000","last_clean":"2023-10-14T19:03:10.213993+0000","last_became_active":"2023-10-14T19:03:09.211425+0000","last_became_peered":"2023-10-14T19:03:09.211425+0000","last_unstale":"2023-10-14T19:03:10.213993+0000","last_undegraded":"2023-10-14T19:03:10.213993+0000","last_fullsized":"2023-10-14T19:03:10.213993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219325+0000","last_change":"2023-10-14T19:03:10.213207+0000","last_active":"2023-10-14T19:03:10.219325+0000","last_peered":"2023-10-14T19:03:10.219325+0000","last_clean":"2023-10-14T19:03:10.219325+0000","last_became_active":"2023-10-14T19:03:10.211874+0000","last_became_peered":"2023-10-14T19:03:10.211874+0000","last_unstale":"2023-10-14T19:03:10.219325+0000","last_undegraded":"2023-10-14T19:03:10.219325+0000","last_fullsized":"2023-10-14T19:03:10.219325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:45.278559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205193+0000","last_change":"2023-10-14T19:03:09.212745+0000","last_active":"2023-10-14T19:03:10.205193+0000","last_peered":"2023-10-14T19:03:10.205193+0000","last_clean":"2023-10-14T19:03:10.205193+0000","last_became_active":"2023-10-14T19:03:09.212470+0000","last_became_peered":"2023-10-14T19:03:09.212470+0000","last_unstale":"2023-10-14T19:03:10.205193+0000","last_undegraded":"2023-10-14T19:03:10.205193+0000","last_fullsized":"2023-10-14T19:03:10.205193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219163+0000","last_change":"2023-10-14T19:03:10.216098+0000","last_active":"2023-10-14T19:03:10.219163+0000","last_peered":"2023-10-14T19:03:10.219163+0000","last_clean":"2023-10-14T19:03:10.219163+0000","last_became_active":"2023-10-14T19:03:10.215829+0000","last_became_peered":"2023-10-14T19:03:10.215829+0000","last_unstale":"2023-10-14T19:03:10.219163+0000","last_undegraded":"2023-10-14T19:03:10.219163+0000","last_fullsized":"2023-10-14T19:03:10.219163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204639+0000","last_change":"2023-10-14T19:03:09.215395+0000","last_active":"2023-10-14T19:03:10.204639+0000","last_peered":"2023-10-14T19:03:10.204639+0000","last_clean":"2023-10-14T19:03:10.204639+0000","last_became_active":"2023-10-14T19:03:09.215081+0000","last_became_peered":"2023-10-14T19:03:09.215081+0000","last_unstale":"2023-10-14T19:03:10.204639+0000","last_undegraded":"2023-10-14T19:03:10.204639+0000","last_fullsized":"2023-10-14T19:03:10.204639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224034+0000","last_change":"2023-10-14T19:03:10.220693+0000","last_active":"2023-10-14T19:03:10.224034+0000","last_peered":"2023-10-14T19:03:10.224034+0000","last_clean":"2023-10-14T19:03:10.224034+0000","last_became_active":"2023-10-14T19:03:10.220340+0000","last_became_peered":"2023-10-14T19:03:10.220340+0000","last_unstale":"2023-10-14T19:03:10.224034+0000","last_undegraded":"2023-10-14T19:03:10.224034+0000","last_fullsized":"2023-10-14T19:03:10.224034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242172+0000","last_change":"2023-10-14T19:03:09.215682+0000","last_active":"2023-10-14T19:03:10.242172+0000","last_peered":"2023-10-14T19:03:10.242172+0000","last_clean":"2023-10-14T19:03:10.242172+0000","last_became_active":"2023-10-14T19:03:09.215405+0000","last_became_peered":"2023-10-14T19:03:09.215405+0000","last_unstale":"2023-10-14T19:03:10.242172+0000","last_undegraded":"2023-10-14T19:03:10.242172+0000","last_fullsized":"2023-10-14T19:03:10.242172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228190+0000","last_change":"2023-10-14T19:03:10.223659+0000","last_active":"2023-10-14T19:03:10.228190+0000","last_peered":"2023-10-14T19:03:10.228190+0000","last_clean":"2023-10-14T19:03:10.228190+0000","last_became_active":"2023-10-14T19:03:10.222280+0000","last_became_peered":"2023-10-14T19:03:10.222280+0000","last_unstale":"2023-10-14T19:03:10.228190+0000","last_undegraded":"2023-10-14T19:03:10.228190+0000","last_fullsized":"2023-10-14T19:03:10.228190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204006+0000","last_change":"2023-10-14T19:03:09.208270+0000","last_active":"2023-10-14T19:03:10.204006+0000","last_peered":"2023-10-14T19:03:10.204006+0000","last_clean":"2023-10-14T19:03:10.204006+0000","last_became_active":"2023-10-14T19:03:09.207959+0000","last_became_peered":"2023-10-14T19:03:09.207959+0000","last_unstale":"2023-10-14T19:03:10.204006+0000","last_undegraded":"2023-10-14T19:03:10.204006+0000","last_fullsized":"2023-10-14T19:03:10.204006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239694+0000","last_change":"2023-10-14T19:03:10.233909+0000","last_active":"2023-10-14T19:03:10.239694+0000","last_peered":"2023-10-14T19:03:10.239694+0000","last_clean":"2023-10-14T19:03:10.239694+0000","last_became_active":"2023-10-14T19:03:10.233422+0000","last_became_peered":"2023-10-14T19:03:10.233422+0000","last_unstale":"2023-10-14T19:03:10.239694+0000","last_undegraded":"2023-10-14T19:03:10.239694+0000","last_fullsized":"2023-10-14T19:03:10.239694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239570+0000","last_change":"2023-10-14T19:03:09.215232+0000","last_active":"2023-10-14T19:03:10.239570+0000","last_peered":"2023-10-14T19:03:10.239570+0000","last_clean":"2023-10-14T19:03:10.239570+0000","last_became_active":"2023-10-14T19:03:09.214965+0000","last_became_peered":"2023-10-14T19:03:09.214965+0000","last_unstale":"2023-10-14T19:03:10.239570+0000","last_undegraded":"2023-10-14T19:03:10.239570+0000","last_fullsized":"2023-10-14T19:03:10.239570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230537+0000","last_change":"2023-10-14T19:03:10.226324+0000","last_active":"2023-10-14T19:03:10.230537+0000","last_peered":"2023-10-14T19:03:10.230537+0000","last_clean":"2023-10-14T19:03:10.230537+0000","last_became_active":"2023-10-14T19:03:10.225606+0000","last_became_peered":"2023-10-14T19:03:10.225606+0000","last_unstale":"2023-10-14T19:03:10.230537+0000","last_undegraded":"2023-10-14T19:03:10.230537+0000","last_fullsized":"2023-10-14T19:03:10.230537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231144+0000","last_change":"2023-10-14T19:03:09.204163+0000","last_active":"2023-10-14T19:03:10.231144+0000","last_peered":"2023-10-14T19:03:10.231144+0000","last_clean":"2023-10-14T19:03:10.231144+0000","last_became_active":"2023-10-14T19:03:09.203726+0000","last_became_peered":"2023-10-14T19:03:09.203726+0000","last_unstale":"2023-10-14T19:03:10.231144+0000","last_undegraded":"2023-10-14T19:03:10.231144+0000","last_fullsized":"2023-10-14T19:03:10.231144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241864+0000","last_change":"2023-10-14T19:03:10.236516+0000","last_active":"2023-10-14T19:03:10.241864+0000","last_peered":"2023-10-14T19:03:10.241864+0000","last_clean":"2023-10-14T19:03:10.241864+0000","last_became_active":"2023-10-14T19:03:10.236201+0000","last_became_peered":"2023-10-14T19:03:10.236201+0000","last_unstale":"2023-10-14T19:03:10.241864+0000","last_undegraded":"2023-10-14T19:03:10.241864+0000","last_fullsized":"2023-10-14T19:03:10.241864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224903+0000","last_change":"2023-10-14T19:03:10.220597+0000","last_active":"2023-10-14T19:03:10.224903+0000","last_peered":"2023-10-14T19:03:10.224903+0000","last_clean":"2023-10-14T19:03:10.224903+0000","last_became_active":"2023-10-14T19:03:10.220306+0000","last_became_peered":"2023-10-14T19:03:10.220306+0000","last_unstale":"2023-10-14T19:03:10.224903+0000","last_undegraded":"2023-10-14T19:03:10.224903+0000","last_fullsized":"2023-10-14T19:03:10.224903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231223+0000","last_change":"2023-10-14T19:03:10.228189+0000","last_active":"2023-10-14T19:03:10.231223+0000","last_peered":"2023-10-14T19:03:10.231223+0000","last_clean":"2023-10-14T19:03:10.231223+0000","last_became_active":"2023-10-14T19:03:10.227963+0000","last_became_peered":"2023-10-14T19:03:10.227963+0000","last_unstale":"2023-10-14T19:03:10.231223+0000","last_undegraded":"2023-10-14T19:03:10.231223+0000","last_fullsized":"2023-10-14T19:03:10.231223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224291+0000","last_change":"2023-10-14T19:03:10.217965+0000","last_active":"2023-10-14T19:03:10.224291+0000","last_peered":"2023-10-14T19:03:10.224291+0000","last_clean":"2023-10-14T19:03:10.224291+0000","last_became_active":"2023-10-14T19:03:10.217687+0000","last_became_peered":"2023-10-14T19:03:10.217687+0000","last_unstale":"2023-10-14T19:03:10.224291+0000","last_undegraded":"2023-10-14T19:03:10.224291+0000","last_fullsized":"2023-10-14T19:03:10.224291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.221439+0000","last_change":"2023-10-14T19:03:10.219458+0000","last_active":"2023-10-14T19:03:10.221439+0000","last_peered":"2023-10-14T19:03:10.221439+0000","last_clean":"2023-10-14T19:03:10.221439+0000","last_became_active":"2023-10-14T19:03:10.219184+0000","last_became_peered":"2023-10-14T19:03:10.219184+0000","last_unstale":"2023-10-14T19:03:10.221439+0000","last_undegraded":"2023-10-14T19:03:10.221439+0000","last_fullsized":"2023-10-14T19:03:10.221439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224376+0000","last_change":"2023-10-14T19:03:10.223589+0000","last_active":"2023-10-14T19:03:10.224376+0000","last_peered":"2023-10-14T19:03:10.224376+0000","last_clean":"2023-10-14T19:03:10.224376+0000","last_became_active":"2023-10-14T19:03:10.223340+0000","last_became_peered":"2023-10-14T19:03:10.223340+0000","last_unstale":"2023-10-14T19:03:10.224376+0000","last_undegraded":"2023-10-14T19:03:10.224376+0000","last_fullsized":"2023-10-14T19:03:10.224376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219559+0000","last_change":"2023-10-14T19:03:10.216180+0000","last_active":"2023-10-14T19:03:10.219559+0000","last_peered":"2023-10-14T19:03:10.219559+0000","last_clean":"2023-10-14T19:03:10.219559+0000","last_became_active":"2023-10-14T19:03:10.215525+0000","last_became_peered":"2023-10-14T19:03:10.215525+0000","last_unstale":"2023-10-14T19:03:10.219559+0000","last_undegraded":"2023-10-14T19:03:10.219559+0000","last_fullsized":"2023-10-14T19:03:10.219559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228241+0000","last_change":"2023-10-14T19:03:10.221680+0000","last_active":"2023-10-14T19:03:10.228241+0000","last_peered":"2023-10-14T19:03:10.228241+0000","last_clean":"2023-10-14T19:03:10.228241+0000","last_became_active":"2023-10-14T19:03:10.221417+0000","last_became_peered":"2023-10-14T19:03:10.221417+0000","last_unstale":"2023-10-14T19:03:10.228241+0000","last_undegraded":"2023-10-14T19:03:10.228241+0000","last_fullsized":"2023-10-14T19:03:10.228241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216940+0000","last_change":"2023-10-14T19:03:10.214621+0000","last_active":"2023-10-14T19:03:10.216940+0000","last_peered":"2023-10-14T19:03:10.216940+0000","last_clean":"2023-10-14T19:03:10.216940+0000","last_became_active":"2023-10-14T19:03:10.214326+0000","last_became_peered":"2023-10-14T19:03:10.214326+0000","last_unstale":"2023-10-14T19:03:10.216940+0000","last_undegraded":"2023-10-14T19:03:10.216940+0000","last_fullsized":"2023-10-14T19:03:10.216940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230803+0000","last_change":"2023-10-14T19:03:10.224902+0000","last_active":"2023-10-14T19:03:10.230803+0000","last_peered":"2023-10-14T19:03:10.230803+0000","last_clean":"2023-10-14T19:03:10.230803+0000","last_became_active":"2023-10-14T19:03:10.224471+0000","last_became_peered":"2023-10-14T19:03:10.224471+0000","last_unstale":"2023-10-14T19:03:10.230803+0000","last_undegraded":"2023-10-14T19:03:10.230803+0000","last_fullsized":"2023-10-14T19:03:10.230803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216352+0000","last_change":"2023-10-14T19:03:10.213932+0000","last_active":"2023-10-14T19:03:10.216352+0000","last_peered":"2023-10-14T19:03:10.216352+0000","last_clean":"2023-10-14T19:03:10.216352+0000","last_became_active":"2023-10-14T19:03:10.213630+0000","last_became_peered":"2023-10-14T19:03:10.213630+0000","last_unstale":"2023-10-14T19:03:10.216352+0000","last_undegraded":"2023-10-14T19:03:10.216352+0000","last_fullsized":"2023-10-14T19:03:10.216352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231123+0000","last_change":"2023-10-14T19:03:10.225610+0000","last_active":"2023-10-14T19:03:10.231123+0000","last_peered":"2023-10-14T19:03:10.231123+0000","last_clean":"2023-10-14T19:03:10.231123+0000","last_became_active":"2023-10-14T19:03:10.225294+0000","last_became_peered":"2023-10-14T19:03:10.225294+0000","last_unstale":"2023-10-14T19:03:10.231123+0000","last_undegraded":"2023-10-14T19:03:10.231123+0000","last_fullsized":"2023-10-14T19:03:10.231123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229349+0000","last_change":"2023-10-14T19:03:10.227867+0000","last_active":"2023-10-14T19:03:10.229349+0000","last_peered":"2023-10-14T19:03:10.229349+0000","last_clean":"2023-10-14T19:03:10.229349+0000","last_became_active":"2023-10-14T19:03:10.227598+0000","last_became_peered":"2023-10-14T19:03:10.227598+0000","last_unstale":"2023-10-14T19:03:10.229349+0000","last_undegraded":"2023-10-14T19:03:10.229349+0000","last_fullsized":"2023-10-14T19:03:10.229349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228139+0000","last_change":"2023-10-14T19:03:10.222435+0000","last_active":"2023-10-14T19:03:10.228139+0000","last_peered":"2023-10-14T19:03:10.228139+0000","last_clean":"2023-10-14T19:03:10.228139+0000","last_became_active":"2023-10-14T19:03:10.222182+0000","last_became_peered":"2023-10-14T19:03:10.222182+0000","last_unstale":"2023-10-14T19:03:10.228139+0000","last_undegraded":"2023-10-14T19:03:10.228139+0000","last_fullsized":"2023-10-14T19:03:10.228139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2080000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1480000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0679999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1269999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4620000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4119999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7130000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:14.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:14.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.484+0000 7f5b568e6700 1 Processor -- start 2023-10-14T19:03:14.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.484+0000 7f5b568e6700 1 -- start start 2023-10-14T19:03:14.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.484+0000 7f5b568e6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b500a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.484+0000 7f5b568e6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b500ce1a0 con 0x7f5b500aee90 2023-10-14T19:03:14.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.484+0000 7f5b568e6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b500cd5d0 con 0x7f5b5006d280 2023-10-14T19:03:14.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.484+0000 7f5b568e6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500cd870 con 0x7f5b500a8be0 2023-10-14T19:03:14.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b54e83700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5b500aee90 0x7f5b500b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47386/0 (socket says 172.21.15.7:47386) 2023-10-14T19:03:14.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b54e83700 1 -- 172.21.15.7:0/2272077268 learned_addr learned my addr 172.21.15.7:0/2272077268 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4ffff700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b500a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693066246 0 0) 0x7f5b500ce1a0 con 0x7f5b500aee90 2023-10-14T19:03:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b38003570 con 0x7f5b500aee90 2023-10-14T19:03:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256301647 0 0) 0x7f5b500cd5d0 con 0x7f5b5006d280 2023-10-14T19:03:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b500ce1a0 con 0x7f5b5006d280 2023-10-14T19:03:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167337464 0 0) 0x7f5b38003570 con 0x7f5b500aee90 2023-10-14T19:03:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 msgr2=0x7f5b500a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b500a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 >> v1:172.21.15.148:6789/0 conn(0x7f5b5006d280 legacy=0x7f5b500ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b500cdb50 con 0x7f5b500aee90 2023-10-14T19:03:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f5b480017f0 con 0x7f5b500aee90 2023-10-14T19:03:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4ffff700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b500a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 >> v1:172.21.15.7:6789/0 conn(0x7f5b500aee90 legacy=0x7f5b500b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b38003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b38004160 0x7f5b38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b38004d50 0x7f5b380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500cd870 con 0x7f5b38004160 2023-10-14T19:03:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3800bba0 con 0x7f5b38004d50 2023-10-14T19:03:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3800bd60 con 0x7f5b500a8be0 2023-10-14T19:03:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b38004160 0x7f5b38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b4ffff700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b38003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.485+0000 7f5b54e83700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b38004d50 0x7f5b380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4f7fe700 1 -- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 msgr2=0x7f5b38003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b500a8be0 0x7f5b38003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4f7fe700 1 -- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b38004d50 msgr2=0x7f5b380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b38004d50 0x7f5b380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4f7fe700 1 -- 172.21.15.7:0/2272077268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400093c0 con 0x7f5b38004160 2023-10-14T19:03:14.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b38004160 0x7f5b38004810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b44001a30 tx=0x7f5b44007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8be663c159490f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440013f0 con 0x7f5b38004160 2023-10-14T19:03:14.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4400c5d0 con 0x7f5b38004160 2023-10-14T19:03:14.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b4effd700 1 -- 172.21.15.7:0/2272077268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400c990 con 0x7f5b38004160 2023-10-14T19:03:14.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b568e6700 1 -- 172.21.15.7:0/2272077268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b38004160 msgr2=0x7f5b38004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b568e6700 1 --2- 172.21.15.7:0/2272077268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b38004160 0x7f5b38004810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b44001a30 tx=0x7f5b44007d80 comp rx=0 tx=0).stop 2023-10-14T19:03:14.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b54e83700 1 -- 172.21.15.7:0/2272077268 reap_dead start 2023-10-14T19:03:14.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b568e6700 1 -- 172.21.15.7:0/2272077268 shutdown_connections 2023-10-14T19:03:14.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b568e6700 1 -- 172.21.15.7:0/2272077268 >> 172.21.15.7:0/2272077268 conn(0x7f5b5006ce80 msgr2=0x7f5b500ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:14.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b568e6700 1 -- 172.21.15.7:0/2272077268 shutdown_connections 2023-10-14T19:03:14.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.486+0000 7f5b568e6700 1 -- 172.21.15.7:0/2272077268 wait complete. 2023-10-14T19:03:14.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 Processor -- start 2023-10-14T19:03:14.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 -- start start 2023-10-14T19:03:14.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 0x7f5b50167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b50168360 0x7f5b5015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b5015d050 0x7f5b50169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b501691e0 con 0x7f5b50167a50 2023-10-14T19:03:14.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5015d840 con 0x7f5b5015d050 2023-10-14T19:03:14.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.488+0000 7f5b568e6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5015db20 con 0x7f5b50168360 2023-10-14T19:03:14.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 0x7f5b50167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 0x7f5b50167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37232/0 (socket says 172.21.15.7:37232) 2023-10-14T19:03:14.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 -- 172.21.15.7:0/3004134688 learned_addr learned my addr 172.21.15.7:0/3004134688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:14.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b50168360 0x7f5b5015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b54e83700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b5015d050 0x7f5b50169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 -- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b50168360 msgr2=0x7f5b5015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b50168360 0x7f5b5015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 -- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b5015d050 msgr2=0x7f5b50169670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b5015d050 0x7f5b50169670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 -- 172.21.15.7:0/3004134688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b50168e70 con 0x7f5b50167a50 2023-10-14T19:03:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b50168360 0x7f5b5015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b54e83700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b5015d050 0x7f5b50169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b4ffff700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 0x7f5b50167e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b40011cf0 tx=0x7f5b40009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000fcd0 con 0x7f5b50167a50 2023-10-14T19:03:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4000fe30 con 0x7f5b50167a50 2023-10-14T19:03:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4001d6b0 con 0x7f5b50167a50 2023-10-14T19:03:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b50168b70 con 0x7f5b50167a50 2023-10-14T19:03:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.489+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b501687d0 con 0x7f5b50167a50 2023-10-14T19:03:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.490+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5004c3c0 con 0x7f5b50167a50 2023-10-14T19:03:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.491+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b4001daa0 con 0x7f5b50167a50 2023-10-14T19:03:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.491+0000 7f5b37fff700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b3c066f30 0x7f5b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.491+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b40018070 con 0x7f5b50167a50 2023-10-14T19:03:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.491+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b3c066f30 0x7f5b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.492+0000 7f5b4f7fe700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b3c066f30 0x7f5b3c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b44001a30 tx=0x7f5b44015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.495+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b400526f0 con 0x7f5b50167a50 2023-10-14T19:03:14.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.684+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b5015d9b0 con 0x7f5b3c066f30 2023-10-14T19:03:14.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.692+0000 7f5b37fff700 1 -- 172.21.15.7:0/3004134688 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264672 (secure 0 0 0) 0x7f5b5015d9b0 con 0x7f5b3c066f30 2023-10-14T19:03:14.696 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b3c066f30 msgr2=0x7f5b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b3c066f30 0x7f5b3c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b44001a30 tx=0x7f5b44015000 comp rx=0 tx=0).stop 2023-10-14T19:03:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 msgr2=0x7f5b50167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 0x7f5b50167e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b40011cf0 tx=0x7f5b40009120 comp rx=0 tx=0).stop 2023-10-14T19:03:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 shutdown_connections 2023-10-14T19:03:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b3c066f30 0x7f5b3c0693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b5015d050 0x7f5b50169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b50167a50 0x7f5b50167e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 --2- 172.21.15.7:0/3004134688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b50168360 0x7f5b5015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.695+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 >> 172.21.15.7:0/3004134688 conn(0x7f5b5006ce80 msgr2=0x7f5b50159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.696+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 shutdown_connections 2023-10-14T19:03:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.696+0000 7f5b568e6700 1 -- 172.21.15.7:0/3004134688 wait complete. 2023-10-14T19:03:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:14.708 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T19:03:13.621774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426863"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236802+0000","last_change":"2023-10-14T19:03:10.230691+0000","last_active":"2023-10-14T19:03:10.236802+0000","last_peered":"2023-10-14T19:03:10.236802+0000","last_clean":"2023-10-14T19:03:10.236802+0000","last_became_active":"2023-10-14T19:03:10.230421+0000","last_became_peered":"2023-10-14T19:03:10.230421+0000","last_unstale":"2023-10-14T19:03:10.236802+0000","last_undegraded":"2023-10-14T19:03:10.236802+0000","last_fullsized":"2023-10-14T19:03:10.236802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220866+0000","last_change":"2023-10-14T19:03:10.218785+0000","last_active":"2023-10-14T19:03:10.220866+0000","last_peered":"2023-10-14T19:03:10.220866+0000","last_clean":"2023-10-14T19:03:10.220866+0000","last_became_active":"2023-10-14T19:03:10.218518+0000","last_became_peered":"2023-10-14T19:03:10.218518+0000","last_unstale":"2023-10-14T19:03:10.220866+0000","last_undegraded":"2023-10-14T19:03:10.220866+0000","last_fullsized":"2023-10-14T19:03:10.220866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.218469+0000","last_change":"2023-10-14T19:03:10.212986+0000","last_active":"2023-10-14T19:03:10.218469+0000","last_peered":"2023-10-14T19:03:10.218469+0000","last_clean":"2023-10-14T19:03:10.218469+0000","last_became_active":"2023-10-14T19:03:10.212712+0000","last_became_peered":"2023-10-14T19:03:10.212712+0000","last_unstale":"2023-10-14T19:03:10.218469+0000","last_undegraded":"2023-10-14T19:03:10.218469+0000","last_fullsized":"2023-10-14T19:03:10.218469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226118+0000","last_change":"2023-10-14T19:03:10.222522+0000","last_active":"2023-10-14T19:03:10.226118+0000","last_peered":"2023-10-14T19:03:10.226118+0000","last_clean":"2023-10-14T19:03:10.226118+0000","last_became_active":"2023-10-14T19:03:10.222033+0000","last_became_peered":"2023-10-14T19:03:10.222033+0000","last_unstale":"2023-10-14T19:03:10.226118+0000","last_undegraded":"2023-10-14T19:03:10.226118+0000","last_fullsized":"2023-10-14T19:03:10.226118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233555+0000","last_change":"2023-10-14T19:03:10.227209+0000","last_active":"2023-10-14T19:03:10.233555+0000","last_peered":"2023-10-14T19:03:10.233555+0000","last_clean":"2023-10-14T19:03:10.233555+0000","last_became_active":"2023-10-14T19:03:10.226848+0000","last_became_peered":"2023-10-14T19:03:10.226848+0000","last_unstale":"2023-10-14T19:03:10.233555+0000","last_undegraded":"2023-10-14T19:03:10.233555+0000","last_fullsized":"2023-10-14T19:03:10.233555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231156+0000","last_change":"2023-10-14T19:03:10.226159+0000","last_active":"2023-10-14T19:03:10.231156+0000","last_peered":"2023-10-14T19:03:10.231156+0000","last_clean":"2023-10-14T19:03:10.231156+0000","last_became_active":"2023-10-14T19:03:10.225860+0000","last_became_peered":"2023-10-14T19:03:10.225860+0000","last_unstale":"2023-10-14T19:03:10.231156+0000","last_undegraded":"2023-10-14T19:03:10.231156+0000","last_fullsized":"2023-10-14T19:03:10.231156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229437+0000","last_change":"2023-10-14T19:03:10.222973+0000","last_active":"2023-10-14T19:03:10.229437+0000","last_peered":"2023-10-14T19:03:10.229437+0000","last_clean":"2023-10-14T19:03:10.229437+0000","last_became_active":"2023-10-14T19:03:10.222694+0000","last_became_peered":"2023-10-14T19:03:10.222694+0000","last_unstale":"2023-10-14T19:03:10.229437+0000","last_undegraded":"2023-10-14T19:03:10.229437+0000","last_fullsized":"2023-10-14T19:03:10.229437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227789+0000","last_change":"2023-10-14T19:03:10.226142+0000","last_active":"2023-10-14T19:03:10.227789+0000","last_peered":"2023-10-14T19:03:10.227789+0000","last_clean":"2023-10-14T19:03:10.227789+0000","last_became_active":"2023-10-14T19:03:10.225807+0000","last_became_peered":"2023-10-14T19:03:10.225807+0000","last_unstale":"2023-10-14T19:03:10.227789+0000","last_undegraded":"2023-10-14T19:03:10.227789+0000","last_fullsized":"2023-10-14T19:03:10.227789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239732+0000","last_change":"2023-10-14T19:03:10.234612+0000","last_active":"2023-10-14T19:03:10.239732+0000","last_peered":"2023-10-14T19:03:10.239732+0000","last_clean":"2023-10-14T19:03:10.239732+0000","last_became_active":"2023-10-14T19:03:10.234121+0000","last_became_peered":"2023-10-14T19:03:10.234121+0000","last_unstale":"2023-10-14T19:03:10.239732+0000","last_undegraded":"2023-10-14T19:03:10.239732+0000","last_fullsized":"2023-10-14T19:03:10.239732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:05:02.219977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.232472+0000","last_change":"2023-10-14T19:03:10.227725+0000","last_active":"2023-10-14T19:03:10.232472+0000","last_peered":"2023-10-14T19:03:10.232472+0000","last_clean":"2023-10-14T19:03:10.232472+0000","last_became_active":"2023-10-14T19:03:10.227514+0000","last_became_peered":"2023-10-14T19:03:10.227514+0000","last_unstale":"2023-10-14T19:03:10.232472+0000","last_undegraded":"2023-10-14T19:03:10.232472+0000","last_fullsized":"2023-10-14T19:03:10.232472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230503+0000","last_change":"2023-10-14T19:03:10.225519+0000","last_active":"2023-10-14T19:03:10.230503+0000","last_peered":"2023-10-14T19:03:10.230503+0000","last_clean":"2023-10-14T19:03:10.230503+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230503+0000","last_undegraded":"2023-10-14T19:03:10.230503+0000","last_fullsized":"2023-10-14T19:03:10.230503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226243+0000","last_change":"2023-10-14T19:03:10.222180+0000","last_active":"2023-10-14T19:03:10.226243+0000","last_peered":"2023-10-14T19:03:10.226243+0000","last_clean":"2023-10-14T19:03:10.226243+0000","last_became_active":"2023-10-14T19:03:10.221860+0000","last_became_peered":"2023-10-14T19:03:10.221860+0000","last_unstale":"2023-10-14T19:03:10.226243+0000","last_undegraded":"2023-10-14T19:03:10.226243+0000","last_fullsized":"2023-10-14T19:03:10.226243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:06.624716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224317+0000","last_change":"2023-10-14T19:03:10.221789+0000","last_active":"2023-10-14T19:03:10.224317+0000","last_peered":"2023-10-14T19:03:10.224317+0000","last_clean":"2023-10-14T19:03:10.224317+0000","last_became_active":"2023-10-14T19:03:10.221495+0000","last_became_peered":"2023-10-14T19:03:10.221495+0000","last_unstale":"2023-10-14T19:03:10.224317+0000","last_undegraded":"2023-10-14T19:03:10.224317+0000","last_fullsized":"2023-10-14T19:03:10.224317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223791+0000","last_change":"2023-10-14T19:03:10.220586+0000","last_active":"2023-10-14T19:03:10.223791+0000","last_peered":"2023-10-14T19:03:10.223791+0000","last_clean":"2023-10-14T19:03:10.223791+0000","last_became_active":"2023-10-14T19:03:10.220319+0000","last_became_peered":"2023-10-14T19:03:10.220319+0000","last_unstale":"2023-10-14T19:03:10.223791+0000","last_undegraded":"2023-10-14T19:03:10.223791+0000","last_fullsized":"2023-10-14T19:03:10.223791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219497+0000","last_change":"2023-10-14T19:03:10.216808+0000","last_active":"2023-10-14T19:03:10.219497+0000","last_peered":"2023-10-14T19:03:10.219497+0000","last_clean":"2023-10-14T19:03:10.219497+0000","last_became_active":"2023-10-14T19:03:10.215467+0000","last_became_peered":"2023-10-14T19:03:10.215467+0000","last_unstale":"2023-10-14T19:03:10.219497+0000","last_undegraded":"2023-10-14T19:03:10.219497+0000","last_fullsized":"2023-10-14T19:03:10.219497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231936+0000","last_change":"2023-10-14T19:03:10.226710+0000","last_active":"2023-10-14T19:03:10.231936+0000","last_peered":"2023-10-14T19:03:10.231936+0000","last_clean":"2023-10-14T19:03:10.231936+0000","last_became_active":"2023-10-14T19:03:10.226470+0000","last_became_peered":"2023-10-14T19:03:10.226470+0000","last_unstale":"2023-10-14T19:03:10.231936+0000","last_undegraded":"2023-10-14T19:03:10.231936+0000","last_fullsized":"2023-10-14T19:03:10.231936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230949+0000","last_change":"2023-10-14T19:03:10.227805+0000","last_active":"2023-10-14T19:03:10.230949+0000","last_peered":"2023-10-14T19:03:10.230949+0000","last_clean":"2023-10-14T19:03:10.230949+0000","last_became_active":"2023-10-14T19:03:10.227530+0000","last_became_peered":"2023-10-14T19:03:10.227530+0000","last_unstale":"2023-10-14T19:03:10.230949+0000","last_undegraded":"2023-10-14T19:03:10.230949+0000","last_fullsized":"2023-10-14T19:03:10.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212844+0000","last_change":"2023-10-14T19:03:10.211421+0000","last_active":"2023-10-14T19:03:10.212844+0000","last_peered":"2023-10-14T19:03:10.212844+0000","last_clean":"2023-10-14T19:03:10.212844+0000","last_became_active":"2023-10-14T19:03:10.211127+0000","last_became_peered":"2023-10-14T19:03:10.211127+0000","last_unstale":"2023-10-14T19:03:10.212844+0000","last_undegraded":"2023-10-14T19:03:10.212844+0000","last_fullsized":"2023-10-14T19:03:10.212844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:47.109849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233763+0000","last_change":"2023-10-14T19:03:10.227239+0000","last_active":"2023-10-14T19:03:10.233763+0000","last_peered":"2023-10-14T19:03:10.233763+0000","last_clean":"2023-10-14T19:03:10.233763+0000","last_became_active":"2023-10-14T19:03:10.226914+0000","last_became_peered":"2023-10-14T19:03:10.226914+0000","last_unstale":"2023-10-14T19:03:10.233763+0000","last_undegraded":"2023-10-14T19:03:10.233763+0000","last_fullsized":"2023-10-14T19:03:10.233763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236969+0000","last_change":"2023-10-14T19:03:09.214413+0000","last_active":"2023-10-14T19:03:10.236969+0000","last_peered":"2023-10-14T19:03:10.236969+0000","last_clean":"2023-10-14T19:03:10.236969+0000","last_became_active":"2023-10-14T19:03:09.214117+0000","last_became_peered":"2023-10-14T19:03:09.214117+0000","last_unstale":"2023-10-14T19:03:10.236969+0000","last_undegraded":"2023-10-14T19:03:10.236969+0000","last_fullsized":"2023-10-14T19:03:10.236969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:55.947066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231800+0000","last_change":"2023-10-14T19:03:10.231111+0000","last_active":"2023-10-14T19:03:10.231800+0000","last_peered":"2023-10-14T19:03:10.231800+0000","last_clean":"2023-10-14T19:03:10.231800+0000","last_became_active":"2023-10-14T19:03:10.230749+0000","last_became_peered":"2023-10-14T19:03:10.230749+0000","last_unstale":"2023-10-14T19:03:10.231800+0000","last_undegraded":"2023-10-14T19:03:10.231800+0000","last_fullsized":"2023-10-14T19:03:10.231800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230362+0000","last_change":"2023-10-14T19:03:09.209057+0000","last_active":"2023-10-14T19:03:10.230362+0000","last_peered":"2023-10-14T19:03:10.230362+0000","last_clean":"2023-10-14T19:03:10.230362+0000","last_became_active":"2023-10-14T19:03:09.208250+0000","last_became_peered":"2023-10-14T19:03:09.208250+0000","last_unstale":"2023-10-14T19:03:10.230362+0000","last_undegraded":"2023-10-14T19:03:10.230362+0000","last_fullsized":"2023-10-14T19:03:10.230362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229580+0000","last_change":"2023-10-14T19:03:10.227667+0000","last_active":"2023-10-14T19:03:10.229580+0000","last_peered":"2023-10-14T19:03:10.229580+0000","last_clean":"2023-10-14T19:03:10.229580+0000","last_became_active":"2023-10-14T19:03:10.227114+0000","last_became_peered":"2023-10-14T19:03:10.227114+0000","last_unstale":"2023-10-14T19:03:10.229580+0000","last_undegraded":"2023-10-14T19:03:10.229580+0000","last_fullsized":"2023-10-14T19:03:10.229580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236879+0000","last_change":"2023-10-14T19:03:09.215258+0000","last_active":"2023-10-14T19:03:10.236879+0000","last_peered":"2023-10-14T19:03:10.236879+0000","last_clean":"2023-10-14T19:03:10.236879+0000","last_became_active":"2023-10-14T19:03:09.214984+0000","last_became_peered":"2023-10-14T19:03:09.214984+0000","last_unstale":"2023-10-14T19:03:10.236879+0000","last_undegraded":"2023-10-14T19:03:10.236879+0000","last_fullsized":"2023-10-14T19:03:10.236879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230515+0000","last_change":"2023-10-14T19:03:10.225703+0000","last_active":"2023-10-14T19:03:10.230515+0000","last_peered":"2023-10-14T19:03:10.230515+0000","last_clean":"2023-10-14T19:03:10.230515+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230515+0000","last_undegraded":"2023-10-14T19:03:10.230515+0000","last_fullsized":"2023-10-14T19:03:10.230515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239608+0000","last_change":"2023-10-14T19:03:09.211764+0000","last_active":"2023-10-14T19:03:10.239608+0000","last_peered":"2023-10-14T19:03:10.239608+0000","last_clean":"2023-10-14T19:03:10.239608+0000","last_became_active":"2023-10-14T19:03:09.211476+0000","last_became_peered":"2023-10-14T19:03:09.211476+0000","last_unstale":"2023-10-14T19:03:10.239608+0000","last_undegraded":"2023-10-14T19:03:10.239608+0000","last_fullsized":"2023-10-14T19:03:10.239608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:46.105558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230389+0000","last_change":"2023-10-14T19:03:10.224871+0000","last_active":"2023-10-14T19:03:10.230389+0000","last_peered":"2023-10-14T19:03:10.230389+0000","last_clean":"2023-10-14T19:03:10.230389+0000","last_became_active":"2023-10-14T19:03:10.224578+0000","last_became_peered":"2023-10-14T19:03:10.224578+0000","last_unstale":"2023-10-14T19:03:10.230389+0000","last_undegraded":"2023-10-14T19:03:10.230389+0000","last_fullsized":"2023-10-14T19:03:10.230389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.234024+0000","last_change":"2023-10-14T19:03:09.211558+0000","last_active":"2023-10-14T19:03:10.234024+0000","last_peered":"2023-10-14T19:03:10.234024+0000","last_clean":"2023-10-14T19:03:10.234024+0000","last_became_active":"2023-10-14T19:03:09.211048+0000","last_became_peered":"2023-10-14T19:03:09.211048+0000","last_unstale":"2023-10-14T19:03:10.234024+0000","last_undegraded":"2023-10-14T19:03:10.234024+0000","last_fullsized":"2023-10-14T19:03:10.234024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.215674+0000","last_change":"2023-10-14T19:03:10.210948+0000","last_active":"2023-10-14T19:03:10.215674+0000","last_peered":"2023-10-14T19:03:10.215674+0000","last_clean":"2023-10-14T19:03:10.215674+0000","last_became_active":"2023-10-14T19:03:10.210692+0000","last_became_peered":"2023-10-14T19:03:10.210692+0000","last_unstale":"2023-10-14T19:03:10.215674+0000","last_undegraded":"2023-10-14T19:03:10.215674+0000","last_fullsized":"2023-10-14T19:03:10.215674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241934+0000","last_change":"2023-10-14T19:03:09.212235+0000","last_active":"2023-10-14T19:03:10.241934+0000","last_peered":"2023-10-14T19:03:10.241934+0000","last_clean":"2023-10-14T19:03:10.241934+0000","last_became_active":"2023-10-14T19:03:09.209044+0000","last_became_peered":"2023-10-14T19:03:09.209044+0000","last_unstale":"2023-10-14T19:03:10.241934+0000","last_undegraded":"2023-10-14T19:03:10.241934+0000","last_fullsized":"2023-10-14T19:03:10.241934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219586+0000","last_change":"2023-10-14T19:03:10.216947+0000","last_active":"2023-10-14T19:03:10.219586+0000","last_peered":"2023-10-14T19:03:10.219586+0000","last_clean":"2023-10-14T19:03:10.219586+0000","last_became_active":"2023-10-14T19:03:10.216625+0000","last_became_peered":"2023-10-14T19:03:10.216625+0000","last_unstale":"2023-10-14T19:03:10.219586+0000","last_undegraded":"2023-10-14T19:03:10.219586+0000","last_fullsized":"2023-10-14T19:03:10.219586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.208754+0000","last_change":"2023-10-14T19:03:09.210714+0000","last_active":"2023-10-14T19:03:10.208754+0000","last_peered":"2023-10-14T19:03:10.208754+0000","last_clean":"2023-10-14T19:03:10.208754+0000","last_became_active":"2023-10-14T19:03:09.210471+0000","last_became_peered":"2023-10-14T19:03:09.210471+0000","last_unstale":"2023-10-14T19:03:10.208754+0000","last_undegraded":"2023-10-14T19:03:10.208754+0000","last_fullsized":"2023-10-14T19:03:10.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224023+0000","last_change":"2023-10-14T19:03:10.220661+0000","last_active":"2023-10-14T19:03:10.224023+0000","last_peered":"2023-10-14T19:03:10.224023+0000","last_clean":"2023-10-14T19:03:10.224023+0000","last_became_active":"2023-10-14T19:03:10.220323+0000","last_became_peered":"2023-10-14T19:03:10.220323+0000","last_unstale":"2023-10-14T19:03:10.224023+0000","last_undegraded":"2023-10-14T19:03:10.224023+0000","last_fullsized":"2023-10-14T19:03:10.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.210972+0000","last_change":"2023-10-14T19:03:09.209100+0000","last_active":"2023-10-14T19:03:10.210972+0000","last_peered":"2023-10-14T19:03:10.210972+0000","last_clean":"2023-10-14T19:03:10.210972+0000","last_became_active":"2023-10-14T19:03:09.208831+0000","last_became_peered":"2023-10-14T19:03:09.208831+0000","last_unstale":"2023-10-14T19:03:10.210972+0000","last_undegraded":"2023-10-14T19:03:10.210972+0000","last_fullsized":"2023-10-14T19:03:10.210972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219475+0000","last_change":"2023-10-14T19:03:10.216390+0000","last_active":"2023-10-14T19:03:10.219475+0000","last_peered":"2023-10-14T19:03:10.219475+0000","last_clean":"2023-10-14T19:03:10.219475+0000","last_became_active":"2023-10-14T19:03:10.215498+0000","last_became_peered":"2023-10-14T19:03:10.215498+0000","last_unstale":"2023-10-14T19:03:10.219475+0000","last_undegraded":"2023-10-14T19:03:10.219475+0000","last_fullsized":"2023-10-14T19:03:10.219475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220845+0000","last_change":"2023-10-14T19:03:09.211585+0000","last_active":"2023-10-14T19:03:10.220845+0000","last_peered":"2023-10-14T19:03:10.220845+0000","last_clean":"2023-10-14T19:03:10.220845+0000","last_became_active":"2023-10-14T19:03:09.211314+0000","last_became_peered":"2023-10-14T19:03:09.211314+0000","last_unstale":"2023-10-14T19:03:10.220845+0000","last_undegraded":"2023-10-14T19:03:10.220845+0000","last_fullsized":"2023-10-14T19:03:10.220845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.225113+0000","last_change":"2023-10-14T19:03:10.220371+0000","last_active":"2023-10-14T19:03:10.225113+0000","last_peered":"2023-10-14T19:03:10.225113+0000","last_clean":"2023-10-14T19:03:10.225113+0000","last_became_active":"2023-10-14T19:03:10.220030+0000","last_became_peered":"2023-10-14T19:03:10.220030+0000","last_unstale":"2023-10-14T19:03:10.225113+0000","last_undegraded":"2023-10-14T19:03:10.225113+0000","last_fullsized":"2023-10-14T19:03:10.225113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212066+0000","last_change":"2023-10-14T19:03:09.213906+0000","last_active":"2023-10-14T19:03:10.212066+0000","last_peered":"2023-10-14T19:03:10.212066+0000","last_clean":"2023-10-14T19:03:10.212066+0000","last_became_active":"2023-10-14T19:03:09.213622+0000","last_became_peered":"2023-10-14T19:03:09.213622+0000","last_unstale":"2023-10-14T19:03:10.212066+0000","last_undegraded":"2023-10-14T19:03:10.212066+0000","last_fullsized":"2023-10-14T19:03:10.212066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230062+0000","last_change":"2023-10-14T19:03:10.229217+0000","last_active":"2023-10-14T19:03:10.230062+0000","last_peered":"2023-10-14T19:03:10.230062+0000","last_clean":"2023-10-14T19:03:10.230062+0000","last_became_active":"2023-10-14T19:03:10.228955+0000","last_became_peered":"2023-10-14T19:03:10.228955+0000","last_unstale":"2023-10-14T19:03:10.230062+0000","last_undegraded":"2023-10-14T19:03:10.230062+0000","last_fullsized":"2023-10-14T19:03:10.230062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233544+0000","last_change":"2023-10-14T19:03:09.212292+0000","last_active":"2023-10-14T19:03:10.233544+0000","last_peered":"2023-10-14T19:03:10.233544+0000","last_clean":"2023-10-14T19:03:10.233544+0000","last_became_active":"2023-10-14T19:03:09.211886+0000","last_became_peered":"2023-10-14T19:03:09.211886+0000","last_unstale":"2023-10-14T19:03:10.233544+0000","last_undegraded":"2023-10-14T19:03:10.233544+0000","last_fullsized":"2023-10-14T19:03:10.233544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241806+0000","last_change":"2023-10-14T19:03:10.232172+0000","last_active":"2023-10-14T19:03:10.241806+0000","last_peered":"2023-10-14T19:03:10.241806+0000","last_clean":"2023-10-14T19:03:10.241806+0000","last_became_active":"2023-10-14T19:03:10.231839+0000","last_became_peered":"2023-10-14T19:03:10.231839+0000","last_unstale":"2023-10-14T19:03:10.241806+0000","last_undegraded":"2023-10-14T19:03:10.241806+0000","last_fullsized":"2023-10-14T19:03:10.241806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242055+0000","last_change":"2023-10-14T19:03:09.213629+0000","last_active":"2023-10-14T19:03:10.242055+0000","last_peered":"2023-10-14T19:03:10.242055+0000","last_clean":"2023-10-14T19:03:10.242055+0000","last_became_active":"2023-10-14T19:03:09.213380+0000","last_became_peered":"2023-10-14T19:03:09.213380+0000","last_unstale":"2023-10-14T19:03:10.242055+0000","last_undegraded":"2023-10-14T19:03:10.242055+0000","last_fullsized":"2023-10-14T19:03:10.242055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233796+0000","last_change":"2023-10-14T19:03:10.227726+0000","last_active":"2023-10-14T19:03:10.233796+0000","last_peered":"2023-10-14T19:03:10.233796+0000","last_clean":"2023-10-14T19:03:10.233796+0000","last_became_active":"2023-10-14T19:03:10.227442+0000","last_became_peered":"2023-10-14T19:03:10.227442+0000","last_unstale":"2023-10-14T19:03:10.233796+0000","last_undegraded":"2023-10-14T19:03:10.233796+0000","last_fullsized":"2023-10-14T19:03:10.233796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239821+0000","last_change":"2023-10-14T19:03:09.206678+0000","last_active":"2023-10-14T19:03:10.239821+0000","last_peered":"2023-10-14T19:03:10.239821+0000","last_clean":"2023-10-14T19:03:10.239821+0000","last_became_active":"2023-10-14T19:03:09.206186+0000","last_became_peered":"2023-10-14T19:03:09.206186+0000","last_unstale":"2023-10-14T19:03:10.239821+0000","last_undegraded":"2023-10-14T19:03:10.239821+0000","last_fullsized":"2023-10-14T19:03:10.239821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219137+0000","last_change":"2023-10-14T19:03:10.216802+0000","last_active":"2023-10-14T19:03:10.219137+0000","last_peered":"2023-10-14T19:03:10.219137+0000","last_clean":"2023-10-14T19:03:10.219137+0000","last_became_active":"2023-10-14T19:03:10.216416+0000","last_became_peered":"2023-10-14T19:03:10.216416+0000","last_unstale":"2023-10-14T19:03:10.219137+0000","last_undegraded":"2023-10-14T19:03:10.219137+0000","last_fullsized":"2023-10-14T19:03:10.219137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211294+0000","last_change":"2023-10-14T19:03:09.211236+0000","last_active":"2023-10-14T19:03:10.211294+0000","last_peered":"2023-10-14T19:03:10.211294+0000","last_clean":"2023-10-14T19:03:10.211294+0000","last_became_active":"2023-10-14T19:03:09.210972+0000","last_became_peered":"2023-10-14T19:03:09.210972+0000","last_unstale":"2023-10-14T19:03:10.211294+0000","last_undegraded":"2023-10-14T19:03:10.211294+0000","last_fullsized":"2023-10-14T19:03:10.211294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241921+0000","last_change":"2023-10-14T19:03:10.236770+0000","last_active":"2023-10-14T19:03:10.241921+0000","last_peered":"2023-10-14T19:03:10.241921+0000","last_clean":"2023-10-14T19:03:10.241921+0000","last_became_active":"2023-10-14T19:03:10.235368+0000","last_became_peered":"2023-10-14T19:03:10.235368+0000","last_unstale":"2023-10-14T19:03:10.241921+0000","last_undegraded":"2023-10-14T19:03:10.241921+0000","last_fullsized":"2023-10-14T19:03:10.241921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212724+0000","last_change":"2023-10-14T19:03:09.214552+0000","last_active":"2023-10-14T19:03:10.212724+0000","last_peered":"2023-10-14T19:03:10.212724+0000","last_clean":"2023-10-14T19:03:10.212724+0000","last_became_active":"2023-10-14T19:03:09.214229+0000","last_became_peered":"2023-10-14T19:03:09.214229+0000","last_unstale":"2023-10-14T19:03:10.212724+0000","last_undegraded":"2023-10-14T19:03:10.212724+0000","last_fullsized":"2023-10-14T19:03:10.212724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220484+0000","last_change":"2023-10-14T19:03:10.215197+0000","last_active":"2023-10-14T19:03:10.220484+0000","last_peered":"2023-10-14T19:03:10.220484+0000","last_clean":"2023-10-14T19:03:10.220484+0000","last_became_active":"2023-10-14T19:03:10.214896+0000","last_became_peered":"2023-10-14T19:03:10.214896+0000","last_unstale":"2023-10-14T19:03:10.220484+0000","last_undegraded":"2023-10-14T19:03:10.220484+0000","last_fullsized":"2023-10-14T19:03:10.220484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233697+0000","last_change":"2023-10-14T19:03:09.212453+0000","last_active":"2023-10-14T19:03:10.233697+0000","last_peered":"2023-10-14T19:03:10.233697+0000","last_clean":"2023-10-14T19:03:10.233697+0000","last_became_active":"2023-10-14T19:03:09.212138+0000","last_became_peered":"2023-10-14T19:03:09.212138+0000","last_unstale":"2023-10-14T19:03:10.233697+0000","last_undegraded":"2023-10-14T19:03:10.233697+0000","last_fullsized":"2023-10-14T19:03:10.233697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233462+0000","last_change":"2023-10-14T19:03:10.227505+0000","last_active":"2023-10-14T19:03:10.233462+0000","last_peered":"2023-10-14T19:03:10.233462+0000","last_clean":"2023-10-14T19:03:10.233462+0000","last_became_active":"2023-10-14T19:03:10.227226+0000","last_became_peered":"2023-10-14T19:03:10.227226+0000","last_unstale":"2023-10-14T19:03:10.233462+0000","last_undegraded":"2023-10-14T19:03:10.233462+0000","last_fullsized":"2023-10-14T19:03:10.233462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239242+0000","last_change":"2023-10-14T19:03:09.210288+0000","last_active":"2023-10-14T19:03:10.239242+0000","last_peered":"2023-10-14T19:03:10.239242+0000","last_clean":"2023-10-14T19:03:10.239242+0000","last_became_active":"2023-10-14T19:03:09.210053+0000","last_became_peered":"2023-10-14T19:03:09.210053+0000","last_unstale":"2023-10-14T19:03:10.239242+0000","last_undegraded":"2023-10-14T19:03:10.239242+0000","last_fullsized":"2023-10-14T19:03:10.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:39.004888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241891+0000","last_change":"2023-10-14T19:03:10.236537+0000","last_active":"2023-10-14T19:03:10.241891+0000","last_peered":"2023-10-14T19:03:10.241891+0000","last_clean":"2023-10-14T19:03:10.241891+0000","last_became_active":"2023-10-14T19:03:10.236256+0000","last_became_peered":"2023-10-14T19:03:10.236256+0000","last_unstale":"2023-10-14T19:03:10.241891+0000","last_undegraded":"2023-10-14T19:03:10.241891+0000","last_fullsized":"2023-10-14T19:03:10.241891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205718+0000","last_change":"2023-10-14T19:03:09.212576+0000","last_active":"2023-10-14T19:03:10.205718+0000","last_peered":"2023-10-14T19:03:10.205718+0000","last_clean":"2023-10-14T19:03:10.205718+0000","last_became_active":"2023-10-14T19:03:09.212291+0000","last_became_peered":"2023-10-14T19:03:09.212291+0000","last_unstale":"2023-10-14T19:03:10.205718+0000","last_undegraded":"2023-10-14T19:03:10.205718+0000","last_fullsized":"2023-10-14T19:03:10.205718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230366+0000","last_change":"2023-10-14T19:03:10.224600+0000","last_active":"2023-10-14T19:03:10.230366+0000","last_peered":"2023-10-14T19:03:10.230366+0000","last_clean":"2023-10-14T19:03:10.230366+0000","last_became_active":"2023-10-14T19:03:10.222507+0000","last_became_peered":"2023-10-14T19:03:10.222507+0000","last_unstale":"2023-10-14T19:03:10.230366+0000","last_undegraded":"2023-10-14T19:03:10.230366+0000","last_fullsized":"2023-10-14T19:03:10.230366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211190+0000","last_change":"2023-10-14T19:03:09.214386+0000","last_active":"2023-10-14T19:03:10.211190+0000","last_peered":"2023-10-14T19:03:10.211190+0000","last_clean":"2023-10-14T19:03:10.211190+0000","last_became_active":"2023-10-14T19:03:09.214062+0000","last_became_peered":"2023-10-14T19:03:09.214062+0000","last_unstale":"2023-10-14T19:03:10.211190+0000","last_undegraded":"2023-10-14T19:03:10.211190+0000","last_fullsized":"2023-10-14T19:03:10.211190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228871+0000","last_change":"2023-10-14T19:03:10.222746+0000","last_active":"2023-10-14T19:03:10.228871+0000","last_peered":"2023-10-14T19:03:10.228871+0000","last_clean":"2023-10-14T19:03:10.228871+0000","last_became_active":"2023-10-14T19:03:10.221548+0000","last_became_peered":"2023-10-14T19:03:10.221548+0000","last_unstale":"2023-10-14T19:03:10.228871+0000","last_undegraded":"2023-10-14T19:03:10.228871+0000","last_fullsized":"2023-10-14T19:03:10.228871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213873+0000","last_change":"2023-10-14T19:03:10.211030+0000","last_active":"2023-10-14T19:03:10.213873+0000","last_peered":"2023-10-14T19:03:10.213873+0000","last_clean":"2023-10-14T19:03:10.213873+0000","last_became_active":"2023-10-14T19:03:10.210612+0000","last_became_peered":"2023-10-14T19:03:10.210612+0000","last_unstale":"2023-10-14T19:03:10.213873+0000","last_undegraded":"2023-10-14T19:03:10.213873+0000","last_fullsized":"2023-10-14T19:03:10.213873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.203993+0000","last_change":"2023-10-14T19:03:09.207759+0000","last_active":"2023-10-14T19:03:10.203993+0000","last_peered":"2023-10-14T19:03:10.203993+0000","last_clean":"2023-10-14T19:03:10.203993+0000","last_became_active":"2023-10-14T19:03:09.207466+0000","last_became_peered":"2023-10-14T19:03:09.207466+0000","last_unstale":"2023-10-14T19:03:10.203993+0000","last_undegraded":"2023-10-14T19:03:10.203993+0000","last_fullsized":"2023-10-14T19:03:10.203993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227804+0000","last_change":"2023-10-14T19:03:10.226423+0000","last_active":"2023-10-14T19:03:10.227804+0000","last_peered":"2023-10-14T19:03:10.227804+0000","last_clean":"2023-10-14T19:03:10.227804+0000","last_became_active":"2023-10-14T19:03:10.226147+0000","last_became_peered":"2023-10-14T19:03:10.226147+0000","last_unstale":"2023-10-14T19:03:10.227804+0000","last_undegraded":"2023-10-14T19:03:10.227804+0000","last_fullsized":"2023-10-14T19:03:10.227804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211113+0000","last_change":"2023-10-14T19:03:09.200879+0000","last_active":"2023-10-14T19:03:10.211113+0000","last_peered":"2023-10-14T19:03:10.211113+0000","last_clean":"2023-10-14T19:03:10.211113+0000","last_became_active":"2023-10-14T19:03:09.200600+0000","last_became_peered":"2023-10-14T19:03:09.200600+0000","last_unstale":"2023-10-14T19:03:10.211113+0000","last_undegraded":"2023-10-14T19:03:10.211113+0000","last_fullsized":"2023-10-14T19:03:10.211113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214084+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:10.214084+0000","last_peered":"2023-10-14T19:03:10.214084+0000","last_clean":"2023-10-14T19:03:10.214084+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:10.214084+0000","last_undegraded":"2023-10-14T19:03:10.214084+0000","last_fullsized":"2023-10-14T19:03:10.214084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224176+0000","last_change":"2023-10-14T19:03:10.222157+0000","last_active":"2023-10-14T19:03:10.224176+0000","last_peered":"2023-10-14T19:03:10.224176+0000","last_clean":"2023-10-14T19:03:10.224176+0000","last_became_active":"2023-10-14T19:03:10.221908+0000","last_became_peered":"2023-10-14T19:03:10.221908+0000","last_unstale":"2023-10-14T19:03:10.224176+0000","last_undegraded":"2023-10-14T19:03:10.224176+0000","last_fullsized":"2023-10-14T19:03:10.224176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214197+0000","last_change":"2023-10-14T19:03:09.213139+0000","last_active":"2023-10-14T19:03:10.214197+0000","last_peered":"2023-10-14T19:03:10.214197+0000","last_clean":"2023-10-14T19:03:10.214197+0000","last_became_active":"2023-10-14T19:03:09.212808+0000","last_became_peered":"2023-10-14T19:03:09.212808+0000","last_unstale":"2023-10-14T19:03:10.214197+0000","last_undegraded":"2023-10-14T19:03:10.214197+0000","last_fullsized":"2023-10-14T19:03:10.214197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:57.697128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.217896+0000","last_change":"2023-10-14T19:03:09.211906+0000","last_active":"2023-10-14T19:03:10.217896+0000","last_peered":"2023-10-14T19:03:10.217896+0000","last_clean":"2023-10-14T19:03:10.217896+0000","last_became_active":"2023-10-14T19:03:09.211587+0000","last_became_peered":"2023-10-14T19:03:09.211587+0000","last_unstale":"2023-10-14T19:03:10.217896+0000","last_undegraded":"2023-10-14T19:03:10.217896+0000","last_fullsized":"2023-10-14T19:03:10.217896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213831+0000","last_change":"2023-10-14T19:03:10.210444+0000","last_active":"2023-10-14T19:03:10.213831+0000","last_peered":"2023-10-14T19:03:10.213831+0000","last_clean":"2023-10-14T19:03:10.213831+0000","last_became_active":"2023-10-14T19:03:10.210175+0000","last_became_peered":"2023-10-14T19:03:10.210175+0000","last_unstale":"2023-10-14T19:03:10.213831+0000","last_undegraded":"2023-10-14T19:03:10.213831+0000","last_fullsized":"2023-10-14T19:03:10.213831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204989+0000","last_change":"2023-10-14T19:03:09.213704+0000","last_active":"2023-10-14T19:03:10.204989+0000","last_peered":"2023-10-14T19:03:10.204989+0000","last_clean":"2023-10-14T19:03:10.204989+0000","last_became_active":"2023-10-14T19:03:09.213422+0000","last_became_peered":"2023-10-14T19:03:09.213422+0000","last_unstale":"2023-10-14T19:03:10.204989+0000","last_undegraded":"2023-10-14T19:03:10.204989+0000","last_fullsized":"2023-10-14T19:03:10.204989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229985+0000","last_change":"2023-10-14T19:03:10.227711+0000","last_active":"2023-10-14T19:03:10.229985+0000","last_peered":"2023-10-14T19:03:10.229985+0000","last_clean":"2023-10-14T19:03:10.229985+0000","last_became_active":"2023-10-14T19:03:10.227271+0000","last_became_peered":"2023-10-14T19:03:10.227271+0000","last_unstale":"2023-10-14T19:03:10.229985+0000","last_undegraded":"2023-10-14T19:03:10.229985+0000","last_fullsized":"2023-10-14T19:03:10.229985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.237073+0000","last_change":"2023-10-14T19:03:09.214397+0000","last_active":"2023-10-14T19:03:10.237073+0000","last_peered":"2023-10-14T19:03:10.237073+0000","last_clean":"2023-10-14T19:03:10.237073+0000","last_became_active":"2023-10-14T19:03:09.214100+0000","last_became_peered":"2023-10-14T19:03:09.214100+0000","last_unstale":"2023-10-14T19:03:10.237073+0000","last_undegraded":"2023-10-14T19:03:10.237073+0000","last_fullsized":"2023-10-14T19:03:10.237073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223211+0000","last_change":"2023-10-14T19:03:10.220584+0000","last_active":"2023-10-14T19:03:10.223211+0000","last_peered":"2023-10-14T19:03:10.223211+0000","last_clean":"2023-10-14T19:03:10.223211+0000","last_became_active":"2023-10-14T19:03:10.220310+0000","last_became_peered":"2023-10-14T19:03:10.220310+0000","last_unstale":"2023-10-14T19:03:10.223211+0000","last_undegraded":"2023-10-14T19:03:10.223211+0000","last_fullsized":"2023-10-14T19:03:10.223211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213993+0000","last_change":"2023-10-14T19:03:09.211690+0000","last_active":"2023-10-14T19:03:10.213993+0000","last_peered":"2023-10-14T19:03:10.213993+0000","last_clean":"2023-10-14T19:03:10.213993+0000","last_became_active":"2023-10-14T19:03:09.211425+0000","last_became_peered":"2023-10-14T19:03:09.211425+0000","last_unstale":"2023-10-14T19:03:10.213993+0000","last_undegraded":"2023-10-14T19:03:10.213993+0000","last_fullsized":"2023-10-14T19:03:10.213993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219325+0000","last_change":"2023-10-14T19:03:10.213207+0000","last_active":"2023-10-14T19:03:10.219325+0000","last_peered":"2023-10-14T19:03:10.219325+0000","last_clean":"2023-10-14T19:03:10.219325+0000","last_became_active":"2023-10-14T19:03:10.211874+0000","last_became_peered":"2023-10-14T19:03:10.211874+0000","last_unstale":"2023-10-14T19:03:10.219325+0000","last_undegraded":"2023-10-14T19:03:10.219325+0000","last_fullsized":"2023-10-14T19:03:10.219325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:45.278559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205193+0000","last_change":"2023-10-14T19:03:09.212745+0000","last_active":"2023-10-14T19:03:10.205193+0000","last_peered":"2023-10-14T19:03:10.205193+0000","last_clean":"2023-10-14T19:03:10.205193+0000","last_became_active":"2023-10-14T19:03:09.212470+0000","last_became_peered":"2023-10-14T19:03:09.212470+0000","last_unstale":"2023-10-14T19:03:10.205193+0000","last_undegraded":"2023-10-14T19:03:10.205193+0000","last_fullsized":"2023-10-14T19:03:10.205193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219163+0000","last_change":"2023-10-14T19:03:10.216098+0000","last_active":"2023-10-14T19:03:10.219163+0000","last_peered":"2023-10-14T19:03:10.219163+0000","last_clean":"2023-10-14T19:03:10.219163+0000","last_became_active":"2023-10-14T19:03:10.215829+0000","last_became_peered":"2023-10-14T19:03:10.215829+0000","last_unstale":"2023-10-14T19:03:10.219163+0000","last_undegraded":"2023-10-14T19:03:10.219163+0000","last_fullsized":"2023-10-14T19:03:10.219163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204639+0000","last_change":"2023-10-14T19:03:09.215395+0000","last_active":"2023-10-14T19:03:10.204639+0000","last_peered":"2023-10-14T19:03:10.204639+0000","last_clean":"2023-10-14T19:03:10.204639+0000","last_became_active":"2023-10-14T19:03:09.215081+0000","last_became_peered":"2023-10-14T19:03:09.215081+0000","last_unstale":"2023-10-14T19:03:10.204639+0000","last_undegraded":"2023-10-14T19:03:10.204639+0000","last_fullsized":"2023-10-14T19:03:10.204639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224034+0000","last_change":"2023-10-14T19:03:10.220693+0000","last_active":"2023-10-14T19:03:10.224034+0000","last_peered":"2023-10-14T19:03:10.224034+0000","last_clean":"2023-10-14T19:03:10.224034+0000","last_became_active":"2023-10-14T19:03:10.220340+0000","last_became_peered":"2023-10-14T19:03:10.220340+0000","last_unstale":"2023-10-14T19:03:10.224034+0000","last_undegraded":"2023-10-14T19:03:10.224034+0000","last_fullsized":"2023-10-14T19:03:10.224034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242172+0000","last_change":"2023-10-14T19:03:09.215682+0000","last_active":"2023-10-14T19:03:10.242172+0000","last_peered":"2023-10-14T19:03:10.242172+0000","last_clean":"2023-10-14T19:03:10.242172+0000","last_became_active":"2023-10-14T19:03:09.215405+0000","last_became_peered":"2023-10-14T19:03:09.215405+0000","last_unstale":"2023-10-14T19:03:10.242172+0000","last_undegraded":"2023-10-14T19:03:10.242172+0000","last_fullsized":"2023-10-14T19:03:10.242172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228190+0000","last_change":"2023-10-14T19:03:10.223659+0000","last_active":"2023-10-14T19:03:10.228190+0000","last_peered":"2023-10-14T19:03:10.228190+0000","last_clean":"2023-10-14T19:03:10.228190+0000","last_became_active":"2023-10-14T19:03:10.222280+0000","last_became_peered":"2023-10-14T19:03:10.222280+0000","last_unstale":"2023-10-14T19:03:10.228190+0000","last_undegraded":"2023-10-14T19:03:10.228190+0000","last_fullsized":"2023-10-14T19:03:10.228190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204006+0000","last_change":"2023-10-14T19:03:09.208270+0000","last_active":"2023-10-14T19:03:10.204006+0000","last_peered":"2023-10-14T19:03:10.204006+0000","last_clean":"2023-10-14T19:03:10.204006+0000","last_became_active":"2023-10-14T19:03:09.207959+0000","last_became_peered":"2023-10-14T19:03:09.207959+0000","last_unstale":"2023-10-14T19:03:10.204006+0000","last_undegraded":"2023-10-14T19:03:10.204006+0000","last_fullsized":"2023-10-14T19:03:10.204006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239694+0000","last_change":"2023-10-14T19:03:10.233909+0000","last_active":"2023-10-14T19:03:10.239694+0000","last_peered":"2023-10-14T19:03:10.239694+0000","last_clean":"2023-10-14T19:03:10.239694+0000","last_became_active":"2023-10-14T19:03:10.233422+0000","last_became_peered":"2023-10-14T19:03:10.233422+0000","last_unstale":"2023-10-14T19:03:10.239694+0000","last_undegraded":"2023-10-14T19:03:10.239694+0000","last_fullsized":"2023-10-14T19:03:10.239694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239570+0000","last_change":"2023-10-14T19:03:09.215232+0000","last_active":"2023-10-14T19:03:10.239570+0000","last_peered":"2023-10-14T19:03:10.239570+0000","last_clean":"2023-10-14T19:03:10.239570+0000","last_became_active":"2023-10-14T19:03:09.214965+0000","last_became_peered":"2023-10-14T19:03:09.214965+0000","last_unstale":"2023-10-14T19:03:10.239570+0000","last_undegraded":"2023-10-14T19:03:10.239570+0000","last_fullsized":"2023-10-14T19:03:10.239570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230537+0000","last_change":"2023-10-14T19:03:10.226324+0000","last_active":"2023-10-14T19:03:10.230537+0000","last_peered":"2023-10-14T19:03:10.230537+0000","last_clean":"2023-10-14T19:03:10.230537+0000","last_became_active":"2023-10-14T19:03:10.225606+0000","last_became_peered":"2023-10-14T19:03:10.225606+0000","last_unstale":"2023-10-14T19:03:10.230537+0000","last_undegraded":"2023-10-14T19:03:10.230537+0000","last_fullsized":"2023-10-14T19:03:10.230537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231144+0000","last_change":"2023-10-14T19:03:09.204163+0000","last_active":"2023-10-14T19:03:10.231144+0000","last_peered":"2023-10-14T19:03:10.231144+0000","last_clean":"2023-10-14T19:03:10.231144+0000","last_became_active":"2023-10-14T19:03:09.203726+0000","last_became_peered":"2023-10-14T19:03:09.203726+0000","last_unstale":"2023-10-14T19:03:10.231144+0000","last_undegraded":"2023-10-14T19:03:10.231144+0000","last_fullsized":"2023-10-14T19:03:10.231144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241864+0000","last_change":"2023-10-14T19:03:10.236516+0000","last_active":"2023-10-14T19:03:10.241864+0000","last_peered":"2023-10-14T19:03:10.241864+0000","last_clean":"2023-10-14T19:03:10.241864+0000","last_became_active":"2023-10-14T19:03:10.236201+0000","last_became_peered":"2023-10-14T19:03:10.236201+0000","last_unstale":"2023-10-14T19:03:10.241864+0000","last_undegraded":"2023-10-14T19:03:10.241864+0000","last_fullsized":"2023-10-14T19:03:10.241864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224903+0000","last_change":"2023-10-14T19:03:10.220597+0000","last_active":"2023-10-14T19:03:10.224903+0000","last_peered":"2023-10-14T19:03:10.224903+0000","last_clean":"2023-10-14T19:03:10.224903+0000","last_became_active":"2023-10-14T19:03:10.220306+0000","last_became_peered":"2023-10-14T19:03:10.220306+0000","last_unstale":"2023-10-14T19:03:10.224903+0000","last_undegraded":"2023-10-14T19:03:10.224903+0000","last_fullsized":"2023-10-14T19:03:10.224903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231223+0000","last_change":"2023-10-14T19:03:10.228189+0000","last_active":"2023-10-14T19:03:10.231223+0000","last_peered":"2023-10-14T19:03:10.231223+0000","last_clean":"2023-10-14T19:03:10.231223+0000","last_became_active":"2023-10-14T19:03:10.227963+0000","last_became_peered":"2023-10-14T19:03:10.227963+0000","last_unstale":"2023-10-14T19:03:10.231223+0000","last_undegraded":"2023-10-14T19:03:10.231223+0000","last_fullsized":"2023-10-14T19:03:10.231223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224291+0000","last_change":"2023-10-14T19:03:10.217965+0000","last_active":"2023-10-14T19:03:10.224291+0000","last_peered":"2023-10-14T19:03:10.224291+0000","last_clean":"2023-10-14T19:03:10.224291+0000","last_became_active":"2023-10-14T19:03:10.217687+0000","last_became_peered":"2023-10-14T19:03:10.217687+0000","last_unstale":"2023-10-14T19:03:10.224291+0000","last_undegraded":"2023-10-14T19:03:10.224291+0000","last_fullsized":"2023-10-14T19:03:10.224291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.221439+0000","last_change":"2023-10-14T19:03:10.219458+0000","last_active":"2023-10-14T19:03:10.221439+0000","last_peered":"2023-10-14T19:03:10.221439+0000","last_clean":"2023-10-14T19:03:10.221439+0000","last_became_active":"2023-10-14T19:03:10.219184+0000","last_became_peered":"2023-10-14T19:03:10.219184+0000","last_unstale":"2023-10-14T19:03:10.221439+0000","last_undegraded":"2023-10-14T19:03:10.221439+0000","last_fullsized":"2023-10-14T19:03:10.221439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224376+0000","last_change":"2023-10-14T19:03:10.223589+0000","last_active":"2023-10-14T19:03:10.224376+0000","last_peered":"2023-10-14T19:03:10.224376+0000","last_clean":"2023-10-14T19:03:10.224376+0000","last_became_active":"2023-10-14T19:03:10.223340+0000","last_became_peered":"2023-10-14T19:03:10.223340+0000","last_unstale":"2023-10-14T19:03:10.224376+0000","last_undegraded":"2023-10-14T19:03:10.224376+0000","last_fullsized":"2023-10-14T19:03:10.224376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219559+0000","last_change":"2023-10-14T19:03:10.216180+0000","last_active":"2023-10-14T19:03:10.219559+0000","last_peered":"2023-10-14T19:03:10.219559+0000","last_clean":"2023-10-14T19:03:10.219559+0000","last_became_active":"2023-10-14T19:03:10.215525+0000","last_became_peered":"2023-10-14T19:03:10.215525+0000","last_unstale":"2023-10-14T19:03:10.219559+0000","last_undegraded":"2023-10-14T19:03:10.219559+0000","last_fullsized":"2023-10-14T19:03:10.219559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228241+0000","last_change":"2023-10-14T19:03:10.221680+0000","last_active":"2023-10-14T19:03:10.228241+0000","last_peered":"2023-10-14T19:03:10.228241+0000","last_clean":"2023-10-14T19:03:10.228241+0000","last_became_active":"2023-10-14T19:03:10.221417+0000","last_became_peered":"2023-10-14T19:03:10.221417+0000","last_unstale":"2023-10-14T19:03:10.228241+0000","last_undegraded":"2023-10-14T19:03:10.228241+0000","last_fullsized":"2023-10-14T19:03:10.228241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216940+0000","last_change":"2023-10-14T19:03:10.214621+0000","last_active":"2023-10-14T19:03:10.216940+0000","last_peered":"2023-10-14T19:03:10.216940+0000","last_clean":"2023-10-14T19:03:10.216940+0000","last_became_active":"2023-10-14T19:03:10.214326+0000","last_became_peered":"2023-10-14T19:03:10.214326+0000","last_unstale":"2023-10-14T19:03:10.216940+0000","last_undegraded":"2023-10-14T19:03:10.216940+0000","last_fullsized":"2023-10-14T19:03:10.216940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230803+0000","last_change":"2023-10-14T19:03:10.224902+0000","last_active":"2023-10-14T19:03:10.230803+0000","last_peered":"2023-10-14T19:03:10.230803+0000","last_clean":"2023-10-14T19:03:10.230803+0000","last_became_active":"2023-10-14T19:03:10.224471+0000","last_became_peered":"2023-10-14T19:03:10.224471+0000","last_unstale":"2023-10-14T19:03:10.230803+0000","last_undegraded":"2023-10-14T19:03:10.230803+0000","last_fullsized":"2023-10-14T19:03:10.230803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216352+0000","last_change":"2023-10-14T19:03:10.213932+0000","last_active":"2023-10-14T19:03:10.216352+0000","last_peered":"2023-10-14T19:03:10.216352+0000","last_clean":"2023-10-14T19:03:10.216352+0000","last_became_active":"2023-10-14T19:03:10.213630+0000","last_became_peered":"2023-10-14T19:03:10.213630+0000","last_unstale":"2023-10-14T19:03:10.216352+0000","last_undegraded":"2023-10-14T19:03:10.216352+0000","last_fullsized":"2023-10-14T19:03:10.216352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231123+0000","last_change":"2023-10-14T19:03:10.225610+0000","last_active":"2023-10-14T19:03:10.231123+0000","last_peered":"2023-10-14T19:03:10.231123+0000","last_clean":"2023-10-14T19:03:10.231123+0000","last_became_active":"2023-10-14T19:03:10.225294+0000","last_became_peered":"2023-10-14T19:03:10.225294+0000","last_unstale":"2023-10-14T19:03:10.231123+0000","last_undegraded":"2023-10-14T19:03:10.231123+0000","last_fullsized":"2023-10-14T19:03:10.231123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229349+0000","last_change":"2023-10-14T19:03:10.227867+0000","last_active":"2023-10-14T19:03:10.229349+0000","last_peered":"2023-10-14T19:03:10.229349+0000","last_clean":"2023-10-14T19:03:10.229349+0000","last_became_active":"2023-10-14T19:03:10.227598+0000","last_became_peered":"2023-10-14T19:03:10.227598+0000","last_unstale":"2023-10-14T19:03:10.229349+0000","last_undegraded":"2023-10-14T19:03:10.229349+0000","last_fullsized":"2023-10-14T19:03:10.229349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228139+0000","last_change":"2023-10-14T19:03:10.222435+0000","last_active":"2023-10-14T19:03:10.228139+0000","last_peered":"2023-10-14T19:03:10.228139+0000","last_clean":"2023-10-14T19:03:10.228139+0000","last_became_active":"2023-10-14T19:03:10.222182+0000","last_became_peered":"2023-10-14T19:03:10.222182+0000","last_unstale":"2023-10-14T19:03:10.228139+0000","last_undegraded":"2023-10-14T19:03:10.228139+0000","last_fullsized":"2023-10-14T19:03:10.228139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2080000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1480000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0679999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1269999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4620000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4119999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7130000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:14.714 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:03:14.715 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T19:03:14.715 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T19:03:14.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T19:03:14.717 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T19:03:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.867+0000 7f3a6baff700 1 Processor -- start 2023-10-14T19:03:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.867+0000 7f3a6baff700 1 -- start start 2023-10-14T19:03:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6baff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3a640cb5a0 0x7f3a640cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6baff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a640cd9e0 0x7f3a64159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6baff700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6415ae40 con 0x7f3a6415a400 2023-10-14T19:03:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6baff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640d13f0 con 0x7f3a640cd9e0 2023-10-14T19:03:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6baff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6415ab60 con 0x7f3a640cb5a0 2023-10-14T19:03:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6909a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a640cd9e0 0x7f3a64159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6a09c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3a6415a400 0x7f3a64156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47396/0 (socket says 172.21.15.7:47396) 2023-10-14T19:03:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6a09c700 1 -- 172.21.15.7:0/2034647451 learned_addr learned my addr 172.21.15.7:0/2034647451 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6989b700 1 --2- 172.21.15.7:0/2034647451 >> v2:172.21.15.148:3300/0 conn(0x7f3a640cb5a0 0x7f3a640cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6909a700 1 -- 172.21.15.7:0/2034647451 >> v2:172.21.15.148:3300/0 conn(0x7f3a640cb5a0 msgr2=0x7f3a640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6909a700 1 --2- 172.21.15.7:0/2034647451 >> v2:172.21.15.148:3300/0 conn(0x7f3a640cb5a0 0x7f3a640cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6909a700 1 -- 172.21.15.7:0/2034647451 >> v1:172.21.15.7:6789/0 conn(0x7f3a6415a400 legacy=0x7f3a64156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6909a700 1 -- 172.21.15.7:0/2034647451 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640ccf00 con 0x7f3a640cd9e0 2023-10-14T19:03:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a68899700 1 -- 172.21.15.7:0/2034647451 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405894465 0 0) 0x7f3a6415ae40 con 0x7f3a6415a400 2023-10-14T19:03:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.868+0000 7f3a6909a700 1 --2- 172.21.15.7:0/2034647451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a64159ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a540098e0 tx=0x7f3a540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70056793a5922649 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a68899700 1 -- 172.21.15.7:0/2034647451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54009e80 con 0x7f3a640cd9e0 2023-10-14T19:03:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a68899700 1 -- 172.21.15.7:0/2034647451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5400b820 con 0x7f3a640cd9e0 2023-10-14T19:03:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a68899700 1 -- 172.21.15.7:0/2034647451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5400bba0 con 0x7f3a640cd9e0 2023-10-14T19:03:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 -- 172.21.15.7:0/2034647451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 msgr2=0x7f3a64159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 --2- 172.21.15.7:0/2034647451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a64159ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a540098e0 tx=0x7f3a540091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 -- 172.21.15.7:0/2034647451 shutdown_connections 2023-10-14T19:03:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 --2- 172.21.15.7:0/2034647451 >> v2:172.21.15.148:3300/0 conn(0x7f3a640cb5a0 0x7f3a640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 --2- 172.21.15.7:0/2034647451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a64159ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 -- 172.21.15.7:0/2034647451 >> 172.21.15.7:0/2034647451 conn(0x7f3a64070e30 msgr2=0x7f3a640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:14.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 -- 172.21.15.7:0/2034647451 shutdown_connections 2023-10-14T19:03:14.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.869+0000 7f3a6baff700 1 -- 172.21.15.7:0/2034647451 wait complete. 2023-10-14T19:03:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.870+0000 7f3a6baff700 1 Processor -- start 2023-10-14T19:03:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.870+0000 7f3a6baff700 1 -- start start 2023-10-14T19:03:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6baff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a640cb5a0 0x7f3a64153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6baff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a6415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6baff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6415a400 0x7f3a6415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6baff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b44b0 con 0x7f3a640cd9e0 2023-10-14T19:03:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6baff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b5030 con 0x7f3a6415a400 2023-10-14T19:03:14.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6baff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6415e300 con 0x7f3a640cb5a0 2023-10-14T19:03:14.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a6415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a6415d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37252/0 (socket says 172.21.15.7:37252) 2023-10-14T19:03:14.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 -- 172.21.15.7:0/927880978 learned_addr learned my addr 172.21.15.7:0/927880978 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:14.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6a09c700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6415a400 0x7f3a6415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 -- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a640cb5a0 msgr2=0x7f3a64153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a640cb5a0 0x7f3a64153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 -- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6415a400 msgr2=0x7f3a6415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:14.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6415a400 0x7f3a6415ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:14.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6909a700 1 -- 172.21.15.7:0/927880978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a54009420 con 0x7f3a640cd9e0 2023-10-14T19:03:14.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.871+0000 7f3a6a09c700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6415a400 0x7f3a6415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:14.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.872+0000 7f3a6909a700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a6415d880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a6406ea60 tx=0x7f3a54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.872+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5401f070 con 0x7f3a640cd9e0 2023-10-14T19:03:14.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.872+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a54000bc0 con 0x7f3a640cd9e0 2023-10-14T19:03:14.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.872+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6415b330 con 0x7f3a640cd9e0 2023-10-14T19:03:14.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.872+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54025420 con 0x7f3a640cd9e0 2023-10-14T19:03:14.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.872+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a640b49e0 con 0x7f3a640cd9e0 2023-10-14T19:03:14.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.873+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6404c3c0 con 0x7f3a640cd9e0 2023-10-14T19:03:14.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.873+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a54023070 con 0x7f3a640cd9e0 2023-10-14T19:03:14.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.874+0000 7f3a59ffb700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3a48066f30 0x7f3a480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:14.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.874+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a54085a30 con 0x7f3a640cd9e0 2023-10-14T19:03:14.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.874+0000 7f3a6989b700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3a48066f30 0x7f3a480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:14.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.874+0000 7f3a6989b700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3a48066f30 0x7f3a480693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009a60 tx=0x7f3a60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:14.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:14.878+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a54052ca0 con 0x7f3a640cd9e0 2023-10-14T19:03:15.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.125+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3a640cd1e0 con 0x7f3a640cd9e0 2023-10-14T19:03:15.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.128+0000 7f3a59ffb700 1 -- 172.21.15.7:0/927880978 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163706 (secure 0 0 0) 0x7f3a5402a090 con 0x7f3a640cd9e0 2023-10-14T19:03:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:15.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3a48066f30 msgr2=0x7f3a480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3a48066f30 0x7f3a480693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009a60 tx=0x7f3a60008040 comp rx=0 tx=0).stop 2023-10-14T19:03:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 msgr2=0x7f3a6415d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a6415d880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a6406ea60 tx=0x7f3a54017000 comp rx=0 tx=0).stop 2023-10-14T19:03:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 shutdown_connections 2023-10-14T19:03:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3a48066f30 0x7f3a480693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6415a400 0x7f3a6415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a640cb5a0 0x7f3a64153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 --2- 172.21.15.7:0/927880978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a640cd9e0 0x7f3a6415d880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 >> 172.21.15.7:0/927880978 conn(0x7f3a64070e30 msgr2=0x7f3a640cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 shutdown_connections 2023-10-14T19:03:15.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.131+0000 7f3a6baff700 1 -- 172.21.15.7:0/927880978 wait complete. 2023-10-14T19:03:15.144 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":90521},{"type":"v1","addr":"172.21.15.148:6833","nonce":90521}]},"active_addr":"172.21.15.148:6833/90521","active_change":"2023-10-14T19:02:57.613576+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2458706767}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1803013902}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1365300183}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2090964001}]}]} 2023-10-14T19:03:15.148 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T19:03:15.148 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T19:03:15.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:15.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.267+0000 7f5a1bdfd700 1 Processor -- start 2023-10-14T19:03:15.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.268+0000 7f5a1bdfd700 1 -- start start 2023-10-14T19:03:15.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.268+0000 7f5a1bdfd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a140cb970 0x7f5a14159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.268+0000 7f5a1bdfd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a1415a400 0x7f5a14156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.268+0000 7f5a1bdfd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1415ae40 con 0x7f5a140cb5a0 2023-10-14T19:03:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.268+0000 7f5a1bdfd700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a140ce0f0 con 0x7f5a1415a400 2023-10-14T19:03:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.268+0000 7f5a1bdfd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140cbde0 con 0x7f5a140cb970 2023-10-14T19:03:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a1415a400 0x7f5a14156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a1415a400 0x7f5a14156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37268/0 (socket says 172.21.15.7:37268) 2023-10-14T19:03:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 -- 172.21.15.7:0/445463806 learned_addr learned my addr 172.21.15.7:0/445463806 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a19398700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a140cb970 0x7f5a14159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 -- 172.21.15.7:0/445463806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a140cb970 msgr2=0x7f5a14159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a140cb970 0x7f5a14159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 -- 172.21.15.7:0/445463806 >> v1:172.21.15.148:6789/0 conn(0x7f5a140cb5a0 legacy=0x7f5a140cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 -- 172.21.15.7:0/445463806 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1415ab60 con 0x7f5a1415a400 2023-10-14T19:03:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a19398700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a140cb970 0x7f5a14159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a1a39a700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a1415a400 0x7f5a14156e90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009f50 tx=0x7f5a04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bb1e089277d095 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a18b97700 1 -- 172.21.15.7:0/445463806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400e070 con 0x7f5a1415a400 2023-10-14T19:03:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a18b97700 1 -- 172.21.15.7:0/445463806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400ba70 con 0x7f5a1415a400 2023-10-14T19:03:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.269+0000 7f5a18b97700 1 -- 172.21.15.7:0/445463806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040092e0 con 0x7f5a1415a400 2023-10-14T19:03:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/445463806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a1415a400 msgr2=0x7f5a14156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a1415a400 0x7f5a14156e90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009f50 tx=0x7f5a04009840 comp rx=0 tx=0).stop 2023-10-14T19:03:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/445463806 shutdown_connections 2023-10-14T19:03:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a1415a400 0x7f5a14156e90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/445463806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a140cb970 0x7f5a14159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/445463806 >> 172.21.15.7:0/445463806 conn(0x7f5a14070e30 msgr2=0x7f5a140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/445463806 shutdown_connections 2023-10-14T19:03:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.270+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/445463806 wait complete. 2023-10-14T19:03:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.271+0000 7f5a1bdfd700 1 Processor -- start 2023-10-14T19:03:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.271+0000 7f5a1bdfd700 1 -- start start 2023-10-14T19:03:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1bdfd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 0x7f5a140ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1bdfd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a140cb970 0x7f5a14159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1bdfd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a1415a400 0x7f5a14157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1bdfd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14159180 con 0x7f5a140cb5a0 2023-10-14T19:03:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1bdfd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14159b50 con 0x7f5a140cb970 2023-10-14T19:03:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1bdfd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141582d0 con 0x7f5a1415a400 2023-10-14T19:03:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 0x7f5a140ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 0x7f5a140ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37274/0 (socket says 172.21.15.7:37274) 2023-10-14T19:03:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 -- 172.21.15.7:0/4039049882 learned_addr learned my addr 172.21.15.7:0/4039049882 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a1a39a700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a1415a400 0x7f5a14157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19398700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a140cb970 0x7f5a14159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 -- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a1415a400 msgr2=0x7f5a14157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a1415a400 0x7f5a14157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 -- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a140cb970 msgr2=0x7f5a14159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a140cb970 0x7f5a14159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 -- 172.21.15.7:0/4039049882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009ae0 con 0x7f5a140cb5a0 2023-10-14T19:03:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a19b99700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 0x7f5a140ca330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00c4e0 tx=0x7f5a0c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.272+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c011590 con 0x7f5a140cb5a0 2023-10-14T19:03:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.273+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c011710 con 0x7f5a140cb5a0 2023-10-14T19:03:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.273+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a14158570 con 0x7f5a140cb5a0 2023-10-14T19:03:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.273+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c011ad0 con 0x7f5a140cb5a0 2023-10-14T19:03:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.273+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a14158b30 con 0x7f5a140cb5a0 2023-10-14T19:03:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.274+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14159460 con 0x7f5a140cb5a0 2023-10-14T19:03:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.274+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a0c01b3b0 con 0x7f5a140cb5a0 2023-10-14T19:03:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.274+0000 7f5a11ffb700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a00066f30 0x7f5a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.275+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a0c083a70 con 0x7f5a140cb5a0 2023-10-14T19:03:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.275+0000 7f5a19398700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a00066f30 0x7f5a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.275+0000 7f5a19398700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a00066f30 0x7f5a000693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a08006f00 tx=0x7f5a08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.279+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a0c050ce0 con 0x7f5a140cb5a0 2023-10-14T19:03:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.471+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a1415a860 con 0x7f5a140cb5a0 2023-10-14T19:03:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.472+0000 7f5a11ffb700 1 -- 172.21.15.7:0/4039049882 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5a0c017070 con 0x7f5a140cb5a0 2023-10-14T19:03:15.473 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:15.473 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:15.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a00066f30 msgr2=0x7f5a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a00066f30 0x7f5a000693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a08006f00 tx=0x7f5a08008040 comp rx=0 tx=0).stop 2023-10-14T19:03:15.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 msgr2=0x7f5a140ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 0x7f5a140ca330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00c4e0 tx=0x7f5a0c00c8a0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 shutdown_connections 2023-10-14T19:03:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a00066f30 0x7f5a000693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a1415a400 0x7f5a14157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a140cb5a0 0x7f5a140ca330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 --2- 172.21.15.7:0/4039049882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a140cb970 0x7f5a14159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 >> 172.21.15.7:0/4039049882 conn(0x7f5a14070e30 msgr2=0x7f5a140b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 shutdown_connections 2023-10-14T19:03:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.474+0000 7f5a1bdfd700 1 -- 172.21.15.7:0/4039049882 wait complete. 2023-10-14T19:03:15.488 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T19:03:15.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:15.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.609+0000 7f6d0e153700 1 Processor -- start 2023-10-14T19:03:15.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.609+0000 7f6d0e153700 1 -- start start 2023-10-14T19:03:15.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.610+0000 7f6d0e153700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.610+0000 7f6d0e153700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6d0806d280 0x7f6d080b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.610+0000 7f6d0e153700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080ce1a0 con 0x7f6d080ae780 2023-10-14T19:03:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.610+0000 7f6d0e153700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080cd5d0 con 0x7f6d0806d280 2023-10-14T19:03:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.610+0000 7f6d0e153700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cd870 con 0x7f6d080a8be0 2023-10-14T19:03:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d077fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6d0806d280 0x7f6d080b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6d0806d280 0x7f6d080b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59204/0 (socket says 172.21.15.7:59204) 2023-10-14T19:03:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d077fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38742/0 (socket says 172.21.15.7:38742) 2023-10-14T19:03:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 -- 172.21.15.7:0/3945118835 learned_addr learned my addr 172.21.15.7:0/3945118835 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d07fff700 1 --1- 172.21.15.7:0/3945118835 >> v1:172.21.15.148:6789/0 conn(0x7f6d080ae780 0x7f6d080cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45576/0 (socket says 172.21.15.7:45576) 2023-10-14T19:03:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 -- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 msgr2=0x7f6d080a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:15.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 --2- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 -- 172.21.15.7:0/3945118835 >> v1:172.21.15.148:6789/0 conn(0x7f6d080ae780 legacy=0x7f6d080cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 -- 172.21.15.7:0/3945118835 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080cdb50 con 0x7f6d0806d280 2023-10-14T19:03:15.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d067fc700 1 -- 172.21.15.7:0/3945118835 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438152225 0 0) 0x7f6d080ce1a0 con 0x7f6d080ae780 2023-10-14T19:03:15.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d077fe700 1 --2- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d06ffd700 1 --2- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0806d280 0x7f6d080b08c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009990 tx=0x7f6cfc009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c946459324033ef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d067fc700 1 -- 172.21.15.7:0/3945118835 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc009e80 con 0x7f6d0806d280 2023-10-14T19:03:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d067fc700 1 -- 172.21.15.7:0/3945118835 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc005c10 con 0x7f6d0806d280 2023-10-14T19:03:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.611+0000 7f6d067fc700 1 -- 172.21.15.7:0/3945118835 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00b6e0 con 0x7f6d0806d280 2023-10-14T19:03:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 -- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0806d280 msgr2=0x7f6d080b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 --2- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0806d280 0x7f6d080b08c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009990 tx=0x7f6cfc009220 comp rx=0 tx=0).stop 2023-10-14T19:03:15.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 -- 172.21.15.7:0/3945118835 shutdown_connections 2023-10-14T19:03:15.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 --2- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 --2- 172.21.15.7:0/3945118835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0806d280 0x7f6d080b08c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 -- 172.21.15.7:0/3945118835 >> 172.21.15.7:0/3945118835 conn(0x7f6d0806ce80 msgr2=0x7f6d080ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 -- 172.21.15.7:0/3945118835 shutdown_connections 2023-10-14T19:03:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.612+0000 7f6d0e153700 1 -- 172.21.15.7:0/3945118835 wait complete. 2023-10-14T19:03:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.613+0000 7f6d0e153700 1 Processor -- start 2023-10-14T19:03:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.613+0000 7f6d0e153700 1 -- start start 2023-10-14T19:03:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d0e153700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 0x7f6d08159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d0e153700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d0e153700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d080ae780 0x7f6d080b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d0e153700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0809a050 con 0x7f6d0806d280 2023-10-14T19:03:15.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d0e153700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080ac320 con 0x7f6d080ae780 2023-10-14T19:03:15.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d0e153700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080ac600 con 0x7f6d080a8be0 2023-10-14T19:03:15.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 0x7f6d08159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 0x7f6d08159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37290/0 (socket says 172.21.15.7:37290) 2023-10-14T19:03:15.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 -- 172.21.15.7:0/801068427 learned_addr learned my addr 172.21.15.7:0/801068427 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:15.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d06ffd700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d07fff700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d080ae780 0x7f6d080b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 -- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 msgr2=0x7f6d080ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 -- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d080ae780 msgr2=0x7f6d080b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d080ae780 0x7f6d080b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 -- 172.21.15.7:0/801068427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80093c0 con 0x7f6d0806d280 2023-10-14T19:03:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.614+0000 7f6d077fe700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 0x7f6d08159050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800ec80 tx=0x7f6cf8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.615+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8005a00 con 0x7f6d0806d280 2023-10-14T19:03:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.615+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf8005b60 con 0x7f6d0806d280 2023-10-14T19:03:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.615+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc009480 con 0x7f6d0806d280 2023-10-14T19:03:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.615+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800c9d0 con 0x7f6d0806d280 2023-10-14T19:03:15.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.615+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d080acbc0 con 0x7f6d0806d280 2023-10-14T19:03:15.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.615+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08067830 con 0x7f6d0806d280 2023-10-14T19:03:15.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.616+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cf800cd40 con 0x7f6d0806d280 2023-10-14T19:03:15.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.616+0000 7f6cef7fe700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:15.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.616+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6cf8084af0 con 0x7f6d0806d280 2023-10-14T19:03:15.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.617+0000 7f6d06ffd700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:15.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.617+0000 7f6d06ffd700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cf4066f30 0x7f6cf40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d080ca940 tx=0x7f6cfc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:15.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.621+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cf8051d60 con 0x7f6d0806d280 2023-10-14T19:03:15.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.816+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d0804c3c0 con 0x7f6d0806d280 2023-10-14T19:03:15.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.816+0000 7f6cef7fe700 1 -- 172.21.15.7:0/801068427 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6cf8055380 con 0x7f6d0806d280 2023-10-14T19:03:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:15.818 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.818+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cf4066f30 msgr2=0x7f6cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.818+0000 7f6d0e153700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cf4066f30 0x7f6cf40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d080ca940 tx=0x7f6cfc016000 comp rx=0 tx=0).stop 2023-10-14T19:03:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.818+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 msgr2=0x7f6d08159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.818+0000 7f6d0e153700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 0x7f6d08159050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800ec80 tx=0x7f6cf8009120 comp rx=0 tx=0).stop 2023-10-14T19:03:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 shutdown_connections 2023-10-14T19:03:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d080ae780 0x7f6d080b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0806d280 0x7f6d08159050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 --2- 172.21.15.7:0/801068427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d080a8be0 0x7f6d080ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 >> 172.21.15.7:0/801068427 conn(0x7f6d0806ce80 msgr2=0x7f6d080b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 shutdown_connections 2023-10-14T19:03:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:15.819+0000 7f6d0e153700 1 -- 172.21.15.7:0/801068427 wait complete. 2023-10-14T19:03:15.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T19:03:15.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T19:03:15.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T19:03:15.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T19:03:15.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T19:03:15.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T19:03:15.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T19:03:15.838 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T19:03:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.027+0000 7f1c956d1700 1 Processor -- start 2023-10-14T19:03:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.028+0000 7f1c956d1700 1 -- start start 2023-10-14T19:03:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c956d1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900afb30 0x7f1c900aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c956d1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 0x7f1c900b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c956d1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1c900cb2d0 0x7f1c900cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c956d1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c900b2230 con 0x7f1c900b1880 2023-10-14T19:03:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c956d1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c90167a60 con 0x7f1c900cb2d0 2023-10-14T19:03:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c956d1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90166e50 con 0x7f1c900afb30 2023-10-14T19:03:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c8e7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 0x7f1c900b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c8e7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 0x7f1c900b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37304/0 (socket says 172.21.15.7:37304) 2023-10-14T19:03:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.029+0000 7f1c8e7fc700 1 -- 172.21.15.7:0/1899144644 learned_addr learned my addr 172.21.15.7:0/1899144644 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8effd700 1 --2- 172.21.15.7:0/1899144644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900afb30 0x7f1c900aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8f7fe700 1 --2- 172.21.15.7:0/1899144644 >> v2:172.21.15.148:3300/0 conn(0x7f1c900cb2d0 0x7f1c900cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8effd700 1 -- 172.21.15.7:0/1899144644 >> v2:172.21.15.148:3300/0 conn(0x7f1c900cb2d0 msgr2=0x7f1c900cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8effd700 1 --2- 172.21.15.7:0/1899144644 >> v2:172.21.15.148:3300/0 conn(0x7f1c900cb2d0 0x7f1c900cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8effd700 1 -- 172.21.15.7:0/1899144644 >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 msgr2=0x7f1c900b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8effd700 1 --2- 172.21.15.7:0/1899144644 >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 0x7f1c900b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8effd700 1 -- 172.21.15.7:0/1899144644 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90167130 con 0x7f1c900afb30 2023-10-14T19:03:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.030+0000 7f1c8e7fc700 1 --2- 172.21.15.7:0/1899144644 >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 0x7f1c900b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.031+0000 7f1c8effd700 1 --2- 172.21.15.7:0/1899144644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900afb30 0x7f1c900aff00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c900b0ee0 tx=0x7f1c800090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df087fe1d1e995f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.031+0000 7f1c8dffb700 1 -- 172.21.15.7:0/1899144644 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000c840 con 0x7f1c900afb30 2023-10-14T19:03:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.031+0000 7f1c8dffb700 1 -- 172.21.15.7:0/1899144644 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8000c9a0 con 0x7f1c900afb30 2023-10-14T19:03:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.031+0000 7f1c8dffb700 1 -- 172.21.15.7:0/1899144644 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000cd60 con 0x7f1c900afb30 2023-10-14T19:03:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 -- 172.21.15.7:0/1899144644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900afb30 msgr2=0x7f1c900aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 --2- 172.21.15.7:0/1899144644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900afb30 0x7f1c900aff00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c900b0ee0 tx=0x7f1c800090f0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 -- 172.21.15.7:0/1899144644 shutdown_connections 2023-10-14T19:03:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 --2- 172.21.15.7:0/1899144644 >> v2:172.21.15.148:3300/0 conn(0x7f1c900cb2d0 0x7f1c900cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 --2- 172.21.15.7:0/1899144644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900afb30 0x7f1c900aff00 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c900b0ee0 tx=0x7f1c800090f0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 --2- 172.21.15.7:0/1899144644 >> v2:172.21.15.7:3300/0 conn(0x7f1c900b1880 0x7f1c900b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.032+0000 7f1c956d1700 1 -- 172.21.15.7:0/1899144644 >> 172.21.15.7:0/1899144644 conn(0x7f1c900cc300 msgr2=0x7f1c900cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.037+0000 7f1c956d1700 1 -- 172.21.15.7:0/1899144644 shutdown_connections 2023-10-14T19:03:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.038+0000 7f1c956d1700 1 -- 172.21.15.7:0/1899144644 wait complete. 2023-10-14T19:03:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.039+0000 7f1c956d1700 1 Processor -- start 2023-10-14T19:03:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.040+0000 7f1c956d1700 1 -- start start 2023-10-14T19:03:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c956d1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c900b1880 0x7f1c9016c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c956d1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900cb2d0 0x7f1c900ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c956d1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c900ac6b0 0x7f1c9015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c956d1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901825a0 con 0x7f1c900ac6b0 2023-10-14T19:03:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c956d1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90183120 con 0x7f1c900b1880 2023-10-14T19:03:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c956d1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901827f0 con 0x7f1c900cb2d0 2023-10-14T19:03:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c900ac6b0 0x7f1c9015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c900ac6b0 0x7f1c9015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37318/0 (socket says 172.21.15.7:37318) 2023-10-14T19:03:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 -- 172.21.15.7:0/147185213 learned_addr learned my addr 172.21.15.7:0/147185213 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 -- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900cb2d0 msgr2=0x7f1c900ac170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:03:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c900cb2d0 0x7f1c900ac170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 -- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c900b1880 msgr2=0x7f1c9016c570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:03:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c900b1880 0x7f1c9016c570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.041+0000 7f1c8f7fe700 1 -- 172.21.15.7:0/147185213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88008ad0 con 0x7f1c900ac6b0 2023-10-14T19:03:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.042+0000 7f1c8f7fe700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c900ac6b0 0x7f1c9015a420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400ba10 tx=0x7f1c8400d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.044+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400aea0 con 0x7f1c900ac6b0 2023-10-14T19:03:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.044+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84008750 con 0x7f1c900ac6b0 2023-10-14T19:03:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.044+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84008af0 con 0x7f1c900ac6b0 2023-10-14T19:03:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.045+0000 7ff8c0ae0700 1 Processor -- start 2023-10-14T19:03:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.044+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8000b4e0 con 0x7f1c900ac6b0 2023-10-14T19:03:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.044+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c90182db0 con 0x7f1c900ac6b0 2023-10-14T19:03:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.045+0000 7ff8c0ae0700 1 -- start start 2023-10-14T19:03:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.046+0000 7f192217d700 1 Processor -- start 2023-10-14T19:03:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.046+0000 7fb17130f700 1 Processor -- start 2023-10-14T19:03:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7ff8c0ae0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8bc06bc20 0x7ff8bc0ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7ff8c0ae0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7ff8c0ae0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0abd50 con 0x7ff8bc0cb720 2023-10-14T19:03:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7ff8c0ae0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0cc100 con 0x7ff8bc06bc20 2023-10-14T19:03:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7ff8c0ae0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b20a0 con 0x7ff8bc06eb00 2023-10-14T19:03:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.046+0000 7f192217d700 1 -- start start 2023-10-14T19:03:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f192217d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c0677b0 0x7f191c067b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f192217d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f191c06ace0 0x7f191c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f192217d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c06a290 con 0x7f191c156310 2023-10-14T19:03:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f192217d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c0c8c20 con 0x7f191c06ace0 2023-10-14T19:03:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f192217d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c068580 con 0x7f191c0677b0 2023-10-14T19:03:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f191bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f191c156310 0x7f191c0c71b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47404/0 (socket says 172.21.15.7:47404) 2023-10-14T19:03:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f191bfff700 1 -- 172.21.15.7:0/3690407598 learned_addr learned my addr 172.21.15.7:0/3690407598 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c84018410 con 0x7f1c900ac6b0 2023-10-14T19:03:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f191b7fe700 1 --2- 172.21.15.7:0/3690407598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c0677b0 0x7f191c067b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8bad9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8ba59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8bc06bc20 0x7ff8bc0ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8bad9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc0cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38790/0 (socket says 172.21.15.7:38790) 2023-10-14T19:03:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8ba59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8bc06bc20 0x7ff8bc0ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37320/0 (socket says 172.21.15.7:37320) 2023-10-14T19:03:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8bad9d700 1 -- 172.21.15.7:0/2767917479 learned_addr learned my addr 172.21.15.7:0/2767917479 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f1912ffd700 1 --2- 172.21.15.7:0/3690407598 >> v2:172.21.15.7:3300/0 conn(0x7f191c06ace0 0x7f191c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f1c76ffd700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c7c067080 0x7f1c7c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f191b7fe700 1 -- 172.21.15.7:0/3690407598 >> v2:172.21.15.7:3300/0 conn(0x7f191c06ace0 msgr2=0x7f191c155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f191b7fe700 1 --2- 172.21.15.7:0/3690407598 >> v2:172.21.15.7:3300/0 conn(0x7f191c06ace0 0x7f191c155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8ba59c700 1 -- 172.21.15.7:0/2767917479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 msgr2=0x7ff8bc0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8ba59c700 1 --2- 172.21.15.7:0/2767917479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f191b7fe700 1 -- 172.21.15.7:0/3690407598 >> v1:172.21.15.7:6789/0 conn(0x7f191c156310 legacy=0x7f191c0c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8ba59c700 1 -- 172.21.15.7:0/2767917479 >> v1:172.21.15.148:6789/0 conn(0x7ff8bc0cb720 legacy=0x7ff8bc06e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T19:03:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7ff8ba59c700 1 -- 172.21.15.7:0/2767917479 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0ac030 con 0x7ff8bc06bc20 2023-10-14T19:03:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f191b7fe700 1 -- 172.21.15.7:0/3690407598 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0680c0 con 0x7f191c0677b0 2023-10-14T19:03:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c84084210 con 0x7f1c900ac6b0 2023-10-14T19:03:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.048+0000 7f191b7fe700 1 --2- 172.21.15.7:0/3690407598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c0677b0 0x7f191c067b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f190c0088f0 tx=0x7f190c008210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bbfc0c105145fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.046+0000 7fb17130f700 1 -- start start 2023-10-14T19:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7fb17130f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb16c0cbcb0 0x7fb16c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7fb17130f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16c0acf40 con 0x7fb16c06e930 2023-10-14T19:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7fb17130f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16c156c00 con 0x7fb16c0cb8e0 2023-10-14T19:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.047+0000 7fb17130f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16c0b20a0 con 0x7fb16c0cbcb0 2023-10-14T19:03:16.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb16affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb16c0cb8e0 0x7fb16c0ac830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45592/0 (socket says 172.21.15.7:45592) 2023-10-14T19:03:16.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb16affd700 1 -- 172.21.15.7:0/1551716134 learned_addr learned my addr 172.21.15.7:0/1551716134 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f191affd700 1 -- 172.21.15.7:0/3690407598 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c010070 con 0x7f191c0677b0 2023-10-14T19:03:16.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f191affd700 1 -- 172.21.15.7:0/3690407598 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00da40 con 0x7f191c0677b0 2023-10-14T19:03:16.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f191affd700 1 -- 172.21.15.7:0/3690407598 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00ddc0 con 0x7f191c0677b0 2023-10-14T19:03:16.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7ff8ba59c700 1 --2- 172.21.15.7:0/2767917479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc0ac830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00098e0 tx=0x7ff8b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267b9a52dfb37e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f1c956d1700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7f1c9016cab0 0x7f1c900a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 --> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c90167410 con 0x7f1c9016cab0 2023-10-14T19:03:16.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300755497 0 0) 0x7fb16c156c00 con 0x7fb16c0cb8e0 2023-10-14T19:03:16.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb154003570 con 0x7fb16c0cb8e0 2023-10-14T19:03:16.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7ff8b959a700 1 -- 172.21.15.7:0/2767917479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0009e80 con 0x7ff8bc06bc20 2023-10-14T19:03:16.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7ff8b959a700 1 -- 172.21.15.7:0/2767917479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000b820 con 0x7ff8bc06bc20 2023-10-14T19:03:16.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7ff8b959a700 1 -- 172.21.15.7:0/2767917479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000bbc0 con 0x7ff8bc06bc20 2023-10-14T19:03:16.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f1c8effd700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c7c067080 0x7f1c7c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7f1c8e7fc700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7f1c9016cab0 0x7f1c900a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274022476 0 0) 0x7fb16c0acf40 con 0x7fb16c06e930 2023-10-14T19:03:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16c156c00 con 0x7fb16c06e930 2023-10-14T19:03:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f192217d700 1 -- 172.21.15.7:0/3690407598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c0677b0 msgr2=0x7f191c067b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f192217d700 1 --2- 172.21.15.7:0/3690407598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c0677b0 0x7f191c067b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f190c0088f0 tx=0x7f190c008210 comp rx=0 tx=0).stop 2023-10-14T19:03:16.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332706707 0 0) 0x7fb154003570 con 0x7fb16c0cb8e0 2023-10-14T19:03:16.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 >> v2:172.21.15.148:3300/0 conn(0x7fb16c0cbcb0 msgr2=0x7fb16c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 --2- 172.21.15.7:0/1551716134 >> v2:172.21.15.148:3300/0 conn(0x7fb16c0cbcb0 0x7fb16c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 >> v1:172.21.15.7:6789/0 conn(0x7fb16c06e930 legacy=0x7fb16c0ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.049+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c0abd50 con 0x7fb16c0cb8e0 2023-10-14T19:03:16.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f1c8effd700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c7c067080 0x7f1c7c069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c900ae5a0 tx=0x7f1c80017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f1c8e7fc700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7f1c9016cab0 0x7f1c900a54d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fb1640017f0 con 0x7fb16c0cb8e0 2023-10-14T19:03:16.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 >> v1:172.21.15.148:6789/0 conn(0x7fb16c0cb8e0 legacy=0x7fb16c0ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/2767917479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 msgr2=0x7ff8bc0ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 --2- 172.21.15.7:0/2767917479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc0ac830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00098e0 tx=0x7ff8b00091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f192217d700 1 -- 172.21.15.7:0/3690407598 shutdown_connections 2023-10-14T19:03:16.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f192217d700 1 --2- 172.21.15.7:0/3690407598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c0677b0 0x7f191c067b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f192217d700 1 --2- 172.21.15.7:0/3690407598 >> v2:172.21.15.7:3300/0 conn(0x7f191c06ace0 0x7f191c155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7f192217d700 1 -- 172.21.15.7:0/3690407598 >> 172.21.15.7:0/3690407598 conn(0x7f191c0cc720 msgr2=0x7f191c0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/2767917479 shutdown_connections 2023-10-14T19:03:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 --2- 172.21.15.7:0/2767917479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 --2- 172.21.15.7:0/2767917479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc0ac830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/2767917479 >> 172.21.15.7:0/2767917479 conn(0x7ff8bc0cc300 msgr2=0x7ff8bc0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb154003ea0 0x7fb1540062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb154006910 0x7fb154006d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb154007580 0x7fb154007a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154010660 con 0x7fb154006910 2023-10-14T19:03:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540107d0 con 0x7fb154003ea0 2023-10-14T19:03:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb154010990 con 0x7fb154007580 2023-10-14T19:03:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb154006910 0x7fb154006d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7fb16b7fe700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb154007580 0x7fb154007a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.050+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/2767917479 shutdown_connections 2023-10-14T19:03:16.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16affd700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb154003ea0 0x7fb1540062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16a7fc700 1 -- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb154007580 msgr2=0x7fb154007a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb154007580 0x7fb154007a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16a7fc700 1 -- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb154003ea0 msgr2=0x7fb1540062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb154003ea0 0x7fb1540062a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16a7fc700 1 -- 172.21.15.7:0/1551716134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154003570 con 0x7fb154006910 2023-10-14T19:03:16.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7f192217d700 1 -- 172.21.15.7:0/3690407598 shutdown_connections 2023-10-14T19:03:16.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb154006910 0x7fb154006d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0099c0 tx=0x7fb15c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de795af068a2180 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7f192217d700 1 -- 172.21.15.7:0/3690407598 wait complete. 2023-10-14T19:03:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== osd.4 v2:172.21.15.148:6800/91106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1c90167410 con 0x7f1c9016cab0 2023-10-14T19:03:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c011420 con 0x7fb154006910 2023-10-14T19:03:16.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c011580 con 0x7fb154006910 2023-10-14T19:03:16.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.051+0000 7fb169ffb700 1 -- 172.21.15.7:0/1551716134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c011940 con 0x7fb154006910 2023-10-14T19:03:16.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7f192217d700 1 Processor -- start 2023-10-14T19:03:16.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7f192217d700 1 -- start start 2023-10-14T19:03:16.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f192217d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191c0677b0 0x7f191c141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f192217d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f191c06ace0 0x7f191c144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f192217d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c156310 0x7f191c145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f192217d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1432c0 con 0x7f191c06ace0 2023-10-14T19:03:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f192217d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1435a0 con 0x7f191c0677b0 2023-10-14T19:03:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f192217d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c143880 con 0x7f191c156310 2023-10-14T19:03:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f191bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c156310 0x7f191c145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f191bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c156310 0x7f191c145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38808/0 (socket says 172.21.15.7:38808) 2023-10-14T19:03:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7f191bfff700 1 -- 172.21.15.7:0/390774353 learned_addr learned my addr 172.21.15.7:0/390774353 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f191bfff700 1 -- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191c0677b0 msgr2=0x7f191c141200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T19:03:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f191bfff700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191c0677b0 0x7f191c141200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f191bfff700 1 -- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f191c06ace0 msgr2=0x7f191c144360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T19:03:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f191bfff700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f191c06ace0 0x7f191c144360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f191bfff700 1 -- 172.21.15.7:0/390774353 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c0084b0 con 0x7f191c156310 2023-10-14T19:03:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f191bfff700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c156310 0x7f191c145080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f191400bb80 tx=0x7f19140097e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/2767917479 wait complete. 2023-10-14T19:03:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7ff8c0ae0700 1 Processor -- start 2023-10-14T19:03:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7ff8c0ae0700 1 -- start start 2023-10-14T19:03:16.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8c0ae0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc166f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8c0ae0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc167480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8c0ae0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8bc0cb720 0x7ff8bc143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8c0ae0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc135610 con 0x7ff8bc06bc20 2023-10-14T19:03:16.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8c0ae0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc134a00 con 0x7ff8bc0cb720 2023-10-14T19:03:16.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8c0ae0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc134ce0 con 0x7ff8bc06eb00 2023-10-14T19:03:16.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc166f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc166f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37340/0 (socket says 172.21.15.7:37340) 2023-10-14T19:03:16.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 -- 172.21.15.7:0/38329312 learned_addr learned my addr 172.21.15.7:0/38329312 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8b9d9b700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc167480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8bad9d700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8bc0cb720 0x7ff8bc143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 -- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 msgr2=0x7ff8bc167480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7fae0a059700 1 Processor -- start 2023-10-14T19:03:16.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7fae0a059700 1 -- start start 2023-10-14T19:03:16.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae0a059700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae041598b0 0x7fae040af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae0a059700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fae04159c80 0x7fae040cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae0a059700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae040ce9d0 con 0x7fae040af790 2023-10-14T19:03:16.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae0a059700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040afc30 con 0x7fae04159c80 2023-10-14T19:03:16.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae0a059700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040aff10 con 0x7fae041598b0 2023-10-14T19:03:16.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae03fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fae040af790 0x7fae040cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47418/0 (socket says 172.21.15.7:47418) 2023-10-14T19:03:16.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae03fff700 1 -- 172.21.15.7:0/1153343525 learned_addr learned my addr 172.21.15.7:0/1153343525 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fae037fe700 1 --2- 172.21.15.7:0/1153343525 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae041598b0 0x7fae040af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae027fc700 1 -- 172.21.15.7:0/1153343525 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608169498 0 0) 0x7fae040ce9d0 con 0x7fae040af790 2023-10-14T19:03:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae037fe700 1 -- 172.21.15.7:0/1153343525 >> v2:172.21.15.148:3300/0 conn(0x7fae04159c80 msgr2=0x7fae040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae037fe700 1 --2- 172.21.15.7:0/1153343525 >> v2:172.21.15.148:3300/0 conn(0x7fae04159c80 0x7fae040cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae037fe700 1 -- 172.21.15.7:0/1153343525 >> v1:172.21.15.7:6789/0 conn(0x7fae040af790 legacy=0x7fae040cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae037fe700 1 -- 172.21.15.7:0/1153343525 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040ce380 con 0x7fae041598b0 2023-10-14T19:03:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae037fe700 1 --2- 172.21.15.7:0/1153343525 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae041598b0 0x7fae040af250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098e0 tx=0x7fadf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366e8153481fd7c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae027fc700 1 -- 172.21.15.7:0/1153343525 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8009e80 con 0x7fae041598b0 2023-10-14T19:03:16.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae027fc700 1 -- 172.21.15.7:0/1153343525 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf800b860 con 0x7fae041598b0 2023-10-14T19:03:16.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.054+0000 7fae027fc700 1 -- 172.21.15.7:0/1153343525 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800bc20 con 0x7fae041598b0 2023-10-14T19:03:16.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f98d11e6700 1 Processor -- start 2023-10-14T19:03:16.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f98d11e6700 1 -- start start 2023-10-14T19:03:16.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7fb17130f700 1 -- 172.21.15.7:0/1551716134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb154006910 msgr2=0x7fb154006d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7fb17130f700 1 --2- 172.21.15.7:0/1551716134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb154006910 0x7fb154006d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0099c0 tx=0x7fb15c009060 comp rx=0 tx=0).stop 2023-10-14T19:03:16.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.052+0000 7fb16b7fe700 1 -- 172.21.15.7:0/1551716134 reap_dead start 2023-10-14T19:03:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fb17130f700 1 -- 172.21.15.7:0/1551716134 shutdown_connections 2023-10-14T19:03:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.053+0000 7fb17130f700 1 -- 172.21.15.7:0/1551716134 >> 172.21.15.7:0/1551716134 conn(0x7fb16c0cc300 msgr2=0x7fb16c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8bc06eb00 0x7ff8bc167480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 -- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8bc0cb720 msgr2=0x7ff8bc143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8bc0cb720 0x7ff8bc143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8ba59c700 1 -- 172.21.15.7:0/38329312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0009420 con 0x7ff8bc06bc20 2023-10-14T19:03:16.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7ff8bad9d700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8bc0cb720 0x7ff8bc143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:16.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7fae0a059700 1 -- 172.21.15.7:0/1153343525 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae041598b0 msgr2=0x7fae040af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7fae0a059700 1 --2- 172.21.15.7:0/1153343525 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae041598b0 0x7fae040af250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098e0 tx=0x7fadf80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400c970 con 0x7f191c156310 2023-10-14T19:03:16.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400caf0 con 0x7f191c156310 2023-10-14T19:03:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c143b60 con 0x7f191c156310 2023-10-14T19:03:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.055+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c141740 con 0x7f191c156310 2023-10-14T19:03:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7ff8ba59c700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc166f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00091e0 tx=0x7ff8b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7fae0a059700 1 -- 172.21.15.7:0/1153343525 shutdown_connections 2023-10-14T19:03:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7fae0a059700 1 --2- 172.21.15.7:0/1153343525 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae041598b0 0x7fae040af250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7fae0a059700 1 --2- 172.21.15.7:0/1153343525 >> v2:172.21.15.148:3300/0 conn(0x7fae04159c80 0x7fae040cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7fae0a059700 1 -- 172.21.15.7:0/1153343525 >> 172.21.15.7:0/1153343525 conn(0x7fae04070e30 msgr2=0x7fae040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000ba60 con 0x7ff8bc06bc20 2023-10-14T19:03:16.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0020070 con 0x7ff8bc06bc20 2023-10-14T19:03:16.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b001b6a0 con 0x7ff8bc06bc20 2023-10-14T19:03:16.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914014440 con 0x7f191c156310 2023-10-14T19:03:16.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98d11e6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f98cc0b1880 0x7f98cc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98d11e6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc06ed90 con 0x7f98cc0cb940 2023-10-14T19:03:16.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98d11e6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc167750 con 0x7f98cc06e930 2023-10-14T19:03:16.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98d11e6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc167ff0 con 0x7f98cc0b1880 2023-10-14T19:03:16.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98cad9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f98cc0cb940 0x7f98cc0afb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47424/0 (socket says 172.21.15.7:47424) 2023-10-14T19:03:16.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98cad9d700 1 -- 172.21.15.7:0/1244027769 learned_addr learned my addr 172.21.15.7:0/1244027769 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f2fa9adc700 1 Processor -- start 2023-10-14T19:03:16.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f191c04c3c0 con 0x7f191c156310 2023-10-14T19:03:16.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc134fc0 con 0x7ff8bc06bc20 2023-10-14T19:03:16.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc133840 con 0x7ff8bc06bc20 2023-10-14T19:03:16.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.056+0000 7f98ca59c700 1 --2- 172.21.15.7:0/1244027769 >> v2:172.21.15.148:3300/0 conn(0x7f98cc0b1880 0x7f98cc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f2fa9adc700 1 -- start start 2023-10-14T19:03:16.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7fb17130f700 1 -- 172.21.15.7:0/1551716134 shutdown_connections 2023-10-14T19:03:16.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98ca59c700 1 -- 172.21.15.7:0/1244027769 >> v1:172.21.15.148:6789/0 conn(0x7f98cc06e930 legacy=0x7f98cc0870f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98ca59c700 1 -- 172.21.15.7:0/1244027769 >> v1:172.21.15.7:6789/0 conn(0x7f98cc0cb940 legacy=0x7f98cc0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98ca59c700 1 -- 172.21.15.7:0/1244027769 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc16e290 con 0x7f98cc0b1880 2023-10-14T19:03:16.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98ca59c700 1 --2- 172.21.15.7:0/1244027769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0b1880 0x7f98cc06e3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98c00098e0 tx=0x7f98c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f56e20584c7d021 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98c9d9b700 1 -- 172.21.15.7:0/1244027769 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0009e80 con 0x7f98cc0b1880 2023-10-14T19:03:16.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98c9d9b700 1 -- 172.21.15.7:0/1244027769 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c000b820 con 0x7f98cc0b1880 2023-10-14T19:03:16.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7f98c9d9b700 1 -- 172.21.15.7:0/1244027769 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000bba0 con 0x7f98cc0b1880 2023-10-14T19:03:16.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7fb17130f700 1 -- 172.21.15.7:0/1551716134 wait complete. 2023-10-14T19:03:16.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1914014830 con 0x7f191c156310 2023-10-14T19:03:16.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7fae0a059700 1 -- 172.21.15.7:0/1153343525 shutdown_connections 2023-10-14T19:03:16.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1913fff700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f18fc066fd0 0x7f18fc069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.057+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8bc133b20 con 0x7ff8bc06bc20 2023-10-14T19:03:16.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f98d11e6700 1 -- 172.21.15.7:0/1244027769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0b1880 msgr2=0x7f98cc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f98d11e6700 1 --2- 172.21.15.7:0/1244027769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0b1880 0x7f98cc06e3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98c00098e0 tx=0x7f98c00091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f2fa9adc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fa40b0420 0x7f2fa4163f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f2fa9adc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa40ac8e0 con 0x7f2fa4159b40 2023-10-14T19:03:16.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f2fa9adc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa40b08a0 con 0x7f2fa406e3f0 2023-10-14T19:03:16.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f2fa9adc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa40abcd0 con 0x7f2fa40b0420 2023-10-14T19:03:16.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f2fa37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2fa406e3f0 0x7f2fa406e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45604/0 (socket says 172.21.15.7:45604) 2023-10-14T19:03:16.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f2fa37fe700 1 -- 172.21.15.7:0/102723868 learned_addr learned my addr 172.21.15.7:0/102723868 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1914085030 con 0x7f191c156310 2023-10-14T19:03:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1913fff700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7f18fc06f1e0 0x7f18fc0715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 --> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18fc071ca0 con 0x7f18fc06f1e0 2023-10-14T19:03:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1914085360 con 0x7f191c156310 2023-10-14T19:03:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f1912ffd700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7f18fc06f1e0 0x7f18fc0715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f98d11e6700 1 -- 172.21.15.7:0/1244027769 shutdown_connections 2023-10-14T19:03:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f98d11e6700 1 --2- 172.21.15.7:0/1244027769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0b1880 0x7f98cc06e3f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7f98d11e6700 1 -- 172.21.15.7:0/1244027769 >> 172.21.15.7:0/1244027769 conn(0x7f98cc0cc300 msgr2=0x7f98cc0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7f2fa3fff700 1 --2- 172.21.15.7:0/102723868 >> v2:172.21.15.7:3300/0 conn(0x7f2fa40b0420 0x7f2fa4163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8b0022030 con 0x7ff8bc06bc20 2023-10-14T19:03:16.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7f1912ffd700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7f18fc06f1e0 0x7f18fc0715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7f191b7fe700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f18fc066fd0 0x7f18fc069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7f98d11e6700 1 -- 172.21.15.7:0/1244027769 shutdown_connections 2023-10-14T19:03:16.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7f98d11e6700 1 -- 172.21.15.7:0/1244027769 wait complete. 2023-10-14T19:03:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.058+0000 7fae0a059700 1 -- 172.21.15.7:0/1153343525 wait complete. 2023-10-14T19:03:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7fae0a059700 1 Processor -- start 2023-10-14T19:03:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7ff8aa7fc700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff89c066fb0 0x7ff89c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8b0086a10 con 0x7ff8bc06bc20 2023-10-14T19:03:16.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7ff8aa7fc700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7ff89c06f140 0x7ff89c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 --> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff89c071c00 con 0x7ff89c06f140 2023-10-14T19:03:16.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7fb17130f700 1 Processor -- start 2023-10-14T19:03:16.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.059+0000 7fb17130f700 1 -- start start 2023-10-14T19:03:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478435299 0 0) 0x7f2fa40b08a0 con 0x7f2fa406e3f0 2023-10-14T19:03:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f8c003570 con 0x7f2fa406e3f0 2023-10-14T19:03:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8b00092a0 con 0x7ff8bc06bc20 2023-10-14T19:03:16.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== osd.0 v2:172.21.15.7:6805/90947 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f18fc071ca0 con 0x7f18fc06f1e0 2023-10-14T19:03:16.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2603037207 0 0) 0x7f2f8c003570 con 0x7f2fa406e3f0 2023-10-14T19:03:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 >> v2:172.21.15.7:3300/0 conn(0x7f2fa40b0420 msgr2=0x7f2fa4163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 --2- 172.21.15.7:0/102723868 >> v2:172.21.15.7:3300/0 conn(0x7f2fa40b0420 0x7f2fa4163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 >> v1:172.21.15.7:6789/0 conn(0x7f2fa4159b40 legacy=0x7f2fa40ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40abfb0 con 0x7f2fa406e3f0 2023-10-14T19:03:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2f9c0017f0 con 0x7f2fa406e3f0 2023-10-14T19:03:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 >> v1:172.21.15.148:6789/0 conn(0x7f2fa406e3f0 legacy=0x7f2fa406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa27fc700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8c003a60 0x7f2f8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa27fc700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004810 0x7f2f8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa27fc700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f8c0051c0 0x7f2f8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40abcd0 con 0x7f2f8c003a60 2023-10-14T19:03:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00c0d0 con 0x7f2f8c004810 2023-10-14T19:03:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00c290 con 0x7f2f8c0051c0 2023-10-14T19:03:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7fb17130f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb16c1455c0 0x7fb16c0a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7fb17130f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb16c0a84d0 0x7fb16c0c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7fb17130f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16c145990 0x7fb16c0c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7fb17130f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c0ab0d0 con 0x7fb16c145990 2023-10-14T19:03:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb17130f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c0aa4c0 con 0x7fb16c1455c0 2023-10-14T19:03:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb17130f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c0aa7a0 con 0x7fb16c0a84d0 2023-10-14T19:03:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb16c0a84d0 0x7fb16c0c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb16c0a84d0 0x7fb16c0c10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38828/0 (socket says 172.21.15.7:38828) 2023-10-14T19:03:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 -- 172.21.15.7:0/256592919 learned_addr learned my addr 172.21.15.7:0/256592919 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16affd700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb16c1455c0 0x7fb16c0a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f191b7fe700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f18fc066fd0 0x7f18fc069480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f190c008250 tx=0x7f190c01b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.060+0000 7fae0a059700 1 -- start start 2023-10-14T19:03:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae0a059700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae040af790 0x7fae0414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae0a059700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae041598b0 0x7fae0415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae0a059700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae040b34b0 0x7fae0415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae0a059700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0415a3c0 con 0x7fae040b34b0 2023-10-14T19:03:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae0a059700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0414e850 con 0x7fae041598b0 2023-10-14T19:03:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae0a059700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040b4750 con 0x7fae040af790 2023-10-14T19:03:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae037fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae040af790 0x7fae0414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae02ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae041598b0 0x7fae0415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae02ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae041598b0 0x7fae0415c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59282/0 (socket says 172.21.15.7:59282) 2023-10-14T19:03:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fae02ffd700 1 -- 172.21.15.7:0/2739219395 learned_addr learned my addr 172.21.15.7:0/2739219395 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f98d11e6700 1 Processor -- start 2023-10-14T19:03:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8c003a60 0x7f2f8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa2ffd700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004810 0x7f2f8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa37fe700 1 -- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f8c0051c0 msgr2=0x7f2f8c00ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:03:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f8c0051c0 0x7f2f8c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa37fe700 1 -- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004810 msgr2=0x7f2f8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004810 0x7f2f8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f2fa37fe700 1 -- 172.21.15.7:0/102723868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40abfb0 con 0x7f2f8c003a60 2023-10-14T19:03:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 -- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb16c1455c0 msgr2=0x7fb16c0a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb16c1455c0 0x7fb16c0a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 -- 172.21.15.7:0/256592919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16c145990 msgr2=0x7fb16c0c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16c145990 0x7fb16c0c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7fb16a7fc700 1 -- 172.21.15.7:0/256592919 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c0aaa80 con 0x7fb16c0a84d0 2023-10-14T19:03:16.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae03fff700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae040b34b0 0x7fae0415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fb16a7fc700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb16c0a84d0 0x7fb16c0c10a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009460 tx=0x7fb15c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae037fe700 1 -- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae041598b0 msgr2=0x7fae0415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae037fe700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae041598b0 0x7fae0415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae037fe700 1 -- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae040b34b0 msgr2=0x7fae0415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae037fe700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae040b34b0 0x7fae0415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae037fe700 1 -- 172.21.15.7:0/2739219395 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009420 con 0x7fae040af790 2023-10-14T19:03:16.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8c003a60 0x7f2f8c003e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00a9a0 tx=0x7f2f9c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf320d87219abd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c011cb0 con 0x7fb16c0a84d0 2023-10-14T19:03:16.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c011e10 con 0x7fb16c0a84d0 2023-10-14T19:03:16.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c011900 con 0x7fb16c0a84d0 2023-10-14T19:03:16.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fae037fe700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae040af790 0x7fae0414e310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fadf8016000 tx=0x7fadf8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.061+0000 7f98d11e6700 1 -- start start 2023-10-14T19:03:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98d11e6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc06e930 0x7f98cc0a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98d11e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98cc0b1880 0x7f98cc0aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98d11e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0cb940 0x7f98cc0aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98d11e6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1648e0 con 0x7f98cc0b1880 2023-10-14T19:03:16.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98d11e6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc179ec0 con 0x7f98cc0cb940 2023-10-14T19:03:16.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98d11e6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0a6e60 con 0x7f98cc06e930 2023-10-14T19:03:16.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf801f070 con 0x7fae040af790 2023-10-14T19:03:16.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8000c90 con 0x7fae040af790 2023-10-14T19:03:16.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae040b4a30 con 0x7fae040af790 2023-10-14T19:03:16.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0415a050 con 0x7fae040af790 2023-10-14T19:03:16.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98ca59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98cc0b1880 0x7f98cc0aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98ca59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98cc0b1880 0x7f98cc0aa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37380/0 (socket says 172.21.15.7:37380) 2023-10-14T19:03:16.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.062+0000 7f98ca59c700 1 -- 172.21.15.7:0/3562160303 learned_addr learned my addr 172.21.15.7:0/3562160303 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc06e930 0x7f98cc0a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7ff8b9d9b700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff89c066fb0 0x7ff89c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7ff8bad9d700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7ff89c06f140 0x7ff89c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 -- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0cb940 msgr2=0x7f98cc0aa7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:03:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc0cb940 0x7f98cc0aa7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 -- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98cc0b1880 msgr2=0x7f98cc0aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98cc0b1880 0x7f98cc0aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 -- 172.21.15.7:0/3562160303 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0009420 con 0x7f98cc06e930 2023-10-14T19:03:16.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0070d0 con 0x7f2f8c003a60 2023-10-14T19:03:16.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c007230 con 0x7f2f8c003a60 2023-10-14T19:03:16.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f2fa27fc700 1 -- 172.21.15.7:0/102723868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0075d0 con 0x7f2f8c003a60 2023-10-14T19:03:16.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7f98cad9d700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc06e930 0x7f98cc0a6920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98bc015bb0 tx=0x7f98bc0107b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7ff8bad9d700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7ff89c06f140 0x7ff89c071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.063+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8025420 con 0x7fae040af790 2023-10-14T19:03:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.064+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fade4000fd0 con 0x7fae040af790 2023-10-14T19:03:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.064+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00f050 con 0x7f98cc06e930 2023-10-14T19:03:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.064+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc013a30 con 0x7f98cc06e930 2023-10-14T19:03:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.064+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc164fe0 con 0x7f98cc06e930 2023-10-14T19:03:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.064+0000 7f2fa3fff700 1 -- 172.21.15.7:0/102723868 reap_dead start 2023-10-14T19:03:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.064+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc179b50 con 0x7f98cc06e930 2023-10-14T19:03:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== osd.1 v2:172.21.15.7:6816/90946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff89c071c00 con 0x7ff89c06f140 2023-10-14T19:03:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98b8001000 con 0x7f98cc06e930 2023-10-14T19:03:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f2fa9adc700 1 -- 172.21.15.7:0/102723868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8c003a60 msgr2=0x7f2f8c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f2fa9adc700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8c003a60 0x7f2f8c003e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00a9a0 tx=0x7f2f9c0021d0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc013dd0 con 0x7f98cc06e930 2023-10-14T19:03:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f2fa9adc700 1 -- 172.21.15.7:0/102723868 shutdown_connections 2023-10-14T19:03:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f2fa9adc700 1 --2- 172.21.15.7:0/102723868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8c003a60 0x7f2f8c003e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7f2fa9adc700 1 -- 172.21.15.7:0/102723868 >> 172.21.15.7:0/102723868 conn(0x7f2fa40cc300 msgr2=0x7f2fa40cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16c0aad60 con 0x7fb16c0a84d0 2023-10-14T19:03:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.065+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16c0aa0b0 con 0x7fb16c0a84d0 2023-10-14T19:03:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.066+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadf8023070 con 0x7fae040af790 2023-10-14T19:03:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.066+0000 7fadeb7fe700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fadf0067000 0x7fadf00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.066+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb16c04c3c0 con 0x7fb16c0a84d0 2023-10-14T19:03:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.066+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98bc019690 con 0x7f98cc06e930 2023-10-14T19:03:16.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.066+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadf80858a0 con 0x7fae040af790 2023-10-14T19:03:16.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7fadeb7fe700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fadf006f190 0x7fadf00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 --> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadf0071c50 con 0x7fadf006f190 2023-10-14T19:03:16.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7f98b2ffd700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f98b40671b0 0x7f98b4069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98bc08ce90 con 0x7f98cc06e930 2023-10-14T19:03:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7f98ca59c700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f98b40671b0 0x7f98b4069660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7f98b2ffd700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f98b406f3c0 0x7f98b40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 --> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98b4071e80 con 0x7f98b406f3c0 2023-10-14T19:03:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98bc08d240 con 0x7f98cc06e930 2023-10-14T19:03:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.067+0000 7fae03fff700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fadf006f190 0x7fadf00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fae02ffd700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fadf0067000 0x7fadf00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb15c0193b0 con 0x7fb16c0a84d0 2023-10-14T19:03:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fae03fff700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fadf006f190 0x7fadf00715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fb152ffd700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb158066f60 0x7fb158069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb15c085b40 con 0x7fb16c0a84d0 2023-10-14T19:03:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fb16affd700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb158066f60 0x7fb158069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.068+0000 7fb152ffd700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7fb15806f170 0x7fb158071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.069+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 --> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb158071c30 con 0x7fb15806f170 2023-10-14T19:03:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.069+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb15c08a240 con 0x7fb16c0a84d0 2023-10-14T19:03:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.069+0000 7fb16b7fe700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7fb15806f170 0x7fb158071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.069+0000 7fb16affd700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb158066f60 0x7fb158069410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb164004c10 tx=0x7fb164001420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.069+0000 7fb16b7fe700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7fb15806f170 0x7fb158071580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.070+0000 7ff8b9d9b700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff89c066fb0 0x7ff89c069460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006fd0 tx=0x7ff8ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.070+0000 7fc37b6ef700 1 Processor -- start 2023-10-14T19:03:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.070+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== osd.6 v2:172.21.15.148:6824/91145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb158071c30 con 0x7fb15806f170 2023-10-14T19:03:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.070+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== osd.2 v2:172.21.15.7:6800/90945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fadf0071c50 con 0x7fadf006f190 2023-10-14T19:03:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.070+0000 7fc37b6ef700 1 -- start start 2023-10-14T19:03:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc37b6ef700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc37415b5e0 0x7fc3740b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc37b6ef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 0x7fc374167810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc37b6ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37415ef50 con 0x7fc37415b9b0 2023-10-14T19:03:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc37b6ef700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37415e180 con 0x7fc37415b5e0 2023-10-14T19:03:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc37b6ef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37415e380 con 0x7fc3740b0470 2023-10-14T19:03:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc379c8c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 0x7fc374167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc37948b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc37415b5e0 0x7fc3740b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc379c8c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 0x7fc374167810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38868/0 (socket says 172.21.15.7:38868) 2023-10-14T19:03:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.071+0000 7fc379c8c700 1 -- 172.21.15.7:0/1947884328 learned_addr learned my addr 172.21.15.7:0/1947884328 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7f98ca59c700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f98b40671b0 0x7f98b4069660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0cb150 tx=0x7f98c0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc379c8c700 1 -- 172.21.15.7:0/1947884328 >> v2:172.21.15.148:3300/0 conn(0x7fc37415b5e0 msgr2=0x7fc3740b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc379c8c700 1 --2- 172.21.15.7:0/1947884328 >> v2:172.21.15.148:3300/0 conn(0x7fc37415b5e0 0x7fc3740b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc379c8c700 1 -- 172.21.15.7:0/1947884328 >> v1:172.21.15.148:6789/0 conn(0x7fc37415b9b0 legacy=0x7fc3740b27d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:03:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc379c8c700 1 -- 172.21.15.7:0/1947884328 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37415e620 con 0x7fc3740b0470 2023-10-14T19:03:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc379c8c700 1 --2- 172.21.15.7:0/1947884328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 0x7fc374167810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009f20 tx=0x7fc36c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ffbf9f08fbda9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc36bfff700 1 -- 172.21.15.7:0/1947884328 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00e070 con 0x7fc3740b0470 2023-10-14T19:03:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc36bfff700 1 -- 172.21.15.7:0/1947884328 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c00b990 con 0x7fc3740b0470 2023-10-14T19:03:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.072+0000 7fc36bfff700 1 -- 172.21.15.7:0/1947884328 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0092e0 con 0x7fc3740b0470 2023-10-14T19:03:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.073+0000 7fc37b6ef700 1 -- 172.21.15.7:0/1947884328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 msgr2=0x7fc374167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.073+0000 7fc37b6ef700 1 --2- 172.21.15.7:0/1947884328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 0x7fc374167810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009f20 tx=0x7fc36c009840 comp rx=0 tx=0).stop 2023-10-14T19:03:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.073+0000 7fc37b6ef700 1 -- 172.21.15.7:0/1947884328 shutdown_connections 2023-10-14T19:03:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.073+0000 7fc37b6ef700 1 --2- 172.21.15.7:0/1947884328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3740b0470 0x7fc374167810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.073+0000 7fc37b6ef700 1 --2- 172.21.15.7:0/1947884328 >> v2:172.21.15.148:3300/0 conn(0x7fc37415b5e0 0x7fc3740b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.073+0000 7fc37b6ef700 1 -- 172.21.15.7:0/1947884328 >> 172.21.15.7:0/1947884328 conn(0x7fc3740cded0 msgr2=0x7fc37406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.075+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 --> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c90087de0 con 0x7f1c9016cab0 2023-10-14T19:03:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c76ffd700 1 -- 172.21.15.7:0/147185213 <== osd.4 v2:172.21.15.148:6800/91106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c90087de0 con 0x7f1c9016cab0 2023-10-14T19:03:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7f1c9016cab0 msgr2=0x7f1c900a54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7f1c9016cab0 0x7f1c900a54d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c7c067080 msgr2=0x7f1c7c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c7c067080 0x7f1c7c069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c900ae5a0 tx=0x7f1c80017000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c900ac6b0 msgr2=0x7f1c9015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 --2- 172.21.15.7:0/147185213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c900ac6b0 0x7f1c9015a420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400ba10 tx=0x7f1c8400d780 comp rx=0 tx=0).stop 2023-10-14T19:03:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c8f7fe700 1 -- 172.21.15.7:0/147185213 reap_dead start 2023-10-14T19:03:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 shutdown_connections 2023-10-14T19:03:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 >> 172.21.15.7:0/147185213 conn(0x7f1c900cc300 msgr2=0x7f1c9006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 shutdown_connections 2023-10-14T19:03:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.076+0000 7f1c956d1700 1 -- 172.21.15.7:0/147185213 wait complete. 2023-10-14T19:03:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.077+0000 7f2fa9adc700 1 -- 172.21.15.7:0/102723868 shutdown_connections 2023-10-14T19:03:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.077+0000 7f98cb59e700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f98b406f3c0 0x7f98b40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.077+0000 7f2fa9adc700 1 -- 172.21.15.7:0/102723868 wait complete. 2023-10-14T19:03:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.077+0000 7f98cb59e700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f98b406f3c0 0x7f98b40717d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.078+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== osd.3 v2:172.21.15.7:6824/90956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f98b4071e80 con 0x7f98b406f3c0 2023-10-14T19:03:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.079+0000 7f2fa9adc700 1 Processor -- start 2023-10-14T19:03:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.079+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadf80092a0 con 0x7fae040af790 2023-10-14T19:03:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.079+0000 7f2fa9adc700 1 -- start start 2023-10-14T19:03:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.080+0000 7f2fa9adc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003a60 0x7f2fa40a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.080+0000 7f2fa9adc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa4157110 0x7f2fa4157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.080+0000 7f2fa9adc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fa406a570 0x7f2fa406a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.080+0000 7f2fa9adc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa406af20 con 0x7f2fa406a570 2023-10-14T19:03:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.080+0000 7f2fa9adc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4156a00 con 0x7f2f8c003a60 2023-10-14T19:03:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.080+0000 7f2fa9adc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40a7ba0 con 0x7f2fa4157110 2023-10-14T19:03:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fa406a570 0x7f2fa406a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fa406a570 0x7f2fa406a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37382/0 (socket says 172.21.15.7:37382) 2023-10-14T19:03:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 -- 172.21.15.7:0/1799344554 learned_addr learned my addr 172.21.15.7:0/1799344554 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003a60 0x7f2fa40a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa2ffd700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa4157110 0x7f2fa4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 -- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa4157110 msgr2=0x7f2fa4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa4157110 0x7f2fa4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 -- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003a60 msgr2=0x7f2fa40a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003a60 0x7f2fa40a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 -- 172.21.15.7:0/1799344554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40a7e10 con 0x7f2fa406a570 2023-10-14T19:03:16.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.081+0000 7f2fa3fff700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fa406a570 0x7f2fa406a9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40cbd70 tx=0x7f2f940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.082+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94013680 con 0x7f2fa406a570 2023-10-14T19:03:16.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.082+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94013800 con 0x7f2fa406a570 2023-10-14T19:03:16.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.082+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94013bc0 con 0x7f2fa406a570 2023-10-14T19:03:16.176 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T19:03:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.092+0000 7fae02ffd700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fadf0067000 0x7fadf00694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae040b2100 tx=0x7fadf40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.092+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa40a80f0 con 0x7f2fa406a570 2023-10-14T19:03:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.092+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa406b110 con 0x7f2fa406a570 2023-10-14T19:03:16.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.092+0000 7fc37b6ef700 1 -- 172.21.15.7:0/1947884328 shutdown_connections 2023-10-14T19:03:16.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.092+0000 7fc37b6ef700 1 -- 172.21.15.7:0/1947884328 wait complete. 2023-10-14T19:03:16.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.093+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 --> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f191c1439c0 con 0x7f18fc06f1e0 2023-10-14T19:03:16.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.093+0000 7fc37b6ef700 1 Processor -- start 2023-10-14T19:03:16.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.094+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fa4159050 con 0x7f2fa406a570 2023-10-14T19:03:16.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.093+0000 7fc37b6ef700 1 -- start start 2023-10-14T19:03:16.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.094+0000 7f1913fff700 1 -- 172.21.15.7:0/390774353 <== osd.0 v2:172.21.15.7:6805/90947 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f191c1439c0 con 0x7f18fc06f1e0 2023-10-14T19:03:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.094+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7f18fc06f1e0 msgr2=0x7f18fc0715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.094+0000 7f192217d700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7f18fc06f1e0 0x7f18fc0715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f18fc066fd0 msgr2=0x7f18fc069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7f192217d700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f18fc066fd0 0x7f18fc069480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f190c008250 tx=0x7f190c01b000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c156310 msgr2=0x7f191c145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7f192217d700 1 --2- 172.21.15.7:0/390774353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f191c156310 0x7f191c145080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f191400bb80 tx=0x7f19140097e0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7f191bfff700 1 -- 172.21.15.7:0/390774353 reap_dead start 2023-10-14T19:03:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37b6ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3740b0470 0x7fc374166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37b6ef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc374167a70 0x7fc37414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37b6ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc374179fc0 0x7fc37417a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37b6ef700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37414e7c0 con 0x7fc3740b0470 2023-10-14T19:03:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37b6ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741675e0 con 0x7fc374179fc0 2023-10-14T19:03:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37b6ef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741669d0 con 0x7fc374167a70 2023-10-14T19:03:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f9401e410 con 0x7f2fa406a570 2023-10-14T19:03:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc378c8a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc374167a70 0x7fc37414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc379c8c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc374179fc0 0x7fc37417a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc378c8a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc374167a70 0x7fc37414e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38876/0 (socket says 172.21.15.7:38876) 2023-10-14T19:03:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc378c8a700 1 -- 172.21.15.7:0/3652961096 learned_addr learned my addr 172.21.15.7:0/3652961096 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc379c8c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc374179fc0 0x7fc37417a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59316/0 (socket says 172.21.15.7:59316) 2023-10-14T19:03:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc37948b700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3740b0470 0x7fc374166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc379c8c700 1 -- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc374167a70 msgr2=0x7fc37414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc379c8c700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc374167a70 0x7fc37414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc379c8c700 1 -- 172.21.15.7:0/3652961096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3740b0470 msgr2=0x7fc374166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.095+0000 7fc379c8c700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3740b0470 0x7fc374166340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc379c8c700 1 -- 172.21.15.7:0/3652961096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c009ae0 con 0x7fc374179fc0 2023-10-14T19:03:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7f2f8b7fe700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc379c8c700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc374179fc0 0x7fc37417a440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc36c014000 tx=0x7fc36c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f94083dd0 con 0x7f2fa406a570 2023-10-14T19:03:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7f2f8b7fe700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f2f9006f0c0 0x7f2f900714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 --> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f90071b80 con 0x7f2f9006f0c0 2023-10-14T19:03:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f94086370 con 0x7f2fa406a570 2023-10-14T19:03:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c012ba0 con 0x7fc374179fc0 2023-10-14T19:03:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc374166cb0 con 0x7fc374179fc0 2023-10-14T19:03:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c012d00 con 0x7fc374179fc0 2023-10-14T19:03:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c01e680 con 0x7fc374179fc0 2023-10-14T19:03:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc374167270 con 0x7fc374179fc0 2023-10-14T19:03:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.096+0000 7f2fa2ffd700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f2f9006f0c0 0x7f2f900714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.097+0000 7f2fa2ffd700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f2f9006f0c0 0x7f2f900714d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.097+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc37404c3c0 con 0x7fc374179fc0 2023-10-14T19:03:16.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== osd.5 v2:172.21.15.148:6808/91107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2f90071b80 con 0x7f2f9006f0c0 2023-10-14T19:03:16.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc36c01e9f0 con 0x7fc374179fc0 2023-10-14T19:03:16.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 --> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98b8002d60 con 0x7f98b406f3c0 2023-10-14T19:03:16.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 shutdown_connections 2023-10-14T19:03:16.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 >> 172.21.15.7:0/390774353 conn(0x7f191c0cc720 msgr2=0x7f191c0ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 shutdown_connections 2023-10-14T19:03:16.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f192217d700 1 -- 172.21.15.7:0/390774353 wait complete. 2023-10-14T19:03:16.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7f98b2ffd700 1 -- 172.21.15.7:0/3562160303 <== osd.3 v2:172.21.15.7:6824/90956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98b8002d60 con 0x7f98b406f3c0 2023-10-14T19:03:16.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.098+0000 7fc3697fa700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc358066f30 0x7fc3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc36c0863d0 con 0x7fc374179fc0 2023-10-14T19:03:16.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc37948b700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc358066f30 0x7fc3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc3697fa700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7fc35806f0b0 0x7fc3580714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 --> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc358071b70 con 0x7fc35806f0b0 2023-10-14T19:03:16.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36c086770 con 0x7fc374179fc0 2023-10-14T19:03:16.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc378c8a700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7fc35806f0b0 0x7fc3580714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc37948b700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc358066f30 0x7fc3580693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc37406a880 tx=0x7fc3700091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.100+0000 7f2fa37fe700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c001350 tx=0x7f2f9c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.101+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 --> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb16c0ad120 con 0x7fb15806f170 2023-10-14T19:03:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.099+0000 7fc378c8a700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7fc35806f0b0 0x7fc3580714c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.100+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== osd.7 v2:172.21.15.148:6816/91110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc358071b70 con 0x7fc35806f0b0 2023-10-14T19:03:16.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.102+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 --> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8bc1504a0 con 0x7ff89c06f140 2023-10-14T19:03:16.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.102+0000 7fb152ffd700 1 -- 172.21.15.7:0/256592919 <== osd.6 v2:172.21.15.148:6824/91145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb16c0ad120 con 0x7fb15806f170 2023-10-14T19:03:16.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.102+0000 7ff8aa7fc700 1 -- 172.21.15.7:0/38329312 <== osd.1 v2:172.21.15.7:6816/90946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff8bc1504a0 con 0x7ff89c06f140 2023-10-14T19:03:16.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.102+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7fb15806f170 msgr2=0x7fb158071580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.102+0000 7fb17130f700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7fb15806f170 0x7fb158071580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb158066f60 msgr2=0x7fb158069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fb17130f700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb158066f60 0x7fb158069410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb164004c10 tx=0x7fb164001420 comp rx=0 tx=0).stop 2023-10-14T19:03:16.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb16c0a84d0 msgr2=0x7fb16c0c10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fb17130f700 1 --2- 172.21.15.7:0/256592919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb16c0a84d0 0x7fb16c0c10a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009460 tx=0x7fb15c017000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fb16b7fe700 1 -- 172.21.15.7:0/256592919 reap_dead start 2023-10-14T19:03:16.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 --> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fade4002cf0 con 0x7fadf006f190 2023-10-14T19:03:16.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f98b406f3c0 msgr2=0x7f98b40717d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f98b406f3c0 0x7f98b40717d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f98b40671b0 msgr2=0x7f98b4069660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f98b40671b0 0x7f98b4069660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0cb150 tx=0x7f98c0016000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc06e930 msgr2=0x7f98cc0a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 --2- 172.21.15.7:0/3562160303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc06e930 0x7f98cc0a6920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98bc015bb0 tx=0x7f98bc0107b0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98cb59e700 1 -- 172.21.15.7:0/3562160303 reap_dead start 2023-10-14T19:03:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 shutdown_connections 2023-10-14T19:03:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 >> 172.21.15.7:0/3562160303 conn(0x7f98cc0cc300 msgr2=0x7f98cc165b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fadeb7fe700 1 -- 172.21.15.7:0/2739219395 <== osd.2 v2:172.21.15.7:6800/90945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fade4002cf0 con 0x7fadf006f190 2023-10-14T19:03:16.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fadf006f190 msgr2=0x7fadf00715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fae0a059700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fadf006f190 0x7fadf00715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 shutdown_connections 2023-10-14T19:03:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 >> 172.21.15.7:0/256592919 conn(0x7fb16c0cc300 msgr2=0x7fb16c1560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.103+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fadf0067000 msgr2=0x7fadf00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fadf0067000 0x7fadf00694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae040b2100 tx=0x7fadf40091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae040af790 msgr2=0x7fae0414e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 --2- 172.21.15.7:0/2739219395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae040af790 0x7fae0414e310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fadf8016000 tx=0x7fadf8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae03fff700 1 -- 172.21.15.7:0/2739219395 reap_dead start 2023-10-14T19:03:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 shutdown_connections 2023-10-14T19:03:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 >> 172.21.15.7:0/2739219395 conn(0x7fae04070e30 msgr2=0x7fae040b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 shutdown_connections 2023-10-14T19:03:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 shutdown_connections 2023-10-14T19:03:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fb17130f700 1 -- 172.21.15.7:0/256592919 wait complete. 2023-10-14T19:03:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.104+0000 7fae0a059700 1 -- 172.21.15.7:0/2739219395 wait complete. 2023-10-14T19:03:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.106+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7ff89c06f140 msgr2=0x7ff89c071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.106+0000 7ff8c0ae0700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7ff89c06f140 0x7ff89c071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.108+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 shutdown_connections 2023-10-14T19:03:16.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.108+0000 7f98d11e6700 1 -- 172.21.15.7:0/3562160303 wait complete. 2023-10-14T19:03:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.110+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff89c066fb0 msgr2=0x7ff89c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.110+0000 7ff8c0ae0700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff89c066fb0 0x7ff89c069460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006fd0 tx=0x7ff8ac008040 comp rx=0 tx=0).stop 2023-10-14T19:03:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.110+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 msgr2=0x7ff8bc166f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.110+0000 7ff8c0ae0700 1 --2- 172.21.15.7:0/38329312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8bc06bc20 0x7ff8bc166f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00091e0 tx=0x7ff8b0016000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.110+0000 7ff8bad9d700 1 -- 172.21.15.7:0/38329312 reap_dead start 2023-10-14T19:03:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.112+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 shutdown_connections 2023-10-14T19:03:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.112+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 >> 172.21.15.7:0/38329312 conn(0x7ff8bc0cc300 msgr2=0x7ff8bc0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.112+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 shutdown_connections 2023-10-14T19:03:16.216 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:16.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T19:03:16.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.114+0000 7ff8c0ae0700 1 -- 172.21.15.7:0/38329312 wait complete. 2023-10-14T19:03:16.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.118+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 --> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fa40a6480 con 0x7f2f9006f0c0 2023-10-14T19:03:16.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.119+0000 7f2f8b7fe700 1 -- 172.21.15.7:0/1799344554 <== osd.5 v2:172.21.15.148:6808/91107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fa40a6480 con 0x7f2f9006f0c0 2023-10-14T19:03:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.119+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f2f9006f0c0 msgr2=0x7f2f900714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.119+0000 7f2fa9adc700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f2f9006f0c0 0x7f2f900714d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 msgr2=0x7f2f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c001350 tx=0x7f2f9c016000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fa406a570 msgr2=0x7f2fa406a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 --2- 172.21.15.7:0/1799344554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fa406a570 0x7f2fa406a9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40cbd70 tx=0x7f2f940091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa3fff700 1 -- 172.21.15.7:0/1799344554 reap_dead start 2023-10-14T19:03:16.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 --> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc37415e900 con 0x7fc35806f0b0 2023-10-14T19:03:16.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 shutdown_connections 2023-10-14T19:03:16.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 >> 172.21.15.7:0/1799344554 conn(0x7f2fa40cc300 msgr2=0x7f2fa4154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 shutdown_connections 2023-10-14T19:03:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7f2fa9adc700 1 -- 172.21.15.7:0/1799344554 wait complete. 2023-10-14T19:03:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.122+0000 7fc3697fa700 1 -- 172.21.15.7:0/3652961096 <== osd.7 v2:172.21.15.148:6816/91110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc37415e900 con 0x7fc35806f0b0 2023-10-14T19:03:16.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.123+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7fc35806f0b0 msgr2=0x7fc3580714c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.123+0000 7fc37b6ef700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7fc35806f0b0 0x7fc3580714c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.124+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc358066f30 msgr2=0x7fc3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.124+0000 7fc37b6ef700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc358066f30 0x7fc3580693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc37406a880 tx=0x7fc3700091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.124+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc374179fc0 msgr2=0x7fc37417a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.124+0000 7fc37b6ef700 1 --2- 172.21.15.7:0/3652961096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc374179fc0 0x7fc37417a440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc36c014000 tx=0x7fc36c017000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.225 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T19:03:16.226 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:16.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T19:03:16.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.127+0000 7fc379c8c700 1 -- 172.21.15.7:0/3652961096 reap_dead start 2023-10-14T19:03:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.127+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 shutdown_connections 2023-10-14T19:03:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.127+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 >> 172.21.15.7:0/3652961096 conn(0x7fc3740cded0 msgr2=0x7fc37415fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.127+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 shutdown_connections 2023-10-14T19:03:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.127+0000 7fc37b6ef700 1 -- 172.21.15.7:0/3652961096 wait complete. 2023-10-14T19:03:16.229 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.229 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T19:03:16.230 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:16.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T19:03:16.232 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T19:03:16.233 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:16.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T19:03:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.455+0000 7ff7eaa26700 1 Processor -- start 2023-10-14T19:03:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.455+0000 7ff7eaa26700 1 -- start start 2023-10-14T19:03:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7eaa26700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7e40afb30 0x7ff7e40aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7eaa26700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40cb9e0 0x7ff7e40b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7eaa26700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e4167a60 con 0x7ff7e40b1880 2023-10-14T19:03:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7eaa26700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40cbe80 con 0x7ff7e40afb30 2023-10-14T19:03:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7eaa26700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4166e50 con 0x7ff7e40cb9e0 2023-10-14T19:03:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7e37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff7e40b1880 0x7ff7e40cb2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45618/0 (socket says 172.21.15.7:45618) 2023-10-14T19:03:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7e37fe700 1 -- 172.21.15.7:0/3864085674 learned_addr learned my addr 172.21.15.7:0/3864085674 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7e2ffd700 1 -- 172.21.15.7:0/3864085674 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813935434 0 0) 0x7ff7e4167a60 con 0x7ff7e40b1880 2023-10-14T19:03:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.457+0000 7ff7e2ffd700 1 -- 172.21.15.7:0/3864085674 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7cc003570 con 0x7ff7e40b1880 2023-10-14T19:03:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.461+0000 7ff7e3fff700 1 --2- 172.21.15.7:0/3864085674 >> v2:172.21.15.7:3300/0 conn(0x7ff7e40afb30 0x7ff7e40aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.462+0000 7ff7e3fff700 1 -- 172.21.15.7:0/3864085674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40cb9e0 msgr2=0x7ff7e40b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.462+0000 7ff7e2ffd700 1 -- 172.21.15.7:0/3864085674 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 769165268 0 0) 0x7ff7cc003570 con 0x7ff7e40b1880 2023-10-14T19:03:16.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.461+0000 7ff7e8fc3700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40cb9e0 0x7ff7e40b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e3fff700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40cb9e0 0x7ff7e40b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e3fff700 1 -- 172.21.15.7:0/3864085674 >> v1:172.21.15.148:6789/0 conn(0x7ff7e40b1880 legacy=0x7ff7e40cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e3fff700 1 -- 172.21.15.7:0/3864085674 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4167130 con 0x7ff7e40afb30 2023-10-14T19:03:16.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7f8ee0097700 1 Processor -- start 2023-10-14T19:03:16.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e8fc3700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40cb9e0 0x7ff7e40b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:16.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e3fff700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40afb30 0x7ff7e40aff00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800b2f0 tx=0x7ff7d8009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8deda401a24e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e2ffd700 1 -- 172.21.15.7:0/3864085674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4001470 con 0x7ff7e40afb30 2023-10-14T19:03:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7f8ee0097700 1 -- start start 2023-10-14T19:03:16.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e2ffd700 1 -- 172.21.15.7:0/3864085674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d800bbf0 con 0x7ff7e40afb30 2023-10-14T19:03:16.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.463+0000 7ff7e2ffd700 1 -- 172.21.15.7:0/3864085674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8011420 con 0x7ff7e40afb30 2023-10-14T19:03:16.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.464+0000 7ff7eaa26700 1 -- 172.21.15.7:0/3864085674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40afb30 msgr2=0x7ff7e40aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.464+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40afb30 0x7ff7e40aff00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800b2f0 tx=0x7ff7d8009a30 comp rx=0 tx=0).stop 2023-10-14T19:03:16.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f929e50f700 1 Processor -- start 2023-10-14T19:03:16.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f929e50f700 1 -- start start 2023-10-14T19:03:16.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f842fd26700 1 Processor -- start 2023-10-14T19:03:16.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8ee0097700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ed81393f0 0x7f8ed80cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8ee0097700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80c3380 con 0x7f8ed8138bc0 2023-10-14T19:03:16.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8ee0097700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80cbf60 con 0x7f8ed80cbb20 2023-10-14T19:03:16.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8ee0097700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed8070ab0 con 0x7f8ed81393f0 2023-10-14T19:03:16.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f5fd39fd700 1 Processor -- start 2023-10-14T19:03:16.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8edd632700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ed81393f0 0x7f8ed80cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8edd632700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ed81393f0 0x7f8ed80cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59330/0 (socket says 172.21.15.7:59330) 2023-10-14T19:03:16.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f8edd632700 1 -- 172.21.15.7:0/2460148491 learned_addr learned my addr 172.21.15.7:0/2460148491 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edd632700 1 -- 172.21.15.7:0/2460148491 >> v1:172.21.15.148:6789/0 conn(0x7f8ed80cbb20 legacy=0x7f8ed80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edd632700 1 -- 172.21.15.7:0/2460148491 >> v1:172.21.15.7:6789/0 conn(0x7f8ed8138bc0 legacy=0x7f8ed806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edd632700 1 -- 172.21.15.7:0/2460148491 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed806e010 con 0x7f8ed81393f0 2023-10-14T19:03:16.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f0ef4191700 1 Processor -- start 2023-10-14T19:03:16.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f927af54700 1 Processor -- start 2023-10-14T19:03:16.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7ff7eaa26700 1 -- 172.21.15.7:0/3864085674 shutdown_connections 2023-10-14T19:03:16.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40cb9e0 0x7ff7e40b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/3864085674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40afb30 0x7ff7e40aff00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7ff7eaa26700 1 -- 172.21.15.7:0/3864085674 >> 172.21.15.7:0/3864085674 conn(0x7ff7e40cc300 msgr2=0x7ff7e40cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edd632700 1 --2- 172.21.15.7:0/2460148491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed81393f0 0x7f8ed80cb5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80c9370 tx=0x7f8ec8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bea2222812635d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f842fd26700 1 -- start start 2023-10-14T19:03:16.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f0ef4191700 1 -- start start 2023-10-14T19:03:16.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.465+0000 7f5fd39fd700 1 -- start start 2023-10-14T19:03:16.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edce31700 1 -- 172.21.15.7:0/2460148491 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800b760 con 0x7f8ed81393f0 2023-10-14T19:03:16.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edce31700 1 -- 172.21.15.7:0/2460148491 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800b8c0 con 0x7f8ed81393f0 2023-10-14T19:03:16.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f8edce31700 1 -- 172.21.15.7:0/2460148491 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800bc80 con 0x7f8ed81393f0 2023-10-14T19:03:16.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f929e50f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9298159850 0x7f92980adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f929e50f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f92980b1040 0x7f92980ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f929e50f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980adb20 con 0x7f9298159c20 2023-10-14T19:03:16.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f929e50f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980acd30 con 0x7f92980b1040 2023-10-14T19:03:16.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f929e50f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980ccdc0 con 0x7f9298159850 2023-10-14T19:03:16.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f9297fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9298159850 0x7f92980adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f9297fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9298159850 0x7f92980adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59338/0 (socket says 172.21.15.7:59338) 2023-10-14T19:03:16.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f92977fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9298159c20 0x7f92980b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45638/0 (socket says 172.21.15.7:45638) 2023-10-14T19:03:16.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f9297fff700 1 -- 172.21.15.7:0/1054165221 learned_addr learned my addr 172.21.15.7:0/1054165221 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f929caac700 1 --2- 172.21.15.7:0/1054165221 >> v2:172.21.15.7:3300/0 conn(0x7f92980b1040 0x7f92980ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7ff7eaa26700 1 -- 172.21.15.7:0/3864085674 shutdown_connections 2023-10-14T19:03:16.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842fd26700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84280cb8e0 0x7f84280cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842fd26700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428156c00 con 0x7f84280accd0 2023-10-14T19:03:16.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842fd26700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280abd50 con 0x7f84280ac830 2023-10-14T19:03:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842fd26700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280b20a0 con 0x7f84280cb8e0 2023-10-14T19:03:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f9297fff700 1 -- 172.21.15.7:0/1054165221 >> v2:172.21.15.7:3300/0 conn(0x7f92980b1040 msgr2=0x7f92980ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f9297fff700 1 --2- 172.21.15.7:0/1054165221 >> v2:172.21.15.7:3300/0 conn(0x7f92980b1040 0x7f92980ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f9297fff700 1 -- 172.21.15.7:0/1054165221 >> v1:172.21.15.148:6789/0 conn(0x7f9298159c20 legacy=0x7f92980b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f9297fff700 1 -- 172.21.15.7:0/1054165221 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980acf10 con 0x7f9298159850 2023-10-14T19:03:16.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f929caac700 1 --2- 172.21.15.7:0/1054165221 >> v2:172.21.15.7:3300/0 conn(0x7f92980b1040 0x7f92980ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:16.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842d2c1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f84280ac830 0x7f842806e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45654/0 (socket says 172.21.15.7:45654) 2023-10-14T19:03:16.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842d2c1700 1 -- 172.21.15.7:0/1994947647 learned_addr learned my addr 172.21.15.7:0/1994947647 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f9297fff700 1 --2- 172.21.15.7:0/1054165221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298159850 0x7f92980adfb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9298069620 tx=0x7f9290009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=727ef02d8d9a7357 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd39fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5fcc0cb720 0x7f5fcc0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd39fd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc0acf40 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd39fd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc0abd50 con 0x7f5fcc06bc20 2023-10-14T19:03:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd39fd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc0cc100 con 0x7f5fcc0cb720 2023-10-14T19:03:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd0f98700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5fcc0cb720 0x7f5fcc0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd0f98700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5fcc0cb720 0x7f5fcc0cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59348/0 (socket says 172.21.15.7:59348) 2023-10-14T19:03:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f5fd0f98700 1 -- 172.21.15.7:0/4211041422 learned_addr learned my addr 172.21.15.7:0/4211041422 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f0ef4191700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0eec15dad0 0x7f0eec06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f0ef4191700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0eec0cac10 0x7f0eec0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f9296ffd700 1 -- 172.21.15.7:0/1054165221 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000e070 con 0x7f9298159850 2023-10-14T19:03:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864351232 0 0) 0x7f8428156c00 con 0x7f84280accd0 2023-10-14T19:03:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8414003570 con 0x7f84280accd0 2023-10-14T19:03:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f842dac2700 1 --2- 172.21.15.7:0/1994947647 >> v2:172.21.15.7:3300/0 conn(0x7f84280cb8e0 0x7f84280cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f0ef4191700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec06b230 con 0x7f0eec15dea0 2023-10-14T19:03:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f0ef4191700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec06a620 con 0x7f0eec0cac10 2023-10-14T19:03:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7f0ef4191700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec06a900 con 0x7f0eec15dad0 2023-10-14T19:03:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002754049 0 0) 0x7f8414003570 con 0x7f84280accd0 2023-10-14T19:03:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 >> v2:172.21.15.7:3300/0 conn(0x7f84280cb8e0 msgr2=0x7f84280cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 --2- 172.21.15.7:0/1994947647 >> v2:172.21.15.7:3300/0 conn(0x7f84280cb8e0 0x7f84280cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 >> v1:172.21.15.148:6789/0 conn(0x7f84280ac830 legacy=0x7f842806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280ac030 con 0x7f84280accd0 2023-10-14T19:03:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f84240013a0 con 0x7f84280accd0 2023-10-14T19:03:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef172c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0eec15dea0 0x7f0eec0ca500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45670/0 (socket says 172.21.15.7:45670) 2023-10-14T19:03:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef172c700 1 -- 172.21.15.7:0/806151894 learned_addr learned my addr 172.21.15.7:0/806151894 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.466+0000 7f927af54700 1 -- start start 2023-10-14T19:03:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f927af54700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f927415da20 0x7f92740ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f927af54700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f927406edf0 0x7f92740cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef272e700 1 --2- 172.21.15.7:0/806151894 >> v2:172.21.15.7:3300/0 conn(0x7f0eec0cac10 0x7f0eec0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f927af54700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740c9d20 con 0x7f927406c6a0 2023-10-14T19:03:16.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f927af54700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9274162790 con 0x7f927415da20 2023-10-14T19:03:16.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f927af54700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92741618a0 con 0x7f927406edf0 2023-10-14T19:03:16.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 >> v1:172.21.15.7:6789/0 conn(0x7f84280accd0 legacy=0x7f84280ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414003b30 0x7f8414003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8414004810 0x7f8414004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84140052e0 0x7f8414010070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84140105b0 con 0x7f8414003b30 2023-10-14T19:03:16.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84140106f0 con 0x7f84140052e0 2023-10-14T19:03:16.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841400bc60 con 0x7f8414004810 2023-10-14T19:03:16.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef1f2d700 1 --2- 172.21.15.7:0/806151894 >> v2:172.21.15.148:3300/0 conn(0x7f0eec15dad0 0x7f0eec06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef272e700 1 -- 172.21.15.7:0/806151894 >> v2:172.21.15.148:3300/0 conn(0x7f0eec15dad0 msgr2=0x7f0eec06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef272e700 1 --2- 172.21.15.7:0/806151894 >> v2:172.21.15.148:3300/0 conn(0x7f0eec15dad0 0x7f0eec06f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef272e700 1 -- 172.21.15.7:0/806151894 >> v1:172.21.15.148:6789/0 conn(0x7f0eec15dea0 legacy=0x7f0eec0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f0ef272e700 1 -- 172.21.15.7:0/806151894 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec06abe0 con 0x7f0eec0cac10 2023-10-14T19:03:16.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842dac2700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414003b30 0x7f8414003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f8ee0097700 1 -- 172.21.15.7:0/2460148491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed81393f0 msgr2=0x7f8ed80cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f8ee0097700 1 --2- 172.21.15.7:0/2460148491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed81393f0 0x7f8ed80cb5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80c9370 tx=0x7f8ec8009250 comp rx=0 tx=0).stop 2023-10-14T19:03:16.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f842d2c1700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8414004810 0x7f8414004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f5fd0f98700 1 -- 172.21.15.7:0/4211041422 >> v1:172.21.15.148:6789/0 conn(0x7f5fcc06bc20 legacy=0x7f5fcc0ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f5fd0f98700 1 -- 172.21.15.7:0/4211041422 >> v1:172.21.15.7:6789/0 conn(0x7f5fcc06e3f0 legacy=0x7f5fcc0ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f5fd0f98700 1 -- 172.21.15.7:0/4211041422 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0ac030 con 0x7f5fcc0cb720 2023-10-14T19:03:16.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f8ee0097700 1 -- 172.21.15.7:0/2460148491 shutdown_connections 2023-10-14T19:03:16.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f8ee0097700 1 --2- 172.21.15.7:0/2460148491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed81393f0 0x7f8ed80cb5e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f8ee0097700 1 -- 172.21.15.7:0/2460148491 >> 172.21.15.7:0/2460148491 conn(0x7f8ed80ccb60 msgr2=0x7f8ed80ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f92794f1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f927406c6a0 0x7f927406ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45680/0 (socket says 172.21.15.7:45680) 2023-10-14T19:03:16.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f92794f1700 1 -- 172.21.15.7:0/786730459 learned_addr learned my addr 172.21.15.7:0/786730459 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f9273fff700 1 --2- 172.21.15.7:0/786730459 >> v2:172.21.15.148:3300/0 conn(0x7f927406edf0 0x7f92740cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f0ef272e700 1 --2- 172.21.15.7:0/806151894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec0cac10 0x7f0eec0c6d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80098e0 tx=0x7f0ee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f74de1885949fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f5fd0f98700 1 --2- 172.21.15.7:0/4211041422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc0cb720 0x7f5fcc0cbbc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0131e0 tx=0x7f5fbc011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=551e6d262ca79e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842dac2700 1 -- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8414004810 msgr2=0x7f8414004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842dac2700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8414004810 0x7f8414004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842dac2700 1 -- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84140052e0 msgr2=0x7f8414010070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:03:16.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842dac2700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84140052e0 0x7f8414010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842dac2700 1 -- 172.21.15.7:0/1994947647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280ac030 con 0x7f8414003b30 2023-10-14T19:03:16.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.467+0000 7ff7eaa26700 1 -- 172.21.15.7:0/3864085674 wait complete. 2023-10-14T19:03:16.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f8ee0097700 1 -- 172.21.15.7:0/2460148491 shutdown_connections 2023-10-14T19:03:16.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7ff7eaa26700 1 Processor -- start 2023-10-14T19:03:16.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f9296ffd700 1 -- 172.21.15.7:0/1054165221 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000ba10 con 0x7f9298159850 2023-10-14T19:03:16.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.468+0000 7f9296ffd700 1 -- 172.21.15.7:0/1054165221 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900092e0 con 0x7f9298159850 2023-10-14T19:03:16.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f929e50f700 1 -- 172.21.15.7:0/1054165221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298159850 msgr2=0x7f92980adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f929e50f700 1 --2- 172.21.15.7:0/1054165221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298159850 0x7f92980adfb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9298069620 tx=0x7f9290009840 comp rx=0 tx=0).stop 2023-10-14T19:03:16.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842dac2700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414003b30 0x7f8414003f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84200075c0 tx=0x7f8420009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a004e764c3ec515 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7ff7eaa26700 1 -- start start 2023-10-14T19:03:16.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f5fc3fff700 1 -- 172.21.15.7:0/4211041422 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc016070 con 0x7f5fcc0cb720 2023-10-14T19:03:16.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f5fc3fff700 1 -- 172.21.15.7:0/4211041422 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc013e80 con 0x7f5fcc0cb720 2023-10-14T19:03:16.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f5fc3fff700 1 -- 172.21.15.7:0/4211041422 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0112e0 con 0x7f5fcc0cb720 2023-10-14T19:03:16.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420009bb0 con 0x7f8414003b30 2023-10-14T19:03:16.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420013460 con 0x7f8414003b30 2023-10-14T19:03:16.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f842cac0700 1 -- 172.21.15.7:0/1994947647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200135f0 con 0x7f8414003b30 2023-10-14T19:03:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f929e50f700 1 -- 172.21.15.7:0/1054165221 shutdown_connections 2023-10-14T19:03:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f929e50f700 1 --2- 172.21.15.7:0/1054165221 >> v2:172.21.15.7:3300/0 conn(0x7f92980b1040 0x7f92980ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f929e50f700 1 --2- 172.21.15.7:0/1054165221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298159850 0x7f92980adfb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f929e50f700 1 -- 172.21.15.7:0/1054165221 >> 172.21.15.7:0/1054165221 conn(0x7f929806d170 msgr2=0x7f92980cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f0ef0f2b700 1 -- 172.21.15.7:0/806151894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8009e80 con 0x7f0eec0cac10 2023-10-14T19:03:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f0ef0f2b700 1 -- 172.21.15.7:0/806151894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800b820 con 0x7f0eec0cac10 2023-10-14T19:03:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f0ef0f2b700 1 -- 172.21.15.7:0/806151894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800bba0 con 0x7f0eec0cac10 2023-10-14T19:03:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f0ef4191700 1 -- 172.21.15.7:0/806151894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec0cac10 msgr2=0x7f0eec0c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f0ef4191700 1 --2- 172.21.15.7:0/806151894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec0cac10 0x7f0eec0c6d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80098e0 tx=0x7f0ee80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f0ef4191700 1 -- 172.21.15.7:0/806151894 shutdown_connections 2023-10-14T19:03:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f0ef4191700 1 --2- 172.21.15.7:0/806151894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec0cac10 0x7f0eec0c6d60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f0ef4191700 1 --2- 172.21.15.7:0/806151894 >> v2:172.21.15.148:3300/0 conn(0x7f0eec15dad0 0x7f0eec06f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f0ef4191700 1 -- 172.21.15.7:0/806151894 >> 172.21.15.7:0/806151894 conn(0x7f0eec0cc720 msgr2=0x7f0eec0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7eaa26700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 0x7ff7e41819a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7eaa26700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40b1880 0x7ff7e4188360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7eaa26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7e40cb9e0 0x7ff7e40a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7eaa26700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40a6da0 con 0x7ff7e40b1880 2023-10-14T19:03:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7eaa26700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e41888a0 con 0x7ff7e40cb9e0 2023-10-14T19:03:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7eaa26700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40a6190 con 0x7ff7e40afb30 2023-10-14T19:03:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7e3fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 0x7ff7e41819a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7e3fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 0x7ff7e41819a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38898/0 (socket says 172.21.15.7:38898) 2023-10-14T19:03:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7e3fff700 1 -- 172.21.15.7:0/340054465 learned_addr learned my addr 172.21.15.7:0/340054465 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f842fd26700 1 -- 172.21.15.7:0/1994947647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414003b30 msgr2=0x7f8414003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f842fd26700 1 --2- 172.21.15.7:0/1994947647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414003b30 0x7f8414003f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84200075c0 tx=0x7f8420009780 comp rx=0 tx=0).stop 2023-10-14T19:03:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f5fd39fd700 1 -- 172.21.15.7:0/4211041422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc0cb720 msgr2=0x7f5fcc0cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/4211041422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc0cb720 0x7f5fcc0cbbc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0131e0 tx=0x7f5fbc011af0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f5fd39fd700 1 -- 172.21.15.7:0/4211041422 shutdown_connections 2023-10-14T19:03:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/4211041422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc0cb720 0x7f5fcc0cbbc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f5fd39fd700 1 -- 172.21.15.7:0/4211041422 >> 172.21.15.7:0/4211041422 conn(0x7f5fcc0cc300 msgr2=0x7f5fcc0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f9273fff700 1 -- 172.21.15.7:0/786730459 >> v2:172.21.15.7:3300/0 conn(0x7f927415da20 msgr2=0x7f92740ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f9273fff700 1 --2- 172.21.15.7:0/786730459 >> v2:172.21.15.7:3300/0 conn(0x7f927415da20 0x7f92740ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f9273fff700 1 -- 172.21.15.7:0/786730459 >> v1:172.21.15.148:6789/0 conn(0x7f927406c6a0 legacy=0x7f927406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7f9273fff700 1 -- 172.21.15.7:0/786730459 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274161b80 con 0x7f927406edf0 2023-10-14T19:03:16.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7e37fe700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40b1880 0x7ff7e4188360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7e8fc3700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7e40cb9e0 0x7ff7e40a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.470+0000 7ff7e3fff700 1 -- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7e40cb9e0 msgr2=0x7ff7e40a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7ff7e3fff700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7e40cb9e0 0x7ff7e40a7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7ff7e3fff700 1 -- 172.21.15.7:0/340054465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40b1880 msgr2=0x7ff7e4188360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7ff7e3fff700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40b1880 0x7ff7e4188360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7ff7e3fff700 1 -- 172.21.15.7:0/340054465 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8009cb0 con 0x7ff7e40afb30 2023-10-14T19:03:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.469+0000 7f8ee0097700 1 -- 172.21.15.7:0/2460148491 wait complete. 2023-10-14T19:03:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f9273fff700 1 --2- 172.21.15.7:0/786730459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406edf0 0x7f92740cab00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f927406ad10 tx=0x7f926c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cd2285ddf849b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f5fd39fd700 1 -- 172.21.15.7:0/4211041422 shutdown_connections 2023-10-14T19:03:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f929e50f700 1 -- 172.21.15.7:0/1054165221 shutdown_connections 2023-10-14T19:03:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f8ee0097700 1 Processor -- start 2023-10-14T19:03:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f929e50f700 1 -- 172.21.15.7:0/1054165221 wait complete. 2023-10-14T19:03:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f5fd39fd700 1 -- 172.21.15.7:0/4211041422 wait complete. 2023-10-14T19:03:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f92737fe700 1 -- 172.21.15.7:0/786730459 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00e070 con 0x7f927406edf0 2023-10-14T19:03:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f0ef4191700 1 -- 172.21.15.7:0/806151894 shutdown_connections 2023-10-14T19:03:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f92737fe700 1 -- 172.21.15.7:0/786730459 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c00bc30 con 0x7f927406edf0 2023-10-14T19:03:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f92737fe700 1 -- 172.21.15.7:0/786730459 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c012430 con 0x7f927406edf0 2023-10-14T19:03:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f0ef4191700 1 -- 172.21.15.7:0/806151894 wait complete. 2023-10-14T19:03:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 -- 172.21.15.7:0/786730459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406edf0 msgr2=0x7f92740cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 --2- 172.21.15.7:0/786730459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406edf0 0x7f92740cab00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f927406ad10 tx=0x7f926c009780 comp rx=0 tx=0).stop 2023-10-14T19:03:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.471+0000 7f8ee0097700 1 -- start start 2023-10-14T19:03:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8ee0097700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed80cbb20 0x7f8ed8123c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8ee0097700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed8138bc0 0x7f8ed8129690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8ee0097700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ed81393f0 0x7f8ed8129bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8ee0097700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c6d00 con 0x7f8ed8138bc0 2023-10-14T19:03:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8ee0097700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c72f0 con 0x7f8ed80cbb20 2023-10-14T19:03:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8ee0097700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c6080 con 0x7f8ed81393f0 2023-10-14T19:03:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 -- 172.21.15.7:0/786730459 shutdown_connections 2023-10-14T19:03:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 --2- 172.21.15.7:0/786730459 >> v2:172.21.15.7:3300/0 conn(0x7f927415da20 0x7f92740ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 --2- 172.21.15.7:0/786730459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406edf0 0x7f92740cab00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 -- 172.21.15.7:0/786730459 >> 172.21.15.7:0/786730459 conn(0x7f92740cde90 msgr2=0x7f92740c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7ff7e3fff700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 0x7ff7e41819a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800b990 tx=0x7ff7d8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f0ef4191700 1 Processor -- start 2023-10-14T19:03:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8edd632700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed8138bc0 0x7f8ed8129690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8edd632700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed8138bc0 0x7f8ed8129690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37462/0 (socket says 172.21.15.7:37462) 2023-10-14T19:03:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8edd632700 1 -- 172.21.15.7:0/4129318648 learned_addr learned my addr 172.21.15.7:0/4129318648 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f8edde33700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed80cbb20 0x7f8ed8123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f0ef4191700 1 -- start start 2023-10-14T19:03:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f842e2c3700 1 -- 172.21.15.7:0/1994947647 reap_dead start 2023-10-14T19:03:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f842e2c3700 1 -- 172.21.15.7:0/1994947647 reap_dead start 2023-10-14T19:03:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f842fd26700 1 -- 172.21.15.7:0/1994947647 shutdown_connections 2023-10-14T19:03:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f842fd26700 1 -- 172.21.15.7:0/1994947647 >> 172.21.15.7:0/1994947647 conn(0x7f84280cc300 msgr2=0x7f84280cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f929e50f700 1 Processor -- start 2023-10-14T19:03:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f5fd39fd700 1 Processor -- start 2023-10-14T19:03:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8edde33700 1 -- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ed81393f0 msgr2=0x7f8ed8129bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8edde33700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ed81393f0 0x7f8ed8129bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8edde33700 1 -- 172.21.15.7:0/4129318648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed8138bc0 msgr2=0x7f8ed8129690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8edde33700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed8138bc0 0x7f8ed8129690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8edde33700 1 -- 172.21.15.7:0/4129318648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80094f0 con 0x7f8ed80cbb20 2023-10-14T19:03:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 -- 172.21.15.7:0/786730459 shutdown_connections 2023-10-14T19:03:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7f927af54700 1 -- 172.21.15.7:0/786730459 wait complete. 2023-10-14T19:03:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8edde33700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed80cbb20 0x7f8ed8123c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c810 tx=0x7f8ed4007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4011590 con 0x7f8ed80cbb20 2023-10-14T19:03:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed4011710 con 0x7f8ed80cbb20 2023-10-14T19:03:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4011ad0 con 0x7f8ed80cbb20 2023-10-14T19:03:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8011960 con 0x7ff7e40afb30 2023-10-14T19:03:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d8020070 con 0x7ff7e40afb30 2023-10-14T19:03:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.472+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8011d10 con 0x7ff7e40afb30 2023-10-14T19:03:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f0ef4191700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0eec0cac10 0x7f0eec15e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f0ef4191700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0eec15dad0 0x7f0eec15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f0ef4191700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec15dea0 0x7f0eec15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f0ef4191700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec16d870 con 0x7f0eec15dea0 2023-10-14T19:03:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f0ef4191700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0c6960 con 0x7f0eec0cac10 2023-10-14T19:03:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f0ef4191700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0c6c40 con 0x7f0eec15dad0 2023-10-14T19:03:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e40a6470 con 0x7ff7e40afb30 2023-10-14T19:03:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e40a6a30 con 0x7ff7e40afb30 2023-10-14T19:03:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80c6360 con 0x7f8ed80cbb20 2023-10-14T19:03:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80c6920 con 0x7f8ed80cbb20 2023-10-14T19:03:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f927af54700 1 Processor -- start 2023-10-14T19:03:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f0ef1f2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0eec0cac10 0x7f0eec15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f0ef272e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec15dea0 0x7f0eec15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f0ef272e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec15dea0 0x7f0eec15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37464/0 (socket says 172.21.15.7:37464) 2023-10-14T19:03:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f0ef272e700 1 -- 172.21.15.7:0/372149266 learned_addr learned my addr 172.21.15.7:0/372149266 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f0ef172c700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0eec15dad0 0x7f0eec15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f5fd39fd700 1 -- start start 2023-10-14T19:03:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f5fd39fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc06bc20 0x7f5fcc166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f5fd39fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fcc06e3f0 0x7f5fcc153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f5fd39fd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fcc0cb720 0x7f5fcc0c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f5fd39fd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0c17f0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f5fd39fd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0c15e0 con 0x7f5fcc06bc20 2023-10-14T19:03:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f5fd39fd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1673d0 con 0x7f5fcc0cb720 2023-10-14T19:03:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f5fd1799700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc06bc20 0x7f5fcc166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f5fd1799700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc06bc20 0x7f5fcc166260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59426/0 (socket says 172.21.15.7:59426) 2023-10-14T19:03:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f5fd1799700 1 -- 172.21.15.7:0/3059132534 learned_addr learned my addr 172.21.15.7:0/3059132534 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.473+0000 7f929e50f700 1 -- start start 2023-10-14T19:03:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f929e50f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 0x7f929816ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f929e50f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298159850 0x7f92980a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f929e50f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298159c20 0x7f92980a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f929e50f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980a69c0 con 0x7f9298159c20 2023-10-14T19:03:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f929e50f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980a5db0 con 0x7f92980b1040 2023-10-14T19:03:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f929e50f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980a6090 con 0x7f9298159850 2023-10-14T19:03:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f9297fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 0x7f929816ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f9297fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 0x7f929816ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59414/0 (socket says 172.21.15.7:59414) 2023-10-14T19:03:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f9297fff700 1 -- 172.21.15.7:0/3226861244 learned_addr learned my addr 172.21.15.7:0/3226861244 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.474+0000 7f92977fe700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298159850 0x7f92980a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f9297fff700 1 -- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298159850 msgr2=0x7f92980a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f9297fff700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298159850 0x7f92980a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f9297fff700 1 -- 172.21.15.7:0/3226861244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298159c20 msgr2=0x7f92980a7880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T19:03:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f9297fff700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298159c20 0x7f92980a7880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f9297fff700 1 -- 172.21.15.7:0/3226861244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009ae0 con 0x7f92980b1040 2023-10-14T19:03:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f842fd26700 1 -- 172.21.15.7:0/1994947647 shutdown_connections 2023-10-14T19:03:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f5fd0f98700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fcc06e3f0 0x7f5fcc153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed804c3c0 con 0x7f8ed80cbb20 2023-10-14T19:03:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f0ef172c700 1 -- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0eec0cac10 msgr2=0x7f0eec15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f0ef172c700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0eec0cac10 0x7f0eec15e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f0ef172c700 1 -- 172.21.15.7:0/372149266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec15dea0 msgr2=0x7f0eec15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f0ef172c700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec15dea0 0x7f0eec15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f0ef172c700 1 -- 172.21.15.7:0/372149266 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009420 con 0x7f0eec15dad0 2023-10-14T19:03:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f5fd0f98700 1 -- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fcc0cb720 msgr2=0x7f5fcc0c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f0ef172c700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0eec15dad0 0x7f0eec15b570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00c490 tx=0x7f0edc007ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00ce90 con 0x7f0eec15dad0 2023-10-14T19:03:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc005b30 con 0x7f0eec15dad0 2023-10-14T19:03:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec15fe00 con 0x7f0eec15dad0 2023-10-14T19:03:16.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0070d0 con 0x7f0eec15dad0 2023-10-14T19:03:16.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f927af54700 1 -- start start 2023-10-14T19:03:16.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ed401b3b0 con 0x7f8ed80cbb20 2023-10-14T19:03:16.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f927af54700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406c6a0 0x7f9274148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f927af54700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927406edf0 0x7f9274144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f927af54700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 0x7f927415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f927af54700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927415f100 con 0x7f927415da20 2023-10-14T19:03:16.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f927af54700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274143650 con 0x7f927406c6a0 2023-10-14T19:03:16.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f927af54700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927413fa90 con 0x7f927406edf0 2023-10-14T19:03:16.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec15ecc0 con 0x7f0eec15dad0 2023-10-14T19:03:16.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f92794f1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 0x7f927415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f9278cf0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406c6a0 0x7f9274148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f92794f1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 0x7f927415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37480/0 (socket says 172.21.15.7:37480) 2023-10-14T19:03:16.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f92794f1700 1 -- 172.21.15.7:0/3000653481 learned_addr learned my addr 172.21.15.7:0/3000653481 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7f9273fff700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927406edf0 0x7f9274144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f92794f1700 1 -- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927406edf0 msgr2=0x7f9274144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f92794f1700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927406edf0 0x7f9274144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f92794f1700 1 -- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406c6a0 msgr2=0x7f9274148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f92794f1700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406c6a0 0x7f9274148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f92794f1700 1 -- 172.21.15.7:0/3000653481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c009a20 con 0x7f927415da20 2023-10-14T19:03:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f9278cf0700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406c6a0 0x7f9274148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f842fd26700 1 -- 172.21.15.7:0/1994947647 wait complete. 2023-10-14T19:03:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f9297fff700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 0x7f929816ec50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9290009fd0 tx=0x7f9290017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f92794f1700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 0x7f927415ddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f926800c560 tx=0x7f9268007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f842fd26700 1 Processor -- start 2023-10-14T19:03:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f842fd26700 1 -- start start 2023-10-14T19:03:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268005b30 con 0x7f927415da20 2023-10-14T19:03:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268005c90 con 0x7f927415da20 2023-10-14T19:03:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680072e0 con 0x7f927415da20 2023-10-14T19:03:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900129a0 con 0x7f92980b1040 2023-10-14T19:03:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290012b00 con 0x7f92980b1040 2023-10-14T19:03:16.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927415e4f0 con 0x7f927415da20 2023-10-14T19:03:16.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f8ecdffb700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ebc066f30 0x7f8ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ed4083a80 con 0x7f8ed80cbb20 2023-10-14T19:03:16.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927415eab0 con 0x7f927415da20 2023-10-14T19:03:16.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec0c6dd0 con 0x7f0eec15dad0 2023-10-14T19:03:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290012ea0 con 0x7f92980b1040 2023-10-14T19:03:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980a6370 con 0x7f92980b1040 2023-10-14T19:03:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929816f190 con 0x7f92980b1040 2023-10-14T19:03:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7f5fd1f9a700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fcc0cb720 0x7f5fcc0c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f5fd0f98700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fcc0cb720 0x7f5fcc0c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f5fd0f98700 1 -- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc06bc20 msgr2=0x7f5fcc166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f5fd0f98700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc06bc20 0x7f5fcc166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f5fd0f98700 1 -- 172.21.15.7:0/3059132534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc011d90 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f5fd1f9a700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fcc0cb720 0x7f5fcc0c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f5fd0f98700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fcc06e3f0 0x7f5fcc153ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0b23d0 tx=0x7f5fbc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.475+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e406f490 con 0x7ff7e40afb30 2023-10-14T19:03:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7d8022030 con 0x7ff7e40afb30 2023-10-14T19:03:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.476+0000 7ff7cbfff700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7d0067080 0x7ff7d0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7d8085f50 con 0x7ff7e40afb30 2023-10-14T19:03:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.477+0000 7ff7e37fe700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7d0067080 0x7ff7d0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7ff7e37fe700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7d0067080 0x7ff7d0069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4185520 tx=0x7ff7d40019d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842fd26700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f842814eb20 0x7f8428154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842fd26700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 0x7f84280a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842fd26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84280a6d60 0x7f84280a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842fd26700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8428152fb0 con 0x7f842814f1f0 2023-10-14T19:03:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842fd26700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8428151fa0 con 0x7f84280a6d60 2023-10-14T19:03:16.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842fd26700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84280a71d0 con 0x7f842814eb20 2023-10-14T19:03:16.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f8edd632700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ebc066f30 0x7f8ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927415f270 con 0x7f927415da20 2023-10-14T19:03:16.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842d2c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 0x7f84280a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842d2c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 0x7f84280a6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37494/0 (socket says 172.21.15.7:37494) 2023-10-14T19:03:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842d2c1700 1 -- 172.21.15.7:0/134105569 learned_addr learned my addr 172.21.15.7:0/134105569 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842e2c3700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84280a6d60 0x7f84280a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.478+0000 7f842dac2700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f842814eb20 0x7f8428154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842d2c1700 1 -- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f842814eb20 msgr2=0x7f8428154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842d2c1700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f842814eb20 0x7f8428154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842d2c1700 1 -- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84280a6d60 msgr2=0x7f84280a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842d2c1700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84280a6d60 0x7f84280a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842d2c1700 1 -- 172.21.15.7:0/134105569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84281521f0 con 0x7f842814f1f0 2023-10-14T19:03:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842d2c1700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 0x7f84280a6820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f841800fa70 tx=0x7f84180050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f8edd632700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ebc066f30 0x7f8ebc0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8157810 tx=0x7f8ec8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800b900 con 0x7f842814f1f0 2023-10-14T19:03:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841800ba60 con 0x7f842814f1f0 2023-10-14T19:03:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84281524d0 con 0x7f842814f1f0 2023-10-14T19:03:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800be00 con 0x7f842814f1f0 2023-10-14T19:03:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929804c3c0 con 0x7f92980b1040 2023-10-14T19:03:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0112e0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc023410 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0237b0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc166aa0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc167060 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.480+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac0052b0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.480+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8428152a90 con 0x7f842814f1f0 2023-10-14T19:03:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.481+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8418011650 con 0x7f842814f1f0 2023-10-14T19:03:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.481+0000 7f7e23a7b700 1 Processor -- start 2023-10-14T19:03:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.479+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9268007690 con 0x7f927415da20 2023-10-14T19:03:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.480+0000 7f9270ff9700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9260066f60 0x7f9260069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.480+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9268083730 con 0x7f927415da20 2023-10-14T19:03:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.480+0000 7f9278cf0700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9260066f60 0x7f9260069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.481+0000 7f9278cf0700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9260066f60 0x7f9260069410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9264009b10 tx=0x7f9264008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.482+0000 7f841dffb700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f840c066f00 0x7f840c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.482+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8428152cb0 con 0x7f842814f1f0 2023-10-14T19:03:16.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.482+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7d80531a0 con 0x7ff7e40afb30 2023-10-14T19:03:16.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.482+0000 7f7e23a7b700 1 -- start start 2023-10-14T19:03:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0edc007480 con 0x7f0eec15dad0 2023-10-14T19:03:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e23a7b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f842dac2700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f840c066f00 0x7f840c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e23a7b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c158c80 con 0x7f7e1c150c90 2023-10-14T19:03:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e23a7b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c158f60 con 0x7f7e1c15a7d0 2023-10-14T19:03:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e23a7b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c15afc0 con 0x7f7e1c1508c0 2023-10-14T19:03:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e21016700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7e1c150c90 0x7f7e1c15a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47476/0 (socket says 172.21.15.7:47476) 2023-10-14T19:03:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e21016700 1 -- 172.21.15.7:0/1720806236 learned_addr learned my addr 172.21.15.7:0/1720806236 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e21817700 1 --2- 172.21.15.7:0/1720806236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f0ee1ffb700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0edc083bc0 con 0x7f0eec15dad0 2023-10-14T19:03:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f0ef1f2d700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f842dac2700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f840c066f00 0x7f840c0693b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84200097c0 tx=0x7f8420018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e21817700 1 -- 172.21.15.7:0/1720806236 >> v1:172.21.15.148:6789/0 conn(0x7f7e1c15a7d0 legacy=0x7f7e1c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e21817700 1 -- 172.21.15.7:0/1720806236 >> v1:172.21.15.7:6789/0 conn(0x7f7e1c150c90 legacy=0x7f7e1c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f7e21817700 1 -- 172.21.15.7:0/1720806236 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c159240 con 0x7f7e1c1508c0 2023-10-14T19:03:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.484+0000 7f7e21817700 1 --2- 172.21.15.7:0/1720806236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c158650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009910 tx=0x7f7e180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3819c14768fa40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.484+0000 7f0ef1f2d700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ed0066f30 0x7f0ed00693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0af2c0 tx=0x7f0ee4007710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.483+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ed4050cf0 con 0x7f8ed80cbb20 2023-10-14T19:03:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.485+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f929001d630 con 0x7f92980b1040 2023-10-14T19:03:16.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.485+0000 7f927ffff700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.485+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9290086030 con 0x7f92980b1040 2023-10-14T19:03:16.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.485+0000 7f92977fe700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.486+0000 7f92977fe700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f929814fe50 tx=0x7f9288008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.486+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f926804b5a0 con 0x7f927415da20 2023-10-14T19:03:16.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.486+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8418007040 con 0x7f842814f1f0 2023-10-14T19:03:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.487+0000 7f7e20815700 1 -- 172.21.15.7:0/1720806236 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800b860 con 0x7f7e1c1508c0 2023-10-14T19:03:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.487+0000 7f7e20815700 1 -- 172.21.15.7:0/1720806236 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800b9c0 con 0x7f7e1c1508c0 2023-10-14T19:03:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.487+0000 7f7e20815700 1 -- 172.21.15.7:0/1720806236 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800bd60 con 0x7f7e1c1508c0 2023-10-14T19:03:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.487+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fbc02b3d0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.487+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0edc050eb0 con 0x7f0eec15dad0 2023-10-14T19:03:16.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.488+0000 7f5fc17fa700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5fb0067030 0x7f5fb00694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.488+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fbc0857e0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.488+0000 7f5fd1799700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5fb0067030 0x7f5fb00694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.488+0000 7f5fd1799700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5fb0067030 0x7f5fb00694e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8003a80 tx=0x7f5fc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.490+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9290053320 con 0x7f92980b1040 2023-10-14T19:03:16.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.490+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1720806236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 msgr2=0x7f7e1c158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.490+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1720806236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c158650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009910 tx=0x7f7e180091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.491+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1720806236 shutdown_connections 2023-10-14T19:03:16.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.491+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1720806236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c158650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.491+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1720806236 >> 172.21.15.7:0/1720806236 conn(0x7f7e1c0cded0 msgr2=0x7f7e1c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.491+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1720806236 shutdown_connections 2023-10-14T19:03:16.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.491+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1720806236 wait complete. 2023-10-14T19:03:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.493+0000 7f7e23a7b700 1 Processor -- start 2023-10-14T19:03:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.493+0000 7f7e23a7b700 1 -- start start 2023-10-14T19:03:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.494+0000 7f7e23a7b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.494+0000 7f7e23a7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 0x7f7e1c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.494+0000 7f7e23a7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1c15a7d0 0x7f7e1c13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.494+0000 7f7e23a7b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c154ed0 con 0x7f7e1c150c90 2023-10-14T19:03:16.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.494+0000 7f7e23a7b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c16ac40 con 0x7f7e1c15a7d0 2023-10-14T19:03:16.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.494+0000 7f7e23a7b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c154880 con 0x7f7e1c1508c0 2023-10-14T19:03:16.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 0x7f7e1c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 0x7f7e1c13ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37500/0 (socket says 172.21.15.7:37500) 2023-10-14T19:03:16.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 -- 172.21.15.7:0/1882895929 learned_addr learned my addr 172.21.15.7:0/1882895929 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:16.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f841801e020 con 0x7f842814f1f0 2023-10-14T19:03:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 -- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 msgr2=0x7f7e1c0af530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:03:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c0af530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 -- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1c15a7d0 msgr2=0x7f7e1c13ef80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:03:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1c15a7d0 0x7f7e1c13ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.497+0000 7f7e21016700 1 -- 172.21.15.7:0/1882895929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009420 con 0x7f7e1c150c90 2023-10-14T19:03:16.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.501+0000 7f7e21016700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 0x7f7e1c13ea40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00e9d0 tx=0x7f7e0c00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.502+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fbc052bb0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.502+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c005b30 con 0x7f7e1c150c90 2023-10-14T19:03:16.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.502+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c005c90 con 0x7f7e1c150c90 2023-10-14T19:03:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.502+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c004a60 con 0x7f7e1c150c90 2023-10-14T19:03:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.502+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c154b60 con 0x7f7e1c150c90 2023-10-14T19:03:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.502+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c169fe0 con 0x7f7e1c150c90 2023-10-14T19:03:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.503+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c14d810 con 0x7f7e1c150c90 2023-10-14T19:03:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.506+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e0c0070f0 con 0x7f7e1c150c90 2023-10-14T19:03:16.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.506+0000 7f7e11ffb700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7e00066fb0 0x7f7e00069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:16.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.506+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e0c086f40 con 0x7f7e1c150c90 2023-10-14T19:03:16.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.514+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e0c0525a0 con 0x7f7e1c150c90 2023-10-14T19:03:16.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.516+0000 7f7e21817700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7e00066fb0 0x7f7e00069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:16.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.568+0000 7f7e21817700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7e00066fb0 0x7f7e00069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e180091e0 tx=0x7f7e18017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:16.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.884+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ed80c2a50 con 0x7f8ed80cbb20 2023-10-14T19:03:16.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.885+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0eec04c3c0 con 0x7f0eec15dad0 2023-10-14T19:03:16.886 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.885+0000 7f8ecdffb700 1 -- 172.21.15.7:0/4129318648 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ed4017070 con 0x7f8ed80cbb20 2023-10-14T19:03:16.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.888+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f927404c3c0 con 0x7f927415da20 2023-10-14T19:03:16.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ebc066f30 msgr2=0x7f8ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ebc066f30 0x7f8ebc0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8157810 tx=0x7f8ec8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed80cbb20 msgr2=0x7f8ed8123c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed80cbb20 0x7f8ed8123c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c810 tx=0x7f8ed4007e20 comp rx=0 tx=0).stop 2023-10-14T19:03:16.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 shutdown_connections 2023-10-14T19:03:16.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ebc066f30 0x7f8ebc0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ed80cbb20 0x7f8ed8123c70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ed81393f0 0x7f8ed8129bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 --2- 172.21.15.7:0/4129318648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed8138bc0 0x7f8ed8129690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 >> 172.21.15.7:0/4129318648 conn(0x7f8ed80ccb60 msgr2=0x7f8ed80c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 shutdown_connections 2023-10-14T19:03:16.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.889+0000 7f8ee0097700 1 -- 172.21.15.7:0/4129318648 wait complete. 2023-10-14T19:03:16.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.890+0000 7f0ee1ffb700 1 -- 172.21.15.7:0/372149266 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0edc017090 con 0x7f0eec15dad0 2023-10-14T19:03:16.894 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-10-14T19:03:16.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.890+0000 7f9270ff9700 1 -- 172.21.15.7:0/3000653481 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9268017090 con 0x7f927415da20 2023-10-14T19:03:16.895 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-10-14T19:03:16.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.897+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f92980ad1f0 con 0x7f92980b1040 2023-10-14T19:03:16.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.898+0000 7f927ffff700 1 -- 172.21.15.7:0/3226861244 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9290056940 con 0x7f92980b1040 2023-10-14T19:03:16.899 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9284066f30 msgr2=0x7f92840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f929e50f700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f929814fe50 tx=0x7f9288008040 comp rx=0 tx=0).stop 2023-10-14T19:03:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 msgr2=0x7f929816ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f929e50f700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 0x7f929816ec50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9290009fd0 tx=0x7f9290017000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ed0066f30 msgr2=0x7f0ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f0ef4191700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ed0066f30 0x7f0ed00693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0af2c0 tx=0x7f0ee4007710 comp rx=0 tx=0).stop 2023-10-14T19:03:16.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0eec15dad0 msgr2=0x7f0eec15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.901+0000 7f0ef4191700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0eec15dad0 0x7f0eec15b570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00c490 tx=0x7f0edc007ed0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9260066f60 msgr2=0x7f9260069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f927af54700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9260066f60 0x7f9260069410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9264009b10 tx=0x7f9264008040 comp rx=0 tx=0).stop 2023-10-14T19:03:16.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 msgr2=0x7f927415ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f927af54700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 0x7f927415ddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f926800c560 tx=0x7f9268007f60 comp rx=0 tx=0).stop 2023-10-14T19:03:16.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 shutdown_connections 2023-10-14T19:03:16.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f0ef4191700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f0ef4191700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0eec0cac10 0x7f0eec15e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f0ef4191700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eec15dea0 0x7f0eec15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f0ef4191700 1 --2- 172.21.15.7:0/372149266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0eec15dad0 0x7f0eec15b570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 >> 172.21.15.7:0/372149266 conn(0x7f0eec0cc720 msgr2=0x7f0eec0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 shutdown_connections 2023-10-14T19:03:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980b1040 0x7f929816ec50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298159c20 0x7f92980a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 --2- 172.21.15.7:0/3226861244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298159850 0x7f92980a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 >> 172.21.15.7:0/3226861244 conn(0x7f929806d170 msgr2=0x7f92980638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 shutdown_connections 2023-10-14T19:03:16.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.902+0000 7f929e50f700 1 -- 172.21.15.7:0/3226861244 wait complete. 2023-10-14T19:03:16.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.903+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff7e404c3c0 con 0x7ff7e40afb30 2023-10-14T19:03:16.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.903+0000 7ff7cbfff700 1 -- 172.21.15.7:0/340054465 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7d80567c0 con 0x7ff7e40afb30 2023-10-14T19:03:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.905+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 shutdown_connections 2023-10-14T19:03:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.905+0000 7f927af54700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9260066f60 0x7f9260069410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.905+0000 7f927af54700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927406c6a0 0x7f9274148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.905+0000 7f927af54700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f927415da20 0x7f927415ddf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.905+0000 7f927af54700 1 --2- 172.21.15.7:0/3000653481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927406edf0 0x7f9274144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.905+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 >> 172.21.15.7:0/3000653481 conn(0x7f92740cde90 msgr2=0x7f92741498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.913 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-10-14T19:03:16.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-14T19:03:16.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7d0067080 msgr2=0x7ff7d0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7d0067080 0x7ff7d0069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4185520 tx=0x7ff7d40019d0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 msgr2=0x7ff7e41819a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 0x7ff7e41819a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800b990 tx=0x7ff7d8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 shutdown_connections 2023-10-14T19:03:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7d0067080 0x7ff7d0069530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7e40cb9e0 0x7ff7e40a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7e40afb30 0x7ff7e41819a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 --2- 172.21.15.7:0/340054465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e40b1880 0x7ff7e4188360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 >> 172.21.15.7:0/340054465 conn(0x7ff7e40cc300 msgr2=0x7ff7e4167d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 shutdown_connections 2023-10-14T19:03:16.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.907+0000 7ff7eaa26700 1 -- 172.21.15.7:0/340054465 wait complete. 2023-10-14T19:03:16.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.909+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 shutdown_connections 2023-10-14T19:03:16.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.909+0000 7f0ef4191700 1 -- 172.21.15.7:0/372149266 wait complete. 2023-10-14T19:03:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.910+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fac005830 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.910+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 shutdown_connections 2023-10-14T19:03:16.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.911+0000 7f5fc17fa700 1 -- 172.21.15.7:0/3059132534 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fbc0561d0 con 0x7f5fcc06e3f0 2023-10-14T19:03:16.921 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-10-14T19:03:16.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.913+0000 7f927af54700 1 -- 172.21.15.7:0/3000653481 wait complete. 2023-10-14T19:03:16.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.913+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5fb0067030 msgr2=0x7f5fb00694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.913+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5fb0067030 0x7f5fb00694e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8003a80 tx=0x7f5fc8009040 comp rx=0 tx=0).stop 2023-10-14T19:03:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.913+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fcc06e3f0 msgr2=0x7f5fcc153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.913+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fcc06e3f0 0x7f5fcc153ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0b23d0 tx=0x7f5fbc01e000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 shutdown_connections 2023-10-14T19:03:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5fb0067030 0x7f5fb00694e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fcc06bc20 0x7f5fcc166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fcc0cb720 0x7f5fcc0c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f5fd39fd700 1 --2- 172.21.15.7:0/3059132534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fcc06e3f0 0x7f5fcc153ae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 >> 172.21.15.7:0/3059132534 conn(0x7f5fcc0cc300 msgr2=0x7f5fcc0cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.915+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e1c1546e0 con 0x7f7e1c150c90 2023-10-14T19:03:16.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.916+0000 7f7e11ffb700 1 -- 172.21.15.7:0/1882895929 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e0c01f020 con 0x7f7e1c150c90 2023-10-14T19:03:16.925 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.918+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 shutdown_connections 2023-10-14T19:03:16.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.919+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7e00066fb0 msgr2=0x7f7e00069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.919+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7e00066fb0 0x7f7e00069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e180091e0 tx=0x7f7e18017000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.919+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 msgr2=0x7f7e1c13ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.919+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 0x7f7e1c13ea40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00e9d0 tx=0x7f7e0c00c270 comp rx=0 tx=0).stop 2023-10-14T19:03:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 shutdown_connections 2023-10-14T19:03:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7e00066fb0 0x7f7e00069460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1c15a7d0 0x7f7e1c13ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e1c1508c0 0x7f7e1c0af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 --2- 172.21.15.7:0/1882895929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e1c150c90 0x7f7e1c13ea40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 >> 172.21.15.7:0/1882895929 conn(0x7f7e1c0cded0 msgr2=0x7f7e1c14faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 shutdown_connections 2023-10-14T19:03:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.922+0000 7f7e23a7b700 1 -- 172.21.15.7:0/1882895929 wait complete. 2023-10-14T19:03:16.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-10-14T19:03:16.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.925+0000 7f5fd39fd700 1 -- 172.21.15.7:0/3059132534 wait complete. 2023-10-14T19:03:16.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-14T19:03:16.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.930+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f842804c3c0 con 0x7f842814f1f0 2023-10-14T19:03:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.931+0000 7f841dffb700 1 -- 172.21.15.7:0/134105569 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84180517c0 con 0x7f842814f1f0 2023-10-14T19:03:16.933 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:16.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-14T19:03:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f840c066f00 msgr2=0x7f840c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f840c066f00 0x7f840c0693b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84200097c0 tx=0x7f8420018000 comp rx=0 tx=0).stop 2023-10-14T19:03:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 msgr2=0x7f84280a6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 0x7f84280a6820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f841800fa70 tx=0x7f84180050e0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 shutdown_connections 2023-10-14T19:03:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f840c066f00 0x7f840c0693b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84280a6d60 0x7f84280a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f842814eb20 0x7f8428154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 --2- 172.21.15.7:0/134105569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f842814f1f0 0x7f84280a6820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:16.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.934+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 >> 172.21.15.7:0/134105569 conn(0x7f84280cc300 msgr2=0x7f8428069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:16.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.935+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 shutdown_connections 2023-10-14T19:03:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:16.935+0000 7f842fd26700 1 -- 172.21.15.7:0/134105569 wait complete. 2023-10-14T19:03:16.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-10-14T19:03:16.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-14T19:03:16.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-14T19:03:16.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-14T19:03:17.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:17.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:17.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T19:03:17.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T19:03:17.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T19:03:17.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T19:03:17.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T19:03:17.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T19:03:17.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T19:03:17.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T19:03:18.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.112+0000 7f42ee9bf700 1 Processor -- start 2023-10-14T19:03:18.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.112+0000 7f42ee9bf700 1 -- start start 2023-10-14T19:03:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ee9bf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e80aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ee9bf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42e80b1880 0x7f42e80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ee9bf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80cbe40 con 0x7f42e80cb2d0 2023-10-14T19:03:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ee9bf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e80b2230 con 0x7f42e80b1880 2023-10-14T19:03:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ee9bf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8167a60 con 0x7f42e80afb30 2023-10-14T19:03:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ecf5c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f42e80cb2d0 0x7f42e80cb730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55092/0 (socket says 172.21.15.7:55092) 2023-10-14T19:03:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42ecf5c700 1 -- 172.21.15.7:0/2483212871 learned_addr learned my addr 172.21.15.7:0/2483212871 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.114+0000 7f42e7fff700 1 --2- 172.21.15.7:0/2483212871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e80aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.115+0000 7f42e77fe700 1 --2- 172.21.15.7:0/2483212871 >> v2:172.21.15.7:3300/0 conn(0x7f42e80b1880 0x7f42e80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.115+0000 7f42e77fe700 1 -- 172.21.15.7:0/2483212871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 msgr2=0x7f42e80aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.115+0000 7f42e77fe700 1 --2- 172.21.15.7:0/2483212871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e80aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.115+0000 7f42e77fe700 1 -- 172.21.15.7:0/2483212871 >> v1:172.21.15.148:6789/0 conn(0x7f42e80cb2d0 legacy=0x7f42e80cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.115+0000 7f42e77fe700 1 -- 172.21.15.7:0/2483212871 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8166e50 con 0x7f42e80b1880 2023-10-14T19:03:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.116+0000 7f42e77fe700 1 --2- 172.21.15.7:0/2483212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80b1880 0x7f42e80b1cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009ec0 tx=0x7f42e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9bc9a5b13abaa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.116+0000 7f42e6ffd700 1 -- 172.21.15.7:0/2483212871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000bbb0 con 0x7f42e80b1880 2023-10-14T19:03:18.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.116+0000 7f42e6ffd700 1 -- 172.21.15.7:0/2483212871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e000bd10 con 0x7f42e80b1880 2023-10-14T19:03:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.116+0000 7f42e6ffd700 1 -- 172.21.15.7:0/2483212871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e001ed80 con 0x7f42e80b1880 2023-10-14T19:03:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 -- 172.21.15.7:0/2483212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80b1880 msgr2=0x7f42e80b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/2483212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80b1880 0x7f42e80b1cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009ec0 tx=0x7f42e0009780 comp rx=0 tx=0).stop 2023-10-14T19:03:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 -- 172.21.15.7:0/2483212871 shutdown_connections 2023-10-14T19:03:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/2483212871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e80aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/2483212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80b1880 0x7f42e80b1cf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 -- 172.21.15.7:0/2483212871 >> 172.21.15.7:0/2483212871 conn(0x7f42e80cc300 msgr2=0x7f42e80cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 -- 172.21.15.7:0/2483212871 shutdown_connections 2023-10-14T19:03:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.117+0000 7f42ee9bf700 1 -- 172.21.15.7:0/2483212871 wait complete. 2023-10-14T19:03:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.119+0000 7f42ee9bf700 1 Processor -- start 2023-10-14T19:03:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.119+0000 7f42ee9bf700 1 -- start start 2023-10-14T19:03:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ee9bf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ee9bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e80b1880 0x7f42e8154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ee9bf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 0x7f42e80ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ee9bf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8154dd0 con 0x7f42e80cb2d0 2023-10-14T19:03:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ee9bf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e81550b0 con 0x7f42e80b1880 2023-10-14T19:03:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ee9bf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8155390 con 0x7f42e80afb30 2023-10-14T19:03:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ecf5c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 0x7f42e80ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ecf5c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 0x7f42e80ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38598/0 (socket says 172.21.15.7:38598) 2023-10-14T19:03:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42ecf5c700 1 -- 172.21.15.7:0/4063756270 learned_addr learned my addr 172.21.15.7:0/4063756270 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.121+0000 7f42e77fe700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e80b1880 0x7f42e8154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.122+0000 7f42ecf5c700 1 -- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 msgr2=0x7f42e8158970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:03:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.122+0000 7f42ecf5c700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e8158970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.122+0000 7f42ecf5c700 1 -- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e80b1880 msgr2=0x7f42e8154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.122+0000 7f42ecf5c700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e80b1880 0x7f42e8154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.122+0000 7f42ecf5c700 1 -- 172.21.15.7:0/4063756270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0009a20 con 0x7f42e80cb2d0 2023-10-14T19:03:18.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.122+0000 7f42ecf5c700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 0x7f42e80ab410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00b9d0 tx=0x7f42dc0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.123+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc050940 con 0x7f42e80cb2d0 2023-10-14T19:03:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.123+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00a040 con 0x7f42e80cb2d0 2023-10-14T19:03:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.123+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc050d30 con 0x7f42e80cb2d0 2023-10-14T19:03:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.123+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e8155670 con 0x7f42e80cb2d0 2023-10-14T19:03:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.123+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e8158eb0 con 0x7f42e80cb2d0 2023-10-14T19:03:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.127+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42dc056070 con 0x7f42e80cb2d0 2023-10-14T19:03:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.127+0000 7f42cffff700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f42d0067230 0x7f42d00696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.127+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42dc0c82a0 con 0x7f42e80cb2d0 2023-10-14T19:03:18.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.128+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d40052e0 con 0x7f42e80cb2d0 2023-10-14T19:03:18.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.130+0000 7f42e7fff700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f42d0067230 0x7f42d00696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.137+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42dc0954f0 con 0x7f42e80cb2d0 2023-10-14T19:03:18.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.137+0000 7f42e7fff700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f42d0067230 0x7f42d00696e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42d800bd20 tx=0x7f42d800b420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.166+0000 7f71cebe8700 1 Processor -- start 2023-10-14T19:03:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.166+0000 7f71cebe8700 1 -- start start 2023-10-14T19:03:18.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.167+0000 7f71cebe8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71c8087a10 0x7f71c8069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.167+0000 7f71cebe8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80ca910 con 0x7f71c80c7380 2023-10-14T19:03:18.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.167+0000 7f71cebe8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80c9fe0 con 0x7f71c80c6a30 2023-10-14T19:03:18.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.167+0000 7f71cebe8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80ca2c0 con 0x7f71c8087a10 2023-10-14T19:03:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.168+0000 7f71cdbe6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f71c80c7380 0x7f71c806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40242/0 (socket says 172.21.15.7:40242) 2023-10-14T19:03:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.168+0000 7f71cdbe6700 1 -- 172.21.15.7:0/1880401130 learned_addr learned my addr 172.21.15.7:0/1880401130 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.169+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212481373 0 0) 0x7f71c80ca910 con 0x7f71c80c7380 2023-10-14T19:03:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.169+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b4003570 con 0x7f71c80c7380 2023-10-14T19:03:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.169+0000 7f71ce3e7700 1 --2- 172.21.15.7:0/1880401130 >> v2:172.21.15.148:3300/0 conn(0x7f71c8087a10 0x7f71c8069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541953434 0 0) 0x7f71b4003570 con 0x7f71c80c7380 2023-10-14T19:03:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 >> v2:172.21.15.148:3300/0 conn(0x7f71c8087a10 msgr2=0x7f71c8069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 --2- 172.21.15.7:0/1880401130 >> v2:172.21.15.148:3300/0 conn(0x7f71c8087a10 0x7f71c8069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 >> v1:172.21.15.148:6789/0 conn(0x7f71c80c6a30 legacy=0x7f71c8087300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:03:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80ca5a0 con 0x7f71c80c7380 2023-10-14T19:03:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f71b80014c0 con 0x7f71c80c7380 2023-10-14T19:03:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 >> v1:172.21.15.7:6789/0 conn(0x7f71c80c7380 legacy=0x7f71c806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b4003ae0 0x7f71b4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b4004810 0x7f71b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b40053c0 0x7f71b401ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80ca2c0 con 0x7f71b4004810 2023-10-14T19:03:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b401d2d0 con 0x7f71b40053c0 2023-10-14T19:03:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b401d490 con 0x7f71b4003ae0 2023-10-14T19:03:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.170+0000 7f71cdbe6700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b4003ae0 0x7f71b4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.173+0000 7f71cdbe6700 1 -- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b40053c0 msgr2=0x7f71b401ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.173+0000 7f71cdbe6700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b40053c0 0x7f71b401ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.173+0000 7f71cdbe6700 1 -- 172.21.15.7:0/1880401130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b4004810 msgr2=0x7f71b4004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T19:03:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.173+0000 7f71cdbe6700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b4004810 0x7f71b4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7f71cdbe6700 1 -- 172.21.15.7:0/1880401130 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80ca5a0 con 0x7f71b4003ae0 2023-10-14T19:03:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7f71ce3e7700 1 -- 172.21.15.7:0/1880401130 reap_dead start 2023-10-14T19:03:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7f71cdbe6700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b4003ae0 0x7f71b4003ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b320 tx=0x7f71b8001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6161556e74dba7ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7f5efeb59700 1 Processor -- start 2023-10-14T19:03:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7fd49e4b8700 1 Processor -- start 2023-10-14T19:03:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7fd49e4b8700 1 -- start start 2023-10-14T19:03:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.174+0000 7f5efeb59700 1 -- start start 2023-10-14T19:03:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efeb59700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5ef815a7d0 0x7f5ef8158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efeb59700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ef8150c90 0x7f5ef80af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efeb59700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef8158c80 con 0x7f5ef81508c0 2023-10-14T19:03:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efeb59700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef815afc0 con 0x7f5ef815a7d0 2023-10-14T19:03:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efeb59700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef80af820 con 0x7f5ef8150c90 2023-10-14T19:03:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800f040 con 0x7f71b4003ae0 2023-10-14T19:03:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b800bc50 con 0x7f71b4003ae0 2023-10-14T19:03:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f71ccbe4700 1 -- 172.21.15.7:0/1880401130 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b80048c0 con 0x7f71b4003ae0 2023-10-14T19:03:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7fd49e4b8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd498140e50 0x7fd4980af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7fd49e4b8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd4980af560 0x7fd49815b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7fd49e4b8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4980af9d0 con 0x7fd49815b750 2023-10-14T19:03:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7fd49e4b8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980cb4d0 con 0x7fd4980af560 2023-10-14T19:03:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7fd49e4b8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd498158000 con 0x7fd498140e50 2023-10-14T19:03:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efd0f6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ef8150c90 0x7f5ef80af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efd0f6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ef8150c90 0x7f5ef80af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:41148/0 (socket says 172.21.15.7:41148) 2023-10-14T19:03:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.175+0000 7f5efd0f6700 1 -- 172.21.15.7:0/2341767572 learned_addr learned my addr 172.21.15.7:0/2341767572 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd49ca55700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd49815b750 0x7fd49806c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55102/0 (socket says 172.21.15.7:55102) 2023-10-14T19:03:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd49ca55700 1 -- 172.21.15.7:0/23505919 learned_addr learned my addr 172.21.15.7:0/23505919 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd497fff700 1 --2- 172.21.15.7:0/23505919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd498140e50 0x7fd4980af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd496ffd700 1 -- 172.21.15.7:0/23505919 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988692788 0 0) 0x7fd4980af9d0 con 0x7fd49815b750 2023-10-14T19:03:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd496ffd700 1 -- 172.21.15.7:0/23505919 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480003570 con 0x7fd49815b750 2023-10-14T19:03:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f5ef7fff700 1 --2- 172.21.15.7:0/2341767572 >> v2:172.21.15.7:3300/0 conn(0x7f5ef815a7d0 0x7f5ef8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd497fff700 1 -- 172.21.15.7:0/23505919 >> v2:172.21.15.7:3300/0 conn(0x7fd4980af560 msgr2=0x7fd49815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd497fff700 1 --2- 172.21.15.7:0/23505919 >> v2:172.21.15.7:3300/0 conn(0x7fd4980af560 0x7fd49815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd497fff700 1 -- 172.21.15.7:0/23505919 >> v1:172.21.15.148:6789/0 conn(0x7fd49815b750 legacy=0x7fd49806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd497fff700 1 -- 172.21.15.7:0/23505919 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980cbd10 con 0x7fd498140e50 2023-10-14T19:03:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f71cebe8700 1 -- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b4003ae0 msgr2=0x7f71b4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f71cebe8700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b4003ae0 0x7f71b4003ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b320 tx=0x7f71b8001e70 comp rx=0 tx=0).stop 2023-10-14T19:03:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fb4e6fc9700 1 Processor -- start 2023-10-14T19:03:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f71cebe8700 1 -- 172.21.15.7:0/1880401130 shutdown_connections 2023-10-14T19:03:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f71cebe8700 1 --2- 172.21.15.7:0/1880401130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b4003ae0 0x7f71b4003ed0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b320 tx=0x7f71b8001e70 comp rx=0 tx=0).stop 2023-10-14T19:03:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f71cebe8700 1 -- 172.21.15.7:0/1880401130 >> 172.21.15.7:0/1880401130 conn(0x7f71c806d130 msgr2=0x7f71c80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f5efd0f6700 1 -- 172.21.15.7:0/2341767572 >> v2:172.21.15.7:3300/0 conn(0x7f5ef815a7d0 msgr2=0x7f5ef8158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f5efd0f6700 1 --2- 172.21.15.7:0/2341767572 >> v2:172.21.15.7:3300/0 conn(0x7f5ef815a7d0 0x7f5ef8158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f5efd0f6700 1 -- 172.21.15.7:0/2341767572 >> v1:172.21.15.7:6789/0 conn(0x7f5ef81508c0 legacy=0x7f5ef815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7f5efd0f6700 1 -- 172.21.15.7:0/2341767572 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8155710 con 0x7f5ef8150c90 2023-10-14T19:03:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fd497fff700 1 --2- 172.21.15.7:0/23505919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd498140e50 0x7fd4980af020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098e0 tx=0x7fd4880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c870877d8687b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7fd496ffd700 1 -- 172.21.15.7:0/23505919 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800b640 con 0x7fd498140e50 2023-10-14T19:03:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7f71cebe8700 1 -- 172.21.15.7:0/1880401130 shutdown_connections 2023-10-14T19:03:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7f5efd0f6700 1 --2- 172.21.15.7:0/2341767572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef8150c90 0x7f5ef80af2e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8070f60 tx=0x7f5ef000ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fe6bf0d8ca9e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7f7b21467700 1 Processor -- start 2023-10-14T19:03:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7f7b21467700 1 -- start start 2023-10-14T19:03:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7f71cebe8700 1 -- 172.21.15.7:0/1880401130 wait complete. 2023-10-14T19:03:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7fd496ffd700 1 -- 172.21.15.7:0/23505919 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48800b7a0 con 0x7fd498140e50 2023-10-14T19:03:18.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.177+0000 7fd496ffd700 1 -- 172.21.15.7:0/23505919 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800bb60 con 0x7fd498140e50 2023-10-14T19:03:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fd49e4b8700 1 -- 172.21.15.7:0/23505919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd498140e50 msgr2=0x7fd4980af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/23505919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd498140e50 0x7fd4980af020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098e0 tx=0x7fd4880091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f5ef77fe700 1 -- 172.21.15.7:0/2341767572 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0010070 con 0x7f5ef8150c90 2023-10-14T19:03:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f5ef77fe700 1 -- 172.21.15.7:0/2341767572 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000dde0 con 0x7f5ef8150c90 2023-10-14T19:03:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f5ef77fe700 1 -- 172.21.15.7:0/2341767572 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000b320 con 0x7f5ef8150c90 2023-10-14T19:03:18.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.176+0000 7fb4e6fc9700 1 -- start start 2023-10-14T19:03:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e6fc9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb4e015db00 0x7fb4e00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e6fc9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb4e00b0120 0x7fb4e015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e6fc9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e0160fb0 con 0x7fb4e0161440 2023-10-14T19:03:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e6fc9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e01603a0 con 0x7fb4e015db00 2023-10-14T19:03:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e6fc9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e0160680 con 0x7fb4e00b0120 2023-10-14T19:03:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e4d65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb4e015db00 0x7fb4e00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4dffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb4e0161440 0x7fb4e00afa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40264/0 (socket says 172.21.15.7:40264) 2023-10-14T19:03:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4dffff700 1 -- 172.21.15.7:0/1870788140 learned_addr learned my addr 172.21.15.7:0/1870788140 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4e5566700 1 --2- 172.21.15.7:0/1870788140 >> v2:172.21.15.148:3300/0 conn(0x7fb4e00b0120 0x7fb4e015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878870086 0 0) 0x7fb4e0160fb0 con 0x7fb4e0161440 2023-10-14T19:03:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c8003570 con 0x7fb4e0161440 2023-10-14T19:03:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f7b21467700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b1c150540 0x7f7b1c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f7b21467700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c06f1c0 0x7f7b1c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f7b21467700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0ae2d0 con 0x7f7b1c150170 2023-10-14T19:03:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f7b21467700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c06f660 con 0x7f7b1c150540 2023-10-14T19:03:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f7b21467700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b0a90 con 0x7f7b1c06f1c0 2023-10-14T19:03:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.178+0000 7f71cebe8700 1 Processor -- start 2023-10-14T19:03:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f71cebe8700 1 -- start start 2023-10-14T19:03:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fe6785c7700 1 Processor -- start 2023-10-14T19:03:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f7b1affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7b1c150170 0x7f7b1c0ae760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55112/0 (socket says 172.21.15.7:55112) 2023-10-14T19:03:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f7b1affd700 1 -- 172.21.15.7:0/3601298932 learned_addr learned my addr 172.21.15.7:0/3601298932 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946875864 0 0) 0x7fb4c8003570 con 0x7fb4e0161440 2023-10-14T19:03:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 >> v2:172.21.15.148:3300/0 conn(0x7fb4e00b0120 msgr2=0x7fb4e015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 --2- 172.21.15.7:0/1870788140 >> v2:172.21.15.148:3300/0 conn(0x7fb4e00b0120 0x7fb4e015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 >> v2:172.21.15.7:3300/0 conn(0x7fb4e015db00 msgr2=0x7fb4e00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 --2- 172.21.15.7:0/1870788140 >> v2:172.21.15.7:3300/0 conn(0x7fb4e015db00 0x7fb4e00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0160960 con 0x7fb4e0161440 2023-10-14T19:03:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fb4d80017f0 con 0x7fb4e0161440 2023-10-14T19:03:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f7b1b7fe700 1 --2- 172.21.15.7:0/3601298932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c06f1c0 0x7f7b1c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f5efeb59700 1 -- 172.21.15.7:0/2341767572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef8150c90 msgr2=0x7f5ef80af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f5efeb59700 1 --2- 172.21.15.7:0/2341767572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef8150c90 0x7f5ef80af2e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8070f60 tx=0x7f5ef000ba50 comp rx=0 tx=0).stop 2023-10-14T19:03:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f5efeb59700 1 -- 172.21.15.7:0/2341767572 shutdown_connections 2023-10-14T19:03:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f5efeb59700 1 --2- 172.21.15.7:0/2341767572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef8150c90 0x7f5ef80af2e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f5efeb59700 1 --2- 172.21.15.7:0/2341767572 >> v2:172.21.15.7:3300/0 conn(0x7f5ef815a7d0 0x7f5ef8158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f5efeb59700 1 -- 172.21.15.7:0/2341767572 >> 172.21.15.7:0/2341767572 conn(0x7f5ef80cded0 msgr2=0x7f5ef806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3601298932 >> v2:172.21.15.7:3300/0 conn(0x7f7b1c150540 0x7f7b1c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f7b127fc700 1 -- 172.21.15.7:0/3601298932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c06f1c0 msgr2=0x7f7b1c0afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3601298932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c06f1c0 0x7f7b1c0afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f7b127fc700 1 -- 172.21.15.7:0/3601298932 >> v1:172.21.15.148:6789/0 conn(0x7f7b1c150170 legacy=0x7f7b1c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f7b127fc700 1 -- 172.21.15.7:0/3601298932 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0ad9a0 con 0x7f7b1c150540 2023-10-14T19:03:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cebe8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c8162090 0x7f71c80b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cebe8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 0x7f71c8176280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cebe8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 0x7f71c81767c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cebe8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80b14c0 con 0x7f71c80afed0 2023-10-14T19:03:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cebe8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80b08b0 con 0x7f71c8162090 2023-10-14T19:03:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cebe8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80b0b90 con 0x7f71c80b0340 2023-10-14T19:03:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 0x7f71c81767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cd3e5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 0x7f71c8176280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 0x7f71c81767c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38674/0 (socket says 172.21.15.7:38674) 2023-10-14T19:03:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cd3e5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 0x7f71c8176280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38630/0 (socket says 172.21.15.7:38630) 2023-10-14T19:03:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 -- 172.21.15.7:0/410785292 learned_addr learned my addr 172.21.15.7:0/410785292 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3601298932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c150540 0x7f7b1c06ec80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b040098e0 tx=0x7f7b040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae8b6d89cd6a574 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 -- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c8162090 msgr2=0x7f71c80b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c8162090 0x7f71c80b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 -- 172.21.15.7:0/410785292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 msgr2=0x7f71c8176280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 0x7f71c8176280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71ce3e7700 1 -- 172.21.15.7:0/410785292 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80b0e70 con 0x7f71c80b0340 2023-10-14T19:03:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7f71cd3e5700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 0x7f71c8176280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f71ce3e7700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 0x7f71c81767c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71c8087e10 tx=0x7f71c0007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000aa90 con 0x7f71c80b0340 2023-10-14T19:03:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000abf0 con 0x7f71c80b0340 2023-10-14T19:03:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0016430 con 0x7f71c80b0340 2023-10-14T19:03:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c80b1150 con 0x7f71c80b0340 2023-10-14T19:03:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fe6785c7700 1 -- start start 2023-10-14T19:03:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fe6785c7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 0x7fe67006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fe6785c7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe67006e930 0x7fe6700ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fe6785c7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700acf40 con 0x7fe6700cb8e0 2023-10-14T19:03:18.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fe6785c7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700b20a0 con 0x7fe67006e930 2023-10-14T19:03:18.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fe6785c7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe670156ee0 con 0x7fe6700cbcb0 2023-10-14T19:03:18.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 0x7fe67006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 0x7fe67006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38686/0 (socket says 172.21.15.7:38686) 2023-10-14T19:03:18.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 -- 172.21.15.7:0/3080674373 learned_addr learned my addr 172.21.15.7:0/3080674373 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 -- 172.21.15.7:0/3080674373 >> v2:172.21.15.148:3300/0 conn(0x7fe67006e930 msgr2=0x7fe6700ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 --2- 172.21.15.7:0/3080674373 >> v2:172.21.15.148:3300/0 conn(0x7fe67006e930 0x7fe6700ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 -- 172.21.15.7:0/3080674373 >> v1:172.21.15.7:6789/0 conn(0x7fe6700cb8e0 legacy=0x7fe6700ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 -- 172.21.15.7:0/3080674373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67006ed80 con 0x7fe6700cbcb0 2023-10-14T19:03:18.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f7b1a7fc700 1 -- 172.21.15.7:0/3601298932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04011630 con 0x7f7b1c150540 2023-10-14T19:03:18.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f7b1a7fc700 1 -- 172.21.15.7:0/3601298932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04011790 con 0x7f7b1c150540 2023-10-14T19:03:18.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f7b1a7fc700 1 -- 172.21.15.7:0/3601298932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04011b50 con 0x7f7b1c150540 2023-10-14T19:03:18.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 >> v1:172.21.15.7:6789/0 conn(0x7fb4e0161440 legacy=0x7fb4e00afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4c8003a60 0x7fb4c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4c8004810 0x7fb4c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c80051c0 0x7fb4c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e01603a0 con 0x7fb4c80051c0 2023-10-14T19:03:18.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0160680 con 0x7fb4c8003a60 2023-10-14T19:03:18.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c800c130 con 0x7fb4c8004810 2023-10-14T19:03:18.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4dffff700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4c8004810 0x7fb4c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4e4d65700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4c8003a60 0x7fb4c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4dffff700 1 -- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4c8003a60 msgr2=0x7fb4c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4dffff700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4c8003a60 0x7fb4c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4dffff700 1 -- 172.21.15.7:0/1870788140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c80051c0 msgr2=0x7fb4c800ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T19:03:18.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4dffff700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c80051c0 0x7fb4c800ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.179+0000 7fb4dffff700 1 -- 172.21.15.7:0/1870788140 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8003570 con 0x7fb4c8004810 2023-10-14T19:03:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fb4dffff700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4c8004810 0x7fb4c8004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800a970 tx=0x7fb4d800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00a74969cb1685b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80070f0 con 0x7fb4c8004810 2023-10-14T19:03:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.180+0000 7fb4df7fe700 1 -- 172.21.15.7:0/1870788140 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8007250 con 0x7fb4c8004810 2023-10-14T19:03:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4c8004810 msgr2=0x7fb4c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/1870788140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4c8004810 0x7fb4c8004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800a970 tx=0x7fb4d800a060 comp rx=0 tx=0).stop 2023-10-14T19:03:18.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fe675b62700 1 --2- 172.21.15.7:0/3080674373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 0x7fe67006e3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6600089b0 tx=0x7fe6600082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d8529bb0cf1f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c81698b0 con 0x7f71c80b0340 2023-10-14T19:03:18.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e5566700 1 -- 172.21.15.7:0/1870788140 reap_dead start 2023-10-14T19:03:18.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e5566700 1 -- 172.21.15.7:0/1870788140 reap_dead start 2023-10-14T19:03:18.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/1870788140 shutdown_connections 2023-10-14T19:03:18.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/1870788140 >> 172.21.15.7:0/1870788140 conn(0x7fb4e006d170 msgr2=0x7fb4e00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/1870788140 shutdown_connections 2023-10-14T19:03:18.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.181+0000 7f5efeb59700 1 -- 172.21.15.7:0/2341767572 shutdown_connections 2023-10-14T19:03:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a80052b0 con 0x7f71c80b0340 2023-10-14T19:03:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71c0003020 con 0x7f71c80b0340 2023-10-14T19:03:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f71bdffb700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ac067000 0x7f71ac0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71c0012070 con 0x7f71c80b0340 2023-10-14T19:03:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f71cdbe6700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ac067000 0x7f71ac0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f5efeb59700 1 -- 172.21.15.7:0/2341767572 wait complete. 2023-10-14T19:03:18.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f7b21467700 1 -- 172.21.15.7:0/3601298932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c150540 msgr2=0x7f7b1c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f7b21467700 1 --2- 172.21.15.7:0/3601298932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c150540 0x7f7b1c06ec80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b040098e0 tx=0x7f7b040091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f7b21467700 1 -- 172.21.15.7:0/3601298932 shutdown_connections 2023-10-14T19:03:18.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f7b21467700 1 --2- 172.21.15.7:0/3601298932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c06f1c0 0x7f7b1c0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f7b21467700 1 --2- 172.21.15.7:0/3601298932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c150540 0x7f7b1c06ec80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7f7b21467700 1 -- 172.21.15.7:0/3601298932 >> 172.21.15.7:0/3601298932 conn(0x7f7b1c0cc300 msgr2=0x7f7b1c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f7b21467700 1 -- 172.21.15.7:0/3601298932 shutdown_connections 2023-10-14T19:03:18.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f7b21467700 1 -- 172.21.15.7:0/3601298932 wait complete. 2023-10-14T19:03:18.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.182+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/1870788140 wait complete. 2023-10-14T19:03:18.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7fb4e6fc9700 1 Processor -- start 2023-10-14T19:03:18.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7f71cdbe6700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ac067000 0x7f71ac0694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b320 tx=0x7f71b8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7fe675361700 1 -- 172.21.15.7:0/3080674373 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660010070 con 0x7fe6700cbcb0 2023-10-14T19:03:18.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7fe675361700 1 -- 172.21.15.7:0/3080674373 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66000daf0 con 0x7fe6700cbcb0 2023-10-14T19:03:18.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7fe675361700 1 -- 172.21.15.7:0/3080674373 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000de70 con 0x7fe6700cbcb0 2023-10-14T19:03:18.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7fd49e4b8700 1 -- 172.21.15.7:0/23505919 shutdown_connections 2023-10-14T19:03:18.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/23505919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd498140e50 0x7fd4980af020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/23505919 >> v2:172.21.15.7:3300/0 conn(0x7fd4980af560 0x7fd49815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7fd49e4b8700 1 -- 172.21.15.7:0/23505919 >> 172.21.15.7:0/23505919 conn(0x7fd4980cded0 msgr2=0x7fd49806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7fd49e4b8700 1 -- 172.21.15.7:0/23505919 shutdown_connections 2023-10-14T19:03:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.183+0000 7f5efeb59700 1 Processor -- start 2023-10-14T19:03:18.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7f5efeb59700 1 -- start start 2023-10-14T19:03:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7f7b21467700 1 Processor -- start 2023-10-14T19:03:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7f7b21467700 1 -- start start 2023-10-14T19:03:18.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7fb4e6fc9700 1 -- start start 2023-10-14T19:03:18.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e6fc9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 0x7fb4e014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e6fc9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e01631b0 0x7fb4e013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e6fc9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e013d090 0x7fb4e0161830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e6fc9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e013d510 con 0x7fb4e014baf0 2023-10-14T19:03:18.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e6fc9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0163620 con 0x7fb4e013d090 2023-10-14T19:03:18.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e6fc9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0162520 con 0x7fb4e01631b0 2023-10-14T19:03:18.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5efeb59700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef81508c0 0x7f5ef8166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5efeb59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 0x7f5ef814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5efeb59700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ef815a7d0 0x7f5ef80c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5efeb59700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8165c50 con 0x7f5ef8150c90 2023-10-14T19:03:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5efeb59700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8151100 con 0x7f5ef81508c0 2023-10-14T19:03:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5efeb59700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81513e0 con 0x7f5ef815a7d0 2023-10-14T19:03:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 0x7f5ef814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 0x7f5ef814ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38648/0 (socket says 172.21.15.7:38648) 2023-10-14T19:03:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f5ef7fff700 1 -- 172.21.15.7:0/1507744187 learned_addr learned my addr 172.21.15.7:0/1507744187 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f7b21467700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c06f1c0 0x7f7b1c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f7b21467700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c150170 0x7f7b1c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f7b21467700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c150540 0x7f7b1c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f7b21467700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1591a0 con 0x7f7b1c06f1c0 2023-10-14T19:03:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f7b21467700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1593b0 con 0x7f7b1c150170 2023-10-14T19:03:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7f7b21467700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c155fd0 con 0x7f7b1c150540 2023-10-14T19:03:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e4d65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 0x7fb4e014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e4d65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 0x7fb4e014bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38636/0 (socket says 172.21.15.7:38636) 2023-10-14T19:03:18.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e5566700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e013d090 0x7fb4e0161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4e4d65700 1 -- 172.21.15.7:0/3661185648 learned_addr learned my addr 172.21.15.7:0/3661185648 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fb4dffff700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e01631b0 0x7fb4e013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f5efc8f5700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef81508c0 0x7f5ef8166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b1affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c06f1c0 0x7f7b1c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b1affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c06f1c0 0x7f7b1c158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38658/0 (socket says 172.21.15.7:38658) 2023-10-14T19:03:18.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b1affd700 1 -- 172.21.15.7:0/3746937861 learned_addr learned my addr 172.21.15.7:0/3746937861 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c150170 0x7f7b1c14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fb4e4d65700 1 -- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e01631b0 msgr2=0x7fb4e013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fb4e4d65700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e01631b0 0x7fb4e013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fb4e4d65700 1 -- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e013d090 msgr2=0x7fb4e0161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fb4e4d65700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e013d090 0x7fb4e0161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fb4e4d65700 1 -- 172.21.15.7:0/3661185648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0162800 con 0x7fb4e014baf0 2023-10-14T19:03:18.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fb4e5566700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e013d090 0x7fb4e0161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:18.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 -- 172.21.15.7:0/3080674373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 msgr2=0x7fe67006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 --2- 172.21.15.7:0/3080674373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 0x7fe67006e3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6600089b0 tx=0x7fe6600082d0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 -- 172.21.15.7:0/3080674373 shutdown_connections 2023-10-14T19:03:18.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 --2- 172.21.15.7:0/3080674373 >> v2:172.21.15.148:3300/0 conn(0x7fe67006e930 0x7fe6700ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 --2- 172.21.15.7:0/3080674373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700cbcb0 0x7fe67006e3f0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6600089b0 tx=0x7fe6600082d0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 -- 172.21.15.7:0/3080674373 >> 172.21.15.7:0/3080674373 conn(0x7fe6700cc300 msgr2=0x7fe6700cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 -- 172.21.15.7:0/3080674373 shutdown_connections 2023-10-14T19:03:18.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.185+0000 7fe6785c7700 1 -- 172.21.15.7:0/3080674373 wait complete. 2023-10-14T19:03:18.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 -- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c150540 msgr2=0x7f7b1c14ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T19:03:18.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c150540 0x7f7b1c14ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 -- 172.21.15.7:0/3746937861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c06f1c0 msgr2=0x7f7b1c158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c06f1c0 0x7f7b1c158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 -- 172.21.15.7:0/3746937861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04009420 con 0x7f7b1c150170 2023-10-14T19:03:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.184+0000 7fd49e4b8700 1 -- 172.21.15.7:0/23505919 wait complete. 2023-10-14T19:03:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7fd49e4b8700 1 Processor -- start 2023-10-14T19:03:18.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f5ef7fff700 1 -- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ef815a7d0 msgr2=0x7f5ef80c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f5ef7fff700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ef815a7d0 0x7f5ef80c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f5ef7fff700 1 -- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef81508c0 msgr2=0x7f5ef8166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f5ef7fff700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef81508c0 0x7f5ef8166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f5ef7fff700 1 -- 172.21.15.7:0/1507744187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef000bcf0 con 0x7f5ef8150c90 2023-10-14T19:03:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.186+0000 7f7b127fc700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c150170 0x7f7b1c14c910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b04015000 tx=0x7f7b04016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fb4e4d65700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 0x7fb4e014bec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400f910 tx=0x7fb4d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7f5ef7fff700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 0x7f5ef814ea60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400ec80 tx=0x7f5ee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04000c40 con 0x7f7b1c150170 2023-10-14T19:03:18.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04020070 con 0x7f7b1c150170 2023-10-14T19:03:18.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b040276d0 con 0x7f7b1c150170 2023-10-14T19:03:18.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4014670 con 0x7fb4e014baf0 2023-10-14T19:03:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d40147d0 con 0x7fb4e014baf0 2023-10-14T19:03:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4014b90 con 0x7fb4e014baf0 2023-10-14T19:03:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e0159820 con 0x7fb4e014baf0 2023-10-14T19:03:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e0159de0 con 0x7fb4e014baf0 2023-10-14T19:03:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fd49e4b8700 1 -- start start 2023-10-14T19:03:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49e4b8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 0x7fd4981572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49e4b8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd498140e50 0x7fd49813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49e4b8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd49815b750 0x7fd4981379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49e4b8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd498139ad0 con 0x7fd4980af560 2023-10-14T19:03:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49e4b8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd498157800 con 0x7fd498140e50 2023-10-14T19:03:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49e4b8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd498138ec0 con 0x7fd49815b750 2023-10-14T19:03:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c1562b0 con 0x7f7b1c150170 2023-10-14T19:03:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c156870 con 0x7f7b1c150170 2023-10-14T19:03:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fe6785c7700 1 Processor -- start 2023-10-14T19:03:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.187+0000 7fe6785c7700 1 -- start start 2023-10-14T19:03:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe6785c7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 0x7fe670179b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe6785c7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700cb8e0 0x7fe67017a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe6785c7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700a8030 0x7fe6700a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe6785c7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700a9000 con 0x7fe67006e930 2023-10-14T19:03:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe6785c7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700a8d20 con 0x7fe6700cb8e0 2023-10-14T19:03:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe6785c7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701571c0 con 0x7fe6700a8030 2023-10-14T19:03:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 0x7fe670179b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 0x7fe670179b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38664/0 (socket says 172.21.15.7:38664) 2023-10-14T19:03:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 -- 172.21.15.7:0/2456301244 learned_addr learned my addr 172.21.15.7:0/2456301244 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 -- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700a8030 msgr2=0x7fe6700a84d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T19:03:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700a8030 0x7fe6700a84d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 -- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700cb8e0 msgr2=0x7fe67017a070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T19:03:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700cb8e0 0x7fe67017a070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fe676363700 1 -- 172.21.15.7:0/2456301244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660008570 con 0x7fe67006e930 2023-10-14T19:03:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fe676363700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 0x7fe670179b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe66800bc30 tx=0x7fe668009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd497fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 0x7fd4981572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd4977fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd498140e50 0x7fd49813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd497fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 0x7fd4981572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38674/0 (socket says 172.21.15.7:38674) 2023-10-14T19:03:18.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd497fff700 1 -- 172.21.15.7:0/1453022150 learned_addr learned my addr 172.21.15.7:0/1453022150 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.188+0000 7fd49ca55700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd49815b750 0x7fd4981379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd49ca55700 1 -- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd498140e50 msgr2=0x7fd49813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd49ca55700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd498140e50 0x7fd49813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd49ca55700 1 -- 172.21.15.7:0/1453022150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 msgr2=0x7fd4981572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd49ca55700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 0x7fd4981572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd49ca55700 1 -- 172.21.15.7:0/1453022150 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009420 con 0x7fd49815b750 2023-10-14T19:03:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd497fff700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 0x7fd4981572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400c850 con 0x7f5ef8150c90 2023-10-14T19:03:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400c9b0 con 0x7f5ef8150c90 2023-10-14T19:03:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400cd70 con 0x7f5ef8150c90 2023-10-14T19:03:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71c0052260 con 0x7f71c80b0340 2023-10-14T19:03:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800c9b0 con 0x7fe67006e930 2023-10-14T19:03:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800cb10 con 0x7fe67006e930 2023-10-14T19:03:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6701574a0 con 0x7fe67006e930 2023-10-14T19:03:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fd49ca55700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd49815b750 0x7fd4981379b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd49000cb90 tx=0x7fd490001980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000a8b0 con 0x7fd49815b750 2023-10-14T19:03:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000aa10 con 0x7fd49815b750 2023-10-14T19:03:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000ad90 con 0x7fd49815b750 2023-10-14T19:03:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c156a60 con 0x7f7b1c150170 2023-10-14T19:03:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c00052b0 con 0x7fb4e014baf0 2023-10-14T19:03:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef81516c0 con 0x7f5ef8150c90 2023-10-14T19:03:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef8151c80 con 0x7f5ef8150c90 2023-10-14T19:03:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4d401d400 con 0x7fb4e014baf0 2023-10-14T19:03:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7fb4dcff9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb4cc067080 0x7fb4cc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.191+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4d4084be0 con 0x7fb4e014baf0 2023-10-14T19:03:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.191+0000 7fb4dffff700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb4cc067080 0x7fb4cc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.191+0000 7fb4dffff700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb4cc067080 0x7fb4cc069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800a460 tx=0x7fb4d8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4981391a0 con 0x7fd49815b750 2023-10-14T19:03:18.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd498139760 con 0x7fd49815b750 2023-10-14T19:03:18.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef8165d90 con 0x7f5ef8150c90 2023-10-14T19:03:18.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.191+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b04027b00 con 0x7f7b1c150170 2023-10-14T19:03:18.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7f7b137fe700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7afc066f30 0x7f7afc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b04022070 con 0x7f7b1c150170 2023-10-14T19:03:18.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7f7b1affd700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7afc066f30 0x7f7afc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.189+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668014410 con 0x7fe67006e930 2023-10-14T19:03:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.190+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6700a8a10 con 0x7fe67006e930 2023-10-14T19:03:18.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.192+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe670157020 con 0x7fe67006e930 2023-10-14T19:03:18.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.193+0000 7f7b1affd700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7afc066f30 0x7f7afc0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c007880 tx=0x7f7b0c004a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.193+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe668014800 con 0x7fe67006e930 2023-10-14T19:03:18.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.193+0000 7fe6667fc700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe65c0670d0 0x7fe65c069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.193+0000 7fe675b62700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe65c0670d0 0x7fe65c069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.194+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd498139c80 con 0x7fd49815b750 2023-10-14T19:03:18.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.194+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd490007300 con 0x7fd49815b750 2023-10-14T19:03:18.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.194+0000 7fe675b62700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe65c0670d0 0x7fe65c069580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6600089b0 tx=0x7fe66001b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.194+0000 7fd487fff700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd47c067050 0x7fd47c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.194+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd490084170 con 0x7fd49815b750 2023-10-14T19:03:18.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.195+0000 7fd497fff700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd47c067050 0x7fd47c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.195+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b04053a10 con 0x7f7b1c150170 2023-10-14T19:03:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.195+0000 7fd497fff700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd47c067050 0x7fd47c069500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd48800c010 tx=0x7fd488017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.198+0000 7f24f04da700 1 Processor -- start 2023-10-14T19:03:18.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.198+0000 7f24f04da700 1 -- start start 2023-10-14T19:03:18.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.198+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd49004b5a0 con 0x7fd49815b750 2023-10-14T19:03:18.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24f04da700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24e80c4d80 0x7f24e80cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24f04da700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c5510 0x7f24e80c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24f04da700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e80c5220 con 0x7f24e81576a0 2023-10-14T19:03:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24f04da700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e80c5e90 con 0x7f24e80c4d80 2023-10-14T19:03:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24f04da700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8157a70 con 0x7f24e80c5510 2023-10-14T19:03:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24ee276700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f24e81576a0 0x7f24e80c8040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55126/0 (socket says 172.21.15.7:55126) 2023-10-14T19:03:18.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24ee276700 1 -- 172.21.15.7:0/248222831 learned_addr learned my addr 172.21.15.7:0/248222831 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:18.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24eda75700 1 --2- 172.21.15.7:0/248222831 >> v2:172.21.15.7:3300/0 conn(0x7f24e80c4d80 0x7f24e80cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24eea77700 1 --2- 172.21.15.7:0/248222831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c5510 0x7f24e80c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24eea77700 1 -- 172.21.15.7:0/248222831 >> v2:172.21.15.7:3300/0 conn(0x7f24e80c4d80 msgr2=0x7f24e80cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24eea77700 1 --2- 172.21.15.7:0/248222831 >> v2:172.21.15.7:3300/0 conn(0x7f24e80c4d80 0x7f24e80cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24eea77700 1 -- 172.21.15.7:0/248222831 >> v1:172.21.15.148:6789/0 conn(0x7f24e81576a0 legacy=0x7f24e80c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7f24eea77700 1 -- 172.21.15.7:0/248222831 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80c8800 con 0x7f24e80c5510 2023-10-14T19:03:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.200+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4d4051e30 con 0x7fb4e014baf0 2023-10-14T19:03:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.201+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe668055aa0 con 0x7fe67006e930 2023-10-14T19:03:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.203+0000 7f24eea77700 1 --2- 172.21.15.7:0/248222831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c5510 0x7f24e80c5950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009e60 tx=0x7f24e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=716b19ff1744bd4b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.204+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ee4013680 con 0x7f5ef8150c90 2023-10-14T19:03:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.205+0000 7f5ef4ff9700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5edc067000 0x7f5edc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.205+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ee4084dd0 con 0x7f5ef8150c90 2023-10-14T19:03:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.205+0000 7f5efc8f5700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5edc067000 0x7f5edc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.206+0000 7f24ed274700 1 -- 172.21.15.7:0/248222831 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e000e070 con 0x7f24e80c5510 2023-10-14T19:03:18.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.206+0000 7f24ed274700 1 -- 172.21.15.7:0/248222831 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e000bb20 con 0x7f24e80c5510 2023-10-14T19:03:18.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.206+0000 7f24ed274700 1 -- 172.21.15.7:0/248222831 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0012430 con 0x7f24e80c5510 2023-10-14T19:03:18.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.207+0000 7f5efc8f5700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5edc067000 0x7f5edc0694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.207+0000 7f24f04da700 1 -- 172.21.15.7:0/248222831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c5510 msgr2=0x7f24e80c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.207+0000 7f24f04da700 1 --2- 172.21.15.7:0/248222831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c5510 0x7f24e80c5950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009e60 tx=0x7f24e0009780 comp rx=0 tx=0).stop 2023-10-14T19:03:18.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.210+0000 7f24f04da700 1 -- 172.21.15.7:0/248222831 shutdown_connections 2023-10-14T19:03:18.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.210+0000 7f24f04da700 1 --2- 172.21.15.7:0/248222831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c5510 0x7f24e80c5950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.210+0000 7f24f04da700 1 --2- 172.21.15.7:0/248222831 >> v2:172.21.15.7:3300/0 conn(0x7f24e80c4d80 0x7f24e80cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.210+0000 7f24f04da700 1 -- 172.21.15.7:0/248222831 >> 172.21.15.7:0/248222831 conn(0x7f24e80ccb60 msgr2=0x7f24e80ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.210+0000 7f24f04da700 1 -- 172.21.15.7:0/248222831 shutdown_connections 2023-10-14T19:03:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.210+0000 7f24f04da700 1 -- 172.21.15.7:0/248222831 wait complete. 2023-10-14T19:03:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.212+0000 7f24f04da700 1 Processor -- start 2023-10-14T19:03:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.213+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe670157020 con 0x7fe67006e930 2023-10-14T19:03:18.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.212+0000 7f24f04da700 1 -- start start 2023-10-14T19:03:18.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24f04da700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c4d80 0x7f24e81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24f04da700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 0x7f24e8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24f04da700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24e81576a0 0x7f24e8150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24f04da700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8152dc0 con 0x7f24e81576a0 2023-10-14T19:03:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24f04da700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8151f10 con 0x7f24e80c5510 2023-10-14T19:03:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24f04da700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e81521b0 con 0x7f24e80c4d80 2023-10-14T19:03:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24ee276700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c4d80 0x7f24e81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24eda75700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 0x7f24e8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24eda75700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 0x7f24e8157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:41242/0 (socket says 172.21.15.7:41242) 2023-10-14T19:03:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.214+0000 7f24eda75700 1 -- 172.21.15.7:0/893120565 learned_addr learned my addr 172.21.15.7:0/893120565 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24eda75700 1 -- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c4d80 msgr2=0x7f24e81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24eda75700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c4d80 0x7f24e81519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24eda75700 1 -- 172.21.15.7:0/893120565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24e81576a0 msgr2=0x7f24e8150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24eda75700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24e81576a0 0x7f24e8150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24eda75700 1 -- 172.21.15.7:0/893120565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e0009a20 con 0x7f24e80c5510 2023-10-14T19:03:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24eda75700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 0x7f24e8157ec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24d800e930 tx=0x7f24d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8013680 con 0x7f24e80c5510 2023-10-14T19:03:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d80137e0 con 0x7f24e80c5510 2023-10-14T19:03:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.215+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8013b80 con 0x7f24e80c5510 2023-10-14T19:03:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.216+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e8152490 con 0x7f24e80c5510 2023-10-14T19:03:18.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.216+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e8152a50 con 0x7f24e80c5510 2023-10-14T19:03:18.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.220+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee40520a0 con 0x7f5ef8150c90 2023-10-14T19:03:18.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.220+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24d800c460 con 0x7f24e80c5510 2023-10-14T19:03:18.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.220+0000 7f24de7fc700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f24cc067000 0x7f24cc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.220+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f24d80845f0 con 0x7f24e80c5510 2023-10-14T19:03:18.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.221+0000 7f24ee276700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f24cc067000 0x7f24cc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.222+0000 7f24ee276700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f24cc067000 0x7f24cc0694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007880 tx=0x7f24e4007f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.234+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e8152f30 con 0x7f24e80c5510 2023-10-14T19:03:18.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.240+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24d80518e0 con 0x7f24e80c5510 2023-10-14T19:03:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.539+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f42d4005590 con 0x7f42e80cb2d0 2023-10-14T19:03:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.556+0000 7f42cffff700 1 -- 172.21.15.7:0/4063756270 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42dc098b10 con 0x7f42e80cb2d0 2023-10-14T19:03:18.560 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.562+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f42d0067230 msgr2=0x7f42d00696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.562+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f42d0067230 0x7f42d00696e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42d800bd20 tx=0x7f42d800b420 comp rx=0 tx=0).stop 2023-10-14T19:03:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.562+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 msgr2=0x7f42e80ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.562+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 0x7f42e80ab410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00b9d0 tx=0x7f42dc0094a0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 shutdown_connections 2023-10-14T19:03:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f42d0067230 0x7f42d00696e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42e80cb2d0 0x7f42e80ab410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42e80afb30 0x7f42e8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 --2- 172.21.15.7:0/4063756270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e80b1880 0x7f42e8154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 >> 172.21.15.7:0/4063756270 conn(0x7f42e80cc300 msgr2=0x7f42e80a5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 shutdown_connections 2023-10-14T19:03:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.563+0000 7f42ee9bf700 1 -- 172.21.15.7:0/4063756270 wait complete. 2023-10-14T19:03:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.580+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b1c156110 con 0x7f7b1c150170 2023-10-14T19:03:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.581+0000 7f7b137fe700 1 -- 172.21.15.7:0/3746937861 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b1c156110 con 0x7f7b1c150170 2023-10-14T19:03:18.584 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:18.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-14T19:03:18.585 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.584+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7afc066f30 msgr2=0x7f7afc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.584+0000 7f7b21467700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7afc066f30 0x7f7afc0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c007880 tx=0x7f7b0c004a80 comp rx=0 tx=0).stop 2023-10-14T19:03:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.584+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c150170 msgr2=0x7f7b1c14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.584+0000 7f7b21467700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c150170 0x7f7b1c14c910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b04015000 tx=0x7f7b04016000 comp rx=0 tx=0).stop 2023-10-14T19:03:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.585+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f71a8005830 con 0x7f71c80b0340 2023-10-14T19:03:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 shutdown_connections 2023-10-14T19:03:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f7b21467700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7afc066f30 0x7f7afc0693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f7b21467700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b1c150540 0x7f7b1c14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f7b21467700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b1c06f1c0 0x7f7b1c158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f7b21467700 1 --2- 172.21.15.7:0/3746937861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c150170 0x7f7b1c14c910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 >> 172.21.15.7:0/3746937861 conn(0x7f7b1c0cc300 msgr2=0x7f7b1c0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd49804c3c0 con 0x7fd49815b750 2023-10-14T19:03:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7f71bdffb700 1 -- 172.21.15.7:0/410785292 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71c0055880 con 0x7f71c80b0340 2023-10-14T19:03:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.586+0000 7fd487fff700 1 -- 172.21.15.7:0/1453022150 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd498139c80 con 0x7fd49815b750 2023-10-14T19:03:18.591 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:18.592 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.588+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 shutdown_connections 2023-10-14T19:03:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7f7b21467700 1 -- 172.21.15.7:0/3746937861 wait complete. 2023-10-14T19:03:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd47c067050 msgr2=0x7fd47c069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd47c067050 0x7fd47c069500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd48800c010 tx=0x7fd488017000 comp rx=0 tx=0).stop 2023-10-14T19:03:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd49815b750 msgr2=0x7fd4981379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd49815b750 0x7fd4981379b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd49000cb90 tx=0x7fd490001980 comp rx=0 tx=0).stop 2023-10-14T19:03:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 shutdown_connections 2023-10-14T19:03:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd47c067050 0x7fd47c069500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd49815b750 0x7fd4981379b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4980af560 0x7fd4981572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 --2- 172.21.15.7:0/1453022150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd498140e50 0x7fd49813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.590+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 >> 172.21.15.7:0/1453022150 conn(0x7fd4980cded0 msgr2=0x7fd49806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.591+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 shutdown_connections 2023-10-14T19:03:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7fd49e4b8700 1 -- 172.21.15.7:0/1453022150 wait complete. 2023-10-14T19:03:18.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ac067000 msgr2=0x7f71ac0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ac067000 0x7f71ac0694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b320 tx=0x7f71b8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:18.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 msgr2=0x7f71c81767c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 0x7f71c81767c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71c8087e10 tx=0x7f71c0007720 comp rx=0 tx=0).stop 2023-10-14T19:03:18.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 shutdown_connections 2023-10-14T19:03:18.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ac067000 0x7f71ac0694b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c8162090 0x7f71c80b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c80b0340 0x7f71c81767c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 --2- 172.21.15.7:0/410785292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71c80afed0 0x7f71c8176280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 >> 172.21.15.7:0/410785292 conn(0x7f71c806d130 msgr2=0x7f71c80c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 shutdown_connections 2023-10-14T19:03:18.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.597+0000 7f71cebe8700 1 -- 172.21.15.7:0/410785292 wait complete. 2023-10-14T19:03:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.608+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4c0005560 con 0x7fb4e014baf0 2023-10-14T19:03:18.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-14T19:03:18.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.609+0000 7fb4dcff9700 1 -- 172.21.15.7:0/3661185648 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4d4055450 con 0x7fb4e014baf0 2023-10-14T19:03:18.610 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:18.611 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.611+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5ef8165d90 con 0x7f5ef8150c90 2023-10-14T19:03:18.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.611+0000 7f5ef4ff9700 1 -- 172.21.15.7:0/1507744187 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ef8165d90 con 0x7f5ef8150c90 2023-10-14T19:03:18.612 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2023-10-14T19:03:18.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb4cc067080 msgr2=0x7fb4cc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb4cc067080 0x7fb4cc069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800a460 tx=0x7fb4d8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:18.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 msgr2=0x7fb4e014bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 0x7fb4e014bec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400f910 tx=0x7fb4d4008040 comp rx=0 tx=0).stop 2023-10-14T19:03:18.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 shutdown_connections 2023-10-14T19:03:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb4cc067080 0x7fb4cc069530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e013d090 0x7fb4e0161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.612+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4e014baf0 0x7fb4e014bec0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.613+0000 7fb4e6fc9700 1 --2- 172.21.15.7:0/3661185648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e01631b0 0x7fb4e013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.613+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 >> 172.21.15.7:0/3661185648 conn(0x7fb4e006d170 msgr2=0x7fb4e015f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.613+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 shutdown_connections 2023-10-14T19:03:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.613+0000 7fb4e6fc9700 1 -- 172.21.15.7:0/3661185648 wait complete. 2023-10-14T19:03:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.614+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5edc067000 msgr2=0x7f5edc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.614+0000 7f5efeb59700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5edc067000 0x7f5edc0694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec007ea0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.614+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 msgr2=0x7f5ef814ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.614+0000 7f5efeb59700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 0x7f5ef814ea60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400ec80 tx=0x7f5ee40091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 shutdown_connections 2023-10-14T19:03:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5edc067000 0x7f5edc0694b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ef81508c0 0x7f5ef8166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ef815a7d0 0x7f5ef80c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 --2- 172.21.15.7:0/1507744187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ef8150c90 0x7f5ef814ea60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 >> 172.21.15.7:0/1507744187 conn(0x7f5ef80cded0 msgr2=0x7f5ef80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 shutdown_connections 2023-10-14T19:03:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.615+0000 7f5efeb59700 1 -- 172.21.15.7:0/1507744187 wait complete. 2023-10-14T19:03:18.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-10-14T19:03:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.619+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe670157020 con 0x7fe67006e930 2023-10-14T19:03:18.621 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-10-14T19:03:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.619+0000 7fe6667fc700 1 -- 172.21.15.7:0/2456301244 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe670157020 con 0x7fe67006e930 2023-10-14T19:03:18.622 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:18.623 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.622+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe65c0670d0 msgr2=0x7fe65c069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.622+0000 7fe6785c7700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe65c0670d0 0x7fe65c069580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6600089b0 tx=0x7fe66001b000 comp rx=0 tx=0).stop 2023-10-14T19:03:18.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.622+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 msgr2=0x7fe670179b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.622+0000 7fe6785c7700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 0x7fe670179b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe66800bc30 tx=0x7fe668009820 comp rx=0 tx=0).stop 2023-10-14T19:03:18.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 shutdown_connections 2023-10-14T19:03:18.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe65c0670d0 0x7fe65c069580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700a8030 0x7fe6700a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67006e930 0x7fe670179b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 --2- 172.21.15.7:0/2456301244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700cb8e0 0x7fe67017a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 >> 172.21.15.7:0/2456301244 conn(0x7fe6700cc300 msgr2=0x7fe6701627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 shutdown_connections 2023-10-14T19:03:18.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.625+0000 7fe6785c7700 1 -- 172.21.15.7:0/2456301244 wait complete. 2023-10-14T19:03:18.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.627+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f24e804c3c0 con 0x7f24e80c5510 2023-10-14T19:03:18.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.628+0000 7f24de7fc700 1 -- 172.21.15.7:0/893120565 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24d8017090 con 0x7f24e80c5510 2023-10-14T19:03:18.628 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2023-10-14T19:03:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f24cc067000 msgr2=0x7f24cc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f24cc067000 0x7f24cc0694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007880 tx=0x7f24e4007f90 comp rx=0 tx=0).stop 2023-10-14T19:03:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 msgr2=0x7f24e8157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 0x7f24e8157ec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24d800e930 tx=0x7f24d80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 shutdown_connections 2023-10-14T19:03:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f24cc067000 0x7f24cc0694b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24e81576a0 0x7f24e8150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24e80c4d80 0x7f24e81519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 --2- 172.21.15.7:0/893120565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e80c5510 0x7f24e8157ec0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 >> 172.21.15.7:0/893120565 conn(0x7f24e80ccb60 msgr2=0x7f24e80cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 shutdown_connections 2023-10-14T19:03:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.630+0000 7f24f04da700 1 -- 172.21.15.7:0/893120565 wait complete. 2023-10-14T19:03:18.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-14T19:03:18.636 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-10-14T19:03:18.637 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-14T19:03:18.641 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-14T19:03:18.645 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:18.645 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T19:03:18.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.802+0000 7f1ed2a90700 1 Processor -- start 2023-10-14T19:03:18.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 -- start start 2023-10-14T19:03:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ecc1508c0 0x7f1ecc158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1ecc150c90 0x7f1ecc0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a0c0 0x7f1ecc15a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc15afc0 con 0x7f1ecc1508c0 2023-10-14T19:03:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0af820 con 0x7f1ecc150c90 2023-10-14T19:03:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed2a90700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc15aa40 con 0x7f1ecc15a0c0 2023-10-14T19:03:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.803+0000 7f1ed082c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ecc1508c0 0x7f1ecc158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ecc1508c0 0x7f1ecc158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38702/0 (socket says 172.21.15.7:38702) 2023-10-14T19:03:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 -- 172.21.15.7:0/224727638 learned_addr learned my addr 172.21.15.7:0/224727638 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ecbfff700 1 --2- 172.21.15.7:0/224727638 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc150c90 0x7f1ecc0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed102d700 1 --2- 172.21.15.7:0/224727638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a0c0 0x7f1ecc15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 -- 172.21.15.7:0/224727638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a0c0 msgr2=0x7f1ecc15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 --2- 172.21.15.7:0/224727638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a0c0 0x7f1ecc15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 -- 172.21.15.7:0/224727638 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc150c90 msgr2=0x7f1ecc0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 --2- 172.21.15.7:0/224727638 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc150c90 0x7f1ecc0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 -- 172.21.15.7:0/224727638 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc158c80 con 0x7f1ecc1508c0 2023-10-14T19:03:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ed082c700 1 --2- 172.21.15.7:0/224727638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc1508c0 0x7f1ecc158650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc06a500 tx=0x7f1ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6c744a20df4110 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ecb7fe700 1 -- 172.21.15.7:0/224727638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400b640 con 0x7f1ecc1508c0 2023-10-14T19:03:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ecb7fe700 1 -- 172.21.15.7:0/224727638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec400b7a0 con 0x7f1ecc1508c0 2023-10-14T19:03:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.804+0000 7f1ecb7fe700 1 -- 172.21.15.7:0/224727638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400bb60 con 0x7f1ecc1508c0 2023-10-14T19:03:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 -- 172.21.15.7:0/224727638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc1508c0 msgr2=0x7f1ecc158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/224727638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc1508c0 0x7f1ecc158650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc06a500 tx=0x7f1ec4009250 comp rx=0 tx=0).stop 2023-10-14T19:03:18.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 -- 172.21.15.7:0/224727638 shutdown_connections 2023-10-14T19:03:18.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/224727638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a0c0 0x7f1ecc15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/224727638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc1508c0 0x7f1ecc158650 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/224727638 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc150c90 0x7f1ecc0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 -- 172.21.15.7:0/224727638 >> 172.21.15.7:0/224727638 conn(0x7f1ecc0cded0 msgr2=0x7f1ecc06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:18.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 -- 172.21.15.7:0/224727638 shutdown_connections 2023-10-14T19:03:18.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.805+0000 7f1ed2a90700 1 -- 172.21.15.7:0/224727638 wait complete. 2023-10-14T19:03:18.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.806+0000 7f1ed2a90700 1 Processor -- start 2023-10-14T19:03:18.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.806+0000 7f1ed2a90700 1 -- start start 2023-10-14T19:03:18.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed2a90700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc1508c0 0x7f1ecc152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed2a90700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 0x7f1ecc153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed2a90700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc15a0c0 0x7f1ecc14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed2a90700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc166990 con 0x7f1ecc150c90 2023-10-14T19:03:18.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed2a90700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc155840 con 0x7f1ecc15a0c0 2023-10-14T19:03:18.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed2a90700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c26b0 con 0x7f1ecc1508c0 2023-10-14T19:03:18.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 0x7f1ecc153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 0x7f1ecc153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38712/0 (socket says 172.21.15.7:38712) 2023-10-14T19:03:18.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 -- 172.21.15.7:0/3257025955 learned_addr learned my addr 172.21.15.7:0/3257025955 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:18.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed102d700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc15a0c0 0x7f1ecc14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ed082c700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc1508c0 0x7f1ecc152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 -- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc1508c0 msgr2=0x7f1ecc152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc1508c0 0x7f1ecc152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 -- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc15a0c0 msgr2=0x7f1ecc14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:18.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc15a0c0 0x7f1ecc14eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:18.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 -- 172.21.15.7:0/3257025955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40094f0 con 0x7f1ecc150c90 2023-10-14T19:03:18.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ecbfff700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 0x7f1ecc153c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009ef0 tx=0x7f1ebc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00cb70 con 0x7f1ecc150c90 2023-10-14T19:03:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.807+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc00f040 con 0x7f1ecc150c90 2023-10-14T19:03:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.808+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc014480 con 0x7f1ecc150c90 2023-10-14T19:03:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.808+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc0c2990 con 0x7f1ecc150c90 2023-10-14T19:03:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.808+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc153430 con 0x7f1ecc150c90 2023-10-14T19:03:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.808+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc155c50 con 0x7f1ecc150c90 2023-10-14T19:03:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.809+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ebc0147f0 con 0x7f1ecc150c90 2023-10-14T19:03:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.809+0000 7f1ec8ff9700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.809+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ebc085130 con 0x7f1ecc150c90 2023-10-14T19:03:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.809+0000 7f1ed082c700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.810+0000 7f1ed082c700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc06a500 tx=0x7f1ec4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:18.813+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ebc0523a0 con 0x7f1ecc150c90 2023-10-14T19:03:19.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.003+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ecc158f60 con 0x7f1eac066f30 2023-10-14T19:03:19.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.011+0000 7f1ec8ff9700 1 -- 172.21.15.7:0/3257025955 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264496 (secure 0 0 0) 0x7f1ecc158f60 con 0x7f1eac066f30 2023-10-14T19:03:19.016 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1eac066f30 msgr2=0x7f1eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc06a500 tx=0x7f1ec4017000 comp rx=0 tx=0).stop 2023-10-14T19:03:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 msgr2=0x7f1ecc153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 0x7f1ecc153c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009ef0 tx=0x7f1ebc00b040 comp rx=0 tx=0).stop 2023-10-14T19:03:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 shutdown_connections 2023-10-14T19:03:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc15a0c0 0x7f1ecc14eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc1508c0 0x7f1ecc152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 --2- 172.21.15.7:0/3257025955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ecc150c90 0x7f1ecc153c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 >> 172.21.15.7:0/3257025955 conn(0x7f1ecc0cded0 msgr2=0x7f1ecc068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:19.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 shutdown_connections 2023-10-14T19:03:19.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.014+0000 7f1ed2a90700 1 -- 172.21.15.7:0/3257025955 wait complete. 2023-10-14T19:03:19.021 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:19.027 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T19:03:17.622742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236802+0000","last_change":"2023-10-14T19:03:10.230691+0000","last_active":"2023-10-14T19:03:10.236802+0000","last_peered":"2023-10-14T19:03:10.236802+0000","last_clean":"2023-10-14T19:03:10.236802+0000","last_became_active":"2023-10-14T19:03:10.230421+0000","last_became_peered":"2023-10-14T19:03:10.230421+0000","last_unstale":"2023-10-14T19:03:10.236802+0000","last_undegraded":"2023-10-14T19:03:10.236802+0000","last_fullsized":"2023-10-14T19:03:10.236802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220866+0000","last_change":"2023-10-14T19:03:10.218785+0000","last_active":"2023-10-14T19:03:10.220866+0000","last_peered":"2023-10-14T19:03:10.220866+0000","last_clean":"2023-10-14T19:03:10.220866+0000","last_became_active":"2023-10-14T19:03:10.218518+0000","last_became_peered":"2023-10-14T19:03:10.218518+0000","last_unstale":"2023-10-14T19:03:10.220866+0000","last_undegraded":"2023-10-14T19:03:10.220866+0000","last_fullsized":"2023-10-14T19:03:10.220866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.218469+0000","last_change":"2023-10-14T19:03:10.212986+0000","last_active":"2023-10-14T19:03:10.218469+0000","last_peered":"2023-10-14T19:03:10.218469+0000","last_clean":"2023-10-14T19:03:10.218469+0000","last_became_active":"2023-10-14T19:03:10.212712+0000","last_became_peered":"2023-10-14T19:03:10.212712+0000","last_unstale":"2023-10-14T19:03:10.218469+0000","last_undegraded":"2023-10-14T19:03:10.218469+0000","last_fullsized":"2023-10-14T19:03:10.218469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226118+0000","last_change":"2023-10-14T19:03:10.222522+0000","last_active":"2023-10-14T19:03:10.226118+0000","last_peered":"2023-10-14T19:03:10.226118+0000","last_clean":"2023-10-14T19:03:10.226118+0000","last_became_active":"2023-10-14T19:03:10.222033+0000","last_became_peered":"2023-10-14T19:03:10.222033+0000","last_unstale":"2023-10-14T19:03:10.226118+0000","last_undegraded":"2023-10-14T19:03:10.226118+0000","last_fullsized":"2023-10-14T19:03:10.226118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233555+0000","last_change":"2023-10-14T19:03:10.227209+0000","last_active":"2023-10-14T19:03:10.233555+0000","last_peered":"2023-10-14T19:03:10.233555+0000","last_clean":"2023-10-14T19:03:10.233555+0000","last_became_active":"2023-10-14T19:03:10.226848+0000","last_became_peered":"2023-10-14T19:03:10.226848+0000","last_unstale":"2023-10-14T19:03:10.233555+0000","last_undegraded":"2023-10-14T19:03:10.233555+0000","last_fullsized":"2023-10-14T19:03:10.233555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231156+0000","last_change":"2023-10-14T19:03:10.226159+0000","last_active":"2023-10-14T19:03:10.231156+0000","last_peered":"2023-10-14T19:03:10.231156+0000","last_clean":"2023-10-14T19:03:10.231156+0000","last_became_active":"2023-10-14T19:03:10.225860+0000","last_became_peered":"2023-10-14T19:03:10.225860+0000","last_unstale":"2023-10-14T19:03:10.231156+0000","last_undegraded":"2023-10-14T19:03:10.231156+0000","last_fullsized":"2023-10-14T19:03:10.231156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229437+0000","last_change":"2023-10-14T19:03:10.222973+0000","last_active":"2023-10-14T19:03:10.229437+0000","last_peered":"2023-10-14T19:03:10.229437+0000","last_clean":"2023-10-14T19:03:10.229437+0000","last_became_active":"2023-10-14T19:03:10.222694+0000","last_became_peered":"2023-10-14T19:03:10.222694+0000","last_unstale":"2023-10-14T19:03:10.229437+0000","last_undegraded":"2023-10-14T19:03:10.229437+0000","last_fullsized":"2023-10-14T19:03:10.229437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227789+0000","last_change":"2023-10-14T19:03:10.226142+0000","last_active":"2023-10-14T19:03:10.227789+0000","last_peered":"2023-10-14T19:03:10.227789+0000","last_clean":"2023-10-14T19:03:10.227789+0000","last_became_active":"2023-10-14T19:03:10.225807+0000","last_became_peered":"2023-10-14T19:03:10.225807+0000","last_unstale":"2023-10-14T19:03:10.227789+0000","last_undegraded":"2023-10-14T19:03:10.227789+0000","last_fullsized":"2023-10-14T19:03:10.227789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239732+0000","last_change":"2023-10-14T19:03:10.234612+0000","last_active":"2023-10-14T19:03:10.239732+0000","last_peered":"2023-10-14T19:03:10.239732+0000","last_clean":"2023-10-14T19:03:10.239732+0000","last_became_active":"2023-10-14T19:03:10.234121+0000","last_became_peered":"2023-10-14T19:03:10.234121+0000","last_unstale":"2023-10-14T19:03:10.239732+0000","last_undegraded":"2023-10-14T19:03:10.239732+0000","last_fullsized":"2023-10-14T19:03:10.239732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:05:02.219977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.232472+0000","last_change":"2023-10-14T19:03:10.227725+0000","last_active":"2023-10-14T19:03:10.232472+0000","last_peered":"2023-10-14T19:03:10.232472+0000","last_clean":"2023-10-14T19:03:10.232472+0000","last_became_active":"2023-10-14T19:03:10.227514+0000","last_became_peered":"2023-10-14T19:03:10.227514+0000","last_unstale":"2023-10-14T19:03:10.232472+0000","last_undegraded":"2023-10-14T19:03:10.232472+0000","last_fullsized":"2023-10-14T19:03:10.232472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230503+0000","last_change":"2023-10-14T19:03:10.225519+0000","last_active":"2023-10-14T19:03:10.230503+0000","last_peered":"2023-10-14T19:03:10.230503+0000","last_clean":"2023-10-14T19:03:10.230503+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230503+0000","last_undegraded":"2023-10-14T19:03:10.230503+0000","last_fullsized":"2023-10-14T19:03:10.230503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226243+0000","last_change":"2023-10-14T19:03:10.222180+0000","last_active":"2023-10-14T19:03:10.226243+0000","last_peered":"2023-10-14T19:03:10.226243+0000","last_clean":"2023-10-14T19:03:10.226243+0000","last_became_active":"2023-10-14T19:03:10.221860+0000","last_became_peered":"2023-10-14T19:03:10.221860+0000","last_unstale":"2023-10-14T19:03:10.226243+0000","last_undegraded":"2023-10-14T19:03:10.226243+0000","last_fullsized":"2023-10-14T19:03:10.226243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:06.624716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224317+0000","last_change":"2023-10-14T19:03:10.221789+0000","last_active":"2023-10-14T19:03:10.224317+0000","last_peered":"2023-10-14T19:03:10.224317+0000","last_clean":"2023-10-14T19:03:10.224317+0000","last_became_active":"2023-10-14T19:03:10.221495+0000","last_became_peered":"2023-10-14T19:03:10.221495+0000","last_unstale":"2023-10-14T19:03:10.224317+0000","last_undegraded":"2023-10-14T19:03:10.224317+0000","last_fullsized":"2023-10-14T19:03:10.224317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223791+0000","last_change":"2023-10-14T19:03:10.220586+0000","last_active":"2023-10-14T19:03:10.223791+0000","last_peered":"2023-10-14T19:03:10.223791+0000","last_clean":"2023-10-14T19:03:10.223791+0000","last_became_active":"2023-10-14T19:03:10.220319+0000","last_became_peered":"2023-10-14T19:03:10.220319+0000","last_unstale":"2023-10-14T19:03:10.223791+0000","last_undegraded":"2023-10-14T19:03:10.223791+0000","last_fullsized":"2023-10-14T19:03:10.223791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219497+0000","last_change":"2023-10-14T19:03:10.216808+0000","last_active":"2023-10-14T19:03:10.219497+0000","last_peered":"2023-10-14T19:03:10.219497+0000","last_clean":"2023-10-14T19:03:10.219497+0000","last_became_active":"2023-10-14T19:03:10.215467+0000","last_became_peered":"2023-10-14T19:03:10.215467+0000","last_unstale":"2023-10-14T19:03:10.219497+0000","last_undegraded":"2023-10-14T19:03:10.219497+0000","last_fullsized":"2023-10-14T19:03:10.219497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231936+0000","last_change":"2023-10-14T19:03:10.226710+0000","last_active":"2023-10-14T19:03:10.231936+0000","last_peered":"2023-10-14T19:03:10.231936+0000","last_clean":"2023-10-14T19:03:10.231936+0000","last_became_active":"2023-10-14T19:03:10.226470+0000","last_became_peered":"2023-10-14T19:03:10.226470+0000","last_unstale":"2023-10-14T19:03:10.231936+0000","last_undegraded":"2023-10-14T19:03:10.231936+0000","last_fullsized":"2023-10-14T19:03:10.231936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230949+0000","last_change":"2023-10-14T19:03:10.227805+0000","last_active":"2023-10-14T19:03:10.230949+0000","last_peered":"2023-10-14T19:03:10.230949+0000","last_clean":"2023-10-14T19:03:10.230949+0000","last_became_active":"2023-10-14T19:03:10.227530+0000","last_became_peered":"2023-10-14T19:03:10.227530+0000","last_unstale":"2023-10-14T19:03:10.230949+0000","last_undegraded":"2023-10-14T19:03:10.230949+0000","last_fullsized":"2023-10-14T19:03:10.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212844+0000","last_change":"2023-10-14T19:03:10.211421+0000","last_active":"2023-10-14T19:03:10.212844+0000","last_peered":"2023-10-14T19:03:10.212844+0000","last_clean":"2023-10-14T19:03:10.212844+0000","last_became_active":"2023-10-14T19:03:10.211127+0000","last_became_peered":"2023-10-14T19:03:10.211127+0000","last_unstale":"2023-10-14T19:03:10.212844+0000","last_undegraded":"2023-10-14T19:03:10.212844+0000","last_fullsized":"2023-10-14T19:03:10.212844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:47.109849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233763+0000","last_change":"2023-10-14T19:03:10.227239+0000","last_active":"2023-10-14T19:03:10.233763+0000","last_peered":"2023-10-14T19:03:10.233763+0000","last_clean":"2023-10-14T19:03:10.233763+0000","last_became_active":"2023-10-14T19:03:10.226914+0000","last_became_peered":"2023-10-14T19:03:10.226914+0000","last_unstale":"2023-10-14T19:03:10.233763+0000","last_undegraded":"2023-10-14T19:03:10.233763+0000","last_fullsized":"2023-10-14T19:03:10.233763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236969+0000","last_change":"2023-10-14T19:03:09.214413+0000","last_active":"2023-10-14T19:03:10.236969+0000","last_peered":"2023-10-14T19:03:10.236969+0000","last_clean":"2023-10-14T19:03:10.236969+0000","last_became_active":"2023-10-14T19:03:09.214117+0000","last_became_peered":"2023-10-14T19:03:09.214117+0000","last_unstale":"2023-10-14T19:03:10.236969+0000","last_undegraded":"2023-10-14T19:03:10.236969+0000","last_fullsized":"2023-10-14T19:03:10.236969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:55.947066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231800+0000","last_change":"2023-10-14T19:03:10.231111+0000","last_active":"2023-10-14T19:03:10.231800+0000","last_peered":"2023-10-14T19:03:10.231800+0000","last_clean":"2023-10-14T19:03:10.231800+0000","last_became_active":"2023-10-14T19:03:10.230749+0000","last_became_peered":"2023-10-14T19:03:10.230749+0000","last_unstale":"2023-10-14T19:03:10.231800+0000","last_undegraded":"2023-10-14T19:03:10.231800+0000","last_fullsized":"2023-10-14T19:03:10.231800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230362+0000","last_change":"2023-10-14T19:03:09.209057+0000","last_active":"2023-10-14T19:03:10.230362+0000","last_peered":"2023-10-14T19:03:10.230362+0000","last_clean":"2023-10-14T19:03:10.230362+0000","last_became_active":"2023-10-14T19:03:09.208250+0000","last_became_peered":"2023-10-14T19:03:09.208250+0000","last_unstale":"2023-10-14T19:03:10.230362+0000","last_undegraded":"2023-10-14T19:03:10.230362+0000","last_fullsized":"2023-10-14T19:03:10.230362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229580+0000","last_change":"2023-10-14T19:03:10.227667+0000","last_active":"2023-10-14T19:03:10.229580+0000","last_peered":"2023-10-14T19:03:10.229580+0000","last_clean":"2023-10-14T19:03:10.229580+0000","last_became_active":"2023-10-14T19:03:10.227114+0000","last_became_peered":"2023-10-14T19:03:10.227114+0000","last_unstale":"2023-10-14T19:03:10.229580+0000","last_undegraded":"2023-10-14T19:03:10.229580+0000","last_fullsized":"2023-10-14T19:03:10.229580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236879+0000","last_change":"2023-10-14T19:03:09.215258+0000","last_active":"2023-10-14T19:03:10.236879+0000","last_peered":"2023-10-14T19:03:10.236879+0000","last_clean":"2023-10-14T19:03:10.236879+0000","last_became_active":"2023-10-14T19:03:09.214984+0000","last_became_peered":"2023-10-14T19:03:09.214984+0000","last_unstale":"2023-10-14T19:03:10.236879+0000","last_undegraded":"2023-10-14T19:03:10.236879+0000","last_fullsized":"2023-10-14T19:03:10.236879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230515+0000","last_change":"2023-10-14T19:03:10.225703+0000","last_active":"2023-10-14T19:03:10.230515+0000","last_peered":"2023-10-14T19:03:10.230515+0000","last_clean":"2023-10-14T19:03:10.230515+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230515+0000","last_undegraded":"2023-10-14T19:03:10.230515+0000","last_fullsized":"2023-10-14T19:03:10.230515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239608+0000","last_change":"2023-10-14T19:03:09.211764+0000","last_active":"2023-10-14T19:03:10.239608+0000","last_peered":"2023-10-14T19:03:10.239608+0000","last_clean":"2023-10-14T19:03:10.239608+0000","last_became_active":"2023-10-14T19:03:09.211476+0000","last_became_peered":"2023-10-14T19:03:09.211476+0000","last_unstale":"2023-10-14T19:03:10.239608+0000","last_undegraded":"2023-10-14T19:03:10.239608+0000","last_fullsized":"2023-10-14T19:03:10.239608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:46.105558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230389+0000","last_change":"2023-10-14T19:03:10.224871+0000","last_active":"2023-10-14T19:03:10.230389+0000","last_peered":"2023-10-14T19:03:10.230389+0000","last_clean":"2023-10-14T19:03:10.230389+0000","last_became_active":"2023-10-14T19:03:10.224578+0000","last_became_peered":"2023-10-14T19:03:10.224578+0000","last_unstale":"2023-10-14T19:03:10.230389+0000","last_undegraded":"2023-10-14T19:03:10.230389+0000","last_fullsized":"2023-10-14T19:03:10.230389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.234024+0000","last_change":"2023-10-14T19:03:09.211558+0000","last_active":"2023-10-14T19:03:10.234024+0000","last_peered":"2023-10-14T19:03:10.234024+0000","last_clean":"2023-10-14T19:03:10.234024+0000","last_became_active":"2023-10-14T19:03:09.211048+0000","last_became_peered":"2023-10-14T19:03:09.211048+0000","last_unstale":"2023-10-14T19:03:10.234024+0000","last_undegraded":"2023-10-14T19:03:10.234024+0000","last_fullsized":"2023-10-14T19:03:10.234024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.215674+0000","last_change":"2023-10-14T19:03:10.210948+0000","last_active":"2023-10-14T19:03:10.215674+0000","last_peered":"2023-10-14T19:03:10.215674+0000","last_clean":"2023-10-14T19:03:10.215674+0000","last_became_active":"2023-10-14T19:03:10.210692+0000","last_became_peered":"2023-10-14T19:03:10.210692+0000","last_unstale":"2023-10-14T19:03:10.215674+0000","last_undegraded":"2023-10-14T19:03:10.215674+0000","last_fullsized":"2023-10-14T19:03:10.215674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241934+0000","last_change":"2023-10-14T19:03:09.212235+0000","last_active":"2023-10-14T19:03:10.241934+0000","last_peered":"2023-10-14T19:03:10.241934+0000","last_clean":"2023-10-14T19:03:10.241934+0000","last_became_active":"2023-10-14T19:03:09.209044+0000","last_became_peered":"2023-10-14T19:03:09.209044+0000","last_unstale":"2023-10-14T19:03:10.241934+0000","last_undegraded":"2023-10-14T19:03:10.241934+0000","last_fullsized":"2023-10-14T19:03:10.241934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219586+0000","last_change":"2023-10-14T19:03:10.216947+0000","last_active":"2023-10-14T19:03:10.219586+0000","last_peered":"2023-10-14T19:03:10.219586+0000","last_clean":"2023-10-14T19:03:10.219586+0000","last_became_active":"2023-10-14T19:03:10.216625+0000","last_became_peered":"2023-10-14T19:03:10.216625+0000","last_unstale":"2023-10-14T19:03:10.219586+0000","last_undegraded":"2023-10-14T19:03:10.219586+0000","last_fullsized":"2023-10-14T19:03:10.219586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.208754+0000","last_change":"2023-10-14T19:03:09.210714+0000","last_active":"2023-10-14T19:03:10.208754+0000","last_peered":"2023-10-14T19:03:10.208754+0000","last_clean":"2023-10-14T19:03:10.208754+0000","last_became_active":"2023-10-14T19:03:09.210471+0000","last_became_peered":"2023-10-14T19:03:09.210471+0000","last_unstale":"2023-10-14T19:03:10.208754+0000","last_undegraded":"2023-10-14T19:03:10.208754+0000","last_fullsized":"2023-10-14T19:03:10.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224023+0000","last_change":"2023-10-14T19:03:10.220661+0000","last_active":"2023-10-14T19:03:10.224023+0000","last_peered":"2023-10-14T19:03:10.224023+0000","last_clean":"2023-10-14T19:03:10.224023+0000","last_became_active":"2023-10-14T19:03:10.220323+0000","last_became_peered":"2023-10-14T19:03:10.220323+0000","last_unstale":"2023-10-14T19:03:10.224023+0000","last_undegraded":"2023-10-14T19:03:10.224023+0000","last_fullsized":"2023-10-14T19:03:10.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.210972+0000","last_change":"2023-10-14T19:03:09.209100+0000","last_active":"2023-10-14T19:03:10.210972+0000","last_peered":"2023-10-14T19:03:10.210972+0000","last_clean":"2023-10-14T19:03:10.210972+0000","last_became_active":"2023-10-14T19:03:09.208831+0000","last_became_peered":"2023-10-14T19:03:09.208831+0000","last_unstale":"2023-10-14T19:03:10.210972+0000","last_undegraded":"2023-10-14T19:03:10.210972+0000","last_fullsized":"2023-10-14T19:03:10.210972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219475+0000","last_change":"2023-10-14T19:03:10.216390+0000","last_active":"2023-10-14T19:03:10.219475+0000","last_peered":"2023-10-14T19:03:10.219475+0000","last_clean":"2023-10-14T19:03:10.219475+0000","last_became_active":"2023-10-14T19:03:10.215498+0000","last_became_peered":"2023-10-14T19:03:10.215498+0000","last_unstale":"2023-10-14T19:03:10.219475+0000","last_undegraded":"2023-10-14T19:03:10.219475+0000","last_fullsized":"2023-10-14T19:03:10.219475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220845+0000","last_change":"2023-10-14T19:03:09.211585+0000","last_active":"2023-10-14T19:03:10.220845+0000","last_peered":"2023-10-14T19:03:10.220845+0000","last_clean":"2023-10-14T19:03:10.220845+0000","last_became_active":"2023-10-14T19:03:09.211314+0000","last_became_peered":"2023-10-14T19:03:09.211314+0000","last_unstale":"2023-10-14T19:03:10.220845+0000","last_undegraded":"2023-10-14T19:03:10.220845+0000","last_fullsized":"2023-10-14T19:03:10.220845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.225113+0000","last_change":"2023-10-14T19:03:10.220371+0000","last_active":"2023-10-14T19:03:10.225113+0000","last_peered":"2023-10-14T19:03:10.225113+0000","last_clean":"2023-10-14T19:03:10.225113+0000","last_became_active":"2023-10-14T19:03:10.220030+0000","last_became_peered":"2023-10-14T19:03:10.220030+0000","last_unstale":"2023-10-14T19:03:10.225113+0000","last_undegraded":"2023-10-14T19:03:10.225113+0000","last_fullsized":"2023-10-14T19:03:10.225113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212066+0000","last_change":"2023-10-14T19:03:09.213906+0000","last_active":"2023-10-14T19:03:10.212066+0000","last_peered":"2023-10-14T19:03:10.212066+0000","last_clean":"2023-10-14T19:03:10.212066+0000","last_became_active":"2023-10-14T19:03:09.213622+0000","last_became_peered":"2023-10-14T19:03:09.213622+0000","last_unstale":"2023-10-14T19:03:10.212066+0000","last_undegraded":"2023-10-14T19:03:10.212066+0000","last_fullsized":"2023-10-14T19:03:10.212066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230062+0000","last_change":"2023-10-14T19:03:10.229217+0000","last_active":"2023-10-14T19:03:10.230062+0000","last_peered":"2023-10-14T19:03:10.230062+0000","last_clean":"2023-10-14T19:03:10.230062+0000","last_became_active":"2023-10-14T19:03:10.228955+0000","last_became_peered":"2023-10-14T19:03:10.228955+0000","last_unstale":"2023-10-14T19:03:10.230062+0000","last_undegraded":"2023-10-14T19:03:10.230062+0000","last_fullsized":"2023-10-14T19:03:10.230062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233544+0000","last_change":"2023-10-14T19:03:09.212292+0000","last_active":"2023-10-14T19:03:10.233544+0000","last_peered":"2023-10-14T19:03:10.233544+0000","last_clean":"2023-10-14T19:03:10.233544+0000","last_became_active":"2023-10-14T19:03:09.211886+0000","last_became_peered":"2023-10-14T19:03:09.211886+0000","last_unstale":"2023-10-14T19:03:10.233544+0000","last_undegraded":"2023-10-14T19:03:10.233544+0000","last_fullsized":"2023-10-14T19:03:10.233544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241806+0000","last_change":"2023-10-14T19:03:10.232172+0000","last_active":"2023-10-14T19:03:10.241806+0000","last_peered":"2023-10-14T19:03:10.241806+0000","last_clean":"2023-10-14T19:03:10.241806+0000","last_became_active":"2023-10-14T19:03:10.231839+0000","last_became_peered":"2023-10-14T19:03:10.231839+0000","last_unstale":"2023-10-14T19:03:10.241806+0000","last_undegraded":"2023-10-14T19:03:10.241806+0000","last_fullsized":"2023-10-14T19:03:10.241806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242055+0000","last_change":"2023-10-14T19:03:09.213629+0000","last_active":"2023-10-14T19:03:10.242055+0000","last_peered":"2023-10-14T19:03:10.242055+0000","last_clean":"2023-10-14T19:03:10.242055+0000","last_became_active":"2023-10-14T19:03:09.213380+0000","last_became_peered":"2023-10-14T19:03:09.213380+0000","last_unstale":"2023-10-14T19:03:10.242055+0000","last_undegraded":"2023-10-14T19:03:10.242055+0000","last_fullsized":"2023-10-14T19:03:10.242055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233796+0000","last_change":"2023-10-14T19:03:10.227726+0000","last_active":"2023-10-14T19:03:10.233796+0000","last_peered":"2023-10-14T19:03:10.233796+0000","last_clean":"2023-10-14T19:03:10.233796+0000","last_became_active":"2023-10-14T19:03:10.227442+0000","last_became_peered":"2023-10-14T19:03:10.227442+0000","last_unstale":"2023-10-14T19:03:10.233796+0000","last_undegraded":"2023-10-14T19:03:10.233796+0000","last_fullsized":"2023-10-14T19:03:10.233796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239821+0000","last_change":"2023-10-14T19:03:09.206678+0000","last_active":"2023-10-14T19:03:10.239821+0000","last_peered":"2023-10-14T19:03:10.239821+0000","last_clean":"2023-10-14T19:03:10.239821+0000","last_became_active":"2023-10-14T19:03:09.206186+0000","last_became_peered":"2023-10-14T19:03:09.206186+0000","last_unstale":"2023-10-14T19:03:10.239821+0000","last_undegraded":"2023-10-14T19:03:10.239821+0000","last_fullsized":"2023-10-14T19:03:10.239821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219137+0000","last_change":"2023-10-14T19:03:10.216802+0000","last_active":"2023-10-14T19:03:10.219137+0000","last_peered":"2023-10-14T19:03:10.219137+0000","last_clean":"2023-10-14T19:03:10.219137+0000","last_became_active":"2023-10-14T19:03:10.216416+0000","last_became_peered":"2023-10-14T19:03:10.216416+0000","last_unstale":"2023-10-14T19:03:10.219137+0000","last_undegraded":"2023-10-14T19:03:10.219137+0000","last_fullsized":"2023-10-14T19:03:10.219137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211294+0000","last_change":"2023-10-14T19:03:09.211236+0000","last_active":"2023-10-14T19:03:10.211294+0000","last_peered":"2023-10-14T19:03:10.211294+0000","last_clean":"2023-10-14T19:03:10.211294+0000","last_became_active":"2023-10-14T19:03:09.210972+0000","last_became_peered":"2023-10-14T19:03:09.210972+0000","last_unstale":"2023-10-14T19:03:10.211294+0000","last_undegraded":"2023-10-14T19:03:10.211294+0000","last_fullsized":"2023-10-14T19:03:10.211294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241921+0000","last_change":"2023-10-14T19:03:10.236770+0000","last_active":"2023-10-14T19:03:10.241921+0000","last_peered":"2023-10-14T19:03:10.241921+0000","last_clean":"2023-10-14T19:03:10.241921+0000","last_became_active":"2023-10-14T19:03:10.235368+0000","last_became_peered":"2023-10-14T19:03:10.235368+0000","last_unstale":"2023-10-14T19:03:10.241921+0000","last_undegraded":"2023-10-14T19:03:10.241921+0000","last_fullsized":"2023-10-14T19:03:10.241921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212724+0000","last_change":"2023-10-14T19:03:09.214552+0000","last_active":"2023-10-14T19:03:10.212724+0000","last_peered":"2023-10-14T19:03:10.212724+0000","last_clean":"2023-10-14T19:03:10.212724+0000","last_became_active":"2023-10-14T19:03:09.214229+0000","last_became_peered":"2023-10-14T19:03:09.214229+0000","last_unstale":"2023-10-14T19:03:10.212724+0000","last_undegraded":"2023-10-14T19:03:10.212724+0000","last_fullsized":"2023-10-14T19:03:10.212724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220484+0000","last_change":"2023-10-14T19:03:10.215197+0000","last_active":"2023-10-14T19:03:10.220484+0000","last_peered":"2023-10-14T19:03:10.220484+0000","last_clean":"2023-10-14T19:03:10.220484+0000","last_became_active":"2023-10-14T19:03:10.214896+0000","last_became_peered":"2023-10-14T19:03:10.214896+0000","last_unstale":"2023-10-14T19:03:10.220484+0000","last_undegraded":"2023-10-14T19:03:10.220484+0000","last_fullsized":"2023-10-14T19:03:10.220484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233697+0000","last_change":"2023-10-14T19:03:09.212453+0000","last_active":"2023-10-14T19:03:10.233697+0000","last_peered":"2023-10-14T19:03:10.233697+0000","last_clean":"2023-10-14T19:03:10.233697+0000","last_became_active":"2023-10-14T19:03:09.212138+0000","last_became_peered":"2023-10-14T19:03:09.212138+0000","last_unstale":"2023-10-14T19:03:10.233697+0000","last_undegraded":"2023-10-14T19:03:10.233697+0000","last_fullsized":"2023-10-14T19:03:10.233697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233462+0000","last_change":"2023-10-14T19:03:10.227505+0000","last_active":"2023-10-14T19:03:10.233462+0000","last_peered":"2023-10-14T19:03:10.233462+0000","last_clean":"2023-10-14T19:03:10.233462+0000","last_became_active":"2023-10-14T19:03:10.227226+0000","last_became_peered":"2023-10-14T19:03:10.227226+0000","last_unstale":"2023-10-14T19:03:10.233462+0000","last_undegraded":"2023-10-14T19:03:10.233462+0000","last_fullsized":"2023-10-14T19:03:10.233462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239242+0000","last_change":"2023-10-14T19:03:09.210288+0000","last_active":"2023-10-14T19:03:10.239242+0000","last_peered":"2023-10-14T19:03:10.239242+0000","last_clean":"2023-10-14T19:03:10.239242+0000","last_became_active":"2023-10-14T19:03:09.210053+0000","last_became_peered":"2023-10-14T19:03:09.210053+0000","last_unstale":"2023-10-14T19:03:10.239242+0000","last_undegraded":"2023-10-14T19:03:10.239242+0000","last_fullsized":"2023-10-14T19:03:10.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:39.004888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241891+0000","last_change":"2023-10-14T19:03:10.236537+0000","last_active":"2023-10-14T19:03:10.241891+0000","last_peered":"2023-10-14T19:03:10.241891+0000","last_clean":"2023-10-14T19:03:10.241891+0000","last_became_active":"2023-10-14T19:03:10.236256+0000","last_became_peered":"2023-10-14T19:03:10.236256+0000","last_unstale":"2023-10-14T19:03:10.241891+0000","last_undegraded":"2023-10-14T19:03:10.241891+0000","last_fullsized":"2023-10-14T19:03:10.241891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205718+0000","last_change":"2023-10-14T19:03:09.212576+0000","last_active":"2023-10-14T19:03:10.205718+0000","last_peered":"2023-10-14T19:03:10.205718+0000","last_clean":"2023-10-14T19:03:10.205718+0000","last_became_active":"2023-10-14T19:03:09.212291+0000","last_became_peered":"2023-10-14T19:03:09.212291+0000","last_unstale":"2023-10-14T19:03:10.205718+0000","last_undegraded":"2023-10-14T19:03:10.205718+0000","last_fullsized":"2023-10-14T19:03:10.205718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230366+0000","last_change":"2023-10-14T19:03:10.224600+0000","last_active":"2023-10-14T19:03:10.230366+0000","last_peered":"2023-10-14T19:03:10.230366+0000","last_clean":"2023-10-14T19:03:10.230366+0000","last_became_active":"2023-10-14T19:03:10.222507+0000","last_became_peered":"2023-10-14T19:03:10.222507+0000","last_unstale":"2023-10-14T19:03:10.230366+0000","last_undegraded":"2023-10-14T19:03:10.230366+0000","last_fullsized":"2023-10-14T19:03:10.230366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211190+0000","last_change":"2023-10-14T19:03:09.214386+0000","last_active":"2023-10-14T19:03:10.211190+0000","last_peered":"2023-10-14T19:03:10.211190+0000","last_clean":"2023-10-14T19:03:10.211190+0000","last_became_active":"2023-10-14T19:03:09.214062+0000","last_became_peered":"2023-10-14T19:03:09.214062+0000","last_unstale":"2023-10-14T19:03:10.211190+0000","last_undegraded":"2023-10-14T19:03:10.211190+0000","last_fullsized":"2023-10-14T19:03:10.211190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228871+0000","last_change":"2023-10-14T19:03:10.222746+0000","last_active":"2023-10-14T19:03:10.228871+0000","last_peered":"2023-10-14T19:03:10.228871+0000","last_clean":"2023-10-14T19:03:10.228871+0000","last_became_active":"2023-10-14T19:03:10.221548+0000","last_became_peered":"2023-10-14T19:03:10.221548+0000","last_unstale":"2023-10-14T19:03:10.228871+0000","last_undegraded":"2023-10-14T19:03:10.228871+0000","last_fullsized":"2023-10-14T19:03:10.228871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213873+0000","last_change":"2023-10-14T19:03:10.211030+0000","last_active":"2023-10-14T19:03:10.213873+0000","last_peered":"2023-10-14T19:03:10.213873+0000","last_clean":"2023-10-14T19:03:10.213873+0000","last_became_active":"2023-10-14T19:03:10.210612+0000","last_became_peered":"2023-10-14T19:03:10.210612+0000","last_unstale":"2023-10-14T19:03:10.213873+0000","last_undegraded":"2023-10-14T19:03:10.213873+0000","last_fullsized":"2023-10-14T19:03:10.213873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.203993+0000","last_change":"2023-10-14T19:03:09.207759+0000","last_active":"2023-10-14T19:03:10.203993+0000","last_peered":"2023-10-14T19:03:10.203993+0000","last_clean":"2023-10-14T19:03:10.203993+0000","last_became_active":"2023-10-14T19:03:09.207466+0000","last_became_peered":"2023-10-14T19:03:09.207466+0000","last_unstale":"2023-10-14T19:03:10.203993+0000","last_undegraded":"2023-10-14T19:03:10.203993+0000","last_fullsized":"2023-10-14T19:03:10.203993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227804+0000","last_change":"2023-10-14T19:03:10.226423+0000","last_active":"2023-10-14T19:03:10.227804+0000","last_peered":"2023-10-14T19:03:10.227804+0000","last_clean":"2023-10-14T19:03:10.227804+0000","last_became_active":"2023-10-14T19:03:10.226147+0000","last_became_peered":"2023-10-14T19:03:10.226147+0000","last_unstale":"2023-10-14T19:03:10.227804+0000","last_undegraded":"2023-10-14T19:03:10.227804+0000","last_fullsized":"2023-10-14T19:03:10.227804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211113+0000","last_change":"2023-10-14T19:03:09.200879+0000","last_active":"2023-10-14T19:03:10.211113+0000","last_peered":"2023-10-14T19:03:10.211113+0000","last_clean":"2023-10-14T19:03:10.211113+0000","last_became_active":"2023-10-14T19:03:09.200600+0000","last_became_peered":"2023-10-14T19:03:09.200600+0000","last_unstale":"2023-10-14T19:03:10.211113+0000","last_undegraded":"2023-10-14T19:03:10.211113+0000","last_fullsized":"2023-10-14T19:03:10.211113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214084+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:10.214084+0000","last_peered":"2023-10-14T19:03:10.214084+0000","last_clean":"2023-10-14T19:03:10.214084+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:10.214084+0000","last_undegraded":"2023-10-14T19:03:10.214084+0000","last_fullsized":"2023-10-14T19:03:10.214084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224176+0000","last_change":"2023-10-14T19:03:10.222157+0000","last_active":"2023-10-14T19:03:10.224176+0000","last_peered":"2023-10-14T19:03:10.224176+0000","last_clean":"2023-10-14T19:03:10.224176+0000","last_became_active":"2023-10-14T19:03:10.221908+0000","last_became_peered":"2023-10-14T19:03:10.221908+0000","last_unstale":"2023-10-14T19:03:10.224176+0000","last_undegraded":"2023-10-14T19:03:10.224176+0000","last_fullsized":"2023-10-14T19:03:10.224176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214197+0000","last_change":"2023-10-14T19:03:09.213139+0000","last_active":"2023-10-14T19:03:10.214197+0000","last_peered":"2023-10-14T19:03:10.214197+0000","last_clean":"2023-10-14T19:03:10.214197+0000","last_became_active":"2023-10-14T19:03:09.212808+0000","last_became_peered":"2023-10-14T19:03:09.212808+0000","last_unstale":"2023-10-14T19:03:10.214197+0000","last_undegraded":"2023-10-14T19:03:10.214197+0000","last_fullsized":"2023-10-14T19:03:10.214197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:57.697128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.217896+0000","last_change":"2023-10-14T19:03:09.211906+0000","last_active":"2023-10-14T19:03:10.217896+0000","last_peered":"2023-10-14T19:03:10.217896+0000","last_clean":"2023-10-14T19:03:10.217896+0000","last_became_active":"2023-10-14T19:03:09.211587+0000","last_became_peered":"2023-10-14T19:03:09.211587+0000","last_unstale":"2023-10-14T19:03:10.217896+0000","last_undegraded":"2023-10-14T19:03:10.217896+0000","last_fullsized":"2023-10-14T19:03:10.217896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213831+0000","last_change":"2023-10-14T19:03:10.210444+0000","last_active":"2023-10-14T19:03:10.213831+0000","last_peered":"2023-10-14T19:03:10.213831+0000","last_clean":"2023-10-14T19:03:10.213831+0000","last_became_active":"2023-10-14T19:03:10.210175+0000","last_became_peered":"2023-10-14T19:03:10.210175+0000","last_unstale":"2023-10-14T19:03:10.213831+0000","last_undegraded":"2023-10-14T19:03:10.213831+0000","last_fullsized":"2023-10-14T19:03:10.213831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T19:03:12.015820+0000","last_change":"2023-10-14T19:03:09.213704+0000","last_active":"2023-10-14T19:03:12.015820+0000","last_peered":"2023-10-14T19:03:12.015820+0000","last_clean":"2023-10-14T19:03:12.015820+0000","last_became_active":"2023-10-14T19:03:09.213422+0000","last_became_peered":"2023-10-14T19:03:09.213422+0000","last_unstale":"2023-10-14T19:03:12.015820+0000","last_undegraded":"2023-10-14T19:03:12.015820+0000","last_fullsized":"2023-10-14T19:03:12.015820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229985+0000","last_change":"2023-10-14T19:03:10.227711+0000","last_active":"2023-10-14T19:03:10.229985+0000","last_peered":"2023-10-14T19:03:10.229985+0000","last_clean":"2023-10-14T19:03:10.229985+0000","last_became_active":"2023-10-14T19:03:10.227271+0000","last_became_peered":"2023-10-14T19:03:10.227271+0000","last_unstale":"2023-10-14T19:03:10.229985+0000","last_undegraded":"2023-10-14T19:03:10.229985+0000","last_fullsized":"2023-10-14T19:03:10.229985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.237073+0000","last_change":"2023-10-14T19:03:09.214397+0000","last_active":"2023-10-14T19:03:10.237073+0000","last_peered":"2023-10-14T19:03:10.237073+0000","last_clean":"2023-10-14T19:03:10.237073+0000","last_became_active":"2023-10-14T19:03:09.214100+0000","last_became_peered":"2023-10-14T19:03:09.214100+0000","last_unstale":"2023-10-14T19:03:10.237073+0000","last_undegraded":"2023-10-14T19:03:10.237073+0000","last_fullsized":"2023-10-14T19:03:10.237073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223211+0000","last_change":"2023-10-14T19:03:10.220584+0000","last_active":"2023-10-14T19:03:10.223211+0000","last_peered":"2023-10-14T19:03:10.223211+0000","last_clean":"2023-10-14T19:03:10.223211+0000","last_became_active":"2023-10-14T19:03:10.220310+0000","last_became_peered":"2023-10-14T19:03:10.220310+0000","last_unstale":"2023-10-14T19:03:10.223211+0000","last_undegraded":"2023-10-14T19:03:10.223211+0000","last_fullsized":"2023-10-14T19:03:10.223211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213993+0000","last_change":"2023-10-14T19:03:09.211690+0000","last_active":"2023-10-14T19:03:10.213993+0000","last_peered":"2023-10-14T19:03:10.213993+0000","last_clean":"2023-10-14T19:03:10.213993+0000","last_became_active":"2023-10-14T19:03:09.211425+0000","last_became_peered":"2023-10-14T19:03:09.211425+0000","last_unstale":"2023-10-14T19:03:10.213993+0000","last_undegraded":"2023-10-14T19:03:10.213993+0000","last_fullsized":"2023-10-14T19:03:10.213993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219325+0000","last_change":"2023-10-14T19:03:10.213207+0000","last_active":"2023-10-14T19:03:10.219325+0000","last_peered":"2023-10-14T19:03:10.219325+0000","last_clean":"2023-10-14T19:03:10.219325+0000","last_became_active":"2023-10-14T19:03:10.211874+0000","last_became_peered":"2023-10-14T19:03:10.211874+0000","last_unstale":"2023-10-14T19:03:10.219325+0000","last_undegraded":"2023-10-14T19:03:10.219325+0000","last_fullsized":"2023-10-14T19:03:10.219325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:45.278559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205193+0000","last_change":"2023-10-14T19:03:09.212745+0000","last_active":"2023-10-14T19:03:10.205193+0000","last_peered":"2023-10-14T19:03:10.205193+0000","last_clean":"2023-10-14T19:03:10.205193+0000","last_became_active":"2023-10-14T19:03:09.212470+0000","last_became_peered":"2023-10-14T19:03:09.212470+0000","last_unstale":"2023-10-14T19:03:10.205193+0000","last_undegraded":"2023-10-14T19:03:10.205193+0000","last_fullsized":"2023-10-14T19:03:10.205193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219163+0000","last_change":"2023-10-14T19:03:10.216098+0000","last_active":"2023-10-14T19:03:10.219163+0000","last_peered":"2023-10-14T19:03:10.219163+0000","last_clean":"2023-10-14T19:03:10.219163+0000","last_became_active":"2023-10-14T19:03:10.215829+0000","last_became_peered":"2023-10-14T19:03:10.215829+0000","last_unstale":"2023-10-14T19:03:10.219163+0000","last_undegraded":"2023-10-14T19:03:10.219163+0000","last_fullsized":"2023-10-14T19:03:10.219163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204639+0000","last_change":"2023-10-14T19:03:09.215395+0000","last_active":"2023-10-14T19:03:10.204639+0000","last_peered":"2023-10-14T19:03:10.204639+0000","last_clean":"2023-10-14T19:03:10.204639+0000","last_became_active":"2023-10-14T19:03:09.215081+0000","last_became_peered":"2023-10-14T19:03:09.215081+0000","last_unstale":"2023-10-14T19:03:10.204639+0000","last_undegraded":"2023-10-14T19:03:10.204639+0000","last_fullsized":"2023-10-14T19:03:10.204639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224034+0000","last_change":"2023-10-14T19:03:10.220693+0000","last_active":"2023-10-14T19:03:10.224034+0000","last_peered":"2023-10-14T19:03:10.224034+0000","last_clean":"2023-10-14T19:03:10.224034+0000","last_became_active":"2023-10-14T19:03:10.220340+0000","last_became_peered":"2023-10-14T19:03:10.220340+0000","last_unstale":"2023-10-14T19:03:10.224034+0000","last_undegraded":"2023-10-14T19:03:10.224034+0000","last_fullsized":"2023-10-14T19:03:10.224034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242172+0000","last_change":"2023-10-14T19:03:09.215682+0000","last_active":"2023-10-14T19:03:10.242172+0000","last_peered":"2023-10-14T19:03:10.242172+0000","last_clean":"2023-10-14T19:03:10.242172+0000","last_became_active":"2023-10-14T19:03:09.215405+0000","last_became_peered":"2023-10-14T19:03:09.215405+0000","last_unstale":"2023-10-14T19:03:10.242172+0000","last_undegraded":"2023-10-14T19:03:10.242172+0000","last_fullsized":"2023-10-14T19:03:10.242172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228190+0000","last_change":"2023-10-14T19:03:10.223659+0000","last_active":"2023-10-14T19:03:10.228190+0000","last_peered":"2023-10-14T19:03:10.228190+0000","last_clean":"2023-10-14T19:03:10.228190+0000","last_became_active":"2023-10-14T19:03:10.222280+0000","last_became_peered":"2023-10-14T19:03:10.222280+0000","last_unstale":"2023-10-14T19:03:10.228190+0000","last_undegraded":"2023-10-14T19:03:10.228190+0000","last_fullsized":"2023-10-14T19:03:10.228190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204006+0000","last_change":"2023-10-14T19:03:09.208270+0000","last_active":"2023-10-14T19:03:10.204006+0000","last_peered":"2023-10-14T19:03:10.204006+0000","last_clean":"2023-10-14T19:03:10.204006+0000","last_became_active":"2023-10-14T19:03:09.207959+0000","last_became_peered":"2023-10-14T19:03:09.207959+0000","last_unstale":"2023-10-14T19:03:10.204006+0000","last_undegraded":"2023-10-14T19:03:10.204006+0000","last_fullsized":"2023-10-14T19:03:10.204006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239694+0000","last_change":"2023-10-14T19:03:10.233909+0000","last_active":"2023-10-14T19:03:10.239694+0000","last_peered":"2023-10-14T19:03:10.239694+0000","last_clean":"2023-10-14T19:03:10.239694+0000","last_became_active":"2023-10-14T19:03:10.233422+0000","last_became_peered":"2023-10-14T19:03:10.233422+0000","last_unstale":"2023-10-14T19:03:10.239694+0000","last_undegraded":"2023-10-14T19:03:10.239694+0000","last_fullsized":"2023-10-14T19:03:10.239694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239570+0000","last_change":"2023-10-14T19:03:09.215232+0000","last_active":"2023-10-14T19:03:10.239570+0000","last_peered":"2023-10-14T19:03:10.239570+0000","last_clean":"2023-10-14T19:03:10.239570+0000","last_became_active":"2023-10-14T19:03:09.214965+0000","last_became_peered":"2023-10-14T19:03:09.214965+0000","last_unstale":"2023-10-14T19:03:10.239570+0000","last_undegraded":"2023-10-14T19:03:10.239570+0000","last_fullsized":"2023-10-14T19:03:10.239570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230537+0000","last_change":"2023-10-14T19:03:10.226324+0000","last_active":"2023-10-14T19:03:10.230537+0000","last_peered":"2023-10-14T19:03:10.230537+0000","last_clean":"2023-10-14T19:03:10.230537+0000","last_became_active":"2023-10-14T19:03:10.225606+0000","last_became_peered":"2023-10-14T19:03:10.225606+0000","last_unstale":"2023-10-14T19:03:10.230537+0000","last_undegraded":"2023-10-14T19:03:10.230537+0000","last_fullsized":"2023-10-14T19:03:10.230537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231144+0000","last_change":"2023-10-14T19:03:09.204163+0000","last_active":"2023-10-14T19:03:10.231144+0000","last_peered":"2023-10-14T19:03:10.231144+0000","last_clean":"2023-10-14T19:03:10.231144+0000","last_became_active":"2023-10-14T19:03:09.203726+0000","last_became_peered":"2023-10-14T19:03:09.203726+0000","last_unstale":"2023-10-14T19:03:10.231144+0000","last_undegraded":"2023-10-14T19:03:10.231144+0000","last_fullsized":"2023-10-14T19:03:10.231144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241864+0000","last_change":"2023-10-14T19:03:10.236516+0000","last_active":"2023-10-14T19:03:10.241864+0000","last_peered":"2023-10-14T19:03:10.241864+0000","last_clean":"2023-10-14T19:03:10.241864+0000","last_became_active":"2023-10-14T19:03:10.236201+0000","last_became_peered":"2023-10-14T19:03:10.236201+0000","last_unstale":"2023-10-14T19:03:10.241864+0000","last_undegraded":"2023-10-14T19:03:10.241864+0000","last_fullsized":"2023-10-14T19:03:10.241864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224903+0000","last_change":"2023-10-14T19:03:10.220597+0000","last_active":"2023-10-14T19:03:10.224903+0000","last_peered":"2023-10-14T19:03:10.224903+0000","last_clean":"2023-10-14T19:03:10.224903+0000","last_became_active":"2023-10-14T19:03:10.220306+0000","last_became_peered":"2023-10-14T19:03:10.220306+0000","last_unstale":"2023-10-14T19:03:10.224903+0000","last_undegraded":"2023-10-14T19:03:10.224903+0000","last_fullsized":"2023-10-14T19:03:10.224903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231223+0000","last_change":"2023-10-14T19:03:10.228189+0000","last_active":"2023-10-14T19:03:10.231223+0000","last_peered":"2023-10-14T19:03:10.231223+0000","last_clean":"2023-10-14T19:03:10.231223+0000","last_became_active":"2023-10-14T19:03:10.227963+0000","last_became_peered":"2023-10-14T19:03:10.227963+0000","last_unstale":"2023-10-14T19:03:10.231223+0000","last_undegraded":"2023-10-14T19:03:10.231223+0000","last_fullsized":"2023-10-14T19:03:10.231223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224291+0000","last_change":"2023-10-14T19:03:10.217965+0000","last_active":"2023-10-14T19:03:10.224291+0000","last_peered":"2023-10-14T19:03:10.224291+0000","last_clean":"2023-10-14T19:03:10.224291+0000","last_became_active":"2023-10-14T19:03:10.217687+0000","last_became_peered":"2023-10-14T19:03:10.217687+0000","last_unstale":"2023-10-14T19:03:10.224291+0000","last_undegraded":"2023-10-14T19:03:10.224291+0000","last_fullsized":"2023-10-14T19:03:10.224291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.221439+0000","last_change":"2023-10-14T19:03:10.219458+0000","last_active":"2023-10-14T19:03:10.221439+0000","last_peered":"2023-10-14T19:03:10.221439+0000","last_clean":"2023-10-14T19:03:10.221439+0000","last_became_active":"2023-10-14T19:03:10.219184+0000","last_became_peered":"2023-10-14T19:03:10.219184+0000","last_unstale":"2023-10-14T19:03:10.221439+0000","last_undegraded":"2023-10-14T19:03:10.221439+0000","last_fullsized":"2023-10-14T19:03:10.221439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224376+0000","last_change":"2023-10-14T19:03:10.223589+0000","last_active":"2023-10-14T19:03:10.224376+0000","last_peered":"2023-10-14T19:03:10.224376+0000","last_clean":"2023-10-14T19:03:10.224376+0000","last_became_active":"2023-10-14T19:03:10.223340+0000","last_became_peered":"2023-10-14T19:03:10.223340+0000","last_unstale":"2023-10-14T19:03:10.224376+0000","last_undegraded":"2023-10-14T19:03:10.224376+0000","last_fullsized":"2023-10-14T19:03:10.224376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219559+0000","last_change":"2023-10-14T19:03:10.216180+0000","last_active":"2023-10-14T19:03:10.219559+0000","last_peered":"2023-10-14T19:03:10.219559+0000","last_clean":"2023-10-14T19:03:10.219559+0000","last_became_active":"2023-10-14T19:03:10.215525+0000","last_became_peered":"2023-10-14T19:03:10.215525+0000","last_unstale":"2023-10-14T19:03:10.219559+0000","last_undegraded":"2023-10-14T19:03:10.219559+0000","last_fullsized":"2023-10-14T19:03:10.219559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228241+0000","last_change":"2023-10-14T19:03:10.221680+0000","last_active":"2023-10-14T19:03:10.228241+0000","last_peered":"2023-10-14T19:03:10.228241+0000","last_clean":"2023-10-14T19:03:10.228241+0000","last_became_active":"2023-10-14T19:03:10.221417+0000","last_became_peered":"2023-10-14T19:03:10.221417+0000","last_unstale":"2023-10-14T19:03:10.228241+0000","last_undegraded":"2023-10-14T19:03:10.228241+0000","last_fullsized":"2023-10-14T19:03:10.228241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216940+0000","last_change":"2023-10-14T19:03:10.214621+0000","last_active":"2023-10-14T19:03:10.216940+0000","last_peered":"2023-10-14T19:03:10.216940+0000","last_clean":"2023-10-14T19:03:10.216940+0000","last_became_active":"2023-10-14T19:03:10.214326+0000","last_became_peered":"2023-10-14T19:03:10.214326+0000","last_unstale":"2023-10-14T19:03:10.216940+0000","last_undegraded":"2023-10-14T19:03:10.216940+0000","last_fullsized":"2023-10-14T19:03:10.216940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230803+0000","last_change":"2023-10-14T19:03:10.224902+0000","last_active":"2023-10-14T19:03:10.230803+0000","last_peered":"2023-10-14T19:03:10.230803+0000","last_clean":"2023-10-14T19:03:10.230803+0000","last_became_active":"2023-10-14T19:03:10.224471+0000","last_became_peered":"2023-10-14T19:03:10.224471+0000","last_unstale":"2023-10-14T19:03:10.230803+0000","last_undegraded":"2023-10-14T19:03:10.230803+0000","last_fullsized":"2023-10-14T19:03:10.230803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216352+0000","last_change":"2023-10-14T19:03:10.213932+0000","last_active":"2023-10-14T19:03:10.216352+0000","last_peered":"2023-10-14T19:03:10.216352+0000","last_clean":"2023-10-14T19:03:10.216352+0000","last_became_active":"2023-10-14T19:03:10.213630+0000","last_became_peered":"2023-10-14T19:03:10.213630+0000","last_unstale":"2023-10-14T19:03:10.216352+0000","last_undegraded":"2023-10-14T19:03:10.216352+0000","last_fullsized":"2023-10-14T19:03:10.216352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231123+0000","last_change":"2023-10-14T19:03:10.225610+0000","last_active":"2023-10-14T19:03:10.231123+0000","last_peered":"2023-10-14T19:03:10.231123+0000","last_clean":"2023-10-14T19:03:10.231123+0000","last_became_active":"2023-10-14T19:03:10.225294+0000","last_became_peered":"2023-10-14T19:03:10.225294+0000","last_unstale":"2023-10-14T19:03:10.231123+0000","last_undegraded":"2023-10-14T19:03:10.231123+0000","last_fullsized":"2023-10-14T19:03:10.231123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229349+0000","last_change":"2023-10-14T19:03:10.227867+0000","last_active":"2023-10-14T19:03:10.229349+0000","last_peered":"2023-10-14T19:03:10.229349+0000","last_clean":"2023-10-14T19:03:10.229349+0000","last_became_active":"2023-10-14T19:03:10.227598+0000","last_became_peered":"2023-10-14T19:03:10.227598+0000","last_unstale":"2023-10-14T19:03:10.229349+0000","last_undegraded":"2023-10-14T19:03:10.229349+0000","last_fullsized":"2023-10-14T19:03:10.229349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228139+0000","last_change":"2023-10-14T19:03:10.222435+0000","last_active":"2023-10-14T19:03:10.228139+0000","last_peered":"2023-10-14T19:03:10.228139+0000","last_clean":"2023-10-14T19:03:10.228139+0000","last_became_active":"2023-10-14T19:03:10.222182+0000","last_became_peered":"2023-10-14T19:03:10.222182+0000","last_unstale":"2023-10-14T19:03:10.228139+0000","last_undegraded":"2023-10-14T19:03:10.228139+0000","last_fullsized":"2023-10-14T19:03:10.228139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:19.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:19.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.186+0000 7fa017469700 1 Processor -- start 2023-10-14T19:03:19.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.186+0000 7fa017469700 1 -- start start 2023-10-14T19:03:19.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa017469700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0101565d0 0x7fa0100ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa017469700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100ae540 con 0x7fa010156200 2023-10-14T19:03:19.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa017469700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100ad930 con 0x7fa01006ab20 2023-10-14T19:03:19.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa017469700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa010070a60 con 0x7fa0101565d0 2023-10-14T19:03:19.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa016467700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa010156200 0x7fa01006a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40274/0 (socket says 172.21.15.7:40274) 2023-10-14T19:03:19.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa016467700 1 -- 172.21.15.7:0/738944778 learned_addr learned my addr 172.21.15.7:0/738944778 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:19.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa016c68700 1 --2- 172.21.15.7:0/738944778 >> v2:172.21.15.148:3300/0 conn(0x7fa0101565d0 0x7fa0100ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265327328 0 0) 0x7fa0100ae540 con 0x7fa010156200 2023-10-14T19:03:19.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.187+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8003570 con 0x7fa010156200 2023-10-14T19:03:19.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220358746 0 0) 0x7f9ff8003570 con 0x7fa010156200 2023-10-14T19:03:19.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 >> v2:172.21.15.148:3300/0 conn(0x7fa0101565d0 msgr2=0x7fa0100ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:19.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 --2- 172.21.15.7:0/738944778 >> v2:172.21.15.148:3300/0 conn(0x7fa0101565d0 0x7fa0100ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 >> v1:172.21.15.148:6789/0 conn(0x7fa01006ab20 legacy=0x7fa01006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100adc10 con 0x7fa010156200 2023-10-14T19:03:19.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa008001470 con 0x7fa010156200 2023-10-14T19:03:19.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 >> v1:172.21.15.7:6789/0 conn(0x7fa010156200 legacy=0x7fa01006a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7f9ff8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff80051c0 0x7f9ff800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010070a60 con 0x7f9ff8004810 2023-10-14T19:03:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800c0d0 con 0x7f9ff80051c0 2023-10-14T19:03:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800c290 con 0x7f9ff8003a60 2023-10-14T19:03:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7f9ff8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa016467700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa016c68700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff80051c0 0x7f9ff800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 -- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ff8003a60 msgr2=0x7f9ff8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 -- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff80051c0 msgr2=0x7f9ff800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff80051c0 0x7f9ff800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 -- 172.21.15.7:0/738944778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8003570 con 0x7f9ff8004810 2023-10-14T19:03:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa016c68700 1 -- 172.21.15.7:0/738944778 reap_dead start 2023-10-14T19:03:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa016467700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015c66700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7f9ff8004c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa0100cda40 tx=0x7fa004007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1a0fe873ad4652 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004012420 con 0x7f9ff8004810 2023-10-14T19:03:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0040125a0 con 0x7f9ff8004810 2023-10-14T19:03:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.188+0000 7fa015465700 1 -- 172.21.15.7:0/738944778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004012960 con 0x7f9ff8004810 2023-10-14T19:03:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 -- 172.21.15.7:0/738944778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 msgr2=0x7f9ff8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7f9ff8004c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa0100cda40 tx=0x7fa004007d30 comp rx=0 tx=0).stop 2023-10-14T19:03:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 -- 172.21.15.7:0/738944778 shutdown_connections 2023-10-14T19:03:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 --2- 172.21.15.7:0/738944778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7f9ff8004c80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 -- 172.21.15.7:0/738944778 >> 172.21.15.7:0/738944778 conn(0x7fa0100cca00 msgr2=0x7fa0100cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 -- 172.21.15.7:0/738944778 shutdown_connections 2023-10-14T19:03:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.189+0000 7fa017469700 1 -- 172.21.15.7:0/738944778 wait complete. 2023-10-14T19:03:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.190+0000 7fa017469700 1 Processor -- start 2023-10-14T19:03:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.190+0000 7fa017469700 1 -- start start 2023-10-14T19:03:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa017469700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7fa01014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa017469700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01015a9c0 0x7fa01015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa017469700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0100c5d00 0x7fa0100c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa017469700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100ca580 con 0x7f9ff8004810 2023-10-14T19:03:19.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa017469700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100c66c0 con 0x7fa01015a9c0 2023-10-14T19:03:19.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa017469700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100cade0 con 0x7fa0100c5d00 2023-10-14T19:03:19.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7fa01014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7fa01014b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38728/0 (socket says 172.21.15.7:38728) 2023-10-14T19:03:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 -- 172.21.15.7:0/3336795876 learned_addr learned my addr 172.21.15.7:0/3336795876 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016c68700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0100c5d00 0x7fa0100c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa015c66700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01015a9c0 0x7fa01015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 -- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0100c5d00 msgr2=0x7fa0100c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0100c5d00 0x7fa0100c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 -- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01015a9c0 msgr2=0x7fa01015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01015a9c0 0x7fa01015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 -- 172.21.15.7:0/3336795876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01015aec0 con 0x7f9ff8004810 2023-10-14T19:03:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa015c66700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01015a9c0 0x7fa01015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa016467700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7fa01014b6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa00800e7c0 tx=0x7fa008001e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008012590 con 0x7f9ff8004810 2023-10-14T19:03:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.191+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080126f0 con 0x7f9ff8004810 2023-10-14T19:03:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.192+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0100ca790 con 0x7f9ff8004810 2023-10-14T19:03:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.192+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008012a70 con 0x7f9ff8004810 2023-10-14T19:03:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.192+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101549d0 con 0x7f9ff8004810 2023-10-14T19:03:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.192+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01004c3c0 con 0x7f9ff8004810 2023-10-14T19:03:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.193+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa00801d460 con 0x7f9ff8004810 2023-10-14T19:03:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.193+0000 7fa00e7fc700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9ffc066f30 0x7f9ffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.193+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa008084460 con 0x7f9ff8004810 2023-10-14T19:03:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.194+0000 7fa015c66700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9ffc066f30 0x7f9ffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.194+0000 7fa015c66700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9ffc066f30 0x7f9ffc0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa0100b2a50 tx=0x7fa004015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.197+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa008051630 con 0x7f9ff8004810 2023-10-14T19:03:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.387+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0100caf20 con 0x7f9ffc066f30 2023-10-14T19:03:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.395+0000 7fa00e7fc700 1 -- 172.21.15.7:0/3336795876 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264496 (secure 0 0 0) 0x7fa004022070 con 0x7f9ffc066f30 2023-10-14T19:03:19.399 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9ffc066f30 msgr2=0x7f9ffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9ffc066f30 0x7f9ffc0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa0100b2a50 tx=0x7fa004015000 comp rx=0 tx=0).stop 2023-10-14T19:03:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 msgr2=0x7fa01014b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7fa01014b6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa00800e7c0 tx=0x7fa008001e20 comp rx=0 tx=0).stop 2023-10-14T19:03:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 shutdown_connections 2023-10-14T19:03:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9ffc066f30 0x7f9ffc0693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0100c5d00 0x7fa0100c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff8004810 0x7fa01014b6b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 --2- 172.21.15.7:0/3336795876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01015a9c0 0x7fa01015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 >> 172.21.15.7:0/3336795876 conn(0x7fa0100cca00 msgr2=0x7fa010155560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 shutdown_connections 2023-10-14T19:03:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.398+0000 7fa017469700 1 -- 172.21.15.7:0/3336795876 wait complete. 2023-10-14T19:03:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:19.410 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T19:03:17.622742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236802+0000","last_change":"2023-10-14T19:03:10.230691+0000","last_active":"2023-10-14T19:03:10.236802+0000","last_peered":"2023-10-14T19:03:10.236802+0000","last_clean":"2023-10-14T19:03:10.236802+0000","last_became_active":"2023-10-14T19:03:10.230421+0000","last_became_peered":"2023-10-14T19:03:10.230421+0000","last_unstale":"2023-10-14T19:03:10.236802+0000","last_undegraded":"2023-10-14T19:03:10.236802+0000","last_fullsized":"2023-10-14T19:03:10.236802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220866+0000","last_change":"2023-10-14T19:03:10.218785+0000","last_active":"2023-10-14T19:03:10.220866+0000","last_peered":"2023-10-14T19:03:10.220866+0000","last_clean":"2023-10-14T19:03:10.220866+0000","last_became_active":"2023-10-14T19:03:10.218518+0000","last_became_peered":"2023-10-14T19:03:10.218518+0000","last_unstale":"2023-10-14T19:03:10.220866+0000","last_undegraded":"2023-10-14T19:03:10.220866+0000","last_fullsized":"2023-10-14T19:03:10.220866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.218469+0000","last_change":"2023-10-14T19:03:10.212986+0000","last_active":"2023-10-14T19:03:10.218469+0000","last_peered":"2023-10-14T19:03:10.218469+0000","last_clean":"2023-10-14T19:03:10.218469+0000","last_became_active":"2023-10-14T19:03:10.212712+0000","last_became_peered":"2023-10-14T19:03:10.212712+0000","last_unstale":"2023-10-14T19:03:10.218469+0000","last_undegraded":"2023-10-14T19:03:10.218469+0000","last_fullsized":"2023-10-14T19:03:10.218469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226118+0000","last_change":"2023-10-14T19:03:10.222522+0000","last_active":"2023-10-14T19:03:10.226118+0000","last_peered":"2023-10-14T19:03:10.226118+0000","last_clean":"2023-10-14T19:03:10.226118+0000","last_became_active":"2023-10-14T19:03:10.222033+0000","last_became_peered":"2023-10-14T19:03:10.222033+0000","last_unstale":"2023-10-14T19:03:10.226118+0000","last_undegraded":"2023-10-14T19:03:10.226118+0000","last_fullsized":"2023-10-14T19:03:10.226118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233555+0000","last_change":"2023-10-14T19:03:10.227209+0000","last_active":"2023-10-14T19:03:10.233555+0000","last_peered":"2023-10-14T19:03:10.233555+0000","last_clean":"2023-10-14T19:03:10.233555+0000","last_became_active":"2023-10-14T19:03:10.226848+0000","last_became_peered":"2023-10-14T19:03:10.226848+0000","last_unstale":"2023-10-14T19:03:10.233555+0000","last_undegraded":"2023-10-14T19:03:10.233555+0000","last_fullsized":"2023-10-14T19:03:10.233555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231156+0000","last_change":"2023-10-14T19:03:10.226159+0000","last_active":"2023-10-14T19:03:10.231156+0000","last_peered":"2023-10-14T19:03:10.231156+0000","last_clean":"2023-10-14T19:03:10.231156+0000","last_became_active":"2023-10-14T19:03:10.225860+0000","last_became_peered":"2023-10-14T19:03:10.225860+0000","last_unstale":"2023-10-14T19:03:10.231156+0000","last_undegraded":"2023-10-14T19:03:10.231156+0000","last_fullsized":"2023-10-14T19:03:10.231156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229437+0000","last_change":"2023-10-14T19:03:10.222973+0000","last_active":"2023-10-14T19:03:10.229437+0000","last_peered":"2023-10-14T19:03:10.229437+0000","last_clean":"2023-10-14T19:03:10.229437+0000","last_became_active":"2023-10-14T19:03:10.222694+0000","last_became_peered":"2023-10-14T19:03:10.222694+0000","last_unstale":"2023-10-14T19:03:10.229437+0000","last_undegraded":"2023-10-14T19:03:10.229437+0000","last_fullsized":"2023-10-14T19:03:10.229437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227789+0000","last_change":"2023-10-14T19:03:10.226142+0000","last_active":"2023-10-14T19:03:10.227789+0000","last_peered":"2023-10-14T19:03:10.227789+0000","last_clean":"2023-10-14T19:03:10.227789+0000","last_became_active":"2023-10-14T19:03:10.225807+0000","last_became_peered":"2023-10-14T19:03:10.225807+0000","last_unstale":"2023-10-14T19:03:10.227789+0000","last_undegraded":"2023-10-14T19:03:10.227789+0000","last_fullsized":"2023-10-14T19:03:10.227789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239732+0000","last_change":"2023-10-14T19:03:10.234612+0000","last_active":"2023-10-14T19:03:10.239732+0000","last_peered":"2023-10-14T19:03:10.239732+0000","last_clean":"2023-10-14T19:03:10.239732+0000","last_became_active":"2023-10-14T19:03:10.234121+0000","last_became_peered":"2023-10-14T19:03:10.234121+0000","last_unstale":"2023-10-14T19:03:10.239732+0000","last_undegraded":"2023-10-14T19:03:10.239732+0000","last_fullsized":"2023-10-14T19:03:10.239732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:05:02.219977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.232472+0000","last_change":"2023-10-14T19:03:10.227725+0000","last_active":"2023-10-14T19:03:10.232472+0000","last_peered":"2023-10-14T19:03:10.232472+0000","last_clean":"2023-10-14T19:03:10.232472+0000","last_became_active":"2023-10-14T19:03:10.227514+0000","last_became_peered":"2023-10-14T19:03:10.227514+0000","last_unstale":"2023-10-14T19:03:10.232472+0000","last_undegraded":"2023-10-14T19:03:10.232472+0000","last_fullsized":"2023-10-14T19:03:10.232472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230503+0000","last_change":"2023-10-14T19:03:10.225519+0000","last_active":"2023-10-14T19:03:10.230503+0000","last_peered":"2023-10-14T19:03:10.230503+0000","last_clean":"2023-10-14T19:03:10.230503+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230503+0000","last_undegraded":"2023-10-14T19:03:10.230503+0000","last_fullsized":"2023-10-14T19:03:10.230503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.226243+0000","last_change":"2023-10-14T19:03:10.222180+0000","last_active":"2023-10-14T19:03:10.226243+0000","last_peered":"2023-10-14T19:03:10.226243+0000","last_clean":"2023-10-14T19:03:10.226243+0000","last_became_active":"2023-10-14T19:03:10.221860+0000","last_became_peered":"2023-10-14T19:03:10.221860+0000","last_unstale":"2023-10-14T19:03:10.226243+0000","last_undegraded":"2023-10-14T19:03:10.226243+0000","last_fullsized":"2023-10-14T19:03:10.226243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:06.624716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224317+0000","last_change":"2023-10-14T19:03:10.221789+0000","last_active":"2023-10-14T19:03:10.224317+0000","last_peered":"2023-10-14T19:03:10.224317+0000","last_clean":"2023-10-14T19:03:10.224317+0000","last_became_active":"2023-10-14T19:03:10.221495+0000","last_became_peered":"2023-10-14T19:03:10.221495+0000","last_unstale":"2023-10-14T19:03:10.224317+0000","last_undegraded":"2023-10-14T19:03:10.224317+0000","last_fullsized":"2023-10-14T19:03:10.224317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223791+0000","last_change":"2023-10-14T19:03:10.220586+0000","last_active":"2023-10-14T19:03:10.223791+0000","last_peered":"2023-10-14T19:03:10.223791+0000","last_clean":"2023-10-14T19:03:10.223791+0000","last_became_active":"2023-10-14T19:03:10.220319+0000","last_became_peered":"2023-10-14T19:03:10.220319+0000","last_unstale":"2023-10-14T19:03:10.223791+0000","last_undegraded":"2023-10-14T19:03:10.223791+0000","last_fullsized":"2023-10-14T19:03:10.223791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219497+0000","last_change":"2023-10-14T19:03:10.216808+0000","last_active":"2023-10-14T19:03:10.219497+0000","last_peered":"2023-10-14T19:03:10.219497+0000","last_clean":"2023-10-14T19:03:10.219497+0000","last_became_active":"2023-10-14T19:03:10.215467+0000","last_became_peered":"2023-10-14T19:03:10.215467+0000","last_unstale":"2023-10-14T19:03:10.219497+0000","last_undegraded":"2023-10-14T19:03:10.219497+0000","last_fullsized":"2023-10-14T19:03:10.219497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231936+0000","last_change":"2023-10-14T19:03:10.226710+0000","last_active":"2023-10-14T19:03:10.231936+0000","last_peered":"2023-10-14T19:03:10.231936+0000","last_clean":"2023-10-14T19:03:10.231936+0000","last_became_active":"2023-10-14T19:03:10.226470+0000","last_became_peered":"2023-10-14T19:03:10.226470+0000","last_unstale":"2023-10-14T19:03:10.231936+0000","last_undegraded":"2023-10-14T19:03:10.231936+0000","last_fullsized":"2023-10-14T19:03:10.231936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230949+0000","last_change":"2023-10-14T19:03:10.227805+0000","last_active":"2023-10-14T19:03:10.230949+0000","last_peered":"2023-10-14T19:03:10.230949+0000","last_clean":"2023-10-14T19:03:10.230949+0000","last_became_active":"2023-10-14T19:03:10.227530+0000","last_became_peered":"2023-10-14T19:03:10.227530+0000","last_unstale":"2023-10-14T19:03:10.230949+0000","last_undegraded":"2023-10-14T19:03:10.230949+0000","last_fullsized":"2023-10-14T19:03:10.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:16.464125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212844+0000","last_change":"2023-10-14T19:03:10.211421+0000","last_active":"2023-10-14T19:03:10.212844+0000","last_peered":"2023-10-14T19:03:10.212844+0000","last_clean":"2023-10-14T19:03:10.212844+0000","last_became_active":"2023-10-14T19:03:10.211127+0000","last_became_peered":"2023-10-14T19:03:10.211127+0000","last_unstale":"2023-10-14T19:03:10.212844+0000","last_undegraded":"2023-10-14T19:03:10.212844+0000","last_fullsized":"2023-10-14T19:03:10.212844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:47.109849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233763+0000","last_change":"2023-10-14T19:03:10.227239+0000","last_active":"2023-10-14T19:03:10.233763+0000","last_peered":"2023-10-14T19:03:10.233763+0000","last_clean":"2023-10-14T19:03:10.233763+0000","last_became_active":"2023-10-14T19:03:10.226914+0000","last_became_peered":"2023-10-14T19:03:10.226914+0000","last_unstale":"2023-10-14T19:03:10.233763+0000","last_undegraded":"2023-10-14T19:03:10.233763+0000","last_fullsized":"2023-10-14T19:03:10.233763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:59.232988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236969+0000","last_change":"2023-10-14T19:03:09.214413+0000","last_active":"2023-10-14T19:03:10.236969+0000","last_peered":"2023-10-14T19:03:10.236969+0000","last_clean":"2023-10-14T19:03:10.236969+0000","last_became_active":"2023-10-14T19:03:09.214117+0000","last_became_peered":"2023-10-14T19:03:09.214117+0000","last_unstale":"2023-10-14T19:03:10.236969+0000","last_undegraded":"2023-10-14T19:03:10.236969+0000","last_fullsized":"2023-10-14T19:03:10.236969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:55.947066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231800+0000","last_change":"2023-10-14T19:03:10.231111+0000","last_active":"2023-10-14T19:03:10.231800+0000","last_peered":"2023-10-14T19:03:10.231800+0000","last_clean":"2023-10-14T19:03:10.231800+0000","last_became_active":"2023-10-14T19:03:10.230749+0000","last_became_peered":"2023-10-14T19:03:10.230749+0000","last_unstale":"2023-10-14T19:03:10.231800+0000","last_undegraded":"2023-10-14T19:03:10.231800+0000","last_fullsized":"2023-10-14T19:03:10.231800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230362+0000","last_change":"2023-10-14T19:03:09.209057+0000","last_active":"2023-10-14T19:03:10.230362+0000","last_peered":"2023-10-14T19:03:10.230362+0000","last_clean":"2023-10-14T19:03:10.230362+0000","last_became_active":"2023-10-14T19:03:09.208250+0000","last_became_peered":"2023-10-14T19:03:09.208250+0000","last_unstale":"2023-10-14T19:03:10.230362+0000","last_undegraded":"2023-10-14T19:03:10.230362+0000","last_fullsized":"2023-10-14T19:03:10.230362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229580+0000","last_change":"2023-10-14T19:03:10.227667+0000","last_active":"2023-10-14T19:03:10.229580+0000","last_peered":"2023-10-14T19:03:10.229580+0000","last_clean":"2023-10-14T19:03:10.229580+0000","last_became_active":"2023-10-14T19:03:10.227114+0000","last_became_peered":"2023-10-14T19:03:10.227114+0000","last_unstale":"2023-10-14T19:03:10.229580+0000","last_undegraded":"2023-10-14T19:03:10.229580+0000","last_fullsized":"2023-10-14T19:03:10.229580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.236879+0000","last_change":"2023-10-14T19:03:09.215258+0000","last_active":"2023-10-14T19:03:10.236879+0000","last_peered":"2023-10-14T19:03:10.236879+0000","last_clean":"2023-10-14T19:03:10.236879+0000","last_became_active":"2023-10-14T19:03:09.214984+0000","last_became_peered":"2023-10-14T19:03:09.214984+0000","last_unstale":"2023-10-14T19:03:10.236879+0000","last_undegraded":"2023-10-14T19:03:10.236879+0000","last_fullsized":"2023-10-14T19:03:10.236879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230515+0000","last_change":"2023-10-14T19:03:10.225703+0000","last_active":"2023-10-14T19:03:10.230515+0000","last_peered":"2023-10-14T19:03:10.230515+0000","last_clean":"2023-10-14T19:03:10.230515+0000","last_became_active":"2023-10-14T19:03:10.225243+0000","last_became_peered":"2023-10-14T19:03:10.225243+0000","last_unstale":"2023-10-14T19:03:10.230515+0000","last_undegraded":"2023-10-14T19:03:10.230515+0000","last_fullsized":"2023-10-14T19:03:10.230515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239608+0000","last_change":"2023-10-14T19:03:09.211764+0000","last_active":"2023-10-14T19:03:10.239608+0000","last_peered":"2023-10-14T19:03:10.239608+0000","last_clean":"2023-10-14T19:03:10.239608+0000","last_became_active":"2023-10-14T19:03:09.211476+0000","last_became_peered":"2023-10-14T19:03:09.211476+0000","last_unstale":"2023-10-14T19:03:10.239608+0000","last_undegraded":"2023-10-14T19:03:10.239608+0000","last_fullsized":"2023-10-14T19:03:10.239608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:46.105558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230389+0000","last_change":"2023-10-14T19:03:10.224871+0000","last_active":"2023-10-14T19:03:10.230389+0000","last_peered":"2023-10-14T19:03:10.230389+0000","last_clean":"2023-10-14T19:03:10.230389+0000","last_became_active":"2023-10-14T19:03:10.224578+0000","last_became_peered":"2023-10-14T19:03:10.224578+0000","last_unstale":"2023-10-14T19:03:10.230389+0000","last_undegraded":"2023-10-14T19:03:10.230389+0000","last_fullsized":"2023-10-14T19:03:10.230389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.234024+0000","last_change":"2023-10-14T19:03:09.211558+0000","last_active":"2023-10-14T19:03:10.234024+0000","last_peered":"2023-10-14T19:03:10.234024+0000","last_clean":"2023-10-14T19:03:10.234024+0000","last_became_active":"2023-10-14T19:03:09.211048+0000","last_became_peered":"2023-10-14T19:03:09.211048+0000","last_unstale":"2023-10-14T19:03:10.234024+0000","last_undegraded":"2023-10-14T19:03:10.234024+0000","last_fullsized":"2023-10-14T19:03:10.234024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.215674+0000","last_change":"2023-10-14T19:03:10.210948+0000","last_active":"2023-10-14T19:03:10.215674+0000","last_peered":"2023-10-14T19:03:10.215674+0000","last_clean":"2023-10-14T19:03:10.215674+0000","last_became_active":"2023-10-14T19:03:10.210692+0000","last_became_peered":"2023-10-14T19:03:10.210692+0000","last_unstale":"2023-10-14T19:03:10.215674+0000","last_undegraded":"2023-10-14T19:03:10.215674+0000","last_fullsized":"2023-10-14T19:03:10.215674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241934+0000","last_change":"2023-10-14T19:03:09.212235+0000","last_active":"2023-10-14T19:03:10.241934+0000","last_peered":"2023-10-14T19:03:10.241934+0000","last_clean":"2023-10-14T19:03:10.241934+0000","last_became_active":"2023-10-14T19:03:09.209044+0000","last_became_peered":"2023-10-14T19:03:09.209044+0000","last_unstale":"2023-10-14T19:03:10.241934+0000","last_undegraded":"2023-10-14T19:03:10.241934+0000","last_fullsized":"2023-10-14T19:03:10.241934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219586+0000","last_change":"2023-10-14T19:03:10.216947+0000","last_active":"2023-10-14T19:03:10.219586+0000","last_peered":"2023-10-14T19:03:10.219586+0000","last_clean":"2023-10-14T19:03:10.219586+0000","last_became_active":"2023-10-14T19:03:10.216625+0000","last_became_peered":"2023-10-14T19:03:10.216625+0000","last_unstale":"2023-10-14T19:03:10.219586+0000","last_undegraded":"2023-10-14T19:03:10.219586+0000","last_fullsized":"2023-10-14T19:03:10.219586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.208754+0000","last_change":"2023-10-14T19:03:09.210714+0000","last_active":"2023-10-14T19:03:10.208754+0000","last_peered":"2023-10-14T19:03:10.208754+0000","last_clean":"2023-10-14T19:03:10.208754+0000","last_became_active":"2023-10-14T19:03:09.210471+0000","last_became_peered":"2023-10-14T19:03:09.210471+0000","last_unstale":"2023-10-14T19:03:10.208754+0000","last_undegraded":"2023-10-14T19:03:10.208754+0000","last_fullsized":"2023-10-14T19:03:10.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224023+0000","last_change":"2023-10-14T19:03:10.220661+0000","last_active":"2023-10-14T19:03:10.224023+0000","last_peered":"2023-10-14T19:03:10.224023+0000","last_clean":"2023-10-14T19:03:10.224023+0000","last_became_active":"2023-10-14T19:03:10.220323+0000","last_became_peered":"2023-10-14T19:03:10.220323+0000","last_unstale":"2023-10-14T19:03:10.224023+0000","last_undegraded":"2023-10-14T19:03:10.224023+0000","last_fullsized":"2023-10-14T19:03:10.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.210972+0000","last_change":"2023-10-14T19:03:09.209100+0000","last_active":"2023-10-14T19:03:10.210972+0000","last_peered":"2023-10-14T19:03:10.210972+0000","last_clean":"2023-10-14T19:03:10.210972+0000","last_became_active":"2023-10-14T19:03:09.208831+0000","last_became_peered":"2023-10-14T19:03:09.208831+0000","last_unstale":"2023-10-14T19:03:10.210972+0000","last_undegraded":"2023-10-14T19:03:10.210972+0000","last_fullsized":"2023-10-14T19:03:10.210972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219475+0000","last_change":"2023-10-14T19:03:10.216390+0000","last_active":"2023-10-14T19:03:10.219475+0000","last_peered":"2023-10-14T19:03:10.219475+0000","last_clean":"2023-10-14T19:03:10.219475+0000","last_became_active":"2023-10-14T19:03:10.215498+0000","last_became_peered":"2023-10-14T19:03:10.215498+0000","last_unstale":"2023-10-14T19:03:10.219475+0000","last_undegraded":"2023-10-14T19:03:10.219475+0000","last_fullsized":"2023-10-14T19:03:10.219475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220845+0000","last_change":"2023-10-14T19:03:09.211585+0000","last_active":"2023-10-14T19:03:10.220845+0000","last_peered":"2023-10-14T19:03:10.220845+0000","last_clean":"2023-10-14T19:03:10.220845+0000","last_became_active":"2023-10-14T19:03:09.211314+0000","last_became_peered":"2023-10-14T19:03:09.211314+0000","last_unstale":"2023-10-14T19:03:10.220845+0000","last_undegraded":"2023-10-14T19:03:10.220845+0000","last_fullsized":"2023-10-14T19:03:10.220845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.225113+0000","last_change":"2023-10-14T19:03:10.220371+0000","last_active":"2023-10-14T19:03:10.225113+0000","last_peered":"2023-10-14T19:03:10.225113+0000","last_clean":"2023-10-14T19:03:10.225113+0000","last_became_active":"2023-10-14T19:03:10.220030+0000","last_became_peered":"2023-10-14T19:03:10.220030+0000","last_unstale":"2023-10-14T19:03:10.225113+0000","last_undegraded":"2023-10-14T19:03:10.225113+0000","last_fullsized":"2023-10-14T19:03:10.225113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:21.166961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212066+0000","last_change":"2023-10-14T19:03:09.213906+0000","last_active":"2023-10-14T19:03:10.212066+0000","last_peered":"2023-10-14T19:03:10.212066+0000","last_clean":"2023-10-14T19:03:10.212066+0000","last_became_active":"2023-10-14T19:03:09.213622+0000","last_became_peered":"2023-10-14T19:03:09.213622+0000","last_unstale":"2023-10-14T19:03:10.212066+0000","last_undegraded":"2023-10-14T19:03:10.212066+0000","last_fullsized":"2023-10-14T19:03:10.212066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230062+0000","last_change":"2023-10-14T19:03:10.229217+0000","last_active":"2023-10-14T19:03:10.230062+0000","last_peered":"2023-10-14T19:03:10.230062+0000","last_clean":"2023-10-14T19:03:10.230062+0000","last_became_active":"2023-10-14T19:03:10.228955+0000","last_became_peered":"2023-10-14T19:03:10.228955+0000","last_unstale":"2023-10-14T19:03:10.230062+0000","last_undegraded":"2023-10-14T19:03:10.230062+0000","last_fullsized":"2023-10-14T19:03:10.230062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233544+0000","last_change":"2023-10-14T19:03:09.212292+0000","last_active":"2023-10-14T19:03:10.233544+0000","last_peered":"2023-10-14T19:03:10.233544+0000","last_clean":"2023-10-14T19:03:10.233544+0000","last_became_active":"2023-10-14T19:03:09.211886+0000","last_became_peered":"2023-10-14T19:03:09.211886+0000","last_unstale":"2023-10-14T19:03:10.233544+0000","last_undegraded":"2023-10-14T19:03:10.233544+0000","last_fullsized":"2023-10-14T19:03:10.233544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:05.620425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241806+0000","last_change":"2023-10-14T19:03:10.232172+0000","last_active":"2023-10-14T19:03:10.241806+0000","last_peered":"2023-10-14T19:03:10.241806+0000","last_clean":"2023-10-14T19:03:10.241806+0000","last_became_active":"2023-10-14T19:03:10.231839+0000","last_became_peered":"2023-10-14T19:03:10.231839+0000","last_unstale":"2023-10-14T19:03:10.241806+0000","last_undegraded":"2023-10-14T19:03:10.241806+0000","last_fullsized":"2023-10-14T19:03:10.241806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242055+0000","last_change":"2023-10-14T19:03:09.213629+0000","last_active":"2023-10-14T19:03:10.242055+0000","last_peered":"2023-10-14T19:03:10.242055+0000","last_clean":"2023-10-14T19:03:10.242055+0000","last_became_active":"2023-10-14T19:03:09.213380+0000","last_became_peered":"2023-10-14T19:03:09.213380+0000","last_unstale":"2023-10-14T19:03:10.242055+0000","last_undegraded":"2023-10-14T19:03:10.242055+0000","last_fullsized":"2023-10-14T19:03:10.242055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:46:11.172425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233796+0000","last_change":"2023-10-14T19:03:10.227726+0000","last_active":"2023-10-14T19:03:10.233796+0000","last_peered":"2023-10-14T19:03:10.233796+0000","last_clean":"2023-10-14T19:03:10.233796+0000","last_became_active":"2023-10-14T19:03:10.227442+0000","last_became_peered":"2023-10-14T19:03:10.227442+0000","last_unstale":"2023-10-14T19:03:10.233796+0000","last_undegraded":"2023-10-14T19:03:10.233796+0000","last_fullsized":"2023-10-14T19:03:10.233796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239821+0000","last_change":"2023-10-14T19:03:09.206678+0000","last_active":"2023-10-14T19:03:10.239821+0000","last_peered":"2023-10-14T19:03:10.239821+0000","last_clean":"2023-10-14T19:03:10.239821+0000","last_became_active":"2023-10-14T19:03:09.206186+0000","last_became_peered":"2023-10-14T19:03:09.206186+0000","last_unstale":"2023-10-14T19:03:10.239821+0000","last_undegraded":"2023-10-14T19:03:10.239821+0000","last_fullsized":"2023-10-14T19:03:10.239821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219137+0000","last_change":"2023-10-14T19:03:10.216802+0000","last_active":"2023-10-14T19:03:10.219137+0000","last_peered":"2023-10-14T19:03:10.219137+0000","last_clean":"2023-10-14T19:03:10.219137+0000","last_became_active":"2023-10-14T19:03:10.216416+0000","last_became_peered":"2023-10-14T19:03:10.216416+0000","last_unstale":"2023-10-14T19:03:10.219137+0000","last_undegraded":"2023-10-14T19:03:10.219137+0000","last_fullsized":"2023-10-14T19:03:10.219137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211294+0000","last_change":"2023-10-14T19:03:09.211236+0000","last_active":"2023-10-14T19:03:10.211294+0000","last_peered":"2023-10-14T19:03:10.211294+0000","last_clean":"2023-10-14T19:03:10.211294+0000","last_became_active":"2023-10-14T19:03:09.210972+0000","last_became_peered":"2023-10-14T19:03:09.210972+0000","last_unstale":"2023-10-14T19:03:10.211294+0000","last_undegraded":"2023-10-14T19:03:10.211294+0000","last_fullsized":"2023-10-14T19:03:10.211294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241921+0000","last_change":"2023-10-14T19:03:10.236770+0000","last_active":"2023-10-14T19:03:10.241921+0000","last_peered":"2023-10-14T19:03:10.241921+0000","last_clean":"2023-10-14T19:03:10.241921+0000","last_became_active":"2023-10-14T19:03:10.235368+0000","last_became_peered":"2023-10-14T19:03:10.235368+0000","last_unstale":"2023-10-14T19:03:10.241921+0000","last_undegraded":"2023-10-14T19:03:10.241921+0000","last_fullsized":"2023-10-14T19:03:10.241921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.212724+0000","last_change":"2023-10-14T19:03:09.214552+0000","last_active":"2023-10-14T19:03:10.212724+0000","last_peered":"2023-10-14T19:03:10.212724+0000","last_clean":"2023-10-14T19:03:10.212724+0000","last_became_active":"2023-10-14T19:03:09.214229+0000","last_became_peered":"2023-10-14T19:03:09.214229+0000","last_unstale":"2023-10-14T19:03:10.212724+0000","last_undegraded":"2023-10-14T19:03:10.212724+0000","last_fullsized":"2023-10-14T19:03:10.212724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.220484+0000","last_change":"2023-10-14T19:03:10.215197+0000","last_active":"2023-10-14T19:03:10.220484+0000","last_peered":"2023-10-14T19:03:10.220484+0000","last_clean":"2023-10-14T19:03:10.220484+0000","last_became_active":"2023-10-14T19:03:10.214896+0000","last_became_peered":"2023-10-14T19:03:10.214896+0000","last_unstale":"2023-10-14T19:03:10.220484+0000","last_undegraded":"2023-10-14T19:03:10.220484+0000","last_fullsized":"2023-10-14T19:03:10.220484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233697+0000","last_change":"2023-10-14T19:03:09.212453+0000","last_active":"2023-10-14T19:03:10.233697+0000","last_peered":"2023-10-14T19:03:10.233697+0000","last_clean":"2023-10-14T19:03:10.233697+0000","last_became_active":"2023-10-14T19:03:09.212138+0000","last_became_peered":"2023-10-14T19:03:09.212138+0000","last_unstale":"2023-10-14T19:03:10.233697+0000","last_undegraded":"2023-10-14T19:03:10.233697+0000","last_fullsized":"2023-10-14T19:03:10.233697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.233462+0000","last_change":"2023-10-14T19:03:10.227505+0000","last_active":"2023-10-14T19:03:10.233462+0000","last_peered":"2023-10-14T19:03:10.233462+0000","last_clean":"2023-10-14T19:03:10.233462+0000","last_became_active":"2023-10-14T19:03:10.227226+0000","last_became_peered":"2023-10-14T19:03:10.227226+0000","last_unstale":"2023-10-14T19:03:10.233462+0000","last_undegraded":"2023-10-14T19:03:10.233462+0000","last_fullsized":"2023-10-14T19:03:10.233462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:57.305821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239242+0000","last_change":"2023-10-14T19:03:09.210288+0000","last_active":"2023-10-14T19:03:10.239242+0000","last_peered":"2023-10-14T19:03:10.239242+0000","last_clean":"2023-10-14T19:03:10.239242+0000","last_became_active":"2023-10-14T19:03:09.210053+0000","last_became_peered":"2023-10-14T19:03:09.210053+0000","last_unstale":"2023-10-14T19:03:10.239242+0000","last_undegraded":"2023-10-14T19:03:10.239242+0000","last_fullsized":"2023-10-14T19:03:10.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:39.004888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241891+0000","last_change":"2023-10-14T19:03:10.236537+0000","last_active":"2023-10-14T19:03:10.241891+0000","last_peered":"2023-10-14T19:03:10.241891+0000","last_clean":"2023-10-14T19:03:10.241891+0000","last_became_active":"2023-10-14T19:03:10.236256+0000","last_became_peered":"2023-10-14T19:03:10.236256+0000","last_unstale":"2023-10-14T19:03:10.241891+0000","last_undegraded":"2023-10-14T19:03:10.241891+0000","last_fullsized":"2023-10-14T19:03:10.241891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:07.405321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205718+0000","last_change":"2023-10-14T19:03:09.212576+0000","last_active":"2023-10-14T19:03:10.205718+0000","last_peered":"2023-10-14T19:03:10.205718+0000","last_clean":"2023-10-14T19:03:10.205718+0000","last_became_active":"2023-10-14T19:03:09.212291+0000","last_became_peered":"2023-10-14T19:03:09.212291+0000","last_unstale":"2023-10-14T19:03:10.205718+0000","last_undegraded":"2023-10-14T19:03:10.205718+0000","last_fullsized":"2023-10-14T19:03:10.205718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230366+0000","last_change":"2023-10-14T19:03:10.224600+0000","last_active":"2023-10-14T19:03:10.230366+0000","last_peered":"2023-10-14T19:03:10.230366+0000","last_clean":"2023-10-14T19:03:10.230366+0000","last_became_active":"2023-10-14T19:03:10.222507+0000","last_became_peered":"2023-10-14T19:03:10.222507+0000","last_unstale":"2023-10-14T19:03:10.230366+0000","last_undegraded":"2023-10-14T19:03:10.230366+0000","last_fullsized":"2023-10-14T19:03:10.230366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:37.998789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211190+0000","last_change":"2023-10-14T19:03:09.214386+0000","last_active":"2023-10-14T19:03:10.211190+0000","last_peered":"2023-10-14T19:03:10.211190+0000","last_clean":"2023-10-14T19:03:10.211190+0000","last_became_active":"2023-10-14T19:03:09.214062+0000","last_became_peered":"2023-10-14T19:03:09.214062+0000","last_unstale":"2023-10-14T19:03:10.211190+0000","last_undegraded":"2023-10-14T19:03:10.211190+0000","last_fullsized":"2023-10-14T19:03:10.211190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228871+0000","last_change":"2023-10-14T19:03:10.222746+0000","last_active":"2023-10-14T19:03:10.228871+0000","last_peered":"2023-10-14T19:03:10.228871+0000","last_clean":"2023-10-14T19:03:10.228871+0000","last_became_active":"2023-10-14T19:03:10.221548+0000","last_became_peered":"2023-10-14T19:03:10.221548+0000","last_unstale":"2023-10-14T19:03:10.228871+0000","last_undegraded":"2023-10-14T19:03:10.228871+0000","last_fullsized":"2023-10-14T19:03:10.228871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:03.593194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213873+0000","last_change":"2023-10-14T19:03:10.211030+0000","last_active":"2023-10-14T19:03:10.213873+0000","last_peered":"2023-10-14T19:03:10.213873+0000","last_clean":"2023-10-14T19:03:10.213873+0000","last_became_active":"2023-10-14T19:03:10.210612+0000","last_became_peered":"2023-10-14T19:03:10.210612+0000","last_unstale":"2023-10-14T19:03:10.213873+0000","last_undegraded":"2023-10-14T19:03:10.213873+0000","last_fullsized":"2023-10-14T19:03:10.213873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.203993+0000","last_change":"2023-10-14T19:03:09.207759+0000","last_active":"2023-10-14T19:03:10.203993+0000","last_peered":"2023-10-14T19:03:10.203993+0000","last_clean":"2023-10-14T19:03:10.203993+0000","last_became_active":"2023-10-14T19:03:09.207466+0000","last_became_peered":"2023-10-14T19:03:09.207466+0000","last_unstale":"2023-10-14T19:03:10.203993+0000","last_undegraded":"2023-10-14T19:03:10.203993+0000","last_fullsized":"2023-10-14T19:03:10.203993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:15.831339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.227804+0000","last_change":"2023-10-14T19:03:10.226423+0000","last_active":"2023-10-14T19:03:10.227804+0000","last_peered":"2023-10-14T19:03:10.227804+0000","last_clean":"2023-10-14T19:03:10.227804+0000","last_became_active":"2023-10-14T19:03:10.226147+0000","last_became_peered":"2023-10-14T19:03:10.226147+0000","last_unstale":"2023-10-14T19:03:10.227804+0000","last_undegraded":"2023-10-14T19:03:10.227804+0000","last_fullsized":"2023-10-14T19:03:10.227804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.211113+0000","last_change":"2023-10-14T19:03:09.200879+0000","last_active":"2023-10-14T19:03:10.211113+0000","last_peered":"2023-10-14T19:03:10.211113+0000","last_clean":"2023-10-14T19:03:10.211113+0000","last_became_active":"2023-10-14T19:03:09.200600+0000","last_became_peered":"2023-10-14T19:03:09.200600+0000","last_unstale":"2023-10-14T19:03:10.211113+0000","last_undegraded":"2023-10-14T19:03:10.211113+0000","last_fullsized":"2023-10-14T19:03:10.211113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214084+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:10.214084+0000","last_peered":"2023-10-14T19:03:10.214084+0000","last_clean":"2023-10-14T19:03:10.214084+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:10.214084+0000","last_undegraded":"2023-10-14T19:03:10.214084+0000","last_fullsized":"2023-10-14T19:03:10.214084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224176+0000","last_change":"2023-10-14T19:03:10.222157+0000","last_active":"2023-10-14T19:03:10.224176+0000","last_peered":"2023-10-14T19:03:10.224176+0000","last_clean":"2023-10-14T19:03:10.224176+0000","last_became_active":"2023-10-14T19:03:10.221908+0000","last_became_peered":"2023-10-14T19:03:10.221908+0000","last_unstale":"2023-10-14T19:03:10.224176+0000","last_undegraded":"2023-10-14T19:03:10.224176+0000","last_fullsized":"2023-10-14T19:03:10.224176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:57.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.214197+0000","last_change":"2023-10-14T19:03:09.213139+0000","last_active":"2023-10-14T19:03:10.214197+0000","last_peered":"2023-10-14T19:03:10.214197+0000","last_clean":"2023-10-14T19:03:10.214197+0000","last_became_active":"2023-10-14T19:03:09.212808+0000","last_became_peered":"2023-10-14T19:03:09.212808+0000","last_unstale":"2023-10-14T19:03:10.214197+0000","last_undegraded":"2023-10-14T19:03:10.214197+0000","last_fullsized":"2023-10-14T19:03:10.214197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:57.697128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.217896+0000","last_change":"2023-10-14T19:03:09.211906+0000","last_active":"2023-10-14T19:03:10.217896+0000","last_peered":"2023-10-14T19:03:10.217896+0000","last_clean":"2023-10-14T19:03:10.217896+0000","last_became_active":"2023-10-14T19:03:09.211587+0000","last_became_peered":"2023-10-14T19:03:09.211587+0000","last_unstale":"2023-10-14T19:03:10.217896+0000","last_undegraded":"2023-10-14T19:03:10.217896+0000","last_fullsized":"2023-10-14T19:03:10.217896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213831+0000","last_change":"2023-10-14T19:03:10.210444+0000","last_active":"2023-10-14T19:03:10.213831+0000","last_peered":"2023-10-14T19:03:10.213831+0000","last_clean":"2023-10-14T19:03:10.213831+0000","last_became_active":"2023-10-14T19:03:10.210175+0000","last_became_peered":"2023-10-14T19:03:10.210175+0000","last_unstale":"2023-10-14T19:03:10.213831+0000","last_undegraded":"2023-10-14T19:03:10.213831+0000","last_fullsized":"2023-10-14T19:03:10.213831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T19:03:12.015820+0000","last_change":"2023-10-14T19:03:09.213704+0000","last_active":"2023-10-14T19:03:12.015820+0000","last_peered":"2023-10-14T19:03:12.015820+0000","last_clean":"2023-10-14T19:03:12.015820+0000","last_became_active":"2023-10-14T19:03:09.213422+0000","last_became_peered":"2023-10-14T19:03:09.213422+0000","last_unstale":"2023-10-14T19:03:12.015820+0000","last_undegraded":"2023-10-14T19:03:12.015820+0000","last_fullsized":"2023-10-14T19:03:12.015820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:48.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229985+0000","last_change":"2023-10-14T19:03:10.227711+0000","last_active":"2023-10-14T19:03:10.229985+0000","last_peered":"2023-10-14T19:03:10.229985+0000","last_clean":"2023-10-14T19:03:10.229985+0000","last_became_active":"2023-10-14T19:03:10.227271+0000","last_became_peered":"2023-10-14T19:03:10.227271+0000","last_unstale":"2023-10-14T19:03:10.229985+0000","last_undegraded":"2023-10-14T19:03:10.229985+0000","last_fullsized":"2023-10-14T19:03:10.229985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.237073+0000","last_change":"2023-10-14T19:03:09.214397+0000","last_active":"2023-10-14T19:03:10.237073+0000","last_peered":"2023-10-14T19:03:10.237073+0000","last_clean":"2023-10-14T19:03:10.237073+0000","last_became_active":"2023-10-14T19:03:09.214100+0000","last_became_peered":"2023-10-14T19:03:09.214100+0000","last_unstale":"2023-10-14T19:03:10.237073+0000","last_undegraded":"2023-10-14T19:03:10.237073+0000","last_fullsized":"2023-10-14T19:03:10.237073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.223211+0000","last_change":"2023-10-14T19:03:10.220584+0000","last_active":"2023-10-14T19:03:10.223211+0000","last_peered":"2023-10-14T19:03:10.223211+0000","last_clean":"2023-10-14T19:03:10.223211+0000","last_became_active":"2023-10-14T19:03:10.220310+0000","last_became_peered":"2023-10-14T19:03:10.220310+0000","last_unstale":"2023-10-14T19:03:10.223211+0000","last_undegraded":"2023-10-14T19:03:10.223211+0000","last_fullsized":"2023-10-14T19:03:10.223211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.213993+0000","last_change":"2023-10-14T19:03:09.211690+0000","last_active":"2023-10-14T19:03:10.213993+0000","last_peered":"2023-10-14T19:03:10.213993+0000","last_clean":"2023-10-14T19:03:10.213993+0000","last_became_active":"2023-10-14T19:03:09.211425+0000","last_became_peered":"2023-10-14T19:03:09.211425+0000","last_unstale":"2023-10-14T19:03:10.213993+0000","last_undegraded":"2023-10-14T19:03:10.213993+0000","last_fullsized":"2023-10-14T19:03:10.213993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:06.816784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219325+0000","last_change":"2023-10-14T19:03:10.213207+0000","last_active":"2023-10-14T19:03:10.219325+0000","last_peered":"2023-10-14T19:03:10.219325+0000","last_clean":"2023-10-14T19:03:10.219325+0000","last_became_active":"2023-10-14T19:03:10.211874+0000","last_became_peered":"2023-10-14T19:03:10.211874+0000","last_unstale":"2023-10-14T19:03:10.219325+0000","last_undegraded":"2023-10-14T19:03:10.219325+0000","last_fullsized":"2023-10-14T19:03:10.219325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:45.278559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.205193+0000","last_change":"2023-10-14T19:03:09.212745+0000","last_active":"2023-10-14T19:03:10.205193+0000","last_peered":"2023-10-14T19:03:10.205193+0000","last_clean":"2023-10-14T19:03:10.205193+0000","last_became_active":"2023-10-14T19:03:09.212470+0000","last_became_peered":"2023-10-14T19:03:09.212470+0000","last_unstale":"2023-10-14T19:03:10.205193+0000","last_undegraded":"2023-10-14T19:03:10.205193+0000","last_fullsized":"2023-10-14T19:03:10.205193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:02.588903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219163+0000","last_change":"2023-10-14T19:03:10.216098+0000","last_active":"2023-10-14T19:03:10.219163+0000","last_peered":"2023-10-14T19:03:10.219163+0000","last_clean":"2023-10-14T19:03:10.219163+0000","last_became_active":"2023-10-14T19:03:10.215829+0000","last_became_peered":"2023-10-14T19:03:10.215829+0000","last_unstale":"2023-10-14T19:03:10.219163+0000","last_undegraded":"2023-10-14T19:03:10.219163+0000","last_fullsized":"2023-10-14T19:03:10.219163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204639+0000","last_change":"2023-10-14T19:03:09.215395+0000","last_active":"2023-10-14T19:03:10.204639+0000","last_peered":"2023-10-14T19:03:10.204639+0000","last_clean":"2023-10-14T19:03:10.204639+0000","last_became_active":"2023-10-14T19:03:09.215081+0000","last_became_peered":"2023-10-14T19:03:09.215081+0000","last_unstale":"2023-10-14T19:03:10.204639+0000","last_undegraded":"2023-10-14T19:03:10.204639+0000","last_fullsized":"2023-10-14T19:03:10.204639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:55.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224034+0000","last_change":"2023-10-14T19:03:10.220693+0000","last_active":"2023-10-14T19:03:10.224034+0000","last_peered":"2023-10-14T19:03:10.224034+0000","last_clean":"2023-10-14T19:03:10.224034+0000","last_became_active":"2023-10-14T19:03:10.220340+0000","last_became_peered":"2023-10-14T19:03:10.220340+0000","last_unstale":"2023-10-14T19:03:10.224034+0000","last_undegraded":"2023-10-14T19:03:10.224034+0000","last_fullsized":"2023-10-14T19:03:10.224034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:34.406891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.242172+0000","last_change":"2023-10-14T19:03:09.215682+0000","last_active":"2023-10-14T19:03:10.242172+0000","last_peered":"2023-10-14T19:03:10.242172+0000","last_clean":"2023-10-14T19:03:10.242172+0000","last_became_active":"2023-10-14T19:03:09.215405+0000","last_became_peered":"2023-10-14T19:03:09.215405+0000","last_unstale":"2023-10-14T19:03:10.242172+0000","last_undegraded":"2023-10-14T19:03:10.242172+0000","last_fullsized":"2023-10-14T19:03:10.242172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228190+0000","last_change":"2023-10-14T19:03:10.223659+0000","last_active":"2023-10-14T19:03:10.228190+0000","last_peered":"2023-10-14T19:03:10.228190+0000","last_clean":"2023-10-14T19:03:10.228190+0000","last_became_active":"2023-10-14T19:03:10.222280+0000","last_became_peered":"2023-10-14T19:03:10.222280+0000","last_unstale":"2023-10-14T19:03:10.228190+0000","last_undegraded":"2023-10-14T19:03:10.228190+0000","last_fullsized":"2023-10-14T19:03:10.228190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.204006+0000","last_change":"2023-10-14T19:03:09.208270+0000","last_active":"2023-10-14T19:03:10.204006+0000","last_peered":"2023-10-14T19:03:10.204006+0000","last_clean":"2023-10-14T19:03:10.204006+0000","last_became_active":"2023-10-14T19:03:09.207959+0000","last_became_peered":"2023-10-14T19:03:09.207959+0000","last_unstale":"2023-10-14T19:03:10.204006+0000","last_undegraded":"2023-10-14T19:03:10.204006+0000","last_fullsized":"2023-10-14T19:03:10.204006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.085956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239694+0000","last_change":"2023-10-14T19:03:10.233909+0000","last_active":"2023-10-14T19:03:10.239694+0000","last_peered":"2023-10-14T19:03:10.239694+0000","last_clean":"2023-10-14T19:03:10.239694+0000","last_became_active":"2023-10-14T19:03:10.233422+0000","last_became_peered":"2023-10-14T19:03:10.233422+0000","last_unstale":"2023-10-14T19:03:10.239694+0000","last_undegraded":"2023-10-14T19:03:10.239694+0000","last_fullsized":"2023-10-14T19:03:10.239694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.239570+0000","last_change":"2023-10-14T19:03:09.215232+0000","last_active":"2023-10-14T19:03:10.239570+0000","last_peered":"2023-10-14T19:03:10.239570+0000","last_clean":"2023-10-14T19:03:10.239570+0000","last_became_active":"2023-10-14T19:03:09.214965+0000","last_became_peered":"2023-10-14T19:03:09.214965+0000","last_unstale":"2023-10-14T19:03:10.239570+0000","last_undegraded":"2023-10-14T19:03:10.239570+0000","last_fullsized":"2023-10-14T19:03:10.239570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:12:56.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230537+0000","last_change":"2023-10-14T19:03:10.226324+0000","last_active":"2023-10-14T19:03:10.230537+0000","last_peered":"2023-10-14T19:03:10.230537+0000","last_clean":"2023-10-14T19:03:10.230537+0000","last_became_active":"2023-10-14T19:03:10.225606+0000","last_became_peered":"2023-10-14T19:03:10.225606+0000","last_unstale":"2023-10-14T19:03:10.230537+0000","last_undegraded":"2023-10-14T19:03:10.230537+0000","last_fullsized":"2023-10-14T19:03:10.230537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:08.818242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231144+0000","last_change":"2023-10-14T19:03:09.204163+0000","last_active":"2023-10-14T19:03:10.231144+0000","last_peered":"2023-10-14T19:03:10.231144+0000","last_clean":"2023-10-14T19:03:10.231144+0000","last_became_active":"2023-10-14T19:03:09.203726+0000","last_became_peered":"2023-10-14T19:03:09.203726+0000","last_unstale":"2023-10-14T19:03:10.231144+0000","last_undegraded":"2023-10-14T19:03:10.231144+0000","last_fullsized":"2023-10-14T19:03:10.231144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:08.185436+0000","last_clean_scrub_stamp":"2023-10-14T19:03:08.185436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:44.274267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.241864+0000","last_change":"2023-10-14T19:03:10.236516+0000","last_active":"2023-10-14T19:03:10.241864+0000","last_peered":"2023-10-14T19:03:10.241864+0000","last_clean":"2023-10-14T19:03:10.241864+0000","last_became_active":"2023-10-14T19:03:10.236201+0000","last_became_peered":"2023-10-14T19:03:10.236201+0000","last_unstale":"2023-10-14T19:03:10.241864+0000","last_undegraded":"2023-10-14T19:03:10.241864+0000","last_fullsized":"2023-10-14T19:03:10.241864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224903+0000","last_change":"2023-10-14T19:03:10.220597+0000","last_active":"2023-10-14T19:03:10.224903+0000","last_peered":"2023-10-14T19:03:10.224903+0000","last_clean":"2023-10-14T19:03:10.224903+0000","last_became_active":"2023-10-14T19:03:10.220306+0000","last_became_peered":"2023-10-14T19:03:10.220306+0000","last_unstale":"2023-10-14T19:03:10.224903+0000","last_undegraded":"2023-10-14T19:03:10.224903+0000","last_fullsized":"2023-10-14T19:03:10.224903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:05.897437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231223+0000","last_change":"2023-10-14T19:03:10.228189+0000","last_active":"2023-10-14T19:03:10.231223+0000","last_peered":"2023-10-14T19:03:10.231223+0000","last_clean":"2023-10-14T19:03:10.231223+0000","last_became_active":"2023-10-14T19:03:10.227963+0000","last_became_peered":"2023-10-14T19:03:10.227963+0000","last_unstale":"2023-10-14T19:03:10.231223+0000","last_undegraded":"2023-10-14T19:03:10.231223+0000","last_fullsized":"2023-10-14T19:03:10.231223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:07.821075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224291+0000","last_change":"2023-10-14T19:03:10.217965+0000","last_active":"2023-10-14T19:03:10.224291+0000","last_peered":"2023-10-14T19:03:10.224291+0000","last_clean":"2023-10-14T19:03:10.224291+0000","last_became_active":"2023-10-14T19:03:10.217687+0000","last_became_peered":"2023-10-14T19:03:10.217687+0000","last_unstale":"2023-10-14T19:03:10.224291+0000","last_undegraded":"2023-10-14T19:03:10.224291+0000","last_fullsized":"2023-10-14T19:03:10.224291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:11.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.221439+0000","last_change":"2023-10-14T19:03:10.219458+0000","last_active":"2023-10-14T19:03:10.221439+0000","last_peered":"2023-10-14T19:03:10.221439+0000","last_clean":"2023-10-14T19:03:10.221439+0000","last_became_active":"2023-10-14T19:03:10.219184+0000","last_became_peered":"2023-10-14T19:03:10.219184+0000","last_unstale":"2023-10-14T19:03:10.221439+0000","last_undegraded":"2023-10-14T19:03:10.221439+0000","last_fullsized":"2023-10-14T19:03:10.221439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.224376+0000","last_change":"2023-10-14T19:03:10.223589+0000","last_active":"2023-10-14T19:03:10.224376+0000","last_peered":"2023-10-14T19:03:10.224376+0000","last_clean":"2023-10-14T19:03:10.224376+0000","last_became_active":"2023-10-14T19:03:10.223340+0000","last_became_peered":"2023-10-14T19:03:10.223340+0000","last_unstale":"2023-10-14T19:03:10.224376+0000","last_undegraded":"2023-10-14T19:03:10.224376+0000","last_fullsized":"2023-10-14T19:03:10.224376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:55:57.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.219559+0000","last_change":"2023-10-14T19:03:10.216180+0000","last_active":"2023-10-14T19:03:10.219559+0000","last_peered":"2023-10-14T19:03:10.219559+0000","last_clean":"2023-10-14T19:03:10.219559+0000","last_became_active":"2023-10-14T19:03:10.215525+0000","last_became_peered":"2023-10-14T19:03:10.215525+0000","last_unstale":"2023-10-14T19:03:10.219559+0000","last_undegraded":"2023-10-14T19:03:10.219559+0000","last_fullsized":"2023-10-14T19:03:10.219559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:24.043811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228241+0000","last_change":"2023-10-14T19:03:10.221680+0000","last_active":"2023-10-14T19:03:10.228241+0000","last_peered":"2023-10-14T19:03:10.228241+0000","last_clean":"2023-10-14T19:03:10.228241+0000","last_became_active":"2023-10-14T19:03:10.221417+0000","last_became_peered":"2023-10-14T19:03:10.221417+0000","last_unstale":"2023-10-14T19:03:10.228241+0000","last_undegraded":"2023-10-14T19:03:10.228241+0000","last_fullsized":"2023-10-14T19:03:10.228241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:07.833396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216940+0000","last_change":"2023-10-14T19:03:10.214621+0000","last_active":"2023-10-14T19:03:10.216940+0000","last_peered":"2023-10-14T19:03:10.216940+0000","last_clean":"2023-10-14T19:03:10.216940+0000","last_became_active":"2023-10-14T19:03:10.214326+0000","last_became_peered":"2023-10-14T19:03:10.214326+0000","last_unstale":"2023-10-14T19:03:10.216940+0000","last_undegraded":"2023-10-14T19:03:10.216940+0000","last_fullsized":"2023-10-14T19:03:10.216940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.230803+0000","last_change":"2023-10-14T19:03:10.224902+0000","last_active":"2023-10-14T19:03:10.230803+0000","last_peered":"2023-10-14T19:03:10.230803+0000","last_clean":"2023-10-14T19:03:10.230803+0000","last_became_active":"2023-10-14T19:03:10.224471+0000","last_became_peered":"2023-10-14T19:03:10.224471+0000","last_unstale":"2023-10-14T19:03:10.230803+0000","last_undegraded":"2023-10-14T19:03:10.230803+0000","last_fullsized":"2023-10-14T19:03:10.230803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:54.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.216352+0000","last_change":"2023-10-14T19:03:10.213932+0000","last_active":"2023-10-14T19:03:10.216352+0000","last_peered":"2023-10-14T19:03:10.216352+0000","last_clean":"2023-10-14T19:03:10.216352+0000","last_became_active":"2023-10-14T19:03:10.213630+0000","last_became_peered":"2023-10-14T19:03:10.213630+0000","last_unstale":"2023-10-14T19:03:10.216352+0000","last_undegraded":"2023-10-14T19:03:10.216352+0000","last_fullsized":"2023-10-14T19:03:10.216352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:11.406193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.231123+0000","last_change":"2023-10-14T19:03:10.225610+0000","last_active":"2023-10-14T19:03:10.231123+0000","last_peered":"2023-10-14T19:03:10.231123+0000","last_clean":"2023-10-14T19:03:10.231123+0000","last_became_active":"2023-10-14T19:03:10.225294+0000","last_became_peered":"2023-10-14T19:03:10.225294+0000","last_unstale":"2023-10-14T19:03:10.231123+0000","last_undegraded":"2023-10-14T19:03:10.231123+0000","last_fullsized":"2023-10-14T19:03:10.231123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:19.853978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.229349+0000","last_change":"2023-10-14T19:03:10.227867+0000","last_active":"2023-10-14T19:03:10.229349+0000","last_peered":"2023-10-14T19:03:10.229349+0000","last_clean":"2023-10-14T19:03:10.229349+0000","last_became_active":"2023-10-14T19:03:10.227598+0000","last_became_peered":"2023-10-14T19:03:10.227598+0000","last_unstale":"2023-10-14T19:03:10.229349+0000","last_undegraded":"2023-10-14T19:03:10.229349+0000","last_fullsized":"2023-10-14T19:03:10.229349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:13.901889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T19:03:10.228139+0000","last_change":"2023-10-14T19:03:10.222435+0000","last_active":"2023-10-14T19:03:10.228139+0000","last_peered":"2023-10-14T19:03:10.228139+0000","last_clean":"2023-10-14T19:03:10.228139+0000","last_became_active":"2023-10-14T19:03:10.222182+0000","last_became_peered":"2023-10-14T19:03:10.222182+0000","last_unstale":"2023-10-14T19:03:10.228139+0000","last_undegraded":"2023-10-14T19:03:10.228139+0000","last_fullsized":"2023-10-14T19:03:10.228139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:09.189727+0000","last_clean_scrub_stamp":"2023-10-14T19:03:09.189727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:28.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:19.416 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T19:03:19.416 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T19:03:19.417 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T19:03:19.417 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T19:03:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.570+0000 7f8f70e88700 1 Processor -- start 2023-10-14T19:03:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.570+0000 7f8f70e88700 1 -- start start 2023-10-14T19:03:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f70e88700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8f6c0cb970 0x7f8f6c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f70e88700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f6c15a400 0x7f8f6c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f70e88700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c15ae40 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f70e88700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0ce0f0 con 0x7f8f6c15a400 2023-10-14T19:03:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f70e88700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0d13f0 con 0x7f8f6c0cb970 2023-10-14T19:03:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f6c15a400 0x7f8f6c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f6c15a400 0x7f8f6c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38730/0 (socket says 172.21.15.7:38730) 2023-10-14T19:03:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 -- 172.21.15.7:0/730575749 learned_addr learned my addr 172.21.15.7:0/730575749 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f69d9b700 1 --2- 172.21.15.7:0/730575749 >> v2:172.21.15.148:3300/0 conn(0x7f8f6c0cb970 0x7f8f6c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 -- 172.21.15.7:0/730575749 >> v2:172.21.15.148:3300/0 conn(0x7f8f6c0cb970 msgr2=0x7f8f6c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 --2- 172.21.15.7:0/730575749 >> v2:172.21.15.148:3300/0 conn(0x7f8f6c0cb970 0x7f8f6c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 -- 172.21.15.7:0/730575749 >> v1:172.21.15.148:6789/0 conn(0x7f8f6c0cb5a0 legacy=0x7f8f6c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 -- 172.21.15.7:0/730575749 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c15ab60 con 0x7f8f6c15a400 2023-10-14T19:03:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.571+0000 7f8f6ad9d700 1 --2- 172.21.15.7:0/730575749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c15a400 0x7f8f6c156e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0d1780 tx=0x7f8f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d374caf7e3ed5c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f6959a700 1 -- 172.21.15.7:0/730575749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00b820 con 0x7f8f6c15a400 2023-10-14T19:03:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f6959a700 1 -- 172.21.15.7:0/730575749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00b980 con 0x7f8f6c15a400 2023-10-14T19:03:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f6959a700 1 -- 172.21.15.7:0/730575749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00bd20 con 0x7f8f6c15a400 2023-10-14T19:03:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 -- 172.21.15.7:0/730575749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c15a400 msgr2=0x7f8f6c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 --2- 172.21.15.7:0/730575749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c15a400 0x7f8f6c156e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0d1780 tx=0x7f8f5c009250 comp rx=0 tx=0).stop 2023-10-14T19:03:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 -- 172.21.15.7:0/730575749 shutdown_connections 2023-10-14T19:03:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 --2- 172.21.15.7:0/730575749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c15a400 0x7f8f6c156e90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 --2- 172.21.15.7:0/730575749 >> v2:172.21.15.148:3300/0 conn(0x7f8f6c0cb970 0x7f8f6c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 -- 172.21.15.7:0/730575749 >> 172.21.15.7:0/730575749 conn(0x7f8f6c070e30 msgr2=0x7f8f6c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 -- 172.21.15.7:0/730575749 shutdown_connections 2023-10-14T19:03:19.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.572+0000 7f8f70e88700 1 -- 172.21.15.7:0/730575749 wait complete. 2023-10-14T19:03:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.573+0000 7f8f70e88700 1 Processor -- start 2023-10-14T19:03:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.573+0000 7f8f70e88700 1 -- start start 2023-10-14T19:03:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f70e88700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 0x7f8f6c16cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f70e88700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f6c0cb970 0x7f8f6c16d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f70e88700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6c15a400 0x7f8f6c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f70e88700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c8d00 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f70e88700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c155d50 con 0x7f8f6c0cb970 2023-10-14T19:03:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f70e88700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c86b0 con 0x7f8f6c15a400 2023-10-14T19:03:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f6a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 0x7f8f6c16cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f6a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 0x7f8f6c16cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38736/0 (socket says 172.21.15.7:38736) 2023-10-14T19:03:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f6a59c700 1 -- 172.21.15.7:0/978001432 learned_addr learned my addr 172.21.15.7:0/978001432 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:19.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.574+0000 7f8f69d9b700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f6c0cb970 0x7f8f6c16d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f6a59c700 1 -- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6c15a400 msgr2=0x7f8f6c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f6a59c700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6c15a400 0x7f8f6c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f6a59c700 1 -- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f6c0cb970 msgr2=0x7f8f6c16d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f6a59c700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f6c0cb970 0x7f8f6c16d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f6a59c700 1 -- 172.21.15.7:0/978001432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0094f0 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f6a59c700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 0x7f8f6c16cb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c950 tx=0x7f8f64002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400a7e0 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6400a940 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c0c8990 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400ad00 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.575+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c15db90 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.576+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c04c3c0 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.576+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f64012630 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.577+0000 7f8f627fc700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8f4c066f30 0x7f8f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.577+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f640849a0 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.577+0000 7f8f69d9b700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8f4c066f30 0x7f8f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.577+0000 7f8f69d9b700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8f4c066f30 0x7f8f4c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0ca7c0 tx=0x7f8f54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.581+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f64051c10 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.817+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8f6c0ccf00 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.817+0000 7f8f627fc700 1 -- 172.21.15.7:0/978001432 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8f6400ae60 con 0x7f8f6c0cb5a0 2023-10-14T19:03:19.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:19.819 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T19:03:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8f4c066f30 msgr2=0x7f8f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8f4c066f30 0x7f8f4c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0ca7c0 tx=0x7f8f54008040 comp rx=0 tx=0).stop 2023-10-14T19:03:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 msgr2=0x7f8f6c16cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 0x7f8f6c16cb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c950 tx=0x7f8f64002760 comp rx=0 tx=0).stop 2023-10-14T19:03:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 shutdown_connections 2023-10-14T19:03:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8f4c066f30 0x7f8f4c0693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6c15a400 0x7f8f6c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f6c0cb5a0 0x7f8f6c16cb60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 --2- 172.21.15.7:0/978001432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f6c0cb970 0x7f8f6c16d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 >> 172.21.15.7:0/978001432 conn(0x7f8f6c070e30 msgr2=0x7f8f6c0b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 shutdown_connections 2023-10-14T19:03:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.820+0000 7f8f70e88700 1 -- 172.21.15.7:0/978001432 wait complete. 2023-10-14T19:03:19.832 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T19:03:19.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.951+0000 7f2fb4ba8700 1 Processor -- start 2023-10-14T19:03:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.951+0000 7f2fb4ba8700 1 -- start start 2023-10-14T19:03:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.952+0000 7f2fb4ba8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2fb00cb5a0 0x7f2fb00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.952+0000 7f2fb4ba8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 0x7f2fb0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.952+0000 7f2fb4ba8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb015ae40 con 0x7f2fb00cde50 2023-10-14T19:03:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.952+0000 7f2fb4ba8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00d13f0 con 0x7f2fb00cb5a0 2023-10-14T19:03:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.952+0000 7f2fb4ba8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb015ab60 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 0x7f2fb0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2faed9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2fb00cde50 0x7f2fb0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55146/0 (socket says 172.21.15.7:55146) 2023-10-14T19:03:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 0x7f2fb0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38772/0 (socket says 172.21.15.7:38772) 2023-10-14T19:03:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2faed9d700 1 -- 172.21.15.7:0/1094305786 learned_addr learned my addr 172.21.15.7:0/1094305786 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fae59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2fb00cb5a0 0x7f2fb00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fad59a700 1 -- 172.21.15.7:0/1094305786 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258315596 0 0) 0x7f2fb015ae40 con 0x7f2fb00cde50 2023-10-14T19:03:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fad59a700 1 -- 172.21.15.7:0/1094305786 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f9c003570 con 0x7f2fb00cde50 2023-10-14T19:03:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 -- 172.21.15.7:0/1094305786 >> v2:172.21.15.148:3300/0 conn(0x7f2fb00cb5a0 msgr2=0x7f2fb00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 --2- 172.21.15.7:0/1094305786 >> v2:172.21.15.148:3300/0 conn(0x7f2fb00cb5a0 0x7f2fb00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 -- 172.21.15.7:0/1094305786 >> v1:172.21.15.148:6789/0 conn(0x7f2fb00cde50 legacy=0x7f2fb0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 -- 172.21.15.7:0/1094305786 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00ccf00 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fadd9b700 1 --2- 172.21.15.7:0/1094305786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 0x7f2fb0159ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f980098e0 tx=0x7f2f980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd118f07e359d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fad59a700 1 -- 172.21.15.7:0/1094305786 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98011630 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fad59a700 1 -- 172.21.15.7:0/1094305786 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98011790 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.953+0000 7f2fad59a700 1 -- 172.21.15.7:0/1094305786 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98011b10 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/1094305786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 msgr2=0x7f2fb0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/1094305786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 0x7f2fb0159ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f980098e0 tx=0x7f2f980091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/1094305786 shutdown_connections 2023-10-14T19:03:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/1094305786 >> v2:172.21.15.148:3300/0 conn(0x7f2fb00cb5a0 0x7f2fb00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/1094305786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cd9e0 0x7f2fb0159ec0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/1094305786 >> 172.21.15.7:0/1094305786 conn(0x7f2fb0070e30 msgr2=0x7f2fb00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/1094305786 shutdown_connections 2023-10-14T19:03:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.954+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/1094305786 wait complete. 2023-10-14T19:03:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.955+0000 7f2fb4ba8700 1 Processor -- start 2023-10-14T19:03:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.955+0000 7f2fb4ba8700 1 -- start start 2023-10-14T19:03:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fb4ba8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cb5a0 0x7f2fb00c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fb4ba8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 0x7f2fb0152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fb4ba8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fb016cc20 0x7f2fb016d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fb4ba8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c9690 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fb4ba8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c98f0 con 0x7f2fb016cc20 2023-10-14T19:03:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fb4ba8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c9bd0 con 0x7f2fb00cb5a0 2023-10-14T19:03:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 0x7f2fb0152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 0x7f2fb0152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38742/0 (socket says 172.21.15.7:38742) 2023-10-14T19:03:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 -- 172.21.15.7:0/3219525612 learned_addr learned my addr 172.21.15.7:0/3219525612 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2faed9d700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fb016cc20 0x7f2fb016d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fae59c700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cb5a0 0x7f2fb00c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 -- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cb5a0 msgr2=0x7f2fb00c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cb5a0 0x7f2fb00c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 -- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fb016cc20 msgr2=0x7f2fb016d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fb016cc20 0x7f2fb016d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.956+0000 7f2fadd9b700 1 -- 172.21.15.7:0/3219525612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009420 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.957+0000 7f2fadd9b700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 0x7f2fb0152330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2fb015aca0 tx=0x7f2f98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.957+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98011900 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.957+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98011a60 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.957+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9801a680 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.957+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00c9eb0 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.957+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb0158bd0 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.958+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0158e80 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.958+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f9801aa30 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.958+0000 7f2fa67fc700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.958+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f98086180 con 0x7f2fb00cd9e0 2023-10-14T19:03:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.959+0000 7f2fae59c700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.959+0000 7f2fae59c700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009d10 tx=0x7f2fa80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:19.963+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb0158e80 con 0x7f2fb00cd9e0 2023-10-14T19:03:20.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.158+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fb0158e80 con 0x7f2fb00cd9e0 2023-10-14T19:03:20.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.158+0000 7f2fa67fc700 1 -- 172.21.15.7:0/3219525612 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f2fb0158e80 con 0x7f2fb00cd9e0 2023-10-14T19:03:20.160 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:20.160 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:20.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 msgr2=0x7f2f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009d10 tx=0x7f2fa80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 msgr2=0x7f2fb0152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 0x7f2fb0152330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2fb015aca0 tx=0x7f2f98017000 comp rx=0 tx=0).stop 2023-10-14T19:03:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 shutdown_connections 2023-10-14T19:03:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f90066f30 0x7f2f900693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fb016cc20 0x7f2fb016d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fb00cb5a0 0x7f2fb00c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.160+0000 7f2fb4ba8700 1 --2- 172.21.15.7:0/3219525612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb00cd9e0 0x7f2fb0152330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.161+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 >> 172.21.15.7:0/3219525612 conn(0x7f2fb0070e30 msgr2=0x7f2fb00b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.161+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 shutdown_connections 2023-10-14T19:03:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.161+0000 7f2fb4ba8700 1 -- 172.21.15.7:0/3219525612 wait complete. 2023-10-14T19:03:20.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:20.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.295+0000 7f81faa6e700 1 Processor -- start 2023-10-14T19:03:20.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81faa6e700 1 -- start start 2023-10-14T19:03:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81faa6e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f81f41598c0 0x7f81f40c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81faa6e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 0x7f81f40c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81faa6e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f40c9310 con 0x7f81f40cd460 2023-10-14T19:03:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81faa6e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40ad990 con 0x7f81f41598c0 2023-10-14T19:03:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81faa6e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40ce090 con 0x7f81f4159c90 2023-10-14T19:03:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81f900b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f81f40cd460 0x7f81f40cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40278/0 (socket says 172.21.15.7:40278) 2023-10-14T19:03:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.296+0000 7f81f900b700 1 -- 172.21.15.7:0/2193971842 learned_addr learned my addr 172.21.15.7:0/2193971842 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f880a700 1 --2- 172.21.15.7:0/2193971842 >> v2:172.21.15.148:3300/0 conn(0x7f81f41598c0 0x7f81f40c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f3fff700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 0x7f81f40c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208282672 0 0) 0x7f81f40c9310 con 0x7f81f40cd460 2023-10-14T19:03:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e0003570 con 0x7f81f40cd460 2023-10-14T19:03:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1840461855 0 0) 0x7f81e0003570 con 0x7f81f40cd460 2023-10-14T19:03:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 msgr2=0x7f81f40c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 0x7f81f40c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 >> v2:172.21.15.148:3300/0 conn(0x7f81f41598c0 msgr2=0x7f81f40c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:20.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 --2- 172.21.15.7:0/2193971842 >> v2:172.21.15.148:3300/0 conn(0x7f81f41598c0 0x7f81f40c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40c8cc0 con 0x7f81f40cd460 2023-10-14T19:03:20.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f81dc001470 con 0x7f81f40cd460 2023-10-14T19:03:20.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 >> v1:172.21.15.7:6789/0 conn(0x7f81f40cd460 legacy=0x7f81f40cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003a60 0x7f81e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 0x7f81e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81e0004d50 0x7f81e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40ad990 con 0x7f81e0004d50 2023-10-14T19:03:20.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40ce090 con 0x7f81e0003a60 2023-10-14T19:03:20.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e000ba60 con 0x7f81f4159c90 2023-10-14T19:03:20.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f880a700 1 --2- 172.21.15.7:0/2193971842 >> v2:172.21.15.148:3300/0 conn(0x7f81f41598c0 0x7f81f40c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:20.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f900b700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81e0004d50 0x7f81e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f3fff700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 0x7f81e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.297+0000 7f81f880a700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003a60 0x7f81e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 -- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 msgr2=0x7f81e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:20.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81f4159c90 0x7f81e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 -- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003a60 msgr2=0x7f81e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:20.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003a60 0x7f81e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 -- 172.21.15.7:0/2193971842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0003570 con 0x7f81e0004d50 2023-10-14T19:03:20.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f880a700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003a60 0x7f81e0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:20.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81e0004d50 0x7f81e00051c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c3c0 tx=0x7f81dc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3c2c8e72338709 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00cc30 con 0x7f81e0004d50 2023-10-14T19:03:20.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc00cdb0 con 0x7f81e0004d50 2023-10-14T19:03:20.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f37fe700 1 -- 172.21.15.7:0/2193971842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005b70 con 0x7f81e0004d50 2023-10-14T19:03:20.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81faa6e700 1 -- 172.21.15.7:0/2193971842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81e0004d50 msgr2=0x7f81e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2193971842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81e0004d50 0x7f81e00051c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c3c0 tx=0x7f81dc001e90 comp rx=0 tx=0).stop 2023-10-14T19:03:20.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81f900b700 1 -- 172.21.15.7:0/2193971842 reap_dead start 2023-10-14T19:03:20.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81faa6e700 1 -- 172.21.15.7:0/2193971842 shutdown_connections 2023-10-14T19:03:20.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81faa6e700 1 -- 172.21.15.7:0/2193971842 >> 172.21.15.7:0/2193971842 conn(0x7f81f4088000 msgr2=0x7f81f40883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:20.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81faa6e700 1 -- 172.21.15.7:0/2193971842 shutdown_connections 2023-10-14T19:03:20.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.298+0000 7f81faa6e700 1 -- 172.21.15.7:0/2193971842 wait complete. 2023-10-14T19:03:20.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.299+0000 7f81faa6e700 1 Processor -- start 2023-10-14T19:03:20.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 -- start start 2023-10-14T19:03:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81e0004d50 0x7f81f41560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81f40c7c80 0x7f81f40c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 0x7f81f40c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40b1bb0 con 0x7f81f40c80f0 2023-10-14T19:03:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40c6be0 con 0x7f81f40c7c80 2023-10-14T19:03:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.300+0000 7f81faa6e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40c6ec0 con 0x7f81e0004d50 2023-10-14T19:03:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 0x7f81f40c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 0x7f81f40c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38762/0 (socket says 172.21.15.7:38762) 2023-10-14T19:03:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 -- 172.21.15.7:0/2683456893 learned_addr learned my addr 172.21.15.7:0/2683456893 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f3fff700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81f40c7c80 0x7f81f40c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f880a700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81e0004d50 0x7f81f41560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 -- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81e0004d50 msgr2=0x7f81f41560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81e0004d50 0x7f81f41560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 -- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81f40c7c80 msgr2=0x7f81f40c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81f40c7c80 0x7f81f40c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 -- 172.21.15.7:0/2683456893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40c71a0 con 0x7f81f40c80f0 2023-10-14T19:03:20.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f900b700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 0x7f81f40c65b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009020 tx=0x7f81dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00cc30 con 0x7f81f40c80f0 2023-10-14T19:03:20.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc001430 con 0x7f81f40c80f0 2023-10-14T19:03:20.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f40c7480 con 0x7f81f40c80f0 2023-10-14T19:03:20.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc012400 con 0x7f81f40c80f0 2023-10-14T19:03:20.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.301+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f41565f0 con 0x7f81f40c80f0 2023-10-14T19:03:20.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.302+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f40c79a0 con 0x7f81f40c80f0 2023-10-14T19:03:20.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.302+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81dc019030 con 0x7f81f40c80f0 2023-10-14T19:03:20.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.303+0000 7f81f0ff9700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f81d4066f30 0x7f81d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.303+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81dc084cc0 con 0x7f81f40c80f0 2023-10-14T19:03:20.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.303+0000 7f81f880a700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f81d4066f30 0x7f81d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.304+0000 7f81f880a700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f81d4066f30 0x7f81d40693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009fd0 tx=0x7f81ec00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.307+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81f40c79a0 con 0x7f81f40c80f0 2023-10-14T19:03:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.499+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81f40c79a0 con 0x7f81f40c80f0 2023-10-14T19:03:20.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.500+0000 7f81f0ff9700 1 -- 172.21.15.7:0/2683456893 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81dc051f30 con 0x7f81f40c80f0 2023-10-14T19:03:20.501 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:20.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f81d4066f30 msgr2=0x7f81d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f81d4066f30 0x7f81d40693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009fd0 tx=0x7f81ec00b040 comp rx=0 tx=0).stop 2023-10-14T19:03:20.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 msgr2=0x7f81f40c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 0x7f81f40c65b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009020 tx=0x7f81dc015000 comp rx=0 tx=0).stop 2023-10-14T19:03:20.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 shutdown_connections 2023-10-14T19:03:20.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f81d4066f30 0x7f81d40693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40c80f0 0x7f81f40c65b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81e0004d50 0x7f81f41560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 --2- 172.21.15.7:0/2683456893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81f40c7c80 0x7f81f40c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 >> 172.21.15.7:0/2683456893 conn(0x7f81f4088000 msgr2=0x7f81f40883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 shutdown_connections 2023-10-14T19:03:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.502+0000 7f81faa6e700 1 -- 172.21.15.7:0/2683456893 wait complete. 2023-10-14T19:03:20.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.639+0000 7fdfbdbf7700 1 Processor -- start 2023-10-14T19:03:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.639+0000 7fdfbdbf7700 1 -- start start 2023-10-14T19:03:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfbdbf7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb8159530 0x7fdfb80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfbdbf7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb80ccfd0 con 0x7fdfb806dc70 2023-10-14T19:03:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfbdbf7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb80cf0e0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfbdbf7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815a3d0 con 0x7fdfb8159530 2023-10-14T19:03:20.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdfb806dc70 0x7fdfb8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40282/0 (socket says 172.21.15.7:40282) 2023-10-14T19:03:20.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb6ffd700 1 -- 172.21.15.7:0/2136787334 learned_addr learned my addr 172.21.15.7:0/2136787334 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:20.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb77fe700 1 --2- 172.21.15.7:0/2136787334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb8159530 0x7fdfb80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571843010 0 0) 0x7fdfb80ccfd0 con 0x7fdfb806dc70 2023-10-14T19:03:20.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa0003570 con 0x7fdfb806dc70 2023-10-14T19:03:20.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133477840 0 0) 0x7fdfb80cf0e0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb80ccfd0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342904665 0 0) 0x7fdfa0003570 con 0x7fdfb806dc70 2023-10-14T19:03:20.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb77fe700 1 -- 172.21.15.7:0/2136787334 >> v1:172.21.15.148:6789/0 conn(0x7fdfb806e0e0 legacy=0x7fdfb80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb77fe700 1 -- 172.21.15.7:0/2136787334 >> v1:172.21.15.7:6789/0 conn(0x7fdfb806dc70 legacy=0x7fdfb8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.640+0000 7fdfb77fe700 1 -- 172.21.15.7:0/2136787334 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb815a6b0 con 0x7fdfb8159530 2023-10-14T19:03:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfb77fe700 1 --2- 172.21.15.7:0/2136787334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb8159530 0x7fdfb80ceba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009910 tx=0x7fdfa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b82a93ef060d924 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac001470 con 0x7fdfb8159530 2023-10-14T19:03:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8011420 con 0x7fdfb8159530 2023-10-14T19:03:20.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfb67fc700 1 -- 172.21.15.7:0/2136787334 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80117c0 con 0x7fdfb8159530 2023-10-14T19:03:20.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/2136787334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb8159530 msgr2=0x7fdfb80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/2136787334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb8159530 0x7fdfb80ceba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009910 tx=0x7fdfa80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/2136787334 shutdown_connections 2023-10-14T19:03:20.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/2136787334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb8159530 0x7fdfb80ceba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/2136787334 >> 172.21.15.7:0/2136787334 conn(0x7fdfb80703a0 msgr2=0x7fdfb80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:20.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/2136787334 shutdown_connections 2023-10-14T19:03:20.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.641+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/2136787334 wait complete. 2023-10-14T19:03:20.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 Processor -- start 2023-10-14T19:03:20.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 -- start start 2023-10-14T19:03:20.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb806dc70 0x7fdfb81559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 0x7fdfb814ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb8159530 0x7fdfb80b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8158af0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80b3ab0 con 0x7fdfb8159530 2023-10-14T19:03:20.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfbdbf7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb814b290 con 0x7fdfb806dc70 2023-10-14T19:03:20.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfb6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 0x7fdfb814ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfb6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 0x7fdfb814ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38774/0 (socket says 172.21.15.7:38774) 2023-10-14T19:03:20.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.643+0000 7fdfb6ffd700 1 -- 172.21.15.7:0/935667539 learned_addr learned my addr 172.21.15.7:0/935667539 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:20.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb77fe700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb806dc70 0x7fdfb81559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb7fff700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb8159530 0x7fdfb80b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb6ffd700 1 -- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb806dc70 msgr2=0x7fdfb81559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb6ffd700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb806dc70 0x7fdfb81559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb6ffd700 1 -- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb8159530 msgr2=0x7fdfb80b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb6ffd700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb8159530 0x7fdfb80b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb6ffd700 1 -- 172.21.15.7:0/935667539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009420 con 0x7fdfb806e0e0 2023-10-14T19:03:20.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb77fe700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb806dc70 0x7fdfb81559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:20.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb7fff700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb8159530 0x7fdfb80b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:20.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfb6ffd700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 0x7fdfb814ad50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00cb70 tx=0x7fdfac001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac007360 con 0x7fdfb806e0e0 2023-10-14T19:03:20.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0074e0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb80b3480 con 0x7fdfb806e0e0 2023-10-14T19:03:20.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac004830 con 0x7fdfb806e0e0 2023-10-14T19:03:20.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.644+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb814cb30 con 0x7fdfb806e0e0 2023-10-14T19:03:20.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.645+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb804c3c0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.646+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfac004ba0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.646+0000 7fdf9f7fe700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdfa4066f30 0x7fdfa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.646+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfac083d20 con 0x7fdfb806e0e0 2023-10-14T19:03:20.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.646+0000 7fdfb77fe700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdfa4066f30 0x7fdfa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.647+0000 7fdfb77fe700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdfa4066f30 0x7fdfa40693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80030c0 tx=0x7fdfa8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.650+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfac051010 con 0x7fdfb806e0e0 2023-10-14T19:03:20.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.845+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfb80b3bf0 con 0x7fdfb806e0e0 2023-10-14T19:03:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.845+0000 7fdf9f7fe700 1 -- 172.21.15.7:0/935667539 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfac018020 con 0x7fdfb806e0e0 2023-10-14T19:03:20.847 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdfa4066f30 msgr2=0x7fdfa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdfa4066f30 0x7fdfa40693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80030c0 tx=0x7fdfa8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 msgr2=0x7fdfb814ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 0x7fdfb814ad50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00cb70 tx=0x7fdfac001b50 comp rx=0 tx=0).stop 2023-10-14T19:03:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 shutdown_connections 2023-10-14T19:03:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdfa4066f30 0x7fdfa40693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb8159530 0x7fdfb80b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb806dc70 0x7fdfb81559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 --2- 172.21.15.7:0/935667539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb806e0e0 0x7fdfb814ad50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 >> 172.21.15.7:0/935667539 conn(0x7fdfb80703a0 msgr2=0x7fdfb80b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 shutdown_connections 2023-10-14T19:03:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.848+0000 7fdfbdbf7700 1 -- 172.21.15.7:0/935667539 wait complete. 2023-10-14T19:03:20.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.982+0000 7f1fdf2a8700 1 Processor -- start 2023-10-14T19:03:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.982+0000 7f1fdf2a8700 1 -- start start 2023-10-14T19:03:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdf2a8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd81508b0 0x7f1fd80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdf2a8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1fd80675a0 0x7f1fd8067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdf2a8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd8067f40 con 0x7f1fd8150c80 2023-10-14T19:03:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdf2a8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd80cddf0 con 0x7f1fd80675a0 2023-10-14T19:03:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdf2a8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80b0360 con 0x7f1fd81508b0 2023-10-14T19:03:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdd845700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1fd80675a0 0x7f1fd8067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdd845700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1fd80675a0 0x7f1fd8067a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38782/0 (socket says 172.21.15.7:38782) 2023-10-14T19:03:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdd845700 1 -- 172.21.15.7:0/3334579570 learned_addr learned my addr 172.21.15.7:0/3334579570 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.983+0000 7f1fdd044700 1 --2- 172.21.15.7:0/3334579570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd81508b0 0x7f1fd80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fdd845700 1 -- 172.21.15.7:0/3334579570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd81508b0 msgr2=0x7f1fd80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fdd845700 1 --2- 172.21.15.7:0/3334579570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd81508b0 0x7f1fd80ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fdd845700 1 -- 172.21.15.7:0/3334579570 >> v1:172.21.15.148:6789/0 conn(0x7f1fd8150c80 legacy=0x7f1fd81573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fdd845700 1 -- 172.21.15.7:0/3334579570 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80cd550 con 0x7f1fd80675a0 2023-10-14T19:03:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fdd845700 1 --2- 172.21.15.7:0/3334579570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd8067a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009f20 tx=0x7f1fc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0184a2d54fe8211 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fd7fff700 1 -- 172.21.15.7:0/3334579570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800e070 con 0x7f1fd80675a0 2023-10-14T19:03:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fd7fff700 1 -- 172.21.15.7:0/3334579570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc800b9d0 con 0x7f1fd80675a0 2023-10-14T19:03:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.984+0000 7f1fd7fff700 1 -- 172.21.15.7:0/3334579570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80092e0 con 0x7f1fd80675a0 2023-10-14T19:03:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/3334579570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 msgr2=0x7f1fd8067a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/3334579570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd8067a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009f20 tx=0x7f1fc8009840 comp rx=0 tx=0).stop 2023-10-14T19:03:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/3334579570 shutdown_connections 2023-10-14T19:03:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/3334579570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd8067a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/3334579570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd81508b0 0x7f1fd80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/3334579570 >> 172.21.15.7:0/3334579570 conn(0x7f1fd806d7b0 msgr2=0x7f1fd806dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/3334579570 shutdown_connections 2023-10-14T19:03:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.985+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/3334579570 wait complete. 2023-10-14T19:03:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.986+0000 7f1fdf2a8700 1 Processor -- start 2023-10-14T19:03:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.986+0000 7f1fdf2a8700 1 -- start start 2023-10-14T19:03:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd80cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fd81508b0 0x7f1fd81552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd8150c80 0x7f1fd80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd81521d0 con 0x7f1fd80675a0 2023-10-14T19:03:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8151d40 con 0x7f1fd81508b0 2023-10-14T19:03:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8151130 con 0x7f1fd8150c80 2023-10-14T19:03:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd80cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd80cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38794/0 (socket says 172.21.15.7:38794) 2023-10-14T19:03:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 -- 172.21.15.7:0/963040322 learned_addr learned my addr 172.21.15.7:0/963040322 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdc843700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fd81508b0 0x7f1fd81552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd845700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd8150c80 0x7f1fd80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 -- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd8150c80 msgr2=0x7f1fd80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd8150c80 0x7f1fd80ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 -- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fd81508b0 msgr2=0x7f1fd81552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fd81508b0 0x7f1fd81552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 -- 172.21.15.7:0/963040322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8009ae0 con 0x7f1fd80675a0 2023-10-14T19:03:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdc843700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fd81508b0 0x7f1fd81552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd845700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd8150c80 0x7f1fd80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdd044700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd80cc2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000ecb0 tx=0x7f1fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000c970 con 0x7f1fd80675a0 2023-10-14T19:03:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000cad0 con 0x7f1fd80675a0 2023-10-14T19:03:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd8151410 con 0x7f1fd80675a0 2023-10-14T19:03:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000ce70 con 0x7f1fd80675a0 2023-10-14T19:03:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.987+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd81519d0 con 0x7f1fd80675a0 2023-10-14T19:03:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.988+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd8152020 con 0x7f1fd80675a0 2023-10-14T19:03:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.989+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fd0013680 con 0x7f1fd80675a0 2023-10-14T19:03:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.989+0000 7f1fd57fa700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fc4066f30 0x7f1fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.989+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd0084870 con 0x7f1fd80675a0 2023-10-14T19:03:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.989+0000 7f1fdc843700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fc4066f30 0x7f1fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.990+0000 7f1fdc843700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fc4066f30 0x7f1fc40693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007fd0 tx=0x7f1fcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:20.993+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fd0051ae0 con 0x7f1fd80675a0 2023-10-14T19:03:21.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.187+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fd804c3c0 con 0x7f1fd80675a0 2023-10-14T19:03:21.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.187+0000 7f1fd57fa700 1 -- 172.21.15.7:0/963040322 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fd0055100 con 0x7f1fd80675a0 2023-10-14T19:03:21.189 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fc4066f30 msgr2=0x7f1fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fc4066f30 0x7f1fc40693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007fd0 tx=0x7f1fcc009040 comp rx=0 tx=0).stop 2023-10-14T19:03:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 msgr2=0x7f1fd80cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd80cc2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000ecb0 tx=0x7f1fd00091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 shutdown_connections 2023-10-14T19:03:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fc4066f30 0x7f1fc40693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fd8150c80 0x7f1fd80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fd80675a0 0x7f1fd80cc2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 --2- 172.21.15.7:0/963040322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fd81508b0 0x7f1fd81552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 >> 172.21.15.7:0/963040322 conn(0x7f1fd806d7b0 msgr2=0x7f1fd80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 shutdown_connections 2023-10-14T19:03:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.189+0000 7f1fdf2a8700 1 -- 172.21.15.7:0/963040322 wait complete. 2023-10-14T19:03:21.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:21.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.321+0000 7f11b0d33700 1 Processor -- start 2023-10-14T19:03:21.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.321+0000 7f11b0d33700 1 -- start start 2023-10-14T19:03:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11b0d33700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11ac0cb970 0x7f11ac159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11b0d33700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac15ae40 con 0x7f11ac0cb5a0 2023-10-14T19:03:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11b0d33700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac15ab60 con 0x7f11ac15a400 2023-10-14T19:03:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11b0d33700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0ce0f0 con 0x7f11ac0cb970 2023-10-14T19:03:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11a9d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11ac0cb970 0x7f11ac159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11aa59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f11ac0cb5a0 0x7f11ac0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40292/0 (socket says 172.21.15.7:40292) 2023-10-14T19:03:21.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11aa59c700 1 -- 172.21.15.7:0/1340661197 learned_addr learned my addr 172.21.15.7:0/1340661197 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:21.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11a9d9b700 1 -- 172.21.15.7:0/1340661197 >> v1:172.21.15.148:6789/0 conn(0x7f11ac15a400 legacy=0x7f11ac156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11a9d9b700 1 -- 172.21.15.7:0/1340661197 >> v1:172.21.15.7:6789/0 conn(0x7f11ac0cb5a0 legacy=0x7f11ac0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.322+0000 7f11a9d9b700 1 -- 172.21.15.7:0/1340661197 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0ccf00 con 0x7f11ac0cb970 2023-10-14T19:03:21.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11a9d9b700 1 --2- 172.21.15.7:0/1340661197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac0cb970 0x7f11ac159ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f11940098e0 tx=0x7f11940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3aecc90636be77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11a959a700 1 -- 172.21.15.7:0/1340661197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194009e80 con 0x7f11ac0cb970 2023-10-14T19:03:21.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11a959a700 1 -- 172.21.15.7:0/1340661197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119400b860 con 0x7f11ac0cb970 2023-10-14T19:03:21.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11a959a700 1 -- 172.21.15.7:0/1340661197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400bbe0 con 0x7f11ac0cb970 2023-10-14T19:03:21.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 -- 172.21.15.7:0/1340661197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac0cb970 msgr2=0x7f11ac159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 --2- 172.21.15.7:0/1340661197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac0cb970 0x7f11ac159ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f11940098e0 tx=0x7f11940091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 -- 172.21.15.7:0/1340661197 shutdown_connections 2023-10-14T19:03:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 --2- 172.21.15.7:0/1340661197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac0cb970 0x7f11ac159ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 -- 172.21.15.7:0/1340661197 >> 172.21.15.7:0/1340661197 conn(0x7f11ac070e30 msgr2=0x7f11ac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 -- 172.21.15.7:0/1340661197 shutdown_connections 2023-10-14T19:03:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.323+0000 7f11b0d33700 1 -- 172.21.15.7:0/1340661197 wait complete. 2023-10-14T19:03:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.324+0000 7f11b0d33700 1 Processor -- start 2023-10-14T19:03:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 -- start start 2023-10-14T19:03:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ac0cb5a0 0x7f11ac14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ac0cb970 0x7f11ac0b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 0x7f11ac15d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac14ccf0 con 0x7f11ac15a400 2023-10-14T19:03:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac15db50 con 0x7f11ac0cb970 2023-10-14T19:03:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11b0d33700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac14d1c0 con 0x7f11ac0cb5a0 2023-10-14T19:03:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11aad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 0x7f11ac15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11aad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 0x7f11ac15d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38822/0 (socket says 172.21.15.7:38822) 2023-10-14T19:03:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11aad9d700 1 -- 172.21.15.7:0/2962419516 learned_addr learned my addr 172.21.15.7:0/2962419516 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11aa59c700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ac0cb5a0 0x7f11ac14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.325+0000 7f11a9d9b700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ac0cb970 0x7f11ac0b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11aad9d700 1 -- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ac0cb5a0 msgr2=0x7f11ac14d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11aad9d700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ac0cb5a0 0x7f11ac14d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11aad9d700 1 -- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ac0cb970 msgr2=0x7f11ac0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11aad9d700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ac0cb970 0x7f11ac0b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11aad9d700 1 -- 172.21.15.7:0/2962419516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194009420 con 0x7f11ac15a400 2023-10-14T19:03:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11aad9d700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 0x7f11ac15d610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c4c0 tx=0x7f119c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00ce70 con 0x7f11ac15a400 2023-10-14T19:03:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c011590 con 0x7f11ac15a400 2023-10-14T19:03:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac0b63a0 con 0x7f11ac15a400 2023-10-14T19:03:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c011970 con 0x7f11ac15a400 2023-10-14T19:03:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.326+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac0b4240 con 0x7f11ac15a400 2023-10-14T19:03:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.327+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac04c3c0 con 0x7f11ac15a400 2023-10-14T19:03:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.327+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f119c011ce0 con 0x7f11ac15a400 2023-10-14T19:03:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.328+0000 7f11a27fc700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.328+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f119c083810 con 0x7f11ac15a400 2023-10-14T19:03:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.328+0000 7f11aa59c700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.328+0000 7f11aa59c700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f118c066f30 0x7f118c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11a40020c0 tx=0x7f11a4001a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.332+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f119c050a80 con 0x7f11ac15a400 2023-10-14T19:03:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.574+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11ac0883f0 con 0x7f11ac15a400 2023-10-14T19:03:21.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.574+0000 7f11a27fc700 1 -- 172.21.15.7:0/2962419516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f119c017020 con 0x7f11ac15a400 2023-10-14T19:03:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:21.576 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:21.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f118c066f30 msgr2=0x7f118c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f118c066f30 0x7f118c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11a40020c0 tx=0x7f11a4001a10 comp rx=0 tx=0).stop 2023-10-14T19:03:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 msgr2=0x7f11ac15d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 0x7f11ac15d610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c4c0 tx=0x7f119c007f50 comp rx=0 tx=0).stop 2023-10-14T19:03:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 shutdown_connections 2023-10-14T19:03:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ac15a400 0x7f11ac15d610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ac0cb5a0 0x7f11ac14d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 --2- 172.21.15.7:0/2962419516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ac0cb970 0x7f11ac0b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 >> 172.21.15.7:0/2962419516 conn(0x7f11ac070e30 msgr2=0x7f11ac0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.576+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 shutdown_connections 2023-10-14T19:03:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.577+0000 7f11b0d33700 1 -- 172.21.15.7:0/2962419516 wait complete. 2023-10-14T19:03:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:21.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:21.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.707+0000 7fa6d4759700 1 Processor -- start 2023-10-14T19:03:21.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.707+0000 7fa6d4759700 1 -- start start 2023-10-14T19:03:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.708+0000 7fa6d4759700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 0x7fa6cc0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.708+0000 7fa6d4759700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0ce1a0 con 0x7fa6cc0a8be0 2023-10-14T19:03:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.708+0000 7fa6d4759700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0cd5d0 con 0x7fa6cc0aee90 2023-10-14T19:03:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.708+0000 7fa6d4759700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0cd870 con 0x7fa6cc06d280 2023-10-14T19:03:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.708+0000 7fa6d24f5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa6cc0a8be0 0x7fa6cc0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40294/0 (socket says 172.21.15.7:40294) 2023-10-14T19:03:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.708+0000 7fa6d24f5700 1 -- 172.21.15.7:0/1931363884 learned_addr learned my addr 172.21.15.7:0/1931363884 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:21.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d2cf6700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 0x7fa6cc0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406042270 0 0) 0x7fa6cc0ce1a0 con 0x7fa6cc0a8be0 2023-10-14T19:03:21.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b4003570 con 0x7fa6cc0a8be0 2023-10-14T19:03:21.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920257223 0 0) 0x7fa6b4003570 con 0x7fa6cc0a8be0 2023-10-14T19:03:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 msgr2=0x7fa6cc0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 0x7fa6cc0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 >> v1:172.21.15.148:6789/0 conn(0x7fa6cc0aee90 legacy=0x7fa6cc0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0cdb50 con 0x7fa6cc0a8be0 2023-10-14T19:03:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa6c4001970 con 0x7fa6cc0a8be0 2023-10-14T19:03:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 >> v1:172.21.15.7:6789/0 conn(0x7fa6cc0a8be0 legacy=0x7fa6cc0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b4003a90 0x7fa6b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 0x7fa6b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0cd870 con 0x7fa6b4004810 2023-10-14T19:03:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b400bb40 con 0x7fa6b4003a90 2023-10-14T19:03:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b400bd00 con 0x7fa6cc06d280 2023-10-14T19:03:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d24f5700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b4003a90 0x7fa6b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d2cf6700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 0x7fa6b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d1cf4700 1 -- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 msgr2=0x7fa6b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06d280 0x7fa6b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d1cf4700 1 -- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b4003a90 msgr2=0x7fa6b4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b4003a90 0x7fa6b4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.709+0000 7fa6d1cf4700 1 -- 172.21.15.7:0/1931363884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b4003570 con 0x7fa6b4004810 2023-10-14T19:03:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6b4004c80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0af290 tx=0x7fa6c0007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ec111b90ff4da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0001330 con 0x7fa6b4004810 2023-10-14T19:03:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c000c5d0 con 0x7fa6b4004810 2023-10-14T19:03:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d14f3700 1 -- 172.21.15.7:0/1931363884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000c970 con 0x7fa6b4004810 2023-10-14T19:03:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d4759700 1 -- 172.21.15.7:0/1931363884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 msgr2=0x7fa6b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1931363884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6b4004c80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0af290 tx=0x7fa6c0007d60 comp rx=0 tx=0).stop 2023-10-14T19:03:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d2cf6700 1 -- 172.21.15.7:0/1931363884 reap_dead start 2023-10-14T19:03:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d4759700 1 -- 172.21.15.7:0/1931363884 shutdown_connections 2023-10-14T19:03:21.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d4759700 1 -- 172.21.15.7:0/1931363884 >> 172.21.15.7:0/1931363884 conn(0x7fa6cc06ce80 msgr2=0x7fa6cc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:21.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d4759700 1 -- 172.21.15.7:0/1931363884 shutdown_connections 2023-10-14T19:03:21.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.710+0000 7fa6d4759700 1 -- 172.21.15.7:0/1931363884 wait complete. 2023-10-14T19:03:21.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.711+0000 7fa6d4759700 1 Processor -- start 2023-10-14T19:03:21.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.711+0000 7fa6d4759700 1 -- start start 2023-10-14T19:03:21.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d4759700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6cc0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d4759700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06e8a0 0x7fa6cc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d4759700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc1566d0 0x7fa6cc156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d4759700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0cb210 con 0x7fa6b4004810 2023-10-14T19:03:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d4759700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc15c7b0 con 0x7fa6cc1566d0 2023-10-14T19:03:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d4759700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc157090 con 0x7fa6cc06e8a0 2023-10-14T19:03:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d24f5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6cc0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d24f5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6cc0ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38846/0 (socket says 172.21.15.7:38846) 2023-10-14T19:03:21.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d24f5700 1 -- 172.21.15.7:0/1194931906 learned_addr learned my addr 172.21.15.7:0/1194931906 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:21.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06e8a0 0x7fa6cc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d2cf6700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc1566d0 0x7fa6cc156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d24f5700 1 -- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06e8a0 msgr2=0x7fa6cc0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.712+0000 7fa6d24f5700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06e8a0 0x7fa6cc0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6d24f5700 1 -- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc1566d0 msgr2=0x7fa6cc156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6d24f5700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc1566d0 0x7fa6cc156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6d24f5700 1 -- 172.21.15.7:0/1194931906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0ca970 con 0x7fa6b4004810 2023-10-14T19:03:21.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6d24f5700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6cc0ca390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ffa0 tx=0x7fa6c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4005d80 con 0x7fa6b4004810 2023-10-14T19:03:21.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c400d9a0 con 0x7fa6b4004810 2023-10-14T19:03:21.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc0cac50 con 0x7fa6b4004810 2023-10-14T19:03:21.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c400dd60 con 0x7fa6b4004810 2023-10-14T19:03:21.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.713+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc06ed10 con 0x7fa6b4004810 2023-10-14T19:03:21.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.714+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc04c3c0 con 0x7fa6b4004810 2023-10-14T19:03:21.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.714+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6c40072e0 con 0x7fa6b4004810 2023-10-14T19:03:21.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.715+0000 7fa6ca7fc700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6b8066f30 0x7fa6b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:21.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.715+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6c4084a70 con 0x7fa6b4004810 2023-10-14T19:03:21.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.715+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6b8066f30 0x7fa6b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:21.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.715+0000 7fa6d1cf4700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6b8066f30 0x7fa6b80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc09c340 tx=0x7fa6c0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:21.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.719+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6c4051ce0 con 0x7fa6b4004810 2023-10-14T19:03:21.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.913+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6cc067b20 con 0x7fa6b4004810 2023-10-14T19:03:21.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.914+0000 7fa6ca7fc700 1 -- 172.21.15.7:0/1194931906 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa6c4055300 con 0x7fa6b4004810 2023-10-14T19:03:21.915 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:21.915 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:21.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6b8066f30 msgr2=0x7fa6b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6b8066f30 0x7fa6b80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc09c340 tx=0x7fa6c0015000 comp rx=0 tx=0).stop 2023-10-14T19:03:21.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 msgr2=0x7fa6cc0ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:21.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6cc0ca390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ffa0 tx=0x7fa6c4009040 comp rx=0 tx=0).stop 2023-10-14T19:03:21.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 shutdown_connections 2023-10-14T19:03:21.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6b8066f30 0x7fa6b80693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc1566d0 0x7fa6cc156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b4004810 0x7fa6cc0ca390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 --2- 172.21.15.7:0/1194931906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc06e8a0 0x7fa6cc0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:21.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 >> 172.21.15.7:0/1194931906 conn(0x7fa6cc06ce80 msgr2=0x7fa6cc159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:21.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 shutdown_connections 2023-10-14T19:03:21.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:21.916+0000 7fa6d4759700 1 -- 172.21.15.7:0/1194931906 wait complete. 2023-10-14T19:03:21.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:21.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.051+0000 7fdcd8a9f700 1 Processor -- start 2023-10-14T19:03:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.051+0000 7fdcd8a9f700 1 -- start start 2023-10-14T19:03:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd8a9f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdcd4159530 0x7fdcd40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd8a9f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406dc70 0x7fdcd4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd8a9f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdcd406e0e0 0x7fdcd40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd8a9f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40ccfd0 con 0x7fdcd4159530 2023-10-14T19:03:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd8a9f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40cf0e0 con 0x7fdcd406e0e0 2023-10-14T19:03:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd8a9f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd415a3d0 con 0x7fdcd406dc70 2023-10-14T19:03:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdcd4159530 0x7fdcd40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdcd4159530 0x7fdcd40ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38848/0 (socket says 172.21.15.7:38848) 2023-10-14T19:03:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 -- 172.21.15.7:0/1282525227 learned_addr learned my addr 172.21.15.7:0/1282525227 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 -- 172.21.15.7:0/1282525227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406dc70 msgr2=0x7fdcd4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 --2- 172.21.15.7:0/1282525227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406dc70 0x7fdcd4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 -- 172.21.15.7:0/1282525227 >> v2:172.21.15.148:3300/0 conn(0x7fdcd406e0e0 msgr2=0x7fdcd40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 --2- 172.21.15.7:0/1282525227 >> v2:172.21.15.148:3300/0 conn(0x7fdcd406e0e0 0x7fdcd40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 -- 172.21.15.7:0/1282525227 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd415a6b0 con 0x7fdcd4159530 2023-10-14T19:03:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd259c700 1 --2- 172.21.15.7:0/1282525227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd4159530 0x7fdcd40ceba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4089880 tx=0x7fdcc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8133dcd8e5d619 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd159a700 1 -- 172.21.15.7:0/1282525227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400b860 con 0x7fdcd4159530 2023-10-14T19:03:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd159a700 1 -- 172.21.15.7:0/1282525227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400b9c0 con 0x7fdcd4159530 2023-10-14T19:03:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.052+0000 7fdcd159a700 1 -- 172.21.15.7:0/1282525227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400bd60 con 0x7fdcd4159530 2023-10-14T19:03:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/1282525227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd4159530 msgr2=0x7fdcd40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/1282525227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd4159530 0x7fdcd40ceba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4089880 tx=0x7fdcc4009250 comp rx=0 tx=0).stop 2023-10-14T19:03:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/1282525227 shutdown_connections 2023-10-14T19:03:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/1282525227 >> v2:172.21.15.148:3300/0 conn(0x7fdcd406e0e0 0x7fdcd40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/1282525227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd4159530 0x7fdcd40ceba0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/1282525227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406dc70 0x7fdcd4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/1282525227 >> 172.21.15.7:0/1282525227 conn(0x7fdcd40703a0 msgr2=0x7fdcd40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:22.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/1282525227 shutdown_connections 2023-10-14T19:03:22.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.053+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/1282525227 wait complete. 2023-10-14T19:03:22.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.054+0000 7fdcd8a9f700 1 Processor -- start 2023-10-14T19:03:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.054+0000 7fdcd8a9f700 1 -- start start 2023-10-14T19:03:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 0x7fdcd414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406e0e0 0x7fdcd4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd4159530 0x7fdcd40b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41534c0 con 0x7fdcd406dc70 2023-10-14T19:03:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b3620 con 0x7fdcd4159530 2023-10-14T19:03:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b3900 con 0x7fdcd406e0e0 2023-10-14T19:03:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 0x7fdcd414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 0x7fdcd414e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38862/0 (socket says 172.21.15.7:38862) 2023-10-14T19:03:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 -- 172.21.15.7:0/2274044717 learned_addr learned my addr 172.21.15.7:0/2274044717 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd1d9b700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406e0e0 0x7fdcd4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd2d9d700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd4159530 0x7fdcd40b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 -- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406e0e0 msgr2=0x7fdcd4153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406e0e0 0x7fdcd4153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 -- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd4159530 msgr2=0x7fdcd40b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd4159530 0x7fdcd40b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 -- 172.21.15.7:0/2274044717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40094f0 con 0x7fdcd406dc70 2023-10-14T19:03:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd259c700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 0x7fdcd414e380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009290 tx=0x7fdcc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4026480 con 0x7fdcd406dc70 2023-10-14T19:03:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc401f070 con 0x7fdcd406dc70 2023-10-14T19:03:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4026850 con 0x7fdcd406dc70 2023-10-14T19:03:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.055+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40b3be0 con 0x7fdcd406dc70 2023-10-14T19:03:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.056+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd40b41a0 con 0x7fdcd406dc70 2023-10-14T19:03:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.056+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd404c3c0 con 0x7fdcd406dc70 2023-10-14T19:03:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.057+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcc401a430 con 0x7fdcd406dc70 2023-10-14T19:03:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.057+0000 7fdcc27fc700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdcb4066f30 0x7fdcb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.057+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdcc4021070 con 0x7fdcd406dc70 2023-10-14T19:03:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.057+0000 7fdcd1d9b700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdcb4066f30 0x7fdcb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.058+0000 7fdcd1d9b700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdcb4066f30 0x7fdcb40693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8006fd0 tx=0x7fdcc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.062+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcc4053690 con 0x7fdcd406dc70 2023-10-14T19:03:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.254+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcd415a990 con 0x7fdcd406dc70 2023-10-14T19:03:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.254+0000 7fdcc27fc700 1 -- 172.21.15.7:0/2274044717 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcc4056cb0 con 0x7fdcd406dc70 2023-10-14T19:03:22.256 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdcb4066f30 msgr2=0x7fdcb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdcb4066f30 0x7fdcb40693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8006fd0 tx=0x7fdcc8008040 comp rx=0 tx=0).stop 2023-10-14T19:03:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 msgr2=0x7fdcd414e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 0x7fdcd414e380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009290 tx=0x7fdcc4017000 comp rx=0 tx=0).stop 2023-10-14T19:03:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 shutdown_connections 2023-10-14T19:03:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdcb4066f30 0x7fdcb40693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd4159530 0x7fdcd40b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd406dc70 0x7fdcd414e380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 --2- 172.21.15.7:0/2274044717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd406e0e0 0x7fdcd4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 >> 172.21.15.7:0/2274044717 conn(0x7fdcd40703a0 msgr2=0x7fdcd40b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 shutdown_connections 2023-10-14T19:03:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.256+0000 7fdcd8a9f700 1 -- 172.21.15.7:0/2274044717 wait complete. 2023-10-14T19:03:22.269 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.392+0000 7efd613a1700 1 Processor -- start 2023-10-14T19:03:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.392+0000 7efd613a1700 1 -- start start 2023-10-14T19:03:22.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd613a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 0x7efd5c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd613a1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd5c15de50 0x7efd5c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd613a1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c15af60 con 0x7efd5c0cea00 2023-10-14T19:03:22.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd613a1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c15d010 con 0x7efd5c15de50 2023-10-14T19:03:22.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd613a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15b240 con 0x7efd5c153a00 2023-10-14T19:03:22.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd60ba0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efd5c0cea00 0x7efd5c0cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40308/0 (socket says 172.21.15.7:40308) 2023-10-14T19:03:22.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd60ba0700 1 -- 172.21.15.7:0/1467629982 learned_addr learned my addr 172.21.15.7:0/1467629982 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:22.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd5b7fe700 1 --2- 172.21.15.7:0/1467629982 >> v2:172.21.15.148:3300/0 conn(0x7efd5c15de50 0x7efd5c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd5bfff700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 0x7efd5c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199096117 0 0) 0x7efd5c15af60 con 0x7efd5c0cea00 2023-10-14T19:03:22.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.393+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd44003570 con 0x7efd5c0cea00 2023-10-14T19:03:22.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708475987 0 0) 0x7efd44003570 con 0x7efd5c0cea00 2023-10-14T19:03:22.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 msgr2=0x7efd5c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 0x7efd5c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 >> v2:172.21.15.148:3300/0 conn(0x7efd5c15de50 msgr2=0x7efd5c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 --2- 172.21.15.7:0/1467629982 >> v2:172.21.15.148:3300/0 conn(0x7efd5c15de50 0x7efd5c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c15b520 con 0x7efd5c0cea00 2023-10-14T19:03:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7efd540017f0 con 0x7efd5c0cea00 2023-10-14T19:03:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 >> v1:172.21.15.7:6789/0 conn(0x7efd5c0cea00 legacy=0x7efd5c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 0x7efd44003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd44003fe0 0x7efd44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44004d50 0x7efd440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15d010 con 0x7efd44003fe0 2023-10-14T19:03:22.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15b240 con 0x7efd44004d50 2023-10-14T19:03:22.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4400ba90 con 0x7efd5c153a00 2023-10-14T19:03:22.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd44003fe0 0x7efd44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5bfff700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 0x7efd44003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd60ba0700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44004d50 0x7efd440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 -- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 msgr2=0x7efd44003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c153a00 0x7efd44003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 -- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44004d50 msgr2=0x7efd440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44004d50 0x7efd440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 -- 172.21.15.7:0/1467629982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44003570 con 0x7efd44003fe0 2023-10-14T19:03:22.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd60ba0700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44004d50 0x7efd440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:22.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5b7fe700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd44003fe0 0x7efd44004810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd50009c00 tx=0x7efd500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fbe7bd8a6ab76c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.394+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000e6b0 con 0x7efd44003fe0 2023-10-14T19:03:22.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5000e810 con 0x7efd44003fe0 2023-10-14T19:03:22.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd5affd700 1 -- 172.21.15.7:0/1467629982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000ebd0 con 0x7efd44003fe0 2023-10-14T19:03:22.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd613a1700 1 -- 172.21.15.7:0/1467629982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd44003fe0 msgr2=0x7efd44004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd613a1700 1 --2- 172.21.15.7:0/1467629982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd44003fe0 0x7efd44004810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd50009c00 tx=0x7efd500091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd60ba0700 1 -- 172.21.15.7:0/1467629982 reap_dead start 2023-10-14T19:03:22.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd613a1700 1 -- 172.21.15.7:0/1467629982 shutdown_connections 2023-10-14T19:03:22.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd613a1700 1 -- 172.21.15.7:0/1467629982 >> 172.21.15.7:0/1467629982 conn(0x7efd5c0703a0 msgr2=0x7efd5c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:22.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd613a1700 1 -- 172.21.15.7:0/1467629982 shutdown_connections 2023-10-14T19:03:22.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.395+0000 7efd613a1700 1 -- 172.21.15.7:0/1467629982 wait complete. 2023-10-14T19:03:22.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.396+0000 7efd613a1700 1 Processor -- start 2023-10-14T19:03:22.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.396+0000 7efd613a1700 1 -- start start 2023-10-14T19:03:22.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd613a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44003fe0 0x7efd5c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd613a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0b3b80 0x7efd5c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd613a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 0x7efd5c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd613a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0c8960 con 0x7efd5c152f60 2023-10-14T19:03:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd613a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0c9200 con 0x7efd44003fe0 2023-10-14T19:03:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd613a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0b40f0 con 0x7efd5c0b3b80 2023-10-14T19:03:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 0x7efd5c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 0x7efd5c0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38878/0 (socket says 172.21.15.7:38878) 2023-10-14T19:03:22.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 -- 172.21.15.7:0/2459695248 learned_addr learned my addr 172.21.15.7:0/2459695248 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:22.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 -- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0b3b80 msgr2=0x7efd5c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd5b7fe700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0b3b80 0x7efd5c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd5bfff700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44003fe0 0x7efd5c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0b3b80 0x7efd5c0b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 -- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44003fe0 msgr2=0x7efd5c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44003fe0 0x7efd5c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.397+0000 7efd60ba0700 1 -- 172.21.15.7:0/2459695248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0c8bb0 con 0x7efd5c152f60 2023-10-14T19:03:22.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.398+0000 7efd60ba0700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 0x7efd5c0cc0e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd54002250 tx=0x7efd54001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.398+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54017070 con 0x7efd5c152f60 2023-10-14T19:03:22.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.398+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5400ebc0 con 0x7efd5c152f60 2023-10-14T19:03:22.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.398+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c0c8e90 con 0x7efd5c152f60 2023-10-14T19:03:22.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.398+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54013420 con 0x7efd5c152f60 2023-10-14T19:03:22.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.398+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c1533d0 con 0x7efd5c152f60 2023-10-14T19:03:22.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.399+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c1535f0 con 0x7efd5c152f60 2023-10-14T19:03:22.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.399+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd540137d0 con 0x7efd5c152f60 2023-10-14T19:03:22.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.399+0000 7efd43fff700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.400+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd54084450 con 0x7efd5c152f60 2023-10-14T19:03:22.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.400+0000 7efd5bfff700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.400+0000 7efd5bfff700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd48066f30 0x7efd480693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0093f0 tx=0x7efd4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.404+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd540516c0 con 0x7efd5c152f60 2023-10-14T19:03:22.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.597+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd5c04c3c0 con 0x7efd5c152f60 2023-10-14T19:03:22.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.597+0000 7efd43fff700 1 -- 172.21.15.7:0/2459695248 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd54054ce0 con 0x7efd5c152f60 2023-10-14T19:03:22.599 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:22.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.599+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd48066f30 msgr2=0x7efd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.599+0000 7efd613a1700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd48066f30 0x7efd480693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0093f0 tx=0x7efd4c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:22.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.599+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 msgr2=0x7efd5c0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.599+0000 7efd613a1700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 0x7efd5c0cc0e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd54002250 tx=0x7efd54001250 comp rx=0 tx=0).stop 2023-10-14T19:03:22.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 shutdown_connections 2023-10-14T19:03:22.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44003fe0 0x7efd5c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd5c152f60 0x7efd5c0cc0e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 --2- 172.21.15.7:0/2459695248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0b3b80 0x7efd5c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 >> 172.21.15.7:0/2459695248 conn(0x7efd5c0703a0 msgr2=0x7efd5c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:22.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 shutdown_connections 2023-10-14T19:03:22.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.600+0000 7efd613a1700 1 -- 172.21.15.7:0/2459695248 wait complete. 2023-10-14T19:03:22.613 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.734+0000 7f868a8e1700 1 Processor -- start 2023-10-14T19:03:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.734+0000 7f868a8e1700 1 -- start start 2023-10-14T19:03:22.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f868a8e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f86840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f868a8e1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f868406dc70 0x7f8684159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f868a8e1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86840ccfd0 con 0x7f868406e0e0 2023-10-14T19:03:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f868a8e1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840cf0e0 con 0x7f868406dc70 2023-10-14T19:03:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f868a8e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868415a3d0 con 0x7f8684159530 2023-10-14T19:03:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f868406dc70 0x7f8684159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f868406dc70 0x7f8684159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38890/0 (socket says 172.21.15.7:38890) 2023-10-14T19:03:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 -- 172.21.15.7:0/729862862 learned_addr learned my addr 172.21.15.7:0/729862862 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f8683fff700 1 --2- 172.21.15.7:0/729862862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f86840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 -- 172.21.15.7:0/729862862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 msgr2=0x7f86840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 --2- 172.21.15.7:0/729862862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f86840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 -- 172.21.15.7:0/729862862 >> v1:172.21.15.148:6789/0 conn(0x7f868406e0e0 legacy=0x7f86840cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 -- 172.21.15.7:0/729862862 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868415a6b0 con 0x7f868406dc70 2023-10-14T19:03:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f86837fe700 1 --2- 172.21.15.7:0/729862862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f8684159900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86780099b0 tx=0x7f8678009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbff561800e9345 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f8682ffd700 1 -- 172.21.15.7:0/729862862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678009ea0 con 0x7f868406dc70 2023-10-14T19:03:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f8682ffd700 1 -- 172.21.15.7:0/729862862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867800b860 con 0x7f868406dc70 2023-10-14T19:03:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.735+0000 7f8682ffd700 1 -- 172.21.15.7:0/729862862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800bc00 con 0x7f868406dc70 2023-10-14T19:03:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 -- 172.21.15.7:0/729862862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 msgr2=0x7f8684159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 --2- 172.21.15.7:0/729862862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f8684159900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86780099b0 tx=0x7f8678009250 comp rx=0 tx=0).stop 2023-10-14T19:03:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 -- 172.21.15.7:0/729862862 shutdown_connections 2023-10-14T19:03:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 --2- 172.21.15.7:0/729862862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f86840ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 --2- 172.21.15.7:0/729862862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f8684159900 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 -- 172.21.15.7:0/729862862 >> 172.21.15.7:0/729862862 conn(0x7f86840703a0 msgr2=0x7f86840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 -- 172.21.15.7:0/729862862 shutdown_connections 2023-10-14T19:03:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.736+0000 7f868a8e1700 1 -- 172.21.15.7:0/729862862 wait complete. 2023-10-14T19:03:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.737+0000 7f868a8e1700 1 Processor -- start 2023-10-14T19:03:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.737+0000 7f868a8e1700 1 -- start start 2023-10-14T19:03:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f868a8e1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f86840ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f868a8e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f868406e0e0 0x7f868416aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f868a8e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f868414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f868a8e1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868416d650 con 0x7f868406dc70 2023-10-14T19:03:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f868a8e1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868416e4b0 con 0x7f868406e0e0 2023-10-14T19:03:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f868a8e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868416afc0 con 0x7f8684159530 2023-10-14T19:03:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f86840ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f86840ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38900/0 (socket says 172.21.15.7:38900) 2023-10-14T19:03:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 -- 172.21.15.7:0/2443637143 learned_addr learned my addr 172.21.15.7:0/2443637143 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 -- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 msgr2=0x7f868414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f86837fe700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f868406e0e0 0x7f868416aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8688e7e700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f868414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f868414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 -- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f868406e0e0 msgr2=0x7f868416aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f868406e0e0 0x7f868416aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 -- 172.21.15.7:0/2443637143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780094f0 con 0x7f868406dc70 2023-10-14T19:03:22.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f86837fe700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f868406e0e0 0x7f868416aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:22.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.738+0000 7f8683fff700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f86840ca240 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f867400e930 tx=0x7f86740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.739+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400eed0 con 0x7f868406dc70 2023-10-14T19:03:22.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.739+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400c850 con 0x7f868406dc70 2023-10-14T19:03:22.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.739+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840c7790 con 0x7f868406dc70 2023-10-14T19:03:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.739+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400cbf0 con 0x7f868406dc70 2023-10-14T19:03:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.739+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868416d8e0 con 0x7f868406dc70 2023-10-14T19:03:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.740+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86840b4710 con 0x7f868406dc70 2023-10-14T19:03:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.740+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8674013470 con 0x7f868406dc70 2023-10-14T19:03:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.741+0000 7f866bfff700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8670066fb0 0x7f8670069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.741+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8674084800 con 0x7f868406dc70 2023-10-14T19:03:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.741+0000 7f86837fe700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8670066fb0 0x7f8670069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.741+0000 7f86837fe700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8670066fb0 0x7f8670069460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86780099b0 tx=0x7f8678017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.745+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86740519d0 con 0x7f868406dc70 2023-10-14T19:03:22.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.936+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f868404c3c0 con 0x7f868406dc70 2023-10-14T19:03:22.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.937+0000 7f866bfff700 1 -- 172.21.15.7:0/2443637143 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8674054ff0 con 0x7f868406dc70 2023-10-14T19:03:22.938 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:22.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8670066fb0 msgr2=0x7f8670069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8670066fb0 0x7f8670069460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86780099b0 tx=0x7f8678017000 comp rx=0 tx=0).stop 2023-10-14T19:03:22.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 msgr2=0x7f86840ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:22.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f86840ca240 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f867400e930 tx=0x7f86740091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 shutdown_connections 2023-10-14T19:03:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8670066fb0 0x7f8670069460 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8684159530 0x7f868414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f868406dc70 0x7f86840ca240 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 --2- 172.21.15.7:0/2443637143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f868406e0e0 0x7f868416aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:22.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 >> 172.21.15.7:0/2443637143 conn(0x7f86840703a0 msgr2=0x7f86840b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:22.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 shutdown_connections 2023-10-14T19:03:22.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:22.939+0000 7f868a8e1700 1 -- 172.21.15.7:0/2443637143 wait complete. 2023-10-14T19:03:22.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.070+0000 7f306d517700 1 Processor -- start 2023-10-14T19:03:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.070+0000 7f306d517700 1 -- start start 2023-10-14T19:03:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f306d517700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30680cb5a0 0x7f30680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f306d517700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cd9e0 0x7f3068159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f306d517700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30680cde50 0x7f306815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f306d517700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680d13f0 con 0x7f30680cde50 2023-10-14T19:03:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f306d517700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306815a940 con 0x7f30680cb5a0 2023-10-14T19:03:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f306d517700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306815ae40 con 0x7f30680cd9e0 2023-10-14T19:03:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f30677fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30680cde50 0x7f306815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f30677fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30680cde50 0x7f306815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38910/0 (socket says 172.21.15.7:38910) 2023-10-14T19:03:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f30677fe700 1 -- 172.21.15.7:0/380267341 learned_addr learned my addr 172.21.15.7:0/380267341 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f3066ffd700 1 --2- 172.21.15.7:0/380267341 >> v2:172.21.15.148:3300/0 conn(0x7f30680cb5a0 0x7f30680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.071+0000 7f30667fc700 1 --2- 172.21.15.7:0/380267341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cd9e0 0x7f3068159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f30677fe700 1 -- 172.21.15.7:0/380267341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cd9e0 msgr2=0x7f3068159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f30677fe700 1 --2- 172.21.15.7:0/380267341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cd9e0 0x7f3068159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f30677fe700 1 -- 172.21.15.7:0/380267341 >> v2:172.21.15.148:3300/0 conn(0x7f30680cb5a0 msgr2=0x7f30680cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f30677fe700 1 --2- 172.21.15.7:0/380267341 >> v2:172.21.15.148:3300/0 conn(0x7f30680cb5a0 0x7f30680cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f30677fe700 1 -- 172.21.15.7:0/380267341 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306815ab60 con 0x7f30680cde50 2023-10-14T19:03:23.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f30677fe700 1 --2- 172.21.15.7:0/380267341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cde50 0x7f306815a400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3068065120 tx=0x7f3058009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76401750faa03b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f3065ffb700 1 -- 172.21.15.7:0/380267341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800e070 con 0x7f30680cde50 2023-10-14T19:03:23.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f3065ffb700 1 -- 172.21.15.7:0/380267341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800ba40 con 0x7f30680cde50 2023-10-14T19:03:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f3065ffb700 1 -- 172.21.15.7:0/380267341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580092e0 con 0x7f30680cde50 2023-10-14T19:03:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 -- 172.21.15.7:0/380267341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cde50 msgr2=0x7f306815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 --2- 172.21.15.7:0/380267341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cde50 0x7f306815a400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3068065120 tx=0x7f3058009840 comp rx=0 tx=0).stop 2023-10-14T19:03:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 -- 172.21.15.7:0/380267341 shutdown_connections 2023-10-14T19:03:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 --2- 172.21.15.7:0/380267341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cde50 0x7f306815a400 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 --2- 172.21.15.7:0/380267341 >> v2:172.21.15.148:3300/0 conn(0x7f30680cb5a0 0x7f30680cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 --2- 172.21.15.7:0/380267341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cd9e0 0x7f3068159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 -- 172.21.15.7:0/380267341 >> 172.21.15.7:0/380267341 conn(0x7f3068070e30 msgr2=0x7f30680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.072+0000 7f306d517700 1 -- 172.21.15.7:0/380267341 shutdown_connections 2023-10-14T19:03:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.073+0000 7f306d517700 1 -- 172.21.15.7:0/380267341 wait complete. 2023-10-14T19:03:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 Processor -- start 2023-10-14T19:03:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 -- start start 2023-10-14T19:03:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cb5a0 0x7f3068156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 0x7f30680ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068156cd0 0x7f30680b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c7ee0 con 0x7f30680cd9e0 2023-10-14T19:03:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306815b070 con 0x7f3068156cd0 2023-10-14T19:03:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.074+0000 7f306d517700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3068159370 con 0x7f30680cb5a0 2023-10-14T19:03:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 0x7f30680ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 0x7f30680ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38922/0 (socket says 172.21.15.7:38922) 2023-10-14T19:03:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 -- 172.21.15.7:0/3038622655 learned_addr learned my addr 172.21.15.7:0/3038622655 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f3066ffd700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cb5a0 0x7f3068156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30677fe700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068156cd0 0x7f30680b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 -- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cb5a0 msgr2=0x7f3068156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cb5a0 0x7f3068156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 -- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068156cd0 msgr2=0x7f30680b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068156cd0 0x7f30680b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 -- 172.21.15.7:0/3038622655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058009ae0 con 0x7f30680cd9e0 2023-10-14T19:03:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30677fe700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068156cd0 0x7f30680b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f30667fc700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 0x7f30680ca010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f305000c7d0 tx=0x7f3050008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011600 con 0x7f30680cd9e0 2023-10-14T19:03:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011760 con 0x7f30680cd9e0 2023-10-14T19:03:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011b20 con 0x7f30680cd9e0 2023-10-14T19:03:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3068159650 con 0x7f30680cd9e0 2023-10-14T19:03:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.075+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3068159c10 con 0x7f30680cd9e0 2023-10-14T19:03:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.076+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306804c3c0 con 0x7f30680cd9e0 2023-10-14T19:03:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.077+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30500193f0 con 0x7f30680cd9e0 2023-10-14T19:03:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.077+0000 7f305effd700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3048066f30 0x7f30480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.077+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3050084940 con 0x7f30680cd9e0 2023-10-14T19:03:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.077+0000 7f3066ffd700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3048066f30 0x7f30480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.078+0000 7f3066ffd700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3048066f30 0x7f30480693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3060006fd0 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.081+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3050051bb0 con 0x7f30680cd9e0 2023-10-14T19:03:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.318+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30680c8020 con 0x7f30680cd9e0 2023-10-14T19:03:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.319+0000 7f305effd700 1 -- 172.21.15.7:0/3038622655 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f30500551d0 con 0x7f30680cd9e0 2023-10-14T19:03:23.320 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:23.321 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:23.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3048066f30 msgr2=0x7f30480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3048066f30 0x7f30480693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3060006fd0 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-10-14T19:03:23.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 msgr2=0x7f30680ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 0x7f30680ca010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f305000c7d0 tx=0x7f3050008040 comp rx=0 tx=0).stop 2023-10-14T19:03:23.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 shutdown_connections 2023-10-14T19:03:23.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3048066f30 0x7f30480693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068156cd0 0x7f30680b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30680cb5a0 0x7f3068156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 --2- 172.21.15.7:0/3038622655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30680cd9e0 0x7f30680ca010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 >> 172.21.15.7:0/3038622655 conn(0x7f3068070e30 msgr2=0x7f30680d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:23.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 shutdown_connections 2023-10-14T19:03:23.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.321+0000 7f306d517700 1 -- 172.21.15.7:0/3038622655 wait complete. 2023-10-14T19:03:23.324 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:23.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:23.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.451+0000 7fb595132700 1 Processor -- start 2023-10-14T19:03:23.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.451+0000 7fb595132700 1 -- start start 2023-10-14T19:03:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb595132700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900b0ba0 0x7fb5900c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb595132700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59015a280 con 0x7fb5900b07d0 2023-10-14T19:03:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb595132700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59006e180 con 0x7fb5900cf200 2023-10-14T19:03:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb595132700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59006d850 con 0x7fb5900b0ba0 2023-10-14T19:03:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb58ed9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb5900b07d0 0x7fb5900ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40316/0 (socket says 172.21.15.7:40316) 2023-10-14T19:03:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb58ed9d700 1 -- 172.21.15.7:0/1277264815 learned_addr learned my addr 172.21.15.7:0/1277264815 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.452+0000 7fb58f59e700 1 --2- 172.21.15.7:0/1277264815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900b0ba0 0x7fb5900c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252420673 0 0) 0x7fb59015a280 con 0x7fb5900b07d0 2023-10-14T19:03:23.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb57c003570 con 0x7fb5900b07d0 2023-10-14T19:03:23.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970613115 0 0) 0x7fb59006e180 con 0x7fb5900cf200 2023-10-14T19:03:23.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59015a280 con 0x7fb5900cf200 2023-10-14T19:03:23.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58f59e700 1 -- 172.21.15.7:0/1277264815 >> v1:172.21.15.148:6789/0 conn(0x7fb5900cf200 legacy=0x7fb59006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58f59e700 1 -- 172.21.15.7:0/1277264815 >> v1:172.21.15.7:6789/0 conn(0x7fb5900b07d0 legacy=0x7fb5900ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58f59e700 1 -- 172.21.15.7:0/1277264815 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59006db30 con 0x7fb5900b0ba0 2023-10-14T19:03:23.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58f59e700 1 --2- 172.21.15.7:0/1277264815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900b0ba0 0x7fb5900c42c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb580009e90 tx=0x7fb580009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73352ecc0453a963 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000e070 con 0x7fb5900b0ba0 2023-10-14T19:03:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58000bb80 con 0x7fb5900b0ba0 2023-10-14T19:03:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.453+0000 7fb58dd9b700 1 -- 172.21.15.7:0/1277264815 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580012430 con 0x7fb5900b0ba0 2023-10-14T19:03:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 -- 172.21.15.7:0/1277264815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900b0ba0 msgr2=0x7fb5900c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 --2- 172.21.15.7:0/1277264815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900b0ba0 0x7fb5900c42c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb580009e90 tx=0x7fb580009780 comp rx=0 tx=0).stop 2023-10-14T19:03:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 -- 172.21.15.7:0/1277264815 shutdown_connections 2023-10-14T19:03:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 --2- 172.21.15.7:0/1277264815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900b0ba0 0x7fb5900c42c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 -- 172.21.15.7:0/1277264815 >> 172.21.15.7:0/1277264815 conn(0x7fb59006ce80 msgr2=0x7fb5900ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 -- 172.21.15.7:0/1277264815 shutdown_connections 2023-10-14T19:03:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.454+0000 7fb595132700 1 -- 172.21.15.7:0/1277264815 wait complete. 2023-10-14T19:03:23.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.455+0000 7fb595132700 1 Processor -- start 2023-10-14T19:03:23.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.455+0000 7fb595132700 1 -- start start 2023-10-14T19:03:23.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb595132700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 0x7fb5900c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb595132700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5900b0ba0 0x7fb59016c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb595132700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900cf200 0x7fb59013e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb595132700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900c88c0 con 0x7fb5900b07d0 2023-10-14T19:03:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb595132700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590156c50 con 0x7fb5900b0ba0 2023-10-14T19:03:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb595132700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590156040 con 0x7fb5900cf200 2023-10-14T19:03:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 0x7fb5900c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 0x7fb5900c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38932/0 (socket says 172.21.15.7:38932) 2023-10-14T19:03:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 -- 172.21.15.7:0/3195412728 learned_addr learned my addr 172.21.15.7:0/3195412728 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58e59c700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5900b0ba0 0x7fb59016c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58f59e700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900cf200 0x7fb59013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 -- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900cf200 msgr2=0x7fb59013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900cf200 0x7fb59013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 -- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5900b0ba0 msgr2=0x7fb59016c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5900b0ba0 0x7fb59016c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 -- 172.21.15.7:0/3195412728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009a20 con 0x7fb5900b07d0 2023-10-14T19:03:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58e59c700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5900b0ba0 0x7fb59016c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58f59e700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900cf200 0x7fb59013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.456+0000 7fb58ed9d700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 0x7fb5900c8380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c790 tx=0x7fb588007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.457+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588007300 con 0x7fb5900b07d0 2023-10-14T19:03:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.457+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588007460 con 0x7fb5900b07d0 2023-10-14T19:03:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.457+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880057f0 con 0x7fb5900b07d0 2023-10-14T19:03:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.457+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb590156320 con 0x7fb5900b07d0 2023-10-14T19:03:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.457+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5901568e0 con 0x7fb5900b07d0 2023-10-14T19:03:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.458+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590158e40 con 0x7fb5900b07d0 2023-10-14T19:03:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.458+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb588005be0 con 0x7fb5900b07d0 2023-10-14T19:03:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.459+0000 7fb586ffd700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb570066f30 0x7fb5700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.459+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb588084110 con 0x7fb5900b07d0 2023-10-14T19:03:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.459+0000 7fb58e59c700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb570066f30 0x7fb5700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.459+0000 7fb58e59c700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb570066f30 0x7fb5700693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b0350 tx=0x7fb578009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.463+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb588051380 con 0x7fb5900b07d0 2023-10-14T19:03:23.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.659+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb59004c3c0 con 0x7fb5900b07d0 2023-10-14T19:03:23.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.660+0000 7fb586ffd700 1 -- 172.21.15.7:0/3195412728 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fb5880549a0 con 0x7fb5900b07d0 2023-10-14T19:03:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:23.661 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:23.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb570066f30 msgr2=0x7fb5700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb570066f30 0x7fb5700693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b0350 tx=0x7fb578009040 comp rx=0 tx=0).stop 2023-10-14T19:03:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 msgr2=0x7fb5900c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 0x7fb5900c8380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c790 tx=0x7fb588007ce0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 shutdown_connections 2023-10-14T19:03:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb570066f30 0x7fb5700693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5900cf200 0x7fb59013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5900b07d0 0x7fb5900c8380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 --2- 172.21.15.7:0/3195412728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5900b0ba0 0x7fb59016c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 >> 172.21.15.7:0/3195412728 conn(0x7fb59006ce80 msgr2=0x7fb5900c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:23.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 shutdown_connections 2023-10-14T19:03:23.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.662+0000 7fb595132700 1 -- 172.21.15.7:0/3195412728 wait complete. 2023-10-14T19:03:23.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.794+0000 7efefc276700 1 Processor -- start 2023-10-14T19:03:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.794+0000 7efefc276700 1 -- start start 2023-10-14T19:03:23.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefc276700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 0x7efef40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefc276700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefc276700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef415ae40 con 0x7efef40cd9e0 2023-10-14T19:03:23.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefc276700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40d13f0 con 0x7efef40cb5a0 2023-10-14T19:03:23.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefc276700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef415ab60 con 0x7efef415a5d0 2023-10-14T19:03:23.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefa012700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 0x7efef40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefa813700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefa813700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:38938/0 (socket says 172.21.15.7:38938) 2023-10-14T19:03:23.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefa012700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 0x7efef40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:41482/0 (socket says 172.21.15.7:41482) 2023-10-14T19:03:23.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efefa813700 1 -- 172.21.15.7:0/3716979632 learned_addr learned my addr 172.21.15.7:0/3716979632 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:23.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.795+0000 7efef9811700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efef40cd9e0 0x7efef4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55200/0 (socket says 172.21.15.7:55200) 2023-10-14T19:03:23.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efefa813700 1 -- 172.21.15.7:0/3716979632 >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 msgr2=0x7efef40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:23.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efefa813700 1 --2- 172.21.15.7:0/3716979632 >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 0x7efef40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efefa813700 1 -- 172.21.15.7:0/3716979632 >> v1:172.21.15.148:6789/0 conn(0x7efef40cd9e0 legacy=0x7efef4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efefa813700 1 -- 172.21.15.7:0/3716979632 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40ccf00 con 0x7efef415a5d0 2023-10-14T19:03:23.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efefa012700 1 --2- 172.21.15.7:0/3716979632 >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 0x7efef40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:23.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efef9010700 1 -- 172.21.15.7:0/3716979632 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836520635 0 0) 0x7efef415ae40 con 0x7efef40cd9e0 2023-10-14T19:03:23.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efefa813700 1 --2- 172.21.15.7:0/3716979632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef4156e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efee4009f50 tx=0x7efee4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d70a4c986e6a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efef9010700 1 -- 172.21.15.7:0/3716979632 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400e070 con 0x7efef415a5d0 2023-10-14T19:03:23.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efef9010700 1 -- 172.21.15.7:0/3716979632 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400b9c0 con 0x7efef415a5d0 2023-10-14T19:03:23.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.796+0000 7efef9010700 1 -- 172.21.15.7:0/3716979632 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40092e0 con 0x7efef415a5d0 2023-10-14T19:03:23.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 -- 172.21.15.7:0/3716979632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 msgr2=0x7efef4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 --2- 172.21.15.7:0/3716979632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef4156e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efee4009f50 tx=0x7efee4009840 comp rx=0 tx=0).stop 2023-10-14T19:03:23.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 -- 172.21.15.7:0/3716979632 shutdown_connections 2023-10-14T19:03:23.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 --2- 172.21.15.7:0/3716979632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef4156e90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 --2- 172.21.15.7:0/3716979632 >> v2:172.21.15.148:3300/0 conn(0x7efef40cb5a0 0x7efef40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 -- 172.21.15.7:0/3716979632 >> 172.21.15.7:0/3716979632 conn(0x7efef4070e30 msgr2=0x7efef40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:23.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 -- 172.21.15.7:0/3716979632 shutdown_connections 2023-10-14T19:03:23.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.797+0000 7efefc276700 1 -- 172.21.15.7:0/3716979632 wait complete. 2023-10-14T19:03:23.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.798+0000 7efefc276700 1 Processor -- start 2023-10-14T19:03:23.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.798+0000 7efefc276700 1 -- start start 2023-10-14T19:03:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefc276700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 0x7efef4153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefc276700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efef40cd9e0 0x7efef40b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefc276700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefc276700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef415c530 con 0x7efef40cb5a0 2023-10-14T19:03:23.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefc276700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40b5c50 con 0x7efef40cd9e0 2023-10-14T19:03:23.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefc276700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef4153940 con 0x7efef415a5d0 2023-10-14T19:03:23.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 0x7efef4153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 0x7efef4153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38948/0 (socket says 172.21.15.7:38948) 2023-10-14T19:03:23.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 -- 172.21.15.7:0/2877737365 learned_addr learned my addr 172.21.15.7:0/2877737365 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:23.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efef9811700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efef40cd9e0 0x7efef40b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa813700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 -- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 msgr2=0x7efef415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 -- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efef40cd9e0 msgr2=0x7efef40b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:23.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efef40cd9e0 0x7efef40b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:23.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 -- 172.21.15.7:0/2877737365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec009420 con 0x7efef40cb5a0 2023-10-14T19:03:23.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efefa012700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 0x7efef4153400 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efeec00ec80 tx=0x7efeec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00c920 con 0x7efef40cb5a0 2023-10-14T19:03:23.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.799+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec00ca80 con 0x7efef40cb5a0 2023-10-14T19:03:23.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.800+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee4009ae0 con 0x7efef40cb5a0 2023-10-14T19:03:23.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.800+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00ce00 con 0x7efef40cb5a0 2023-10-14T19:03:23.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.800+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef40b5590 con 0x7efef40cb5a0 2023-10-14T19:03:23.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.801+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef40b5030 con 0x7efef40cb5a0 2023-10-14T19:03:23.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.801+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efeec013680 con 0x7efef40cb5a0 2023-10-14T19:03:23.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.801+0000 7efef27fc700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efee0066f30 0x7efee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:23.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.801+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efeec084910 con 0x7efef40cb5a0 2023-10-14T19:03:23.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.801+0000 7efef9811700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efee0066f30 0x7efee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:23.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.802+0000 7efef9811700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efee0066f30 0x7efee00693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efef40c5b70 tx=0x7efee8007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:23.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:23.805+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeec051b80 con 0x7efef40cb5a0 2023-10-14T19:03:24.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.045+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efef404c3c0 con 0x7efef40cb5a0 2023-10-14T19:03:24.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.045+0000 7efef27fc700 1 -- 172.21.15.7:0/2877737365 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7efeec0551a0 con 0x7efef40cb5a0 2023-10-14T19:03:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:24.047 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:24.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efee0066f30 msgr2=0x7efee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efee0066f30 0x7efee00693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efef40c5b70 tx=0x7efee8007d50 comp rx=0 tx=0).stop 2023-10-14T19:03:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 msgr2=0x7efef4153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 0x7efef4153400 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efeec00ec80 tx=0x7efeec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 shutdown_connections 2023-10-14T19:03:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efee0066f30 0x7efee00693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efef415a5d0 0x7efef415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efef40cb5a0 0x7efef4153400 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 --2- 172.21.15.7:0/2877737365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efef40cd9e0 0x7efef40b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 >> 172.21.15.7:0/2877737365 conn(0x7efef4070e30 msgr2=0x7efef40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 shutdown_connections 2023-10-14T19:03:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.047+0000 7efefc276700 1 -- 172.21.15.7:0/2877737365 wait complete. 2023-10-14T19:03:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:24.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:03:09.608348+0000', 'modified': '2023-10-14T19:03:13.232313+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6836/4287852448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 4287852448}, {'type': 'v1', 'addr': '172.21.15.148:6836', 'nonce': 4287852448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:03:24.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:03:24.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T19:03:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.588+0000 7fb1153b2700 1 Processor -- start 2023-10-14T19:03:24.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.588+0000 7fb1153b2700 1 -- start start 2023-10-14T19:03:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb1153b2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1100cf180 0x7fb1100ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb1153b2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cb1a0 0x7fb1100cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb1153b2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11015e010 con 0x7fb1101594d0 2023-10-14T19:03:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb1153b2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11015d420 con 0x7fb1100cf180 2023-10-14T19:03:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb1153b2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015d6e0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb10e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1100cf180 0x7fb1100ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb10f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cb1a0 0x7fb1100cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb10e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1100cf180 0x7fb1100ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:41500/0 (socket says 172.21.15.7:41500) 2023-10-14T19:03:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb10e7fc700 1 -- 172.21.15.7:0/786469543 learned_addr learned my addr 172.21.15.7:0/786469543 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.589+0000 7fb10effd700 1 --1- 172.21.15.7:0/786469543 >> v1:172.21.15.148:6789/0 conn(0x7fb1101594d0 0x7fb1100cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:55210/0 (socket says 172.21.15.7:55210) 2023-10-14T19:03:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10e7fc700 1 -- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cb1a0 msgr2=0x7fb1100cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cb1a0 0x7fb1100cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10e7fc700 1 -- 172.21.15.7:0/786469543 >> v1:172.21.15.148:6789/0 conn(0x7fb1101594d0 legacy=0x7fb1100cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10e7fc700 1 -- 172.21.15.7:0/786469543 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11015d9c0 con 0x7fb1100cf180 2023-10-14T19:03:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1100cf180 0x7fb1100ccfc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80099b0 tx=0x7fb0f8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85b6fa6b493d7a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10dffb700 1 -- 172.21.15.7:0/786469543 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8009ea0 con 0x7fb1100cf180 2023-10-14T19:03:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10dffb700 1 -- 172.21.15.7:0/786469543 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800b860 con 0x7fb1100cf180 2023-10-14T19:03:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb10dffb700 1 -- 172.21.15.7:0/786469543 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800bc00 con 0x7fb1100cf180 2023-10-14T19:03:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb1153b2700 1 -- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1100cf180 msgr2=0x7fb1100ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb1153b2700 1 --2- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1100cf180 0x7fb1100ccfc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80099b0 tx=0x7fb0f8009250 comp rx=0 tx=0).stop 2023-10-14T19:03:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb1153b2700 1 -- 172.21.15.7:0/786469543 shutdown_connections 2023-10-14T19:03:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.590+0000 7fb1153b2700 1 --2- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cb1a0 0x7fb1100cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.591+0000 7fb1153b2700 1 --2- 172.21.15.7:0/786469543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1100cf180 0x7fb1100ccfc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.591+0000 7fb1153b2700 1 -- 172.21.15.7:0/786469543 >> 172.21.15.7:0/786469543 conn(0x7fb1100703a0 msgr2=0x7fb110070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.591+0000 7fb1153b2700 1 -- 172.21.15.7:0/786469543 shutdown_connections 2023-10-14T19:03:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.591+0000 7fb1153b2700 1 -- 172.21.15.7:0/786469543 wait complete. 2023-10-14T19:03:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 Processor -- start 2023-10-14T19:03:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 -- start start 2023-10-14T19:03:24.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 0x7fb1100c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cf180 0x7fb11015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1101594d0 0x7fb1100c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c8ae0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c8f70 con 0x7fb1101594d0 2023-10-14T19:03:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.592+0000 7fb1153b2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c7ed0 con 0x7fb1100cf180 2023-10-14T19:03:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 0x7fb1100c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 0x7fb1100c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38950/0 (socket says 172.21.15.7:38950) 2023-10-14T19:03:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 -- 172.21.15.7:0/4083362014 learned_addr learned my addr 172.21.15.7:0/4083362014 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:24.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1101594d0 0x7fb1100c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cf180 0x7fb11015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 -- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cf180 msgr2=0x7fb11015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cf180 0x7fb11015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 -- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1101594d0 msgr2=0x7fb1100c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1101594d0 0x7fb1100c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 -- 172.21.15.7:0/4083362014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80094f0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb10effd700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 0x7fb1100c77d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c560 tx=0x7fb100007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb106ffd700 1 -- 172.21.15.7:0/4083362014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100005a70 con 0x7fb1100cb1a0 2023-10-14T19:03:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb106ffd700 1 -- 172.21.15.7:0/4083362014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100005bd0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1100c81b0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb106ffd700 1 -- 172.21.15.7:0/4083362014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000070d0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.593+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100c8770 con 0x7fb1100cb1a0 2023-10-14T19:03:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.595+0000 7fb106ffd700 1 -- 172.21.15.7:0/4083362014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb100007480 con 0x7fb1100cb1a0 2023-10-14T19:03:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.595+0000 7fb106ffd700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0f0066f30 0x7fb0f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.595+0000 7fb106ffd700 1 -- 172.21.15.7:0/4083362014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1000838b0 con 0x7fb1100cb1a0 2023-10-14T19:03:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.595+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0f0066f30 0x7fb0f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.596+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0f0066f30 0x7fb0f00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb1100cacb0 tx=0x7fb0f8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.597+0000 7fb11e6abb80 1 Processor -- start 2023-10-14T19:03:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.597+0000 7fb11e6abb80 1 -- start start 2023-10-14T19:03:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d546c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d54678ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d545cfa70 con 0x561d546c3480 2023-10-14T19:03:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d545cd270 con 0x561d54678b80 2023-10-14T19:03:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d545c9060 con 0x561d546765f0 2023-10-14T19:03:24.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546a27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38958/0 (socket says 172.21.15.7:38958) 2023-10-14T19:03:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 -- 172.21.15.7:0/2252913172 learned_addr learned my addr 172.21.15.7:0/2252913172 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d546c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d54678ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 -- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 msgr2=0x561d546c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d546c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 -- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 msgr2=0x561d54678ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d54678ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 -- 172.21.15.7:0/2252913172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d54463270 con 0x561d546c3480 2023-10-14T19:03:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d54678ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.598+0000 7fb10effd700 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546a27d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb100081e80 tx=0x7fb100009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a537dcfb585e5e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb0effff700 1 -- 172.21.15.7:0/2252913172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10006a020 con 0x561d546c3480 2023-10-14T19:03:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb0effff700 1 -- 172.21.15.7:0/2252913172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100054ee0 con 0x561d546c3480 2023-10-14T19:03:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb0effff700 1 -- 172.21.15.7:0/2252913172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100007730 con 0x561d546c3480 2023-10-14T19:03:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2252913172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 msgr2=0x561d546a27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546a27d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb100081e80 tx=0x7fb100009040 comp rx=0 tx=0).stop 2023-10-14T19:03:24.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2252913172 shutdown_connections 2023-10-14T19:03:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d54678ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546a27d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2252913172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d546c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2252913172 >> 172.21.15.7:0/2252913172 conn(0x561d5467a0c0 msgr2=0x561d5467a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2252913172 shutdown_connections 2023-10-14T19:03:24.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.599+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2252913172 wait complete. 2023-10-14T19:03:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.600+0000 7fb11e6abb80 1 -- start start 2023-10-14T19:03:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.600+0000 7fb11e6abb80 1 Processor -- start 2023-10-14T19:03:24.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 0x561d546c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546a1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546c3480 0x561d546a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d54574890 con 0x561d546765f0 2023-10-14T19:03:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5458fea0 con 0x561d54678b80 2023-10-14T19:03:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d5444be30 con 0x561d546c3480 2023-10-14T19:03:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 10 client.0 _ll_register_callbacks cb 0x561d5463c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:03:24.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 0x561d546c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 0x561d546c2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38968/0 (socket says 172.21.15.7:38968) 2023-10-14T19:03:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 -- 172.21.15.7:0/4020979478 learned_addr learned my addr 172.21.15.7:0/4020979478 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 -- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546c3480 msgr2=0x561d546a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546c3480 0x561d546a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 -- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 msgr2=0x561d546a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 -- 172.21.15.7:0/4020979478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100c8770 con 0x561d546765f0 2023-10-14T19:03:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb10effd700 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 0x561d546c2bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb100069040 tx=0x7fb100014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9ba6b4294da449 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb0ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:03:24.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/4020979478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10006a070 con 0x561d546765f0 2023-10-14T19:03:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/4020979478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb100057a30 con 0x561d546765f0 2023-10-14T19:03:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.601+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d5466dcd0 con 0x561d546765f0 2023-10-14T19:03:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/4020979478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb10005b780 con 0x561d546765f0 2023-10-14T19:03:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 10 client.4608 fetch_fsmap learned FSMap version 8 2023-10-14T19:03:24.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561d54405fe0 con 0x561d546765f0 2023-10-14T19:03:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/4020979478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d5466dcd0 con 0x561d546765f0 2023-10-14T19:03:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/4020979478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb1000505d0 con 0x561d546765f0 2023-10-14T19:03:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 10 client.4608 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T19:03:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 10 client.4608 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T19:03:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 20 client.4608 populate_metadata read hostname 'smithi007' 2023-10-14T19:03:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546a2b70 0x561d546a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 4 client.4608 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:03:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 --> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d5464aaa0 con 0x561d546a2b70 2023-10-14T19:03:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.602+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546a2b70 0x561d546a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb0ed7fa700 10 client.4608 ms_handle_connect on v2:172.21.15.148:6834/4287852448 2023-10-14T19:03:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546a2b70 0x561d546a2f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ab811e6ea9c08d server_cookie=6ed82057a307d9bc in_seq=0 out_seq=0 2023-10-14T19:03:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/4020979478 <== mds.0 v2:172.21.15.148:6834/4287852448 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561d5464aaa0 con 0x561d546a2b70 2023-10-14T19:03:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb0ed7fa700 10 client.4608 handle_command_reply: tid=0 2023-10-14T19:03:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb11e6abb80 1 client.4608 shutdown 2023-10-14T19:03:24.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 msgr2=0x561d546c2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 0x561d546c2bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb100069040 tx=0x7fb100014000 comp rx=0 tx=0).stop 2023-10-14T19:03:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 shutdown_connections 2023-10-14T19:03:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.603+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546a2b70 0x561d546a2f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546c3480 0x561d546a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546765f0 0x561d546c2bd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/4020979478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb0ed7fa700 0 client.4608 ms_handle_reset on v2:172.21.15.148:6834/4287852448 2023-10-14T19:03:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 >> 172.21.15.7:0/4020979478 conn(0x561d5467a0c0 msgr2=0x561d5467c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 shutdown_connections 2023-10-14T19:03:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 1 -- 172.21.15.7:0/4020979478 wait complete. 2023-10-14T19:03:24.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.604+0000 7fb11e6abb80 20 client.4608 trim_cache size 0 max 16384 2023-10-14T19:03:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 Processor -- start 2023-10-14T19:03:24.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 -- start start 2023-10-14T19:03:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d546765f0 0x561d5471ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d54678b80 0x561d546ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d54677cc0 con 0x561d546c3480 2023-10-14T19:03:24.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d546a1e90 con 0x561d546765f0 2023-10-14T19:03:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d546719e0 con 0x561d54678b80 2023-10-14T19:03:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb10f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb10f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38978/0 (socket says 172.21.15.7:38978) 2023-10-14T19:03:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.621+0000 7fb10f7fe700 1 -- 172.21.15.7:0/1556000648 learned_addr learned my addr 172.21.15.7:0/1556000648 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb10f7fe700 1 -- 172.21.15.7:0/1556000648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d54678b80 msgr2=0x561d546ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d54678b80 0x561d546ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb10f7fe700 1 -- 172.21.15.7:0/1556000648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d546765f0 msgr2=0x561d5471ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d546765f0 0x561d5471ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb10f7fe700 1 -- 172.21.15.7:0/1556000648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d54597780 con 0x561d546c3480 2023-10-14T19:03:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546bf7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb108007520 tx=0x7fb10800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24df23a9d7c0b49d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb104ff9700 1 -- 172.21.15.7:0/1556000648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800e040 con 0x561d546c3480 2023-10-14T19:03:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb104ff9700 1 -- 172.21.15.7:0/1556000648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10800f040 con 0x561d546c3480 2023-10-14T19:03:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb104ff9700 1 -- 172.21.15.7:0/1556000648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108016660 con 0x561d546c3480 2023-10-14T19:03:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 -- 172.21.15.7:0/1556000648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 msgr2=0x561d546bf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546bf7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb108007520 tx=0x7fb10800b040 comp rx=0 tx=0).stop 2023-10-14T19:03:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 -- 172.21.15.7:0/1556000648 shutdown_connections 2023-10-14T19:03:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d546765f0 0x561d5471ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546bf7a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/1556000648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d54678b80 0x561d546ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.622+0000 7fb11e6abb80 1 -- 172.21.15.7:0/1556000648 >> 172.21.15.7:0/1556000648 conn(0x561d5467a0c0 msgr2=0x561d546c1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.623+0000 7fb11e6abb80 1 -- 172.21.15.7:0/1556000648 shutdown_connections 2023-10-14T19:03:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.623+0000 7fb11e6abb80 1 -- 172.21.15.7:0/1556000648 wait complete. 2023-10-14T19:03:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.623+0000 7fb11e6abb80 1 -- start start 2023-10-14T19:03:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.623+0000 7fb11e6abb80 1 Processor -- start 2023-10-14T19:03:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d5471e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546dc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d54728c50 con 0x561d546c3480 2023-10-14T19:03:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d54725ac0 con 0x561d54678b80 2023-10-14T19:03:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d546c2910 con 0x561d546765f0 2023-10-14T19:03:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb11e6abb80 10 client.0 _ll_register_callbacks cb 0x561d5463c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:03:24.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546dcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38986/0 (socket says 172.21.15.7:38986) 2023-10-14T19:03:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 -- 172.21.15.7:0/2602997503 learned_addr learned my addr 172.21.15.7:0/2602997503 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10effd700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d5471e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10e7fc700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546dc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 -- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 msgr2=0x561d5471e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d5471e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 -- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 msgr2=0x561d546dc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546dc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.624+0000 7fb10f7fe700 1 -- 172.21.15.7:0/2602997503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb108007340 con 0x561d546c3480 2023-10-14T19:03:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb10f7fe700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546dcaa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb108007990 tx=0x7fb10801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c4d775cf2b16e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb0ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:03:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/2602997503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800e030 con 0x561d546c3480 2023-10-14T19:03:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/2602997503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb108016ca0 con 0x561d546c3480 2023-10-14T19:03:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb100054ee0 con 0x561d546c3480 2023-10-14T19:03:24.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/2602997503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb108025070 con 0x561d546c3480 2023-10-14T19:03:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 10 client.4614 fetch_fsmap learned FSMap version 8 2023-10-14T19:03:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561d5457e470 con 0x561d546c3480 2023-10-14T19:03:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/2602997503 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100054ee0 con 0x561d546c3480 2023-10-14T19:03:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/2602997503 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb108028020 con 0x561d546c3480 2023-10-14T19:03:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T19:03:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 10 client.4614 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T19:03:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 20 client.4614 populate_metadata read hostname 'smithi007' 2023-10-14T19:03:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546c0850 0x561d546c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:24.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 4 client.4614 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-10-14T19:03:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 --> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d5456be00 con 0x561d546c0850 2023-10-14T19:03:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.625+0000 7fb10effd700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546c0850 0x561d546c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb0ed7fa700 10 client.4614 ms_handle_connect on v2:172.21.15.148:6834/4287852448 2023-10-14T19:03:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb10effd700 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546c0850 0x561d546c0c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3024d54443c867fc server_cookie=1f070b3992c84e3f in_seq=0 out_seq=0 2023-10-14T19:03:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb0ed7fa700 1 -- 172.21.15.7:0/2602997503 <== mds.0 v2:172.21.15.148:6834/4287852448 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x561d5456be00 con 0x561d546c0850 2023-10-14T19:03:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb0ed7fa700 10 client.4614 handle_command_reply: tid=0 2023-10-14T19:03:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 client.4614 shutdown 2023-10-14T19:03:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 msgr2=0x561d546dcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546dcaa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb108007990 tx=0x7fb10801d000 comp rx=0 tx=0).stop 2023-10-14T19:03:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 shutdown_connections 2023-10-14T19:03:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:6834/4287852448,v1:172.21.15.148:6836/4287852448] conn(0x561d546c0850 0x561d546c0c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d546c3480 0x561d546dcaa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561d546765f0 0x561d5471e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 --2- 172.21.15.7:0/2602997503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561d54678b80 0x561d546dc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb0ed7fa700 0 client.4614 ms_handle_reset on v2:172.21.15.148:6834/4287852448 2023-10-14T19:03:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 >> 172.21.15.7:0/2602997503 conn(0x561d5467a0c0 msgr2=0x561d546ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 shutdown_connections 2023-10-14T19:03:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 1 -- 172.21.15.7:0/2602997503 wait complete. 2023-10-14T19:03:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.626+0000 7fb11e6abb80 20 client.4614 trim_cache size 0 max 16384 2023-10-14T19:03:24.656 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:03:24.656 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:03:24.656 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:03:24.656 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4294, 2023-10-14T19:03:24.657 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:03:24.657 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:03:24.657 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:03:24.657 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 14.411772335, 2023-10-14T19:03:24.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 8, 2023-10-14T19:03:24.658 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 21, 2023-10-14T19:03:24.658 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 21, 2023-10-14T19:03:24.658 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 21.693412879 2023-10-14T19:03:24.658 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:03:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0f0066f30 msgr2=0x7fb0f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0f0066f30 0x7fb0f00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb1100cacb0 tx=0x7fb0f8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 msgr2=0x7fb1100c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 0x7fb1100c77d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c560 tx=0x7fb100007f70 comp rx=0 tx=0).stop 2023-10-14T19:03:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 shutdown_connections 2023-10-14T19:03:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0f0066f30 0x7fb0f00693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1101594d0 0x7fb1100c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cb1a0 0x7fb1100c77d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 --2- 172.21.15.7:0/4083362014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1100cf180 0x7fb11015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 >> 172.21.15.7:0/4083362014 conn(0x7fb1100703a0 msgr2=0x7fb11015ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 shutdown_connections 2023-10-14T19:03:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:24.627+0000 7fb1153b2700 1 -- 172.21.15.7:0/4083362014 wait complete. 2023-10-14T19:03:24.663 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T19:03:24.692 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T19:03:24.693 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T19:03:24.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.695 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:03:24.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-10-14T19:03:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2023-10-14T19:03:24.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:03:24.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.782 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:03:24.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-10-14T19:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2023-10-14T19:03:24.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:03:24.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.905 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:03:24.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.924 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-14T19:03:24.995 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-10-14T19:03:24.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:03:24.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:24.997 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:03:25.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:25.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-14T19:03:25.122 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-10-14T19:03:25.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:03:25.123 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-14T19:03:25.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:03:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.245+0000 7f451ab21700 1 Processor -- start 2023-10-14T19:03:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.245+0000 7f451ab21700 1 -- start start 2023-10-14T19:03:25.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f451ab21700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45140cb5a0 0x7f45140cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:25.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f451ab21700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45140cde50 0x7f4514156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:25.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f451ab21700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451415ae40 con 0x7f45140cd9e0 2023-10-14T19:03:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f451ab21700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140d13f0 con 0x7f45140cde50 2023-10-14T19:03:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f451ab21700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451415ab60 con 0x7f45140cb5a0 2023-10-14T19:03:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f4513fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f45140cd9e0 0x7f4514159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40322/0 (socket says 172.21.15.7:40322) 2023-10-14T19:03:25.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f4513fff700 1 -- 172.21.15.7:0/2447921004 learned_addr learned my addr 172.21.15.7:0/2447921004 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:25.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45190be700 1 --2- 172.21.15.7:0/2447921004 >> v2:172.21.15.148:3300/0 conn(0x7f45140cde50 0x7f4514156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:25.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45188bd700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45140cb5a0 0x7f45140cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:25.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45137fe700 1 -- 172.21.15.7:0/2447921004 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025311330 0 0) 0x7f451415ae40 con 0x7f45140cd9e0 2023-10-14T19:03:25.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45137fe700 1 -- 172.21.15.7:0/2447921004 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44fc003570 con 0x7f45140cd9e0 2023-10-14T19:03:25.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45190be700 1 -- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45140cb5a0 msgr2=0x7f45140cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:25.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45190be700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45140cb5a0 0x7f45140cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45190be700 1 -- 172.21.15.7:0/2447921004 >> v1:172.21.15.7:6789/0 conn(0x7f45140cd9e0 legacy=0x7f4514159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:25.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45190be700 1 -- 172.21.15.7:0/2447921004 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140ccf00 con 0x7f45140cde50 2023-10-14T19:03:25.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45188bd700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45140cb5a0 0x7f45140cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:25.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.246+0000 7f45190be700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cde50 0x7f4514156e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45040098e0 tx=0x7f45040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1627f0e257cfe15a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:25.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f45137fe700 1 -- 172.21.15.7:0/2447921004 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504011630 con 0x7f45140cde50 2023-10-14T19:03:25.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f45137fe700 1 -- 172.21.15.7:0/2447921004 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504011790 con 0x7f45140cde50 2023-10-14T19:03:25.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f45137fe700 1 -- 172.21.15.7:0/2447921004 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504011b30 con 0x7f45140cde50 2023-10-14T19:03:25.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 -- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cde50 msgr2=0x7f4514156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:25.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cde50 0x7f4514156e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45040098e0 tx=0x7f45040091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 -- 172.21.15.7:0/2447921004 shutdown_connections 2023-10-14T19:03:25.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cde50 0x7f4514156e90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 --2- 172.21.15.7:0/2447921004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45140cb5a0 0x7f45140cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 -- 172.21.15.7:0/2447921004 >> 172.21.15.7:0/2447921004 conn(0x7f4514070e30 msgr2=0x7f45140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:25.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 -- 172.21.15.7:0/2447921004 shutdown_connections 2023-10-14T19:03:25.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.247+0000 7f451ab21700 1 -- 172.21.15.7:0/2447921004 wait complete. 2023-10-14T19:03:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.248+0000 7f451ab21700 1 Processor -- start 2023-10-14T19:03:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.248+0000 7f451ab21700 1 -- start start 2023-10-14T19:03:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f451ab21700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 0x7f451415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f451ab21700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cd9e0 0x7f4514158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f451ab21700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f451415e170 0x7f45140c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f451ab21700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451415bd50 con 0x7f45140cb5a0 2023-10-14T19:03:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f451ab21700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140ca5e0 con 0x7f45140cd9e0 2023-10-14T19:03:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f451ab21700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140ca8c0 con 0x7f451415e170 2023-10-14T19:03:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 0x7f451415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 0x7f451415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38996/0 (socket says 172.21.15.7:38996) 2023-10-14T19:03:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 -- 172.21.15.7:0/1371746339 learned_addr learned my addr 172.21.15.7:0/1371746339 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f4513fff700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cd9e0 0x7f4514158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45190be700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f451415e170 0x7f45140c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 -- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f451415e170 msgr2=0x7f45140c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f451415e170 0x7f45140c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 -- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cd9e0 msgr2=0x7f4514158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:25.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cd9e0 0x7f4514158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f45188bd700 1 -- 172.21.15.7:0/1371746339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c009a20 con 0x7f45140cb5a0 2023-10-14T19:03:25.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.249+0000 7f4513fff700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cd9e0 0x7f4514158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:25.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.250+0000 7f45188bd700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 0x7f451415dc30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c170 tx=0x7f450c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:25.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.250+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ce10 con 0x7f45140cb5a0 2023-10-14T19:03:25.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.250+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504009420 con 0x7f45140cb5a0 2023-10-14T19:03:25.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.250+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00f040 con 0x7f45140cb5a0 2023-10-14T19:03:25.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.250+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c014690 con 0x7f45140cb5a0 2023-10-14T19:03:25.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.250+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45141592a0 con 0x7f45140cb5a0 2023-10-14T19:03:25.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.251+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4514159520 con 0x7f45140cb5a0 2023-10-14T19:03:25.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.251+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f450c014a00 con 0x7f45140cb5a0 2023-10-14T19:03:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.252+0000 7f4510ff9700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4500066f30 0x7f45000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.252+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f450c085500 con 0x7f45140cb5a0 2023-10-14T19:03:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.252+0000 7f4513fff700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4500066f30 0x7f45000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:25.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.252+0000 7f4513fff700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4500066f30 0x7f45000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f451416cf10 tx=0x7f4508009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:25.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.256+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f450c052770 con 0x7f45140cb5a0 2023-10-14T19:03:25.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.495+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f451404c3c0 con 0x7f45140cb5a0 2023-10-14T19:03:25.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.495+0000 7f4510ff9700 1 -- 172.21.15.7:0/1371746339 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f450c014cb0 con 0x7f45140cb5a0 2023-10-14T19:03:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:03:25.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4500066f30 msgr2=0x7f45000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:25.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4500066f30 0x7f45000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f451416cf10 tx=0x7f4508009040 comp rx=0 tx=0).stop 2023-10-14T19:03:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 msgr2=0x7f451415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 0x7f451415dc30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c170 tx=0x7f450c00b040 comp rx=0 tx=0).stop 2023-10-14T19:03:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 shutdown_connections 2023-10-14T19:03:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4500066f30 0x7f45000693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f451415e170 0x7f45140c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45140cb5a0 0x7f451415dc30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 --2- 172.21.15.7:0/1371746339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45140cd9e0 0x7f4514158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:25.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 >> 172.21.15.7:0/1371746339 conn(0x7f4514070e30 msgr2=0x7f45140c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:25.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 shutdown_connections 2023-10-14T19:03:25.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:25.497+0000 7f451ab21700 1 -- 172.21.15.7:0/1371746339 wait complete. 2023-10-14T19:03:25.510 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T19:03:25.510 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:03:25.511 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:03:25.511 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:03:25.511 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:03:25.511 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T19:03:25.512 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T19:03:25.512 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:03:25.512 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:03:25.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:25.513 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:03:25.529 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:25.529 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:25.529 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:25.529 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:25.530 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:25.530 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:25.530 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:25.530 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:25.531 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:03:25.531 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:25.531 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:25.531 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:03:25.531 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:03:25.532 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:25.532 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:03:25.532 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:03:25.532 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42448sec preferred_lft 42448sec 2023-10-14T19:03:25.533 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:03:25.533 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:25.533 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:25.533 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:25.533 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:03:25.534 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T19:03:25.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:25.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:25.535 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:25.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2023-10-14T19:03:25.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2023-10-14T19:03:25.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2023-10-14T19:03:25.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T19:03:25.536 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:25.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:25.718 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:03:25.762 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:03:25.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:25.764 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:03:25.836 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:03:25.837 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:03:25.837 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:03:25.837 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:03:25.837 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:03:25.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:25.838 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:25.839 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:25.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:03:25.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:03:25.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:03:25.840 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:26.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:26.119 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:03:26.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:26.135 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2023-10-14T19:03:26.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:26.191 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:26.191 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:26.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:03:26.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T19:03:26.192 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:26.281 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T19:03:26.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:26.282 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:26.283 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:26.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T19:03:26.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T19:03:26.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T19:03:26.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T19:03:26.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T19:03:26.284 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:26.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:26.464 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:26.464 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:26.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:03:26.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T19:03:26.465 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:26.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:26.559 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:03:26.574 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:03:26.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:26.575 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:03:26.629 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:03:26.630 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:03:26.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:03:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:03:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:03:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:03:26.807 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:03:26.807 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:03:26.807 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:03:26.807 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:26.808 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:26.830 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:03:26.831 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:03:26.831 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:03:26.831 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:26.832 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:26.832 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:03:26.832 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:03:26.832 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:03:26.833 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:03:26.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:26.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:03:26.860 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-14T19:03:26.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:03:27.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.018+0000 7f5cbcf6c700 1 Processor -- start 2023-10-14T19:03:27.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.018+0000 7f5cbcf6c700 1 -- start start 2023-10-14T19:03:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.019+0000 7f5cbcf6c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cb80b07d0 0x7f5cb80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.019+0000 7f5cbcf6c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5cb80b0ba0 0x7f5cb80c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.019+0000 7f5cbcf6c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb815a280 con 0x7f5cb80cf200 2023-10-14T19:03:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.019+0000 7f5cbcf6c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb806e180 con 0x7f5cb80b0ba0 2023-10-14T19:03:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.019+0000 7f5cbcf6c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb806d850 con 0x7f5cb80b07d0 2023-10-14T19:03:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5cb80b0ba0 0x7f5cb80c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5cb80b0ba0 0x7f5cb80c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58636/0 (socket says 172.21.15.7:58636) 2023-10-14T19:03:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/549272418 learned_addr learned my addr 172.21.15.7:0/549272418 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb659c700 1 --2- 172.21.15.7:0/549272418 >> v2:172.21.15.148:3300/0 conn(0x7f5cb80b07d0 0x7f5cb80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/549272418 >> v2:172.21.15.148:3300/0 conn(0x7f5cb80b07d0 msgr2=0x7f5cb80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:27.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 --2- 172.21.15.7:0/549272418 >> v2:172.21.15.148:3300/0 conn(0x7f5cb80b07d0 0x7f5cb80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/549272418 >> v1:172.21.15.148:6789/0 conn(0x7f5cb80cf200 legacy=0x7f5cb806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/549272418 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb806db30 con 0x7f5cb80b0ba0 2023-10-14T19:03:27.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb6d9d700 1 --2- 172.21.15.7:0/549272418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80b0ba0 0x7f5cb80c42c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8064720 tx=0x7f5ca8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798ad70bae2f1263 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb559a700 1 -- 172.21.15.7:0/549272418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800e070 con 0x7f5cb80b0ba0 2023-10-14T19:03:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb559a700 1 -- 172.21.15.7:0/549272418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca800ba10 con 0x7f5cb80b0ba0 2023-10-14T19:03:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.020+0000 7f5cb559a700 1 -- 172.21.15.7:0/549272418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80092e0 con 0x7f5cb80b0ba0 2023-10-14T19:03:27.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/549272418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80b0ba0 msgr2=0x7f5cb80c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:27.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/549272418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80b0ba0 0x7f5cb80c42c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8064720 tx=0x7f5ca8009840 comp rx=0 tx=0).stop 2023-10-14T19:03:27.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/549272418 shutdown_connections 2023-10-14T19:03:27.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/549272418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80b0ba0 0x7f5cb80c42c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/549272418 >> v2:172.21.15.148:3300/0 conn(0x7f5cb80b07d0 0x7f5cb80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/549272418 >> 172.21.15.7:0/549272418 conn(0x7f5cb806ce80 msgr2=0x7f5cb80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/549272418 shutdown_connections 2023-10-14T19:03:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.021+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/549272418 wait complete. 2023-10-14T19:03:27.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.022+0000 7f5cbcf6c700 1 Processor -- start 2023-10-14T19:03:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.022+0000 7f5cbcf6c700 1 -- start start 2023-10-14T19:03:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cbcf6c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb80b07d0 0x7f5cb8140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cbcf6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb80b0ba0 0x7f5cb80cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cbcf6c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 0x7f5cb80cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cbcf6c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8152af0 con 0x7f5cb80cf200 2023-10-14T19:03:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cbcf6c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb81530b0 con 0x7f5cb80b07d0 2023-10-14T19:03:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cbcf6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8158a30 con 0x7f5cb80b0ba0 2023-10-14T19:03:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cb6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 0x7f5cb80cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cb6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 0x7f5cb80cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58642/0 (socket says 172.21.15.7:58642) 2023-10-14T19:03:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/1283568930 learned_addr learned my addr 172.21.15.7:0/1283568930 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cb659c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb80b07d0 0x7f5cb8140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.023+0000 7f5cb5d9b700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb80b0ba0 0x7f5cb80cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:27.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb80b0ba0 msgr2=0x7f5cb80cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb6d9d700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb80b0ba0 0x7f5cb80cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb80b07d0 msgr2=0x7f5cb8140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb6d9d700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb80b07d0 0x7f5cb8140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb6d9d700 1 -- 172.21.15.7:0/1283568930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8009ae0 con 0x7f5cb80cf200 2023-10-14T19:03:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb659c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb80b07d0 0x7f5cb8140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cb6d9d700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 0x7f5cb80cdc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cb806af10 tx=0x7f5ca8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:27.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800bee0 con 0x7f5cb80cf200 2023-10-14T19:03:27.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca80032f0 con 0x7f5cb80cf200 2023-10-14T19:03:27.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca801d650 con 0x7f5cb80cf200 2023-10-14T19:03:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb8158d10 con 0x7f5cb80cf200 2023-10-14T19:03:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.024+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb8140a70 con 0x7f5cb80cf200 2023-10-14T19:03:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.025+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb8153220 con 0x7f5cb80cf200 2023-10-14T19:03:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.025+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ca801da80 con 0x7f5cb80cf200 2023-10-14T19:03:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.026+0000 7f5cae7fc700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c98066f30 0x7f5c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.026+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ca8085d50 con 0x7f5cb80cf200 2023-10-14T19:03:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.026+0000 7f5cb659c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c98066f30 0x7f5c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.026+0000 7f5cb659c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c98066f30 0x7f5c980693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0006aa0 tx=0x7f5cb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.030+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ca8089030 con 0x7f5cb80cf200 2023-10-14T19:03:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.267+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cb804c3c0 con 0x7f5cb80cf200 2023-10-14T19:03:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.267+0000 7f5cae7fc700 1 -- 172.21.15.7:0/1283568930 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ca8052fc0 con 0x7f5cb80cf200 2023-10-14T19:03:27.269 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:03:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c98066f30 msgr2=0x7f5c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:27.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c98066f30 0x7f5c980693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0006aa0 tx=0x7f5cb0008040 comp rx=0 tx=0).stop 2023-10-14T19:03:27.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 msgr2=0x7f5cb80cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:27.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 0x7f5cb80cdc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cb806af10 tx=0x7f5ca8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:27.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 shutdown_connections 2023-10-14T19:03:27.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c98066f30 0x7f5c980693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb80b07d0 0x7f5cb8140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cb80cf200 0x7f5cb80cdc50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 --2- 172.21.15.7:0/1283568930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb80b0ba0 0x7f5cb80cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:27.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 >> 172.21.15.7:0/1283568930 conn(0x7f5cb806ce80 msgr2=0x7f5cb8067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:27.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 shutdown_connections 2023-10-14T19:03:27.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:27.269+0000 7f5cbcf6c700 1 -- 172.21.15.7:0/1283568930 wait complete. 2023-10-14T19:03:27.282 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T19:03:27.283 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:03:27.283 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:03:27.283 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T19:03:27.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T19:03:27.284 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T19:03:27.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T19:03:27.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:03:27.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T19:03:27.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.285 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:03:27.301 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.302 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:03:27.303 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:03:27.304 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:03:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:03:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:03:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42447sec preferred_lft 42447sec 2023-10-14T19:03:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:03:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.305 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:03:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:03:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:03:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.307 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:03:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:03:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link tentative 2023-10-14T19:03:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.309 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:03:27.367 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:03:27.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.368 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:03:27.424 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:03:27.424 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:03:27.424 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:03:27.424 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:03:27.425 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:03:27.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.425 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:27.426 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:27.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:03:27.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:03:27.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:03:27.430 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:27.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.526 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:03:27.541 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:03:27.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.542 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2023-10-14T19:03:27.596 INFO:teuthology.orchestra.run.smithi007.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T19:03:27.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.597 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:27.598 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:27.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:03:27.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T19:03:27.599 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:27.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T19:03:27.724 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.726 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:03:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 66:ae:44:dc:6b:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T19:03:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T19:03:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::64ae:44ff:fedc:6b98/64 scope link tentative 2023-10-14T19:03:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.738 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T19:03:27.821 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.822 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:03:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 66:ae:44:dc:6b:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T19:03:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T19:03:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::64ae:44ff:fedc:6b98/64 scope link tentative 2023-10-14T19:03:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:27.837 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T19:03:27.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:27.838 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:27.838 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:27.838 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T19:03:27.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T19:03:27.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T19:03:27.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T19:03:27.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T19:03:27.842 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:28.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:28.061 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:03:28.061 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:03:28.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.1 up 2023-10-14T19:03:28.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T19:03:28.062 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:03:28.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:28.144 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T19:03:28.159 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T19:03:28.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:28.160 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T19:03:28.214 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:03:28.215 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:03:28.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T19:03:28.298 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T19:03:28.298 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-14T19:03:28.298 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:03:28.306 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T19:03:28.306 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-14T19:03:28.307 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:03:28.307 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:28.307 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:28.328 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T19:03:28.328 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-14T19:03:28.328 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:03:28.329 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:28.329 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:28.329 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:03:28.329 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:03:28.330 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:03:28.331 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:03:28.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:28.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T19:03:28.397 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-14T19:03:28.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:03:28.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.554+0000 7fd67340c700 1 Processor -- start 2023-10-14T19:03:28.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.554+0000 7fd67340c700 1 -- start start 2023-10-14T19:03:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd67340c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd66c0cb5a0 0x7fd66c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd67340c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c15a5d0 0x7fd66c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd67340c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c15ae40 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd67340c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c0d13f0 con 0x7fd66c0cb5a0 2023-10-14T19:03:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd67340c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c15ab60 con 0x7fd66c15a5d0 2023-10-14T19:03:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd6711a8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd66c0cb5a0 0x7fd66c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd6711a8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd66c0cb5a0 0x7fd66c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58650/0 (socket says 172.21.15.7:58650) 2023-10-14T19:03:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.555+0000 7fd6711a8700 1 -- 172.21.15.7:0/631414688 learned_addr learned my addr 172.21.15.7:0/631414688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6719a9700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c15a5d0 0x7fd66c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6711a8700 1 -- 172.21.15.7:0/631414688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c15a5d0 msgr2=0x7fd66c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6711a8700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c15a5d0 0x7fd66c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6711a8700 1 -- 172.21.15.7:0/631414688 >> v1:172.21.15.148:6789/0 conn(0x7fd66c0cd9e0 legacy=0x7fd66c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6711a8700 1 -- 172.21.15.7:0/631414688 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0ccf00 con 0x7fd66c0cb5a0 2023-10-14T19:03:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6719a9700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c15a5d0 0x7fd66c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd6711a8700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cb5a0 0x7fd66c0cb970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd6640099e0 tx=0x7fd664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe204ac7fbd678f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd66bfff700 1 -- 172.21.15.7:0/631414688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400b820 con 0x7fd66c0cb5a0 2023-10-14T19:03:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd66bfff700 1 -- 172.21.15.7:0/631414688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66400b980 con 0x7fd66c0cb5a0 2023-10-14T19:03:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.556+0000 7fd66bfff700 1 -- 172.21.15.7:0/631414688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400bd20 con 0x7fd66c0cb5a0 2023-10-14T19:03:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 -- 172.21.15.7:0/631414688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cb5a0 msgr2=0x7fd66c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cb5a0 0x7fd66c0cb970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd6640099e0 tx=0x7fd664009250 comp rx=0 tx=0).stop 2023-10-14T19:03:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 -- 172.21.15.7:0/631414688 shutdown_connections 2023-10-14T19:03:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c15a5d0 0x7fd66c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 --2- 172.21.15.7:0/631414688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cb5a0 0x7fd66c0cb970 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 -- 172.21.15.7:0/631414688 >> 172.21.15.7:0/631414688 conn(0x7fd66c070e30 msgr2=0x7fd66c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 -- 172.21.15.7:0/631414688 shutdown_connections 2023-10-14T19:03:28.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.557+0000 7fd67340c700 1 -- 172.21.15.7:0/631414688 wait complete. 2023-10-14T19:03:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.558+0000 7fd67340c700 1 Processor -- start 2023-10-14T19:03:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.558+0000 7fd67340c700 1 -- start start 2023-10-14T19:03:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd67340c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c0cb5a0 0x7fd66c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd67340c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 0x7fd66c169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd67340c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd66c15a5d0 0x7fd66c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd67340c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c157040 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd67340c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c157320 con 0x7fd66c15a5d0 2023-10-14T19:03:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd67340c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c157600 con 0x7fd66c0cb5a0 2023-10-14T19:03:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 0x7fd66c169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 0x7fd66c169960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58660/0 (socket says 172.21.15.7:58660) 2023-10-14T19:03:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 -- 172.21.15.7:0/2071180297 learned_addr learned my addr 172.21.15.7:0/2071180297 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6711a8700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c0cb5a0 0x7fd66c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6719a9700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd66c15a5d0 0x7fd66c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 -- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c0cb5a0 msgr2=0x7fd66c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c0cb5a0 0x7fd66c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 -- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd66c15a5d0 msgr2=0x7fd66c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd66c15a5d0 0x7fd66c0b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 -- 172.21.15.7:0/2071180297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640094f0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6709a7700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 0x7fd66c169960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd66000c790 tx=0x7fd660007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.559+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660011590 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.560+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c1578e0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.560+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660011710 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.560+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660011ad0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.560+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c156c60 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.560+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c04c3c0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.561+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd66001b3b0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.561+0000 7fd6697fa700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd658066f30 0x7fd6580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.561+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6600839c0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.562+0000 7fd6711a8700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd658066f30 0x7fd6580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.562+0000 7fd6711a8700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd658066f30 0x7fd6580693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6640099e0 tx=0x7fd664017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.566+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd660050c30 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.804+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd66c0cd1e0 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.804+0000 7fd6697fa700 1 -- 172.21.15.7:0/2071180297 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd660017070 con 0x7fd66c0cd9e0 2023-10-14T19:03:28.806 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:03:28.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd658066f30 msgr2=0x7fd6580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:28.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd658066f30 0x7fd6580693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6640099e0 tx=0x7fd664017000 comp rx=0 tx=0).stop 2023-10-14T19:03:28.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 msgr2=0x7fd66c169960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:28.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 0x7fd66c169960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd66000c790 tx=0x7fd660007f40 comp rx=0 tx=0).stop 2023-10-14T19:03:28.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 shutdown_connections 2023-10-14T19:03:28.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd658066f30 0x7fd6580693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd66c15a5d0 0x7fd66c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd66c0cb5a0 0x7fd66c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 --2- 172.21.15.7:0/2071180297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c0cd9e0 0x7fd66c169960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 >> 172.21.15.7:0/2071180297 conn(0x7fd66c070e30 msgr2=0x7fd66c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 shutdown_connections 2023-10-14T19:03:28.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:28.806+0000 7fd67340c700 1 -- 172.21.15.7:0/2071180297 wait complete. 2023-10-14T19:03:28.819 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T19:03:28.820 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:03:28.820 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:03:28.820 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:03:28.820 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:03:28.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T19:03:28.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T19:03:28.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:03:28.821 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:03:28.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:28.822 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:03:28.841 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:28.841 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:28.841 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:28.841 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:28.842 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:28.842 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:28.842 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:28.842 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:28.842 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:03:28.843 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:28.843 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:28.843 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:03:28.843 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:28.843 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:28.844 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:03:28.844 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:28.844 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:03:28.844 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42455sec preferred_lft 42455sec 2023-10-14T19:03:28.844 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:03:28.845 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:28.845 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T19:03:28.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:28.846 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:28.846 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:28.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2023-10-14T19:03:28.847 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2023-10-14T19:03:28.847 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2023-10-14T19:03:28.847 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T19:03:28.847 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:29.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.023 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:03:29.064 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:03:29.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.066 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:03:29.138 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:03:29.139 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:03:29.139 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:03:29.139 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:03:29.139 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:03:29.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.140 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:29.141 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:29.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:03:29.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:03:29.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:03:29.142 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:29.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.381 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:03:29.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.399 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-10-14T19:03:29.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.453 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:29.453 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:29.453 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:03:29.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T19:03:29.454 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:29.541 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T19:03:29.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.542 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:29.543 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:29.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T19:03:29.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T19:03:29.544 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T19:03:29.544 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T19:03:29.544 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T19:03:29.544 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:29.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:29.741 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:29.741 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:29.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:03:29.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T19:03:29.742 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:29.834 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:29.835 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:03:29.851 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:03:29.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:29.852 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:03:29.907 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:03:29.907 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:03:29.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:03:30.000 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:03:30.000 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:03:30.000 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:03:30.078 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:03:30.078 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:03:30.078 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:03:30.079 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:30.079 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:30.099 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:03:30.100 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:03:30.100 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:03:30.100 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:30.100 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:30.101 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:03:30.101 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:03:30.101 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:03:30.102 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:03:30.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.103 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:03:30.128 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-14T19:03:30.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:03:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.261+0000 7fd10bcbb700 1 Processor -- start 2023-10-14T19:03:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.261+0000 7fd10bcbb700 1 -- start start 2023-10-14T19:03:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10bcbb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1040cb5a0 0x7fd1040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10bcbb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1040cd9e0 0x7fd104159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10bcbb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10415ae40 con 0x7fd10415a400 2023-10-14T19:03:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10bcbb700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040d13f0 con 0x7fd1040cd9e0 2023-10-14T19:03:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10bcbb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10415ab60 con 0x7fd1040cb5a0 2023-10-14T19:03:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd109256700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1040cd9e0 0x7fd104159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10a258700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd10415a400 0x7fd104156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44980/0 (socket says 172.21.15.7:44980) 2023-10-14T19:03:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.262+0000 7fd10a258700 1 -- 172.21.15.7:0/2619959022 learned_addr learned my addr 172.21.15.7:0/2619959022 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd109a57700 1 --2- 172.21.15.7:0/2619959022 >> v2:172.21.15.148:3300/0 conn(0x7fd1040cb5a0 0x7fd1040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd109256700 1 -- 172.21.15.7:0/2619959022 >> v2:172.21.15.148:3300/0 conn(0x7fd1040cb5a0 msgr2=0x7fd1040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd109256700 1 --2- 172.21.15.7:0/2619959022 >> v2:172.21.15.148:3300/0 conn(0x7fd1040cb5a0 0x7fd1040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd109256700 1 -- 172.21.15.7:0/2619959022 >> v1:172.21.15.7:6789/0 conn(0x7fd10415a400 legacy=0x7fd104156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd109256700 1 -- 172.21.15.7:0/2619959022 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040ccf00 con 0x7fd1040cd9e0 2023-10-14T19:03:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd109256700 1 --2- 172.21.15.7:0/2619959022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd104159ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80098e0 tx=0x7fd0f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c579e0c07629c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd108a55700 1 -- 172.21.15.7:0/2619959022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8011630 con 0x7fd1040cd9e0 2023-10-14T19:03:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd108a55700 1 -- 172.21.15.7:0/2619959022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8011790 con 0x7fd1040cd9e0 2023-10-14T19:03:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.263+0000 7fd108a55700 1 -- 172.21.15.7:0/2619959022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8011b30 con 0x7fd1040cd9e0 2023-10-14T19:03:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 -- 172.21.15.7:0/2619959022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 msgr2=0x7fd104159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/2619959022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd104159ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80098e0 tx=0x7fd0f80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 -- 172.21.15.7:0/2619959022 shutdown_connections 2023-10-14T19:03:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/2619959022 >> v2:172.21.15.148:3300/0 conn(0x7fd1040cb5a0 0x7fd1040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/2619959022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd104159ec0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 -- 172.21.15.7:0/2619959022 >> 172.21.15.7:0/2619959022 conn(0x7fd104070e30 msgr2=0x7fd1040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 -- 172.21.15.7:0/2619959022 shutdown_connections 2023-10-14T19:03:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.264+0000 7fd10bcbb700 1 -- 172.21.15.7:0/2619959022 wait complete. 2023-10-14T19:03:30.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.265+0000 7fd10bcbb700 1 Processor -- start 2023-10-14T19:03:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.265+0000 7fd10bcbb700 1 -- start start 2023-10-14T19:03:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10bcbb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1040cb5a0 0x7fd10416db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10bcbb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd1040c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10bcbb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd10415a400 0x7fd1041530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10bcbb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10416d700 con 0x7fd1040cd9e0 2023-10-14T19:03:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10bcbb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040c8270 con 0x7fd10415a400 2023-10-14T19:03:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10bcbb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040ca940 con 0x7fd1040cb5a0 2023-10-14T19:03:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd1040c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd1040c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58666/0 (socket says 172.21.15.7:58666) 2023-10-14T19:03:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 -- 172.21.15.7:0/907230705 learned_addr learned my addr 172.21.15.7:0/907230705 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109a57700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1040cb5a0 0x7fd10416db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd10a258700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd10415a400 0x7fd1041530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 -- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1040cb5a0 msgr2=0x7fd10416db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1040cb5a0 0x7fd10416db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 -- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd10415a400 msgr2=0x7fd1041530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd10415a400 0x7fd1041530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 -- 172.21.15.7:0/907230705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009420 con 0x7fd1040cd9e0 2023-10-14T19:03:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109a57700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1040cb5a0 0x7fd10416db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.266+0000 7fd109256700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd1040c7d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80091e0 tx=0x7fd0f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.267+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f801bce0 con 0x7fd1040cd9e0 2023-10-14T19:03:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.267+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f801be60 con 0x7fd1040cd9e0 2023-10-14T19:03:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.267+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1040cac20 con 0x7fd1040cd9e0 2023-10-14T19:03:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.267+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8025670 con 0x7fd1040cd9e0 2023-10-14T19:03:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.267+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10416d390 con 0x7fd1040cd9e0 2023-10-14T19:03:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.268+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10416d870 con 0x7fd1040cd9e0 2023-10-14T19:03:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.268+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0f8023070 con 0x7fd1040cd9e0 2023-10-14T19:03:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.269+0000 7fd101ffb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd0f0066f30 0x7fd0f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.269+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd0f8085b40 con 0x7fd1040cd9e0 2023-10-14T19:03:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.269+0000 7fd109a57700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd0f0066f30 0x7fd0f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.269+0000 7fd109a57700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd0f0066f30 0x7fd0f00693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006f00 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.273+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0f8052df0 con 0x7fd1040cd9e0 2023-10-14T19:03:30.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.516+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd10404c3c0 con 0x7fd1040cd9e0 2023-10-14T19:03:30.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.517+0000 7fd101ffb700 1 -- 172.21.15.7:0/907230705 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0f8015070 con 0x7fd1040cd9e0 2023-10-14T19:03:30.517 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:03:30.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd0f0066f30 msgr2=0x7fd0f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:30.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd0f0066f30 0x7fd0f00693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006f00 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2023-10-14T19:03:30.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 msgr2=0x7fd1040c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:30.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd1040c7d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80091e0 tx=0x7fd0f8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 shutdown_connections 2023-10-14T19:03:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd0f0066f30 0x7fd0f00693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd10415a400 0x7fd1041530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1040cb5a0 0x7fd10416db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 --2- 172.21.15.7:0/907230705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1040cd9e0 0x7fd1040c7d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 >> 172.21.15.7:0/907230705 conn(0x7fd104070e30 msgr2=0x7fd1040cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 shutdown_connections 2023-10-14T19:03:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:30.519+0000 7fd10bcbb700 1 -- 172.21.15.7:0/907230705 wait complete. 2023-10-14T19:03:30.530 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T19:03:30.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:03:30.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:03:30.531 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T19:03:30.531 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T19:03:30.532 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T19:03:30.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T19:03:30.532 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:03:30.532 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T19:03:30.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.533 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:03:30.548 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.550 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:03:30.550 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:03:30.551 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:03:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:30.551 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:03:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:03:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42454sec preferred_lft 42454sec 2023-10-14T19:03:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:03:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.553 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:03:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:03:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link tentative 2023-10-14T19:03:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.554 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:03:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:03:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link tentative 2023-10-14T19:03:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.555 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:03:30.612 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:03:30.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.613 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:03:30.670 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:03:30.670 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:03:30.670 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:03:30.671 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:03:30.671 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:03:30.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.672 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:30.672 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:30.672 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:03:30.672 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:03:30.673 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:03:30.673 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:30.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.770 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:03:30.785 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:03:30.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.786 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-10-14T19:03:30.840 INFO:teuthology.orchestra.run.smithi148.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T19:03:30.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.841 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:30.841 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:30.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:03:30.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T19:03:30.842 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:30.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.930 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T19:03:30.960 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:30.961 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:30.961 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:30.961 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.961 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:30.961 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.962 INFO:teuthology.orchestra.run.smithi148.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:03:30.962 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether e6:6b:ad:ed:f6:41 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T19:03:30.962 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T19:03:30.962 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.962 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::e46b:adff:feed:f641/64 scope link tentative 2023-10-14T19:03:30.963 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:30.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:30.974 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T19:03:31.045 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:03:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:03:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:03:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:03:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:31.047 INFO:teuthology.orchestra.run.smithi148.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:03:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether e6:6b:ad:ed:f6:41 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T19:03:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T19:03:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::e46b:adff:feed:f641/64 scope link tentative 2023-10-14T19:03:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:03:31.056 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T19:03:31.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:31.057 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:31.058 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:31.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T19:03:31.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T19:03:31.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T19:03:31.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T19:03:31.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T19:03:31.059 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:31.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:31.271 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:03:31.271 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:03:31.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.1 up 2023-10-14T19:03:31.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T19:03:31.272 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:03:31.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:31.351 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T19:03:31.366 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T19:03:31.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:03:31.367 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T19:03:31.420 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:03:31.421 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:03:31.421 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T19:03:31.500 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T19:03:31.500 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-14T19:03:31.500 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:03:31.508 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T19:03:31.508 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-14T19:03:31.508 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:03:31.508 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:31.509 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:31.530 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T19:03:31.530 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-14T19:03:31.530 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:03:31.531 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:03:31.531 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:03:31.531 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:03:31.531 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:03:31.531 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:03:31.532 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:03:31.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:31.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T19:03:31.597 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T19:03:31.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.749+0000 7f8cd1dc6700 1 Processor -- start 2023-10-14T19:03:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.749+0000 7f8cd1dc6700 1 -- start start 2023-10-14T19:03:31.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8cd1dc6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0cb5a0 0x7f8ccc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:31.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8cd1dc6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:31.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8cd1dc6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc15ae40 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8cd1dc6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0d13f0 con 0x7f8ccc0cb5a0 2023-10-14T19:03:31.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8cd1dc6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc15ab60 con 0x7f8ccc15a5d0 2023-10-14T19:03:31.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccbfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:31.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0cb5a0 0x7f8ccc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:31.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0cb5a0 0x7f8ccc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:34224/0 (socket says 172.21.15.7:34224) 2023-10-14T19:03:31.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 -- 172.21.15.7:0/4009001841 learned_addr learned my addr 172.21.15.7:0/4009001841 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:31.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccbfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:35786/0 (socket says 172.21.15.7:35786) 2023-10-14T19:03:31.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccaffd700 1 --1- 172.21.15.7:0/4009001841 >> v1:172.21.15.148:6789/0 conn(0x7f8ccc0cd9e0 0x7f8ccc159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:43886/0 (socket says 172.21.15.7:43886) 2023-10-14T19:03:31.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 -- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 msgr2=0x7f8ccc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:31.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 --2- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 -- 172.21.15.7:0/4009001841 >> v1:172.21.15.148:6789/0 conn(0x7f8ccc0cd9e0 legacy=0x7f8ccc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:31.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccb7fe700 1 -- 172.21.15.7:0/4009001841 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0ccf00 con 0x7f8ccc0cb5a0 2023-10-14T19:03:31.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8cca7fc700 1 -- 172.21.15.7:0/4009001841 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209897278 0 0) 0x7f8ccc15ae40 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.750+0000 7f8ccbfff700 1 --2- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:31.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8ccb7fe700 1 --2- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc0cb970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099e0 tx=0x7f8cc0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9967bc086d708e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:31.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cca7fc700 1 -- 172.21.15.7:0/4009001841 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000b820 con 0x7f8ccc0cb5a0 2023-10-14T19:03:31.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cca7fc700 1 -- 172.21.15.7:0/4009001841 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000b980 con 0x7f8ccc0cb5a0 2023-10-14T19:03:31.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cca7fc700 1 -- 172.21.15.7:0/4009001841 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000bd20 con 0x7f8ccc0cb5a0 2023-10-14T19:03:31.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 msgr2=0x7f8ccc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:31.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc0cb970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099e0 tx=0x7f8cc0009250 comp rx=0 tx=0).stop 2023-10-14T19:03:31.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/4009001841 shutdown_connections 2023-10-14T19:03:31.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/4009001841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc0cb970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/4009001841 >> 172.21.15.7:0/4009001841 conn(0x7f8ccc070e30 msgr2=0x7f8ccc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:31.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/4009001841 shutdown_connections 2023-10-14T19:03:31.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.751+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/4009001841 wait complete. 2023-10-14T19:03:31.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 Processor -- start 2023-10-14T19:03:31.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 -- start start 2023-10-14T19:03:31.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 0x7f8ccc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc152ac0 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0c89a0 con 0x7f8ccc0cb5a0 2023-10-14T19:03:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.753+0000 7f8cd1dc6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0c7d90 con 0x7f8ccc15a5d0 2023-10-14T19:03:31.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 0x7f8ccc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:31.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:31.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccbfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:31.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 0x7f8ccc156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58682/0 (socket says 172.21.15.7:58682) 2023-10-14T19:03:31.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 -- 172.21.15.7:0/3563966483 learned_addr learned my addr 172.21.15.7:0/3563966483 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 -- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 msgr2=0x7f8ccc158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 -- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 msgr2=0x7f8ccc155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 -- 172.21.15.7:0/3563966483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4009a20 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccb7fe700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8ccaffd700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 0x7f8ccc156c60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c7e0 tx=0x7f8cbc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc005a70 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc005bd0 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc00094f0 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0070d0 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.754+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc0c83d0 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.755+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc0c8b30 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.756+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cbc007480 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.756+0000 7f8cb37fe700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8cb8066f30 0x7f8cb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.756+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cbc083890 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.756+0000 7f8ccb7fe700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8cb8066f30 0x7f8cb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.757+0000 7f8ccb7fe700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8cb8066f30 0x7f8cb80693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099e0 tx=0x7f8cc0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.761+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cbc050c70 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.955+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ccc04c3c0 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.955+0000 7f8cb37fe700 1 -- 172.21.15.7:0/3563966483 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f8cbc017070 con 0x7f8ccc0cd9e0 2023-10-14T19:03:31.955 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:31.956 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8cb8066f30 msgr2=0x7f8cb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8cb8066f30 0x7f8cb80693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099e0 tx=0x7f8cc0017000 comp rx=0 tx=0).stop 2023-10-14T19:03:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 msgr2=0x7f8ccc156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 0x7f8ccc156c60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c7e0 tx=0x7f8cbc007e10 comp rx=0 tx=0).stop 2023-10-14T19:03:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 shutdown_connections 2023-10-14T19:03:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8cb8066f30 0x7f8cb80693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc0cb5a0 0x7f8ccc155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc15a5d0 0x7f8ccc158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 --2- 172.21.15.7:0/3563966483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ccc0cd9e0 0x7f8ccc156c60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 >> 172.21.15.7:0/3563966483 conn(0x7f8ccc070e30 msgr2=0x7f8ccc0b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 shutdown_connections 2023-10-14T19:03:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:31.957+0000 7f8cd1dc6700 1 -- 172.21.15.7:0/3563966483 wait complete. 2023-10-14T19:03:31.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:31.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:32.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.092+0000 7f14f4c2c700 1 Processor -- start 2023-10-14T19:03:32.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.092+0000 7f14f4c2c700 1 -- start start 2023-10-14T19:03:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14f4c2c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f14f006dc70 0x7f14f0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14f4c2c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14f006e0e0 0x7f14f00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14f4c2c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f00ccfd0 con 0x7f14f0159530 2023-10-14T19:03:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14f4c2c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f015a3d0 con 0x7f14f006e0e0 2023-10-14T19:03:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14f4c2c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f015a6b0 con 0x7f14f006dc70 2023-10-14T19:03:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14eed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14f006e0e0 0x7f14f00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14ee59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14f0159530 0x7f14f00ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44996/0 (socket says 172.21.15.7:44996) 2023-10-14T19:03:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.093+0000 7f14ee59c700 1 -- 172.21.15.7:0/1010079372 learned_addr learned my addr 172.21.15.7:0/1010079372 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14edd9b700 1 --2- 172.21.15.7:0/1010079372 >> v2:172.21.15.148:3300/0 conn(0x7f14f006dc70 0x7f14f0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14eed9d700 1 -- 172.21.15.7:0/1010079372 >> v2:172.21.15.148:3300/0 conn(0x7f14f006dc70 msgr2=0x7f14f0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14eed9d700 1 --2- 172.21.15.7:0/1010079372 >> v2:172.21.15.148:3300/0 conn(0x7f14f006dc70 0x7f14f0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14eed9d700 1 -- 172.21.15.7:0/1010079372 >> v1:172.21.15.7:6789/0 conn(0x7f14f0159530 legacy=0x7f14f00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14eed9d700 1 -- 172.21.15.7:0/1010079372 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f015a990 con 0x7f14f006e0e0 2023-10-14T19:03:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14ed59a700 1 -- 172.21.15.7:0/1010079372 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290256868 0 0) 0x7f14f00ccfd0 con 0x7f14f0159530 2023-10-14T19:03:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14edd9b700 1 --2- 172.21.15.7:0/1010079372 >> v2:172.21.15.148:3300/0 conn(0x7f14f006dc70 0x7f14f0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14eed9d700 1 --2- 172.21.15.7:0/1010079372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f00cb6f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14f00b66e0 tx=0x7f14e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784ce17f1d9eef5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14ed59a700 1 -- 172.21.15.7:0/1010079372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000e070 con 0x7f14f006e0e0 2023-10-14T19:03:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14ed59a700 1 -- 172.21.15.7:0/1010079372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e000bc30 con 0x7f14f006e0e0 2023-10-14T19:03:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14ed59a700 1 -- 172.21.15.7:0/1010079372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e0012430 con 0x7f14f006e0e0 2023-10-14T19:03:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1010079372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 msgr2=0x7f14f00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.094+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1010079372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f00cb6f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14f00b66e0 tx=0x7f14e0009780 comp rx=0 tx=0).stop 2023-10-14T19:03:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.095+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1010079372 shutdown_connections 2023-10-14T19:03:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.095+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1010079372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f00cb6f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.095+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1010079372 >> v2:172.21.15.148:3300/0 conn(0x7f14f006dc70 0x7f14f0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.095+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1010079372 >> 172.21.15.7:0/1010079372 conn(0x7f14f00703a0 msgr2=0x7f14f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.095+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1010079372 shutdown_connections 2023-10-14T19:03:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.095+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1010079372 wait complete. 2023-10-14T19:03:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 Processor -- start 2023-10-14T19:03:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 -- start start 2023-10-14T19:03:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f006dc70 0x7f14f00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f0153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14f0159530 0x7f14f0150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f01540b0 con 0x7f14f006e0e0 2023-10-14T19:03:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0169fe0 con 0x7f14f006dc70 2023-10-14T19:03:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.096+0000 7f14f4c2c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0169730 con 0x7f14f0159530 2023-10-14T19:03:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f0153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f0153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58704/0 (socket says 172.21.15.7:58704) 2023-10-14T19:03:32.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14ee59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f006dc70 0x7f14f00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 -- 172.21.15.7:0/1694332156 learned_addr learned my addr 172.21.15.7:0/1694332156 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:32.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14eed9d700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14f0159530 0x7f14f0150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 -- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14f0159530 msgr2=0x7f14f0150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14f0159530 0x7f14f0150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 -- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f006dc70 msgr2=0x7f14f00b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f006dc70 0x7f14f00b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 -- 172.21.15.7:0/1694332156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0009a20 con 0x7f14f006e0e0 2023-10-14T19:03:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14edd9b700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f0153740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c830 tx=0x7f14d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011600 con 0x7f14f006e0e0 2023-10-14T19:03:32.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8011760 con 0x7f14f006e0e0 2023-10-14T19:03:32.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f0153dd0 con 0x7f14f006e0e0 2023-10-14T19:03:32.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011b20 con 0x7f14f006e0e0 2023-10-14T19:03:32.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.097+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f0169c70 con 0x7f14f006e0e0 2023-10-14T19:03:32.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.098+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f004c3c0 con 0x7f14f006e0e0 2023-10-14T19:03:32.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.099+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14d8018360 con 0x7f14f006e0e0 2023-10-14T19:03:32.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.099+0000 7f14e67fc700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f14d0066f30 0x7f14d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.099+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14d80844c0 con 0x7f14f006e0e0 2023-10-14T19:03:32.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.099+0000 7f14ee59c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f14d0066f30 0x7f14d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.100+0000 7f14ee59c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f14d0066f30 0x7f14d00693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14e8007160 tx=0x7f14e8007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.103+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14d8051730 con 0x7f14f006e0e0 2023-10-14T19:03:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.295+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14f016a120 con 0x7f14f006e0e0 2023-10-14T19:03:32.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.296+0000 7f14e67fc700 1 -- 172.21.15.7:0/1694332156 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14d8054d50 con 0x7f14f006e0e0 2023-10-14T19:03:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:32.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f14d0066f30 msgr2=0x7f14d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f14d0066f30 0x7f14d00693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14e8007160 tx=0x7f14e8007f50 comp rx=0 tx=0).stop 2023-10-14T19:03:32.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 msgr2=0x7f14f0153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f0153740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c830 tx=0x7f14d8008040 comp rx=0 tx=0).stop 2023-10-14T19:03:32.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 shutdown_connections 2023-10-14T19:03:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f14d0066f30 0x7f14d00693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f006dc70 0x7f14f00b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14f0159530 0x7f14f0150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 --2- 172.21.15.7:0/1694332156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14f006e0e0 0x7f14f0153740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 >> 172.21.15.7:0/1694332156 conn(0x7f14f00703a0 msgr2=0x7f14f015ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 shutdown_connections 2023-10-14T19:03:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.298+0000 7f14f4c2c700 1 -- 172.21.15.7:0/1694332156 wait complete. 2023-10-14T19:03:32.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:32.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.432+0000 7fefd8416700 1 Processor -- start 2023-10-14T19:03:32.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.432+0000 7fefd8416700 1 -- start start 2023-10-14T19:03:32.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd8416700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fefd0159530 0x7fefd00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd8416700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd006e0e0 0x7fefd00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd8416700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00ccfd0 con 0x7fefd006dc70 2023-10-14T19:03:32.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd8416700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd00cf0e0 con 0x7fefd0159530 2023-10-14T19:03:32.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd8416700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015a3d0 con 0x7fefd006e0e0 2023-10-14T19:03:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd59b1700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fefd006dc70 0x7fefd0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45012/0 (socket says 172.21.15.7:45012) 2023-10-14T19:03:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd59b1700 1 -- 172.21.15.7:0/3510072568 learned_addr learned my addr 172.21.15.7:0/3510072568 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.433+0000 7fefd61b2700 1 --2- 172.21.15.7:0/3510072568 >> v2:172.21.15.148:3300/0 conn(0x7fefd0159530 0x7fefd00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd69b3700 1 --2- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd006e0e0 0x7fefd00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd51b0700 1 -- 172.21.15.7:0/3510072568 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872559577 0 0) 0x7fefd00ccfd0 con 0x7fefd006dc70 2023-10-14T19:03:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd51b0700 1 -- 172.21.15.7:0/3510072568 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb8003570 con 0x7fefd006dc70 2023-10-14T19:03:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd61b2700 1 -- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd006e0e0 msgr2=0x7fefd00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd61b2700 1 --2- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd006e0e0 0x7fefd00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd61b2700 1 -- 172.21.15.7:0/3510072568 >> v1:172.21.15.7:6789/0 conn(0x7fefd006dc70 legacy=0x7fefd0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd51b0700 1 -- 172.21.15.7:0/3510072568 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3469610483 0 0) 0x7fefb8003570 con 0x7fefd006dc70 2023-10-14T19:03:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd61b2700 1 -- 172.21.15.7:0/3510072568 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd015a6b0 con 0x7fefd0159530 2023-10-14T19:03:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd61b2700 1 --2- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd0159530 0x7fefd00ceba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefc80098e0 tx=0x7fefc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bc2c765f2579615 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd51b0700 1 -- 172.21.15.7:0/3510072568 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4001470 con 0x7fefd0159530 2023-10-14T19:03:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd51b0700 1 -- 172.21.15.7:0/3510072568 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8011420 con 0x7fefd0159530 2023-10-14T19:03:32.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.434+0000 7fefd51b0700 1 -- 172.21.15.7:0/3510072568 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80117c0 con 0x7fefd0159530 2023-10-14T19:03:32.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 -- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd0159530 msgr2=0x7fefd00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 --2- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd0159530 0x7fefd00ceba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefc80098e0 tx=0x7fefc80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 -- 172.21.15.7:0/3510072568 shutdown_connections 2023-10-14T19:03:32.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 --2- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd0159530 0x7fefd00ceba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 --2- 172.21.15.7:0/3510072568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd006e0e0 0x7fefd00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 -- 172.21.15.7:0/3510072568 >> 172.21.15.7:0/3510072568 conn(0x7fefd00703a0 msgr2=0x7fefd00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:32.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 -- 172.21.15.7:0/3510072568 shutdown_connections 2023-10-14T19:03:32.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.435+0000 7fefd8416700 1 -- 172.21.15.7:0/3510072568 wait complete. 2023-10-14T19:03:32.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.436+0000 7fefd8416700 1 Processor -- start 2023-10-14T19:03:32.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.436+0000 7fefd8416700 1 -- start start 2023-10-14T19:03:32.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd8416700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 0x7fefd00c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd8416700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd006e0e0 0x7fefd00b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd8416700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0159530 0x7fefd00b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd8416700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015d3c0 con 0x7fefd006dc70 2023-10-14T19:03:32.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd8416700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015d5d0 con 0x7fefd006e0e0 2023-10-14T19:03:32.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd8416700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015d8b0 con 0x7fefd0159530 2023-10-14T19:03:32.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 0x7fefd00c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 0x7fefd00c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58712/0 (socket says 172.21.15.7:58712) 2023-10-14T19:03:32.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 -- 172.21.15.7:0/1385819942 learned_addr learned my addr 172.21.15.7:0/1385819942 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:32.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd59b1700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd006e0e0 0x7fefd00b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 -- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0159530 msgr2=0x7fefd00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd69b3700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0159530 0x7fefd00b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0159530 0x7fefd00b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 -- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd006e0e0 msgr2=0x7fefd00b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd006e0e0 0x7fefd00b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 -- 172.21.15.7:0/1385819942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8009420 con 0x7fefd006dc70 2023-10-14T19:03:32.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd59b1700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd006e0e0 0x7fefd00b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:32.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefd61b2700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 0x7fefd00c9c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fefc80030c0 tx=0x7fefc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.437+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc801cc90 con 0x7fefd006dc70 2023-10-14T19:03:32.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.438+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc801cdf0 con 0x7fefd006dc70 2023-10-14T19:03:32.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.438+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc801a6a0 con 0x7fefd006dc70 2023-10-14T19:03:32.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.438+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd015db90 con 0x7fefd006dc70 2023-10-14T19:03:32.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.438+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd015e150 con 0x7fefd006dc70 2023-10-14T19:03:32.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.439+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd004c3c0 con 0x7fefd006dc70 2023-10-14T19:03:32.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.439+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefc801aad0 con 0x7fefd006dc70 2023-10-14T19:03:32.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.439+0000 7fefce7fc700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.440+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefc8085ed0 con 0x7fefd006dc70 2023-10-14T19:03:32.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.440+0000 7fefd59b1700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.440+0000 7fefd59b1700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fefbc066f30 0x7fefbc0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fefc40011e0 tx=0x7fefc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.444+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefc8053140 con 0x7fefd006dc70 2023-10-14T19:03:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.638+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefd015a990 con 0x7fefd006dc70 2023-10-14T19:03:32.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.638+0000 7fefce7fc700 1 -- 172.21.15.7:0/1385819942 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefc8056760 con 0x7fefd006dc70 2023-10-14T19:03:32.638 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:32.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fefbc066f30 msgr2=0x7fefbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fefbc066f30 0x7fefbc0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fefc40011e0 tx=0x7fefc4009040 comp rx=0 tx=0).stop 2023-10-14T19:03:32.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 msgr2=0x7fefd00c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 0x7fefd00c9c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fefc80030c0 tx=0x7fefc8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:32.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 shutdown_connections 2023-10-14T19:03:32.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0159530 0x7fefd00b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefd006dc70 0x7fefd00c9c40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 --2- 172.21.15.7:0/1385819942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd006e0e0 0x7fefd00b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 >> 172.21.15.7:0/1385819942 conn(0x7fefd00703a0 msgr2=0x7fefd00c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 shutdown_connections 2023-10-14T19:03:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.640+0000 7fefd8416700 1 -- 172.21.15.7:0/1385819942 wait complete. 2023-10-14T19:03:32.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:32.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.774+0000 7f6db21ca700 1 Processor -- start 2023-10-14T19:03:32.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 -- start start 2023-10-14T19:03:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dac159530 0x7f6dac0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6dac06dc70 0x7f6dac159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06e0e0 0x7f6dac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0ccfd0 con 0x7f6dac06dc70 2023-10-14T19:03:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0cf0e0 con 0x7f6dac159530 2023-10-14T19:03:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.775+0000 7f6db21ca700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac15a3d0 con 0x7f6dac06e0e0 2023-10-14T19:03:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6dac06dc70 0x7f6dac159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6dac06dc70 0x7f6dac159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58726/0 (socket says 172.21.15.7:58726) 2023-10-14T19:03:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 -- 172.21.15.7:0/391958019 learned_addr learned my addr 172.21.15.7:0/391958019 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6dab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dac159530 0x7f6dac0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6dabfff700 1 --2- 172.21.15.7:0/391958019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06e0e0 0x7f6dac0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 -- 172.21.15.7:0/391958019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06e0e0 msgr2=0x7f6dac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 --2- 172.21.15.7:0/391958019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06e0e0 0x7f6dac0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 -- 172.21.15.7:0/391958019 >> v2:172.21.15.148:3300/0 conn(0x7f6dac159530 msgr2=0x7f6dac0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 --2- 172.21.15.7:0/391958019 >> v2:172.21.15.148:3300/0 conn(0x7f6dac159530 0x7f6dac0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 -- 172.21.15.7:0/391958019 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac15a6b0 con 0x7f6dac06dc70 2023-10-14T19:03:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6dab7fe700 1 --2- 172.21.15.7:0/391958019 >> v2:172.21.15.148:3300/0 conn(0x7f6dac159530 0x7f6dac0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daaffd700 1 --2- 172.21.15.7:0/391958019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06dc70 0x7f6dac159900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06d630 tx=0x7f6da0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add6747afd9b5c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daa7fc700 1 -- 172.21.15.7:0/391958019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000b640 con 0x7f6dac06dc70 2023-10-14T19:03:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daa7fc700 1 -- 172.21.15.7:0/391958019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da000b7a0 con 0x7f6dac06dc70 2023-10-14T19:03:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.776+0000 7f6daa7fc700 1 -- 172.21.15.7:0/391958019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000bb60 con 0x7f6dac06dc70 2023-10-14T19:03:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 -- 172.21.15.7:0/391958019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06dc70 msgr2=0x7f6dac159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 --2- 172.21.15.7:0/391958019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06dc70 0x7f6dac159900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06d630 tx=0x7f6da0009250 comp rx=0 tx=0).stop 2023-10-14T19:03:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 -- 172.21.15.7:0/391958019 shutdown_connections 2023-10-14T19:03:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 --2- 172.21.15.7:0/391958019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06e0e0 0x7f6dac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 --2- 172.21.15.7:0/391958019 >> v2:172.21.15.148:3300/0 conn(0x7f6dac159530 0x7f6dac0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 --2- 172.21.15.7:0/391958019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06dc70 0x7f6dac159900 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 -- 172.21.15.7:0/391958019 >> 172.21.15.7:0/391958019 conn(0x7f6dac0703a0 msgr2=0x7f6dac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 -- 172.21.15.7:0/391958019 shutdown_connections 2023-10-14T19:03:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.777+0000 7f6db21ca700 1 -- 172.21.15.7:0/391958019 wait complete. 2023-10-14T19:03:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.778+0000 7f6db21ca700 1 Processor -- start 2023-10-14T19:03:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.778+0000 7f6db21ca700 1 -- start start 2023-10-14T19:03:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6db21ca700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06dc70 0x7f6dac14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6db21ca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 0x7f6dac0b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6db21ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac159530 0x7f6dac154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6db21ca700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac14e800 con 0x7f6dac06e0e0 2023-10-14T19:03:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6db21ca700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0b5040 con 0x7f6dac159530 2023-10-14T19:03:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6db21ca700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0b26c0 con 0x7f6dac06dc70 2023-10-14T19:03:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 0x7f6dac0b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 0x7f6dac0b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58734/0 (socket says 172.21.15.7:58734) 2023-10-14T19:03:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 -- 172.21.15.7:0/1026103417 learned_addr learned my addr 172.21.15.7:0/1026103417 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6dab7fe700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06dc70 0x7f6dac14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6dabfff700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac159530 0x7f6dac154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 -- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06dc70 msgr2=0x7f6dac14e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06dc70 0x7f6dac14e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 -- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac159530 msgr2=0x7f6dac154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac159530 0x7f6dac154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 -- 172.21.15.7:0/1026103417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009420 con 0x7f6dac06e0e0 2023-10-14T19:03:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6dabfff700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac159530 0x7f6dac154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6dab7fe700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06dc70 0x7f6dac14e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6daaffd700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 0x7f6dac0b2180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dac089650 tx=0x7f6da0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.779+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0000d10 con 0x7f6dac06e0e0 2023-10-14T19:03:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.780+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da000bb20 con 0x7f6dac06e0e0 2023-10-14T19:03:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.780+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da00094f0 con 0x7f6dac06e0e0 2023-10-14T19:03:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.780+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011670 con 0x7f6dac06e0e0 2023-10-14T19:03:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.780+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0b4710 con 0x7f6dac06e0e0 2023-10-14T19:03:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.780+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac0b51b0 con 0x7f6dac06e0e0 2023-10-14T19:03:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.782+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6da00119e0 con 0x7f6dac06e0e0 2023-10-14T19:03:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.782+0000 7f6d937fe700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.782+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6da0086640 con 0x7f6dac06e0e0 2023-10-14T19:03:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.782+0000 7f6dab7fe700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.783+0000 7f6dab7fe700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0093f0 tx=0x7f6d9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.785+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6da0053930 con 0x7f6dac06e0e0 2023-10-14T19:03:32.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.978+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6dac04c3c0 con 0x7f6dac06e0e0 2023-10-14T19:03:32.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.978+0000 7f6d937fe700 1 -- 172.21.15.7:0/1026103417 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6da0056f50 con 0x7f6dac06e0e0 2023-10-14T19:03:32.978 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:32.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6d98066f30 msgr2=0x7f6d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0093f0 tx=0x7f6d9c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:32.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 msgr2=0x7f6dac0b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:32.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 0x7f6dac0b2180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dac089650 tx=0x7f6da0017000 comp rx=0 tx=0).stop 2023-10-14T19:03:32.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 shutdown_connections 2023-10-14T19:03:32.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac159530 0x7f6dac154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6dac06dc70 0x7f6dac14e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 --2- 172.21.15.7:0/1026103417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dac06e0e0 0x7f6dac0b2180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:32.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 >> 172.21.15.7:0/1026103417 conn(0x7f6dac0703a0 msgr2=0x7f6dac0d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:32.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 shutdown_connections 2023-10-14T19:03:32.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:32.980+0000 7f6db21ca700 1 -- 172.21.15.7:0/1026103417 wait complete. 2023-10-14T19:03:32.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:33.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.112+0000 7fe85fa35700 1 Processor -- start 2023-10-14T19:03:33.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.113+0000 7fe85fa35700 1 -- start start 2023-10-14T19:03:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.113+0000 7fe85fa35700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 0x7fe8580a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.113+0000 7fe85fa35700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580ce1a0 con 0x7fe8580aee90 2023-10-14T19:03:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.113+0000 7fe85fa35700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580cd5d0 con 0x7fe85806d280 2023-10-14T19:03:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.113+0000 7fe85fa35700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580cd870 con 0x7fe8580a8be0 2023-10-14T19:03:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe85dfd2700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe8580aee90 0x7fe8580b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45024/0 (socket says 172.21.15.7:45024) 2023-10-14T19:03:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe85dfd2700 1 -- 172.21.15.7:0/4184714032 learned_addr learned my addr 172.21.15.7:0/4184714032 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 0x7fe8580a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217684126 0 0) 0x7fe8580ce1a0 con 0x7fe8580aee90 2023-10-14T19:03:33.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe840003570 con 0x7fe8580aee90 2023-10-14T19:03:33.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436064873 0 0) 0x7fe840003570 con 0x7fe8580aee90 2023-10-14T19:03:33.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 msgr2=0x7fe8580a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:33.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 0x7fe8580a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 >> v1:172.21.15.148:6789/0 conn(0x7fe85806d280 legacy=0x7fe8580ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8580cdb50 con 0x7fe8580aee90 2023-10-14T19:03:33.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fe8480017f0 con 0x7fe8580aee90 2023-10-14T19:03:33.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 >> v1:172.21.15.7:6789/0 conn(0x7fe8580aee90 legacy=0x7fe8580b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe840003a90 0x7fe840003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 0x7fe840004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe840004d50 0x7fe8400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580cd870 con 0x7fe840003a90 2023-10-14T19:03:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84000bb10 con 0x7fe840004d50 2023-10-14T19:03:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84000bcd0 con 0x7fe8580a8be0 2023-10-14T19:03:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe840003a90 0x7fe840003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe85dfd2700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe840004d50 0x7fe8400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.114+0000 7fe85cfd0700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 0x7fe840004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85d7d1700 1 -- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 msgr2=0x7fe840004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8580a8be0 0x7fe840004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85d7d1700 1 -- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe840004d50 msgr2=0x7fe8400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe840004d50 0x7fe8400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85d7d1700 1 -- 172.21.15.7:0/4184714032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840003570 con 0x7fe840003a90 2023-10-14T19:03:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe840003a90 0x7fe840003e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe850009bf0 tx=0x7fe850009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbb342379ce9f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850005a00 con 0x7fe840003a90 2023-10-14T19:03:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850005b60 con 0x7fe840003a90 2023-10-14T19:03:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe857fff700 1 -- 172.21.15.7:0/4184714032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000e710 con 0x7fe840003a90 2023-10-14T19:03:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85fa35700 1 -- 172.21.15.7:0/4184714032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe840003a90 msgr2=0x7fe840003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85fa35700 1 --2- 172.21.15.7:0/4184714032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe840003a90 0x7fe840003e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe850009bf0 tx=0x7fe850009120 comp rx=0 tx=0).stop 2023-10-14T19:03:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85dfd2700 1 -- 172.21.15.7:0/4184714032 reap_dead start 2023-10-14T19:03:33.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85fa35700 1 -- 172.21.15.7:0/4184714032 shutdown_connections 2023-10-14T19:03:33.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.115+0000 7fe85fa35700 1 -- 172.21.15.7:0/4184714032 >> 172.21.15.7:0/4184714032 conn(0x7fe85806ce80 msgr2=0x7fe8580ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:33.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.116+0000 7fe85fa35700 1 -- 172.21.15.7:0/4184714032 shutdown_connections 2023-10-14T19:03:33.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.116+0000 7fe85fa35700 1 -- 172.21.15.7:0/4184714032 wait complete. 2023-10-14T19:03:33.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 Processor -- start 2023-10-14T19:03:33.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 -- start start 2023-10-14T19:03:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe840003a90 0x7fe858161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 0x7fe858099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8580980f0 0x7fe858098560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858098aa0 con 0x7fe858099910 2023-10-14T19:03:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85815b6a0 con 0x7fe8580980f0 2023-10-14T19:03:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.117+0000 7fe85fa35700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8581617b0 con 0x7fe840003a90 2023-10-14T19:03:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 0x7fe858099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 0x7fe858099d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58752/0 (socket says 172.21.15.7:58752) 2023-10-14T19:03:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 -- 172.21.15.7:0/331140548 learned_addr learned my addr 172.21.15.7:0/331140548 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe840003a90 0x7fe858161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85dfd2700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8580980f0 0x7fe858098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 -- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe840003a90 msgr2=0x7fe858161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe840003a90 0x7fe858161270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 -- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8580980f0 msgr2=0x7fe858098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8580980f0 0x7fe858098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 -- 172.21.15.7:0/331140548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85815b370 con 0x7fe858099910 2023-10-14T19:03:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85cfd0700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 0x7fe858099d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e8c0 tx=0x7fe84c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c012590 con 0x7fe858099910 2023-10-14T19:03:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c0126f0 con 0x7fe858099910 2023-10-14T19:03:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85809a3b0 con 0x7fe858099910 2023-10-14T19:03:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c012ab0 con 0x7fe858099910 2023-10-14T19:03:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.118+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85809a970 con 0x7fe858099910 2023-10-14T19:03:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.119+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85815b850 con 0x7fe858099910 2023-10-14T19:03:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.120+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe84c01d460 con 0x7fe858099910 2023-10-14T19:03:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.120+0000 7fe8557fa700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe844066f30 0x7fe8440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.120+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe84c084720 con 0x7fe858099910 2023-10-14T19:03:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.120+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe844066f30 0x7fe8440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.121+0000 7fe85d7d1700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe844066f30 0x7fe8440693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe850009160 tx=0x7fe850019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.124+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe85815b850 con 0x7fe858099910 2023-10-14T19:03:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.324+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe85815b810 con 0x7fe858099910 2023-10-14T19:03:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.325+0000 7fe8557fa700 1 -- 172.21.15.7:0/331140548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe84c051990 con 0x7fe858099910 2023-10-14T19:03:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:33.326 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:33.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe844066f30 msgr2=0x7fe8440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe844066f30 0x7fe8440693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe850009160 tx=0x7fe850019000 comp rx=0 tx=0).stop 2023-10-14T19:03:33.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 msgr2=0x7fe858099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 0x7fe858099d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e8c0 tx=0x7fe84c009040 comp rx=0 tx=0).stop 2023-10-14T19:03:33.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 shutdown_connections 2023-10-14T19:03:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe844066f30 0x7fe8440693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8580980f0 0x7fe858098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe840003a90 0x7fe858161270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 --2- 172.21.15.7:0/331140548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe858099910 0x7fe858099d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 >> 172.21.15.7:0/331140548 conn(0x7fe85806ce80 msgr2=0x7fe8580add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 shutdown_connections 2023-10-14T19:03:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.327+0000 7fe85fa35700 1 -- 172.21.15.7:0/331140548 wait complete. 2023-10-14T19:03:33.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:33.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:33.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.462+0000 7ff63c332700 1 Processor -- start 2023-10-14T19:03:33.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.462+0000 7ff63c332700 1 -- start start 2023-10-14T19:03:33.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63c332700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff634159530 0x7ff6340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63c332700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff63406dc70 0x7ff634159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63c332700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6340ccfd0 con 0x7ff63406e0e0 2023-10-14T19:03:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63c332700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6340cf0e0 con 0x7ff634159530 2023-10-14T19:03:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63c332700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63415a3d0 con 0x7ff63406dc70 2023-10-14T19:03:33.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63a0ce700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff634159530 0x7ff6340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.463+0000 7ff63a0ce700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff634159530 0x7ff6340ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58758/0 (socket says 172.21.15.7:58758) 2023-10-14T19:03:33.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff63a0ce700 1 -- 172.21.15.7:0/4022036213 learned_addr learned my addr 172.21.15.7:0/4022036213 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:33.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff6398cd700 1 --2- 172.21.15.7:0/4022036213 >> v2:172.21.15.148:3300/0 conn(0x7ff63406dc70 0x7ff634159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff63a0ce700 1 -- 172.21.15.7:0/4022036213 >> v2:172.21.15.148:3300/0 conn(0x7ff63406dc70 msgr2=0x7ff634159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:33.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff63a0ce700 1 --2- 172.21.15.7:0/4022036213 >> v2:172.21.15.148:3300/0 conn(0x7ff63406dc70 0x7ff634159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff63a0ce700 1 -- 172.21.15.7:0/4022036213 >> v1:172.21.15.148:6789/0 conn(0x7ff63406e0e0 legacy=0x7ff6340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:33.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff63a0ce700 1 -- 172.21.15.7:0/4022036213 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63415a6b0 con 0x7ff634159530 2023-10-14T19:03:33.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff6398cd700 1 --2- 172.21.15.7:0/4022036213 >> v2:172.21.15.148:3300/0 conn(0x7ff63406dc70 0x7ff634159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:33.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff63a0ce700 1 --2- 172.21.15.7:0/4022036213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff634159530 0x7ff6340ceba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6340b66e0 tx=0x7ff62c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ca0ad467f2e75c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff6390cc700 1 -- 172.21.15.7:0/4022036213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00b820 con 0x7ff634159530 2023-10-14T19:03:33.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff6390cc700 1 -- 172.21.15.7:0/4022036213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c00b980 con 0x7ff634159530 2023-10-14T19:03:33.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.464+0000 7ff6390cc700 1 -- 172.21.15.7:0/4022036213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00bd20 con 0x7ff634159530 2023-10-14T19:03:33.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 -- 172.21.15.7:0/4022036213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff634159530 msgr2=0x7ff6340ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 --2- 172.21.15.7:0/4022036213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff634159530 0x7ff6340ceba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6340b66e0 tx=0x7ff62c009250 comp rx=0 tx=0).stop 2023-10-14T19:03:33.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 -- 172.21.15.7:0/4022036213 shutdown_connections 2023-10-14T19:03:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 --2- 172.21.15.7:0/4022036213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff634159530 0x7ff6340ceba0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 --2- 172.21.15.7:0/4022036213 >> v2:172.21.15.148:3300/0 conn(0x7ff63406dc70 0x7ff634159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 -- 172.21.15.7:0/4022036213 >> 172.21.15.7:0/4022036213 conn(0x7ff6340703a0 msgr2=0x7ff6340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 -- 172.21.15.7:0/4022036213 shutdown_connections 2023-10-14T19:03:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.465+0000 7ff63c332700 1 -- 172.21.15.7:0/4022036213 wait complete. 2023-10-14T19:03:33.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.466+0000 7ff63c332700 1 Processor -- start 2023-10-14T19:03:33.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.466+0000 7ff63c332700 1 -- start start 2023-10-14T19:03:33.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.466+0000 7ff63c332700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff63406dc70 0x7ff6340b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 0x7ff63414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634159530 0x7ff6340c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634151250 con 0x7ff63406e0e0 2023-10-14T19:03:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340b39c0 con 0x7ff634159530 2023-10-14T19:03:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff634150640 con 0x7ff63406dc70 2023-10-14T19:03:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 0x7ff63414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 0x7ff63414c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58766/0 (socket says 172.21.15.7:58766) 2023-10-14T19:03:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 -- 172.21.15.7:0/2823337635 learned_addr learned my addr 172.21.15.7:0/2823337635 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63a0ce700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff63406dc70 0x7ff6340b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63a8cf700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634159530 0x7ff6340c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 -- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff63406dc70 msgr2=0x7ff6340b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff63406dc70 0x7ff6340b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 -- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634159530 msgr2=0x7ff6340c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634159530 0x7ff6340c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 -- 172.21.15.7:0/2823337635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0094f0 con 0x7ff63406e0e0 2023-10-14T19:03:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63a8cf700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634159530 0x7ff6340c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6398cd700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 0x7ff63414c2c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c860 tx=0x7ff628008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628011600 con 0x7ff63406e0e0 2023-10-14T19:03:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628011760 con 0x7ff63406e0e0 2023-10-14T19:03:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff634150920 con 0x7ff63406e0e0 2023-10-14T19:03:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628011b20 con 0x7ff63406e0e0 2023-10-14T19:03:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.467+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff634150ee0 con 0x7ff63406e0e0 2023-10-14T19:03:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.468+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63404c3c0 con 0x7ff63406e0e0 2023-10-14T19:03:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.469+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6280193b0 con 0x7ff63406e0e0 2023-10-14T19:03:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.469+0000 7ff6327fc700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.469+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6280845c0 con 0x7ff63406e0e0 2023-10-14T19:03:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.469+0000 7ff63a0ce700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.470+0000 7ff63a0ce700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6340b66e0 tx=0x7ff62c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.473+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff628051830 con 0x7ff63406e0e0 2023-10-14T19:03:33.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.668+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6341513c0 con 0x7ff63406e0e0 2023-10-14T19:03:33.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.668+0000 7ff6327fc700 1 -- 172.21.15.7:0/2823337635 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff628054e50 con 0x7ff63406e0e0 2023-10-14T19:03:33.668 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 msgr2=0x7ff6200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6340b66e0 tx=0x7ff62c016000 comp rx=0 tx=0).stop 2023-10-14T19:03:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 msgr2=0x7ff63414c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 0x7ff63414c2c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c860 tx=0x7ff628008040 comp rx=0 tx=0).stop 2023-10-14T19:03:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 shutdown_connections 2023-10-14T19:03:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634159530 0x7ff6340c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff63406dc70 0x7ff6340b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 --2- 172.21.15.7:0/2823337635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63406e0e0 0x7ff63414c2c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 >> 172.21.15.7:0/2823337635 conn(0x7ff6340703a0 msgr2=0x7ff6340d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 shutdown_connections 2023-10-14T19:03:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.670+0000 7ff63c332700 1 -- 172.21.15.7:0/2823337635 wait complete. 2023-10-14T19:03:33.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.805+0000 7fdfba1b6700 1 Processor -- start 2023-10-14T19:03:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.805+0000 7fdfba1b6700 1 -- start start 2023-10-14T19:03:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfba1b6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb4159530 0x7fdfb40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfba1b6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfb406dc70 0x7fdfb4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfba1b6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40ccfd0 con 0x7fdfb406e0e0 2023-10-14T19:03:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfba1b6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40cf0e0 con 0x7fdfb406dc70 2023-10-14T19:03:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfba1b6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb415a3d0 con 0x7fdfb4159530 2023-10-14T19:03:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfb406dc70 0x7fdfb4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb4159530 0x7fdfb40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb3fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdfb406e0e0 0x7fdfb40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:43912/0 (socket says 172.21.15.7:43912) 2023-10-14T19:03:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb3fff700 1 -- 172.21.15.7:0/3056404028 learned_addr learned my addr 172.21.15.7:0/3056404028 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfb406dc70 0x7fdfb4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:34324/0 (socket says 172.21.15.7:34324) 2023-10-14T19:03:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb2ffd700 1 -- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb4159530 msgr2=0x7fdfb40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb2ffd700 1 --2- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb4159530 0x7fdfb40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb2ffd700 1 -- 172.21.15.7:0/3056404028 >> v1:172.21.15.148:6789/0 conn(0x7fdfb406e0e0 legacy=0x7fdfb40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb2ffd700 1 -- 172.21.15.7:0/3056404028 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb415a6b0 con 0x7fdfb406dc70 2023-10-14T19:03:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.806+0000 7fdfb27fc700 1 -- 172.21.15.7:0/3056404028 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121829798 0 0) 0x7fdfb40ccfd0 con 0x7fdfb406e0e0 2023-10-14T19:03:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfb2ffd700 1 --2- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb406dc70 0x7fdfb4159900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0098e0 tx=0x7fdf9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4331c66764eb5a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfb27fc700 1 -- 172.21.15.7:0/3056404028 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00b640 con 0x7fdfb406dc70 2023-10-14T19:03:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfb27fc700 1 -- 172.21.15.7:0/3056404028 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00b7a0 con 0x7fdfb406dc70 2023-10-14T19:03:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfb27fc700 1 -- 172.21.15.7:0/3056404028 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00bb40 con 0x7fdfb406dc70 2023-10-14T19:03:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb406dc70 msgr2=0x7fdfb4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb406dc70 0x7fdfb4159900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0098e0 tx=0x7fdf9c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3056404028 shutdown_connections 2023-10-14T19:03:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb4159530 0x7fdfb40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3056404028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb406dc70 0x7fdfb4159900 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3056404028 >> 172.21.15.7:0/3056404028 conn(0x7fdfb40703a0 msgr2=0x7fdfb40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3056404028 shutdown_connections 2023-10-14T19:03:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.807+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3056404028 wait complete. 2023-10-14T19:03:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 Processor -- start 2023-10-14T19:03:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 -- start start 2023-10-14T19:03:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 0x7fdfb4155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb406e0e0 0x7fdfb416a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb4159530 0x7fdfb40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4155bd0 con 0x7fdfb406dc70 2023-10-14T19:03:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb416ac80 con 0x7fdfb4159530 2023-10-14T19:03:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfba1b6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40ca5f0 con 0x7fdfb406e0e0 2023-10-14T19:03:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 0x7fdfb4155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 0x7fdfb4155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58782/0 (socket says 172.21.15.7:58782) 2023-10-14T19:03:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.809+0000 7fdfb37fe700 1 -- 172.21.15.7:0/3868703442 learned_addr learned my addr 172.21.15.7:0/3868703442 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb2ffd700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb406e0e0 0x7fdfb416a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb3fff700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb4159530 0x7fdfb40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb37fe700 1 -- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb406e0e0 msgr2=0x7fdfb416a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb37fe700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb406e0e0 0x7fdfb416a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb37fe700 1 -- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb4159530 msgr2=0x7fdfb40ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb37fe700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb4159530 0x7fdfb40ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb37fe700 1 -- 172.21.15.7:0/3868703442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c009420 con 0x7fdfb406dc70 2023-10-14T19:03:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb2ffd700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb406e0e0 0x7fdfb416a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfb37fe700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 0x7fdfb4155690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009e80 tx=0x7fdfa400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400cc20 con 0x7fdfb406dc70 2023-10-14T19:03:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa400f040 con 0x7fdfb406dc70 2023-10-14T19:03:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb41569d0 con 0x7fdfb406dc70 2023-10-14T19:03:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4014480 con 0x7fdfb406dc70 2023-10-14T19:03:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.810+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb41560a0 con 0x7fdfb406dc70 2023-10-14T19:03:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.811+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb4156cb0 con 0x7fdfb406dc70 2023-10-14T19:03:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.812+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfa40147f0 con 0x7fdfb406dc70 2023-10-14T19:03:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.812+0000 7fdfab7fe700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.812+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfa4084f50 con 0x7fdfb406dc70 2023-10-14T19:03:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.812+0000 7fdfb2ffd700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.813+0000 7fdfb2ffd700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf94066f30 0x7fdf940693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0091e0 tx=0x7fdf9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:33.816+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfa40521c0 con 0x7fdfb406dc70 2023-10-14T19:03:34.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.009+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfb404c3c0 con 0x7fdfb406dc70 2023-10-14T19:03:34.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.010+0000 7fdfab7fe700 1 -- 172.21.15.7:0/3868703442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfa40557e0 con 0x7fdfb406dc70 2023-10-14T19:03:34.010 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:34.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf94066f30 msgr2=0x7fdf940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf94066f30 0x7fdf940693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0091e0 tx=0x7fdf9c017000 comp rx=0 tx=0).stop 2023-10-14T19:03:34.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 msgr2=0x7fdfb4155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 0x7fdfb4155690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009e80 tx=0x7fdfa400b040 comp rx=0 tx=0).stop 2023-10-14T19:03:34.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 shutdown_connections 2023-10-14T19:03:34.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfb4159530 0x7fdfb40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb406dc70 0x7fdfb4155690 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 --2- 172.21.15.7:0/3868703442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfb406e0e0 0x7fdfb416a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 >> 172.21.15.7:0/3868703442 conn(0x7fdfb40703a0 msgr2=0x7fdfb40cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 shutdown_connections 2023-10-14T19:03:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.012+0000 7fdfba1b6700 1 -- 172.21.15.7:0/3868703442 wait complete. 2023-10-14T19:03:34.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.147+0000 7f12c5893700 1 Processor -- start 2023-10-14T19:03:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.147+0000 7f12c5893700 1 -- start start 2023-10-14T19:03:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12c5893700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f12c01594d0 0x7f12c00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12c5893700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 0x7f12c00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12c5893700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c015e010 con 0x7f12c00cb1a0 2023-10-14T19:03:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12c5893700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c015d420 con 0x7f12c01594d0 2023-10-14T19:03:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12c5893700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c015d6e0 con 0x7f12c01598a0 2023-10-14T19:03:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12be7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f12c00cb1a0 0x7f12c00ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45032/0 (socket says 172.21.15.7:45032) 2023-10-14T19:03:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12be7fc700 1 -- 172.21.15.7:0/2545556772 learned_addr learned my addr 172.21.15.7:0/2545556772 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12beffd700 1 --2- 172.21.15.7:0/2545556772 >> v2:172.21.15.148:3300/0 conn(0x7f12c01594d0 0x7f12c00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 0x7f12c00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477587930 0 0) 0x7f12c015e010 con 0x7f12c00cb1a0 2023-10-14T19:03:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ac003570 con 0x7f12c00cb1a0 2023-10-14T19:03:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958275458 0 0) 0x7f12ac003570 con 0x7f12c00cb1a0 2023-10-14T19:03:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 msgr2=0x7f12c00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.148+0000 7f12bdffb700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 0x7f12c00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 >> v2:172.21.15.148:3300/0 conn(0x7f12c01594d0 msgr2=0x7f12c00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 --2- 172.21.15.7:0/2545556772 >> v2:172.21.15.148:3300/0 conn(0x7f12c01594d0 0x7f12c00cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c015d9c0 con 0x7f12c00cb1a0 2023-10-14T19:03:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f12a8001470 con 0x7f12c00cb1a0 2023-10-14T19:03:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12beffd700 1 --2- 172.21.15.7:0/2545556772 >> v2:172.21.15.148:3300/0 conn(0x7f12c01594d0 0x7f12c00cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 >> v1:172.21.15.7:6789/0 conn(0x7f12c00cb1a0 legacy=0x7f12c00ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12ac003a60 0x7f12ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 0x7f12ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac004d50 0x7f12ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c015d420 con 0x7f12ac004d50 2023-10-14T19:03:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c015d6e0 con 0x7f12ac003a60 2023-10-14T19:03:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac00ba60 con 0x7f12c01598a0 2023-10-14T19:03:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac004d50 0x7f12ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12be7fc700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 0x7f12ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12beffd700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12ac003a60 0x7f12ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 -- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 msgr2=0x7f12ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c01598a0 0x7f12ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 -- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12ac003a60 msgr2=0x7f12ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12ac003a60 0x7f12ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 -- 172.21.15.7:0/2545556772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac003570 con 0x7f12ac004d50 2023-10-14T19:03:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac004d50 0x7f12ac0051c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12b000e1c0 tx=0x7f12b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6616a004166dfe1e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000ea10 con 0x7f12ac004d50 2023-10-14T19:03:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b000f040 con 0x7f12ac004d50 2023-10-14T19:03:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.149+0000 7f12bdffb700 1 -- 172.21.15.7:0/2545556772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000edc0 con 0x7f12ac004d50 2023-10-14T19:03:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12c5893700 1 -- 172.21.15.7:0/2545556772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac004d50 msgr2=0x7f12ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12c5893700 1 --2- 172.21.15.7:0/2545556772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac004d50 0x7f12ac0051c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12b000e1c0 tx=0x7f12b000b040 comp rx=0 tx=0).stop 2023-10-14T19:03:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12bf7fe700 1 -- 172.21.15.7:0/2545556772 reap_dead start 2023-10-14T19:03:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12c5893700 1 -- 172.21.15.7:0/2545556772 shutdown_connections 2023-10-14T19:03:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12c5893700 1 -- 172.21.15.7:0/2545556772 >> 172.21.15.7:0/2545556772 conn(0x7f12c00703a0 msgr2=0x7f12c0070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12c5893700 1 -- 172.21.15.7:0/2545556772 shutdown_connections 2023-10-14T19:03:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.150+0000 7f12c5893700 1 -- 172.21.15.7:0/2545556772 wait complete. 2023-10-14T19:03:34.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.151+0000 7f12c5893700 1 Processor -- start 2023-10-14T19:03:34.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.151+0000 7f12c5893700 1 -- start start 2023-10-14T19:03:34.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12c5893700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c0142ce0 0x7f12c00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12c5893700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 0x7f12c00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12c5893700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c00b0e30 0x7f12c00b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12c5893700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00c7fc0 con 0x7f12c01430b0 2023-10-14T19:03:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12c5893700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00b38e0 con 0x7f12c0142ce0 2023-10-14T19:03:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12c5893700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00c76b0 con 0x7f12c00b0e30 2023-10-14T19:03:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 0x7f12c00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 0x7f12c00b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58806/0 (socket says 172.21.15.7:58806) 2023-10-14T19:03:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 -- 172.21.15.7:0/632077946 learned_addr learned my addr 172.21.15.7:0/632077946 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12beffd700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c0142ce0 0x7f12c00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c00b0e30 0x7f12c00b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 -- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c00b0e30 msgr2=0x7f12c00b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c00b0e30 0x7f12c00b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 -- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c0142ce0 msgr2=0x7f12c00b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c0142ce0 0x7f12c00b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 -- 172.21.15.7:0/632077946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00b60b0 con 0x7f12c01430b0 2023-10-14T19:03:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12bf7fe700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c00b0e30 0x7f12c00b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.152+0000 7f12be7fc700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 0x7f12c00b08f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f12a80079e0 tx=0x7f12a8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.153+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8018030 con 0x7f12c01430b0 2023-10-14T19:03:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.153+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a800f9d0 con 0x7f12c01430b0 2023-10-14T19:03:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.153+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c00c7900 con 0x7f12c01430b0 2023-10-14T19:03:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.153+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800fd70 con 0x7f12c01430b0 2023-10-14T19:03:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.153+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c00b4de0 con 0x7f12c01430b0 2023-10-14T19:03:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.154+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c004c3c0 con 0x7f12c01430b0 2023-10-14T19:03:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.154+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12a801b070 con 0x7f12c01430b0 2023-10-14T19:03:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.154+0000 7f12b6ffd700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12a0066f30 0x7f12a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.155+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12a8019070 con 0x7f12c01430b0 2023-10-14T19:03:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.155+0000 7f12beffd700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12a0066f30 0x7f12a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.155+0000 7f12beffd700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12a0066f30 0x7f12a00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12c00ca0a0 tx=0x7f12b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.159+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a8051940 con 0x7f12c01430b0 2023-10-14T19:03:34.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.353+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12c015dca0 con 0x7f12c01430b0 2023-10-14T19:03:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.354+0000 7f12b6ffd700 1 -- 172.21.15.7:0/632077946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12a8054f60 con 0x7f12c01430b0 2023-10-14T19:03:34.354 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12a0066f30 msgr2=0x7f12a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12a0066f30 0x7f12a00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12c00ca0a0 tx=0x7f12b8008040 comp rx=0 tx=0).stop 2023-10-14T19:03:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 msgr2=0x7f12c00b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 0x7f12c00b08f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f12a80079e0 tx=0x7f12a8001e90 comp rx=0 tx=0).stop 2023-10-14T19:03:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 shutdown_connections 2023-10-14T19:03:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12a0066f30 0x7f12a00693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c0142ce0 0x7f12c00b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12c00b0e30 0x7f12c00b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 --2- 172.21.15.7:0/632077946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12c01430b0 0x7f12c00b08f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 >> 172.21.15.7:0/632077946 conn(0x7f12c00703a0 msgr2=0x7f12c00ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 shutdown_connections 2023-10-14T19:03:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.356+0000 7f12c5893700 1 -- 172.21.15.7:0/632077946 wait complete. 2023-10-14T19:03:34.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:34.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.487+0000 7fea77b62700 1 Processor -- start 2023-10-14T19:03:34.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.487+0000 7fea77b62700 1 -- start start 2023-10-14T19:03:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea77b62700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea700cb5a0 0x7fea700cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea77b62700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 0x7fea70156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea77b62700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7015ae40 con 0x7fea700cd9e0 2023-10-14T19:03:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea77b62700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea700d13f0 con 0x7fea700cb5a0 2023-10-14T19:03:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea77b62700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7015ab60 con 0x7fea7015a5d0 2023-10-14T19:03:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea750fd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fea700cd9e0 0x7fea70159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45046/0 (socket says 172.21.15.7:45046) 2023-10-14T19:03:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea750fd700 1 -- 172.21.15.7:0/3634578796 learned_addr learned my addr 172.21.15.7:0/3634578796 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea758fe700 1 --2- 172.21.15.7:0/3634578796 >> v2:172.21.15.148:3300/0 conn(0x7fea700cb5a0 0x7fea700cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155150892 0 0) 0x7fea7015ae40 con 0x7fea700cd9e0 2023-10-14T19:03:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.488+0000 7fea760ff700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 0x7fea70156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea58003570 con 0x7fea700cd9e0 2023-10-14T19:03:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 680974469 0 0) 0x7fea58003570 con 0x7fea700cd9e0 2023-10-14T19:03:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 msgr2=0x7fea70156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 0x7fea70156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 >> v2:172.21.15.148:3300/0 conn(0x7fea700cb5a0 msgr2=0x7fea700cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 --2- 172.21.15.7:0/3634578796 >> v2:172.21.15.148:3300/0 conn(0x7fea700cb5a0 0x7fea700cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea700ccf00 con 0x7fea700cd9e0 2023-10-14T19:03:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fea64001470 con 0x7fea700cd9e0 2023-10-14T19:03:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 >> v1:172.21.15.7:6789/0 conn(0x7fea700cd9e0 legacy=0x7fea70159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea58003a60 0x7fea58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 0x7fea58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58004d50 0x7fea580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7015ab60 con 0x7fea58003a60 2023-10-14T19:03:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5800ba60 con 0x7fea58004d50 2023-10-14T19:03:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5800bba0 con 0x7fea7015a5d0 2023-10-14T19:03:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea58003a60 0x7fea58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea750fd700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 0x7fea58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea760ff700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58004d50 0x7fea580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 -- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 msgr2=0x7fea58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea7015a5d0 0x7fea58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 -- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58004d50 msgr2=0x7fea580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58004d50 0x7fea580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 -- 172.21.15.7:0/3634578796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58003570 con 0x7fea58003a60 2023-10-14T19:03:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea760ff700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58004d50 0x7fea580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.489+0000 7fea758fe700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea58003a60 0x7fea58003e70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea68009c00 tx=0x7fea680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a61ed7e5cdc738 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6800e6b0 con 0x7fea58003a60 2023-10-14T19:03:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6800e810 con 0x7fea58003a60 2023-10-14T19:03:34.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea748fc700 1 -- 172.21.15.7:0/3634578796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6800ebd0 con 0x7fea58003a60 2023-10-14T19:03:34.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea77b62700 1 -- 172.21.15.7:0/3634578796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea58003a60 msgr2=0x7fea58003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea77b62700 1 --2- 172.21.15.7:0/3634578796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea58003a60 0x7fea58003e70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea68009c00 tx=0x7fea680091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea760ff700 1 -- 172.21.15.7:0/3634578796 reap_dead start 2023-10-14T19:03:34.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea77b62700 1 -- 172.21.15.7:0/3634578796 shutdown_connections 2023-10-14T19:03:34.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea77b62700 1 -- 172.21.15.7:0/3634578796 >> 172.21.15.7:0/3634578796 conn(0x7fea70070e30 msgr2=0x7fea700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:34.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea77b62700 1 -- 172.21.15.7:0/3634578796 shutdown_connections 2023-10-14T19:03:34.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.490+0000 7fea77b62700 1 -- 172.21.15.7:0/3634578796 wait complete. 2023-10-14T19:03:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.491+0000 7fea77b62700 1 Processor -- start 2023-10-14T19:03:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.491+0000 7fea77b62700 1 -- start start 2023-10-14T19:03:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea77b62700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58003a60 0x7fea70150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea77b62700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea70154c70 0x7fea70157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea77b62700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 0x7fea700c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea77b62700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea70157ea0 con 0x7fea70157a40 2023-10-14T19:03:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea77b62700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea70155c70 con 0x7fea58003a60 2023-10-14T19:03:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea77b62700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea701550f0 con 0x7fea70154c70 2023-10-14T19:03:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 0x7fea700c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 0x7fea700c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58818/0 (socket says 172.21.15.7:58818) 2023-10-14T19:03:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 -- 172.21.15.7:0/273916010 learned_addr learned my addr 172.21.15.7:0/273916010 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea750fd700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea70154c70 0x7fea70157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea758fe700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58003a60 0x7fea70150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 -- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea70154c70 msgr2=0x7fea70157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea70154c70 0x7fea70157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 -- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58003a60 msgr2=0x7fea70150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58003a60 0x7fea70150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.492+0000 7fea760ff700 1 -- 172.21.15.7:0/273916010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea701553d0 con 0x7fea70157a40 2023-10-14T19:03:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.493+0000 7fea760ff700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 0x7fea700c7b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fea700cbeb0 tx=0x7fea6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.493+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000e050 con 0x7fea70157a40 2023-10-14T19:03:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.493+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6000f040 con 0x7fea70157a40 2023-10-14T19:03:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.493+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea701556b0 con 0x7fea70157a40 2023-10-14T19:03:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.493+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60010ec0 con 0x7fea70157a40 2023-10-14T19:03:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.493+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea70150980 con 0x7fea70157a40 2023-10-14T19:03:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.494+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea700c7850 con 0x7fea70157a40 2023-10-14T19:03:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.494+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea60003020 con 0x7fea70157a40 2023-10-14T19:03:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.495+0000 7fea6dffb700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea5c066f30 0x7fea5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.495+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea60084cb0 con 0x7fea70157a40 2023-10-14T19:03:34.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.495+0000 7fea758fe700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea5c066f30 0x7fea5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.495+0000 7fea758fe700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea5c066f30 0x7fea5c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea680091e0 tx=0x7fea6801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.499+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea700c7850 con 0x7fea70157a40 2023-10-14T19:03:34.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.692+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea700c7850 con 0x7fea70157a40 2023-10-14T19:03:34.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.693+0000 7fea6dffb700 1 -- 172.21.15.7:0/273916010 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fea700c7850 con 0x7fea70157a40 2023-10-14T19:03:34.693 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:34.693 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:34.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea5c066f30 msgr2=0x7fea5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea5c066f30 0x7fea5c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea680091e0 tx=0x7fea6801a000 comp rx=0 tx=0).stop 2023-10-14T19:03:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 msgr2=0x7fea700c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 0x7fea700c7b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fea700cbeb0 tx=0x7fea6000b040 comp rx=0 tx=0).stop 2023-10-14T19:03:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 shutdown_connections 2023-10-14T19:03:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea5c066f30 0x7fea5c0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea58003a60 0x7fea70150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea70157a40 0x7fea700c7b30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 --2- 172.21.15.7:0/273916010 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea70154c70 0x7fea70157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 >> 172.21.15.7:0/273916010 conn(0x7fea70070e30 msgr2=0x7fea700b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 shutdown_connections 2023-10-14T19:03:34.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.695+0000 7fea77b62700 1 -- 172.21.15.7:0/273916010 wait complete. 2023-10-14T19:03:34.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:34.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:34.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.830+0000 7fec2b2d3700 1 Processor -- start 2023-10-14T19:03:34.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec2b2d3700 1 -- start start 2023-10-14T19:03:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec2b2d3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fec241598c0 0x7fec240c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec2b2d3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fec240cdb70 0x7fec240c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec2b2d3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240c9310 con 0x7fec24159c90 2023-10-14T19:03:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec2b2d3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240ad990 con 0x7fec240cdb70 2023-10-14T19:03:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec2b2d3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240ce090 con 0x7fec241598c0 2023-10-14T19:03:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.831+0000 7fec29870700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fec240cdb70 0x7fec240c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec2886e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fec24159c90 0x7fec240cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45056/0 (socket says 172.21.15.7:45056) 2023-10-14T19:03:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec2886e700 1 -- 172.21.15.7:0/3248611546 learned_addr learned my addr 172.21.15.7:0/3248611546 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec2906f700 1 --2- 172.21.15.7:0/3248611546 >> v2:172.21.15.148:3300/0 conn(0x7fec241598c0 0x7fec240c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec29870700 1 -- 172.21.15.7:0/3248611546 >> v2:172.21.15.148:3300/0 conn(0x7fec241598c0 msgr2=0x7fec240c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec29870700 1 --2- 172.21.15.7:0/3248611546 >> v2:172.21.15.148:3300/0 conn(0x7fec241598c0 0x7fec240c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec29870700 1 -- 172.21.15.7:0/3248611546 >> v1:172.21.15.7:6789/0 conn(0x7fec24159c90 legacy=0x7fec240cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec29870700 1 -- 172.21.15.7:0/3248611546 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240c8cc0 con 0x7fec240cdb70 2023-10-14T19:03:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec23fff700 1 -- 172.21.15.7:0/3248611546 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663698911 0 0) 0x7fec240c9310 con 0x7fec24159c90 2023-10-14T19:03:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec29870700 1 --2- 172.21.15.7:0/3248611546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec240cdb70 0x7fec240c43b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec2406ab90 tx=0x7fec14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a01c2c16b2db9f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec23fff700 1 -- 172.21.15.7:0/3248611546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400e070 con 0x7fec240cdb70 2023-10-14T19:03:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec23fff700 1 -- 172.21.15.7:0/3248611546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400bb60 con 0x7fec240cdb70 2023-10-14T19:03:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.832+0000 7fec23fff700 1 -- 172.21.15.7:0/3248611546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14012430 con 0x7fec240cdb70 2023-10-14T19:03:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 -- 172.21.15.7:0/3248611546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec240cdb70 msgr2=0x7fec240c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/3248611546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec240cdb70 0x7fec240c43b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec2406ab90 tx=0x7fec14009780 comp rx=0 tx=0).stop 2023-10-14T19:03:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 -- 172.21.15.7:0/3248611546 shutdown_connections 2023-10-14T19:03:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/3248611546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec240cdb70 0x7fec240c43b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/3248611546 >> v2:172.21.15.148:3300/0 conn(0x7fec241598c0 0x7fec240c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 -- 172.21.15.7:0/3248611546 >> 172.21.15.7:0/3248611546 conn(0x7fec24088000 msgr2=0x7fec240883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 -- 172.21.15.7:0/3248611546 shutdown_connections 2023-10-14T19:03:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.833+0000 7fec2b2d3700 1 -- 172.21.15.7:0/3248611546 wait complete. 2023-10-14T19:03:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.834+0000 7fec2b2d3700 1 Processor -- start 2023-10-14T19:03:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.834+0000 7fec2b2d3700 1 -- start start 2023-10-14T19:03:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2b2d3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240cdb70 0x7fec2415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2b2d3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 0x7fec2415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2b2d3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec24159c90 0x7fec241563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2b2d3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2415b1e0 con 0x7fec241598c0 2023-10-14T19:03:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2b2d3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240b1c70 con 0x7fec24159c90 2023-10-14T19:03:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2b2d3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2415cc00 con 0x7fec240cdb70 2023-10-14T19:03:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 0x7fec2415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 0x7fec2415c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58822/0 (socket says 172.21.15.7:58822) 2023-10-14T19:03:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 -- 172.21.15.7:0/790710079 learned_addr learned my addr 172.21.15.7:0/790710079 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec29870700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec24159c90 0x7fec241563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2906f700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240cdb70 0x7fec2415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 -- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240cdb70 msgr2=0x7fec2415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240cdb70 0x7fec2415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 -- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec24159c90 msgr2=0x7fec241563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:34.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec24159c90 0x7fec241563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:34.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 -- 172.21.15.7:0/790710079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009a20 con 0x7fec241598c0 2023-10-14T19:03:34.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec29870700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec24159c90 0x7fec241563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:34.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.835+0000 7fec2886e700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 0x7fec2415c6c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c810 tx=0x7fec18007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.836+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18005b30 con 0x7fec241598c0 2023-10-14T19:03:34.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.836+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18005c90 con 0x7fec241598c0 2023-10-14T19:03:34.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.836+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec240c55b0 con 0x7fec241598c0 2023-10-14T19:03:34.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.836+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18007300 con 0x7fec241598c0 2023-10-14T19:03:34.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.836+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2415cf00 con 0x7fec241598c0 2023-10-14T19:03:34.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.836+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec240b1e20 con 0x7fec241598c0 2023-10-14T19:03:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.837+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec180076b0 con 0x7fec241598c0 2023-10-14T19:03:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.837+0000 7fec217fa700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec10066f30 0x7fec100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.837+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec18084030 con 0x7fec241598c0 2023-10-14T19:03:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.838+0000 7fec2906f700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec10066f30 0x7fec100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.838+0000 7fec2906f700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec10066f30 0x7fec100693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009d40 tx=0x7fec1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:34.842+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec240b1e20 con 0x7fec241598c0 2023-10-14T19:03:35.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.035+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec240b1e20 con 0x7fec241598c0 2023-10-14T19:03:35.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.035+0000 7fec217fa700 1 -- 172.21.15.7:0/790710079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec240b1e20 con 0x7fec241598c0 2023-10-14T19:03:35.035 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec10066f30 msgr2=0x7fec100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec10066f30 0x7fec100693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009d40 tx=0x7fec1c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 msgr2=0x7fec2415c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 0x7fec2415c6c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c810 tx=0x7fec18007df0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 shutdown_connections 2023-10-14T19:03:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec10066f30 0x7fec100693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec24159c90 0x7fec241563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240cdb70 0x7fec2415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 --2- 172.21.15.7:0/790710079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec241598c0 0x7fec2415c6c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 >> 172.21.15.7:0/790710079 conn(0x7fec24088000 msgr2=0x7fec240cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 shutdown_connections 2023-10-14T19:03:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.037+0000 7fec2b2d3700 1 -- 172.21.15.7:0/790710079 wait complete. 2023-10-14T19:03:35.049 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.171+0000 7f4b274fb700 1 Processor -- start 2023-10-14T19:03:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.172+0000 7f4b274fb700 1 -- start start 2023-10-14T19:03:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.172+0000 7f4b274fb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b20159530 0x7f4b200ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.172+0000 7f4b274fb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4b2006dc70 0x7f4b20159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b274fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b274fb700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200ccfd0 con 0x7f4b20159530 2023-10-14T19:03:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b274fb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200cf0e0 con 0x7f4b2006dc70 2023-10-14T19:03:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b274fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015a3d0 con 0x7f4b2006e0e0 2023-10-14T19:03:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b20159530 0x7f4b200ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b20159530 0x7f4b200ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58828/0 (socket says 172.21.15.7:58828) 2023-10-14T19:03:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 -- 172.21.15.7:0/1887695905 learned_addr learned my addr 172.21.15.7:0/1887695905 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b24a96700 1 --2- 172.21.15.7:0/1887695905 >> v2:172.21.15.148:3300/0 conn(0x7f4b2006dc70 0x7f4b20159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25a98700 1 --2- 172.21.15.7:0/1887695905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 -- 172.21.15.7:0/1887695905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 msgr2=0x7f4b200cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 --2- 172.21.15.7:0/1887695905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b200cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 -- 172.21.15.7:0/1887695905 >> v2:172.21.15.148:3300/0 conn(0x7f4b2006dc70 msgr2=0x7f4b20159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 --2- 172.21.15.7:0/1887695905 >> v2:172.21.15.148:3300/0 conn(0x7f4b2006dc70 0x7f4b20159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 -- 172.21.15.7:0/1887695905 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2015a6b0 con 0x7f4b20159530 2023-10-14T19:03:35.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b25297700 1 --2- 172.21.15.7:0/1887695905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b20159530 0x7f4b200ceba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b200b66e0 tx=0x7f4b18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663cf545bf2327b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b1ffff700 1 -- 172.21.15.7:0/1887695905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800b860 con 0x7f4b20159530 2023-10-14T19:03:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b1ffff700 1 -- 172.21.15.7:0/1887695905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800b9c0 con 0x7f4b20159530 2023-10-14T19:03:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.173+0000 7f4b1ffff700 1 -- 172.21.15.7:0/1887695905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800bd60 con 0x7f4b20159530 2023-10-14T19:03:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 -- 172.21.15.7:0/1887695905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b20159530 msgr2=0x7f4b200ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 --2- 172.21.15.7:0/1887695905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b20159530 0x7f4b200ceba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b200b66e0 tx=0x7f4b18009250 comp rx=0 tx=0).stop 2023-10-14T19:03:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 -- 172.21.15.7:0/1887695905 shutdown_connections 2023-10-14T19:03:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 --2- 172.21.15.7:0/1887695905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b200cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 --2- 172.21.15.7:0/1887695905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b20159530 0x7f4b200ceba0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 --2- 172.21.15.7:0/1887695905 >> v2:172.21.15.148:3300/0 conn(0x7f4b2006dc70 0x7f4b20159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 -- 172.21.15.7:0/1887695905 >> 172.21.15.7:0/1887695905 conn(0x7f4b200703a0 msgr2=0x7f4b200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 -- 172.21.15.7:0/1887695905 shutdown_connections 2023-10-14T19:03:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.174+0000 7f4b274fb700 1 -- 172.21.15.7:0/1887695905 wait complete. 2023-10-14T19:03:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.175+0000 7f4b274fb700 1 Processor -- start 2023-10-14T19:03:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.175+0000 7f4b274fb700 1 -- start start 2023-10-14T19:03:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b274fb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 0x7f4b200ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b274fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b20151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b274fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b20159530 0x7f4b200c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b274fb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015e700 con 0x7f4b2006dc70 2023-10-14T19:03:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b274fb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200ca5e0 con 0x7f4b20159530 2023-10-14T19:03:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b274fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c8920 con 0x7f4b2006e0e0 2023-10-14T19:03:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 0x7f4b200ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 0x7f4b200ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58836/0 (socket says 172.21.15.7:58836) 2023-10-14T19:03:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 -- 172.21.15.7:0/508854566 learned_addr learned my addr 172.21.15.7:0/508854566 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25a98700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b20159530 0x7f4b200c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b24a96700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b20151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 -- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 msgr2=0x7f4b20151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b20151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 -- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b20159530 msgr2=0x7f4b200c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b20159530 0x7f4b200c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b25297700 1 -- 172.21.15.7:0/508854566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180094f0 con 0x7f4b2006dc70 2023-10-14T19:03:35.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.176+0000 7f4b24a96700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b20151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:35.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.177+0000 7f4b25297700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 0x7f4b200ca0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b18006fd0 tx=0x7f4b18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.177+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18024440 con 0x7f4b2006dc70 2023-10-14T19:03:35.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.177+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b180245a0 con 0x7f4b2006dc70 2023-10-14T19:03:35.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.177+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2015ddd0 con 0x7f4b2006dc70 2023-10-14T19:03:35.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.177+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18024960 con 0x7f4b2006dc70 2023-10-14T19:03:35.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.177+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2015e390 con 0x7f4b2006dc70 2023-10-14T19:03:35.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.178+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2004c3c0 con 0x7f4b2006dc70 2023-10-14T19:03:35.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.178+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b1801a420 con 0x7f4b2006dc70 2023-10-14T19:03:35.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.179+0000 7f4b1d7fa700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4b0c066f30 0x7f4b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.179+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b18086310 con 0x7f4b2006dc70 2023-10-14T19:03:35.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.179+0000 7f4b24a96700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4b0c066f30 0x7f4b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.179+0000 7f4b24a96700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4b0c066f30 0x7f4b0c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b14006fd0 tx=0x7f4b14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.183+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b18053580 con 0x7f4b2006dc70 2023-10-14T19:03:35.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.377+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b2015a990 con 0x7f4b2006dc70 2023-10-14T19:03:35.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.377+0000 7f4b1d7fa700 1 -- 172.21.15.7:0/508854566 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b18056ba0 con 0x7f4b2006dc70 2023-10-14T19:03:35.378 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4b0c066f30 msgr2=0x7f4b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4b0c066f30 0x7f4b0c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b14006fd0 tx=0x7f4b14008040 comp rx=0 tx=0).stop 2023-10-14T19:03:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 msgr2=0x7f4b200ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 0x7f4b200ca0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b18006fd0 tx=0x7f4b18017000 comp rx=0 tx=0).stop 2023-10-14T19:03:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 shutdown_connections 2023-10-14T19:03:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4b0c066f30 0x7f4b0c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b20159530 0x7f4b200c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b2006dc70 0x7f4b200ca0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 --2- 172.21.15.7:0/508854566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b2006e0e0 0x7f4b20151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 >> 172.21.15.7:0/508854566 conn(0x7f4b200703a0 msgr2=0x7f4b200b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 shutdown_connections 2023-10-14T19:03:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.379+0000 7f4b274fb700 1 -- 172.21.15.7:0/508854566 wait complete. 2023-10-14T19:03:35.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 Processor -- start 2023-10-14T19:03:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 -- start start 2023-10-14T19:03:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb82c06dc70 0x7fb82c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c0ccfd0 con 0x7fb82c159530 2023-10-14T19:03:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c15a3d0 con 0x7fb82c06dc70 2023-10-14T19:03:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.514+0000 7fb8326e5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c15a6b0 con 0x7fb82c06e0e0 2023-10-14T19:03:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb82c06dc70 0x7fb82c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb830c82700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb82c159530 0x7fb82c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:43914/0 (socket says 172.21.15.7:43914) 2023-10-14T19:03:35.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82bfff700 1 -- 172.21.15.7:0/3510970693 learned_addr learned my addr 172.21.15.7:0/3510970693 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:35.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82b7fe700 1 -- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 msgr2=0x7fb82c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:35.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82b7fe700 1 --2- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82b7fe700 1 -- 172.21.15.7:0/3510970693 >> v1:172.21.15.148:6789/0 conn(0x7fb82c159530 legacy=0x7fb82c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82affd700 1 -- 172.21.15.7:0/3510970693 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693226467 0 0) 0x7fb82c0ccfd0 con 0x7fb82c159530 2023-10-14T19:03:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82b7fe700 1 -- 172.21.15.7:0/3510970693 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c15a990 con 0x7fb82c06dc70 2023-10-14T19:03:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.515+0000 7fb82b7fe700 1 --2- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c06dc70 0x7fb82c159900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0098e0 tx=0x7fb81c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75c7bf7542b83986 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb82affd700 1 -- 172.21.15.7:0/3510970693 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00b640 con 0x7fb82c06dc70 2023-10-14T19:03:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb82affd700 1 -- 172.21.15.7:0/3510970693 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00b7a0 con 0x7fb82c06dc70 2023-10-14T19:03:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb82affd700 1 -- 172.21.15.7:0/3510970693 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00bb40 con 0x7fb82c06dc70 2023-10-14T19:03:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 -- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c06dc70 msgr2=0x7fb82c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 --2- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c06dc70 0x7fb82c159900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0098e0 tx=0x7fb81c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 -- 172.21.15.7:0/3510970693 shutdown_connections 2023-10-14T19:03:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 --2- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 --2- 172.21.15.7:0/3510970693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c06dc70 0x7fb82c159900 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 -- 172.21.15.7:0/3510970693 >> 172.21.15.7:0/3510970693 conn(0x7fb82c0703a0 msgr2=0x7fb82c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 -- 172.21.15.7:0/3510970693 shutdown_connections 2023-10-14T19:03:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.516+0000 7fb8326e5700 1 -- 172.21.15.7:0/3510970693 wait complete. 2023-10-14T19:03:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.517+0000 7fb8326e5700 1 Processor -- start 2023-10-14T19:03:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.517+0000 7fb8326e5700 1 -- start start 2023-10-14T19:03:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb8326e5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 0x7fb82c16a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb8326e5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb8326e5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c159530 0x7fb82c0b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb8326e5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0b4960 con 0x7fb82c06dc70 2023-10-14T19:03:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb8326e5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c16acc0 con 0x7fb82c159530 2023-10-14T19:03:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb8326e5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0b3a40 con 0x7fb82c06e0e0 2023-10-14T19:03:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 0x7fb82c16a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 0x7fb82c16a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58844/0 (socket says 172.21.15.7:58844) 2023-10-14T19:03:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb82bfff700 1 -- 172.21.15.7:0/789209391 learned_addr learned my addr 172.21.15.7:0/789209391 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.518+0000 7fb830c82700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c159530 0x7fb82c0b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82b7fe700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82bfff700 1 -- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 msgr2=0x7fb82c0b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82bfff700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82bfff700 1 -- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c159530 msgr2=0x7fb82c0b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82bfff700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c159530 0x7fb82c0b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82bfff700 1 -- 172.21.15.7:0/789209391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009420 con 0x7fb82c06dc70 2023-10-14T19:03:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb82bfff700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 0x7fb82c16a780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c5b0 tx=0x7fb814001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814005b30 con 0x7fb82c06dc70 2023-10-14T19:03:35.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb814005c90 con 0x7fb82c06dc70 2023-10-14T19:03:35.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c0b3d20 con 0x7fb82c06dc70 2023-10-14T19:03:35.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814007300 con 0x7fb82c06dc70 2023-10-14T19:03:35.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.519+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c0b42e0 con 0x7fb82c06dc70 2023-10-14T19:03:35.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.520+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c071110 con 0x7fb82c06dc70 2023-10-14T19:03:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.520+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb81401b3b0 con 0x7fb82c06dc70 2023-10-14T19:03:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.521+0000 7fb823fff700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb80c066f30 0x7fb80c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.521+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb814083a60 con 0x7fb82c06dc70 2023-10-14T19:03:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.521+0000 7fb82b7fe700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb80c066f30 0x7fb80c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.522+0000 7fb82b7fe700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb80c066f30 0x7fb80c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb82c153fc0 tx=0x7fb81c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.525+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb814050cd0 con 0x7fb82c06dc70 2023-10-14T19:03:35.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.715+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb82c04c3c0 con 0x7fb82c06dc70 2023-10-14T19:03:35.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.715+0000 7fb823fff700 1 -- 172.21.15.7:0/789209391 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8140170a0 con 0x7fb82c06dc70 2023-10-14T19:03:35.716 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb80c066f30 msgr2=0x7fb80c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb80c066f30 0x7fb80c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb82c153fc0 tx=0x7fb81c017000 comp rx=0 tx=0).stop 2023-10-14T19:03:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 msgr2=0x7fb82c16a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 0x7fb82c16a780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c5b0 tx=0x7fb814001070 comp rx=0 tx=0).stop 2023-10-14T19:03:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 shutdown_connections 2023-10-14T19:03:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb80c066f30 0x7fb80c0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb82c159530 0x7fb82c0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82c06dc70 0x7fb82c16a780 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 --2- 172.21.15.7:0/789209391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb82c06e0e0 0x7fb82c0b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 >> 172.21.15.7:0/789209391 conn(0x7fb82c0703a0 msgr2=0x7fb82c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 shutdown_connections 2023-10-14T19:03:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.717+0000 7fb8326e5700 1 -- 172.21.15.7:0/789209391 wait complete. 2023-10-14T19:03:35.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.849+0000 7f9676351700 1 Processor -- start 2023-10-14T19:03:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f9676351700 1 -- start start 2023-10-14T19:03:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f9676351700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96700a8be0 0x7f96700a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f9676351700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96700aee90 0x7f96700b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f9676351700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700ce1a0 con 0x7f967006d280 2023-10-14T19:03:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f9676351700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96700cd5d0 con 0x7f96700aee90 2023-10-14T19:03:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f9676351700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700cd870 con 0x7f96700a8be0 2023-10-14T19:03:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f96748ee700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96700aee90 0x7f96700b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f96748ee700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96700aee90 0x7f96700b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58848/0 (socket says 172.21.15.7:58848) 2023-10-14T19:03:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.850+0000 7f96748ee700 1 -- 172.21.15.7:0/3494193673 learned_addr learned my addr 172.21.15.7:0/3494193673 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f966ffff700 1 --2- 172.21.15.7:0/3494193673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96700a8be0 0x7f96700a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f96748ee700 1 -- 172.21.15.7:0/3494193673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96700a8be0 msgr2=0x7f96700a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f96748ee700 1 --2- 172.21.15.7:0/3494193673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96700a8be0 0x7f96700a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f96748ee700 1 -- 172.21.15.7:0/3494193673 >> v1:172.21.15.148:6789/0 conn(0x7f967006d280 legacy=0x7f96700ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f96748ee700 1 -- 172.21.15.7:0/3494193673 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700cdb50 con 0x7f96700aee90 2023-10-14T19:03:35.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f96748ee700 1 --2- 172.21.15.7:0/3494193673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700aee90 0x7f96700b08c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9668009f20 tx=0x7f9668009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25c4b4c893951e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f966effd700 1 -- 172.21.15.7:0/3494193673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800e070 con 0x7f96700aee90 2023-10-14T19:03:35.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f966effd700 1 -- 172.21.15.7:0/3494193673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800bb10 con 0x7f96700aee90 2023-10-14T19:03:35.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.851+0000 7f966effd700 1 -- 172.21.15.7:0/3494193673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680092e0 con 0x7f96700aee90 2023-10-14T19:03:35.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 -- 172.21.15.7:0/3494193673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700aee90 msgr2=0x7f96700b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 --2- 172.21.15.7:0/3494193673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700aee90 0x7f96700b08c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9668009f20 tx=0x7f9668009840 comp rx=0 tx=0).stop 2023-10-14T19:03:35.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 -- 172.21.15.7:0/3494193673 shutdown_connections 2023-10-14T19:03:35.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 --2- 172.21.15.7:0/3494193673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700aee90 0x7f96700b08c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 --2- 172.21.15.7:0/3494193673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96700a8be0 0x7f96700a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 -- 172.21.15.7:0/3494193673 >> 172.21.15.7:0/3494193673 conn(0x7f967006ce80 msgr2=0x7f96700ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 -- 172.21.15.7:0/3494193673 shutdown_connections 2023-10-14T19:03:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.852+0000 7f9676351700 1 -- 172.21.15.7:0/3494193673 wait complete. 2023-10-14T19:03:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.853+0000 7f9676351700 1 Processor -- start 2023-10-14T19:03:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.853+0000 7f9676351700 1 -- start start 2023-10-14T19:03:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f9676351700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f967006d280 0x7f967009a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f9676351700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 0x7f96700aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f9676351700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96700aee90 0x7f96700aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f9676351700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700ab5c0 con 0x7f96700a8be0 2023-10-14T19:03:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f9676351700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700ab8a0 con 0x7f96700aee90 2023-10-14T19:03:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f9676351700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700abb80 con 0x7f967006d280 2023-10-14T19:03:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 0x7f96700aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 0x7f96700aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58856/0 (socket says 172.21.15.7:58856) 2023-10-14T19:03:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 -- 172.21.15.7:0/1690827760 learned_addr learned my addr 172.21.15.7:0/1690827760 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f96748ee700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96700aee90 0x7f96700aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966ffff700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f967006d280 0x7f967009a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 -- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f967006d280 msgr2=0x7f967009a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f967006d280 0x7f967009a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 -- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96700aee90 msgr2=0x7f96700aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96700aee90 0x7f96700aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 -- 172.21.15.7:0/1690827760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009ae0 con 0x7f96700a8be0 2023-10-14T19:03:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.854+0000 7f966f7fe700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 0x7f96700aa9e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f966400c540 tx=0x7f9664001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.855+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664011590 con 0x7f96700a8be0 2023-10-14T19:03:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.855+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96640116f0 con 0x7f96700a8be0 2023-10-14T19:03:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.855+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664011ab0 con 0x7f96700a8be0 2023-10-14T19:03:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.855+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700abe60 con 0x7f96700a8be0 2023-10-14T19:03:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.855+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967009ae10 con 0x7f96700a8be0 2023-10-14T19:03:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.855+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700ac380 con 0x7f96700a8be0 2023-10-14T19:03:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.856+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f966401b3b0 con 0x7f96700a8be0 2023-10-14T19:03:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.856+0000 7f9657fff700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f965c066f30 0x7f965c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.857+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9664083820 con 0x7f96700a8be0 2023-10-14T19:03:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.857+0000 7f966ffff700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f965c066f30 0x7f965c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.857+0000 7f966ffff700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f965c066f30 0x7f965c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96700ad5a0 tx=0x7f9660008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:35.862+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96700ac380 con 0x7f96700a8be0 2023-10-14T19:03:36.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.056+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96700ac380 con 0x7f96700a8be0 2023-10-14T19:03:36.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.057+0000 7f9657fff700 1 -- 172.21.15.7:0/1690827760 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f96700ac380 con 0x7f96700a8be0 2023-10-14T19:03:36.057 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:36.057 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f965c066f30 msgr2=0x7f965c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f965c066f30 0x7f965c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96700ad5a0 tx=0x7f9660008040 comp rx=0 tx=0).stop 2023-10-14T19:03:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 msgr2=0x7f96700aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 0x7f96700aa9e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f966400c540 tx=0x7f9664001070 comp rx=0 tx=0).stop 2023-10-14T19:03:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 shutdown_connections 2023-10-14T19:03:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f965c066f30 0x7f965c0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96700aee90 0x7f96700aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f967006d280 0x7f967009a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 --2- 172.21.15.7:0/1690827760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96700a8be0 0x7f96700aa9e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 >> 172.21.15.7:0/1690827760 conn(0x7f967006ce80 msgr2=0x7f96700ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 shutdown_connections 2023-10-14T19:03:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.059+0000 7f9676351700 1 -- 172.21.15.7:0/1690827760 wait complete. 2023-10-14T19:03:36.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:36.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:36.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.194+0000 7fdde2f99700 1 Processor -- start 2023-10-14T19:03:36.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.194+0000 7fdde2f99700 1 -- start start 2023-10-14T19:03:36.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde2f99700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdddc06e0e0 0x7fdddc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde2f99700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0ccfd0 con 0x7fdddc159530 2023-10-14T19:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde2f99700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc15a3d0 con 0x7fdddc06dc70 2023-10-14T19:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde2f99700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc15a6b0 con 0x7fdddc06e0e0 2023-10-14T19:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde1536700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdddc06e0e0 0x7fdddc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde0d35700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdddc159530 0x7fdddc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45070/0 (socket says 172.21.15.7:45070) 2023-10-14T19:03:36.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.195+0000 7fdde0d35700 1 -- 172.21.15.7:0/3218191844 learned_addr learned my addr 172.21.15.7:0/3218191844 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:36.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde1536700 1 -- 172.21.15.7:0/3218191844 >> v1:172.21.15.148:6789/0 conn(0x7fdddc06dc70 legacy=0x7fdddc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde1536700 1 -- 172.21.15.7:0/3218191844 >> v1:172.21.15.7:6789/0 conn(0x7fdddc159530 legacy=0x7fdddc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde1536700 1 -- 172.21.15.7:0/3218191844 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc15a990 con 0x7fdddc06e0e0 2023-10-14T19:03:36.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdddb7fe700 1 -- 172.21.15.7:0/3218191844 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148115772 0 0) 0x7fdddc0ccfd0 con 0x7fdddc159530 2023-10-14T19:03:36.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde1536700 1 --2- 172.21.15.7:0/3218191844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0cb6f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fddc40098e0 tx=0x7fddc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b855d8db36f201e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdddb7fe700 1 -- 172.21.15.7:0/3218191844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4009e80 con 0x7fdddc06e0e0 2023-10-14T19:03:36.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdddb7fe700 1 -- 172.21.15.7:0/3218191844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400b860 con 0x7fdddc06e0e0 2023-10-14T19:03:36.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdddb7fe700 1 -- 172.21.15.7:0/3218191844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400bbe0 con 0x7fdddc06e0e0 2023-10-14T19:03:36.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde2f99700 1 -- 172.21.15.7:0/3218191844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 msgr2=0x7fdddc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde2f99700 1 --2- 172.21.15.7:0/3218191844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0cb6f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fddc40098e0 tx=0x7fddc40091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde2f99700 1 -- 172.21.15.7:0/3218191844 shutdown_connections 2023-10-14T19:03:36.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.196+0000 7fdde2f99700 1 --2- 172.21.15.7:0/3218191844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0cb6f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.197+0000 7fdde2f99700 1 -- 172.21.15.7:0/3218191844 >> 172.21.15.7:0/3218191844 conn(0x7fdddc0703a0 msgr2=0x7fdddc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:36.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.197+0000 7fdde2f99700 1 -- 172.21.15.7:0/3218191844 shutdown_connections 2023-10-14T19:03:36.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.197+0000 7fdde2f99700 1 -- 172.21.15.7:0/3218191844 wait complete. 2023-10-14T19:03:36.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.198+0000 7fdde2f99700 1 Processor -- start 2023-10-14T19:03:36.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.198+0000 7fdde2f99700 1 -- start start 2023-10-14T19:03:36.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde2f99700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdddc06dc70 0x7fdddc0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde2f99700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde2f99700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdddc159530 0x7fdddc169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde2f99700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0b3d80 con 0x7fdddc06e0e0 2023-10-14T19:03:36.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde2f99700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c80a0 con 0x7fdddc06dc70 2023-10-14T19:03:36.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde2f99700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c8ec0 con 0x7fdddc159530 2023-10-14T19:03:36.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58878/0 (socket says 172.21.15.7:58878) 2023-10-14T19:03:36.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 -- 172.21.15.7:0/1797375688 learned_addr learned my addr 172.21.15.7:0/1797375688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:36.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde0d35700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdddc06dc70 0x7fdddc0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdde1536700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdddc159530 0x7fdddc169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 -- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdddc159530 msgr2=0x7fdddc169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdddc159530 0x7fdddc169030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 -- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdddc06dc70 msgr2=0x7fdddc0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdddc06dc70 0x7fdddc0b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 -- 172.21.15.7:0/1797375688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009420 con 0x7fdddc06e0e0 2023-10-14T19:03:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.199+0000 7fdddbfff700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0c7b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00c4e0 tx=0x7fddcc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.200+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00cea0 con 0x7fdddc06e0e0 2023-10-14T19:03:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.200+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc011590 con 0x7fdddc06e0e0 2023-10-14T19:03:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.200+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011930 con 0x7fdddc06e0e0 2023-10-14T19:03:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.200+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc169570 con 0x7fdddc06e0e0 2023-10-14T19:03:36.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.200+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc0c8610 con 0x7fdddc06e0e0 2023-10-14T19:03:36.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.201+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04c3c0 con 0x7fdddc06e0e0 2023-10-14T19:03:36.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.201+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddcc011d20 con 0x7fdddc06e0e0 2023-10-14T19:03:36.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.201+0000 7fddd8ff9700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddbc066f30 0x7fddbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.201+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddcc083840 con 0x7fdddc06e0e0 2023-10-14T19:03:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.202+0000 7fdde0d35700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddbc066f30 0x7fddbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.202+0000 7fdde0d35700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddbc066f30 0x7fddbc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fddd4002250 tx=0x7fddd4001a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.206+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddcc050ab0 con 0x7fdddc06e0e0 2023-10-14T19:03:36.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.395+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdddc15ac70 con 0x7fdddc06e0e0 2023-10-14T19:03:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.396+0000 7fddd8ff9700 1 -- 172.21.15.7:0/1797375688 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddcc017070 con 0x7fdddc06e0e0 2023-10-14T19:03:36.397 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:36.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddbc066f30 msgr2=0x7fddbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddbc066f30 0x7fddbc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fddd4002250 tx=0x7fddd4001a00 comp rx=0 tx=0).stop 2023-10-14T19:03:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 msgr2=0x7fdddc0c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0c7b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00c4e0 tx=0x7fddcc00c7f0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 shutdown_connections 2023-10-14T19:03:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddbc066f30 0x7fddbc0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdddc06dc70 0x7fdddc0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdddc159530 0x7fdddc169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 --2- 172.21.15.7:0/1797375688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdddc06e0e0 0x7fdddc0c7b60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 >> 172.21.15.7:0/1797375688 conn(0x7fdddc0703a0 msgr2=0x7fdddc0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 shutdown_connections 2023-10-14T19:03:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.398+0000 7fdde2f99700 1 -- 172.21.15.7:0/1797375688 wait complete. 2023-10-14T19:03:36.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.534+0000 7f798a77c700 1 Processor -- start 2023-10-14T19:03:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.534+0000 7f798a77c700 1 -- start start 2023-10-14T19:03:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f798a77c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7984153a00 0x7f7984153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f798a77c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f798415de50 0x7f798415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f798a77c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798415af60 con 0x7f79840cea00 2023-10-14T19:03:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f798a77c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798415d010 con 0x7f798415de50 2023-10-14T19:03:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f798a77c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798415b240 con 0x7f7984153a00 2023-10-14T19:03:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7988f79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f798415de50 0x7f798415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7989f7b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f79840cea00 0x7f79840cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45072/0 (socket says 172.21.15.7:45072) 2023-10-14T19:03:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7988f79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f798415de50 0x7f798415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58886/0 (socket says 172.21.15.7:58886) 2023-10-14T19:03:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7989f7b700 1 -- 172.21.15.7:0/478639015 learned_addr learned my addr 172.21.15.7:0/478639015 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f798977a700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7984153a00 0x7f7984153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7988f79700 1 -- 172.21.15.7:0/478639015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7984153a00 msgr2=0x7f7984153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7988f79700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7984153a00 0x7f7984153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7988f79700 1 -- 172.21.15.7:0/478639015 >> v1:172.21.15.7:6789/0 conn(0x7f79840cea00 legacy=0x7f79840cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.535+0000 7f7983fff700 1 -- 172.21.15.7:0/478639015 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785752674 0 0) 0x7f798415af60 con 0x7f79840cea00 2023-10-14T19:03:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f7988f79700 1 -- 172.21.15.7:0/478639015 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798415b520 con 0x7f798415de50 2023-10-14T19:03:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798977a700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7984153a00 0x7f7984153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f7988f79700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f798415a540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79780098e0 tx=0x7f79780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5773183d2ddfca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f7983fff700 1 -- 172.21.15.7:0/478639015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978009e80 con 0x7f798415de50 2023-10-14T19:03:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f7983fff700 1 -- 172.21.15.7:0/478639015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800b860 con 0x7f798415de50 2023-10-14T19:03:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f7983fff700 1 -- 172.21.15.7:0/478639015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800bbe0 con 0x7f798415de50 2023-10-14T19:03:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 -- 172.21.15.7:0/478639015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 msgr2=0x7f798415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f798415a540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79780098e0 tx=0x7f79780091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 -- 172.21.15.7:0/478639015 shutdown_connections 2023-10-14T19:03:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7984153a00 0x7f7984153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 --2- 172.21.15.7:0/478639015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f798415a540 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 -- 172.21.15.7:0/478639015 >> 172.21.15.7:0/478639015 conn(0x7f79840703a0 msgr2=0x7f79840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 -- 172.21.15.7:0/478639015 shutdown_connections 2023-10-14T19:03:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.536+0000 7f798a77c700 1 -- 172.21.15.7:0/478639015 wait complete. 2023-10-14T19:03:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 Processor -- start 2023-10-14T19:03:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 -- start start 2023-10-14T19:03:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79840cea00 0x7f7984152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7984153a00 0x7f79840c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f79840b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840c8660 con 0x7f798415de50 2023-10-14T19:03:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b3a00 con 0x7f7984153a00 2023-10-14T19:03:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.538+0000 7f798a77c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b3cc0 con 0x7f79840cea00 2023-10-14T19:03:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f79840b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f79840b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58892/0 (socket says 172.21.15.7:58892) 2023-10-14T19:03:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 -- 172.21.15.7:0/786326340 learned_addr learned my addr 172.21.15.7:0/786326340 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f798977a700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79840cea00 0x7f7984152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7988f79700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7984153a00 0x7f79840c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 -- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79840cea00 msgr2=0x7f7984152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79840cea00 0x7f7984152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 -- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7984153a00 msgr2=0x7f79840c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7984153a00 0x7f79840c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 -- 172.21.15.7:0/786326340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978009420 con 0x7f798415de50 2023-10-14T19:03:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f7989f7b700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f79840b0410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f797400ccc0 tx=0x7f7974001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400a860 con 0x7f798415de50 2023-10-14T19:03:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400a9c0 con 0x7f798415de50 2023-10-14T19:03:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400ad80 con 0x7f798415de50 2023-10-14T19:03:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79841527d0 con 0x7f798415de50 2023-10-14T19:03:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.539+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840c7dc0 con 0x7f798415de50 2023-10-14T19:03:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.540+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798404c3c0 con 0x7f798415de50 2023-10-14T19:03:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.541+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7974007300 con 0x7f798415de50 2023-10-14T19:03:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.541+0000 7f79817fa700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7970066f60 0x7f7970069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.541+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7974084890 con 0x7f798415de50 2023-10-14T19:03:36.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.541+0000 7f798977a700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7970066f60 0x7f7970069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.542+0000 7f798977a700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7970066f60 0x7f7970069410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f797c00adc0 tx=0x7f797c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.546+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7974051af0 con 0x7f798415de50 2023-10-14T19:03:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.737+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79840b3e00 con 0x7f798415de50 2023-10-14T19:03:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.737+0000 7f79817fa700 1 -- 172.21.15.7:0/786326340 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7974055110 con 0x7f798415de50 2023-10-14T19:03:36.737 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:36.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7970066f60 msgr2=0x7f7970069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7970066f60 0x7f7970069410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f797c00adc0 tx=0x7f797c006f90 comp rx=0 tx=0).stop 2023-10-14T19:03:36.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 msgr2=0x7f79840b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f79840b0410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f797400ccc0 tx=0x7f7974001a20 comp rx=0 tx=0).stop 2023-10-14T19:03:36.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 shutdown_connections 2023-10-14T19:03:36.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7970066f60 0x7f7970069410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f798415de50 0x7f79840b0410 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79840cea00 0x7f7984152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 --2- 172.21.15.7:0/786326340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7984153a00 0x7f79840c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 >> 172.21.15.7:0/786326340 conn(0x7f79840703a0 msgr2=0x7f798415bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:36.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 shutdown_connections 2023-10-14T19:03:36.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.739+0000 7f798a77c700 1 -- 172.21.15.7:0/786326340 wait complete. 2023-10-14T19:03:36.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:36.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.876+0000 7f7f0081d700 1 Processor -- start 2023-10-14T19:03:36.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.876+0000 7f7f0081d700 1 -- start start 2023-10-14T19:03:36.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7f0081d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7efc153a00 0x7f7efc153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7f0081d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc0cea00 0x7f7efc0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7f0081d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc15ac50 con 0x7f7efc15de50 2023-10-14T19:03:36.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7f0081d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc15d010 con 0x7f7efc153a00 2023-10-14T19:03:36.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7f0081d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0cf3c0 con 0x7f7efc0cea00 2023-10-14T19:03:36.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7efc153a00 0x7f7efc153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efa59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7efc15de50 0x7f7efc15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47670/0 (socket says 172.21.15.7:47670) 2023-10-14T19:03:36.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efa59c700 1 -- 172.21.15.7:0/3563806967 learned_addr learned my addr 172.21.15.7:0/3563806967 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:36.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 --2- 172.21.15.7:0/3563806967 >> v2:172.21.15.7:3300/0 conn(0x7f7efc153a00 0x7f7efc153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46482/0 (socket says 172.21.15.7:46482) 2023-10-14T19:03:36.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efb59e700 1 --2- 172.21.15.7:0/3563806967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc0cea00 0x7f7efc0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 -- 172.21.15.7:0/3563806967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc0cea00 msgr2=0x7f7efc0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:36.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 --2- 172.21.15.7:0/3563806967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc0cea00 0x7f7efc0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 -- 172.21.15.7:0/3563806967 >> v1:172.21.15.7:6789/0 conn(0x7f7efc15de50 legacy=0x7f7efc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 -- 172.21.15.7:0/3563806967 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc15af60 con 0x7f7efc153a00 2023-10-14T19:03:36.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7ef9d9b700 1 -- 172.21.15.7:0/3563806967 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071956963 0 0) 0x7f7efc15ac50 con 0x7f7efc15de50 2023-10-14T19:03:36.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7efad9d700 1 --2- 172.21.15.7:0/3563806967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc153dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0098e0 tx=0x7f7eec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c5f78aa4e71c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7ef9d9b700 1 -- 172.21.15.7:0/3563806967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec009e80 con 0x7f7efc153a00 2023-10-14T19:03:36.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7ef9d9b700 1 -- 172.21.15.7:0/3563806967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00b860 con 0x7f7efc153a00 2023-10-14T19:03:36.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.877+0000 7f7ef9d9b700 1 -- 172.21.15.7:0/3563806967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00bbe0 con 0x7f7efc153a00 2023-10-14T19:03:36.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 -- 172.21.15.7:0/3563806967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 msgr2=0x7f7efc153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 --2- 172.21.15.7:0/3563806967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc153dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0098e0 tx=0x7f7eec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 -- 172.21.15.7:0/3563806967 shutdown_connections 2023-10-14T19:03:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 --2- 172.21.15.7:0/3563806967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc153dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 --2- 172.21.15.7:0/3563806967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc0cea00 0x7f7efc0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 -- 172.21.15.7:0/3563806967 >> 172.21.15.7:0/3563806967 conn(0x7f7efc0703a0 msgr2=0x7f7efc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:36.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 -- 172.21.15.7:0/3563806967 shutdown_connections 2023-10-14T19:03:36.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.878+0000 7f7f0081d700 1 -- 172.21.15.7:0/3563806967 wait complete. 2023-10-14T19:03:36.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.879+0000 7f7f0081d700 1 Processor -- start 2023-10-14T19:03:36.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.879+0000 7f7f0081d700 1 -- start start 2023-10-14T19:03:36.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7f0081d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7efc0cea00 0x7f7efc0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7f0081d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7f0081d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc15de50 0x7f7efc0c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7f0081d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b0c50 con 0x7f7efc153a00 2023-10-14T19:03:36.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7f0081d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b1a70 con 0x7f7efc0cea00 2023-10-14T19:03:36.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7f0081d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b0e60 con 0x7f7efc15de50 2023-10-14T19:03:36.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc0b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46492/0 (socket says 172.21.15.7:46492) 2023-10-14T19:03:36.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 -- 172.21.15.7:0/465346440 learned_addr learned my addr 172.21.15.7:0/465346440 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:36.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efb59e700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc15de50 0x7f7efc0c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efad9d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7efc0cea00 0x7f7efc0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 -- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc15de50 msgr2=0x7f7efc0c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc15de50 0x7f7efc0c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 -- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7efc0cea00 msgr2=0x7f7efc0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:36.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.880+0000 7f7efa59c700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7efc0cea00 0x7f7efc0b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:36.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7efa59c700 1 -- 172.21.15.7:0/465346440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009420 con 0x7f7efc153a00 2023-10-14T19:03:36.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7efa59c700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc0b59a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c5b0 tx=0x7f7ef0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0005b30 con 0x7f7efc153a00 2023-10-14T19:03:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0005c90 con 0x7f7efc153a00 2023-10-14T19:03:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc0b1140 con 0x7f7efc153a00 2023-10-14T19:03:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0007300 con 0x7f7efc153a00 2023-10-14T19:03:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.881+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc0b1700 con 0x7f7efc153a00 2023-10-14T19:03:36.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.882+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc04c3c0 con 0x7f7efc153a00 2023-10-14T19:03:36.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.882+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ef001b3b0 con 0x7f7efc153a00 2023-10-14T19:03:36.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.883+0000 7f7ee2ffd700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ee8066f30 0x7f7ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:36.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.883+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ef0083960 con 0x7f7efc153a00 2023-10-14T19:03:36.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.883+0000 7f7efad9d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ee8066f30 0x7f7ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:36.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.883+0000 7f7efad9d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ee8066f30 0x7f7ee80693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0091e0 tx=0x7f7eec017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:36.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:36.887+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ef0050bd0 con 0x7f7efc153a00 2023-10-14T19:03:37.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.078+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7efc0b1bb0 con 0x7f7efc153a00 2023-10-14T19:03:37.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.079+0000 7f7ee2ffd700 1 -- 172.21.15.7:0/465346440 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ef00170a0 con 0x7f7efc153a00 2023-10-14T19:03:37.079 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:37.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ee8066f30 msgr2=0x7f7ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ee8066f30 0x7f7ee80693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0091e0 tx=0x7f7eec017000 comp rx=0 tx=0).stop 2023-10-14T19:03:37.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 msgr2=0x7f7efc0b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc0b59a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c5b0 tx=0x7f7ef0001070 comp rx=0 tx=0).stop 2023-10-14T19:03:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 shutdown_connections 2023-10-14T19:03:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ee8066f30 0x7f7ee80693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7efc0cea00 0x7f7efc0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7efc15de50 0x7f7efc0c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 --2- 172.21.15.7:0/465346440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7efc153a00 0x7f7efc0b59a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 >> 172.21.15.7:0/465346440 conn(0x7f7efc0703a0 msgr2=0x7f7efc15bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:37.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 shutdown_connections 2023-10-14T19:03:37.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.081+0000 7f7f0081d700 1 -- 172.21.15.7:0/465346440 wait complete. 2023-10-14T19:03:37.160 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-10-14T19:03:37.161 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:03:37.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-14T19:03:37.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.283+0000 7f70d8e83700 1 Processor -- start 2023-10-14T19:03:37.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.283+0000 7f70d8e83700 1 -- start start 2023-10-14T19:03:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d8e83700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d8e83700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f70d40cd9e0 0x7f70d4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d8e83700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d415ae40 con 0x7f70d40cde50 2023-10-14T19:03:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d8e83700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40d13f0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d8e83700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d415ab60 con 0x7f70d40cb5a0 2023-10-14T19:03:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f70d40cd9e0 0x7f70d4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:37.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f70d40cd9e0 0x7f70d4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46502/0 (socket says 172.21.15.7:46502) 2023-10-14T19:03:37.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 -- 172.21.15.7:0/369489640 learned_addr learned my addr 172.21.15.7:0/369489640 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:37.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d259c700 1 --2- 172.21.15.7:0/369489640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:37.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 -- 172.21.15.7:0/369489640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 msgr2=0x7f70d40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:37.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 --2- 172.21.15.7:0/369489640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 -- 172.21.15.7:0/369489640 >> v1:172.21.15.148:6789/0 conn(0x7f70d40cde50 legacy=0x7f70d4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 -- 172.21.15.7:0/369489640 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d40ccf00 con 0x7f70d40cd9e0 2023-10-14T19:03:37.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d1d9b700 1 --2- 172.21.15.7:0/369489640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d4159ec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0099b0 tx=0x7f70bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516e75f5104bd1f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:37.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d159a700 1 -- 172.21.15.7:0/369489640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00b860 con 0x7f70d40cd9e0 2023-10-14T19:03:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d159a700 1 -- 172.21.15.7:0/369489640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc00b9c0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.284+0000 7f70d159a700 1 -- 172.21.15.7:0/369489640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00bd60 con 0x7f70d40cd9e0 2023-10-14T19:03:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 -- 172.21.15.7:0/369489640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 msgr2=0x7f70d4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 --2- 172.21.15.7:0/369489640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d4159ec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0099b0 tx=0x7f70bc009250 comp rx=0 tx=0).stop 2023-10-14T19:03:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 -- 172.21.15.7:0/369489640 shutdown_connections 2023-10-14T19:03:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 --2- 172.21.15.7:0/369489640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 --2- 172.21.15.7:0/369489640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d4159ec0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 -- 172.21.15.7:0/369489640 >> 172.21.15.7:0/369489640 conn(0x7f70d4070e30 msgr2=0x7f70d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 -- 172.21.15.7:0/369489640 shutdown_connections 2023-10-14T19:03:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.285+0000 7f70d8e83700 1 -- 172.21.15.7:0/369489640 wait complete. 2023-10-14T19:03:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.286+0000 7f70d8e83700 1 Processor -- start 2023-10-14T19:03:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.286+0000 7f70d8e83700 1 -- start start 2023-10-14T19:03:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d8e83700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d8e83700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d8e83700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70d415b5b0 0x7f70d40b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d8e83700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d415bec0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d8e83700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41568d0 con 0x7f70d415b5b0 2023-10-14T19:03:37.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d8e83700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d4157de0 con 0x7f70d40cb5a0 2023-10-14T19:03:37.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:37.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46504/0 (socket says 172.21.15.7:46504) 2023-10-14T19:03:37.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 -- 172.21.15.7:0/1507319272 learned_addr learned my addr 172.21.15.7:0/1507319272 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:37.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d2d9d700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70d415b5b0 0x7f70d40b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:37.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d259c700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:37.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 -- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 msgr2=0x7f70d4156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d4156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 -- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70d415b5b0 msgr2=0x7f70d40b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70d415b5b0 0x7f70d40b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 -- 172.21.15.7:0/1507319272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc0094f0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.287+0000 7f70d1d9b700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d415b070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f70bc006fd0 tx=0x7f70bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:37.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.288+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc024440 con 0x7f70d40cd9e0 2023-10-14T19:03:37.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.288+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0245c0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.288+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc024980 con 0x7f70d40cd9e0 2023-10-14T19:03:37.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.288+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d40ca7c0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.288+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d4157790 con 0x7f70d40cd9e0 2023-10-14T19:03:37.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.288+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d415b9b0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.289+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70bc01a420 con 0x7f70d40cd9e0 2023-10-14T19:03:37.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.289+0000 7f70ca7fc700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f70b4066f30 0x7f70b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:37.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.289+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70bc0862c0 con 0x7f70d40cd9e0 2023-10-14T19:03:37.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.290+0000 7f70d259c700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f70b4066f30 0x7f70b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:37.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.290+0000 7f70d259c700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f70b4066f30 0x7f70b40693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70c40075a0 tx=0x7f70c40097a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:37.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.294+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70bc053530 con 0x7f70d40cd9e0 2023-10-14T19:03:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.565+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f70d4157f70 con 0x7f70d40cd9e0 2023-10-14T19:03:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.863+0000 7f70ca7fc700 1 -- 172.21.15.7:0/1507319272 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f70bc056b50 con 0x7f70d40cd9e0 2023-10-14T19:03:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f70b4066f30 msgr2=0x7f70b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f70b4066f30 0x7f70b40693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70c40075a0 tx=0x7f70c40097a0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 msgr2=0x7f70d415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d415b070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f70bc006fd0 tx=0x7f70bc017000 comp rx=0 tx=0).stop 2023-10-14T19:03:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 shutdown_connections 2023-10-14T19:03:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f70b4066f30 0x7f70b40693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70d415b5b0 0x7f70d40b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70d40cb5a0 0x7f70d4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 --2- 172.21.15.7:0/1507319272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70d40cd9e0 0x7f70d415b070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 >> 172.21.15.7:0/1507319272 conn(0x7f70d4070e30 msgr2=0x7f70d40c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 shutdown_connections 2023-10-14T19:03:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:37.866+0000 7f70d8e83700 1 -- 172.21.15.7:0/1507319272 wait complete. 2023-10-14T19:03:37.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:03:38.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.003+0000 7f3c66717700 1 Processor -- start 2023-10-14T19:03:38.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.004+0000 7f3c66717700 1 -- start start 2023-10-14T19:03:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.004+0000 7f3c66717700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c6015dfd0 0x7f3c600aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c66717700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159920 0x7f3c600ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c66717700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c600acc00 con 0x7f3c60159550 2023-10-14T19:03:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c66717700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c600abff0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c66717700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600ac2d0 con 0x7f3c60159920 2023-10-14T19:03:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c6015dfd0 0x7f3c600aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c65715700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3c60159550 0x7f3c600ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47678/0 (socket says 172.21.15.7:47678) 2023-10-14T19:03:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c65715700 1 -- 172.21.15.7:0/3752474929 learned_addr learned my addr 172.21.15.7:0/3752474929 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c6015dfd0 0x7f3c600aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46510/0 (socket says 172.21.15.7:46510) 2023-10-14T19:03:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c65f16700 1 --2- 172.21.15.7:0/3752474929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159920 0x7f3c600ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 -- 172.21.15.7:0/3752474929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159920 msgr2=0x7f3c600ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 --2- 172.21.15.7:0/3752474929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159920 0x7f3c600ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 -- 172.21.15.7:0/3752474929 >> v1:172.21.15.7:6789/0 conn(0x7f3c60159550 legacy=0x7f3c600ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c5ffff700 1 -- 172.21.15.7:0/3752474929 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267864706 0 0) 0x7f3c600acc00 con 0x7f3c60159550 2023-10-14T19:03:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 -- 172.21.15.7:0/3752474929 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c600ac5b0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c64f14700 1 --2- 172.21.15.7:0/3752474929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c600aedb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c540098e0 tx=0x7f3c540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc95c572678ebc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c5ffff700 1 -- 172.21.15.7:0/3752474929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54009e80 con 0x7f3c6015dfd0 2023-10-14T19:03:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c5ffff700 1 -- 172.21.15.7:0/3752474929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400b860 con 0x7f3c6015dfd0 2023-10-14T19:03:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.005+0000 7f3c5ffff700 1 -- 172.21.15.7:0/3752474929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400bbe0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 -- 172.21.15.7:0/3752474929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 msgr2=0x7f3c600aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 --2- 172.21.15.7:0/3752474929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c600aedb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c540098e0 tx=0x7f3c540091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 -- 172.21.15.7:0/3752474929 shutdown_connections 2023-10-14T19:03:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 --2- 172.21.15.7:0/3752474929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159920 0x7f3c600ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 --2- 172.21.15.7:0/3752474929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c600aedb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 -- 172.21.15.7:0/3752474929 >> 172.21.15.7:0/3752474929 conn(0x7f3c6006ce80 msgr2=0x7f3c600ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 -- 172.21.15.7:0/3752474929 shutdown_connections 2023-10-14T19:03:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.006+0000 7f3c66717700 1 -- 172.21.15.7:0/3752474929 wait complete. 2023-10-14T19:03:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.007+0000 7f3c66717700 1 Processor -- start 2023-10-14T19:03:38.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.007+0000 7f3c66717700 1 -- start start 2023-10-14T19:03:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c66717700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159550 0x7f3c6014b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c66717700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c60159920 0x7f3c60151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c66717700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c601517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c66717700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6014bc50 con 0x7f3c6015dfd0 2023-10-14T19:03:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c66717700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600c7ea0 con 0x7f3c60159920 2023-10-14T19:03:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c66717700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600c8180 con 0x7f3c60159550 2023-10-14T19:03:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c601517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c601517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46526/0 (socket says 172.21.15.7:46526) 2023-10-14T19:03:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 -- 172.21.15.7:0/905700379 learned_addr learned my addr 172.21.15.7:0/905700379 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65715700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159550 0x7f3c6014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c64f14700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c60159920 0x7f3c60151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 -- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159550 msgr2=0x7f3c6014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159550 0x7f3c6014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 -- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c60159920 msgr2=0x7f3c60151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c60159920 0x7f3c60151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c65f16700 1 -- 172.21.15.7:0/905700379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54009420 con 0x7f3c6015dfd0 2023-10-14T19:03:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.008+0000 7f3c64f14700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c60159920 0x7f3c60151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.009+0000 7f3c65f16700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c601517d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009fa0 tx=0x7f3c50009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.009+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000ec70 con 0x7f3c6015dfd0 2023-10-14T19:03:38.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.009+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5000edd0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.009+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50014670 con 0x7f3c6015dfd0 2023-10-14T19:03:38.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.009+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c600c8460 con 0x7f3c6015dfd0 2023-10-14T19:03:38.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.009+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6014e0c0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.010+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600c8980 con 0x7f3c6015dfd0 2023-10-14T19:03:38.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.010+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c500149e0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.010+0000 7f3c5d7fa700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.011+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c50084c20 con 0x7f3c6015dfd0 2023-10-14T19:03:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.011+0000 7f3c65715700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.011+0000 7f3c65715700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c4c066f30 0x7f3c4c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c58007fd0 tx=0x7f3c58007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.015+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c50051e90 con 0x7f3c6015dfd0 2023-10-14T19:03:38.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.207+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3c6004c3c0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.211+0000 7f3c5d7fa700 1 -- 172.21.15.7:0/905700379 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c500554b0 con 0x7f3c6015dfd0 2023-10-14T19:03:38.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c4c066f30 msgr2=0x7f3c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c4c066f30 0x7f3c4c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c58007fd0 tx=0x7f3c58007d30 comp rx=0 tx=0).stop 2023-10-14T19:03:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 msgr2=0x7f3c601517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c601517d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009fa0 tx=0x7f3c50009900 comp rx=0 tx=0).stop 2023-10-14T19:03:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 shutdown_connections 2023-10-14T19:03:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c6015dfd0 0x7f3c601517d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c60159550 0x7f3c6014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 --2- 172.21.15.7:0/905700379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c60159920 0x7f3c60151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 >> 172.21.15.7:0/905700379 conn(0x7f3c6006ce80 msgr2=0x7f3c600af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:38.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 shutdown_connections 2023-10-14T19:03:38.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.213+0000 7f3c66717700 1 -- 172.21.15.7:0/905700379 wait complete. 2023-10-14T19:03:38.226 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:03:38.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:03:38.275 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:03:38.320 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:03:38.321 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:03:38.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:03:38.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T19:03:38.357 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:03:38.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:38.358 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:03:38.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:03:38.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:03:38.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T19:03:38.453 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:03:38.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:38.454 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:03:38.511 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-14T19:03:38.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:03:38.512 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-14T19:03:38.550 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:03:38.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:38.551 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T19:03:38.606 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-14T19:03:38.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:03:38.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-14T19:03:38.646 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:03:38.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:03:38.647 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T19:03:38.707 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:03:38.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:38.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.827+0000 7fa7abea5700 1 Processor -- start 2023-10-14T19:03:38.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.827+0000 7fa7abea5700 1 -- start start 2023-10-14T19:03:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7abea5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 0x7fa7a40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7abea5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a415ae40 con 0x7fa7a40cde50 2023-10-14T19:03:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7abea5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a415ab60 con 0x7fa7a40cd9e0 2023-10-14T19:03:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7abea5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40d13f0 con 0x7fa7a40cb5a0 2023-10-14T19:03:38.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7aa442700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa7a40cde50 0x7fa7a4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47686/0 (socket says 172.21.15.7:47686) 2023-10-14T19:03:38.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7aa442700 1 -- 172.21.15.7:0/4199255665 learned_addr learned my addr 172.21.15.7:0/4199255665 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:38.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a9c41700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 0x7fa7a40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388500913 0 0) 0x7fa7a415ae40 con 0x7fa7a40cde50 2023-10-14T19:03:38.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003570 con 0x7fa7a40cde50 2023-10-14T19:03:38.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 440686102 0 0) 0x7fa790003570 con 0x7fa7a40cde50 2023-10-14T19:03:38.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 msgr2=0x7fa7a40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:38.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 0x7fa7a40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 >> v1:172.21.15.148:6789/0 conn(0x7fa7a40cd9e0 legacy=0x7fa7a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40ccf00 con 0x7fa7a40cde50 2023-10-14T19:03:38.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa79c0017f0 con 0x7fa7a40cde50 2023-10-14T19:03:38.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 >> v1:172.21.15.7:6789/0 conn(0x7fa7a40cde50 legacy=0x7fa7a4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 0x7fa790003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790003fd0 0x7fa790004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.828+0000 7fa7a8c3f700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000bb10 con 0x7fa790004d50 2023-10-14T19:03:38.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000bc80 con 0x7fa790003fd0 2023-10-14T19:03:38.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000be40 con 0x7fa7a40cb5a0 2023-10-14T19:03:38.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a9c41700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 0x7fa790003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a9440700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790003fd0 0x7fa790004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 -- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 msgr2=0x7fa790003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a40cb5a0 0x7fa790003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 -- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790003fd0 msgr2=0x7fa790004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790003fd0 0x7fa790004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 -- 172.21.15.7:0/4199255665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790003570 con 0x7fa790004d50 2023-10-14T19:03:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7aa442700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00a950 tx=0x7fa79c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef49038d882b322 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0070d0 con 0x7fa790004d50 2023-10-14T19:03:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c007230 con 0x7fa790004d50 2023-10-14T19:03:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.829+0000 7fa7a8c3f700 1 -- 172.21.15.7:0/4199255665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0075f0 con 0x7fa790004d50 2023-10-14T19:03:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7abea5700 1 -- 172.21.15.7:0/4199255665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa790004d50 msgr2=0x7fa7900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7abea5700 1 --2- 172.21.15.7:0/4199255665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00a950 tx=0x7fa79c0021f0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7aa442700 1 -- 172.21.15.7:0/4199255665 reap_dead start 2023-10-14T19:03:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7abea5700 1 -- 172.21.15.7:0/4199255665 shutdown_connections 2023-10-14T19:03:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7abea5700 1 -- 172.21.15.7:0/4199255665 >> 172.21.15.7:0/4199255665 conn(0x7fa7a4070e30 msgr2=0x7fa7a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7abea5700 1 -- 172.21.15.7:0/4199255665 shutdown_connections 2023-10-14T19:03:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.830+0000 7fa7abea5700 1 -- 172.21.15.7:0/4199255665 wait complete. 2023-10-14T19:03:38.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.831+0000 7fa7abea5700 1 Processor -- start 2023-10-14T19:03:38.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.831+0000 7fa7abea5700 1 -- start start 2023-10-14T19:03:38.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790004d50 0x7fa7a4168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a4156ac0 0x7fa7a4156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 0x7fa7a4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415a3d0 con 0x7fa7a4158e00 2023-10-14T19:03:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415c270 con 0x7fa790004d50 2023-10-14T19:03:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4157450 con 0x7fa7a4156ac0 2023-10-14T19:03:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 0x7fa7a4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 0x7fa7a4159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46536/0 (socket says 172.21.15.7:46536) 2023-10-14T19:03:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 -- 172.21.15.7:0/796094128 learned_addr learned my addr 172.21.15.7:0/796094128 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7a9c41700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790004d50 0x7fa7a4168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7a9440700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a4156ac0 0x7fa7a4156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 -- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a4156ac0 msgr2=0x7fa7a4156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a4156ac0 0x7fa7a4156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 -- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790004d50 msgr2=0x7fa7a4168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:38.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790004d50 0x7fa7a4168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:38.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 -- 172.21.15.7:0/796094128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4159b30 con 0x7fa7a4158e00 2023-10-14T19:03:38.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7a9440700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a4156ac0 0x7fa7a4156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:38.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7aa442700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 0x7fa7a4159280 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa79000bc50 tx=0x7fa79c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:38.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c01e450 con 0x7fa7a4158e00 2023-10-14T19:03:38.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c01e610 con 0x7fa7a4158e00 2023-10-14T19:03:38.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4159e10 con 0x7fa7a4158e00 2023-10-14T19:03:38.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.832+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c01e9d0 con 0x7fa7a4158e00 2023-10-14T19:03:38.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.833+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4169190 con 0x7fa7a4158e00 2023-10-14T19:03:38.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.834+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a415c040 con 0x7fa7a4158e00 2023-10-14T19:03:38.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.834+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa79c029460 con 0x7fa7a4158e00 2023-10-14T19:03:38.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.834+0000 7fa799ffb700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:38.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.834+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa79c086920 con 0x7fa7a4158e00 2023-10-14T19:03:38.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.835+0000 7fa7a9c41700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:38.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.835+0000 7fa7a9c41700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa788066f30 0x7fa7880693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40c8230 tx=0x7fa7a00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:38.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:38.839+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a415c040 con 0x7fa7a4158e00 2023-10-14T19:03:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.077+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7a415c420 con 0x7fa7a4158e00 2023-10-14T19:03:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.077+0000 7fa799ffb700 1 -- 172.21.15.7:0/796094128 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fa7a415c420 con 0x7fa7a4158e00 2023-10-14T19:03:39.079 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa788066f30 msgr2=0x7fa7880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa788066f30 0x7fa7880693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40c8230 tx=0x7fa7a00091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 msgr2=0x7fa7a4159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 0x7fa7a4159280 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa79000bc50 tx=0x7fa79c015000 comp rx=0 tx=0).stop 2023-10-14T19:03:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 shutdown_connections 2023-10-14T19:03:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa790004d50 0x7fa7a4168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7a4158e00 0x7fa7a4159280 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 --2- 172.21.15.7:0/796094128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7a4156ac0 0x7fa7a4156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 >> 172.21.15.7:0/796094128 conn(0x7fa7a4070e30 msgr2=0x7fa7a40c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 shutdown_connections 2023-10-14T19:03:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.079+0000 7fa7abea5700 1 -- 172.21.15.7:0/796094128 wait complete. 2023-10-14T19:03:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:39.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:39.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.210+0000 7fd160bc1700 1 Processor -- start 2023-10-14T19:03:39.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.210+0000 7fd160bc1700 1 -- start start 2023-10-14T19:03:39.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd160bc1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd15c1508c0 0x7fd15c158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd160bc1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd15c150c90 0x7fd15c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd160bc1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c15a0c0 0x7fd15c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd160bc1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c15afc0 con 0x7fd15c150c90 2023-10-14T19:03:39.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd160bc1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c0af820 con 0x7fd15c1508c0 2023-10-14T19:03:39.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd160bc1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c15aa40 con 0x7fd15c15a0c0 2023-10-14T19:03:39.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd159d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd15c150c90 0x7fd15c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd159d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd15c150c90 0x7fd15c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46544/0 (socket says 172.21.15.7:46544) 2023-10-14T19:03:39.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.211+0000 7fd159d9b700 1 -- 172.21.15.7:0/2856383181 learned_addr learned my addr 172.21.15.7:0/2856383181 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:39.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd15ad9d700 1 --2- 172.21.15.7:0/2856383181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c15a0c0 0x7fd15c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd15a59c700 1 --2- 172.21.15.7:0/2856383181 >> v2:172.21.15.148:3300/0 conn(0x7fd15c1508c0 0x7fd15c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd159d9b700 1 -- 172.21.15.7:0/2856383181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c15a0c0 msgr2=0x7fd15c15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd159d9b700 1 --2- 172.21.15.7:0/2856383181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c15a0c0 0x7fd15c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd159d9b700 1 -- 172.21.15.7:0/2856383181 >> v2:172.21.15.148:3300/0 conn(0x7fd15c1508c0 msgr2=0x7fd15c158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd159d9b700 1 --2- 172.21.15.7:0/2856383181 >> v2:172.21.15.148:3300/0 conn(0x7fd15c1508c0 0x7fd15c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd159d9b700 1 -- 172.21.15.7:0/2856383181 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c158c80 con 0x7fd15c150c90 2023-10-14T19:03:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd159d9b700 1 --2- 172.21.15.7:0/2856383181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0af2e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0aed00 tx=0x7fd14400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a495bf40344c9ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd15959a700 1 -- 172.21.15.7:0/2856383181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400dc50 con 0x7fd15c150c90 2023-10-14T19:03:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd15959a700 1 -- 172.21.15.7:0/2856383181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400ddb0 con 0x7fd15c150c90 2023-10-14T19:03:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.212+0000 7fd15959a700 1 -- 172.21.15.7:0/2856383181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1440196d0 con 0x7fd15c150c90 2023-10-14T19:03:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 -- 172.21.15.7:0/2856383181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 msgr2=0x7fd15c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 --2- 172.21.15.7:0/2856383181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0af2e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0aed00 tx=0x7fd14400b4f0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 -- 172.21.15.7:0/2856383181 shutdown_connections 2023-10-14T19:03:39.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 --2- 172.21.15.7:0/2856383181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c15a0c0 0x7fd15c15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 --2- 172.21.15.7:0/2856383181 >> v2:172.21.15.148:3300/0 conn(0x7fd15c1508c0 0x7fd15c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 --2- 172.21.15.7:0/2856383181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0af2e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 -- 172.21.15.7:0/2856383181 >> 172.21.15.7:0/2856383181 conn(0x7fd15c0cded0 msgr2=0x7fd15c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 -- 172.21.15.7:0/2856383181 shutdown_connections 2023-10-14T19:03:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.213+0000 7fd160bc1700 1 -- 172.21.15.7:0/2856383181 wait complete. 2023-10-14T19:03:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.214+0000 7fd160bc1700 1 Processor -- start 2023-10-14T19:03:39.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.214+0000 7fd160bc1700 1 -- start start 2023-10-14T19:03:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.214+0000 7fd160bc1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c1508c0 0x7fd15c153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.214+0000 7fd160bc1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.214+0000 7fd160bc1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c15a0c0 0x7fd15c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd160bc1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c152cd0 con 0x7fd15c150c90 2023-10-14T19:03:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd160bc1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c1536a0 con 0x7fd15c15a0c0 2023-10-14T19:03:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd160bc1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c8f40 con 0x7fd15c1508c0 2023-10-14T19:03:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46558/0 (socket says 172.21.15.7:46558) 2023-10-14T19:03:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 -- 172.21.15.7:0/3275262494 learned_addr learned my addr 172.21.15.7:0/3275262494 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd15a59c700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c1508c0 0x7fd15c153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd15ad9d700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c15a0c0 0x7fd15c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 -- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c1508c0 msgr2=0x7fd15c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c1508c0 0x7fd15c153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 -- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c15a0c0 msgr2=0x7fd15c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c15a0c0 0x7fd15c151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 -- 172.21.15.7:0/3275262494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14400b790 con 0x7fd15c150c90 2023-10-14T19:03:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd15a59c700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c1508c0 0x7fd15c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd159d9b700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0c8a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd15c06f240 tx=0x7fd14401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1440105c0 con 0x7fd15c150c90 2023-10-14T19:03:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144010720 con 0x7fd15c150c90 2023-10-14T19:03:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c1520c0 con 0x7fd15c150c90 2023-10-14T19:03:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144010ae0 con 0x7fd15c150c90 2023-10-14T19:03:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.215+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c152680 con 0x7fd15c150c90 2023-10-14T19:03:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.216+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c157f10 con 0x7fd15c150c90 2023-10-14T19:03:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.217+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd144022030 con 0x7fd15c150c90 2023-10-14T19:03:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.217+0000 7fd1527fc700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd13c066f30 0x7fd13c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.217+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd144014070 con 0x7fd15c150c90 2023-10-14T19:03:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.217+0000 7fd15a59c700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd13c066f30 0x7fd13c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.218+0000 7fd15a59c700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd13c066f30 0x7fd13c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd154006fd0 tx=0x7fd154008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.221+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1440559c0 con 0x7fd15c150c90 2023-10-14T19:03:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.415+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd15c04c3c0 con 0x7fd15c150c90 2023-10-14T19:03:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.416+0000 7fd1527fc700 1 -- 172.21.15.7:0/3275262494 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fd144058fe0 con 0x7fd15c150c90 2023-10-14T19:03:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:39.417 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:39.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd13c066f30 msgr2=0x7fd13c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd13c066f30 0x7fd13c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd154006fd0 tx=0x7fd154008040 comp rx=0 tx=0).stop 2023-10-14T19:03:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 msgr2=0x7fd15c0c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0c8a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd15c06f240 tx=0x7fd14401b000 comp rx=0 tx=0).stop 2023-10-14T19:03:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 shutdown_connections 2023-10-14T19:03:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd13c066f30 0x7fd13c0693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c15a0c0 0x7fd15c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd15c1508c0 0x7fd15c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 --2- 172.21.15.7:0/3275262494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd15c150c90 0x7fd15c0c8a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 >> 172.21.15.7:0/3275262494 conn(0x7fd15c0cded0 msgr2=0x7fd15c14fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 shutdown_connections 2023-10-14T19:03:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.418+0000 7fd160bc1700 1 -- 172.21.15.7:0/3275262494 wait complete. 2023-10-14T19:03:39.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:07.458368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:08.579730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:03:39.432 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.554+0000 7f1e89cc5700 1 Processor -- start 2023-10-14T19:03:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.554+0000 7f1e89cc5700 1 -- start start 2023-10-14T19:03:39.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e89cc5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e8415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e89cc5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8415ac50 con 0x7f1e84153dd0 2023-10-14T19:03:39.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e89cc5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8415d010 con 0x7f1e84153a00 2023-10-14T19:03:39.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e89cc5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8415af60 con 0x7f1e840cf110 2023-10-14T19:03:39.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e83fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1e84153dd0 0x7f1e840cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47690/0 (socket says 172.21.15.7:47690) 2023-10-14T19:03:39.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e83fff700 1 -- 172.21.15.7:0/199165709 learned_addr learned my addr 172.21.15.7:0/199165709 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:39.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e894c4700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e8415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412567018 0 0) 0x7f1e8415ac50 con 0x7f1e84153dd0 2023-10-14T19:03:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.555+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e70003570 con 0x7f1e84153dd0 2023-10-14T19:03:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3381874305 0 0) 0x7f1e70003570 con 0x7f1e84153dd0 2023-10-14T19:03:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 msgr2=0x7f1e8415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e8415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 >> v1:172.21.15.148:6789/0 conn(0x7f1e84153a00 legacy=0x7f1e8415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8415b240 con 0x7f1e84153dd0 2023-10-14T19:03:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f1e74001470 con 0x7f1e84153dd0 2023-10-14T19:03:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 >> v1:172.21.15.7:6789/0 conn(0x7f1e84153dd0 legacy=0x7f1e840cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e70003a90 0x7f1e70003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8415af60 con 0x7f1e70003a90 2023-10-14T19:03:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000bb70 con 0x7f1e70004d50 2023-10-14T19:03:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000bd30 con 0x7f1e840cf110 2023-10-14T19:03:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e70003a90 0x7f1e70003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e83fff700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e894c4700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 -- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 msgr2=0x7f1e70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 -- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70004d50 msgr2=0x7f1e700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 -- 172.21.15.7:0/199165709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70003570 con 0x7f1e70003a90 2023-10-14T19:03:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e83fff700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cf110 0x7f1e70004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e70003a90 0x7f1e70003ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c001fc0 tx=0x7f1e7c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaaf6fef1d00645b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c001950 con 0x7f1e70003a90 2023-10-14T19:03:39.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00c8b0 con 0x7f1e70003a90 2023-10-14T19:03:39.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.556+0000 7f1e837fe700 1 -- 172.21.15.7:0/199165709 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00cc50 con 0x7f1e70003a90 2023-10-14T19:03:39.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e89cc5700 1 -- 172.21.15.7:0/199165709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e70003a90 msgr2=0x7f1e70003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/199165709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e70003a90 0x7f1e70003ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c001fc0 tx=0x7f1e7c001640 comp rx=0 tx=0).stop 2023-10-14T19:03:39.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e894c4700 1 -- 172.21.15.7:0/199165709 reap_dead start 2023-10-14T19:03:39.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e89cc5700 1 -- 172.21.15.7:0/199165709 shutdown_connections 2023-10-14T19:03:39.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e89cc5700 1 -- 172.21.15.7:0/199165709 >> 172.21.15.7:0/199165709 conn(0x7f1e840703a0 msgr2=0x7f1e840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:39.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e89cc5700 1 -- 172.21.15.7:0/199165709 shutdown_connections 2023-10-14T19:03:39.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.557+0000 7f1e89cc5700 1 -- 172.21.15.7:0/199165709 wait complete. 2023-10-14T19:03:39.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.558+0000 7f1e89cc5700 1 Processor -- start 2023-10-14T19:03:39.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.558+0000 7f1e89cc5700 1 -- start start 2023-10-14T19:03:39.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e89cc5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70003a90 0x7f1e840c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e89cc5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cd540 0x7f1e8416d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e89cc5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 0x7f1e84158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e89cc5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8416ce10 con 0x7f1e84152ee0 2023-10-14T19:03:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e89cc5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84156b10 con 0x7f1e70003a90 2023-10-14T19:03:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e89cc5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84156db0 con 0x7f1e840cd540 2023-10-14T19:03:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 0x7f1e84158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 0x7f1e84158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46582/0 (socket says 172.21.15.7:46582) 2023-10-14T19:03:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 -- 172.21.15.7:0/2497725375 learned_addr learned my addr 172.21.15.7:0/2497725375 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70003a90 0x7f1e840c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e83fff700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cd540 0x7f1e8416d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 -- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cd540 msgr2=0x7f1e8416d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cd540 0x7f1e8416d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 -- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70003a90 msgr2=0x7f1e840c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70003a90 0x7f1e840c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e894c4700 1 -- 172.21.15.7:0/2497725375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84157090 con 0x7f1e84152ee0 2023-10-14T19:03:39.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.559+0000 7f1e83fff700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cd540 0x7f1e8416d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.560+0000 7f1e894c4700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 0x7f1e84158690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1e84088780 tx=0x7f1e6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.560+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c015670 con 0x7f1e84152ee0 2023-10-14T19:03:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.560+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0157f0 con 0x7f1e84152ee0 2023-10-14T19:03:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.560+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8416caa0 con 0x7f1e84152ee0 2023-10-14T19:03:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.560+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c015bb0 con 0x7f1e84152ee0 2023-10-14T19:03:39.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.560+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8416d7e0 con 0x7f1e84152ee0 2023-10-14T19:03:39.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.561+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8404c3c0 con 0x7f1e84152ee0 2023-10-14T19:03:39.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.561+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e6c01e400 con 0x7f1e84152ee0 2023-10-14T19:03:39.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.561+0000 7f1e80ff9700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.561+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e6c084720 con 0x7f1e84152ee0 2023-10-14T19:03:39.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.562+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.562+0000 7f1e88cc3700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e64066f30 0x7f1e640693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c001fc0 tx=0x7f1e7c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.566+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e6c051990 con 0x7f1e84152ee0 2023-10-14T19:03:39.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.757+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e8415b520 con 0x7f1e84152ee0 2023-10-14T19:03:39.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.757+0000 7f1e80ff9700 1 -- 172.21.15.7:0/2497725375 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e6c054fb0 con 0x7f1e84152ee0 2023-10-14T19:03:39.759 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:39.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e64066f30 msgr2=0x7f1e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e64066f30 0x7f1e640693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c001fc0 tx=0x7f1e7c015000 comp rx=0 tx=0).stop 2023-10-14T19:03:39.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 msgr2=0x7f1e84158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 0x7f1e84158690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1e84088780 tx=0x7f1e6c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:39.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 shutdown_connections 2023-10-14T19:03:39.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e70003a90 0x7f1e840c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e84152ee0 0x7f1e84158690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 --2- 172.21.15.7:0/2497725375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e840cd540 0x7f1e8416d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 >> 172.21.15.7:0/2497725375 conn(0x7f1e840703a0 msgr2=0x7f1e840c56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 shutdown_connections 2023-10-14T19:03:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.759+0000 7f1e89cc5700 1 -- 172.21.15.7:0/2497725375 wait complete. 2023-10-14T19:03:39.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:03:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.895+0000 7f2bb1c20700 1 Processor -- start 2023-10-14T19:03:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 -- start start 2023-10-14T19:03:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2bac159530 0x7f2bac0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2bac06e0e0 0x7f2bac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0ccfd0 con 0x7f2bac159530 2023-10-14T19:03:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0cf0e0 con 0x7f2bac06e0e0 2023-10-14T19:03:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bb1c20700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac15a3d0 con 0x7f2bac06dc70 2023-10-14T19:03:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.896+0000 7f2bab7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2bac159530 0x7f2bac0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2bac159530 0x7f2bac0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46598/0 (socket says 172.21.15.7:46598) 2023-10-14T19:03:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 -- 172.21.15.7:0/1173184117 learned_addr learned my addr 172.21.15.7:0/1173184117 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 -- 172.21.15.7:0/1173184117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 msgr2=0x7f2bac159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2babfff700 1 --2- 172.21.15.7:0/1173184117 >> v2:172.21.15.148:3300/0 conn(0x7f2bac06e0e0 0x7f2bac0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2baaffd700 1 --2- 172.21.15.7:0/1173184117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 --2- 172.21.15.7:0/1173184117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 -- 172.21.15.7:0/1173184117 >> v2:172.21.15.148:3300/0 conn(0x7f2bac06e0e0 msgr2=0x7f2bac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 --2- 172.21.15.7:0/1173184117 >> v2:172.21.15.148:3300/0 conn(0x7f2bac06e0e0 0x7f2bac0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 -- 172.21.15.7:0/1173184117 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac15a6b0 con 0x7f2bac159530 2023-10-14T19:03:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2babfff700 1 --2- 172.21.15.7:0/1173184117 >> v2:172.21.15.148:3300/0 conn(0x7f2bac06e0e0 0x7f2bac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2bab7fe700 1 --2- 172.21.15.7:0/1173184117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac159530 0x7f2bac0ceba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2bac089880 tx=0x7f2b9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e602d385ef1274ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2baa7fc700 1 -- 172.21.15.7:0/1173184117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00b860 con 0x7f2bac159530 2023-10-14T19:03:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2baa7fc700 1 -- 172.21.15.7:0/1173184117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00b9c0 con 0x7f2bac159530 2023-10-14T19:03:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.897+0000 7f2baa7fc700 1 -- 172.21.15.7:0/1173184117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00bd60 con 0x7f2bac159530 2023-10-14T19:03:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 -- 172.21.15.7:0/1173184117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac159530 msgr2=0x7f2bac0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/1173184117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac159530 0x7f2bac0ceba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2bac089880 tx=0x7f2b9c009250 comp rx=0 tx=0).stop 2023-10-14T19:03:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 -- 172.21.15.7:0/1173184117 shutdown_connections 2023-10-14T19:03:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/1173184117 >> v2:172.21.15.148:3300/0 conn(0x7f2bac06e0e0 0x7f2bac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/1173184117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac159530 0x7f2bac0ceba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/1173184117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 -- 172.21.15.7:0/1173184117 >> 172.21.15.7:0/1173184117 conn(0x7f2bac0703a0 msgr2=0x7f2bac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 -- 172.21.15.7:0/1173184117 shutdown_connections 2023-10-14T19:03:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.898+0000 7f2bb1c20700 1 -- 172.21.15.7:0/1173184117 wait complete. 2023-10-14T19:03:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.899+0000 7f2bb1c20700 1 Processor -- start 2023-10-14T19:03:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.899+0000 7f2bb1c20700 1 -- start start 2023-10-14T19:03:39.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 0x7f2bac0b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bac159530 0x7f2bac0b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0b35b0 con 0x7f2bac06e0e0 2023-10-14T19:03:39.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1521a0 con 0x7f2bac159530 2023-10-14T19:03:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0c98b0 con 0x7f2bac06dc70 2023-10-14T19:03:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 0x7f2bac0b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 0x7f2bac0b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46614/0 (socket says 172.21.15.7:46614) 2023-10-14T19:03:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 -- 172.21.15.7:0/3851129014 learned_addr learned my addr 172.21.15.7:0/3851129014 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2babfff700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bac159530 0x7f2bac0b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bab7fe700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 -- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 msgr2=0x7f2bac151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 -- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bac159530 msgr2=0x7f2bac0b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bac159530 0x7f2bac0b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 -- 172.21.15.7:0/3851129014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0094f0 con 0x7f2bac06e0e0 2023-10-14T19:03:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2baaffd700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 0x7f2bac0b59e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c800 tx=0x7f2ba0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0011600 con 0x7f2bac06e0e0 2023-10-14T19:03:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0011760 con 0x7f2bac06e0e0 2023-10-14T19:03:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac0c9b90 con 0x7f2bac06e0e0 2023-10-14T19:03:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0011b20 con 0x7f2bac06e0e0 2023-10-14T19:03:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.900+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac0ca150 con 0x7f2bac06e0e0 2023-10-14T19:03:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.901+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac0b3760 con 0x7f2bac06e0e0 2023-10-14T19:03:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.902+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ba00193f0 con 0x7f2bac06e0e0 2023-10-14T19:03:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.902+0000 7f2b937fe700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b98066f30 0x7f2b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.902+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ba0084a00 con 0x7f2bac06e0e0 2023-10-14T19:03:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.903+0000 7f2bab7fe700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b98066f30 0x7f2b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.903+0000 7f2bab7fe700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b98066f30 0x7f2b980693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bac089880 tx=0x7f2b9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:39.906+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bac0b3760 con 0x7f2bac06e0e0 2023-10-14T19:03:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.096+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bac04c3c0 con 0x7f2bac06e0e0 2023-10-14T19:03:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.097+0000 7f2b937fe700 1 -- 172.21.15.7:0/3851129014 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ba0051bd0 con 0x7f2bac06e0e0 2023-10-14T19:03:40.098 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:03:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b98066f30 msgr2=0x7f2b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b98066f30 0x7f2b980693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bac089880 tx=0x7f2b9c017000 comp rx=0 tx=0).stop 2023-10-14T19:03:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 msgr2=0x7f2bac0b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 0x7f2bac0b59e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c800 tx=0x7f2ba0008040 comp rx=0 tx=0).stop 2023-10-14T19:03:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 shutdown_connections 2023-10-14T19:03:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b98066f30 0x7f2b980693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bac159530 0x7f2bac0b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bac06dc70 0x7f2bac151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 --2- 172.21.15.7:0/3851129014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac06e0e0 0x7f2bac0b59e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 >> 172.21.15.7:0/3851129014 conn(0x7f2bac0703a0 msgr2=0x7f2bac0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 shutdown_connections 2023-10-14T19:03:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.099+0000 7f2bb1c20700 1 -- 172.21.15.7:0/3851129014 wait complete. 2023-10-14T19:03:40.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:03:40.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 Processor -- start 2023-10-14T19:03:40.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 -- start start 2023-10-14T19:03:40.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa1e806dc70 0x7fa1e8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e80ccfd0 con 0x7fa1e806e0e0 2023-10-14T19:03:40.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e80cf0e0 con 0x7fa1e806dc70 2023-10-14T19:03:40.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.234+0000 7fa1eed03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e815a3d0 con 0x7fa1e8159530 2023-10-14T19:03:40.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1ed2a0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa1e806e0e0 0x7fa1e80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47692/0 (socket says 172.21.15.7:47692) 2023-10-14T19:03:40.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1ed2a0700 1 -- 172.21.15.7:0/576971700 learned_addr learned my addr 172.21.15.7:0/576971700 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:40.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1e7fff700 1 --2- 172.21.15.7:0/576971700 >> v2:172.21.15.148:3300/0 conn(0x7fa1e806dc70 0x7fa1e8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1eca9f700 1 --2- 172.21.15.7:0/576971700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1e77fe700 1 -- 172.21.15.7:0/576971700 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245714221 0 0) 0x7fa1e80ccfd0 con 0x7fa1e806e0e0 2023-10-14T19:03:40.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1e77fe700 1 -- 172.21.15.7:0/576971700 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d4003570 con 0x7fa1e806e0e0 2023-10-14T19:03:40.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1eca9f700 1 -- 172.21.15.7:0/576971700 >> v2:172.21.15.148:3300/0 conn(0x7fa1e806dc70 msgr2=0x7fa1e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:40.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1eca9f700 1 --2- 172.21.15.7:0/576971700 >> v2:172.21.15.148:3300/0 conn(0x7fa1e806dc70 0x7fa1e8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1eca9f700 1 -- 172.21.15.7:0/576971700 >> v1:172.21.15.7:6789/0 conn(0x7fa1e806e0e0 legacy=0x7fa1e80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1eca9f700 1 -- 172.21.15.7:0/576971700 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e815a6b0 con 0x7fa1e8159530 2023-10-14T19:03:40.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1eca9f700 1 --2- 172.21.15.7:0/576971700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e80ceba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009e60 tx=0x7fa1e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbe4c84be2a397e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1e77fe700 1 -- 172.21.15.7:0/576971700 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000e070 con 0x7fa1e8159530 2023-10-14T19:03:40.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1e77fe700 1 -- 172.21.15.7:0/576971700 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e000bab0 con 0x7fa1e8159530 2023-10-14T19:03:40.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.235+0000 7fa1e77fe700 1 -- 172.21.15.7:0/576971700 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000be70 con 0x7fa1e8159530 2023-10-14T19:03:40.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 -- 172.21.15.7:0/576971700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 msgr2=0x7fa1e80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 --2- 172.21.15.7:0/576971700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e80ceba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009e60 tx=0x7fa1e0009780 comp rx=0 tx=0).stop 2023-10-14T19:03:40.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 -- 172.21.15.7:0/576971700 shutdown_connections 2023-10-14T19:03:40.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 --2- 172.21.15.7:0/576971700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e80ceba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 --2- 172.21.15.7:0/576971700 >> v2:172.21.15.148:3300/0 conn(0x7fa1e806dc70 0x7fa1e8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 -- 172.21.15.7:0/576971700 >> 172.21.15.7:0/576971700 conn(0x7fa1e80703a0 msgr2=0x7fa1e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:40.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 -- 172.21.15.7:0/576971700 shutdown_connections 2023-10-14T19:03:40.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.236+0000 7fa1eed03700 1 -- 172.21.15.7:0/576971700 wait complete. 2023-10-14T19:03:40.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.237+0000 7fa1eed03700 1 Processor -- start 2023-10-14T19:03:40.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.237+0000 7fa1eed03700 1 -- start start 2023-10-14T19:03:40.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eed03700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 0x7fa1e8169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eed03700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1e806e0e0 0x7fa1e816c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eed03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e8151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eed03700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e816a020 con 0x7fa1e806dc70 2023-10-14T19:03:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eed03700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e816cea0 con 0x7fa1e806e0e0 2023-10-14T19:03:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eed03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80c91c0 con 0x7fa1e8159530 2023-10-14T19:03:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 0x7fa1e8169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 0x7fa1e8169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46624/0 (socket says 172.21.15.7:46624) 2023-10-14T19:03:40.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 -- 172.21.15.7:0/1551929449 learned_addr learned my addr 172.21.15.7:0/1551929449 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:40.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 -- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 msgr2=0x7fa1e8151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1ed2a0700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e8151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1e7fff700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1e806e0e0 0x7fa1e816c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e8151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 -- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1e806e0e0 msgr2=0x7fa1e816c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1e806e0e0 0x7fa1e816c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.238+0000 7fa1eca9f700 1 -- 172.21.15.7:0/1551929449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e0009a20 con 0x7fa1e806dc70 2023-10-14T19:03:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.239+0000 7fa1eca9f700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 0x7fa1e8169ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00097c0 tx=0x7fa1e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.239+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0012d00 con 0x7fa1e806dc70 2023-10-14T19:03:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.239+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0012e80 con 0x7fa1e806dc70 2023-10-14T19:03:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.239+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e80ca930 con 0x7fa1e806dc70 2023-10-14T19:03:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.239+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00276c0 con 0x7fa1e806dc70 2023-10-14T19:03:40.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.239+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e80c88a0 con 0x7fa1e806dc70 2023-10-14T19:03:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.240+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e804c3c0 con 0x7fa1e806dc70 2023-10-14T19:03:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.240+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1e0024070 con 0x7fa1e806dc70 2023-10-14T19:03:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.240+0000 7fa1e4ff9700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa1c8066f30 0x7fa1c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.240+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1e0086c30 con 0x7fa1e806dc70 2023-10-14T19:03:40.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.241+0000 7fa1e7fff700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa1c8066f30 0x7fa1c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.241+0000 7fa1e7fff700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa1c8066f30 0x7fa1c80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80093f0 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.245+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1e0053ea0 con 0x7fa1e806dc70 2023-10-14T19:03:40.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.435+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1e815aa20 con 0x7fa1e806dc70 2023-10-14T19:03:40.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.436+0000 7fa1e4ff9700 1 -- 172.21.15.7:0/1551929449 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa1e002c070 con 0x7fa1e806dc70 2023-10-14T19:03:40.437 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:03:40.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa1c8066f30 msgr2=0x7fa1c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa1c8066f30 0x7fa1c80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80093f0 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2023-10-14T19:03:40.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 msgr2=0x7fa1e8169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 0x7fa1e8169ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00097c0 tx=0x7fa1e0019000 comp rx=0 tx=0).stop 2023-10-14T19:03:40.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 shutdown_connections 2023-10-14T19:03:40.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa1c8066f30 0x7fa1c80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1e8159530 0x7fa1e8151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1e806dc70 0x7fa1e8169ae0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 --2- 172.21.15.7:0/1551929449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1e806e0e0 0x7fa1e816c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 >> 172.21.15.7:0/1551929449 conn(0x7fa1e80703a0 msgr2=0x7fa1e80b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:40.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 shutdown_connections 2023-10-14T19:03:40.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.438+0000 7fa1eed03700 1 -- 172.21.15.7:0/1551929449 wait complete. 2023-10-14T19:03:40.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:40.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.569+0000 7fe966836700 1 Processor -- start 2023-10-14T19:03:40.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.569+0000 7fe966836700 1 -- start start 2023-10-14T19:03:40.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe966836700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9600cb970 0x7fe960159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe966836700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe96015a400 0x7fe960156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe966836700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96015ae40 con 0x7fe9600cb5a0 2023-10-14T19:03:40.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe966836700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9600ce0f0 con 0x7fe9600cb970 2023-10-14T19:03:40.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe966836700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9600d13f0 con 0x7fe96015a400 2023-10-14T19:03:40.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe95f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9600cb970 0x7fe960159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe95f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9600cb970 0x7fe960159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46632/0 (socket says 172.21.15.7:46632) 2023-10-14T19:03:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe95f7fe700 1 -- 172.21.15.7:0/298327087 learned_addr learned my addr 172.21.15.7:0/298327087 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.570+0000 7fe964dd3700 1 --2- 172.21.15.7:0/298327087 >> v2:172.21.15.148:3300/0 conn(0x7fe96015a400 0x7fe960156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95f7fe700 1 -- 172.21.15.7:0/298327087 >> v2:172.21.15.148:3300/0 conn(0x7fe96015a400 msgr2=0x7fe960156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95f7fe700 1 --2- 172.21.15.7:0/298327087 >> v2:172.21.15.148:3300/0 conn(0x7fe96015a400 0x7fe960156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95f7fe700 1 -- 172.21.15.7:0/298327087 >> v1:172.21.15.148:6789/0 conn(0x7fe9600cb5a0 legacy=0x7fe9600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95f7fe700 1 -- 172.21.15.7:0/298327087 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96015ab60 con 0x7fe9600cb970 2023-10-14T19:03:40.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95f7fe700 1 --2- 172.21.15.7:0/298327087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb970 0x7fe960159ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9600ccdf0 tx=0x7fe950009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d1c59f1afaa77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95effd700 1 -- 172.21.15.7:0/298327087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950009e70 con 0x7fe9600cb970 2023-10-14T19:03:40.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95effd700 1 -- 172.21.15.7:0/298327087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95000b860 con 0x7fe9600cb970 2023-10-14T19:03:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe95effd700 1 -- 172.21.15.7:0/298327087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000bc00 con 0x7fe9600cb970 2023-10-14T19:03:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe966836700 1 -- 172.21.15.7:0/298327087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb970 msgr2=0x7fe960159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe966836700 1 --2- 172.21.15.7:0/298327087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb970 0x7fe960159ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9600ccdf0 tx=0x7fe950009250 comp rx=0 tx=0).stop 2023-10-14T19:03:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe966836700 1 -- 172.21.15.7:0/298327087 shutdown_connections 2023-10-14T19:03:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe966836700 1 --2- 172.21.15.7:0/298327087 >> v2:172.21.15.148:3300/0 conn(0x7fe96015a400 0x7fe960156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.571+0000 7fe966836700 1 --2- 172.21.15.7:0/298327087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb970 0x7fe960159ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.572+0000 7fe966836700 1 -- 172.21.15.7:0/298327087 >> 172.21.15.7:0/298327087 conn(0x7fe960070e30 msgr2=0x7fe9600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:40.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.572+0000 7fe966836700 1 -- 172.21.15.7:0/298327087 shutdown_connections 2023-10-14T19:03:40.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.572+0000 7fe966836700 1 -- 172.21.15.7:0/298327087 wait complete. 2023-10-14T19:03:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.573+0000 7fe966836700 1 Processor -- start 2023-10-14T19:03:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.573+0000 7fe966836700 1 -- start start 2023-10-14T19:03:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 0x7fe960151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9600cb970 0x7fe9600b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96015a400 0x7fe9600b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600b3ba0 con 0x7fe9600cb5a0 2023-10-14T19:03:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600ca7e0 con 0x7fe96015a400 2023-10-14T19:03:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600ca500 con 0x7fe9600cb970 2023-10-14T19:03:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 0x7fe960151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 0x7fe960151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46646/0 (socket says 172.21.15.7:46646) 2023-10-14T19:03:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 -- 172.21.15.7:0/2011194437 learned_addr learned my addr 172.21.15.7:0/2011194437 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe964dd3700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96015a400 0x7fe9600b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95f7fe700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9600cb970 0x7fe9600b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 -- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9600cb970 msgr2=0x7fe9600b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9600cb970 0x7fe9600b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 -- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96015a400 msgr2=0x7fe9600b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96015a400 0x7fe9600b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 -- 172.21.15.7:0/2011194437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9500094f0 con 0x7fe9600cb5a0 2023-10-14T19:03:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe95ffff700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 0x7fe960151120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c590 tx=0x7fe94800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948011590 con 0x7fe9600cb5a0 2023-10-14T19:03:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948011710 con 0x7fe9600cb5a0 2023-10-14T19:03:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9600b3550 con 0x7fe9600cb5a0 2023-10-14T19:03:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948011ad0 con 0x7fe9600cb5a0 2023-10-14T19:03:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.574+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe960151660 con 0x7fe9600cb5a0 2023-10-14T19:03:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.575+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe960151850 con 0x7fe9600cb5a0 2023-10-14T19:03:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.576+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe94801b3b0 con 0x7fe9600cb5a0 2023-10-14T19:03:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.576+0000 7fe957fff700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe940066f30 0x7fe9400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.576+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9480839c0 con 0x7fe9600cb5a0 2023-10-14T19:03:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.576+0000 7fe95f7fe700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe940066f30 0x7fe9400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.577+0000 7fe95f7fe700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe940066f30 0x7fe9400693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe9600ccdf0 tx=0x7fe950017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.581+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe948050c30 con 0x7fe9600cb5a0 2023-10-14T19:03:40.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.819+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe96004c3c0 con 0x7fe9600cb5a0 2023-10-14T19:03:40.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.820+0000 7fe957fff700 1 -- 172.21.15.7:0/2011194437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fe948017070 con 0x7fe9600cb5a0 2023-10-14T19:03:40.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:40.822 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe940066f30 msgr2=0x7fe9400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe940066f30 0x7fe9400693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe9600ccdf0 tx=0x7fe950017000 comp rx=0 tx=0).stop 2023-10-14T19:03:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 msgr2=0x7fe960151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 0x7fe960151120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c590 tx=0x7fe94800c8a0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 shutdown_connections 2023-10-14T19:03:40.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe940066f30 0x7fe9400693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96015a400 0x7fe9600b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9600cb5a0 0x7fe960151120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 --2- 172.21.15.7:0/2011194437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9600cb970 0x7fe9600b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 >> 172.21.15.7:0/2011194437 conn(0x7fe960070e30 msgr2=0x7fe9600cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 shutdown_connections 2023-10-14T19:03:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.822+0000 7fe966836700 1 -- 172.21.15.7:0/2011194437 wait complete. 2023-10-14T19:03:40.826 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:40.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.954+0000 7f02b7bd8700 1 Processor -- start 2023-10-14T19:03:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.954+0000 7f02b7bd8700 1 -- start start 2023-10-14T19:03:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b7bd8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00aee90 0x7f02b00a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b7bd8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02b006d280 0x7f02b00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b7bd8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b00ce1a0 con 0x7f02b00a8be0 2023-10-14T19:03:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b7bd8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00cd5d0 con 0x7f02b006d280 2023-10-14T19:03:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b7bd8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00cd870 con 0x7f02b00aee90 2023-10-14T19:03:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02b006d280 0x7f02b00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02b006d280 0x7f02b00b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46652/0 (socket says 172.21.15.7:46652) 2023-10-14T19:03:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 -- 172.21.15.7:0/1819755168 learned_addr learned my addr 172.21.15.7:0/1819755168 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b5173700 1 --2- 172.21.15.7:0/1819755168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00aee90 0x7f02b00a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 -- 172.21.15.7:0/1819755168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00aee90 msgr2=0x7f02b00a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 --2- 172.21.15.7:0/1819755168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00aee90 0x7f02b00a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 -- 172.21.15.7:0/1819755168 >> v1:172.21.15.148:6789/0 conn(0x7f02b00a8be0 legacy=0x7f02b00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.955+0000 7f02b6175700 1 -- 172.21.15.7:0/1819755168 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00cdb50 con 0x7f02b006d280 2023-10-14T19:03:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b6175700 1 --2- 172.21.15.7:0/1819755168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b006d280 0x7f02b00b08c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02a80099b0 tx=0x7f02a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386985dfce030fea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b4972700 1 -- 172.21.15.7:0/1819755168 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800b8b0 con 0x7f02b006d280 2023-10-14T19:03:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b4972700 1 -- 172.21.15.7:0/1819755168 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800ba10 con 0x7f02b006d280 2023-10-14T19:03:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b4972700 1 -- 172.21.15.7:0/1819755168 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800bdb0 con 0x7f02b006d280 2023-10-14T19:03:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 -- 172.21.15.7:0/1819755168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b006d280 msgr2=0x7f02b00b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/1819755168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b006d280 0x7f02b00b08c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02a80099b0 tx=0x7f02a8009250 comp rx=0 tx=0).stop 2023-10-14T19:03:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 -- 172.21.15.7:0/1819755168 shutdown_connections 2023-10-14T19:03:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/1819755168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b006d280 0x7f02b00b08c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/1819755168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00aee90 0x7f02b00a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 -- 172.21.15.7:0/1819755168 >> 172.21.15.7:0/1819755168 conn(0x7f02b006ce80 msgr2=0x7f02b00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 -- 172.21.15.7:0/1819755168 shutdown_connections 2023-10-14T19:03:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.956+0000 7f02b7bd8700 1 -- 172.21.15.7:0/1819755168 wait complete. 2023-10-14T19:03:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.957+0000 7f02b7bd8700 1 Processor -- start 2023-10-14T19:03:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.957+0000 7f02b7bd8700 1 -- start start 2023-10-14T19:03:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b7bd8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02b006d280 0x7f02b01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b7bd8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00a8be0 0x7f02b0167890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b7bd8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 0x7f02b0167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b7bd8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015c3b0 con 0x7f02b00aee90 2023-10-14T19:03:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b7bd8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015b7a0 con 0x7f02b006d280 2023-10-14T19:03:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b7bd8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015ba80 con 0x7f02b00a8be0 2023-10-14T19:03:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b6175700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 0x7f02b0167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b6175700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 0x7f02b0167dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46654/0 (socket says 172.21.15.7:46654) 2023-10-14T19:03:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b6175700 1 -- 172.21.15.7:0/913269951 learned_addr learned my addr 172.21.15.7:0/913269951 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b5173700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00a8be0 0x7f02b0167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.958+0000 7f02b5974700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02b006d280 0x7f02b01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b6175700 1 -- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00a8be0 msgr2=0x7f02b0167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b6175700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00a8be0 0x7f02b0167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b6175700 1 -- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02b006d280 msgr2=0x7f02b01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b6175700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02b006d280 0x7f02b01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b6175700 1 -- 172.21.15.7:0/913269951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80094f0 con 0x7f02b00aee90 2023-10-14T19:03:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b6175700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 0x7f02b0167dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f02a80094c0 tx=0x7f02a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8011ea0 con 0x7f02b00aee90 2023-10-14T19:03:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a8020070 con 0x7f02b00aee90 2023-10-14T19:03:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a801b6a0 con 0x7f02b00aee90 2023-10-14T19:03:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b015bd60 con 0x7f02b00aee90 2023-10-14T19:03:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.959+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b0156ef0 con 0x7f02b00aee90 2023-10-14T19:03:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.960+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b015c520 con 0x7f02b00aee90 2023-10-14T19:03:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.961+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02a8022030 con 0x7f02b00aee90 2023-10-14T19:03:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.961+0000 7f02a5ffb700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0294066f60 0x7f0294069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.961+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02a8086360 con 0x7f02b00aee90 2023-10-14T19:03:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.961+0000 7f02b5974700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0294066f60 0x7f0294069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.962+0000 7f02b5974700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0294066f60 0x7f0294069410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00f430 tx=0x7f02ac002ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:40.965+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02a80535d0 con 0x7f02b00aee90 2023-10-14T19:03:41.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.158+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02b004c3c0 con 0x7f02b00aee90 2023-10-14T19:03:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.159+0000 7f02a5ffb700 1 -- 172.21.15.7:0/913269951 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f02a8056bf0 con 0x7f02b00aee90 2023-10-14T19:03:41.161 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:41.161 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:41.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0294066f60 msgr2=0x7f0294069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0294066f60 0x7f0294069410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00f430 tx=0x7f02ac002ad0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 msgr2=0x7f02b0167dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 0x7f02b0167dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f02a80094c0 tx=0x7f02a8016000 comp rx=0 tx=0).stop 2023-10-14T19:03:41.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 shutdown_connections 2023-10-14T19:03:41.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0294066f60 0x7f0294069410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02b006d280 0x7f02b01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b00aee90 0x7f02b0167dd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 --2- 172.21.15.7:0/913269951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02b00a8be0 0x7f02b0167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 >> 172.21.15.7:0/913269951 conn(0x7f02b006ce80 msgr2=0x7f02b0067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:41.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 shutdown_connections 2023-10-14T19:03:41.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.161+0000 7f02b7bd8700 1 -- 172.21.15.7:0/913269951 wait complete. 2023-10-14T19:03:41.175 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:03:41.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:41.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.294+0000 7fb6c6597700 1 Processor -- start 2023-10-14T19:03:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.294+0000 7fb6c6597700 1 -- start start 2023-10-14T19:03:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6c6597700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb6c00cb5a0 0x7fb6c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6c6597700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c015a5d0 0x7fb6c0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6c6597700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c015ae40 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6c6597700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c00d13f0 con 0x7fb6c00cb5a0 2023-10-14T19:03:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6c6597700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c015ab60 con 0x7fb6c015a5d0 2023-10-14T19:03:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6bf7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb6c00cd9e0 0x7fb6c0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47700/0 (socket says 172.21.15.7:47700) 2023-10-14T19:03:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6bf7fe700 1 -- 172.21.15.7:0/2656000526 learned_addr learned my addr 172.21.15.7:0/2656000526 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6bffff700 1 --2- 172.21.15.7:0/2656000526 >> v2:172.21.15.148:3300/0 conn(0x7fb6c00cb5a0 0x7fb6c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6c4b34700 1 --2- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c015a5d0 0x7fb6c0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.295+0000 7fb6beffd700 1 -- 172.21.15.7:0/2656000526 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793011411 0 0) 0x7fb6c015ae40 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6beffd700 1 -- 172.21.15.7:0/2656000526 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a8003570 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6bffff700 1 -- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c015a5d0 msgr2=0x7fb6c0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6bffff700 1 --2- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c015a5d0 0x7fb6c0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6bffff700 1 -- 172.21.15.7:0/2656000526 >> v1:172.21.15.7:6789/0 conn(0x7fb6c00cd9e0 legacy=0x7fb6c0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6beffd700 1 -- 172.21.15.7:0/2656000526 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3872042141 0 0) 0x7fb6a8003570 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6bffff700 1 -- 172.21.15.7:0/2656000526 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00ccf00 con 0x7fb6c00cb5a0 2023-10-14T19:03:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6bffff700 1 --2- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c00cb5a0 0x7fb6c00cb970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009910 tx=0x7fb6b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71afcbd3d25d6e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6beffd700 1 -- 172.21.15.7:0/2656000526 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4001470 con 0x7fb6c00cb5a0 2023-10-14T19:03:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6beffd700 1 -- 172.21.15.7:0/2656000526 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b0011420 con 0x7fb6c00cb5a0 2023-10-14T19:03:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.296+0000 7fb6beffd700 1 -- 172.21.15.7:0/2656000526 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00117a0 con 0x7fb6c00cb5a0 2023-10-14T19:03:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 -- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c00cb5a0 msgr2=0x7fb6c00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 --2- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c00cb5a0 0x7fb6c00cb970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009910 tx=0x7fb6b00091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 -- 172.21.15.7:0/2656000526 shutdown_connections 2023-10-14T19:03:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 --2- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c00cb5a0 0x7fb6c00cb970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 --2- 172.21.15.7:0/2656000526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c015a5d0 0x7fb6c0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 -- 172.21.15.7:0/2656000526 >> 172.21.15.7:0/2656000526 conn(0x7fb6c0070e30 msgr2=0x7fb6c00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 -- 172.21.15.7:0/2656000526 shutdown_connections 2023-10-14T19:03:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.297+0000 7fb6c6597700 1 -- 172.21.15.7:0/2656000526 wait complete. 2023-10-14T19:03:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.298+0000 7fb6c6597700 1 Processor -- start 2023-10-14T19:03:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.298+0000 7fb6c6597700 1 -- start start 2023-10-14T19:03:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c00cb5a0 0x7fb6c01526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 0x7fb6c0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c015a5d0 0x7fb6c00c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c00b56b0 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0153ee0 con 0x7fb6c015a5d0 2023-10-14T19:03:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c00b4aa0 con 0x7fb6c00cb5a0 2023-10-14T19:03:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 0x7fb6c0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 0x7fb6c0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46658/0 (socket says 172.21.15.7:46658) 2023-10-14T19:03:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 -- 172.21.15.7:0/233479945 learned_addr learned my addr 172.21.15.7:0/233479945 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bffff700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c00cb5a0 0x7fb6c01526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c4b34700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c015a5d0 0x7fb6c00c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 -- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c00cb5a0 msgr2=0x7fb6c01526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c00cb5a0 0x7fb6c01526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 -- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c015a5d0 msgr2=0x7fb6c00c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c015a5d0 0x7fb6c00c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 -- 172.21.15.7:0/233479945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b0009420 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6bf7fe700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 0x7fb6c0151470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400cb90 tx=0x7fb6b4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4007360 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c00b4d80 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40074e0 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4004830 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.299+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c00b5340 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.300+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c004c3c0 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.301+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6b4004bc0 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.302+0000 7fb6a7fff700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ac066f30 0x7fb6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.302+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6b4084290 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.302+0000 7fb6bffff700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ac066f30 0x7fb6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.302+0000 7fb6bffff700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ac066f30 0x7fb6ac0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00091e0 tx=0x7fb6b0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.305+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6b4051580 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.541+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6c00cd1e0 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.542+0000 7fb6a7fff700 1 -- 172.21.15.7:0/233479945 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fb6b4018020 con 0x7fb6c00cd9e0 2023-10-14T19:03:41.543 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:41.543 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:41.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ac066f30 msgr2=0x7fb6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ac066f30 0x7fb6ac0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00091e0 tx=0x7fb6b0016000 comp rx=0 tx=0).stop 2023-10-14T19:03:41.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 msgr2=0x7fb6c0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 0x7fb6c0151470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400cb90 tx=0x7fb6b4001b50 comp rx=0 tx=0).stop 2023-10-14T19:03:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 shutdown_connections 2023-10-14T19:03:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ac066f30 0x7fb6ac0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6c015a5d0 0x7fb6c00c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6c00cb5a0 0x7fb6c01526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 --2- 172.21.15.7:0/233479945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c00cd9e0 0x7fb6c0151470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 >> 172.21.15.7:0/233479945 conn(0x7fb6c0070e30 msgr2=0x7fb6c01552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 shutdown_connections 2023-10-14T19:03:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.544+0000 7fb6c6597700 1 -- 172.21.15.7:0/233479945 wait complete. 2023-10-14T19:03:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:41.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:41.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.676+0000 7fac67f03700 1 Processor -- start 2023-10-14T19:03:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.676+0000 7fac67f03700 1 -- start start 2023-10-14T19:03:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac67f03700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac600cb5a0 0x7fac600cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac67f03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac6015a5d0 0x7fac60156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac67f03700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6015ae40 con 0x7fac600cd9e0 2023-10-14T19:03:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac67f03700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600d13f0 con 0x7fac600cb5a0 2023-10-14T19:03:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac67f03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015ab60 con 0x7fac6015a5d0 2023-10-14T19:03:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac664a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac6015a5d0 0x7fac60156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac65c9f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac600cb5a0 0x7fac600cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac6549e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fac600cd9e0 0x7fac60159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45006/0 (socket says 172.21.15.7:45006) 2023-10-14T19:03:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac6549e700 1 -- 172.21.15.7:0/3722232913 learned_addr learned my addr 172.21.15.7:0/3722232913 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac65c9f700 1 -- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac6015a5d0 msgr2=0x7fac60156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac65c9f700 1 --2- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac6015a5d0 0x7fac60156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac65c9f700 1 -- 172.21.15.7:0/3722232913 >> v1:172.21.15.148:6789/0 conn(0x7fac600cd9e0 legacy=0x7fac60159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac65c9f700 1 -- 172.21.15.7:0/3722232913 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600ccf00 con 0x7fac600cb5a0 2023-10-14T19:03:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac64c9d700 1 -- 172.21.15.7:0/3722232913 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309822679 0 0) 0x7fac6015ae40 con 0x7fac600cd9e0 2023-10-14T19:03:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.677+0000 7fac664a0700 1 --2- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac6015a5d0 0x7fac60156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac65c9f700 1 --2- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac600cb970 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac58009910 tx=0x7fac580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d332d8711177ccca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac64c9d700 1 -- 172.21.15.7:0/3722232913 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800b640 con 0x7fac600cb5a0 2023-10-14T19:03:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac64c9d700 1 -- 172.21.15.7:0/3722232913 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800b7a0 con 0x7fac600cb5a0 2023-10-14T19:03:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac64c9d700 1 -- 172.21.15.7:0/3722232913 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800bb60 con 0x7fac600cb5a0 2023-10-14T19:03:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 -- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 msgr2=0x7fac600cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 --2- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac600cb970 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac58009910 tx=0x7fac580091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 -- 172.21.15.7:0/3722232913 shutdown_connections 2023-10-14T19:03:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 --2- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac6015a5d0 0x7fac60156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 --2- 172.21.15.7:0/3722232913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac600cb970 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 -- 172.21.15.7:0/3722232913 >> 172.21.15.7:0/3722232913 conn(0x7fac60070e30 msgr2=0x7fac600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:41.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 -- 172.21.15.7:0/3722232913 shutdown_connections 2023-10-14T19:03:41.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.678+0000 7fac67f03700 1 -- 172.21.15.7:0/3722232913 wait complete. 2023-10-14T19:03:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.679+0000 7fac67f03700 1 Processor -- start 2023-10-14T19:03:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.679+0000 7fac67f03700 1 -- start start 2023-10-14T19:03:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac67f03700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac60155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac67f03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac600cd9e0 0x7fac60156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac67f03700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 0x7fac60158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac67f03700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac60152ac0 con 0x7fac6015a5d0 2023-10-14T19:03:41.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac67f03700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac600c89a0 con 0x7fac600cb5a0 2023-10-14T19:03:41.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac67f03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600c7d90 con 0x7fac600cd9e0 2023-10-14T19:03:41.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac664a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 0x7fac60158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac664a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 0x7fac60158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46662/0 (socket says 172.21.15.7:46662) 2023-10-14T19:03:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac664a0700 1 -- 172.21.15.7:0/3151388252 learned_addr learned my addr 172.21.15.7:0/3151388252 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac65c9f700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac60155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.680+0000 7fac6549e700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac600cd9e0 0x7fac60156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac664a0700 1 -- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac600cd9e0 msgr2=0x7fac60156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac664a0700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac600cd9e0 0x7fac60156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac664a0700 1 -- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 msgr2=0x7fac60155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac664a0700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac60155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac664a0700 1 -- 172.21.15.7:0/3151388252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50009a20 con 0x7fac6015a5d0 2023-10-14T19:03:41.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac664a0700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 0x7fac60158860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac50009f50 tx=0x7fac5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:41.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5000cb50 con 0x7fac6015a5d0 2023-10-14T19:03:41.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5000f040 con 0x7fac6015a5d0 2023-10-14T19:03:41.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac58009420 con 0x7fac6015a5d0 2023-10-14T19:03:41.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50014480 con 0x7fac6015a5d0 2023-10-14T19:03:41.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.681+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac600c8350 con 0x7fac6015a5d0 2023-10-14T19:03:41.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.682+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6004c3c0 con 0x7fac6015a5d0 2023-10-14T19:03:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.682+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac50003020 con 0x7fac6015a5d0 2023-10-14T19:03:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.683+0000 7fac5dffb700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac4c066f30 0x7fac4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.683+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac50084d50 con 0x7fac6015a5d0 2023-10-14T19:03:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.683+0000 7fac65c9f700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac4c066f30 0x7fac4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.683+0000 7fac65c9f700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac4c066f30 0x7fac4c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac580091e0 tx=0x7fac58017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.687+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac50088030 con 0x7fac6015a5d0 2023-10-14T19:03:41.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.924+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac600cd240 con 0x7fac6015a5d0 2023-10-14T19:03:41.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.925+0000 7fac5dffb700 1 -- 172.21.15.7:0/3151388252 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fac50051fc0 con 0x7fac6015a5d0 2023-10-14T19:03:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:41.926 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3143458592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3143458592},{"type":"v1","addr":"172.21.15.148:6837","nonce":3143458592}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3100614063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3100614063},{"type":"v1","addr":"172.21.15.7:6834","nonce":3100614063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/736348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":736348006},{"type":"v1","addr":"172.21.15.7:6835","nonce":736348006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:09.608348+0000","modified":"2023-10-14T19:03:13.232313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/4287852448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4287852448},{"type":"v1","addr":"172.21.15.148:6836","nonce":4287852448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T19:03:41.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac4c066f30 msgr2=0x7fac4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac4c066f30 0x7fac4c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac580091e0 tx=0x7fac58017000 comp rx=0 tx=0).stop 2023-10-14T19:03:41.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 msgr2=0x7fac60158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:41.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 0x7fac60158860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac50009f50 tx=0x7fac5000b040 comp rx=0 tx=0).stop 2023-10-14T19:03:41.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 shutdown_connections 2023-10-14T19:03:41.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac4c066f30 0x7fac4c0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac600cb5a0 0x7fac60155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac6015a5d0 0x7fac60158860 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 --2- 172.21.15.7:0/3151388252 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac600cd9e0 0x7fac60156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:41.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 >> 172.21.15.7:0/3151388252 conn(0x7fac60070e30 msgr2=0x7fac600b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:41.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 shutdown_connections 2023-10-14T19:03:41.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:41.927+0000 7fac67f03700 1 -- 172.21.15.7:0/3151388252 wait complete. 2023-10-14T19:03:41.931 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2023-10-14T19:03:41.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.059+0000 7efe73866700 1 Processor -- start 2023-10-14T19:03:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.059+0000 7efe73866700 1 -- start start 2023-10-14T19:03:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe73866700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb970 0x7efe6c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe73866700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe6c15a400 0x7efe6c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe73866700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c15ae40 con 0x7efe6c0cb5a0 2023-10-14T19:03:42.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe73866700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c0ce0f0 con 0x7efe6c15a400 2023-10-14T19:03:42.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe73866700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c0cbde0 con 0x7efe6c0cb970 2023-10-14T19:03:42.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe6c15a400 0x7efe6c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe6c15a400 0x7efe6c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46674/0 (socket says 172.21.15.7:46674) 2023-10-14T19:03:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 -- 172.21.15.7:0/1196680691 learned_addr learned my addr 172.21.15.7:0/1196680691 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71602700 1 --1- 172.21.15.7:0/1196680691 >> v1:172.21.15.148:6789/0 conn(0x7efe6c0cb5a0 0x7efe6c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45022/0 (socket says 172.21.15.7:45022) 2023-10-14T19:03:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe70e01700 1 --2- 172.21.15.7:0/1196680691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb970 0x7efe6c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 -- 172.21.15.7:0/1196680691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb970 msgr2=0x7efe6c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 --2- 172.21.15.7:0/1196680691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb970 0x7efe6c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 -- 172.21.15.7:0/1196680691 >> v1:172.21.15.148:6789/0 conn(0x7efe6c0cb5a0 legacy=0x7efe6c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.060+0000 7efe71e03700 1 -- 172.21.15.7:0/1196680691 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c15ab60 con 0x7efe6c15a400 2023-10-14T19:03:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe71e03700 1 --2- 172.21.15.7:0/1196680691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c15a400 0x7efe6c156e90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe640099e0 tx=0x7efe64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75a37442a5ed091 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe6bfff700 1 -- 172.21.15.7:0/1196680691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400b820 con 0x7efe6c15a400 2023-10-14T19:03:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe6bfff700 1 -- 172.21.15.7:0/1196680691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6400b980 con 0x7efe6c15a400 2023-10-14T19:03:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe6bfff700 1 -- 172.21.15.7:0/1196680691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400bd20 con 0x7efe6c15a400 2023-10-14T19:03:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe73866700 1 -- 172.21.15.7:0/1196680691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c15a400 msgr2=0x7efe6c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe73866700 1 --2- 172.21.15.7:0/1196680691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c15a400 0x7efe6c156e90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe640099e0 tx=0x7efe64009250 comp rx=0 tx=0).stop 2023-10-14T19:03:42.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe73866700 1 -- 172.21.15.7:0/1196680691 shutdown_connections 2023-10-14T19:03:42.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe73866700 1 --2- 172.21.15.7:0/1196680691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c15a400 0x7efe6c156e90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe73866700 1 --2- 172.21.15.7:0/1196680691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb970 0x7efe6c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.061+0000 7efe73866700 1 -- 172.21.15.7:0/1196680691 >> 172.21.15.7:0/1196680691 conn(0x7efe6c070e30 msgr2=0x7efe6c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:42.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.062+0000 7efe73866700 1 -- 172.21.15.7:0/1196680691 shutdown_connections 2023-10-14T19:03:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.062+0000 7efe73866700 1 -- 172.21.15.7:0/1196680691 wait complete. 2023-10-14T19:03:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.063+0000 7efe73866700 1 Processor -- start 2023-10-14T19:03:42.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.063+0000 7efe73866700 1 -- start start 2023-10-14T19:03:42.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.063+0000 7efe73866700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb5a0 0x7efe6c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.063+0000 7efe73866700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 0x7efe6c16a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe73866700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c15a400 0x7efe6c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe73866700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c0b5950 con 0x7efe6c0cb970 2023-10-14T19:03:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe73866700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c16a890 con 0x7efe6c15a400 2023-10-14T19:03:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe73866700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c0b4d40 con 0x7efe6c0cb5a0 2023-10-14T19:03:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 0x7efe6c16a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 0x7efe6c16a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46680/0 (socket says 172.21.15.7:46680) 2023-10-14T19:03:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 -- 172.21.15.7:0/1237851140 learned_addr learned my addr 172.21.15.7:0/1237851140 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe71602700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb5a0 0x7efe6c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe71e03700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c15a400 0x7efe6c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 -- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb5a0 msgr2=0x7efe6c0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb5a0 0x7efe6c0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 -- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c15a400 msgr2=0x7efe6c0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c15a400 0x7efe6c0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 -- 172.21.15.7:0/1237851140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640094f0 con 0x7efe6c0cb970 2023-10-14T19:03:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe70e01700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 0x7efe6c16a350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe6000d8c0 tx=0x7efe60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600125f0 con 0x7efe6c0cb970 2023-10-14T19:03:42.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe60012750 con 0x7efe6c0cb970 2023-10-14T19:03:42.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c0b5020 con 0x7efe6c0cb970 2023-10-14T19:03:42.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60012af0 con 0x7efe6c0cb970 2023-10-14T19:03:42.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.064+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c0b55e0 con 0x7efe6c0cb970 2023-10-14T19:03:42.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.065+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c0b5ac0 con 0x7efe6c0cb970 2023-10-14T19:03:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.066+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe6001e460 con 0x7efe6c0cb970 2023-10-14T19:03:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.066+0000 7efe697fa700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.066+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe60084b50 con 0x7efe6c0cb970 2023-10-14T19:03:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.066+0000 7efe71602700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.067+0000 7efe71602700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe58066f30 0x7efe580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe5c002020 tx=0x7efe5c001a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.070+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe60051d20 con 0x7efe6c0cb970 2023-10-14T19:03:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.267+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6c04c3c0 con 0x7efe6c0cb970 2023-10-14T19:03:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.267+0000 7efe697fa700 1 -- 172.21.15.7:0/1237851140 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7efe60055340 con 0x7efe6c0cb970 2023-10-14T19:03:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:42.269 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:11.201881+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:07.458368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:08.579730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.269+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe58066f30 msgr2=0x7efe580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.269+0000 7efe73866700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe58066f30 0x7efe580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe5c002020 tx=0x7efe5c001a30 comp rx=0 tx=0).stop 2023-10-14T19:03:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.269+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 msgr2=0x7efe6c16a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.269+0000 7efe73866700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 0x7efe6c16a350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe6000d8c0 tx=0x7efe60008040 comp rx=0 tx=0).stop 2023-10-14T19:03:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 shutdown_connections 2023-10-14T19:03:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c15a400 0x7efe6c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe6c0cb5a0 0x7efe6c0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 --2- 172.21.15.7:0/1237851140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6c0cb970 0x7efe6c16a350 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 >> 172.21.15.7:0/1237851140 conn(0x7efe6c070e30 msgr2=0x7efe6c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 shutdown_connections 2023-10-14T19:03:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.270+0000 7efe73866700 1 -- 172.21.15.7:0/1237851140 wait complete. 2023-10-14T19:03:42.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:03:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.402+0000 7ff63c3c9700 1 Processor -- start 2023-10-14T19:03:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.402+0000 7ff63c3c9700 1 -- start start 2023-10-14T19:03:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63c3c9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6341598b0 0x7ff6340af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63c3c9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff634159c80 0x7ff6340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63c3c9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6340ce9d0 con 0x7ff6340af790 2023-10-14T19:03:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63c3c9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6340afc30 con 0x7ff634159c80 2023-10-14T19:03:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63c3c9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340aff10 con 0x7ff6341598b0 2023-10-14T19:03:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63a966700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff6340af790 0x7ff6340cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47714/0 (socket says 172.21.15.7:47714) 2023-10-14T19:03:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.403+0000 7ff63a966700 1 -- 172.21.15.7:0/1920230364 learned_addr learned my addr 172.21.15.7:0/1920230364 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff63a165700 1 --2- 172.21.15.7:0/1920230364 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6341598b0 0x7ff6340af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639964700 1 --2- 172.21.15.7:0/1920230364 >> v2:172.21.15.148:3300/0 conn(0x7ff634159c80 0x7ff6340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639163700 1 -- 172.21.15.7:0/1920230364 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001142110 0 0) 0x7ff6340ce9d0 con 0x7ff6340af790 2023-10-14T19:03:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639163700 1 -- 172.21.15.7:0/1920230364 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff61c003570 con 0x7ff6340af790 2023-10-14T19:03:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff63a165700 1 -- 172.21.15.7:0/1920230364 >> v2:172.21.15.148:3300/0 conn(0x7ff634159c80 msgr2=0x7ff6340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff63a165700 1 --2- 172.21.15.7:0/1920230364 >> v2:172.21.15.148:3300/0 conn(0x7ff634159c80 0x7ff6340cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff63a165700 1 -- 172.21.15.7:0/1920230364 >> v1:172.21.15.7:6789/0 conn(0x7ff6340af790 legacy=0x7ff6340cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639163700 1 -- 172.21.15.7:0/1920230364 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836873072 0 0) 0x7ff61c003570 con 0x7ff6340af790 2023-10-14T19:03:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff63a165700 1 -- 172.21.15.7:0/1920230364 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340ce380 con 0x7ff6341598b0 2023-10-14T19:03:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639964700 1 --2- 172.21.15.7:0/1920230364 >> v2:172.21.15.148:3300/0 conn(0x7ff634159c80 0x7ff6340cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff63a165700 1 --2- 172.21.15.7:0/1920230364 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6341598b0 0x7ff6340af250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0098e0 tx=0x7ff62c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c254b03d85e323 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639163700 1 -- 172.21.15.7:0/1920230364 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6240017f0 con 0x7ff6341598b0 2023-10-14T19:03:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639163700 1 -- 172.21.15.7:0/1920230364 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c011420 con 0x7ff6341598b0 2023-10-14T19:03:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.404+0000 7ff639163700 1 -- 172.21.15.7:0/1920230364 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0117a0 con 0x7ff6341598b0 2023-10-14T19:03:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 -- 172.21.15.7:0/1920230364 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6341598b0 msgr2=0x7ff6340af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/1920230364 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6341598b0 0x7ff6340af250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0098e0 tx=0x7ff62c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 -- 172.21.15.7:0/1920230364 shutdown_connections 2023-10-14T19:03:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/1920230364 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6341598b0 0x7ff6340af250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/1920230364 >> v2:172.21.15.148:3300/0 conn(0x7ff634159c80 0x7ff6340cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 -- 172.21.15.7:0/1920230364 >> 172.21.15.7:0/1920230364 conn(0x7ff634070e30 msgr2=0x7ff6340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 -- 172.21.15.7:0/1920230364 shutdown_connections 2023-10-14T19:03:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.405+0000 7ff63c3c9700 1 -- 172.21.15.7:0/1920230364 wait complete. 2023-10-14T19:03:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.406+0000 7ff63c3c9700 1 Processor -- start 2023-10-14T19:03:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.406+0000 7ff63c3c9700 1 -- start start 2023-10-14T19:03:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63c3c9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 0x7ff63414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63c3c9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6341598b0 0x7ff63406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63c3c9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff634159c80 0x7ff63406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63c3c9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634155d20 con 0x7ff6340af790 2023-10-14T19:03:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63c3c9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63415c8a0 con 0x7ff6341598b0 2023-10-14T19:03:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63c3c9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63415c000 con 0x7ff634159c80 2023-10-14T19:03:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 0x7ff63414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 0x7ff63414d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46686/0 (socket says 172.21.15.7:46686) 2023-10-14T19:03:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 -- 172.21.15.7:0/3413787493 learned_addr learned my addr 172.21.15.7:0/3413787493 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff639964700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6341598b0 0x7ff63406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a966700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff634159c80 0x7ff63406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 -- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff634159c80 msgr2=0x7ff63406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff634159c80 0x7ff63406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 -- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6341598b0 msgr2=0x7ff63406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6341598b0 0x7ff63406d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 -- 172.21.15.7:0/3413787493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628009420 con 0x7ff6340af790 2023-10-14T19:03:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff639964700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6341598b0 0x7ff63406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a966700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff634159c80 0x7ff63406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.407+0000 7ff63a165700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 0x7ff63414d320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009ed0 tx=0x7ff62c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.408+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c01cb90 con 0x7ff6340af790 2023-10-14T19:03:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.408+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c01ccf0 con 0x7ff6340af790 2023-10-14T19:03:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.408+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c009420 con 0x7ff6340af790 2023-10-14T19:03:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.408+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c01a680 con 0x7ff6340af790 2023-10-14T19:03:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.408+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63415c5c0 con 0x7ff6340af790 2023-10-14T19:03:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.408+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63404c3c0 con 0x7ff6340af790 2023-10-14T19:03:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.409+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff62c01aa70 con 0x7ff6340af790 2023-10-14T19:03:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.409+0000 7ff6327fc700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.409+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff62c085eb0 con 0x7ff6340af790 2023-10-14T19:03:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.410+0000 7ff639964700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.410+0000 7ff639964700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6280093f0 tx=0x7ff628008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.414+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff62c053120 con 0x7ff6340af790 2023-10-14T19:03:42.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.649+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff6340ce660 con 0x7ff6340af790 2023-10-14T19:03:42.651 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:03:42.650+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:03:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.653+0000 7ff6327fc700 1 -- 172.21.15.7:0/3413787493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff62c01ce60 con 0x7ff6340af790 2023-10-14T19:03:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 msgr2=0x7ff6200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6280093f0 tx=0x7ff628008040 comp rx=0 tx=0).stop 2023-10-14T19:03:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 msgr2=0x7ff63414d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 0x7ff63414d320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009ed0 tx=0x7ff62c016000 comp rx=0 tx=0).stop 2023-10-14T19:03:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 shutdown_connections 2023-10-14T19:03:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff634159c80 0x7ff63406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6340af790 0x7ff63414d320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 --2- 172.21.15.7:0/3413787493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6341598b0 0x7ff63406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 >> 172.21.15.7:0/3413787493 conn(0x7ff634070e30 msgr2=0x7ff6340b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 shutdown_connections 2023-10-14T19:03:42.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.655+0000 7ff63c3c9700 1 -- 172.21.15.7:0/3413787493 wait complete. 2023-10-14T19:03:42.661 INFO:tasks.ceph.mds.b.smithi148.stderr: -1611> 2023-10-14T19:03:13.947+0000 7ffafd2a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:03:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:03:42.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:03:42.682 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:03:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.792+0000 7f45cffff700 1 Processor -- start 2023-10-14T19:03:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.792+0000 7f45cffff700 1 -- start start 2023-10-14T19:03:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45cffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f45d00b2b00 0x7f45d006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45cffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45d00cb1e0 0x7f45d006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45cffff700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d015bc40 con 0x7f45d0159580 2023-10-14T19:03:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45cffff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d015b070 con 0x7f45d00b2b00 2023-10-14T19:03:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45cffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d015b310 con 0x7f45d00cb1e0 2023-10-14T19:03:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45ceffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f45d0159580 0x7f45d00b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47728/0 (socket says 172.21.15.7:47728) 2023-10-14T19:03:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45ceffd700 1 -- 172.21.15.7:0/139320264 learned_addr learned my addr 172.21.15.7:0/139320264 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.793+0000 7f45ce7fc700 1 --2- 172.21.15.7:0/139320264 >> v2:172.21.15.7:3300/0 conn(0x7f45d00b2b00 0x7f45d006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cdffb700 1 -- 172.21.15.7:0/139320264 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604164287 0 0) 0x7f45d015bc40 con 0x7f45d0159580 2023-10-14T19:03:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cf7fe700 1 --2- 172.21.15.7:0/139320264 >> v2:172.21.15.148:3300/0 conn(0x7f45d00cb1e0 0x7f45d006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cdffb700 1 -- 172.21.15.7:0/139320264 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45bc003570 con 0x7f45d0159580 2023-10-14T19:03:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45ce7fc700 1 -- 172.21.15.7:0/139320264 >> v2:172.21.15.148:3300/0 conn(0x7f45d00cb1e0 msgr2=0x7f45d006dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45ce7fc700 1 --2- 172.21.15.7:0/139320264 >> v2:172.21.15.148:3300/0 conn(0x7f45d00cb1e0 0x7f45d006dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45ce7fc700 1 -- 172.21.15.7:0/139320264 >> v1:172.21.15.7:6789/0 conn(0x7f45d0159580 legacy=0x7f45d00b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45ce7fc700 1 -- 172.21.15.7:0/139320264 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d015b5f0 con 0x7f45d00b2b00 2023-10-14T19:03:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cf7fe700 1 --2- 172.21.15.7:0/139320264 >> v2:172.21.15.148:3300/0 conn(0x7f45d00cb1e0 0x7f45d006dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45ce7fc700 1 --2- 172.21.15.7:0/139320264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d006d7c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f45d015bbb0 tx=0x7f45b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82cbfcbc317f124 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cdffb700 1 -- 172.21.15.7:0/139320264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011630 con 0x7f45d00b2b00 2023-10-14T19:03:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cdffb700 1 -- 172.21.15.7:0/139320264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8011790 con 0x7f45d00b2b00 2023-10-14T19:03:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.794+0000 7f45cdffb700 1 -- 172.21.15.7:0/139320264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011b30 con 0x7f45d00b2b00 2023-10-14T19:03:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 -- 172.21.15.7:0/139320264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 msgr2=0x7f45d006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 --2- 172.21.15.7:0/139320264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d006d7c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f45d015bbb0 tx=0x7f45b80091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 -- 172.21.15.7:0/139320264 shutdown_connections 2023-10-14T19:03:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 --2- 172.21.15.7:0/139320264 >> v2:172.21.15.148:3300/0 conn(0x7f45d00cb1e0 0x7f45d006dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 --2- 172.21.15.7:0/139320264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d006d7c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 -- 172.21.15.7:0/139320264 >> 172.21.15.7:0/139320264 conn(0x7f45d00703a0 msgr2=0x7f45d00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 -- 172.21.15.7:0/139320264 shutdown_connections 2023-10-14T19:03:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.795+0000 7f45cffff700 1 -- 172.21.15.7:0/139320264 wait complete. 2023-10-14T19:03:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.796+0000 7f45cffff700 1 Processor -- start 2023-10-14T19:03:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.796+0000 7f45cffff700 1 -- start start 2023-10-14T19:03:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d016d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45d00cb1e0 0x7f45d00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45d0159580 0x7f45d00b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d016aac0 con 0x7f45d00b2b00 2023-10-14T19:03:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c6e60 con 0x7f45d0159580 2023-10-14T19:03:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c9c40 con 0x7f45d00cb1e0 2023-10-14T19:03:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d016d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d016d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46714/0 (socket says 172.21.15.7:46714) 2023-10-14T19:03:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 -- 172.21.15.7:0/2664683628 learned_addr learned my addr 172.21.15.7:0/2664683628 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cf7fe700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45d0159580 0x7f45d00b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ce7fc700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45d00cb1e0 0x7f45d00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 -- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45d00cb1e0 msgr2=0x7f45d00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45d00cb1e0 0x7f45d00c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 -- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45d0159580 msgr2=0x7f45d00b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45d0159580 0x7f45d00b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 -- 172.21.15.7:0/2664683628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8009420 con 0x7f45d00b2b00 2023-10-14T19:03:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cf7fe700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45d0159580 0x7f45d00b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45ceffd700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d016d140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f45c000c5c0 tx=0x7f45c0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0005b30 con 0x7f45d00b2b00 2023-10-14T19:03:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0005c90 con 0x7f45d00b2b00 2023-10-14T19:03:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00b3390 con 0x7f45d00b2b00 2023-10-14T19:03:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0007320 con 0x7f45d00b2b00 2023-10-14T19:03:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.797+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00ca170 con 0x7f45d00b2b00 2023-10-14T19:03:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.798+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d0088b50 con 0x7f45d00b2b00 2023-10-14T19:03:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.799+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45c0007690 con 0x7f45d00b2b00 2023-10-14T19:03:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.799+0000 7f45c6ffd700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f45b0066f30 0x7f45b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.799+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f45c0083a60 con 0x7f45d00b2b00 2023-10-14T19:03:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.799+0000 7f45ce7fc700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f45b0066f30 0x7f45b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.800+0000 7f45ce7fc700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f45b0066f30 0x7f45b00693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45d00b2f00 tx=0x7f45b8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:42.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:42.803+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45c0050c80 con 0x7f45d00b2b00 2023-10-14T19:03:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.041+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45d015b8d0 con 0x7f45d00b2b00 2023-10-14T19:03:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.654+0000 7f45c6ffd700 1 -- 172.21.15.7:0/2664683628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45c0017020 con 0x7f45d00b2b00 2023-10-14T19:03:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f45b0066f30 msgr2=0x7f45b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f45b0066f30 0x7f45b00693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45d00b2f00 tx=0x7f45b8017000 comp rx=0 tx=0).stop 2023-10-14T19:03:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 msgr2=0x7f45d016d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d016d140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f45c000c5c0 tx=0x7f45c0007e00 comp rx=0 tx=0).stop 2023-10-14T19:03:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 shutdown_connections 2023-10-14T19:03:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f45b0066f30 0x7f45b00693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45d0159580 0x7f45d00b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45d00b2b00 0x7f45d016d140 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 --2- 172.21.15.7:0/2664683628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45d00cb1e0 0x7f45d00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 >> 172.21.15.7:0/2664683628 conn(0x7f45d00703a0 msgr2=0x7f45d0070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 shutdown_connections 2023-10-14T19:03:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.657+0000 7f45cffff700 1 -- 172.21.15.7:0/2664683628 wait complete. 2023-10-14T19:03:43.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:03:43.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.800+0000 7f86a6183700 1 Processor -- start 2023-10-14T19:03:43.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.800+0000 7f86a6183700 1 -- start start 2023-10-14T19:03:43.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a6183700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a015aa00 0x7f86a00cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:43.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a6183700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86a00ceed0 0x7f86a00c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:43.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a6183700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00cbe80 con 0x7f86a00cba10 2023-10-14T19:03:43.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a6183700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00cf510 con 0x7f86a00ceed0 2023-10-14T19:03:43.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a6183700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00cf7f0 con 0x7f86a015aa00 2023-10-14T19:03:43.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a5982700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86a00ceed0 0x7f86a00c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:43.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a5982700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86a00ceed0 0x7f86a00c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46726/0 (socket says 172.21.15.7:46726) 2023-10-14T19:03:43.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a5982700 1 -- 172.21.15.7:0/2931443838 learned_addr learned my addr 172.21.15.7:0/2931443838 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:43.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.801+0000 7f86a5181700 1 --2- 172.21.15.7:0/2931443838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a015aa00 0x7f86a00cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:43.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a5982700 1 -- 172.21.15.7:0/2931443838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a015aa00 msgr2=0x7f86a00cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:43.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a5982700 1 --2- 172.21.15.7:0/2931443838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a015aa00 0x7f86a00cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a5982700 1 -- 172.21.15.7:0/2931443838 >> v1:172.21.15.148:6789/0 conn(0x7f86a00cba10 legacy=0x7f86a00ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:43.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a5982700 1 -- 172.21.15.7:0/2931443838 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00cfad0 con 0x7f86a00ceed0 2023-10-14T19:03:43.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a5982700 1 --2- 172.21.15.7:0/2931443838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00ceed0 0x7f86a00c5390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8690009f20 tx=0x7f8690009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b126101daf5c6a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:43.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f869ffff700 1 -- 172.21.15.7:0/2931443838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000e070 con 0x7f86a00ceed0 2023-10-14T19:03:43.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f869ffff700 1 -- 172.21.15.7:0/2931443838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869000b9d0 con 0x7f86a00ceed0 2023-10-14T19:03:43.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f869ffff700 1 -- 172.21.15.7:0/2931443838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900092e0 con 0x7f86a00ceed0 2023-10-14T19:03:43.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a6183700 1 -- 172.21.15.7:0/2931443838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00ceed0 msgr2=0x7f86a00c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:43.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a6183700 1 --2- 172.21.15.7:0/2931443838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00ceed0 0x7f86a00c5390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8690009f20 tx=0x7f8690009840 comp rx=0 tx=0).stop 2023-10-14T19:03:43.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a6183700 1 -- 172.21.15.7:0/2931443838 shutdown_connections 2023-10-14T19:03:43.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a6183700 1 --2- 172.21.15.7:0/2931443838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00ceed0 0x7f86a00c5390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a6183700 1 --2- 172.21.15.7:0/2931443838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a015aa00 0x7f86a00cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.802+0000 7f86a6183700 1 -- 172.21.15.7:0/2931443838 >> 172.21.15.7:0/2931443838 conn(0x7f86a0099740 msgr2=0x7f86a0070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:43.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.803+0000 7f86a6183700 1 -- 172.21.15.7:0/2931443838 shutdown_connections 2023-10-14T19:03:43.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.803+0000 7f86a6183700 1 -- 172.21.15.7:0/2931443838 wait complete. 2023-10-14T19:03:43.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 Processor -- start 2023-10-14T19:03:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 -- start start 2023-10-14T19:03:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 0x7f86a015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a00ceed0 0x7f86a00aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a015aa00 0x7f86a0154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00af150 con 0x7f86a00cba10 2023-10-14T19:03:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00c9f90 con 0x7f86a015aa00 2023-10-14T19:03:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.804+0000 7f86a6183700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00ca270 con 0x7f86a00ceed0 2023-10-14T19:03:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 0x7f86a015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 0x7f86a015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46734/0 (socket says 172.21.15.7:46734) 2023-10-14T19:03:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 -- 172.21.15.7:0/852499998 learned_addr learned my addr 172.21.15.7:0/852499998 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:43.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5982700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a015aa00 0x7f86a0154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:43.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a4980700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a00ceed0 0x7f86a00aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:43.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 -- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a00ceed0 msgr2=0x7f86a00aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:43.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a00ceed0 0x7f86a00aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 -- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a015aa00 msgr2=0x7f86a0154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a015aa00 0x7f86a0154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 -- 172.21.15.7:0/852499998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8690009ae0 con 0x7f86a00cba10 2023-10-14T19:03:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a5181700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 0x7f86a015cbd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f869800ea00 tx=0x7f8698009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800c6a0 con 0x7f86a00cba10 2023-10-14T19:03:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800c800 con 0x7f86a00cba10 2023-10-14T19:03:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00c75a0 con 0x7f86a00cba10 2023-10-14T19:03:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800cb80 con 0x7f86a00cba10 2023-10-14T19:03:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.805+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a00c7b60 con 0x7f86a00cba10 2023-10-14T19:03:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.806+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00af2c0 con 0x7f86a00cba10 2023-10-14T19:03:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.807+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8698013470 con 0x7f86a00cba10 2023-10-14T19:03:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.807+0000 7f869d7fa700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.807+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8698084ab0 con 0x7f86a00cba10 2023-10-14T19:03:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.807+0000 7f86a4980700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.808+0000 7f86a4980700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f868c066f30 0x7f868c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f86a016cc30 tx=0x7f8694007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:43.811+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8698051cd0 con 0x7f86a00cba10 2023-10-14T19:03:44.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.009+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86a00aea10 con 0x7f86a00cba10 2023-10-14T19:03:44.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.892+0000 7f869d7fa700 1 -- 172.21.15.7:0/852499998 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f86980210d0 con 0x7f86a00cba10 2023-10-14T19:03:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.894+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f868c066f30 msgr2=0x7f868c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:44.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.894+0000 7f86a6183700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f868c066f30 0x7f868c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f86a016cc30 tx=0x7f8694007ec0 comp rx=0 tx=0).stop 2023-10-14T19:03:44.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 msgr2=0x7f86a015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:44.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 0x7f86a015cbd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f869800ea00 tx=0x7f8698009120 comp rx=0 tx=0).stop 2023-10-14T19:03:44.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 shutdown_connections 2023-10-14T19:03:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a015aa00 0x7f86a0154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86a00cba10 0x7f86a015cbd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 --2- 172.21.15.7:0/852499998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86a00ceed0 0x7f86a00aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 >> 172.21.15.7:0/852499998 conn(0x7f86a0099740 msgr2=0x7f86a006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 shutdown_connections 2023-10-14T19:03:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:44.895+0000 7f86a6183700 1 -- 172.21.15.7:0/852499998 wait complete. 2023-10-14T19:03:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:03:44.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:03:45.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.040+0000 7fb1e8aa3700 1 Processor -- start 2023-10-14T19:03:45.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.040+0000 7fb1e8aa3700 1 -- start start 2023-10-14T19:03:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e8aa3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1e4159fb0 0x7fb1e415a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e8aa3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e415a8c0 0x7fb1e40cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e8aa3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40cd830 con 0x7fb1e40cd3d0 2023-10-14T19:03:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e8aa3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e415e180 con 0x7fb1e4159fb0 2023-10-14T19:03:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e8aa3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e415d570 con 0x7fb1e415a8c0 2023-10-14T19:03:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e37fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1e4159fb0 0x7fb1e415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e3fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb1e40cd3d0 0x7fb1e406d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45040/0 (socket says 172.21.15.7:45040) 2023-10-14T19:03:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e3fff700 1 -- 172.21.15.7:0/636431155 learned_addr learned my addr 172.21.15.7:0/636431155 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.041+0000 7fb1e2ffd700 1 --2- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e415a8c0 0x7fb1e40cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e37fe700 1 -- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e415a8c0 msgr2=0x7fb1e40cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e37fe700 1 --2- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e415a8c0 0x7fb1e40cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e37fe700 1 -- 172.21.15.7:0/636431155 >> v1:172.21.15.148:6789/0 conn(0x7fb1e40cd3d0 legacy=0x7fb1e406d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e37fe700 1 -- 172.21.15.7:0/636431155 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e415d850 con 0x7fb1e4159fb0 2023-10-14T19:03:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e37fe700 1 --2- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e415a380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40098e0 tx=0x7fb1d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ba15dc3efc3d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e27fc700 1 -- 172.21.15.7:0/636431155 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400b640 con 0x7fb1e4159fb0 2023-10-14T19:03:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e27fc700 1 -- 172.21.15.7:0/636431155 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400b7a0 con 0x7fb1e4159fb0 2023-10-14T19:03:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.042+0000 7fb1e27fc700 1 -- 172.21.15.7:0/636431155 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400bb40 con 0x7fb1e4159fb0 2023-10-14T19:03:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 msgr2=0x7fb1e415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e415a380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40098e0 tx=0x7fb1d40091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/636431155 shutdown_connections 2023-10-14T19:03:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e415a380 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/636431155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e415a8c0 0x7fb1e40cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/636431155 >> 172.21.15.7:0/636431155 conn(0x7fb1e40703a0 msgr2=0x7fb1e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/636431155 shutdown_connections 2023-10-14T19:03:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.043+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/636431155 wait complete. 2023-10-14T19:03:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.044+0000 7fb1e8aa3700 1 Processor -- start 2023-10-14T19:03:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.044+0000 7fb1e8aa3700 1 -- start start 2023-10-14T19:03:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e8aa3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e40cd3d0 0x7fb1e40c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e8aa3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e4147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e8aa3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 0x7fb1e40c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e8aa3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4148270 con 0x7fb1e415a8c0 2023-10-14T19:03:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e8aa3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c87f0 con 0x7fb1e4159fb0 2023-10-14T19:03:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e8aa3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c7be0 con 0x7fb1e40cd3d0 2023-10-14T19:03:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 0x7fb1e40c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 0x7fb1e40c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46742/0 (socket says 172.21.15.7:46742) 2023-10-14T19:03:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 -- 172.21.15.7:0/1545369685 learned_addr learned my addr 172.21.15.7:0/1545369685 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e37fe700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e40cd3d0 0x7fb1e40c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e2ffd700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e4147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 -- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e40cd3d0 msgr2=0x7fb1e40c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e40cd3d0 0x7fb1e40c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 -- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 msgr2=0x7fb1e4147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e4147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.045+0000 7fb1e3fff700 1 -- 172.21.15.7:0/1545369685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4009420 con 0x7fb1e415a8c0 2023-10-14T19:03:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.046+0000 7fb1e3fff700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 0x7fb1e40c8c80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00cc40 tx=0x7fb1dc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.046+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00a8b0 con 0x7fb1e415a8c0 2023-10-14T19:03:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.046+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00aa10 con 0x7fb1e415a8c0 2023-10-14T19:03:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.046+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e40c7ec0 con 0x7fb1e415a8c0 2023-10-14T19:03:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.046+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00add0 con 0x7fb1e415a8c0 2023-10-14T19:03:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.046+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e40c8500 con 0x7fb1e415a8c0 2023-10-14T19:03:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.047+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e40c8960 con 0x7fb1e415a8c0 2023-10-14T19:03:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.047+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1dc007300 con 0x7fb1e415a8c0 2023-10-14T19:03:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.047+0000 7fb1cb7fe700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1d0066f30 0x7fb1d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.047+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fb1dc084500 con 0x7fb1e415a8c0 2023-10-14T19:03:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.048+0000 7fb1e37fe700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1d0066f30 0x7fb1d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.048+0000 7fb1e37fe700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1d0066f30 0x7fb1d00693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40093f0 tx=0x7fb1d4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:45.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.052+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1dc051950 con 0x7fb1e415a8c0 2023-10-14T19:03:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.244+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1e40cd830 con 0x7fb1e415a8c0 2023-10-14T19:03:45.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.896+0000 7fb1cb7fe700 1 -- 172.21.15.7:0/1545369685 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1e40cd830 con 0x7fb1e415a8c0 2023-10-14T19:03:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1d0066f30 msgr2=0x7fb1d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1d0066f30 0x7fb1d00693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40093f0 tx=0x7fb1d4017000 comp rx=0 tx=0).stop 2023-10-14T19:03:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 msgr2=0x7fb1e40c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 0x7fb1e40c8c80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00cc40 tx=0x7fb1dc001a50 comp rx=0 tx=0).stop 2023-10-14T19:03:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 shutdown_connections 2023-10-14T19:03:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1d0066f30 0x7fb1d00693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415a8c0 0x7fb1e40c8c80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e40cd3d0 0x7fb1e40c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 --2- 172.21.15.7:0/1545369685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e4159fb0 0x7fb1e4147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 >> 172.21.15.7:0/1545369685 conn(0x7fb1e40703a0 msgr2=0x7fb1e415ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 shutdown_connections 2023-10-14T19:03:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:45.899+0000 7fb1e8aa3700 1 -- 172.21.15.7:0/1545369685 wait complete. 2023-10-14T19:03:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:03:45.913 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:03:45.914 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:03:45.914 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:03:45.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:03:45.915 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:03:45.915 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:03:45.915 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:03:45.915 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:03:45.916 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:03:45.916 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:03:45.916 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:03:45.917 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:03:45.917 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:03:45.917 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:03:45.918 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:03:45.918 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:03:45.926 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:03:45.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:03:45.928 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:03:45.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:03:45.930 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:03:45.930 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:03:45.931 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:03:45.932 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:03:45.969 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:03:45.969 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:45.970 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:03:45.971 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:45.973 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:03:45.974 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:45.975 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:03:45.976 DEBUG:teuthology.parallel:result is None 2023-10-14T19:03:45.977 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:03:46.046 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:03:46.047 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:03:46.052 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:03:46.053 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:03:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.101+0000 7f6e9a0f8700 1 Processor -- start 2023-10-14T19:03:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.101+0000 7f6e9a0f8700 1 -- start start 2023-10-14T19:03:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e9a0f8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6e9406e0a0 0x7f6e940c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e9a0f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6e94150380 0x7f6e9406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e9a0f8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9406a490 con 0x7f6e9406f3a0 2023-10-14T19:03:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e9a0f8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940c7490 con 0x7f6e9406e0a0 2023-10-14T19:03:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e9a0f8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940c7770 con 0x7f6e94150380 2023-10-14T19:03:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6e9406e0a0 0x7f6e940c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6e9406e0a0 0x7f6e940c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46784/0 (socket says 172.21.15.7:46784) 2023-10-14T19:03:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 -- 172.21.15.7:0/3490673473 learned_addr learned my addr 172.21.15.7:0/3490673473 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e998f7700 1 --2- 172.21.15.7:0/3490673473 >> v2:172.21.15.148:3300/0 conn(0x7f6e94150380 0x7f6e9406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 -- 172.21.15.7:0/3490673473 >> v2:172.21.15.148:3300/0 conn(0x7f6e94150380 msgr2=0x7f6e9406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 --2- 172.21.15.7:0/3490673473 >> v2:172.21.15.148:3300/0 conn(0x7f6e94150380 0x7f6e9406a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 -- 172.21.15.7:0/3490673473 >> v1:172.21.15.148:6789/0 conn(0x7f6e9406f3a0 legacy=0x7f6e9414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.102+0000 7f6e990f6700 1 -- 172.21.15.7:0/3490673473 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940c7a50 con 0x7f6e9406e0a0 2023-10-14T19:03:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e990f6700 1 --2- 172.21.15.7:0/3490673473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e940c6b20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6e9406a400 tx=0x7f6e84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db90602558f26d0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e8bfff700 1 -- 172.21.15.7:0/3490673473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84009e70 con 0x7f6e9406e0a0 2023-10-14T19:03:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e8bfff700 1 -- 172.21.15.7:0/3490673473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8400b860 con 0x7f6e9406e0a0 2023-10-14T19:03:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e8bfff700 1 -- 172.21.15.7:0/3490673473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400bc00 con 0x7f6e9406e0a0 2023-10-14T19:03:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/3490673473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 msgr2=0x7f6e940c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/3490673473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e940c6b20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6e9406a400 tx=0x7f6e84009250 comp rx=0 tx=0).stop 2023-10-14T19:03:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/3490673473 shutdown_connections 2023-10-14T19:03:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/3490673473 >> v2:172.21.15.148:3300/0 conn(0x7f6e94150380 0x7f6e9406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/3490673473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e940c6b20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/3490673473 >> 172.21.15.7:0/3490673473 conn(0x7f6e9406d170 msgr2=0x7f6e940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/3490673473 shutdown_connections 2023-10-14T19:03:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.103+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/3490673473 wait complete. 2023-10-14T19:03:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.105+0000 7f6e9a0f8700 1 Processor -- start 2023-10-14T19:03:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.105+0000 7f6e9a0f8700 1 -- start start 2023-10-14T19:03:46.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e94148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:46.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e9406f3a0 0x7f6e940c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:46.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e94150380 0x7f6e940c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:46.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c57f0 con 0x7f6e9406e0a0 2023-10-14T19:03:46.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c6010 con 0x7f6e94150380 2023-10-14T19:03:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c5a70 con 0x7f6e9406f3a0 2023-10-14T19:03:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e94148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e94148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46794/0 (socket says 172.21.15.7:46794) 2023-10-14T19:03:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 -- 172.21.15.7:0/4101137122 learned_addr learned my addr 172.21.15.7:0/4101137122 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e998f7700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e94150380 0x7f6e940c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e988f5700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e9406f3a0 0x7f6e940c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 -- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e9406f3a0 msgr2=0x7f6e940c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e9406f3a0 0x7f6e940c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 -- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e94150380 msgr2=0x7f6e940c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e94150380 0x7f6e940c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 -- 172.21.15.7:0/4101137122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840094f0 con 0x7f6e9406e0a0 2023-10-14T19:03:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e988f5700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e9406f3a0 0x7f6e940c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e990f6700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e94148f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e94071320 tx=0x7f6e84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8401d070 con 0x7f6e9406e0a0 2023-10-14T19:03:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8400bbe0 con 0x7f6e9406e0a0 2023-10-14T19:03:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e940c5d30 con 0x7f6e9406e0a0 2023-10-14T19:03:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84021640 con 0x7f6e9406e0a0 2023-10-14T19:03:46.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.106+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9414b220 con 0x7f6e9406e0a0 2023-10-14T19:03:46.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.107+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9404c3c0 con 0x7f6e9406e0a0 2023-10-14T19:03:46.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.108+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e840103f0 con 0x7f6e9406e0a0 2023-10-14T19:03:46.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.108+0000 7f6e897fa700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e78066f30 0x7f6e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:46.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.108+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6e84086430 con 0x7f6e9406e0a0 2023-10-14T19:03:46.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.108+0000 7f6e988f5700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e78066f30 0x7f6e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:46.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.109+0000 7f6e988f5700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e78066f30 0x7f6e780693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e94169270 tx=0x7f6e90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:46.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.112+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e840539a0 con 0x7f6e9406e0a0 2023-10-14T19:03:46.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:46.320+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6e940c7d30 con 0x7f6e9406e0a0 2023-10-14T19:03:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.799+0000 7f6e897fa700 1 -- 172.21.15.7:0/4101137122 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e84056fc0 con 0x7f6e9406e0a0 2023-10-14T19:03:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e78066f30 msgr2=0x7f6e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e78066f30 0x7f6e780693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e94169270 tx=0x7f6e90009040 comp rx=0 tx=0).stop 2023-10-14T19:03:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 msgr2=0x7f6e94148f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e94148f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e94071320 tx=0x7f6e84018000 comp rx=0 tx=0).stop 2023-10-14T19:03:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 shutdown_connections 2023-10-14T19:03:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e78066f30 0x7f6e780693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e94150380 0x7f6e940c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e9406e0a0 0x7f6e94148f70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.801+0000 7f6e9a0f8700 1 --2- 172.21.15.7:0/4101137122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e9406f3a0 0x7f6e940c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.802+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 >> 172.21.15.7:0/4101137122 conn(0x7f6e9406d170 msgr2=0x7f6e941596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.802+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 shutdown_connections 2023-10-14T19:03:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.802+0000 7f6e9a0f8700 1 -- 172.21.15.7:0/4101137122 wait complete. 2023-10-14T19:03:47.806 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:03:47.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:03:47.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:47.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:47.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.944+0000 7fd24fbda700 1 Processor -- start 2023-10-14T19:03:47.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.944+0000 7fd24fbda700 1 -- start start 2023-10-14T19:03:47.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24fbda700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2480a8d00 0x7fd2480cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:47.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24fbda700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2480aeee0 con 0x7fd24806e550 2023-10-14T19:03:47.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24fbda700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2480cf490 con 0x7fd2480a90d0 2023-10-14T19:03:47.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24fbda700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2480ae680 con 0x7fd2480a8d00 2023-10-14T19:03:47.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24d976700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2480a8d00 0x7fd2480cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:47.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24e177700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd24806e550 0x7fd2480af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55368/0 (socket says 172.21.15.7:55368) 2023-10-14T19:03:47.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.945+0000 7fd24e177700 1 -- 172.21.15.7:0/3389995859 learned_addr learned my addr 172.21.15.7:0/3389995859 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:47.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24c974700 1 -- 172.21.15.7:0/3389995859 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516632057 0 0) 0x7fd2480aeee0 con 0x7fd24806e550 2023-10-14T19:03:47.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24c974700 1 -- 172.21.15.7:0/3389995859 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd230003570 con 0x7fd24806e550 2023-10-14T19:03:47.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24d976700 1 -- 172.21.15.7:0/3389995859 >> v1:172.21.15.148:6789/0 conn(0x7fd2480a90d0 legacy=0x7fd24806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24d976700 1 -- 172.21.15.7:0/3389995859 >> v1:172.21.15.7:6789/0 conn(0x7fd24806e550 legacy=0x7fd2480af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24d976700 1 -- 172.21.15.7:0/3389995859 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480ce330 con 0x7fd2480a8d00 2023-10-14T19:03:47.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24d976700 1 --2- 172.21.15.7:0/3389995859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd2480cddf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2380098d0 tx=0x7fd238009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c834a33cd053d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:47.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24c974700 1 -- 172.21.15.7:0/3389995859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238005c10 con 0x7fd2480a8d00 2023-10-14T19:03:47.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24c974700 1 -- 172.21.15.7:0/3389995859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238005d70 con 0x7fd2480a8d00 2023-10-14T19:03:47.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.946+0000 7fd24c974700 1 -- 172.21.15.7:0/3389995859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238006280 con 0x7fd2480a8d00 2023-10-14T19:03:47.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 -- 172.21.15.7:0/3389995859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 msgr2=0x7fd2480cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 --2- 172.21.15.7:0/3389995859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd2480cddf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2380098d0 tx=0x7fd238009120 comp rx=0 tx=0).stop 2023-10-14T19:03:47.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 -- 172.21.15.7:0/3389995859 shutdown_connections 2023-10-14T19:03:47.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 --2- 172.21.15.7:0/3389995859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd2480cddf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 -- 172.21.15.7:0/3389995859 >> 172.21.15.7:0/3389995859 conn(0x7fd24806ce80 msgr2=0x7fd2480ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:47.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 -- 172.21.15.7:0/3389995859 shutdown_connections 2023-10-14T19:03:47.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.947+0000 7fd24fbda700 1 -- 172.21.15.7:0/3389995859 wait complete. 2023-10-14T19:03:47.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.948+0000 7fd24fbda700 1 Processor -- start 2023-10-14T19:03:47.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.948+0000 7fd24fbda700 1 -- start start 2023-10-14T19:03:47.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd24806e550 0x7fd2480b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:47.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd248148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2480a90d0 0x7fd2481485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24814b780 con 0x7fd2480a8d00 2023-10-14T19:03:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24814bc10 con 0x7fd2480a90d0 2023-10-14T19:03:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24814ab70 con 0x7fd24806e550 2023-10-14T19:03:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd248148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:47.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd248148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38210/0 (socket says 172.21.15.7:38210) 2023-10-14T19:03:47.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 -- 172.21.15.7:0/552122655 learned_addr learned my addr 172.21.15.7:0/552122655 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:47.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d976700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd24806e550 0x7fd2480b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:47.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24e177700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2480a90d0 0x7fd2481485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:47.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 -- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd24806e550 msgr2=0x7fd2480b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd24806e550 0x7fd2480b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 -- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2480a90d0 msgr2=0x7fd2481485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:47.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2480a90d0 0x7fd2481485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:47.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 -- 172.21.15.7:0/552122655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380093c0 con 0x7fd2480a8d00 2023-10-14T19:03:47.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24d175700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd248148080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c7c0 tx=0x7fd23c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:47.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c011590 con 0x7fd2480a8d00 2023-10-14T19:03:47.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0116f0 con 0x7fd2480a8d00 2023-10-14T19:03:47.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.949+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24814ae50 con 0x7fd2480a8d00 2023-10-14T19:03:47.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.950+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c011ab0 con 0x7fd2480a8d00 2023-10-14T19:03:47.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.950+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24814b410 con 0x7fd2480a8d00 2023-10-14T19:03:47.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.951+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24814b930 con 0x7fd2480a8d00 2023-10-14T19:03:47.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.951+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd23c01b3b0 con 0x7fd2480a8d00 2023-10-14T19:03:47.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.951+0000 7fd245ffb700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd234066f30 0x7fd2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:47.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.951+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd23c0835e0 con 0x7fd2480a8d00 2023-10-14T19:03:47.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.952+0000 7fd24d976700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd234066f30 0x7fd2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:47.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.952+0000 7fd24d976700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd234066f30 0x7fd2340693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd238009390 tx=0x7fd238016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:47.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:47.956+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd24814b930 con 0x7fd2480a8d00 2023-10-14T19:03:48.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.232+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd24804c3c0 con 0x7fd2480a8d00 2023-10-14T19:03:48.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.233+0000 7fd245ffb700 1 -- 172.21.15.7:0/552122655 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd23c017020 con 0x7fd2480a8d00 2023-10-14T19:03:48.234 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:48.235 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:03:48.235 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:03:48.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.235 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:03:48.235 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:03:48.236 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.236 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.236 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:03:48.236 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:03:48.237 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.238 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:03:48.238 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:03:48.238 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.238 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.239 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:03:48.239 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:03:48.239 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.240 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:03:48.240 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:03:48.240 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.240 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.241 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:03:48.241 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:03:48.241 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.242 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:03:48.242 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:03:48.243 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.243 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.243 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:03:48.243 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:03:48.243 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.244 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.244 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:03:48.244 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:03:48.245 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.245 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.245 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.245 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.247 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:03:48.247 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:03:48.247 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.247 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.248 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.249 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:03:48.249 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:03:48.249 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.249 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.249 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.250 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.250 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:03:48.251 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:03:48.251 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.251 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.251 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:03:48.253 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:03:48.253 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.253 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.253 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.254 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:03:48.254 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:03:48.255 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.255 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.255 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.256 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:03:48.257 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:03:48.257 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.257 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.257 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.258 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:03:48.259 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:03:48.259 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.259 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:03:48.259 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:03:48.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.260 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:03:48.261 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:03:48.261 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.261 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.261 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:03:48.261 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:03:48.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:03:48.262 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.262 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:03:48.263 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:03:48.263 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.263 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.263 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:03:48.264 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:03:48.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:03:48.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.265 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:03:48.266 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:03:48.266 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.266 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.266 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:03:48.267 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:03:48.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:03:48.267 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.268 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:03:48.268 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:03:48.268 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.268 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:03:48.269 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:03:48.269 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:03:48.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:03:48.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.270 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:03:48.270 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:03:48.270 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.270 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:03:48.271 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:03:48.271 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:03:48.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.272 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mds", 2023-10-14T19:03:48.272 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDc5SplXTyxABAAsPaQ5mAXtUOFrelfqR/psA==", 2023-10-14T19:03:48.272 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.273 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T19:03:48.273 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.274 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T19:03:48.274 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDc5SplVUexABAArgkMCNR8e9WSnp9dtgWCGA==", 2023-10-14T19:03:48.274 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.274 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T19:03:48.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.275 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-osd", 2023-10-14T19:03:48.276 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDc5SplH1GxABAAzs4XfFsxlbG7d+YI/B1H4g==", 2023-10-14T19:03:48.276 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.276 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T19:03:48.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.277 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T19:03:48.277 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDc5Spl5VixABAAcWadxUBIjSJmva0fqjrlfg==", 2023-10-14T19:03:48.277 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.277 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T19:03:48.278 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.278 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T19:03:48.279 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDc5SplCGGxABAAu3CCSF6F+m86oodXIOoNNQ==", 2023-10-14T19:03:48.279 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.279 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T19:03:48.279 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.280 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T19:03:48.280 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDc5SplWWmxABAAoV8AgmM+AiTes8jOd/xLEA==", 2023-10-14T19:03:48.280 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.280 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T19:03:48.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.281 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:03:48.281 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:03:48.282 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.282 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:03:48.282 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:03:48.282 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:03:48.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:48.283 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:03:48.283 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:03:48.283 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:03:48.284 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:03:48.284 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:03:48.284 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:03:48.284 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:48.285 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:03:48.285 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:03:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd234066f30 msgr2=0x7fd2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd234066f30 0x7fd2340693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd238009390 tx=0x7fd238016000 comp rx=0 tx=0).stop 2023-10-14T19:03:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 msgr2=0x7fd248148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd248148080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c7c0 tx=0x7fd23c007f70 comp rx=0 tx=0).stop 2023-10-14T19:03:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 shutdown_connections 2023-10-14T19:03:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd234066f30 0x7fd2340693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2480a90d0 0x7fd2481485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd24806e550 0x7fd2480b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 --2- 172.21.15.7:0/552122655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2480a8d00 0x7fd248148080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 >> 172.21.15.7:0/552122655 conn(0x7fd24806ce80 msgr2=0x7fd24815eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 shutdown_connections 2023-10-14T19:03:48.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.235+0000 7fd24fbda700 1 -- 172.21.15.7:0/552122655 wait complete. 2023-10-14T19:03:48.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T19:03:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.447+0000 7f26463ce700 1 Processor -- start 2023-10-14T19:03:48.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.447+0000 7f26463ce700 1 -- start start 2023-10-14T19:03:48.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.448+0000 7f26463ce700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f26400cb970 0x7f2640159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.448+0000 7f26463ce700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f264015a400 0x7f2640156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.448+0000 7f26463ce700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264015ae40 con 0x7f26400cb5a0 2023-10-14T19:03:48.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.448+0000 7f26463ce700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400ce0f0 con 0x7f26400cb970 2023-10-14T19:03:48.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.448+0000 7f26463ce700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400d13f0 con 0x7f264015a400 2023-10-14T19:03:48.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.448+0000 7f263ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f26400cb5a0 0x7f26400cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:34256/0 (socket says 172.21.15.7:34256) 2023-10-14T19:03:48.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263ffff700 1 -- 172.21.15.7:0/2081542706 learned_addr learned my addr 172.21.15.7:0/2081542706 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:48.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f264496b700 1 --2- 172.21.15.7:0/2081542706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f264015a400 0x7f2640156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263f7fe700 1 --2- 172.21.15.7:0/2081542706 >> v2:172.21.15.148:3300/0 conn(0x7f26400cb970 0x7f2640159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263effd700 1 -- 172.21.15.7:0/2081542706 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755934857 0 0) 0x7f264015ae40 con 0x7f26400cb5a0 2023-10-14T19:03:48.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263effd700 1 -- 172.21.15.7:0/2081542706 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f262c003570 con 0x7f26400cb5a0 2023-10-14T19:03:48.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f264496b700 1 -- 172.21.15.7:0/2081542706 >> v2:172.21.15.148:3300/0 conn(0x7f26400cb970 msgr2=0x7f2640159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:48.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f264496b700 1 --2- 172.21.15.7:0/2081542706 >> v2:172.21.15.148:3300/0 conn(0x7f26400cb970 0x7f2640159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f264496b700 1 -- 172.21.15.7:0/2081542706 >> v1:172.21.15.148:6789/0 conn(0x7f26400cb5a0 legacy=0x7f26400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f264496b700 1 -- 172.21.15.7:0/2081542706 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264015ab60 con 0x7f264015a400 2023-10-14T19:03:48.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f264496b700 1 --2- 172.21.15.7:0/2081542706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f264015a400 0x7f2640156e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2638009e60 tx=0x7f2638009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4acff90a0cc8df8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:48.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263effd700 1 -- 172.21.15.7:0/2081542706 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800e070 con 0x7f264015a400 2023-10-14T19:03:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263effd700 1 -- 172.21.15.7:0/2081542706 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800bab0 con 0x7f264015a400 2023-10-14T19:03:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.449+0000 7f263effd700 1 -- 172.21.15.7:0/2081542706 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800be70 con 0x7f264015a400 2023-10-14T19:03:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 -- 172.21.15.7:0/2081542706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f264015a400 msgr2=0x7f2640156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 --2- 172.21.15.7:0/2081542706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f264015a400 0x7f2640156e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2638009e60 tx=0x7f2638009780 comp rx=0 tx=0).stop 2023-10-14T19:03:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 -- 172.21.15.7:0/2081542706 shutdown_connections 2023-10-14T19:03:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 --2- 172.21.15.7:0/2081542706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f264015a400 0x7f2640156e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 --2- 172.21.15.7:0/2081542706 >> v2:172.21.15.148:3300/0 conn(0x7f26400cb970 0x7f2640159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 -- 172.21.15.7:0/2081542706 >> 172.21.15.7:0/2081542706 conn(0x7f2640070e30 msgr2=0x7f26400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 -- 172.21.15.7:0/2081542706 shutdown_connections 2023-10-14T19:03:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.450+0000 7f26463ce700 1 -- 172.21.15.7:0/2081542706 wait complete. 2023-10-14T19:03:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.451+0000 7f26463ce700 1 Processor -- start 2023-10-14T19:03:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.451+0000 7f26463ce700 1 -- start start 2023-10-14T19:03:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f26463ce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 0x7f26401512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f26463ce700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26400cb970 0x7f26400cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f26463ce700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f264015a400 0x7f26400cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f26463ce700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640151810 con 0x7f26400cb5a0 2023-10-14T19:03:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f26463ce700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b3a50 con 0x7f264015a400 2023-10-14T19:03:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f26463ce700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b3d30 con 0x7f26400cb970 2023-10-14T19:03:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 0x7f26401512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 0x7f26401512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38224/0 (socket says 172.21.15.7:38224) 2023-10-14T19:03:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 -- 172.21.15.7:0/3641641556 learned_addr learned my addr 172.21.15.7:0/3641641556 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f264496b700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f264015a400 0x7f26400cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263f7fe700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26400cb970 0x7f26400cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 -- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26400cb970 msgr2=0x7f26400cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26400cb970 0x7f26400cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 -- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f264015a400 msgr2=0x7f26400cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f264015a400 0x7f26400cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f263ffff700 1 -- 172.21.15.7:0/3641641556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2638009a20 con 0x7f26400cb5a0 2023-10-14T19:03:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.452+0000 7f264496b700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f264015a400 0x7f26400cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.453+0000 7f263ffff700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 0x7f26401512d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f262800c590 tx=0x7f2628007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.453+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628005cd0 con 0x7f26400cb5a0 2023-10-14T19:03:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.453+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628005e50 con 0x7f26400cb5a0 2023-10-14T19:03:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.453+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26400b4010 con 0x7f26400cb5a0 2023-10-14T19:03:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.453+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628007320 con 0x7f26400cb5a0 2023-10-14T19:03:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.453+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26400b5260 con 0x7f26400cb5a0 2023-10-14T19:03:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.454+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26400b44b0 con 0x7f26400cb5a0 2023-10-14T19:03:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.454+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f262801b3b0 con 0x7f26400cb5a0 2023-10-14T19:03:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.455+0000 7f2637fff700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2620066f30 0x7f26200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.455+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f26280838d0 con 0x7f26400cb5a0 2023-10-14T19:03:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.455+0000 7f263f7fe700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2620066f30 0x7f26200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.455+0000 7f263f7fe700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2620066f30 0x7f26200693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2640156800 tx=0x7f26300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.459+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2628050e90 con 0x7f26400cb5a0 2023-10-14T19:03:48.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.733+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f264004c3c0 con 0x7f26400cb5a0 2023-10-14T19:03:48.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.737+0000 7f2637fff700 1 -- 172.21.15.7:0/3641641556 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2628017070 con 0x7f26400cb5a0 2023-10-14T19:03:48.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2620066f30 msgr2=0x7f26200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2620066f30 0x7f26200693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2640156800 tx=0x7f26300091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 msgr2=0x7f26401512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 0x7f26401512d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f262800c590 tx=0x7f2628007e00 comp rx=0 tx=0).stop 2023-10-14T19:03:48.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 shutdown_connections 2023-10-14T19:03:48.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2620066f30 0x7f26200693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f264015a400 0x7f26400cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26400cb5a0 0x7f26401512d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 --2- 172.21.15.7:0/3641641556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26400cb970 0x7f26400cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 >> 172.21.15.7:0/3641641556 conn(0x7f2640070e30 msgr2=0x7f2640155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:48.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 shutdown_connections 2023-10-14T19:03:48.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.739+0000 7f26463ce700 1 -- 172.21.15.7:0/3641641556 wait complete. 2023-10-14T19:03:48.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T19:03:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.872+0000 7f964f027700 1 Processor -- start 2023-10-14T19:03:48.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.872+0000 7f964f027700 1 -- start start 2023-10-14T19:03:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964f027700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96480cb5a0 0x7f96480cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964f027700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480cd9e0 0x7f9648159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964f027700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96480cde50 0x7f964815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964f027700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96480d13f0 con 0x7f96480cde50 2023-10-14T19:03:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964f027700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964815a940 con 0x7f96480cb5a0 2023-10-14T19:03:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964f027700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964815ae40 con 0x7f96480cd9e0 2023-10-14T19:03:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96480cde50 0x7f964815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96480cde50 0x7f964815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38234/0 (socket says 172.21.15.7:38234) 2023-10-14T19:03:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 -- 172.21.15.7:0/3046530970 learned_addr learned my addr 172.21.15.7:0/3046530970 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964cdc3700 1 --2- 172.21.15.7:0/3046530970 >> v2:172.21.15.148:3300/0 conn(0x7f96480cb5a0 0x7f96480cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f9647fff700 1 --2- 172.21.15.7:0/3046530970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480cd9e0 0x7f9648159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 -- 172.21.15.7:0/3046530970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480cd9e0 msgr2=0x7f9648159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 --2- 172.21.15.7:0/3046530970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480cd9e0 0x7f9648159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 -- 172.21.15.7:0/3046530970 >> v2:172.21.15.148:3300/0 conn(0x7f96480cb5a0 msgr2=0x7f96480cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 --2- 172.21.15.7:0/3046530970 >> v2:172.21.15.148:3300/0 conn(0x7f96480cb5a0 0x7f96480cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 -- 172.21.15.7:0/3046530970 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964815ab60 con 0x7f96480cde50 2023-10-14T19:03:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f964d5c4700 1 --2- 172.21.15.7:0/3046530970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cde50 0x7f964815a400 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9648065120 tx=0x7f9638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6668de8644309606 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f96477fe700 1 -- 172.21.15.7:0/3046530970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800b820 con 0x7f96480cde50 2023-10-14T19:03:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f96477fe700 1 -- 172.21.15.7:0/3046530970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963800b980 con 0x7f96480cde50 2023-10-14T19:03:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.873+0000 7f96477fe700 1 -- 172.21.15.7:0/3046530970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800bd20 con 0x7f96480cde50 2023-10-14T19:03:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 -- 172.21.15.7:0/3046530970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cde50 msgr2=0x7f964815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 --2- 172.21.15.7:0/3046530970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cde50 0x7f964815a400 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9648065120 tx=0x7f9638009250 comp rx=0 tx=0).stop 2023-10-14T19:03:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 -- 172.21.15.7:0/3046530970 shutdown_connections 2023-10-14T19:03:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 --2- 172.21.15.7:0/3046530970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cde50 0x7f964815a400 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 --2- 172.21.15.7:0/3046530970 >> v2:172.21.15.148:3300/0 conn(0x7f96480cb5a0 0x7f96480cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 --2- 172.21.15.7:0/3046530970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480cd9e0 0x7f9648159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 -- 172.21.15.7:0/3046530970 >> 172.21.15.7:0/3046530970 conn(0x7f9648070e30 msgr2=0x7f96480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 -- 172.21.15.7:0/3046530970 shutdown_connections 2023-10-14T19:03:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.874+0000 7f964f027700 1 -- 172.21.15.7:0/3046530970 wait complete. 2023-10-14T19:03:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.875+0000 7f964f027700 1 Processor -- start 2023-10-14T19:03:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.875+0000 7f964f027700 1 -- start start 2023-10-14T19:03:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964f027700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96480cb5a0 0x7f96481558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964f027700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 0x7f96480c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964f027700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480c7950 0x7f9648159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964f027700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648156f00 con 0x7f96480cd9e0 2023-10-14T19:03:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964f027700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964815b910 con 0x7f96480cb5a0 2023-10-14T19:03:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964f027700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96480caaf0 con 0x7f96480c7950 2023-10-14T19:03:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f9647fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 0x7f96480c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f9647fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 0x7f96480c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38236/0 (socket says 172.21.15.7:38236) 2023-10-14T19:03:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f9647fff700 1 -- 172.21.15.7:0/677269715 learned_addr learned my addr 172.21.15.7:0/677269715 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964cdc3700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96480cb5a0 0x7f96481558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.876+0000 7f964d5c4700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480c7950 0x7f9648159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9647fff700 1 -- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480c7950 msgr2=0x7f9648159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9647fff700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480c7950 0x7f9648159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9647fff700 1 -- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96480cb5a0 msgr2=0x7f96481558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9647fff700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96480cb5a0 0x7f96481558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9647fff700 1 -- 172.21.15.7:0/677269715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380094f0 con 0x7f96480cd9e0 2023-10-14T19:03:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f964d5c4700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480c7950 0x7f9648159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9647fff700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 0x7f96480c9bd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f963c00d8c0 tx=0x7f963c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c0125f0 con 0x7f96480cd9e0 2023-10-14T19:03:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c012750 con 0x7f96480cd9e0 2023-10-14T19:03:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96480ca530 con 0x7f96480cd9e0 2023-10-14T19:03:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c012af0 con 0x7f96480cd9e0 2023-10-14T19:03:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.877+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964815b5a0 con 0x7f96480cd9e0 2023-10-14T19:03:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.878+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964815bac0 con 0x7f96480cd9e0 2023-10-14T19:03:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.878+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f963c01e460 con 0x7f96480cd9e0 2023-10-14T19:03:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.879+0000 7f9644ff9700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9634066f30 0x7f96340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.879+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f963c084780 con 0x7f96480cd9e0 2023-10-14T19:03:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.879+0000 7f964cdc3700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9634066f30 0x7f96340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.880+0000 7f964cdc3700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9634066f30 0x7f96340693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9640009fd0 tx=0x7f9640009880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:48.883+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f964815bac0 con 0x7f96480cd9e0 2023-10-14T19:03:49.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.153+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f964815bac0 con 0x7f96480cd9e0 2023-10-14T19:03:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.157+0000 7f9644ff9700 1 -- 172.21.15.7:0/677269715 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f964815bac0 con 0x7f96480cd9e0 2023-10-14T19:03:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9634066f30 msgr2=0x7f96340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9634066f30 0x7f96340693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9640009fd0 tx=0x7f9640009880 comp rx=0 tx=0).stop 2023-10-14T19:03:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 msgr2=0x7f96480c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 0x7f96480c9bd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f963c00d8c0 tx=0x7f963c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 shutdown_connections 2023-10-14T19:03:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9634066f30 0x7f96340693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96480cb5a0 0x7f96481558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96480c7950 0x7f9648159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 --2- 172.21.15.7:0/677269715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96480cd9e0 0x7f96480c9bd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 >> 172.21.15.7:0/677269715 conn(0x7f9648070e30 msgr2=0x7f96480ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 shutdown_connections 2023-10-14T19:03:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.159+0000 7f964f027700 1 -- 172.21.15.7:0/677269715 wait complete. 2023-10-14T19:03:49.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T19:03:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.292+0000 7f2fa2dad700 1 Processor -- start 2023-10-14T19:03:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.292+0000 7f2fa2dad700 1 -- start start 2023-10-14T19:03:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa2dad700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2f9c153c30 0x7f2f9c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa2dad700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c0cf110 0x7f2f9c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa2dad700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c15afd0 con 0x7f2f9c15de50 2023-10-14T19:03:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa2dad700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c15b2b0 con 0x7f2f9c153c30 2023-10-14T19:03:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa2dad700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c15b590 con 0x7f2f9c0cf110 2023-10-14T19:03:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa15aa700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2f9c15de50 0x7f2f9c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55384/0 (socket says 172.21.15.7:55384) 2023-10-14T19:03:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa15aa700 1 -- 172.21.15.7:0/2339649874 learned_addr learned my addr 172.21.15.7:0/2339649874 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa25ac700 1 --2- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c0cf110 0x7f2f9c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa1dab700 1 --2- 172.21.15.7:0/2339649874 >> v2:172.21.15.148:3300/0 conn(0x7f2f9c153c30 0x7f2f9c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.293+0000 7f2fa0da9700 1 -- 172.21.15.7:0/2339649874 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717857173 0 0) 0x7f2f9c15afd0 con 0x7f2f9c15de50 2023-10-14T19:03:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa0da9700 1 -- 172.21.15.7:0/2339649874 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f84003570 con 0x7f2f9c15de50 2023-10-14T19:03:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa1dab700 1 -- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c0cf110 msgr2=0x7f2f9c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa1dab700 1 --2- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c0cf110 0x7f2f9c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa1dab700 1 -- 172.21.15.7:0/2339649874 >> v1:172.21.15.7:6789/0 conn(0x7f2f9c15de50 legacy=0x7f2f9c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa1dab700 1 -- 172.21.15.7:0/2339649874 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c15b870 con 0x7f2f9c153c30 2023-10-14T19:03:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa1dab700 1 --2- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153c30 0x7f2f9c15a5e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009e60 tx=0x7f2f8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f5f2f3446adf1b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa0da9700 1 -- 172.21.15.7:0/2339649874 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00e070 con 0x7f2f9c153c30 2023-10-14T19:03:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa0da9700 1 -- 172.21.15.7:0/2339649874 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c00bab0 con 0x7f2f9c153c30 2023-10-14T19:03:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.294+0000 7f2fa0da9700 1 -- 172.21.15.7:0/2339649874 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00be70 con 0x7f2f9c153c30 2023-10-14T19:03:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153c30 msgr2=0x7f2f9c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153c30 0x7f2f9c15a5e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009e60 tx=0x7f2f8c009780 comp rx=0 tx=0).stop 2023-10-14T19:03:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2339649874 shutdown_connections 2023-10-14T19:03:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153c30 0x7f2f9c15a5e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2339649874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c0cf110 0x7f2f9c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2339649874 >> 172.21.15.7:0/2339649874 conn(0x7f2f9c0703a0 msgr2=0x7f2f9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2339649874 shutdown_connections 2023-10-14T19:03:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.295+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2339649874 wait complete. 2023-10-14T19:03:49.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.296+0000 7f2fa2dad700 1 Processor -- start 2023-10-14T19:03:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.296+0000 7f2fa2dad700 1 -- start start 2023-10-14T19:03:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.296+0000 7f2fa2dad700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0cf110 0x7f2f9c0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.296+0000 7f2fa2dad700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c153c30 0x7f2f9c13efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa2dad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 0x7f2f9c14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa2dad700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c13f4f0 con 0x7f2f9c15de50 2023-10-14T19:03:49.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa2dad700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0cd4f0 con 0x7f2f9c0cf110 2023-10-14T19:03:49.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa2dad700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c150d50 con 0x7f2f9c153c30 2023-10-14T19:03:49.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 0x7f2f9c14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 0x7f2f9c14c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38240/0 (socket says 172.21.15.7:38240) 2023-10-14T19:03:49.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 -- 172.21.15.7:0/2912263241 learned_addr learned my addr 172.21.15.7:0/2912263241 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:49.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa1dab700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0cf110 0x7f2f9c0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa15aa700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c153c30 0x7f2f9c13efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 -- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c153c30 msgr2=0x7f2f9c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c153c30 0x7f2f9c13efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 -- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0cf110 msgr2=0x7f2f9c0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0cf110 0x7f2f9c0ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 -- 172.21.15.7:0/2912263241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c009a20 con 0x7f2f9c15de50 2023-10-14T19:03:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa25ac700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 0x7f2f9c14c100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400ea80 tx=0x7f2f940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400eec0 con 0x7f2f9c15de50 2023-10-14T19:03:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9400c850 con 0x7f2f9c15de50 2023-10-14T19:03:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c0cb930 con 0x7f2f9c15de50 2023-10-14T19:03:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.297+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400cc10 con 0x7f2f9c15de50 2023-10-14T19:03:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.298+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c14bea0 con 0x7f2f9c15de50 2023-10-14T19:03:49.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.298+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c150ec0 con 0x7f2f9c15de50 2023-10-14T19:03:49.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.299+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f94013470 con 0x7f2f9c15de50 2023-10-14T19:03:49.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.299+0000 7f2f99ffb700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f88066f30 0x7f2f880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.299+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f94084460 con 0x7f2f9c15de50 2023-10-14T19:03:49.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.300+0000 7f2fa1dab700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f88066f30 0x7f2f880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.300+0000 7f2fa1dab700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f88066f30 0x7f2f880693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0097c0 tx=0x7f2f8c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:49.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.304+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f9c150ec0 con 0x7f2f9c15de50 2023-10-14T19:03:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.574+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2f9c150ec0 con 0x7f2f9c15de50 2023-10-14T19:03:49.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.577+0000 7f2f99ffb700 1 -- 172.21.15.7:0/2912263241 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2f9c150ec0 con 0x7f2f9c15de50 2023-10-14T19:03:49.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f88066f30 msgr2=0x7f2f880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f88066f30 0x7f2f880693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0097c0 tx=0x7f2f8c019000 comp rx=0 tx=0).stop 2023-10-14T19:03:49.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 msgr2=0x7f2f9c14c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 0x7f2f9c14c100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400ea80 tx=0x7f2f940091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 shutdown_connections 2023-10-14T19:03:49.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f88066f30 0x7f2f880693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0cf110 0x7f2f9c0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f9c15de50 0x7f2f9c14c100 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 --2- 172.21.15.7:0/2912263241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f9c153c30 0x7f2f9c13efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.579+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 >> 172.21.15.7:0/2912263241 conn(0x7f2f9c0703a0 msgr2=0x7f2f9c0c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:49.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.580+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 shutdown_connections 2023-10-14T19:03:49.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.580+0000 7f2fa2dad700 1 -- 172.21.15.7:0/2912263241 wait complete. 2023-10-14T19:03:49.592 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T19:03:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.711+0000 7fe5c8045700 1 Processor -- start 2023-10-14T19:03:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.712+0000 7fe5c8045700 1 -- start start 2023-10-14T19:03:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.712+0000 7fe5c8045700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c00cb970 0x7fe5c0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.712+0000 7fe5c8045700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c015ae40 con 0x7fe5c015a400 2023-10-14T19:03:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.712+0000 7fe5c8045700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c015ab60 con 0x7fe5c00cb5a0 2023-10-14T19:03:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.712+0000 7fe5c8045700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c00ce0f0 con 0x7fe5c00cb970 2023-10-14T19:03:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c55e0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c00cb970 0x7fe5c0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c65e2700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe5c015a400 0x7fe5c0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55394/0 (socket says 172.21.15.7:55394) 2023-10-14T19:03:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c65e2700 1 -- 172.21.15.7:0/2833839210 learned_addr learned my addr 172.21.15.7:0/2833839210 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c55e0700 1 -- 172.21.15.7:0/2833839210 >> v1:172.21.15.148:6789/0 conn(0x7fe5c00cb5a0 legacy=0x7fe5c00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c55e0700 1 -- 172.21.15.7:0/2833839210 >> v1:172.21.15.7:6789/0 conn(0x7fe5c015a400 legacy=0x7fe5c0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c55e0700 1 -- 172.21.15.7:0/2833839210 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c00ccf00 con 0x7fe5c00cb970 2023-10-14T19:03:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c4ddf700 1 -- 172.21.15.7:0/2833839210 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576838028 0 0) 0x7fe5c015ae40 con 0x7fe5c015a400 2023-10-14T19:03:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c55e0700 1 --2- 172.21.15.7:0/2833839210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c0159ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40098e0 tx=0x7fe5b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db886bf044b1059 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c4ddf700 1 -- 172.21.15.7:0/2833839210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4009e80 con 0x7fe5c00cb970 2023-10-14T19:03:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c4ddf700 1 -- 172.21.15.7:0/2833839210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400b860 con 0x7fe5c00cb970 2023-10-14T19:03:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.713+0000 7fe5c4ddf700 1 -- 172.21.15.7:0/2833839210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400bbe0 con 0x7fe5c00cb970 2023-10-14T19:03:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 -- 172.21.15.7:0/2833839210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 msgr2=0x7fe5c0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 --2- 172.21.15.7:0/2833839210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c0159ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40098e0 tx=0x7fe5b40091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 -- 172.21.15.7:0/2833839210 shutdown_connections 2023-10-14T19:03:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 --2- 172.21.15.7:0/2833839210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c0159ec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 -- 172.21.15.7:0/2833839210 >> 172.21.15.7:0/2833839210 conn(0x7fe5c0070e30 msgr2=0x7fe5c00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 -- 172.21.15.7:0/2833839210 shutdown_connections 2023-10-14T19:03:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.714+0000 7fe5c8045700 1 -- 172.21.15.7:0/2833839210 wait complete. 2023-10-14T19:03:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.715+0000 7fe5c8045700 1 Processor -- start 2023-10-14T19:03:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.715+0000 7fe5c8045700 1 -- start start 2023-10-14T19:03:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c8045700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c00cb5a0 0x7fe5c01530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c8045700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c00af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c8045700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c015a400 0x7fe5c00b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c8045700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c015d320 con 0x7fe5c00cb970 2023-10-14T19:03:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c8045700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c015dec0 con 0x7fe5c015a400 2023-10-14T19:03:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c8045700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c015cd60 con 0x7fe5c00cb5a0 2023-10-14T19:03:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c00af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c00af160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38252/0 (socket says 172.21.15.7:38252) 2023-10-14T19:03:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 -- 172.21.15.7:0/3886425258 learned_addr learned my addr 172.21.15.7:0/3886425258 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c5de1700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c00cb5a0 0x7fe5c01530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c65e2700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c015a400 0x7fe5c00b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 -- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c00cb5a0 msgr2=0x7fe5c01530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c00cb5a0 0x7fe5c01530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 -- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c015a400 msgr2=0x7fe5c00b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c015a400 0x7fe5c00b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:49.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 -- 172.21.15.7:0/3886425258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4009420 con 0x7fe5c00cb970 2023-10-14T19:03:49.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.716+0000 7fe5c55e0700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c00af160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe5c006ea60 tx=0x7fe5b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:49.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.717+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b401f070 con 0x7fe5c00cb970 2023-10-14T19:03:49.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.717+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b4011420 con 0x7fe5c00cb970 2023-10-14T19:03:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.717+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c015d040 con 0x7fe5c00cb970 2023-10-14T19:03:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.717+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400bbe0 con 0x7fe5c00cb970 2023-10-14T19:03:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.717+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c00c8c10 con 0x7fe5c00cb970 2023-10-14T19:03:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.718+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c00c8e00 con 0x7fe5c00cb970 2023-10-14T19:03:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.718+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5b4011a50 con 0x7fe5c00cb970 2023-10-14T19:03:49.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.719+0000 7fe5bdffb700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5ac066f30 0x7fe5ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:49.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.719+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe5b40858b0 con 0x7fe5c00cb970 2023-10-14T19:03:49.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.719+0000 7fe5c5de1700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5ac066f30 0x7fe5ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:49.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.719+0000 7fe5c5de1700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5ac066f30 0x7fe5ac0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0003860 tx=0x7fe5b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:49.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.723+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5b4052dd0 con 0x7fe5c00cb970 2023-10-14T19:03:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.995+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe5c004c3c0 con 0x7fe5c00cb970 2023-10-14T19:03:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:49.998+0000 7fe5bdffb700 1 -- 172.21.15.7:0/3886425258 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5b40563f0 con 0x7fe5c00cb970 2023-10-14T19:03:50.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5ac066f30 msgr2=0x7fe5ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5ac066f30 0x7fe5ac0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0003860 tx=0x7fe5b0009040 comp rx=0 tx=0).stop 2023-10-14T19:03:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 msgr2=0x7fe5c00af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c00af160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe5c006ea60 tx=0x7fe5b4017000 comp rx=0 tx=0).stop 2023-10-14T19:03:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 shutdown_connections 2023-10-14T19:03:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5ac066f30 0x7fe5ac0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c015a400 0x7fe5c00b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c00cb5a0 0x7fe5c01530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 --2- 172.21.15.7:0/3886425258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c00cb970 0x7fe5c00af160 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 >> 172.21.15.7:0/3886425258 conn(0x7fe5c0070e30 msgr2=0x7fe5c00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 shutdown_connections 2023-10-14T19:03:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.000+0000 7fe5c8045700 1 -- 172.21.15.7:0/3886425258 wait complete. 2023-10-14T19:03:50.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T19:03:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.132+0000 7f7a83052700 1 Processor -- start 2023-10-14T19:03:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.132+0000 7f7a83052700 1 -- start start 2023-10-14T19:03:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a83052700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a7c0cb970 0x7f7a7c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a83052700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c15a400 0x7f7a7c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a83052700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c15ae40 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a83052700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0ce0f0 con 0x7f7a7c0cb970 2023-10-14T19:03:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a83052700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0d13f0 con 0x7f7a7c15a400 2023-10-14T19:03:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a7c0cb970 0x7f7a7c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a7c0cb970 0x7f7a7c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38264/0 (socket says 172.21.15.7:38264) 2023-10-14T19:03:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 -- 172.21.15.7:0/1216045425 learned_addr learned my addr 172.21.15.7:0/1216045425 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a815ef700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c15a400 0x7f7a7c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 -- 172.21.15.7:0/1216045425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c15a400 msgr2=0x7f7a7c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c15a400 0x7f7a7c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 -- 172.21.15.7:0/1216045425 >> v1:172.21.15.148:6789/0 conn(0x7f7a7c0cb5a0 legacy=0x7f7a7c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 -- 172.21.15.7:0/1216045425 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c15ab60 con 0x7f7a7c0cb970 2023-10-14T19:03:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a815ef700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c15a400 0x7f7a7c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:50.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.133+0000 7f7a7bfff700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb970 0x7f7a7c159ec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7a700099b0 tx=0x7f7a70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f15dfc66dd606e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a7b7fe700 1 -- 172.21.15.7:0/1216045425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000b820 con 0x7f7a7c0cb970 2023-10-14T19:03:50.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a7b7fe700 1 -- 172.21.15.7:0/1216045425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000b980 con 0x7f7a7c0cb970 2023-10-14T19:03:50.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a7b7fe700 1 -- 172.21.15.7:0/1216045425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000bd20 con 0x7f7a7c0cb970 2023-10-14T19:03:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 -- 172.21.15.7:0/1216045425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb970 msgr2=0x7f7a7c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb970 0x7f7a7c159ec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7a700099b0 tx=0x7f7a70009250 comp rx=0 tx=0).stop 2023-10-14T19:03:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 -- 172.21.15.7:0/1216045425 shutdown_connections 2023-10-14T19:03:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c15a400 0x7f7a7c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 --2- 172.21.15.7:0/1216045425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb970 0x7f7a7c159ec0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 -- 172.21.15.7:0/1216045425 >> 172.21.15.7:0/1216045425 conn(0x7f7a7c070e30 msgr2=0x7f7a7c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:50.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 -- 172.21.15.7:0/1216045425 shutdown_connections 2023-10-14T19:03:50.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.134+0000 7f7a83052700 1 -- 172.21.15.7:0/1216045425 wait complete. 2023-10-14T19:03:50.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.135+0000 7f7a83052700 1 Processor -- start 2023-10-14T19:03:50.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.135+0000 7f7a83052700 1 -- start start 2023-10-14T19:03:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a83052700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 0x7f7a7c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a83052700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0cb970 0x7f7a7c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a83052700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c15a400 0x7f7a7c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a83052700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b34b0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a83052700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b3790 con 0x7f7a7c15a400 2023-10-14T19:03:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a83052700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b3a70 con 0x7f7a7c0cb970 2023-10-14T19:03:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a80dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 0x7f7a7c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a80dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 0x7f7a7c0b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38278/0 (socket says 172.21.15.7:38278) 2023-10-14T19:03:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a80dee700 1 -- 172.21.15.7:0/3398278209 learned_addr learned my addr 172.21.15.7:0/3398278209 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a7bfff700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0cb970 0x7f7a7c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.136+0000 7f7a815ef700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c15a400 0x7f7a7c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a80dee700 1 -- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0cb970 msgr2=0x7f7a7c1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a80dee700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0cb970 0x7f7a7c1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a80dee700 1 -- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c15a400 msgr2=0x7f7a7c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a80dee700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c15a400 0x7f7a7c0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a80dee700 1 -- 172.21.15.7:0/3398278209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700094f0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a80dee700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 0x7f7a7c0b5210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c5d0 tx=0x7f7a6c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c011590 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c011710 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c0b3d50 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c011ad0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.137+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0b4310 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.138+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c04c3c0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.138+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a6c01c460 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.139+0000 7f7a78ff9700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a68066f30 0x7f7a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.139+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7a6c083fe0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.139+0000 7f7a7bfff700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a68066f30 0x7f7a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.140+0000 7f7a7bfff700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a68066f30 0x7f7a680693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a700099b0 tx=0x7f7a70016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.143+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a6c0515a0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.416+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7a7c089700 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.420+0000 7f7a78ff9700 1 -- 172.21.15.7:0/3398278209 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a6c054bc0 con 0x7f7a7c0cb5a0 2023-10-14T19:03:50.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a68066f30 msgr2=0x7f7a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a68066f30 0x7f7a680693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a700099b0 tx=0x7f7a70016000 comp rx=0 tx=0).stop 2023-10-14T19:03:50.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 msgr2=0x7f7a7c0b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 0x7f7a7c0b5210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c5d0 tx=0x7f7a6c007f60 comp rx=0 tx=0).stop 2023-10-14T19:03:50.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 shutdown_connections 2023-10-14T19:03:50.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a68066f30 0x7f7a680693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c15a400 0x7f7a7c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a7c0cb5a0 0x7f7a7c0b5210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 --2- 172.21.15.7:0/3398278209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0cb970 0x7f7a7c1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 >> 172.21.15.7:0/3398278209 conn(0x7f7a7c070e30 msgr2=0x7f7a7c1552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:50.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 shutdown_connections 2023-10-14T19:03:50.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.422+0000 7f7a83052700 1 -- 172.21.15.7:0/3398278209 wait complete. 2023-10-14T19:03:50.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T19:03:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.555+0000 7f3799891700 1 Processor -- start 2023-10-14T19:03:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.555+0000 7f3799891700 1 -- start start 2023-10-14T19:03:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.555+0000 7f3799891700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37940cb5a0 0x7f37940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3799891700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 0x7f3794156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3799891700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379415ae40 con 0x7f37940cd9e0 2023-10-14T19:03:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3799891700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940d13f0 con 0x7f37940cb5a0 2023-10-14T19:03:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3799891700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379415ab60 con 0x7f379415a5d0 2023-10-14T19:03:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f37927fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37940cd9e0 0x7f3794159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55404/0 (socket says 172.21.15.7:55404) 2023-10-14T19:03:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f37927fc700 1 -- 172.21.15.7:0/4226531005 learned_addr learned my addr 172.21.15.7:0/4226531005 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3792ffd700 1 --2- 172.21.15.7:0/4226531005 >> v2:172.21.15.148:3300/0 conn(0x7f37940cb5a0 0x7f37940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f37937fe700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 0x7f3794156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879608817 0 0) 0x7f379415ae40 con 0x7f37940cd9e0 2023-10-14T19:03:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3780003570 con 0x7f37940cd9e0 2023-10-14T19:03:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 752770670 0 0) 0x7f3780003570 con 0x7f37940cd9e0 2023-10-14T19:03:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 msgr2=0x7f3794156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 0x7f3794156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 >> v2:172.21.15.148:3300/0 conn(0x7f37940cb5a0 msgr2=0x7f37940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 --2- 172.21.15.7:0/4226531005 >> v2:172.21.15.148:3300/0 conn(0x7f37940cb5a0 0x7f37940cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940ccf00 con 0x7f37940cd9e0 2023-10-14T19:03:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f377c001470 con 0x7f37940cd9e0 2023-10-14T19:03:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 >> v1:172.21.15.7:6789/0 conn(0x7f37940cd9e0 legacy=0x7f3794159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.556+0000 7f3791ffb700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3780003a60 0x7f3780003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 0x7f3780004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3780004d50 0x7f37800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379415ab60 con 0x7f3780004d50 2023-10-14T19:03:50.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378000ba60 con 0x7f3780003a60 2023-10-14T19:03:50.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378000bba0 con 0x7f379415a5d0 2023-10-14T19:03:50.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3780004d50 0x7f37800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3792ffd700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3780003a60 0x7f3780003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37927fc700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 0x7f3780004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 -- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 msgr2=0x7f3780004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f379415a5d0 0x7f3780004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 -- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3780003a60 msgr2=0x7f3780003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3780003a60 0x7f3780003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 -- 172.21.15.7:0/4226531005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780003570 con 0x7f3780004d50 2023-10-14T19:03:50.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f37937fe700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3780004d50 0x7f37800051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f378c009c00 tx=0x7f378c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b73d366b4ce9f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00e6b0 con 0x7f3780004d50 2023-10-14T19:03:50.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00e810 con 0x7f3780004d50 2023-10-14T19:03:50.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.557+0000 7f3791ffb700 1 -- 172.21.15.7:0/4226531005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00ebd0 con 0x7f3780004d50 2023-10-14T19:03:50.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f3799891700 1 -- 172.21.15.7:0/4226531005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3780004d50 msgr2=0x7f37800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f3799891700 1 --2- 172.21.15.7:0/4226531005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3780004d50 0x7f37800051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f378c009c00 tx=0x7f378c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f37937fe700 1 -- 172.21.15.7:0/4226531005 reap_dead start 2023-10-14T19:03:50.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f3799891700 1 -- 172.21.15.7:0/4226531005 shutdown_connections 2023-10-14T19:03:50.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f3799891700 1 -- 172.21.15.7:0/4226531005 >> 172.21.15.7:0/4226531005 conn(0x7f3794070e30 msgr2=0x7f37940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:50.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f3799891700 1 -- 172.21.15.7:0/4226531005 shutdown_connections 2023-10-14T19:03:50.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.558+0000 7f3799891700 1 -- 172.21.15.7:0/4226531005 wait complete. 2023-10-14T19:03:50.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.559+0000 7f3799891700 1 Processor -- start 2023-10-14T19:03:50.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.559+0000 7f3799891700 1 -- start start 2023-10-14T19:03:50.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3799891700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3794151110 0x7f3794152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3799891700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37940b4a00 0x7f37940c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3799891700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 0x7f37940c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3799891700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940b4e90 con 0x7f37941514e0 2023-10-14T19:03:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3799891700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940b5170 con 0x7f37940b4a00 2023-10-14T19:03:50.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3799891700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940b5450 con 0x7f3794151110 2023-10-14T19:03:50.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 0x7f37940c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 0x7f37940c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38300/0 (socket says 172.21.15.7:38300) 2023-10-14T19:03:50.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 -- 172.21.15.7:0/3721715275 learned_addr learned my addr 172.21.15.7:0/3721715275 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:50.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f3792ffd700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3794151110 0x7f3794152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37927fc700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37940b4a00 0x7f37940c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 -- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3794151110 msgr2=0x7f3794152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3794151110 0x7f3794152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 -- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37940b4a00 msgr2=0x7f37940c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37940b4a00 0x7f37940c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 -- 172.21.15.7:0/3721715275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940b5730 con 0x7f37941514e0 2023-10-14T19:03:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.560+0000 7f37937fe700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 0x7f37940c69c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f378c016000 tx=0x7f378c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.561+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c022070 con 0x7f37941514e0 2023-10-14T19:03:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.561+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00eb90 con 0x7f37941514e0 2023-10-14T19:03:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.561+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37940b5a10 con 0x7f37941514e0 2023-10-14T19:03:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.561+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00e6b0 con 0x7f37941514e0 2023-10-14T19:03:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.561+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37940b34b0 con 0x7f37941514e0 2023-10-14T19:03:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.562+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37940c8340 con 0x7f37941514e0 2023-10-14T19:03:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.562+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f378c027920 con 0x7f37941514e0 2023-10-14T19:03:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.562+0000 7f378affd700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3774066f30 0x7f37740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.562+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f378c085b40 con 0x7f37941514e0 2023-10-14T19:03:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.563+0000 7f3792ffd700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3774066f30 0x7f37740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.563+0000 7f3792ffd700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3774066f30 0x7f37740693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3784009fd0 tx=0x7f378400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.567+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f378c0531b0 con 0x7f37941514e0 2023-10-14T19:03:50.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.842+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f37940b4e90 con 0x7f37941514e0 2023-10-14T19:03:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.846+0000 7f378affd700 1 -- 172.21.15.7:0/3721715275 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f378c0567d0 con 0x7f37941514e0 2023-10-14T19:03:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3774066f30 msgr2=0x7f37740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3774066f30 0x7f37740693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3784009fd0 tx=0x7f378400b040 comp rx=0 tx=0).stop 2023-10-14T19:03:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 msgr2=0x7f37940c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 0x7f37940c69c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f378c016000 tx=0x7f378c01a000 comp rx=0 tx=0).stop 2023-10-14T19:03:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 shutdown_connections 2023-10-14T19:03:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3774066f30 0x7f37740693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37941514e0 0x7f37940c69c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3794151110 0x7f3794152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 --2- 172.21.15.7:0/3721715275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37940b4a00 0x7f37940c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 >> 172.21.15.7:0/3721715275 conn(0x7f3794070e30 msgr2=0x7f37940b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 shutdown_connections 2023-10-14T19:03:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.848+0000 7f3799891700 1 -- 172.21.15.7:0/3721715275 wait complete. 2023-10-14T19:03:50.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.979+0000 7f8783cfe700 1 Processor -- start 2023-10-14T19:03:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.980+0000 7f8783cfe700 1 -- start start 2023-10-14T19:03:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.980+0000 7f8783cfe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 0x7f877c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.980+0000 7f8783cfe700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0ce9d0 con 0x7f877c0cfe70 2023-10-14T19:03:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.980+0000 7f8783cfe700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0af960 con 0x7f877c1598b0 2023-10-14T19:03:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.980+0000 7f8783cfe700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0afc30 con 0x7f877c159c80 2023-10-14T19:03:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f878229b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f877c0cfe70 0x7f877c163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55406/0 (socket says 172.21.15.7:55406) 2023-10-14T19:03:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f878229b700 1 -- 172.21.15.7:0/1214361722 learned_addr learned my addr 172.21.15.7:0/1214361722 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8781299700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 0x7f877c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695785743 0 0) 0x7f877c0ce9d0 con 0x7f877c0cfe70 2023-10-14T19:03:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8764003570 con 0x7f877c0cfe70 2023-10-14T19:03:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521266340 0 0) 0x7f877c0af960 con 0x7f877c1598b0 2023-10-14T19:03:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f877c0ce9d0 con 0x7f877c1598b0 2023-10-14T19:03:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442115354 0 0) 0x7f8764003570 con 0x7f877c0cfe70 2023-10-14T19:03:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 msgr2=0x7f877c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 0x7f877c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 >> v1:172.21.15.148:6789/0 conn(0x7f877c1598b0 legacy=0x7f877c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c0aff10 con 0x7f877c0cfe70 2023-10-14T19:03:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f876c0017f0 con 0x7f877c0cfe70 2023-10-14T19:03:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 >> v1:172.21.15.7:6789/0 conn(0x7f877c0cfe70 legacy=0x7f877c163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 0x7f8764003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87640041d0 0x7f8764004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764004d50 0x7f87640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0afc30 con 0x7f8764004d50 2023-10-14T19:03:50.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876400bbf0 con 0x7f87640041d0 2023-10-14T19:03:50.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876400bdb0 con 0x7f877c159c80 2023-10-14T19:03:50.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f878229b700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764004d50 0x7f87640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8781a9a700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 0x7f8764003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.981+0000 7f8781299700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87640041d0 0x7f8764004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:50.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 -- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 msgr2=0x7f8764003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c159c80 0x7f8764003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 -- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87640041d0 msgr2=0x7f8764004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:50.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87640041d0 0x7f8764004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 -- 172.21.15.7:0/1214361722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764003570 con 0x7f8764004d50 2023-10-14T19:03:50.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764004d50 0x7f87640051c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f877c089aa0 tx=0x7f876c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad6c9a60b478f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:50.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0071a0 con 0x7f8764004d50 2023-10-14T19:03:50.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c007300 con 0x7f8764004d50 2023-10-14T19:03:50.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f8780a98700 1 -- 172.21.15.7:0/1214361722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0076c0 con 0x7f8764004d50 2023-10-14T19:03:50.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f8783cfe700 1 -- 172.21.15.7:0/1214361722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764004d50 msgr2=0x7f87640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f8783cfe700 1 --2- 172.21.15.7:0/1214361722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764004d50 0x7f87640051c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f877c089aa0 tx=0x7f876c0020c0 comp rx=0 tx=0).stop 2023-10-14T19:03:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.982+0000 7f878229b700 1 -- 172.21.15.7:0/1214361722 reap_dead start 2023-10-14T19:03:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.983+0000 7f8783cfe700 1 -- 172.21.15.7:0/1214361722 shutdown_connections 2023-10-14T19:03:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.983+0000 7f8783cfe700 1 -- 172.21.15.7:0/1214361722 >> 172.21.15.7:0/1214361722 conn(0x7f877c070e30 msgr2=0x7f877c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.983+0000 7f8783cfe700 1 -- 172.21.15.7:0/1214361722 shutdown_connections 2023-10-14T19:03:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.983+0000 7f8783cfe700 1 -- 172.21.15.7:0/1214361722 wait complete. 2023-10-14T19:03:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 Processor -- start 2023-10-14T19:03:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 -- start start 2023-10-14T19:03:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 0x7f877c16df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f877c0b4ce0 0x7f877c16a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c0b0d40 0x7f877c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0b6000 con 0x7f877c0b0970 2023-10-14T19:03:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c16d490 con 0x7f877c0b4ce0 2023-10-14T19:03:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.984+0000 7f8783cfe700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0b5170 con 0x7f877c0b0d40 2023-10-14T19:03:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 0x7f877c16df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 0x7f877c16df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38320/0 (socket says 172.21.15.7:38320) 2023-10-14T19:03:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 -- 172.21.15.7:0/2282696235 learned_addr learned my addr 172.21.15.7:0/2282696235 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781299700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f877c0b4ce0 0x7f877c16a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f878229b700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c0b0d40 0x7f877c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 -- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c0b0d40 msgr2=0x7f877c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c0b0d40 0x7f877c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 -- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f877c0b4ce0 msgr2=0x7f877c16a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f877c0b4ce0 0x7f877c16a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 -- 172.21.15.7:0/2282696235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c16d730 con 0x7f877c0b0970 2023-10-14T19:03:51.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f878229b700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c0b0d40 0x7f877c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:51.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8781a9a700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 0x7f877c16df10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8774002bd0 tx=0x7f8774007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400f9a0 con 0x7f877c0b0970 2023-10-14T19:03:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400fb20 con 0x7f877c0b0970 2023-10-14T19:03:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c16da10 con 0x7f877c0b0970 2023-10-14T19:03:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400fee0 con 0x7f877c0b0970 2023-10-14T19:03:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.985+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c14d110 con 0x7f877c0b0970 2023-10-14T19:03:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.986+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c04c3c0 con 0x7f877c0b0970 2023-10-14T19:03:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.987+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8774013600 con 0x7f877c0b0970 2023-10-14T19:03:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.987+0000 7f8779ffb700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8768066f30 0x7f87680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.987+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f87740849e0 con 0x7f877c0b0970 2023-10-14T19:03:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.987+0000 7f8781299700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8768066f30 0x7f87680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.988+0000 7f8781299700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8768066f30 0x7f87680693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f877c0cb170 tx=0x7f87700091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:50.991+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8774051fa0 con 0x7f877c0b0970 2023-10-14T19:03:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.183+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f877c0ce380 con 0x7f877c0b0970 2023-10-14T19:03:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.184+0000 7f8779ffb700 1 -- 172.21.15.7:0/2282696235 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f87740555c0 con 0x7f877c0b0970 2023-10-14T19:03:51.185 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:51.185 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":29,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:47.796190+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8768066f30 msgr2=0x7f87680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8768066f30 0x7f87680693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f877c0cb170 tx=0x7f87700091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 msgr2=0x7f877c16df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 0x7f877c16df10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8774002bd0 tx=0x7f8774007d30 comp rx=0 tx=0).stop 2023-10-14T19:03:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 shutdown_connections 2023-10-14T19:03:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8768066f30 0x7f87680693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f877c0b0d40 0x7f877c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c0b0970 0x7f877c16df10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 --2- 172.21.15.7:0/2282696235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f877c0b4ce0 0x7f877c16a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 >> 172.21.15.7:0/2282696235 conn(0x7f877c070e30 msgr2=0x7f877c15f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:51.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 shutdown_connections 2023-10-14T19:03:51.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.186+0000 7f8783cfe700 1 -- 172.21.15.7:0/2282696235 wait complete. 2023-10-14T19:03:51.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:03:51.199 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:03:51.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 Processor -- start 2023-10-14T19:03:51.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 -- start start 2023-10-14T19:03:51.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff72c06e0e0 0x7ff72c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0ccfd0 con 0x7ff72c159530 2023-10-14T19:03:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c15a3d0 con 0x7ff72c06e0e0 2023-10-14T19:03:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.321+0000 7ff73162d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c15a6b0 con 0x7ff72c06dc70 2023-10-14T19:03:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff72c159530 0x7ff72c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55414/0 (socket says 172.21.15.7:55414) 2023-10-14T19:03:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72affd700 1 -- 172.21.15.7:0/2761954801 learned_addr learned my addr 172.21.15.7:0/2761954801 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72b7fe700 1 --2- 172.21.15.7:0/2761954801 >> v2:172.21.15.148:3300/0 conn(0x7ff72c06e0e0 0x7ff72c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72a7fc700 1 --2- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff729ffb700 1 -- 172.21.15.7:0/2761954801 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801296453 0 0) 0x7ff72c0ccfd0 con 0x7ff72c159530 2023-10-14T19:03:51.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff729ffb700 1 -- 172.21.15.7:0/2761954801 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff718003570 con 0x7ff72c159530 2023-10-14T19:03:51.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 msgr2=0x7ff72c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:51.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72b7fe700 1 --2- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2761954801 >> v1:172.21.15.7:6789/0 conn(0x7ff72c159530 legacy=0x7ff72c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2761954801 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c15a990 con 0x7ff72c06e0e0 2023-10-14T19:03:51.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff72b7fe700 1 --2- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c0cb6f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009e60 tx=0x7ff71c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e32a6cc86013a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff729ffb700 1 -- 172.21.15.7:0/2761954801 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00e070 con 0x7ff72c06e0e0 2023-10-14T19:03:51.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff729ffb700 1 -- 172.21.15.7:0/2761954801 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00bab0 con 0x7ff72c06e0e0 2023-10-14T19:03:51.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.322+0000 7ff729ffb700 1 -- 172.21.15.7:0/2761954801 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00be30 con 0x7ff72c06e0e0 2023-10-14T19:03:51.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 -- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 msgr2=0x7ff72c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 --2- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c0cb6f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009e60 tx=0x7ff71c009780 comp rx=0 tx=0).stop 2023-10-14T19:03:51.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 -- 172.21.15.7:0/2761954801 shutdown_connections 2023-10-14T19:03:51.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 --2- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c0cb6f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 --2- 172.21.15.7:0/2761954801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 -- 172.21.15.7:0/2761954801 >> 172.21.15.7:0/2761954801 conn(0x7ff72c0703a0 msgr2=0x7ff72c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:51.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 -- 172.21.15.7:0/2761954801 shutdown_connections 2023-10-14T19:03:51.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.323+0000 7ff73162d700 1 -- 172.21.15.7:0/2761954801 wait complete. 2023-10-14T19:03:51.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.324+0000 7ff73162d700 1 Processor -- start 2023-10-14T19:03:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 -- start start 2023-10-14T19:03:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 0x7ff72c169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c156f60 con 0x7ff72c159530 2023-10-14T19:03:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c157140 con 0x7ff72c06e0e0 2023-10-14T19:03:51.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff73162d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c157400 con 0x7ff72c06dc70 2023-10-14T19:03:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff72b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 0x7ff72c169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff72b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 0x7ff72c169870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38324/0 (socket says 172.21.15.7:38324) 2023-10-14T19:03:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.325+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2117559199 learned_addr learned my addr 172.21.15.7:0/2117559199 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72a7fc700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72affd700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 msgr2=0x7ff72c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72b7fe700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 msgr2=0x7ff72c169330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72b7fe700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c169330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72b7fe700 1 -- 172.21.15.7:0/2117559199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009a20 con 0x7ff72c159530 2023-10-14T19:03:51.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72a7fc700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:51.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72affd700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:51.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff72b7fe700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 0x7ff72c169870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71c013000 tx=0x7ff71c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c027470 con 0x7ff72c159530 2023-10-14T19:03:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0275f0 con 0x7ff72c159530 2023-10-14T19:03:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c1576e0 con 0x7ff72c159530 2023-10-14T19:03:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0279b0 con 0x7ff72c159530 2023-10-14T19:03:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.326+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c157ca0 con 0x7ff72c159530 2023-10-14T19:03:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.327+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c04c3c0 con 0x7ff72c159530 2023-10-14T19:03:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.327+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff71c024070 con 0x7ff72c159530 2023-10-14T19:03:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.328+0000 7ff722ffd700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff70c066f30 0x7ff70c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.328+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff71c086930 con 0x7ff72c159530 2023-10-14T19:03:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.328+0000 7ff72affd700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff70c066f30 0x7ff70c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.329+0000 7ff72affd700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff70c066f30 0x7ff70c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7240058d0 tx=0x7ff724009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.332+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff71c053ef0 con 0x7ff72c159530 2023-10-14T19:03:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.523+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff72c0c88d0 con 0x7ff72c159530 2023-10-14T19:03:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.523+0000 7ff722ffd700 1 -- 172.21.15.7:0/2117559199 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff71c057510 con 0x7ff72c159530 2023-10-14T19:03:51.524 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:03:51.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff70c066f30 msgr2=0x7ff70c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff70c066f30 0x7ff70c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7240058d0 tx=0x7ff724009040 comp rx=0 tx=0).stop 2023-10-14T19:03:51.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 msgr2=0x7ff72c169870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 0x7ff72c169870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71c013000 tx=0x7ff71c019000 comp rx=0 tx=0).stop 2023-10-14T19:03:51.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 shutdown_connections 2023-10-14T19:03:51.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff70c066f30 0x7ff70c0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72c159530 0x7ff72c169870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c06dc70 0x7ff72c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 --2- 172.21.15.7:0/2117559199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c06e0e0 0x7ff72c169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 >> 172.21.15.7:0/2117559199 conn(0x7ff72c0703a0 msgr2=0x7ff72c0d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 shutdown_connections 2023-10-14T19:03:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.525+0000 7ff73162d700 1 -- 172.21.15.7:0/2117559199 wait complete. 2023-10-14T19:03:51.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:03:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.657+0000 7fb1c0009700 1 Processor -- start 2023-10-14T19:03:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.657+0000 7fb1c0009700 1 -- start start 2023-10-14T19:03:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1c0009700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb970 0x7fb1b8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1c0009700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1b815a400 0x7fb1b8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1c0009700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b815ae40 con 0x7fb1b80cb5a0 2023-10-14T19:03:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1c0009700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80ce0f0 con 0x7fb1b815a400 2023-10-14T19:03:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1c0009700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80cbde0 con 0x7fb1b80cb970 2023-10-14T19:03:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1bdda5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb1b80cb5a0 0x7fb1b80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55430/0 (socket says 172.21.15.7:55430) 2023-10-14T19:03:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1bdda5700 1 -- 172.21.15.7:0/3104090148 learned_addr learned my addr 172.21.15.7:0/3104090148 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1be5a6700 1 --2- 172.21.15.7:0/3104090148 >> v2:172.21.15.148:3300/0 conn(0x7fb1b815a400 0x7fb1b8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1bd5a4700 1 --2- 172.21.15.7:0/3104090148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb970 0x7fb1b8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.658+0000 7fb1bcda3700 1 -- 172.21.15.7:0/3104090148 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840555944 0 0) 0x7fb1b815ae40 con 0x7fb1b80cb5a0 2023-10-14T19:03:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bcda3700 1 -- 172.21.15.7:0/3104090148 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003570 con 0x7fb1b80cb5a0 2023-10-14T19:03:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bcda3700 1 -- 172.21.15.7:0/3104090148 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 564418376 0 0) 0x7fb1a0003570 con 0x7fb1b80cb5a0 2023-10-14T19:03:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/3104090148 >> v2:172.21.15.148:3300/0 conn(0x7fb1b815a400 msgr2=0x7fb1b8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bd5a4700 1 --2- 172.21.15.7:0/3104090148 >> v2:172.21.15.148:3300/0 conn(0x7fb1b815a400 0x7fb1b8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/3104090148 >> v1:172.21.15.7:6789/0 conn(0x7fb1b80cb5a0 legacy=0x7fb1b80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/3104090148 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b815ab60 con 0x7fb1b80cb970 2023-10-14T19:03:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1be5a6700 1 --2- 172.21.15.7:0/3104090148 >> v2:172.21.15.148:3300/0 conn(0x7fb1b815a400 0x7fb1b8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bd5a4700 1 --2- 172.21.15.7:0/3104090148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb970 0x7fb1b8159ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0098e0 tx=0x7fb1ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3647f26c01da1232 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bcda3700 1 -- 172.21.15.7:0/3104090148 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80017f0 con 0x7fb1b80cb970 2023-10-14T19:03:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bcda3700 1 -- 172.21.15.7:0/3104090148 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac011420 con 0x7fb1b80cb970 2023-10-14T19:03:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.659+0000 7fb1bcda3700 1 -- 172.21.15.7:0/3104090148 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0117c0 con 0x7fb1b80cb970 2023-10-14T19:03:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 -- 172.21.15.7:0/3104090148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb970 msgr2=0x7fb1b8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 --2- 172.21.15.7:0/3104090148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb970 0x7fb1b8159ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0098e0 tx=0x7fb1ac0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 -- 172.21.15.7:0/3104090148 shutdown_connections 2023-10-14T19:03:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 --2- 172.21.15.7:0/3104090148 >> v2:172.21.15.148:3300/0 conn(0x7fb1b815a400 0x7fb1b8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 --2- 172.21.15.7:0/3104090148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb970 0x7fb1b8159ec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 -- 172.21.15.7:0/3104090148 >> 172.21.15.7:0/3104090148 conn(0x7fb1b8070e30 msgr2=0x7fb1b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 -- 172.21.15.7:0/3104090148 shutdown_connections 2023-10-14T19:03:51.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.660+0000 7fb1c0009700 1 -- 172.21.15.7:0/3104090148 wait complete. 2023-10-14T19:03:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.661+0000 7fb1c0009700 1 Processor -- start 2023-10-14T19:03:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.661+0000 7fb1c0009700 1 -- start start 2023-10-14T19:03:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.661+0000 7fb1c0009700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb5a0 0x7fb1b815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.661+0000 7fb1c0009700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 0x7fb1b80b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1c0009700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b815a400 0x7fb1b80b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1c0009700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b815d680 con 0x7fb1b80cb970 2023-10-14T19:03:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1c0009700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b815ca70 con 0x7fb1b815a400 2023-10-14T19:03:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1c0009700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b815cd50 con 0x7fb1b80cb5a0 2023-10-14T19:03:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 0x7fb1b80b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 0x7fb1b80b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38326/0 (socket says 172.21.15.7:38326) 2023-10-14T19:03:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/145789541 learned_addr learned my addr 172.21.15.7:0/145789541 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1be5a6700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b815a400 0x7fb1b80b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bdda5700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb5a0 0x7fb1b815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb5a0 msgr2=0x7fb1b815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb5a0 0x7fb1b815bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b815a400 msgr2=0x7fb1b80b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b815a400 0x7fb1b80b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 -- 172.21.15.7:0/145789541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b0009420 con 0x7fb1b80cb970 2023-10-14T19:03:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bdda5700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb5a0 0x7fb1b815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1bd5a4700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 0x7fb1b80b36c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009ed0 tx=0x7fb1ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac01cc80 con 0x7fb1b80cb970 2023-10-14T19:03:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac01ce00 con 0x7fb1b80cb970 2023-10-14T19:03:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac009420 con 0x7fb1b80cb970 2023-10-14T19:03:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.662+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac01a6a0 con 0x7fb1b80cb970 2023-10-14T19:03:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.663+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b815d310 con 0x7fb1b80cb970 2023-10-14T19:03:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.663+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b815d830 con 0x7fb1b80cb970 2023-10-14T19:03:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.664+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1ac01aa10 con 0x7fb1b80cb970 2023-10-14T19:03:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.664+0000 7fb1b5ffb700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4066f60 0x7fb1a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.664+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb1ac085bc0 con 0x7fb1b80cb970 2023-10-14T19:03:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.665+0000 7fb1bdda5700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4066f60 0x7fb1a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.665+0000 7fb1bdda5700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4066f60 0x7fb1a4069410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8001f10 tx=0x7fb1a8007f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.669+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1b815d830 con 0x7fb1b80cb970 2023-10-14T19:03:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.863+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1b815d830 con 0x7fb1b80cb970 2023-10-14T19:03:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.863+0000 7fb1b5ffb700 1 -- 172.21.15.7:0/145789541 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb1b815d830 con 0x7fb1b80cb970 2023-10-14T19:03:51.864 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:51.865 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:03:51.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:03:51.865 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:03:51.865 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:03:51.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:03:51.866 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:03:51.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4066f60 msgr2=0x7fb1a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4066f60 0x7fb1a4069410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8001f10 tx=0x7fb1a8007f30 comp rx=0 tx=0).stop 2023-10-14T19:03:51.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 msgr2=0x7fb1b80b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:51.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 0x7fb1b80b36c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009ed0 tx=0x7fb1ac016000 comp rx=0 tx=0).stop 2023-10-14T19:03:51.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 shutdown_connections 2023-10-14T19:03:51.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4066f60 0x7fb1a4069410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b815a400 0x7fb1b80b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b80cb5a0 0x7fb1b815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 --2- 172.21.15.7:0/145789541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b80cb970 0x7fb1b80b36c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 >> 172.21.15.7:0/145789541 conn(0x7fb1b8070e30 msgr2=0x7fb1b80b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 shutdown_connections 2023-10-14T19:03:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:51.865+0000 7fb1c0009700 1 -- 172.21.15.7:0/145789541 wait complete. 2023-10-14T19:03:51.878 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:03:51.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:03:52.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.002+0000 7f38f7ce8700 1 Processor -- start 2023-10-14T19:03:52.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.002+0000 7f38f7ce8700 1 -- start start 2023-10-14T19:03:52.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f7ce8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38f006dcf0 0x7f38f0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:52.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f7ce8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38f0159e40 0x7f38f00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:52.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f7ce8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f00ccfd0 con 0x7f38f0159530 2023-10-14T19:03:52.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f7ce8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f015a410 con 0x7f38f0159e40 2023-10-14T19:03:52.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f7ce8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f015a6f0 con 0x7f38f006dcf0 2023-10-14T19:03:52.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f6285700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38f0159e40 0x7f38f00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:52.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f5a84700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38f0159530 0x7f38f00ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55444/0 (socket says 172.21.15.7:55444) 2023-10-14T19:03:52.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f5a84700 1 -- 172.21.15.7:0/3657872611 learned_addr learned my addr 172.21.15.7:0/3657872611 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:52.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f6285700 1 -- 172.21.15.7:0/3657872611 >> v2:172.21.15.148:3300/0 conn(0x7f38f006dcf0 msgr2=0x7f38f0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:52.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f6285700 1 --2- 172.21.15.7:0/3657872611 >> v2:172.21.15.148:3300/0 conn(0x7f38f006dcf0 0x7f38f0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f6285700 1 -- 172.21.15.7:0/3657872611 >> v1:172.21.15.7:6789/0 conn(0x7f38f0159530 legacy=0x7f38f00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:52.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f4a82700 1 -- 172.21.15.7:0/3657872611 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253936559 0 0) 0x7f38f00ccfd0 con 0x7f38f0159530 2023-10-14T19:03:52.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f6285700 1 -- 172.21.15.7:0/3657872611 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f015a9d0 con 0x7f38f0159e40 2023-10-14T19:03:52.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.003+0000 7f38f6285700 1 --2- 172.21.15.7:0/3657872611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00cb6f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f38f015d390 tx=0x7f38e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b92654142369ae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:52.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f4a82700 1 -- 172.21.15.7:0/3657872611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800e070 con 0x7f38f0159e40 2023-10-14T19:03:52.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f4a82700 1 -- 172.21.15.7:0/3657872611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800bc30 con 0x7f38f0159e40 2023-10-14T19:03:52.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f4a82700 1 -- 172.21.15.7:0/3657872611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8012430 con 0x7f38f0159e40 2023-10-14T19:03:52.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 -- 172.21.15.7:0/3657872611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 msgr2=0x7f38f00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/3657872611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00cb6f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f38f015d390 tx=0x7f38e8009780 comp rx=0 tx=0).stop 2023-10-14T19:03:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 -- 172.21.15.7:0/3657872611 shutdown_connections 2023-10-14T19:03:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/3657872611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00cb6f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/3657872611 >> v2:172.21.15.148:3300/0 conn(0x7f38f006dcf0 0x7f38f0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 -- 172.21.15.7:0/3657872611 >> 172.21.15.7:0/3657872611 conn(0x7f38f00703a0 msgr2=0x7f38f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:52.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 -- 172.21.15.7:0/3657872611 shutdown_connections 2023-10-14T19:03:52.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.004+0000 7f38f7ce8700 1 -- 172.21.15.7:0/3657872611 wait complete. 2023-10-14T19:03:52.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.005+0000 7f38f7ce8700 1 Processor -- start 2023-10-14T19:03:52.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.005+0000 7f38f7ce8700 1 -- start start 2023-10-14T19:03:52.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f7ce8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f006dcf0 0x7f38f0156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:52.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f7ce8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f0159530 0x7f38f00b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:52.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f7ce8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:52.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f7ce8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00b1c50 con 0x7f38f0159e40 2023-10-14T19:03:52.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f7ce8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00b1040 con 0x7f38f006dcf0 2023-10-14T19:03:52.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f7ce8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00b1320 con 0x7f38f0159530 2023-10-14T19:03:52.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:52.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38338/0 (socket says 172.21.15.7:38338) 2023-10-14T19:03:52.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 -- 172.21.15.7:0/1633421495 learned_addr learned my addr 172.21.15.7:0/1633421495 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:52.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f5a84700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f006dcf0 0x7f38f0156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:52.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f5283700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f0159530 0x7f38f00b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:52.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 -- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f0159530 msgr2=0x7f38f00b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:52.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f0159530 0x7f38f00b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 -- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f006dcf0 msgr2=0x7f38f0156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:52.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f006dcf0 0x7f38f0156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.006+0000 7f38f6285700 1 -- 172.21.15.7:0/1633421495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009a20 con 0x7f38f0159e40 2023-10-14T19:03:52.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.007+0000 7f38f6285700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00b59b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38e80097c0 tx=0x7f38e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:52.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.007+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8027470 con 0x7f38f0159e40 2023-10-14T19:03:52.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.007+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8027610 con 0x7f38f0159e40 2023-10-14T19:03:52.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.007+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f00b1600 con 0x7f38f0159e40 2023-10-14T19:03:52.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.007+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80279d0 con 0x7f38f0159e40 2023-10-14T19:03:52.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.007+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f01571f0 con 0x7f38f0159e40 2023-10-14T19:03:52.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.008+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f00b1dc0 con 0x7f38f0159e40 2023-10-14T19:03:52.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.008+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38e8024070 con 0x7f38f0159e40 2023-10-14T19:03:52.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.009+0000 7f38e5ffb700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38d4066f30 0x7f38d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:52.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.009+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f38e80869a0 con 0x7f38f0159e40 2023-10-14T19:03:52.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.009+0000 7f38f5a84700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38d4066f30 0x7f38d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:52.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.009+0000 7f38f5a84700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38d4066f30 0x7f38d40693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38f00cac40 tx=0x7f38ec007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:52.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.013+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38e8053ec0 con 0x7f38f0159e40 2023-10-14T19:03:52.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.207+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f38f004c3c0 con 0x7f38f0159e40 2023-10-14T19:03:52.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.919+0000 7f38e5ffb700 1 -- 172.21.15.7:0/1633421495 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f38e80574e0 con 0x7f38f0159e40 2023-10-14T19:03:52.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38d4066f30 msgr2=0x7f38d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:52.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38d4066f30 0x7f38d40693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38f00cac40 tx=0x7f38ec007d30 comp rx=0 tx=0).stop 2023-10-14T19:03:52.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 msgr2=0x7f38f00b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:52.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00b59b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38e80097c0 tx=0x7f38e8019000 comp rx=0 tx=0).stop 2023-10-14T19:03:52.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 shutdown_connections 2023-10-14T19:03:52.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38d4066f30 0x7f38d40693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f006dcf0 0x7f38f0156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f0159e40 0x7f38f00b59b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 --2- 172.21.15.7:0/1633421495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f0159530 0x7f38f00b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:52.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.924+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 >> 172.21.15.7:0/1633421495 conn(0x7f38f00703a0 msgr2=0x7f38f00c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:52.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.926+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 shutdown_connections 2023-10-14T19:03:52.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:52.926+0000 7f38f7ce8700 1 -- 172.21.15.7:0/1633421495 wait complete. 2023-10-14T19:03:52.929 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:03:52.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:03:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.075+0000 7f1341e1c700 1 Processor -- start 2023-10-14T19:03:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.075+0000 7f1341e1c700 1 -- start start 2023-10-14T19:03:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f1341e1c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f133c159530 0x7f133c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f1341e1c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133c06dc70 0x7f133c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f1341e1c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06e0e0 0x7f133c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f1341e1c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0ccfd0 con 0x7f133c06dc70 2023-10-14T19:03:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f1341e1c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0cf0e0 con 0x7f133c159530 2023-10-14T19:03:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f1341e1c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c15a3d0 con 0x7f133c06e0e0 2023-10-14T19:03:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133c06dc70 0x7f133c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133c06dc70 0x7f133c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38350/0 (socket says 172.21.15.7:38350) 2023-10-14T19:03:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 -- 172.21.15.7:0/4238718019 learned_addr learned my addr 172.21.15.7:0/4238718019 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133b7fe700 1 --2- 172.21.15.7:0/4238718019 >> v2:172.21.15.148:3300/0 conn(0x7f133c159530 0x7f133c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 -- 172.21.15.7:0/4238718019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06e0e0 msgr2=0x7f133c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133bfff700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06e0e0 0x7f133c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06e0e0 0x7f133c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 -- 172.21.15.7:0/4238718019 >> v2:172.21.15.148:3300/0 conn(0x7f133c159530 msgr2=0x7f133c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 --2- 172.21.15.7:0/4238718019 >> v2:172.21.15.148:3300/0 conn(0x7f133c159530 0x7f133c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 -- 172.21.15.7:0/4238718019 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c15a6b0 con 0x7f133c06dc70 2023-10-14T19:03:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133b7fe700 1 --2- 172.21.15.7:0/4238718019 >> v2:172.21.15.148:3300/0 conn(0x7f133c159530 0x7f133c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133bfff700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06e0e0 0x7f133c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.076+0000 7f133affd700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06dc70 0x7f133c159900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f133c06d630 tx=0x7f1330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c51431245054ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f133a7fc700 1 -- 172.21.15.7:0/4238718019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000b860 con 0x7f133c06dc70 2023-10-14T19:03:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f133a7fc700 1 -- 172.21.15.7:0/4238718019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133000b9c0 con 0x7f133c06dc70 2023-10-14T19:03:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f133a7fc700 1 -- 172.21.15.7:0/4238718019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000bd60 con 0x7f133c06dc70 2023-10-14T19:03:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 -- 172.21.15.7:0/4238718019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06dc70 msgr2=0x7f133c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06dc70 0x7f133c159900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f133c06d630 tx=0x7f1330009250 comp rx=0 tx=0).stop 2023-10-14T19:03:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 -- 172.21.15.7:0/4238718019 shutdown_connections 2023-10-14T19:03:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06e0e0 0x7f133c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 --2- 172.21.15.7:0/4238718019 >> v2:172.21.15.148:3300/0 conn(0x7f133c159530 0x7f133c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 --2- 172.21.15.7:0/4238718019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06dc70 0x7f133c159900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 -- 172.21.15.7:0/4238718019 >> 172.21.15.7:0/4238718019 conn(0x7f133c0703a0 msgr2=0x7f133c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 -- 172.21.15.7:0/4238718019 shutdown_connections 2023-10-14T19:03:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.077+0000 7f1341e1c700 1 -- 172.21.15.7:0/4238718019 wait complete. 2023-10-14T19:03:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.078+0000 7f1341e1c700 1 Processor -- start 2023-10-14T19:03:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 -- start start 2023-10-14T19:03:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06dc70 0x7f133c0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 0x7f133c16d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f133c159530 0x7f133c16d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1576e0 con 0x7f133c06e0e0 2023-10-14T19:03:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1525e0 con 0x7f133c159530 2023-10-14T19:03:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f1341e1c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c157120 con 0x7f133c06dc70 2023-10-14T19:03:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f133affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 0x7f133c16d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f133affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 0x7f133c16d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38364/0 (socket says 172.21.15.7:38364) 2023-10-14T19:03:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.079+0000 7f133affd700 1 -- 172.21.15.7:0/228294992 learned_addr learned my addr 172.21.15.7:0/228294992 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133b7fe700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06dc70 0x7f133c0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133bfff700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f133c159530 0x7f133c16d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133affd700 1 -- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06dc70 msgr2=0x7f133c0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133affd700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06dc70 0x7f133c0b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133affd700 1 -- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f133c159530 msgr2=0x7f133c16d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133affd700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f133c159530 0x7f133c16d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133affd700 1 -- 172.21.15.7:0/228294992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300094f0 con 0x7f133c06e0e0 2023-10-14T19:03:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133b7fe700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06dc70 0x7f133c0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133bfff700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f133c159530 0x7f133c16d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f133affd700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 0x7f133c16d2d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f133c089650 tx=0x7f1330017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330024440 con 0x7f133c06e0e0 2023-10-14T19:03:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300245a0 con 0x7f133c06e0e0 2023-10-14T19:03:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c157400 con 0x7f133c06e0e0 2023-10-14T19:03:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330024960 con 0x7f133c06e0e0 2023-10-14T19:03:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.080+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c0b1d40 con 0x7f133c06e0e0 2023-10-14T19:03:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.081+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c0b1f60 con 0x7f133c06e0e0 2023-10-14T19:03:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.082+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1330024d50 con 0x7f133c06e0e0 2023-10-14T19:03:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.082+0000 7f13237fe700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.082+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1330085e90 con 0x7f133c06e0e0 2023-10-14T19:03:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.082+0000 7f133b7fe700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.083+0000 7f133b7fe700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f132c006fd0 tx=0x7f132c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.086+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13300532e0 con 0x7f133c06e0e0 2023-10-14T19:03:53.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.280+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f133c04c3c0 con 0x7f133c06e0e0 2023-10-14T19:03:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.923+0000 7f13237fe700 1 -- 172.21.15.7:0/228294992 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f133002b340 con 0x7f133c06e0e0 2023-10-14T19:03:53.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1328066f30 msgr2=0x7f13280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:53.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f132c006fd0 tx=0x7f132c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:53.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 msgr2=0x7f133c16d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:53.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 0x7f133c16d2d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f133c089650 tx=0x7f1330017000 comp rx=0 tx=0).stop 2023-10-14T19:03:53.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 shutdown_connections 2023-10-14T19:03:53.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f132c006fd0 tx=0x7f132c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:53.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f133c159530 0x7f133c16d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133c06dc70 0x7f133c0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:53.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 --2- 172.21.15.7:0/228294992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06e0e0 0x7f133c16d2d0 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f133c089650 tx=0x7f1330017000 comp rx=0 tx=0).stop 2023-10-14T19:03:53.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.928+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 >> 172.21.15.7:0/228294992 conn(0x7f133c0703a0 msgr2=0x7f133c15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:53.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.931+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 shutdown_connections 2023-10-14T19:03:53.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:53.931+0000 7f1341e1c700 1 -- 172.21.15.7:0/228294992 wait complete. 2023-10-14T19:03:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:03:53.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:03:54.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.079+0000 7f20f00ff700 1 Processor -- start 2023-10-14T19:03:54.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.079+0000 7f20f00ff700 1 -- start start 2023-10-14T19:03:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20f00ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e8159530 0x7f20e80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20f00ff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20e806e0e0 0x7f20e80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20f00ff700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80ccfd0 con 0x7f20e806dc70 2023-10-14T19:03:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20f00ff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e80cf0e0 con 0x7f20e806e0e0 2023-10-14T19:03:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20f00ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e815a3d0 con 0x7f20e8159530 2023-10-14T19:03:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ee69c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20e806e0e0 0x7f20e80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ed69a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f20e806dc70 0x7f20e8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55454/0 (socket says 172.21.15.7:55454) 2023-10-14T19:03:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ed69a700 1 -- 172.21.15.7:0/487689257 learned_addr learned my addr 172.21.15.7:0/487689257 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ede9b700 1 --2- 172.21.15.7:0/487689257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e8159530 0x7f20e80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ee69c700 1 -- 172.21.15.7:0/487689257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e8159530 msgr2=0x7f20e80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ee69c700 1 --2- 172.21.15.7:0/487689257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e8159530 0x7f20e80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ee69c700 1 -- 172.21.15.7:0/487689257 >> v1:172.21.15.7:6789/0 conn(0x7f20e806dc70 legacy=0x7f20e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ece99700 1 -- 172.21.15.7:0/487689257 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022423050 0 0) 0x7f20e80ccfd0 con 0x7f20e806dc70 2023-10-14T19:03:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ee69c700 1 -- 172.21.15.7:0/487689257 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e815a6b0 con 0x7f20e806e0e0 2023-10-14T19:03:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ee69c700 1 --2- 172.21.15.7:0/487689257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806e0e0 0x7f20e80cb6f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009e60 tx=0x7f20e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a7797d5f94c014 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.080+0000 7f20ece99700 1 -- 172.21.15.7:0/487689257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000e070 con 0x7f20e806e0e0 2023-10-14T19:03:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20ece99700 1 -- 172.21.15.7:0/487689257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000bc30 con 0x7f20e806e0e0 2023-10-14T19:03:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20ece99700 1 -- 172.21.15.7:0/487689257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0012430 con 0x7f20e806e0e0 2023-10-14T19:03:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 -- 172.21.15.7:0/487689257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806e0e0 msgr2=0x7f20e80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 --2- 172.21.15.7:0/487689257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806e0e0 0x7f20e80cb6f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009e60 tx=0x7f20e0009780 comp rx=0 tx=0).stop 2023-10-14T19:03:54.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 -- 172.21.15.7:0/487689257 shutdown_connections 2023-10-14T19:03:54.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 --2- 172.21.15.7:0/487689257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806e0e0 0x7f20e80cb6f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 --2- 172.21.15.7:0/487689257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e8159530 0x7f20e80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 -- 172.21.15.7:0/487689257 >> 172.21.15.7:0/487689257 conn(0x7f20e80703a0 msgr2=0x7f20e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:54.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 -- 172.21.15.7:0/487689257 shutdown_connections 2023-10-14T19:03:54.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.081+0000 7f20f00ff700 1 -- 172.21.15.7:0/487689257 wait complete. 2023-10-14T19:03:54.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.082+0000 7f20f00ff700 1 Processor -- start 2023-10-14T19:03:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.082+0000 7f20f00ff700 1 -- start start 2023-10-14T19:03:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20f00ff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 0x7f20e8169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20f00ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e806e0e0 0x7f20e81588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20f00ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8159530 0x7f20e815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:54.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20f00ff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e816acc0 con 0x7f20e806dc70 2023-10-14T19:03:54.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20f00ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8158de0 con 0x7f20e8159530 2023-10-14T19:03:54.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20f00ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e816a140 con 0x7f20e806e0e0 2023-10-14T19:03:54.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 0x7f20e8169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 0x7f20e8169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38378/0 (socket says 172.21.15.7:38378) 2023-10-14T19:03:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 -- 172.21.15.7:0/2084948899 learned_addr learned my addr 172.21.15.7:0/2084948899 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ed69a700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e806e0e0 0x7f20e81588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ee69c700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8159530 0x7f20e815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 -- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e806e0e0 msgr2=0x7f20e81588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e806e0e0 0x7f20e81588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 -- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8159530 msgr2=0x7f20e815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8159530 0x7f20e815e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ede9b700 1 -- 172.21.15.7:0/2084948899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0009a20 con 0x7f20e806dc70 2023-10-14T19:03:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ed69a700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e806e0e0 0x7f20e81588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.083+0000 7f20ee69c700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8159530 0x7f20e815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.084+0000 7f20ede9b700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 0x7f20e8169ae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c880 tx=0x7f20e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.084+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4011600 con 0x7f20e806dc70 2023-10-14T19:03:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.084+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4011780 con 0x7f20e806dc70 2023-10-14T19:03:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.084+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e816a420 con 0x7f20e806dc70 2023-10-14T19:03:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.084+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4011b40 con 0x7f20e806dc70 2023-10-14T19:03:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.084+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e816a9e0 con 0x7f20e806dc70 2023-10-14T19:03:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.085+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e804c3c0 con 0x7f20e806dc70 2023-10-14T19:03:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.085+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20e4018360 con 0x7f20e806dc70 2023-10-14T19:03:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.086+0000 7f20ddffb700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20cc066f30 0x7f20cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:54.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.086+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f20e40842f0 con 0x7f20e806dc70 2023-10-14T19:03:54.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.086+0000 7f20ed69a700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20cc066f30 0x7f20cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:54.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.086+0000 7f20ed69a700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20cc066f30 0x7f20cc0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20e80d1420 tx=0x7f20d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:54.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.090+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20e4054fb0 con 0x7f20e806dc70 2023-10-14T19:03:54.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.328+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f20e815a990 con 0x7f20e806dc70 2023-10-14T19:03:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.948+0000 7f20ddffb700 1 -- 172.21.15.7:0/2084948899 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f20e405a030 con 0x7f20e806dc70 2023-10-14T19:03:54.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20cc066f30 msgr2=0x7f20cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:54.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20cc066f30 0x7f20cc0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20e80d1420 tx=0x7f20d8009040 comp rx=0 tx=0).stop 2023-10-14T19:03:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 msgr2=0x7f20e8169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 0x7f20e8169ae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c880 tx=0x7f20e4008040 comp rx=0 tx=0).stop 2023-10-14T19:03:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 shutdown_connections 2023-10-14T19:03:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20cc066f30 0x7f20cc0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8159530 0x7f20e815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20e806dc70 0x7f20e8169ae0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 --2- 172.21.15.7:0/2084948899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e806e0e0 0x7f20e81588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.954+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 >> 172.21.15.7:0/2084948899 conn(0x7f20e80703a0 msgr2=0x7f20e80d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.956+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 shutdown_connections 2023-10-14T19:03:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:54.957+0000 7f20f00ff700 1 -- 172.21.15.7:0/2084948899 wait complete. 2023-10-14T19:03:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T19:03:54.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:55.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.113+0000 7f1e3b59e700 1 Processor -- start 2023-10-14T19:03:55.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.113+0000 7f1e3b59e700 1 -- start start 2023-10-14T19:03:55.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e3c06aaa0 0x7f1e3c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c15ae70 con 0x7f1e3c13fef0 2023-10-14T19:03:55.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c06af60 con 0x7f1e3c06aaa0 2023-10-14T19:03:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c06b240 con 0x7f1e3c13fb20 2023-10-14T19:03:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e3c06aaa0 0x7f1e3c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e3a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e39d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1e3c13fef0 0x7f1e3c0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:34284/0 (socket says 172.21.15.7:34284) 2023-10-14T19:03:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.114+0000 7f1e39d9b700 1 -- 172.21.15.7:0/3373809424 learned_addr learned my addr 172.21.15.7:0/3373809424 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3959a700 1 -- 172.21.15.7:0/3373809424 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661236048 0 0) 0x7f1e24001160 con 0x7f1e3c13fef0 2023-10-14T19:03:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3959a700 1 -- 172.21.15.7:0/3373809424 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e28003570 con 0x7f1e3c13fef0 2023-10-14T19:03:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 msgr2=0x7f1e3c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3ad9d700 1 --2- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/3373809424 >> v1:172.21.15.148:6789/0 conn(0x7f1e3c13fef0 legacy=0x7f1e3c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/3373809424 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c06b520 con 0x7f1e3c06aaa0 2023-10-14T19:03:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3a59c700 1 --2- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3ad9d700 1 --2- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c0c9d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e60 tx=0x7f1e2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2ca30f705b74f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3959a700 1 -- 172.21.15.7:0/3373809424 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00e070 con 0x7f1e3c06aaa0 2023-10-14T19:03:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3959a700 1 -- 172.21.15.7:0/3373809424 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c00bab0 con 0x7f1e3c06aaa0 2023-10-14T19:03:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.115+0000 7f1e3959a700 1 -- 172.21.15.7:0/3373809424 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00be70 con 0x7f1e3c06aaa0 2023-10-14T19:03:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 -- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 msgr2=0x7f1e3c0c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c0c9d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e60 tx=0x7f1e2c009780 comp rx=0 tx=0).stop 2023-10-14T19:03:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 -- 172.21.15.7:0/3373809424 shutdown_connections 2023-10-14T19:03:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c0c9d00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/3373809424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 -- 172.21.15.7:0/3373809424 >> 172.21.15.7:0/3373809424 conn(0x7f1e3c06d170 msgr2=0x7f1e3c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 -- 172.21.15.7:0/3373809424 shutdown_connections 2023-10-14T19:03:55.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.116+0000 7f1e3b59e700 1 -- 172.21.15.7:0/3373809424 wait complete. 2023-10-14T19:03:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.117+0000 7f1e3b59e700 1 Processor -- start 2023-10-14T19:03:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.117+0000 7f1e3b59e700 1 -- start start 2023-10-14T19:03:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c13cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 0x7f1e3c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3b59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0ad860 con 0x7f1e3c13fef0 2023-10-14T19:03:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c159910 con 0x7f1e3c06aaa0 2023-10-14T19:03:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c157e20 con 0x7f1e3c13fb20 2023-10-14T19:03:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 0x7f1e3c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 0x7f1e3c0b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38380/0 (socket says 172.21.15.7:38380) 2023-10-14T19:03:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/1099682644 learned_addr learned my addr 172.21.15.7:0/1099682644 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e39d9b700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3a59c700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c13cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 msgr2=0x7f1e3c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 msgr2=0x7f1e3c13cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c13cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 -- 172.21.15.7:0/1099682644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009420 con 0x7f1e3c13fef0 2023-10-14T19:03:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e3ad9d700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 0x7f1e3c0b1150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c013000 tx=0x7f1e2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c012e10 con 0x7f1e3c13fef0 2023-10-14T19:03:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.118+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c027470 con 0x7f1e3c13fef0 2023-10-14T19:03:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.119+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c009a20 con 0x7f1e3c13fef0 2023-10-14T19:03:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.119+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c027830 con 0x7f1e3c13fef0 2023-10-14T19:03:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.119+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c1583e0 con 0x7f1e3c13fef0 2023-10-14T19:03:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.119+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c04c3c0 con 0x7f1e3c13fef0 2023-10-14T19:03:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.120+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e2c024070 con 0x7f1e3c13fef0 2023-10-14T19:03:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.120+0000 7f1e327fc700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e1c066f30 0x7f1e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.120+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e2c086f60 con 0x7f1e3c13fef0 2023-10-14T19:03:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.121+0000 7f1e3a59c700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e1c066f30 0x7f1e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.121+0000 7f1e3a59c700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e1c066f30 0x7f1e1c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009f40 tx=0x7f1e340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.125+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e2c0541d0 con 0x7f1e3c13fef0 2023-10-14T19:03:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.319+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e3c06eb30 con 0x7f1e3c13fef0 2023-10-14T19:03:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.320+0000 7f1e327fc700 1 -- 172.21.15.7:0/1099682644 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f1e2c0577f0 con 0x7f1e3c13fef0 2023-10-14T19:03:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:55.321 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:54.330350+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e1c066f30 msgr2=0x7f1e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e1c066f30 0x7f1e1c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009f40 tx=0x7f1e340091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 msgr2=0x7f1e3c0b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 0x7f1e3c0b1150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c013000 tx=0x7f1e2c019000 comp rx=0 tx=0).stop 2023-10-14T19:03:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 shutdown_connections 2023-10-14T19:03:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1e1c066f30 0x7f1e1c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3c06aaa0 0x7f1e3c13cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e3c13fef0 0x7f1e3c0b1150 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 --2- 172.21.15.7:0/1099682644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e3c13fb20 0x7f1e3c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 >> 172.21.15.7:0/1099682644 conn(0x7f1e3c06d170 msgr2=0x7f1e3c0c1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 shutdown_connections 2023-10-14T19:03:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.322+0000 7f1e3b59e700 1 -- 172.21.15.7:0/1099682644 wait complete. 2023-10-14T19:03:55.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.454+0000 7ffad6300700 1 Processor -- start 2023-10-14T19:03:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.454+0000 7ffad6300700 1 -- start start 2023-10-14T19:03:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffad6300700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffad00cb970 0x7ffad0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffad6300700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad015ae40 con 0x7ffad00cb5a0 2023-10-14T19:03:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffad6300700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad015ab60 con 0x7ffad015a400 2023-10-14T19:03:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffad6300700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00ce0f0 con 0x7ffad00cb970 2023-10-14T19:03:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffacffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffad00cb5a0 0x7ffad00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55460/0 (socket says 172.21.15.7:55460) 2023-10-14T19:03:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffacffff700 1 -- 172.21.15.7:0/3110767813 learned_addr learned my addr 172.21.15.7:0/3110767813 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffacf7fe700 1 --2- 172.21.15.7:0/3110767813 >> v2:172.21.15.148:3300/0 conn(0x7ffad00cb970 0x7ffad0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffaceffd700 1 -- 172.21.15.7:0/3110767813 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401032952 0 0) 0x7ffad015ae40 con 0x7ffad00cb5a0 2023-10-14T19:03:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffaceffd700 1 -- 172.21.15.7:0/3110767813 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab8003570 con 0x7ffad00cb5a0 2023-10-14T19:03:55.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffacf7fe700 1 -- 172.21.15.7:0/3110767813 >> v1:172.21.15.148:6789/0 conn(0x7ffad015a400 legacy=0x7ffad0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffacf7fe700 1 -- 172.21.15.7:0/3110767813 >> v1:172.21.15.7:6789/0 conn(0x7ffad00cb5a0 legacy=0x7ffad00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.455+0000 7ffacf7fe700 1 -- 172.21.15.7:0/3110767813 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00ccf00 con 0x7ffad00cb970 2023-10-14T19:03:55.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffacf7fe700 1 --2- 172.21.15.7:0/3110767813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb970 0x7ffad0159ec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffac40098e0 tx=0x7ffac40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b26bd19ebf8be15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffaceffd700 1 -- 172.21.15.7:0/3110767813 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400b640 con 0x7ffad00cb970 2023-10-14T19:03:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffaceffd700 1 -- 172.21.15.7:0/3110767813 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400b7a0 con 0x7ffad00cb970 2023-10-14T19:03:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffaceffd700 1 -- 172.21.15.7:0/3110767813 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400bb40 con 0x7ffad00cb970 2023-10-14T19:03:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 -- 172.21.15.7:0/3110767813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb970 msgr2=0x7ffad0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 --2- 172.21.15.7:0/3110767813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb970 0x7ffad0159ec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffac40098e0 tx=0x7ffac40091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 -- 172.21.15.7:0/3110767813 shutdown_connections 2023-10-14T19:03:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 --2- 172.21.15.7:0/3110767813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb970 0x7ffad0159ec0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 -- 172.21.15.7:0/3110767813 >> 172.21.15.7:0/3110767813 conn(0x7ffad0070e30 msgr2=0x7ffad00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 -- 172.21.15.7:0/3110767813 shutdown_connections 2023-10-14T19:03:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.456+0000 7ffad6300700 1 -- 172.21.15.7:0/3110767813 wait complete. 2023-10-14T19:03:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.457+0000 7ffad6300700 1 Processor -- start 2023-10-14T19:03:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 -- start start 2023-10-14T19:03:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb5a0 0x7ffad00b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 0x7ffad0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad015a400 0x7ffad01530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad015cc90 con 0x7ffad00cb970 2023-10-14T19:03:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00b6450 con 0x7ffad00cb5a0 2023-10-14T19:03:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffad6300700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c9ff0 con 0x7ffad015a400 2023-10-14T19:03:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 0x7ffad0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 0x7ffad0156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38394/0 (socket says 172.21.15.7:38394) 2023-10-14T19:03:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.458+0000 7ffacf7fe700 1 -- 172.21.15.7:0/653147123 learned_addr learned my addr 172.21.15.7:0/653147123 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacffff700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb5a0 0x7ffad00b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffad489d700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad015a400 0x7ffad01530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacf7fe700 1 -- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad015a400 msgr2=0x7ffad01530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacf7fe700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad015a400 0x7ffad01530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacf7fe700 1 -- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb5a0 msgr2=0x7ffad00b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacf7fe700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb5a0 0x7ffad00b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacf7fe700 1 -- 172.21.15.7:0/653147123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009420 con 0x7ffad00cb970 2023-10-14T19:03:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacffff700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb5a0 0x7ffad00b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:55.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffacf7fe700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 0x7ffad0156c60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffad006ea60 tx=0x7ffac4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400bb20 con 0x7ffad00cb970 2023-10-14T19:03:55.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4011420 con 0x7ffad00cb970 2023-10-14T19:03:55.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad00ca2d0 con 0x7ffad00cb970 2023-10-14T19:03:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40117a0 con 0x7ffad00cb970 2023-10-14T19:03:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.459+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad01571a0 con 0x7ffad00cb970 2023-10-14T19:03:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.460+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad0089590 con 0x7ffad00cb970 2023-10-14T19:03:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.460+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffac4011b50 con 0x7ffad00cb970 2023-10-14T19:03:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.461+0000 7ffab7fff700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffabc066f30 0x7ffabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.461+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffac4085d70 con 0x7ffad00cb970 2023-10-14T19:03:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.461+0000 7ffacffff700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffabc066f30 0x7ffabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.462+0000 7ffacffff700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffabc066f30 0x7ffabc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffac0007fd0 tx=0x7ffac0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.465+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffac4052fe0 con 0x7ffad00cb970 2023-10-14T19:03:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.659+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffad004c3c0 con 0x7ffad00cb970 2023-10-14T19:03:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.660+0000 7ffab7fff700 1 -- 172.21.15.7:0/653147123 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15315 (secure 0 0 0) 0x7ffac4056600 con 0x7ffad00cb970 2023-10-14T19:03:55.661 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:55.661 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:54.330350+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:55.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffabc066f30 msgr2=0x7ffabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffabc066f30 0x7ffabc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffac0007fd0 tx=0x7ffac0009040 comp rx=0 tx=0).stop 2023-10-14T19:03:55.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 msgr2=0x7ffad0156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 0x7ffad0156c60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffad006ea60 tx=0x7ffac4017000 comp rx=0 tx=0).stop 2023-10-14T19:03:55.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 shutdown_connections 2023-10-14T19:03:55.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffabc066f30 0x7ffabc0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad00cb5a0 0x7ffad00b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad015a400 0x7ffad01530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 --2- 172.21.15.7:0/653147123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00cb970 0x7ffad0156c60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 >> 172.21.15.7:0/653147123 conn(0x7ffad0070e30 msgr2=0x7ffad00b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:55.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 shutdown_connections 2023-10-14T19:03:55.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.662+0000 7ffad6300700 1 -- 172.21.15.7:0/653147123 wait complete. 2023-10-14T19:03:55.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:03:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.797+0000 7f5c0359e700 1 Processor -- start 2023-10-14T19:03:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.797+0000 7f5c0359e700 1 -- start start 2023-10-14T19:03:55.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0359e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c04157420 0x7f5c040b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0359e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c040ac840 con 0x7f5c0406d250 2023-10-14T19:03:55.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c040b18f0 con 0x7f5c040af6b0 2023-10-14T19:03:55.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0359e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c040abf50 con 0x7f5c04157420 2023-10-14T19:03:55.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c01d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5c0406d250 0x7f5c040aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55466/0 (socket says 172.21.15.7:55466) 2023-10-14T19:03:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c01d9b700 1 -- 172.21.15.7:0/2071325044 learned_addr learned my addr 172.21.15.7:0/2071325044 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427471754 0 0) 0x7f5c040ac840 con 0x7f5c0406d250 2023-10-14T19:03:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf0003570 con 0x7f5c0406d250 2023-10-14T19:03:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.798+0000 7f5c0259c700 1 --2- 172.21.15.7:0/2071325044 >> v2:172.21.15.148:3300/0 conn(0x7f5c04157420 0x7f5c040b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3778277205 0 0) 0x7f5bf0003570 con 0x7f5c0406d250 2023-10-14T19:03:55.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 >> v2:172.21.15.148:3300/0 conn(0x7f5c04157420 msgr2=0x7f5c040b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:55.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 --2- 172.21.15.7:0/2071325044 >> v2:172.21.15.148:3300/0 conn(0x7f5c04157420 0x7f5c040b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 >> v1:172.21.15.148:6789/0 conn(0x7f5c040af6b0 legacy=0x7f5c040accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040aea60 con 0x7f5c0406d250 2023-10-14T19:03:55.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f5bec001470 con 0x7f5c0406d250 2023-10-14T19:03:55.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 --2- 172.21.15.7:0/2071325044 >> v2:172.21.15.148:3300/0 conn(0x7f5c04157420 0x7f5c040b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:55.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 >> v1:172.21.15.7:6789/0 conn(0x7f5c0406d250 legacy=0x7f5c040aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5bf0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5bf0004810 0x7f5bf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00052e0 0x7f5bf000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040abf50 con 0x7f5bf0003a60 2023-10-14T19:03:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf000c230 con 0x7f5bf00052e0 2023-10-14T19:03:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf000c3f0 con 0x7f5bf0004810 2023-10-14T19:03:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5bf0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c01d9b700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5bf0004810 0x7f5bf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c02d9d700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00052e0 0x7f5bf000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 -- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5bf0004810 msgr2=0x7f5bf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5bf0004810 0x7f5bf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 -- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00052e0 msgr2=0x7f5bf000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00052e0 0x7f5bf000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 -- 172.21.15.7:0/2071325044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0003570 con 0x7f5bf0003a60 2023-10-14T19:03:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c02d9d700 1 -- 172.21.15.7:0/2071325044 reap_dead start 2023-10-14T19:03:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c01d9b700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5bf0004810 0x7f5bf0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0259c700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5bf0003e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009ba0 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5639441dba6a69b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00c070 con 0x7f5bf0003a60 2023-10-14T19:03:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00e5e0 con 0x7f5bf0003a60 2023-10-14T19:03:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.799+0000 7f5c0159a700 1 -- 172.21.15.7:0/2071325044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc009510 con 0x7f5bf0003a60 2023-10-14T19:03:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 -- 172.21.15.7:0/2071325044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 msgr2=0x7f5bf0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5bf0003e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009ba0 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2023-10-14T19:03:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 -- 172.21.15.7:0/2071325044 shutdown_connections 2023-10-14T19:03:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 --2- 172.21.15.7:0/2071325044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5bf0003e70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 -- 172.21.15.7:0/2071325044 >> 172.21.15.7:0/2071325044 conn(0x7f5c0406ce80 msgr2=0x7f5c040ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 -- 172.21.15.7:0/2071325044 shutdown_connections 2023-10-14T19:03:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.800+0000 7f5c0359e700 1 -- 172.21.15.7:0/2071325044 wait complete. 2023-10-14T19:03:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.801+0000 7f5c0359e700 1 Processor -- start 2023-10-14T19:03:55.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.801+0000 7f5c0359e700 1 -- start start 2023-10-14T19:03:55.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5c0414b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04152cd0 0x7f5c0406e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c0406ecc0 0x7f5c040adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0359e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0416ee30 con 0x7f5bf0003a60 2023-10-14T19:03:55.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0416e260 con 0x7f5c04152cd0 2023-10-14T19:03:55.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0416e500 con 0x7f5c0406ecc0 2023-10-14T19:03:55.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5c0414b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5c0414b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38424/0 (socket says 172.21.15.7:38424) 2023-10-14T19:03:55.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 -- 172.21.15.7:0/3717403149 learned_addr learned my addr 172.21.15.7:0/3717403149 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:55.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c02d9d700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c0406ecc0 0x7f5c040adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c01d9b700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04152cd0 0x7f5c0406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 -- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c0406ecc0 msgr2=0x7f5c040adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c0406ecc0 0x7f5c040adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 -- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04152cd0 msgr2=0x7f5c0406e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:55.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04152cd0 0x7f5c0406e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:55.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 -- 172.21.15.7:0/3717403149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0416e7e0 con 0x7f5bf0003a60 2023-10-14T19:03:55.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c02d9d700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c0406ecc0 0x7f5c040adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:55.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c01d9b700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04152cd0 0x7f5c0406e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:55.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.802+0000 7f5c0259c700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5c0414b4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c200 tx=0x7f5bfc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.803+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00eec0 con 0x7f5bf0003a60 2023-10-14T19:03:55.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.803+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc013cb0 con 0x7f5bf0003a60 2023-10-14T19:03:55.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.803+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0416eac0 con 0x7f5bf0003a60 2023-10-14T19:03:55.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.803+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc01c690 con 0x7f5bf0003a60 2023-10-14T19:03:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.803+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0414ba30 con 0x7f5bf0003a60 2023-10-14T19:03:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.804+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0404c3c0 con 0x7f5bf0003a60 2023-10-14T19:03:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.804+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bfc01cac0 con 0x7f5bf0003a60 2023-10-14T19:03:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.804+0000 7f5bfa7fc700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.804+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bfc085eb0 con 0x7f5bf0003a60 2023-10-14T19:03:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.804+0000 7f5c01d9b700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.805+0000 7f5c01d9b700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000e10 tx=0x7f5bec000f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:55.809+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bfc053120 con 0x7f5bf0003a60 2023-10-14T19:03:56.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.053+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5c040ac1f0 con 0x7f5bf0003a60 2023-10-14T19:03:56.905 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-10-14T19:03:56.905+0000 7f49da8f8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:03:56.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.974+0000 7f5bfa7fc700 1 -- 172.21.15.7:0/3717403149 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5bfc056740 con 0x7f5bf0003a60 2023-10-14T19:03:56.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5be4066f30 msgr2=0x7f5be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:56.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000e10 tx=0x7f5bec000f60 comp rx=0 tx=0).stop 2023-10-14T19:03:56.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 msgr2=0x7f5c0414b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:56.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5c0414b4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c200 tx=0x7f5bfc01a000 comp rx=0 tx=0).stop 2023-10-14T19:03:56.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 shutdown_connections 2023-10-14T19:03:56.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c0406ecc0 0x7f5c040adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf0003a60 0x7f5c0414b4f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 --2- 172.21.15.7:0/3717403149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04152cd0 0x7f5c0406e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 >> 172.21.15.7:0/3717403149 conn(0x7f5c0406ce80 msgr2=0x7f5c040b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 shutdown_connections 2023-10-14T19:03:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:56.977+0000 7f5c0359e700 1 -- 172.21.15.7:0/3717403149 wait complete. 2023-10-14T19:03:56.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:03:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 Processor -- start 2023-10-14T19:03:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 -- start start 2023-10-14T19:03:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 0x7f4e38159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806e0e0 0x7f4e380cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380ccfd0 con 0x7f4e38159530 2023-10-14T19:03:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3815a3d0 con 0x7f4e3806dc70 2023-10-14T19:03:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.124+0000 7f4e3d8e2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3815a6b0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806e0e0 0x7f4e380cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e367fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 0x7f4e38159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:57.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e367fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 0x7f4e38159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:32870/0 (socket says 172.21.15.7:32870) 2023-10-14T19:03:57.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e367fc700 1 -- 172.21.15.7:0/511111003 learned_addr learned my addr 172.21.15.7:0/511111003 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:57.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e36ffd700 1 --1- 172.21.15.7:0/511111003 >> v1:172.21.15.148:6789/0 conn(0x7f4e38159530 0x7f4e380ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:39176/0 (socket says 172.21.15.7:39176) 2023-10-14T19:03:57.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e377fe700 1 -- 172.21.15.7:0/511111003 >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 msgr2=0x7f4e38159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:57.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e377fe700 1 --2- 172.21.15.7:0/511111003 >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 0x7f4e38159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e377fe700 1 -- 172.21.15.7:0/511111003 >> v1:172.21.15.148:6789/0 conn(0x7f4e38159530 legacy=0x7f4e380ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:57.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e377fe700 1 -- 172.21.15.7:0/511111003 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3815a990 con 0x7f4e3806e0e0 2023-10-14T19:03:57.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.125+0000 7f4e367fc700 1 --2- 172.21.15.7:0/511111003 >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 0x7f4e38159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:03:57.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e377fe700 1 --2- 172.21.15.7:0/511111003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806e0e0 0x7f4e380cb6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e300098e0 tx=0x7f4e300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366756369afdcc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:57.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e35ffb700 1 -- 172.21.15.7:0/511111003 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000b640 con 0x7f4e3806e0e0 2023-10-14T19:03:57.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e35ffb700 1 -- 172.21.15.7:0/511111003 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000b7a0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e35ffb700 1 -- 172.21.15.7:0/511111003 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000bb40 con 0x7f4e3806e0e0 2023-10-14T19:03:57.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/511111003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806e0e0 msgr2=0x7f4e380cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:57.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/511111003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806e0e0 0x7f4e380cb6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e300098e0 tx=0x7f4e300091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/511111003 shutdown_connections 2023-10-14T19:03:57.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/511111003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806e0e0 0x7f4e380cb6f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/511111003 >> v2:172.21.15.148:3300/0 conn(0x7f4e3806dc70 0x7f4e38159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/511111003 >> 172.21.15.7:0/511111003 conn(0x7f4e380703a0 msgr2=0x7f4e380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/511111003 shutdown_connections 2023-10-14T19:03:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.126+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/511111003 wait complete. 2023-10-14T19:03:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 Processor -- start 2023-10-14T19:03:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 -- start start 2023-10-14T19:03:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806dc70 0x7f4e38153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 0x7f4e380b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:57.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e38159530 0x7f4e380b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:57.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381699e0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380c8260 con 0x7f4e38159530 2023-10-14T19:03:57.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.128+0000 7f4e3d8e2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380c7930 con 0x7f4e3806dc70 2023-10-14T19:03:57.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 0x7f4e380b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 0x7f4e380b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39886/0 (socket says 172.21.15.7:39886) 2023-10-14T19:03:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 -- 172.21.15.7:0/1691321728 learned_addr learned my addr 172.21.15.7:0/1691321728 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e377fe700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e38159530 0x7f4e380b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e36ffd700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806dc70 0x7f4e38153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 -- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806dc70 msgr2=0x7f4e38153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806dc70 0x7f4e38153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 -- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e38159530 msgr2=0x7f4e380b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e38159530 0x7f4e380b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 -- 172.21.15.7:0/1691321728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200094f0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e367fc700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 0x7f4e380b3e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000ec50 tx=0x7f4e20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000c850 con 0x7f4e3806e0e0 2023-10-14T19:03:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2000c9b0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000cd50 con 0x7f4e3806e0e0 2023-10-14T19:03:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e30009420 con 0x7f4e3806e0e0 2023-10-14T19:03:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.129+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e380c7ef0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.130+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e380c83f0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.131+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e20013680 con 0x7f4e3806e0e0 2023-10-14T19:03:57.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.131+0000 7f4e2effd700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e18066f30 0x7f4e180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:57.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.131+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e200845d0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.131+0000 7f4e36ffd700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e18066f30 0x7f4e180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:57.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.132+0000 7f4e36ffd700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e18066f30 0x7f4e180693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e28002020 tx=0x7f4e28001a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:57.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.136+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e20051840 con 0x7f4e3806e0e0 2023-10-14T19:03:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.374+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4e3804c3c0 con 0x7f4e3806e0e0 2023-10-14T19:03:57.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.982+0000 7f4e2effd700 1 -- 172.21.15.7:0/1691321728 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4e20054e60 con 0x7f4e3806e0e0 2023-10-14T19:03:57.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e18066f30 msgr2=0x7f4e180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:57.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e18066f30 0x7f4e180693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e28002020 tx=0x7f4e28001a30 comp rx=0 tx=0).stop 2023-10-14T19:03:57.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 msgr2=0x7f4e380b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:57.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 0x7f4e380b3e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000ec50 tx=0x7f4e20009250 comp rx=0 tx=0).stop 2023-10-14T19:03:57.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 shutdown_connections 2023-10-14T19:03:57.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e18066f30 0x7f4e180693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e38159530 0x7f4e380b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3806dc70 0x7f4e38153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 --2- 172.21.15.7:0/1691321728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e3806e0e0 0x7f4e380b3e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:57.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 >> 172.21.15.7:0/1691321728 conn(0x7f4e380703a0 msgr2=0x7f4e380c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:57.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 shutdown_connections 2023-10-14T19:03:57.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:57.984+0000 7f4e3d8e2700 1 -- 172.21.15.7:0/1691321728 wait complete. 2023-10-14T19:03:58.000 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:03:58.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.124+0000 7f6e681c8700 1 Processor -- start 2023-10-14T19:03:58.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.124+0000 7f6e681c8700 1 -- start start 2023-10-14T19:03:58.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e681c8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6e600cb970 0x7f6e60159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e681c8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6015ae40 con 0x7f6e600cb5a0 2023-10-14T19:03:58.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e681c8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6015ab60 con 0x7f6e6015a400 2023-10-14T19:03:58.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e681c8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e600ce0f0 con 0x7f6e600cb970 2023-10-14T19:03:58.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e65f64700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6e600cb5a0 0x7f6e600cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34654/0 (socket says 172.21.15.7:34654) 2023-10-14T19:03:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e65f64700 1 -- 172.21.15.7:0/565216282 learned_addr learned my addr 172.21.15.7:0/565216282 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066790833 0 0) 0x7f6e6015ae40 con 0x7f6e600cb5a0 2023-10-14T19:03:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e48003570 con 0x7f6e600cb5a0 2023-10-14T19:03:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e65763700 1 --2- 172.21.15.7:0/565216282 >> v2:172.21.15.148:3300/0 conn(0x7f6e600cb970 0x7f6e60159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4224037631 0 0) 0x7f6e48003570 con 0x7f6e600cb5a0 2023-10-14T19:03:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 >> v2:172.21.15.148:3300/0 conn(0x7f6e600cb970 msgr2=0x7f6e60159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 --2- 172.21.15.7:0/565216282 >> v2:172.21.15.148:3300/0 conn(0x7f6e600cb970 0x7f6e60159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 >> v1:172.21.15.148:6789/0 conn(0x7f6e6015a400 legacy=0x7f6e60156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e600ccf00 con 0x7f6e600cb5a0 2023-10-14T19:03:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.125+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f6e500017f0 con 0x7f6e600cb5a0 2023-10-14T19:03:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 >> v1:172.21.15.7:6789/0 conn(0x7f6e600cb5a0 legacy=0x7f6e600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e48003a60 0x7f6e48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e48004810 0x7f6e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e480051c0 0x7f6e4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600ce0f0 con 0x7f6e480051c0 2023-10-14T19:03:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4800c0d0 con 0x7f6e48004810 2023-10-14T19:03:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4800c290 con 0x7f6e48003a60 2023-10-14T19:03:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e480051c0 0x7f6e4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e65763700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e48004810 0x7f6e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e65f64700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e48003a60 0x7f6e48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 -- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e48003a60 msgr2=0x7f6e48003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e48003a60 0x7f6e48003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 -- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e48004810 msgr2=0x7f6e48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e48004810 0x7f6e48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 -- 172.21.15.7:0/565216282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48003570 con 0x7f6e480051c0 2023-10-14T19:03:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e65f64700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e48003a60 0x7f6e48003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 -- 172.21.15.7:0/565216282 reap_dead start 2023-10-14T19:03:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e66765700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e480051c0 0x7f6e4800ba60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e580018b0 tx=0x7f6e58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f002f51ee44f4be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58012420 con 0x7f6e480051c0 2023-10-14T19:03:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58012580 con 0x7f6e480051c0 2023-10-14T19:03:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.126+0000 7f6e64f62700 1 -- 172.21.15.7:0/565216282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58012920 con 0x7f6e480051c0 2023-10-14T19:03:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 -- 172.21.15.7:0/565216282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e480051c0 msgr2=0x7f6e4800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e480051c0 0x7f6e4800ba60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e580018b0 tx=0x7f6e58007d30 comp rx=0 tx=0).stop 2023-10-14T19:03:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 -- 172.21.15.7:0/565216282 shutdown_connections 2023-10-14T19:03:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 --2- 172.21.15.7:0/565216282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e480051c0 0x7f6e4800ba60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 -- 172.21.15.7:0/565216282 >> 172.21.15.7:0/565216282 conn(0x7f6e60070e30 msgr2=0x7f6e600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 -- 172.21.15.7:0/565216282 shutdown_connections 2023-10-14T19:03:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.127+0000 7f6e681c8700 1 -- 172.21.15.7:0/565216282 wait complete. 2023-10-14T19:03:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.128+0000 7f6e681c8700 1 Processor -- start 2023-10-14T19:03:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.128+0000 7f6e681c8700 1 -- start start 2023-10-14T19:03:58.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e681c8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e480051c0 0x7f6e600b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e681c8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 0x7f6e6016d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e681c8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e6016ac60 0x7f6e6015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e681c8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60153320 con 0x7f6e6016caf0 2023-10-14T19:03:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e681c8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6016e010 con 0x7f6e480051c0 2023-10-14T19:03:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e681c8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600c9550 con 0x7f6e6016ac60 2023-10-14T19:03:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 0x7f6e6016d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 0x7f6e6016d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39902/0 (socket says 172.21.15.7:39902) 2023-10-14T19:03:58.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 -- 172.21.15.7:0/1221382084 learned_addr learned my addr 172.21.15.7:0/1221382084 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:58.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65f64700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e480051c0 0x7f6e600b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e66765700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e6016ac60 0x7f6e6015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 -- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e6016ac60 msgr2=0x7f6e6015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e6016ac60 0x7f6e6015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 -- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e480051c0 msgr2=0x7f6e600b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e480051c0 0x7f6e600b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 -- 172.21.15.7:0/1221382084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e600c9810 con 0x7f6e6016caf0 2023-10-14T19:03:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e66765700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e6016ac60 0x7f6e6015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e65763700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 0x7f6e6016d090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e54006ac0 tx=0x7f6e540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.129+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400f940 con 0x7f6e6016caf0 2023-10-14T19:03:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.130+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400faa0 con 0x7f6e6016caf0 2023-10-14T19:03:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.130+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6016d770 con 0x7f6e6016caf0 2023-10-14T19:03:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.130+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400fe20 con 0x7f6e6016caf0 2023-10-14T19:03:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.130+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6016dd30 con 0x7f6e6016caf0 2023-10-14T19:03:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.131+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e600c99a0 con 0x7f6e6016caf0 2023-10-14T19:03:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.131+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e54014650 con 0x7f6e6016caf0 2023-10-14T19:03:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.132+0000 7f6e5dffb700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e4c066f30 0x7f6e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.132+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e54018030 con 0x7f6e6016caf0 2023-10-14T19:03:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.132+0000 7f6e65f64700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e4c066f30 0x7f6e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.132+0000 7f6e65f64700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e4c066f30 0x7f6e4c0693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e50001190 tx=0x7f6e5000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.136+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e54052160 con 0x7f6e6016caf0 2023-10-14T19:03:58.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.373+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e60089590 con 0x7f6e6016caf0 2023-10-14T19:03:58.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.374+0000 7f6e5dffb700 1 -- 172.21.15.7:0/1221382084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4588 (secure 0 0 0) 0x7f6e54055780 con 0x7f6e6016caf0 2023-10-14T19:03:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:58.375 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4866,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1287999800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1287999800},{"type":"v1","addr":"172.21.15.7:6835","nonce":1287999800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:54.330660+0000","modified":"2023-10-14T19:03:57.974158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4878":{"gid":4878,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6836/851698468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":851698468},{"type":"v1","addr":"172.21.15.148:6836","nonce":851698468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T19:03:58.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.375+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e4c066f30 msgr2=0x7f6e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.375+0000 7f6e681c8700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e4c066f30 0x7f6e4c0693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e50001190 tx=0x7f6e5000c040 comp rx=0 tx=0).stop 2023-10-14T19:03:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.375+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 msgr2=0x7f6e6016d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.375+0000 7f6e681c8700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 0x7f6e6016d090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e54006ac0 tx=0x7f6e540091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 shutdown_connections 2023-10-14T19:03:58.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e4c066f30 0x7f6e4c0693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e480051c0 0x7f6e600b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e6016ac60 0x7f6e6015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 --2- 172.21.15.7:0/1221382084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e6016caf0 0x7f6e6016d090 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 >> 172.21.15.7:0/1221382084 conn(0x7f6e60070e30 msgr2=0x7f6e600c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:58.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 shutdown_connections 2023-10-14T19:03:58.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.376+0000 7f6e681c8700 1 -- 172.21.15.7:0/1221382084 wait complete. 2023-10-14T19:03:58.379 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2023-10-14T19:03:58.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:03:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.508+0000 7fca927df700 1 Processor -- start 2023-10-14T19:03:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.508+0000 7fca927df700 1 -- start start 2023-10-14T19:03:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca927df700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fca8c0cb5a0 0x7fca8c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca927df700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c0cd9e0 0x7fca8c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca927df700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c15ae40 con 0x7fca8c0cde50 2023-10-14T19:03:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca927df700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c0d13f0 con 0x7fca8c0cb5a0 2023-10-14T19:03:58.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca927df700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c15ab60 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fca8c0cb5a0 0x7fca8c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca90d7c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fca8c0cde50 0x7fca8c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34658/0 (socket says 172.21.15.7:34658) 2023-10-14T19:03:58.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca90d7c700 1 -- 172.21.15.7:0/2584948782 learned_addr learned my addr 172.21.15.7:0/2584948782 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:58.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8b7fe700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c0cd9e0 0x7fca8c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8bfff700 1 -- 172.21.15.7:0/2584948782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c0cd9e0 msgr2=0x7fca8c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8bfff700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c0cd9e0 0x7fca8c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8bfff700 1 -- 172.21.15.7:0/2584948782 >> v1:172.21.15.7:6789/0 conn(0x7fca8c0cde50 legacy=0x7fca8c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8bfff700 1 -- 172.21.15.7:0/2584948782 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0ccf00 con 0x7fca8c0cb5a0 2023-10-14T19:03:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8b7fe700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c0cd9e0 0x7fca8c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.509+0000 7fca8bfff700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c0cb970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fca740098e0 tx=0x7fca740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33806ccd1acd1262 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca8affd700 1 -- 172.21.15.7:0/2584948782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74009e80 con 0x7fca8c0cb5a0 2023-10-14T19:03:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca8affd700 1 -- 172.21.15.7:0/2584948782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400b860 con 0x7fca8c0cb5a0 2023-10-14T19:03:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca8affd700 1 -- 172.21.15.7:0/2584948782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400bbe0 con 0x7fca8c0cb5a0 2023-10-14T19:03:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 -- 172.21.15.7:0/2584948782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cb5a0 msgr2=0x7fca8c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c0cb970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fca740098e0 tx=0x7fca740091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 -- 172.21.15.7:0/2584948782 shutdown_connections 2023-10-14T19:03:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c0cb970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 --2- 172.21.15.7:0/2584948782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c0cd9e0 0x7fca8c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 -- 172.21.15.7:0/2584948782 >> 172.21.15.7:0/2584948782 conn(0x7fca8c070e30 msgr2=0x7fca8c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 -- 172.21.15.7:0/2584948782 shutdown_connections 2023-10-14T19:03:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.510+0000 7fca927df700 1 -- 172.21.15.7:0/2584948782 wait complete. 2023-10-14T19:03:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.511+0000 7fca927df700 1 Processor -- start 2023-10-14T19:03:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.511+0000 7fca927df700 1 -- start start 2023-10-14T19:03:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca927df700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca927df700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 0x7fca8c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca927df700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c156350 0x7fca8c0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca927df700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0c9a30 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca927df700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1567a0 con 0x7fca8c0cb5a0 2023-10-14T19:03:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca927df700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0c8e20 con 0x7fca8c156350 2023-10-14T19:03:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca8b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 0x7fca8c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca8b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 0x7fca8c155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39912/0 (socket says 172.21.15.7:39912) 2023-10-14T19:03:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca8b7fe700 1 -- 172.21.15.7:0/3800097012 learned_addr learned my addr 172.21.15.7:0/3800097012 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.512+0000 7fca90d7c700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c156350 0x7fca8c0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8bfff700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8b7fe700 1 -- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c156350 msgr2=0x7fca8c0c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8b7fe700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c156350 0x7fca8c0c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8b7fe700 1 -- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c0cb5a0 msgr2=0x7fca8c15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8b7fe700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8b7fe700 1 -- 172.21.15.7:0/3800097012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74009420 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8bfff700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:03:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca8b7fe700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 0x7fca8c155e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c830 tx=0x7fca7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c011600 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c011760 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c011b20 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c0c9100 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.513+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c0c96c0 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.514+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c04c3c0 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.515+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca7c01a450 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.515+0000 7fca83fff700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.515+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca7c0849f0 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.515+0000 7fca8bfff700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.516+0000 7fca8bfff700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca74003080 tx=0x7fca74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.519+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca7c051c60 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.715+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca8c0cd1e0 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.716+0000 7fca83fff700 1 -- 172.21.15.7:0/3800097012 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fca7c015090 con 0x7fca8c0cd9e0 2023-10-14T19:03:58.717 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:58.717 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:03:55.958722+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:03:58.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fca6c066f30 msgr2=0x7fca6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca74003080 tx=0x7fca74017000 comp rx=0 tx=0).stop 2023-10-14T19:03:58.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 msgr2=0x7fca8c155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 0x7fca8c155e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c830 tx=0x7fca7c008040 comp rx=0 tx=0).stop 2023-10-14T19:03:58.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 shutdown_connections 2023-10-14T19:03:58.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c0cb5a0 0x7fca8c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca8c156350 0x7fca8c0c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 --2- 172.21.15.7:0/3800097012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca8c0cd9e0 0x7fca8c155e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 >> 172.21.15.7:0/3800097012 conn(0x7fca8c070e30 msgr2=0x7fca8c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:58.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 shutdown_connections 2023-10-14T19:03:58.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.718+0000 7fca927df700 1 -- 172.21.15.7:0/3800097012 wait complete. 2023-10-14T19:03:58.731 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:03:58.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:58.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.850+0000 7f8457183700 1 Processor -- start 2023-10-14T19:03:58.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.850+0000 7f8457183700 1 -- start start 2023-10-14T19:03:58.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8457183700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f845015de50 0x7f84500cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8457183700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84500cef40 0x7f845015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8457183700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500cf3c0 con 0x7f8450153c30 2023-10-14T19:03:58.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8457183700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845015afd0 con 0x7f845015de50 2023-10-14T19:03:58.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8457183700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845015b2b0 con 0x7f84500cef40 2023-10-14T19:03:58.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8456181700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8450153c30 0x7f845015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34674/0 (socket says 172.21.15.7:34674) 2023-10-14T19:03:58.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8456181700 1 -- 172.21.15.7:0/2125410715 learned_addr learned my addr 172.21.15.7:0/2125410715 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.851+0000 7f8455980700 1 --2- 172.21.15.7:0/2125410715 >> v2:172.21.15.148:3300/0 conn(0x7f845015de50 0x7f84500cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f8456982700 1 --2- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84500cef40 0x7f845015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f845517f700 1 -- 172.21.15.7:0/2125410715 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264078913 0 0) 0x7f84500cf3c0 con 0x7f8450153c30 2023-10-14T19:03:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f845517f700 1 -- 172.21.15.7:0/2125410715 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8438003570 con 0x7f8450153c30 2023-10-14T19:03:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f8455980700 1 -- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84500cef40 msgr2=0x7f845015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f8455980700 1 --2- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84500cef40 0x7f845015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f8455980700 1 -- 172.21.15.7:0/2125410715 >> v1:172.21.15.7:6789/0 conn(0x7f8450153c30 legacy=0x7f845015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f845517f700 1 -- 172.21.15.7:0/2125410715 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427840496 0 0) 0x7f8438003570 con 0x7f8450153c30 2023-10-14T19:03:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f8455980700 1 -- 172.21.15.7:0/2125410715 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845015b590 con 0x7f845015de50 2023-10-14T19:03:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f8455980700 1 --2- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f845015de50 0x7f84500cea00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f84440098e0 tx=0x7f84440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45de0b55d1fd557a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f845517f700 1 -- 172.21.15.7:0/2125410715 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448001470 con 0x7f845015de50 2023-10-14T19:03:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f845517f700 1 -- 172.21.15.7:0/2125410715 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444011420 con 0x7f845015de50 2023-10-14T19:03:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.852+0000 7f845517f700 1 -- 172.21.15.7:0/2125410715 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440117c0 con 0x7f845015de50 2023-10-14T19:03:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 -- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f845015de50 msgr2=0x7f84500cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 --2- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f845015de50 0x7f84500cea00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f84440098e0 tx=0x7f84440091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 -- 172.21.15.7:0/2125410715 shutdown_connections 2023-10-14T19:03:58.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 --2- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84500cef40 0x7f845015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 --2- 172.21.15.7:0/2125410715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f845015de50 0x7f84500cea00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 -- 172.21.15.7:0/2125410715 >> 172.21.15.7:0/2125410715 conn(0x7f84500703a0 msgr2=0x7f84500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 -- 172.21.15.7:0/2125410715 shutdown_connections 2023-10-14T19:03:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.853+0000 7f8457183700 1 -- 172.21.15.7:0/2125410715 wait complete. 2023-10-14T19:03:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.854+0000 7f8457183700 1 Processor -- start 2023-10-14T19:03:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.854+0000 7f8457183700 1 -- start start 2023-10-14T19:03:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84500cef40 0x7f84500cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 0x7f8450140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845015de50 0x7f8450141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501535b0 con 0x7f8450153c30 2023-10-14T19:03:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b5730 con 0x7f84500cef40 2023-10-14T19:03:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b5a10 con 0x7f845015de50 2023-10-14T19:03:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 0x7f8450140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 0x7f8450140cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39922/0 (socket says 172.21.15.7:39922) 2023-10-14T19:03:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 -- 172.21.15.7:0/1702293973 learned_addr learned my addr 172.21.15.7:0/1702293973 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8456181700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84500cef40 0x7f84500cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8456982700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845015de50 0x7f8450141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 -- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845015de50 msgr2=0x7f8450141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845015de50 0x7f8450141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 -- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84500cef40 msgr2=0x7f84500cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84500cef40 0x7f84500cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 -- 172.21.15.7:0/1702293973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444009420 con 0x7f8450153c30 2023-10-14T19:03:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8455980700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 0x7f8450140cf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f84440030c0 tx=0x7f8444016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844401cc90 con 0x7f8450153c30 2023-10-14T19:03:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844401ce10 con 0x7f8450153c30 2023-10-14T19:03:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844401a6a0 con 0x7f8450153c30 2023-10-14T19:03:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.855+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84500b5cf0 con 0x7f8450153c30 2023-10-14T19:03:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.856+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8450152180 con 0x7f8450153c30 2023-10-14T19:03:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.856+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84500b5f00 con 0x7f8450153c30 2023-10-14T19:03:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.857+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f844401aad0 con 0x7f8450153c30 2023-10-14T19:03:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.857+0000 7f844e7fc700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f843c066f30 0x7f843c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.857+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8444085f10 con 0x7f8450153c30 2023-10-14T19:03:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.857+0000 7f8456181700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f843c066f30 0x7f843c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.858+0000 7f8456181700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f843c066f30 0x7f843c0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84480011e0 tx=0x7f8448001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:58.861+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84440531c0 con 0x7f8450153c30 2023-10-14T19:03:59.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.052+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f845004c3c0 con 0x7f843c066f30 2023-10-14T19:03:59.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.060+0000 7f844e7fc700 1 -- 172.21.15.7:0/1702293973 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249911 (secure 0 0 0) 0x7f845004c3c0 con 0x7f843c066f30 2023-10-14T19:03:59.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:59.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f843c066f30 msgr2=0x7f843c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f843c066f30 0x7f843c0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84480011e0 tx=0x7f8448001520 comp rx=0 tx=0).stop 2023-10-14T19:03:59.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 msgr2=0x7f8450140cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 0x7f8450140cf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f84440030c0 tx=0x7f8444016000 comp rx=0 tx=0).stop 2023-10-14T19:03:59.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 shutdown_connections 2023-10-14T19:03:59.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f843c066f30 0x7f843c0693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84500cef40 0x7f84500cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845015de50 0x7f8450141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 --2- 172.21.15.7:0/1702293973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8450153c30 0x7f8450140cf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 >> 172.21.15.7:0/1702293973 conn(0x7f84500703a0 msgr2=0x7f84500d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 shutdown_connections 2023-10-14T19:03:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.063+0000 7f8457183700 1 -- 172.21.15.7:0/1702293973 wait complete. 2023-10-14T19:03:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:59.075 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-14T19:03:57.632378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381992,"kb_used_data":3688,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592728,"statfs":{"total":773094113280,"available":770654953472,"internally_reserved":0,"allocated":3776512,"data_stored":2129256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.714252"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T19:03:46.799846+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:46.799846+0000","last_peered":"2023-10-14T19:03:46.799846+0000","last_clean":"2023-10-14T19:03:46.799846+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:46.799846+0000","last_undegraded":"2023-10-14T19:03:46.799846+0000","last_fullsized":"2023-10-14T19:03:46.799846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:59.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:59.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.234+0000 7f055abe0700 1 Processor -- start 2023-10-14T19:03:59.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.234+0000 7f055abe0700 1 -- start start 2023-10-14T19:03:59.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f055abe0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0554142c00 0x7f055406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f055abe0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540ca480 con 0x7f05540c7f90 2023-10-14T19:03:59.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f055abe0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055415e240 con 0x7f055406bd20 2023-10-14T19:03:59.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f055abe0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055406b350 con 0x7f0554142c00 2023-10-14T19:03:59.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f0559bde700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0554142c00 0x7f055406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f055a3df700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f05540c7f90 0x7f055406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34690/0 (socket says 172.21.15.7:34690) 2023-10-14T19:03:59.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f055a3df700 1 -- 172.21.15.7:0/2115498161 learned_addr learned my addr 172.21.15.7:0/2115498161 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:03:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f0559bde700 1 -- 172.21.15.7:0/2115498161 >> v1:172.21.15.148:6789/0 conn(0x7f055406bd20 legacy=0x7f05540c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f0559bde700 1 -- 172.21.15.7:0/2115498161 >> v1:172.21.15.7:6789/0 conn(0x7f05540c7f90 legacy=0x7f055406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f0559bde700 1 -- 172.21.15.7:0/2115498161 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055415df60 con 0x7f0554142c00 2023-10-14T19:03:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.235+0000 7f0558bdc700 1 -- 172.21.15.7:0/2115498161 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157217973 0 0) 0x7f05540ca480 con 0x7f05540c7f90 2023-10-14T19:03:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f0559bde700 1 --2- 172.21.15.7:0/2115498161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f055406b7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f054c0098e0 tx=0x7f054c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9572cf4ef347bead server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f0558bdc700 1 -- 172.21.15.7:0/2115498161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c009e80 con 0x7f0554142c00 2023-10-14T19:03:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f0558bdc700 1 -- 172.21.15.7:0/2115498161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00b820 con 0x7f0554142c00 2023-10-14T19:03:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f0558bdc700 1 -- 172.21.15.7:0/2115498161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00bba0 con 0x7f0554142c00 2023-10-14T19:03:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 -- 172.21.15.7:0/2115498161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 msgr2=0x7f055406b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 --2- 172.21.15.7:0/2115498161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f055406b7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f054c0098e0 tx=0x7f054c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 -- 172.21.15.7:0/2115498161 shutdown_connections 2023-10-14T19:03:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 --2- 172.21.15.7:0/2115498161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f055406b7e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 -- 172.21.15.7:0/2115498161 >> 172.21.15.7:0/2115498161 conn(0x7f05540675a0 msgr2=0x7f05540679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 -- 172.21.15.7:0/2115498161 shutdown_connections 2023-10-14T19:03:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.236+0000 7f055abe0700 1 -- 172.21.15.7:0/2115498161 wait complete. 2023-10-14T19:03:59.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.237+0000 7f055abe0700 1 Processor -- start 2023-10-14T19:03:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 -- start start 2023-10-14T19:03:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f055406bd20 0x7f0554141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05540c7f90 0x7f055415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f0554169580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055415ae70 con 0x7f0554142c00 2023-10-14T19:03:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055415b150 con 0x7f055406bd20 2023-10-14T19:03:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055abe0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055415b430 con 0x7f05540c7f90 2023-10-14T19:03:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055a3df700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f0554169580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055a3df700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f0554169580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39938/0 (socket says 172.21.15.7:39938) 2023-10-14T19:03:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f055a3df700 1 -- 172.21.15.7:0/2649450940 learned_addr learned my addr 172.21.15.7:0/2649450940 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f0559bde700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f055406bd20 0x7f0554141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.238+0000 7f05593dd700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05540c7f90 0x7f055415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055a3df700 1 -- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05540c7f90 msgr2=0x7f055415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055a3df700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05540c7f90 0x7f055415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055a3df700 1 -- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f055406bd20 msgr2=0x7f0554141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055a3df700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f055406bd20 0x7f0554141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055a3df700 1 -- 172.21.15.7:0/2649450940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c009420 con 0x7f0554142c00 2023-10-14T19:03:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f0559bde700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f055406bd20 0x7f0554141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055a3df700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f0554169580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f054400cc90 tx=0x7f0544001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400cea0 con 0x7f0554142c00 2023-10-14T19:03:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054400ab30 con 0x7f0554142c00 2023-10-14T19:03:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05540c61a0 con 0x7f0554142c00 2023-10-14T19:03:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440070f0 con 0x7f0554142c00 2023-10-14T19:03:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.239+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055415b710 con 0x7f0554142c00 2023-10-14T19:03:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.240+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055404c3c0 con 0x7f0554142c00 2023-10-14T19:03:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.240+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05440074a0 con 0x7f0554142c00 2023-10-14T19:03:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.241+0000 7f0551ffb700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0540066f30 0x7f05400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.241+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0544084960 con 0x7f0554142c00 2023-10-14T19:03:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.241+0000 7f0559bde700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0540066f30 0x7f05400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.241+0000 7f0559bde700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0540066f30 0x7f05400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f054c0030c0 tx=0x7f054c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:59.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.245+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0544051c50 con 0x7f0554142c00 2023-10-14T19:03:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.436+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f055406ad00 con 0x7f0540066f30 2023-10-14T19:03:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.443+0000 7f0551ffb700 1 -- 172.21.15.7:0/2649450940 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249911 (secure 0 0 0) 0x7f055406ad00 con 0x7f0540066f30 2023-10-14T19:03:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0540066f30 msgr2=0x7f05400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0540066f30 0x7f05400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f054c0030c0 tx=0x7f054c016000 comp rx=0 tx=0).stop 2023-10-14T19:03:59.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 msgr2=0x7f0554169580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f0554169580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f054400cc90 tx=0x7f0544001a20 comp rx=0 tx=0).stop 2023-10-14T19:03:59.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 shutdown_connections 2023-10-14T19:03:59.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0540066f30 0x7f05400693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f055406bd20 0x7f0554141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554142c00 0x7f0554169580 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 --2- 172.21.15.7:0/2649450940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05540c7f90 0x7f055415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 >> 172.21.15.7:0/2649450940 conn(0x7f05540675a0 msgr2=0x7f05540c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 shutdown_connections 2023-10-14T19:03:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.446+0000 7f055abe0700 1 -- 172.21.15.7:0/2649450940 wait complete. 2023-10-14T19:03:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:59.459 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-14T19:03:57.632378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381992,"kb_used_data":3688,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592728,"statfs":{"total":773094113280,"available":770654953472,"internally_reserved":0,"allocated":3776512,"data_stored":2129256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.714252"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:53.917328+0000","last_change":"2023-10-14T19:03:53.917328+0000","last_active":"2023-10-14T19:03:53.917328+0000","last_peered":"2023-10-14T19:03:53.917328+0000","last_clean":"2023-10-14T19:03:53.917328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:53.917328+0000","last_undegraded":"2023-10-14T19:03:53.917328+0000","last_fullsized":"2023-10-14T19:03:53.917328+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:03:52.915343+0000","last_change":"2023-10-14T19:03:52.915343+0000","last_active":"2023-10-14T19:03:52.915343+0000","last_peered":"2023-10-14T19:03:52.915343+0000","last_clean":"2023-10-14T19:03:52.915343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:03:52.915343+0000","last_undegraded":"2023-10-14T19:03:52.915343+0000","last_fullsized":"2023-10-14T19:03:52.915343+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T19:03:46.799846+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:46.799846+0000","last_peered":"2023-10-14T19:03:46.799846+0000","last_clean":"2023-10-14T19:03:46.799846+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:46.799846+0000","last_undegraded":"2023-10-14T19:03:46.799846+0000","last_fullsized":"2023-10-14T19:03:46.799846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":708933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":118565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:59.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:03:59.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 Processor -- start 2023-10-14T19:03:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 -- start start 2023-10-14T19:03:59.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08140cb5a0 0x7f08140cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081415ae40 con 0x7f08140cd9e0 2023-10-14T19:03:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08140d13f0 con 0x7f08140cb5a0 2023-10-14T19:03:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.618+0000 7f08190d6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081415ab60 con 0x7f081415a5d0 2023-10-14T19:03:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08140cb5a0 0x7f08140cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08140cb5a0 0x7f08140cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39952/0 (socket says 172.21.15.7:39952) 2023-10-14T19:03:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 -- 172.21.15.7:0/1068335022 learned_addr learned my addr 172.21.15.7:0/1068335022 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f081359e700 1 --2- 172.21.15.7:0/1068335022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 -- 172.21.15.7:0/1068335022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 msgr2=0x7f0814156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 --2- 172.21.15.7:0/1068335022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 -- 172.21.15.7:0/1068335022 >> v1:172.21.15.148:6789/0 conn(0x7f08140cd9e0 legacy=0x7f0814159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:03:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 -- 172.21.15.7:0/1068335022 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140ccf00 con 0x7f08140cb5a0 2023-10-14T19:03:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f0812d9d700 1 --2- 172.21.15.7:0/1068335022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cb5a0 0x7f08140cb970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08040099e0 tx=0x7f0804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3fc43e21dc2a2d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f081259c700 1 -- 172.21.15.7:0/1068335022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400b7e0 con 0x7f08140cb5a0 2023-10-14T19:03:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f081259c700 1 -- 172.21.15.7:0/1068335022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400b940 con 0x7f08140cb5a0 2023-10-14T19:03:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.619+0000 7f081259c700 1 -- 172.21.15.7:0/1068335022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400bce0 con 0x7f08140cb5a0 2023-10-14T19:03:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 -- 172.21.15.7:0/1068335022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cb5a0 msgr2=0x7f08140cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 --2- 172.21.15.7:0/1068335022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cb5a0 0x7f08140cb970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08040099e0 tx=0x7f0804009250 comp rx=0 tx=0).stop 2023-10-14T19:03:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 -- 172.21.15.7:0/1068335022 shutdown_connections 2023-10-14T19:03:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 --2- 172.21.15.7:0/1068335022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 --2- 172.21.15.7:0/1068335022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cb5a0 0x7f08140cb970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 -- 172.21.15.7:0/1068335022 >> 172.21.15.7:0/1068335022 conn(0x7f0814070e30 msgr2=0x7f08140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:59.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 -- 172.21.15.7:0/1068335022 shutdown_connections 2023-10-14T19:03:59.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.620+0000 7f08190d6700 1 -- 172.21.15.7:0/1068335022 wait complete. 2023-10-14T19:03:59.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.621+0000 7f08190d6700 1 Processor -- start 2023-10-14T19:03:59.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.621+0000 7f08190d6700 1 -- start start 2023-10-14T19:03:59.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08140cb5a0 0x7f081416ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 0x7f08140b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081416a690 con 0x7f08140cd9e0 2023-10-14T19:03:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08140b6340 con 0x7f08140cb5a0 2023-10-14T19:03:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814152890 con 0x7f081415a5d0 2023-10-14T19:03:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 0x7f08140b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 0x7f08140b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39954/0 (socket says 172.21.15.7:39954) 2023-10-14T19:03:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 -- 172.21.15.7:0/427111673 learned_addr learned my addr 172.21.15.7:0/427111673 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:03:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f0812d9d700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08140cb5a0 0x7f081416ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f081359e700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 -- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 msgr2=0x7f0814151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 -- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08140cb5a0 msgr2=0x7f081416ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08140cb5a0 0x7f081416ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 -- 172.21.15.7:0/427111673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040094f0 con 0x7f08140cd9e0 2023-10-14T19:03:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f0812d9d700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08140cb5a0 0x7f081416ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:03:59.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080a59c700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 0x7f08140b5e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00c5d0 tx=0x7f07fc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:59.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc011590 con 0x7f08140cd9e0 2023-10-14T19:03:59.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc011710 con 0x7f08140cd9e0 2023-10-14T19:03:59.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08140af8b0 con 0x7f08140cd9e0 2023-10-14T19:03:59.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.622+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc011ad0 con 0x7f08140cd9e0 2023-10-14T19:03:59.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.623+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081416a040 con 0x7f08140cd9e0 2023-10-14T19:03:59.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.623+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081416a840 con 0x7f08140cd9e0 2023-10-14T19:03:59.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.624+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07fc01c460 con 0x7f08140cd9e0 2023-10-14T19:03:59.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.624+0000 7f080b7fe700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07f4066f30 0x7f07f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:03:59.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.624+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07fc084330 con 0x7f08140cd9e0 2023-10-14T19:03:59.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.624+0000 7f0812d9d700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07f4066f30 0x7f07f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:03:59.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.625+0000 7f0812d9d700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07f4066f30 0x7f07f40693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08040099e0 tx=0x7f0804016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:03:59.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.629+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f081416a840 con 0x7f08140cd9e0 2023-10-14T19:03:59.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.817+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f081404c3c0 con 0x7f07f4066f30 2023-10-14T19:03:59.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.825+0000 7f080b7fe700 1 -- 172.21.15.7:0/427111673 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264640 (secure 0 0 0) 0x7f081404c3c0 con 0x7f07f4066f30 2023-10-14T19:03:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:03:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.827+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07f4066f30 msgr2=0x7f07f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07f4066f30 0x7f07f40693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08040099e0 tx=0x7f0804016000 comp rx=0 tx=0).stop 2023-10-14T19:03:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 msgr2=0x7f08140b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:03:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 0x7f08140b5e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00c5d0 tx=0x7f07fc007f60 comp rx=0 tx=0).stop 2023-10-14T19:03:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 shutdown_connections 2023-10-14T19:03:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07f4066f30 0x7f07f40693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08140cb5a0 0x7f081416ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f081415a5d0 0x7f0814151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 --2- 172.21.15.7:0/427111673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08140cd9e0 0x7f08140b5e00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:03:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 >> 172.21.15.7:0/427111673 conn(0x7f0814070e30 msgr2=0x7f08140b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:03:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 shutdown_connections 2023-10-14T19:03:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.828+0000 7f08190d6700 1 -- 172.21.15.7:0/427111673 wait complete. 2023-10-14T19:03:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:03:59.841 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-14T19:03:59.632870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382428,"kb_used_data":4124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592292,"statfs":{"total":773094113280,"available":770654507008,"internally_reserved":0,"allocated":4222976,"data_stored":2328468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001270"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972883+0000","last_change":"2023-10-14T19:03:54.965542+0000","last_active":"2023-10-14T19:03:54.972883+0000","last_peered":"2023-10-14T19:03:54.972883+0000","last_clean":"2023-10-14T19:03:54.972883+0000","last_became_active":"2023-10-14T19:03:54.965162+0000","last_became_peered":"2023-10-14T19:03:54.965162+0000","last_unstale":"2023-10-14T19:03:54.972883+0000","last_undegraded":"2023-10-14T19:03:54.972883+0000","last_fullsized":"2023-10-14T19:03:54.972883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970912+0000","last_change":"2023-10-14T19:03:54.969130+0000","last_active":"2023-10-14T19:03:54.970912+0000","last_peered":"2023-10-14T19:03:54.970912+0000","last_clean":"2023-10-14T19:03:54.970912+0000","last_became_active":"2023-10-14T19:03:54.968863+0000","last_became_peered":"2023-10-14T19:03:54.968863+0000","last_unstale":"2023-10-14T19:03:54.970912+0000","last_undegraded":"2023-10-14T19:03:54.970912+0000","last_fullsized":"2023-10-14T19:03:54.970912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:30.690416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980074+0000","last_change":"2023-10-14T19:03:54.976548+0000","last_active":"2023-10-14T19:03:54.980074+0000","last_peered":"2023-10-14T19:03:54.980074+0000","last_clean":"2023-10-14T19:03:54.980074+0000","last_became_active":"2023-10-14T19:03:54.976264+0000","last_became_peered":"2023-10-14T19:03:54.976264+0000","last_unstale":"2023-10-14T19:03:54.980074+0000","last_undegraded":"2023-10-14T19:03:54.980074+0000","last_fullsized":"2023-10-14T19:03:54.980074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:30.690416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979952+0000","last_change":"2023-10-14T19:03:54.978697+0000","last_active":"2023-10-14T19:03:54.979952+0000","last_peered":"2023-10-14T19:03:54.979952+0000","last_clean":"2023-10-14T19:03:54.979952+0000","last_became_active":"2023-10-14T19:03:54.978403+0000","last_became_peered":"2023-10-14T19:03:54.978403+0000","last_unstale":"2023-10-14T19:03:54.979952+0000","last_undegraded":"2023-10-14T19:03:54.979952+0000","last_fullsized":"2023-10-14T19:03:54.979952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.959703+0000","last_change":"2023-10-14T19:03:54.958469+0000","last_active":"2023-10-14T19:03:54.959703+0000","last_peered":"2023-10-14T19:03:54.959703+0000","last_clean":"2023-10-14T19:03:54.959703+0000","last_became_active":"2023-10-14T19:03:54.957362+0000","last_became_peered":"2023-10-14T19:03:54.957362+0000","last_unstale":"2023-10-14T19:03:54.959703+0000","last_undegraded":"2023-10-14T19:03:54.959703+0000","last_fullsized":"2023-10-14T19:03:54.959703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:34.678754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967928+0000","last_change":"2023-10-14T19:03:54.965611+0000","last_active":"2023-10-14T19:03:54.967928+0000","last_peered":"2023-10-14T19:03:54.967928+0000","last_clean":"2023-10-14T19:03:54.967928+0000","last_became_active":"2023-10-14T19:03:54.965195+0000","last_became_peered":"2023-10-14T19:03:54.965195+0000","last_unstale":"2023-10-14T19:03:54.967928+0000","last_undegraded":"2023-10-14T19:03:54.967928+0000","last_fullsized":"2023-10-14T19:03:54.967928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972517+0000","last_change":"2023-10-14T19:03:54.968465+0000","last_active":"2023-10-14T19:03:54.972517+0000","last_peered":"2023-10-14T19:03:54.972517+0000","last_clean":"2023-10-14T19:03:54.972517+0000","last_became_active":"2023-10-14T19:03:54.968158+0000","last_became_peered":"2023-10-14T19:03:54.968158+0000","last_unstale":"2023-10-14T19:03:54.972517+0000","last_undegraded":"2023-10-14T19:03:54.972517+0000","last_fullsized":"2023-10-14T19:03:54.972517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:30.582842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967852+0000","last_change":"2023-10-14T19:03:54.964936+0000","last_active":"2023-10-14T19:03:54.967852+0000","last_peered":"2023-10-14T19:03:54.967852+0000","last_clean":"2023-10-14T19:03:54.967852+0000","last_became_active":"2023-10-14T19:03:54.964669+0000","last_became_peered":"2023-10-14T19:03:54.964669+0000","last_unstale":"2023-10-14T19:03:54.967852+0000","last_undegraded":"2023-10-14T19:03:54.967852+0000","last_fullsized":"2023-10-14T19:03:54.967852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977907+0000","last_change":"2023-10-14T19:03:54.974543+0000","last_active":"2023-10-14T19:03:54.977907+0000","last_peered":"2023-10-14T19:03:54.977907+0000","last_clean":"2023-10-14T19:03:54.977907+0000","last_became_active":"2023-10-14T19:03:54.974298+0000","last_became_peered":"2023-10-14T19:03:54.974298+0000","last_unstale":"2023-10-14T19:03:54.977907+0000","last_undegraded":"2023-10-14T19:03:54.977907+0000","last_fullsized":"2023-10-14T19:03:54.977907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:57:24.099372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979891+0000","last_change":"2023-10-14T19:03:54.978355+0000","last_active":"2023-10-14T19:03:54.979891+0000","last_peered":"2023-10-14T19:03:54.979891+0000","last_clean":"2023-10-14T19:03:54.979891+0000","last_became_active":"2023-10-14T19:03:54.978069+0000","last_became_peered":"2023-10-14T19:03:54.978069+0000","last_unstale":"2023-10-14T19:03:54.979891+0000","last_undegraded":"2023-10-14T19:03:54.979891+0000","last_fullsized":"2023-10-14T19:03:54.979891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.983296+0000","last_change":"2023-10-14T19:03:54.980346+0000","last_active":"2023-10-14T19:03:54.983296+0000","last_peered":"2023-10-14T19:03:54.983296+0000","last_clean":"2023-10-14T19:03:54.983296+0000","last_became_active":"2023-10-14T19:03:54.980027+0000","last_became_peered":"2023-10-14T19:03:54.980027+0000","last_unstale":"2023-10-14T19:03:54.983296+0000","last_undegraded":"2023-10-14T19:03:54.983296+0000","last_fullsized":"2023-10-14T19:03:54.983296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965414+0000","last_change":"2023-10-14T19:03:54.961366+0000","last_active":"2023-10-14T19:03:54.965414+0000","last_peered":"2023-10-14T19:03:54.965414+0000","last_clean":"2023-10-14T19:03:54.965414+0000","last_became_active":"2023-10-14T19:03:54.961076+0000","last_became_peered":"2023-10-14T19:03:54.961076+0000","last_unstale":"2023-10-14T19:03:54.965414+0000","last_undegraded":"2023-10-14T19:03:54.965414+0000","last_fullsized":"2023-10-14T19:03:54.965414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980552+0000","last_change":"2023-10-14T19:03:54.974954+0000","last_active":"2023-10-14T19:03:54.980552+0000","last_peered":"2023-10-14T19:03:54.980552+0000","last_clean":"2023-10-14T19:03:54.980552+0000","last_became_active":"2023-10-14T19:03:54.974480+0000","last_became_peered":"2023-10-14T19:03:54.974480+0000","last_unstale":"2023-10-14T19:03:54.980552+0000","last_undegraded":"2023-10-14T19:03:54.980552+0000","last_fullsized":"2023-10-14T19:03:54.980552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:44.445832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965706+0000","last_change":"2023-10-14T19:03:54.958128+0000","last_active":"2023-10-14T19:03:54.965706+0000","last_peered":"2023-10-14T19:03:54.965706+0000","last_clean":"2023-10-14T19:03:54.965706+0000","last_became_active":"2023-10-14T19:03:54.957843+0000","last_became_peered":"2023-10-14T19:03:54.957843+0000","last_unstale":"2023-10-14T19:03:54.965706+0000","last_undegraded":"2023-10-14T19:03:54.965706+0000","last_fullsized":"2023-10-14T19:03:54.965706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966657+0000","last_change":"2023-10-14T19:03:54.961919+0000","last_active":"2023-10-14T19:03:54.966657+0000","last_peered":"2023-10-14T19:03:54.966657+0000","last_clean":"2023-10-14T19:03:54.966657+0000","last_became_active":"2023-10-14T19:03:54.961088+0000","last_became_peered":"2023-10-14T19:03:54.961088+0000","last_unstale":"2023-10-14T19:03:54.966657+0000","last_undegraded":"2023-10-14T19:03:54.966657+0000","last_fullsized":"2023-10-14T19:03:54.966657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977650+0000","last_change":"2023-10-14T19:03:54.973187+0000","last_active":"2023-10-14T19:03:54.977650+0000","last_peered":"2023-10-14T19:03:54.977650+0000","last_clean":"2023-10-14T19:03:54.977650+0000","last_became_active":"2023-10-14T19:03:54.972754+0000","last_became_peered":"2023-10-14T19:03:54.972754+0000","last_unstale":"2023-10-14T19:03:54.977650+0000","last_undegraded":"2023-10-14T19:03:54.977650+0000","last_fullsized":"2023-10-14T19:03:54.977650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972664+0000","last_change":"2023-10-14T19:03:54.969485+0000","last_active":"2023-10-14T19:03:54.972664+0000","last_peered":"2023-10-14T19:03:54.972664+0000","last_clean":"2023-10-14T19:03:54.972664+0000","last_became_active":"2023-10-14T19:03:54.969231+0000","last_became_peered":"2023-10-14T19:03:54.969231+0000","last_unstale":"2023-10-14T19:03:54.972664+0000","last_undegraded":"2023-10-14T19:03:54.972664+0000","last_fullsized":"2023-10-14T19:03:54.972664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976701+0000","last_change":"2023-10-14T19:03:54.974412+0000","last_active":"2023-10-14T19:03:54.976701+0000","last_peered":"2023-10-14T19:03:54.976701+0000","last_clean":"2023-10-14T19:03:54.976701+0000","last_became_active":"2023-10-14T19:03:54.974130+0000","last_became_peered":"2023-10-14T19:03:54.974130+0000","last_unstale":"2023-10-14T19:03:54.976701+0000","last_undegraded":"2023-10-14T19:03:54.976701+0000","last_fullsized":"2023-10-14T19:03:54.976701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979176+0000","last_change":"2023-10-14T19:03:54.977115+0000","last_active":"2023-10-14T19:03:54.979176+0000","last_peered":"2023-10-14T19:03:54.979176+0000","last_clean":"2023-10-14T19:03:54.979176+0000","last_became_active":"2023-10-14T19:03:54.976848+0000","last_became_peered":"2023-10-14T19:03:54.976848+0000","last_unstale":"2023-10-14T19:03:54.979176+0000","last_undegraded":"2023-10-14T19:03:54.979176+0000","last_fullsized":"2023-10-14T19:03:54.979176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:30.582842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966977+0000","last_change":"2023-10-14T19:03:54.965077+0000","last_active":"2023-10-14T19:03:54.966977+0000","last_peered":"2023-10-14T19:03:54.966977+0000","last_clean":"2023-10-14T19:03:54.966977+0000","last_became_active":"2023-10-14T19:03:54.964803+0000","last_became_peered":"2023-10-14T19:03:54.964803+0000","last_unstale":"2023-10-14T19:03:54.966977+0000","last_undegraded":"2023-10-14T19:03:54.966977+0000","last_fullsized":"2023-10-14T19:03:54.966977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:05.011075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977629+0000","last_change":"2023-10-14T19:03:54.970579+0000","last_active":"2023-10-14T19:03:54.977629+0000","last_peered":"2023-10-14T19:03:54.977629+0000","last_clean":"2023-10-14T19:03:54.977629+0000","last_became_active":"2023-10-14T19:03:54.970269+0000","last_became_peered":"2023-10-14T19:03:54.970269+0000","last_unstale":"2023-10-14T19:03:54.977629+0000","last_undegraded":"2023-10-14T19:03:54.977629+0000","last_fullsized":"2023-10-14T19:03:54.977629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967785+0000","last_change":"2023-10-14T19:03:54.959826+0000","last_active":"2023-10-14T19:03:54.967785+0000","last_peered":"2023-10-14T19:03:54.967785+0000","last_clean":"2023-10-14T19:03:54.967785+0000","last_became_active":"2023-10-14T19:03:54.959525+0000","last_became_peered":"2023-10-14T19:03:54.959525+0000","last_unstale":"2023-10-14T19:03:54.967785+0000","last_undegraded":"2023-10-14T19:03:54.967785+0000","last_fullsized":"2023-10-14T19:03:54.967785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:00:53.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971498+0000","last_change":"2023-10-14T19:03:54.968843+0000","last_active":"2023-10-14T19:03:54.971498+0000","last_peered":"2023-10-14T19:03:54.971498+0000","last_clean":"2023-10-14T19:03:54.971498+0000","last_became_active":"2023-10-14T19:03:54.968567+0000","last_became_peered":"2023-10-14T19:03:54.968567+0000","last_unstale":"2023-10-14T19:03:54.971498+0000","last_undegraded":"2023-10-14T19:03:54.971498+0000","last_fullsized":"2023-10-14T19:03:54.971498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:46.867930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965459+0000","last_change":"2023-10-14T19:03:54.961787+0000","last_active":"2023-10-14T19:03:54.965459+0000","last_peered":"2023-10-14T19:03:54.965459+0000","last_clean":"2023-10-14T19:03:54.965459+0000","last_became_active":"2023-10-14T19:03:54.961561+0000","last_became_peered":"2023-10-14T19:03:54.961561+0000","last_unstale":"2023-10-14T19:03:54.965459+0000","last_undegraded":"2023-10-14T19:03:54.965459+0000","last_fullsized":"2023-10-14T19:03:54.965459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975336+0000","last_change":"2023-10-14T19:03:54.972284+0000","last_active":"2023-10-14T19:03:54.975336+0000","last_peered":"2023-10-14T19:03:54.975336+0000","last_clean":"2023-10-14T19:03:54.975336+0000","last_became_active":"2023-10-14T19:03:54.972015+0000","last_became_peered":"2023-10-14T19:03:54.972015+0000","last_unstale":"2023-10-14T19:03:54.975336+0000","last_undegraded":"2023-10-14T19:03:54.975336+0000","last_fullsized":"2023-10-14T19:03:54.975336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:48.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970895+0000","last_change":"2023-10-14T19:03:54.966444+0000","last_active":"2023-10-14T19:03:54.970895+0000","last_peered":"2023-10-14T19:03:54.970895+0000","last_clean":"2023-10-14T19:03:54.970895+0000","last_became_active":"2023-10-14T19:03:54.966176+0000","last_became_peered":"2023-10-14T19:03:54.966176+0000","last_unstale":"2023-10-14T19:03:54.970895+0000","last_undegraded":"2023-10-14T19:03:54.970895+0000","last_fullsized":"2023-10-14T19:03:54.970895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:18.417288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980552+0000","last_change":"2023-10-14T19:03:54.979276+0000","last_active":"2023-10-14T19:03:54.980552+0000","last_peered":"2023-10-14T19:03:54.980552+0000","last_clean":"2023-10-14T19:03:54.980552+0000","last_became_active":"2023-10-14T19:03:54.978992+0000","last_became_peered":"2023-10-14T19:03:54.978992+0000","last_unstale":"2023-10-14T19:03:54.980552+0000","last_undegraded":"2023-10-14T19:03:54.980552+0000","last_fullsized":"2023-10-14T19:03:54.980552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965433+0000","last_change":"2023-10-14T19:03:54.963040+0000","last_active":"2023-10-14T19:03:54.965433+0000","last_peered":"2023-10-14T19:03:54.965433+0000","last_clean":"2023-10-14T19:03:54.965433+0000","last_became_active":"2023-10-14T19:03:54.962791+0000","last_became_peered":"2023-10-14T19:03:54.962791+0000","last_unstale":"2023-10-14T19:03:54.965433+0000","last_undegraded":"2023-10-14T19:03:54.965433+0000","last_fullsized":"2023-10-14T19:03:54.965433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969862+0000","last_change":"2023-10-14T19:03:54.959358+0000","last_active":"2023-10-14T19:03:54.969862+0000","last_peered":"2023-10-14T19:03:54.969862+0000","last_clean":"2023-10-14T19:03:54.969862+0000","last_became_active":"2023-10-14T19:03:54.959098+0000","last_became_peered":"2023-10-14T19:03:54.959098+0000","last_unstale":"2023-10-14T19:03:54.969862+0000","last_undegraded":"2023-10-14T19:03:54.969862+0000","last_fullsized":"2023-10-14T19:03:54.969862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:04.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972489+0000","last_change":"2023-10-14T19:03:54.968457+0000","last_active":"2023-10-14T19:03:54.972489+0000","last_peered":"2023-10-14T19:03:54.972489+0000","last_clean":"2023-10-14T19:03:54.972489+0000","last_became_active":"2023-10-14T19:03:54.968173+0000","last_became_peered":"2023-10-14T19:03:54.968173+0000","last_unstale":"2023-10-14T19:03:54.972489+0000","last_undegraded":"2023-10-14T19:03:54.972489+0000","last_fullsized":"2023-10-14T19:03:54.972489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:32.176095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963419+0000","last_change":"2023-10-14T19:03:54.958453+0000","last_active":"2023-10-14T19:03:54.963419+0000","last_peered":"2023-10-14T19:03:54.963419+0000","last_clean":"2023-10-14T19:03:54.963419+0000","last_became_active":"2023-10-14T19:03:54.958180+0000","last_became_peered":"2023-10-14T19:03:54.958180+0000","last_unstale":"2023-10-14T19:03:54.963419+0000","last_undegraded":"2023-10-14T19:03:54.963419+0000","last_fullsized":"2023-10-14T19:03:54.963419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:00:53.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977632+0000","last_change":"2023-10-14T19:03:54.972307+0000","last_active":"2023-10-14T19:03:54.977632+0000","last_peered":"2023-10-14T19:03:54.977632+0000","last_clean":"2023-10-14T19:03:54.977632+0000","last_became_active":"2023-10-14T19:03:54.971972+0000","last_became_peered":"2023-10-14T19:03:54.971972+0000","last_unstale":"2023-10-14T19:03:54.977632+0000","last_undegraded":"2023-10-14T19:03:54.977632+0000","last_fullsized":"2023-10-14T19:03:54.977632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971395+0000","last_change":"2023-10-14T19:03:54.968757+0000","last_active":"2023-10-14T19:03:54.971395+0000","last_peered":"2023-10-14T19:03:54.971395+0000","last_clean":"2023-10-14T19:03:54.971395+0000","last_became_active":"2023-10-14T19:03:54.968462+0000","last_became_peered":"2023-10-14T19:03:54.968462+0000","last_unstale":"2023-10-14T19:03:54.971395+0000","last_undegraded":"2023-10-14T19:03:54.971395+0000","last_fullsized":"2023-10-14T19:03:54.971395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.968175+0000","last_change":"2023-10-14T19:03:53.938414+0000","last_active":"2023-10-14T19:03:54.968175+0000","last_peered":"2023-10-14T19:03:54.968175+0000","last_clean":"2023-10-14T19:03:54.968175+0000","last_became_active":"2023-10-14T19:03:53.938118+0000","last_became_peered":"2023-10-14T19:03:53.938118+0000","last_unstale":"2023-10-14T19:03:54.968175+0000","last_undegraded":"2023-10-14T19:03:54.968175+0000","last_fullsized":"2023-10-14T19:03:54.968175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.973391+0000","last_change":"2023-10-14T19:03:54.969609+0000","last_active":"2023-10-14T19:03:54.973391+0000","last_peered":"2023-10-14T19:03:54.973391+0000","last_clean":"2023-10-14T19:03:54.973391+0000","last_became_active":"2023-10-14T19:03:54.969323+0000","last_became_peered":"2023-10-14T19:03:54.969323+0000","last_unstale":"2023-10-14T19:03:54.973391+0000","last_undegraded":"2023-10-14T19:03:54.973391+0000","last_fullsized":"2023-10-14T19:03:54.973391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974713+0000","last_change":"2023-10-14T19:03:53.934075+0000","last_active":"2023-10-14T19:03:54.974713+0000","last_peered":"2023-10-14T19:03:54.974713+0000","last_clean":"2023-10-14T19:03:54.974713+0000","last_became_active":"2023-10-14T19:03:53.933765+0000","last_became_peered":"2023-10-14T19:03:53.933765+0000","last_unstale":"2023-10-14T19:03:54.974713+0000","last_undegraded":"2023-10-14T19:03:54.974713+0000","last_fullsized":"2023-10-14T19:03:54.974713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967813+0000","last_change":"2023-10-14T19:03:54.961630+0000","last_active":"2023-10-14T19:03:54.967813+0000","last_peered":"2023-10-14T19:03:54.967813+0000","last_clean":"2023-10-14T19:03:54.967813+0000","last_became_active":"2023-10-14T19:03:54.961383+0000","last_became_peered":"2023-10-14T19:03:54.961383+0000","last_unstale":"2023-10-14T19:03:54.967813+0000","last_undegraded":"2023-10-14T19:03:54.967813+0000","last_fullsized":"2023-10-14T19:03:54.967813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976605+0000","last_change":"2023-10-14T19:03:53.941920+0000","last_active":"2023-10-14T19:03:54.976605+0000","last_peered":"2023-10-14T19:03:54.976605+0000","last_clean":"2023-10-14T19:03:54.976605+0000","last_became_active":"2023-10-14T19:03:53.941656+0000","last_became_peered":"2023-10-14T19:03:53.941656+0000","last_unstale":"2023-10-14T19:03:54.976605+0000","last_undegraded":"2023-10-14T19:03:54.976605+0000","last_fullsized":"2023-10-14T19:03:54.976605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:14.749737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979923+0000","last_change":"2023-10-14T19:03:54.979145+0000","last_active":"2023-10-14T19:03:54.979923+0000","last_peered":"2023-10-14T19:03:54.979923+0000","last_clean":"2023-10-14T19:03:54.979923+0000","last_became_active":"2023-10-14T19:03:54.978677+0000","last_became_peered":"2023-10-14T19:03:54.978677+0000","last_unstale":"2023-10-14T19:03:54.979923+0000","last_undegraded":"2023-10-14T19:03:54.979923+0000","last_fullsized":"2023-10-14T19:03:54.979923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:57:24.099372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.957715+0000","last_change":"2023-10-14T19:03:53.929740+0000","last_active":"2023-10-14T19:03:54.957715+0000","last_peered":"2023-10-14T19:03:54.957715+0000","last_clean":"2023-10-14T19:03:54.957715+0000","last_became_active":"2023-10-14T19:03:53.929456+0000","last_became_peered":"2023-10-14T19:03:53.929456+0000","last_unstale":"2023-10-14T19:03:54.957715+0000","last_undegraded":"2023-10-14T19:03:54.957715+0000","last_fullsized":"2023-10-14T19:03:54.957715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:46.800352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975037+0000","last_change":"2023-10-14T19:03:54.971564+0000","last_active":"2023-10-14T19:03:54.975037+0000","last_peered":"2023-10-14T19:03:54.975037+0000","last_clean":"2023-10-14T19:03:54.975037+0000","last_became_active":"2023-10-14T19:03:54.971198+0000","last_became_peered":"2023-10-14T19:03:54.971198+0000","last_unstale":"2023-10-14T19:03:54.975037+0000","last_undegraded":"2023-10-14T19:03:54.975037+0000","last_fullsized":"2023-10-14T19:03:54.975037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969892+0000","last_change":"2023-10-14T19:03:53.934830+0000","last_active":"2023-10-14T19:03:54.969892+0000","last_peered":"2023-10-14T19:03:54.969892+0000","last_clean":"2023-10-14T19:03:54.969892+0000","last_became_active":"2023-10-14T19:03:53.934166+0000","last_became_peered":"2023-10-14T19:03:53.934166+0000","last_unstale":"2023-10-14T19:03:54.969892+0000","last_undegraded":"2023-10-14T19:03:54.969892+0000","last_fullsized":"2023-10-14T19:03:54.969892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:43.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977377+0000","last_change":"2023-10-14T19:03:54.971536+0000","last_active":"2023-10-14T19:03:54.977377+0000","last_peered":"2023-10-14T19:03:54.977377+0000","last_clean":"2023-10-14T19:03:54.977377+0000","last_became_active":"2023-10-14T19:03:54.971240+0000","last_became_peered":"2023-10-14T19:03:54.971240+0000","last_unstale":"2023-10-14T19:03:54.977377+0000","last_undegraded":"2023-10-14T19:03:54.977377+0000","last_fullsized":"2023-10-14T19:03:54.977377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966381+0000","last_change":"2023-10-14T19:03:53.933946+0000","last_active":"2023-10-14T19:03:54.966381+0000","last_peered":"2023-10-14T19:03:54.966381+0000","last_clean":"2023-10-14T19:03:54.966381+0000","last_became_active":"2023-10-14T19:03:53.933656+0000","last_became_peered":"2023-10-14T19:03:53.933656+0000","last_unstale":"2023-10-14T19:03:54.966381+0000","last_undegraded":"2023-10-14T19:03:54.966381+0000","last_fullsized":"2023-10-14T19:03:54.966381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:22.618256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963254+0000","last_change":"2023-10-14T19:03:54.954930+0000","last_active":"2023-10-14T19:03:54.963254+0000","last_peered":"2023-10-14T19:03:54.963254+0000","last_clean":"2023-10-14T19:03:54.963254+0000","last_became_active":"2023-10-14T19:03:54.954689+0000","last_became_peered":"2023-10-14T19:03:54.954689+0000","last_unstale":"2023-10-14T19:03:54.963254+0000","last_undegraded":"2023-10-14T19:03:54.963254+0000","last_fullsized":"2023-10-14T19:03:54.963254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947784+0000","last_change":"2023-10-14T19:03:53.937049+0000","last_active":"2023-10-14T19:03:54.947784+0000","last_peered":"2023-10-14T19:03:54.947784+0000","last_clean":"2023-10-14T19:03:54.947784+0000","last_became_active":"2023-10-14T19:03:53.936834+0000","last_became_peered":"2023-10-14T19:03:53.936834+0000","last_unstale":"2023-10-14T19:03:54.947784+0000","last_undegraded":"2023-10-14T19:03:54.947784+0000","last_fullsized":"2023-10-14T19:03:54.947784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:37.508875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974585+0000","last_change":"2023-10-14T19:03:54.972421+0000","last_active":"2023-10-14T19:03:54.974585+0000","last_peered":"2023-10-14T19:03:54.974585+0000","last_clean":"2023-10-14T19:03:54.974585+0000","last_became_active":"2023-10-14T19:03:54.970191+0000","last_became_peered":"2023-10-14T19:03:54.970191+0000","last_unstale":"2023-10-14T19:03:54.974585+0000","last_undegraded":"2023-10-14T19:03:54.974585+0000","last_fullsized":"2023-10-14T19:03:54.974585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:43.294272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950419+0000","last_change":"2023-10-14T19:03:53.932989+0000","last_active":"2023-10-14T19:03:54.950419+0000","last_peered":"2023-10-14T19:03:54.950419+0000","last_clean":"2023-10-14T19:03:54.950419+0000","last_became_active":"2023-10-14T19:03:53.932698+0000","last_became_peered":"2023-10-14T19:03:53.932698+0000","last_unstale":"2023-10-14T19:03:54.950419+0000","last_undegraded":"2023-10-14T19:03:54.950419+0000","last_fullsized":"2023-10-14T19:03:54.950419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:43.931855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965613+0000","last_change":"2023-10-14T19:03:54.961354+0000","last_active":"2023-10-14T19:03:54.965613+0000","last_peered":"2023-10-14T19:03:54.965613+0000","last_clean":"2023-10-14T19:03:54.965613+0000","last_became_active":"2023-10-14T19:03:54.961058+0000","last_became_peered":"2023-10-14T19:03:54.961058+0000","last_unstale":"2023-10-14T19:03:54.965613+0000","last_undegraded":"2023-10-14T19:03:54.965613+0000","last_fullsized":"2023-10-14T19:03:54.965613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.948311+0000","last_change":"2023-10-14T19:03:53.940701+0000","last_active":"2023-10-14T19:03:54.948311+0000","last_peered":"2023-10-14T19:03:54.948311+0000","last_clean":"2023-10-14T19:03:54.948311+0000","last_became_active":"2023-10-14T19:03:53.940428+0000","last_became_peered":"2023-10-14T19:03:53.940428+0000","last_unstale":"2023-10-14T19:03:54.948311+0000","last_undegraded":"2023-10-14T19:03:54.948311+0000","last_fullsized":"2023-10-14T19:03:54.948311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:13:14.209007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977261+0000","last_change":"2023-10-14T19:03:54.975517+0000","last_active":"2023-10-14T19:03:54.977261+0000","last_peered":"2023-10-14T19:03:54.977261+0000","last_clean":"2023-10-14T19:03:54.977261+0000","last_became_active":"2023-10-14T19:03:54.975244+0000","last_became_peered":"2023-10-14T19:03:54.975244+0000","last_unstale":"2023-10-14T19:03:54.977261+0000","last_undegraded":"2023-10-14T19:03:54.977261+0000","last_fullsized":"2023-10-14T19:03:54.977261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.958501+0000","last_change":"2023-10-14T19:03:53.939672+0000","last_active":"2023-10-14T19:03:54.958501+0000","last_peered":"2023-10-14T19:03:54.958501+0000","last_clean":"2023-10-14T19:03:54.958501+0000","last_became_active":"2023-10-14T19:03:53.939343+0000","last_became_peered":"2023-10-14T19:03:53.939343+0000","last_unstale":"2023-10-14T19:03:54.958501+0000","last_undegraded":"2023-10-14T19:03:54.958501+0000","last_fullsized":"2023-10-14T19:03:54.958501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970270+0000","last_change":"2023-10-14T19:03:54.966074+0000","last_active":"2023-10-14T19:03:54.970270+0000","last_peered":"2023-10-14T19:03:54.970270+0000","last_clean":"2023-10-14T19:03:54.970270+0000","last_became_active":"2023-10-14T19:03:54.965793+0000","last_became_peered":"2023-10-14T19:03:54.965793+0000","last_unstale":"2023-10-14T19:03:54.970270+0000","last_undegraded":"2023-10-14T19:03:54.970270+0000","last_fullsized":"2023-10-14T19:03:54.970270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:50.814259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966136+0000","last_change":"2023-10-14T19:03:53.937854+0000","last_active":"2023-10-14T19:03:54.966136+0000","last_peered":"2023-10-14T19:03:54.966136+0000","last_clean":"2023-10-14T19:03:54.966136+0000","last_became_active":"2023-10-14T19:03:53.937577+0000","last_became_peered":"2023-10-14T19:03:53.937577+0000","last_unstale":"2023-10-14T19:03:54.966136+0000","last_undegraded":"2023-10-14T19:03:54.966136+0000","last_fullsized":"2023-10-14T19:03:54.966136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:41.140204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980092+0000","last_change":"2023-10-14T19:03:54.976558+0000","last_active":"2023-10-14T19:03:54.980092+0000","last_peered":"2023-10-14T19:03:54.980092+0000","last_clean":"2023-10-14T19:03:54.980092+0000","last_became_active":"2023-10-14T19:03:54.976269+0000","last_became_peered":"2023-10-14T19:03:54.976269+0000","last_unstale":"2023-10-14T19:03:54.980092+0000","last_undegraded":"2023-10-14T19:03:54.980092+0000","last_fullsized":"2023-10-14T19:03:54.980092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:50.814259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.982318+0000","last_change":"2023-10-14T19:03:53.942558+0000","last_active":"2023-10-14T19:03:54.982318+0000","last_peered":"2023-10-14T19:03:54.982318+0000","last_clean":"2023-10-14T19:03:54.982318+0000","last_became_active":"2023-10-14T19:03:53.942272+0000","last_became_peered":"2023-10-14T19:03:53.942272+0000","last_unstale":"2023-10-14T19:03:54.982318+0000","last_undegraded":"2023-10-14T19:03:54.982318+0000","last_fullsized":"2023-10-14T19:03:54.982318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:41.140204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974554+0000","last_change":"2023-10-14T19:03:54.971970+0000","last_active":"2023-10-14T19:03:54.974554+0000","last_peered":"2023-10-14T19:03:54.974554+0000","last_clean":"2023-10-14T19:03:54.974554+0000","last_became_active":"2023-10-14T19:03:54.970108+0000","last_became_peered":"2023-10-14T19:03:54.970108+0000","last_unstale":"2023-10-14T19:03:54.974554+0000","last_undegraded":"2023-10-14T19:03:54.974554+0000","last_fullsized":"2023-10-14T19:03:54.974554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:32.176095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970028+0000","last_change":"2023-10-14T19:03:53.938546+0000","last_active":"2023-10-14T19:03:54.970028+0000","last_peered":"2023-10-14T19:03:54.970028+0000","last_clean":"2023-10-14T19:03:54.970028+0000","last_became_active":"2023-10-14T19:03:53.938208+0000","last_became_peered":"2023-10-14T19:03:53.938208+0000","last_unstale":"2023-10-14T19:03:54.970028+0000","last_undegraded":"2023-10-14T19:03:54.970028+0000","last_fullsized":"2023-10-14T19:03:54.970028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:39.636536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971900+0000","last_change":"2023-10-14T19:03:54.970510+0000","last_active":"2023-10-14T19:03:54.971900+0000","last_peered":"2023-10-14T19:03:54.971900+0000","last_clean":"2023-10-14T19:03:54.971900+0000","last_became_active":"2023-10-14T19:03:54.970240+0000","last_became_peered":"2023-10-14T19:03:54.970240+0000","last_unstale":"2023-10-14T19:03:54.971900+0000","last_undegraded":"2023-10-14T19:03:54.971900+0000","last_fullsized":"2023-10-14T19:03:54.971900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970175+0000","last_change":"2023-10-14T19:03:53.937706+0000","last_active":"2023-10-14T19:03:54.970175+0000","last_peered":"2023-10-14T19:03:54.970175+0000","last_clean":"2023-10-14T19:03:54.970175+0000","last_became_active":"2023-10-14T19:03:53.937443+0000","last_became_peered":"2023-10-14T19:03:53.937443+0000","last_unstale":"2023-10-14T19:03:54.970175+0000","last_undegraded":"2023-10-14T19:03:54.970175+0000","last_fullsized":"2023-10-14T19:03:54.970175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977609+0000","last_change":"2023-10-14T19:03:54.972267+0000","last_active":"2023-10-14T19:03:54.977609+0000","last_peered":"2023-10-14T19:03:54.977609+0000","last_clean":"2023-10-14T19:03:54.977609+0000","last_became_active":"2023-10-14T19:03:54.971632+0000","last_became_peered":"2023-10-14T19:03:54.971632+0000","last_unstale":"2023-10-14T19:03:54.977609+0000","last_undegraded":"2023-10-14T19:03:54.977609+0000","last_fullsized":"2023-10-14T19:03:54.977609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947801+0000","last_change":"2023-10-14T19:03:53.940727+0000","last_active":"2023-10-14T19:03:54.947801+0000","last_peered":"2023-10-14T19:03:54.947801+0000","last_clean":"2023-10-14T19:03:54.947801+0000","last_became_active":"2023-10-14T19:03:53.940465+0000","last_became_peered":"2023-10-14T19:03:53.940465+0000","last_unstale":"2023-10-14T19:03:54.947801+0000","last_undegraded":"2023-10-14T19:03:54.947801+0000","last_fullsized":"2023-10-14T19:03:54.947801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:45.865946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967741+0000","last_change":"2023-10-14T19:03:54.961292+0000","last_active":"2023-10-14T19:03:54.967741+0000","last_peered":"2023-10-14T19:03:54.967741+0000","last_clean":"2023-10-14T19:03:54.967741+0000","last_became_active":"2023-10-14T19:03:54.961000+0000","last_became_peered":"2023-10-14T19:03:54.961000+0000","last_unstale":"2023-10-14T19:03:54.967741+0000","last_undegraded":"2023-10-14T19:03:54.967741+0000","last_fullsized":"2023-10-14T19:03:54.967741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:04.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.978155+0000","last_change":"2023-10-14T19:03:53.942705+0000","last_active":"2023-10-14T19:03:54.978155+0000","last_peered":"2023-10-14T19:03:54.978155+0000","last_clean":"2023-10-14T19:03:54.978155+0000","last_became_active":"2023-10-14T19:03:53.942426+0000","last_became_peered":"2023-10-14T19:03:53.942426+0000","last_unstale":"2023-10-14T19:03:54.978155+0000","last_undegraded":"2023-10-14T19:03:54.978155+0000","last_fullsized":"2023-10-14T19:03:54.978155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:44.851605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975197+0000","last_change":"2023-10-14T19:03:54.969515+0000","last_active":"2023-10-14T19:03:54.975197+0000","last_peered":"2023-10-14T19:03:54.975197+0000","last_clean":"2023-10-14T19:03:54.975197+0000","last_became_active":"2023-10-14T19:03:54.969124+0000","last_became_peered":"2023-10-14T19:03:54.969124+0000","last_unstale":"2023-10-14T19:03:54.975197+0000","last_undegraded":"2023-10-14T19:03:54.975197+0000","last_fullsized":"2023-10-14T19:03:54.975197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977700+0000","last_change":"2023-10-14T19:03:53.942226+0000","last_active":"2023-10-14T19:03:54.977700+0000","last_peered":"2023-10-14T19:03:54.977700+0000","last_clean":"2023-10-14T19:03:54.977700+0000","last_became_active":"2023-10-14T19:03:53.941478+0000","last_became_peered":"2023-10-14T19:03:53.941478+0000","last_unstale":"2023-10-14T19:03:54.977700+0000","last_undegraded":"2023-10-14T19:03:54.977700+0000","last_fullsized":"2023-10-14T19:03:54.977700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966876+0000","last_change":"2023-10-14T19:03:54.963700+0000","last_active":"2023-10-14T19:03:54.966876+0000","last_peered":"2023-10-14T19:03:54.966876+0000","last_clean":"2023-10-14T19:03:54.966876+0000","last_became_active":"2023-10-14T19:03:54.963445+0000","last_became_peered":"2023-10-14T19:03:54.963445+0000","last_unstale":"2023-10-14T19:03:54.966876+0000","last_undegraded":"2023-10-14T19:03:54.966876+0000","last_fullsized":"2023-10-14T19:03:54.966876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969403+0000","last_change":"2023-10-14T19:03:53.932938+0000","last_active":"2023-10-14T19:03:54.969403+0000","last_peered":"2023-10-14T19:03:54.969403+0000","last_clean":"2023-10-14T19:03:54.969403+0000","last_became_active":"2023-10-14T19:03:53.932654+0000","last_became_peered":"2023-10-14T19:03:53.932654+0000","last_unstale":"2023-10-14T19:03:54.969403+0000","last_undegraded":"2023-10-14T19:03:54.969403+0000","last_fullsized":"2023-10-14T19:03:54.969403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:26.758367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979929+0000","last_change":"2023-10-14T19:03:54.978677+0000","last_active":"2023-10-14T19:03:54.979929+0000","last_peered":"2023-10-14T19:03:54.979929+0000","last_clean":"2023-10-14T19:03:54.979929+0000","last_became_active":"2023-10-14T19:03:54.978349+0000","last_became_peered":"2023-10-14T19:03:54.978349+0000","last_unstale":"2023-10-14T19:03:54.979929+0000","last_undegraded":"2023-10-14T19:03:54.979929+0000","last_fullsized":"2023-10-14T19:03:54.979929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:01.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966393+0000","last_change":"2023-10-14T19:03:53.930784+0000","last_active":"2023-10-14T19:03:54.966393+0000","last_peered":"2023-10-14T19:03:54.966393+0000","last_clean":"2023-10-14T19:03:54.966393+0000","last_became_active":"2023-10-14T19:03:53.930491+0000","last_became_peered":"2023-10-14T19:03:53.930491+0000","last_unstale":"2023-10-14T19:03:54.966393+0000","last_undegraded":"2023-10-14T19:03:54.966393+0000","last_fullsized":"2023-10-14T19:03:54.966393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:23.513627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970934+0000","last_change":"2023-10-14T19:03:54.969099+0000","last_active":"2023-10-14T19:03:54.970934+0000","last_peered":"2023-10-14T19:03:54.970934+0000","last_clean":"2023-10-14T19:03:54.970934+0000","last_became_active":"2023-10-14T19:03:54.968829+0000","last_became_peered":"2023-10-14T19:03:54.968829+0000","last_unstale":"2023-10-14T19:03:54.970934+0000","last_undegraded":"2023-10-14T19:03:54.970934+0000","last_fullsized":"2023-10-14T19:03:54.970934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:34.986850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.951255+0000","last_change":"2023-10-14T19:03:53.940717+0000","last_active":"2023-10-14T19:03:54.951255+0000","last_peered":"2023-10-14T19:03:54.951255+0000","last_clean":"2023-10-14T19:03:54.951255+0000","last_became_active":"2023-10-14T19:03:53.940375+0000","last_became_peered":"2023-10-14T19:03:53.940375+0000","last_unstale":"2023-10-14T19:03:54.951255+0000","last_undegraded":"2023-10-14T19:03:54.951255+0000","last_fullsized":"2023-10-14T19:03:54.951255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:54.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963220+0000","last_change":"2023-10-14T19:03:54.961261+0000","last_active":"2023-10-14T19:03:54.963220+0000","last_peered":"2023-10-14T19:03:54.963220+0000","last_clean":"2023-10-14T19:03:54.963220+0000","last_became_active":"2023-10-14T19:03:54.960605+0000","last_became_peered":"2023-10-14T19:03:54.960605+0000","last_unstale":"2023-10-14T19:03:54.963220+0000","last_undegraded":"2023-10-14T19:03:54.963220+0000","last_fullsized":"2023-10-14T19:03:54.963220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:23.620241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979233+0000","last_change":"2023-10-14T19:03:53.941991+0000","last_active":"2023-10-14T19:03:54.979233+0000","last_peered":"2023-10-14T19:03:54.979233+0000","last_clean":"2023-10-14T19:03:54.979233+0000","last_became_active":"2023-10-14T19:03:53.941742+0000","last_became_peered":"2023-10-14T19:03:53.941742+0000","last_unstale":"2023-10-14T19:03:54.979233+0000","last_undegraded":"2023-10-14T19:03:54.979233+0000","last_fullsized":"2023-10-14T19:03:54.979233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:54.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980536+0000","last_change":"2023-10-14T19:03:54.974751+0000","last_active":"2023-10-14T19:03:54.980536+0000","last_peered":"2023-10-14T19:03:54.980536+0000","last_clean":"2023-10-14T19:03:54.980536+0000","last_became_active":"2023-10-14T19:03:54.974115+0000","last_became_peered":"2023-10-14T19:03:54.974115+0000","last_unstale":"2023-10-14T19:03:54.980536+0000","last_undegraded":"2023-10-14T19:03:54.980536+0000","last_fullsized":"2023-10-14T19:03:54.980536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:41.312433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.954244+0000","last_change":"2023-10-14T19:03:53.939613+0000","last_active":"2023-10-14T19:03:54.954244+0000","last_peered":"2023-10-14T19:03:54.954244+0000","last_clean":"2023-10-14T19:03:54.954244+0000","last_became_active":"2023-10-14T19:03:53.939341+0000","last_became_peered":"2023-10-14T19:03:53.939341+0000","last_unstale":"2023-10-14T19:03:54.954244+0000","last_undegraded":"2023-10-14T19:03:54.954244+0000","last_fullsized":"2023-10-14T19:03:54.954244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969573+0000","last_change":"2023-10-14T19:03:54.967042+0000","last_active":"2023-10-14T19:03:54.969573+0000","last_peered":"2023-10-14T19:03:54.969573+0000","last_clean":"2023-10-14T19:03:54.969573+0000","last_became_active":"2023-10-14T19:03:54.966582+0000","last_became_peered":"2023-10-14T19:03:54.966582+0000","last_unstale":"2023-10-14T19:03:54.969573+0000","last_undegraded":"2023-10-14T19:03:54.969573+0000","last_fullsized":"2023-10-14T19:03:54.969573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:40.638520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950576+0000","last_change":"2023-10-14T19:03:53.935002+0000","last_active":"2023-10-14T19:03:54.950576+0000","last_peered":"2023-10-14T19:03:54.950576+0000","last_clean":"2023-10-14T19:03:54.950576+0000","last_became_active":"2023-10-14T19:03:53.934342+0000","last_became_peered":"2023-10-14T19:03:53.934342+0000","last_unstale":"2023-10-14T19:03:54.950576+0000","last_undegraded":"2023-10-14T19:03:54.950576+0000","last_fullsized":"2023-10-14T19:03:54.950576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:33.984865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977681+0000","last_change":"2023-10-14T19:03:54.973962+0000","last_active":"2023-10-14T19:03:54.977681+0000","last_peered":"2023-10-14T19:03:54.977681+0000","last_clean":"2023-10-14T19:03:54.977681+0000","last_became_active":"2023-10-14T19:03:54.973709+0000","last_became_peered":"2023-10-14T19:03:54.973709+0000","last_unstale":"2023-10-14T19:03:54.977681+0000","last_undegraded":"2023-10-14T19:03:54.977681+0000","last_fullsized":"2023-10-14T19:03:54.977681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.955697+0000","last_change":"2023-10-14T19:03:53.939589+0000","last_active":"2023-10-14T19:03:54.955697+0000","last_peered":"2023-10-14T19:03:54.955697+0000","last_clean":"2023-10-14T19:03:54.955697+0000","last_became_active":"2023-10-14T19:03:53.939322+0000","last_became_peered":"2023-10-14T19:03:53.939322+0000","last_unstale":"2023-10-14T19:03:54.955697+0000","last_undegraded":"2023-10-14T19:03:54.955697+0000","last_fullsized":"2023-10-14T19:03:54.955697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:37.508875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967694+0000","last_change":"2023-10-14T19:03:54.966771+0000","last_active":"2023-10-14T19:03:54.967694+0000","last_peered":"2023-10-14T19:03:54.967694+0000","last_clean":"2023-10-14T19:03:54.967694+0000","last_became_active":"2023-10-14T19:03:54.966456+0000","last_became_peered":"2023-10-14T19:03:54.966456+0000","last_unstale":"2023-10-14T19:03:54.967694+0000","last_undegraded":"2023-10-14T19:03:54.967694+0000","last_fullsized":"2023-10-14T19:03:54.967694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:55.887418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979939+0000","last_change":"2023-10-14T19:03:53.937224+0000","last_active":"2023-10-14T19:03:54.979939+0000","last_peered":"2023-10-14T19:03:54.979939+0000","last_clean":"2023-10-14T19:03:54.979939+0000","last_became_active":"2023-10-14T19:03:53.936906+0000","last_became_peered":"2023-10-14T19:03:53.936906+0000","last_unstale":"2023-10-14T19:03:54.979939+0000","last_undegraded":"2023-10-14T19:03:54.979939+0000","last_fullsized":"2023-10-14T19:03:54.979939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977449+0000","last_change":"2023-10-14T19:03:54.972347+0000","last_active":"2023-10-14T19:03:54.977449+0000","last_peered":"2023-10-14T19:03:54.977449+0000","last_clean":"2023-10-14T19:03:54.977449+0000","last_became_active":"2023-10-14T19:03:54.971682+0000","last_became_peered":"2023-10-14T19:03:54.971682+0000","last_unstale":"2023-10-14T19:03:54.977449+0000","last_undegraded":"2023-10-14T19:03:54.977449+0000","last_fullsized":"2023-10-14T19:03:54.977449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:18.417288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T19:03:55.966704+0000","last_change":"2023-10-14T19:03:53.941915+0000","last_active":"2023-10-14T19:03:55.966704+0000","last_peered":"2023-10-14T19:03:55.966704+0000","last_clean":"2023-10-14T19:03:55.966704+0000","last_became_active":"2023-10-14T19:03:53.941632+0000","last_became_peered":"2023-10-14T19:03:53.941632+0000","last_unstale":"2023-10-14T19:03:55.966704+0000","last_undegraded":"2023-10-14T19:03:55.966704+0000","last_fullsized":"2023-10-14T19:03:55.966704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980529+0000","last_change":"2023-10-14T19:03:54.978101+0000","last_active":"2023-10-14T19:03:54.980529+0000","last_peered":"2023-10-14T19:03:54.980529+0000","last_clean":"2023-10-14T19:03:54.980529+0000","last_became_active":"2023-10-14T19:03:54.975814+0000","last_became_peered":"2023-10-14T19:03:54.975814+0000","last_unstale":"2023-10-14T19:03:54.980529+0000","last_undegraded":"2023-10-14T19:03:54.980529+0000","last_fullsized":"2023-10-14T19:03:54.980529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965681+0000","last_change":"2023-10-14T19:03:53.933680+0000","last_active":"2023-10-14T19:03:54.965681+0000","last_peered":"2023-10-14T19:03:54.965681+0000","last_clean":"2023-10-14T19:03:54.965681+0000","last_became_active":"2023-10-14T19:03:53.933390+0000","last_became_peered":"2023-10-14T19:03:53.933390+0000","last_unstale":"2023-10-14T19:03:54.965681+0000","last_undegraded":"2023-10-14T19:03:54.965681+0000","last_fullsized":"2023-10-14T19:03:54.965681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:14.749737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972981+0000","last_change":"2023-10-14T19:03:54.968739+0000","last_active":"2023-10-14T19:03:54.972981+0000","last_peered":"2023-10-14T19:03:54.972981+0000","last_clean":"2023-10-14T19:03:54.972981+0000","last_became_active":"2023-10-14T19:03:54.968425+0000","last_became_peered":"2023-10-14T19:03:54.968425+0000","last_unstale":"2023-10-14T19:03:54.972981+0000","last_undegraded":"2023-10-14T19:03:54.972981+0000","last_fullsized":"2023-10-14T19:03:54.972981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.960092+0000","last_change":"2023-10-14T19:03:53.936231+0000","last_active":"2023-10-14T19:03:54.960092+0000","last_peered":"2023-10-14T19:03:54.960092+0000","last_clean":"2023-10-14T19:03:54.960092+0000","last_became_active":"2023-10-14T19:03:53.935966+0000","last_became_peered":"2023-10-14T19:03:53.935966+0000","last_unstale":"2023-10-14T19:03:54.960092+0000","last_undegraded":"2023-10-14T19:03:54.960092+0000","last_fullsized":"2023-10-14T19:03:54.960092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:22.618256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971770+0000","last_change":"2023-10-14T19:03:54.969820+0000","last_active":"2023-10-14T19:03:54.971770+0000","last_peered":"2023-10-14T19:03:54.971770+0000","last_clean":"2023-10-14T19:03:54.971770+0000","last_became_active":"2023-10-14T19:03:54.969457+0000","last_became_peered":"2023-10-14T19:03:54.969457+0000","last_unstale":"2023-10-14T19:03:54.971770+0000","last_undegraded":"2023-10-14T19:03:54.971770+0000","last_fullsized":"2023-10-14T19:03:54.971770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965460+0000","last_change":"2023-10-14T19:03:53.936109+0000","last_active":"2023-10-14T19:03:54.965460+0000","last_peered":"2023-10-14T19:03:54.965460+0000","last_clean":"2023-10-14T19:03:54.965460+0000","last_became_active":"2023-10-14T19:03:53.935804+0000","last_became_peered":"2023-10-14T19:03:53.935804+0000","last_unstale":"2023-10-14T19:03:54.965460+0000","last_undegraded":"2023-10-14T19:03:54.965460+0000","last_fullsized":"2023-10-14T19:03:54.965460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:13:14.209007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976861+0000","last_change":"2023-10-14T19:03:54.974912+0000","last_active":"2023-10-14T19:03:54.976861+0000","last_peered":"2023-10-14T19:03:54.976861+0000","last_clean":"2023-10-14T19:03:54.976861+0000","last_became_active":"2023-10-14T19:03:54.974654+0000","last_became_peered":"2023-10-14T19:03:54.974654+0000","last_unstale":"2023-10-14T19:03:54.976861+0000","last_undegraded":"2023-10-14T19:03:54.976861+0000","last_fullsized":"2023-10-14T19:03:54.976861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950687+0000","last_change":"2023-10-14T19:03:53.935058+0000","last_active":"2023-10-14T19:03:54.950687+0000","last_peered":"2023-10-14T19:03:54.950687+0000","last_clean":"2023-10-14T19:03:54.950687+0000","last_became_active":"2023-10-14T19:03:53.934116+0000","last_became_peered":"2023-10-14T19:03:53.934116+0000","last_unstale":"2023-10-14T19:03:54.950687+0000","last_undegraded":"2023-10-14T19:03:54.950687+0000","last_fullsized":"2023-10-14T19:03:54.950687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:03.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966612+0000","last_change":"2023-10-14T19:03:54.958822+0000","last_active":"2023-10-14T19:03:54.966612+0000","last_peered":"2023-10-14T19:03:54.966612+0000","last_clean":"2023-10-14T19:03:54.966612+0000","last_became_active":"2023-10-14T19:03:54.958568+0000","last_became_peered":"2023-10-14T19:03:54.958568+0000","last_unstale":"2023-10-14T19:03:54.966612+0000","last_undegraded":"2023-10-14T19:03:54.966612+0000","last_fullsized":"2023-10-14T19:03:54.966612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:43.294272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947921+0000","last_change":"2023-10-14T19:03:53.939493+0000","last_active":"2023-10-14T19:03:54.947921+0000","last_peered":"2023-10-14T19:03:54.947921+0000","last_clean":"2023-10-14T19:03:54.947921+0000","last_became_active":"2023-10-14T19:03:53.939228+0000","last_became_peered":"2023-10-14T19:03:53.939228+0000","last_unstale":"2023-10-14T19:03:54.947921+0000","last_undegraded":"2023-10-14T19:03:54.947921+0000","last_fullsized":"2023-10-14T19:03:54.947921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:24.037397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971926+0000","last_change":"2023-10-14T19:03:54.966591+0000","last_active":"2023-10-14T19:03:54.971926+0000","last_peered":"2023-10-14T19:03:54.971926+0000","last_clean":"2023-10-14T19:03:54.971926+0000","last_became_active":"2023-10-14T19:03:54.966352+0000","last_became_peered":"2023-10-14T19:03:54.966352+0000","last_unstale":"2023-10-14T19:03:54.971926+0000","last_undegraded":"2023-10-14T19:03:54.971926+0000","last_fullsized":"2023-10-14T19:03:54.971926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:01.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.957209+0000","last_change":"2023-10-14T19:03:53.939366+0000","last_active":"2023-10-14T19:03:54.957209+0000","last_peered":"2023-10-14T19:03:54.957209+0000","last_clean":"2023-10-14T19:03:54.957209+0000","last_became_active":"2023-10-14T19:03:53.939051+0000","last_became_peered":"2023-10-14T19:03:53.939051+0000","last_unstale":"2023-10-14T19:03:54.957209+0000","last_undegraded":"2023-10-14T19:03:54.957209+0000","last_fullsized":"2023-10-14T19:03:54.957209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963679+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:54.963679+0000","last_peered":"2023-10-14T19:03:54.963679+0000","last_clean":"2023-10-14T19:03:54.963679+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:54.963679+0000","last_undegraded":"2023-10-14T19:03:54.963679+0000","last_fullsized":"2023-10-14T19:03:54.963679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":734134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":143746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":138946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":143780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:03:59.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T19:03:59.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.998+0000 7f92b5ca5700 1 Processor -- start 2023-10-14T19:04:00.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.999+0000 7f92b5ca5700 1 -- start start 2023-10-14T19:04:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.999+0000 7f92b5ca5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92b015a5d0 0x7f92b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.999+0000 7f92b5ca5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b015ae40 con 0x7f92b00cb970 2023-10-14T19:04:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.999+0000 7f92b5ca5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b015ab60 con 0x7f92b00cb5a0 2023-10-14T19:04:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.999+0000 7f92b5ca5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b00ce0f0 con 0x7f92b015a5d0 2023-10-14T19:04:00.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:03:59.999+0000 7f92aeffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f92b00cb970 0x7f92b0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34694/0 (socket says 172.21.15.7:34694) 2023-10-14T19:04:00.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92aeffd700 1 -- 172.21.15.7:0/98529496 learned_addr learned my addr 172.21.15.7:0/98529496 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:00.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234634582 0 0) 0x7f92b015ae40 con 0x7f92b00cb970 2023-10-14T19:04:00.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92affff700 1 --2- 172.21.15.7:0/98529496 >> v2:172.21.15.148:3300/0 conn(0x7f92b015a5d0 0x7f92b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9298003570 con 0x7f92b00cb970 2023-10-14T19:04:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3354018724 0 0) 0x7f9298003570 con 0x7f92b00cb970 2023-10-14T19:04:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 >> v2:172.21.15.148:3300/0 conn(0x7f92b015a5d0 msgr2=0x7f92b0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 --2- 172.21.15.7:0/98529496 >> v2:172.21.15.148:3300/0 conn(0x7f92b015a5d0 0x7f92b0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 >> v1:172.21.15.148:6789/0 conn(0x7f92b00cb5a0 legacy=0x7f92b00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00ccf00 con 0x7f92b00cb970 2023-10-14T19:04:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f92a4001470 con 0x7f92b00cb970 2023-10-14T19:04:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 >> v1:172.21.15.7:6789/0 conn(0x7f92b00cb970 legacy=0x7f92b0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298003ab0 0x7f9298003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298005210 0x7f929800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00ce0f0 con 0x7f9298003ab0 2023-10-14T19:04:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929800c130 con 0x7f9298004810 2023-10-14T19:04:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929800c2f0 con 0x7f9298005210 2023-10-14T19:04:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92af7fe700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298003ab0 0x7f9298003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.000+0000 7f92aeffd700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92affff700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298005210 0x7f929800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92af7fe700 1 -- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298005210 msgr2=0x7f929800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:00.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92af7fe700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298005210 0x7f929800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92af7fe700 1 -- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298004810 msgr2=0x7f9298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:00.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92af7fe700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92af7fe700 1 -- 172.21.15.7:0/98529496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298003570 con 0x7f9298003ab0 2023-10-14T19:04:00.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92aeffd700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:00.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92affff700 1 -- 172.21.15.7:0/98529496 reap_dead start 2023-10-14T19:04:00.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92af7fe700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298003ab0 0x7f9298003ec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92a00018b0 tx=0x7f92a0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756c413f56b01b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:00.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0012420 con 0x7f9298003ab0 2023-10-14T19:04:00.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00125a0 con 0x7f9298003ab0 2023-10-14T19:04:00.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92ae7fc700 1 -- 172.21.15.7:0/98529496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0012960 con 0x7f9298003ab0 2023-10-14T19:04:00.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92b5ca5700 1 -- 172.21.15.7:0/98529496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298003ab0 msgr2=0x7f9298003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298003ab0 0x7f9298003ec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92a00018b0 tx=0x7f92a0007d30 comp rx=0 tx=0).stop 2023-10-14T19:04:00.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92b5ca5700 1 -- 172.21.15.7:0/98529496 shutdown_connections 2023-10-14T19:04:00.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/98529496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9298003ab0 0x7f9298003ec0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92b5ca5700 1 -- 172.21.15.7:0/98529496 >> 172.21.15.7:0/98529496 conn(0x7f92b0070e30 msgr2=0x7f92b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:00.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.001+0000 7f92b5ca5700 1 -- 172.21.15.7:0/98529496 shutdown_connections 2023-10-14T19:04:00.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.002+0000 7f92b5ca5700 1 -- 172.21.15.7:0/98529496 wait complete. 2023-10-14T19:04:00.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.003+0000 7f92b5ca5700 1 Processor -- start 2023-10-14T19:04:00.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.003+0000 7f92b5ca5700 1 -- start start 2023-10-14T19:04:00.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.003+0000 7f92b5ca5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298003ab0 0x7f92b0141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b00b3770 0x7f92b00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 0x7f92b00c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00b4db0 con 0x7f92b00b3be0 2023-10-14T19:04:00.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0141990 con 0x7f92b00b3770 2023-10-14T19:04:00.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00b41a0 con 0x7f9298003ab0 2023-10-14T19:04:00.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 0x7f92b00c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 0x7f92b00c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39964/0 (socket says 172.21.15.7:39964) 2023-10-14T19:04:00.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 -- 172.21.15.7:0/2275438442 learned_addr learned my addr 172.21.15.7:0/2275438442 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:00.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92af7fe700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298003ab0 0x7f92b0141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92aeffd700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b00b3770 0x7f92b00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 -- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298003ab0 msgr2=0x7f92b0141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298003ab0 0x7f92b0141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 -- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b00b3770 msgr2=0x7f92b00c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b00b3770 0x7f92b00c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 -- 172.21.15.7:0/2275438442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00b4480 con 0x7f92b00b3be0 2023-10-14T19:04:00.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92affff700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 0x7f92b00c7d00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92b00d1750 tx=0x7f92a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:00.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800e070 con 0x7f92b00b3be0 2023-10-14T19:04:00.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8011b80 con 0x7f92b00b3be0 2023-10-14T19:04:00.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00b4760 con 0x7f92b00b3be0 2023-10-14T19:04:00.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8016470 con 0x7f92b00b3be0 2023-10-14T19:04:00.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.004+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b01564a0 con 0x7f92b00b3be0 2023-10-14T19:04:00.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.005+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b00b4f20 con 0x7f92b00b3be0 2023-10-14T19:04:00.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.006+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92a8016860 con 0x7f92b00b3be0 2023-10-14T19:04:00.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.006+0000 7f92977fe700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f929c066f30 0x7f929c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.006+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92a8084ef0 con 0x7f92b00b3be0 2023-10-14T19:04:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.006+0000 7f92af7fe700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f929c066f30 0x7f929c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.007+0000 7f92af7fe700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f929c066f30 0x7f929c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f92b00b5bf0 tx=0x7f92a0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.010+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92a8052160 con 0x7f92b00b3be0 2023-10-14T19:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.283+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f92b004c3c0 con 0x7f92b00b3be0 2023-10-14T19:04:00.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.284+0000 7f92977fe700 1 -- 172.21.15.7:0/2275438442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2627 (secure 0 0 0) 0x7f92a8055780 con 0x7f92b00b3be0 2023-10-14T19:04:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:00.286 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1697310181,"num_in_osds":8,"osd_in_since":1697310174,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592674,"bytes_used":2439606272,"bytes_avail":770654507008,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4878}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-14T19:03:59.633079+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-14T19:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f929c066f30 msgr2=0x7f929c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f929c066f30 0x7f929c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f92b00b5bf0 tx=0x7f92a0015000 comp rx=0 tx=0).stop 2023-10-14T19:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 msgr2=0x7f92b00c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 0x7f92b00c7d00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92b00d1750 tx=0x7f92a800b040 comp rx=0 tx=0).stop 2023-10-14T19:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 shutdown_connections 2023-10-14T19:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f929c066f30 0x7f929c0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00b3be0 0x7f92b00c7d00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9298003ab0 0x7f92b0141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 --2- 172.21.15.7:0/2275438442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b00b3770 0x7f92b00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 >> 172.21.15.7:0/2275438442 conn(0x7f92b0070e30 msgr2=0x7f92b00b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 shutdown_connections 2023-10-14T19:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.286+0000 7f92b5ca5700 1 -- 172.21.15.7:0/2275438442 wait complete. 2023-10-14T19:04:00.299 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T19:04:00.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:04:00.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.417+0000 7f6aa14a0700 1 Processor -- start 2023-10-14T19:04:00.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.417+0000 7f6aa14a0700 1 -- start start 2023-10-14T19:04:00.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6aa14a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb970 0x7f6a9c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6aa14a0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c15ae40 con 0x7f6a9c15a400 2023-10-14T19:04:00.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6aa14a0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c15ab60 con 0x7f6a9c0cb5a0 2023-10-14T19:04:00.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6aa14a0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0ce0f0 con 0x7f6a9c0cb970 2023-10-14T19:04:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6a9b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6a9c15a400 0x7f6a9c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34696/0 (socket says 172.21.15.7:34696) 2023-10-14T19:04:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6a9b7fe700 1 -- 172.21.15.7:0/2591707576 learned_addr learned my addr 172.21.15.7:0/2591707576 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6a9a7fc700 1 --2- 172.21.15.7:0/2591707576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb970 0x7f6a9c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.418+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780092425 0 0) 0x7f6a9c15ae40 con 0x7f6a9c15a400 2023-10-14T19:04:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a88003570 con 0x7f6a9c15a400 2023-10-14T19:04:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897044188 0 0) 0x7f6a9c15ab60 con 0x7f6a9c0cb5a0 2023-10-14T19:04:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c15ae40 con 0x7f6a9c0cb5a0 2023-10-14T19:04:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a9a7fc700 1 -- 172.21.15.7:0/2591707576 >> v1:172.21.15.148:6789/0 conn(0x7f6a9c0cb5a0 legacy=0x7f6a9c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a9a7fc700 1 -- 172.21.15.7:0/2591707576 >> v1:172.21.15.7:6789/0 conn(0x7f6a9c15a400 legacy=0x7f6a9c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a9a7fc700 1 -- 172.21.15.7:0/2591707576 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0ccf00 con 0x7f6a9c0cb970 2023-10-14T19:04:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a9a7fc700 1 --2- 172.21.15.7:0/2591707576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb970 0x7f6a9c159ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009910 tx=0x7f6a840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ccfc6e006d57223 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84011630 con 0x7f6a9c0cb970 2023-10-14T19:04:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84011790 con 0x7f6a9c0cb970 2023-10-14T19:04:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.419+0000 7f6a99ffb700 1 -- 172.21.15.7:0/2591707576 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84011b30 con 0x7f6a9c0cb970 2023-10-14T19:04:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2591707576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb970 msgr2=0x7f6a9c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2591707576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb970 0x7f6a9c159ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009910 tx=0x7f6a840091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2591707576 shutdown_connections 2023-10-14T19:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2591707576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb970 0x7f6a9c159ec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2591707576 >> 172.21.15.7:0/2591707576 conn(0x7f6a9c070e30 msgr2=0x7f6a9c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2591707576 shutdown_connections 2023-10-14T19:04:00.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.420+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2591707576 wait complete. 2023-10-14T19:04:00.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.421+0000 7f6aa14a0700 1 Processor -- start 2023-10-14T19:04:00.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.421+0000 7f6aa14a0700 1 -- start start 2023-10-14T19:04:00.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6aa14a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb5a0 0x7f6a9c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6aa14a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a9c0cb970 0x7f6a9c0c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6aa14a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 0x7f6a9c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6aa14a0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cbde0 con 0x7f6a9c15a400 2023-10-14T19:04:00.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6aa14a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c16a5e0 con 0x7f6a9c0cb970 2023-10-14T19:04:00.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6aa14a0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1567d0 con 0x7f6a9c0cb5a0 2023-10-14T19:04:00.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 0x7f6a9c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 0x7f6a9c0b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39972/0 (socket says 172.21.15.7:39972) 2023-10-14T19:04:00.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 -- 172.21.15.7:0/2682435107 learned_addr learned my addr 172.21.15.7:0/2682435107 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:00.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9a7fc700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a9c0cb970 0x7f6a9c0c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9affd700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb5a0 0x7f6a9c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 -- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb5a0 msgr2=0x7f6a9c156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb5a0 0x7f6a9c156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 -- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a9c0cb970 msgr2=0x7f6a9c0c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a9c0cb970 0x7f6a9c0c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 -- 172.21.15.7:0/2682435107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009420 con 0x7f6a9c15a400 2023-10-14T19:04:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9affd700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb5a0 0x7f6a9c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:00.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.422+0000 7f6a9b7fe700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 0x7f6a9c0b4480 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00cc20 tx=0x7f6a8c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:00.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.423+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00a8b0 con 0x7f6a9c15a400 2023-10-14T19:04:00.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.423+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00aa10 con 0x7f6a9c15a400 2023-10-14T19:04:00.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.423+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c0c8de0 con 0x7f6a9c15a400 2023-10-14T19:04:00.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.423+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00add0 con 0x7f6a9c15a400 2023-10-14T19:04:00.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.423+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c169f90 con 0x7f6a9c15a400 2023-10-14T19:04:00.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.424+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c04c3c0 con 0x7f6a9c15a400 2023-10-14T19:04:00.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.424+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a8c007300 con 0x7f6a9c15a400 2023-10-14T19:04:00.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.424+0000 7f6a92ffd700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a7c066f30 0x7f6a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:00.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.425+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a8c084860 con 0x7f6a9c15a400 2023-10-14T19:04:00.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.425+0000 7f6a9affd700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a7c066f30 0x7f6a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:00.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.425+0000 7f6a9affd700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a7c066f30 0x7f6a7c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6a94000c00 tx=0x7f6a94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:00.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.429+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a8c051b50 con 0x7f6a9c15a400 2023-10-14T19:04:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.615+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a9c0ccb80 con 0x7f6a7c066f30 2023-10-14T19:04:00.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.623+0000 7f6a92ffd700 1 -- 172.21.15.7:0/2682435107 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264640 (secure 0 0 0) 0x7f6a9c0ccb80 con 0x7f6a7c066f30 2023-10-14T19:04:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:00.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a7c066f30 msgr2=0x7f6a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a7c066f30 0x7f6a7c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6a94000c00 tx=0x7f6a94009040 comp rx=0 tx=0).stop 2023-10-14T19:04:00.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 msgr2=0x7f6a9c0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:00.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 0x7f6a9c0b4480 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00cc20 tx=0x7f6a8c001a40 comp rx=0 tx=0).stop 2023-10-14T19:04:00.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 shutdown_connections 2023-10-14T19:04:00.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a7c066f30 0x7f6a7c0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a9c15a400 0x7f6a9c0b4480 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a9c0cb5a0 0x7f6a9c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 --2- 172.21.15.7:0/2682435107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a9c0cb970 0x7f6a9c0c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 >> 172.21.15.7:0/2682435107 conn(0x7f6a9c070e30 msgr2=0x7f6a9c0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 shutdown_connections 2023-10-14T19:04:00.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:00.626+0000 7f6aa14a0700 1 -- 172.21.15.7:0/2682435107 wait complete. 2023-10-14T19:04:00.634 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:04:00.639 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-14T19:03:59.632870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382428,"kb_used_data":4124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592292,"statfs":{"total":773094113280,"available":770654507008,"internally_reserved":0,"allocated":4222976,"data_stored":2328468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001270"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972883+0000","last_change":"2023-10-14T19:03:54.965542+0000","last_active":"2023-10-14T19:03:54.972883+0000","last_peered":"2023-10-14T19:03:54.972883+0000","last_clean":"2023-10-14T19:03:54.972883+0000","last_became_active":"2023-10-14T19:03:54.965162+0000","last_became_peered":"2023-10-14T19:03:54.965162+0000","last_unstale":"2023-10-14T19:03:54.972883+0000","last_undegraded":"2023-10-14T19:03:54.972883+0000","last_fullsized":"2023-10-14T19:03:54.972883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970912+0000","last_change":"2023-10-14T19:03:54.969130+0000","last_active":"2023-10-14T19:03:54.970912+0000","last_peered":"2023-10-14T19:03:54.970912+0000","last_clean":"2023-10-14T19:03:54.970912+0000","last_became_active":"2023-10-14T19:03:54.968863+0000","last_became_peered":"2023-10-14T19:03:54.968863+0000","last_unstale":"2023-10-14T19:03:54.970912+0000","last_undegraded":"2023-10-14T19:03:54.970912+0000","last_fullsized":"2023-10-14T19:03:54.970912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:30.690416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980074+0000","last_change":"2023-10-14T19:03:54.976548+0000","last_active":"2023-10-14T19:03:54.980074+0000","last_peered":"2023-10-14T19:03:54.980074+0000","last_clean":"2023-10-14T19:03:54.980074+0000","last_became_active":"2023-10-14T19:03:54.976264+0000","last_became_peered":"2023-10-14T19:03:54.976264+0000","last_unstale":"2023-10-14T19:03:54.980074+0000","last_undegraded":"2023-10-14T19:03:54.980074+0000","last_fullsized":"2023-10-14T19:03:54.980074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:30.690416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979952+0000","last_change":"2023-10-14T19:03:54.978697+0000","last_active":"2023-10-14T19:03:54.979952+0000","last_peered":"2023-10-14T19:03:54.979952+0000","last_clean":"2023-10-14T19:03:54.979952+0000","last_became_active":"2023-10-14T19:03:54.978403+0000","last_became_peered":"2023-10-14T19:03:54.978403+0000","last_unstale":"2023-10-14T19:03:54.979952+0000","last_undegraded":"2023-10-14T19:03:54.979952+0000","last_fullsized":"2023-10-14T19:03:54.979952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.959703+0000","last_change":"2023-10-14T19:03:54.958469+0000","last_active":"2023-10-14T19:03:54.959703+0000","last_peered":"2023-10-14T19:03:54.959703+0000","last_clean":"2023-10-14T19:03:54.959703+0000","last_became_active":"2023-10-14T19:03:54.957362+0000","last_became_peered":"2023-10-14T19:03:54.957362+0000","last_unstale":"2023-10-14T19:03:54.959703+0000","last_undegraded":"2023-10-14T19:03:54.959703+0000","last_fullsized":"2023-10-14T19:03:54.959703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:34.678754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967928+0000","last_change":"2023-10-14T19:03:54.965611+0000","last_active":"2023-10-14T19:03:54.967928+0000","last_peered":"2023-10-14T19:03:54.967928+0000","last_clean":"2023-10-14T19:03:54.967928+0000","last_became_active":"2023-10-14T19:03:54.965195+0000","last_became_peered":"2023-10-14T19:03:54.965195+0000","last_unstale":"2023-10-14T19:03:54.967928+0000","last_undegraded":"2023-10-14T19:03:54.967928+0000","last_fullsized":"2023-10-14T19:03:54.967928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972517+0000","last_change":"2023-10-14T19:03:54.968465+0000","last_active":"2023-10-14T19:03:54.972517+0000","last_peered":"2023-10-14T19:03:54.972517+0000","last_clean":"2023-10-14T19:03:54.972517+0000","last_became_active":"2023-10-14T19:03:54.968158+0000","last_became_peered":"2023-10-14T19:03:54.968158+0000","last_unstale":"2023-10-14T19:03:54.972517+0000","last_undegraded":"2023-10-14T19:03:54.972517+0000","last_fullsized":"2023-10-14T19:03:54.972517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:30.582842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967852+0000","last_change":"2023-10-14T19:03:54.964936+0000","last_active":"2023-10-14T19:03:54.967852+0000","last_peered":"2023-10-14T19:03:54.967852+0000","last_clean":"2023-10-14T19:03:54.967852+0000","last_became_active":"2023-10-14T19:03:54.964669+0000","last_became_peered":"2023-10-14T19:03:54.964669+0000","last_unstale":"2023-10-14T19:03:54.967852+0000","last_undegraded":"2023-10-14T19:03:54.967852+0000","last_fullsized":"2023-10-14T19:03:54.967852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977907+0000","last_change":"2023-10-14T19:03:54.974543+0000","last_active":"2023-10-14T19:03:54.977907+0000","last_peered":"2023-10-14T19:03:54.977907+0000","last_clean":"2023-10-14T19:03:54.977907+0000","last_became_active":"2023-10-14T19:03:54.974298+0000","last_became_peered":"2023-10-14T19:03:54.974298+0000","last_unstale":"2023-10-14T19:03:54.977907+0000","last_undegraded":"2023-10-14T19:03:54.977907+0000","last_fullsized":"2023-10-14T19:03:54.977907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:57:24.099372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979891+0000","last_change":"2023-10-14T19:03:54.978355+0000","last_active":"2023-10-14T19:03:54.979891+0000","last_peered":"2023-10-14T19:03:54.979891+0000","last_clean":"2023-10-14T19:03:54.979891+0000","last_became_active":"2023-10-14T19:03:54.978069+0000","last_became_peered":"2023-10-14T19:03:54.978069+0000","last_unstale":"2023-10-14T19:03:54.979891+0000","last_undegraded":"2023-10-14T19:03:54.979891+0000","last_fullsized":"2023-10-14T19:03:54.979891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.983296+0000","last_change":"2023-10-14T19:03:54.980346+0000","last_active":"2023-10-14T19:03:54.983296+0000","last_peered":"2023-10-14T19:03:54.983296+0000","last_clean":"2023-10-14T19:03:54.983296+0000","last_became_active":"2023-10-14T19:03:54.980027+0000","last_became_peered":"2023-10-14T19:03:54.980027+0000","last_unstale":"2023-10-14T19:03:54.983296+0000","last_undegraded":"2023-10-14T19:03:54.983296+0000","last_fullsized":"2023-10-14T19:03:54.983296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965414+0000","last_change":"2023-10-14T19:03:54.961366+0000","last_active":"2023-10-14T19:03:54.965414+0000","last_peered":"2023-10-14T19:03:54.965414+0000","last_clean":"2023-10-14T19:03:54.965414+0000","last_became_active":"2023-10-14T19:03:54.961076+0000","last_became_peered":"2023-10-14T19:03:54.961076+0000","last_unstale":"2023-10-14T19:03:54.965414+0000","last_undegraded":"2023-10-14T19:03:54.965414+0000","last_fullsized":"2023-10-14T19:03:54.965414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980552+0000","last_change":"2023-10-14T19:03:54.974954+0000","last_active":"2023-10-14T19:03:54.980552+0000","last_peered":"2023-10-14T19:03:54.980552+0000","last_clean":"2023-10-14T19:03:54.980552+0000","last_became_active":"2023-10-14T19:03:54.974480+0000","last_became_peered":"2023-10-14T19:03:54.974480+0000","last_unstale":"2023-10-14T19:03:54.980552+0000","last_undegraded":"2023-10-14T19:03:54.980552+0000","last_fullsized":"2023-10-14T19:03:54.980552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:44.445832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965706+0000","last_change":"2023-10-14T19:03:54.958128+0000","last_active":"2023-10-14T19:03:54.965706+0000","last_peered":"2023-10-14T19:03:54.965706+0000","last_clean":"2023-10-14T19:03:54.965706+0000","last_became_active":"2023-10-14T19:03:54.957843+0000","last_became_peered":"2023-10-14T19:03:54.957843+0000","last_unstale":"2023-10-14T19:03:54.965706+0000","last_undegraded":"2023-10-14T19:03:54.965706+0000","last_fullsized":"2023-10-14T19:03:54.965706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966657+0000","last_change":"2023-10-14T19:03:54.961919+0000","last_active":"2023-10-14T19:03:54.966657+0000","last_peered":"2023-10-14T19:03:54.966657+0000","last_clean":"2023-10-14T19:03:54.966657+0000","last_became_active":"2023-10-14T19:03:54.961088+0000","last_became_peered":"2023-10-14T19:03:54.961088+0000","last_unstale":"2023-10-14T19:03:54.966657+0000","last_undegraded":"2023-10-14T19:03:54.966657+0000","last_fullsized":"2023-10-14T19:03:54.966657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977650+0000","last_change":"2023-10-14T19:03:54.973187+0000","last_active":"2023-10-14T19:03:54.977650+0000","last_peered":"2023-10-14T19:03:54.977650+0000","last_clean":"2023-10-14T19:03:54.977650+0000","last_became_active":"2023-10-14T19:03:54.972754+0000","last_became_peered":"2023-10-14T19:03:54.972754+0000","last_unstale":"2023-10-14T19:03:54.977650+0000","last_undegraded":"2023-10-14T19:03:54.977650+0000","last_fullsized":"2023-10-14T19:03:54.977650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972664+0000","last_change":"2023-10-14T19:03:54.969485+0000","last_active":"2023-10-14T19:03:54.972664+0000","last_peered":"2023-10-14T19:03:54.972664+0000","last_clean":"2023-10-14T19:03:54.972664+0000","last_became_active":"2023-10-14T19:03:54.969231+0000","last_became_peered":"2023-10-14T19:03:54.969231+0000","last_unstale":"2023-10-14T19:03:54.972664+0000","last_undegraded":"2023-10-14T19:03:54.972664+0000","last_fullsized":"2023-10-14T19:03:54.972664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976701+0000","last_change":"2023-10-14T19:03:54.974412+0000","last_active":"2023-10-14T19:03:54.976701+0000","last_peered":"2023-10-14T19:03:54.976701+0000","last_clean":"2023-10-14T19:03:54.976701+0000","last_became_active":"2023-10-14T19:03:54.974130+0000","last_became_peered":"2023-10-14T19:03:54.974130+0000","last_unstale":"2023-10-14T19:03:54.976701+0000","last_undegraded":"2023-10-14T19:03:54.976701+0000","last_fullsized":"2023-10-14T19:03:54.976701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979176+0000","last_change":"2023-10-14T19:03:54.977115+0000","last_active":"2023-10-14T19:03:54.979176+0000","last_peered":"2023-10-14T19:03:54.979176+0000","last_clean":"2023-10-14T19:03:54.979176+0000","last_became_active":"2023-10-14T19:03:54.976848+0000","last_became_peered":"2023-10-14T19:03:54.976848+0000","last_unstale":"2023-10-14T19:03:54.979176+0000","last_undegraded":"2023-10-14T19:03:54.979176+0000","last_fullsized":"2023-10-14T19:03:54.979176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:30.582842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966977+0000","last_change":"2023-10-14T19:03:54.965077+0000","last_active":"2023-10-14T19:03:54.966977+0000","last_peered":"2023-10-14T19:03:54.966977+0000","last_clean":"2023-10-14T19:03:54.966977+0000","last_became_active":"2023-10-14T19:03:54.964803+0000","last_became_peered":"2023-10-14T19:03:54.964803+0000","last_unstale":"2023-10-14T19:03:54.966977+0000","last_undegraded":"2023-10-14T19:03:54.966977+0000","last_fullsized":"2023-10-14T19:03:54.966977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:05.011075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977629+0000","last_change":"2023-10-14T19:03:54.970579+0000","last_active":"2023-10-14T19:03:54.977629+0000","last_peered":"2023-10-14T19:03:54.977629+0000","last_clean":"2023-10-14T19:03:54.977629+0000","last_became_active":"2023-10-14T19:03:54.970269+0000","last_became_peered":"2023-10-14T19:03:54.970269+0000","last_unstale":"2023-10-14T19:03:54.977629+0000","last_undegraded":"2023-10-14T19:03:54.977629+0000","last_fullsized":"2023-10-14T19:03:54.977629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967785+0000","last_change":"2023-10-14T19:03:54.959826+0000","last_active":"2023-10-14T19:03:54.967785+0000","last_peered":"2023-10-14T19:03:54.967785+0000","last_clean":"2023-10-14T19:03:54.967785+0000","last_became_active":"2023-10-14T19:03:54.959525+0000","last_became_peered":"2023-10-14T19:03:54.959525+0000","last_unstale":"2023-10-14T19:03:54.967785+0000","last_undegraded":"2023-10-14T19:03:54.967785+0000","last_fullsized":"2023-10-14T19:03:54.967785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:00:53.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971498+0000","last_change":"2023-10-14T19:03:54.968843+0000","last_active":"2023-10-14T19:03:54.971498+0000","last_peered":"2023-10-14T19:03:54.971498+0000","last_clean":"2023-10-14T19:03:54.971498+0000","last_became_active":"2023-10-14T19:03:54.968567+0000","last_became_peered":"2023-10-14T19:03:54.968567+0000","last_unstale":"2023-10-14T19:03:54.971498+0000","last_undegraded":"2023-10-14T19:03:54.971498+0000","last_fullsized":"2023-10-14T19:03:54.971498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:46.867930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965459+0000","last_change":"2023-10-14T19:03:54.961787+0000","last_active":"2023-10-14T19:03:54.965459+0000","last_peered":"2023-10-14T19:03:54.965459+0000","last_clean":"2023-10-14T19:03:54.965459+0000","last_became_active":"2023-10-14T19:03:54.961561+0000","last_became_peered":"2023-10-14T19:03:54.961561+0000","last_unstale":"2023-10-14T19:03:54.965459+0000","last_undegraded":"2023-10-14T19:03:54.965459+0000","last_fullsized":"2023-10-14T19:03:54.965459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975336+0000","last_change":"2023-10-14T19:03:54.972284+0000","last_active":"2023-10-14T19:03:54.975336+0000","last_peered":"2023-10-14T19:03:54.975336+0000","last_clean":"2023-10-14T19:03:54.975336+0000","last_became_active":"2023-10-14T19:03:54.972015+0000","last_became_peered":"2023-10-14T19:03:54.972015+0000","last_unstale":"2023-10-14T19:03:54.975336+0000","last_undegraded":"2023-10-14T19:03:54.975336+0000","last_fullsized":"2023-10-14T19:03:54.975336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:48.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970895+0000","last_change":"2023-10-14T19:03:54.966444+0000","last_active":"2023-10-14T19:03:54.970895+0000","last_peered":"2023-10-14T19:03:54.970895+0000","last_clean":"2023-10-14T19:03:54.970895+0000","last_became_active":"2023-10-14T19:03:54.966176+0000","last_became_peered":"2023-10-14T19:03:54.966176+0000","last_unstale":"2023-10-14T19:03:54.970895+0000","last_undegraded":"2023-10-14T19:03:54.970895+0000","last_fullsized":"2023-10-14T19:03:54.970895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:18.417288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980552+0000","last_change":"2023-10-14T19:03:54.979276+0000","last_active":"2023-10-14T19:03:54.980552+0000","last_peered":"2023-10-14T19:03:54.980552+0000","last_clean":"2023-10-14T19:03:54.980552+0000","last_became_active":"2023-10-14T19:03:54.978992+0000","last_became_peered":"2023-10-14T19:03:54.978992+0000","last_unstale":"2023-10-14T19:03:54.980552+0000","last_undegraded":"2023-10-14T19:03:54.980552+0000","last_fullsized":"2023-10-14T19:03:54.980552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965433+0000","last_change":"2023-10-14T19:03:54.963040+0000","last_active":"2023-10-14T19:03:54.965433+0000","last_peered":"2023-10-14T19:03:54.965433+0000","last_clean":"2023-10-14T19:03:54.965433+0000","last_became_active":"2023-10-14T19:03:54.962791+0000","last_became_peered":"2023-10-14T19:03:54.962791+0000","last_unstale":"2023-10-14T19:03:54.965433+0000","last_undegraded":"2023-10-14T19:03:54.965433+0000","last_fullsized":"2023-10-14T19:03:54.965433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969862+0000","last_change":"2023-10-14T19:03:54.959358+0000","last_active":"2023-10-14T19:03:54.969862+0000","last_peered":"2023-10-14T19:03:54.969862+0000","last_clean":"2023-10-14T19:03:54.969862+0000","last_became_active":"2023-10-14T19:03:54.959098+0000","last_became_peered":"2023-10-14T19:03:54.959098+0000","last_unstale":"2023-10-14T19:03:54.969862+0000","last_undegraded":"2023-10-14T19:03:54.969862+0000","last_fullsized":"2023-10-14T19:03:54.969862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:04.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972489+0000","last_change":"2023-10-14T19:03:54.968457+0000","last_active":"2023-10-14T19:03:54.972489+0000","last_peered":"2023-10-14T19:03:54.972489+0000","last_clean":"2023-10-14T19:03:54.972489+0000","last_became_active":"2023-10-14T19:03:54.968173+0000","last_became_peered":"2023-10-14T19:03:54.968173+0000","last_unstale":"2023-10-14T19:03:54.972489+0000","last_undegraded":"2023-10-14T19:03:54.972489+0000","last_fullsized":"2023-10-14T19:03:54.972489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:32.176095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963419+0000","last_change":"2023-10-14T19:03:54.958453+0000","last_active":"2023-10-14T19:03:54.963419+0000","last_peered":"2023-10-14T19:03:54.963419+0000","last_clean":"2023-10-14T19:03:54.963419+0000","last_became_active":"2023-10-14T19:03:54.958180+0000","last_became_peered":"2023-10-14T19:03:54.958180+0000","last_unstale":"2023-10-14T19:03:54.963419+0000","last_undegraded":"2023-10-14T19:03:54.963419+0000","last_fullsized":"2023-10-14T19:03:54.963419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:00:53.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977632+0000","last_change":"2023-10-14T19:03:54.972307+0000","last_active":"2023-10-14T19:03:54.977632+0000","last_peered":"2023-10-14T19:03:54.977632+0000","last_clean":"2023-10-14T19:03:54.977632+0000","last_became_active":"2023-10-14T19:03:54.971972+0000","last_became_peered":"2023-10-14T19:03:54.971972+0000","last_unstale":"2023-10-14T19:03:54.977632+0000","last_undegraded":"2023-10-14T19:03:54.977632+0000","last_fullsized":"2023-10-14T19:03:54.977632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971395+0000","last_change":"2023-10-14T19:03:54.968757+0000","last_active":"2023-10-14T19:03:54.971395+0000","last_peered":"2023-10-14T19:03:54.971395+0000","last_clean":"2023-10-14T19:03:54.971395+0000","last_became_active":"2023-10-14T19:03:54.968462+0000","last_became_peered":"2023-10-14T19:03:54.968462+0000","last_unstale":"2023-10-14T19:03:54.971395+0000","last_undegraded":"2023-10-14T19:03:54.971395+0000","last_fullsized":"2023-10-14T19:03:54.971395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.968175+0000","last_change":"2023-10-14T19:03:53.938414+0000","last_active":"2023-10-14T19:03:54.968175+0000","last_peered":"2023-10-14T19:03:54.968175+0000","last_clean":"2023-10-14T19:03:54.968175+0000","last_became_active":"2023-10-14T19:03:53.938118+0000","last_became_peered":"2023-10-14T19:03:53.938118+0000","last_unstale":"2023-10-14T19:03:54.968175+0000","last_undegraded":"2023-10-14T19:03:54.968175+0000","last_fullsized":"2023-10-14T19:03:54.968175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.973391+0000","last_change":"2023-10-14T19:03:54.969609+0000","last_active":"2023-10-14T19:03:54.973391+0000","last_peered":"2023-10-14T19:03:54.973391+0000","last_clean":"2023-10-14T19:03:54.973391+0000","last_became_active":"2023-10-14T19:03:54.969323+0000","last_became_peered":"2023-10-14T19:03:54.969323+0000","last_unstale":"2023-10-14T19:03:54.973391+0000","last_undegraded":"2023-10-14T19:03:54.973391+0000","last_fullsized":"2023-10-14T19:03:54.973391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974713+0000","last_change":"2023-10-14T19:03:53.934075+0000","last_active":"2023-10-14T19:03:54.974713+0000","last_peered":"2023-10-14T19:03:54.974713+0000","last_clean":"2023-10-14T19:03:54.974713+0000","last_became_active":"2023-10-14T19:03:53.933765+0000","last_became_peered":"2023-10-14T19:03:53.933765+0000","last_unstale":"2023-10-14T19:03:54.974713+0000","last_undegraded":"2023-10-14T19:03:54.974713+0000","last_fullsized":"2023-10-14T19:03:54.974713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967813+0000","last_change":"2023-10-14T19:03:54.961630+0000","last_active":"2023-10-14T19:03:54.967813+0000","last_peered":"2023-10-14T19:03:54.967813+0000","last_clean":"2023-10-14T19:03:54.967813+0000","last_became_active":"2023-10-14T19:03:54.961383+0000","last_became_peered":"2023-10-14T19:03:54.961383+0000","last_unstale":"2023-10-14T19:03:54.967813+0000","last_undegraded":"2023-10-14T19:03:54.967813+0000","last_fullsized":"2023-10-14T19:03:54.967813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976605+0000","last_change":"2023-10-14T19:03:53.941920+0000","last_active":"2023-10-14T19:03:54.976605+0000","last_peered":"2023-10-14T19:03:54.976605+0000","last_clean":"2023-10-14T19:03:54.976605+0000","last_became_active":"2023-10-14T19:03:53.941656+0000","last_became_peered":"2023-10-14T19:03:53.941656+0000","last_unstale":"2023-10-14T19:03:54.976605+0000","last_undegraded":"2023-10-14T19:03:54.976605+0000","last_fullsized":"2023-10-14T19:03:54.976605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:14.749737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979923+0000","last_change":"2023-10-14T19:03:54.979145+0000","last_active":"2023-10-14T19:03:54.979923+0000","last_peered":"2023-10-14T19:03:54.979923+0000","last_clean":"2023-10-14T19:03:54.979923+0000","last_became_active":"2023-10-14T19:03:54.978677+0000","last_became_peered":"2023-10-14T19:03:54.978677+0000","last_unstale":"2023-10-14T19:03:54.979923+0000","last_undegraded":"2023-10-14T19:03:54.979923+0000","last_fullsized":"2023-10-14T19:03:54.979923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:57:24.099372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.957715+0000","last_change":"2023-10-14T19:03:53.929740+0000","last_active":"2023-10-14T19:03:54.957715+0000","last_peered":"2023-10-14T19:03:54.957715+0000","last_clean":"2023-10-14T19:03:54.957715+0000","last_became_active":"2023-10-14T19:03:53.929456+0000","last_became_peered":"2023-10-14T19:03:53.929456+0000","last_unstale":"2023-10-14T19:03:54.957715+0000","last_undegraded":"2023-10-14T19:03:54.957715+0000","last_fullsized":"2023-10-14T19:03:54.957715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:46.800352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975037+0000","last_change":"2023-10-14T19:03:54.971564+0000","last_active":"2023-10-14T19:03:54.975037+0000","last_peered":"2023-10-14T19:03:54.975037+0000","last_clean":"2023-10-14T19:03:54.975037+0000","last_became_active":"2023-10-14T19:03:54.971198+0000","last_became_peered":"2023-10-14T19:03:54.971198+0000","last_unstale":"2023-10-14T19:03:54.975037+0000","last_undegraded":"2023-10-14T19:03:54.975037+0000","last_fullsized":"2023-10-14T19:03:54.975037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969892+0000","last_change":"2023-10-14T19:03:53.934830+0000","last_active":"2023-10-14T19:03:54.969892+0000","last_peered":"2023-10-14T19:03:54.969892+0000","last_clean":"2023-10-14T19:03:54.969892+0000","last_became_active":"2023-10-14T19:03:53.934166+0000","last_became_peered":"2023-10-14T19:03:53.934166+0000","last_unstale":"2023-10-14T19:03:54.969892+0000","last_undegraded":"2023-10-14T19:03:54.969892+0000","last_fullsized":"2023-10-14T19:03:54.969892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:43.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977377+0000","last_change":"2023-10-14T19:03:54.971536+0000","last_active":"2023-10-14T19:03:54.977377+0000","last_peered":"2023-10-14T19:03:54.977377+0000","last_clean":"2023-10-14T19:03:54.977377+0000","last_became_active":"2023-10-14T19:03:54.971240+0000","last_became_peered":"2023-10-14T19:03:54.971240+0000","last_unstale":"2023-10-14T19:03:54.977377+0000","last_undegraded":"2023-10-14T19:03:54.977377+0000","last_fullsized":"2023-10-14T19:03:54.977377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966381+0000","last_change":"2023-10-14T19:03:53.933946+0000","last_active":"2023-10-14T19:03:54.966381+0000","last_peered":"2023-10-14T19:03:54.966381+0000","last_clean":"2023-10-14T19:03:54.966381+0000","last_became_active":"2023-10-14T19:03:53.933656+0000","last_became_peered":"2023-10-14T19:03:53.933656+0000","last_unstale":"2023-10-14T19:03:54.966381+0000","last_undegraded":"2023-10-14T19:03:54.966381+0000","last_fullsized":"2023-10-14T19:03:54.966381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:22.618256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963254+0000","last_change":"2023-10-14T19:03:54.954930+0000","last_active":"2023-10-14T19:03:54.963254+0000","last_peered":"2023-10-14T19:03:54.963254+0000","last_clean":"2023-10-14T19:03:54.963254+0000","last_became_active":"2023-10-14T19:03:54.954689+0000","last_became_peered":"2023-10-14T19:03:54.954689+0000","last_unstale":"2023-10-14T19:03:54.963254+0000","last_undegraded":"2023-10-14T19:03:54.963254+0000","last_fullsized":"2023-10-14T19:03:54.963254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947784+0000","last_change":"2023-10-14T19:03:53.937049+0000","last_active":"2023-10-14T19:03:54.947784+0000","last_peered":"2023-10-14T19:03:54.947784+0000","last_clean":"2023-10-14T19:03:54.947784+0000","last_became_active":"2023-10-14T19:03:53.936834+0000","last_became_peered":"2023-10-14T19:03:53.936834+0000","last_unstale":"2023-10-14T19:03:54.947784+0000","last_undegraded":"2023-10-14T19:03:54.947784+0000","last_fullsized":"2023-10-14T19:03:54.947784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:37.508875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974585+0000","last_change":"2023-10-14T19:03:54.972421+0000","last_active":"2023-10-14T19:03:54.974585+0000","last_peered":"2023-10-14T19:03:54.974585+0000","last_clean":"2023-10-14T19:03:54.974585+0000","last_became_active":"2023-10-14T19:03:54.970191+0000","last_became_peered":"2023-10-14T19:03:54.970191+0000","last_unstale":"2023-10-14T19:03:54.974585+0000","last_undegraded":"2023-10-14T19:03:54.974585+0000","last_fullsized":"2023-10-14T19:03:54.974585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:43.294272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950419+0000","last_change":"2023-10-14T19:03:53.932989+0000","last_active":"2023-10-14T19:03:54.950419+0000","last_peered":"2023-10-14T19:03:54.950419+0000","last_clean":"2023-10-14T19:03:54.950419+0000","last_became_active":"2023-10-14T19:03:53.932698+0000","last_became_peered":"2023-10-14T19:03:53.932698+0000","last_unstale":"2023-10-14T19:03:54.950419+0000","last_undegraded":"2023-10-14T19:03:54.950419+0000","last_fullsized":"2023-10-14T19:03:54.950419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:43.931855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965613+0000","last_change":"2023-10-14T19:03:54.961354+0000","last_active":"2023-10-14T19:03:54.965613+0000","last_peered":"2023-10-14T19:03:54.965613+0000","last_clean":"2023-10-14T19:03:54.965613+0000","last_became_active":"2023-10-14T19:03:54.961058+0000","last_became_peered":"2023-10-14T19:03:54.961058+0000","last_unstale":"2023-10-14T19:03:54.965613+0000","last_undegraded":"2023-10-14T19:03:54.965613+0000","last_fullsized":"2023-10-14T19:03:54.965613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.948311+0000","last_change":"2023-10-14T19:03:53.940701+0000","last_active":"2023-10-14T19:03:54.948311+0000","last_peered":"2023-10-14T19:03:54.948311+0000","last_clean":"2023-10-14T19:03:54.948311+0000","last_became_active":"2023-10-14T19:03:53.940428+0000","last_became_peered":"2023-10-14T19:03:53.940428+0000","last_unstale":"2023-10-14T19:03:54.948311+0000","last_undegraded":"2023-10-14T19:03:54.948311+0000","last_fullsized":"2023-10-14T19:03:54.948311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:13:14.209007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977261+0000","last_change":"2023-10-14T19:03:54.975517+0000","last_active":"2023-10-14T19:03:54.977261+0000","last_peered":"2023-10-14T19:03:54.977261+0000","last_clean":"2023-10-14T19:03:54.977261+0000","last_became_active":"2023-10-14T19:03:54.975244+0000","last_became_peered":"2023-10-14T19:03:54.975244+0000","last_unstale":"2023-10-14T19:03:54.977261+0000","last_undegraded":"2023-10-14T19:03:54.977261+0000","last_fullsized":"2023-10-14T19:03:54.977261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.958501+0000","last_change":"2023-10-14T19:03:53.939672+0000","last_active":"2023-10-14T19:03:54.958501+0000","last_peered":"2023-10-14T19:03:54.958501+0000","last_clean":"2023-10-14T19:03:54.958501+0000","last_became_active":"2023-10-14T19:03:53.939343+0000","last_became_peered":"2023-10-14T19:03:53.939343+0000","last_unstale":"2023-10-14T19:03:54.958501+0000","last_undegraded":"2023-10-14T19:03:54.958501+0000","last_fullsized":"2023-10-14T19:03:54.958501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970270+0000","last_change":"2023-10-14T19:03:54.966074+0000","last_active":"2023-10-14T19:03:54.970270+0000","last_peered":"2023-10-14T19:03:54.970270+0000","last_clean":"2023-10-14T19:03:54.970270+0000","last_became_active":"2023-10-14T19:03:54.965793+0000","last_became_peered":"2023-10-14T19:03:54.965793+0000","last_unstale":"2023-10-14T19:03:54.970270+0000","last_undegraded":"2023-10-14T19:03:54.970270+0000","last_fullsized":"2023-10-14T19:03:54.970270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:50.814259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966136+0000","last_change":"2023-10-14T19:03:53.937854+0000","last_active":"2023-10-14T19:03:54.966136+0000","last_peered":"2023-10-14T19:03:54.966136+0000","last_clean":"2023-10-14T19:03:54.966136+0000","last_became_active":"2023-10-14T19:03:53.937577+0000","last_became_peered":"2023-10-14T19:03:53.937577+0000","last_unstale":"2023-10-14T19:03:54.966136+0000","last_undegraded":"2023-10-14T19:03:54.966136+0000","last_fullsized":"2023-10-14T19:03:54.966136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:41.140204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980092+0000","last_change":"2023-10-14T19:03:54.976558+0000","last_active":"2023-10-14T19:03:54.980092+0000","last_peered":"2023-10-14T19:03:54.980092+0000","last_clean":"2023-10-14T19:03:54.980092+0000","last_became_active":"2023-10-14T19:03:54.976269+0000","last_became_peered":"2023-10-14T19:03:54.976269+0000","last_unstale":"2023-10-14T19:03:54.980092+0000","last_undegraded":"2023-10-14T19:03:54.980092+0000","last_fullsized":"2023-10-14T19:03:54.980092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:50.814259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.982318+0000","last_change":"2023-10-14T19:03:53.942558+0000","last_active":"2023-10-14T19:03:54.982318+0000","last_peered":"2023-10-14T19:03:54.982318+0000","last_clean":"2023-10-14T19:03:54.982318+0000","last_became_active":"2023-10-14T19:03:53.942272+0000","last_became_peered":"2023-10-14T19:03:53.942272+0000","last_unstale":"2023-10-14T19:03:54.982318+0000","last_undegraded":"2023-10-14T19:03:54.982318+0000","last_fullsized":"2023-10-14T19:03:54.982318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:41.140204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974554+0000","last_change":"2023-10-14T19:03:54.971970+0000","last_active":"2023-10-14T19:03:54.974554+0000","last_peered":"2023-10-14T19:03:54.974554+0000","last_clean":"2023-10-14T19:03:54.974554+0000","last_became_active":"2023-10-14T19:03:54.970108+0000","last_became_peered":"2023-10-14T19:03:54.970108+0000","last_unstale":"2023-10-14T19:03:54.974554+0000","last_undegraded":"2023-10-14T19:03:54.974554+0000","last_fullsized":"2023-10-14T19:03:54.974554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:32.176095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970028+0000","last_change":"2023-10-14T19:03:53.938546+0000","last_active":"2023-10-14T19:03:54.970028+0000","last_peered":"2023-10-14T19:03:54.970028+0000","last_clean":"2023-10-14T19:03:54.970028+0000","last_became_active":"2023-10-14T19:03:53.938208+0000","last_became_peered":"2023-10-14T19:03:53.938208+0000","last_unstale":"2023-10-14T19:03:54.970028+0000","last_undegraded":"2023-10-14T19:03:54.970028+0000","last_fullsized":"2023-10-14T19:03:54.970028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:39.636536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971900+0000","last_change":"2023-10-14T19:03:54.970510+0000","last_active":"2023-10-14T19:03:54.971900+0000","last_peered":"2023-10-14T19:03:54.971900+0000","last_clean":"2023-10-14T19:03:54.971900+0000","last_became_active":"2023-10-14T19:03:54.970240+0000","last_became_peered":"2023-10-14T19:03:54.970240+0000","last_unstale":"2023-10-14T19:03:54.971900+0000","last_undegraded":"2023-10-14T19:03:54.971900+0000","last_fullsized":"2023-10-14T19:03:54.971900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970175+0000","last_change":"2023-10-14T19:03:53.937706+0000","last_active":"2023-10-14T19:03:54.970175+0000","last_peered":"2023-10-14T19:03:54.970175+0000","last_clean":"2023-10-14T19:03:54.970175+0000","last_became_active":"2023-10-14T19:03:53.937443+0000","last_became_peered":"2023-10-14T19:03:53.937443+0000","last_unstale":"2023-10-14T19:03:54.970175+0000","last_undegraded":"2023-10-14T19:03:54.970175+0000","last_fullsized":"2023-10-14T19:03:54.970175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977609+0000","last_change":"2023-10-14T19:03:54.972267+0000","last_active":"2023-10-14T19:03:54.977609+0000","last_peered":"2023-10-14T19:03:54.977609+0000","last_clean":"2023-10-14T19:03:54.977609+0000","last_became_active":"2023-10-14T19:03:54.971632+0000","last_became_peered":"2023-10-14T19:03:54.971632+0000","last_unstale":"2023-10-14T19:03:54.977609+0000","last_undegraded":"2023-10-14T19:03:54.977609+0000","last_fullsized":"2023-10-14T19:03:54.977609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947801+0000","last_change":"2023-10-14T19:03:53.940727+0000","last_active":"2023-10-14T19:03:54.947801+0000","last_peered":"2023-10-14T19:03:54.947801+0000","last_clean":"2023-10-14T19:03:54.947801+0000","last_became_active":"2023-10-14T19:03:53.940465+0000","last_became_peered":"2023-10-14T19:03:53.940465+0000","last_unstale":"2023-10-14T19:03:54.947801+0000","last_undegraded":"2023-10-14T19:03:54.947801+0000","last_fullsized":"2023-10-14T19:03:54.947801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:45.865946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967741+0000","last_change":"2023-10-14T19:03:54.961292+0000","last_active":"2023-10-14T19:03:54.967741+0000","last_peered":"2023-10-14T19:03:54.967741+0000","last_clean":"2023-10-14T19:03:54.967741+0000","last_became_active":"2023-10-14T19:03:54.961000+0000","last_became_peered":"2023-10-14T19:03:54.961000+0000","last_unstale":"2023-10-14T19:03:54.967741+0000","last_undegraded":"2023-10-14T19:03:54.967741+0000","last_fullsized":"2023-10-14T19:03:54.967741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:04.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.978155+0000","last_change":"2023-10-14T19:03:53.942705+0000","last_active":"2023-10-14T19:03:54.978155+0000","last_peered":"2023-10-14T19:03:54.978155+0000","last_clean":"2023-10-14T19:03:54.978155+0000","last_became_active":"2023-10-14T19:03:53.942426+0000","last_became_peered":"2023-10-14T19:03:53.942426+0000","last_unstale":"2023-10-14T19:03:54.978155+0000","last_undegraded":"2023-10-14T19:03:54.978155+0000","last_fullsized":"2023-10-14T19:03:54.978155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:44.851605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975197+0000","last_change":"2023-10-14T19:03:54.969515+0000","last_active":"2023-10-14T19:03:54.975197+0000","last_peered":"2023-10-14T19:03:54.975197+0000","last_clean":"2023-10-14T19:03:54.975197+0000","last_became_active":"2023-10-14T19:03:54.969124+0000","last_became_peered":"2023-10-14T19:03:54.969124+0000","last_unstale":"2023-10-14T19:03:54.975197+0000","last_undegraded":"2023-10-14T19:03:54.975197+0000","last_fullsized":"2023-10-14T19:03:54.975197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977700+0000","last_change":"2023-10-14T19:03:53.942226+0000","last_active":"2023-10-14T19:03:54.977700+0000","last_peered":"2023-10-14T19:03:54.977700+0000","last_clean":"2023-10-14T19:03:54.977700+0000","last_became_active":"2023-10-14T19:03:53.941478+0000","last_became_peered":"2023-10-14T19:03:53.941478+0000","last_unstale":"2023-10-14T19:03:54.977700+0000","last_undegraded":"2023-10-14T19:03:54.977700+0000","last_fullsized":"2023-10-14T19:03:54.977700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966876+0000","last_change":"2023-10-14T19:03:54.963700+0000","last_active":"2023-10-14T19:03:54.966876+0000","last_peered":"2023-10-14T19:03:54.966876+0000","last_clean":"2023-10-14T19:03:54.966876+0000","last_became_active":"2023-10-14T19:03:54.963445+0000","last_became_peered":"2023-10-14T19:03:54.963445+0000","last_unstale":"2023-10-14T19:03:54.966876+0000","last_undegraded":"2023-10-14T19:03:54.966876+0000","last_fullsized":"2023-10-14T19:03:54.966876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969403+0000","last_change":"2023-10-14T19:03:53.932938+0000","last_active":"2023-10-14T19:03:54.969403+0000","last_peered":"2023-10-14T19:03:54.969403+0000","last_clean":"2023-10-14T19:03:54.969403+0000","last_became_active":"2023-10-14T19:03:53.932654+0000","last_became_peered":"2023-10-14T19:03:53.932654+0000","last_unstale":"2023-10-14T19:03:54.969403+0000","last_undegraded":"2023-10-14T19:03:54.969403+0000","last_fullsized":"2023-10-14T19:03:54.969403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:26.758367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979929+0000","last_change":"2023-10-14T19:03:54.978677+0000","last_active":"2023-10-14T19:03:54.979929+0000","last_peered":"2023-10-14T19:03:54.979929+0000","last_clean":"2023-10-14T19:03:54.979929+0000","last_became_active":"2023-10-14T19:03:54.978349+0000","last_became_peered":"2023-10-14T19:03:54.978349+0000","last_unstale":"2023-10-14T19:03:54.979929+0000","last_undegraded":"2023-10-14T19:03:54.979929+0000","last_fullsized":"2023-10-14T19:03:54.979929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:01.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966393+0000","last_change":"2023-10-14T19:03:53.930784+0000","last_active":"2023-10-14T19:03:54.966393+0000","last_peered":"2023-10-14T19:03:54.966393+0000","last_clean":"2023-10-14T19:03:54.966393+0000","last_became_active":"2023-10-14T19:03:53.930491+0000","last_became_peered":"2023-10-14T19:03:53.930491+0000","last_unstale":"2023-10-14T19:03:54.966393+0000","last_undegraded":"2023-10-14T19:03:54.966393+0000","last_fullsized":"2023-10-14T19:03:54.966393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:23.513627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970934+0000","last_change":"2023-10-14T19:03:54.969099+0000","last_active":"2023-10-14T19:03:54.970934+0000","last_peered":"2023-10-14T19:03:54.970934+0000","last_clean":"2023-10-14T19:03:54.970934+0000","last_became_active":"2023-10-14T19:03:54.968829+0000","last_became_peered":"2023-10-14T19:03:54.968829+0000","last_unstale":"2023-10-14T19:03:54.970934+0000","last_undegraded":"2023-10-14T19:03:54.970934+0000","last_fullsized":"2023-10-14T19:03:54.970934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:34.986850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.951255+0000","last_change":"2023-10-14T19:03:53.940717+0000","last_active":"2023-10-14T19:03:54.951255+0000","last_peered":"2023-10-14T19:03:54.951255+0000","last_clean":"2023-10-14T19:03:54.951255+0000","last_became_active":"2023-10-14T19:03:53.940375+0000","last_became_peered":"2023-10-14T19:03:53.940375+0000","last_unstale":"2023-10-14T19:03:54.951255+0000","last_undegraded":"2023-10-14T19:03:54.951255+0000","last_fullsized":"2023-10-14T19:03:54.951255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:54.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963220+0000","last_change":"2023-10-14T19:03:54.961261+0000","last_active":"2023-10-14T19:03:54.963220+0000","last_peered":"2023-10-14T19:03:54.963220+0000","last_clean":"2023-10-14T19:03:54.963220+0000","last_became_active":"2023-10-14T19:03:54.960605+0000","last_became_peered":"2023-10-14T19:03:54.960605+0000","last_unstale":"2023-10-14T19:03:54.963220+0000","last_undegraded":"2023-10-14T19:03:54.963220+0000","last_fullsized":"2023-10-14T19:03:54.963220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:23.620241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979233+0000","last_change":"2023-10-14T19:03:53.941991+0000","last_active":"2023-10-14T19:03:54.979233+0000","last_peered":"2023-10-14T19:03:54.979233+0000","last_clean":"2023-10-14T19:03:54.979233+0000","last_became_active":"2023-10-14T19:03:53.941742+0000","last_became_peered":"2023-10-14T19:03:53.941742+0000","last_unstale":"2023-10-14T19:03:54.979233+0000","last_undegraded":"2023-10-14T19:03:54.979233+0000","last_fullsized":"2023-10-14T19:03:54.979233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:54.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980536+0000","last_change":"2023-10-14T19:03:54.974751+0000","last_active":"2023-10-14T19:03:54.980536+0000","last_peered":"2023-10-14T19:03:54.980536+0000","last_clean":"2023-10-14T19:03:54.980536+0000","last_became_active":"2023-10-14T19:03:54.974115+0000","last_became_peered":"2023-10-14T19:03:54.974115+0000","last_unstale":"2023-10-14T19:03:54.980536+0000","last_undegraded":"2023-10-14T19:03:54.980536+0000","last_fullsized":"2023-10-14T19:03:54.980536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:41.312433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.954244+0000","last_change":"2023-10-14T19:03:53.939613+0000","last_active":"2023-10-14T19:03:54.954244+0000","last_peered":"2023-10-14T19:03:54.954244+0000","last_clean":"2023-10-14T19:03:54.954244+0000","last_became_active":"2023-10-14T19:03:53.939341+0000","last_became_peered":"2023-10-14T19:03:53.939341+0000","last_unstale":"2023-10-14T19:03:54.954244+0000","last_undegraded":"2023-10-14T19:03:54.954244+0000","last_fullsized":"2023-10-14T19:03:54.954244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969573+0000","last_change":"2023-10-14T19:03:54.967042+0000","last_active":"2023-10-14T19:03:54.969573+0000","last_peered":"2023-10-14T19:03:54.969573+0000","last_clean":"2023-10-14T19:03:54.969573+0000","last_became_active":"2023-10-14T19:03:54.966582+0000","last_became_peered":"2023-10-14T19:03:54.966582+0000","last_unstale":"2023-10-14T19:03:54.969573+0000","last_undegraded":"2023-10-14T19:03:54.969573+0000","last_fullsized":"2023-10-14T19:03:54.969573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:40.638520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950576+0000","last_change":"2023-10-14T19:03:53.935002+0000","last_active":"2023-10-14T19:03:54.950576+0000","last_peered":"2023-10-14T19:03:54.950576+0000","last_clean":"2023-10-14T19:03:54.950576+0000","last_became_active":"2023-10-14T19:03:53.934342+0000","last_became_peered":"2023-10-14T19:03:53.934342+0000","last_unstale":"2023-10-14T19:03:54.950576+0000","last_undegraded":"2023-10-14T19:03:54.950576+0000","last_fullsized":"2023-10-14T19:03:54.950576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:33.984865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977681+0000","last_change":"2023-10-14T19:03:54.973962+0000","last_active":"2023-10-14T19:03:54.977681+0000","last_peered":"2023-10-14T19:03:54.977681+0000","last_clean":"2023-10-14T19:03:54.977681+0000","last_became_active":"2023-10-14T19:03:54.973709+0000","last_became_peered":"2023-10-14T19:03:54.973709+0000","last_unstale":"2023-10-14T19:03:54.977681+0000","last_undegraded":"2023-10-14T19:03:54.977681+0000","last_fullsized":"2023-10-14T19:03:54.977681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.955697+0000","last_change":"2023-10-14T19:03:53.939589+0000","last_active":"2023-10-14T19:03:54.955697+0000","last_peered":"2023-10-14T19:03:54.955697+0000","last_clean":"2023-10-14T19:03:54.955697+0000","last_became_active":"2023-10-14T19:03:53.939322+0000","last_became_peered":"2023-10-14T19:03:53.939322+0000","last_unstale":"2023-10-14T19:03:54.955697+0000","last_undegraded":"2023-10-14T19:03:54.955697+0000","last_fullsized":"2023-10-14T19:03:54.955697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:37.508875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967694+0000","last_change":"2023-10-14T19:03:54.966771+0000","last_active":"2023-10-14T19:03:54.967694+0000","last_peered":"2023-10-14T19:03:54.967694+0000","last_clean":"2023-10-14T19:03:54.967694+0000","last_became_active":"2023-10-14T19:03:54.966456+0000","last_became_peered":"2023-10-14T19:03:54.966456+0000","last_unstale":"2023-10-14T19:03:54.967694+0000","last_undegraded":"2023-10-14T19:03:54.967694+0000","last_fullsized":"2023-10-14T19:03:54.967694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:55.887418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979939+0000","last_change":"2023-10-14T19:03:53.937224+0000","last_active":"2023-10-14T19:03:54.979939+0000","last_peered":"2023-10-14T19:03:54.979939+0000","last_clean":"2023-10-14T19:03:54.979939+0000","last_became_active":"2023-10-14T19:03:53.936906+0000","last_became_peered":"2023-10-14T19:03:53.936906+0000","last_unstale":"2023-10-14T19:03:54.979939+0000","last_undegraded":"2023-10-14T19:03:54.979939+0000","last_fullsized":"2023-10-14T19:03:54.979939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977449+0000","last_change":"2023-10-14T19:03:54.972347+0000","last_active":"2023-10-14T19:03:54.977449+0000","last_peered":"2023-10-14T19:03:54.977449+0000","last_clean":"2023-10-14T19:03:54.977449+0000","last_became_active":"2023-10-14T19:03:54.971682+0000","last_became_peered":"2023-10-14T19:03:54.971682+0000","last_unstale":"2023-10-14T19:03:54.977449+0000","last_undegraded":"2023-10-14T19:03:54.977449+0000","last_fullsized":"2023-10-14T19:03:54.977449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:18.417288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T19:03:55.966704+0000","last_change":"2023-10-14T19:03:53.941915+0000","last_active":"2023-10-14T19:03:55.966704+0000","last_peered":"2023-10-14T19:03:55.966704+0000","last_clean":"2023-10-14T19:03:55.966704+0000","last_became_active":"2023-10-14T19:03:53.941632+0000","last_became_peered":"2023-10-14T19:03:53.941632+0000","last_unstale":"2023-10-14T19:03:55.966704+0000","last_undegraded":"2023-10-14T19:03:55.966704+0000","last_fullsized":"2023-10-14T19:03:55.966704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980529+0000","last_change":"2023-10-14T19:03:54.978101+0000","last_active":"2023-10-14T19:03:54.980529+0000","last_peered":"2023-10-14T19:03:54.980529+0000","last_clean":"2023-10-14T19:03:54.980529+0000","last_became_active":"2023-10-14T19:03:54.975814+0000","last_became_peered":"2023-10-14T19:03:54.975814+0000","last_unstale":"2023-10-14T19:03:54.980529+0000","last_undegraded":"2023-10-14T19:03:54.980529+0000","last_fullsized":"2023-10-14T19:03:54.980529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965681+0000","last_change":"2023-10-14T19:03:53.933680+0000","last_active":"2023-10-14T19:03:54.965681+0000","last_peered":"2023-10-14T19:03:54.965681+0000","last_clean":"2023-10-14T19:03:54.965681+0000","last_became_active":"2023-10-14T19:03:53.933390+0000","last_became_peered":"2023-10-14T19:03:53.933390+0000","last_unstale":"2023-10-14T19:03:54.965681+0000","last_undegraded":"2023-10-14T19:03:54.965681+0000","last_fullsized":"2023-10-14T19:03:54.965681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:14.749737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972981+0000","last_change":"2023-10-14T19:03:54.968739+0000","last_active":"2023-10-14T19:03:54.972981+0000","last_peered":"2023-10-14T19:03:54.972981+0000","last_clean":"2023-10-14T19:03:54.972981+0000","last_became_active":"2023-10-14T19:03:54.968425+0000","last_became_peered":"2023-10-14T19:03:54.968425+0000","last_unstale":"2023-10-14T19:03:54.972981+0000","last_undegraded":"2023-10-14T19:03:54.972981+0000","last_fullsized":"2023-10-14T19:03:54.972981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.960092+0000","last_change":"2023-10-14T19:03:53.936231+0000","last_active":"2023-10-14T19:03:54.960092+0000","last_peered":"2023-10-14T19:03:54.960092+0000","last_clean":"2023-10-14T19:03:54.960092+0000","last_became_active":"2023-10-14T19:03:53.935966+0000","last_became_peered":"2023-10-14T19:03:53.935966+0000","last_unstale":"2023-10-14T19:03:54.960092+0000","last_undegraded":"2023-10-14T19:03:54.960092+0000","last_fullsized":"2023-10-14T19:03:54.960092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:22.618256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971770+0000","last_change":"2023-10-14T19:03:54.969820+0000","last_active":"2023-10-14T19:03:54.971770+0000","last_peered":"2023-10-14T19:03:54.971770+0000","last_clean":"2023-10-14T19:03:54.971770+0000","last_became_active":"2023-10-14T19:03:54.969457+0000","last_became_peered":"2023-10-14T19:03:54.969457+0000","last_unstale":"2023-10-14T19:03:54.971770+0000","last_undegraded":"2023-10-14T19:03:54.971770+0000","last_fullsized":"2023-10-14T19:03:54.971770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965460+0000","last_change":"2023-10-14T19:03:53.936109+0000","last_active":"2023-10-14T19:03:54.965460+0000","last_peered":"2023-10-14T19:03:54.965460+0000","last_clean":"2023-10-14T19:03:54.965460+0000","last_became_active":"2023-10-14T19:03:53.935804+0000","last_became_peered":"2023-10-14T19:03:53.935804+0000","last_unstale":"2023-10-14T19:03:54.965460+0000","last_undegraded":"2023-10-14T19:03:54.965460+0000","last_fullsized":"2023-10-14T19:03:54.965460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:13:14.209007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976861+0000","last_change":"2023-10-14T19:03:54.974912+0000","last_active":"2023-10-14T19:03:54.976861+0000","last_peered":"2023-10-14T19:03:54.976861+0000","last_clean":"2023-10-14T19:03:54.976861+0000","last_became_active":"2023-10-14T19:03:54.974654+0000","last_became_peered":"2023-10-14T19:03:54.974654+0000","last_unstale":"2023-10-14T19:03:54.976861+0000","last_undegraded":"2023-10-14T19:03:54.976861+0000","last_fullsized":"2023-10-14T19:03:54.976861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950687+0000","last_change":"2023-10-14T19:03:53.935058+0000","last_active":"2023-10-14T19:03:54.950687+0000","last_peered":"2023-10-14T19:03:54.950687+0000","last_clean":"2023-10-14T19:03:54.950687+0000","last_became_active":"2023-10-14T19:03:53.934116+0000","last_became_peered":"2023-10-14T19:03:53.934116+0000","last_unstale":"2023-10-14T19:03:54.950687+0000","last_undegraded":"2023-10-14T19:03:54.950687+0000","last_fullsized":"2023-10-14T19:03:54.950687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:03.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966612+0000","last_change":"2023-10-14T19:03:54.958822+0000","last_active":"2023-10-14T19:03:54.966612+0000","last_peered":"2023-10-14T19:03:54.966612+0000","last_clean":"2023-10-14T19:03:54.966612+0000","last_became_active":"2023-10-14T19:03:54.958568+0000","last_became_peered":"2023-10-14T19:03:54.958568+0000","last_unstale":"2023-10-14T19:03:54.966612+0000","last_undegraded":"2023-10-14T19:03:54.966612+0000","last_fullsized":"2023-10-14T19:03:54.966612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:43.294272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947921+0000","last_change":"2023-10-14T19:03:53.939493+0000","last_active":"2023-10-14T19:03:54.947921+0000","last_peered":"2023-10-14T19:03:54.947921+0000","last_clean":"2023-10-14T19:03:54.947921+0000","last_became_active":"2023-10-14T19:03:53.939228+0000","last_became_peered":"2023-10-14T19:03:53.939228+0000","last_unstale":"2023-10-14T19:03:54.947921+0000","last_undegraded":"2023-10-14T19:03:54.947921+0000","last_fullsized":"2023-10-14T19:03:54.947921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:24.037397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971926+0000","last_change":"2023-10-14T19:03:54.966591+0000","last_active":"2023-10-14T19:03:54.971926+0000","last_peered":"2023-10-14T19:03:54.971926+0000","last_clean":"2023-10-14T19:03:54.971926+0000","last_became_active":"2023-10-14T19:03:54.966352+0000","last_became_peered":"2023-10-14T19:03:54.966352+0000","last_unstale":"2023-10-14T19:03:54.971926+0000","last_undegraded":"2023-10-14T19:03:54.971926+0000","last_fullsized":"2023-10-14T19:03:54.971926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:01.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.957209+0000","last_change":"2023-10-14T19:03:53.939366+0000","last_active":"2023-10-14T19:03:54.957209+0000","last_peered":"2023-10-14T19:03:54.957209+0000","last_clean":"2023-10-14T19:03:54.957209+0000","last_became_active":"2023-10-14T19:03:53.939051+0000","last_became_peered":"2023-10-14T19:03:53.939051+0000","last_unstale":"2023-10-14T19:03:54.957209+0000","last_undegraded":"2023-10-14T19:03:54.957209+0000","last_fullsized":"2023-10-14T19:03:54.957209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963679+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:54.963679+0000","last_peered":"2023-10-14T19:03:54.963679+0000","last_clean":"2023-10-14T19:03:54.963679+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:54.963679+0000","last_undegraded":"2023-10-14T19:03:54.963679+0000","last_fullsized":"2023-10-14T19:03:54.963679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":734134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":143746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":138946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":143780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:04:03.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:04:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 Processor -- start 2023-10-14T19:04:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 -- start start 2023-10-14T19:04:03.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c800a8be0 0x7f2c800a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:03.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2c8006d280 0x7f2c800b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:03.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c800ce1a0 con 0x7f2c800ae780 2023-10-14T19:04:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800cd5d0 con 0x7f2c8006d280 2023-10-14T19:04:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.778+0000 7f2c86f0c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800cd870 con 0x7f2c800a8be0 2023-10-14T19:04:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2c8006d280 0x7f2c800b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c854a9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2c800ae780 0x7f2c800cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34700/0 (socket says 172.21.15.7:34700) 2023-10-14T19:04:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c854a9700 1 -- 172.21.15.7:0/1479805088 learned_addr learned my addr 172.21.15.7:0/1479805088 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c84ca8700 1 --2- 172.21.15.7:0/1479805088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c800a8be0 0x7f2c800a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7ffff700 1 -- 172.21.15.7:0/1479805088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c800a8be0 msgr2=0x7f2c800a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7ffff700 1 --2- 172.21.15.7:0/1479805088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c800a8be0 0x7f2c800a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7ffff700 1 -- 172.21.15.7:0/1479805088 >> v1:172.21.15.7:6789/0 conn(0x7f2c800ae780 legacy=0x7f2c800cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7ffff700 1 -- 172.21.15.7:0/1479805088 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800cdb50 con 0x7f2c8006d280 2023-10-14T19:04:03.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7ffff700 1 --2- 172.21.15.7:0/1479805088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8006d280 0x7f2c800b08c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2c740098d0 tx=0x7f2c74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ec6817c79ac363 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:03.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7f7fe700 1 -- 172.21.15.7:0/1479805088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74005c10 con 0x7f2c8006d280 2023-10-14T19:04:03.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7f7fe700 1 -- 172.21.15.7:0/1479805088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c74005d70 con 0x7f2c8006d280 2023-10-14T19:04:03.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.779+0000 7f2c7f7fe700 1 -- 172.21.15.7:0/1479805088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74006280 con 0x7f2c8006d280 2023-10-14T19:04:03.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 -- 172.21.15.7:0/1479805088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8006d280 msgr2=0x7f2c800b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/1479805088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8006d280 0x7f2c800b08c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2c740098d0 tx=0x7f2c74009120 comp rx=0 tx=0).stop 2023-10-14T19:04:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 -- 172.21.15.7:0/1479805088 shutdown_connections 2023-10-14T19:04:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/1479805088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c800a8be0 0x7f2c800a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/1479805088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8006d280 0x7f2c800b08c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 -- 172.21.15.7:0/1479805088 >> 172.21.15.7:0/1479805088 conn(0x7f2c8006ce80 msgr2=0x7f2c800ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 -- 172.21.15.7:0/1479805088 shutdown_connections 2023-10-14T19:04:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.780+0000 7f2c86f0c700 1 -- 172.21.15.7:0/1479805088 wait complete. 2023-10-14T19:04:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.781+0000 7f2c86f0c700 1 Processor -- start 2023-10-14T19:04:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.781+0000 7f2c86f0c700 1 -- start start 2023-10-14T19:04:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c86f0c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c8006d280 0x7f2c8009a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c86f0c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 0x7f2c80153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c86f0c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c800ae780 0x7f2c800b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c86f0c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8009b200 con 0x7f2c800a8be0 2023-10-14T19:04:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c86f0c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80098d20 con 0x7f2c800ae780 2023-10-14T19:04:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c86f0c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8009af20 con 0x7f2c8006d280 2023-10-14T19:04:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 0x7f2c80153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 0x7f2c80153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39984/0 (socket says 172.21.15.7:39984) 2023-10-14T19:04:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 -- 172.21.15.7:0/2179378610 learned_addr learned my addr 172.21.15.7:0/2179378610 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c854a9700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c800ae780 0x7f2c800b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c84ca8700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c8006d280 0x7f2c8009a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 -- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c8006d280 msgr2=0x7f2c8009a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c8006d280 0x7f2c8009a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 -- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c800ae780 msgr2=0x7f2c800b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c800ae780 0x7f2c800b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c7ffff700 1 -- 172.21.15.7:0/2179378610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740093c0 con 0x7f2c800a8be0 2023-10-14T19:04:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.782+0000 7f2c854a9700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c800ae780 0x7f2c800b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.783+0000 7f2c7ffff700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 0x7f2c80153960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2c74006210 tx=0x7f2c74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.783+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400b920 con 0x7f2c800a8be0 2023-10-14T19:04:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.783+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7400baa0 con 0x7f2c800a8be0 2023-10-14T19:04:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.783+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c800986d0 con 0x7f2c800a8be0 2023-10-14T19:04:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.783+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400be60 con 0x7f2c800a8be0 2023-10-14T19:04:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.783+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8009abe0 con 0x7f2c800a8be0 2023-10-14T19:04:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.784+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c80098530 con 0x7f2c800a8be0 2023-10-14T19:04:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.784+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c7401b690 con 0x7f2c800a8be0 2023-10-14T19:04:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.785+0000 7f2c7cff9700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c6c066f30 0x7f2c6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.785+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c74086440 con 0x7f2c800a8be0 2023-10-14T19:04:03.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.785+0000 7f2c84ca8700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c6c066f30 0x7f2c6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:03.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.785+0000 7f2c84ca8700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c6c066f30 0x7f2c6c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c80069020 tx=0x7f2c7800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:03.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.789+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c80098530 con 0x7f2c800a8be0 2023-10-14T19:04:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.977+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c80098530 con 0x7f2c6c066f30 2023-10-14T19:04:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.985+0000 7f2c7cff9700 1 -- 172.21.15.7:0/2179378610 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270733 (secure 0 0 0) 0x7f2c80098530 con 0x7f2c6c066f30 2023-10-14T19:04:03.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c6c066f30 msgr2=0x7f2c6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c6c066f30 0x7f2c6c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c80069020 tx=0x7f2c7800b040 comp rx=0 tx=0).stop 2023-10-14T19:04:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 msgr2=0x7f2c80153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:03.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 0x7f2c80153960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2c74006210 tx=0x7f2c74016000 comp rx=0 tx=0).stop 2023-10-14T19:04:03.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 shutdown_connections 2023-10-14T19:04:03.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c6c066f30 0x7f2c6c0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c800ae780 0x7f2c800b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c8006d280 0x7f2c8009a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 --2- 172.21.15.7:0/2179378610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c800a8be0 0x7f2c80153960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.988+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 >> 172.21.15.7:0/2179378610 conn(0x7f2c8006ce80 msgr2=0x7f2c800b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.989+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 shutdown_connections 2023-10-14T19:04:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:03.989+0000 7f2c86f0c700 1 -- 172.21.15.7:0/2179378610 wait complete. 2023-10-14T19:04:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:04:04.002 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-14T19:04:03.633992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382440,"kb_used_data":4136,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592280,"statfs":{"total":773094113280,"available":770654494720,"internally_reserved":0,"allocated":4235264,"data_stored":2334756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.687067"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972883+0000","last_change":"2023-10-14T19:03:54.965542+0000","last_active":"2023-10-14T19:03:54.972883+0000","last_peered":"2023-10-14T19:03:54.972883+0000","last_clean":"2023-10-14T19:03:54.972883+0000","last_became_active":"2023-10-14T19:03:54.965162+0000","last_became_peered":"2023-10-14T19:03:54.965162+0000","last_unstale":"2023-10-14T19:03:54.972883+0000","last_undegraded":"2023-10-14T19:03:54.972883+0000","last_fullsized":"2023-10-14T19:03:54.972883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970912+0000","last_change":"2023-10-14T19:03:54.969130+0000","last_active":"2023-10-14T19:03:54.970912+0000","last_peered":"2023-10-14T19:03:54.970912+0000","last_clean":"2023-10-14T19:03:54.970912+0000","last_became_active":"2023-10-14T19:03:54.968863+0000","last_became_peered":"2023-10-14T19:03:54.968863+0000","last_unstale":"2023-10-14T19:03:54.970912+0000","last_undegraded":"2023-10-14T19:03:54.970912+0000","last_fullsized":"2023-10-14T19:03:54.970912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:30.690416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980074+0000","last_change":"2023-10-14T19:03:54.976548+0000","last_active":"2023-10-14T19:03:54.980074+0000","last_peered":"2023-10-14T19:03:54.980074+0000","last_clean":"2023-10-14T19:03:54.980074+0000","last_became_active":"2023-10-14T19:03:54.976264+0000","last_became_peered":"2023-10-14T19:03:54.976264+0000","last_unstale":"2023-10-14T19:03:54.980074+0000","last_undegraded":"2023-10-14T19:03:54.980074+0000","last_fullsized":"2023-10-14T19:03:54.980074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:30.690416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979952+0000","last_change":"2023-10-14T19:03:54.978697+0000","last_active":"2023-10-14T19:03:54.979952+0000","last_peered":"2023-10-14T19:03:54.979952+0000","last_clean":"2023-10-14T19:03:54.979952+0000","last_became_active":"2023-10-14T19:03:54.978403+0000","last_became_peered":"2023-10-14T19:03:54.978403+0000","last_unstale":"2023-10-14T19:03:54.979952+0000","last_undegraded":"2023-10-14T19:03:54.979952+0000","last_fullsized":"2023-10-14T19:03:54.979952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.959703+0000","last_change":"2023-10-14T19:03:54.958469+0000","last_active":"2023-10-14T19:03:54.959703+0000","last_peered":"2023-10-14T19:03:54.959703+0000","last_clean":"2023-10-14T19:03:54.959703+0000","last_became_active":"2023-10-14T19:03:54.957362+0000","last_became_peered":"2023-10-14T19:03:54.957362+0000","last_unstale":"2023-10-14T19:03:54.959703+0000","last_undegraded":"2023-10-14T19:03:54.959703+0000","last_fullsized":"2023-10-14T19:03:54.959703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:34.678754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967928+0000","last_change":"2023-10-14T19:03:54.965611+0000","last_active":"2023-10-14T19:03:54.967928+0000","last_peered":"2023-10-14T19:03:54.967928+0000","last_clean":"2023-10-14T19:03:54.967928+0000","last_became_active":"2023-10-14T19:03:54.965195+0000","last_became_peered":"2023-10-14T19:03:54.965195+0000","last_unstale":"2023-10-14T19:03:54.967928+0000","last_undegraded":"2023-10-14T19:03:54.967928+0000","last_fullsized":"2023-10-14T19:03:54.967928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972517+0000","last_change":"2023-10-14T19:03:54.968465+0000","last_active":"2023-10-14T19:03:54.972517+0000","last_peered":"2023-10-14T19:03:54.972517+0000","last_clean":"2023-10-14T19:03:54.972517+0000","last_became_active":"2023-10-14T19:03:54.968158+0000","last_became_peered":"2023-10-14T19:03:54.968158+0000","last_unstale":"2023-10-14T19:03:54.972517+0000","last_undegraded":"2023-10-14T19:03:54.972517+0000","last_fullsized":"2023-10-14T19:03:54.972517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:30.582842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967852+0000","last_change":"2023-10-14T19:03:54.964936+0000","last_active":"2023-10-14T19:03:54.967852+0000","last_peered":"2023-10-14T19:03:54.967852+0000","last_clean":"2023-10-14T19:03:54.967852+0000","last_became_active":"2023-10-14T19:03:54.964669+0000","last_became_peered":"2023-10-14T19:03:54.964669+0000","last_unstale":"2023-10-14T19:03:54.967852+0000","last_undegraded":"2023-10-14T19:03:54.967852+0000","last_fullsized":"2023-10-14T19:03:54.967852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977907+0000","last_change":"2023-10-14T19:03:54.974543+0000","last_active":"2023-10-14T19:03:54.977907+0000","last_peered":"2023-10-14T19:03:54.977907+0000","last_clean":"2023-10-14T19:03:54.977907+0000","last_became_active":"2023-10-14T19:03:54.974298+0000","last_became_peered":"2023-10-14T19:03:54.974298+0000","last_unstale":"2023-10-14T19:03:54.977907+0000","last_undegraded":"2023-10-14T19:03:54.977907+0000","last_fullsized":"2023-10-14T19:03:54.977907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:57:24.099372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979891+0000","last_change":"2023-10-14T19:03:54.978355+0000","last_active":"2023-10-14T19:03:54.979891+0000","last_peered":"2023-10-14T19:03:54.979891+0000","last_clean":"2023-10-14T19:03:54.979891+0000","last_became_active":"2023-10-14T19:03:54.978069+0000","last_became_peered":"2023-10-14T19:03:54.978069+0000","last_unstale":"2023-10-14T19:03:54.979891+0000","last_undegraded":"2023-10-14T19:03:54.979891+0000","last_fullsized":"2023-10-14T19:03:54.979891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.983296+0000","last_change":"2023-10-14T19:03:54.980346+0000","last_active":"2023-10-14T19:03:54.983296+0000","last_peered":"2023-10-14T19:03:54.983296+0000","last_clean":"2023-10-14T19:03:54.983296+0000","last_became_active":"2023-10-14T19:03:54.980027+0000","last_became_peered":"2023-10-14T19:03:54.980027+0000","last_unstale":"2023-10-14T19:03:54.983296+0000","last_undegraded":"2023-10-14T19:03:54.983296+0000","last_fullsized":"2023-10-14T19:03:54.983296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965414+0000","last_change":"2023-10-14T19:03:54.961366+0000","last_active":"2023-10-14T19:03:54.965414+0000","last_peered":"2023-10-14T19:03:54.965414+0000","last_clean":"2023-10-14T19:03:54.965414+0000","last_became_active":"2023-10-14T19:03:54.961076+0000","last_became_peered":"2023-10-14T19:03:54.961076+0000","last_unstale":"2023-10-14T19:03:54.965414+0000","last_undegraded":"2023-10-14T19:03:54.965414+0000","last_fullsized":"2023-10-14T19:03:54.965414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980552+0000","last_change":"2023-10-14T19:03:54.974954+0000","last_active":"2023-10-14T19:03:54.980552+0000","last_peered":"2023-10-14T19:03:54.980552+0000","last_clean":"2023-10-14T19:03:54.980552+0000","last_became_active":"2023-10-14T19:03:54.974480+0000","last_became_peered":"2023-10-14T19:03:54.974480+0000","last_unstale":"2023-10-14T19:03:54.980552+0000","last_undegraded":"2023-10-14T19:03:54.980552+0000","last_fullsized":"2023-10-14T19:03:54.980552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:44.445832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965706+0000","last_change":"2023-10-14T19:03:54.958128+0000","last_active":"2023-10-14T19:03:54.965706+0000","last_peered":"2023-10-14T19:03:54.965706+0000","last_clean":"2023-10-14T19:03:54.965706+0000","last_became_active":"2023-10-14T19:03:54.957843+0000","last_became_peered":"2023-10-14T19:03:54.957843+0000","last_unstale":"2023-10-14T19:03:54.965706+0000","last_undegraded":"2023-10-14T19:03:54.965706+0000","last_fullsized":"2023-10-14T19:03:54.965706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966657+0000","last_change":"2023-10-14T19:03:54.961919+0000","last_active":"2023-10-14T19:03:54.966657+0000","last_peered":"2023-10-14T19:03:54.966657+0000","last_clean":"2023-10-14T19:03:54.966657+0000","last_became_active":"2023-10-14T19:03:54.961088+0000","last_became_peered":"2023-10-14T19:03:54.961088+0000","last_unstale":"2023-10-14T19:03:54.966657+0000","last_undegraded":"2023-10-14T19:03:54.966657+0000","last_fullsized":"2023-10-14T19:03:54.966657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977650+0000","last_change":"2023-10-14T19:03:54.973187+0000","last_active":"2023-10-14T19:03:54.977650+0000","last_peered":"2023-10-14T19:03:54.977650+0000","last_clean":"2023-10-14T19:03:54.977650+0000","last_became_active":"2023-10-14T19:03:54.972754+0000","last_became_peered":"2023-10-14T19:03:54.972754+0000","last_unstale":"2023-10-14T19:03:54.977650+0000","last_undegraded":"2023-10-14T19:03:54.977650+0000","last_fullsized":"2023-10-14T19:03:54.977650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972664+0000","last_change":"2023-10-14T19:03:54.969485+0000","last_active":"2023-10-14T19:03:54.972664+0000","last_peered":"2023-10-14T19:03:54.972664+0000","last_clean":"2023-10-14T19:03:54.972664+0000","last_became_active":"2023-10-14T19:03:54.969231+0000","last_became_peered":"2023-10-14T19:03:54.969231+0000","last_unstale":"2023-10-14T19:03:54.972664+0000","last_undegraded":"2023-10-14T19:03:54.972664+0000","last_fullsized":"2023-10-14T19:03:54.972664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976701+0000","last_change":"2023-10-14T19:03:54.974412+0000","last_active":"2023-10-14T19:03:54.976701+0000","last_peered":"2023-10-14T19:03:54.976701+0000","last_clean":"2023-10-14T19:03:54.976701+0000","last_became_active":"2023-10-14T19:03:54.974130+0000","last_became_peered":"2023-10-14T19:03:54.974130+0000","last_unstale":"2023-10-14T19:03:54.976701+0000","last_undegraded":"2023-10-14T19:03:54.976701+0000","last_fullsized":"2023-10-14T19:03:54.976701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979176+0000","last_change":"2023-10-14T19:03:54.977115+0000","last_active":"2023-10-14T19:03:54.979176+0000","last_peered":"2023-10-14T19:03:54.979176+0000","last_clean":"2023-10-14T19:03:54.979176+0000","last_became_active":"2023-10-14T19:03:54.976848+0000","last_became_peered":"2023-10-14T19:03:54.976848+0000","last_unstale":"2023-10-14T19:03:54.979176+0000","last_undegraded":"2023-10-14T19:03:54.979176+0000","last_fullsized":"2023-10-14T19:03:54.979176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:30.582842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966977+0000","last_change":"2023-10-14T19:03:54.965077+0000","last_active":"2023-10-14T19:03:54.966977+0000","last_peered":"2023-10-14T19:03:54.966977+0000","last_clean":"2023-10-14T19:03:54.966977+0000","last_became_active":"2023-10-14T19:03:54.964803+0000","last_became_peered":"2023-10-14T19:03:54.964803+0000","last_unstale":"2023-10-14T19:03:54.966977+0000","last_undegraded":"2023-10-14T19:03:54.966977+0000","last_fullsized":"2023-10-14T19:03:54.966977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:05.011075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977629+0000","last_change":"2023-10-14T19:03:54.970579+0000","last_active":"2023-10-14T19:03:54.977629+0000","last_peered":"2023-10-14T19:03:54.977629+0000","last_clean":"2023-10-14T19:03:54.977629+0000","last_became_active":"2023-10-14T19:03:54.970269+0000","last_became_peered":"2023-10-14T19:03:54.970269+0000","last_unstale":"2023-10-14T19:03:54.977629+0000","last_undegraded":"2023-10-14T19:03:54.977629+0000","last_fullsized":"2023-10-14T19:03:54.977629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967785+0000","last_change":"2023-10-14T19:03:54.959826+0000","last_active":"2023-10-14T19:03:54.967785+0000","last_peered":"2023-10-14T19:03:54.967785+0000","last_clean":"2023-10-14T19:03:54.967785+0000","last_became_active":"2023-10-14T19:03:54.959525+0000","last_became_peered":"2023-10-14T19:03:54.959525+0000","last_unstale":"2023-10-14T19:03:54.967785+0000","last_undegraded":"2023-10-14T19:03:54.967785+0000","last_fullsized":"2023-10-14T19:03:54.967785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:00:53.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971498+0000","last_change":"2023-10-14T19:03:54.968843+0000","last_active":"2023-10-14T19:03:54.971498+0000","last_peered":"2023-10-14T19:03:54.971498+0000","last_clean":"2023-10-14T19:03:54.971498+0000","last_became_active":"2023-10-14T19:03:54.968567+0000","last_became_peered":"2023-10-14T19:03:54.968567+0000","last_unstale":"2023-10-14T19:03:54.971498+0000","last_undegraded":"2023-10-14T19:03:54.971498+0000","last_fullsized":"2023-10-14T19:03:54.971498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:46.867930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965459+0000","last_change":"2023-10-14T19:03:54.961787+0000","last_active":"2023-10-14T19:03:54.965459+0000","last_peered":"2023-10-14T19:03:54.965459+0000","last_clean":"2023-10-14T19:03:54.965459+0000","last_became_active":"2023-10-14T19:03:54.961561+0000","last_became_peered":"2023-10-14T19:03:54.961561+0000","last_unstale":"2023-10-14T19:03:54.965459+0000","last_undegraded":"2023-10-14T19:03:54.965459+0000","last_fullsized":"2023-10-14T19:03:54.965459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975336+0000","last_change":"2023-10-14T19:03:54.972284+0000","last_active":"2023-10-14T19:03:54.975336+0000","last_peered":"2023-10-14T19:03:54.975336+0000","last_clean":"2023-10-14T19:03:54.975336+0000","last_became_active":"2023-10-14T19:03:54.972015+0000","last_became_peered":"2023-10-14T19:03:54.972015+0000","last_unstale":"2023-10-14T19:03:54.975336+0000","last_undegraded":"2023-10-14T19:03:54.975336+0000","last_fullsized":"2023-10-14T19:03:54.975336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:48.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970895+0000","last_change":"2023-10-14T19:03:54.966444+0000","last_active":"2023-10-14T19:03:54.970895+0000","last_peered":"2023-10-14T19:03:54.970895+0000","last_clean":"2023-10-14T19:03:54.970895+0000","last_became_active":"2023-10-14T19:03:54.966176+0000","last_became_peered":"2023-10-14T19:03:54.966176+0000","last_unstale":"2023-10-14T19:03:54.970895+0000","last_undegraded":"2023-10-14T19:03:54.970895+0000","last_fullsized":"2023-10-14T19:03:54.970895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:18.417288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980552+0000","last_change":"2023-10-14T19:03:54.979276+0000","last_active":"2023-10-14T19:03:54.980552+0000","last_peered":"2023-10-14T19:03:54.980552+0000","last_clean":"2023-10-14T19:03:54.980552+0000","last_became_active":"2023-10-14T19:03:54.978992+0000","last_became_peered":"2023-10-14T19:03:54.978992+0000","last_unstale":"2023-10-14T19:03:54.980552+0000","last_undegraded":"2023-10-14T19:03:54.980552+0000","last_fullsized":"2023-10-14T19:03:54.980552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965433+0000","last_change":"2023-10-14T19:03:54.963040+0000","last_active":"2023-10-14T19:03:54.965433+0000","last_peered":"2023-10-14T19:03:54.965433+0000","last_clean":"2023-10-14T19:03:54.965433+0000","last_became_active":"2023-10-14T19:03:54.962791+0000","last_became_peered":"2023-10-14T19:03:54.962791+0000","last_unstale":"2023-10-14T19:03:54.965433+0000","last_undegraded":"2023-10-14T19:03:54.965433+0000","last_fullsized":"2023-10-14T19:03:54.965433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:59.984579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969862+0000","last_change":"2023-10-14T19:03:54.959358+0000","last_active":"2023-10-14T19:03:54.969862+0000","last_peered":"2023-10-14T19:03:54.969862+0000","last_clean":"2023-10-14T19:03:54.969862+0000","last_became_active":"2023-10-14T19:03:54.959098+0000","last_became_peered":"2023-10-14T19:03:54.959098+0000","last_unstale":"2023-10-14T19:03:54.969862+0000","last_undegraded":"2023-10-14T19:03:54.969862+0000","last_fullsized":"2023-10-14T19:03:54.969862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:04.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972489+0000","last_change":"2023-10-14T19:03:54.968457+0000","last_active":"2023-10-14T19:03:54.972489+0000","last_peered":"2023-10-14T19:03:54.972489+0000","last_clean":"2023-10-14T19:03:54.972489+0000","last_became_active":"2023-10-14T19:03:54.968173+0000","last_became_peered":"2023-10-14T19:03:54.968173+0000","last_unstale":"2023-10-14T19:03:54.972489+0000","last_undegraded":"2023-10-14T19:03:54.972489+0000","last_fullsized":"2023-10-14T19:03:54.972489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:32.176095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963419+0000","last_change":"2023-10-14T19:03:54.958453+0000","last_active":"2023-10-14T19:03:54.963419+0000","last_peered":"2023-10-14T19:03:54.963419+0000","last_clean":"2023-10-14T19:03:54.963419+0000","last_became_active":"2023-10-14T19:03:54.958180+0000","last_became_peered":"2023-10-14T19:03:54.958180+0000","last_unstale":"2023-10-14T19:03:54.963419+0000","last_undegraded":"2023-10-14T19:03:54.963419+0000","last_fullsized":"2023-10-14T19:03:54.963419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:00:53.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977632+0000","last_change":"2023-10-14T19:03:54.972307+0000","last_active":"2023-10-14T19:03:54.977632+0000","last_peered":"2023-10-14T19:03:54.977632+0000","last_clean":"2023-10-14T19:03:54.977632+0000","last_became_active":"2023-10-14T19:03:54.971972+0000","last_became_peered":"2023-10-14T19:03:54.971972+0000","last_unstale":"2023-10-14T19:03:54.977632+0000","last_undegraded":"2023-10-14T19:03:54.977632+0000","last_fullsized":"2023-10-14T19:03:54.977632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971395+0000","last_change":"2023-10-14T19:03:54.968757+0000","last_active":"2023-10-14T19:03:54.971395+0000","last_peered":"2023-10-14T19:03:54.971395+0000","last_clean":"2023-10-14T19:03:54.971395+0000","last_became_active":"2023-10-14T19:03:54.968462+0000","last_became_peered":"2023-10-14T19:03:54.968462+0000","last_unstale":"2023-10-14T19:03:54.971395+0000","last_undegraded":"2023-10-14T19:03:54.971395+0000","last_fullsized":"2023-10-14T19:03:54.971395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.968175+0000","last_change":"2023-10-14T19:03:53.938414+0000","last_active":"2023-10-14T19:03:54.968175+0000","last_peered":"2023-10-14T19:03:54.968175+0000","last_clean":"2023-10-14T19:03:54.968175+0000","last_became_active":"2023-10-14T19:03:53.938118+0000","last_became_peered":"2023-10-14T19:03:53.938118+0000","last_unstale":"2023-10-14T19:03:54.968175+0000","last_undegraded":"2023-10-14T19:03:54.968175+0000","last_fullsized":"2023-10-14T19:03:54.968175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.973391+0000","last_change":"2023-10-14T19:03:54.969609+0000","last_active":"2023-10-14T19:03:54.973391+0000","last_peered":"2023-10-14T19:03:54.973391+0000","last_clean":"2023-10-14T19:03:54.973391+0000","last_became_active":"2023-10-14T19:03:54.969323+0000","last_became_peered":"2023-10-14T19:03:54.969323+0000","last_unstale":"2023-10-14T19:03:54.973391+0000","last_undegraded":"2023-10-14T19:03:54.973391+0000","last_fullsized":"2023-10-14T19:03:54.973391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974713+0000","last_change":"2023-10-14T19:03:53.934075+0000","last_active":"2023-10-14T19:03:54.974713+0000","last_peered":"2023-10-14T19:03:54.974713+0000","last_clean":"2023-10-14T19:03:54.974713+0000","last_became_active":"2023-10-14T19:03:53.933765+0000","last_became_peered":"2023-10-14T19:03:53.933765+0000","last_unstale":"2023-10-14T19:03:54.974713+0000","last_undegraded":"2023-10-14T19:03:54.974713+0000","last_fullsized":"2023-10-14T19:03:54.974713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967813+0000","last_change":"2023-10-14T19:03:54.961630+0000","last_active":"2023-10-14T19:03:54.967813+0000","last_peered":"2023-10-14T19:03:54.967813+0000","last_clean":"2023-10-14T19:03:54.967813+0000","last_became_active":"2023-10-14T19:03:54.961383+0000","last_became_peered":"2023-10-14T19:03:54.961383+0000","last_unstale":"2023-10-14T19:03:54.967813+0000","last_undegraded":"2023-10-14T19:03:54.967813+0000","last_fullsized":"2023-10-14T19:03:54.967813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976605+0000","last_change":"2023-10-14T19:03:53.941920+0000","last_active":"2023-10-14T19:03:54.976605+0000","last_peered":"2023-10-14T19:03:54.976605+0000","last_clean":"2023-10-14T19:03:54.976605+0000","last_became_active":"2023-10-14T19:03:53.941656+0000","last_became_peered":"2023-10-14T19:03:53.941656+0000","last_unstale":"2023-10-14T19:03:54.976605+0000","last_undegraded":"2023-10-14T19:03:54.976605+0000","last_fullsized":"2023-10-14T19:03:54.976605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:14.749737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979923+0000","last_change":"2023-10-14T19:03:54.979145+0000","last_active":"2023-10-14T19:03:54.979923+0000","last_peered":"2023-10-14T19:03:54.979923+0000","last_clean":"2023-10-14T19:03:54.979923+0000","last_became_active":"2023-10-14T19:03:54.978677+0000","last_became_peered":"2023-10-14T19:03:54.978677+0000","last_unstale":"2023-10-14T19:03:54.979923+0000","last_undegraded":"2023-10-14T19:03:54.979923+0000","last_fullsized":"2023-10-14T19:03:54.979923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:57:24.099372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.957715+0000","last_change":"2023-10-14T19:03:53.929740+0000","last_active":"2023-10-14T19:03:54.957715+0000","last_peered":"2023-10-14T19:03:54.957715+0000","last_clean":"2023-10-14T19:03:54.957715+0000","last_became_active":"2023-10-14T19:03:53.929456+0000","last_became_peered":"2023-10-14T19:03:53.929456+0000","last_unstale":"2023-10-14T19:03:54.957715+0000","last_undegraded":"2023-10-14T19:03:54.957715+0000","last_fullsized":"2023-10-14T19:03:54.957715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:46.800352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975037+0000","last_change":"2023-10-14T19:03:54.971564+0000","last_active":"2023-10-14T19:03:54.975037+0000","last_peered":"2023-10-14T19:03:54.975037+0000","last_clean":"2023-10-14T19:03:54.975037+0000","last_became_active":"2023-10-14T19:03:54.971198+0000","last_became_peered":"2023-10-14T19:03:54.971198+0000","last_unstale":"2023-10-14T19:03:54.975037+0000","last_undegraded":"2023-10-14T19:03:54.975037+0000","last_fullsized":"2023-10-14T19:03:54.975037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969892+0000","last_change":"2023-10-14T19:03:53.934830+0000","last_active":"2023-10-14T19:03:54.969892+0000","last_peered":"2023-10-14T19:03:54.969892+0000","last_clean":"2023-10-14T19:03:54.969892+0000","last_became_active":"2023-10-14T19:03:53.934166+0000","last_became_peered":"2023-10-14T19:03:53.934166+0000","last_unstale":"2023-10-14T19:03:54.969892+0000","last_undegraded":"2023-10-14T19:03:54.969892+0000","last_fullsized":"2023-10-14T19:03:54.969892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:43.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977377+0000","last_change":"2023-10-14T19:03:54.971536+0000","last_active":"2023-10-14T19:03:54.977377+0000","last_peered":"2023-10-14T19:03:54.977377+0000","last_clean":"2023-10-14T19:03:54.977377+0000","last_became_active":"2023-10-14T19:03:54.971240+0000","last_became_peered":"2023-10-14T19:03:54.971240+0000","last_unstale":"2023-10-14T19:03:54.977377+0000","last_undegraded":"2023-10-14T19:03:54.977377+0000","last_fullsized":"2023-10-14T19:03:54.977377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:16.447198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966381+0000","last_change":"2023-10-14T19:03:53.933946+0000","last_active":"2023-10-14T19:03:54.966381+0000","last_peered":"2023-10-14T19:03:54.966381+0000","last_clean":"2023-10-14T19:03:54.966381+0000","last_became_active":"2023-10-14T19:03:53.933656+0000","last_became_peered":"2023-10-14T19:03:53.933656+0000","last_unstale":"2023-10-14T19:03:54.966381+0000","last_undegraded":"2023-10-14T19:03:54.966381+0000","last_fullsized":"2023-10-14T19:03:54.966381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:22.618256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963254+0000","last_change":"2023-10-14T19:03:54.954930+0000","last_active":"2023-10-14T19:03:54.963254+0000","last_peered":"2023-10-14T19:03:54.963254+0000","last_clean":"2023-10-14T19:03:54.963254+0000","last_became_active":"2023-10-14T19:03:54.954689+0000","last_became_peered":"2023-10-14T19:03:54.954689+0000","last_unstale":"2023-10-14T19:03:54.963254+0000","last_undegraded":"2023-10-14T19:03:54.963254+0000","last_fullsized":"2023-10-14T19:03:54.963254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:42.142189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947784+0000","last_change":"2023-10-14T19:03:53.937049+0000","last_active":"2023-10-14T19:03:54.947784+0000","last_peered":"2023-10-14T19:03:54.947784+0000","last_clean":"2023-10-14T19:03:54.947784+0000","last_became_active":"2023-10-14T19:03:53.936834+0000","last_became_peered":"2023-10-14T19:03:53.936834+0000","last_unstale":"2023-10-14T19:03:54.947784+0000","last_undegraded":"2023-10-14T19:03:54.947784+0000","last_fullsized":"2023-10-14T19:03:54.947784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:37.508875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974585+0000","last_change":"2023-10-14T19:03:54.972421+0000","last_active":"2023-10-14T19:03:54.974585+0000","last_peered":"2023-10-14T19:03:54.974585+0000","last_clean":"2023-10-14T19:03:54.974585+0000","last_became_active":"2023-10-14T19:03:54.970191+0000","last_became_peered":"2023-10-14T19:03:54.970191+0000","last_unstale":"2023-10-14T19:03:54.974585+0000","last_undegraded":"2023-10-14T19:03:54.974585+0000","last_fullsized":"2023-10-14T19:03:54.974585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:43.294272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950419+0000","last_change":"2023-10-14T19:03:53.932989+0000","last_active":"2023-10-14T19:03:54.950419+0000","last_peered":"2023-10-14T19:03:54.950419+0000","last_clean":"2023-10-14T19:03:54.950419+0000","last_became_active":"2023-10-14T19:03:53.932698+0000","last_became_peered":"2023-10-14T19:03:53.932698+0000","last_unstale":"2023-10-14T19:03:54.950419+0000","last_undegraded":"2023-10-14T19:03:54.950419+0000","last_fullsized":"2023-10-14T19:03:54.950419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:43.931855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965613+0000","last_change":"2023-10-14T19:03:54.961354+0000","last_active":"2023-10-14T19:03:54.965613+0000","last_peered":"2023-10-14T19:03:54.965613+0000","last_clean":"2023-10-14T19:03:54.965613+0000","last_became_active":"2023-10-14T19:03:54.961058+0000","last_became_peered":"2023-10-14T19:03:54.961058+0000","last_unstale":"2023-10-14T19:03:54.965613+0000","last_undegraded":"2023-10-14T19:03:54.965613+0000","last_fullsized":"2023-10-14T19:03:54.965613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:02.899701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.948311+0000","last_change":"2023-10-14T19:03:53.940701+0000","last_active":"2023-10-14T19:03:54.948311+0000","last_peered":"2023-10-14T19:03:54.948311+0000","last_clean":"2023-10-14T19:03:54.948311+0000","last_became_active":"2023-10-14T19:03:53.940428+0000","last_became_peered":"2023-10-14T19:03:53.940428+0000","last_unstale":"2023-10-14T19:03:54.948311+0000","last_undegraded":"2023-10-14T19:03:54.948311+0000","last_fullsized":"2023-10-14T19:03:54.948311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:13:14.209007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977261+0000","last_change":"2023-10-14T19:03:54.975517+0000","last_active":"2023-10-14T19:03:54.977261+0000","last_peered":"2023-10-14T19:03:54.977261+0000","last_clean":"2023-10-14T19:03:54.977261+0000","last_became_active":"2023-10-14T19:03:54.975244+0000","last_became_peered":"2023-10-14T19:03:54.975244+0000","last_unstale":"2023-10-14T19:03:54.977261+0000","last_undegraded":"2023-10-14T19:03:54.977261+0000","last_fullsized":"2023-10-14T19:03:54.977261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.958501+0000","last_change":"2023-10-14T19:03:53.939672+0000","last_active":"2023-10-14T19:03:54.958501+0000","last_peered":"2023-10-14T19:03:54.958501+0000","last_clean":"2023-10-14T19:03:54.958501+0000","last_became_active":"2023-10-14T19:03:53.939343+0000","last_became_peered":"2023-10-14T19:03:53.939343+0000","last_unstale":"2023-10-14T19:03:54.958501+0000","last_undegraded":"2023-10-14T19:03:54.958501+0000","last_fullsized":"2023-10-14T19:03:54.958501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970270+0000","last_change":"2023-10-14T19:03:54.966074+0000","last_active":"2023-10-14T19:03:54.970270+0000","last_peered":"2023-10-14T19:03:54.970270+0000","last_clean":"2023-10-14T19:03:54.970270+0000","last_became_active":"2023-10-14T19:03:54.965793+0000","last_became_peered":"2023-10-14T19:03:54.965793+0000","last_unstale":"2023-10-14T19:03:54.970270+0000","last_undegraded":"2023-10-14T19:03:54.970270+0000","last_fullsized":"2023-10-14T19:03:54.970270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:50.814259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966136+0000","last_change":"2023-10-14T19:03:53.937854+0000","last_active":"2023-10-14T19:03:54.966136+0000","last_peered":"2023-10-14T19:03:54.966136+0000","last_clean":"2023-10-14T19:03:54.966136+0000","last_became_active":"2023-10-14T19:03:53.937577+0000","last_became_peered":"2023-10-14T19:03:53.937577+0000","last_unstale":"2023-10-14T19:03:54.966136+0000","last_undegraded":"2023-10-14T19:03:54.966136+0000","last_fullsized":"2023-10-14T19:03:54.966136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:41.140204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980092+0000","last_change":"2023-10-14T19:03:54.976558+0000","last_active":"2023-10-14T19:03:54.980092+0000","last_peered":"2023-10-14T19:03:54.980092+0000","last_clean":"2023-10-14T19:03:54.980092+0000","last_became_active":"2023-10-14T19:03:54.976269+0000","last_became_peered":"2023-10-14T19:03:54.976269+0000","last_unstale":"2023-10-14T19:03:54.980092+0000","last_undegraded":"2023-10-14T19:03:54.980092+0000","last_fullsized":"2023-10-14T19:03:54.980092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:50.814259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.982318+0000","last_change":"2023-10-14T19:03:53.942558+0000","last_active":"2023-10-14T19:03:54.982318+0000","last_peered":"2023-10-14T19:03:54.982318+0000","last_clean":"2023-10-14T19:03:54.982318+0000","last_became_active":"2023-10-14T19:03:53.942272+0000","last_became_peered":"2023-10-14T19:03:53.942272+0000","last_unstale":"2023-10-14T19:03:54.982318+0000","last_undegraded":"2023-10-14T19:03:54.982318+0000","last_fullsized":"2023-10-14T19:03:54.982318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:41.140204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.974554+0000","last_change":"2023-10-14T19:03:54.971970+0000","last_active":"2023-10-14T19:03:54.974554+0000","last_peered":"2023-10-14T19:03:54.974554+0000","last_clean":"2023-10-14T19:03:54.974554+0000","last_became_active":"2023-10-14T19:03:54.970108+0000","last_became_peered":"2023-10-14T19:03:54.970108+0000","last_unstale":"2023-10-14T19:03:54.974554+0000","last_undegraded":"2023-10-14T19:03:54.974554+0000","last_fullsized":"2023-10-14T19:03:54.974554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:32.176095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970028+0000","last_change":"2023-10-14T19:03:53.938546+0000","last_active":"2023-10-14T19:03:54.970028+0000","last_peered":"2023-10-14T19:03:54.970028+0000","last_clean":"2023-10-14T19:03:54.970028+0000","last_became_active":"2023-10-14T19:03:53.938208+0000","last_became_peered":"2023-10-14T19:03:53.938208+0000","last_unstale":"2023-10-14T19:03:54.970028+0000","last_undegraded":"2023-10-14T19:03:54.970028+0000","last_fullsized":"2023-10-14T19:03:54.970028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:39.636536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971900+0000","last_change":"2023-10-14T19:03:54.970510+0000","last_active":"2023-10-14T19:03:54.971900+0000","last_peered":"2023-10-14T19:03:54.971900+0000","last_clean":"2023-10-14T19:03:54.971900+0000","last_became_active":"2023-10-14T19:03:54.970240+0000","last_became_peered":"2023-10-14T19:03:54.970240+0000","last_unstale":"2023-10-14T19:03:54.971900+0000","last_undegraded":"2023-10-14T19:03:54.971900+0000","last_fullsized":"2023-10-14T19:03:54.971900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.464581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970175+0000","last_change":"2023-10-14T19:03:53.937706+0000","last_active":"2023-10-14T19:03:54.970175+0000","last_peered":"2023-10-14T19:03:54.970175+0000","last_clean":"2023-10-14T19:03:54.970175+0000","last_became_active":"2023-10-14T19:03:53.937443+0000","last_became_peered":"2023-10-14T19:03:53.937443+0000","last_unstale":"2023-10-14T19:03:54.970175+0000","last_undegraded":"2023-10-14T19:03:54.970175+0000","last_fullsized":"2023-10-14T19:03:54.970175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:04.009090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977609+0000","last_change":"2023-10-14T19:03:54.972267+0000","last_active":"2023-10-14T19:03:54.977609+0000","last_peered":"2023-10-14T19:03:54.977609+0000","last_clean":"2023-10-14T19:03:54.977609+0000","last_became_active":"2023-10-14T19:03:54.971632+0000","last_became_peered":"2023-10-14T19:03:54.971632+0000","last_unstale":"2023-10-14T19:03:54.977609+0000","last_undegraded":"2023-10-14T19:03:54.977609+0000","last_fullsized":"2023-10-14T19:03:54.977609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:21.111366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947801+0000","last_change":"2023-10-14T19:03:53.940727+0000","last_active":"2023-10-14T19:03:54.947801+0000","last_peered":"2023-10-14T19:03:54.947801+0000","last_clean":"2023-10-14T19:03:54.947801+0000","last_became_active":"2023-10-14T19:03:53.940465+0000","last_became_peered":"2023-10-14T19:03:53.940465+0000","last_unstale":"2023-10-14T19:03:54.947801+0000","last_undegraded":"2023-10-14T19:03:54.947801+0000","last_fullsized":"2023-10-14T19:03:54.947801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:45.865946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967741+0000","last_change":"2023-10-14T19:03:54.961292+0000","last_active":"2023-10-14T19:03:54.967741+0000","last_peered":"2023-10-14T19:03:54.967741+0000","last_clean":"2023-10-14T19:03:54.967741+0000","last_became_active":"2023-10-14T19:03:54.961000+0000","last_became_peered":"2023-10-14T19:03:54.961000+0000","last_unstale":"2023-10-14T19:03:54.967741+0000","last_undegraded":"2023-10-14T19:03:54.967741+0000","last_fullsized":"2023-10-14T19:03:54.967741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:04.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.978155+0000","last_change":"2023-10-14T19:03:53.942705+0000","last_active":"2023-10-14T19:03:54.978155+0000","last_peered":"2023-10-14T19:03:54.978155+0000","last_clean":"2023-10-14T19:03:54.978155+0000","last_became_active":"2023-10-14T19:03:53.942426+0000","last_became_peered":"2023-10-14T19:03:53.942426+0000","last_unstale":"2023-10-14T19:03:54.978155+0000","last_undegraded":"2023-10-14T19:03:54.978155+0000","last_fullsized":"2023-10-14T19:03:54.978155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:44.851605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.975197+0000","last_change":"2023-10-14T19:03:54.969515+0000","last_active":"2023-10-14T19:03:54.975197+0000","last_peered":"2023-10-14T19:03:54.975197+0000","last_clean":"2023-10-14T19:03:54.975197+0000","last_became_active":"2023-10-14T19:03:54.969124+0000","last_became_peered":"2023-10-14T19:03:54.969124+0000","last_unstale":"2023-10-14T19:03:54.975197+0000","last_undegraded":"2023-10-14T19:03:54.975197+0000","last_fullsized":"2023-10-14T19:03:54.975197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977700+0000","last_change":"2023-10-14T19:03:53.942226+0000","last_active":"2023-10-14T19:03:54.977700+0000","last_peered":"2023-10-14T19:03:54.977700+0000","last_clean":"2023-10-14T19:03:54.977700+0000","last_became_active":"2023-10-14T19:03:53.941478+0000","last_became_peered":"2023-10-14T19:03:53.941478+0000","last_unstale":"2023-10-14T19:03:54.977700+0000","last_undegraded":"2023-10-14T19:03:54.977700+0000","last_fullsized":"2023-10-14T19:03:54.977700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966876+0000","last_change":"2023-10-14T19:03:54.963700+0000","last_active":"2023-10-14T19:03:54.966876+0000","last_peered":"2023-10-14T19:03:54.966876+0000","last_clean":"2023-10-14T19:03:54.966876+0000","last_became_active":"2023-10-14T19:03:54.963445+0000","last_became_peered":"2023-10-14T19:03:54.963445+0000","last_unstale":"2023-10-14T19:03:54.966876+0000","last_undegraded":"2023-10-14T19:03:54.966876+0000","last_fullsized":"2023-10-14T19:03:54.966876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:42.604174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969403+0000","last_change":"2023-10-14T19:03:53.932938+0000","last_active":"2023-10-14T19:03:54.969403+0000","last_peered":"2023-10-14T19:03:54.969403+0000","last_clean":"2023-10-14T19:03:54.969403+0000","last_became_active":"2023-10-14T19:03:53.932654+0000","last_became_peered":"2023-10-14T19:03:53.932654+0000","last_unstale":"2023-10-14T19:03:54.969403+0000","last_undegraded":"2023-10-14T19:03:54.969403+0000","last_fullsized":"2023-10-14T19:03:54.969403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:26.758367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979929+0000","last_change":"2023-10-14T19:03:54.978677+0000","last_active":"2023-10-14T19:03:54.979929+0000","last_peered":"2023-10-14T19:03:54.979929+0000","last_clean":"2023-10-14T19:03:54.979929+0000","last_became_active":"2023-10-14T19:03:54.978349+0000","last_became_peered":"2023-10-14T19:03:54.978349+0000","last_unstale":"2023-10-14T19:03:54.979929+0000","last_undegraded":"2023-10-14T19:03:54.979929+0000","last_fullsized":"2023-10-14T19:03:54.979929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:01.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966393+0000","last_change":"2023-10-14T19:03:53.930784+0000","last_active":"2023-10-14T19:03:54.966393+0000","last_peered":"2023-10-14T19:03:54.966393+0000","last_clean":"2023-10-14T19:03:54.966393+0000","last_became_active":"2023-10-14T19:03:53.930491+0000","last_became_peered":"2023-10-14T19:03:53.930491+0000","last_unstale":"2023-10-14T19:03:54.966393+0000","last_undegraded":"2023-10-14T19:03:54.966393+0000","last_fullsized":"2023-10-14T19:03:54.966393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:23.513627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.970934+0000","last_change":"2023-10-14T19:03:54.969099+0000","last_active":"2023-10-14T19:03:54.970934+0000","last_peered":"2023-10-14T19:03:54.970934+0000","last_clean":"2023-10-14T19:03:54.970934+0000","last_became_active":"2023-10-14T19:03:54.968829+0000","last_became_peered":"2023-10-14T19:03:54.968829+0000","last_unstale":"2023-10-14T19:03:54.970934+0000","last_undegraded":"2023-10-14T19:03:54.970934+0000","last_fullsized":"2023-10-14T19:03:54.970934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:34.986850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.951255+0000","last_change":"2023-10-14T19:03:53.940717+0000","last_active":"2023-10-14T19:03:54.951255+0000","last_peered":"2023-10-14T19:03:54.951255+0000","last_clean":"2023-10-14T19:03:54.951255+0000","last_became_active":"2023-10-14T19:03:53.940375+0000","last_became_peered":"2023-10-14T19:03:53.940375+0000","last_unstale":"2023-10-14T19:03:54.951255+0000","last_undegraded":"2023-10-14T19:03:54.951255+0000","last_fullsized":"2023-10-14T19:03:54.951255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:54.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963220+0000","last_change":"2023-10-14T19:03:54.961261+0000","last_active":"2023-10-14T19:03:54.963220+0000","last_peered":"2023-10-14T19:03:54.963220+0000","last_clean":"2023-10-14T19:03:54.963220+0000","last_became_active":"2023-10-14T19:03:54.960605+0000","last_became_peered":"2023-10-14T19:03:54.960605+0000","last_unstale":"2023-10-14T19:03:54.963220+0000","last_undegraded":"2023-10-14T19:03:54.963220+0000","last_fullsized":"2023-10-14T19:03:54.963220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:23.620241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979233+0000","last_change":"2023-10-14T19:03:53.941991+0000","last_active":"2023-10-14T19:03:54.979233+0000","last_peered":"2023-10-14T19:03:54.979233+0000","last_clean":"2023-10-14T19:03:54.979233+0000","last_became_active":"2023-10-14T19:03:53.941742+0000","last_became_peered":"2023-10-14T19:03:53.941742+0000","last_unstale":"2023-10-14T19:03:54.979233+0000","last_undegraded":"2023-10-14T19:03:54.979233+0000","last_fullsized":"2023-10-14T19:03:54.979233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:54.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980536+0000","last_change":"2023-10-14T19:03:54.974751+0000","last_active":"2023-10-14T19:03:54.980536+0000","last_peered":"2023-10-14T19:03:54.980536+0000","last_clean":"2023-10-14T19:03:54.980536+0000","last_became_active":"2023-10-14T19:03:54.974115+0000","last_became_peered":"2023-10-14T19:03:54.974115+0000","last_unstale":"2023-10-14T19:03:54.980536+0000","last_undegraded":"2023-10-14T19:03:54.980536+0000","last_fullsized":"2023-10-14T19:03:54.980536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:41.312433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.954244+0000","last_change":"2023-10-14T19:03:53.939613+0000","last_active":"2023-10-14T19:03:54.954244+0000","last_peered":"2023-10-14T19:03:54.954244+0000","last_clean":"2023-10-14T19:03:54.954244+0000","last_became_active":"2023-10-14T19:03:53.939341+0000","last_became_peered":"2023-10-14T19:03:53.939341+0000","last_unstale":"2023-10-14T19:03:54.954244+0000","last_undegraded":"2023-10-14T19:03:54.954244+0000","last_fullsized":"2023-10-14T19:03:54.954244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:40.310448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.969573+0000","last_change":"2023-10-14T19:03:54.967042+0000","last_active":"2023-10-14T19:03:54.969573+0000","last_peered":"2023-10-14T19:03:54.969573+0000","last_clean":"2023-10-14T19:03:54.969573+0000","last_became_active":"2023-10-14T19:03:54.966582+0000","last_became_peered":"2023-10-14T19:03:54.966582+0000","last_unstale":"2023-10-14T19:03:54.969573+0000","last_undegraded":"2023-10-14T19:03:54.969573+0000","last_fullsized":"2023-10-14T19:03:54.969573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:40.638520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950576+0000","last_change":"2023-10-14T19:03:53.935002+0000","last_active":"2023-10-14T19:03:54.950576+0000","last_peered":"2023-10-14T19:03:54.950576+0000","last_clean":"2023-10-14T19:03:54.950576+0000","last_became_active":"2023-10-14T19:03:53.934342+0000","last_became_peered":"2023-10-14T19:03:53.934342+0000","last_unstale":"2023-10-14T19:03:54.950576+0000","last_undegraded":"2023-10-14T19:03:54.950576+0000","last_fullsized":"2023-10-14T19:03:54.950576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:33.984865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977681+0000","last_change":"2023-10-14T19:03:54.973962+0000","last_active":"2023-10-14T19:03:54.977681+0000","last_peered":"2023-10-14T19:03:54.977681+0000","last_clean":"2023-10-14T19:03:54.977681+0000","last_became_active":"2023-10-14T19:03:54.973709+0000","last_became_peered":"2023-10-14T19:03:54.973709+0000","last_unstale":"2023-10-14T19:03:54.977681+0000","last_undegraded":"2023-10-14T19:03:54.977681+0000","last_fullsized":"2023-10-14T19:03:54.977681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:11.883209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.955697+0000","last_change":"2023-10-14T19:03:53.939589+0000","last_active":"2023-10-14T19:03:54.955697+0000","last_peered":"2023-10-14T19:03:54.955697+0000","last_clean":"2023-10-14T19:03:54.955697+0000","last_became_active":"2023-10-14T19:03:53.939322+0000","last_became_peered":"2023-10-14T19:03:53.939322+0000","last_unstale":"2023-10-14T19:03:54.955697+0000","last_undegraded":"2023-10-14T19:03:54.955697+0000","last_fullsized":"2023-10-14T19:03:54.955697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:37.508875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.967694+0000","last_change":"2023-10-14T19:03:54.966771+0000","last_active":"2023-10-14T19:03:54.967694+0000","last_peered":"2023-10-14T19:03:54.967694+0000","last_clean":"2023-10-14T19:03:54.967694+0000","last_became_active":"2023-10-14T19:03:54.966456+0000","last_became_peered":"2023-10-14T19:03:54.966456+0000","last_unstale":"2023-10-14T19:03:54.967694+0000","last_undegraded":"2023-10-14T19:03:54.967694+0000","last_fullsized":"2023-10-14T19:03:54.967694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:55.887418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.979939+0000","last_change":"2023-10-14T19:03:53.937224+0000","last_active":"2023-10-14T19:03:54.979939+0000","last_peered":"2023-10-14T19:03:54.979939+0000","last_clean":"2023-10-14T19:03:54.979939+0000","last_became_active":"2023-10-14T19:03:53.936906+0000","last_became_peered":"2023-10-14T19:03:53.936906+0000","last_unstale":"2023-10-14T19:03:54.979939+0000","last_undegraded":"2023-10-14T19:03:54.979939+0000","last_fullsized":"2023-10-14T19:03:54.979939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.977449+0000","last_change":"2023-10-14T19:03:54.972347+0000","last_active":"2023-10-14T19:03:54.977449+0000","last_peered":"2023-10-14T19:03:54.977449+0000","last_clean":"2023-10-14T19:03:54.977449+0000","last_became_active":"2023-10-14T19:03:54.971682+0000","last_became_peered":"2023-10-14T19:03:54.971682+0000","last_unstale":"2023-10-14T19:03:54.977449+0000","last_undegraded":"2023-10-14T19:03:54.977449+0000","last_fullsized":"2023-10-14T19:03:54.977449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:18.417288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T19:03:55.966704+0000","last_change":"2023-10-14T19:03:53.941915+0000","last_active":"2023-10-14T19:03:55.966704+0000","last_peered":"2023-10-14T19:03:55.966704+0000","last_clean":"2023-10-14T19:03:55.966704+0000","last_became_active":"2023-10-14T19:03:53.941632+0000","last_became_peered":"2023-10-14T19:03:53.941632+0000","last_unstale":"2023-10-14T19:03:55.966704+0000","last_undegraded":"2023-10-14T19:03:55.966704+0000","last_fullsized":"2023-10-14T19:03:55.966704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.980529+0000","last_change":"2023-10-14T19:03:54.978101+0000","last_active":"2023-10-14T19:03:54.980529+0000","last_peered":"2023-10-14T19:03:54.980529+0000","last_clean":"2023-10-14T19:03:54.980529+0000","last_became_active":"2023-10-14T19:03:54.975814+0000","last_became_peered":"2023-10-14T19:03:54.975814+0000","last_unstale":"2023-10-14T19:03:54.980529+0000","last_undegraded":"2023-10-14T19:03:54.980529+0000","last_fullsized":"2023-10-14T19:03:54.980529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965681+0000","last_change":"2023-10-14T19:03:53.933680+0000","last_active":"2023-10-14T19:03:54.965681+0000","last_peered":"2023-10-14T19:03:54.965681+0000","last_clean":"2023-10-14T19:03:54.965681+0000","last_became_active":"2023-10-14T19:03:53.933390+0000","last_became_peered":"2023-10-14T19:03:53.933390+0000","last_unstale":"2023-10-14T19:03:54.965681+0000","last_undegraded":"2023-10-14T19:03:54.965681+0000","last_fullsized":"2023-10-14T19:03:54.965681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:14.749737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.972981+0000","last_change":"2023-10-14T19:03:54.968739+0000","last_active":"2023-10-14T19:03:54.972981+0000","last_peered":"2023-10-14T19:03:54.972981+0000","last_clean":"2023-10-14T19:03:54.972981+0000","last_became_active":"2023-10-14T19:03:54.968425+0000","last_became_peered":"2023-10-14T19:03:54.968425+0000","last_unstale":"2023-10-14T19:03:54.972981+0000","last_undegraded":"2023-10-14T19:03:54.972981+0000","last_fullsized":"2023-10-14T19:03:54.972981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:11.014368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.960092+0000","last_change":"2023-10-14T19:03:53.936231+0000","last_active":"2023-10-14T19:03:54.960092+0000","last_peered":"2023-10-14T19:03:54.960092+0000","last_clean":"2023-10-14T19:03:54.960092+0000","last_became_active":"2023-10-14T19:03:53.935966+0000","last_became_peered":"2023-10-14T19:03:53.935966+0000","last_unstale":"2023-10-14T19:03:54.960092+0000","last_undegraded":"2023-10-14T19:03:54.960092+0000","last_fullsized":"2023-10-14T19:03:54.960092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:22.618256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971770+0000","last_change":"2023-10-14T19:03:54.969820+0000","last_active":"2023-10-14T19:03:54.971770+0000","last_peered":"2023-10-14T19:03:54.971770+0000","last_clean":"2023-10-14T19:03:54.971770+0000","last_became_active":"2023-10-14T19:03:54.969457+0000","last_became_peered":"2023-10-14T19:03:54.969457+0000","last_unstale":"2023-10-14T19:03:54.971770+0000","last_undegraded":"2023-10-14T19:03:54.971770+0000","last_fullsized":"2023-10-14T19:03:54.971770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:59.523265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.965460+0000","last_change":"2023-10-14T19:03:53.936109+0000","last_active":"2023-10-14T19:03:54.965460+0000","last_peered":"2023-10-14T19:03:54.965460+0000","last_clean":"2023-10-14T19:03:54.965460+0000","last_became_active":"2023-10-14T19:03:53.935804+0000","last_became_peered":"2023-10-14T19:03:53.935804+0000","last_unstale":"2023-10-14T19:03:54.965460+0000","last_undegraded":"2023-10-14T19:03:54.965460+0000","last_fullsized":"2023-10-14T19:03:54.965460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:13:14.209007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.976861+0000","last_change":"2023-10-14T19:03:54.974912+0000","last_active":"2023-10-14T19:03:54.976861+0000","last_peered":"2023-10-14T19:03:54.976861+0000","last_clean":"2023-10-14T19:03:54.976861+0000","last_became_active":"2023-10-14T19:03:54.974654+0000","last_became_peered":"2023-10-14T19:03:54.974654+0000","last_unstale":"2023-10-14T19:03:54.976861+0000","last_undegraded":"2023-10-14T19:03:54.976861+0000","last_fullsized":"2023-10-14T19:03:54.976861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:49.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.950687+0000","last_change":"2023-10-14T19:03:53.935058+0000","last_active":"2023-10-14T19:03:54.950687+0000","last_peered":"2023-10-14T19:03:54.950687+0000","last_clean":"2023-10-14T19:03:54.950687+0000","last_became_active":"2023-10-14T19:03:53.934116+0000","last_became_peered":"2023-10-14T19:03:53.934116+0000","last_unstale":"2023-10-14T19:03:54.950687+0000","last_undegraded":"2023-10-14T19:03:54.950687+0000","last_fullsized":"2023-10-14T19:03:54.950687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:03.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.966612+0000","last_change":"2023-10-14T19:03:54.958822+0000","last_active":"2023-10-14T19:03:54.966612+0000","last_peered":"2023-10-14T19:03:54.966612+0000","last_clean":"2023-10-14T19:03:54.966612+0000","last_became_active":"2023-10-14T19:03:54.958568+0000","last_became_peered":"2023-10-14T19:03:54.958568+0000","last_unstale":"2023-10-14T19:03:54.966612+0000","last_undegraded":"2023-10-14T19:03:54.966612+0000","last_fullsized":"2023-10-14T19:03:54.966612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:43.294272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.947921+0000","last_change":"2023-10-14T19:03:53.939493+0000","last_active":"2023-10-14T19:03:54.947921+0000","last_peered":"2023-10-14T19:03:54.947921+0000","last_clean":"2023-10-14T19:03:54.947921+0000","last_became_active":"2023-10-14T19:03:53.939228+0000","last_became_peered":"2023-10-14T19:03:53.939228+0000","last_unstale":"2023-10-14T19:03:54.947921+0000","last_undegraded":"2023-10-14T19:03:54.947921+0000","last_fullsized":"2023-10-14T19:03:54.947921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:24.037397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.971926+0000","last_change":"2023-10-14T19:03:54.966591+0000","last_active":"2023-10-14T19:03:54.971926+0000","last_peered":"2023-10-14T19:03:54.971926+0000","last_clean":"2023-10-14T19:03:54.971926+0000","last_became_active":"2023-10-14T19:03:54.966352+0000","last_became_peered":"2023-10-14T19:03:54.966352+0000","last_unstale":"2023-10-14T19:03:54.971926+0000","last_undegraded":"2023-10-14T19:03:54.971926+0000","last_fullsized":"2023-10-14T19:03:54.971926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:53.917328+0000","last_clean_scrub_stamp":"2023-10-14T19:03:53.917328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:01.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.957209+0000","last_change":"2023-10-14T19:03:53.939366+0000","last_active":"2023-10-14T19:03:54.957209+0000","last_peered":"2023-10-14T19:03:54.957209+0000","last_clean":"2023-10-14T19:03:54.957209+0000","last_became_active":"2023-10-14T19:03:53.939051+0000","last_became_peered":"2023-10-14T19:03:53.939051+0000","last_unstale":"2023-10-14T19:03:54.957209+0000","last_undegraded":"2023-10-14T19:03:54.957209+0000","last_fullsized":"2023-10-14T19:03:54.957209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:52.915343+0000","last_clean_scrub_stamp":"2023-10-14T19:03:52.915343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:33.676770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T19:03:54.963679+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:03:54.963679+0000","last_peered":"2023-10-14T19:03:54.963679+0000","last_clean":"2023-10-14T19:03:54.963679+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:03:54.963679+0000","last_undegraded":"2023-10-14T19:03:54.963679+0000","last_fullsized":"2023-10-14T19:03:54.963679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":734134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.505}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":143746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":145234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":143780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.438},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.627},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:04:04.008 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:04:04.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:04:04.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.167+0000 7f8d24192700 1 Processor -- start 2023-10-14T19:04:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.168+0000 7f8d24192700 1 -- start start 2023-10-14T19:04:04.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.168+0000 7f8d24192700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d1c159530 0x7f8d1c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.168+0000 7f8d24192700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d1c06dc70 0x7f8d1c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.168+0000 7f8d24192700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c0ccfd0 con 0x7f8d1c06e0e0 2023-10-14T19:04:04.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.168+0000 7f8d24192700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c0cf0e0 con 0x7f8d1c06dc70 2023-10-14T19:04:04.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.168+0000 7f8d24192700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c15a3d0 con 0x7f8d1c159530 2023-10-14T19:04:04.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2272f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8d1c06e0e0 0x7f8d1c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34710/0 (socket says 172.21.15.7:34710) 2023-10-14T19:04:04.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2172d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d1c06dc70 0x7f8d1c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2272f700 1 -- 172.21.15.7:0/2545959222 learned_addr learned my addr 172.21.15.7:0/2545959222 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:04.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d21f2e700 1 --2- 172.21.15.7:0/2545959222 >> v2:172.21.15.148:3300/0 conn(0x7f8d1c159530 0x7f8d1c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2172d700 1 -- 172.21.15.7:0/2545959222 >> v2:172.21.15.148:3300/0 conn(0x7f8d1c159530 msgr2=0x7f8d1c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:04.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2172d700 1 --2- 172.21.15.7:0/2545959222 >> v2:172.21.15.148:3300/0 conn(0x7f8d1c159530 0x7f8d1c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2172d700 1 -- 172.21.15.7:0/2545959222 >> v1:172.21.15.7:6789/0 conn(0x7f8d1c06e0e0 legacy=0x7f8d1c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2172d700 1 -- 172.21.15.7:0/2545959222 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c15a6b0 con 0x7f8d1c06dc70 2023-10-14T19:04:04.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d2172d700 1 --2- 172.21.15.7:0/2545959222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c159900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c06d630 tx=0x7f8d100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22da21d7b294cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:04.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d20f2c700 1 -- 172.21.15.7:0/2545959222 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10011630 con 0x7f8d1c06dc70 2023-10-14T19:04:04.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d20f2c700 1 -- 172.21.15.7:0/2545959222 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d10011790 con 0x7f8d1c06dc70 2023-10-14T19:04:04.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.169+0000 7f8d20f2c700 1 -- 172.21.15.7:0/2545959222 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10011b30 con 0x7f8d1c06dc70 2023-10-14T19:04:04.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 -- 172.21.15.7:0/2545959222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c06dc70 msgr2=0x7f8d1c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 --2- 172.21.15.7:0/2545959222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c159900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c06d630 tx=0x7f8d100091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 -- 172.21.15.7:0/2545959222 shutdown_connections 2023-10-14T19:04:04.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 --2- 172.21.15.7:0/2545959222 >> v2:172.21.15.148:3300/0 conn(0x7f8d1c159530 0x7f8d1c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 --2- 172.21.15.7:0/2545959222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c159900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 -- 172.21.15.7:0/2545959222 >> 172.21.15.7:0/2545959222 conn(0x7f8d1c0703a0 msgr2=0x7f8d1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 -- 172.21.15.7:0/2545959222 shutdown_connections 2023-10-14T19:04:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.170+0000 7f8d24192700 1 -- 172.21.15.7:0/2545959222 wait complete. 2023-10-14T19:04:04.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.171+0000 7f8d24192700 1 Processor -- start 2023-10-14T19:04:04.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.171+0000 7f8d24192700 1 -- start start 2023-10-14T19:04:04.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d24192700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d24192700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d1c06e0e0 0x7f8d1c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d24192700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 0x7f8d1c151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d24192700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c16e210 con 0x7f8d1c159530 2023-10-14T19:04:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d24192700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c153a90 con 0x7f8d1c06dc70 2023-10-14T19:04:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d24192700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c16d600 con 0x7f8d1c06e0e0 2023-10-14T19:04:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 0x7f8d1c151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 0x7f8d1c151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39994/0 (socket says 172.21.15.7:39994) 2023-10-14T19:04:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 -- 172.21.15.7:0/1409289626 learned_addr learned my addr 172.21.15.7:0/1409289626 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d21f2e700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2172d700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d1c06e0e0 0x7f8d1c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 -- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d1c06e0e0 msgr2=0x7f8d1c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d1c06e0e0 0x7f8d1c15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 -- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d1c06dc70 msgr2=0x7f8d1c153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 -- 172.21.15.7:0/1409289626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d10009420 con 0x7f8d1c159530 2023-10-14T19:04:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.172+0000 7f8d2272f700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 0x7f8d1c151730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400c590 tx=0x7f8d14007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.173+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14005b30 con 0x7f8d1c159530 2023-10-14T19:04:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.173+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14005cb0 con 0x7f8d1c159530 2023-10-14T19:04:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.173+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c16d8e0 con 0x7f8d1c159530 2023-10-14T19:04:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.173+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14007320 con 0x7f8d1c159530 2023-10-14T19:04:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.173+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c16dea0 con 0x7f8d1c159530 2023-10-14T19:04:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.174+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c0b3480 con 0x7f8d1c159530 2023-10-14T19:04:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.174+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d1401b3b0 con 0x7f8d1c159530 2023-10-14T19:04:04.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.175+0000 7f8d19ffb700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d08066f30 0x7f8d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.175+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d140839b0 con 0x7f8d1c159530 2023-10-14T19:04:04.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.175+0000 7f8d21f2e700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d08066f30 0x7f8d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.175+0000 7f8d21f2e700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d08066f30 0x7f8d080693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009fd0 tx=0x7f8d0c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.179+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d1c0b3480 con 0x7f8d1c159530 2023-10-14T19:04:04.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.450+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8d1c0b3480 con 0x7f8d1c159530 2023-10-14T19:04:04.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.454+0000 7f8d19ffb700 1 -- 172.21.15.7:0/1409289626 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8d1c0b3480 con 0x7f8d1c159530 2023-10-14T19:04:04.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d08066f30 msgr2=0x7f8d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d08066f30 0x7f8d080693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009fd0 tx=0x7f8d0c00b040 comp rx=0 tx=0).stop 2023-10-14T19:04:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 msgr2=0x7f8d1c151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 0x7f8d1c151730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400c590 tx=0x7f8d14007ef0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 shutdown_connections 2023-10-14T19:04:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d08066f30 0x7f8d080693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d1c06dc70 0x7f8d1c153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d1c159530 0x7f8d1c151730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 --2- 172.21.15.7:0/1409289626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d1c06e0e0 0x7f8d1c15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 >> 172.21.15.7:0/1409289626 conn(0x7f8d1c0703a0 msgr2=0x7f8d1c0cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 shutdown_connections 2023-10-14T19:04:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.456+0000 7f8d24192700 1 -- 172.21.15.7:0/1409289626 wait complete. 2023-10-14T19:04:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:04:04.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.588+0000 7f0749ddc700 1 Processor -- start 2023-10-14T19:04:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.588+0000 7f0749ddc700 1 -- start start 2023-10-14T19:04:04.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0749ddc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0744159c80 0x7f07440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0749ddc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f07440cfe70 0x7f07440cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0749ddc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07440ce9d0 con 0x7f07441598b0 2023-10-14T19:04:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0749ddc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440af960 con 0x7f07440cfe70 2023-10-14T19:04:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0749ddc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07440afc30 con 0x7f0744159c80 2023-10-14T19:04:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f07437fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f07441598b0 0x7f07440af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34718/0 (socket says 172.21.15.7:34718) 2023-10-14T19:04:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f07437fe700 1 -- 172.21.15.7:0/2200697253 learned_addr learned my addr 172.21.15.7:0/2200697253 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0743fff700 1 --2- 172.21.15.7:0/2200697253 >> v2:172.21.15.148:3300/0 conn(0x7f07440cfe70 0x7f07440cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0742ffd700 1 --2- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0744159c80 0x7f07440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f07427fc700 1 -- 172.21.15.7:0/2200697253 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606745116 0 0) 0x7f07440ce9d0 con 0x7f07441598b0 2023-10-14T19:04:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f07427fc700 1 -- 172.21.15.7:0/2200697253 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f072c003570 con 0x7f07441598b0 2023-10-14T19:04:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0743fff700 1 -- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0744159c80 msgr2=0x7f07440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0743fff700 1 --2- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0744159c80 0x7f07440cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0743fff700 1 -- 172.21.15.7:0/2200697253 >> v1:172.21.15.7:6789/0 conn(0x7f07441598b0 legacy=0x7f07440af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.589+0000 7f0743fff700 1 -- 172.21.15.7:0/2200697253 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07440aff10 con 0x7f07440cfe70 2023-10-14T19:04:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0743fff700 1 --2- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07440cfe70 0x7f07440cbc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f073c009e60 tx=0x7f073c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592eb2de2d08f1e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f07427fc700 1 -- 172.21.15.7:0/2200697253 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00e070 con 0x7f07440cfe70 2023-10-14T19:04:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f07427fc700 1 -- 172.21.15.7:0/2200697253 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00bab0 con 0x7f07440cfe70 2023-10-14T19:04:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f07427fc700 1 -- 172.21.15.7:0/2200697253 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00be70 con 0x7f07440cfe70 2023-10-14T19:04:04.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 -- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07440cfe70 msgr2=0x7f07440cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 --2- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07440cfe70 0x7f07440cbc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f073c009e60 tx=0x7f073c009780 comp rx=0 tx=0).stop 2023-10-14T19:04:04.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 -- 172.21.15.7:0/2200697253 shutdown_connections 2023-10-14T19:04:04.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 --2- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07440cfe70 0x7f07440cbc30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 --2- 172.21.15.7:0/2200697253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0744159c80 0x7f07440cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 -- 172.21.15.7:0/2200697253 >> 172.21.15.7:0/2200697253 conn(0x7f0744070e30 msgr2=0x7f07440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:04.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 -- 172.21.15.7:0/2200697253 shutdown_connections 2023-10-14T19:04:04.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.590+0000 7f0749ddc700 1 -- 172.21.15.7:0/2200697253 wait complete. 2023-10-14T19:04:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 Processor -- start 2023-10-14T19:04:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 -- start start 2023-10-14T19:04:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 0x7f0744143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07441598b0 0x7f074415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0744159c80 0x7f074415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440b34b0 con 0x7f07440cfe70 2023-10-14T19:04:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440b3a70 con 0x7f0744159c80 2023-10-14T19:04:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f0749ddc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0744157de0 con 0x7f07441598b0 2023-10-14T19:04:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f07437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 0x7f0744143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.592+0000 7f07437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 0x7f0744143030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39998/0 (socket says 172.21.15.7:39998) 2023-10-14T19:04:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 -- 172.21.15.7:0/1374332827 learned_addr learned my addr 172.21.15.7:0/1374332827 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f0743fff700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0744159c80 0x7f074415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f0742ffd700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07441598b0 0x7f074415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 -- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07441598b0 msgr2=0x7f074415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07441598b0 0x7f074415a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 -- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0744159c80 msgr2=0x7f074415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0744159c80 0x7f074415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 -- 172.21.15.7:0/1374332827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009a20 con 0x7f07440cfe70 2023-10-14T19:04:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f0743fff700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0744159c80 0x7f074415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f07437fe700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 0x7f0744143030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f073400c7c0 tx=0x7f0734007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734005b30 con 0x7f07440cfe70 2023-10-14T19:04:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734005c90 con 0x7f07440cfe70 2023-10-14T19:04:04.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07441580c0 con 0x7f07440cfe70 2023-10-14T19:04:04.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734007340 con 0x7f07440cfe70 2023-10-14T19:04:04.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.593+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0744143570 con 0x7f07440cfe70 2023-10-14T19:04:04.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.594+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074404c3c0 con 0x7f07440cfe70 2023-10-14T19:04:04.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.595+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f073401b400 con 0x7f07440cfe70 2023-10-14T19:04:04.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.595+0000 7f072b7fe700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:04.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.595+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0734084040 con 0x7f07440cfe70 2023-10-14T19:04:04.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.595+0000 7f0742ffd700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:04.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.596+0000 7f0742ffd700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0730066f30 0x7f07300693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0738006f00 tx=0x7f0738008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:04.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.599+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0734051330 con 0x7f07440cfe70 2023-10-14T19:04:04.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.840+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07440b38c0 con 0x7f07440cfe70 2023-10-14T19:04:04.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.840+0000 7f072b7fe700 1 -- 172.21.15.7:0/1374332827 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4588 (secure 0 0 0) 0x7f0734054950 con 0x7f07440cfe70 2023-10-14T19:04:04.841 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:04.842 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4866,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1287999800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1287999800},{"type":"v1","addr":"172.21.15.7:6835","nonce":1287999800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:54.330660+0000","modified":"2023-10-14T19:03:57.974158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4878":{"gid":4878,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6836/851698468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":851698468},{"type":"v1","addr":"172.21.15.148:6836","nonce":851698468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T19:04:04.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0730066f30 msgr2=0x7f07300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0730066f30 0x7f07300693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0738006f00 tx=0x7f0738008040 comp rx=0 tx=0).stop 2023-10-14T19:04:04.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 msgr2=0x7f0744143030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:04.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 0x7f0744143030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f073400c7c0 tx=0x7f0734007e00 comp rx=0 tx=0).stop 2023-10-14T19:04:04.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 shutdown_connections 2023-10-14T19:04:04.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0744159c80 0x7f074415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07440cfe70 0x7f0744143030 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 --2- 172.21.15.7:0/1374332827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07441598b0 0x7f074415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 >> 172.21.15.7:0/1374332827 conn(0x7f0744070e30 msgr2=0x7f07440b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 shutdown_connections 2023-10-14T19:04:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:04.842+0000 7f0749ddc700 1 -- 172.21.15.7:0/1374332827 wait complete. 2023-10-14T19:04:04.846 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2023-10-14T19:04:05.257 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:03:54.330660+0000', 'modified': '2023-10-14T19:03:57.974158+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4878}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4878': {'gid': 4878, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.148:6836/851698468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 851698468}, {'type': 'v1', 'addr': '172.21.15.148:6836', 'nonce': 851698468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:04:05.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:04:05.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T19:04:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.380+0000 7f8bdb120700 1 Processor -- start 2023-10-14T19:04:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.380+0000 7f8bdb120700 1 -- start start 2023-10-14T19:04:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bdb120700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cb5a0 0x7f8bd40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bdb120700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8bd40cd9e0 0x7f8bd4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bdb120700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd415ae40 con 0x7f8bd40cde50 2023-10-14T19:04:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bdb120700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd40d13f0 con 0x7f8bd40cd9e0 2023-10-14T19:04:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bdb120700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd415ab60 con 0x7f8bd40cb5a0 2023-10-14T19:04:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd96bd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8bd40cde50 0x7f8bd4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34730/0 (socket says 172.21.15.7:34730) 2023-10-14T19:04:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd96bd700 1 -- 172.21.15.7:0/3004996045 learned_addr learned my addr 172.21.15.7:0/3004996045 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cb5a0 0x7f8bd40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/3004996045 >> v2:172.21.15.148:3300/0 conn(0x7f8bd40cd9e0 0x7f8bd4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd37fe700 1 -- 172.21.15.7:0/3004996045 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755878945 0 0) 0x7f8bd415ae40 con 0x7f8bd40cde50 2023-10-14T19:04:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd37fe700 1 -- 172.21.15.7:0/3004996045 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bc4003570 con 0x7f8bd40cde50 2023-10-14T19:04:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd3fff700 1 -- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cb5a0 msgr2=0x7f8bd40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cb5a0 0x7f8bd40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd3fff700 1 -- 172.21.15.7:0/3004996045 >> v1:172.21.15.7:6789/0 conn(0x7f8bd40cde50 legacy=0x7f8bd4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd3fff700 1 -- 172.21.15.7:0/3004996045 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd40ccf00 con 0x7f8bd40cd9e0 2023-10-14T19:04:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.381+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cb5a0 0x7f8bd40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cd9e0 0x7f8bd4159ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00098e0 tx=0x7f8bc00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53bb229bf6cf3194 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bd37fe700 1 -- 172.21.15.7:0/3004996045 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0011630 con 0x7f8bd40cd9e0 2023-10-14T19:04:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bd37fe700 1 -- 172.21.15.7:0/3004996045 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0011790 con 0x7f8bd40cd9e0 2023-10-14T19:04:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bd37fe700 1 -- 172.21.15.7:0/3004996045 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0011b30 con 0x7f8bd40cd9e0 2023-10-14T19:04:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 -- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cd9e0 msgr2=0x7f8bd4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cd9e0 0x7f8bd4159ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00098e0 tx=0x7f8bc00091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 -- 172.21.15.7:0/3004996045 shutdown_connections 2023-10-14T19:04:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cb5a0 0x7f8bd40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 --2- 172.21.15.7:0/3004996045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cd9e0 0x7f8bd4159ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 -- 172.21.15.7:0/3004996045 >> 172.21.15.7:0/3004996045 conn(0x7f8bd4070e30 msgr2=0x7f8bd40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 -- 172.21.15.7:0/3004996045 shutdown_connections 2023-10-14T19:04:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.382+0000 7f8bdb120700 1 -- 172.21.15.7:0/3004996045 wait complete. 2023-10-14T19:04:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.383+0000 7f8bdb120700 1 Processor -- start 2023-10-14T19:04:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 -- start start 2023-10-14T19:04:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cb5a0 0x7f8bd4147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cd9e0 0x7f8bd416c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 0x7f8bd416cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40b3e60 con 0x7f8bd416a2e0 2023-10-14T19:04:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4159c00 con 0x7f8bd40cb5a0 2023-10-14T19:04:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bdb120700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4159920 con 0x7f8bd40cd9e0 2023-10-14T19:04:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bd96bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 0x7f8bd416cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bd96bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 0x7f8bd416cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40012/0 (socket says 172.21.15.7:40012) 2023-10-14T19:04:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.384+0000 7f8bd96bd700 1 -- 172.21.15.7:0/2150645107 learned_addr learned my addr 172.21.15.7:0/2150645107 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cb5a0 0x7f8bd4147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cd9e0 0x7f8bd416c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd96bd700 1 -- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cd9e0 msgr2=0x7f8bd416c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cd9e0 0x7f8bd416c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd96bd700 1 -- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cb5a0 msgr2=0x7f8bd4147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cb5a0 0x7f8bd4147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd96bd700 1 -- 172.21.15.7:0/2150645107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009420 con 0x7f8bd416a2e0 2023-10-14T19:04:05.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 0x7f8bd416cd10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001460 tx=0x7f8bcc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd0ff9700 1 -- 172.21.15.7:0/2150645107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00a950 con 0x7f8bd416a2e0 2023-10-14T19:04:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd0ff9700 1 -- 172.21.15.7:0/2150645107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc00aab0 con 0x7f8bd416a2e0 2023-10-14T19:04:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc0009420 con 0x7f8bd416a2e0 2023-10-14T19:04:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bd0ff9700 1 -- 172.21.15.7:0/2150645107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00ae30 con 0x7f8bd416a2e0 2023-10-14T19:04:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.385+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd40b3af0 con 0x7f8bd416a2e0 2023-10-14T19:04:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.387+0000 7f8bd0ff9700 1 -- 172.21.15.7:0/2150645107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bcc007300 con 0x7f8bd416a2e0 2023-10-14T19:04:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.387+0000 7f8bd0ff9700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bb8066f30 0x7f8bb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.387+0000 7f8bd0ff9700 1 -- 172.21.15.7:0/2150645107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bcc084a30 con 0x7f8bd416a2e0 2023-10-14T19:04:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.387+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bb8066f30 0x7f8bb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.388+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bb8066f30 0x7f8bb80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80093f0 tx=0x7f8bc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.389+0000 7f8be4419b80 1 Processor -- start 2023-10-14T19:04:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.389+0000 7f8be4419b80 1 -- start start 2023-10-14T19:04:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559376f4a50 0x5559376f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 0x55593771da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8be4419b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593764ba70 con 0x55593773ed00 2023-10-14T19:04:05.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937649270 con 0x5559376f4a50 2023-10-14T19:04:05.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x555937645060 con 0x55593771df60 2023-10-14T19:04:05.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 0x55593771da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 0x55593771da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40022/0 (socket says 172.21.15.7:40022) 2023-10-14T19:04:05.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 -- 172.21.15.7:0/1336432 learned_addr learned my addr 172.21.15.7:0/1336432 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559376f4a50 0x5559376f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 -- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 msgr2=0x5559376f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 -- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559376f4a50 msgr2=0x5559376f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559376f4a50 0x5559376f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 -- 172.21.15.7:0/1336432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559374df270 con 0x55593773ed00 2023-10-14T19:04:05.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559376f4a50 0x5559376f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:05.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:05.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 0x55593771da20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00093a0 tx=0x7f8bc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb702e2716277cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bbdffb700 1 -- 172.21.15.7:0/1336432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0000bc0 con 0x55593773ed00 2023-10-14T19:04:05.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.390+0000 7f8bbdffb700 1 -- 172.21.15.7:0/1336432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0011900 con 0x55593773ed00 2023-10-14T19:04:05.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8bbdffb700 1 -- 172.21.15.7:0/1336432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0000d20 con 0x55593773ed00 2023-10-14T19:04:05.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 -- 172.21.15.7:0/1336432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 msgr2=0x55593771da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 0x55593771da20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00093a0 tx=0x7f8bc0017000 comp rx=0 tx=0).stop 2023-10-14T19:04:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 -- 172.21.15.7:0/1336432 shutdown_connections 2023-10-14T19:04:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559376f4a50 0x5559376f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 --2- 172.21.15.7:0/1336432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55593773ed00 0x55593771da20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 -- 172.21.15.7:0/1336432 >> 172.21.15.7:0/1336432 conn(0x5559376f6370 msgr2=0x5559376f6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 -- 172.21.15.7:0/1336432 shutdown_connections 2023-10-14T19:04:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.391+0000 7f8be4419b80 1 -- 172.21.15.7:0/1336432 wait complete. 2023-10-14T19:04:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.392+0000 7f8be4419b80 1 -- start start 2023-10-14T19:04:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.392+0000 7f8be4419b80 1 Processor -- start 2023-10-14T19:04:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593774ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593773ed00 0x5559376f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559375f0890 con 0x5559376f4a50 2023-10-14T19:04:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593760bea0 con 0x55593773ed00 2023-10-14T19:04:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559374c7e30 con 0x55593771df60 2023-10-14T19:04:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8be4419b80 10 client.0 _ll_register_callbacks cb 0x5559376b8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:04:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593774ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593774ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40036/0 (socket says 172.21.15.7:40036) 2023-10-14T19:04:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/4269252898 learned_addr learned my addr 172.21.15.7:0/4269252898 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593773ed00 0x5559376f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 msgr2=0x5559376f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593773ed00 msgr2=0x5559376f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593773ed00 0x5559376f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/4269252898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd40ccf00 con 0x5559376f4a50 2023-10-14T19:04:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593773ed00 0x5559376f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593774ae20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8015b70 tx=0x7f8bc8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa928dfe4d11fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bb2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:04:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.393+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/4269252898 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8014a80 con 0x5559376f4a50 2023-10-14T19:04:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/4269252898 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bc8014be0 con 0x5559376f4a50 2023-10-14T19:04:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559376e9b70 con 0x5559376f4a50 2023-10-14T19:04:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/4269252898 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bc8022420 con 0x5559376f4a50 2023-10-14T19:04:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 10 client.5076 fetch_fsmap learned FSMap version 16 2023-10-14T19:04:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555937481fe0 con 0x5559376f4a50 2023-10-14T19:04:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/4269252898 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559376e9b70 con 0x5559376f4a50 2023-10-14T19:04:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/4269252898 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8bc8022580 con 0x5559376f4a50 2023-10-14T19:04:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 10 client.5076 fetch_fsmap finished waiting for FSMap version 16 2023-10-14T19:04:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 10 client.5076 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T19:04:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 20 client.5076 populate_metadata read hostname 'smithi007' 2023-10-14T19:04:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773e250 0x555937758760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 4 client.5076 mds_command: new command op to 4878 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:04:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 --> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559376c6aa0 con 0x55593773e250 2023-10-14T19:04:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.394+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773e250 0x555937758760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.395+0000 7f8bb2ffd700 10 client.5076 ms_handle_connect on v2:172.21.15.148:6834/851698468 2023-10-14T19:04:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.395+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773e250 0x555937758760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee2fe0c359dec978 server_cookie=5fe6daccdab38f3a in_seq=0 out_seq=0 2023-10-14T19:04:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/4269252898 <== mds.0 v2:172.21.15.148:6834/851698468 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5559376c6aa0 con 0x55593773e250 2023-10-14T19:04:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8bb2ffd700 10 client.5076 handle_command_reply: tid=0 2023-10-14T19:04:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 client.5076 shutdown 2023-10-14T19:04:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 msgr2=0x55593774ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593774ae20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8015b70 tx=0x7f8bc8018000 comp rx=0 tx=0).stop 2023-10-14T19:04:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 shutdown_connections 2023-10-14T19:04:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773e250 0x555937758760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593773ed00 0x5559376f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8bb2ffd700 0 client.5076 ms_handle_reset on v2:172.21.15.148:6834/851698468 2023-10-14T19:04:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593774ae20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 --2- 172.21.15.7:0/4269252898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593771df60 0x5559376f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 >> 172.21.15.7:0/4269252898 conn(0x5559376f6370 msgr2=0x5559376f7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 shutdown_connections 2023-10-14T19:04:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 1 -- 172.21.15.7:0/4269252898 wait complete. 2023-10-14T19:04:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.396+0000 7f8be4419b80 20 client.5076 trim_cache size 0 max 16384 2023-10-14T19:04:05.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.413+0000 7f8be4419b80 1 Processor -- start 2023-10-14T19:04:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.413+0000 7f8be4419b80 1 -- start start 2023-10-14T19:04:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x555937719ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593775c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8be4419b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559376f01e0 con 0x5559376f4a50 2023-10-14T19:04:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559376f2d30 con 0x55593771df60 2023-10-14T19:04:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55593773e6c0 con 0x55593773e250 2023-10-14T19:04:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x555937719ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x555937719ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40046/0 (socket says 172.21.15.7:40046) 2023-10-14T19:04:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/983773987 learned_addr learned my addr 172.21.15.7:0/983773987 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593775c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 msgr2=0x5559376ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 msgr2=0x55593775c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593775c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/983773987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555937613780 con 0x5559376f4a50 2023-10-14T19:04:05.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.414+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x555937719ec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8012010 tx=0x7f8bc8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8175a6c8a395d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8bbe7fc700 1 -- 172.21.15.7:0/983773987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8022ae0 con 0x5559376f4a50 2023-10-14T19:04:05.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8bbe7fc700 1 -- 172.21.15.7:0/983773987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8009b20 con 0x5559376f4a50 2023-10-14T19:04:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8bbe7fc700 1 -- 172.21.15.7:0/983773987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8014a80 con 0x5559376f4a50 2023-10-14T19:04:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 -- 172.21.15.7:0/983773987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 msgr2=0x555937719ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x555937719ec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8012010 tx=0x7f8bc8023000 comp rx=0 tx=0).stop 2023-10-14T19:04:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 -- 172.21.15.7:0/983773987 shutdown_connections 2023-10-14T19:04:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x555937719ec0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 --2- 172.21.15.7:0/983773987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593775c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 -- 172.21.15.7:0/983773987 >> 172.21.15.7:0/983773987 conn(0x5559376f6370 msgr2=0x55593771ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 -- 172.21.15.7:0/983773987 shutdown_connections 2023-10-14T19:04:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.415+0000 7f8be4419b80 1 -- 172.21.15.7:0/983773987 wait complete. 2023-10-14T19:04:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.416+0000 7f8be4419b80 1 -- start start 2023-10-14T19:04:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.416+0000 7f8be4419b80 1 Processor -- start 2023-10-14T19:04:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.416+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593779b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.416+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593773b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.416+0000 7f8be4419b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559377a2730 con 0x5559376f4a50 2023-10-14T19:04:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559377a28d0 con 0x55593771df60 2023-10-14T19:04:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559377a2280 con 0x55593773e250 2023-10-14T19:04:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 10 client.0 _ll_register_callbacks cb 0x5559376b8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:04:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593779b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593779b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40052/0 (socket says 172.21.15.7:40052) 2023-10-14T19:04:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/2464047359 learned_addr learned my addr 172.21.15.7:0/2464047359 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593773b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 msgr2=0x5559376f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 msgr2=0x55593773b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:05.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593773b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 -- 172.21.15.7:0/2464047359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555937481fe0 con 0x5559376f4a50 2023-10-14T19:04:05.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593773b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:05.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd96bd700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bd8ebc700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593779b5b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8037040 tx=0x7f8bc802e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b422e6fff100e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bb2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:04:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/2464047359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8042070 con 0x5559376f4a50 2023-10-14T19:04:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/2464047359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bc80146c0 con 0x5559376f4a50 2023-10-14T19:04:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bc0011900 con 0x5559376f4a50 2023-10-14T19:04:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/2464047359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bc8014a90 con 0x5559376f4a50 2023-10-14T19:04:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 10 client.5082 fetch_fsmap learned FSMap version 16 2023-10-14T19:04:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.417+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5559375fa470 con 0x5559376f4a50 2023-10-14T19:04:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/2464047359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0011900 con 0x5559376f4a50 2023-10-14T19:04:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/2464047359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8bc8045020 con 0x5559376f4a50 2023-10-14T19:04:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8be4419b80 10 client.5082 fetch_fsmap finished waiting for FSMap version 16 2023-10-14T19:04:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8be4419b80 10 client.5082 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T19:04:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8be4419b80 20 client.5082 populate_metadata read hostname 'smithi007' 2023-10-14T19:04:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8be4419b80 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773ed00 0x555937738320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8be4419b80 4 client.5082 mds_command: new command op to 4878 tid=0[{"prefix": "status"}] 2023-10-14T19:04:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 --> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5559375e7e00 con 0x55593773ed00 2023-10-14T19:04:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773ed00 0x555937738320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8bb2ffd700 10 client.5082 ms_handle_connect on v2:172.21.15.148:6834/851698468 2023-10-14T19:04:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.418+0000 7f8bd3fff700 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773ed00 0x555937738320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d545490a1a6aa624 server_cookie=4a5bfa370fa1cbc5 in_seq=0 out_seq=0 2023-10-14T19:04:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bb2ffd700 1 -- 172.21.15.7:0/2464047359 <== mds.0 v2:172.21.15.148:6834/851698468 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5559375e7e00 con 0x55593773ed00 2023-10-14T19:04:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bb2ffd700 10 client.5082 handle_command_reply: tid=0 2023-10-14T19:04:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 client.5082 shutdown 2023-10-14T19:04:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 msgr2=0x55593779b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593779b5b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8037040 tx=0x7f8bc802e040 comp rx=0 tx=0).stop 2023-10-14T19:04:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 shutdown_connections 2023-10-14T19:04:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:6834/851698468,v1:172.21.15.148:6836/851698468] conn(0x55593773ed00 0x555937738320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55593773e250 0x5559376f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bb2ffd700 0 client.5082 ms_handle_reset on v2:172.21.15.148:6834/851698468 2023-10-14T19:04:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559376f4a50 0x55593779b5b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 --2- 172.21.15.7:0/2464047359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55593771df60 0x55593773b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 >> 172.21.15.7:0/2464047359 conn(0x5559376f6370 msgr2=0x55593773c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 shutdown_connections 2023-10-14T19:04:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 1 -- 172.21.15.7:0/2464047359 wait complete. 2023-10-14T19:04:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8be4419b80 20 client.5082 trim_cache size 0 max 16384 2023-10-14T19:04:05.443 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:04:05.444 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:04:05.444 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:04:05.444 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4878, 2023-10-14T19:04:05.444 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:04:05.444 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:04:05.445 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:04:05.445 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 10.474106033, 2023-10-14T19:04:05.445 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 16, 2023-10-14T19:04:05.445 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 33, 2023-10-14T19:04:05.445 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 33, 2023-10-14T19:04:05.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 19.365476864000001 2023-10-14T19:04:05.446 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:04:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bb8066f30 msgr2=0x7f8bb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bb8066f30 0x7f8bb80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80093f0 tx=0x7f8bc8008040 comp rx=0 tx=0).stop 2023-10-14T19:04:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 msgr2=0x7f8bd416cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 0x7f8bd416cd10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001460 tx=0x7f8bcc001a40 comp rx=0 tx=0).stop 2023-10-14T19:04:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 shutdown_connections 2023-10-14T19:04:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bb8066f30 0x7f8bb80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bd40cb5a0 0x7f8bd4147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bd416a2e0 0x7f8bd416cd10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 --2- 172.21.15.7:0/2150645107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bd40cd9e0 0x7f8bd416c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.419+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 >> 172.21.15.7:0/2150645107 conn(0x7f8bd4070e30 msgr2=0x7f8bd40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.420+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 shutdown_connections 2023-10-14T19:04:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.420+0000 7f8bdb120700 1 -- 172.21.15.7:0/2150645107 wait complete. 2023-10-14T19:04:05.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:04:05.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.568+0000 7f7cf94be700 1 Processor -- start 2023-10-14T19:04:05.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.568+0000 7f7cf94be700 1 -- start start 2023-10-14T19:04:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf94be700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7cf41595f0 0x7f7cf40cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf94be700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40cc770 con 0x7f7cf40cee70 2023-10-14T19:04:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf94be700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40b1400 con 0x7f7cf406df60 2023-10-14T19:04:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf94be700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40cbb60 con 0x7f7cf41595f0 2023-10-14T19:04:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf27fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7cf40cee70 0x7f7cf406d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34740/0 (socket says 172.21.15.7:34740) 2023-10-14T19:04:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf27fc700 1 -- 172.21.15.7:0/120760168 learned_addr learned my addr 172.21.15.7:0/120760168 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf2ffd700 1 --2- 172.21.15.7:0/120760168 >> v2:172.21.15.148:3300/0 conn(0x7f7cf41595f0 0x7f7cf40cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf1ffb700 1 -- 172.21.15.7:0/120760168 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691847586 0 0) 0x7f7cf40cc770 con 0x7f7cf40cee70 2023-10-14T19:04:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.569+0000 7f7cf1ffb700 1 -- 172.21.15.7:0/120760168 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cdc003570 con 0x7f7cf40cee70 2023-10-14T19:04:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/120760168 >> v1:172.21.15.148:6789/0 conn(0x7f7cf406df60 legacy=0x7f7cf41632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/120760168 >> v1:172.21.15.7:6789/0 conn(0x7f7cf40cee70 legacy=0x7f7cf406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/120760168 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40cbe40 con 0x7f7cf41595f0 2023-10-14T19:04:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf2ffd700 1 --2- 172.21.15.7:0/120760168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf40cb560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40098e0 tx=0x7f7ce40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555a2a4d4fb7410d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf1ffb700 1 -- 172.21.15.7:0/120760168 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400b640 con 0x7f7cf41595f0 2023-10-14T19:04:05.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf1ffb700 1 -- 172.21.15.7:0/120760168 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400b7a0 con 0x7f7cf41595f0 2023-10-14T19:04:05.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf1ffb700 1 -- 172.21.15.7:0/120760168 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400bb40 con 0x7f7cf41595f0 2023-10-14T19:04:05.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf94be700 1 -- 172.21.15.7:0/120760168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 msgr2=0x7f7cf40cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.570+0000 7f7cf94be700 1 --2- 172.21.15.7:0/120760168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf40cb560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40098e0 tx=0x7f7ce40091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.571+0000 7f7cf94be700 1 -- 172.21.15.7:0/120760168 shutdown_connections 2023-10-14T19:04:05.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.571+0000 7f7cf94be700 1 --2- 172.21.15.7:0/120760168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf40cb560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.571+0000 7f7cf94be700 1 -- 172.21.15.7:0/120760168 >> 172.21.15.7:0/120760168 conn(0x7f7cf4070e70 msgr2=0x7f7cf40d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.571+0000 7f7cf94be700 1 -- 172.21.15.7:0/120760168 shutdown_connections 2023-10-14T19:04:05.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.571+0000 7f7cf94be700 1 -- 172.21.15.7:0/120760168 wait complete. 2023-10-14T19:04:05.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.572+0000 7f7cf94be700 1 Processor -- start 2023-10-14T19:04:05.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.572+0000 7f7cf94be700 1 -- start start 2023-10-14T19:04:05.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 0x7f7cf40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf40cee70 0x7f7cf415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40b47f0 con 0x7f7cf406df60 2023-10-14T19:04:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40b5650 con 0x7f7cf41595f0 2023-10-14T19:04:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40b4a40 con 0x7f7cf40cee70 2023-10-14T19:04:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 0x7f7cf40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 0x7f7cf40b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40060/0 (socket says 172.21.15.7:40060) 2023-10-14T19:04:05.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/3923661261 learned_addr learned my addr 172.21.15.7:0/3923661261 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:05.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf37fe700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf27fc700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf40cee70 0x7f7cf415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf40cee70 msgr2=0x7f7cf415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf40cee70 0x7f7cf415d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 msgr2=0x7f7cf415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 -- 172.21.15.7:0/3923661261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4009420 con 0x7f7cf406df60 2023-10-14T19:04:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf2ffd700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 0x7f7cf40b5ae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40712c0 tx=0x7f7ce4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400bb20 con 0x7f7cf406df60 2023-10-14T19:04:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4011420 con 0x7f7cf406df60 2023-10-14T19:04:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf40b4d20 con 0x7f7cf406df60 2023-10-14T19:04:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40117a0 con 0x7f7cf406df60 2023-10-14T19:04:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.573+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf40b52e0 con 0x7f7cf406df60 2023-10-14T19:04:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.574+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf404c3c0 con 0x7f7cf406df60 2023-10-14T19:04:05.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.575+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ce4011b50 con 0x7f7cf406df60 2023-10-14T19:04:05.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.575+0000 7f7cdaffd700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ce0066f30 0x7f7ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:05.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.575+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ce4085cf0 con 0x7f7cf406df60 2023-10-14T19:04:05.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.575+0000 7f7cf27fc700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ce0066f30 0x7f7ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:05.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.576+0000 7f7cf27fc700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ce0066f30 0x7f7ce00693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80058d0 tx=0x7f7ce8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:05.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.579+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ce408a070 con 0x7f7cf406df60 2023-10-14T19:04:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.817+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7cf40b5930 con 0x7f7cf406df60 2023-10-14T19:04:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.817+0000 7f7cdaffd700 1 -- 172.21.15.7:0/3923661261 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7ce4052f60 con 0x7f7cf406df60 2023-10-14T19:04:05.818 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:04:05.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ce0066f30 msgr2=0x7f7ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ce0066f30 0x7f7ce00693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80058d0 tx=0x7f7ce8009040 comp rx=0 tx=0).stop 2023-10-14T19:04:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 msgr2=0x7f7cf40b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 0x7f7cf40b5ae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40712c0 tx=0x7f7ce4017000 comp rx=0 tx=0).stop 2023-10-14T19:04:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 shutdown_connections 2023-10-14T19:04:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ce0066f30 0x7f7ce00693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf41595f0 0x7f7cf415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cf406df60 0x7f7cf40b5ae0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 --2- 172.21.15.7:0/3923661261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf40cee70 0x7f7cf415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 >> 172.21.15.7:0/3923661261 conn(0x7f7cf4070e70 msgr2=0x7f7cf4158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 shutdown_connections 2023-10-14T19:04:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:05.819+0000 7f7cf94be700 1 -- 172.21.15.7:0/3923661261 wait complete. 2023-10-14T19:04:05.832 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:04:05.833 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:04:05.833 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:04:05.833 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:04:05.834 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:05.834 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:04:05.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:04:05.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:04:05.835 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:04:05.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:05.836 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:04:05.852 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:04:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:04:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:04:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:04:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.854 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:04:05.854 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:04:05.855 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:04:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:04:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:04:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-10-14T19:04:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:04:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.856 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:04:05.857 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:04:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:04:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:04:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.858 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:04:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:04:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.859 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:04:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:04:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:05.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:05.861 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:04:05.916 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:04:05.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:05.919 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:04:05.976 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:04:05.976 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:04:05.976 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:04:05.977 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:04:05.977 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:04:05.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:05.979 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:04:05.980 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:04:05.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:04:05.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:04:05.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:04:05.983 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:04:06.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:06.079 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:04:06.094 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:04:06.094 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:04:06.095 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:04:06.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:06.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:04:06.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:06.161 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:06.215 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:04:06.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:06.216 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:06.269 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:04:06.270 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:04:06.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:06.350 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:06.351 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:04:06.351 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:04:06.359 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:06.359 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:04:06.360 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:04:06.360 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:06.360 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:06.382 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:06.383 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:04:06.383 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:04:06.384 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:06.384 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:06.384 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:04:06.385 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:04:06.385 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:04:06.387 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:04:06.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:06.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:06.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:04:06.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.612+0000 7fe16d097700 1 Processor -- start 2023-10-14T19:04:06.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.612+0000 7fe16d097700 1 -- start start 2023-10-14T19:04:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16d097700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe1680cb5a0 0x7fe1680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16d097700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cd9e0 0x7fe168159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16d097700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16815ae40 con 0x7fe1680cde50 2023-10-14T19:04:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16d097700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1680d13f0 con 0x7fe1680cb5a0 2023-10-14T19:04:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16d097700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16815ab60 con 0x7fe1680cd9e0 2023-10-14T19:04:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16759e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe1680cde50 0x7fe168156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34746/0 (socket says 172.21.15.7:34746) 2023-10-14T19:04:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16759e700 1 -- 172.21.15.7:0/3766274887 learned_addr learned my addr 172.21.15.7:0/3766274887 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe166d9d700 1 --2- 172.21.15.7:0/3766274887 >> v2:172.21.15.148:3300/0 conn(0x7fe1680cb5a0 0x7fe1680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe16659c700 1 --2- 172.21.15.7:0/3766274887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cd9e0 0x7fe168159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe165d9b700 1 -- 172.21.15.7:0/3766274887 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424431338 0 0) 0x7fe16815ae40 con 0x7fe1680cde50 2023-10-14T19:04:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.613+0000 7fe165d9b700 1 -- 172.21.15.7:0/3766274887 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe154003570 con 0x7fe1680cde50 2023-10-14T19:04:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16659c700 1 -- 172.21.15.7:0/3766274887 >> v2:172.21.15.148:3300/0 conn(0x7fe1680cb5a0 msgr2=0x7fe1680cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16659c700 1 --2- 172.21.15.7:0/3766274887 >> v2:172.21.15.148:3300/0 conn(0x7fe1680cb5a0 0x7fe1680cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16659c700 1 -- 172.21.15.7:0/3766274887 >> v1:172.21.15.7:6789/0 conn(0x7fe1680cde50 legacy=0x7fe168156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16659c700 1 -- 172.21.15.7:0/3766274887 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680ccf00 con 0x7fe1680cd9e0 2023-10-14T19:04:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16659c700 1 --2- 172.21.15.7:0/3766274887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cd9e0 0x7fe168159ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1500098e0 tx=0x7fe1500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe1143b5c6d0932 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe165d9b700 1 -- 172.21.15.7:0/3766274887 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150011630 con 0x7fe1680cd9e0 2023-10-14T19:04:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe165d9b700 1 -- 172.21.15.7:0/3766274887 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150011790 con 0x7fe1680cd9e0 2023-10-14T19:04:06.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe165d9b700 1 -- 172.21.15.7:0/3766274887 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150011b10 con 0x7fe1680cd9e0 2023-10-14T19:04:06.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16d097700 1 -- 172.21.15.7:0/3766274887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cd9e0 msgr2=0x7fe168159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:06.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16d097700 1 --2- 172.21.15.7:0/3766274887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cd9e0 0x7fe168159ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1500098e0 tx=0x7fe1500091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16d097700 1 -- 172.21.15.7:0/3766274887 shutdown_connections 2023-10-14T19:04:06.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16d097700 1 --2- 172.21.15.7:0/3766274887 >> v2:172.21.15.148:3300/0 conn(0x7fe1680cb5a0 0x7fe1680cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.614+0000 7fe16d097700 1 --2- 172.21.15.7:0/3766274887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cd9e0 0x7fe168159ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.615+0000 7fe16d097700 1 -- 172.21.15.7:0/3766274887 >> 172.21.15.7:0/3766274887 conn(0x7fe168070e30 msgr2=0x7fe1680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:06.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.615+0000 7fe16d097700 1 -- 172.21.15.7:0/3766274887 shutdown_connections 2023-10-14T19:04:06.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.615+0000 7fe16d097700 1 -- 172.21.15.7:0/3766274887 wait complete. 2023-10-14T19:04:06.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.616+0000 7fe16d097700 1 Processor -- start 2023-10-14T19:04:06.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.616+0000 7fe16d097700 1 -- start start 2023-10-14T19:04:06.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.616+0000 7fe16d097700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cb5a0 0x7fe168151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:06.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 0x7fe16815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:06.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1680b5c30 0x7fe1680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:06.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680c95c0 con 0x7fe1680cd9e0 2023-10-14T19:04:06.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680c89b0 con 0x7fe1680b5c30 2023-10-14T19:04:06.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680c8c90 con 0x7fe1680cb5a0 2023-10-14T19:04:06.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 0x7fe16815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:06.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 0x7fe16815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40070/0 (socket says 172.21.15.7:40070) 2023-10-14T19:04:06.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 -- 172.21.15.7:0/2474865697 learned_addr learned my addr 172.21.15.7:0/2474865697 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:06.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16759e700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1680b5c30 0x7fe1680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:06.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe166d9d700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cb5a0 0x7fe168151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:06.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 -- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cb5a0 msgr2=0x7fe168151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:06.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cb5a0 0x7fe168151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 -- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1680b5c30 msgr2=0x7fe1680b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:06.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1680b5c30 0x7fe1680b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 -- 172.21.15.7:0/2474865697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009420 con 0x7fe1680cd9e0 2023-10-14T19:04:06.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16659c700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 0x7fe16815b070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe16815aca0 tx=0x7fe150017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:06.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150011900 con 0x7fe1680cd9e0 2023-10-14T19:04:06.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150011a60 con 0x7fe1680cd9e0 2023-10-14T19:04:06.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680c8f70 con 0x7fe1680cd9e0 2023-10-14T19:04:06.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15001a680 con 0x7fe1680cd9e0 2023-10-14T19:04:06.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.617+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16815b5b0 con 0x7fe1680cd9e0 2023-10-14T19:04:06.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.618+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16804c3c0 con 0x7fe1680cd9e0 2023-10-14T19:04:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.619+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe15001aa30 con 0x7fe1680cd9e0 2023-10-14T19:04:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.619+0000 7fe15effd700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe148066f30 0x7fe1480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.619+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe150086180 con 0x7fe1680cd9e0 2023-10-14T19:04:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.619+0000 7fe166d9d700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe148066f30 0x7fe1480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.620+0000 7fe166d9d700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe148066f30 0x7fe1480693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe158009d10 tx=0x7fe1580091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.623+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1500533f0 con 0x7fe1680cd9e0 2023-10-14T19:04:06.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.863+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1680cd1e0 con 0x7fe1680cd9e0 2023-10-14T19:04:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.863+0000 7fe15effd700 1 -- 172.21.15.7:0/2474865697 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe150056a10 con 0x7fe1680cd9e0 2023-10-14T19:04:06.865 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:04:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe148066f30 msgr2=0x7fe1480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe148066f30 0x7fe1480693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe158009d10 tx=0x7fe1580091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 msgr2=0x7fe16815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 0x7fe16815b070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe16815aca0 tx=0x7fe150017000 comp rx=0 tx=0).stop 2023-10-14T19:04:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 shutdown_connections 2023-10-14T19:04:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe148066f30 0x7fe1480693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1680b5c30 0x7fe1680b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1680cb5a0 0x7fe168151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 --2- 172.21.15.7:0/2474865697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1680cd9e0 0x7fe16815b070 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.865+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 >> 172.21.15.7:0/2474865697 conn(0x7fe168070e30 msgr2=0x7fe16806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.866+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 shutdown_connections 2023-10-14T19:04:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:06.866+0000 7fe16d097700 1 -- 172.21.15.7:0/2474865697 wait complete. 2023-10-14T19:04:06.878 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:04:06.879 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:04:06.879 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:04:06.880 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:04:06.880 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:06.880 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:04:06.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:04:06.881 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:04:06.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:04:06.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:06.882 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:04:06.902 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:04:06.903 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:04:06.903 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:04:06.903 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.903 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:04:06.904 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.904 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:06.904 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:06.904 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:04:06.905 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:06.905 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:06.905 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:04:06.905 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:06.906 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:06.906 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:04:06.906 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:06.906 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:04:06.910 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42417sec preferred_lft 42417sec 2023-10-14T19:04:06.911 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:04:06.911 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.911 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:04:06.912 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:06.912 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:04:06.912 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.912 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:04:06.913 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.913 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:06.913 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:04:06.913 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:04:06.914 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.914 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:06.914 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:04:06.914 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:04:06.914 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:06.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:06.915 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:04:06.971 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:04:06.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:06.973 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:04:07.032 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:04:07.033 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:04:07.033 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:04:07.033 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:04:07.034 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:04:07.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:07.034 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:04:07.035 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:04:07.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:04:07.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:04:07.036 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:04:07.036 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:04:07.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:07.139 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:04:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:04:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:04:07.156 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:04:07.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:07.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:04:07.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:07.222 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:07.276 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:04:07.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:07.278 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:07.331 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:04:07.331 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:04:07.332 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:07.413 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:07.413 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:04:07.414 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:04:07.420 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:07.420 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:04:07.420 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:04:07.421 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:07.421 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:07.442 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:07.442 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:04:07.443 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:04:07.443 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:07.443 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:07.443 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:04:07.444 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:04:07.444 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:04:07.445 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:04:07.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:07.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:07.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:04:07.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.641+0000 7f55616fb700 1 Processor -- start 2023-10-14T19:04:07.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.641+0000 7f55616fb700 1 -- start start 2023-10-14T19:04:07.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.642+0000 7f55616fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 0x7f555c157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.642+0000 7f55616fb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f555c0c7b30 0x7f555c06b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.642+0000 7f55616fb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c06b2f0 con 0x7f555c06bcc0 2023-10-14T19:04:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.642+0000 7f55616fb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c06ace0 con 0x7f555c0c7b30 2023-10-14T19:04:07.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.642+0000 7f55616fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0c8310 con 0x7f555c156480 2023-10-14T19:04:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555a7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f555c0c7b30 0x7f555c06b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 0x7f555c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 0x7f555c157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:35004/0 (socket says 172.21.15.7:35004) 2023-10-14T19:04:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f555c06bcc0 0x7f555c0ae140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:46544/0 (socket says 172.21.15.7:46544) 2023-10-14T19:04:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555affd700 1 -- 172.21.15.7:0/3196453216 learned_addr learned my addr 172.21.15.7:0/3196453216 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f5559ffb700 1 -- 172.21.15.7:0/3196453216 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005325042 0 0) 0x7f555c06b2f0 con 0x7f555c06bcc0 2023-10-14T19:04:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f5559ffb700 1 -- 172.21.15.7:0/3196453216 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5544003570 con 0x7f555c06bcc0 2023-10-14T19:04:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555a7fc700 1 -- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 msgr2=0x7f555c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555a7fc700 1 --2- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 0x7f555c157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555a7fc700 1 -- 172.21.15.7:0/3196453216 >> v1:172.21.15.148:6789/0 conn(0x7f555c06bcc0 legacy=0x7f555c0ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555a7fc700 1 -- 172.21.15.7:0/3196453216 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0c85f0 con 0x7f555c0c7b30 2023-10-14T19:04:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555affd700 1 --2- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 0x7f555c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f555a7fc700 1 --2- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c0c7b30 0x7f555c06b780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55500098e0 tx=0x7f55500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae7d1a8374bdb4af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f5559ffb700 1 -- 172.21.15.7:0/3196453216 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011630 con 0x7f555c0c7b30 2023-10-14T19:04:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.643+0000 7f5559ffb700 1 -- 172.21.15.7:0/3196453216 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5550011790 con 0x7f555c0c7b30 2023-10-14T19:04:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f5559ffb700 1 -- 172.21.15.7:0/3196453216 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011b30 con 0x7f555c0c7b30 2023-10-14T19:04:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 -- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c0c7b30 msgr2=0x7f555c06b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 --2- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c0c7b30 0x7f555c06b780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55500098e0 tx=0x7f55500091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 -- 172.21.15.7:0/3196453216 shutdown_connections 2023-10-14T19:04:07.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 --2- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c156480 0x7f555c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 --2- 172.21.15.7:0/3196453216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c0c7b30 0x7f555c06b780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 -- 172.21.15.7:0/3196453216 >> 172.21.15.7:0/3196453216 conn(0x7f555c06d170 msgr2=0x7f555c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 -- 172.21.15.7:0/3196453216 shutdown_connections 2023-10-14T19:04:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.644+0000 7f55616fb700 1 -- 172.21.15.7:0/3196453216 wait complete. 2023-10-14T19:04:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.645+0000 7f55616fb700 1 Processor -- start 2023-10-14T19:04:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.645+0000 7f55616fb700 1 -- start start 2023-10-14T19:04:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f55616fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c06bcc0 0x7f555c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f55616fb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 0x7f555c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f55616fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c156480 0x7f555c1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f55616fb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c158af0 con 0x7f555c0c7b30 2023-10-14T19:04:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f55616fb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c16b5f0 con 0x7f555c156480 2023-10-14T19:04:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f55616fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c158810 con 0x7f555c06bcc0 2023-10-14T19:04:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 0x7f555c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 0x7f555c157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43672/0 (socket says 172.21.15.7:43672) 2023-10-14T19:04:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 -- 172.21.15.7:0/3914755973 learned_addr learned my addr 172.21.15.7:0/3914755973 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555b7fe700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c156480 0x7f555c1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555affd700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c06bcc0 0x7f555c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 -- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c06bcc0 msgr2=0x7f555c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c06bcc0 0x7f555c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 -- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c156480 msgr2=0x7f555c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c156480 0x7f555c1581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.646+0000 7f555a7fc700 1 -- 172.21.15.7:0/3914755973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0094f0 con 0x7f555c0c7b30 2023-10-14T19:04:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.647+0000 7f555a7fc700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 0x7f555c157ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f555c06d5c0 tx=0x7f5550017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.647+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011b10 con 0x7f555c0c7b30 2023-10-14T19:04:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.647+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55500253f0 con 0x7f555c0c7b30 2023-10-14T19:04:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.647+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500257b0 con 0x7f555c0c7b30 2023-10-14T19:04:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.647+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5550009420 con 0x7f555c0c7b30 2023-10-14T19:04:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.647+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c16b280 con 0x7f555c0c7b30 2023-10-14T19:04:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.648+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c16ae00 con 0x7f555c0c7b30 2023-10-14T19:04:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.648+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5550025ba0 con 0x7f555c0c7b30 2023-10-14T19:04:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.649+0000 7f5542ffd700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5548066f30 0x7f55480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.649+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5550085ef0 con 0x7f555c0c7b30 2023-10-14T19:04:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.649+0000 7f555affd700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5548066f30 0x7f55480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:07.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.649+0000 7f555affd700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5548066f30 0x7f55480693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f555c0b1510 tx=0x7f554c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:07.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.653+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f555c16ae00 con 0x7f555c0c7b30 2023-10-14T19:04:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:07.890+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f555c16ae00 con 0x7f555c0c7b30 2023-10-14T19:04:08.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.003+0000 7f5542ffd700 1 -- 172.21.15.7:0/3914755973 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f555c16ae00 con 0x7f555c0c7b30 2023-10-14T19:04:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.005+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5548066f30 msgr2=0x7f55480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.005+0000 7f55616fb700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5548066f30 0x7f55480693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f555c0b1510 tx=0x7f554c008040 comp rx=0 tx=0).stop 2023-10-14T19:04:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.005+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 msgr2=0x7f555c157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.005+0000 7f55616fb700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 0x7f555c157ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f555c06d5c0 tx=0x7f5550017000 comp rx=0 tx=0).stop 2023-10-14T19:04:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 shutdown_connections 2023-10-14T19:04:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5548066f30 0x7f55480693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f555c156480 0x7f555c1581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f555c06bcc0 0x7f555c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 --2- 172.21.15.7:0/3914755973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c0c7b30 0x7f555c157ca0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 >> 172.21.15.7:0/3914755973 conn(0x7f555c06d170 msgr2=0x7f555c152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:08.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 shutdown_connections 2023-10-14T19:04:08.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.006+0000 7f55616fb700 1 -- 172.21.15.7:0/3914755973 wait complete. 2023-10-14T19:04:08.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:04:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.139+0000 7f1046ca3700 1 Processor -- start 2023-10-14T19:04:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.139+0000 7f1046ca3700 1 -- start start 2023-10-14T19:04:08.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.139+0000 7f1046ca3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f10400cb5a0 0x7f10400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.139+0000 7f1046ca3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104015ae40 con 0x7f10400cd9e0 2023-10-14T19:04:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.139+0000 7f1046ca3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104015ab60 con 0x7f104015a5d0 2023-10-14T19:04:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.139+0000 7f1046ca3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10400d13f0 con 0x7f10400cb5a0 2023-10-14T19:04:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f10400cd9e0 0x7f1040159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47696/0 (socket says 172.21.15.7:47696) 2023-10-14T19:04:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103ffff700 1 -- 172.21.15.7:0/2966831648 learned_addr learned my addr 172.21.15.7:0/2966831648 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f1044a3f700 1 --2- 172.21.15.7:0/2966831648 >> v2:172.21.15.148:3300/0 conn(0x7f10400cb5a0 0x7f10400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109392685 0 0) 0x7f104015ae40 con 0x7f10400cd9e0 2023-10-14T19:04:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f102c003570 con 0x7f10400cd9e0 2023-10-14T19:04:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1817706819 0 0) 0x7f102c003570 con 0x7f10400cd9e0 2023-10-14T19:04:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 >> v2:172.21.15.148:3300/0 conn(0x7f10400cb5a0 msgr2=0x7f10400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 --2- 172.21.15.7:0/2966831648 >> v2:172.21.15.148:3300/0 conn(0x7f10400cb5a0 0x7f10400cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 >> v1:172.21.15.148:6789/0 conn(0x7f104015a5d0 legacy=0x7f1040156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400ccf00 con 0x7f10400cd9e0 2023-10-14T19:04:08.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f1030001470 con 0x7f10400cd9e0 2023-10-14T19:04:08.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 >> v1:172.21.15.7:6789/0 conn(0x7f10400cd9e0 legacy=0x7f1040159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f102c003a60 0x7f102c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102c004810 0x7f102c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c0051c0 0x7f102c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c00c0a0 con 0x7f102c004810 2023-10-14T19:04:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c00c210 con 0x7f102c003a60 2023-10-14T19:04:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c00c3d0 con 0x7f102c0051c0 2023-10-14T19:04:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f103ffff700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102c004810 0x7f102c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.140+0000 7f1044a3f700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f102c003a60 0x7f102c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f1045240700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c0051c0 0x7f102c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103ffff700 1 -- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c0051c0 msgr2=0x7f102c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103ffff700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c0051c0 0x7f102c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103ffff700 1 -- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f102c003a60 msgr2=0x7f102c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103ffff700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f102c003a60 0x7f102c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103ffff700 1 -- 172.21.15.7:0/2966831648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c003570 con 0x7f102c004810 2023-10-14T19:04:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f1045240700 1 -- 172.21.15.7:0/2966831648 reap_dead start 2023-10-14T19:04:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103ffff700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102c004810 0x7f102c004c80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f103000c3c0 tx=0x7f1030001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57515a18dea03664 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103000cc90 con 0x7f102c004810 2023-10-14T19:04:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103000cdf0 con 0x7f102c004810 2023-10-14T19:04:08.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f103f7fe700 1 -- 172.21.15.7:0/2966831648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030005b50 con 0x7f102c004810 2023-10-14T19:04:08.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f1046ca3700 1 -- 172.21.15.7:0/2966831648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102c004810 msgr2=0x7f102c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.141+0000 7f1046ca3700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102c004810 0x7f102c004c80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f103000c3c0 tx=0x7f1030001e50 comp rx=0 tx=0).stop 2023-10-14T19:04:08.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.142+0000 7f1046ca3700 1 -- 172.21.15.7:0/2966831648 shutdown_connections 2023-10-14T19:04:08.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.142+0000 7f1046ca3700 1 --2- 172.21.15.7:0/2966831648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102c004810 0x7f102c004c80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.142+0000 7f1046ca3700 1 -- 172.21.15.7:0/2966831648 >> 172.21.15.7:0/2966831648 conn(0x7f1040070e30 msgr2=0x7f10400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.142+0000 7f1046ca3700 1 -- 172.21.15.7:0/2966831648 shutdown_connections 2023-10-14T19:04:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.142+0000 7f1046ca3700 1 -- 172.21.15.7:0/2966831648 wait complete. 2023-10-14T19:04:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.143+0000 7f1046ca3700 1 Processor -- start 2023-10-14T19:04:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.143+0000 7f1046ca3700 1 -- start start 2023-10-14T19:04:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c004810 0x7f104013f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10400b5c60 0x7f10400b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 0x7f10401404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040157800 con 0x7f1040140070 2023-10-14T19:04:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040140a20 con 0x7f10400b5c60 2023-10-14T19:04:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b57d0 con 0x7f102c004810 2023-10-14T19:04:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 0x7f10401404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 0x7f10401404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43692/0 (socket says 172.21.15.7:43692) 2023-10-14T19:04:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 -- 172.21.15.7:0/40040792 learned_addr learned my addr 172.21.15.7:0/40040792 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f103ffff700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10400b5c60 0x7f10400b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1044a3f700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c004810 0x7f104013f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 -- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c004810 msgr2=0x7f104013f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c004810 0x7f104013f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 -- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10400b5c60 msgr2=0x7f10400b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10400b5c60 0x7f10400b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 -- 172.21.15.7:0/40040792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104013fd90 con 0x7f1040140070 2023-10-14T19:04:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1045240700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 0x7f10401404e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10400cbeb0 tx=0x7f1038009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380032e0 con 0x7f1040140070 2023-10-14T19:04:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1038003460 con 0x7f1040140070 2023-10-14T19:04:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1040157520 con 0x7f1040140070 2023-10-14T19:04:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380017d0 con 0x7f1040140070 2023-10-14T19:04:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.144+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10400b5460 con 0x7f1040140070 2023-10-14T19:04:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.145+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10400b4fe0 con 0x7f1040140070 2023-10-14T19:04:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.146+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1038001bc0 con 0x7f1040140070 2023-10-14T19:04:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.146+0000 7f103cff9700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1020066f30 0x7f10200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.146+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1038083e40 con 0x7f1040140070 2023-10-14T19:04:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.146+0000 7f1044a3f700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1020066f30 0x7f10200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.147+0000 7f1044a3f700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1020066f30 0x7f10200693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1028006f00 tx=0x7f10280091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.150+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10400b4fe0 con 0x7f1040140070 2023-10-14T19:04:08.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.373+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f10400b4fe0 con 0x7f1020066f30 2023-10-14T19:04:08.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.375+0000 7f103cff9700 1 -- 172.21.15.7:0/40040792 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f10400b4fe0 con 0x7f1020066f30 2023-10-14T19:04:08.375 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:04:08.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:08.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:04:08.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:08.376 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:04:08.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1020066f30 msgr2=0x7f10200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1020066f30 0x7f10200693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1028006f00 tx=0x7f10280091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 msgr2=0x7f10401404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 0x7f10401404e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10400cbeb0 tx=0x7f1038009040 comp rx=0 tx=0).stop 2023-10-14T19:04:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 shutdown_connections 2023-10-14T19:04:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1020066f30 0x7f10200693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.376+0000 7f1046ca3700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040140070 0x7f10401404e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.377+0000 7f1046ca3700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f102c004810 0x7f104013f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.377+0000 7f1046ca3700 1 --2- 172.21.15.7:0/40040792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10400b5c60 0x7f10400b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.377+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 >> 172.21.15.7:0/40040792 conn(0x7f1040070e30 msgr2=0x7f1040154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.377+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 shutdown_connections 2023-10-14T19:04:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.377+0000 7f1046ca3700 1 -- 172.21.15.7:0/40040792 wait complete. 2023-10-14T19:04:08.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:04:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.511+0000 7fcedfab7700 1 Processor -- start 2023-10-14T19:04:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.511+0000 7fcedfab7700 1 -- start start 2023-10-14T19:04:08.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedfab7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedfab7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fced806dc70 0x7fced8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedfab7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80ccfd0 con 0x7fced806e0e0 2023-10-14T19:04:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedfab7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced80cf0e0 con 0x7fced806dc70 2023-10-14T19:04:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedfab7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced815a3d0 con 0x7fced8159530 2023-10-14T19:04:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd052700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fced806dc70 0x7fced8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcede054700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fced806e0e0 0x7fced80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47706/0 (socket says 172.21.15.7:47706) 2023-10-14T19:04:08.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcede054700 1 -- 172.21.15.7:0/3376358104 learned_addr learned my addr 172.21.15.7:0/3376358104 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:08.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd853700 1 --2- 172.21.15.7:0/3376358104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd052700 1 -- 172.21.15.7:0/3376358104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 msgr2=0x7fced80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:08.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd052700 1 --2- 172.21.15.7:0/3376358104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd052700 1 -- 172.21.15.7:0/3376358104 >> v1:172.21.15.7:6789/0 conn(0x7fced806e0e0 legacy=0x7fced80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd052700 1 -- 172.21.15.7:0/3376358104 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced815a6b0 con 0x7fced806dc70 2023-10-14T19:04:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedc851700 1 -- 172.21.15.7:0/3376358104 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671167639 0 0) 0x7fced80ccfd0 con 0x7fced806e0e0 2023-10-14T19:04:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.512+0000 7fcedd052700 1 --2- 172.21.15.7:0/3376358104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8159900 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098e0 tx=0x7fcecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3241887f8fcb6a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedc851700 1 -- 172.21.15.7:0/3376358104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00b640 con 0x7fced806dc70 2023-10-14T19:04:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedc851700 1 -- 172.21.15.7:0/3376358104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00b7a0 con 0x7fced806dc70 2023-10-14T19:04:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedc851700 1 -- 172.21.15.7:0/3376358104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bb40 con 0x7fced806dc70 2023-10-14T19:04:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 -- 172.21.15.7:0/3376358104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 msgr2=0x7fced8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3376358104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8159900 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098e0 tx=0x7fcecc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 -- 172.21.15.7:0/3376358104 shutdown_connections 2023-10-14T19:04:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3376358104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3376358104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8159900 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 -- 172.21.15.7:0/3376358104 >> 172.21.15.7:0/3376358104 conn(0x7fced80703a0 msgr2=0x7fced80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:08.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 -- 172.21.15.7:0/3376358104 shutdown_connections 2023-10-14T19:04:08.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.513+0000 7fcedfab7700 1 -- 172.21.15.7:0/3376358104 wait complete. 2023-10-14T19:04:08.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.514+0000 7fcedfab7700 1 Processor -- start 2023-10-14T19:04:08.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.514+0000 7fcedfab7700 1 -- start start 2023-10-14T19:04:08.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedfab7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedfab7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced806e0e0 0x7fced816a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedfab7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedfab7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8155bd0 con 0x7fced806dc70 2023-10-14T19:04:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedfab7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced816ac80 con 0x7fced806e0e0 2023-10-14T19:04:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedfab7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80ca5f0 con 0x7fced8159530 2023-10-14T19:04:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedd853700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedd853700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43702/0 (socket says 172.21.15.7:43702) 2023-10-14T19:04:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.515+0000 7fcedd853700 1 -- 172.21.15.7:0/3697601610 learned_addr learned my addr 172.21.15.7:0/3697601610 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd853700 1 -- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 msgr2=0x7fced80ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd853700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd853700 1 -- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced806e0e0 msgr2=0x7fced816a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd052700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced806e0e0 0x7fced816a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd853700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced806e0e0 0x7fced816a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd853700 1 -- 172.21.15.7:0/3697601610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009420 con 0x7fced806dc70 2023-10-14T19:04:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedd853700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8155690 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009e80 tx=0x7fcec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec800cc20 con 0x7fced806dc70 2023-10-14T19:04:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec800f040 con 0x7fced806dc70 2023-10-14T19:04:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced81569d0 con 0x7fced806dc70 2023-10-14T19:04:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8014480 con 0x7fced806dc70 2023-10-14T19:04:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.516+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced81560a0 con 0x7fced806dc70 2023-10-14T19:04:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.517+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8156cb0 con 0x7fced806dc70 2023-10-14T19:04:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.518+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcec80147f0 con 0x7fced806dc70 2023-10-14T19:04:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.518+0000 7fced5ffb700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.518+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcec8085260 con 0x7fced806dc70 2023-10-14T19:04:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.518+0000 7fcedd052700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.519+0000 7fcedd052700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcec4066f30 0x7fcec40693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcecc003080 tx=0x7fcecc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.522+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcec80524d0 con 0x7fced806dc70 2023-10-14T19:04:08.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.717+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fced804c3c0 con 0x7fced806dc70 2023-10-14T19:04:08.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.717+0000 7fced5ffb700 1 -- 172.21.15.7:0/3697601610 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcec8055af0 con 0x7fced806dc70 2023-10-14T19:04:08.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.719+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcec4066f30 msgr2=0x7fcec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.719+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcec4066f30 0x7fcec40693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcecc003080 tx=0x7fcecc017000 comp rx=0 tx=0).stop 2023-10-14T19:04:08.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.719+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 msgr2=0x7fced8155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.719+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8155690 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009e80 tx=0x7fcec800b040 comp rx=0 tx=0).stop 2023-10-14T19:04:08.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 shutdown_connections 2023-10-14T19:04:08.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fced8159530 0x7fced80ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fced806dc70 0x7fced8155690 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 --2- 172.21.15.7:0/3697601610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced806e0e0 0x7fced816a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 >> 172.21.15.7:0/3697601610 conn(0x7fced80703a0 msgr2=0x7fced80cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 shutdown_connections 2023-10-14T19:04:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.720+0000 7fcedfab7700 1 -- 172.21.15.7:0/3697601610 wait complete. 2023-10-14T19:04:08.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000825670 2023-10-14T19:04:08.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.853+0000 7f7cbedd3700 1 Processor -- start 2023-10-14T19:04:08.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.853+0000 7f7cbedd3700 1 -- start start 2023-10-14T19:04:08.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbedd3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbedd3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7cb806e0e0 0x7f7cb80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbedd3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80ccfd0 con 0x7f7cb8159530 2023-10-14T19:04:08.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbedd3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb815a3d0 con 0x7f7cb806e0e0 2023-10-14T19:04:08.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbedd3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb815a6b0 con 0x7f7cb806dc70 2023-10-14T19:04:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbcb6f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7cb8159530 0x7f7cb80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47716/0 (socket says 172.21.15.7:47716) 2023-10-14T19:04:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbcb6f700 1 -- 172.21.15.7:0/723409622 learned_addr learned my addr 172.21.15.7:0/723409622 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cbd370700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7cb806e0e0 0x7f7cb80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.854+0000 7f7cb7fff700 1 --2- 172.21.15.7:0/723409622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbd370700 1 -- 172.21.15.7:0/723409622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 msgr2=0x7f7cb8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbd370700 1 --2- 172.21.15.7:0/723409622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbd370700 1 -- 172.21.15.7:0/723409622 >> v1:172.21.15.7:6789/0 conn(0x7f7cb8159530 legacy=0x7f7cb80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbd370700 1 -- 172.21.15.7:0/723409622 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb815a990 con 0x7f7cb806e0e0 2023-10-14T19:04:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cb77fe700 1 -- 172.21.15.7:0/723409622 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096576249 0 0) 0x7f7cb80ccfd0 con 0x7f7cb8159530 2023-10-14T19:04:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbd370700 1 --2- 172.21.15.7:0/723409622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80cb6f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009e60 tx=0x7f7cb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0655771d90d5f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cb77fe700 1 -- 172.21.15.7:0/723409622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000e070 con 0x7f7cb806e0e0 2023-10-14T19:04:08.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cb77fe700 1 -- 172.21.15.7:0/723409622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000bc30 con 0x7f7cb806e0e0 2023-10-14T19:04:08.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cb77fe700 1 -- 172.21.15.7:0/723409622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0012430 con 0x7f7cb806e0e0 2023-10-14T19:04:08.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 -- 172.21.15.7:0/723409622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb806e0e0 msgr2=0x7f7cb80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/723409622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80cb6f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009e60 tx=0x7f7cb0009780 comp rx=0 tx=0).stop 2023-10-14T19:04:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 -- 172.21.15.7:0/723409622 shutdown_connections 2023-10-14T19:04:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/723409622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80cb6f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/723409622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 -- 172.21.15.7:0/723409622 >> 172.21.15.7:0/723409622 conn(0x7f7cb80703a0 msgr2=0x7f7cb80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:08.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 -- 172.21.15.7:0/723409622 shutdown_connections 2023-10-14T19:04:08.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.855+0000 7f7cbedd3700 1 -- 172.21.15.7:0/723409622 wait complete. 2023-10-14T19:04:08.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.857+0000 7f7cbedd3700 1 Processor -- start 2023-10-14T19:04:08.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.857+0000 7f7cbedd3700 1 -- start start 2023-10-14T19:04:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.857+0000 7f7cbedd3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb80ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.857+0000 7f7cbedd3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbedd3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 0x7f7cb80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbedd3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb816a530 con 0x7f7cb8159530 2023-10-14T19:04:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbedd3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80cab00 con 0x7f7cb806e0e0 2023-10-14T19:04:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbedd3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c86c0 con 0x7f7cb806dc70 2023-10-14T19:04:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 0x7f7cb80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 0x7f7cb80b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43718/0 (socket says 172.21.15.7:43718) 2023-10-14T19:04:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 -- 172.21.15.7:0/1524389768 learned_addr learned my addr 172.21.15.7:0/1524389768 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbcb6f700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb80ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cb7fff700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 -- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 msgr2=0x7f7cb80ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb80ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 -- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb806e0e0 msgr2=0x7f7cb80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 -- 172.21.15.7:0/1524389768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0009a20 con 0x7f7cb8159530 2023-10-14T19:04:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cb7fff700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbd370700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 0x7f7cb80b4eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0013000 tx=0x7f7cb0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb001d630 con 0x7f7cb8159530 2023-10-14T19:04:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb001d790 con 0x7f7cb8159530 2023-10-14T19:04:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8169920 con 0x7f7cb8159530 2023-10-14T19:04:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb001db50 con 0x7f7cb8159530 2023-10-14T19:04:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.858+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8169ee0 con 0x7f7cb8159530 2023-10-14T19:04:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.859+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb804c3c0 con 0x7f7cb8159530 2023-10-14T19:04:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.860+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cb0024070 con 0x7f7cb8159530 2023-10-14T19:04:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.860+0000 7f7cb4ff9700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.860+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cb0086da0 con 0x7f7cb8159530 2023-10-14T19:04:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.861+0000 7f7cbcb6f700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.861+0000 7f7cbcb6f700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80709f0 tx=0x7f7ca8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:08.865+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cb0054010 con 0x7f7cb8159530 2023-10-14T19:04:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:09.085+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000825670", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cb815ac70 con 0x7f7ca4066f30 2023-10-14T19:04:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.035+0000 7f7cb4ff9700 1 -- 172.21.15.7:0/1524389768 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f7cb815ac70 con 0x7f7ca4066f30 2023-10-14T19:04:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ca4066f30 msgr2=0x7f7ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80709f0 tx=0x7f7ca8009040 comp rx=0 tx=0).stop 2023-10-14T19:04:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 msgr2=0x7f7cb80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 0x7f7cb80b4eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0013000 tx=0x7f7cb0019000 comp rx=0 tx=0).stop 2023-10-14T19:04:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 shutdown_connections 2023-10-14T19:04:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb8159530 0x7f7cb80b4eb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb806dc70 0x7f7cb80ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 --2- 172.21.15.7:0/1524389768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb806e0e0 0x7f7cb80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 >> 172.21.15.7:0/1524389768 conn(0x7f7cb80703a0 msgr2=0x7f7cb815bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 shutdown_connections 2023-10-14T19:04:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.039+0000 7f7cbedd3700 1 -- 172.21.15.7:0/1524389768 wait complete. 2023-10-14T19:04:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:Volume created successfully (no MDS daemons created) 2023-10-14T19:04:12.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:04:12.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.182+0000 7ff8a864e700 1 Processor -- start 2023-10-14T19:04:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.182+0000 7ff8a864e700 1 -- start start 2023-10-14T19:04:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a864e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8a00cf200 0x7ff8a00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a864e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00b0ba0 0x7ff8a006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a864e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a015a280 con 0x7ff8a00b07d0 2023-10-14T19:04:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a864e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a006e180 con 0x7ff8a00cf200 2023-10-14T19:04:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a864e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a006d850 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a5be9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8a00cf200 0x7ff8a00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a63ea700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8a00b07d0 0x7ff8a00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47726/0 (socket says 172.21.15.7:47726) 2023-10-14T19:04:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a63ea700 1 -- 172.21.15.7:0/1761677780 learned_addr learned my addr 172.21.15.7:0/1761677780 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a6beb700 1 --2- 172.21.15.7:0/1761677780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00b0ba0 0x7ff8a006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a5be9700 1 -- 172.21.15.7:0/1761677780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00b0ba0 msgr2=0x7ff8a006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a5be9700 1 --2- 172.21.15.7:0/1761677780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00b0ba0 0x7ff8a006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a5be9700 1 -- 172.21.15.7:0/1761677780 >> v1:172.21.15.7:6789/0 conn(0x7ff8a00b07d0 legacy=0x7ff8a00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a53e8700 1 -- 172.21.15.7:0/1761677780 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413308540 0 0) 0x7ff8a015a280 con 0x7ff8a00b07d0 2023-10-14T19:04:12.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a5be9700 1 -- 172.21.15.7:0/1761677780 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a006db30 con 0x7ff8a00cf200 2023-10-14T19:04:12.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a5be9700 1 --2- 172.21.15.7:0/1761677780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00cf200 0x7ff8a00c42c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8900098e0 tx=0x7ff8900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ff6fd51c1214e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.183+0000 7ff8a53e8700 1 -- 172.21.15.7:0/1761677780 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890009e80 con 0x7ff8a00cf200 2023-10-14T19:04:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a53e8700 1 -- 172.21.15.7:0/1761677780 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000b860 con 0x7ff8a00cf200 2023-10-14T19:04:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a53e8700 1 -- 172.21.15.7:0/1761677780 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000bbe0 con 0x7ff8a00cf200 2023-10-14T19:04:12.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 -- 172.21.15.7:0/1761677780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00cf200 msgr2=0x7ff8a00c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 --2- 172.21.15.7:0/1761677780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00cf200 0x7ff8a00c42c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8900098e0 tx=0x7ff8900091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 -- 172.21.15.7:0/1761677780 shutdown_connections 2023-10-14T19:04:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 --2- 172.21.15.7:0/1761677780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00b0ba0 0x7ff8a006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 --2- 172.21.15.7:0/1761677780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00cf200 0x7ff8a00c42c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 -- 172.21.15.7:0/1761677780 >> 172.21.15.7:0/1761677780 conn(0x7ff8a006ce80 msgr2=0x7ff8a00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 -- 172.21.15.7:0/1761677780 shutdown_connections 2023-10-14T19:04:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.184+0000 7ff8a864e700 1 -- 172.21.15.7:0/1761677780 wait complete. 2023-10-14T19:04:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.185+0000 7ff8a864e700 1 Processor -- start 2023-10-14T19:04:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.185+0000 7ff8a864e700 1 -- start start 2023-10-14T19:04:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a864e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8a00b07d0 0x7ff8a0143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a864e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 0x7ff8a01413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a864e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00cf200 0x7ff8a00b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a864e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a01436c0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a864e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00c7fd0 con 0x7ff8a00b07d0 2023-10-14T19:04:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a864e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a01418f0 con 0x7ff8a00cf200 2023-10-14T19:04:12.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 0x7ff8a01413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 0x7ff8a01413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43726/0 (socket says 172.21.15.7:43726) 2023-10-14T19:04:12.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 -- 172.21.15.7:0/747364428 learned_addr learned my addr 172.21.15.7:0/747364428 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:12.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a6beb700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00cf200 0x7ff8a00b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 -- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00cf200 msgr2=0x7ff8a00b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00cf200 0x7ff8a00b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 -- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8a00b07d0 msgr2=0x7ff8a0143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a63ea700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8a00b07d0 0x7ff8a0143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8a00b07d0 0x7ff8a0143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.186+0000 7ff8a5be9700 1 -- 172.21.15.7:0/747364428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff890009420 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.187+0000 7ff8a5be9700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 0x7ff8a01413b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8a006af10 tx=0x7ff890017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.187+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000bbe0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.187+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890011420 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.187+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a00c73c0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.187+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8900117e0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.187+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a00c7980 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.188+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a004c3c0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.188+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff890011bd0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.189+0000 7ff8967fc700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.189+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff8900862e0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.189+0000 7ff8a63ea700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.189+0000 7ff8a63ea700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff884066f30 0x7ff8840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001730 tx=0x7ff89c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.193+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8900531d0 con 0x7ff8a00b0ba0 2023-10-14T19:04:12.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.413+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8a00c8110 con 0x7ff884066f30 2023-10-14T19:04:12.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.415+0000 7ff8967fc700 1 -- 172.21.15.7:0/747364428 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7ff8a00c8110 con 0x7ff884066f30 2023-10-14T19:04:12.416 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:04:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:04:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volume_0000000000825670" 2023-10-14T19:04:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:12.417 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:04:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff884066f30 msgr2=0x7ff8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff884066f30 0x7ff8840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001730 tx=0x7ff89c009040 comp rx=0 tx=0).stop 2023-10-14T19:04:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 msgr2=0x7ff8a01413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 0x7ff8a01413b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8a006af10 tx=0x7ff890017000 comp rx=0 tx=0).stop 2023-10-14T19:04:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 shutdown_connections 2023-10-14T19:04:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8a00b07d0 0x7ff8a0143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8a00cf200 0x7ff8a00b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 --2- 172.21.15.7:0/747364428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8a00b0ba0 0x7ff8a01413b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 >> 172.21.15.7:0/747364428 conn(0x7ff8a006ce80 msgr2=0x7ff8a0068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 shutdown_connections 2023-10-14T19:04:12.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.417+0000 7ff8a864e700 1 -- 172.21.15.7:0/747364428 wait complete. 2023-10-14T19:04:12.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-10-14T19:04:12.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.550+0000 7fd6b2f4a700 1 Processor -- start 2023-10-14T19:04:12.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.551+0000 7fd6b2f4a700 1 -- start start 2023-10-14T19:04:12.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.551+0000 7fd6b2f4a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 0x7fd6ac0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.551+0000 7fd6b2f4a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd6ac0ccfa0 0x7fd6ac0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.551+0000 7fd6b2f4a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac0cf510 con 0x7fd6ac0cbd90 2023-10-14T19:04:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.551+0000 7fd6b2f4a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0d00b0 con 0x7fd6ac0ccfa0 2023-10-14T19:04:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.551+0000 7fd6b2f4a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0cc1e0 con 0x7fd6ac159860 2023-10-14T19:04:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b0ce6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 0x7fd6ac0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd6ac0ccfa0 0x7fd6ac0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6abfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd6ac0cbd90 0x7fd6ac0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:46566/0 (socket says 172.21.15.7:46566) 2023-10-14T19:04:12.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b0ce6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 0x7fd6ac0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:35108/0 (socket says 172.21.15.7:35108) 2023-10-14T19:04:12.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6abfff700 1 -- 172.21.15.7:0/3039550843 learned_addr learned my addr 172.21.15.7:0/3039550843 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:12.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd6ac0ccfa0 0x7fd6ac0cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:35582/0 (socket says 172.21.15.7:35582) 2023-10-14T19:04:12.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6ab7fe700 1 -- 172.21.15.7:0/3039550843 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824144267 0 0) 0x7fd6ac0cf510 con 0x7fd6ac0cbd90 2023-10-14T19:04:12.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6ab7fe700 1 -- 172.21.15.7:0/3039550843 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd694003570 con 0x7fd6ac0cbd90 2023-10-14T19:04:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 msgr2=0x7fd6ac0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 --2- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 0x7fd6ac0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3039550843 >> v1:172.21.15.148:6789/0 conn(0x7fd6ac0cbd90 legacy=0x7fd6ac0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3039550843 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0cd960 con 0x7fd6ac0ccfa0 2023-10-14T19:04:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b0ce6700 1 --2- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 0x7fd6ac0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6b14e7700 1 --2- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0ccfa0 0x7fd6ac0cd420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0098e0 tx=0x7fd69c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b984cfba16b30540 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6ab7fe700 1 -- 172.21.15.7:0/3039550843 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c011630 con 0x7fd6ac0ccfa0 2023-10-14T19:04:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6ab7fe700 1 -- 172.21.15.7:0/3039550843 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c011790 con 0x7fd6ac0ccfa0 2023-10-14T19:04:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.552+0000 7fd6ab7fe700 1 -- 172.21.15.7:0/3039550843 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c011b30 con 0x7fd6ac0ccfa0 2023-10-14T19:04:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0ccfa0 msgr2=0x7fd6ac0cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0ccfa0 0x7fd6ac0cd420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0098e0 tx=0x7fd69c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3039550843 shutdown_connections 2023-10-14T19:04:12.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0ccfa0 0x7fd6ac0cd420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3039550843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac159860 0x7fd6ac0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3039550843 >> 172.21.15.7:0/3039550843 conn(0x7fd6ac0999b0 msgr2=0x7fd6ac070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:12.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3039550843 shutdown_connections 2023-10-14T19:04:12.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.553+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3039550843 wait complete. 2023-10-14T19:04:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.554+0000 7fd6b2f4a700 1 Processor -- start 2023-10-14T19:04:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.554+0000 7fd6b2f4a700 1 -- start start 2023-10-14T19:04:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b2f4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0cbd90 0x7fd6ac09c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b2f4a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac0ccfa0 0x7fd6ac09a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b2f4a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 0x7fd6ac1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b2f4a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c6bd0 con 0x7fd6ac159860 2023-10-14T19:04:12.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b2f4a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac09a860 con 0x7fd6ac0cbd90 2023-10-14T19:04:12.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b2f4a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac09cee0 con 0x7fd6ac0ccfa0 2023-10-14T19:04:12.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 0x7fd6ac1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 0x7fd6ac1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43742/0 (socket says 172.21.15.7:43742) 2023-10-14T19:04:12.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3011495071 learned_addr learned my addr 172.21.15.7:0/3011495071 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:12.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b0ce6700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0cbd90 0x7fd6ac09c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6abfff700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac0ccfa0 0x7fd6ac09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac0ccfa0 msgr2=0x7fd6ac09a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac0ccfa0 0x7fd6ac09a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0cbd90 msgr2=0x7fd6ac09c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0cbd90 0x7fd6ac09c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.555+0000 7fd6b14e7700 1 -- 172.21.15.7:0/3011495071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009a20 con 0x7fd6ac159860 2023-10-14T19:04:12.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.556+0000 7fd6b14e7700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 0x7fd6ac1584f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac06c7c0 tx=0x7fd69c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.556+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c011b10 con 0x7fd6ac159860 2023-10-14T19:04:12.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.556+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c0253f0 con 0x7fd6ac159860 2023-10-14T19:04:12.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.556+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c009420 con 0x7fd6ac159860 2023-10-14T19:04:12.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.556+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c025790 con 0x7fd6ac159860 2023-10-14T19:04:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.556+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac09d4a0 con 0x7fd6ac159860 2023-10-14T19:04:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.557+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac08a740 con 0x7fd6ac159860 2023-10-14T19:04:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.557+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd69c025b80 con 0x7fd6ac159860 2023-10-14T19:04:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.558+0000 7fd6a8ff9700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd698066f30 0x7fd6980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.558+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd69c0861d0 con 0x7fd6ac159860 2023-10-14T19:04:12.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.558+0000 7fd6b0ce6700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd698066f30 0x7fd6980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.558+0000 7fd6b0ce6700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd698066f30 0x7fd6980693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400f610 tx=0x7fd6a400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.562+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd69c0530c0 con 0x7fd6ac159860 2023-10-14T19:04:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.754+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fd6ac04c3c0 con 0x7fd6ac159860 2023-10-14T19:04:12.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.754+0000 7fd6a8ff9700 1 -- 172.21.15.7:0/3011495071 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fd69c0566e0 con 0x7fd6ac159860 2023-10-14T19:04:12.756 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd698066f30 msgr2=0x7fd6980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd698066f30 0x7fd6980693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400f610 tx=0x7fd6a400b040 comp rx=0 tx=0).stop 2023-10-14T19:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 msgr2=0x7fd6ac1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 0x7fd6ac1584f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac06c7c0 tx=0x7fd69c017000 comp rx=0 tx=0).stop 2023-10-14T19:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 shutdown_connections 2023-10-14T19:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd698066f30 0x7fd6980693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6ac0cbd90 0x7fd6ac09c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ac159860 0x7fd6ac1584f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 --2- 172.21.15.7:0/3011495071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6ac0ccfa0 0x7fd6ac09a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 >> 172.21.15.7:0/3011495071 conn(0x7fd6ac0999b0 msgr2=0x7fd6ac0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.756+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 shutdown_connections 2023-10-14T19:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.757+0000 7fd6b2f4a700 1 -- 172.21.15.7:0/3011495071 wait complete. 2023-10-14T19:04:12.769 INFO:teuthology.orchestra.run.smithi007.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000825670.meta","create_time":"2023-10-14T19:04:09.117755+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000825670"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000825670.data","create_time":"2023-10-14T19:04:10.052052+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000825670"}}}] 2023-10-14T19:04:12.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000825670 --format=json 2023-10-14T19:04:12.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.891+0000 7f4eee6b4700 1 Processor -- start 2023-10-14T19:04:12.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.891+0000 7f4eee6b4700 1 -- start start 2023-10-14T19:04:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eee6b4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee8153c30 0x7f4ee815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eee6b4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4ee815de50 0x7f4ee80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eee6b4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee815afd0 con 0x7f4ee80cef40 2023-10-14T19:04:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eee6b4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee815b2b0 con 0x7f4ee815de50 2023-10-14T19:04:12.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eee6b4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee815b590 con 0x7f4ee8153c30 2023-10-14T19:04:12.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eedeb3700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4ee80cef40 0x7f4ee806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47734/0 (socket says 172.21.15.7:47734) 2023-10-14T19:04:12.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eedeb3700 1 -- 172.21.15.7:0/2401914591 learned_addr learned my addr 172.21.15.7:0/2401914591 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:12.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eed6b2700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee8153c30 0x7f4ee815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4eeceb1700 1 --2- 172.21.15.7:0/2401914591 >> v2:172.21.15.148:3300/0 conn(0x7f4ee815de50 0x7f4ee80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4ee7fff700 1 -- 172.21.15.7:0/2401914591 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365584911 0 0) 0x7f4ee815afd0 con 0x7f4ee80cef40 2023-10-14T19:04:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.892+0000 7f4ee7fff700 1 -- 172.21.15.7:0/2401914591 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed0003570 con 0x7f4ee80cef40 2023-10-14T19:04:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4eeceb1700 1 -- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee8153c30 msgr2=0x7f4ee815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4eeceb1700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee8153c30 0x7f4ee815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4eeceb1700 1 -- 172.21.15.7:0/2401914591 >> v1:172.21.15.7:6789/0 conn(0x7f4ee80cef40 legacy=0x7f4ee806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4eeceb1700 1 -- 172.21.15.7:0/2401914591 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee815b870 con 0x7f4ee815de50 2023-10-14T19:04:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4eed6b2700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee8153c30 0x7f4ee815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4eeceb1700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee80cea00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0098e0 tx=0x7f4edc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d3ac46e25886e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4ee7fff700 1 -- 172.21.15.7:0/2401914591 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011630 con 0x7f4ee815de50 2023-10-14T19:04:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4ee7fff700 1 -- 172.21.15.7:0/2401914591 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc011790 con 0x7f4ee815de50 2023-10-14T19:04:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.893+0000 7f4ee7fff700 1 -- 172.21.15.7:0/2401914591 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011b10 con 0x7f4ee815de50 2023-10-14T19:04:12.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 -- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 msgr2=0x7f4ee80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee80cea00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0098e0 tx=0x7f4edc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 -- 172.21.15.7:0/2401914591 shutdown_connections 2023-10-14T19:04:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee8153c30 0x7f4ee815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/2401914591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee80cea00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 -- 172.21.15.7:0/2401914591 >> 172.21.15.7:0/2401914591 conn(0x7f4ee80703a0 msgr2=0x7f4ee80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 -- 172.21.15.7:0/2401914591 shutdown_connections 2023-10-14T19:04:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.894+0000 7f4eee6b4700 1 -- 172.21.15.7:0/2401914591 wait complete. 2023-10-14T19:04:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.895+0000 7f4eee6b4700 1 Processor -- start 2023-10-14T19:04:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.895+0000 7f4eee6b4700 1 -- start start 2023-10-14T19:04:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eee6b4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee80cef40 0x7f4ee816daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eee6b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 0x7f4ee80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eee6b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eee6b4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80c75e0 con 0x7f4ee8153c30 2023-10-14T19:04:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eee6b4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80c9a70 con 0x7f4ee815de50 2023-10-14T19:04:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eee6b4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80c7880 con 0x7f4ee80cef40 2023-10-14T19:04:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 0x7f4ee80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 0x7f4ee80c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43758/0 (socket says 172.21.15.7:43758) 2023-10-14T19:04:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 -- 172.21.15.7:0/1898106085 learned_addr learned my addr 172.21.15.7:0/1898106085 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eed6b2700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee80cef40 0x7f4ee816daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eedeb3700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 -- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee80cef40 msgr2=0x7f4ee816daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee80cef40 0x7f4ee816daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 -- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 msgr2=0x7f4ee8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee8151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 -- 172.21.15.7:0/1898106085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009a20 con 0x7f4ee8153c30 2023-10-14T19:04:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eedeb3700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4eeceb1700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 0x7f4ee80c9530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009ed0 tx=0x7f4edc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.896+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011b10 con 0x7f4ee8153c30 2023-10-14T19:04:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.897+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc000c90 con 0x7f4ee8153c30 2023-10-14T19:04:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.897+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc009420 con 0x7f4ee8153c30 2023-10-14T19:04:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.897+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc01a680 con 0x7f4ee8153c30 2023-10-14T19:04:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.897+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee80c9f80 con 0x7f4ee8153c30 2023-10-14T19:04:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.897+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee80c79f0 con 0x7f4ee8153c30 2023-10-14T19:04:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.898+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4edc01aa30 con 0x7f4ee8153c30 2023-10-14T19:04:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.898+0000 7f4ee57fa700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.898+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4edc0863a0 con 0x7f4ee8153c30 2023-10-14T19:04:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.898+0000 7f4eed6b2700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.899+0000 7f4eed6b2700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009fd0 tx=0x7f4ed800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:12.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:12.903+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4edc053290 con 0x7f4ee8153c30 2023-10-14T19:04:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.149+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000825670", "format": "json"} v 0) v1 -- 0x7f4ee804c3c0 con 0x7f4ee8153c30 2023-10-14T19:04:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.149+0000 7f4ee57fa700 1 -- 172.21.15.7:0/1898106085 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000825670", "format": "json"}]=0 v20) v1 ==== 110+0+1841 (secure 0 0 0) 0x7f4edc0568b0 con 0x7f4ee8153c30 2023-10-14T19:04:13.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:13.151 INFO:teuthology.orchestra.run.smithi007.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:11.031506+0000","modified":"2023-10-14T19:04:13.027301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4866},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4866":{"gid":4866,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.7:6835/1287999800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1287999800},{"type":"v1","addr":"172.21.15.7:6835","nonce":1287999800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000825670","balancer":"","standby_count_wanted":1},"id":3} 2023-10-14T19:04:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.151+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ed4066f30 msgr2=0x7f4ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.151+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009fd0 tx=0x7f4ed800b040 comp rx=0 tx=0).stop 2023-10-14T19:04:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.151+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 msgr2=0x7f4ee80c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.151+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 0x7f4ee80c9530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009ed0 tx=0x7f4edc017000 comp rx=0 tx=0).stop 2023-10-14T19:04:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 shutdown_connections 2023-10-14T19:04:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ee815de50 0x7f4ee8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ee80cef40 0x7f4ee816daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 --2- 172.21.15.7:0/1898106085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee8153c30 0x7f4ee80c9530 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 >> 172.21.15.7:0/1898106085 conn(0x7f4ee80703a0 msgr2=0x7f4ee815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 shutdown_connections 2023-10-14T19:04:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.152+0000 7f4eee6b4700 1 -- 172.21.15.7:0/1898106085 wait complete. 2023-10-14T19:04:13.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000825670 --yes-i-really-mean-it 2023-10-14T19:04:13.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.286+0000 7f164b260700 1 Processor -- start 2023-10-14T19:04:13.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.286+0000 7f164b260700 1 -- start start 2023-10-14T19:04:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f164b260700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1644159530 0x7f16440ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f164b260700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f164406e0e0 0x7f16440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f164b260700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16440ccfd0 con 0x7f164406dc70 2023-10-14T19:04:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f164b260700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16440cf0e0 con 0x7f1644159530 2023-10-14T19:04:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f164b260700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164415a3d0 con 0x7f164406e0e0 2023-10-14T19:04:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f1648ffc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1644159530 0x7f16440ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f1643fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f164406dc70 0x7f1644159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47736/0 (socket says 172.21.15.7:47736) 2023-10-14T19:04:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.287+0000 7f1643fff700 1 -- 172.21.15.7:0/2685999459 learned_addr learned my addr 172.21.15.7:0/2685999459 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f16497fd700 1 --2- 172.21.15.7:0/2685999459 >> v2:172.21.15.148:3300/0 conn(0x7f164406e0e0 0x7f16440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f1648ffc700 1 -- 172.21.15.7:0/2685999459 >> v2:172.21.15.148:3300/0 conn(0x7f164406e0e0 msgr2=0x7f16440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f1648ffc700 1 --2- 172.21.15.7:0/2685999459 >> v2:172.21.15.148:3300/0 conn(0x7f164406e0e0 0x7f16440cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f1648ffc700 1 -- 172.21.15.7:0/2685999459 >> v1:172.21.15.7:6789/0 conn(0x7f164406dc70 legacy=0x7f1644159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f1648ffc700 1 -- 172.21.15.7:0/2685999459 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164415a6b0 con 0x7f1644159530 2023-10-14T19:04:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f16437fe700 1 -- 172.21.15.7:0/2685999459 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251314973 0 0) 0x7f16440ccfd0 con 0x7f164406dc70 2023-10-14T19:04:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f1648ffc700 1 --2- 172.21.15.7:0/2685999459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f16440ceba0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f16440caef0 tx=0x7f163c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfabdbd4f94894f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f16437fe700 1 -- 172.21.15.7:0/2685999459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c00e070 con 0x7f1644159530 2023-10-14T19:04:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f16437fe700 1 -- 172.21.15.7:0/2685999459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c00bc30 con 0x7f1644159530 2023-10-14T19:04:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.288+0000 7f16437fe700 1 -- 172.21.15.7:0/2685999459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c012430 con 0x7f1644159530 2023-10-14T19:04:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 -- 172.21.15.7:0/2685999459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 msgr2=0x7f16440ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 --2- 172.21.15.7:0/2685999459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f16440ceba0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f16440caef0 tx=0x7f163c009780 comp rx=0 tx=0).stop 2023-10-14T19:04:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 -- 172.21.15.7:0/2685999459 shutdown_connections 2023-10-14T19:04:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 --2- 172.21.15.7:0/2685999459 >> v2:172.21.15.148:3300/0 conn(0x7f164406e0e0 0x7f16440cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 --2- 172.21.15.7:0/2685999459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f16440ceba0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 -- 172.21.15.7:0/2685999459 >> 172.21.15.7:0/2685999459 conn(0x7f16440703a0 msgr2=0x7f16440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 -- 172.21.15.7:0/2685999459 shutdown_connections 2023-10-14T19:04:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.289+0000 7f164b260700 1 -- 172.21.15.7:0/2685999459 wait complete. 2023-10-14T19:04:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.290+0000 7f164b260700 1 Processor -- start 2023-10-14T19:04:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.290+0000 7f164b260700 1 -- start start 2023-10-14T19:04:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f164406dc70 0x7f164416d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f164406e0e0 0x7f16440b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f164416db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164416d700 con 0x7f1644159530 2023-10-14T19:04:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16441540c0 con 0x7f164406e0e0 2023-10-14T19:04:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164416a030 con 0x7f164406dc70 2023-10-14T19:04:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f164416db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f164416db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43772/0 (socket says 172.21.15.7:43772) 2023-10-14T19:04:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 -- 172.21.15.7:0/1303271607 learned_addr learned my addr 172.21.15.7:0/1303271607 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f1648ffc700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f164406dc70 0x7f164416d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f1643fff700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f164406e0e0 0x7f16440b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 -- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f164406dc70 msgr2=0x7f164416d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f164406dc70 0x7f164416d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 -- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f164406e0e0 msgr2=0x7f16440b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f164406e0e0 0x7f16440b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:13.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 -- 172.21.15.7:0/1303271607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c009a20 con 0x7f1644159530 2023-10-14T19:04:13.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f1643fff700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f164406e0e0 0x7f16440b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:13.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f16497fd700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f164416db00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f163400d890 tx=0x7f1634008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:13.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16340125f0 con 0x7f1644159530 2023-10-14T19:04:13.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1634012770 con 0x7f1644159530 2023-10-14T19:04:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164416a310 con 0x7f1644159530 2023-10-14T19:04:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.291+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634012b30 con 0x7f1644159530 2023-10-14T19:04:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.292+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164416a8d0 con 0x7f1644159530 2023-10-14T19:04:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.292+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1644152160 con 0x7f1644159530 2023-10-14T19:04:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.293+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f163401e460 con 0x7f1644159530 2023-10-14T19:04:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.293+0000 7f1640ff9700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1630066f30 0x7f16300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.293+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1634084ea0 con 0x7f1644159530 2023-10-14T19:04:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.294+0000 7f1648ffc700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1630066f30 0x7f16300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.294+0000 7f1648ffc700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1630066f30 0x7f16300693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16440caef0 tx=0x7f163c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:13.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.297+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1644152160 con 0x7f1644159530 2023-10-14T19:04:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:13.518+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000825670", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f1644153cf0 con 0x7f1630066f30 2023-10-14T19:04:13.523 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:04:13.523+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:04:13.547 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:04:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.543+0000 7f1640ff9700 1 -- 172.21.15.7:0/1303271607 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f1644153cf0 con 0x7f1630066f30 2023-10-14T19:04:16.544 INFO:teuthology.orchestra.run.smithi007.stdout:metadata pool: cephfs.volume_0000000000825670.meta data pool: ['cephfs.volume_0000000000825670.data'] removed 2023-10-14T19:04:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1630066f30 msgr2=0x7f16300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1630066f30 0x7f16300693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16440caef0 tx=0x7f163c019000 comp rx=0 tx=0).stop 2023-10-14T19:04:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 msgr2=0x7f164416db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f164416db00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f163400d890 tx=0x7f1634008040 comp rx=0 tx=0).stop 2023-10-14T19:04:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 shutdown_connections 2023-10-14T19:04:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1630066f30 0x7f16300693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1644159530 0x7f164416db00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f164406dc70 0x7f164416d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 --2- 172.21.15.7:0/1303271607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f164406e0e0 0x7f16440b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 >> 172.21.15.7:0/1303271607 conn(0x7f16440703a0 msgr2=0x7f16440d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 shutdown_connections 2023-10-14T19:04:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.545+0000 7f164b260700 1 -- 172.21.15.7:0/1303271607 wait complete. 2023-10-14T19:04:16.560 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:04:16.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:16.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:16.650 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:04:16.651 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:04:16.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:04:16.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:16.699 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:04:16.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:16.700 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:04:16.716 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:04:16.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:04:16.717 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:16.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:04:16.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:16.760 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:04:16.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.939+0000 7fe42cf2e700 1 Processor -- start 2023-10-14T19:04:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.939+0000 7fe42cf2e700 1 -- start start 2023-10-14T19:04:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe42cf2e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4281598b0 0x7fe4280af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe42cf2e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe428163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe42cf2e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4280ce9d0 con 0x7fe428159c80 2023-10-14T19:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe42cf2e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280afc30 con 0x7fe4281598b0 2023-10-14T19:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe42cf2e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280aff10 con 0x7fe4280af790 2023-10-14T19:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe425d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe428159c80 0x7fe4280cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58690/0 (socket says 172.21.15.7:58690) 2023-10-14T19:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.940+0000 7fe425d9b700 1 -- 172.21.15.7:0/1083579665 learned_addr learned my addr 172.21.15.7:0/1083579665 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42659c700 1 --2- 172.21.15.7:0/1083579665 >> v2:172.21.15.148:3300/0 conn(0x7fe4281598b0 0x7fe4280af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe426d9d700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe428163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8692927 0 0) 0x7fe4280ce9d0 con 0x7fe428159c80 2023-10-14T19:04:16.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe414003570 con 0x7fe428159c80 2023-10-14T19:04:16.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333561760 0 0) 0x7fe414003570 con 0x7fe428159c80 2023-10-14T19:04:16.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 msgr2=0x7fe428163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:16.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe428163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 >> v2:172.21.15.148:3300/0 conn(0x7fe4281598b0 msgr2=0x7fe4280af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 --2- 172.21.15.7:0/1083579665 >> v2:172.21.15.148:3300/0 conn(0x7fe4281598b0 0x7fe4280af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280ce380 con 0x7fe428159c80 2023-10-14T19:04:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fe410001470 con 0x7fe428159c80 2023-10-14T19:04:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe426d9d700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe428163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 >> v1:172.21.15.7:6789/0 conn(0x7fe428159c80 legacy=0x7fe4280cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe414003a60 0x7fe414003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe414004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414004d50 0x7fe4140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280afc30 con 0x7fe414003a60 2023-10-14T19:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280aff10 con 0x7fe414004d50 2023-10-14T19:04:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41400ba60 con 0x7fe4280af790 2023-10-14T19:04:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe42659c700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe414003a60 0x7fe414003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe425d9b700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe414004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.941+0000 7fe426d9d700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414004d50 0x7fe4140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42659c700 1 -- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 msgr2=0x7fe414004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42659c700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4280af790 0x7fe414004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42659c700 1 -- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414004d50 msgr2=0x7fe4140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42659c700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414004d50 0x7fe4140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42659c700 1 -- 172.21.15.7:0/1083579665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009a20 con 0x7fe414003a60 2023-10-14T19:04:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42659c700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe414003a60 0x7fe414003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe418009c30 tx=0x7fe4180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6314c32847e009 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800e6b0 con 0x7fe414003a60 2023-10-14T19:04:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800e810 con 0x7fe414003a60 2023-10-14T19:04:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42559a700 1 -- 172.21.15.7:0/1083579665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800ebd0 con 0x7fe414003a60 2023-10-14T19:04:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42cf2e700 1 -- 172.21.15.7:0/1083579665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe414003a60 msgr2=0x7fe414003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/1083579665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe414003a60 0x7fe414003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe418009c30 tx=0x7fe4180091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe426d9d700 1 -- 172.21.15.7:0/1083579665 reap_dead start 2023-10-14T19:04:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42cf2e700 1 -- 172.21.15.7:0/1083579665 shutdown_connections 2023-10-14T19:04:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42cf2e700 1 -- 172.21.15.7:0/1083579665 >> 172.21.15.7:0/1083579665 conn(0x7fe428070e30 msgr2=0x7fe4280d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.942+0000 7fe42cf2e700 1 -- 172.21.15.7:0/1083579665 shutdown_connections 2023-10-14T19:04:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.943+0000 7fe42cf2e700 1 -- 172.21.15.7:0/1083579665 wait complete. 2023-10-14T19:04:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 Processor -- start 2023-10-14T19:04:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 -- start start 2023-10-14T19:04:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe414003a60 0x7fe4280b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 0x7fe42814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe42815eb40 0x7fe42815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b6170 con 0x7fe42815f9d0 2023-10-14T19:04:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b34b0 con 0x7fe42815eb40 2023-10-14T19:04:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42cf2e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b3790 con 0x7fe414003a60 2023-10-14T19:04:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe425d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 0x7fe42814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe425d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 0x7fe42814e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59628/0 (socket says 172.21.15.7:59628) 2023-10-14T19:04:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe425d9b700 1 -- 172.21.15.7:0/778847743 learned_addr learned my addr 172.21.15.7:0/778847743 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe426d9d700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe42815eb40 0x7fe42815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.944+0000 7fe42659c700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe414003a60 0x7fe4280b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe425d9b700 1 -- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe414003a60 msgr2=0x7fe4280b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:16.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe425d9b700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe414003a60 0x7fe4280b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe425d9b700 1 -- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe42815eb40 msgr2=0x7fe42815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:16.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe425d9b700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe42815eb40 0x7fe42815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:16.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe425d9b700 1 -- 172.21.15.7:0/778847743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280b3a70 con 0x7fe42815f9d0 2023-10-14T19:04:16.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe425d9b700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 0x7fe42814e1f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4100016e0 tx=0x7fe410001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:16.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000f6f0 con 0x7fe42815f9d0 2023-10-14T19:04:16.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000f850 con 0x7fe42815f9d0 2023-10-14T19:04:16.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4280b3d50 con 0x7fe42815f9d0 2023-10-14T19:04:16.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000fc10 con 0x7fe42815f9d0 2023-10-14T19:04:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.945+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42815f4b0 con 0x7fe42815f9d0 2023-10-14T19:04:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.946+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4280b3f70 con 0x7fe42815f9d0 2023-10-14T19:04:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.947+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe41001e3b0 con 0x7fe42815f9d0 2023-10-14T19:04:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.947+0000 7fe41e7fc700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.947+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe410084280 con 0x7fe42815f9d0 2023-10-14T19:04:16.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.947+0000 7fe42659c700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:16.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.948+0000 7fe42659c700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe408066f30 0x7fe4080693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe4180091e0 tx=0x7fe41801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:16.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:16.951+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4100514a0 con 0x7fe42815f9d0 2023-10-14T19:04:17.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.191+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe42804c3c0 con 0x7fe42815f9d0 2023-10-14T19:04:17.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.191+0000 7fe41e7fc700 1 -- 172.21.15.7:0/778847743 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4588 (secure 0 0 0) 0x7fe41001a090 con 0x7fe42815f9d0 2023-10-14T19:04:17.193 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:17.193 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1353990012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1353990012},{"type":"v1","addr":"172.21.15.7:6835","nonce":1353990012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:54.330660+0000","modified":"2023-10-14T19:03:57.974158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4878":{"gid":4878,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6836/851698468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":851698468},{"type":"v1","addr":"172.21.15.148:6836","nonce":851698468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T19:04:17.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe408066f30 msgr2=0x7fe4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe408066f30 0x7fe4080693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe4180091e0 tx=0x7fe41801a000 comp rx=0 tx=0).stop 2023-10-14T19:04:17.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 msgr2=0x7fe42814e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 0x7fe42814e1f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4100016e0 tx=0x7fe410001e90 comp rx=0 tx=0).stop 2023-10-14T19:04:17.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 shutdown_connections 2023-10-14T19:04:17.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe42815eb40 0x7fe42815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe414003a60 0x7fe4280b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 --2- 172.21.15.7:0/778847743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe42815f9d0 0x7fe42814e1f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 >> 172.21.15.7:0/778847743 conn(0x7fe428070e30 msgr2=0x7fe4280b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:17.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 shutdown_connections 2023-10-14T19:04:17.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.194+0000 7fe42cf2e700 1 -- 172.21.15.7:0/778847743 wait complete. 2023-10-14T19:04:17.198 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2023-10-14T19:04:17.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:17.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 Processor -- start 2023-10-14T19:04:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 -- start start 2023-10-14T19:04:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cb5a0 0x7f23b00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23b00cde50 0x7f23b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b015ae40 con 0x7f23b00cd9e0 2023-10-14T19:04:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00d13f0 con 0x7f23b00cde50 2023-10-14T19:04:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.325+0000 7f23b5468700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b015ab60 con 0x7f23b00cb5a0 2023-10-14T19:04:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23af7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23b00cde50 0x7f23b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23ae7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f23b00cd9e0 0x7f23b0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58694/0 (socket says 172.21.15.7:58694) 2023-10-14T19:04:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23ae7fc700 1 -- 172.21.15.7:0/1834605932 learned_addr learned my addr 172.21.15.7:0/1834605932 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23aeffd700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cb5a0 0x7f23b00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23af7fe700 1 -- 172.21.15.7:0/1834605932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cb5a0 msgr2=0x7f23b00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23af7fe700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cb5a0 0x7f23b00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23af7fe700 1 -- 172.21.15.7:0/1834605932 >> v1:172.21.15.7:6789/0 conn(0x7f23b00cd9e0 legacy=0x7f23b0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23adffb700 1 -- 172.21.15.7:0/1834605932 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675412351 0 0) 0x7f23b015ae40 con 0x7f23b00cd9e0 2023-10-14T19:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23af7fe700 1 -- 172.21.15.7:0/1834605932 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b00ccf00 con 0x7f23b00cde50 2023-10-14T19:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23aeffd700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cb5a0 0x7f23b00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23af7fe700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00cde50 0x7f23b0156e90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098e0 tx=0x7f23a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65b83b0eadbe5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23adffb700 1 -- 172.21.15.7:0/1834605932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8009e80 con 0x7f23b00cde50 2023-10-14T19:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23adffb700 1 -- 172.21.15.7:0/1834605932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800b860 con 0x7f23b00cde50 2023-10-14T19:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.326+0000 7f23adffb700 1 -- 172.21.15.7:0/1834605932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800bbe0 con 0x7f23b00cde50 2023-10-14T19:04:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 -- 172.21.15.7:0/1834605932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00cde50 msgr2=0x7f23b0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00cde50 0x7f23b0156e90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098e0 tx=0x7f23a80091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 -- 172.21.15.7:0/1834605932 shutdown_connections 2023-10-14T19:04:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00cde50 0x7f23b0156e90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 --2- 172.21.15.7:0/1834605932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cb5a0 0x7f23b00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 -- 172.21.15.7:0/1834605932 >> 172.21.15.7:0/1834605932 conn(0x7f23b0070e30 msgr2=0x7f23b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 -- 172.21.15.7:0/1834605932 shutdown_connections 2023-10-14T19:04:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.327+0000 7f23b5468700 1 -- 172.21.15.7:0/1834605932 wait complete. 2023-10-14T19:04:17.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.328+0000 7f23b5468700 1 Processor -- start 2023-10-14T19:04:17.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.328+0000 7f23b5468700 1 -- start start 2023-10-14T19:04:17.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23b5468700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23b00cb5a0 0x7f23b00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23b5468700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cd9e0 0x7f23b00b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23b5468700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 0x7f23b01526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23b5468700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01536a0 con 0x7f23b00b5730 2023-10-14T19:04:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23b5468700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00b39f0 con 0x7f23b00cb5a0 2023-10-14T19:04:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23b5468700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00c9c10 con 0x7f23b00cd9e0 2023-10-14T19:04:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 0x7f23b01526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 0x7f23b01526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59652/0 (socket says 172.21.15.7:59652) 2023-10-14T19:04:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 -- 172.21.15.7:0/1227829382 learned_addr learned my addr 172.21.15.7:0/1227829382 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23ae7fc700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cd9e0 0x7f23b00b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23aeffd700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23b00cb5a0 0x7f23b00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 -- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cd9e0 msgr2=0x7f23b00b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cd9e0 0x7f23b00b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 -- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23b00cb5a0 msgr2=0x7f23b00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23b00cb5a0 0x7f23b00b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 -- 172.21.15.7:0/1227829382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009420 con 0x7f23b00b5730 2023-10-14T19:04:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.329+0000 7f23af7fe700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 0x7f23b01526e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f23a80091e0 tx=0x7f23a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.330+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011420 con 0x7f23b00b5730 2023-10-14T19:04:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.330+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8011580 con 0x7f23b00b5730 2023-10-14T19:04:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.330+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b00c9ef0 con 0x7f23b00b5730 2023-10-14T19:04:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.330+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011900 con 0x7f23b00b5730 2023-10-14T19:04:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.330+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b015b5f0 con 0x7f23b00b5730 2023-10-14T19:04:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.331+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b00ca130 con 0x7f23b00b5730 2023-10-14T19:04:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.331+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23a8011d30 con 0x7f23b00b5730 2023-10-14T19:04:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.331+0000 7f23a6ffd700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2390066f30 0x7f23900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.331+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f23a8086140 con 0x7f23b00b5730 2023-10-14T19:04:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.332+0000 7f23aeffd700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2390066f30 0x7f23900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.332+0000 7f23aeffd700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2390066f30 0x7f23900693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f23a0007600 tx=0x7f23a0009850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.336+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23b00ca130 con 0x7f23b00b5730 2023-10-14T19:04:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.529+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23b00ca130 con 0x7f23b00b5730 2023-10-14T19:04:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.530+0000 7f23a6ffd700 1 -- 172.21.15.7:0/1227829382 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15429 (secure 0 0 0) 0x7f23b00ca130 con 0x7f23b00b5730 2023-10-14T19:04:17.531 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:17.531 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:16.531925+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6835/1287999800":"2023-10-15T19:04:13.523872+0000","172.21.15.7:6833/1287999800":"2023-10-15T19:04:13.523872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2390066f30 msgr2=0x7f23900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2390066f30 0x7f23900693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f23a0007600 tx=0x7f23a0009850 comp rx=0 tx=0).stop 2023-10-14T19:04:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 msgr2=0x7f23b01526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 0x7f23b01526e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f23a80091e0 tx=0x7f23a8017000 comp rx=0 tx=0).stop 2023-10-14T19:04:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 shutdown_connections 2023-10-14T19:04:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2390066f30 0x7f23900693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23b00cb5a0 0x7f23b00b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b00b5730 0x7f23b01526e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 --2- 172.21.15.7:0/1227829382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23b00cd9e0 0x7f23b00b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 >> 172.21.15.7:0/1227829382 conn(0x7f23b0070e30 msgr2=0x7f23b00d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 shutdown_connections 2023-10-14T19:04:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.532+0000 7f23b5468700 1 -- 172.21.15.7:0/1227829382 wait complete. 2023-10-14T19:04:17.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:03:52.238054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:03:53.310520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:04:17.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:04:17.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 Processor -- start 2023-10-14T19:04:17.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 -- start start 2023-10-14T19:04:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabf00c8800 0x7fabf00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00b1150 0x7fabf00ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf00adbc0 con 0x7fabf00c8bd0 2023-10-14T19:04:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00c9d30 con 0x7fabf00c8800 2023-10-14T19:04:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.669+0000 7fabf67de700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00acfb0 con 0x7fabf00b1150 2023-10-14T19:04:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabf00c8800 0x7fabf00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabf00c8800 0x7fabf00c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59662/0 (socket says 172.21.15.7:59662) 2023-10-14T19:04:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 -- 172.21.15.7:0/2239898058 learned_addr learned my addr 172.21.15.7:0/2239898058 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabf4d7b700 1 --2- 172.21.15.7:0/2239898058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00b1150 0x7fabf00ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 -- 172.21.15.7:0/2239898058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00b1150 msgr2=0x7fabf00ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 --2- 172.21.15.7:0/2239898058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00b1150 0x7fabf00ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 -- 172.21.15.7:0/2239898058 >> v1:172.21.15.148:6789/0 conn(0x7fabf00c8bd0 legacy=0x7fabf00b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 -- 172.21.15.7:0/2239898058 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00ad290 con 0x7fabf00c8800 2023-10-14T19:04:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeffff700 1 --2- 172.21.15.7:0/2239898058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00c8800 0x7fabf00c94e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fabe00099b0 tx=0x7fabe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3105d8912983827f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeeffd700 1 -- 172.21.15.7:0/2239898058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000b820 con 0x7fabf00c8800 2023-10-14T19:04:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeeffd700 1 -- 172.21.15.7:0/2239898058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000b980 con 0x7fabf00c8800 2023-10-14T19:04:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.670+0000 7fabeeffd700 1 -- 172.21.15.7:0/2239898058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000bd20 con 0x7fabf00c8800 2023-10-14T19:04:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 -- 172.21.15.7:0/2239898058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00c8800 msgr2=0x7fabf00c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 --2- 172.21.15.7:0/2239898058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00c8800 0x7fabf00c94e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fabe00099b0 tx=0x7fabe0009250 comp rx=0 tx=0).stop 2023-10-14T19:04:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 -- 172.21.15.7:0/2239898058 shutdown_connections 2023-10-14T19:04:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 --2- 172.21.15.7:0/2239898058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00b1150 0x7fabf00ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 --2- 172.21.15.7:0/2239898058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00c8800 0x7fabf00c94e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 -- 172.21.15.7:0/2239898058 >> 172.21.15.7:0/2239898058 conn(0x7fabf006d170 msgr2=0x7fabf00cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 -- 172.21.15.7:0/2239898058 shutdown_connections 2023-10-14T19:04:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.671+0000 7fabf67de700 1 -- 172.21.15.7:0/2239898058 wait complete. 2023-10-14T19:04:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.672+0000 7fabf67de700 1 Processor -- start 2023-10-14T19:04:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.672+0000 7fabf67de700 1 -- start start 2023-10-14T19:04:17.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf67de700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 0x7fabf014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf67de700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00c8800 0x7fabf0165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf67de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf00c8bd0 0x7fabf00af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf67de700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0154c00 con 0x7fabf00b1150 2023-10-14T19:04:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf67de700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0158be0 con 0x7fabf00c8bd0 2023-10-14T19:04:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf67de700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0154920 con 0x7fabf00c8800 2023-10-14T19:04:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 0x7fabf014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 0x7fabf014dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59670/0 (socket says 172.21.15.7:59670) 2023-10-14T19:04:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 -- 172.21.15.7:0/3685451572 learned_addr learned my addr 172.21.15.7:0/3685451572 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabf4d7b700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf00c8bd0 0x7fabf00af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabef7fe700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00c8800 0x7fabf0165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 -- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00c8800 msgr2=0x7fabf0165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00c8800 0x7fabf0165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 -- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf00c8bd0 msgr2=0x7fabf00af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf00c8bd0 0x7fabf00af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 -- 172.21.15.7:0/3685451572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00094f0 con 0x7fabf00b1150 2023-10-14T19:04:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.673+0000 7fabeffff700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 0x7fabf014dfd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009290 tx=0x7fabe0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.674+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011c10 con 0x7fabf00b1150 2023-10-14T19:04:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.674+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0020070 con 0x7fabf00b1150 2023-10-14T19:04:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.674+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0158590 con 0x7fabf00b1150 2023-10-14T19:04:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.674+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe001b450 con 0x7fabf00b1150 2023-10-14T19:04:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.674+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf014e510 con 0x7fabf00b1150 2023-10-14T19:04:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.675+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf01583f0 con 0x7fabf00b1150 2023-10-14T19:04:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.675+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabe0022030 con 0x7fabf00b1150 2023-10-14T19:04:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.675+0000 7fabd7fff700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabdc066f30 0x7fabdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.675+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fabe00863a0 con 0x7fabf00b1150 2023-10-14T19:04:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.676+0000 7fabef7fe700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabdc066f30 0x7fabdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.676+0000 7fabef7fe700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabdc066f30 0x7fabdc0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabf00c73f0 tx=0x7fabe4007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.680+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabf01583f0 con 0x7fabf00b1150 2023-10-14T19:04:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.873+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabf01583f0 con 0x7fabf00b1150 2023-10-14T19:04:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.873+0000 7fabd7fff700 1 -- 172.21.15.7:0/3685451572 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabf01583f0 con 0x7fabf00b1150 2023-10-14T19:04:17.875 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:04:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabdc066f30 msgr2=0x7fabdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabdc066f30 0x7fabdc0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabf00c73f0 tx=0x7fabe4007ea0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 msgr2=0x7fabf014dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:17.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 0x7fabf014dfd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009290 tx=0x7fabe0016000 comp rx=0 tx=0).stop 2023-10-14T19:04:17.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 shutdown_connections 2023-10-14T19:04:17.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabdc066f30 0x7fabdc0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf00c8bd0 0x7fabf00af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf00b1150 0x7fabf014dfd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 --2- 172.21.15.7:0/3685451572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf00c8800 0x7fabf0165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 >> 172.21.15.7:0/3685451572 conn(0x7fabf006d170 msgr2=0x7fabf0159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:17.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 shutdown_connections 2023-10-14T19:04:17.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:17.875+0000 7fabf67de700 1 -- 172.21.15.7:0/3685451572 wait complete. 2023-10-14T19:04:17.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:04:17.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:04:17.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:04:18.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.012+0000 7fd8e179d700 1 Processor -- start 2023-10-14T19:04:18.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.012+0000 7fd8e179d700 1 -- start start 2023-10-14T19:04:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e179d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8dc153a00 0x7fd8dc153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e179d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8dc15de50 0x7fd8dc15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e179d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc15af60 con 0x7fd8dc0cea00 2023-10-14T19:04:18.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e179d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc15d010 con 0x7fd8dc153a00 2023-10-14T19:04:18.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e179d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc15b240 con 0x7fd8dc15de50 2023-10-14T19:04:18.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8dbfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8dc153a00 0x7fd8dc153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e0f9c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd8dc0cea00 0x7fd8dc0cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58708/0 (socket says 172.21.15.7:58708) 2023-10-14T19:04:18.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8e0f9c700 1 -- 172.21.15.7:0/2190824239 learned_addr learned my addr 172.21.15.7:0/2190824239 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:18.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8db7fe700 1 --2- 172.21.15.7:0/2190824239 >> v2:172.21.15.148:3300/0 conn(0x7fd8dc15de50 0x7fd8dc15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8dbfff700 1 -- 172.21.15.7:0/2190824239 >> v2:172.21.15.148:3300/0 conn(0x7fd8dc15de50 msgr2=0x7fd8dc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8dbfff700 1 --2- 172.21.15.7:0/2190824239 >> v2:172.21.15.148:3300/0 conn(0x7fd8dc15de50 0x7fd8dc15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8dbfff700 1 -- 172.21.15.7:0/2190824239 >> v1:172.21.15.7:6789/0 conn(0x7fd8dc0cea00 legacy=0x7fd8dc0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8dbfff700 1 -- 172.21.15.7:0/2190824239 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc15b520 con 0x7fd8dc153a00 2023-10-14T19:04:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.013+0000 7fd8daffd700 1 -- 172.21.15.7:0/2190824239 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212973205 0 0) 0x7fd8dc15af60 con 0x7fd8dc0cea00 2023-10-14T19:04:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8dbfff700 1 --2- 172.21.15.7:0/2190824239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc153dd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0b3070 tx=0x7fd8cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98900f7cd193d92b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8daffd700 1 -- 172.21.15.7:0/2190824239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00b6b0 con 0x7fd8dc153a00 2023-10-14T19:04:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8daffd700 1 -- 172.21.15.7:0/2190824239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc00b810 con 0x7fd8dc153a00 2023-10-14T19:04:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8daffd700 1 -- 172.21.15.7:0/2190824239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00bbb0 con 0x7fd8dc153a00 2023-10-14T19:04:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 -- 172.21.15.7:0/2190824239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 msgr2=0x7fd8dc153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2190824239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc153dd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0b3070 tx=0x7fd8cc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 -- 172.21.15.7:0/2190824239 shutdown_connections 2023-10-14T19:04:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2190824239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc153dd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2190824239 >> v2:172.21.15.148:3300/0 conn(0x7fd8dc15de50 0x7fd8dc15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 -- 172.21.15.7:0/2190824239 >> 172.21.15.7:0/2190824239 conn(0x7fd8dc0703a0 msgr2=0x7fd8dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 -- 172.21.15.7:0/2190824239 shutdown_connections 2023-10-14T19:04:18.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.014+0000 7fd8e179d700 1 -- 172.21.15.7:0/2190824239 wait complete. 2023-10-14T19:04:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.015+0000 7fd8e179d700 1 Processor -- start 2023-10-14T19:04:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 -- start start 2023-10-14T19:04:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8dc0cea00 0x7fd8dc0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8dc15de50 0x7fd8dc14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0b11e0 con 0x7fd8dc153a00 2023-10-14T19:04:18.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0b05d0 con 0x7fd8dc15de50 2023-10-14T19:04:18.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8e179d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0b08b0 con 0x7fd8dc0cea00 2023-10-14T19:04:18.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8db7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8db7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc14f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59690/0 (socket says 172.21.15.7:59690) 2023-10-14T19:04:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.016+0000 7fd8db7fe700 1 -- 172.21.15.7:0/2651886607 learned_addr learned my addr 172.21.15.7:0/2651886607 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8e0f9c700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8dc15de50 0x7fd8dc14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8dbfff700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8dc0cea00 0x7fd8dc0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8db7fe700 1 -- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8dc0cea00 msgr2=0x7fd8dc0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8db7fe700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8dc0cea00 0x7fd8dc0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8db7fe700 1 -- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8dc15de50 msgr2=0x7fd8dc14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8db7fe700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8dc15de50 0x7fd8dc14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8db7fe700 1 -- 172.21.15.7:0/2651886607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc009420 con 0x7fd8dc153a00 2023-10-14T19:04:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8dbfff700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8dc0cea00 0x7fd8dc0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8db7fe700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc14f770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000d890 tx=0x7fd8d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00125f0 con 0x7fd8dc153a00 2023-10-14T19:04:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0012750 con 0x7fd8dc153a00 2023-10-14T19:04:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc0b0b90 con 0x7fd8dc153a00 2023-10-14T19:04:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0012ad0 con 0x7fd8dc153a00 2023-10-14T19:04:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.017+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc0c68e0 con 0x7fd8dc153a00 2023-10-14T19:04:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.018+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0b1390 con 0x7fd8dc153a00 2023-10-14T19:04:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.019+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8d001e460 con 0x7fd8dc153a00 2023-10-14T19:04:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.019+0000 7fd8c3fff700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd8c8066f60 0x7fd8c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.019+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd8d0084bf0 con 0x7fd8dc153a00 2023-10-14T19:04:18.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.019+0000 7fd8dbfff700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd8c8066f60 0x7fd8c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.020+0000 7fd8dbfff700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd8c8066f60 0x7fd8c8069410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0093f0 tx=0x7fd8cc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.023+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8dc0b1390 con 0x7fd8dc153a00 2023-10-14T19:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.217+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8dc0c6b00 con 0x7fd8dc153a00 2023-10-14T19:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.217+0000 7fd8c3fff700 1 -- 172.21.15.7:0/2651886607 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8d0051d70 con 0x7fd8dc153a00 2023-10-14T19:04:18.218 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd8c8066f60 msgr2=0x7fd8c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd8c8066f60 0x7fd8c8069410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0093f0 tx=0x7fd8cc017000 comp rx=0 tx=0).stop 2023-10-14T19:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 msgr2=0x7fd8dc14f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc14f770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000d890 tx=0x7fd8d0008040 comp rx=0 tx=0).stop 2023-10-14T19:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 shutdown_connections 2023-10-14T19:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd8c8066f60 0x7fd8c8069410 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8dc15de50 0x7fd8dc14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8dc0cea00 0x7fd8dc0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 --2- 172.21.15.7:0/2651886607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8dc153a00 0x7fd8dc14f770 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 >> 172.21.15.7:0/2651886607 conn(0x7fd8dc0703a0 msgr2=0x7fd8dc1584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 shutdown_connections 2023-10-14T19:04:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.219+0000 7fd8e179d700 1 -- 172.21.15.7:0/2651886607 wait complete. 2023-10-14T19:04:18.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:04:18.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.353+0000 7fdc8b5e2700 1 Processor -- start 2023-10-14T19:04:18.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.353+0000 7fdc8b5e2700 1 -- start start 2023-10-14T19:04:18.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8b5e2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc84159530 0x7fdc840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8b5e2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdc8406dc70 0x7fdc84159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8b5e2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840ccfd0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8b5e2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc840cf0e0 con 0x7fdc8406dc70 2023-10-14T19:04:18.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8b5e2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8415a3d0 con 0x7fdc84159530 2023-10-14T19:04:18.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8937e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc84159530 0x7fdc840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc88b7d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdc8406dc70 0x7fdc84159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc89b7f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdc8406e0e0 0x7fdc840cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:59020/0 (socket says 172.21.15.7:59020) 2023-10-14T19:04:18.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc89b7f700 1 -- 172.21.15.7:0/409256784 learned_addr learned my addr 172.21.15.7:0/409256784 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:18.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8937e700 1 -- 172.21.15.7:0/409256784 >> v2:172.21.15.148:3300/0 conn(0x7fdc8406dc70 msgr2=0x7fdc84159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:18.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8937e700 1 --2- 172.21.15.7:0/409256784 >> v2:172.21.15.148:3300/0 conn(0x7fdc8406dc70 0x7fdc84159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8937e700 1 -- 172.21.15.7:0/409256784 >> v1:172.21.15.148:6789/0 conn(0x7fdc8406e0e0 legacy=0x7fdc840cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.354+0000 7fdc8937e700 1 -- 172.21.15.7:0/409256784 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8415a6b0 con 0x7fdc84159530 2023-10-14T19:04:18.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc8937e700 1 --2- 172.21.15.7:0/409256784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc84159530 0x7fdc840ceba0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc740098e0 tx=0x7fdc740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f0fcd3a70d10b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc83fff700 1 -- 172.21.15.7:0/409256784 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400b640 con 0x7fdc84159530 2023-10-14T19:04:18.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc83fff700 1 -- 172.21.15.7:0/409256784 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7400b7a0 con 0x7fdc84159530 2023-10-14T19:04:18.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc83fff700 1 -- 172.21.15.7:0/409256784 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400bb40 con 0x7fdc84159530 2023-10-14T19:04:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/409256784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc84159530 msgr2=0x7fdc840ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/409256784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc84159530 0x7fdc840ceba0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc740098e0 tx=0x7fdc740091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/409256784 shutdown_connections 2023-10-14T19:04:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/409256784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc84159530 0x7fdc840ceba0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.355+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/409256784 >> v2:172.21.15.148:3300/0 conn(0x7fdc8406dc70 0x7fdc84159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.356+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/409256784 >> 172.21.15.7:0/409256784 conn(0x7fdc840703a0 msgr2=0x7fdc840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.356+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/409256784 shutdown_connections 2023-10-14T19:04:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.356+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/409256784 wait complete. 2023-10-14T19:04:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.357+0000 7fdc8b5e2700 1 Processor -- start 2023-10-14T19:04:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.357+0000 7fdc8b5e2700 1 -- start start 2023-10-14T19:04:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc8406dc70 0x7fdc840c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 0x7fdc840c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc84159530 0x7fdc840c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841559c0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c93e0 con 0x7fdc84159530 2023-10-14T19:04:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c96c0 con 0x7fdc8406dc70 2023-10-14T19:04:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 0x7fdc840c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 0x7fdc840c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59696/0 (socket says 172.21.15.7:59696) 2023-10-14T19:04:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8937e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc8406dc70 0x7fdc840c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 -- 172.21.15.7:0/718065325 learned_addr learned my addr 172.21.15.7:0/718065325 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc89b7f700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc84159530 0x7fdc840c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 -- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc8406dc70 msgr2=0x7fdc840c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc8406dc70 0x7fdc840c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 -- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc84159530 msgr2=0x7fdc840c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc84159530 0x7fdc840c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 -- 172.21.15.7:0/718065325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74009420 con 0x7fdc8406e0e0 2023-10-14T19:04:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc88b7d700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 0x7fdc840c6d60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800ec80 tx=0x7fdc780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800c850 con 0x7fdc8406e0e0 2023-10-14T19:04:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7800c9b0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.358+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc84155370 con 0x7fdc8406e0e0 2023-10-14T19:04:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.359+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800cd50 con 0x7fdc8406e0e0 2023-10-14T19:04:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.359+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840c8ca0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.359+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8404c3c0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.360+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc78013680 con 0x7fdc8406e0e0 2023-10-14T19:04:18.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.360+0000 7fdc817fa700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdc70066f30 0x7fdc700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.360+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdc780847a0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.361+0000 7fdc8937e700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdc70066f30 0x7fdc700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.361+0000 7fdc8937e700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdc70066f30 0x7fdc700693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc740093f0 tx=0x7fdc74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.365+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc780519c0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.561+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc8415a990 con 0x7fdc8406e0e0 2023-10-14T19:04:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.561+0000 7fdc817fa700 1 -- 172.21.15.7:0/718065325 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc78054fe0 con 0x7fdc8406e0e0 2023-10-14T19:04:18.563 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:04:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdc70066f30 msgr2=0x7fdc700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdc70066f30 0x7fdc700693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc740093f0 tx=0x7fdc74017000 comp rx=0 tx=0).stop 2023-10-14T19:04:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 msgr2=0x7fdc840c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 0x7fdc840c6d60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800ec80 tx=0x7fdc780091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 shutdown_connections 2023-10-14T19:04:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdc70066f30 0x7fdc700693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc84159530 0x7fdc840c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc8406dc70 0x7fdc840c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 --2- 172.21.15.7:0/718065325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8406e0e0 0x7fdc840c6d60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 >> 172.21.15.7:0/718065325 conn(0x7fdc840703a0 msgr2=0x7fdc840b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 shutdown_connections 2023-10-14T19:04:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.563+0000 7fdc8b5e2700 1 -- 172.21.15.7:0/718065325 wait complete. 2023-10-14T19:04:18.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.695+0000 7f9298f67700 1 Processor -- start 2023-10-14T19:04:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.695+0000 7f9298f67700 1 -- start start 2023-10-14T19:04:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f9298f67700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f929415cb50 0x7f92940b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f9298f67700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929415ad50 con 0x7f92940b0710 2023-10-14T19:04:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f9298f67700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929415a140 con 0x7f929415cf20 2023-10-14T19:04:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f9298f67700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929415a420 con 0x7f929415cb50 2023-10-14T19:04:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f929259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f929415cb50 0x7f92940b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f9292d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f92940b0710 0x7f92941536c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58718/0 (socket says 172.21.15.7:58718) 2023-10-14T19:04:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.696+0000 7f9292d9d700 1 -- 172.21.15.7:0/3934671226 learned_addr learned my addr 172.21.15.7:0/3934671226 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929259c700 1 -- 172.21.15.7:0/3934671226 >> v1:172.21.15.148:6789/0 conn(0x7f929415cf20 legacy=0x7f92940b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929259c700 1 -- 172.21.15.7:0/3934671226 >> v1:172.21.15.7:6789/0 conn(0x7f92940b0710 legacy=0x7f92941536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929259c700 1 -- 172.21.15.7:0/3934671226 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929415a700 con 0x7f929415cb50 2023-10-14T19:04:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929259c700 1 --2- 172.21.15.7:0/3934671226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940b01d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2104de95094f3b3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929159a700 1 -- 172.21.15.7:0/3934671226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400e070 con 0x7f929415cb50 2023-10-14T19:04:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929159a700 1 -- 172.21.15.7:0/3934671226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400bc30 con 0x7f929415cb50 2023-10-14T19:04:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.697+0000 7f929159a700 1 -- 172.21.15.7:0/3934671226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284012430 con 0x7f929415cb50 2023-10-14T19:04:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 -- 172.21.15.7:0/3934671226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 msgr2=0x7f92940b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 --2- 172.21.15.7:0/3934671226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940b01d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284009780 comp rx=0 tx=0).stop 2023-10-14T19:04:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 -- 172.21.15.7:0/3934671226 shutdown_connections 2023-10-14T19:04:18.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 --2- 172.21.15.7:0/3934671226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940b01d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 -- 172.21.15.7:0/3934671226 >> 172.21.15.7:0/3934671226 conn(0x7f92940cded0 msgr2=0x7f929406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:18.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 -- 172.21.15.7:0/3934671226 shutdown_connections 2023-10-14T19:04:18.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.698+0000 7f9298f67700 1 -- 172.21.15.7:0/3934671226 wait complete. 2023-10-14T19:04:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.699+0000 7f9298f67700 1 Processor -- start 2023-10-14T19:04:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.699+0000 7f9298f67700 1 -- start start 2023-10-14T19:04:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92940b0710 0x7f9294144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f929415cf20 0x7f92940abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940c5060 con 0x7f929415cb50 2023-10-14T19:04:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9294144d60 con 0x7f929415cf20 2023-10-14T19:04:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92940ae960 con 0x7f92940b0710 2023-10-14T19:04:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59710/0 (socket says 172.21.15.7:59710) 2023-10-14T19:04:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 -- 172.21.15.7:0/1294656094 learned_addr learned my addr 172.21.15.7:0/1294656094 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9292d9d700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f929415cf20 0x7f92940abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f929259c700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92940b0710 0x7f9294144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 -- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92940b0710 msgr2=0x7f9294144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92940b0710 0x7f9294144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 -- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f929415cf20 msgr2=0x7f92940abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f929415cf20 0x7f92940abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 -- 172.21.15.7:0/1294656094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009a20 con 0x7f929415cb50 2023-10-14T19:04:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9291d9b700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940ab8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c7c0 tx=0x7f927c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c011590 con 0x7f929415cb50 2023-10-14T19:04:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c0116f0 con 0x7f929415cb50 2023-10-14T19:04:18.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92940aec40 con 0x7f929415cb50 2023-10-14T19:04:18.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c011ab0 con 0x7f929415cb50 2023-10-14T19:04:18.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.700+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929416b420 con 0x7f929415cb50 2023-10-14T19:04:18.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.701+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929404c3c0 con 0x7f929415cb50 2023-10-14T19:04:18.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.702+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f927c01b3b0 con 0x7f929415cb50 2023-10-14T19:04:18.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.702+0000 7f928a7fc700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9274066f30 0x7f92740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:18.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.702+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f927c0839e0 con 0x7f929415cb50 2023-10-14T19:04:18.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.702+0000 7f929259c700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9274066f30 0x7f92740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:18.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.703+0000 7f929259c700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9274066f30 0x7f92740693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:18.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.706+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f927c050b60 con 0x7f929415cb50 2023-10-14T19:04:18.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.944+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92941577a0 con 0x7f929415cb50 2023-10-14T19:04:18.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.945+0000 7f928a7fc700 1 -- 172.21.15.7:0/1294656094 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4588 (secure 0 0 0) 0x7f927c017070 con 0x7f929415cb50 2023-10-14T19:04:18.946 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:18.947 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1353990012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1353990012},{"type":"v1","addr":"172.21.15.7:6835","nonce":1353990012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:54.330660+0000","modified":"2023-10-14T19:03:57.974158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4878":{"gid":4878,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6836/851698468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":851698468},{"type":"v1","addr":"172.21.15.148:6836","nonce":851698468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T19:04:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9274066f30 msgr2=0x7f92740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9274066f30 0x7f92740693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284019000 comp rx=0 tx=0).stop 2023-10-14T19:04:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 msgr2=0x7f92940ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940ab8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c7c0 tx=0x7f927c007f50 comp rx=0 tx=0).stop 2023-10-14T19:04:18.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 shutdown_connections 2023-10-14T19:04:18.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9274066f30 0x7f92740693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f929415cf20 0x7f92940abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92940b0710 0x7f9294144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 --2- 172.21.15.7:0/1294656094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f929415cb50 0x7f92940ab8f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:18.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 >> 172.21.15.7:0/1294656094 conn(0x7f92940cded0 msgr2=0x7f929415ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:18.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 shutdown_connections 2023-10-14T19:04:18.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:18.947+0000 7f9298f67700 1 -- 172.21.15.7:0/1294656094 wait complete. 2023-10-14T19:04:18.953 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2023-10-14T19:04:18.960 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:19.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.079+0000 7fc136975700 1 Processor -- start 2023-10-14T19:04:19.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.079+0000 7fc136975700 1 -- start start 2023-10-14T19:04:19.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc136975700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1300cb5a0 0x7fc1300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc136975700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1300cd9e0 0x7fc130159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc136975700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1300cde50 0x7fc13015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc136975700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1300d13f0 con 0x7fc1300cde50 2023-10-14T19:04:19.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc136975700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13015a940 con 0x7fc1300cb5a0 2023-10-14T19:04:19.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc136975700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13015ae40 con 0x7fc1300cd9e0 2023-10-14T19:04:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1300cde50 0x7fc13015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1300cde50 0x7fc13015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59724/0 (socket says 172.21.15.7:59724) 2023-10-14T19:04:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 -- 172.21.15.7:0/3947175855 learned_addr learned my addr 172.21.15.7:0/3947175855 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc12ffff700 1 --2- 172.21.15.7:0/3947175855 >> v2:172.21.15.148:3300/0 conn(0x7fc1300cb5a0 0x7fc1300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc12f7fe700 1 --2- 172.21.15.7:0/3947175855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1300cd9e0 0x7fc130159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 -- 172.21.15.7:0/3947175855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1300cd9e0 msgr2=0x7fc130159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 --2- 172.21.15.7:0/3947175855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1300cd9e0 0x7fc130159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 -- 172.21.15.7:0/3947175855 >> v2:172.21.15.148:3300/0 conn(0x7fc1300cb5a0 msgr2=0x7fc1300cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 --2- 172.21.15.7:0/3947175855 >> v2:172.21.15.148:3300/0 conn(0x7fc1300cb5a0 0x7fc1300cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 -- 172.21.15.7:0/3947175855 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13015ab60 con 0x7fc1300cde50 2023-10-14T19:04:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc134f12700 1 --2- 172.21.15.7:0/3947175855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cde50 0x7fc13015a400 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc130065120 tx=0x7fc128009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4565edcd3b122f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc12effd700 1 -- 172.21.15.7:0/3947175855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12800e070 con 0x7fc1300cde50 2023-10-14T19:04:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.080+0000 7fc12effd700 1 -- 172.21.15.7:0/3947175855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12800b930 con 0x7fc1300cde50 2023-10-14T19:04:19.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc12effd700 1 -- 172.21.15.7:0/3947175855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280092e0 con 0x7fc1300cde50 2023-10-14T19:04:19.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 -- 172.21.15.7:0/3947175855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cde50 msgr2=0x7fc13015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 --2- 172.21.15.7:0/3947175855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cde50 0x7fc13015a400 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc130065120 tx=0x7fc128009840 comp rx=0 tx=0).stop 2023-10-14T19:04:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 -- 172.21.15.7:0/3947175855 shutdown_connections 2023-10-14T19:04:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 --2- 172.21.15.7:0/3947175855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cde50 0x7fc13015a400 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 --2- 172.21.15.7:0/3947175855 >> v2:172.21.15.148:3300/0 conn(0x7fc1300cb5a0 0x7fc1300cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 --2- 172.21.15.7:0/3947175855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1300cd9e0 0x7fc130159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 -- 172.21.15.7:0/3947175855 >> 172.21.15.7:0/3947175855 conn(0x7fc130070e30 msgr2=0x7fc1300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 -- 172.21.15.7:0/3947175855 shutdown_connections 2023-10-14T19:04:19.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.081+0000 7fc136975700 1 -- 172.21.15.7:0/3947175855 wait complete. 2023-10-14T19:04:19.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.082+0000 7fc136975700 1 Processor -- start 2023-10-14T19:04:19.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.082+0000 7fc136975700 1 -- start start 2023-10-14T19:04:19.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc136975700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1300cb5a0 0x7fc130169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc136975700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 0x7fc13015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc136975700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13015dc20 0x7fc130157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc136975700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300c8c20 con 0x7fc1300cd9e0 2023-10-14T19:04:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc136975700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc130159770 con 0x7fc1300cb5a0 2023-10-14T19:04:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc136975700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13015e0a0 con 0x7fc13015dc20 2023-10-14T19:04:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 0x7fc13015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 0x7fc13015d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59740/0 (socket says 172.21.15.7:59740) 2023-10-14T19:04:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 -- 172.21.15.7:0/3410301965 learned_addr learned my addr 172.21.15.7:0/3410301965 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12ffff700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1300cb5a0 0x7fc130169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc134f12700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13015dc20 0x7fc130157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 -- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13015dc20 msgr2=0x7fc130157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13015dc20 0x7fc130157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 -- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1300cb5a0 msgr2=0x7fc130169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1300cb5a0 0x7fc130169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc12f7fe700 1 -- 172.21.15.7:0/3410301965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128009ae0 con 0x7fc1300cd9e0 2023-10-14T19:04:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.083+0000 7fc134f12700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13015dc20 0x7fc130157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.084+0000 7fc12f7fe700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 0x7fc13015d6e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc12400ec80 tx=0x7fc1240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.084+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400c850 con 0x7fc1300cd9e0 2023-10-14T19:04:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.084+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400c9b0 con 0x7fc1300cd9e0 2023-10-14T19:04:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.084+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400cd50 con 0x7fc1300cd9e0 2023-10-14T19:04:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.084+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13016a520 con 0x7fc1300cd9e0 2023-10-14T19:04:19.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.084+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc130158ed0 con 0x7fc1300cd9e0 2023-10-14T19:04:19.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.085+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13004c3c0 con 0x7fc1300cd9e0 2023-10-14T19:04:19.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.085+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc124013680 con 0x7fc1300cd9e0 2023-10-14T19:04:19.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.086+0000 7fc117fff700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc11c066f30 0x7fc11c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.086+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc124084b60 con 0x7fc1300cd9e0 2023-10-14T19:04:19.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.086+0000 7fc12ffff700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc11c066f30 0x7fc11c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.087+0000 7fc12ffff700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc11c066f30 0x7fc11c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc120009db0 tx=0x7fc1200091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.090+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc124051d80 con 0x7fc1300cd9e0 2023-10-14T19:04:19.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.284+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1300ccf00 con 0x7fc1300cd9e0 2023-10-14T19:04:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.284+0000 7fc117fff700 1 -- 172.21.15.7:0/3410301965 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15429 (secure 0 0 0) 0x7fc124017090 con 0x7fc1300cd9e0 2023-10-14T19:04:19.286 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:19.286 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:16.531925+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6835/1287999800":"2023-10-15T19:04:13.523872+0000","172.21.15.7:6833/1287999800":"2023-10-15T19:04:13.523872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc11c066f30 msgr2=0x7fc11c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc11c066f30 0x7fc11c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc120009db0 tx=0x7fc1200091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 msgr2=0x7fc13015d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 0x7fc13015d6e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc12400ec80 tx=0x7fc1240091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 shutdown_connections 2023-10-14T19:04:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc11c066f30 0x7fc11c0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1300cb5a0 0x7fc130169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13015dc20 0x7fc130157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 --2- 172.21.15.7:0/3410301965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1300cd9e0 0x7fc13015d6e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 >> 172.21.15.7:0/3410301965 conn(0x7fc130070e30 msgr2=0x7fc1300ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 shutdown_connections 2023-10-14T19:04:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.287+0000 7fc136975700 1 -- 172.21.15.7:0/3410301965 wait complete. 2023-10-14T19:04:19.300 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:04:19.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.420+0000 7fb98669d700 1 Processor -- start 2023-10-14T19:04:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.420+0000 7fb98669d700 1 -- start start 2023-10-14T19:04:19.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb98669d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb980140e50 0x7fb9800af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb98669d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb98015b920 0x7fb9800cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb98669d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb980158000 con 0x7fb9800af560 2023-10-14T19:04:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb98669d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800cb4d0 con 0x7fb980140e50 2023-10-14T19:04:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb98669d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800cbd10 con 0x7fb98015b920 2023-10-14T19:04:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb97ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb980140e50 0x7fb9800af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb97f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb9800af560 0x7fb98015b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58732/0 (socket says 172.21.15.7:58732) 2023-10-14T19:04:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.421+0000 7fb97f7fe700 1 -- 172.21.15.7:0/3674994366 learned_addr learned my addr 172.21.15.7:0/3674994366 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:19.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb984c3a700 1 --2- 172.21.15.7:0/3674994366 >> v2:172.21.15.148:3300/0 conn(0x7fb98015b920 0x7fb9800cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97ffff700 1 -- 172.21.15.7:0/3674994366 >> v2:172.21.15.148:3300/0 conn(0x7fb98015b920 msgr2=0x7fb9800cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97ffff700 1 --2- 172.21.15.7:0/3674994366 >> v2:172.21.15.148:3300/0 conn(0x7fb98015b920 0x7fb9800cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97ffff700 1 -- 172.21.15.7:0/3674994366 >> v1:172.21.15.7:6789/0 conn(0x7fb9800af560 legacy=0x7fb98015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97effd700 1 -- 172.21.15.7:0/3674994366 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233989395 0 0) 0x7fb980158000 con 0x7fb9800af560 2023-10-14T19:04:19.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97ffff700 1 -- 172.21.15.7:0/3674994366 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800af9b0 con 0x7fb980140e50 2023-10-14T19:04:19.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97ffff700 1 --2- 172.21.15.7:0/3674994366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb980140e50 0x7fb9800af020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb98015b140 tx=0x7fb9700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5978a55d998007e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97effd700 1 -- 172.21.15.7:0/3674994366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000b6b0 con 0x7fb980140e50 2023-10-14T19:04:19.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97effd700 1 -- 172.21.15.7:0/3674994366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000b810 con 0x7fb980140e50 2023-10-14T19:04:19.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.422+0000 7fb97effd700 1 -- 172.21.15.7:0/3674994366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000bbb0 con 0x7fb980140e50 2023-10-14T19:04:19.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 -- 172.21.15.7:0/3674994366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb980140e50 msgr2=0x7fb9800af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 --2- 172.21.15.7:0/3674994366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb980140e50 0x7fb9800af020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb98015b140 tx=0x7fb9700091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 -- 172.21.15.7:0/3674994366 shutdown_connections 2023-10-14T19:04:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 --2- 172.21.15.7:0/3674994366 >> v2:172.21.15.148:3300/0 conn(0x7fb98015b920 0x7fb9800cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 --2- 172.21.15.7:0/3674994366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb980140e50 0x7fb9800af020 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 -- 172.21.15.7:0/3674994366 >> 172.21.15.7:0/3674994366 conn(0x7fb9800cded0 msgr2=0x7fb98006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 -- 172.21.15.7:0/3674994366 shutdown_connections 2023-10-14T19:04:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.423+0000 7fb98669d700 1 -- 172.21.15.7:0/3674994366 wait complete. 2023-10-14T19:04:19.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.424+0000 7fb98669d700 1 Processor -- start 2023-10-14T19:04:19.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.424+0000 7fb98669d700 1 -- start start 2023-10-14T19:04:19.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb98669d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 0x7fb980156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb98669d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb980140e50 0x7fb98015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb98669d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb98015b920 0x7fb98015d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb98669d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98013e5a0 con 0x7fb9800af560 2023-10-14T19:04:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb98669d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98015af60 con 0x7fb98015b920 2023-10-14T19:04:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb98669d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800c2370 con 0x7fb980140e50 2023-10-14T19:04:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 0x7fb980156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 0x7fb980156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59758/0 (socket says 172.21.15.7:59758) 2023-10-14T19:04:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 -- 172.21.15.7:0/1324929570 learned_addr learned my addr 172.21.15.7:0/1324929570 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb984c3a700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb98015b920 0x7fb98015d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97f7fe700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb980140e50 0x7fb98015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 -- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb980140e50 msgr2=0x7fb98015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb980140e50 0x7fb98015d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 -- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb98015b920 msgr2=0x7fb98015d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb98015b920 0x7fb98015d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 -- 172.21.15.7:0/1324929570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970009420 con 0x7fb9800af560 2023-10-14T19:04:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb984c3a700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb98015b920 0x7fb98015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb97ffff700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 0x7fb980156d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb97000b0e0 tx=0x7fb970017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970011420 con 0x7fb9800af560 2023-10-14T19:04:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.425+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970011580 con 0x7fb9800af560 2023-10-14T19:04:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.426+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98015a6c0 con 0x7fb9800af560 2023-10-14T19:04:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.426+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970011940 con 0x7fb9800af560 2023-10-14T19:04:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.426+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98015ac80 con 0x7fb9800af560 2023-10-14T19:04:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.427+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98004c3c0 con 0x7fb9800af560 2023-10-14T19:04:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.427+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb970011d30 con 0x7fb9800af560 2023-10-14T19:04:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.427+0000 7fb967fff700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb96c066f30 0x7fb96c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.427+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fb970085b20 con 0x7fb9800af560 2023-10-14T19:04:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.428+0000 7fb97f7fe700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb96c066f30 0x7fb96c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.428+0000 7fb97f7fe700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb96c066f30 0x7fb96c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb974007fd0 tx=0x7fb974009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.432+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb970052dc0 con 0x7fb9800af560 2023-10-14T19:04:19.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.668+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9800c9000 con 0x7fb9800af560 2023-10-14T19:04:19.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.669+0000 7fb967fff700 1 -- 172.21.15.7:0/1324929570 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4588 (secure 0 0 0) 0x7fb970015090 con 0x7fb9800af560 2023-10-14T19:04:19.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:19.671 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1353990012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1353990012},{"type":"v1","addr":"172.21.15.7:6835","nonce":1353990012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:54.330660+0000","modified":"2023-10-14T19:03:57.974158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4878":{"gid":4878,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6836/851698468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":851698468},{"type":"v1","addr":"172.21.15.148:6836","nonce":851698468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T19:04:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb96c066f30 msgr2=0x7fb96c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb96c066f30 0x7fb96c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb974007fd0 tx=0x7fb974009040 comp rx=0 tx=0).stop 2023-10-14T19:04:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 msgr2=0x7fb980156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 0x7fb980156d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb97000b0e0 tx=0x7fb970017000 comp rx=0 tx=0).stop 2023-10-14T19:04:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 shutdown_connections 2023-10-14T19:04:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb96c066f30 0x7fb96c0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb98015b920 0x7fb98015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9800af560 0x7fb980156d80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 --2- 172.21.15.7:0/1324929570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb980140e50 0x7fb98015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.670+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 >> 172.21.15.7:0/1324929570 conn(0x7fb9800cded0 msgr2=0x7fb9800b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.671+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 shutdown_connections 2023-10-14T19:04:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.671+0000 7fb98669d700 1 -- 172.21.15.7:0/1324929570 wait complete. 2023-10-14T19:04:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2023-10-14T19:04:19.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:19.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 Processor -- start 2023-10-14T19:04:19.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 -- start start 2023-10-14T19:04:19.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b380cb5a0 0x7f2b380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 0x7f2b38156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3815ae40 con 0x7f2b380cd9e0 2023-10-14T19:04:19.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b380d13f0 con 0x7f2b380cb5a0 2023-10-14T19:04:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.803+0000 7f2b3f1ac700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3815ab60 con 0x7f2b3815a5d0 2023-10-14T19:04:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b37fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b380cd9e0 0x7f2b38159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58746/0 (socket says 172.21.15.7:58746) 2023-10-14T19:04:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b37fff700 1 -- 172.21.15.7:0/1920047726 learned_addr learned my addr 172.21.15.7:0/1920047726 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:19.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/1920047726 >> v2:172.21.15.148:3300/0 conn(0x7f2b380cb5a0 0x7f2b380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b3d749700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 0x7f2b38156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417119172 0 0) 0x7f2b3815ae40 con 0x7f2b380cd9e0 2023-10-14T19:04:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b20003570 con 0x7f2b380cd9e0 2023-10-14T19:04:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694213680 0 0) 0x7f2b20003570 con 0x7f2b380cd9e0 2023-10-14T19:04:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 msgr2=0x7f2b38156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 0x7f2b38156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 >> v2:172.21.15.148:3300/0 conn(0x7f2b380cb5a0 msgr2=0x7f2b380cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 --2- 172.21.15.7:0/1920047726 >> v2:172.21.15.148:3300/0 conn(0x7f2b380cb5a0 0x7f2b380cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380ccf00 con 0x7f2b380cd9e0 2023-10-14T19:04:19.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2b2c001470 con 0x7f2b380cd9e0 2023-10-14T19:04:19.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 >> v1:172.21.15.7:6789/0 conn(0x7f2b380cd9e0 legacy=0x7f2b38159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 0x7f2b20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20004d50 0x7f2b200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3815ab60 con 0x7f2b20003a60 2023-10-14T19:04:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2000ba60 con 0x7f2b20004d50 2023-10-14T19:04:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2000bba0 con 0x7f2b3815a5d0 2023-10-14T19:04:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b37fff700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 0x7f2b20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.804+0000 7f2b3d749700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20004d50 0x7f2b200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3cf48700 1 -- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 msgr2=0x7f2b20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b3815a5d0 0x7f2b20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3cf48700 1 -- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20004d50 msgr2=0x7f2b200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20004d50 0x7f2b200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3cf48700 1 -- 172.21.15.7:0/1920047726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20003570 con 0x7f2b20003a60 2023-10-14T19:04:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b20003e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e210 tx=0x7f2b3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfa6b15a532b9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000ea60 con 0x7f2b20003a60 2023-10-14T19:04:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000f040 con 0x7f2b20003a60 2023-10-14T19:04:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b377fe700 1 -- 172.21.15.7:0/1920047726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000ee10 con 0x7f2b20003a60 2023-10-14T19:04:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/1920047726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 msgr2=0x7f2b20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.805+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/1920047726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b20003e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e210 tx=0x7f2b3000b040 comp rx=0 tx=0).stop 2023-10-14T19:04:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.806+0000 7f2b3d749700 1 -- 172.21.15.7:0/1920047726 reap_dead start 2023-10-14T19:04:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.806+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/1920047726 shutdown_connections 2023-10-14T19:04:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.806+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/1920047726 >> 172.21.15.7:0/1920047726 conn(0x7f2b38070e30 msgr2=0x7f2b380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.806+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/1920047726 shutdown_connections 2023-10-14T19:04:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.806+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/1920047726 wait complete. 2023-10-14T19:04:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.807+0000 7f2b3f1ac700 1 Processor -- start 2023-10-14T19:04:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.807+0000 7f2b3f1ac700 1 -- start start 2023-10-14T19:04:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b380c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b38153570 0x7f2b381515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b380c6480 0x7f2b380c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380c6e30 con 0x7f2b20003a60 2023-10-14T19:04:19.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38153f20 con 0x7f2b380c6480 2023-10-14T19:04:19.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380c7e50 con 0x7f2b38153570 2023-10-14T19:04:19.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b380c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b380c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59780/0 (socket says 172.21.15.7:59780) 2023-10-14T19:04:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 -- 172.21.15.7:0/644225866 learned_addr learned my addr 172.21.15.7:0/644225866 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b37fff700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b38153570 0x7f2b381515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3d749700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b380c6480 0x7f2b380c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 -- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b38153570 msgr2=0x7f2b381515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b38153570 0x7f2b381515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 -- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b380c6480 msgr2=0x7f2b380c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b380c6480 0x7f2b380c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 -- 172.21.15.7:0/644225866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380c8130 con 0x7f2b20003a60 2023-10-14T19:04:19.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3cf48700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b380c77c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000afd0 tx=0x7f2b3001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30014e60 con 0x7f2b20003a60 2023-10-14T19:04:19.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3001d420 con 0x7f2b20003a60 2023-10-14T19:04:19.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b380c8410 con 0x7f2b20003a60 2023-10-14T19:04:19.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3001d7e0 con 0x7f2b20003a60 2023-10-14T19:04:19.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.808+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3815bc60 con 0x7f2b20003a60 2023-10-14T19:04:19.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.809+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3815c040 con 0x7f2b20003a60 2023-10-14T19:04:19.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.810+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b30003040 con 0x7f2b20003a60 2023-10-14T19:04:19.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.810+0000 7f2b34ff9700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b24066f30 0x7f2b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:19.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.810+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2b30086860 con 0x7f2b20003a60 2023-10-14T19:04:19.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.810+0000 7f2b37fff700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b24066f30 0x7f2b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:19.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.811+0000 7f2b37fff700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b24066f30 0x7f2b240693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c001120 tx=0x7f2b2c001e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:19.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:19.814+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b30053b40 con 0x7f2b20003a60 2023-10-14T19:04:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.053+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b3804c3c0 con 0x7f2b20003a60 2023-10-14T19:04:20.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.054+0000 7f2b34ff9700 1 -- 172.21.15.7:0/644225866 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4588 (secure 0 0 0) 0x7f2b30018070 con 0x7f2b20003a60 2023-10-14T19:04:20.056 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:20.056 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1353990012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1353990012},{"type":"v1","addr":"172.21.15.7:6835","nonce":1353990012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:03:54.330660+0000","modified":"2023-10-14T19:03:57.974158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4878":{"gid":4878,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6836/851698468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":851698468},{"type":"v1","addr":"172.21.15.148:6836","nonce":851698468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T19:04:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b24066f30 msgr2=0x7f2b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b24066f30 0x7f2b240693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c001120 tx=0x7f2b2c001e50 comp rx=0 tx=0).stop 2023-10-14T19:04:20.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 msgr2=0x7f2b380c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b380c77c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000afd0 tx=0x7f2b3001a000 comp rx=0 tx=0).stop 2023-10-14T19:04:20.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 shutdown_connections 2023-10-14T19:04:20.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b24066f30 0x7f2b240693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b380c6480 0x7f2b380c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b20003a60 0x7f2b380c77c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 --2- 172.21.15.7:0/644225866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b38153570 0x7f2b381515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 >> 172.21.15.7:0/644225866 conn(0x7f2b38070e30 msgr2=0x7f2b380b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:20.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 shutdown_connections 2023-10-14T19:04:20.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.056+0000 7f2b3f1ac700 1 -- 172.21.15.7:0/644225866 wait complete. 2023-10-14T19:04:20.062 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2023-10-14T19:04:20.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:20.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.187+0000 7fc75c177700 1 Processor -- start 2023-10-14T19:04:20.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75c177700 1 -- start start 2023-10-14T19:04:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75c177700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7541598b0 0x7fc7540af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75c177700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7540af790 0x7fc754163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75c177700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7540ce9d0 con 0x7fc754159c80 2023-10-14T19:04:20.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75c177700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540afc30 con 0x7fc7540af790 2023-10-14T19:04:20.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75c177700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540aff10 con 0x7fc7541598b0 2023-10-14T19:04:20.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.188+0000 7fc75a714700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7540af790 0x7fc754163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7540af790 0x7fc754163590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59794/0 (socket says 172.21.15.7:59794) 2023-10-14T19:04:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 -- 172.21.15.7:0/3772359128 learned_addr learned my addr 172.21.15.7:0/3772359128 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc759f13700 1 --2- 172.21.15.7:0/3772359128 >> v2:172.21.15.148:3300/0 conn(0x7fc7541598b0 0x7fc7540af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 -- 172.21.15.7:0/3772359128 >> v2:172.21.15.148:3300/0 conn(0x7fc7541598b0 msgr2=0x7fc7540af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 --2- 172.21.15.7:0/3772359128 >> v2:172.21.15.148:3300/0 conn(0x7fc7541598b0 0x7fc7540af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 -- 172.21.15.7:0/3772359128 >> v1:172.21.15.148:6789/0 conn(0x7fc754159c80 legacy=0x7fc7540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 -- 172.21.15.7:0/3772359128 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540ce380 con 0x7fc7540af790 2023-10-14T19:04:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc759f13700 1 --2- 172.21.15.7:0/3772359128 >> v2:172.21.15.148:3300/0 conn(0x7fc7541598b0 0x7fc7540af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc75a714700 1 --2- 172.21.15.7:0/3772359128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc754163590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc754065860 tx=0x7fc74c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49724d6638a6e36b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc758f11700 1 -- 172.21.15.7:0/3772359128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00b820 con 0x7fc7540af790 2023-10-14T19:04:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc758f11700 1 -- 172.21.15.7:0/3772359128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00b980 con 0x7fc7540af790 2023-10-14T19:04:20.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.189+0000 7fc758f11700 1 -- 172.21.15.7:0/3772359128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00bd20 con 0x7fc7540af790 2023-10-14T19:04:20.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 -- 172.21.15.7:0/3772359128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 msgr2=0x7fc754163590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 --2- 172.21.15.7:0/3772359128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc754163590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc754065860 tx=0x7fc74c009250 comp rx=0 tx=0).stop 2023-10-14T19:04:20.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 -- 172.21.15.7:0/3772359128 shutdown_connections 2023-10-14T19:04:20.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 --2- 172.21.15.7:0/3772359128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc754163590 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 --2- 172.21.15.7:0/3772359128 >> v2:172.21.15.148:3300/0 conn(0x7fc7541598b0 0x7fc7540af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 -- 172.21.15.7:0/3772359128 >> 172.21.15.7:0/3772359128 conn(0x7fc754070e30 msgr2=0x7fc7540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 -- 172.21.15.7:0/3772359128 shutdown_connections 2023-10-14T19:04:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.190+0000 7fc75c177700 1 -- 172.21.15.7:0/3772359128 wait complete. 2023-10-14T19:04:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.191+0000 7fc75c177700 1 Processor -- start 2023-10-14T19:04:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.191+0000 7fc75c177700 1 -- start start 2023-10-14T19:04:20.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc7540c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7541598b0 0x7fc7541490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc754159c80 0x7fc7541547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540c7eb0 con 0x7fc7540af790 2023-10-14T19:04:20.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75416a510 con 0x7fc754159c80 2023-10-14T19:04:20.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540c7860 con 0x7fc7541598b0 2023-10-14T19:04:20.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc7540c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc7540c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59810/0 (socket says 172.21.15.7:59810) 2023-10-14T19:04:20.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 -- 172.21.15.7:0/2273277523 learned_addr learned my addr 172.21.15.7:0/2273277523 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:20.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75a714700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc754159c80 0x7fc7541547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759712700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7541598b0 0x7fc7541490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 -- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7541598b0 msgr2=0x7fc7541490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7541598b0 0x7fc7541490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 -- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc754159c80 msgr2=0x7fc7541547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc754159c80 0x7fc7541547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 -- 172.21.15.7:0/2273277523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0094f0 con 0x7fc7540af790 2023-10-14T19:04:20.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc759f13700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc7540c8340 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc74400a400 tx=0x7fc744007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744015440 con 0x7fc7540af790 2023-10-14T19:04:20.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440155a0 con 0x7fc7540af790 2023-10-14T19:04:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7540c7b40 con 0x7fc7540af790 2023-10-14T19:04:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.192+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744015940 con 0x7fc7540af790 2023-10-14T19:04:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.193+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75416a7f0 con 0x7fc7540af790 2023-10-14T19:04:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.194+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7540c8190 con 0x7fc7540af790 2023-10-14T19:04:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.194+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc744015cf0 con 0x7fc7540af790 2023-10-14T19:04:20.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.194+0000 7fc751ffb700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740066f30 0x7fc7400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.194+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc744084cc0 con 0x7fc7540af790 2023-10-14T19:04:20.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.195+0000 7fc759712700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740066f30 0x7fc7400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.195+0000 7fc759712700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740066f30 0x7fc7400693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc754153730 tx=0x7fc748009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.199+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc74404e5a0 con 0x7fc7540af790 2023-10-14T19:04:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.393+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc75404c3c0 con 0x7fc7540af790 2023-10-14T19:04:20.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.394+0000 7fc751ffb700 1 -- 172.21.15.7:0/2273277523 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15429 (secure 0 0 0) 0x7fc744051f90 con 0x7fc7540af790 2023-10-14T19:04:20.395 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:20.395 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:16.531925+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:03:52.238054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T19:03:53.310520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6835/1287999800":"2023-10-15T19:04:13.523872+0000","172.21.15.7:6833/1287999800":"2023-10-15T19:04:13.523872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.395+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740066f30 msgr2=0x7fc7400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.395+0000 7fc75c177700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740066f30 0x7fc7400693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc754153730 tx=0x7fc748009060 comp rx=0 tx=0).stop 2023-10-14T19:04:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.395+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 msgr2=0x7fc7540c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.395+0000 7fc75c177700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc7540c8340 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc74400a400 tx=0x7fc744007910 comp rx=0 tx=0).stop 2023-10-14T19:04:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 shutdown_connections 2023-10-14T19:04:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740066f30 0x7fc7400693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc754159c80 0x7fc7541547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540af790 0x7fc7540c8340 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 --2- 172.21.15.7:0/2273277523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7541598b0 0x7fc7541490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 >> 172.21.15.7:0/2273277523 conn(0x7fc754070e30 msgr2=0x7fc7540c6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 shutdown_connections 2023-10-14T19:04:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.396+0000 7fc75c177700 1 -- 172.21.15.7:0/2273277523 wait complete. 2023-10-14T19:04:20.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:04:20.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.528+0000 7fe66337c700 1 Processor -- start 2023-10-14T19:04:20.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.528+0000 7fe66337c700 1 -- start start 2023-10-14T19:04:20.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66337c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe65c153c30 0x7fe65c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66337c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe65c15de50 0x7fe65c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66337c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0cf3c0 con 0x7fe65c0cef40 2023-10-14T19:04:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66337c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c15afd0 con 0x7fe65c15de50 2023-10-14T19:04:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66337c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c15b2b0 con 0x7fe65c153c30 2023-10-14T19:04:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe65c15de50 0x7fe65c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe65c15de50 0x7fe65c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59814/0 (socket says 172.21.15.7:59814) 2023-10-14T19:04:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 -- 172.21.15.7:0/3489219921 learned_addr learned my addr 172.21.15.7:0/3489219921 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66237a700 1 --2- 172.21.15.7:0/3489219921 >> v2:172.21.15.148:3300/0 conn(0x7fe65c153c30 0x7fe65c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 -- 172.21.15.7:0/3489219921 >> v2:172.21.15.148:3300/0 conn(0x7fe65c153c30 msgr2=0x7fe65c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 --2- 172.21.15.7:0/3489219921 >> v2:172.21.15.148:3300/0 conn(0x7fe65c153c30 0x7fe65c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 -- 172.21.15.7:0/3489219921 >> v1:172.21.15.148:6789/0 conn(0x7fe65c0cef40 legacy=0x7fe65c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe661b79700 1 -- 172.21.15.7:0/3489219921 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c15b590 con 0x7fe65c15de50 2023-10-14T19:04:20.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.529+0000 7fe66237a700 1 --2- 172.21.15.7:0/3489219921 >> v2:172.21.15.148:3300/0 conn(0x7fe65c153c30 0x7fe65c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:20.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe661b79700 1 --2- 172.21.15.7:0/3489219921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c15de50 0x7fe65c0cea00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe65c06ead0 tx=0x7fe650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c1e6eeb73a7f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe661378700 1 -- 172.21.15.7:0/3489219921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000b860 con 0x7fe65c15de50 2023-10-14T19:04:20.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe661378700 1 -- 172.21.15.7:0/3489219921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65000b9c0 con 0x7fe65c15de50 2023-10-14T19:04:20.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe661378700 1 -- 172.21.15.7:0/3489219921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000bd60 con 0x7fe65c15de50 2023-10-14T19:04:20.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 -- 172.21.15.7:0/3489219921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c15de50 msgr2=0x7fe65c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 --2- 172.21.15.7:0/3489219921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c15de50 0x7fe65c0cea00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe65c06ead0 tx=0x7fe650009250 comp rx=0 tx=0).stop 2023-10-14T19:04:20.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 -- 172.21.15.7:0/3489219921 shutdown_connections 2023-10-14T19:04:20.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 --2- 172.21.15.7:0/3489219921 >> v2:172.21.15.148:3300/0 conn(0x7fe65c153c30 0x7fe65c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 --2- 172.21.15.7:0/3489219921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c15de50 0x7fe65c0cea00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 -- 172.21.15.7:0/3489219921 >> 172.21.15.7:0/3489219921 conn(0x7fe65c0703a0 msgr2=0x7fe65c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:20.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 -- 172.21.15.7:0/3489219921 shutdown_connections 2023-10-14T19:04:20.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.530+0000 7fe66337c700 1 -- 172.21.15.7:0/3489219921 wait complete. 2023-10-14T19:04:20.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.531+0000 7fe66337c700 1 Processor -- start 2023-10-14T19:04:20.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 -- start start 2023-10-14T19:04:20.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe65c0cef40 0x7fe65c13e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 0x7fe65c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe65c15de50 0x7fe65c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b61a0 con 0x7fe65c153c30 2023-10-14T19:04:20.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0c8bf0 con 0x7fe65c0cef40 2023-10-14T19:04:20.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66337c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c13edf0 con 0x7fe65c15de50 2023-10-14T19:04:20.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe661b79700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 0x7fe65c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe661b79700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 0x7fe65c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59824/0 (socket says 172.21.15.7:59824) 2023-10-14T19:04:20.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe661b79700 1 -- 172.21.15.7:0/3327030968 learned_addr learned my addr 172.21.15.7:0/3327030968 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:20.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe66237a700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe65c0cef40 0x7fe65c13e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.532+0000 7fe662b7b700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe65c15de50 0x7fe65c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe661b79700 1 -- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe65c15de50 msgr2=0x7fe65c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe661b79700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe65c15de50 0x7fe65c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe661b79700 1 -- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe65c0cef40 msgr2=0x7fe65c13e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe661b79700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe65c0cef40 0x7fe65c13e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe661b79700 1 -- 172.21.15.7:0/3327030968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500094f0 con 0x7fe65c153c30 2023-10-14T19:04:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe661b79700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 0x7fe65c0b1640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe6500090b0 tx=0x7fe650017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650024440 con 0x7fe65c153c30 2023-10-14T19:04:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6500245c0 con 0x7fe65c153c30 2023-10-14T19:04:20.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c0c7fe0 con 0x7fe65c153c30 2023-10-14T19:04:20.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650024980 con 0x7fe65c153c30 2023-10-14T19:04:20.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.533+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c0c85a0 con 0x7fe65c153c30 2023-10-14T19:04:20.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.534+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c0b2c30 con 0x7fe65c153c30 2023-10-14T19:04:20.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.534+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe65001a420 con 0x7fe65c153c30 2023-10-14T19:04:20.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.535+0000 7fe65a7fc700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe648066f30 0x7fe6480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.535+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe6500862d0 con 0x7fe65c153c30 2023-10-14T19:04:20.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.535+0000 7fe66237a700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe648066f30 0x7fe6480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.536+0000 7fe66237a700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe648066f30 0x7fe6480693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0076a0 tx=0x7fe64c009930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.539+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe650053570 con 0x7fe65c153c30 2023-10-14T19:04:20.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.778+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe65c04c3c0 con 0x7fe65c153c30 2023-10-14T19:04:20.779 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:04:20.778+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:04:20.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.781+0000 7fe65a7fc700 1 -- 172.21.15.7:0/3327030968 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe650056b90 con 0x7fe65c153c30 2023-10-14T19:04:20.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe648066f30 msgr2=0x7fe6480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe648066f30 0x7fe6480693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0076a0 tx=0x7fe64c009930 comp rx=0 tx=0).stop 2023-10-14T19:04:20.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 msgr2=0x7fe65c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 0x7fe65c0b1640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe6500090b0 tx=0x7fe650017000 comp rx=0 tx=0).stop 2023-10-14T19:04:20.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 shutdown_connections 2023-10-14T19:04:20.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe648066f30 0x7fe6480693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe65c0cef40 0x7fe65c13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe65c15de50 0x7fe65c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 --2- 172.21.15.7:0/3327030968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c153c30 0x7fe65c0b1640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.783+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 >> 172.21.15.7:0/3327030968 conn(0x7fe65c0703a0 msgr2=0x7fe65c153280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:20.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.784+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 shutdown_connections 2023-10-14T19:04:20.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.784+0000 7fe66337c700 1 -- 172.21.15.7:0/3327030968 wait complete. 2023-10-14T19:04:20.787 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:04:20.788 INFO:tasks.ceph.mds.b.smithi148.stderr: -1230> 2023-10-14T19:03:56.905+0000 7f49da8f8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:04:20.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:04:20.809 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:04:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.917+0000 7f4b1405f700 1 Processor -- start 2023-10-14T19:04:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.917+0000 7f4b1405f700 1 -- start start 2023-10-14T19:04:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b1405f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4b0c159530 0x7f4b0c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b1405f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c06e0e0 0x7f4b0c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b1405f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0ccfd0 con 0x7f4b0c06dc70 2023-10-14T19:04:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b1405f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0cf0e0 con 0x7f4b0c159530 2023-10-14T19:04:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b1405f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15a3d0 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b115fa700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4b0c06dc70 0x7f4b0c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58750/0 (socket says 172.21.15.7:58750) 2023-10-14T19:04:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b115fa700 1 -- 172.21.15.7:0/317608535 learned_addr learned my addr 172.21.15.7:0/317608535 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/317608535 >> v2:172.21.15.148:3300/0 conn(0x7f4b0c159530 0x7f4b0c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b125fc700 1 --2- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c06e0e0 0x7f4b0c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b10df9700 1 -- 172.21.15.7:0/317608535 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016197594 0 0) 0x7f4b0c0ccfd0 con 0x7f4b0c06dc70 2023-10-14T19:04:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b10df9700 1 -- 172.21.15.7:0/317608535 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af4003570 con 0x7f4b0c06dc70 2023-10-14T19:04:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b10df9700 1 -- 172.21.15.7:0/317608535 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093587614 0 0) 0x7f4af4003570 con 0x7f4b0c06dc70 2023-10-14T19:04:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b11dfb700 1 -- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c06e0e0 msgr2=0x7f4b0c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c06e0e0 0x7f4b0c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b11dfb700 1 -- 172.21.15.7:0/317608535 >> v1:172.21.15.7:6789/0 conn(0x7f4b0c06dc70 legacy=0x7f4b0c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.918+0000 7f4b11dfb700 1 -- 172.21.15.7:0/317608535 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c15a6b0 con 0x7f4b0c159530 2023-10-14T19:04:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c159530 0x7f4b0c0ceba0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b040098e0 tx=0x7f4b040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0050e1177abc74d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b10df9700 1 -- 172.21.15.7:0/317608535 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00001470 con 0x7f4b0c159530 2023-10-14T19:04:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b10df9700 1 -- 172.21.15.7:0/317608535 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b04011420 con 0x7f4b0c159530 2023-10-14T19:04:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b10df9700 1 -- 172.21.15.7:0/317608535 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040117c0 con 0x7f4b0c159530 2023-10-14T19:04:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 -- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c159530 msgr2=0x7f4b0c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 --2- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c159530 0x7f4b0c0ceba0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b040098e0 tx=0x7f4b040091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 -- 172.21.15.7:0/317608535 shutdown_connections 2023-10-14T19:04:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 --2- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c159530 0x7f4b0c0ceba0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 --2- 172.21.15.7:0/317608535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c06e0e0 0x7f4b0c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 -- 172.21.15.7:0/317608535 >> 172.21.15.7:0/317608535 conn(0x7f4b0c0703a0 msgr2=0x7f4b0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 -- 172.21.15.7:0/317608535 shutdown_connections 2023-10-14T19:04:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.919+0000 7f4b1405f700 1 -- 172.21.15.7:0/317608535 wait complete. 2023-10-14T19:04:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.920+0000 7f4b1405f700 1 Processor -- start 2023-10-14T19:04:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 -- start start 2023-10-14T19:04:20.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c06dc70 0x7f4b0c0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 0x7f4b0c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c159530 0x7f4b0c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15d3c0 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15d5d0 con 0x7f4b0c06dc70 2023-10-14T19:04:20.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b1405f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15d8b0 con 0x7f4b0c159530 2023-10-14T19:04:20.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b115fa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 0x7f4b0c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b115fa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 0x7f4b0c0b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59830/0 (socket says 172.21.15.7:59830) 2023-10-14T19:04:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.921+0000 7f4b115fa700 1 -- 172.21.15.7:0/3379866183 learned_addr learned my addr 172.21.15.7:0/3379866183 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c06dc70 0x7f4b0c0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b115fa700 1 -- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c159530 msgr2=0x7f4b0c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b125fc700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c159530 0x7f4b0c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b115fa700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c159530 0x7f4b0c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b115fa700 1 -- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c06dc70 msgr2=0x7f4b0c0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b115fa700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c06dc70 0x7f4b0c0c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b115fa700 1 -- 172.21.15.7:0/3379866183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009420 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c06dc70 0x7f4b0c0c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b125fc700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c159530 0x7f4b0c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b115fa700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 0x7f4b0c0b1b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000cb90 tx=0x7f4b00001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00007360 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000074e0 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c15db90 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004830 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.922+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c15e150 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.923+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c15e370 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.924+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b00004ba0 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.924+0000 7f4b09ffb700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4af8066f30 0x7f4af80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.924+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f4b00083f10 con 0x7f4b0c06e0e0 2023-10-14T19:04:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.924+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4af8066f30 0x7f4af80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.925+0000 7f4b11dfb700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4af8066f30 0x7f4af80693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b040030c0 tx=0x7f4b04016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:20.928+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b00051150 con 0x7f4b0c06e0e0 2023-10-14T19:04:21.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.165+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4b0c04c3c0 con 0x7f4b0c06e0e0 2023-10-14T19:04:21.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.782+0000 7f4b09ffb700 1 -- 172.21.15.7:0/3379866183 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b000180a0 con 0x7f4b0c06e0e0 2023-10-14T19:04:21.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4af8066f30 msgr2=0x7f4af80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:21.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4af8066f30 0x7f4af80693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b040030c0 tx=0x7f4b04016000 comp rx=0 tx=0).stop 2023-10-14T19:04:21.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 msgr2=0x7f4b0c0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:21.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 0x7f4b0c0b1b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000cb90 tx=0x7f4b00001b50 comp rx=0 tx=0).stop 2023-10-14T19:04:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 shutdown_connections 2023-10-14T19:04:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4af8066f30 0x7f4af80693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b0c06dc70 0x7f4b0c0c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b0c159530 0x7f4b0c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 --2- 172.21.15.7:0/3379866183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c06e0e0 0x7f4b0c0b1b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 >> 172.21.15.7:0/3379866183 conn(0x7f4b0c0703a0 msgr2=0x7f4b0c0c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:21.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 shutdown_connections 2023-10-14T19:04:21.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.785+0000 7f4b1405f700 1 -- 172.21.15.7:0/3379866183 wait complete. 2023-10-14T19:04:21.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:04:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.932+0000 7fa5a359e700 1 Processor -- start 2023-10-14T19:04:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.932+0000 7fa5a359e700 1 -- start start 2023-10-14T19:04:21.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5a4159770 0x7fa5a406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a359e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5a406c6a0 0x7fa5a40ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a40caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a359e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a4159b40 con 0x7fa5a4159770 2023-10-14T19:04:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a359e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a406d740 con 0x7fa5a406c6a0 2023-10-14T19:04:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a406cb30 con 0x7fa5a406a330 2023-10-14T19:04:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5a4159770 0x7fa5a406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5a4159770 0x7fa5a406dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59842/0 (socket says 172.21.15.7:59842) 2023-10-14T19:04:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 -- 172.21.15.7:0/3042291030 learned_addr learned my addr 172.21.15.7:0/3042291030 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a1d9b700 1 --2- 172.21.15.7:0/3042291030 >> v2:172.21.15.148:3300/0 conn(0x7fa5a406c6a0 0x7fa5a40ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 -- 172.21.15.7:0/3042291030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 msgr2=0x7fa5a40caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 --2- 172.21.15.7:0/3042291030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a40caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 -- 172.21.15.7:0/3042291030 >> v2:172.21.15.148:3300/0 conn(0x7fa5a406c6a0 msgr2=0x7fa5a40ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 --2- 172.21.15.7:0/3042291030 >> v2:172.21.15.148:3300/0 conn(0x7fa5a406c6a0 0x7fa5a40ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.933+0000 7fa5a259c700 1 -- 172.21.15.7:0/3042291030 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a406ce10 con 0x7fa5a4159770 2023-10-14T19:04:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a259c700 1 --2- 172.21.15.7:0/3042291030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a4159770 0x7fa5a406dbd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cc970 tx=0x7fa594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1d6ec64e336383 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a159a700 1 -- 172.21.15.7:0/3042291030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400b860 con 0x7fa5a4159770 2023-10-14T19:04:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a159a700 1 -- 172.21.15.7:0/3042291030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59400b9c0 con 0x7fa5a4159770 2023-10-14T19:04:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a159a700 1 -- 172.21.15.7:0/3042291030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400bd60 con 0x7fa5a4159770 2023-10-14T19:04:21.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 -- 172.21.15.7:0/3042291030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a4159770 msgr2=0x7fa5a406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:21.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3042291030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a4159770 0x7fa5a406dbd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cc970 tx=0x7fa594009250 comp rx=0 tx=0).stop 2023-10-14T19:04:21.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 -- 172.21.15.7:0/3042291030 shutdown_connections 2023-10-14T19:04:21.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3042291030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a40caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3042291030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a4159770 0x7fa5a406dbd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3042291030 >> v2:172.21.15.148:3300/0 conn(0x7fa5a406c6a0 0x7fa5a40ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 -- 172.21.15.7:0/3042291030 >> 172.21.15.7:0/3042291030 conn(0x7fa5a406e790 msgr2=0x7fa5a406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 -- 172.21.15.7:0/3042291030 shutdown_connections 2023-10-14T19:04:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.934+0000 7fa5a359e700 1 -- 172.21.15.7:0/3042291030 wait complete. 2023-10-14T19:04:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.935+0000 7fa5a359e700 1 Processor -- start 2023-10-14T19:04:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.935+0000 7fa5a359e700 1 -- start start 2023-10-14T19:04:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a41699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 0x7fa5a416d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4159770 0x7fa5a4146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a359e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4156cd0 con 0x7fa5a406c6a0 2023-10-14T19:04:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41563a0 con 0x7fa5a4159770 2023-10-14T19:04:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4156680 con 0x7fa5a406a330 2023-10-14T19:04:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 0x7fa5a416d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 0x7fa5a416d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59844/0 (socket says 172.21.15.7:59844) 2023-10-14T19:04:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a1d9b700 1 -- 172.21.15.7:0/3484401643 learned_addr learned my addr 172.21.15.7:0/3484401643 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a259c700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a41699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.936+0000 7fa5a2d9d700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4159770 0x7fa5a4146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a1d9b700 1 -- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 msgr2=0x7fa5a41699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a1d9b700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a41699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a1d9b700 1 -- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4159770 msgr2=0x7fa5a4146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a1d9b700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4159770 0x7fa5a4146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a1d9b700 1 -- 172.21.15.7:0/3484401643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940094f0 con 0x7fa5a406c6a0 2023-10-14T19:04:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a2d9d700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4159770 0x7fa5a4146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a1d9b700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 0x7fa5a416d130 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa59800c880 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011600 con 0x7fa5a406c6a0 2023-10-14T19:04:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598011760 con 0x7fa5a406c6a0 2023-10-14T19:04:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a4156960 con 0x7fa5a406c6a0 2023-10-14T19:04:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011b00 con 0x7fa5a406c6a0 2023-10-14T19:04:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.937+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a416a0b0 con 0x7fa5a406c6a0 2023-10-14T19:04:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.938+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a4156e40 con 0x7fa5a406c6a0 2023-10-14T19:04:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.938+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa598019400 con 0x7fa5a406c6a0 2023-10-14T19:04:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.939+0000 7fa5927fc700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa584066f30 0x7fa5840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:21.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.939+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fa598084680 con 0x7fa5a406c6a0 2023-10-14T19:04:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.939+0000 7fa5a259c700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa584066f30 0x7fa5840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.940+0000 7fa5a259c700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa584066f30 0x7fa5840693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cc970 tx=0x7fa594017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:21.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:21.943+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5980517a0 con 0x7fa5a406c6a0 2023-10-14T19:04:22.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.138+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5a404c3c0 con 0x7fa5a406c6a0 2023-10-14T19:04:22.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.785+0000 7fa5927fc700 1 -- 172.21.15.7:0/3484401643 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa598054dc0 con 0x7fa5a406c6a0 2023-10-14T19:04:22.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa584066f30 msgr2=0x7fa5840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:22.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa584066f30 0x7fa5840693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cc970 tx=0x7fa594017000 comp rx=0 tx=0).stop 2023-10-14T19:04:22.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 msgr2=0x7fa5a416d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:22.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 0x7fa5a416d130 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa59800c880 tx=0x7fa598008040 comp rx=0 tx=0).stop 2023-10-14T19:04:22.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 shutdown_connections 2023-10-14T19:04:22.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa584066f30 0x7fa5840693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4159770 0x7fa5a4146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5a406a330 0x7fa5a41699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 --2- 172.21.15.7:0/3484401643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5a406c6a0 0x7fa5a416d130 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 >> 172.21.15.7:0/3484401643 conn(0x7fa5a406e790 msgr2=0x7fa5a40c1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:22.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 shutdown_connections 2023-10-14T19:04:22.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.789+0000 7fa5a359e700 1 -- 172.21.15.7:0/3484401643 wait complete. 2023-10-14T19:04:22.794 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:04:22.807 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:04:22.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.933+0000 7f188063b700 1 Processor -- start 2023-10-14T19:04:22.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.934+0000 7f188063b700 1 -- start start 2023-10-14T19:04:22.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.934+0000 7f188063b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1878067e50 0x7f187815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:22.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.934+0000 7f188063b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:22.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.934+0000 7f188063b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187815d9f0 con 0x7f1878068220 2023-10-14T19:04:22.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.934+0000 7f188063b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187815d3c0 con 0x7f1878067e50 2023-10-14T19:04:22.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.934+0000 7f188063b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187815a8f0 con 0x7f18780c8c70 2023-10-14T19:04:22.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187e3d7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1878067e50 0x7f187815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:22.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187dbd6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1878068220 0x7f1878159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58752/0 (socket says 172.21.15.7:58752) 2023-10-14T19:04:22.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187dbd6700 1 -- 172.21.15.7:0/3884691856 learned_addr learned my addr 172.21.15.7:0/3884691856 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:22.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187ebd8700 1 --2- 172.21.15.7:0/3884691856 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:22.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187e3d7700 1 -- 172.21.15.7:0/3884691856 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 msgr2=0x7f18780c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:22.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187e3d7700 1 --2- 172.21.15.7:0/3884691856 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187e3d7700 1 -- 172.21.15.7:0/3884691856 >> v1:172.21.15.7:6789/0 conn(0x7f1878068220 legacy=0x7f1878159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187e3d7700 1 -- 172.21.15.7:0/3884691856 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187815abd0 con 0x7f1878067e50 2023-10-14T19:04:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187d3d5700 1 -- 172.21.15.7:0/3884691856 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939620079 0 0) 0x7f187815d9f0 con 0x7f1878068220 2023-10-14T19:04:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187e3d7700 1 --2- 172.21.15.7:0/3884691856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878067e50 0x7f187815de80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f18700098e0 tx=0x7f18700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251d6e42c9ee9017 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:22.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187d3d5700 1 -- 172.21.15.7:0/3884691856 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870009e80 con 0x7f1878067e50 2023-10-14T19:04:22.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187d3d5700 1 -- 172.21.15.7:0/3884691856 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000b860 con 0x7f1878067e50 2023-10-14T19:04:22.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.935+0000 7f187d3d5700 1 -- 172.21.15.7:0/3884691856 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000bbe0 con 0x7f1878067e50 2023-10-14T19:04:22.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 -- 172.21.15.7:0/3884691856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878067e50 msgr2=0x7f187815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:22.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 --2- 172.21.15.7:0/3884691856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878067e50 0x7f187815de80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f18700098e0 tx=0x7f18700091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 -- 172.21.15.7:0/3884691856 shutdown_connections 2023-10-14T19:04:22.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 --2- 172.21.15.7:0/3884691856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878067e50 0x7f187815de80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 --2- 172.21.15.7:0/3884691856 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 -- 172.21.15.7:0/3884691856 >> 172.21.15.7:0/3884691856 conn(0x7f18780ce4a0 msgr2=0x7f18780ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:22.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 -- 172.21.15.7:0/3884691856 shutdown_connections 2023-10-14T19:04:22.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.936+0000 7f188063b700 1 -- 172.21.15.7:0/3884691856 wait complete. 2023-10-14T19:04:22.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.937+0000 7f188063b700 1 Processor -- start 2023-10-14T19:04:22.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.937+0000 7f188063b700 1 -- start start 2023-10-14T19:04:22.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f188063b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1878067e50 0x7f18780c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:22.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f188063b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 0x7f1878157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:22.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f188063b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:22.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f188063b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18780c7090 con 0x7f1878068220 2023-10-14T19:04:22.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f188063b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18780b31a0 con 0x7f1878067e50 2023-10-14T19:04:22.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f188063b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18780c6480 con 0x7f18780c8c70 2023-10-14T19:04:22.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 0x7f1878157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:22.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 0x7f1878157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59856/0 (socket says 172.21.15.7:59856) 2023-10-14T19:04:22.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 -- 172.21.15.7:0/316156397 learned_addr learned my addr 172.21.15.7:0/316156397 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:22.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187e3d7700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1878067e50 0x7f18780c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:22.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187ebd8700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:22.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 -- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 msgr2=0x7f18780b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:22.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 -- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1878067e50 msgr2=0x7f18780c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:22.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1878067e50 0x7f18780c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:22.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 -- 172.21.15.7:0/316156397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009420 con 0x7f1878068220 2023-10-14T19:04:22.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.938+0000 7f187dbd6700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 0x7f1878157be0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c7e0 tx=0x7f186c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:22.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.939+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c005b30 con 0x7f1878068220 2023-10-14T19:04:22.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.939+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c005c90 con 0x7f1878068220 2023-10-14T19:04:22.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.939+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18780c6760 con 0x7f1878068220 2023-10-14T19:04:22.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.939+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c007300 con 0x7f1878068220 2023-10-14T19:04:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.939+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18780c6d20 con 0x7f1878068220 2023-10-14T19:04:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.940+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18780c92e0 con 0x7f1878068220 2023-10-14T19:04:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.940+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f186c01b3b0 con 0x7f1878068220 2023-10-14T19:04:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.940+0000 7f18767fc700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1864066f30 0x7f18640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.940+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5439+0+0 (secure 0 0 0) 0x7f186c083940 con 0x7f1878068220 2023-10-14T19:04:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.941+0000 7f187e3d7700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1864066f30 0x7f18640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.941+0000 7f187e3d7700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1864066f30 0x7f18640693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18700091e0 tx=0x7f1870017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:22.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:22.944+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f186c050cc0 con 0x7f1878068220 2023-10-14T19:04:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.136+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f187804c3c0 con 0x7f1878068220 2023-10-14T19:04:23.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.790+0000 7f18767fc700 1 -- 172.21.15.7:0/316156397 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f186c017020 con 0x7f1878068220 2023-10-14T19:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1864066f30 msgr2=0x7f18640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1864066f30 0x7f18640693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18700091e0 tx=0x7f1870017000 comp rx=0 tx=0).stop 2023-10-14T19:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 msgr2=0x7f1878157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 0x7f1878157be0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c7e0 tx=0x7f186c007df0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 shutdown_connections 2023-10-14T19:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1864066f30 0x7f18640693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1878067e50 0x7f18780c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18780c8c70 0x7f18780b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 --2- 172.21.15.7:0/316156397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1878068220 0x7f1878157be0 secure :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c7e0 tx=0x7f186c007df0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 >> 172.21.15.7:0/316156397 conn(0x7f18780ce4a0 msgr2=0x7f1878069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:23.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 shutdown_connections 2023-10-14T19:04:23.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.794+0000 7f188063b700 1 -- 172.21.15.7:0/316156397 wait complete. 2023-10-14T19:04:23.798 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:04:23.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:04:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.933+0000 7fbd43aed700 1 Processor -- start 2023-10-14T19:04:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.933+0000 7fbd43aed700 1 -- start start 2023-10-14T19:04:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd43aed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd43aed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbd3c0ccfa0 0x7fbd3c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd43aed700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3c0cf510 con 0x7fbd3c159860 2023-10-14T19:04:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd43aed700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c0d00b0 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd43aed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0ce670 con 0x7fbd3c0ce220 2023-10-14T19:04:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbd3c0ccfa0 0x7fbd3c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbd3c0ccfa0 0x7fbd3c0cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59862/0 (socket says 172.21.15.7:59862) 2023-10-14T19:04:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 -- 172.21.15.7:0/3491170845 learned_addr learned my addr 172.21.15.7:0/3491170845 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 -- 172.21.15.7:0/3491170845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 msgr2=0x7fbd3c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd41088700 1 --2- 172.21.15.7:0/3491170845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 --2- 172.21.15.7:0/3491170845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c0cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 -- 172.21.15.7:0/3491170845 >> v1:172.21.15.148:6789/0 conn(0x7fbd3c159860 legacy=0x7fbd3c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 -- 172.21.15.7:0/3491170845 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0cd960 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd4208a700 1 --2- 172.21.15.7:0/3491170845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c0cd420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd340099b0 tx=0x7fbd34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826868039f6a2cd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.934+0000 7fbd40887700 1 -- 172.21.15.7:0/3491170845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400b820 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd40887700 1 -- 172.21.15.7:0/3491170845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3400b980 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd40887700 1 -- 172.21.15.7:0/3491170845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400bd20 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 -- 172.21.15.7:0/3491170845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 msgr2=0x7fbd3c0cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 --2- 172.21.15.7:0/3491170845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c0cd420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd340099b0 tx=0x7fbd34009250 comp rx=0 tx=0).stop 2023-10-14T19:04:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 -- 172.21.15.7:0/3491170845 shutdown_connections 2023-10-14T19:04:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 --2- 172.21.15.7:0/3491170845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c0cd420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 --2- 172.21.15.7:0/3491170845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c0cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 -- 172.21.15.7:0/3491170845 >> 172.21.15.7:0/3491170845 conn(0x7fbd3c0999b0 msgr2=0x7fbd3c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 -- 172.21.15.7:0/3491170845 shutdown_connections 2023-10-14T19:04:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.935+0000 7fbd43aed700 1 -- 172.21.15.7:0/3491170845 wait complete. 2023-10-14T19:04:23.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.936+0000 7fbd43aed700 1 Processor -- start 2023-10-14T19:04:23.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.936+0000 7fbd43aed700 1 -- start start 2023-10-14T19:04:23.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd43aed700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:23.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd43aed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:23.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd43aed700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd3c159860 0x7fbd3c09b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:23.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd43aed700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c15e380 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd43aed700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c15ef00 con 0x7fbd3c159860 2023-10-14T19:04:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd43aed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c1591c0 con 0x7fbd3c0ce220 2023-10-14T19:04:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59866/0 (socket says 172.21.15.7:59866) 2023-10-14T19:04:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 -- 172.21.15.7:0/181346954 learned_addr learned my addr 172.21.15.7:0/181346954 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41088700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:23.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd4208a700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd3c159860 0x7fbd3c09b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:23.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 -- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 msgr2=0x7fbd3c15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:23.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c15c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 -- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd3c159860 msgr2=0x7fbd3c09b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:23.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd3c159860 0x7fbd3c09b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:23.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 -- 172.21.15.7:0/181346954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340094f0 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd4208a700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd3c159860 0x7fbd3c09b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:23.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41088700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c15c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:23.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.937+0000 7fbd41889700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c158c80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00cd60 tx=0x7fbd2c002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:23.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.938+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00ab30 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.938+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00ac90 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.938+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c15e5d0 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.938+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c012670 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.938+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c15eb90 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.939+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c04c3c0 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.939+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd2c012a60 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.940+0000 7fbd39ffb700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd28066f30 0x7fbd280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:23.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.940+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbd2c084870 con 0x7fbd3c0ccfa0 2023-10-14T19:04:23.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.940+0000 7fbd41088700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd28066f30 0x7fbd280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:23.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.940+0000 7fbd41088700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd28066f30 0x7fbd280693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0d16a0 tx=0x7fbd30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:23.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:23.944+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd2c051d80 con 0x7fbd3c0ccfa0 2023-10-14T19:04:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.139+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbd3c06caa0 con 0x7fbd3c0ccfa0 2023-10-14T19:04:24.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.142+0000 7fbd39ffb700 1 -- 172.21.15.7:0/181346954 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd2c0553a0 con 0x7fbd3c0ccfa0 2023-10-14T19:04:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd28066f30 msgr2=0x7fbd280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd28066f30 0x7fbd280693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0d16a0 tx=0x7fbd30008040 comp rx=0 tx=0).stop 2023-10-14T19:04:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 msgr2=0x7fbd3c158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c158c80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00cd60 tx=0x7fbd2c002b90 comp rx=0 tx=0).stop 2023-10-14T19:04:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 shutdown_connections 2023-10-14T19:04:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd28066f30 0x7fbd280693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd3c159860 0x7fbd3c09b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c0ccfa0 0x7fbd3c158c80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 --2- 172.21.15.7:0/181346954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd3c0ce220 0x7fbd3c15c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 >> 172.21.15.7:0/181346954 conn(0x7fbd3c0999b0 msgr2=0x7fbd3c0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 shutdown_connections 2023-10-14T19:04:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.144+0000 7fbd43aed700 1 -- 172.21.15.7:0/181346954 wait complete. 2023-10-14T19:04:24.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-14T19:04:24.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.280+0000 7f63fb254700 1 Processor -- start 2023-10-14T19:04:24.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.280+0000 7f63fb254700 1 -- start start 2023-10-14T19:04:24.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63fb254700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f40a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63fb254700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63f406d280 0x7f63f40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63fb254700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f63f40ae780 0x7f63f40aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63fb254700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40af140 con 0x7f63f406d280 2023-10-14T19:04:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63fb254700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40ce1a0 con 0x7f63f40ae780 2023-10-14T19:04:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63fb254700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40cd5d0 con 0x7f63f40a8be0 2023-10-14T19:04:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63f406d280 0x7f63f40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63f406d280 0x7f63f40b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59870/0 (socket says 172.21.15.7:59870) 2023-10-14T19:04:24.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 -- 172.21.15.7:0/3657492181 learned_addr learned my addr 172.21.15.7:0/3657492181 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:24.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 -- 172.21.15.7:0/3657492181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 msgr2=0x7f63f40a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:24.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 --2- 172.21.15.7:0/3657492181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f40a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 -- 172.21.15.7:0/3657492181 >> v2:172.21.15.148:3300/0 conn(0x7f63f40ae780 msgr2=0x7f63f40aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f97f1700 1 --2- 172.21.15.7:0/3657492181 >> v2:172.21.15.148:3300/0 conn(0x7f63f40ae780 0x7f63f40aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 --2- 172.21.15.7:0/3657492181 >> v2:172.21.15.148:3300/0 conn(0x7f63f40ae780 0x7f63f40aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.281+0000 7f63f3fff700 1 -- 172.21.15.7:0/3657492181 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40cd870 con 0x7f63f406d280 2023-10-14T19:04:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63f3fff700 1 --2- 172.21.15.7:0/3657492181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f40b08c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63f4065140 tx=0x7f63e8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f7474540f699a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63f37fe700 1 -- 172.21.15.7:0/3657492181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8005c10 con 0x7f63f406d280 2023-10-14T19:04:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63f37fe700 1 -- 172.21.15.7:0/3657492181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8005d70 con 0x7f63f406d280 2023-10-14T19:04:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63f37fe700 1 -- 172.21.15.7:0/3657492181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e800b910 con 0x7f63f406d280 2023-10-14T19:04:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 -- 172.21.15.7:0/3657492181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 msgr2=0x7f63f40b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 --2- 172.21.15.7:0/3657492181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f40b08c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63f4065140 tx=0x7f63e8009220 comp rx=0 tx=0).stop 2023-10-14T19:04:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 -- 172.21.15.7:0/3657492181 shutdown_connections 2023-10-14T19:04:24.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 --2- 172.21.15.7:0/3657492181 >> v2:172.21.15.148:3300/0 conn(0x7f63f40ae780 0x7f63f40aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 --2- 172.21.15.7:0/3657492181 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f40a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 --2- 172.21.15.7:0/3657492181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f40b08c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 -- 172.21.15.7:0/3657492181 >> 172.21.15.7:0/3657492181 conn(0x7f63f406ce80 msgr2=0x7f63f40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:24.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 -- 172.21.15.7:0/3657492181 shutdown_connections 2023-10-14T19:04:24.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.282+0000 7f63fb254700 1 -- 172.21.15.7:0/3657492181 wait complete. 2023-10-14T19:04:24.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.283+0000 7f63fb254700 1 Processor -- start 2023-10-14T19:04:24.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 -- start start 2023-10-14T19:04:24.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f4068f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63f40ae780 0x7f63f4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4167d70 con 0x7f63f406d280 2023-10-14T19:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4159800 con 0x7f63f40ae780 2023-10-14T19:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63fb254700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4158bf0 con 0x7f63f40a8be0 2023-10-14T19:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.284+0000 7f63f8ff0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f4151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59872/0 (socket says 172.21.15.7:59872) 2023-10-14T19:04:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 -- 172.21.15.7:0/680081997 learned_addr learned my addr 172.21.15.7:0/680081997 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f3fff700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f4068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f97f1700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63f40ae780 0x7f63f4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 -- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 msgr2=0x7f63f4068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f4068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 -- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63f40ae780 msgr2=0x7f63f4069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63f40ae780 0x7f63f4069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 -- 172.21.15.7:0/680081997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8009480 con 0x7f63f406d280 2023-10-14T19:04:24.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f8ff0700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f4151cc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b810 tx=0x7f63e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400f510 con 0x7f63f406d280 2023-10-14T19:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400f690 con 0x7f63f406d280 2023-10-14T19:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f4158ed0 con 0x7f63f406d280 2023-10-14T19:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400fa50 con 0x7f63f406d280 2023-10-14T19:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.285+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f4159490 con 0x7f63f406d280 2023-10-14T19:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.286+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f404c3c0 con 0x7f63f406d280 2023-10-14T19:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.287+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63e401a400 con 0x7f63f406d280 2023-10-14T19:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.287+0000 7f63f0ff9700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63e0066f30 0x7f63e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.287+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f63e4083d80 con 0x7f63f406d280 2023-10-14T19:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.287+0000 7f63f3fff700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63e0066f30 0x7f63e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.288+0000 7f63f3fff700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63e0066f30 0x7f63e00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009260 tx=0x7f63e8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.291+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63e4051310 con 0x7f63f406d280 2023-10-14T19:04:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.562+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f63f40a8fb0 con 0x7f63f406d280 2023-10-14T19:04:24.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.792+0000 7f63f0ff9700 1 -- 172.21.15.7:0/680081997 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v87) v1 ==== 135+0+0 (secure 0 0 0) 0x7f63e4054930 con 0x7f63f406d280 2023-10-14T19:04:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63e0066f30 msgr2=0x7f63e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63e0066f30 0x7f63e00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009260 tx=0x7f63e8016000 comp rx=0 tx=0).stop 2023-10-14T19:04:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 msgr2=0x7f63f4151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f4151cc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b810 tx=0x7f63e4009250 comp rx=0 tx=0).stop 2023-10-14T19:04:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 shutdown_connections 2023-10-14T19:04:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63e0066f30 0x7f63e00693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63f40ae780 0x7f63f4069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f406d280 0x7f63f4151cc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 --2- 172.21.15.7:0/680081997 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63f40a8be0 0x7f63f4068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 >> 172.21.15.7:0/680081997 conn(0x7f63f406ce80 msgr2=0x7f63f40b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 shutdown_connections 2023-10-14T19:04:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.794+0000 7f63fb254700 1 -- 172.21.15.7:0/680081997 wait complete. 2023-10-14T19:04:24.809 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-10-14T19:04:24.810 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-10-14T19:04:24.810 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:04:24.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-14T19:04:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.929+0000 7f54ff3cb700 1 Processor -- start 2023-10-14T19:04:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.929+0000 7f54ff3cb700 1 -- start start 2023-10-14T19:04:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54ff3cb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54f80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54ff3cb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54f80cef40 0x7f54f815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54ff3cb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f815afd0 con 0x7f54f8153c30 2023-10-14T19:04:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54ff3cb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f815b2b0 con 0x7f54f80cef40 2023-10-14T19:04:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54ff3cb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815b590 con 0x7f54f815de50 2023-10-14T19:04:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54fe3c9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f54f8153c30 0x7f54f815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58766/0 (socket says 172.21.15.7:58766) 2023-10-14T19:04:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54fe3c9700 1 -- 172.21.15.7:0/1034251067 learned_addr learned my addr 172.21.15.7:0/1034251067 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54febca700 1 --2- 172.21.15.7:0/1034251067 >> v2:172.21.15.148:3300/0 conn(0x7f54f80cef40 0x7f54f815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.930+0000 7f54fdbc8700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54f80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534751619 0 0) 0x7f54f815afd0 con 0x7f54f8153c30 2023-10-14T19:04:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e0003570 con 0x7f54f8153c30 2023-10-14T19:04:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3089143576 0 0) 0x7f54e0003570 con 0x7f54f8153c30 2023-10-14T19:04:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 msgr2=0x7f54f80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54f80cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 >> v2:172.21.15.148:3300/0 conn(0x7f54f80cef40 msgr2=0x7f54f815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 --2- 172.21.15.7:0/1034251067 >> v2:172.21.15.148:3300/0 conn(0x7f54f80cef40 0x7f54f815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f815b870 con 0x7f54f8153c30 2023-10-14T19:04:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f54f00017f0 con 0x7f54f8153c30 2023-10-14T19:04:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fdbc8700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54f80cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 >> v1:172.21.15.7:6789/0 conn(0x7f54f8153c30 legacy=0x7f54f815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54e0003a60 0x7f54e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54e0004d50 0x7f54e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815b2b0 con 0x7f54e0004d50 2023-10-14T19:04:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815b590 con 0x7f54e0003a60 2023-10-14T19:04:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e000ba60 con 0x7f54f815de50 2023-10-14T19:04:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54febca700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54e0004d50 0x7f54e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fdbc8700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54fe3c9700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54e0003a60 0x7f54e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54febca700 1 -- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 msgr2=0x7f54e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54febca700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54f815de50 0x7f54e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54febca700 1 -- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54e0003a60 msgr2=0x7f54e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54febca700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54e0003a60 0x7f54e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.931+0000 7f54febca700 1 -- 172.21.15.7:0/1034251067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec009420 con 0x7f54e0004d50 2023-10-14T19:04:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54febca700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54e0004d50 0x7f54e00051c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009c30 tx=0x7f54e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cb1898e44c74cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800e6b0 con 0x7f54e0004d50 2023-10-14T19:04:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e800e810 con 0x7f54e0004d50 2023-10-14T19:04:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54fd3c7700 1 -- 172.21.15.7:0/1034251067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800ebd0 con 0x7f54e0004d50 2023-10-14T19:04:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1034251067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54e0004d50 msgr2=0x7f54e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1034251067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54e0004d50 0x7f54e00051c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009c30 tx=0x7f54e80091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54febca700 1 -- 172.21.15.7:0/1034251067 reap_dead start 2023-10-14T19:04:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1034251067 shutdown_connections 2023-10-14T19:04:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1034251067 >> 172.21.15.7:0/1034251067 conn(0x7f54f80703a0 msgr2=0x7f54f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1034251067 shutdown_connections 2023-10-14T19:04:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.932+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1034251067 wait complete. 2023-10-14T19:04:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.933+0000 7f54ff3cb700 1 Processor -- start 2023-10-14T19:04:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 -- start start 2023-10-14T19:04:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54e0004d50 0x7f54f80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 0x7f54f81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54f8151bf0 0x7f54f80b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8152020 con 0x7f54f814c220 2023-10-14T19:04:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80c75e0 con 0x7f54f8151bf0 2023-10-14T19:04:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54ff3cb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80b04c0 con 0x7f54e0004d50 2023-10-14T19:04:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54fdbc8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 0x7f54f81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54fdbc8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 0x7f54f81516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59882/0 (socket says 172.21.15.7:59882) 2023-10-14T19:04:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54fdbc8700 1 -- 172.21.15.7:0/1907443751 learned_addr learned my addr 172.21.15.7:0/1907443751 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54fe3c9700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54e0004d50 0x7f54f80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.934+0000 7f54febca700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54f8151bf0 0x7f54f80b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54fdbc8700 1 -- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54e0004d50 msgr2=0x7f54f80b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54fdbc8700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54e0004d50 0x7f54f80b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54fdbc8700 1 -- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54f8151bf0 msgr2=0x7f54f80b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54fdbc8700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54f8151bf0 0x7f54f80b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54fdbc8700 1 -- 172.21.15.7:0/1907443751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80c7830 con 0x7f54f814c220 2023-10-14T19:04:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54fdbc8700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 0x7f54f81516b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f54ec011dd0 tx=0x7f54ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec011ed0 con 0x7f54f814c220 2023-10-14T19:04:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec00fcd0 con 0x7f54f814c220 2023-10-14T19:04:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f80c7b10 con 0x7f54f814c220 2023-10-14T19:04:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec01d6b0 con 0x7f54f814c220 2023-10-14T19:04:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.935+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f80c80d0 con 0x7f54f814c220 2023-10-14T19:04:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.936+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f80b0650 con 0x7f54f814c220 2023-10-14T19:04:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.936+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54ec01daa0 con 0x7f54f814c220 2023-10-14T19:04:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.937+0000 7f54f67fc700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f54e4066f30 0x7f54e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.937+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f54ec018070 con 0x7f54f814c220 2023-10-14T19:04:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.937+0000 7f54fe3c9700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f54e4066f30 0x7f54e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.938+0000 7f54fe3c9700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f54e4066f30 0x7f54e40693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54f0001920 tx=0x7f54f0002210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:24.941+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54ec052620 con 0x7f54f814c220 2023-10-14T19:04:25.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.213+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f54f804c3c0 con 0x7f54f814c220 2023-10-14T19:04:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.795+0000 7f54f67fc700 1 -- 172.21.15.7:0/1907443751 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v88) v1 ==== 136+0+0 (secure 0 0 0) 0x7f54ec0220c0 con 0x7f54f814c220 2023-10-14T19:04:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f54e4066f30 msgr2=0x7f54e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f54e4066f30 0x7f54e40693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54f0001920 tx=0x7f54f0002210 comp rx=0 tx=0).stop 2023-10-14T19:04:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 msgr2=0x7f54f81516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 0x7f54f81516b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f54ec011dd0 tx=0x7f54ec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 shutdown_connections 2023-10-14T19:04:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f54e4066f30 0x7f54e40693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54f8151bf0 0x7f54f80b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54e0004d50 0x7f54f80b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 --2- 172.21.15.7:0/1907443751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f814c220 0x7f54f81516b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 >> 172.21.15.7:0/1907443751 conn(0x7f54f80703a0 msgr2=0x7f54f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 shutdown_connections 2023-10-14T19:04:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.798+0000 7f54ff3cb700 1 -- 172.21.15.7:0/1907443751 wait complete. 2023-10-14T19:04:25.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:04:25.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.945+0000 7f55ea826700 1 Processor -- start 2023-10-14T19:04:25.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.945+0000 7f55ea826700 1 -- start start 2023-10-14T19:04:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55ea826700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f55e40cf110 0x7f55e415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:25.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55ea826700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e415ac50 con 0x7f55e4153dd0 2023-10-14T19:04:25.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55ea826700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e415d010 con 0x7f55e4153a00 2023-10-14T19:04:25.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55ea826700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e415af60 con 0x7f55e40cf110 2023-10-14T19:04:25.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55e9023700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f55e4153dd0 0x7f55e40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58774/0 (socket says 172.21.15.7:58774) 2023-10-14T19:04:25.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55e9023700 1 -- 172.21.15.7:0/716120684 learned_addr learned my addr 172.21.15.7:0/716120684 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:25.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.946+0000 7f55ea025700 1 --2- 172.21.15.7:0/716120684 >> v2:172.21.15.148:3300/0 conn(0x7f55e40cf110 0x7f55e415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:25.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55e8822700 1 -- 172.21.15.7:0/716120684 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182644573 0 0) 0x7f55e415ac50 con 0x7f55e4153dd0 2023-10-14T19:04:25.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55e8822700 1 -- 172.21.15.7:0/716120684 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc003570 con 0x7f55e4153dd0 2023-10-14T19:04:25.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55e8822700 1 -- 172.21.15.7:0/716120684 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762903671 0 0) 0x7f55cc003570 con 0x7f55e4153dd0 2023-10-14T19:04:25.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55ea025700 1 -- 172.21.15.7:0/716120684 >> v1:172.21.15.148:6789/0 conn(0x7f55e4153a00 legacy=0x7f55e415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55ea025700 1 -- 172.21.15.7:0/716120684 >> v1:172.21.15.7:6789/0 conn(0x7f55e4153dd0 legacy=0x7f55e40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55ea025700 1 -- 172.21.15.7:0/716120684 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e415b240 con 0x7f55e40cf110 2023-10-14T19:04:25.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55ea025700 1 --2- 172.21.15.7:0/716120684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e415de50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0098e0 tx=0x7f55dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f157c759ae7d4a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:25.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55e8822700 1 -- 172.21.15.7:0/716120684 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8001470 con 0x7f55e40cf110 2023-10-14T19:04:25.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55e8822700 1 -- 172.21.15.7:0/716120684 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc011420 con 0x7f55e40cf110 2023-10-14T19:04:25.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.947+0000 7f55e8822700 1 -- 172.21.15.7:0/716120684 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0117c0 con 0x7f55e40cf110 2023-10-14T19:04:25.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 -- 172.21.15.7:0/716120684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 msgr2=0x7f55e415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 --2- 172.21.15.7:0/716120684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e415de50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0098e0 tx=0x7f55dc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 -- 172.21.15.7:0/716120684 shutdown_connections 2023-10-14T19:04:25.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 --2- 172.21.15.7:0/716120684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e415de50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 -- 172.21.15.7:0/716120684 >> 172.21.15.7:0/716120684 conn(0x7f55e40703a0 msgr2=0x7f55e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:25.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 -- 172.21.15.7:0/716120684 shutdown_connections 2023-10-14T19:04:25.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.948+0000 7f55ea826700 1 -- 172.21.15.7:0/716120684 wait complete. 2023-10-14T19:04:25.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.949+0000 7f55ea826700 1 Processor -- start 2023-10-14T19:04:25.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.949+0000 7f55ea826700 1 -- start start 2023-10-14T19:04:25.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e416a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:25.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 0x7f55e4153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:25.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55e4153dd0 0x7f55e4158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:25.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40c8f60 con 0x7f55e4153a00 2023-10-14T19:04:25.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40cc9c0 con 0x7f55e40cf110 2023-10-14T19:04:25.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40c8c80 con 0x7f55e4153dd0 2023-10-14T19:04:25.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 0x7f55e4153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:25.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 0x7f55e4153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59892/0 (socket says 172.21.15.7:59892) 2023-10-14T19:04:25.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 -- 172.21.15.7:0/733319259 learned_addr learned my addr 172.21.15.7:0/733319259 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:25.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9824700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e416a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:25.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 -- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55e4153dd0 msgr2=0x7f55e4158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55e4153dd0 0x7f55e4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 -- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 msgr2=0x7f55e416a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:25.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e416a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:25.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 -- 172.21.15.7:0/733319259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc009420 con 0x7f55e4153a00 2023-10-14T19:04:25.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e9023700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 0x7f55e4153180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f55d800cbc0 tx=0x7f55d8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:25.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8007360 con 0x7f55e4153a00 2023-10-14T19:04:25.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d80074e0 con 0x7f55e4153a00 2023-10-14T19:04:25.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e40cc370 con 0x7f55e4153a00 2023-10-14T19:04:25.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.950+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8004830 con 0x7f55e4153a00 2023-10-14T19:04:25.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.951+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e4158a60 con 0x7f55e4153a00 2023-10-14T19:04:25.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.952+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e404c3c0 con 0x7f55e4153a00 2023-10-14T19:04:25.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.952+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55d8004be0 con 0x7f55e4153a00 2023-10-14T19:04:25.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.952+0000 7f55e1ffb700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f55d0066f30 0x7f55d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:25.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.952+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f55d8083990 con 0x7f55e4153a00 2023-10-14T19:04:25.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.953+0000 7f55e9824700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f55d0066f30 0x7f55d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:25.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.953+0000 7f55e9824700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f55d0066f30 0x7f55d00693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:25.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:25.957+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55d8050f20 con 0x7f55e4153a00 2023-10-14T19:04:26.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.151+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f55e40ccb00 con 0x7f55e4153a00 2023-10-14T19:04:26.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.155+0000 7f55e1ffb700 1 -- 172.21.15.7:0/733319259 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55d80180c0 con 0x7f55e4153a00 2023-10-14T19:04:26.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f55d0066f30 msgr2=0x7f55d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f55d0066f30 0x7f55d00693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).stop 2023-10-14T19:04:26.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 msgr2=0x7f55e4153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 0x7f55e4153180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f55d800cbc0 tx=0x7f55d8001a30 comp rx=0 tx=0).stop 2023-10-14T19:04:26.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 shutdown_connections 2023-10-14T19:04:26.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f55d0066f30 0x7f55d00693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e40cf110 0x7f55e416a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55e4153dd0 0x7f55e4158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 --2- 172.21.15.7:0/733319259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4153a00 0x7f55e4153180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 >> 172.21.15.7:0/733319259 conn(0x7f55e40703a0 msgr2=0x7f55e40ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 shutdown_connections 2023-10-14T19:04:26.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.157+0000 7f55ea826700 1 -- 172.21.15.7:0/733319259 wait complete. 2023-10-14T19:04:26.170 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:04:26.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:26.215 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:26.256 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:04:26.257 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:04:26.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.375+0000 7f773b790700 1 Processor -- start 2023-10-14T19:04:26.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773b790700 1 -- start start 2023-10-14T19:04:26.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773b790700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 0x7f773406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773b790700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f773406e380 0x7f77340af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773b790700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773406e7f0 con 0x7f77340a8d00 2023-10-14T19:04:26.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773b790700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77340ae680 con 0x7f773406e380 2023-10-14T19:04:26.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773b790700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77340aeee0 con 0x7f77340a90d0 2023-10-14T19:04:26.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773952c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f77340a8d00 0x7f77340cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58780/0 (socket says 172.21.15.7:58780) 2023-10-14T19:04:26.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.376+0000 7f773952c700 1 -- 172.21.15.7:0/3638081221 learned_addr learned my addr 172.21.15.7:0/3638081221 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:26.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677589147 0 0) 0x7f773406e7f0 con 0x7f77340a8d00 2023-10-14T19:04:26.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f771c003570 con 0x7f77340a8d00 2023-10-14T19:04:26.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7738d2b700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 0x7f773406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7739d2d700 1 --2- 172.21.15.7:0/3638081221 >> v2:172.21.15.148:3300/0 conn(0x7f773406e380 0x7f77340af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 793842560 0 0) 0x7f771c003570 con 0x7f77340a8d00 2023-10-14T19:04:26.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 msgr2=0x7f773406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:26.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 0x7f773406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 >> v2:172.21.15.148:3300/0 conn(0x7f773406e380 msgr2=0x7f77340af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 --2- 172.21.15.7:0/3638081221 >> v2:172.21.15.148:3300/0 conn(0x7f773406e380 0x7f77340af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77340cf490 con 0x7f77340a8d00 2023-10-14T19:04:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f772c0015f0 con 0x7f77340a8d00 2023-10-14T19:04:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 >> v1:172.21.15.7:6789/0 conn(0x7f77340a8d00 legacy=0x7f77340cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 0x7f771c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f771c003fe0 0x7f771c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771c004d50 0x7f771c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340ae680 con 0x7f771c004d50 2023-10-14T19:04:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340aeee0 con 0x7f771c003fe0 2023-10-14T19:04:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c00ba90 con 0x7f77340a90d0 2023-10-14T19:04:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7739d2d700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771c004d50 0x7f771c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f773952c700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 0x7f771c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.377+0000 7f7738d2b700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f771c003fe0 0x7f771c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 -- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 msgr2=0x7f771c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:26.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77340a90d0 0x7f771c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 -- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f771c003fe0 msgr2=0x7f771c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:26.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f771c003fe0 0x7f771c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 -- 172.21.15.7:0/3638081221 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c003570 con 0x7f771c004d50 2023-10-14T19:04:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771c004d50 0x7f771c0051c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f772400e210 tx=0x7f772400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e885bbc9a9548f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ea60 con 0x7f771c004d50 2023-10-14T19:04:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400f040 con 0x7f771c004d50 2023-10-14T19:04:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7733fff700 1 -- 172.21.15.7:0/3638081221 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ee10 con 0x7f771c004d50 2023-10-14T19:04:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f773b790700 1 -- 172.21.15.7:0/3638081221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771c004d50 msgr2=0x7f771c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f773b790700 1 --2- 172.21.15.7:0/3638081221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771c004d50 0x7f771c0051c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f772400e210 tx=0x7f772400b040 comp rx=0 tx=0).stop 2023-10-14T19:04:26.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f7739d2d700 1 -- 172.21.15.7:0/3638081221 reap_dead start 2023-10-14T19:04:26.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f773b790700 1 -- 172.21.15.7:0/3638081221 shutdown_connections 2023-10-14T19:04:26.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.378+0000 7f773b790700 1 -- 172.21.15.7:0/3638081221 >> 172.21.15.7:0/3638081221 conn(0x7f773406ce80 msgr2=0x7f77340ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:26.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.379+0000 7f773b790700 1 -- 172.21.15.7:0/3638081221 shutdown_connections 2023-10-14T19:04:26.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.379+0000 7f773b790700 1 -- 172.21.15.7:0/3638081221 wait complete. 2023-10-14T19:04:26.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 Processor -- start 2023-10-14T19:04:26.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 -- start start 2023-10-14T19:04:26.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 0x7f773409a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f773409adc0 0x7f77340b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77340b2d50 0x7f77340980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773409a450 con 0x7f773414b990 2023-10-14T19:04:26.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773415c870 con 0x7f77340b2d50 2023-10-14T19:04:26.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.380+0000 7f773b790700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773409b230 con 0x7f773409adc0 2023-10-14T19:04:26.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 0x7f773409a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 0x7f773409a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59906/0 (socket says 172.21.15.7:59906) 2023-10-14T19:04:26.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 -- 172.21.15.7:0/1785256965 learned_addr learned my addr 172.21.15.7:0/1785256965 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:26.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f7739d2d700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77340b2d50 0x7f77340980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f7738d2b700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f773409adc0 0x7f77340b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 -- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f773409adc0 msgr2=0x7f77340b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f773409adc0 0x7f77340b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 -- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77340b2d50 msgr2=0x7f77340980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77340b2d50 0x7f77340980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 -- 172.21.15.7:0/1785256965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77340b31c0 con 0x7f773414b990 2023-10-14T19:04:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f7739d2d700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77340b2d50 0x7f77340980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773952c700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 0x7f773409a880 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f772c00fc30 tx=0x7f772c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0072e0 con 0x7f773414b990 2023-10-14T19:04:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c007480 con 0x7f773414b990 2023-10-14T19:04:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773415ca00 con 0x7f773414b990 2023-10-14T19:04:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0057f0 con 0x7f773414b990 2023-10-14T19:04:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.381+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773409b740 con 0x7f773414b990 2023-10-14T19:04:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.382+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773404c3c0 con 0x7f773414b990 2023-10-14T19:04:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.383+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f772c005bc0 con 0x7f773414b990 2023-10-14T19:04:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.383+0000 7f77317fa700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7720066f30 0x7f77200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.383+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f772c0845b0 con 0x7f773414b990 2023-10-14T19:04:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.383+0000 7f7738d2b700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7720066f30 0x7f77200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.384+0000 7f7738d2b700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7720066f30 0x7f77200693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77340b3640 tx=0x7f7728008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.387+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f772c051ac0 con 0x7f773414b990 2023-10-14T19:04:26.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.622+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7734067b20 con 0x7f773414b990 2023-10-14T19:04:26.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.622+0000 7f77317fa700 1 -- 172.21.15.7:0/1785256965 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f772c0550e0 con 0x7f773414b990 2023-10-14T19:04:26.624 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:26.624 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/16258788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":16258788},{"type":"v1","addr":"172.21.15.148:6837","nonce":16258788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4863,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2979300899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2979300899},{"type":"v1","addr":"172.21.15.7:6834","nonce":2979300899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/258625948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":258625948},{"type":"v1","addr":"172.21.15.148:6836","nonce":258625948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1353990012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1353990012},{"type":"v1","addr":"172.21.15.7:6835","nonce":1353990012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2023-10-14T19:04:26.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7720066f30 msgr2=0x7f77200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7720066f30 0x7f77200693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77340b3640 tx=0x7f7728008040 comp rx=0 tx=0).stop 2023-10-14T19:04:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 msgr2=0x7f773409a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 0x7f773409a880 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f772c00fc30 tx=0x7f772c009040 comp rx=0 tx=0).stop 2023-10-14T19:04:26.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 shutdown_connections 2023-10-14T19:04:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7720066f30 0x7f77200693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77340b2d50 0x7f77340980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f773414b990 0x7f773409a880 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 --2- 172.21.15.7:0/1785256965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f773409adc0 0x7f77340b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 >> 172.21.15.7:0/1785256965 conn(0x7f773406ce80 msgr2=0x7f77340cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:26.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 shutdown_connections 2023-10-14T19:04:26.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.624+0000 7f773b790700 1 -- 172.21.15.7:0/1785256965 wait complete. 2023-10-14T19:04:26.628 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2023-10-14T19:04:26.637 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:04:26.638 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:04:26.638 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:04:26.639 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:26.639 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:04:26.639 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:04:26.640 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:04:26.640 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:26.641 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:04:26.641 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:04:26.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:04:26.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:26.642 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:04:26.642 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:04:26.642 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:04:26.643 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:26.650 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:04:26.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:04:26.652 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:04:26.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:04:26.653 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:04:26.654 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:04:26.654 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:04:26.655 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:04:26.693 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:04:26.694 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:26.695 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:04:26.695 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:26.696 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:04:26.697 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:26.698 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:04:26.698 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:26.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:04:26.768 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:04:26.769 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:04:26.778 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:04:26.778 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:04:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.825+0000 7fe82cbcd700 1 Processor -- start 2023-10-14T19:04:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.825+0000 7fe82cbcd700 1 -- start start 2023-10-14T19:04:26.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe82cbcd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe828153c30 0x7fe82815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe82cbcd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82815de50 0x7fe8280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe82cbcd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8280cef40 0x7fe82806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe82cbcd700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82815afd0 con 0x7fe8280cef40 2023-10-14T19:04:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe82cbcd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82815b2b0 con 0x7fe828153c30 2023-10-14T19:04:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe82cbcd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82815b590 con 0x7fe82815de50 2023-10-14T19:04:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8280cef40 0x7fe82806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8280cef40 0x7fe82806d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59682/0 (socket says 172.21.15.7:59682) 2023-10-14T19:04:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 -- 172.21.15.7:0/2368670375 learned_addr learned my addr 172.21.15.7:0/2368670375 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe826ffd700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82815de50 0x7fe8280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe8277fe700 1 --2- 172.21.15.7:0/2368670375 >> v2:172.21.15.148:3300/0 conn(0x7fe828153c30 0x7fe82815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 -- 172.21.15.7:0/2368670375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82815de50 msgr2=0x7fe8280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82815de50 0x7fe8280cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 -- 172.21.15.7:0/2368670375 >> v2:172.21.15.148:3300/0 conn(0x7fe828153c30 msgr2=0x7fe82815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 --2- 172.21.15.7:0/2368670375 >> v2:172.21.15.148:3300/0 conn(0x7fe828153c30 0x7fe82815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe827fff700 1 -- 172.21.15.7:0/2368670375 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82815b870 con 0x7fe8280cef40 2023-10-14T19:04:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe826ffd700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82815de50 0x7fe8280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.826+0000 7fe8277fe700 1 --2- 172.21.15.7:0/2368670375 >> v2:172.21.15.148:3300/0 conn(0x7fe828153c30 0x7fe82815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe827fff700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8280cef40 0x7fe82806d790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe82806ead0 tx=0x7fe820009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b629407fc7465c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe8267fc700 1 -- 172.21.15.7:0/2368670375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000e070 con 0x7fe8280cef40 2023-10-14T19:04:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe8267fc700 1 -- 172.21.15.7:0/2368670375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82000ba50 con 0x7fe8280cef40 2023-10-14T19:04:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe8267fc700 1 -- 172.21.15.7:0/2368670375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200092e0 con 0x7fe8280cef40 2023-10-14T19:04:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 -- 172.21.15.7:0/2368670375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8280cef40 msgr2=0x7fe82806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8280cef40 0x7fe82806d790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe82806ead0 tx=0x7fe820009840 comp rx=0 tx=0).stop 2023-10-14T19:04:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 -- 172.21.15.7:0/2368670375 shutdown_connections 2023-10-14T19:04:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8280cef40 0x7fe82806d790 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/2368670375 >> v2:172.21.15.148:3300/0 conn(0x7fe828153c30 0x7fe82815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/2368670375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82815de50 0x7fe8280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 -- 172.21.15.7:0/2368670375 >> 172.21.15.7:0/2368670375 conn(0x7fe8280703a0 msgr2=0x7fe8280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 -- 172.21.15.7:0/2368670375 shutdown_connections 2023-10-14T19:04:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.827+0000 7fe82cbcd700 1 -- 172.21.15.7:0/2368670375 wait complete. 2023-10-14T19:04:26.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 Processor -- start 2023-10-14T19:04:26.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 -- start start 2023-10-14T19:04:26.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8280cef40 0x7fe8280c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe828153c30 0x7fe82814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 0x7fe828070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280cc5a0 con 0x7fe82815de50 2023-10-14T19:04:26.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280cca30 con 0x7fe828153c30 2023-10-14T19:04:26.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe82cbcd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280cb6b0 con 0x7fe8280cef40 2023-10-14T19:04:26.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.829+0000 7fe827fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 0x7fe828070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 0x7fe828070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59688/0 (socket says 172.21.15.7:59688) 2023-10-14T19:04:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 -- 172.21.15.7:0/3455063276 learned_addr learned my addr 172.21.15.7:0/3455063276 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe8277fe700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8280cef40 0x7fe8280c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe826ffd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe828153c30 0x7fe82814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 -- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8280cef40 msgr2=0x7fe8280c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8280cef40 0x7fe8280c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 -- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe828153c30 msgr2=0x7fe82814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe828153c30 0x7fe82814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 -- 172.21.15.7:0/3455063276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009ae0 con 0x7fe82815de50 2023-10-14T19:04:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe827fff700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 0x7fe828070770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe82806eb00 tx=0x7fe820018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200032f0 con 0x7fe82815de50 2023-10-14T19:04:26.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820008e80 con 0x7fe82815de50 2023-10-14T19:04:26.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8280cb990 con 0x7fe82815de50 2023-10-14T19:04:26.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820026690 con 0x7fe82815de50 2023-10-14T19:04:26.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.830+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280cbf50 con 0x7fe82815de50 2023-10-14T19:04:26.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.831+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82804c3c0 con 0x7fe82815de50 2023-10-14T19:04:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.832+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe820003040 con 0x7fe82815de50 2023-10-14T19:04:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.832+0000 7fe80f7fe700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe814066f30 0x7fe8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.832+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe820086330 con 0x7fe82815de50 2023-10-14T19:04:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.832+0000 7fe8277fe700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe814066f30 0x7fe8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.833+0000 7fe8277fe700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe814066f30 0x7fe8140693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe81800ab30 tx=0x7fe818008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:26.836+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe820053840 con 0x7fe82815de50 2023-10-14T19:04:27.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.047+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe82815bb50 con 0x7fe82815de50 2023-10-14T19:04:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.806+0000 7fe80f7fe700 1 -- 172.21.15.7:0/3455063276 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe820056e60 con 0x7fe82815de50 2023-10-14T19:04:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe814066f30 msgr2=0x7fe8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe814066f30 0x7fe8140693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe81800ab30 tx=0x7fe818008040 comp rx=0 tx=0).stop 2023-10-14T19:04:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 msgr2=0x7fe828070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 0x7fe828070770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe82806eb00 tx=0x7fe820018000 comp rx=0 tx=0).stop 2023-10-14T19:04:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 shutdown_connections 2023-10-14T19:04:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe814066f30 0x7fe8140693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815de50 0x7fe828070770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8280cef40 0x7fe8280c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 --2- 172.21.15.7:0/3455063276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe828153c30 0x7fe82814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 >> 172.21.15.7:0/3455063276 conn(0x7fe8280703a0 msgr2=0x7fe828151080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:27.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 shutdown_connections 2023-10-14T19:04:27.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.809+0000 7fe82cbcd700 1 -- 172.21.15.7:0/3455063276 wait complete. 2023-10-14T19:04:27.813 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:04:27.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:04:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.950+0000 7f3eb94c4700 1 Processor -- start 2023-10-14T19:04:27.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.950+0000 7f3eb94c4700 1 -- start start 2023-10-14T19:04:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb94c4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb41598b0 0x7f3eb40af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb94c4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3eb40af790 0x7f3eb4163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb94c4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb40ce9d0 con 0x7f3eb4159c80 2023-10-14T19:04:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb94c4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40afc30 con 0x7f3eb40af790 2023-10-14T19:04:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb94c4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40aff10 con 0x7f3eb41598b0 2023-10-14T19:04:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3eb40af790 0x7f3eb4163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb27fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3eb4159c80 0x7f3eb40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37720/0 (socket says 172.21.15.7:37720) 2023-10-14T19:04:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.951+0000 7f3eb27fc700 1 -- 172.21.15.7:0/3553011070 learned_addr learned my addr 172.21.15.7:0/3553011070 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb2ffd700 1 --2- 172.21.15.7:0/3553011070 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb41598b0 0x7f3eb40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb37fe700 1 -- 172.21.15.7:0/3553011070 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb41598b0 msgr2=0x7f3eb40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb37fe700 1 --2- 172.21.15.7:0/3553011070 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb41598b0 0x7f3eb40af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb37fe700 1 -- 172.21.15.7:0/3553011070 >> v1:172.21.15.7:6789/0 conn(0x7f3eb4159c80 legacy=0x7f3eb40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb37fe700 1 -- 172.21.15.7:0/3553011070 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40ce380 con 0x7f3eb40af790 2023-10-14T19:04:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb37fe700 1 --2- 172.21.15.7:0/3553011070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb40af790 0x7f3eb4163590 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009e60 tx=0x7f3ea4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d94b90ec7dc340 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb1ffb700 1 -- 172.21.15.7:0/3553011070 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400e070 con 0x7f3eb40af790 2023-10-14T19:04:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb1ffb700 1 -- 172.21.15.7:0/3553011070 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400bc30 con 0x7f3eb40af790 2023-10-14T19:04:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb1ffb700 1 -- 172.21.15.7:0/3553011070 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4012430 con 0x7f3eb40af790 2023-10-14T19:04:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb94c4700 1 -- 172.21.15.7:0/3553011070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb40af790 msgr2=0x7f3eb4163590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/3553011070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb40af790 0x7f3eb4163590 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009e60 tx=0x7f3ea4009780 comp rx=0 tx=0).stop 2023-10-14T19:04:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb94c4700 1 -- 172.21.15.7:0/3553011070 shutdown_connections 2023-10-14T19:04:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/3553011070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb40af790 0x7f3eb4163590 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/3553011070 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb41598b0 0x7f3eb40af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.952+0000 7f3eb94c4700 1 -- 172.21.15.7:0/3553011070 >> 172.21.15.7:0/3553011070 conn(0x7f3eb4070e30 msgr2=0x7f3eb40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.953+0000 7f3eb94c4700 1 -- 172.21.15.7:0/3553011070 shutdown_connections 2023-10-14T19:04:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.953+0000 7f3eb94c4700 1 -- 172.21.15.7:0/3553011070 wait complete. 2023-10-14T19:04:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 Processor -- start 2023-10-14T19:04:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 -- start start 2023-10-14T19:04:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb40af790 0x7f3eb40c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb41598b0 0x7f3eb416d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 0x7f3eb416de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40c9ff0 con 0x7f3eb4159c80 2023-10-14T19:04:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ca2d0 con 0x7f3eb41598b0 2023-10-14T19:04:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.954+0000 7f3eb94c4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ca5b0 con 0x7f3eb40af790 2023-10-14T19:04:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 0x7f3eb416de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 0x7f3eb416de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59712/0 (socket says 172.21.15.7:59712) 2023-10-14T19:04:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 -- 172.21.15.7:0/2143642259 learned_addr learned my addr 172.21.15.7:0/2143642259 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb27fc700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb41598b0 0x7f3eb416d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb2ffd700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb40af790 0x7f3eb40c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 -- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb40af790 msgr2=0x7f3eb40c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb40af790 0x7f3eb40c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 -- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb41598b0 msgr2=0x7f3eb416d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb41598b0 0x7f3eb416d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 -- 172.21.15.7:0/2143642259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009a20 con 0x7f3eb4159c80 2023-10-14T19:04:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb37fe700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 0x7f3eb416de50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4013000 tx=0x7f3ea4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4027470 con 0x7f3eb4159c80 2023-10-14T19:04:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4027630 con 0x7f3eb4159c80 2023-10-14T19:04:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40ca890 con 0x7f3eb4159c80 2023-10-14T19:04:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40279f0 con 0x7f3eb4159c80 2023-10-14T19:04:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.955+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb40c9a70 con 0x7f3eb4159c80 2023-10-14T19:04:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.956+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb404c3c0 con 0x7f3eb4159c80 2023-10-14T19:04:27.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.957+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ea4024070 con 0x7f3eb4159c80 2023-10-14T19:04:27.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.957+0000 7f3eaaffd700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e94066f30 0x7f3e940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:27.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.957+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3ea40869a0 con 0x7f3eb4159c80 2023-10-14T19:04:27.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.957+0000 7f3eb2ffd700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e94066f30 0x7f3e940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:27.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.958+0000 7f3eb2ffd700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e94066f30 0x7f3e940693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3eac006fd0 tx=0x7f3eac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:27.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:27.962+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ea4053f60 con 0x7f3eb4159c80 2023-10-14T19:04:28.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.233+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3eb40ce660 con 0x7f3eb4159c80 2023-10-14T19:04:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.233+0000 7f3eaaffd700 1 -- 172.21.15.7:0/2143642259 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3ea4057580 con 0x7f3eb4159c80 2023-10-14T19:04:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:28.235 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:04:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:04:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:04:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:04:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:04:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:04:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:04:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:04:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:04:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:04:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:04:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:04:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:04:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:04:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:04:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:04:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:04:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:04:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:04:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:04:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:04:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:04:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:04:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:04:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:04:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:04:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:04:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:04:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:04:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:04:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:04:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:04:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:04:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:04:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:04:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:04:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:04:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:04:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:04:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:04:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:04:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:04:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:04:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:04:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:04:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:04:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:04:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:04:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:04:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:04:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:04:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:04:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:04:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:04:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:04:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:04:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:04:28.272 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:04:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e94066f30 msgr2=0x7f3e940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e94066f30 0x7f3e940693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3eac006fd0 tx=0x7f3eac008040 comp rx=0 tx=0).stop 2023-10-14T19:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 msgr2=0x7f3eb416de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 0x7f3eb416de50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4013000 tx=0x7f3ea4019000 comp rx=0 tx=0).stop 2023-10-14T19:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 shutdown_connections 2023-10-14T19:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e94066f30 0x7f3e940693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb4159c80 0x7f3eb416de50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3eb40af790 0x7f3eb40c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 --2- 172.21.15.7:0/2143642259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb41598b0 0x7f3eb416d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 >> 172.21.15.7:0/2143642259 conn(0x7f3eb4070e30 msgr2=0x7f3eb40c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 shutdown_connections 2023-10-14T19:04:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.235+0000 7f3eb94c4700 1 -- 172.21.15.7:0/2143642259 wait complete. 2023-10-14T19:04:28.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 Processor -- start 2023-10-14T19:04:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 -- start start 2023-10-14T19:04:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f420c0cb5a0 0x7f420c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f420c0cd9e0 0x7f420c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c15ae40 con 0x7f420c15a400 2023-10-14T19:04:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0d13f0 con 0x7f420c0cb5a0 2023-10-14T19:04:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.395+0000 7f42110ef700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c15ab60 con 0x7f420c0cd9e0 2023-10-14T19:04:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420ad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f420c0cb5a0 0x7f420c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420b59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f420c15a400 0x7f420c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37732/0 (socket says 172.21.15.7:37732) 2023-10-14T19:04:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420b59e700 1 -- 172.21.15.7:0/1743300404 learned_addr learned my addr 172.21.15.7:0/1743300404 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420a59c700 1 --2- 172.21.15.7:0/1743300404 >> v2:172.21.15.148:3300/0 conn(0x7f420c0cd9e0 0x7f420c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420ad9d700 1 -- 172.21.15.7:0/1743300404 >> v2:172.21.15.148:3300/0 conn(0x7f420c0cd9e0 msgr2=0x7f420c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420ad9d700 1 --2- 172.21.15.7:0/1743300404 >> v2:172.21.15.148:3300/0 conn(0x7f420c0cd9e0 0x7f420c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420ad9d700 1 -- 172.21.15.7:0/1743300404 >> v1:172.21.15.7:6789/0 conn(0x7f420c15a400 legacy=0x7f420c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f4209d9b700 1 -- 172.21.15.7:0/1743300404 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490865220 0 0) 0x7f420c15ae40 con 0x7f420c15a400 2023-10-14T19:04:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420ad9d700 1 -- 172.21.15.7:0/1743300404 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0ccf00 con 0x7f420c0cb5a0 2023-10-14T19:04:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f420ad9d700 1 --2- 172.21.15.7:0/1743300404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cb5a0 0x7f420c0cb970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009e60 tx=0x7f41fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeac3e14a1923661 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f4209d9b700 1 -- 172.21.15.7:0/1743300404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00e070 con 0x7f420c0cb5a0 2023-10-14T19:04:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f4209d9b700 1 -- 172.21.15.7:0/1743300404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc00bbf0 con 0x7f420c0cb5a0 2023-10-14T19:04:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.396+0000 7f4209d9b700 1 -- 172.21.15.7:0/1743300404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc012430 con 0x7f420c0cb5a0 2023-10-14T19:04:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 -- 172.21.15.7:0/1743300404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cb5a0 msgr2=0x7f420c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 --2- 172.21.15.7:0/1743300404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cb5a0 0x7f420c0cb970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009e60 tx=0x7f41fc009780 comp rx=0 tx=0).stop 2023-10-14T19:04:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 -- 172.21.15.7:0/1743300404 shutdown_connections 2023-10-14T19:04:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 --2- 172.21.15.7:0/1743300404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cb5a0 0x7f420c0cb970 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 --2- 172.21.15.7:0/1743300404 >> v2:172.21.15.148:3300/0 conn(0x7f420c0cd9e0 0x7f420c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 -- 172.21.15.7:0/1743300404 >> 172.21.15.7:0/1743300404 conn(0x7f420c070e30 msgr2=0x7f420c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 -- 172.21.15.7:0/1743300404 shutdown_connections 2023-10-14T19:04:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.397+0000 7f42110ef700 1 -- 172.21.15.7:0/1743300404 wait complete. 2023-10-14T19:04:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.398+0000 7f42110ef700 1 Processor -- start 2023-10-14T19:04:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.398+0000 7f42110ef700 1 -- start start 2023-10-14T19:04:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f42110ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c0cb5a0 0x7f420c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f42110ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 0x7f420c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f42110ef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c15a400 0x7f420c0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f42110ef700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c6e50 con 0x7f420c0cd9e0 2023-10-14T19:04:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f42110ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1597f0 con 0x7f420c0cb5a0 2023-10-14T19:04:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f42110ef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c152f20 con 0x7f420c15a400 2023-10-14T19:04:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 0x7f420c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 0x7f420c157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59728/0 (socket says 172.21.15.7:59728) 2023-10-14T19:04:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 -- 172.21.15.7:0/2194717754 learned_addr learned my addr 172.21.15.7:0/2194717754 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420ad9d700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c0cb5a0 0x7f420c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420b59e700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c15a400 0x7f420c0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 -- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c15a400 msgr2=0x7f420c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c15a400 0x7f420c0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 -- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c0cb5a0 msgr2=0x7f420c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c0cb5a0 0x7f420c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 -- 172.21.15.7:0/2194717754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc009a20 con 0x7f420c0cd9e0 2023-10-14T19:04:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.399+0000 7f420a59c700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 0x7f420c157830 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f41f400d8c0 tx=0x7f41f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.400+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40125f0 con 0x7f420c0cd9e0 2023-10-14T19:04:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.400+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4012750 con 0x7f420c0cd9e0 2023-10-14T19:04:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.400+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c152310 con 0x7f420c0cd9e0 2023-10-14T19:04:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.400+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4012af0 con 0x7f420c0cd9e0 2023-10-14T19:04:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.400+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c1528d0 con 0x7f420c0cd9e0 2023-10-14T19:04:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.401+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c04c3c0 con 0x7f420c0cd9e0 2023-10-14T19:04:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.401+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41f401e460 con 0x7f420c0cd9e0 2023-10-14T19:04:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.401+0000 7f4202ffd700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41ec066f30 0x7f41ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.401+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f41f4084770 con 0x7f420c0cd9e0 2023-10-14T19:04:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.401+0000 7f420ad9d700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41ec066f30 0x7f41ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.402+0000 7f420ad9d700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41ec066f30 0x7f41ec0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0099f0 tx=0x7f41fc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.406+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41f4051d30 con 0x7f420c0cd9e0 2023-10-14T19:04:28.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.600+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f420c153060 con 0x7f420c0cd9e0 2023-10-14T19:04:28.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.601+0000 7f4202ffd700 1 -- 172.21.15.7:0/2194717754 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f41f4055350 con 0x7f420c0cd9e0 2023-10-14T19:04:28.602 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:28.602 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":48,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:27.804190+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41ec066f30 msgr2=0x7f41ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41ec066f30 0x7f41ec0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0099f0 tx=0x7f41fc019000 comp rx=0 tx=0).stop 2023-10-14T19:04:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 msgr2=0x7f420c157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 0x7f420c157830 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f41f400d8c0 tx=0x7f41f4008040 comp rx=0 tx=0).stop 2023-10-14T19:04:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 shutdown_connections 2023-10-14T19:04:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41ec066f30 0x7f41ec0693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c0cb5a0 0x7f420c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c15a400 0x7f420c0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 --2- 172.21.15.7:0/2194717754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f420c0cd9e0 0x7f420c157830 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 >> 172.21.15.7:0/2194717754 conn(0x7f420c070e30 msgr2=0x7f420c154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:28.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 shutdown_connections 2023-10-14T19:04:28.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.603+0000 7f42110ef700 1 -- 172.21.15.7:0/2194717754 wait complete. 2023-10-14T19:04:28.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:04:28.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:04:28.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.738+0000 7f5f142d4700 1 Processor -- start 2023-10-14T19:04:28.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.738+0000 7f5f142d4700 1 -- start start 2023-10-14T19:04:28.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f142d4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f0c0c8bd0 0x7f5f0c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f142d4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f0c0b0f80 0x7f5f0c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f142d4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0adbc0 con 0x7f5f0c0c8800 2023-10-14T19:04:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f142d4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b13d0 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f142d4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c9d30 con 0x7f5f0c0c8bd0 2023-10-14T19:04:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f0c0b0f80 0x7f5f0c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f0c0b0f80 0x7f5f0c0ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59742/0 (socket says 172.21.15.7:59742) 2023-10-14T19:04:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 -- 172.21.15.7:0/1866301460 learned_addr learned my addr 172.21.15.7:0/1866301460 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f1186f700 1 --2- 172.21.15.7:0/1866301460 >> v2:172.21.15.148:3300/0 conn(0x7f5f0c0c8bd0 0x7f5f0c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 -- 172.21.15.7:0/1866301460 >> v2:172.21.15.148:3300/0 conn(0x7f5f0c0c8bd0 msgr2=0x7f5f0c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 --2- 172.21.15.7:0/1866301460 >> v2:172.21.15.148:3300/0 conn(0x7f5f0c0c8bd0 0x7f5f0c0b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 -- 172.21.15.7:0/1866301460 >> v1:172.21.15.148:6789/0 conn(0x7f5f0c0c8800 legacy=0x7f5f0c0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 -- 172.21.15.7:0/1866301460 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0acfb0 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f12871700 1 --2- 172.21.15.7:0/1866301460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c0ae050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c069850 tx=0x7f5f04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c0caee9f945fee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:28.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f1106e700 1 -- 172.21.15.7:0/1866301460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04009e70 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f1106e700 1 -- 172.21.15.7:0/1866301460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400b860 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.739+0000 7f5f1106e700 1 -- 172.21.15.7:0/1866301460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400bc00 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 -- 172.21.15.7:0/1866301460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 msgr2=0x7f5f0c0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1866301460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c0ae050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c069850 tx=0x7f5f04009250 comp rx=0 tx=0).stop 2023-10-14T19:04:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 -- 172.21.15.7:0/1866301460 shutdown_connections 2023-10-14T19:04:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1866301460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c0ae050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1866301460 >> v2:172.21.15.148:3300/0 conn(0x7f5f0c0c8bd0 0x7f5f0c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 -- 172.21.15.7:0/1866301460 >> 172.21.15.7:0/1866301460 conn(0x7f5f0c06d170 msgr2=0x7f5f0c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 -- 172.21.15.7:0/1866301460 shutdown_connections 2023-10-14T19:04:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.740+0000 7f5f142d4700 1 -- 172.21.15.7:0/1866301460 wait complete. 2023-10-14T19:04:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.741+0000 7f5f142d4700 1 Processor -- start 2023-10-14T19:04:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.741+0000 7f5f142d4700 1 -- start start 2023-10-14T19:04:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f142d4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c1683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f142d4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f0c0c8800 0x7f5f0c0c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f142d4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f0c0c8bd0 0x7f5f0c0c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f142d4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c2c20 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f142d4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c1588a0 con 0x7f5f0c0c8800 2023-10-14T19:04:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f142d4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c157c90 con 0x7f5f0c0c8bd0 2023-10-14T19:04:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c1683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c1683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59752/0 (socket says 172.21.15.7:59752) 2023-10-14T19:04:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 -- 172.21.15.7:0/1422237804 learned_addr learned my addr 172.21.15.7:0/1422237804 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f1186f700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f0c0c8800 0x7f5f0c0c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12871700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f0c0c8bd0 0x7f5f0c0c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 -- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f0c0c8bd0 msgr2=0x7f5f0c0c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f0c0c8bd0 0x7f5f0c0c16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 -- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f0c0c8800 msgr2=0x7f5f0c0c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f0c0c8800 0x7f5f0c0c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.742+0000 7f5f12070700 1 -- 172.21.15.7:0/1422237804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040094f0 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.743+0000 7f5f12070700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c1683b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00c8e0 tx=0x7f5efc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.743+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc012630 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.743+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc0127b0 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.743+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c157f70 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.743+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc012b70 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.743+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c158530 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.744+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c06c040 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.744+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5efc003030 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.744+0000 7f5f0a7fc700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5ef8066f30 0x7f5ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.744+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5efc084100 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.745+0000 7f5f1186f700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5ef8066f30 0x7f5ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.745+0000 7f5f1186f700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5ef8066f30 0x7f5ef80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c153290 tx=0x7f5f000091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.749+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5efc055150 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.941+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f0c04c3c0 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.941+0000 7f5f0a7fc700 1 -- 172.21.15.7:0/1422237804 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5efc054ce0 con 0x7f5f0c0b0f80 2023-10-14T19:04:28.942 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:04:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5ef8066f30 msgr2=0x7f5ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5ef8066f30 0x7f5ef80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c153290 tx=0x7f5f000091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 msgr2=0x7f5f0c1683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:28.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c1683b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00c8e0 tx=0x7f5efc001710 comp rx=0 tx=0).stop 2023-10-14T19:04:28.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 shutdown_connections 2023-10-14T19:04:28.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5ef8066f30 0x7f5ef80693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f0c0c8bd0 0x7f5f0c0c16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f0c0b0f80 0x7f5f0c1683b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 --2- 172.21.15.7:0/1422237804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f0c0c8800 0x7f5f0c0c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 >> 172.21.15.7:0/1422237804 conn(0x7f5f0c06d170 msgr2=0x7f5f0c0ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 shutdown_connections 2023-10-14T19:04:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:28.943+0000 7f5f142d4700 1 -- 172.21.15.7:0/1422237804 wait complete. 2023-10-14T19:04:28.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:04:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.074+0000 7f6815525700 1 Processor -- start 2023-10-14T19:04:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.075+0000 7f6815525700 1 -- start start 2023-10-14T19:04:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.075+0000 7f6815525700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f681015a5d0 0x7f6810156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.075+0000 7f6815525700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681015ae40 con 0x7f68100cb5a0 2023-10-14T19:04:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.075+0000 7f6815525700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681015ab60 con 0x7f68100cb970 2023-10-14T19:04:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.075+0000 7f6815525700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68100ce0f0 con 0x7f681015a5d0 2023-10-14T19:04:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f68100cb5a0 0x7f68100cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37736/0 (socket says 172.21.15.7:37736) 2023-10-14T19:04:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680effd700 1 -- 172.21.15.7:0/2087023289 learned_addr learned my addr 172.21.15.7:0/2087023289 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375217078 0 0) 0x7f681015ae40 con 0x7f68100cb5a0 2023-10-14T19:04:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680f7fe700 1 --2- 172.21.15.7:0/2087023289 >> v2:172.21.15.148:3300/0 conn(0x7f681015a5d0 0x7f6810156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc003570 con 0x7f68100cb5a0 2023-10-14T19:04:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2677119422 0 0) 0x7f67fc003570 con 0x7f68100cb5a0 2023-10-14T19:04:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 >> v2:172.21.15.148:3300/0 conn(0x7f681015a5d0 msgr2=0x7f6810156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 --2- 172.21.15.7:0/2087023289 >> v2:172.21.15.148:3300/0 conn(0x7f681015a5d0 0x7f6810156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 >> v1:172.21.15.148:6789/0 conn(0x7f68100cb970 legacy=0x7f6810159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100ccf00 con 0x7f68100cb5a0 2023-10-14T19:04:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f6808001470 con 0x7f68100cb5a0 2023-10-14T19:04:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 >> v1:172.21.15.7:6789/0 conn(0x7f68100cb5a0 legacy=0x7f68100cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67fc003ab0 0x7f67fc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67fc004810 0x7f67fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc005210 0x7f67fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68100ce0f0 con 0x7f67fc004810 2023-10-14T19:04:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc00c130 con 0x7f67fc005210 2023-10-14T19:04:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc00c2f0 con 0x7f67fc003ab0 2023-10-14T19:04:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680e7fc700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67fc004810 0x7f67fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680effd700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67fc003ab0 0x7f67fc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.076+0000 7f680f7fe700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc005210 0x7f67fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680e7fc700 1 -- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67fc003ab0 msgr2=0x7f67fc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680e7fc700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67fc003ab0 0x7f67fc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680e7fc700 1 -- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc005210 msgr2=0x7f67fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680e7fc700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc005210 0x7f67fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680f7fe700 1 -- 172.21.15.7:0/2087023289 reap_dead start 2023-10-14T19:04:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680e7fc700 1 -- 172.21.15.7:0/2087023289 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc003570 con 0x7f67fc004810 2023-10-14T19:04:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680e7fc700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67fc004810 0x7f67fc004c80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f67f80018b0 tx=0x7f67f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4a84c5af7cc671 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8012420 con 0x7f67fc004810 2023-10-14T19:04:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f80125a0 con 0x7f67fc004810 2023-10-14T19:04:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f680dffb700 1 -- 172.21.15.7:0/2087023289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8012960 con 0x7f67fc004810 2023-10-14T19:04:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f6815525700 1 -- 172.21.15.7:0/2087023289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67fc004810 msgr2=0x7f67fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f6815525700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67fc004810 0x7f67fc004c80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f67f80018b0 tx=0x7f67f8007d30 comp rx=0 tx=0).stop 2023-10-14T19:04:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f6815525700 1 -- 172.21.15.7:0/2087023289 shutdown_connections 2023-10-14T19:04:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f6815525700 1 --2- 172.21.15.7:0/2087023289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67fc004810 0x7f67fc004c80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f6815525700 1 -- 172.21.15.7:0/2087023289 >> 172.21.15.7:0/2087023289 conn(0x7f6810070e30 msgr2=0x7f68100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.077+0000 7f6815525700 1 -- 172.21.15.7:0/2087023289 shutdown_connections 2023-10-14T19:04:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.078+0000 7f6815525700 1 -- 172.21.15.7:0/2087023289 wait complete. 2023-10-14T19:04:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 Processor -- start 2023-10-14T19:04:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 -- start start 2023-10-14T19:04:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc004810 0x7f6810152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 0x7f681015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68100b4390 0x7f68100b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68100b3800 con 0x7f681015b070 2023-10-14T19:04:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6810158d30 con 0x7f67fc004810 2023-10-14T19:04:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.079+0000 7f6815525700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6810158120 con 0x7f68100b4390 2023-10-14T19:04:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 0x7f681015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 0x7f681015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59774/0 (socket says 172.21.15.7:59774) 2023-10-14T19:04:29.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 -- 172.21.15.7:0/386012369 learned_addr learned my addr 172.21.15.7:0/386012369 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:29.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680f7fe700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68100b4390 0x7f68100b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680effd700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc004810 0x7f6810152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 -- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68100b4390 msgr2=0x7f68100b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68100b4390 0x7f68100b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 -- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc004810 msgr2=0x7f6810152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc004810 0x7f6810152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 -- 172.21.15.7:0/386012369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810158400 con 0x7f681015b070 2023-10-14T19:04:29.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f680e7fc700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 0x7f681015b4e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0057d0 tx=0x7f67f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f801f620 con 0x7f681015b070 2023-10-14T19:04:29.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f801f780 con 0x7f681015b070 2023-10-14T19:04:29.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f801fb40 con 0x7f681015b070 2023-10-14T19:04:29.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68101586e0 con 0x7f681015b070 2023-10-14T19:04:29.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.080+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6810152c80 con 0x7f681015b070 2023-10-14T19:04:29.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.081+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6810158ee0 con 0x7f681015b070 2023-10-14T19:04:29.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.082+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67f800c420 con 0x7f681015b070 2023-10-14T19:04:29.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.082+0000 7f6806ffd700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67f0066f30 0x7f67f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.082+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f67f8085860 con 0x7f681015b070 2023-10-14T19:04:29.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.082+0000 7f680effd700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67f0066f30 0x7f67f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.083+0000 7f680effd700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67f0066f30 0x7f67f00693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68080015a0 tx=0x7f6808001d80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.086+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6810158ee0 con 0x7f681015b070 2023-10-14T19:04:29.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.281+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68100b37e0 con 0x7f681015b070 2023-10-14T19:04:29.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.281+0000 7f6806ffd700 1 -- 172.21.15.7:0/386012369 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7f67f802d060 con 0x7f681015b070 2023-10-14T19:04:29.283 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:29.283 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:04:29.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:29.284 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:04:29.284 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:04:29.284 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:29.284 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:04:29.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67f0066f30 msgr2=0x7f67f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67f0066f30 0x7f67f00693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68080015a0 tx=0x7f6808001d80 comp rx=0 tx=0).stop 2023-10-14T19:04:29.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 msgr2=0x7f681015b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 0x7f681015b4e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0057d0 tx=0x7f67f8015000 comp rx=0 tx=0).stop 2023-10-14T19:04:29.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 shutdown_connections 2023-10-14T19:04:29.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67f0066f30 0x7f67f00693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67fc004810 0x7f6810152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68100b4390 0x7f68100b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 --2- 172.21.15.7:0/386012369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f681015b070 0x7f681015b4e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 >> 172.21.15.7:0/386012369 conn(0x7f6810070e30 msgr2=0x7f68100b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:29.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 shutdown_connections 2023-10-14T19:04:29.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.283+0000 7f6815525700 1 -- 172.21.15.7:0/386012369 wait complete. 2023-10-14T19:04:29.296 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:04:29.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:04:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.419+0000 7f8aa1661700 1 Processor -- start 2023-10-14T19:04:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.419+0000 7f8aa1661700 1 -- start start 2023-10-14T19:04:29.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8aa1661700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a9c159fb0 0x7f8a9c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8aa1661700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8aa1661700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c15d570 con 0x7f8a9c15a8c0 2023-10-14T19:04:29.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8aa1661700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c15e180 con 0x7f8a9c159fb0 2023-10-14T19:04:29.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8aa1661700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c15d850 con 0x7f8a9c0cd5a0 2023-10-14T19:04:29.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8aa0e60700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.420+0000 7f8a9bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a9c159fb0 0x7f8a9c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8a9c15a8c0 0x7f8a9c0cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:34040/0 (socket says 172.21.15.7:34040) 2023-10-14T19:04:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9b7fe700 1 -- 172.21.15.7:0/459517506 learned_addr learned my addr 172.21.15.7:0/459517506 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9affd700 1 -- 172.21.15.7:0/459517506 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342100481 0 0) 0x7f8a9c15d570 con 0x7f8a9c15a8c0 2023-10-14T19:04:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9affd700 1 -- 172.21.15.7:0/459517506 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a88003570 con 0x7f8a9c15a8c0 2023-10-14T19:04:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8aa0e60700 1 -- 172.21.15.7:0/459517506 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c159fb0 msgr2=0x7f8a9c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8aa0e60700 1 --2- 172.21.15.7:0/459517506 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c159fb0 0x7f8a9c15a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8aa0e60700 1 -- 172.21.15.7:0/459517506 >> v1:172.21.15.148:6789/0 conn(0x7f8a9c15a8c0 legacy=0x7f8a9c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8aa0e60700 1 -- 172.21.15.7:0/459517506 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c15db30 con 0x7f8a9c0cd5a0 2023-10-14T19:04:29.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9bfff700 1 --2- 172.21.15.7:0/459517506 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c159fb0 0x7f8a9c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:29.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8aa0e60700 1 --2- 172.21.15.7:0/459517506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c0cb440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009e60 tx=0x7f8a94009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adcbd9890d40bc10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9affd700 1 -- 172.21.15.7:0/459517506 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400e070 con 0x7f8a9c0cd5a0 2023-10-14T19:04:29.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9affd700 1 -- 172.21.15.7:0/459517506 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9400bab0 con 0x7f8a9c0cd5a0 2023-10-14T19:04:29.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.421+0000 7f8a9affd700 1 -- 172.21.15.7:0/459517506 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400be70 con 0x7f8a9c0cd5a0 2023-10-14T19:04:29.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 -- 172.21.15.7:0/459517506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 msgr2=0x7f8a9c0cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 --2- 172.21.15.7:0/459517506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c0cb440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009e60 tx=0x7f8a94009780 comp rx=0 tx=0).stop 2023-10-14T19:04:29.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 -- 172.21.15.7:0/459517506 shutdown_connections 2023-10-14T19:04:29.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 --2- 172.21.15.7:0/459517506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c0cb440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 --2- 172.21.15.7:0/459517506 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c159fb0 0x7f8a9c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 -- 172.21.15.7:0/459517506 >> 172.21.15.7:0/459517506 conn(0x7f8a9c0703a0 msgr2=0x7f8a9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:29.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 -- 172.21.15.7:0/459517506 shutdown_connections 2023-10-14T19:04:29.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.422+0000 7f8aa1661700 1 -- 172.21.15.7:0/459517506 wait complete. 2023-10-14T19:04:29.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.423+0000 7f8aa1661700 1 Processor -- start 2023-10-14T19:04:29.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.423+0000 7f8aa1661700 1 -- start start 2023-10-14T19:04:29.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa1661700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa1661700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 0x7f8a9c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa1661700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c15a8c0 0x7f8a9c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa1661700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0b0b80 con 0x7f8a9c159fb0 2023-10-14T19:04:29.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa1661700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c150c80 con 0x7f8a9c15a8c0 2023-10-14T19:04:29.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa1661700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0b0270 con 0x7f8a9c0cd5a0 2023-10-14T19:04:29.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 0x7f8a9c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 0x7f8a9c1533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59782/0 (socket says 172.21.15.7:59782) 2023-10-14T19:04:29.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 -- 172.21.15.7:0/901476688 learned_addr learned my addr 172.21.15.7:0/901476688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:29.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9bfff700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa0e60700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c15a8c0 0x7f8a9c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 -- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 msgr2=0x7f8a9c14bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c14bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 -- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c15a8c0 msgr2=0x7f8a9c0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c15a8c0 0x7f8a9c0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9b7fe700 1 -- 172.21.15.7:0/901476688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c009420 con 0x7f8a9c159fb0 2023-10-14T19:04:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8aa0e60700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c15a8c0 0x7f8a9c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.424+0000 7f8a9bfff700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c14bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:29.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.425+0000 7f8a9b7fe700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 0x7f8a9c1533b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c560 tx=0x7f8a84007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.425+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84005c00 con 0x7f8a9c159fb0 2023-10-14T19:04:29.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.425+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a84005d60 con 0x7f8a9c159fb0 2023-10-14T19:04:29.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.425+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a94009a20 con 0x7f8a9c159fb0 2023-10-14T19:04:29.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.425+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84007300 con 0x7f8a9c159fb0 2023-10-14T19:04:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.425+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c0b0530 con 0x7f8a9c159fb0 2023-10-14T19:04:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.426+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c0b0d30 con 0x7f8a9c159fb0 2023-10-14T19:04:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.426+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a8401b3b0 con 0x7f8a9c159fb0 2023-10-14T19:04:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.426+0000 7f8a93fff700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a7c066f30 0x7f8a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.426+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8a84083760 con 0x7f8a9c159fb0 2023-10-14T19:04:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.427+0000 7f8a9bfff700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a7c066f30 0x7f8a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.427+0000 7f8a9bfff700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a7c066f30 0x7f8a7c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0093f0 tx=0x7f8a8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.431+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a9c0b0d30 con 0x7f8a9c159fb0 2023-10-14T19:04:29.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.626+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8a9c04c3c0 con 0x7f8a9c159fb0 2023-10-14T19:04:29.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.812+0000 7f8a93fff700 1 -- 172.21.15.7:0/901476688 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8a84017020 con 0x7f8a9c159fb0 2023-10-14T19:04:29.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a7c066f30 msgr2=0x7f8a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a7c066f30 0x7f8a7c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0093f0 tx=0x7f8a8c008040 comp rx=0 tx=0).stop 2023-10-14T19:04:29.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 msgr2=0x7f8a9c1533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 0x7f8a9c1533b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c560 tx=0x7f8a84007dd0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 shutdown_connections 2023-10-14T19:04:29.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a7c066f30 0x7f8a7c0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c15a8c0 0x7f8a9c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0cd5a0 0x7f8a9c14bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 --2- 172.21.15.7:0/901476688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9c159fb0 0x7f8a9c1533b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 >> 172.21.15.7:0/901476688 conn(0x7f8a9c0703a0 msgr2=0x7f8a9c14fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.816+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 shutdown_connections 2023-10-14T19:04:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.817+0000 7f8aa1661700 1 -- 172.21.15.7:0/901476688 wait complete. 2023-10-14T19:04:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:04:29.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:04:29.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.956+0000 7fb41a4ad700 1 Processor -- start 2023-10-14T19:04:29.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.956+0000 7fb41a4ad700 1 -- start start 2023-10-14T19:04:29.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb41a4ad700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb414159530 0x7fb4140ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb41a4ad700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb414159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb41a4ad700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140ccfd0 con 0x7fb41406e0e0 2023-10-14T19:04:29.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb41a4ad700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140cf0e0 con 0x7fb414159530 2023-10-14T19:04:29.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb41a4ad700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41415a3d0 con 0x7fb41406dc70 2023-10-14T19:04:29.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb413fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb414159530 0x7fb4140ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb413fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb414159530 0x7fb4140ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59786/0 (socket says 172.21.15.7:59786) 2023-10-14T19:04:29.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.957+0000 7fb413fff700 1 -- 172.21.15.7:0/1071292945 learned_addr learned my addr 172.21.15.7:0/1071292945 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:29.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb4137fe700 1 --2- 172.21.15.7:0/1071292945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb414159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb413fff700 1 -- 172.21.15.7:0/1071292945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 msgr2=0x7fb414159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb413fff700 1 --2- 172.21.15.7:0/1071292945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb414159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb413fff700 1 -- 172.21.15.7:0/1071292945 >> v1:172.21.15.148:6789/0 conn(0x7fb41406e0e0 legacy=0x7fb4140cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb413fff700 1 -- 172.21.15.7:0/1071292945 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41415a6b0 con 0x7fb414159530 2023-10-14T19:04:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb413fff700 1 --2- 172.21.15.7:0/1071292945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb4140ceba0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4040099b0 tx=0x7fb404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3a1076df3ae56 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb412ffd700 1 -- 172.21.15.7:0/1071292945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400b820 con 0x7fb414159530 2023-10-14T19:04:29.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb412ffd700 1 -- 172.21.15.7:0/1071292945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400b980 con 0x7fb414159530 2023-10-14T19:04:29.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb412ffd700 1 -- 172.21.15.7:0/1071292945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400bd20 con 0x7fb414159530 2023-10-14T19:04:29.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 -- 172.21.15.7:0/1071292945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 msgr2=0x7fb4140ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/1071292945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb4140ceba0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4040099b0 tx=0x7fb404009250 comp rx=0 tx=0).stop 2023-10-14T19:04:29.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 -- 172.21.15.7:0/1071292945 shutdown_connections 2023-10-14T19:04:29.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/1071292945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb4140ceba0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/1071292945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb414159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 -- 172.21.15.7:0/1071292945 >> 172.21.15.7:0/1071292945 conn(0x7fb4140703a0 msgr2=0x7fb4140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:29.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.958+0000 7fb41a4ad700 1 -- 172.21.15.7:0/1071292945 shutdown_connections 2023-10-14T19:04:29.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.959+0000 7fb41a4ad700 1 -- 172.21.15.7:0/1071292945 wait complete. 2023-10-14T19:04:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 Processor -- start 2023-10-14T19:04:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 -- start start 2023-10-14T19:04:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb41416b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41406e0e0 0x7fb41415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb41415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41413fc60 con 0x7fb414159530 2023-10-14T19:04:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41415d3c0 con 0x7fb41406e0e0 2023-10-14T19:04:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.960+0000 7fb41a4ad700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41415d6a0 con 0x7fb41406dc70 2023-10-14T19:04:29.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb41415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb41415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59796/0 (socket says 172.21.15.7:59796) 2023-10-14T19:04:29.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 -- 172.21.15.7:0/678471236 learned_addr learned my addr 172.21.15.7:0/678471236 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:29.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb413fff700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb41416b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb4137fe700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41406e0e0 0x7fb41415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 -- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 msgr2=0x7fb41416b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb41416b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 -- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41406e0e0 msgr2=0x7fb41415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:29.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41406e0e0 0x7fb41415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:29.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 -- 172.21.15.7:0/678471236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040094f0 con 0x7fb414159530 2023-10-14T19:04:29.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb418a4a700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb41415e9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c890 tx=0x7fb40c0026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c012630 con 0x7fb414159530 2023-10-14T19:04:29.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c0127b0 con 0x7fb414159530 2023-10-14T19:04:29.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41415d980 con 0x7fb414159530 2023-10-14T19:04:29.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c012b70 con 0x7fb414159530 2023-10-14T19:04:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.961+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41415dfc0 con 0x7fb414159530 2023-10-14T19:04:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.962+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41415e150 con 0x7fb414159530 2023-10-14T19:04:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.963+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb40c01b400 con 0x7fb414159530 2023-10-14T19:04:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.963+0000 7fb3fbfff700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb400066f30 0x7fb4000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.963+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fb40c084640 con 0x7fb414159530 2023-10-14T19:04:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.963+0000 7fb413fff700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb400066f30 0x7fb4000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.964+0000 7fb413fff700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb400066f30 0x7fb4000693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb4040099b0 tx=0x7fb404016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:29.968+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb40c0519f0 con 0x7fb414159530 2023-10-14T19:04:30.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.162+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb41404c3c0 con 0x7fb414159530 2023-10-14T19:04:30.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.817+0000 7fb3fbfff700 1 -- 172.21.15.7:0/678471236 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb40c055010 con 0x7fb414159530 2023-10-14T19:04:30.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.823+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb400066f30 msgr2=0x7fb4000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.823+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb400066f30 0x7fb4000693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb4040099b0 tx=0x7fb404016000 comp rx=0 tx=0).stop 2023-10-14T19:04:30.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.823+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 msgr2=0x7fb41415e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.823+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb41415e9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c890 tx=0x7fb40c0026a0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.825+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 shutdown_connections 2023-10-14T19:04:30.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.825+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb400066f30 0x7fb4000693e0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb4040099b0 tx=0x7fb404016000 comp rx=0 tx=0).stop 2023-10-14T19:04:30.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.825+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb414159530 0x7fb41415e9a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.825+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb41406dc70 0x7fb41416b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.825+0000 7fb41a4ad700 1 --2- 172.21.15.7:0/678471236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41406e0e0 0x7fb41415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.825+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 >> 172.21.15.7:0/678471236 conn(0x7fb4140703a0 msgr2=0x7fb41415abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:30.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.827+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 shutdown_connections 2023-10-14T19:04:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.828+0000 7fb41a4ad700 1 -- 172.21.15.7:0/678471236 wait complete. 2023-10-14T19:04:30.837 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:04:30.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:04:30.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.973+0000 7f8c150e8700 1 Processor -- start 2023-10-14T19:04:30.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.973+0000 7f8c150e8700 1 -- start start 2023-10-14T19:04:30.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.974+0000 7f8c150e8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 0x7f8c100ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.974+0000 7f8c150e8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c100ccfd0 con 0x7f8c1006e0e0 2023-10-14T19:04:30.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.974+0000 7f8c150e8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c100cf0e0 con 0x7f8c1006dc70 2023-10-14T19:04:30.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.974+0000 7f8c150e8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1015a3d0 con 0x7f8c10159530 2023-10-14T19:04:30.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.974+0000 7f8c0f59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8c1006e0e0 0x7f8c100cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37738/0 (socket says 172.21.15.7:37738) 2023-10-14T19:04:30.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.974+0000 7f8c0f59e700 1 -- 172.21.15.7:0/1610017922 learned_addr learned my addr 172.21.15.7:0/1610017922 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:30.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0ed9d700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 0x7f8c100ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901534843 0 0) 0x7f8c100ccfd0 con 0x7f8c1006e0e0 2023-10-14T19:04:30.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bfc003570 con 0x7f8c1006e0e0 2023-10-14T19:04:30.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575212400 0 0) 0x7f8bfc003570 con 0x7f8c1006e0e0 2023-10-14T19:04:30.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 msgr2=0x7f8c100ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:30.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 0x7f8c100ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 >> v1:172.21.15.148:6789/0 conn(0x7f8c1006dc70 legacy=0x7f8c10159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1015a6b0 con 0x7f8c1006e0e0 2023-10-14T19:04:30.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8c080017f0 con 0x7f8c1006e0e0 2023-10-14T19:04:30.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 >> v1:172.21.15.7:6789/0 conn(0x7f8c1006e0e0 legacy=0x7f8c100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 0x7f8bfc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc003fd0 0x7f8bfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1015a3d0 con 0x7f8bfc004d50 2023-10-14T19:04:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc00bba0 con 0x7f8bfc003fd0 2023-10-14T19:04:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc00bd60 con 0x7f8c10159530 2023-10-14T19:04:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0f59e700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0e59c700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc003fd0 0x7f8bfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0ed9d700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 0x7f8bfc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0f59e700 1 -- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 msgr2=0x7f8bfc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:30.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0f59e700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10159530 0x7f8bfc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.975+0000 7f8c0f59e700 1 -- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc003fd0 msgr2=0x7f8bfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0f59e700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc003fd0 0x7f8bfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0f59e700 1 -- 172.21.15.7:0/1610017922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc003570 con 0x7f8bfc004d50 2023-10-14T19:04:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0f59e700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800a850 tx=0x7f8c08002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b2814f09c523b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c080070f0 con 0x7f8bfc004d50 2023-10-14T19:04:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c08007250 con 0x7f8bfc004d50 2023-10-14T19:04:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0dd9b700 1 -- 172.21.15.7:0/1610017922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08007610 con 0x7f8bfc004d50 2023-10-14T19:04:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c150e8700 1 -- 172.21.15.7:0/1610017922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bfc004d50 msgr2=0x7f8bfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c150e8700 1 --2- 172.21.15.7:0/1610017922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800a850 tx=0x7f8c08002120 comp rx=0 tx=0).stop 2023-10-14T19:04:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c0f59e700 1 -- 172.21.15.7:0/1610017922 reap_dead start 2023-10-14T19:04:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c150e8700 1 -- 172.21.15.7:0/1610017922 shutdown_connections 2023-10-14T19:04:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c150e8700 1 -- 172.21.15.7:0/1610017922 >> 172.21.15.7:0/1610017922 conn(0x7f8c100703a0 msgr2=0x7f8c100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c150e8700 1 -- 172.21.15.7:0/1610017922 shutdown_connections 2023-10-14T19:04:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.976+0000 7f8c150e8700 1 -- 172.21.15.7:0/1610017922 wait complete. 2023-10-14T19:04:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 Processor -- start 2023-10-14T19:04:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 -- start start 2023-10-14T19:04:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 0x7f8c100b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c100b18f0 0x7f8c10169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10154200 0x7f8c10169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1015cf60 con 0x7f8c100b1520 2023-10-14T19:04:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1015d240 con 0x7f8c100b18f0 2023-10-14T19:04:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c150e8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1015d520 con 0x7f8c10154200 2023-10-14T19:04:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c0ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 0x7f8c100b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c0ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 0x7f8c100b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59812/0 (socket says 172.21.15.7:59812) 2023-10-14T19:04:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.978+0000 7f8c0ed9d700 1 -- 172.21.15.7:0/2012154720 learned_addr learned my addr 172.21.15.7:0/2012154720 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0f59e700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10154200 0x7f8c10169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0e59c700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c100b18f0 0x7f8c10169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0ed9d700 1 -- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10154200 msgr2=0x7f8c10169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0ed9d700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10154200 0x7f8c10169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0ed9d700 1 -- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c100b18f0 msgr2=0x7f8c10169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0ed9d700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c100b18f0 0x7f8c10169860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0ed9d700 1 -- 172.21.15.7:0/2012154720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1015d800 con 0x7f8c100b1520 2023-10-14T19:04:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c0ed9d700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 0x7f8c100b60b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006ac0 tx=0x7f8c000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000f940 con 0x7f8c100b1520 2023-10-14T19:04:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000faa0 con 0x7f8c100b1520 2023-10-14T19:04:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000fe20 con 0x7f8c100b1520 2023-10-14T19:04:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1015dae0 con 0x7f8c100b1520 2023-10-14T19:04:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.979+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1015e2e0 con 0x7f8c100b1520 2023-10-14T19:04:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.980+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1004c3c0 con 0x7f8c100b1520 2023-10-14T19:04:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.981+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c00014650 con 0x7f8c100b1520 2023-10-14T19:04:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.981+0000 7f8c06ffd700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bf0066f30 0x7f8bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.981+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8c00018030 con 0x7f8c100b1520 2023-10-14T19:04:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.981+0000 7f8c0e59c700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bf0066f30 0x7f8bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.982+0000 7f8c0e59c700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bf0066f30 0x7f8bf00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c100b1e30 tx=0x7f8bf8007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:30.985+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c000521e0 con 0x7f8c100b1520 2023-10-14T19:04:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.223+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8c1015a990 con 0x7f8c100b1520 2023-10-14T19:04:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.819+0000 7f8c06ffd700 1 -- 172.21.15.7:0/2012154720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8c000220c0 con 0x7f8c100b1520 2023-10-14T19:04:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bf0066f30 msgr2=0x7f8bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bf0066f30 0x7f8bf00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c100b1e30 tx=0x7f8bf8007d10 comp rx=0 tx=0).stop 2023-10-14T19:04:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 msgr2=0x7f8c100b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 0x7f8c100b60b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006ac0 tx=0x7f8c000091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 shutdown_connections 2023-10-14T19:04:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8bf0066f30 0x7f8bf00693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c10154200 0x7f8c10169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c100b1520 0x7f8c100b60b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 --2- 172.21.15.7:0/2012154720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c100b18f0 0x7f8c10169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 >> 172.21.15.7:0/2012154720 conn(0x7f8c100703a0 msgr2=0x7f8c100b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.825+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 shutdown_connections 2023-10-14T19:04:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.826+0000 7f8c150e8700 1 -- 172.21.15.7:0/2012154720 wait complete. 2023-10-14T19:04:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 8 and data pool 9 2023-10-14T19:04:31.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.959+0000 7fac22ff3700 1 Processor -- start 2023-10-14T19:04:31.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.960+0000 7fac22ff3700 1 -- start start 2023-10-14T19:04:31.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.960+0000 7fac22ff3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c0d0780 0x7fac1c0d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:31.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.960+0000 7fac22ff3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac1c1599e0 0x7fac1c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:31.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.960+0000 7fac22ff3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c0ced70 con 0x7fac1c0ce7b0 2023-10-14T19:04:31.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.960+0000 7fac22ff3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c0cf050 con 0x7fac1c1599e0 2023-10-14T19:04:31.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.960+0000 7fac22ff3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0cf330 con 0x7fac1c0d0780 2023-10-14T19:04:31.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac20d8f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c0d0780 0x7fac1c0d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac21590700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac1c1599e0 0x7fac1c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac1bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fac1c0ce7b0 0x7fac1c1592d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:34074/0 (socket says 172.21.15.7:34074) 2023-10-14T19:04:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac1bfff700 1 -- 172.21.15.7:0/2416712254 learned_addr learned my addr 172.21.15.7:0/2416712254 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac1b7fe700 1 -- 172.21.15.7:0/2416712254 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399574074 0 0) 0x7fac1c0ced70 con 0x7fac1c0ce7b0 2023-10-14T19:04:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac1b7fe700 1 -- 172.21.15.7:0/2416712254 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac08003570 con 0x7fac1c0ce7b0 2023-10-14T19:04:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac21590700 1 -- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c0d0780 msgr2=0x7fac1c0d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac21590700 1 --2- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c0d0780 0x7fac1c0d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac21590700 1 -- 172.21.15.7:0/2416712254 >> v1:172.21.15.148:6789/0 conn(0x7fac1c0ce7b0 legacy=0x7fac1c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac21590700 1 -- 172.21.15.7:0/2416712254 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c0cf610 con 0x7fac1c1599e0 2023-10-14T19:04:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac20d8f700 1 --2- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c0d0780 0x7fac1c0d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.961+0000 7fac21590700 1 --2- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c1599e0 0x7fac1c0cfe10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fac140098e0 tx=0x7fac140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375c47c639680ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac1b7fe700 1 -- 172.21.15.7:0/2416712254 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011630 con 0x7fac1c1599e0 2023-10-14T19:04:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac1b7fe700 1 -- 172.21.15.7:0/2416712254 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14011790 con 0x7fac1c1599e0 2023-10-14T19:04:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac1b7fe700 1 -- 172.21.15.7:0/2416712254 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011b10 con 0x7fac1c1599e0 2023-10-14T19:04:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 -- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c1599e0 msgr2=0x7fac1c0cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 --2- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c1599e0 0x7fac1c0cfe10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fac140098e0 tx=0x7fac140091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 -- 172.21.15.7:0/2416712254 shutdown_connections 2023-10-14T19:04:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 --2- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c1599e0 0x7fac1c0cfe10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 --2- 172.21.15.7:0/2416712254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c0d0780 0x7fac1c0d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 -- 172.21.15.7:0/2416712254 >> 172.21.15.7:0/2416712254 conn(0x7fac1c0703a0 msgr2=0x7fac1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:31.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 -- 172.21.15.7:0/2416712254 shutdown_connections 2023-10-14T19:04:31.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.962+0000 7fac22ff3700 1 -- 172.21.15.7:0/2416712254 wait complete. 2023-10-14T19:04:31.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.963+0000 7fac22ff3700 1 Processor -- start 2023-10-14T19:04:31.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.963+0000 7fac22ff3700 1 -- start start 2023-10-14T19:04:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac22ff3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c0ce7b0 0x7fac1c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac22ff3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 0x7fac1c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac22ff3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c1599e0 0x7fac1c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac22ff3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c15fa60 con 0x7fac1c0d0780 2023-10-14T19:04:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac22ff3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c158ba0 con 0x7fac1c0ce7b0 2023-10-14T19:04:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac22ff3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0c98c0 con 0x7fac1c1599e0 2023-10-14T19:04:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 0x7fac1c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 0x7fac1c158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59816/0 (socket says 172.21.15.7:59816) 2023-10-14T19:04:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 -- 172.21.15.7:0/4885847 learned_addr learned my addr 172.21.15.7:0/4885847 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac21590700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c1599e0 0x7fac1c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac20d8f700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c0ce7b0 0x7fac1c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 -- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c1599e0 msgr2=0x7fac1c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c1599e0 0x7fac1c0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 -- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c0ce7b0 msgr2=0x7fac1c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.964+0000 7fac1bfff700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c0ce7b0 0x7fac1c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac1bfff700 1 -- 172.21.15.7:0/4885847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04009420 con 0x7fac1c0d0780 2023-10-14T19:04:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac20d8f700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c0ce7b0 0x7fac1c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac1bfff700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 0x7fac1c158660 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00cd30 tx=0x7fac0c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00aad0 con 0x7fac1c0d0780 2023-10-14T19:04:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00ac30 con 0x7fac1c0d0780 2023-10-14T19:04:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac14009420 con 0x7fac1c0d0780 2023-10-14T19:04:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0070f0 con 0x7fac1c0d0780 2023-10-14T19:04:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.965+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c15f130 con 0x7fac1c0d0780 2023-10-14T19:04:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.966+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c15fc10 con 0x7fac1c0d0780 2023-10-14T19:04:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.966+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac0c0074a0 con 0x7fac1c0d0780 2023-10-14T19:04:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.967+0000 7fac18ff9700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabfc066f30 0x7fabfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.967+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac0c084a80 con 0x7fac1c0d0780 2023-10-14T19:04:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.967+0000 7fac20d8f700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabfc066f30 0x7fabfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.967+0000 7fac20d8f700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabfc066f30 0x7fabfc0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fac040093f0 tx=0x7fac04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:31.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:31.971+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac1c15fc10 con 0x7fac1c0d0780 2023-10-14T19:04:32.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.163+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac1c15fc10 con 0x7fac1c0d0780 2023-10-14T19:04:32.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.164+0000 7fac18ff9700 1 -- 172.21.15.7:0/4885847 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fac1c15fc10 con 0x7fac1c0d0780 2023-10-14T19:04:32.165 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:32.166 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:31.225104+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:29.657115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:30.193005+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabfc066f30 msgr2=0x7fabfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabfc066f30 0x7fabfc0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fac040093f0 tx=0x7fac04008040 comp rx=0 tx=0).stop 2023-10-14T19:04:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 msgr2=0x7fac1c158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 0x7fac1c158660 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00cd30 tx=0x7fac0c001b00 comp rx=0 tx=0).stop 2023-10-14T19:04:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 shutdown_connections 2023-10-14T19:04:32.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fabfc066f30 0x7fabfc0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac1c0ce7b0 0x7fac1c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac1c1599e0 0x7fac1c0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 --2- 172.21.15.7:0/4885847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac1c0d0780 0x7fac1c158660 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 >> 172.21.15.7:0/4885847 conn(0x7fac1c0703a0 msgr2=0x7fac1c0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:32.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 shutdown_connections 2023-10-14T19:04:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.166+0000 7fac22ff3700 1 -- 172.21.15.7:0/4885847 wait complete. 2023-10-14T19:04:32.179 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.298+0000 7f0224085700 1 Processor -- start 2023-10-14T19:04:32.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.298+0000 7f0224085700 1 -- start start 2023-10-14T19:04:32.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0224085700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f021c159850 0x7f021c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0224085700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c159c20 0x7f021c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0224085700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0adb20 con 0x7f021c0b0930 2023-10-14T19:04:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0224085700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0ccdc0 con 0x7f021c159850 2023-10-14T19:04:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0224085700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0acf10 con 0x7f021c159c20 2023-10-14T19:04:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221e21700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f021c159850 0x7f021c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0222622700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f021c0b0930 0x7f021c0c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37742/0 (socket says 172.21.15.7:37742) 2023-10-14T19:04:32.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0222622700 1 -- 172.21.15.7:0/3804519699 learned_addr learned my addr 172.21.15.7:0/3804519699 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:32.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221620700 1 --2- 172.21.15.7:0/3804519699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c159c20 0x7f021c0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0220e1f700 1 -- 172.21.15.7:0/3804519699 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279596642 0 0) 0x7f021c0adb20 con 0x7f021c0b0930 2023-10-14T19:04:32.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0220e1f700 1 -- 172.21.15.7:0/3804519699 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0204003570 con 0x7f021c0b0930 2023-10-14T19:04:32.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221e21700 1 -- 172.21.15.7:0/3804519699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c159c20 msgr2=0x7f021c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221e21700 1 --2- 172.21.15.7:0/3804519699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c159c20 0x7f021c0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221e21700 1 -- 172.21.15.7:0/3804519699 >> v1:172.21.15.7:6789/0 conn(0x7f021c0b0930 legacy=0x7f021c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221e21700 1 -- 172.21.15.7:0/3804519699 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0ad1f0 con 0x7f021c159850 2023-10-14T19:04:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.299+0000 7f0221e21700 1 --2- 172.21.15.7:0/3804519699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c0adfb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f020c009e60 tx=0x7f020c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9ed0c114bd2589 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0220e1f700 1 -- 172.21.15.7:0/3804519699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00e070 con 0x7f021c159850 2023-10-14T19:04:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0220e1f700 1 -- 172.21.15.7:0/3804519699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00bb60 con 0x7f021c159850 2023-10-14T19:04:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0220e1f700 1 -- 172.21.15.7:0/3804519699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c012430 con 0x7f021c159850 2023-10-14T19:04:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 -- 172.21.15.7:0/3804519699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 msgr2=0x7f021c0adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 --2- 172.21.15.7:0/3804519699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c0adfb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f020c009e60 tx=0x7f020c009780 comp rx=0 tx=0).stop 2023-10-14T19:04:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 -- 172.21.15.7:0/3804519699 shutdown_connections 2023-10-14T19:04:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 --2- 172.21.15.7:0/3804519699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c0adfb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 --2- 172.21.15.7:0/3804519699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c159c20 0x7f021c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 -- 172.21.15.7:0/3804519699 >> 172.21.15.7:0/3804519699 conn(0x7f021c06d170 msgr2=0x7f021c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:32.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 -- 172.21.15.7:0/3804519699 shutdown_connections 2023-10-14T19:04:32.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.300+0000 7f0224085700 1 -- 172.21.15.7:0/3804519699 wait complete. 2023-10-14T19:04:32.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.301+0000 7f0224085700 1 Processor -- start 2023-10-14T19:04:32.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.301+0000 7f0224085700 1 -- start start 2023-10-14T19:04:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0224085700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c0b0930 0x7f021c141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0224085700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0224085700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f021c159c20 0x7f021c0abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0224085700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c143f10 con 0x7f021c159850 2023-10-14T19:04:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0224085700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c143300 con 0x7f021c159c20 2023-10-14T19:04:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0224085700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1435e0 con 0x7f021c0b0930 2023-10-14T19:04:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0221620700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0221620700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c142920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59828/0 (socket says 172.21.15.7:59828) 2023-10-14T19:04:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0221620700 1 -- 172.21.15.7:0/819847678 learned_addr learned my addr 172.21.15.7:0/819847678 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0222622700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f021c159c20 0x7f021c0abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.302+0000 7f0221e21700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c0b0930 0x7f021c141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0221620700 1 -- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c0b0930 msgr2=0x7f021c141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0221620700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c0b0930 0x7f021c141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0221620700 1 -- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f021c159c20 msgr2=0x7f021c0abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0221620700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f021c159c20 0x7f021c0abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0221620700 1 -- 172.21.15.7:0/819847678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009a20 con 0x7f021c159850 2023-10-14T19:04:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0222622700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f021c159c20 0x7f021c0abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0221620700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c142920 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f021000d860 tx=0x7f0210008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100125f0 con 0x7f021c159850 2023-10-14T19:04:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210012750 con 0x7f021c159850 2023-10-14T19:04:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c1438c0 con 0x7f021c159850 2023-10-14T19:04:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210012b10 con 0x7f021c159850 2023-10-14T19:04:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.303+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c1424f0 con 0x7f021c159850 2023-10-14T19:04:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.304+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c1440c0 con 0x7f021c159850 2023-10-14T19:04:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.304+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f021001e460 con 0x7f021c159850 2023-10-14T19:04:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.305+0000 7f0219ffb700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.305+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0210084aa0 con 0x7f021c159850 2023-10-14T19:04:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.305+0000 7f0221e21700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.306+0000 7f0221e21700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0208066f30 0x7f02080693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f020c0097c0 tx=0x7f020c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.309+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f021c1440c0 con 0x7f021c159850 2023-10-14T19:04:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.502+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021c04c3c0 con 0x7f021c159850 2023-10-14T19:04:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.503+0000 7f0219ffb700 1 -- 172.21.15.7:0/819847678 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f02100557a0 con 0x7f021c159850 2023-10-14T19:04:32.504 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:32.504 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:31.225104+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:29.657115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:30.193005+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0208066f30 msgr2=0x7f02080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0208066f30 0x7f02080693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f020c0097c0 tx=0x7f020c019000 comp rx=0 tx=0).stop 2023-10-14T19:04:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 msgr2=0x7f021c142920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c142920 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f021000d860 tx=0x7f0210008040 comp rx=0 tx=0).stop 2023-10-14T19:04:32.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 shutdown_connections 2023-10-14T19:04:32.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f021c159c20 0x7f021c0abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f021c0b0930 0x7f021c141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 --2- 172.21.15.7:0/819847678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f021c159850 0x7f021c142920 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 >> 172.21.15.7:0/819847678 conn(0x7f021c06d170 msgr2=0x7f021c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 shutdown_connections 2023-10-14T19:04:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.505+0000 7f0224085700 1 -- 172.21.15.7:0/819847678 wait complete. 2023-10-14T19:04:32.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:04:32.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.640+0000 7fc8d320d700 1 Processor -- start 2023-10-14T19:04:32.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.640+0000 7fc8d320d700 1 -- start start 2023-10-14T19:04:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.640+0000 7fc8d320d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8cc06e0e0 0x7fc8cc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.640+0000 7fc8d320d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc0ccfd0 con 0x7fc8cc159530 2023-10-14T19:04:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.640+0000 7fc8d320d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc15a3d0 con 0x7fc8cc06dc70 2023-10-14T19:04:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.640+0000 7fc8d320d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc15a6b0 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d0fa9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc8cc159530 0x7fc8cc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37746/0 (socket says 172.21.15.7:37746) 2023-10-14T19:04:32.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d17aa700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8cc06e0e0 0x7fc8cc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d0fa9700 1 -- 172.21.15.7:0/436100204 learned_addr learned my addr 172.21.15.7:0/436100204 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:32.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d17aa700 1 -- 172.21.15.7:0/436100204 >> v1:172.21.15.148:6789/0 conn(0x7fc8cc06dc70 legacy=0x7fc8cc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:32.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d17aa700 1 -- 172.21.15.7:0/436100204 >> v1:172.21.15.7:6789/0 conn(0x7fc8cc159530 legacy=0x7fc8cc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d17aa700 1 -- 172.21.15.7:0/436100204 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc15a990 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8cb7fe700 1 -- 172.21.15.7:0/436100204 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623512593 0 0) 0x7fc8cc0ccfd0 con 0x7fc8cc159530 2023-10-14T19:04:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8d17aa700 1 --2- 172.21.15.7:0/436100204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc0cb6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40098e0 tx=0x7fc8b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcb3a156f7a9ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8cb7fe700 1 -- 172.21.15.7:0/436100204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4009e80 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8cb7fe700 1 -- 172.21.15.7:0/436100204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b400b820 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.641+0000 7fc8cb7fe700 1 -- 172.21.15.7:0/436100204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400bba0 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 -- 172.21.15.7:0/436100204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 msgr2=0x7fc8cc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 --2- 172.21.15.7:0/436100204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc0cb6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40098e0 tx=0x7fc8b40091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 -- 172.21.15.7:0/436100204 shutdown_connections 2023-10-14T19:04:32.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 --2- 172.21.15.7:0/436100204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc0cb6f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 -- 172.21.15.7:0/436100204 >> 172.21.15.7:0/436100204 conn(0x7fc8cc0703a0 msgr2=0x7fc8cc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:32.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 -- 172.21.15.7:0/436100204 shutdown_connections 2023-10-14T19:04:32.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.642+0000 7fc8d320d700 1 -- 172.21.15.7:0/436100204 wait complete. 2023-10-14T19:04:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.643+0000 7fc8d320d700 1 Processor -- start 2023-10-14T19:04:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.643+0000 7fc8d320d700 1 -- start start 2023-10-14T19:04:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d320d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc06dc70 0x7fc8cc0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d320d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d320d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8cc159530 0x7fc8cc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d320d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0c84c0 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d320d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0c87a0 con 0x7fc8cc06dc70 2023-10-14T19:04:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d320d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0c8a80 con 0x7fc8cc159530 2023-10-14T19:04:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc14e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59840/0 (socket says 172.21.15.7:59840) 2023-10-14T19:04:32.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 -- 172.21.15.7:0/708391578 learned_addr learned my addr 172.21.15.7:0/708391578 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:32.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d17aa700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8cc159530 0x7fc8cc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d0fa9700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc06dc70 0x7fc8cc0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 -- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8cc159530 msgr2=0x7fc8cc0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8cc159530 0x7fc8cc0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 -- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc06dc70 msgr2=0x7fc8cc0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:32.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc06dc70 0x7fc8cc0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:32.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8cbfff700 1 -- 172.21.15.7:0/708391578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4009420 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.644+0000 7fc8d17aa700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8cc159530 0x7fc8cc0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:32.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.645+0000 7fc8cbfff700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc14e150 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c950 tx=0x7fc8bc002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:32.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.645+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00a7e0 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.645+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc00a940 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.645+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc0c8d60 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.645+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00ad00 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.645+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc0b1e70 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.646+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc04c3c0 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.646+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8bc012630 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.647+0000 7fc8c8ff9700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8ac066f30 0x7fc8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:32.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.647+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8bc0849a0 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.647+0000 7fc8d0fa9700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8ac066f30 0x7fc8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.647+0000 7fc8d0fa9700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8ac066f30 0x7fc8ac0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400c8f0 tx=0x7fc8c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.651+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8bc051c10 con 0x7fc8cc06e0e0 2023-10-14T19:04:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:32.890+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc8cc15ac70 con 0x7fc8cc06e0e0 2023-10-14T19:04:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.832+0000 7fc8c8ff9700 1 -- 172.21.15.7:0/708391578 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc8bc00ae60 con 0x7fc8cc06e0e0 2023-10-14T19:04:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.835+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8ac066f30 msgr2=0x7fc8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.835+0000 7fc8d320d700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8ac066f30 0x7fc8ac0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400c8f0 tx=0x7fc8c4009040 comp rx=0 tx=0).stop 2023-10-14T19:04:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.835+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 msgr2=0x7fc8cc14e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.835+0000 7fc8d320d700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc14e150 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c950 tx=0x7fc8bc002760 comp rx=0 tx=0).stop 2023-10-14T19:04:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 shutdown_connections 2023-10-14T19:04:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8ac066f30 0x7fc8ac0693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc06dc70 0x7fc8cc0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8cc159530 0x7fc8cc0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 --2- 172.21.15.7:0/708391578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8cc06e0e0 0x7fc8cc14e150 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 >> 172.21.15.7:0/708391578 conn(0x7fc8cc0703a0 msgr2=0x7fc8cc0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 shutdown_connections 2023-10-14T19:04:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.836+0000 7fc8d320d700 1 -- 172.21.15.7:0/708391578 wait complete. 2023-10-14T19:04:33.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:04:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.979+0000 7efdb1102700 1 Processor -- start 2023-10-14T19:04:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.979+0000 7efdb1102700 1 -- start start 2023-10-14T19:04:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdb1102700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdac159860 0x7efdac0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdb1102700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0ccfa0 0x7efdac0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdb1102700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac0cf510 con 0x7efdac0cbd90 2023-10-14T19:04:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdb1102700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac0d00b0 con 0x7efdac159860 2023-10-14T19:04:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdb1102700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0cc210 con 0x7efdac0ccfa0 2023-10-14T19:04:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdaad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdac159860 0x7efdac0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdaad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdac159860 0x7efdac0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59846/0 (socket says 172.21.15.7:59846) 2023-10-14T19:04:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdaad9d700 1 -- 172.21.15.7:0/492712621 learned_addr learned my addr 172.21.15.7:0/492712621 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.980+0000 7efdab59e700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0ccfa0 0x7efdac0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdaad9d700 1 -- 172.21.15.7:0/492712621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0ccfa0 msgr2=0x7efdac0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdaad9d700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0ccfa0 0x7efdac0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdaad9d700 1 -- 172.21.15.7:0/492712621 >> v1:172.21.15.148:6789/0 conn(0x7efdac0cbd90 legacy=0x7efdac0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdaad9d700 1 -- 172.21.15.7:0/492712621 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0cd960 con 0x7efdac159860 2023-10-14T19:04:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdab59e700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0ccfa0 0x7efdac0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdaad9d700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac0ce220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009f70 tx=0x7efd9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c9336421786246 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efda9d9b700 1 -- 172.21.15.7:0/492712621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e070 con 0x7efdac159860 2023-10-14T19:04:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efda9d9b700 1 -- 172.21.15.7:0/492712621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00bad0 con 0x7efdac159860 2023-10-14T19:04:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efda9d9b700 1 -- 172.21.15.7:0/492712621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0092e0 con 0x7efdac159860 2023-10-14T19:04:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdb1102700 1 -- 172.21.15.7:0/492712621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 msgr2=0x7efdac0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdb1102700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac0ce220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009f70 tx=0x7efd9c009840 comp rx=0 tx=0).stop 2023-10-14T19:04:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdb1102700 1 -- 172.21.15.7:0/492712621 shutdown_connections 2023-10-14T19:04:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdb1102700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0ccfa0 0x7efdac0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdb1102700 1 --2- 172.21.15.7:0/492712621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac0ce220 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.981+0000 7efdb1102700 1 -- 172.21.15.7:0/492712621 >> 172.21.15.7:0/492712621 conn(0x7efdac0999b0 msgr2=0x7efdac070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.982+0000 7efdb1102700 1 -- 172.21.15.7:0/492712621 shutdown_connections 2023-10-14T19:04:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.982+0000 7efdb1102700 1 -- 172.21.15.7:0/492712621 wait complete. 2023-10-14T19:04:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 Processor -- start 2023-10-14T19:04:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 -- start start 2023-10-14T19:04:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0cbd90 0x7efdac0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdac0ccfa0 0x7efdac169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac09cb50 con 0x7efdac159860 2023-10-14T19:04:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac09c540 con 0x7efdac0ccfa0 2023-10-14T19:04:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.983+0000 7efdb1102700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac16a700 con 0x7efdac0cbd90 2023-10-14T19:04:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59848/0 (socket says 172.21.15.7:59848) 2023-10-14T19:04:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 -- 172.21.15.7:0/567886949 learned_addr learned my addr 172.21.15.7:0/567886949 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdaad9d700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0cbd90 0x7efdac0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdaa59c700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdac0ccfa0 0x7efdac169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 -- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0cbd90 msgr2=0x7efdac0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:33.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0cbd90 0x7efdac0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 -- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdac0ccfa0 msgr2=0x7efdac169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:33.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdac0ccfa0 0x7efdac169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:33.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 -- 172.21.15.7:0/567886949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c009ae0 con 0x7efdac159860 2023-10-14T19:04:33.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdab59e700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac15adb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efda400e8a0 tx=0x7efda4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:33.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4013410 con 0x7efdac159860 2023-10-14T19:04:33.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda4013570 con 0x7efdac159860 2023-10-14T19:04:33.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac16a140 con 0x7efdac159860 2023-10-14T19:04:33.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda40138f0 con 0x7efdac159860 2023-10-14T19:04:33.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.984+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac09c770 con 0x7efdac159860 2023-10-14T19:04:33.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.985+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac09cc90 con 0x7efdac159860 2023-10-14T19:04:33.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.986+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efda4013ce0 con 0x7efdac159860 2023-10-14T19:04:33.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.986+0000 7efda2ffd700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd8c066f30 0x7efd8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:33.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.986+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efda4084160 con 0x7efdac159860 2023-10-14T19:04:33.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.987+0000 7efdaad9d700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd8c066f30 0x7efd8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:33.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.987+0000 7efdaad9d700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd8c066f30 0x7efd8c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009880 tx=0x7efd9c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:33.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:33.991+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdac09cc90 con 0x7efdac159860 2023-10-14T19:04:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.229+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efdac09cc90 con 0x7efdac159860 2023-10-14T19:04:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.838+0000 7efda2ffd700 1 -- 172.21.15.7:0/567886949 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7efdac09cc90 con 0x7efdac159860 2023-10-14T19:04:34.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd8c066f30 msgr2=0x7efd8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd8c066f30 0x7efd8c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009880 tx=0x7efd9c018000 comp rx=0 tx=0).stop 2023-10-14T19:04:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 msgr2=0x7efdac15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac15adb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efda400e8a0 tx=0x7efda4008040 comp rx=0 tx=0).stop 2023-10-14T19:04:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 shutdown_connections 2023-10-14T19:04:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd8c066f30 0x7efd8c0693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdac159860 0x7efdac15adb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdac0cbd90 0x7efdac0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 --2- 172.21.15.7:0/567886949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdac0ccfa0 0x7efdac169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.840+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 >> 172.21.15.7:0/567886949 conn(0x7efdac0999b0 msgr2=0x7efdac15c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.841+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 shutdown_connections 2023-10-14T19:04:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.841+0000 7efdb1102700 1 -- 172.21.15.7:0/567886949 wait complete. 2023-10-14T19:04:34.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:34.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.981+0000 7f64aebf7700 1 Processor -- start 2023-10-14T19:04:34.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.981+0000 7f64aebf7700 1 -- start start 2023-10-14T19:04:34.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.981+0000 7f64aebf7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64a80aee90 0x7f64a80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:34.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.981+0000 7f64aebf7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a80ce1a0 con 0x7f64a80a8be0 2023-10-14T19:04:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.981+0000 7f64aebf7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a80cd5d0 con 0x7f64a806d280 2023-10-14T19:04:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.981+0000 7f64aebf7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a80cd870 con 0x7f64a80aee90 2023-10-14T19:04:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64ac993700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f64a80a8be0 0x7f64a80ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37752/0 (socket says 172.21.15.7:37752) 2023-10-14T19:04:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64ac993700 1 -- 172.21.15.7:0/2584950137 learned_addr learned my addr 172.21.15.7:0/2584950137 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:34.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a7fff700 1 --2- 172.21.15.7:0/2584950137 >> v2:172.21.15.148:3300/0 conn(0x7f64a80aee90 0x7f64a80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:34.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795382913 0 0) 0x7f64a80ce1a0 con 0x7f64a80a8be0 2023-10-14T19:04:34.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6494003570 con 0x7f64a80a8be0 2023-10-14T19:04:34.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209889080 0 0) 0x7f64a80cd5d0 con 0x7f64a806d280 2023-10-14T19:04:34.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a80ce1a0 con 0x7f64a806d280 2023-10-14T19:04:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a7fff700 1 -- 172.21.15.7:0/2584950137 >> v1:172.21.15.148:6789/0 conn(0x7f64a806d280 legacy=0x7f64a80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a7fff700 1 -- 172.21.15.7:0/2584950137 >> v1:172.21.15.7:6789/0 conn(0x7f64a80a8be0 legacy=0x7f64a80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a7fff700 1 -- 172.21.15.7:0/2584950137 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80cdb50 con 0x7f64a80aee90 2023-10-14T19:04:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.982+0000 7f64a7fff700 1 --2- 172.21.15.7:0/2584950137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a80aee90 0x7f64a80a8fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f64980098d0 tx=0x7f6498009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2075f011bc1acae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498005c10 con 0x7f64a80aee90 2023-10-14T19:04:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6498005d70 con 0x7f64a80aee90 2023-10-14T19:04:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64a77fe700 1 -- 172.21.15.7:0/2584950137 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498006260 con 0x7f64a80aee90 2023-10-14T19:04:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 -- 172.21.15.7:0/2584950137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a80aee90 msgr2=0x7f64a80a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 --2- 172.21.15.7:0/2584950137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a80aee90 0x7f64a80a8fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f64980098d0 tx=0x7f6498009120 comp rx=0 tx=0).stop 2023-10-14T19:04:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 -- 172.21.15.7:0/2584950137 shutdown_connections 2023-10-14T19:04:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 --2- 172.21.15.7:0/2584950137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a80aee90 0x7f64a80a8fb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 -- 172.21.15.7:0/2584950137 >> 172.21.15.7:0/2584950137 conn(0x7f64a806ce80 msgr2=0x7f64a80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 -- 172.21.15.7:0/2584950137 shutdown_connections 2023-10-14T19:04:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.983+0000 7f64aebf7700 1 -- 172.21.15.7:0/2584950137 wait complete. 2023-10-14T19:04:34.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.984+0000 7f64aebf7700 1 Processor -- start 2023-10-14T19:04:34.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.984+0000 7f64aebf7700 1 -- start start 2023-10-14T19:04:34.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64aebf7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a806d280 0x7f64a80b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64aebf7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 0x7f64a8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64aebf7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a80aee90 0x7f64a8155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64aebf7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a806da30 con 0x7f64a80a8be0 2023-10-14T19:04:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64aebf7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a81561d0 con 0x7f64a806d280 2023-10-14T19:04:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64aebf7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a816e0b0 con 0x7f64a80aee90 2023-10-14T19:04:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 0x7f64a8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 0x7f64a8155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59852/0 (socket says 172.21.15.7:59852) 2023-10-14T19:04:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.985+0000 7f64a7fff700 1 -- 172.21.15.7:0/1796891979 learned_addr learned my addr 172.21.15.7:0/1796891979 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a7fff700 1 -- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a80aee90 msgr2=0x7f64a8155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a7fff700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a80aee90 0x7f64a8155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a7fff700 1 -- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a806d280 msgr2=0x7f64a80b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64ac993700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a806d280 0x7f64a80b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a7fff700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a806d280 0x7f64a80b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a7fff700 1 -- 172.21.15.7:0/1796891979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980093c0 con 0x7f64a80a8be0 2023-10-14T19:04:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64ac993700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a806d280 0x7f64a80b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:34.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a7fff700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 0x7f64a8155750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6498009390 tx=0x7f6498016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:34.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649801d8a0 con 0x7f64a80a8be0 2023-10-14T19:04:34.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649801da40 con 0x7f64a80a8be0 2023-10-14T19:04:34.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649801de00 con 0x7f64a80a8be0 2023-10-14T19:04:34.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a8157140 con 0x7f64a80a8be0 2023-10-14T19:04:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.986+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a816d780 con 0x7f64a80a8be0 2023-10-14T19:04:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.987+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a816e220 con 0x7f64a80a8be0 2023-10-14T19:04:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.987+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f649801b690 con 0x7f64a80a8be0 2023-10-14T19:04:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.988+0000 7f64a4ff9700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6488066f30 0x7f64880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.988+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6498086220 con 0x7f64a80a8be0 2023-10-14T19:04:34.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.988+0000 7f64ac993700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6488066f30 0x7f64880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:34.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.989+0000 7f64ac993700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6488066f30 0x7f64880693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64900028d0 tx=0x7f6490009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:34.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:34.992+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6498053540 con 0x7f64a80a8be0 2023-10-14T19:04:35.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.230+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64a804c3c0 con 0x7f64a80a8be0 2023-10-14T19:04:35.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.231+0000 7f64a4ff9700 1 -- 172.21.15.7:0/1796891979 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f649802a090 con 0x7f64a80a8be0 2023-10-14T19:04:35.232 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:35.232 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:31.225490+0000","modified":"2023-10-14T19:04:34.832188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/1084131518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1084131518},{"type":"v1","addr":"172.21.15.7:6834","nonce":1084131518}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T19:04:35.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6488066f30 msgr2=0x7f64880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6488066f30 0x7f64880693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64900028d0 tx=0x7f6490009040 comp rx=0 tx=0).stop 2023-10-14T19:04:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 msgr2=0x7f64a8155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 0x7f64a8155750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6498009390 tx=0x7f6498016000 comp rx=0 tx=0).stop 2023-10-14T19:04:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 shutdown_connections 2023-10-14T19:04:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6488066f30 0x7f64880693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a806d280 0x7f64a80b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a80aee90 0x7f64a8155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 --2- 172.21.15.7:0/1796891979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a80a8be0 0x7f64a8155750 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 >> 172.21.15.7:0/1796891979 conn(0x7f64a806ce80 msgr2=0x7f64a80ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 shutdown_connections 2023-10-14T19:04:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.233+0000 7f64aebf7700 1 -- 172.21.15.7:0/1796891979 wait complete. 2023-10-14T19:04:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2023-10-14T19:04:35.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.365+0000 7f6c5359e700 1 Processor -- start 2023-10-14T19:04:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.365+0000 7f6c5359e700 1 -- start start 2023-10-14T19:04:35.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c5359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c5415de50 0x7f6c540cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c5359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c540cef40 0x7f6c5415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c5359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5415afd0 con 0x7f6c54153c30 2023-10-14T19:04:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c5359e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5415b2b0 con 0x7f6c540cef40 2023-10-14T19:04:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c5359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415b590 con 0x7f6c5415de50 2023-10-14T19:04:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c540cef40 0x7f6c5415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c540cef40 0x7f6c5415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59858/0 (socket says 172.21.15.7:59858) 2023-10-14T19:04:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 -- 172.21.15.7:0/932327820 learned_addr learned my addr 172.21.15.7:0/932327820 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c51d9b700 1 --2- 172.21.15.7:0/932327820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c5415de50 0x7f6c540cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 -- 172.21.15.7:0/932327820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c5415de50 msgr2=0x7f6c540cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 --2- 172.21.15.7:0/932327820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c5415de50 0x7f6c540cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 -- 172.21.15.7:0/932327820 >> v1:172.21.15.148:6789/0 conn(0x7f6c54153c30 legacy=0x7f6c5415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.366+0000 7f6c52d9d700 1 -- 172.21.15.7:0/932327820 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5415b870 con 0x7f6c540cef40 2023-10-14T19:04:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c52d9d700 1 --2- 172.21.15.7:0/932327820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c540cef40 0x7f6c5415c070 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009f20 tx=0x7f6c4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ba3f4a363be093 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5159a700 1 -- 172.21.15.7:0/932327820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00e070 con 0x7f6c540cef40 2023-10-14T19:04:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5159a700 1 -- 172.21.15.7:0/932327820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00ba80 con 0x7f6c540cef40 2023-10-14T19:04:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5159a700 1 -- 172.21.15.7:0/932327820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0092e0 con 0x7f6c540cef40 2023-10-14T19:04:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 -- 172.21.15.7:0/932327820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c540cef40 msgr2=0x7f6c5415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 --2- 172.21.15.7:0/932327820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c540cef40 0x7f6c5415c070 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009f20 tx=0x7f6c4c009840 comp rx=0 tx=0).stop 2023-10-14T19:04:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 -- 172.21.15.7:0/932327820 shutdown_connections 2023-10-14T19:04:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 --2- 172.21.15.7:0/932327820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c540cef40 0x7f6c5415c070 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 --2- 172.21.15.7:0/932327820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c5415de50 0x7f6c540cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 -- 172.21.15.7:0/932327820 >> 172.21.15.7:0/932327820 conn(0x7f6c540703a0 msgr2=0x7f6c540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 -- 172.21.15.7:0/932327820 shutdown_connections 2023-10-14T19:04:35.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.367+0000 7f6c5359e700 1 -- 172.21.15.7:0/932327820 wait complete. 2023-10-14T19:04:35.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.368+0000 7f6c5359e700 1 Processor -- start 2023-10-14T19:04:35.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.368+0000 7f6c5359e700 1 -- start start 2023-10-14T19:04:35.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c540cef40 0x7f6c541471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c54153c30 0x7f6c540d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 0x7f6c540d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5359e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54147730 con 0x7f6c5415de50 2023-10-14T19:04:35.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b41c0 con 0x7f6c540cef40 2023-10-14T19:04:35.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c8750 con 0x7f6c54153c30 2023-10-14T19:04:35.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 0x7f6c540d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 0x7f6c540d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59868/0 (socket says 172.21.15.7:59868) 2023-10-14T19:04:35.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 -- 172.21.15.7:0/572174958 learned_addr learned my addr 172.21.15.7:0/572174958 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c51d9b700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c54153c30 0x7f6c540d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c5259c700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c540cef40 0x7f6c541471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 -- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c54153c30 msgr2=0x7f6c540d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c54153c30 0x7f6c540d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 -- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c540cef40 msgr2=0x7f6c541471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c540cef40 0x7f6c541471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.369+0000 7f6c52d9d700 1 -- 172.21.15.7:0/572174958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009ae0 con 0x7f6c5415de50 2023-10-14T19:04:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.370+0000 7f6c52d9d700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 0x7f6c540d0990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00b6c0 tx=0x7f6c4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.370+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0032f0 con 0x7f6c5415de50 2023-10-14T19:04:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.370+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c008e80 con 0x7f6c5415de50 2023-10-14T19:04:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.370+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540c8a30 con 0x7f6c5415de50 2023-10-14T19:04:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.370+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c025670 con 0x7f6c5415de50 2023-10-14T19:04:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.370+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540b3490 con 0x7f6c5415de50 2023-10-14T19:04:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.371+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540b5760 con 0x7f6c5415de50 2023-10-14T19:04:35.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.371+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c4c003040 con 0x7f6c5415de50 2023-10-14T19:04:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.372+0000 7f6c427fc700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c34066f30 0x7f6c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.372+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c4c0862e0 con 0x7f6c5415de50 2023-10-14T19:04:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.372+0000 7f6c5259c700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c34066f30 0x7f6c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.373+0000 7f6c5259c700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c34066f30 0x7f6c340693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c44003860 tx=0x7f6c44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.376+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c4c053550 con 0x7f6c5415de50 2023-10-14T19:04:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.569+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c540c85b0 con 0x7f6c5415de50 2023-10-14T19:04:35.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.570+0000 7f6c427fc700 1 -- 172.21.15.7:0/572174958 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6c540c85b0 con 0x7f6c5415de50 2023-10-14T19:04:35.571 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:35.571 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:32.781544+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:29.657115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:30.193005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c34066f30 msgr2=0x7f6c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c34066f30 0x7f6c340693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c44003860 tx=0x7f6c44009040 comp rx=0 tx=0).stop 2023-10-14T19:04:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 msgr2=0x7f6c540d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 0x7f6c540d0990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00b6c0 tx=0x7f6c4c018000 comp rx=0 tx=0).stop 2023-10-14T19:04:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 shutdown_connections 2023-10-14T19:04:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c34066f30 0x7f6c340693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c540cef40 0x7f6c541471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c5415de50 0x7f6c540d0990 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 --2- 172.21.15.7:0/572174958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c54153c30 0x7f6c540d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 >> 172.21.15.7:0/572174958 conn(0x7f6c540703a0 msgr2=0x7f6c540cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 shutdown_connections 2023-10-14T19:04:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.572+0000 7f6c5359e700 1 -- 172.21.15.7:0/572174958 wait complete. 2023-10-14T19:04:35.587 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:04:35.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:04:35.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.706+0000 7fe25f59e700 1 Processor -- start 2023-10-14T19:04:35.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.706+0000 7fe25f59e700 1 -- start start 2023-10-14T19:04:35.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe260153c30 0x7fe26015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2600cf110 0x7fe26015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26015afd0 con 0x7fe26015de50 2023-10-14T19:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26015b2b0 con 0x7fe260153c30 2023-10-14T19:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26015b590 con 0x7fe2600cf110 2023-10-14T19:04:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25ed9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2600cf110 0x7fe26015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe260153c30 0x7fe26015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe260153c30 0x7fe26015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:58656/0 (socket says 172.21.15.7:58656) 2023-10-14T19:04:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25dd9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe26015de50 0x7fe2600cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:34130/0 (socket says 172.21.15.7:34130) 2023-10-14T19:04:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25ed9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2600cf110 0x7fe26015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:59390/0 (socket says 172.21.15.7:59390) 2023-10-14T19:04:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 -- 172.21.15.7:0/3938867078 learned_addr learned my addr 172.21.15.7:0/3938867078 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 -- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2600cf110 msgr2=0x7fe26015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 --2- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2600cf110 0x7fe26015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 -- 172.21.15.7:0/3938867078 >> v1:172.21.15.148:6789/0 conn(0x7fe26015de50 legacy=0x7fe2600cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 -- 172.21.15.7:0/3938867078 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26015b870 con 0x7fe260153c30 2023-10-14T19:04:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25e59c700 1 --2- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe260153c30 0x7fe26015a5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2580099b0 tx=0x7fe258009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15a0033d21e97e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25d59a700 1 -- 172.21.15.7:0/3938867078 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258009ea0 con 0x7fe260153c30 2023-10-14T19:04:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25d59a700 1 -- 172.21.15.7:0/3938867078 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800b860 con 0x7fe260153c30 2023-10-14T19:04:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25d59a700 1 -- 172.21.15.7:0/3938867078 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800bc00 con 0x7fe260153c30 2023-10-14T19:04:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 -- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe260153c30 msgr2=0x7fe26015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.708+0000 7fe25f59e700 1 --2- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe260153c30 0x7fe26015a5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2580099b0 tx=0x7fe258009250 comp rx=0 tx=0).stop 2023-10-14T19:04:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.709+0000 7fe25f59e700 1 -- 172.21.15.7:0/3938867078 shutdown_connections 2023-10-14T19:04:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.709+0000 7fe25f59e700 1 --2- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2600cf110 0x7fe26015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.709+0000 7fe25f59e700 1 --2- 172.21.15.7:0/3938867078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe260153c30 0x7fe26015a5e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.709+0000 7fe25f59e700 1 -- 172.21.15.7:0/3938867078 >> 172.21.15.7:0/3938867078 conn(0x7fe2600703a0 msgr2=0x7fe2600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:35.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.709+0000 7fe25f59e700 1 -- 172.21.15.7:0/3938867078 shutdown_connections 2023-10-14T19:04:35.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.709+0000 7fe25f59e700 1 -- 172.21.15.7:0/3938867078 wait complete. 2023-10-14T19:04:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 Processor -- start 2023-10-14T19:04:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 -- start start 2023-10-14T19:04:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2600cf110 0x7fe2600cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe260153c30 0x7fe260151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 0x7fe260151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600cd910 con 0x7fe26015de50 2023-10-14T19:04:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600b3d30 con 0x7fe2600cf110 2023-10-14T19:04:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601518d0 con 0x7fe260153c30 2023-10-14T19:04:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 0x7fe260151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 0x7fe260151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59884/0 (socket says 172.21.15.7:59884) 2023-10-14T19:04:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 -- 172.21.15.7:0/620157006 learned_addr learned my addr 172.21.15.7:0/620157006 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25e59c700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2600cf110 0x7fe2600cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25dd9b700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe260153c30 0x7fe260151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 -- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe260153c30 msgr2=0x7fe260151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe260153c30 0x7fe260151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 -- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2600cf110 msgr2=0x7fe2600cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2600cf110 0x7fe2600cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 -- 172.21.15.7:0/620157006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580094f0 con 0x7fe26015de50 2023-10-14T19:04:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25ed9d700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 0x7fe260151390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe250009ec0 tx=0x7fe25000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000cb70 con 0x7fe26015de50 2023-10-14T19:04:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000f040 con 0x7fe26015de50 2023-10-14T19:04:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250014480 con 0x7fe26015de50 2023-10-14T19:04:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2600b3400 con 0x7fe26015de50 2023-10-14T19:04:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.711+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2600b39c0 con 0x7fe26015de50 2023-10-14T19:04:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.712+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26004c3c0 con 0x7fe26015de50 2023-10-14T19:04:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.713+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe250014830 con 0x7fe26015de50 2023-10-14T19:04:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.713+0000 7fe2567fc700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe240066f30 0x7fe2400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.713+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe250084e90 con 0x7fe26015de50 2023-10-14T19:04:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.713+0000 7fe25e59c700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe240066f30 0x7fe2400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.714+0000 7fe25e59c700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe240066f30 0x7fe2400693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2580099b0 tx=0x7fe258017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.717+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe250052100 con 0x7fe26015de50 2023-10-14T19:04:35.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.905+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe26015bb50 con 0x7fe240066f30 2023-10-14T19:04:35.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.915+0000 7fe2567fc700 1 -- 172.21.15.7:0/620157006 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289612 (secure 0 0 0) 0x7fe26015bb50 con 0x7fe240066f30 2023-10-14T19:04:35.920 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:35.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe240066f30 msgr2=0x7fe2400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe240066f30 0x7fe2400693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2580099b0 tx=0x7fe258017000 comp rx=0 tx=0).stop 2023-10-14T19:04:35.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 msgr2=0x7fe260151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:35.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 0x7fe260151390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe250009ec0 tx=0x7fe25000b040 comp rx=0 tx=0).stop 2023-10-14T19:04:35.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 shutdown_connections 2023-10-14T19:04:35.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe240066f30 0x7fe2400693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2600cf110 0x7fe2600cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe26015de50 0x7fe260151390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 --2- 172.21.15.7:0/620157006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe260153c30 0x7fe260151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:35.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 >> 172.21.15.7:0/620157006 conn(0x7fe2600703a0 msgr2=0x7fe2600b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:35.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 shutdown_connections 2023-10-14T19:04:35.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:35.918+0000 7fe25f59e700 1 -- 172.21.15.7:0/620157006 wait complete. 2023-10-14T19:04:35.925 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:04:35.931 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-10-14T19:04:35.642248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392488,"kb_used_data":5992,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582232,"statfs":{"total":773094113280,"available":770644205568,"internally_reserved":0,"allocated":6135808,"data_stored":3231068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.825538"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798152+0000","last_change":"2023-10-14T19:04:31.795432+0000","last_active":"2023-10-14T19:04:31.798152+0000","last_peered":"2023-10-14T19:04:31.798152+0000","last_clean":"2023-10-14T19:04:31.798152+0000","last_became_active":"2023-10-14T19:04:31.795140+0000","last_became_peered":"2023-10-14T19:04:31.795140+0000","last_unstale":"2023-10-14T19:04:31.798152+0000","last_undegraded":"2023-10-14T19:04:31.798152+0000","last_fullsized":"2023-10-14T19:04:31.798152+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:33.004820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801342+0000","last_change":"2023-10-14T19:04:31.801342+0000","last_active":"2023-10-14T19:04:31.801342+0000","last_peered":"2023-10-14T19:04:31.801342+0000","last_clean":"2023-10-14T19:04:31.801342+0000","last_became_active":"2023-10-14T19:04:31.801072+0000","last_became_peered":"2023-10-14T19:04:31.801072+0000","last_unstale":"2023-10-14T19:04:31.801342+0000","last_undegraded":"2023-10-14T19:04:31.801342+0000","last_fullsized":"2023-10-14T19:04:31.801342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:42.243779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799710+0000","last_change":"2023-10-14T19:04:31.799710+0000","last_active":"2023-10-14T19:04:31.799710+0000","last_peered":"2023-10-14T19:04:31.799710+0000","last_clean":"2023-10-14T19:04:31.799710+0000","last_became_active":"2023-10-14T19:04:31.799340+0000","last_became_peered":"2023-10-14T19:04:31.799340+0000","last_unstale":"2023-10-14T19:04:31.799710+0000","last_undegraded":"2023-10-14T19:04:31.799710+0000","last_fullsized":"2023-10-14T19:04:31.799710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:20.270989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.793897+0000","last_change":"2023-10-14T19:04:31.793897+0000","last_active":"2023-10-14T19:04:31.793897+0000","last_peered":"2023-10-14T19:04:31.793897+0000","last_clean":"2023-10-14T19:04:31.793897+0000","last_became_active":"2023-10-14T19:04:31.793223+0000","last_became_peered":"2023-10-14T19:04:31.793223+0000","last_unstale":"2023-10-14T19:04:31.793897+0000","last_undegraded":"2023-10-14T19:04:31.793897+0000","last_fullsized":"2023-10-14T19:04:31.793897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:40.890151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798165+0000","last_change":"2023-10-14T19:04:31.795889+0000","last_active":"2023-10-14T19:04:31.798165+0000","last_peered":"2023-10-14T19:04:31.798165+0000","last_clean":"2023-10-14T19:04:31.798165+0000","last_became_active":"2023-10-14T19:04:31.795579+0000","last_became_peered":"2023-10-14T19:04:31.795579+0000","last_unstale":"2023-10-14T19:04:31.798165+0000","last_undegraded":"2023-10-14T19:04:31.798165+0000","last_fullsized":"2023-10-14T19:04:31.798165+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:51:00.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797730+0000","last_change":"2023-10-14T19:04:31.797730+0000","last_active":"2023-10-14T19:04:31.797730+0000","last_peered":"2023-10-14T19:04:31.797730+0000","last_clean":"2023-10-14T19:04:31.797730+0000","last_became_active":"2023-10-14T19:04:31.797480+0000","last_became_peered":"2023-10-14T19:04:31.797480+0000","last_unstale":"2023-10-14T19:04:31.797730+0000","last_undegraded":"2023-10-14T19:04:31.797730+0000","last_fullsized":"2023-10-14T19:04:31.797730+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:00.174039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796719+0000","last_change":"2023-10-14T19:04:31.796719+0000","last_active":"2023-10-14T19:04:31.796719+0000","last_peered":"2023-10-14T19:04:31.796719+0000","last_clean":"2023-10-14T19:04:31.796719+0000","last_became_active":"2023-10-14T19:04:31.796447+0000","last_became_peered":"2023-10-14T19:04:31.796447+0000","last_unstale":"2023-10-14T19:04:31.796719+0000","last_undegraded":"2023-10-14T19:04:31.796719+0000","last_fullsized":"2023-10-14T19:04:31.796719+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:00.338267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800110+0000","last_change":"2023-10-14T19:04:31.800110+0000","last_active":"2023-10-14T19:04:31.800110+0000","last_peered":"2023-10-14T19:04:31.800110+0000","last_clean":"2023-10-14T19:04:31.800110+0000","last_became_active":"2023-10-14T19:04:31.799783+0000","last_became_peered":"2023-10-14T19:04:31.799783+0000","last_unstale":"2023-10-14T19:04:31.800110+0000","last_undegraded":"2023-10-14T19:04:31.800110+0000","last_fullsized":"2023-10-14T19:04:31.800110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:48:39.365520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795107+0000","last_change":"2023-10-14T19:04:31.795107+0000","last_active":"2023-10-14T19:04:31.795107+0000","last_peered":"2023-10-14T19:04:31.795107+0000","last_clean":"2023-10-14T19:04:31.795107+0000","last_became_active":"2023-10-14T19:04:31.794806+0000","last_became_peered":"2023-10-14T19:04:31.794806+0000","last_unstale":"2023-10-14T19:04:31.795107+0000","last_undegraded":"2023-10-14T19:04:31.795107+0000","last_fullsized":"2023-10-14T19:04:31.795107+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:05.185952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798144+0000","last_change":"2023-10-14T19:04:31.798144+0000","last_active":"2023-10-14T19:04:31.798144+0000","last_peered":"2023-10-14T19:04:31.798144+0000","last_clean":"2023-10-14T19:04:31.798144+0000","last_became_active":"2023-10-14T19:04:31.797861+0000","last_became_peered":"2023-10-14T19:04:31.797861+0000","last_unstale":"2023-10-14T19:04:31.798144+0000","last_undegraded":"2023-10-14T19:04:31.798144+0000","last_fullsized":"2023-10-14T19:04:31.798144+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:49.536476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800481+0000","last_change":"2023-10-14T19:04:31.800481+0000","last_active":"2023-10-14T19:04:31.800481+0000","last_peered":"2023-10-14T19:04:31.800481+0000","last_clean":"2023-10-14T19:04:31.800481+0000","last_became_active":"2023-10-14T19:04:31.798872+0000","last_became_peered":"2023-10-14T19:04:31.798872+0000","last_unstale":"2023-10-14T19:04:31.800481+0000","last_undegraded":"2023-10-14T19:04:31.800481+0000","last_fullsized":"2023-10-14T19:04:31.800481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:19.572641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794089+0000","last_change":"2023-10-14T19:04:31.794089+0000","last_active":"2023-10-14T19:04:31.794089+0000","last_peered":"2023-10-14T19:04:31.794089+0000","last_clean":"2023-10-14T19:04:31.794089+0000","last_became_active":"2023-10-14T19:04:31.793603+0000","last_became_peered":"2023-10-14T19:04:31.793603+0000","last_unstale":"2023-10-14T19:04:31.794089+0000","last_undegraded":"2023-10-14T19:04:31.794089+0000","last_fullsized":"2023-10-14T19:04:31.794089+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:57.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800977+0000","last_change":"2023-10-14T19:04:31.800977+0000","last_active":"2023-10-14T19:04:31.800977+0000","last_peered":"2023-10-14T19:04:31.800977+0000","last_clean":"2023-10-14T19:04:31.800977+0000","last_became_active":"2023-10-14T19:04:31.800736+0000","last_became_peered":"2023-10-14T19:04:31.800736+0000","last_unstale":"2023-10-14T19:04:31.800977+0000","last_undegraded":"2023-10-14T19:04:31.800977+0000","last_fullsized":"2023-10-14T19:04:31.800977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:49.017499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.792293+0000","last_change":"2023-10-14T19:04:31.792293+0000","last_active":"2023-10-14T19:04:31.792293+0000","last_peered":"2023-10-14T19:04:31.792293+0000","last_clean":"2023-10-14T19:04:31.792293+0000","last_became_active":"2023-10-14T19:04:31.792015+0000","last_became_peered":"2023-10-14T19:04:31.792015+0000","last_unstale":"2023-10-14T19:04:31.792293+0000","last_undegraded":"2023-10-14T19:04:31.792293+0000","last_fullsized":"2023-10-14T19:04:31.792293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:20.198256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794035+0000","last_change":"2023-10-14T19:04:31.794035+0000","last_active":"2023-10-14T19:04:31.794035+0000","last_peered":"2023-10-14T19:04:31.794035+0000","last_clean":"2023-10-14T19:04:31.794035+0000","last_became_active":"2023-10-14T19:04:31.793775+0000","last_became_peered":"2023-10-14T19:04:31.793775+0000","last_unstale":"2023-10-14T19:04:31.794035+0000","last_undegraded":"2023-10-14T19:04:31.794035+0000","last_fullsized":"2023-10-14T19:04:31.794035+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:49.536476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796720+0000","last_change":"2023-10-14T19:04:31.796720+0000","last_active":"2023-10-14T19:04:31.796720+0000","last_peered":"2023-10-14T19:04:31.796720+0000","last_clean":"2023-10-14T19:04:31.796720+0000","last_became_active":"2023-10-14T19:04:31.796436+0000","last_became_peered":"2023-10-14T19:04:31.796436+0000","last_unstale":"2023-10-14T19:04:31.796720+0000","last_undegraded":"2023-10-14T19:04:31.796720+0000","last_fullsized":"2023-10-14T19:04:31.796720+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:04.030855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795710+0000","last_change":"2023-10-14T19:04:31.795710+0000","last_active":"2023-10-14T19:04:31.795710+0000","last_peered":"2023-10-14T19:04:31.795710+0000","last_clean":"2023-10-14T19:04:31.795710+0000","last_became_active":"2023-10-14T19:04:31.795400+0000","last_became_peered":"2023-10-14T19:04:31.795400+0000","last_unstale":"2023-10-14T19:04:31.795710+0000","last_undegraded":"2023-10-14T19:04:31.795710+0000","last_fullsized":"2023-10-14T19:04:31.795710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:58.726826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795905+0000","last_change":"2023-10-14T19:04:31.795905+0000","last_active":"2023-10-14T19:04:31.795905+0000","last_peered":"2023-10-14T19:04:31.795905+0000","last_clean":"2023-10-14T19:04:31.795905+0000","last_became_active":"2023-10-14T19:04:31.795602+0000","last_became_peered":"2023-10-14T19:04:31.795602+0000","last_unstale":"2023-10-14T19:04:31.795905+0000","last_undegraded":"2023-10-14T19:04:31.795905+0000","last_fullsized":"2023-10-14T19:04:31.795905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.873430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798688+0000","last_change":"2023-10-14T19:04:31.794722+0000","last_active":"2023-10-14T19:04:31.798688+0000","last_peered":"2023-10-14T19:04:31.798688+0000","last_clean":"2023-10-14T19:04:31.798688+0000","last_became_active":"2023-10-14T19:04:31.794443+0000","last_became_peered":"2023-10-14T19:04:31.794443+0000","last_unstale":"2023-10-14T19:04:31.798688+0000","last_undegraded":"2023-10-14T19:04:31.798688+0000","last_fullsized":"2023-10-14T19:04:31.798688+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:32.598465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795858+0000","last_change":"2023-10-14T19:04:31.795858+0000","last_active":"2023-10-14T19:04:31.795858+0000","last_peered":"2023-10-14T19:04:31.795858+0000","last_clean":"2023-10-14T19:04:31.795858+0000","last_became_active":"2023-10-14T19:04:31.795555+0000","last_became_peered":"2023-10-14T19:04:31.795555+0000","last_unstale":"2023-10-14T19:04:31.795858+0000","last_undegraded":"2023-10-14T19:04:31.795858+0000","last_fullsized":"2023-10-14T19:04:31.795858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:38:38.254547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.802669+0000","last_change":"2023-10-14T19:04:31.802669+0000","last_active":"2023-10-14T19:04:31.802669+0000","last_peered":"2023-10-14T19:04:31.802669+0000","last_clean":"2023-10-14T19:04:31.802669+0000","last_became_active":"2023-10-14T19:04:31.802395+0000","last_became_peered":"2023-10-14T19:04:31.802395+0000","last_unstale":"2023-10-14T19:04:31.802669+0000","last_undegraded":"2023-10-14T19:04:31.802669+0000","last_fullsized":"2023-10-14T19:04:31.802669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:08.139676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794045+0000","last_change":"2023-10-14T19:04:31.794045+0000","last_active":"2023-10-14T19:04:31.794045+0000","last_peered":"2023-10-14T19:04:31.794045+0000","last_clean":"2023-10-14T19:04:31.794045+0000","last_became_active":"2023-10-14T19:04:31.793605+0000","last_became_peered":"2023-10-14T19:04:31.793605+0000","last_unstale":"2023-10-14T19:04:31.794045+0000","last_undegraded":"2023-10-14T19:04:31.794045+0000","last_fullsized":"2023-10-14T19:04:31.794045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:49.607600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803924+0000","last_change":"2023-10-14T19:04:31.803924+0000","last_active":"2023-10-14T19:04:31.803924+0000","last_peered":"2023-10-14T19:04:31.803924+0000","last_clean":"2023-10-14T19:04:31.803924+0000","last_became_active":"2023-10-14T19:04:31.803670+0000","last_became_peered":"2023-10-14T19:04:31.803670+0000","last_unstale":"2023-10-14T19:04:31.803924+0000","last_undegraded":"2023-10-14T19:04:31.803924+0000","last_fullsized":"2023-10-14T19:04:31.803924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:07.118249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800972+0000","last_change":"2023-10-14T19:04:31.800972+0000","last_active":"2023-10-14T19:04:31.800972+0000","last_peered":"2023-10-14T19:04:31.800972+0000","last_clean":"2023-10-14T19:04:31.800972+0000","last_became_active":"2023-10-14T19:04:31.800720+0000","last_became_peered":"2023-10-14T19:04:31.800720+0000","last_unstale":"2023-10-14T19:04:31.800972+0000","last_undegraded":"2023-10-14T19:04:31.800972+0000","last_fullsized":"2023-10-14T19:04:31.800972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:33.922793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.805296+0000","last_change":"2023-10-14T19:04:31.804500+0000","last_active":"2023-10-14T19:04:31.805296+0000","last_peered":"2023-10-14T19:04:31.805296+0000","last_clean":"2023-10-14T19:04:31.805296+0000","last_became_active":"2023-10-14T19:04:31.804243+0000","last_became_peered":"2023-10-14T19:04:31.804243+0000","last_unstale":"2023-10-14T19:04:31.805296+0000","last_undegraded":"2023-10-14T19:04:31.805296+0000","last_fullsized":"2023-10-14T19:04:31.805296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:56:27.409491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797398+0000","last_change":"2023-10-14T19:04:31.797398+0000","last_active":"2023-10-14T19:04:31.797398+0000","last_peered":"2023-10-14T19:04:31.797398+0000","last_clean":"2023-10-14T19:04:31.797398+0000","last_became_active":"2023-10-14T19:04:31.797077+0000","last_became_peered":"2023-10-14T19:04:31.797077+0000","last_unstale":"2023-10-14T19:04:31.797398+0000","last_undegraded":"2023-10-14T19:04:31.797398+0000","last_fullsized":"2023-10-14T19:04:31.797398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:44.910248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796926+0000","last_change":"2023-10-14T19:04:31.796926+0000","last_active":"2023-10-14T19:04:31.796926+0000","last_peered":"2023-10-14T19:04:31.796926+0000","last_clean":"2023-10-14T19:04:31.796926+0000","last_became_active":"2023-10-14T19:04:31.796631+0000","last_became_peered":"2023-10-14T19:04:31.796631+0000","last_unstale":"2023-10-14T19:04:31.796926+0000","last_undegraded":"2023-10-14T19:04:31.796926+0000","last_fullsized":"2023-10-14T19:04:31.796926+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:50.173129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798228+0000","last_change":"2023-10-14T19:04:31.796470+0000","last_active":"2023-10-14T19:04:31.798228+0000","last_peered":"2023-10-14T19:04:31.798228+0000","last_clean":"2023-10-14T19:04:31.798228+0000","last_became_active":"2023-10-14T19:04:31.796225+0000","last_became_peered":"2023-10-14T19:04:31.796225+0000","last_unstale":"2023-10-14T19:04:31.798228+0000","last_undegraded":"2023-10-14T19:04:31.798228+0000","last_fullsized":"2023-10-14T19:04:31.798228+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:07.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795807+0000","last_change":"2023-10-14T19:04:31.795807+0000","last_active":"2023-10-14T19:04:31.795807+0000","last_peered":"2023-10-14T19:04:31.795807+0000","last_clean":"2023-10-14T19:04:31.795807+0000","last_became_active":"2023-10-14T19:04:31.795506+0000","last_became_peered":"2023-10-14T19:04:31.795506+0000","last_unstale":"2023-10-14T19:04:31.795807+0000","last_undegraded":"2023-10-14T19:04:31.795807+0000","last_fullsized":"2023-10-14T19:04:31.795807+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:27.267092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800067+0000","last_change":"2023-10-14T19:04:31.800067+0000","last_active":"2023-10-14T19:04:31.800067+0000","last_peered":"2023-10-14T19:04:31.800067+0000","last_clean":"2023-10-14T19:04:31.800067+0000","last_became_active":"2023-10-14T19:04:31.799626+0000","last_became_peered":"2023-10-14T19:04:31.799626+0000","last_unstale":"2023-10-14T19:04:31.800067+0000","last_undegraded":"2023-10-14T19:04:31.800067+0000","last_fullsized":"2023-10-14T19:04:31.800067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:28.116611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797732+0000","last_change":"2023-10-14T19:04:31.794871+0000","last_active":"2023-10-14T19:04:31.797732+0000","last_peered":"2023-10-14T19:04:31.797732+0000","last_clean":"2023-10-14T19:04:31.797732+0000","last_became_active":"2023-10-14T19:04:31.794595+0000","last_became_peered":"2023-10-14T19:04:31.794595+0000","last_unstale":"2023-10-14T19:04:31.797732+0000","last_undegraded":"2023-10-14T19:04:31.797732+0000","last_fullsized":"2023-10-14T19:04:31.797732+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:44.045568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.802513+0000","last_change":"2023-10-14T19:04:31.802513+0000","last_active":"2023-10-14T19:04:31.802513+0000","last_peered":"2023-10-14T19:04:31.802513+0000","last_clean":"2023-10-14T19:04:31.802513+0000","last_became_active":"2023-10-14T19:04:31.802199+0000","last_became_peered":"2023-10-14T19:04:31.802199+0000","last_unstale":"2023-10-14T19:04:31.802513+0000","last_undegraded":"2023-10-14T19:04:31.802513+0000","last_fullsized":"2023-10-14T19:04:31.802513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:08:39.109060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799945+0000","last_change":"2023-10-14T19:04:31.799945+0000","last_active":"2023-10-14T19:04:31.799945+0000","last_peered":"2023-10-14T19:04:31.799945+0000","last_clean":"2023-10-14T19:04:31.799945+0000","last_became_active":"2023-10-14T19:04:31.799693+0000","last_became_peered":"2023-10-14T19:04:31.799693+0000","last_unstale":"2023-10-14T19:04:31.799945+0000","last_undegraded":"2023-10-14T19:04:31.799945+0000","last_fullsized":"2023-10-14T19:04:31.799945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:48.771477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827713+0000","last_change":"2023-10-14T19:04:30.829067+0000","last_active":"2023-10-14T19:04:31.827713+0000","last_peered":"2023-10-14T19:04:31.827713+0000","last_clean":"2023-10-14T19:04:31.827713+0000","last_became_active":"2023-10-14T19:04:30.828783+0000","last_became_peered":"2023-10-14T19:04:30.828783+0000","last_unstale":"2023-10-14T19:04:31.827713+0000","last_undegraded":"2023-10-14T19:04:31.827713+0000","last_fullsized":"2023-10-14T19:04:31.827713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.193554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800862+0000","last_change":"2023-10-14T19:04:31.800862+0000","last_active":"2023-10-14T19:04:31.800862+0000","last_peered":"2023-10-14T19:04:31.800862+0000","last_clean":"2023-10-14T19:04:31.800862+0000","last_became_active":"2023-10-14T19:04:31.800322+0000","last_became_peered":"2023-10-14T19:04:31.800322+0000","last_unstale":"2023-10-14T19:04:31.800862+0000","last_undegraded":"2023-10-14T19:04:31.800862+0000","last_fullsized":"2023-10-14T19:04:31.800862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:00.338267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.790584+0000","last_change":"2023-10-14T19:04:30.834379+0000","last_active":"2023-10-14T19:04:31.790584+0000","last_peered":"2023-10-14T19:04:31.790584+0000","last_clean":"2023-10-14T19:04:31.790584+0000","last_became_active":"2023-10-14T19:04:30.833955+0000","last_became_peered":"2023-10-14T19:04:30.833955+0000","last_unstale":"2023-10-14T19:04:31.790584+0000","last_undegraded":"2023-10-14T19:04:31.790584+0000","last_fullsized":"2023-10-14T19:04:31.790584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:21.231849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795219+0000","last_change":"2023-10-14T19:04:31.795219+0000","last_active":"2023-10-14T19:04:31.795219+0000","last_peered":"2023-10-14T19:04:31.795219+0000","last_clean":"2023-10-14T19:04:31.795219+0000","last_became_active":"2023-10-14T19:04:31.794731+0000","last_became_peered":"2023-10-14T19:04:31.794731+0000","last_unstale":"2023-10-14T19:04:31.795219+0000","last_undegraded":"2023-10-14T19:04:31.795219+0000","last_fullsized":"2023-10-14T19:04:31.795219+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:53.431722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827340+0000","last_change":"2023-10-14T19:04:30.837671+0000","last_active":"2023-10-14T19:04:31.827340+0000","last_peered":"2023-10-14T19:04:31.827340+0000","last_clean":"2023-10-14T19:04:31.827340+0000","last_became_active":"2023-10-14T19:04:30.837307+0000","last_became_peered":"2023-10-14T19:04:30.837307+0000","last_unstale":"2023-10-14T19:04:31.827340+0000","last_undegraded":"2023-10-14T19:04:31.827340+0000","last_fullsized":"2023-10-14T19:04:31.827340+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:25.044543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803206+0000","last_change":"2023-10-14T19:04:31.803206+0000","last_active":"2023-10-14T19:04:31.803206+0000","last_peered":"2023-10-14T19:04:31.803206+0000","last_clean":"2023-10-14T19:04:31.803206+0000","last_became_active":"2023-10-14T19:04:31.802880+0000","last_became_peered":"2023-10-14T19:04:31.802880+0000","last_unstale":"2023-10-14T19:04:31.803206+0000","last_undegraded":"2023-10-14T19:04:31.803206+0000","last_fullsized":"2023-10-14T19:04:31.803206+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:22.236551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.824907+0000","last_change":"2023-10-14T19:04:30.828998+0000","last_active":"2023-10-14T19:04:31.824907+0000","last_peered":"2023-10-14T19:04:31.824907+0000","last_clean":"2023-10-14T19:04:31.824907+0000","last_became_active":"2023-10-14T19:04:30.828725+0000","last_became_peered":"2023-10-14T19:04:30.828725+0000","last_unstale":"2023-10-14T19:04:31.824907+0000","last_undegraded":"2023-10-14T19:04:31.824907+0000","last_fullsized":"2023-10-14T19:04:31.824907+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:48.531774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794115+0000","last_change":"2023-10-14T19:04:31.794115+0000","last_active":"2023-10-14T19:04:31.794115+0000","last_peered":"2023-10-14T19:04:31.794115+0000","last_clean":"2023-10-14T19:04:31.794115+0000","last_became_active":"2023-10-14T19:04:31.793774+0000","last_became_peered":"2023-10-14T19:04:31.793774+0000","last_unstale":"2023-10-14T19:04:31.794115+0000","last_undegraded":"2023-10-14T19:04:31.794115+0000","last_fullsized":"2023-10-14T19:04:31.794115+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:09.657442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.785660+0000","last_change":"2023-10-14T19:04:30.828631+0000","last_active":"2023-10-14T19:04:31.785660+0000","last_peered":"2023-10-14T19:04:31.785660+0000","last_clean":"2023-10-14T19:04:31.785660+0000","last_became_active":"2023-10-14T19:04:30.828336+0000","last_became_peered":"2023-10-14T19:04:30.828336+0000","last_unstale":"2023-10-14T19:04:31.785660+0000","last_undegraded":"2023-10-14T19:04:31.785660+0000","last_fullsized":"2023-10-14T19:04:31.785660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:32.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795708+0000","last_change":"2023-10-14T19:04:31.795708+0000","last_active":"2023-10-14T19:04:31.795708+0000","last_peered":"2023-10-14T19:04:31.795708+0000","last_clean":"2023-10-14T19:04:31.795708+0000","last_became_active":"2023-10-14T19:04:31.795424+0000","last_became_peered":"2023-10-14T19:04:31.795424+0000","last_unstale":"2023-10-14T19:04:31.795708+0000","last_undegraded":"2023-10-14T19:04:31.795708+0000","last_fullsized":"2023-10-14T19:04:31.795708+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:59.903331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.791756+0000","last_change":"2023-10-14T19:04:30.832572+0000","last_active":"2023-10-14T19:04:31.791756+0000","last_peered":"2023-10-14T19:04:31.791756+0000","last_clean":"2023-10-14T19:04:31.791756+0000","last_became_active":"2023-10-14T19:04:30.832310+0000","last_became_peered":"2023-10-14T19:04:30.832310+0000","last_unstale":"2023-10-14T19:04:31.791756+0000","last_undegraded":"2023-10-14T19:04:31.791756+0000","last_fullsized":"2023-10-14T19:04:31.791756+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:31.032258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799162+0000","last_change":"2023-10-14T19:04:31.799162+0000","last_active":"2023-10-14T19:04:31.799162+0000","last_peered":"2023-10-14T19:04:31.799162+0000","last_clean":"2023-10-14T19:04:31.799162+0000","last_became_active":"2023-10-14T19:04:31.798898+0000","last_became_peered":"2023-10-14T19:04:31.798898+0000","last_unstale":"2023-10-14T19:04:31.799162+0000","last_undegraded":"2023-10-14T19:04:31.799162+0000","last_fullsized":"2023-10-14T19:04:31.799162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:21.528825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835653+0000","last_change":"2023-10-14T19:04:30.829773+0000","last_active":"2023-10-14T19:04:30.835653+0000","last_peered":"2023-10-14T19:04:30.835653+0000","last_clean":"2023-10-14T19:04:30.835653+0000","last_became_active":"2023-10-14T19:04:30.829468+0000","last_became_peered":"2023-10-14T19:04:30.829468+0000","last_unstale":"2023-10-14T19:04:30.835653+0000","last_undegraded":"2023-10-14T19:04:30.835653+0000","last_fullsized":"2023-10-14T19:04:30.835653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:01.526602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798212+0000","last_change":"2023-10-14T19:04:31.798212+0000","last_active":"2023-10-14T19:04:31.798212+0000","last_peered":"2023-10-14T19:04:31.798212+0000","last_clean":"2023-10-14T19:04:31.798212+0000","last_became_active":"2023-10-14T19:04:31.796568+0000","last_became_peered":"2023-10-14T19:04:31.796568+0000","last_unstale":"2023-10-14T19:04:31.798212+0000","last_undegraded":"2023-10-14T19:04:31.798212+0000","last_fullsized":"2023-10-14T19:04:31.798212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:08.805174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.841145+0000","last_change":"2023-10-14T19:04:30.836615+0000","last_active":"2023-10-14T19:04:30.841145+0000","last_peered":"2023-10-14T19:04:30.841145+0000","last_clean":"2023-10-14T19:04:30.841145+0000","last_became_active":"2023-10-14T19:04:30.836367+0000","last_became_peered":"2023-10-14T19:04:30.836367+0000","last_unstale":"2023-10-14T19:04:30.841145+0000","last_undegraded":"2023-10-14T19:04:30.841145+0000","last_fullsized":"2023-10-14T19:04:30.841145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.688447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801478+0000","last_change":"2023-10-14T19:04:31.801478+0000","last_active":"2023-10-14T19:04:31.801478+0000","last_peered":"2023-10-14T19:04:31.801478+0000","last_clean":"2023-10-14T19:04:31.801478+0000","last_became_active":"2023-10-14T19:04:31.801184+0000","last_became_peered":"2023-10-14T19:04:31.801184+0000","last_unstale":"2023-10-14T19:04:31.801478+0000","last_undegraded":"2023-10-14T19:04:31.801478+0000","last_fullsized":"2023-10-14T19:04:31.801478+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:02.531304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.841702+0000","last_change":"2023-10-14T19:04:30.838911+0000","last_active":"2023-10-14T19:04:30.841702+0000","last_peered":"2023-10-14T19:04:30.841702+0000","last_clean":"2023-10-14T19:04:30.841702+0000","last_became_active":"2023-10-14T19:04:30.838527+0000","last_became_peered":"2023-10-14T19:04:30.838527+0000","last_unstale":"2023-10-14T19:04:30.841702+0000","last_undegraded":"2023-10-14T19:04:30.841702+0000","last_fullsized":"2023-10-14T19:04:30.841702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:37.922323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.804722+0000","last_change":"2023-10-14T19:04:31.804722+0000","last_active":"2023-10-14T19:04:31.804722+0000","last_peered":"2023-10-14T19:04:31.804722+0000","last_clean":"2023-10-14T19:04:31.804722+0000","last_became_active":"2023-10-14T19:04:31.804469+0000","last_became_peered":"2023-10-14T19:04:31.804469+0000","last_unstale":"2023-10-14T19:04:31.804722+0000","last_undegraded":"2023-10-14T19:04:31.804722+0000","last_fullsized":"2023-10-14T19:04:31.804722+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:00.174039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835723+0000","last_change":"2023-10-14T19:04:30.833737+0000","last_active":"2023-10-14T19:04:30.835723+0000","last_peered":"2023-10-14T19:04:30.835723+0000","last_clean":"2023-10-14T19:04:30.835723+0000","last_became_active":"2023-10-14T19:04:30.832294+0000","last_became_peered":"2023-10-14T19:04:30.832294+0000","last_unstale":"2023-10-14T19:04:30.835723+0000","last_undegraded":"2023-10-14T19:04:30.835723+0000","last_fullsized":"2023-10-14T19:04:30.835723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:39.885449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801763+0000","last_change":"2023-10-14T19:04:31.801763+0000","last_active":"2023-10-14T19:04:31.801763+0000","last_peered":"2023-10-14T19:04:31.801763+0000","last_clean":"2023-10-14T19:04:31.801763+0000","last_became_active":"2023-10-14T19:04:31.801301+0000","last_became_peered":"2023-10-14T19:04:31.801301+0000","last_unstale":"2023-10-14T19:04:31.801763+0000","last_undegraded":"2023-10-14T19:04:31.801763+0000","last_fullsized":"2023-10-14T19:04:31.801763+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:05.185952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827765+0000","last_change":"2023-10-14T19:04:30.838459+0000","last_active":"2023-10-14T19:04:31.827765+0000","last_peered":"2023-10-14T19:04:31.827765+0000","last_clean":"2023-10-14T19:04:31.827765+0000","last_became_active":"2023-10-14T19:04:30.838170+0000","last_became_peered":"2023-10-14T19:04:30.838170+0000","last_unstale":"2023-10-14T19:04:31.827765+0000","last_undegraded":"2023-10-14T19:04:31.827765+0000","last_fullsized":"2023-10-14T19:04:31.827765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:52.350856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.805142+0000","last_change":"2023-10-14T19:04:31.805142+0000","last_active":"2023-10-14T19:04:31.805142+0000","last_peered":"2023-10-14T19:04:31.805142+0000","last_clean":"2023-10-14T19:04:31.805142+0000","last_became_active":"2023-10-14T19:04:31.804873+0000","last_became_peered":"2023-10-14T19:04:31.804873+0000","last_unstale":"2023-10-14T19:04:31.805142+0000","last_undegraded":"2023-10-14T19:04:31.805142+0000","last_fullsized":"2023-10-14T19:04:31.805142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:44.118301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828151+0000","last_change":"2023-10-14T19:04:30.835702+0000","last_active":"2023-10-14T19:04:31.828151+0000","last_peered":"2023-10-14T19:04:31.828151+0000","last_clean":"2023-10-14T19:04:31.828151+0000","last_became_active":"2023-10-14T19:04:30.835438+0000","last_became_peered":"2023-10-14T19:04:30.835438+0000","last_unstale":"2023-10-14T19:04:31.828151+0000","last_undegraded":"2023-10-14T19:04:31.828151+0000","last_fullsized":"2023-10-14T19:04:31.828151+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:04.601734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794812+0000","last_change":"2023-10-14T19:04:31.794812+0000","last_active":"2023-10-14T19:04:31.794812+0000","last_peered":"2023-10-14T19:04:31.794812+0000","last_clean":"2023-10-14T19:04:31.794812+0000","last_became_active":"2023-10-14T19:04:31.794537+0000","last_became_peered":"2023-10-14T19:04:31.794537+0000","last_unstale":"2023-10-14T19:04:31.794812+0000","last_undegraded":"2023-10-14T19:04:31.794812+0000","last_fullsized":"2023-10-14T19:04:31.794812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:04.030855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827321+0000","last_change":"2023-10-14T19:04:30.832233+0000","last_active":"2023-10-14T19:04:31.827321+0000","last_peered":"2023-10-14T19:04:31.827321+0000","last_clean":"2023-10-14T19:04:31.827321+0000","last_became_active":"2023-10-14T19:04:30.831954+0000","last_became_peered":"2023-10-14T19:04:30.831954+0000","last_unstale":"2023-10-14T19:04:31.827321+0000","last_undegraded":"2023-10-14T19:04:31.827321+0000","last_fullsized":"2023-10-14T19:04:31.827321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:40.794556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796399+0000","last_change":"2023-10-14T19:04:31.796399+0000","last_active":"2023-10-14T19:04:31.796399+0000","last_peered":"2023-10-14T19:04:31.796399+0000","last_clean":"2023-10-14T19:04:31.796399+0000","last_became_active":"2023-10-14T19:04:31.796160+0000","last_became_peered":"2023-10-14T19:04:31.796160+0000","last_unstale":"2023-10-14T19:04:31.796399+0000","last_undegraded":"2023-10-14T19:04:31.796399+0000","last_fullsized":"2023-10-14T19:04:31.796399+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:38.613232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835685+0000","last_change":"2023-10-14T19:04:30.833845+0000","last_active":"2023-10-14T19:04:30.835685+0000","last_peered":"2023-10-14T19:04:30.835685+0000","last_clean":"2023-10-14T19:04:30.835685+0000","last_became_active":"2023-10-14T19:04:30.833594+0000","last_became_peered":"2023-10-14T19:04:30.833594+0000","last_unstale":"2023-10-14T19:04:30.835685+0000","last_undegraded":"2023-10-14T19:04:30.835685+0000","last_fullsized":"2023-10-14T19:04:30.835685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:51.054136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794224+0000","last_change":"2023-10-14T19:04:31.794224+0000","last_active":"2023-10-14T19:04:31.794224+0000","last_peered":"2023-10-14T19:04:31.794224+0000","last_clean":"2023-10-14T19:04:31.794224+0000","last_became_active":"2023-10-14T19:04:31.793955+0000","last_became_peered":"2023-10-14T19:04:31.793955+0000","last_unstale":"2023-10-14T19:04:31.794224+0000","last_undegraded":"2023-10-14T19:04:31.794224+0000","last_fullsized":"2023-10-14T19:04:31.794224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:08.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835822+0000","last_change":"2023-10-14T19:04:30.833706+0000","last_active":"2023-10-14T19:04:30.835822+0000","last_peered":"2023-10-14T19:04:30.835822+0000","last_clean":"2023-10-14T19:04:30.835822+0000","last_became_active":"2023-10-14T19:04:30.833445+0000","last_became_peered":"2023-10-14T19:04:30.833445+0000","last_unstale":"2023-10-14T19:04:30.835822+0000","last_undegraded":"2023-10-14T19:04:30.835822+0000","last_fullsized":"2023-10-14T19:04:30.835822+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:59.333565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803984+0000","last_change":"2023-10-14T19:04:31.803984+0000","last_active":"2023-10-14T19:04:31.803984+0000","last_peered":"2023-10-14T19:04:31.803984+0000","last_clean":"2023-10-14T19:04:31.803984+0000","last_became_active":"2023-10-14T19:04:31.803699+0000","last_became_peered":"2023-10-14T19:04:31.803699+0000","last_unstale":"2023-10-14T19:04:31.803984+0000","last_undegraded":"2023-10-14T19:04:31.803984+0000","last_fullsized":"2023-10-14T19:04:31.803984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:09.657442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828513+0000","last_change":"2023-10-14T19:04:30.838309+0000","last_active":"2023-10-14T19:04:31.828513+0000","last_peered":"2023-10-14T19:04:31.828513+0000","last_clean":"2023-10-14T19:04:31.828513+0000","last_became_active":"2023-10-14T19:04:30.838018+0000","last_became_peered":"2023-10-14T19:04:30.838018+0000","last_unstale":"2023-10-14T19:04:31.828513+0000","last_undegraded":"2023-10-14T19:04:31.828513+0000","last_fullsized":"2023-10-14T19:04:31.828513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.567939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799578+0000","last_change":"2023-10-14T19:04:31.799578+0000","last_active":"2023-10-14T19:04:31.799578+0000","last_peered":"2023-10-14T19:04:31.799578+0000","last_clean":"2023-10-14T19:04:31.799578+0000","last_became_active":"2023-10-14T19:04:31.799291+0000","last_became_peered":"2023-10-14T19:04:31.799291+0000","last_unstale":"2023-10-14T19:04:31.799578+0000","last_undegraded":"2023-10-14T19:04:31.799578+0000","last_fullsized":"2023-10-14T19:04:31.799578+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:40.890151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.790841+0000","last_change":"2023-10-14T19:04:30.832355+0000","last_active":"2023-10-14T19:04:31.790841+0000","last_peered":"2023-10-14T19:04:31.790841+0000","last_clean":"2023-10-14T19:04:31.790841+0000","last_became_active":"2023-10-14T19:04:30.831721+0000","last_became_peered":"2023-10-14T19:04:30.831721+0000","last_unstale":"2023-10-14T19:04:31.790841+0000","last_undegraded":"2023-10-14T19:04:31.790841+0000","last_fullsized":"2023-10-14T19:04:31.790841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:03.026153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.804583+0000","last_change":"2023-10-14T19:04:31.804583+0000","last_active":"2023-10-14T19:04:31.804583+0000","last_peered":"2023-10-14T19:04:31.804583+0000","last_clean":"2023-10-14T19:04:31.804583+0000","last_became_active":"2023-10-14T19:04:31.804255+0000","last_became_peered":"2023-10-14T19:04:31.804255+0000","last_unstale":"2023-10-14T19:04:31.804583+0000","last_undegraded":"2023-10-14T19:04:31.804583+0000","last_fullsized":"2023-10-14T19:04:31.804583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:48.771477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827865+0000","last_change":"2023-10-14T19:04:30.831458+0000","last_active":"2023-10-14T19:04:31.827865+0000","last_peered":"2023-10-14T19:04:31.827865+0000","last_clean":"2023-10-14T19:04:31.827865+0000","last_became_active":"2023-10-14T19:04:30.831205+0000","last_became_peered":"2023-10-14T19:04:30.831205+0000","last_unstale":"2023-10-14T19:04:31.827865+0000","last_undegraded":"2023-10-14T19:04:31.827865+0000","last_fullsized":"2023-10-14T19:04:31.827865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:05.959809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799166+0000","last_change":"2023-10-14T19:04:31.799166+0000","last_active":"2023-10-14T19:04:31.799166+0000","last_peered":"2023-10-14T19:04:31.799166+0000","last_clean":"2023-10-14T19:04:31.799166+0000","last_became_active":"2023-10-14T19:04:31.798907+0000","last_became_peered":"2023-10-14T19:04:31.798907+0000","last_unstale":"2023-10-14T19:04:31.799166+0000","last_undegraded":"2023-10-14T19:04:31.799166+0000","last_fullsized":"2023-10-14T19:04:31.799166+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:04.064360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.786872+0000","last_change":"2023-10-14T19:04:30.833941+0000","last_active":"2023-10-14T19:04:31.786872+0000","last_peered":"2023-10-14T19:04:31.786872+0000","last_clean":"2023-10-14T19:04:31.786872+0000","last_became_active":"2023-10-14T19:04:30.833587+0000","last_became_peered":"2023-10-14T19:04:30.833587+0000","last_unstale":"2023-10-14T19:04:31.786872+0000","last_undegraded":"2023-10-14T19:04:31.786872+0000","last_fullsized":"2023-10-14T19:04:31.786872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:07.583562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.805164+0000","last_change":"2023-10-14T19:04:31.805164+0000","last_active":"2023-10-14T19:04:31.805164+0000","last_peered":"2023-10-14T19:04:31.805164+0000","last_clean":"2023-10-14T19:04:31.805164+0000","last_became_active":"2023-10-14T19:04:31.804933+0000","last_became_peered":"2023-10-14T19:04:31.804933+0000","last_unstale":"2023-10-14T19:04:31.805164+0000","last_undegraded":"2023-10-14T19:04:31.805164+0000","last_fullsized":"2023-10-14T19:04:31.805164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:15.636009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.837589+0000","last_change":"2023-10-14T19:04:30.835234+0000","last_active":"2023-10-14T19:04:30.837589+0000","last_peered":"2023-10-14T19:04:30.837589+0000","last_clean":"2023-10-14T19:04:30.837589+0000","last_became_active":"2023-10-14T19:04:30.834972+0000","last_became_peered":"2023-10-14T19:04:30.834972+0000","last_unstale":"2023-10-14T19:04:30.837589+0000","last_undegraded":"2023-10-14T19:04:30.837589+0000","last_fullsized":"2023-10-14T19:04:30.837589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:21.576736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794309+0000","last_change":"2023-10-14T19:04:31.794309+0000","last_active":"2023-10-14T19:04:31.794309+0000","last_peered":"2023-10-14T19:04:31.794309+0000","last_clean":"2023-10-14T19:04:31.794309+0000","last_became_active":"2023-10-14T19:04:31.793564+0000","last_became_peered":"2023-10-14T19:04:31.793564+0000","last_unstale":"2023-10-14T19:04:31.794309+0000","last_undegraded":"2023-10-14T19:04:31.794309+0000","last_fullsized":"2023-10-14T19:04:31.794309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:50.173129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828104+0000","last_change":"2023-10-14T19:04:30.831715+0000","last_active":"2023-10-14T19:04:31.828104+0000","last_peered":"2023-10-14T19:04:31.828104+0000","last_clean":"2023-10-14T19:04:31.828104+0000","last_became_active":"2023-10-14T19:04:30.831419+0000","last_became_peered":"2023-10-14T19:04:30.831419+0000","last_unstale":"2023-10-14T19:04:31.828104+0000","last_undegraded":"2023-10-14T19:04:31.828104+0000","last_fullsized":"2023-10-14T19:04:31.828104+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:43.905547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797366+0000","last_change":"2023-10-14T19:04:31.797366+0000","last_active":"2023-10-14T19:04:31.797366+0000","last_peered":"2023-10-14T19:04:31.797366+0000","last_clean":"2023-10-14T19:04:31.797366+0000","last_became_active":"2023-10-14T19:04:31.796335+0000","last_became_peered":"2023-10-14T19:04:31.796335+0000","last_unstale":"2023-10-14T19:04:31.797366+0000","last_undegraded":"2023-10-14T19:04:31.797366+0000","last_fullsized":"2023-10-14T19:04:31.797366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:40.890151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836767+0000","last_change":"2023-10-14T19:04:30.828570+0000","last_active":"2023-10-14T19:04:30.836767+0000","last_peered":"2023-10-14T19:04:30.836767+0000","last_clean":"2023-10-14T19:04:30.836767+0000","last_became_active":"2023-10-14T19:04:30.828299+0000","last_became_peered":"2023-10-14T19:04:30.828299+0000","last_unstale":"2023-10-14T19:04:30.836767+0000","last_undegraded":"2023-10-14T19:04:30.836767+0000","last_fullsized":"2023-10-14T19:04:30.836767+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:04.601734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799340+0000","last_change":"2023-10-14T19:04:31.799340+0000","last_active":"2023-10-14T19:04:31.799340+0000","last_peered":"2023-10-14T19:04:31.799340+0000","last_clean":"2023-10-14T19:04:31.799340+0000","last_became_active":"2023-10-14T19:04:31.799067+0000","last_became_peered":"2023-10-14T19:04:31.799067+0000","last_unstale":"2023-10-14T19:04:31.799340+0000","last_undegraded":"2023-10-14T19:04:31.799340+0000","last_fullsized":"2023-10-14T19:04:31.799340+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:44.910248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.838092+0000","last_change":"2023-10-14T19:04:30.836207+0000","last_active":"2023-10-14T19:04:30.838092+0000","last_peered":"2023-10-14T19:04:30.838092+0000","last_clean":"2023-10-14T19:04:30.838092+0000","last_became_active":"2023-10-14T19:04:30.835925+0000","last_became_peered":"2023-10-14T19:04:30.835925+0000","last_unstale":"2023-10-14T19:04:30.838092+0000","last_undegraded":"2023-10-14T19:04:30.838092+0000","last_fullsized":"2023-10-14T19:04:30.838092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.193554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794437+0000","last_change":"2023-10-14T19:04:31.794437+0000","last_active":"2023-10-14T19:04:31.794437+0000","last_peered":"2023-10-14T19:04:31.794437+0000","last_clean":"2023-10-14T19:04:31.794437+0000","last_became_active":"2023-10-14T19:04:31.794173+0000","last_became_peered":"2023-10-14T19:04:31.794173+0000","last_unstale":"2023-10-14T19:04:31.794437+0000","last_undegraded":"2023-10-14T19:04:31.794437+0000","last_fullsized":"2023-10-14T19:04:31.794437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:41.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828222+0000","last_change":"2023-10-14T19:04:30.833030+0000","last_active":"2023-10-14T19:04:31.828222+0000","last_peered":"2023-10-14T19:04:31.828222+0000","last_clean":"2023-10-14T19:04:31.828222+0000","last_became_active":"2023-10-14T19:04:30.832806+0000","last_became_peered":"2023-10-14T19:04:30.832806+0000","last_unstale":"2023-10-14T19:04:31.828222+0000","last_undegraded":"2023-10-14T19:04:31.828222+0000","last_fullsized":"2023-10-14T19:04:31.828222+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.688447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794095+0000","last_change":"2023-10-14T19:04:31.794095+0000","last_active":"2023-10-14T19:04:31.794095+0000","last_peered":"2023-10-14T19:04:31.794095+0000","last_clean":"2023-10-14T19:04:31.794095+0000","last_became_active":"2023-10-14T19:04:31.793827+0000","last_became_peered":"2023-10-14T19:04:31.793827+0000","last_unstale":"2023-10-14T19:04:31.794095+0000","last_undegraded":"2023-10-14T19:04:31.794095+0000","last_fullsized":"2023-10-14T19:04:31.794095+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:22.236551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.834866+0000","last_change":"2023-10-14T19:04:30.830942+0000","last_active":"2023-10-14T19:04:30.834866+0000","last_peered":"2023-10-14T19:04:30.834866+0000","last_clean":"2023-10-14T19:04:30.834866+0000","last_became_active":"2023-10-14T19:04:30.830670+0000","last_became_peered":"2023-10-14T19:04:30.830670+0000","last_unstale":"2023-10-14T19:04:30.834866+0000","last_undegraded":"2023-10-14T19:04:30.834866+0000","last_fullsized":"2023-10-14T19:04:30.834866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:57.546903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801563+0000","last_change":"2023-10-14T19:04:31.801563+0000","last_active":"2023-10-14T19:04:31.801563+0000","last_peered":"2023-10-14T19:04:31.801563+0000","last_clean":"2023-10-14T19:04:31.801563+0000","last_became_active":"2023-10-14T19:04:31.800942+0000","last_became_peered":"2023-10-14T19:04:31.800942+0000","last_unstale":"2023-10-14T19:04:31.801563+0000","last_undegraded":"2023-10-14T19:04:31.801563+0000","last_fullsized":"2023-10-14T19:04:31.801563+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:02.531304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835177+0000","last_change":"2023-10-14T19:04:30.830034+0000","last_active":"2023-10-14T19:04:30.835177+0000","last_peered":"2023-10-14T19:04:30.835177+0000","last_clean":"2023-10-14T19:04:30.835177+0000","last_became_active":"2023-10-14T19:04:30.829448+0000","last_became_peered":"2023-10-14T19:04:30.829448+0000","last_unstale":"2023-10-14T19:04:30.835177+0000","last_undegraded":"2023-10-14T19:04:30.835177+0000","last_fullsized":"2023-10-14T19:04:30.835177+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:01.827976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803605+0000","last_change":"2023-10-14T19:04:31.803605+0000","last_active":"2023-10-14T19:04:31.803605+0000","last_peered":"2023-10-14T19:04:31.803605+0000","last_clean":"2023-10-14T19:04:31.803605+0000","last_became_active":"2023-10-14T19:04:31.803251+0000","last_became_peered":"2023-10-14T19:04:31.803251+0000","last_unstale":"2023-10-14T19:04:31.803605+0000","last_undegraded":"2023-10-14T19:04:31.803605+0000","last_fullsized":"2023-10-14T19:04:31.803605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:41.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835796+0000","last_change":"2023-10-14T19:04:30.829976+0000","last_active":"2023-10-14T19:04:30.835796+0000","last_peered":"2023-10-14T19:04:30.835796+0000","last_clean":"2023-10-14T19:04:30.835796+0000","last_became_active":"2023-10-14T19:04:30.829702+0000","last_became_peered":"2023-10-14T19:04:30.829702+0000","last_unstale":"2023-10-14T19:04:30.835796+0000","last_undegraded":"2023-10-14T19:04:30.835796+0000","last_fullsized":"2023-10-14T19:04:30.835796+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:04.181250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.793905+0000","last_change":"2023-10-14T19:04:31.793905+0000","last_active":"2023-10-14T19:04:31.793905+0000","last_peered":"2023-10-14T19:04:31.793905+0000","last_clean":"2023-10-14T19:04:31.793905+0000","last_became_active":"2023-10-14T19:04:31.793088+0000","last_became_peered":"2023-10-14T19:04:31.793088+0000","last_unstale":"2023-10-14T19:04:31.793905+0000","last_undegraded":"2023-10-14T19:04:31.793905+0000","last_fullsized":"2023-10-14T19:04:31.793905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:18.969855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836881+0000","last_change":"2023-10-14T19:04:30.833547+0000","last_active":"2023-10-14T19:04:30.836881+0000","last_peered":"2023-10-14T19:04:30.836881+0000","last_clean":"2023-10-14T19:04:30.836881+0000","last_became_active":"2023-10-14T19:04:30.833260+0000","last_became_peered":"2023-10-14T19:04:30.833260+0000","last_unstale":"2023-10-14T19:04:30.836881+0000","last_undegraded":"2023-10-14T19:04:30.836881+0000","last_fullsized":"2023-10-14T19:04:30.836881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:00.532841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801672+0000","last_change":"2023-10-14T19:04:31.801672+0000","last_active":"2023-10-14T19:04:31.801672+0000","last_peered":"2023-10-14T19:04:31.801672+0000","last_clean":"2023-10-14T19:04:31.801672+0000","last_became_active":"2023-10-14T19:04:31.801395+0000","last_became_peered":"2023-10-14T19:04:31.801395+0000","last_unstale":"2023-10-14T19:04:31.801672+0000","last_undegraded":"2023-10-14T19:04:31.801672+0000","last_fullsized":"2023-10-14T19:04:31.801672+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:56:29.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.841082+0000","last_change":"2023-10-14T19:04:30.835313+0000","last_active":"2023-10-14T19:04:30.841082+0000","last_peered":"2023-10-14T19:04:30.841082+0000","last_clean":"2023-10-14T19:04:30.841082+0000","last_became_active":"2023-10-14T19:04:30.834981+0000","last_became_peered":"2023-10-14T19:04:30.834981+0000","last_unstale":"2023-10-14T19:04:30.841082+0000","last_undegraded":"2023-10-14T19:04:30.841082+0000","last_fullsized":"2023-10-14T19:04:30.841082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:00.532841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798032+0000","last_change":"2023-10-14T19:04:31.798032+0000","last_active":"2023-10-14T19:04:31.798032+0000","last_peered":"2023-10-14T19:04:31.798032+0000","last_clean":"2023-10-14T19:04:31.798032+0000","last_became_active":"2023-10-14T19:04:31.797783+0000","last_became_peered":"2023-10-14T19:04:31.797783+0000","last_unstale":"2023-10-14T19:04:31.798032+0000","last_undegraded":"2023-10-14T19:04:31.798032+0000","last_fullsized":"2023-10-14T19:04:31.798032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:08.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836900+0000","last_change":"2023-10-14T19:04:30.835048+0000","last_active":"2023-10-14T19:04:30.836900+0000","last_peered":"2023-10-14T19:04:30.836900+0000","last_clean":"2023-10-14T19:04:30.836900+0000","last_became_active":"2023-10-14T19:04:30.834774+0000","last_became_peered":"2023-10-14T19:04:30.834774+0000","last_unstale":"2023-10-14T19:04:30.836900+0000","last_undegraded":"2023-10-14T19:04:30.836900+0000","last_fullsized":"2023-10-14T19:04:30.836900+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:32.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796338+0000","last_change":"2023-10-14T19:04:31.796338+0000","last_active":"2023-10-14T19:04:31.796338+0000","last_peered":"2023-10-14T19:04:31.796338+0000","last_clean":"2023-10-14T19:04:31.796338+0000","last_became_active":"2023-10-14T19:04:31.796023+0000","last_became_peered":"2023-10-14T19:04:31.796023+0000","last_unstale":"2023-10-14T19:04:31.796338+0000","last_undegraded":"2023-10-14T19:04:31.796338+0000","last_fullsized":"2023-10-14T19:04:31.796338+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:02.402891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836990+0000","last_change":"2023-10-14T19:04:30.835110+0000","last_active":"2023-10-14T19:04:30.836990+0000","last_peered":"2023-10-14T19:04:30.836990+0000","last_clean":"2023-10-14T19:04:30.836990+0000","last_became_active":"2023-10-14T19:04:30.834766+0000","last_became_peered":"2023-10-14T19:04:30.834766+0000","last_unstale":"2023-10-14T19:04:30.836990+0000","last_undegraded":"2023-10-14T19:04:30.836990+0000","last_fullsized":"2023-10-14T19:04:30.836990+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:47.766775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799793+0000","last_change":"2023-10-14T19:04:31.799793+0000","last_active":"2023-10-14T19:04:31.799793+0000","last_peered":"2023-10-14T19:04:31.799793+0000","last_clean":"2023-10-14T19:04:31.799793+0000","last_became_active":"2023-10-14T19:04:31.796235+0000","last_became_peered":"2023-10-14T19:04:31.796235+0000","last_unstale":"2023-10-14T19:04:31.799793+0000","last_undegraded":"2023-10-14T19:04:31.799793+0000","last_fullsized":"2023-10-14T19:04:31.799793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:26.684280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.830233+0000","last_change":"2023-10-14T19:04:30.828303+0000","last_active":"2023-10-14T19:04:30.830233+0000","last_peered":"2023-10-14T19:04:30.830233+0000","last_clean":"2023-10-14T19:04:30.830233+0000","last_became_active":"2023-10-14T19:04:30.828006+0000","last_became_peered":"2023-10-14T19:04:30.828006+0000","last_unstale":"2023-10-14T19:04:30.830233+0000","last_undegraded":"2023-10-14T19:04:30.830233+0000","last_fullsized":"2023-10-14T19:04:30.830233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:57:08.924836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.827576+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:30.827576+0000","last_peered":"2023-10-14T19:04:30.827576+0000","last_clean":"2023-10-14T19:04:30.827576+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:30.827576+0000","last_undegraded":"2023-10-14T19:04:30.827576+0000","last_fullsized":"2023-10-14T19:04:30.827576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":846243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.626}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.441}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":610304,"data_stored":255715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.75600000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301984,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069856,"statfs":{"total":96636764160,"available":96327532544,"internally_reserved":0,"allocated":614400,"data_stored":255805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.215},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.249},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":848173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34499999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.311},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28799999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.504},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":255771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.317},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.33400000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.374}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":255771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.435}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64000000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297896,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":622592,"data_stored":257251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":3.3220000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":5.7830000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":3.488},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":1.254}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.6200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":3.5230000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":1.2949999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":1.5269999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":3.9729999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":3.6259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":256339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.503},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:04:35.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:04:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.089+0000 7f274b86a700 1 Processor -- start 2023-10-14T19:04:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.089+0000 7f274b86a700 1 -- start start 2023-10-14T19:04:36.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f274b86a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27440cf200 0x7f27440c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f274b86a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440b0ba0 0x7f274406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f274b86a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274415a280 con 0x7f27440b07d0 2023-10-14T19:04:36.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f274b86a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274406e180 con 0x7f27440cf200 2023-10-14T19:04:36.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f274b86a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274406d850 con 0x7f27440b0ba0 2023-10-14T19:04:36.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2748e05700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27440cf200 0x7f27440c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2749e07700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440b0ba0 0x7f274406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2748e05700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27440cf200 0x7f27440c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:58662/0 (socket says 172.21.15.7:58662) 2023-10-14T19:04:36.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2749606700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f27440b07d0 0x7f27440ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:34132/0 (socket says 172.21.15.7:34132) 2023-10-14T19:04:36.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2748e05700 1 -- 172.21.15.7:0/3727445576 learned_addr learned my addr 172.21.15.7:0/3727445576 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:36.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2748e05700 1 -- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440b0ba0 msgr2=0x7f274406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:36.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2748e05700 1 --2- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440b0ba0 0x7f274406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.090+0000 7f2748e05700 1 -- 172.21.15.7:0/3727445576 >> v1:172.21.15.148:6789/0 conn(0x7f27440b07d0 legacy=0x7f27440ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f2748e05700 1 -- 172.21.15.7:0/3727445576 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274406db30 con 0x7f27440cf200 2023-10-14T19:04:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f273bfff700 1 -- 172.21.15.7:0/3727445576 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402384887 0 0) 0x7f274415a280 con 0x7f27440b07d0 2023-10-14T19:04:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f2748e05700 1 --2- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440cf200 0x7f27440c42c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27340099b0 tx=0x7f2734009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139dab325a2ea9df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f273bfff700 1 -- 172.21.15.7:0/3727445576 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734009ea0 con 0x7f27440cf200 2023-10-14T19:04:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f273bfff700 1 -- 172.21.15.7:0/3727445576 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273400b860 con 0x7f27440cf200 2023-10-14T19:04:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f273bfff700 1 -- 172.21.15.7:0/3727445576 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400bc00 con 0x7f27440cf200 2023-10-14T19:04:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f274b86a700 1 -- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440cf200 msgr2=0x7f27440c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f274b86a700 1 --2- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440cf200 0x7f27440c42c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27340099b0 tx=0x7f2734009250 comp rx=0 tx=0).stop 2023-10-14T19:04:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f274b86a700 1 -- 172.21.15.7:0/3727445576 shutdown_connections 2023-10-14T19:04:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f274b86a700 1 --2- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440b0ba0 0x7f274406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f274b86a700 1 --2- 172.21.15.7:0/3727445576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440cf200 0x7f27440c42c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.091+0000 7f274b86a700 1 -- 172.21.15.7:0/3727445576 >> 172.21.15.7:0/3727445576 conn(0x7f274406ce80 msgr2=0x7f27440ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.092+0000 7f274b86a700 1 -- 172.21.15.7:0/3727445576 shutdown_connections 2023-10-14T19:04:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.092+0000 7f274b86a700 1 -- 172.21.15.7:0/3727445576 wait complete. 2023-10-14T19:04:36.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.094+0000 7f274b86a700 1 Processor -- start 2023-10-14T19:04:36.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.094+0000 7f274b86a700 1 -- start start 2023-10-14T19:04:36.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 0x7f2744140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440b0ba0 0x7f2744141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440cf200 0x7f27440c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27441411d0 con 0x7f27440b07d0 2023-10-14T19:04:36.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440c6ed0 con 0x7f27440b0ba0 2023-10-14T19:04:36.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274416ad10 con 0x7f27440cf200 2023-10-14T19:04:36.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 0x7f2744140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 0x7f2744140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59900/0 (socket says 172.21.15.7:59900) 2023-10-14T19:04:36.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 -- 172.21.15.7:0/296832257 learned_addr learned my addr 172.21.15.7:0/296832257 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:36.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2748e05700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440b0ba0 0x7f2744141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749e07700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440cf200 0x7f27440c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 -- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440cf200 msgr2=0x7f27440c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440cf200 0x7f27440c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 -- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440b0ba0 msgr2=0x7f2744141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440b0ba0 0x7f2744141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 -- 172.21.15.7:0/296832257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340094f0 con 0x7f27440b07d0 2023-10-14T19:04:36.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2748e05700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440b0ba0 0x7f2744141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:36.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f2749606700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 0x7f2744140c90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f274000c5e0 tx=0x7f2740001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740005ac0 con 0x7f27440b07d0 2023-10-14T19:04:36.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740005c20 con 0x7f27440b07d0 2023-10-14T19:04:36.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274416aa30 con 0x7f27440b07d0 2023-10-14T19:04:36.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400070d0 con 0x7f27440b07d0 2023-10-14T19:04:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27440c6b60 con 0x7f27440b07d0 2023-10-14T19:04:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.095+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27440c71b0 con 0x7f27440b07d0 2023-10-14T19:04:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.096+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2740007480 con 0x7f27440b07d0 2023-10-14T19:04:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.096+0000 7f27397fa700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2728066f30 0x7f27280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.096+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2740083ae0 con 0x7f27440b07d0 2023-10-14T19:04:36.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.096+0000 7f2748e05700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2728066f30 0x7f27280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.097+0000 7f2748e05700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2728066f30 0x7f27280693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f27340099b0 tx=0x7f2734017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.101+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2740050d50 con 0x7f27440b07d0 2023-10-14T19:04:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.289+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27440c7010 con 0x7f2728066f30 2023-10-14T19:04:36.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.297+0000 7f27397fa700 1 -- 172.21.15.7:0/296832257 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289612 (secure 0 0 0) 0x7f273400b9d0 con 0x7f2728066f30 2023-10-14T19:04:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:36.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2728066f30 msgr2=0x7f27280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2728066f30 0x7f27280693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f27340099b0 tx=0x7f2734017000 comp rx=0 tx=0).stop 2023-10-14T19:04:36.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 msgr2=0x7f2744140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 0x7f2744140c90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f274000c5e0 tx=0x7f2740001030 comp rx=0 tx=0).stop 2023-10-14T19:04:36.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 shutdown_connections 2023-10-14T19:04:36.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2728066f30 0x7f27280693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440cf200 0x7f27440c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27440b07d0 0x7f2744140c90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 --2- 172.21.15.7:0/296832257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27440b0ba0 0x7f2744141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.300+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 >> 172.21.15.7:0/296832257 conn(0x7f274406ce80 msgr2=0x7f27440ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:36.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.301+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 shutdown_connections 2023-10-14T19:04:36.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.301+0000 7f274b86a700 1 -- 172.21.15.7:0/296832257 wait complete. 2023-10-14T19:04:36.306 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:04:36.312 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-10-14T19:04:35.642248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392488,"kb_used_data":5992,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582232,"statfs":{"total":773094113280,"available":770644205568,"internally_reserved":0,"allocated":6135808,"data_stored":3231068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.825538"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798152+0000","last_change":"2023-10-14T19:04:31.795432+0000","last_active":"2023-10-14T19:04:31.798152+0000","last_peered":"2023-10-14T19:04:31.798152+0000","last_clean":"2023-10-14T19:04:31.798152+0000","last_became_active":"2023-10-14T19:04:31.795140+0000","last_became_peered":"2023-10-14T19:04:31.795140+0000","last_unstale":"2023-10-14T19:04:31.798152+0000","last_undegraded":"2023-10-14T19:04:31.798152+0000","last_fullsized":"2023-10-14T19:04:31.798152+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:33.004820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801342+0000","last_change":"2023-10-14T19:04:31.801342+0000","last_active":"2023-10-14T19:04:31.801342+0000","last_peered":"2023-10-14T19:04:31.801342+0000","last_clean":"2023-10-14T19:04:31.801342+0000","last_became_active":"2023-10-14T19:04:31.801072+0000","last_became_peered":"2023-10-14T19:04:31.801072+0000","last_unstale":"2023-10-14T19:04:31.801342+0000","last_undegraded":"2023-10-14T19:04:31.801342+0000","last_fullsized":"2023-10-14T19:04:31.801342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:42.243779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799710+0000","last_change":"2023-10-14T19:04:31.799710+0000","last_active":"2023-10-14T19:04:31.799710+0000","last_peered":"2023-10-14T19:04:31.799710+0000","last_clean":"2023-10-14T19:04:31.799710+0000","last_became_active":"2023-10-14T19:04:31.799340+0000","last_became_peered":"2023-10-14T19:04:31.799340+0000","last_unstale":"2023-10-14T19:04:31.799710+0000","last_undegraded":"2023-10-14T19:04:31.799710+0000","last_fullsized":"2023-10-14T19:04:31.799710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:20.270989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.793897+0000","last_change":"2023-10-14T19:04:31.793897+0000","last_active":"2023-10-14T19:04:31.793897+0000","last_peered":"2023-10-14T19:04:31.793897+0000","last_clean":"2023-10-14T19:04:31.793897+0000","last_became_active":"2023-10-14T19:04:31.793223+0000","last_became_peered":"2023-10-14T19:04:31.793223+0000","last_unstale":"2023-10-14T19:04:31.793897+0000","last_undegraded":"2023-10-14T19:04:31.793897+0000","last_fullsized":"2023-10-14T19:04:31.793897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:40.890151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798165+0000","last_change":"2023-10-14T19:04:31.795889+0000","last_active":"2023-10-14T19:04:31.798165+0000","last_peered":"2023-10-14T19:04:31.798165+0000","last_clean":"2023-10-14T19:04:31.798165+0000","last_became_active":"2023-10-14T19:04:31.795579+0000","last_became_peered":"2023-10-14T19:04:31.795579+0000","last_unstale":"2023-10-14T19:04:31.798165+0000","last_undegraded":"2023-10-14T19:04:31.798165+0000","last_fullsized":"2023-10-14T19:04:31.798165+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:51:00.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797730+0000","last_change":"2023-10-14T19:04:31.797730+0000","last_active":"2023-10-14T19:04:31.797730+0000","last_peered":"2023-10-14T19:04:31.797730+0000","last_clean":"2023-10-14T19:04:31.797730+0000","last_became_active":"2023-10-14T19:04:31.797480+0000","last_became_peered":"2023-10-14T19:04:31.797480+0000","last_unstale":"2023-10-14T19:04:31.797730+0000","last_undegraded":"2023-10-14T19:04:31.797730+0000","last_fullsized":"2023-10-14T19:04:31.797730+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:00.174039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796719+0000","last_change":"2023-10-14T19:04:31.796719+0000","last_active":"2023-10-14T19:04:31.796719+0000","last_peered":"2023-10-14T19:04:31.796719+0000","last_clean":"2023-10-14T19:04:31.796719+0000","last_became_active":"2023-10-14T19:04:31.796447+0000","last_became_peered":"2023-10-14T19:04:31.796447+0000","last_unstale":"2023-10-14T19:04:31.796719+0000","last_undegraded":"2023-10-14T19:04:31.796719+0000","last_fullsized":"2023-10-14T19:04:31.796719+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:00.338267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800110+0000","last_change":"2023-10-14T19:04:31.800110+0000","last_active":"2023-10-14T19:04:31.800110+0000","last_peered":"2023-10-14T19:04:31.800110+0000","last_clean":"2023-10-14T19:04:31.800110+0000","last_became_active":"2023-10-14T19:04:31.799783+0000","last_became_peered":"2023-10-14T19:04:31.799783+0000","last_unstale":"2023-10-14T19:04:31.800110+0000","last_undegraded":"2023-10-14T19:04:31.800110+0000","last_fullsized":"2023-10-14T19:04:31.800110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:48:39.365520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795107+0000","last_change":"2023-10-14T19:04:31.795107+0000","last_active":"2023-10-14T19:04:31.795107+0000","last_peered":"2023-10-14T19:04:31.795107+0000","last_clean":"2023-10-14T19:04:31.795107+0000","last_became_active":"2023-10-14T19:04:31.794806+0000","last_became_peered":"2023-10-14T19:04:31.794806+0000","last_unstale":"2023-10-14T19:04:31.795107+0000","last_undegraded":"2023-10-14T19:04:31.795107+0000","last_fullsized":"2023-10-14T19:04:31.795107+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:05.185952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798144+0000","last_change":"2023-10-14T19:04:31.798144+0000","last_active":"2023-10-14T19:04:31.798144+0000","last_peered":"2023-10-14T19:04:31.798144+0000","last_clean":"2023-10-14T19:04:31.798144+0000","last_became_active":"2023-10-14T19:04:31.797861+0000","last_became_peered":"2023-10-14T19:04:31.797861+0000","last_unstale":"2023-10-14T19:04:31.798144+0000","last_undegraded":"2023-10-14T19:04:31.798144+0000","last_fullsized":"2023-10-14T19:04:31.798144+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:49.536476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800481+0000","last_change":"2023-10-14T19:04:31.800481+0000","last_active":"2023-10-14T19:04:31.800481+0000","last_peered":"2023-10-14T19:04:31.800481+0000","last_clean":"2023-10-14T19:04:31.800481+0000","last_became_active":"2023-10-14T19:04:31.798872+0000","last_became_peered":"2023-10-14T19:04:31.798872+0000","last_unstale":"2023-10-14T19:04:31.800481+0000","last_undegraded":"2023-10-14T19:04:31.800481+0000","last_fullsized":"2023-10-14T19:04:31.800481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:19.572641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794089+0000","last_change":"2023-10-14T19:04:31.794089+0000","last_active":"2023-10-14T19:04:31.794089+0000","last_peered":"2023-10-14T19:04:31.794089+0000","last_clean":"2023-10-14T19:04:31.794089+0000","last_became_active":"2023-10-14T19:04:31.793603+0000","last_became_peered":"2023-10-14T19:04:31.793603+0000","last_unstale":"2023-10-14T19:04:31.794089+0000","last_undegraded":"2023-10-14T19:04:31.794089+0000","last_fullsized":"2023-10-14T19:04:31.794089+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:29:57.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800977+0000","last_change":"2023-10-14T19:04:31.800977+0000","last_active":"2023-10-14T19:04:31.800977+0000","last_peered":"2023-10-14T19:04:31.800977+0000","last_clean":"2023-10-14T19:04:31.800977+0000","last_became_active":"2023-10-14T19:04:31.800736+0000","last_became_peered":"2023-10-14T19:04:31.800736+0000","last_unstale":"2023-10-14T19:04:31.800977+0000","last_undegraded":"2023-10-14T19:04:31.800977+0000","last_fullsized":"2023-10-14T19:04:31.800977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:49.017499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.792293+0000","last_change":"2023-10-14T19:04:31.792293+0000","last_active":"2023-10-14T19:04:31.792293+0000","last_peered":"2023-10-14T19:04:31.792293+0000","last_clean":"2023-10-14T19:04:31.792293+0000","last_became_active":"2023-10-14T19:04:31.792015+0000","last_became_peered":"2023-10-14T19:04:31.792015+0000","last_unstale":"2023-10-14T19:04:31.792293+0000","last_undegraded":"2023-10-14T19:04:31.792293+0000","last_fullsized":"2023-10-14T19:04:31.792293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:20.198256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794035+0000","last_change":"2023-10-14T19:04:31.794035+0000","last_active":"2023-10-14T19:04:31.794035+0000","last_peered":"2023-10-14T19:04:31.794035+0000","last_clean":"2023-10-14T19:04:31.794035+0000","last_became_active":"2023-10-14T19:04:31.793775+0000","last_became_peered":"2023-10-14T19:04:31.793775+0000","last_unstale":"2023-10-14T19:04:31.794035+0000","last_undegraded":"2023-10-14T19:04:31.794035+0000","last_fullsized":"2023-10-14T19:04:31.794035+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:49.536476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796720+0000","last_change":"2023-10-14T19:04:31.796720+0000","last_active":"2023-10-14T19:04:31.796720+0000","last_peered":"2023-10-14T19:04:31.796720+0000","last_clean":"2023-10-14T19:04:31.796720+0000","last_became_active":"2023-10-14T19:04:31.796436+0000","last_became_peered":"2023-10-14T19:04:31.796436+0000","last_unstale":"2023-10-14T19:04:31.796720+0000","last_undegraded":"2023-10-14T19:04:31.796720+0000","last_fullsized":"2023-10-14T19:04:31.796720+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:04.030855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795710+0000","last_change":"2023-10-14T19:04:31.795710+0000","last_active":"2023-10-14T19:04:31.795710+0000","last_peered":"2023-10-14T19:04:31.795710+0000","last_clean":"2023-10-14T19:04:31.795710+0000","last_became_active":"2023-10-14T19:04:31.795400+0000","last_became_peered":"2023-10-14T19:04:31.795400+0000","last_unstale":"2023-10-14T19:04:31.795710+0000","last_undegraded":"2023-10-14T19:04:31.795710+0000","last_fullsized":"2023-10-14T19:04:31.795710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:58.726826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795905+0000","last_change":"2023-10-14T19:04:31.795905+0000","last_active":"2023-10-14T19:04:31.795905+0000","last_peered":"2023-10-14T19:04:31.795905+0000","last_clean":"2023-10-14T19:04:31.795905+0000","last_became_active":"2023-10-14T19:04:31.795602+0000","last_became_peered":"2023-10-14T19:04:31.795602+0000","last_unstale":"2023-10-14T19:04:31.795905+0000","last_undegraded":"2023-10-14T19:04:31.795905+0000","last_fullsized":"2023-10-14T19:04:31.795905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.873430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798688+0000","last_change":"2023-10-14T19:04:31.794722+0000","last_active":"2023-10-14T19:04:31.798688+0000","last_peered":"2023-10-14T19:04:31.798688+0000","last_clean":"2023-10-14T19:04:31.798688+0000","last_became_active":"2023-10-14T19:04:31.794443+0000","last_became_peered":"2023-10-14T19:04:31.794443+0000","last_unstale":"2023-10-14T19:04:31.798688+0000","last_undegraded":"2023-10-14T19:04:31.798688+0000","last_fullsized":"2023-10-14T19:04:31.798688+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:32.598465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795858+0000","last_change":"2023-10-14T19:04:31.795858+0000","last_active":"2023-10-14T19:04:31.795858+0000","last_peered":"2023-10-14T19:04:31.795858+0000","last_clean":"2023-10-14T19:04:31.795858+0000","last_became_active":"2023-10-14T19:04:31.795555+0000","last_became_peered":"2023-10-14T19:04:31.795555+0000","last_unstale":"2023-10-14T19:04:31.795858+0000","last_undegraded":"2023-10-14T19:04:31.795858+0000","last_fullsized":"2023-10-14T19:04:31.795858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:38:38.254547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.802669+0000","last_change":"2023-10-14T19:04:31.802669+0000","last_active":"2023-10-14T19:04:31.802669+0000","last_peered":"2023-10-14T19:04:31.802669+0000","last_clean":"2023-10-14T19:04:31.802669+0000","last_became_active":"2023-10-14T19:04:31.802395+0000","last_became_peered":"2023-10-14T19:04:31.802395+0000","last_unstale":"2023-10-14T19:04:31.802669+0000","last_undegraded":"2023-10-14T19:04:31.802669+0000","last_fullsized":"2023-10-14T19:04:31.802669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:08.139676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794045+0000","last_change":"2023-10-14T19:04:31.794045+0000","last_active":"2023-10-14T19:04:31.794045+0000","last_peered":"2023-10-14T19:04:31.794045+0000","last_clean":"2023-10-14T19:04:31.794045+0000","last_became_active":"2023-10-14T19:04:31.793605+0000","last_became_peered":"2023-10-14T19:04:31.793605+0000","last_unstale":"2023-10-14T19:04:31.794045+0000","last_undegraded":"2023-10-14T19:04:31.794045+0000","last_fullsized":"2023-10-14T19:04:31.794045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:49.607600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803924+0000","last_change":"2023-10-14T19:04:31.803924+0000","last_active":"2023-10-14T19:04:31.803924+0000","last_peered":"2023-10-14T19:04:31.803924+0000","last_clean":"2023-10-14T19:04:31.803924+0000","last_became_active":"2023-10-14T19:04:31.803670+0000","last_became_peered":"2023-10-14T19:04:31.803670+0000","last_unstale":"2023-10-14T19:04:31.803924+0000","last_undegraded":"2023-10-14T19:04:31.803924+0000","last_fullsized":"2023-10-14T19:04:31.803924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:07.118249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800972+0000","last_change":"2023-10-14T19:04:31.800972+0000","last_active":"2023-10-14T19:04:31.800972+0000","last_peered":"2023-10-14T19:04:31.800972+0000","last_clean":"2023-10-14T19:04:31.800972+0000","last_became_active":"2023-10-14T19:04:31.800720+0000","last_became_peered":"2023-10-14T19:04:31.800720+0000","last_unstale":"2023-10-14T19:04:31.800972+0000","last_undegraded":"2023-10-14T19:04:31.800972+0000","last_fullsized":"2023-10-14T19:04:31.800972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:33.922793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.805296+0000","last_change":"2023-10-14T19:04:31.804500+0000","last_active":"2023-10-14T19:04:31.805296+0000","last_peered":"2023-10-14T19:04:31.805296+0000","last_clean":"2023-10-14T19:04:31.805296+0000","last_became_active":"2023-10-14T19:04:31.804243+0000","last_became_peered":"2023-10-14T19:04:31.804243+0000","last_unstale":"2023-10-14T19:04:31.805296+0000","last_undegraded":"2023-10-14T19:04:31.805296+0000","last_fullsized":"2023-10-14T19:04:31.805296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:56:27.409491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797398+0000","last_change":"2023-10-14T19:04:31.797398+0000","last_active":"2023-10-14T19:04:31.797398+0000","last_peered":"2023-10-14T19:04:31.797398+0000","last_clean":"2023-10-14T19:04:31.797398+0000","last_became_active":"2023-10-14T19:04:31.797077+0000","last_became_peered":"2023-10-14T19:04:31.797077+0000","last_unstale":"2023-10-14T19:04:31.797398+0000","last_undegraded":"2023-10-14T19:04:31.797398+0000","last_fullsized":"2023-10-14T19:04:31.797398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:44.910248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796926+0000","last_change":"2023-10-14T19:04:31.796926+0000","last_active":"2023-10-14T19:04:31.796926+0000","last_peered":"2023-10-14T19:04:31.796926+0000","last_clean":"2023-10-14T19:04:31.796926+0000","last_became_active":"2023-10-14T19:04:31.796631+0000","last_became_peered":"2023-10-14T19:04:31.796631+0000","last_unstale":"2023-10-14T19:04:31.796926+0000","last_undegraded":"2023-10-14T19:04:31.796926+0000","last_fullsized":"2023-10-14T19:04:31.796926+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:50.173129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798228+0000","last_change":"2023-10-14T19:04:31.796470+0000","last_active":"2023-10-14T19:04:31.798228+0000","last_peered":"2023-10-14T19:04:31.798228+0000","last_clean":"2023-10-14T19:04:31.798228+0000","last_became_active":"2023-10-14T19:04:31.796225+0000","last_became_peered":"2023-10-14T19:04:31.796225+0000","last_unstale":"2023-10-14T19:04:31.798228+0000","last_undegraded":"2023-10-14T19:04:31.798228+0000","last_fullsized":"2023-10-14T19:04:31.798228+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:07.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795807+0000","last_change":"2023-10-14T19:04:31.795807+0000","last_active":"2023-10-14T19:04:31.795807+0000","last_peered":"2023-10-14T19:04:31.795807+0000","last_clean":"2023-10-14T19:04:31.795807+0000","last_became_active":"2023-10-14T19:04:31.795506+0000","last_became_peered":"2023-10-14T19:04:31.795506+0000","last_unstale":"2023-10-14T19:04:31.795807+0000","last_undegraded":"2023-10-14T19:04:31.795807+0000","last_fullsized":"2023-10-14T19:04:31.795807+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:27.267092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800067+0000","last_change":"2023-10-14T19:04:31.800067+0000","last_active":"2023-10-14T19:04:31.800067+0000","last_peered":"2023-10-14T19:04:31.800067+0000","last_clean":"2023-10-14T19:04:31.800067+0000","last_became_active":"2023-10-14T19:04:31.799626+0000","last_became_peered":"2023-10-14T19:04:31.799626+0000","last_unstale":"2023-10-14T19:04:31.800067+0000","last_undegraded":"2023-10-14T19:04:31.800067+0000","last_fullsized":"2023-10-14T19:04:31.800067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:28.116611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797732+0000","last_change":"2023-10-14T19:04:31.794871+0000","last_active":"2023-10-14T19:04:31.797732+0000","last_peered":"2023-10-14T19:04:31.797732+0000","last_clean":"2023-10-14T19:04:31.797732+0000","last_became_active":"2023-10-14T19:04:31.794595+0000","last_became_peered":"2023-10-14T19:04:31.794595+0000","last_unstale":"2023-10-14T19:04:31.797732+0000","last_undegraded":"2023-10-14T19:04:31.797732+0000","last_fullsized":"2023-10-14T19:04:31.797732+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:44.045568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.802513+0000","last_change":"2023-10-14T19:04:31.802513+0000","last_active":"2023-10-14T19:04:31.802513+0000","last_peered":"2023-10-14T19:04:31.802513+0000","last_clean":"2023-10-14T19:04:31.802513+0000","last_became_active":"2023-10-14T19:04:31.802199+0000","last_became_peered":"2023-10-14T19:04:31.802199+0000","last_unstale":"2023-10-14T19:04:31.802513+0000","last_undegraded":"2023-10-14T19:04:31.802513+0000","last_fullsized":"2023-10-14T19:04:31.802513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:08:39.109060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799945+0000","last_change":"2023-10-14T19:04:31.799945+0000","last_active":"2023-10-14T19:04:31.799945+0000","last_peered":"2023-10-14T19:04:31.799945+0000","last_clean":"2023-10-14T19:04:31.799945+0000","last_became_active":"2023-10-14T19:04:31.799693+0000","last_became_peered":"2023-10-14T19:04:31.799693+0000","last_unstale":"2023-10-14T19:04:31.799945+0000","last_undegraded":"2023-10-14T19:04:31.799945+0000","last_fullsized":"2023-10-14T19:04:31.799945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:48.771477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827713+0000","last_change":"2023-10-14T19:04:30.829067+0000","last_active":"2023-10-14T19:04:31.827713+0000","last_peered":"2023-10-14T19:04:31.827713+0000","last_clean":"2023-10-14T19:04:31.827713+0000","last_became_active":"2023-10-14T19:04:30.828783+0000","last_became_peered":"2023-10-14T19:04:30.828783+0000","last_unstale":"2023-10-14T19:04:31.827713+0000","last_undegraded":"2023-10-14T19:04:31.827713+0000","last_fullsized":"2023-10-14T19:04:31.827713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.193554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.800862+0000","last_change":"2023-10-14T19:04:31.800862+0000","last_active":"2023-10-14T19:04:31.800862+0000","last_peered":"2023-10-14T19:04:31.800862+0000","last_clean":"2023-10-14T19:04:31.800862+0000","last_became_active":"2023-10-14T19:04:31.800322+0000","last_became_peered":"2023-10-14T19:04:31.800322+0000","last_unstale":"2023-10-14T19:04:31.800862+0000","last_undegraded":"2023-10-14T19:04:31.800862+0000","last_fullsized":"2023-10-14T19:04:31.800862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:34:00.338267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.790584+0000","last_change":"2023-10-14T19:04:30.834379+0000","last_active":"2023-10-14T19:04:31.790584+0000","last_peered":"2023-10-14T19:04:31.790584+0000","last_clean":"2023-10-14T19:04:31.790584+0000","last_became_active":"2023-10-14T19:04:30.833955+0000","last_became_peered":"2023-10-14T19:04:30.833955+0000","last_unstale":"2023-10-14T19:04:31.790584+0000","last_undegraded":"2023-10-14T19:04:31.790584+0000","last_fullsized":"2023-10-14T19:04:31.790584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:21.231849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795219+0000","last_change":"2023-10-14T19:04:31.795219+0000","last_active":"2023-10-14T19:04:31.795219+0000","last_peered":"2023-10-14T19:04:31.795219+0000","last_clean":"2023-10-14T19:04:31.795219+0000","last_became_active":"2023-10-14T19:04:31.794731+0000","last_became_peered":"2023-10-14T19:04:31.794731+0000","last_unstale":"2023-10-14T19:04:31.795219+0000","last_undegraded":"2023-10-14T19:04:31.795219+0000","last_fullsized":"2023-10-14T19:04:31.795219+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:53.431722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827340+0000","last_change":"2023-10-14T19:04:30.837671+0000","last_active":"2023-10-14T19:04:31.827340+0000","last_peered":"2023-10-14T19:04:31.827340+0000","last_clean":"2023-10-14T19:04:31.827340+0000","last_became_active":"2023-10-14T19:04:30.837307+0000","last_became_peered":"2023-10-14T19:04:30.837307+0000","last_unstale":"2023-10-14T19:04:31.827340+0000","last_undegraded":"2023-10-14T19:04:31.827340+0000","last_fullsized":"2023-10-14T19:04:31.827340+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:25.044543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803206+0000","last_change":"2023-10-14T19:04:31.803206+0000","last_active":"2023-10-14T19:04:31.803206+0000","last_peered":"2023-10-14T19:04:31.803206+0000","last_clean":"2023-10-14T19:04:31.803206+0000","last_became_active":"2023-10-14T19:04:31.802880+0000","last_became_peered":"2023-10-14T19:04:31.802880+0000","last_unstale":"2023-10-14T19:04:31.803206+0000","last_undegraded":"2023-10-14T19:04:31.803206+0000","last_fullsized":"2023-10-14T19:04:31.803206+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:22.236551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.824907+0000","last_change":"2023-10-14T19:04:30.828998+0000","last_active":"2023-10-14T19:04:31.824907+0000","last_peered":"2023-10-14T19:04:31.824907+0000","last_clean":"2023-10-14T19:04:31.824907+0000","last_became_active":"2023-10-14T19:04:30.828725+0000","last_became_peered":"2023-10-14T19:04:30.828725+0000","last_unstale":"2023-10-14T19:04:31.824907+0000","last_undegraded":"2023-10-14T19:04:31.824907+0000","last_fullsized":"2023-10-14T19:04:31.824907+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:48.531774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794115+0000","last_change":"2023-10-14T19:04:31.794115+0000","last_active":"2023-10-14T19:04:31.794115+0000","last_peered":"2023-10-14T19:04:31.794115+0000","last_clean":"2023-10-14T19:04:31.794115+0000","last_became_active":"2023-10-14T19:04:31.793774+0000","last_became_peered":"2023-10-14T19:04:31.793774+0000","last_unstale":"2023-10-14T19:04:31.794115+0000","last_undegraded":"2023-10-14T19:04:31.794115+0000","last_fullsized":"2023-10-14T19:04:31.794115+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:09.657442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.785660+0000","last_change":"2023-10-14T19:04:30.828631+0000","last_active":"2023-10-14T19:04:31.785660+0000","last_peered":"2023-10-14T19:04:31.785660+0000","last_clean":"2023-10-14T19:04:31.785660+0000","last_became_active":"2023-10-14T19:04:30.828336+0000","last_became_peered":"2023-10-14T19:04:30.828336+0000","last_unstale":"2023-10-14T19:04:31.785660+0000","last_undegraded":"2023-10-14T19:04:31.785660+0000","last_fullsized":"2023-10-14T19:04:31.785660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:32.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.795708+0000","last_change":"2023-10-14T19:04:31.795708+0000","last_active":"2023-10-14T19:04:31.795708+0000","last_peered":"2023-10-14T19:04:31.795708+0000","last_clean":"2023-10-14T19:04:31.795708+0000","last_became_active":"2023-10-14T19:04:31.795424+0000","last_became_peered":"2023-10-14T19:04:31.795424+0000","last_unstale":"2023-10-14T19:04:31.795708+0000","last_undegraded":"2023-10-14T19:04:31.795708+0000","last_fullsized":"2023-10-14T19:04:31.795708+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:59.903331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.791756+0000","last_change":"2023-10-14T19:04:30.832572+0000","last_active":"2023-10-14T19:04:31.791756+0000","last_peered":"2023-10-14T19:04:31.791756+0000","last_clean":"2023-10-14T19:04:31.791756+0000","last_became_active":"2023-10-14T19:04:30.832310+0000","last_became_peered":"2023-10-14T19:04:30.832310+0000","last_unstale":"2023-10-14T19:04:31.791756+0000","last_undegraded":"2023-10-14T19:04:31.791756+0000","last_fullsized":"2023-10-14T19:04:31.791756+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:31.032258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799162+0000","last_change":"2023-10-14T19:04:31.799162+0000","last_active":"2023-10-14T19:04:31.799162+0000","last_peered":"2023-10-14T19:04:31.799162+0000","last_clean":"2023-10-14T19:04:31.799162+0000","last_became_active":"2023-10-14T19:04:31.798898+0000","last_became_peered":"2023-10-14T19:04:31.798898+0000","last_unstale":"2023-10-14T19:04:31.799162+0000","last_undegraded":"2023-10-14T19:04:31.799162+0000","last_fullsized":"2023-10-14T19:04:31.799162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:21.528825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835653+0000","last_change":"2023-10-14T19:04:30.829773+0000","last_active":"2023-10-14T19:04:30.835653+0000","last_peered":"2023-10-14T19:04:30.835653+0000","last_clean":"2023-10-14T19:04:30.835653+0000","last_became_active":"2023-10-14T19:04:30.829468+0000","last_became_peered":"2023-10-14T19:04:30.829468+0000","last_unstale":"2023-10-14T19:04:30.835653+0000","last_undegraded":"2023-10-14T19:04:30.835653+0000","last_fullsized":"2023-10-14T19:04:30.835653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:01.526602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798212+0000","last_change":"2023-10-14T19:04:31.798212+0000","last_active":"2023-10-14T19:04:31.798212+0000","last_peered":"2023-10-14T19:04:31.798212+0000","last_clean":"2023-10-14T19:04:31.798212+0000","last_became_active":"2023-10-14T19:04:31.796568+0000","last_became_peered":"2023-10-14T19:04:31.796568+0000","last_unstale":"2023-10-14T19:04:31.798212+0000","last_undegraded":"2023-10-14T19:04:31.798212+0000","last_fullsized":"2023-10-14T19:04:31.798212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:08.805174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.841145+0000","last_change":"2023-10-14T19:04:30.836615+0000","last_active":"2023-10-14T19:04:30.841145+0000","last_peered":"2023-10-14T19:04:30.841145+0000","last_clean":"2023-10-14T19:04:30.841145+0000","last_became_active":"2023-10-14T19:04:30.836367+0000","last_became_peered":"2023-10-14T19:04:30.836367+0000","last_unstale":"2023-10-14T19:04:30.841145+0000","last_undegraded":"2023-10-14T19:04:30.841145+0000","last_fullsized":"2023-10-14T19:04:30.841145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.688447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801478+0000","last_change":"2023-10-14T19:04:31.801478+0000","last_active":"2023-10-14T19:04:31.801478+0000","last_peered":"2023-10-14T19:04:31.801478+0000","last_clean":"2023-10-14T19:04:31.801478+0000","last_became_active":"2023-10-14T19:04:31.801184+0000","last_became_peered":"2023-10-14T19:04:31.801184+0000","last_unstale":"2023-10-14T19:04:31.801478+0000","last_undegraded":"2023-10-14T19:04:31.801478+0000","last_fullsized":"2023-10-14T19:04:31.801478+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:02.531304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.841702+0000","last_change":"2023-10-14T19:04:30.838911+0000","last_active":"2023-10-14T19:04:30.841702+0000","last_peered":"2023-10-14T19:04:30.841702+0000","last_clean":"2023-10-14T19:04:30.841702+0000","last_became_active":"2023-10-14T19:04:30.838527+0000","last_became_peered":"2023-10-14T19:04:30.838527+0000","last_unstale":"2023-10-14T19:04:30.841702+0000","last_undegraded":"2023-10-14T19:04:30.841702+0000","last_fullsized":"2023-10-14T19:04:30.841702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:37.922323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.804722+0000","last_change":"2023-10-14T19:04:31.804722+0000","last_active":"2023-10-14T19:04:31.804722+0000","last_peered":"2023-10-14T19:04:31.804722+0000","last_clean":"2023-10-14T19:04:31.804722+0000","last_became_active":"2023-10-14T19:04:31.804469+0000","last_became_peered":"2023-10-14T19:04:31.804469+0000","last_unstale":"2023-10-14T19:04:31.804722+0000","last_undegraded":"2023-10-14T19:04:31.804722+0000","last_fullsized":"2023-10-14T19:04:31.804722+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:00.174039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835723+0000","last_change":"2023-10-14T19:04:30.833737+0000","last_active":"2023-10-14T19:04:30.835723+0000","last_peered":"2023-10-14T19:04:30.835723+0000","last_clean":"2023-10-14T19:04:30.835723+0000","last_became_active":"2023-10-14T19:04:30.832294+0000","last_became_peered":"2023-10-14T19:04:30.832294+0000","last_unstale":"2023-10-14T19:04:30.835723+0000","last_undegraded":"2023-10-14T19:04:30.835723+0000","last_fullsized":"2023-10-14T19:04:30.835723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:39.885449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801763+0000","last_change":"2023-10-14T19:04:31.801763+0000","last_active":"2023-10-14T19:04:31.801763+0000","last_peered":"2023-10-14T19:04:31.801763+0000","last_clean":"2023-10-14T19:04:31.801763+0000","last_became_active":"2023-10-14T19:04:31.801301+0000","last_became_peered":"2023-10-14T19:04:31.801301+0000","last_unstale":"2023-10-14T19:04:31.801763+0000","last_undegraded":"2023-10-14T19:04:31.801763+0000","last_fullsized":"2023-10-14T19:04:31.801763+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:05.185952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827765+0000","last_change":"2023-10-14T19:04:30.838459+0000","last_active":"2023-10-14T19:04:31.827765+0000","last_peered":"2023-10-14T19:04:31.827765+0000","last_clean":"2023-10-14T19:04:31.827765+0000","last_became_active":"2023-10-14T19:04:30.838170+0000","last_became_peered":"2023-10-14T19:04:30.838170+0000","last_unstale":"2023-10-14T19:04:31.827765+0000","last_undegraded":"2023-10-14T19:04:31.827765+0000","last_fullsized":"2023-10-14T19:04:31.827765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:52.350856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.805142+0000","last_change":"2023-10-14T19:04:31.805142+0000","last_active":"2023-10-14T19:04:31.805142+0000","last_peered":"2023-10-14T19:04:31.805142+0000","last_clean":"2023-10-14T19:04:31.805142+0000","last_became_active":"2023-10-14T19:04:31.804873+0000","last_became_peered":"2023-10-14T19:04:31.804873+0000","last_unstale":"2023-10-14T19:04:31.805142+0000","last_undegraded":"2023-10-14T19:04:31.805142+0000","last_fullsized":"2023-10-14T19:04:31.805142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:44.118301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828151+0000","last_change":"2023-10-14T19:04:30.835702+0000","last_active":"2023-10-14T19:04:31.828151+0000","last_peered":"2023-10-14T19:04:31.828151+0000","last_clean":"2023-10-14T19:04:31.828151+0000","last_became_active":"2023-10-14T19:04:30.835438+0000","last_became_peered":"2023-10-14T19:04:30.835438+0000","last_unstale":"2023-10-14T19:04:31.828151+0000","last_undegraded":"2023-10-14T19:04:31.828151+0000","last_fullsized":"2023-10-14T19:04:31.828151+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:04.601734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794812+0000","last_change":"2023-10-14T19:04:31.794812+0000","last_active":"2023-10-14T19:04:31.794812+0000","last_peered":"2023-10-14T19:04:31.794812+0000","last_clean":"2023-10-14T19:04:31.794812+0000","last_became_active":"2023-10-14T19:04:31.794537+0000","last_became_peered":"2023-10-14T19:04:31.794537+0000","last_unstale":"2023-10-14T19:04:31.794812+0000","last_undegraded":"2023-10-14T19:04:31.794812+0000","last_fullsized":"2023-10-14T19:04:31.794812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:04.030855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827321+0000","last_change":"2023-10-14T19:04:30.832233+0000","last_active":"2023-10-14T19:04:31.827321+0000","last_peered":"2023-10-14T19:04:31.827321+0000","last_clean":"2023-10-14T19:04:31.827321+0000","last_became_active":"2023-10-14T19:04:30.831954+0000","last_became_peered":"2023-10-14T19:04:30.831954+0000","last_unstale":"2023-10-14T19:04:31.827321+0000","last_undegraded":"2023-10-14T19:04:31.827321+0000","last_fullsized":"2023-10-14T19:04:31.827321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:40.794556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796399+0000","last_change":"2023-10-14T19:04:31.796399+0000","last_active":"2023-10-14T19:04:31.796399+0000","last_peered":"2023-10-14T19:04:31.796399+0000","last_clean":"2023-10-14T19:04:31.796399+0000","last_became_active":"2023-10-14T19:04:31.796160+0000","last_became_peered":"2023-10-14T19:04:31.796160+0000","last_unstale":"2023-10-14T19:04:31.796399+0000","last_undegraded":"2023-10-14T19:04:31.796399+0000","last_fullsized":"2023-10-14T19:04:31.796399+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:38.613232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835685+0000","last_change":"2023-10-14T19:04:30.833845+0000","last_active":"2023-10-14T19:04:30.835685+0000","last_peered":"2023-10-14T19:04:30.835685+0000","last_clean":"2023-10-14T19:04:30.835685+0000","last_became_active":"2023-10-14T19:04:30.833594+0000","last_became_peered":"2023-10-14T19:04:30.833594+0000","last_unstale":"2023-10-14T19:04:30.835685+0000","last_undegraded":"2023-10-14T19:04:30.835685+0000","last_fullsized":"2023-10-14T19:04:30.835685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:51.054136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794224+0000","last_change":"2023-10-14T19:04:31.794224+0000","last_active":"2023-10-14T19:04:31.794224+0000","last_peered":"2023-10-14T19:04:31.794224+0000","last_clean":"2023-10-14T19:04:31.794224+0000","last_became_active":"2023-10-14T19:04:31.793955+0000","last_became_peered":"2023-10-14T19:04:31.793955+0000","last_unstale":"2023-10-14T19:04:31.794224+0000","last_undegraded":"2023-10-14T19:04:31.794224+0000","last_fullsized":"2023-10-14T19:04:31.794224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:08.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835822+0000","last_change":"2023-10-14T19:04:30.833706+0000","last_active":"2023-10-14T19:04:30.835822+0000","last_peered":"2023-10-14T19:04:30.835822+0000","last_clean":"2023-10-14T19:04:30.835822+0000","last_became_active":"2023-10-14T19:04:30.833445+0000","last_became_peered":"2023-10-14T19:04:30.833445+0000","last_unstale":"2023-10-14T19:04:30.835822+0000","last_undegraded":"2023-10-14T19:04:30.835822+0000","last_fullsized":"2023-10-14T19:04:30.835822+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:59.333565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803984+0000","last_change":"2023-10-14T19:04:31.803984+0000","last_active":"2023-10-14T19:04:31.803984+0000","last_peered":"2023-10-14T19:04:31.803984+0000","last_clean":"2023-10-14T19:04:31.803984+0000","last_became_active":"2023-10-14T19:04:31.803699+0000","last_became_peered":"2023-10-14T19:04:31.803699+0000","last_unstale":"2023-10-14T19:04:31.803984+0000","last_undegraded":"2023-10-14T19:04:31.803984+0000","last_fullsized":"2023-10-14T19:04:31.803984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:09.657442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828513+0000","last_change":"2023-10-14T19:04:30.838309+0000","last_active":"2023-10-14T19:04:31.828513+0000","last_peered":"2023-10-14T19:04:31.828513+0000","last_clean":"2023-10-14T19:04:31.828513+0000","last_became_active":"2023-10-14T19:04:30.838018+0000","last_became_peered":"2023-10-14T19:04:30.838018+0000","last_unstale":"2023-10-14T19:04:31.828513+0000","last_undegraded":"2023-10-14T19:04:31.828513+0000","last_fullsized":"2023-10-14T19:04:31.828513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.567939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799578+0000","last_change":"2023-10-14T19:04:31.799578+0000","last_active":"2023-10-14T19:04:31.799578+0000","last_peered":"2023-10-14T19:04:31.799578+0000","last_clean":"2023-10-14T19:04:31.799578+0000","last_became_active":"2023-10-14T19:04:31.799291+0000","last_became_peered":"2023-10-14T19:04:31.799291+0000","last_unstale":"2023-10-14T19:04:31.799578+0000","last_undegraded":"2023-10-14T19:04:31.799578+0000","last_fullsized":"2023-10-14T19:04:31.799578+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:40.890151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.790841+0000","last_change":"2023-10-14T19:04:30.832355+0000","last_active":"2023-10-14T19:04:31.790841+0000","last_peered":"2023-10-14T19:04:31.790841+0000","last_clean":"2023-10-14T19:04:31.790841+0000","last_became_active":"2023-10-14T19:04:30.831721+0000","last_became_peered":"2023-10-14T19:04:30.831721+0000","last_unstale":"2023-10-14T19:04:31.790841+0000","last_undegraded":"2023-10-14T19:04:31.790841+0000","last_fullsized":"2023-10-14T19:04:31.790841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:03.026153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.804583+0000","last_change":"2023-10-14T19:04:31.804583+0000","last_active":"2023-10-14T19:04:31.804583+0000","last_peered":"2023-10-14T19:04:31.804583+0000","last_clean":"2023-10-14T19:04:31.804583+0000","last_became_active":"2023-10-14T19:04:31.804255+0000","last_became_peered":"2023-10-14T19:04:31.804255+0000","last_unstale":"2023-10-14T19:04:31.804583+0000","last_undegraded":"2023-10-14T19:04:31.804583+0000","last_fullsized":"2023-10-14T19:04:31.804583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:48.771477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.827865+0000","last_change":"2023-10-14T19:04:30.831458+0000","last_active":"2023-10-14T19:04:31.827865+0000","last_peered":"2023-10-14T19:04:31.827865+0000","last_clean":"2023-10-14T19:04:31.827865+0000","last_became_active":"2023-10-14T19:04:30.831205+0000","last_became_peered":"2023-10-14T19:04:30.831205+0000","last_unstale":"2023-10-14T19:04:31.827865+0000","last_undegraded":"2023-10-14T19:04:31.827865+0000","last_fullsized":"2023-10-14T19:04:31.827865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:05.959809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799166+0000","last_change":"2023-10-14T19:04:31.799166+0000","last_active":"2023-10-14T19:04:31.799166+0000","last_peered":"2023-10-14T19:04:31.799166+0000","last_clean":"2023-10-14T19:04:31.799166+0000","last_became_active":"2023-10-14T19:04:31.798907+0000","last_became_peered":"2023-10-14T19:04:31.798907+0000","last_unstale":"2023-10-14T19:04:31.799166+0000","last_undegraded":"2023-10-14T19:04:31.799166+0000","last_fullsized":"2023-10-14T19:04:31.799166+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:04.064360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.786872+0000","last_change":"2023-10-14T19:04:30.833941+0000","last_active":"2023-10-14T19:04:31.786872+0000","last_peered":"2023-10-14T19:04:31.786872+0000","last_clean":"2023-10-14T19:04:31.786872+0000","last_became_active":"2023-10-14T19:04:30.833587+0000","last_became_peered":"2023-10-14T19:04:30.833587+0000","last_unstale":"2023-10-14T19:04:31.786872+0000","last_undegraded":"2023-10-14T19:04:31.786872+0000","last_fullsized":"2023-10-14T19:04:31.786872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:07.583562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.805164+0000","last_change":"2023-10-14T19:04:31.805164+0000","last_active":"2023-10-14T19:04:31.805164+0000","last_peered":"2023-10-14T19:04:31.805164+0000","last_clean":"2023-10-14T19:04:31.805164+0000","last_became_active":"2023-10-14T19:04:31.804933+0000","last_became_peered":"2023-10-14T19:04:31.804933+0000","last_unstale":"2023-10-14T19:04:31.805164+0000","last_undegraded":"2023-10-14T19:04:31.805164+0000","last_fullsized":"2023-10-14T19:04:31.805164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:15.636009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.837589+0000","last_change":"2023-10-14T19:04:30.835234+0000","last_active":"2023-10-14T19:04:30.837589+0000","last_peered":"2023-10-14T19:04:30.837589+0000","last_clean":"2023-10-14T19:04:30.837589+0000","last_became_active":"2023-10-14T19:04:30.834972+0000","last_became_peered":"2023-10-14T19:04:30.834972+0000","last_unstale":"2023-10-14T19:04:30.837589+0000","last_undegraded":"2023-10-14T19:04:30.837589+0000","last_fullsized":"2023-10-14T19:04:30.837589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:21.576736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794309+0000","last_change":"2023-10-14T19:04:31.794309+0000","last_active":"2023-10-14T19:04:31.794309+0000","last_peered":"2023-10-14T19:04:31.794309+0000","last_clean":"2023-10-14T19:04:31.794309+0000","last_became_active":"2023-10-14T19:04:31.793564+0000","last_became_peered":"2023-10-14T19:04:31.793564+0000","last_unstale":"2023-10-14T19:04:31.794309+0000","last_undegraded":"2023-10-14T19:04:31.794309+0000","last_fullsized":"2023-10-14T19:04:31.794309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:50.173129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828104+0000","last_change":"2023-10-14T19:04:30.831715+0000","last_active":"2023-10-14T19:04:31.828104+0000","last_peered":"2023-10-14T19:04:31.828104+0000","last_clean":"2023-10-14T19:04:31.828104+0000","last_became_active":"2023-10-14T19:04:30.831419+0000","last_became_peered":"2023-10-14T19:04:30.831419+0000","last_unstale":"2023-10-14T19:04:31.828104+0000","last_undegraded":"2023-10-14T19:04:31.828104+0000","last_fullsized":"2023-10-14T19:04:31.828104+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:43.905547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.797366+0000","last_change":"2023-10-14T19:04:31.797366+0000","last_active":"2023-10-14T19:04:31.797366+0000","last_peered":"2023-10-14T19:04:31.797366+0000","last_clean":"2023-10-14T19:04:31.797366+0000","last_became_active":"2023-10-14T19:04:31.796335+0000","last_became_peered":"2023-10-14T19:04:31.796335+0000","last_unstale":"2023-10-14T19:04:31.797366+0000","last_undegraded":"2023-10-14T19:04:31.797366+0000","last_fullsized":"2023-10-14T19:04:31.797366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:40.890151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836767+0000","last_change":"2023-10-14T19:04:30.828570+0000","last_active":"2023-10-14T19:04:30.836767+0000","last_peered":"2023-10-14T19:04:30.836767+0000","last_clean":"2023-10-14T19:04:30.836767+0000","last_became_active":"2023-10-14T19:04:30.828299+0000","last_became_peered":"2023-10-14T19:04:30.828299+0000","last_unstale":"2023-10-14T19:04:30.836767+0000","last_undegraded":"2023-10-14T19:04:30.836767+0000","last_fullsized":"2023-10-14T19:04:30.836767+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:04.601734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799340+0000","last_change":"2023-10-14T19:04:31.799340+0000","last_active":"2023-10-14T19:04:31.799340+0000","last_peered":"2023-10-14T19:04:31.799340+0000","last_clean":"2023-10-14T19:04:31.799340+0000","last_became_active":"2023-10-14T19:04:31.799067+0000","last_became_peered":"2023-10-14T19:04:31.799067+0000","last_unstale":"2023-10-14T19:04:31.799340+0000","last_undegraded":"2023-10-14T19:04:31.799340+0000","last_fullsized":"2023-10-14T19:04:31.799340+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:44.910248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.838092+0000","last_change":"2023-10-14T19:04:30.836207+0000","last_active":"2023-10-14T19:04:30.838092+0000","last_peered":"2023-10-14T19:04:30.838092+0000","last_clean":"2023-10-14T19:04:30.838092+0000","last_became_active":"2023-10-14T19:04:30.835925+0000","last_became_peered":"2023-10-14T19:04:30.835925+0000","last_unstale":"2023-10-14T19:04:30.838092+0000","last_undegraded":"2023-10-14T19:04:30.838092+0000","last_fullsized":"2023-10-14T19:04:30.838092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.193554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794437+0000","last_change":"2023-10-14T19:04:31.794437+0000","last_active":"2023-10-14T19:04:31.794437+0000","last_peered":"2023-10-14T19:04:31.794437+0000","last_clean":"2023-10-14T19:04:31.794437+0000","last_became_active":"2023-10-14T19:04:31.794173+0000","last_became_peered":"2023-10-14T19:04:31.794173+0000","last_unstale":"2023-10-14T19:04:31.794437+0000","last_undegraded":"2023-10-14T19:04:31.794437+0000","last_fullsized":"2023-10-14T19:04:31.794437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:41.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.828222+0000","last_change":"2023-10-14T19:04:30.833030+0000","last_active":"2023-10-14T19:04:31.828222+0000","last_peered":"2023-10-14T19:04:31.828222+0000","last_clean":"2023-10-14T19:04:31.828222+0000","last_became_active":"2023-10-14T19:04:30.832806+0000","last_became_peered":"2023-10-14T19:04:30.832806+0000","last_unstale":"2023-10-14T19:04:31.828222+0000","last_undegraded":"2023-10-14T19:04:31.828222+0000","last_fullsized":"2023-10-14T19:04:31.828222+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.688447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.794095+0000","last_change":"2023-10-14T19:04:31.794095+0000","last_active":"2023-10-14T19:04:31.794095+0000","last_peered":"2023-10-14T19:04:31.794095+0000","last_clean":"2023-10-14T19:04:31.794095+0000","last_became_active":"2023-10-14T19:04:31.793827+0000","last_became_peered":"2023-10-14T19:04:31.793827+0000","last_unstale":"2023-10-14T19:04:31.794095+0000","last_undegraded":"2023-10-14T19:04:31.794095+0000","last_fullsized":"2023-10-14T19:04:31.794095+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:22.236551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.834866+0000","last_change":"2023-10-14T19:04:30.830942+0000","last_active":"2023-10-14T19:04:30.834866+0000","last_peered":"2023-10-14T19:04:30.834866+0000","last_clean":"2023-10-14T19:04:30.834866+0000","last_became_active":"2023-10-14T19:04:30.830670+0000","last_became_peered":"2023-10-14T19:04:30.830670+0000","last_unstale":"2023-10-14T19:04:30.834866+0000","last_undegraded":"2023-10-14T19:04:30.834866+0000","last_fullsized":"2023-10-14T19:04:30.834866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:57.546903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801563+0000","last_change":"2023-10-14T19:04:31.801563+0000","last_active":"2023-10-14T19:04:31.801563+0000","last_peered":"2023-10-14T19:04:31.801563+0000","last_clean":"2023-10-14T19:04:31.801563+0000","last_became_active":"2023-10-14T19:04:31.800942+0000","last_became_peered":"2023-10-14T19:04:31.800942+0000","last_unstale":"2023-10-14T19:04:31.801563+0000","last_undegraded":"2023-10-14T19:04:31.801563+0000","last_fullsized":"2023-10-14T19:04:31.801563+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:02.531304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835177+0000","last_change":"2023-10-14T19:04:30.830034+0000","last_active":"2023-10-14T19:04:30.835177+0000","last_peered":"2023-10-14T19:04:30.835177+0000","last_clean":"2023-10-14T19:04:30.835177+0000","last_became_active":"2023-10-14T19:04:30.829448+0000","last_became_peered":"2023-10-14T19:04:30.829448+0000","last_unstale":"2023-10-14T19:04:30.835177+0000","last_undegraded":"2023-10-14T19:04:30.835177+0000","last_fullsized":"2023-10-14T19:04:30.835177+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:01.827976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.803605+0000","last_change":"2023-10-14T19:04:31.803605+0000","last_active":"2023-10-14T19:04:31.803605+0000","last_peered":"2023-10-14T19:04:31.803605+0000","last_clean":"2023-10-14T19:04:31.803605+0000","last_became_active":"2023-10-14T19:04:31.803251+0000","last_became_peered":"2023-10-14T19:04:31.803251+0000","last_unstale":"2023-10-14T19:04:31.803605+0000","last_undegraded":"2023-10-14T19:04:31.803605+0000","last_fullsized":"2023-10-14T19:04:31.803605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:41.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.835796+0000","last_change":"2023-10-14T19:04:30.829976+0000","last_active":"2023-10-14T19:04:30.835796+0000","last_peered":"2023-10-14T19:04:30.835796+0000","last_clean":"2023-10-14T19:04:30.835796+0000","last_became_active":"2023-10-14T19:04:30.829702+0000","last_became_peered":"2023-10-14T19:04:30.829702+0000","last_unstale":"2023-10-14T19:04:30.835796+0000","last_undegraded":"2023-10-14T19:04:30.835796+0000","last_fullsized":"2023-10-14T19:04:30.835796+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:04.181250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.793905+0000","last_change":"2023-10-14T19:04:31.793905+0000","last_active":"2023-10-14T19:04:31.793905+0000","last_peered":"2023-10-14T19:04:31.793905+0000","last_clean":"2023-10-14T19:04:31.793905+0000","last_became_active":"2023-10-14T19:04:31.793088+0000","last_became_peered":"2023-10-14T19:04:31.793088+0000","last_unstale":"2023-10-14T19:04:31.793905+0000","last_undegraded":"2023-10-14T19:04:31.793905+0000","last_fullsized":"2023-10-14T19:04:31.793905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:18.969855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836881+0000","last_change":"2023-10-14T19:04:30.833547+0000","last_active":"2023-10-14T19:04:30.836881+0000","last_peered":"2023-10-14T19:04:30.836881+0000","last_clean":"2023-10-14T19:04:30.836881+0000","last_became_active":"2023-10-14T19:04:30.833260+0000","last_became_peered":"2023-10-14T19:04:30.833260+0000","last_unstale":"2023-10-14T19:04:30.836881+0000","last_undegraded":"2023-10-14T19:04:30.836881+0000","last_fullsized":"2023-10-14T19:04:30.836881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:00.532841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.801672+0000","last_change":"2023-10-14T19:04:31.801672+0000","last_active":"2023-10-14T19:04:31.801672+0000","last_peered":"2023-10-14T19:04:31.801672+0000","last_clean":"2023-10-14T19:04:31.801672+0000","last_became_active":"2023-10-14T19:04:31.801395+0000","last_became_peered":"2023-10-14T19:04:31.801395+0000","last_unstale":"2023-10-14T19:04:31.801672+0000","last_undegraded":"2023-10-14T19:04:31.801672+0000","last_fullsized":"2023-10-14T19:04:31.801672+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:56:29.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.841082+0000","last_change":"2023-10-14T19:04:30.835313+0000","last_active":"2023-10-14T19:04:30.841082+0000","last_peered":"2023-10-14T19:04:30.841082+0000","last_clean":"2023-10-14T19:04:30.841082+0000","last_became_active":"2023-10-14T19:04:30.834981+0000","last_became_peered":"2023-10-14T19:04:30.834981+0000","last_unstale":"2023-10-14T19:04:30.841082+0000","last_undegraded":"2023-10-14T19:04:30.841082+0000","last_fullsized":"2023-10-14T19:04:30.841082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:00.532841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.798032+0000","last_change":"2023-10-14T19:04:31.798032+0000","last_active":"2023-10-14T19:04:31.798032+0000","last_peered":"2023-10-14T19:04:31.798032+0000","last_clean":"2023-10-14T19:04:31.798032+0000","last_became_active":"2023-10-14T19:04:31.797783+0000","last_became_peered":"2023-10-14T19:04:31.797783+0000","last_unstale":"2023-10-14T19:04:31.798032+0000","last_undegraded":"2023-10-14T19:04:31.798032+0000","last_fullsized":"2023-10-14T19:04:31.798032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:08.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836900+0000","last_change":"2023-10-14T19:04:30.835048+0000","last_active":"2023-10-14T19:04:30.836900+0000","last_peered":"2023-10-14T19:04:30.836900+0000","last_clean":"2023-10-14T19:04:30.836900+0000","last_became_active":"2023-10-14T19:04:30.834774+0000","last_became_peered":"2023-10-14T19:04:30.834774+0000","last_unstale":"2023-10-14T19:04:30.836900+0000","last_undegraded":"2023-10-14T19:04:30.836900+0000","last_fullsized":"2023-10-14T19:04:30.836900+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:32.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.796338+0000","last_change":"2023-10-14T19:04:31.796338+0000","last_active":"2023-10-14T19:04:31.796338+0000","last_peered":"2023-10-14T19:04:31.796338+0000","last_clean":"2023-10-14T19:04:31.796338+0000","last_became_active":"2023-10-14T19:04:31.796023+0000","last_became_peered":"2023-10-14T19:04:31.796023+0000","last_unstale":"2023-10-14T19:04:31.796338+0000","last_undegraded":"2023-10-14T19:04:31.796338+0000","last_fullsized":"2023-10-14T19:04:31.796338+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:02.402891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.836990+0000","last_change":"2023-10-14T19:04:30.835110+0000","last_active":"2023-10-14T19:04:30.836990+0000","last_peered":"2023-10-14T19:04:30.836990+0000","last_clean":"2023-10-14T19:04:30.836990+0000","last_became_active":"2023-10-14T19:04:30.834766+0000","last_became_peered":"2023-10-14T19:04:30.834766+0000","last_unstale":"2023-10-14T19:04:30.836990+0000","last_undegraded":"2023-10-14T19:04:30.836990+0000","last_fullsized":"2023-10-14T19:04:30.836990+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:47.766775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-14T19:04:31.799793+0000","last_change":"2023-10-14T19:04:31.799793+0000","last_active":"2023-10-14T19:04:31.799793+0000","last_peered":"2023-10-14T19:04:31.799793+0000","last_clean":"2023-10-14T19:04:31.799793+0000","last_became_active":"2023-10-14T19:04:31.796235+0000","last_became_peered":"2023-10-14T19:04:31.796235+0000","last_unstale":"2023-10-14T19:04:31.799793+0000","last_undegraded":"2023-10-14T19:04:31.799793+0000","last_fullsized":"2023-10-14T19:04:31.799793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:30.811803+0000","last_clean_scrub_stamp":"2023-10-14T19:04:30.811803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:26.684280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.830233+0000","last_change":"2023-10-14T19:04:30.828303+0000","last_active":"2023-10-14T19:04:30.830233+0000","last_peered":"2023-10-14T19:04:30.830233+0000","last_clean":"2023-10-14T19:04:30.830233+0000","last_became_active":"2023-10-14T19:04:30.828006+0000","last_became_peered":"2023-10-14T19:04:30.828006+0000","last_unstale":"2023-10-14T19:04:30.830233+0000","last_undegraded":"2023-10-14T19:04:30.830233+0000","last_fullsized":"2023-10-14T19:04:30.830233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:29.807101+0000","last_clean_scrub_stamp":"2023-10-14T19:04:29.807101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:57:08.924836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-14T19:04:30.827576+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:30.827576+0000","last_peered":"2023-10-14T19:04:30.827576+0000","last_clean":"2023-10-14T19:04:30.827576+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:30.827576+0000","last_undegraded":"2023-10-14T19:04:30.827576+0000","last_fullsized":"2023-10-14T19:04:30.827576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":846243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.626}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.441}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":610304,"data_stored":255715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.75600000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301984,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069856,"statfs":{"total":96636764160,"available":96327532544,"internally_reserved":0,"allocated":614400,"data_stored":255805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.215},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.249},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":848173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34499999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.311},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28799999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.504},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":255771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.317},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.33400000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.374}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":255771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.435}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64000000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297896,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":622592,"data_stored":257251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":3.3220000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":5.7830000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":3.488},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":1.254}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.6200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":3.5230000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":1.2949999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":1.5269999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":3.9729999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":3.6259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":256339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.503},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:04:36.320 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:04:36.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:04:36.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.479+0000 7f5a0a034700 1 Processor -- start 2023-10-14T19:04:36.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.479+0000 7f5a0a034700 1 -- start start 2023-10-14T19:04:36.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a0a034700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f5a040cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a0a034700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040cf3a0 con 0x7f5a040cef40 2023-10-14T19:04:36.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a0a034700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040cc350 con 0x7f5a04159380 2023-10-14T19:04:36.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a0a034700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040cb740 con 0x7f5a04159750 2023-10-14T19:04:36.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a09833700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5a040cef40 0x7f5a040b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37762/0 (socket says 172.21.15.7:37762) 2023-10-14T19:04:36.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a09833700 1 -- 172.21.15.7:0/3777293531 learned_addr learned my addr 172.21.15.7:0/3777293531 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:36.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889955531 0 0) 0x7f59f4001490 con 0x7f5a040cef40 2023-10-14T19:04:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ec003570 con 0x7f5a040cef40 2023-10-14T19:04:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.480+0000 7f5a08831700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f5a040cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2028951117 0 0) 0x7f59ec003570 con 0x7f5a040cef40 2023-10-14T19:04:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 msgr2=0x7f5a040cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:36.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f5a040cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 >> v1:172.21.15.148:6789/0 conn(0x7f5a04159380 legacy=0x7f5a0415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040cba20 con 0x7f5a040cef40 2023-10-14T19:04:36.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f59f4001980 con 0x7f5a040cef40 2023-10-14T19:04:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a08831700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f5a040cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 >> v1:172.21.15.7:6789/0 conn(0x7f5a040cef40 legacy=0x7f5a040b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f59ec003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59ec004080 0x7f59ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59ec004d50 0x7f59ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040cb740 con 0x7f59ec004d50 2023-10-14T19:04:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec00bca0 con 0x7f59ec004080 2023-10-14T19:04:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec00be60 con 0x7f5a04159750 2023-10-14T19:04:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59ec004d50 0x7f59ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09032700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f59ec003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a08831700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59ec004080 0x7f59ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 -- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 msgr2=0x7f59ec003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a04159750 0x7f59ec003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 -- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59ec004080 msgr2=0x7f59ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59ec004080 0x7f59ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 -- 172.21.15.7:0/3777293531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec003570 con 0x7f59ec004d50 2023-10-14T19:04:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.481+0000 7f5a09833700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59ec004d50 0x7f59ec0051c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f59f4002250 tx=0x7f59f400a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f50d62c0af7208d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400c5d0 con 0x7f59ec004d50 2023-10-14T19:04:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400c730 con 0x7f59ec004d50 2023-10-14T19:04:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a03fff700 1 -- 172.21.15.7:0/3777293531 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400caf0 con 0x7f59ec004d50 2023-10-14T19:04:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a0a034700 1 -- 172.21.15.7:0/3777293531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59ec004d50 msgr2=0x7f59ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a0a034700 1 --2- 172.21.15.7:0/3777293531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59ec004d50 0x7f59ec0051c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f59f4002250 tx=0x7f59f400a170 comp rx=0 tx=0).stop 2023-10-14T19:04:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a09833700 1 -- 172.21.15.7:0/3777293531 reap_dead start 2023-10-14T19:04:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a0a034700 1 -- 172.21.15.7:0/3777293531 shutdown_connections 2023-10-14T19:04:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a0a034700 1 -- 172.21.15.7:0/3777293531 >> 172.21.15.7:0/3777293531 conn(0x7f5a040703a0 msgr2=0x7f5a040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a0a034700 1 -- 172.21.15.7:0/3777293531 shutdown_connections 2023-10-14T19:04:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.482+0000 7f5a0a034700 1 -- 172.21.15.7:0/3777293531 wait complete. 2023-10-14T19:04:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.483+0000 7f5a0a034700 1 Processor -- start 2023-10-14T19:04:36.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.483+0000 7f5a0a034700 1 -- start start 2023-10-14T19:04:36.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a0a034700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 0x7f5a0416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a0a034700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0414a0b0 0x7f5a040d0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a0a034700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a040d0c40 0x7f5a040c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a0a034700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040d10b0 con 0x7f5a04149940 2023-10-14T19:04:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a0a034700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0416aa60 con 0x7f5a040d0c40 2023-10-14T19:04:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a0a034700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040c7bb0 con 0x7f5a0414a0b0 2023-10-14T19:04:36.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a09032700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 0x7f5a0416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a09032700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 0x7f5a0416a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59916/0 (socket says 172.21.15.7:59916) 2023-10-14T19:04:36.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.484+0000 7f5a09032700 1 -- 172.21.15.7:0/916512905 learned_addr learned my addr 172.21.15.7:0/916512905 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:36.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09833700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a040d0c40 0x7f5a040c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a08831700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0414a0b0 0x7f5a040d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09032700 1 -- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0414a0b0 msgr2=0x7f5a040d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09032700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0414a0b0 0x7f5a040d0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09032700 1 -- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a040d0c40 msgr2=0x7f5a040c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09032700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a040d0c40 0x7f5a040c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09032700 1 -- 172.21.15.7:0/916512905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040c7e90 con 0x7f5a04149940 2023-10-14T19:04:36.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a09032700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 0x7f5a0416a520 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f59fc002920 tx=0x7f59fc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00f8d0 con 0x7f5a04149940 2023-10-14T19:04:36.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc00fa30 con 0x7f5a04149940 2023-10-14T19:04:36.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a040c8170 con 0x7f5a04149940 2023-10-14T19:04:36.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00fdf0 con 0x7f5a04149940 2023-10-14T19:04:36.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.485+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a040c8730 con 0x7f5a04149940 2023-10-14T19:04:36.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.486+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0404c3c0 con 0x7f5a04149940 2023-10-14T19:04:36.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.486+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59fc013600 con 0x7f5a04149940 2023-10-14T19:04:36.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.487+0000 7f5a017fa700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59f0066f30 0x7f59f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.487+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59fc084a70 con 0x7f5a04149940 2023-10-14T19:04:36.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.487+0000 7f5a08831700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59f0066f30 0x7f59f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.488+0000 7f5a08831700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59f0066f30 0x7f59f00693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009310 tx=0x7f59f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.491+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59fc051ce0 con 0x7f5a04149940 2023-10-14T19:04:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.762+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5a040cbd00 con 0x7f5a04149940 2023-10-14T19:04:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.766+0000 7f5a017fa700 1 -- 172.21.15.7:0/916512905 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f59fc055300 con 0x7f5a04149940 2023-10-14T19:04:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59f0066f30 msgr2=0x7f59f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59f0066f30 0x7f59f00693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009310 tx=0x7f59f8008040 comp rx=0 tx=0).stop 2023-10-14T19:04:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 msgr2=0x7f5a0416a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 0x7f5a0416a520 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f59fc002920 tx=0x7f59fc007d30 comp rx=0 tx=0).stop 2023-10-14T19:04:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 shutdown_connections 2023-10-14T19:04:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59f0066f30 0x7f59f00693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a040d0c40 0x7f5a040c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a04149940 0x7f5a0416a520 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 --2- 172.21.15.7:0/916512905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0414a0b0 0x7f5a040d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 >> 172.21.15.7:0/916512905 conn(0x7f5a040703a0 msgr2=0x7f5a0415f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 shutdown_connections 2023-10-14T19:04:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.768+0000 7f5a0a034700 1 -- 172.21.15.7:0/916512905 wait complete. 2023-10-14T19:04:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:04:36.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.899+0000 7f319d70c700 1 Processor -- start 2023-10-14T19:04:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.899+0000 7f319d70c700 1 -- start start 2023-10-14T19:04:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f319d70c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f31980cb5a0 0x7f31980cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f319d70c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319815ae40 con 0x7f319815a5d0 2023-10-14T19:04:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f319d70c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319815ab60 con 0x7f31980cd9e0 2023-10-14T19:04:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f319d70c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980d13f0 con 0x7f31980cb5a0 2023-10-14T19:04:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f3196ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f31980cb5a0 0x7f31980cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f31977fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f319815a5d0 0x7f3198156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47468/0 (socket says 172.21.15.7:47468) 2023-10-14T19:04:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f31977fe700 1 -- 172.21.15.7:0/69832278 learned_addr learned my addr 172.21.15.7:0/69832278 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f3196ffd700 1 -- 172.21.15.7:0/69832278 >> v1:172.21.15.148:6789/0 conn(0x7f31980cd9e0 legacy=0x7f3198159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.900+0000 7f3196ffd700 1 -- 172.21.15.7:0/69832278 >> v1:172.21.15.7:6789/0 conn(0x7f319815a5d0 legacy=0x7f3198156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f3196ffd700 1 -- 172.21.15.7:0/69832278 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980ccf00 con 0x7f31980cb5a0 2023-10-14T19:04:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f3195ffb700 1 -- 172.21.15.7:0/69832278 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856552772 0 0) 0x7f319815ae40 con 0x7f319815a5d0 2023-10-14T19:04:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f3196ffd700 1 --2- 172.21.15.7:0/69832278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31980cb970 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e90 tx=0x7f3188009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b62436012e3f444 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f3195ffb700 1 -- 172.21.15.7:0/69832278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800e070 con 0x7f31980cb5a0 2023-10-14T19:04:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f3195ffb700 1 -- 172.21.15.7:0/69832278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800bbb0 con 0x7f31980cb5a0 2023-10-14T19:04:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f3195ffb700 1 -- 172.21.15.7:0/69832278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188012430 con 0x7f31980cb5a0 2023-10-14T19:04:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 -- 172.21.15.7:0/69832278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 msgr2=0x7f31980cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 --2- 172.21.15.7:0/69832278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31980cb970 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e90 tx=0x7f3188009780 comp rx=0 tx=0).stop 2023-10-14T19:04:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 -- 172.21.15.7:0/69832278 shutdown_connections 2023-10-14T19:04:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 --2- 172.21.15.7:0/69832278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31980cb970 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 -- 172.21.15.7:0/69832278 >> 172.21.15.7:0/69832278 conn(0x7f3198070e30 msgr2=0x7f31980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 -- 172.21.15.7:0/69832278 shutdown_connections 2023-10-14T19:04:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.901+0000 7f319d70c700 1 -- 172.21.15.7:0/69832278 wait complete. 2023-10-14T19:04:36.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 Processor -- start 2023-10-14T19:04:36.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 -- start start 2023-10-14T19:04:36.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31981531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31980cd9e0 0x7f31980b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f319815a5d0 0x7f3198169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319815cf30 con 0x7f31980cb5a0 2023-10-14T19:04:36.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980b4cf0 con 0x7f31980cd9e0 2023-10-14T19:04:36.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f319d70c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319815c600 con 0x7f319815a5d0 2023-10-14T19:04:36.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31981531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31981531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49284/0 (socket says 172.21.15.7:49284) 2023-10-14T19:04:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.903+0000 7f3196ffd700 1 -- 172.21.15.7:0/873150729 learned_addr learned my addr 172.21.15.7:0/873150729 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f31967fc700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31980cd9e0 0x7f31980b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f31977fe700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f319815a5d0 0x7f3198169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f3196ffd700 1 -- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f319815a5d0 msgr2=0x7f3198169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f3196ffd700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f319815a5d0 0x7f3198169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f3196ffd700 1 -- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31980cd9e0 msgr2=0x7f31980b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f3196ffd700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31980cd9e0 0x7f31980b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f3196ffd700 1 -- 172.21.15.7:0/873150729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009a20 con 0x7f31980cb5a0 2023-10-14T19:04:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f31977fe700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f319815a5d0 0x7f3198169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f3196ffd700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31981531f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f31880097c0 tx=0x7f3188018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188012e60 con 0x7f31980cb5a0 2023-10-14T19:04:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318801d640 con 0x7f31980cb5a0 2023-10-14T19:04:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319815c8e0 con 0x7f31980cb5a0 2023-10-14T19:04:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318801da00 con 0x7f31980cb5a0 2023-10-14T19:04:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.904+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198153730 con 0x7f31980cb5a0 2023-10-14T19:04:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.905+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319804c3c0 con 0x7f31980cb5a0 2023-10-14T19:04:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.906+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3188024070 con 0x7f31980cb5a0 2023-10-14T19:04:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.906+0000 7f318effd700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3178066f60 0x7f3178069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.906+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3188086f10 con 0x7f31980cb5a0 2023-10-14T19:04:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.906+0000 7f31967fc700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3178066f60 0x7f3178069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.907+0000 7f31967fc700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3178066f60 0x7f3178069410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3180006fd0 tx=0x7f3180008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:36.910+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3188054180 con 0x7f31980cb5a0 2023-10-14T19:04:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.146+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31980cd1e0 con 0x7f31980cb5a0 2023-10-14T19:04:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.146+0000 7f318effd700 1 -- 172.21.15.7:0/873150729 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f31880577a0 con 0x7f31980cb5a0 2023-10-14T19:04:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:37.147 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:31.225490+0000","modified":"2023-10-14T19:04:34.832188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/1084131518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1084131518},{"type":"v1","addr":"172.21.15.7:6834","nonce":1084131518}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T19:04:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3178066f60 msgr2=0x7f3178069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3178066f60 0x7f3178069410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3180006fd0 tx=0x7f3180008040 comp rx=0 tx=0).stop 2023-10-14T19:04:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 msgr2=0x7f31981531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31981531f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f31880097c0 tx=0x7f3188018000 comp rx=0 tx=0).stop 2023-10-14T19:04:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 shutdown_connections 2023-10-14T19:04:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3178066f60 0x7f3178069410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f319815a5d0 0x7f3198169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31980cb5a0 0x7f31981531f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 --2- 172.21.15.7:0/873150729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31980cd9e0 0x7f31980b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 >> 172.21.15.7:0/873150729 conn(0x7f3198070e30 msgr2=0x7f31980b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 shutdown_connections 2023-10-14T19:04:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.148+0000 7f319d70c700 1 -- 172.21.15.7:0/873150729 wait complete. 2023-10-14T19:04:37.151 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2023-10-14T19:04:37.160 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-14T19:04:37.160+0000 7f58391df700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:04:37.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:04:31.225490+0000', 'modified': '2023-10-14T19:04:34.832188+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5298': {'gid': 5298, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6834/1084131518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6832', 'nonce': 1084131518}, {'type': 'v1', 'addr': '172.21.15.7:6834', 'nonce': 1084131518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:04:37.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:04:37.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T19:04:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.687+0000 7f7d295fd700 1 Processor -- start 2023-10-14T19:04:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.687+0000 7f7d295fd700 1 -- start start 2023-10-14T19:04:37.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d295fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7d24155b70 0x7f7d240b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d295fd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 0x7f7d240b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d295fd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d24157510 con 0x7f7d240add80 2023-10-14T19:04:37.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d295fd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240ae2f0 con 0x7f7d24155b70 2023-10-14T19:04:37.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d295fd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240ae5d0 con 0x7f7d241589b0 2023-10-14T19:04:37.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d227fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7d240add80 0x7f7d24155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47482/0 (socket says 172.21.15.7:47482) 2023-10-14T19:04:37.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d227fc700 1 -- 172.21.15.7:0/1302680431 learned_addr learned my addr 172.21.15.7:0/1302680431 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:37.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1302680431 >> v2:172.21.15.148:3300/0 conn(0x7f7d24155b70 0x7f7d240b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d237fe700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 0x7f7d240b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710893212 0 0) 0x7f7d24157510 con 0x7f7d240add80 2023-10-14T19:04:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d10003570 con 0x7f7d240add80 2023-10-14T19:04:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2892285287 0 0) 0x7f7d10003570 con 0x7f7d240add80 2023-10-14T19:04:37.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 msgr2=0x7f7d240b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 0x7f7d240b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 >> v2:172.21.15.148:3300/0 conn(0x7f7d24155b70 msgr2=0x7f7d240b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 --2- 172.21.15.7:0/1302680431 >> v2:172.21.15.148:3300/0 conn(0x7f7d24155b70 0x7f7d240b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240ae8b0 con 0x7f7d240add80 2023-10-14T19:04:37.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f7d0c001470 con 0x7f7d240add80 2023-10-14T19:04:37.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 >> v1:172.21.15.7:6789/0 conn(0x7f7d240add80 legacy=0x7f7d24155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d10003a60 0x7f7d10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10004810 0x7f7d10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 0x7f7d100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240ae2f0 con 0x7f7d10003a60 2023-10-14T19:04:37.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240ae5d0 con 0x7f7d10004810 2023-10-14T19:04:37.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.688+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1000ba60 con 0x7f7d241589b0 2023-10-14T19:04:37.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d10003a60 0x7f7d10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d237fe700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 0x7f7d100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d227fc700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10004810 0x7f7d10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 -- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 msgr2=0x7f7d100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241589b0 0x7f7d100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 -- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10004810 msgr2=0x7f7d10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10004810 0x7f7d10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 -- 172.21.15.7:0/1302680431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10003570 con 0x7f7d10003a60 2023-10-14T19:04:37.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d10003a60 0x7f7d10003e70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009c30 tx=0x7f7d1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcd0d09bef25593 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00e710 con 0x7f7d10003a60 2023-10-14T19:04:37.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c00e870 con 0x7f7d10003a60 2023-10-14T19:04:37.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.689+0000 7f7d21ffb700 1 -- 172.21.15.7:0/1302680431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00ec30 con 0x7f7d10003a60 2023-10-14T19:04:37.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d295fd700 1 -- 172.21.15.7:0/1302680431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d10003a60 msgr2=0x7f7d10003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d295fd700 1 --2- 172.21.15.7:0/1302680431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d10003a60 0x7f7d10003e70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009c30 tx=0x7f7d1c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d237fe700 1 -- 172.21.15.7:0/1302680431 reap_dead start 2023-10-14T19:04:37.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d295fd700 1 -- 172.21.15.7:0/1302680431 shutdown_connections 2023-10-14T19:04:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d295fd700 1 -- 172.21.15.7:0/1302680431 >> 172.21.15.7:0/1302680431 conn(0x7f7d2406d170 msgr2=0x7f7d240cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d295fd700 1 -- 172.21.15.7:0/1302680431 shutdown_connections 2023-10-14T19:04:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.690+0000 7f7d295fd700 1 -- 172.21.15.7:0/1302680431 wait complete. 2023-10-14T19:04:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.691+0000 7f7d295fd700 1 Processor -- start 2023-10-14T19:04:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.691+0000 7f7d295fd700 1 -- start start 2023-10-14T19:04:37.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d295fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10003a60 0x7f7d24141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d295fd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241426e0 0x7f7d24142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d295fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 0x7f7d24154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d295fd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d24146980 con 0x7f7d24154130 2023-10-14T19:04:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d295fd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d24154ac0 con 0x7f7d10003a60 2023-10-14T19:04:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d295fd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d241424f0 con 0x7f7d241426e0 2023-10-14T19:04:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 0x7f7d24154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 0x7f7d24154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49294/0 (socket says 172.21.15.7:49294) 2023-10-14T19:04:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 -- 172.21.15.7:0/2983347540 learned_addr learned my addr 172.21.15.7:0/2983347540 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10003a60 0x7f7d24141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241426e0 0x7f7d24142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 -- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241426e0 msgr2=0x7f7d24142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241426e0 0x7f7d24142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 -- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10003a60 msgr2=0x7f7d24141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10003a60 0x7f7d24141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 -- 172.21.15.7:0/2983347540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24143160 con 0x7f7d24154130 2023-10-14T19:04:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.692+0000 7f7d237fe700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 0x7f7d24154580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009d70 tx=0x7f7d1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.693+0000 7f7d1affd700 1 -- 172.21.15.7:0/2983347540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400e040 con 0x7f7d24154130 2023-10-14T19:04:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.693+0000 7f7d1affd700 1 -- 172.21.15.7:0/2983347540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1400f040 con 0x7f7d24154130 2023-10-14T19:04:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.693+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d24143440 con 0x7f7d24154130 2023-10-14T19:04:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.693+0000 7f7d1affd700 1 -- 172.21.15.7:0/2983347540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400fda0 con 0x7f7d24154130 2023-10-14T19:04:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.693+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2414ac90 con 0x7f7d24154130 2023-10-14T19:04:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.694+0000 7f7d1affd700 1 -- 172.21.15.7:0/2983347540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d14015640 con 0x7f7d24154130 2023-10-14T19:04:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.694+0000 7f7d1affd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7d04066f30 0x7f7d040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.695+0000 7f7d1affd700 1 -- 172.21.15.7:0/2983347540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d14084da0 con 0x7f7d24154130 2023-10-14T19:04:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.695+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7d04066f30 0x7f7d040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.695+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7d04066f30 0x7f7d040693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0091e0 tx=0x7f7d1c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.696+0000 7f7d328f6b80 1 Processor -- start 2023-10-14T19:04:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.696+0000 7f7d328f6b80 1 -- start start 2023-10-14T19:04:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc2553ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc25567a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc2553acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc25495a70 con 0x55fc25588d00 2023-10-14T19:04:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc25493270 con 0x55fc2553ea50 2023-10-14T19:04:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc2548f060 con 0x55fc25567f60 2023-10-14T19:04:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d227fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc25567a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d227fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc25567a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49306/0 (socket says 172.21.15.7:49306) 2023-10-14T19:04:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d227fc700 1 -- 172.21.15.7:0/659042588 learned_addr learned my addr 172.21.15.7:0/659042588 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc2553ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.697+0000 7f7d237fe700 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc2553acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d227fc700 1 -- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 msgr2=0x55fc2553acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d227fc700 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc2553acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d227fc700 1 -- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 msgr2=0x55fc2553ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d227fc700 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc2553ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d227fc700 1 -- 172.21.15.7:0/659042588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc25329270 con 0x55fc25588d00 2023-10-14T19:04:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d227fc700 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc25567a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c005bc0 tx=0x7f7d0c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1c0733cbca740a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d03fff700 1 -- 172.21.15.7:0/659042588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011ab0 con 0x55fc25588d00 2023-10-14T19:04:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d03fff700 1 -- 172.21.15.7:0/659042588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c011c10 con 0x55fc25588d00 2023-10-14T19:04:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.698+0000 7f7d03fff700 1 -- 172.21.15.7:0/659042588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c015470 con 0x55fc25588d00 2023-10-14T19:04:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 -- 172.21.15.7:0/659042588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 msgr2=0x55fc25567a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc25567a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c005bc0 tx=0x7f7d0c007040 comp rx=0 tx=0).stop 2023-10-14T19:04:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 -- 172.21.15.7:0/659042588 shutdown_connections 2023-10-14T19:04:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc2553ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc2553acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/659042588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc25567a20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 -- 172.21.15.7:0/659042588 >> 172.21.15.7:0/659042588 conn(0x55fc25540370 msgr2=0x55fc25540740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 -- 172.21.15.7:0/659042588 shutdown_connections 2023-10-14T19:04:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 -- 172.21.15.7:0/659042588 wait complete. 2023-10-14T19:04:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 -- start start 2023-10-14T19:04:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.699+0000 7f7d328f6b80 1 Processor -- start 2023-10-14T19:04:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc25595b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc255850f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc2557ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2543a890 con 0x55fc25588d00 2023-10-14T19:04:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc25455ea0 con 0x55fc2553ea50 2023-10-14T19:04:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc25311e30 con 0x55fc25567f60 2023-10-14T19:04:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d328f6b80 10 client.0 _ll_register_callbacks cb 0x55fc25502110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:04:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc2557ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc2557ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49316/0 (socket says 172.21.15.7:49316) 2023-10-14T19:04:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d237fe700 1 -- 172.21.15.7:0/1148426789 learned_addr learned my addr 172.21.15.7:0/1148426789 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.700+0000 7f7d227fc700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc255850f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc25595b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d237fe700 1 -- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 msgr2=0x55fc255850f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d237fe700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc255850f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d237fe700 1 -- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 msgr2=0x55fc25595b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d237fe700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc25595b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d237fe700 1 -- 172.21.15.7:0/1148426789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c00f040 con 0x55fc25588d00 2023-10-14T19:04:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc25595b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d237fe700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc2557ee70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d140094d0 tx=0x7f7d14058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c079527fb870127 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d017fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:04:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d017fa700 1 -- 172.21.15.7:0/1148426789 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14055770 con 0x55fc25588d00 2023-10-14T19:04:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d017fa700 1 -- 172.21.15.7:0/1148426789 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d14058e80 con 0x55fc25588d00 2023-10-14T19:04:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc25533b70 con 0x55fc25588d00 2023-10-14T19:04:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d017fa700 1 -- 172.21.15.7:0/1148426789 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1405cbd0 con 0x55fc25588d00 2023-10-14T19:04:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 10 client.5433 fetch_fsmap learned FSMap version 30 2023-10-14T19:04:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55fc252cbfe0 con 0x55fc25588d00 2023-10-14T19:04:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d017fa700 1 -- 172.21.15.7:0/1148426789 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14081080 con 0x55fc25588d00 2023-10-14T19:04:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d017fa700 1 -- 172.21.15.7:0/1148426789 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7d14059bc0 con 0x55fc25588d00 2023-10-14T19:04:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 10 client.5433 fetch_fsmap finished waiting for FSMap version 30 2023-10-14T19:04:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 10 client.5433 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:04:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 20 client.5433 populate_metadata read hostname 'smithi007' 2023-10-14T19:04:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.701+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25588260 0x55fc25588630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d328f6b80 4 client.5433 mds_command: new command op to 5298 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:04:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 --> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc25510aa0 con 0x55fc25588260 2023-10-14T19:04:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25588260 0x55fc25588630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25588260 0x55fc25588630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c96ef70e0295ed3 server_cookie=31e2546fbca26ed8 in_seq=0 out_seq=0 2023-10-14T19:04:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d017fa700 10 client.5433 ms_handle_connect on v2:172.21.15.7:6832/1084131518 2023-10-14T19:04:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d017fa700 1 -- 172.21.15.7:0/1148426789 <== mds.0 v2:172.21.15.7:6832/1084131518 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fc25510aa0 con 0x55fc25588260 2023-10-14T19:04:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d017fa700 10 client.5433 handle_command_reply: tid=0 2023-10-14T19:04:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.702+0000 7f7d328f6b80 1 client.5433 shutdown 2023-10-14T19:04:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 msgr2=0x55fc2557ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc2557ee70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d140094d0 tx=0x7f7d14058040 comp rx=0 tx=0).stop 2023-10-14T19:04:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 shutdown_connections 2023-10-14T19:04:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25588260 0x55fc25588630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc2553ea50 0x55fc25595b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25588d00 0x55fc2557ee70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/1148426789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc25567f60 0x55fc255850f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d017fa700 0 client.5433 ms_handle_reset on v2:172.21.15.7:6832/1084131518 2023-10-14T19:04:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 >> 172.21.15.7:0/1148426789 conn(0x55fc25540370 msgr2=0x55fc2553b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 shutdown_connections 2023-10-14T19:04:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 1 -- 172.21.15.7:0/1148426789 wait complete. 2023-10-14T19:04:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.703+0000 7f7d328f6b80 20 client.5433 trim_cache size 0 max 16384 2023-10-14T19:04:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 Processor -- start 2023-10-14T19:04:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 -- start start 2023-10-14T19:04:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 0x55fc2553afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 0x55fc2559f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc255395a0 con 0x55fc25567f60 2023-10-14T19:04:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc25583dc0 con 0x55fc25588d00 2023-10-14T19:04:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc2551e510 con 0x55fc2553ea50 2023-10-14T19:04:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d227fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d227fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49330/0 (socket says 172.21.15.7:49330) 2023-10-14T19:04:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.720+0000 7f7d227fc700 1 -- 172.21.15.7:0/2976671129 learned_addr learned my addr 172.21.15.7:0/2976671129 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d227fc700 1 -- 172.21.15.7:0/2976671129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 msgr2=0x55fc2553afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 0x55fc2553afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d227fc700 1 -- 172.21.15.7:0/2976671129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 msgr2=0x55fc2559f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 0x55fc2559f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d227fc700 1 -- 172.21.15.7:0/2976671129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc2545d780 con 0x55fc25567f60 2023-10-14T19:04:37.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0016e0 tx=0x7f7d0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362872d9da777bde server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d18ff9700 1 -- 172.21.15.7:0/2976671129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011ab0 con 0x55fc25567f60 2023-10-14T19:04:37.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d18ff9700 1 -- 172.21.15.7:0/2976671129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c015470 con 0x55fc25567f60 2023-10-14T19:04:37.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d18ff9700 1 -- 172.21.15.7:0/2976671129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011d80 con 0x55fc25567f60 2023-10-14T19:04:37.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2976671129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 msgr2=0x55fc2559ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.721+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0016e0 tx=0x7f7d0c017000 comp rx=0 tx=0).stop 2023-10-14T19:04:37.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2976671129 shutdown_connections 2023-10-14T19:04:37.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 0x55fc2559f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 0x55fc2553afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2976671129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2976671129 >> 172.21.15.7:0/2976671129 conn(0x55fc25540370 msgr2=0x55fc25540740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2976671129 shutdown_connections 2023-10-14T19:04:37.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2976671129 wait complete. 2023-10-14T19:04:37.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 -- start start 2023-10-14T19:04:37.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.722+0000 7f7d328f6b80 1 Processor -- start 2023-10-14T19:04:37.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 0x55fc25539d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 0x55fc2559f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc255ec880 con 0x55fc25567f60 2023-10-14T19:04:37.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2553b300 con 0x55fc25588d00 2023-10-14T19:04:37.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc255ecec0 con 0x55fc2553ea50 2023-10-14T19:04:37.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d328f6b80 10 client.0 _ll_register_callbacks cb 0x55fc25502110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:04:37.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49344/0 (socket says 172.21.15.7:49344) 2023-10-14T19:04:37.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 -- 172.21.15.7:0/2068169316 learned_addr learned my addr 172.21.15.7:0/2068169316 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 -- 172.21.15.7:0/2068169316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 msgr2=0x55fc25539d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 0x55fc25539d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 -- 172.21.15.7:0/2068169316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 msgr2=0x55fc2559f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 0x55fc2559f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.723+0000 7f7d227fc700 1 -- 172.21.15.7:0/2068169316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc25329270 con 0x55fc25567f60 2023-10-14T19:04:37.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d227fc700 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c001050 tx=0x7f7d0c024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f265f8a73fbb61b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d017fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:04:37.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d017fa700 1 -- 172.21.15.7:0/2068169316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c004d40 con 0x55fc25567f60 2023-10-14T19:04:37.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d017fa700 1 -- 172.21.15.7:0/2068169316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d0c037af0 con 0x55fc25567f60 2023-10-14T19:04:37.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d0c011c10 con 0x55fc25567f60 2023-10-14T19:04:37.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d017fa700 1 -- 172.21.15.7:0/2068169316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d0c004ea0 con 0x55fc25567f60 2023-10-14T19:04:37.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 10 client.5439 fetch_fsmap learned FSMap version 30 2023-10-14T19:04:37.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55fc25444470 con 0x55fc25567f60 2023-10-14T19:04:37.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d017fa700 1 -- 172.21.15.7:0/2068169316 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c011c10 con 0x55fc25567f60 2023-10-14T19:04:37.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d017fa700 1 -- 172.21.15.7:0/2068169316 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7d0c015820 con 0x55fc25567f60 2023-10-14T19:04:37.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 10 client.5439 fetch_fsmap finished waiting for FSMap version 30 2023-10-14T19:04:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 10 client.5439 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:04:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 20 client.5439 populate_metadata read hostname 'smithi007' 2023-10-14T19:04:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25593d20 0x55fc255940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 4 client.5439 mds_command: new command op to 5298 tid=0[{"prefix": "status"}] 2023-10-14T19:04:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 --> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fc25431e00 con 0x55fc25593d20 2023-10-14T19:04:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.724+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25593d20 0x55fc255940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d017fa700 10 client.5439 ms_handle_connect on v2:172.21.15.7:6832/1084131518 2023-10-14T19:04:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d22ffd700 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25593d20 0x55fc255940f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e65741db3f6f14 server_cookie=fc0dd407ef8336fe in_seq=0 out_seq=0 2023-10-14T19:04:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d017fa700 1 -- 172.21.15.7:0/2068169316 <== mds.0 v2:172.21.15.7:6832/1084131518 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55fc25431e00 con 0x55fc25593d20 2023-10-14T19:04:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d017fa700 10 client.5439 handle_command_reply: tid=0 2023-10-14T19:04:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 client.5439 shutdown 2023-10-14T19:04:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 msgr2=0x55fc2559ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c001050 tx=0x7f7d0c024040 comp rx=0 tx=0).stop 2023-10-14T19:04:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 shutdown_connections 2023-10-14T19:04:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:6832/1084131518,v1:172.21.15.7:6834/1084131518] conn(0x55fc25593d20 0x55fc255940f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc25588d00 0x55fc2559f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55fc2553ea50 0x55fc25539d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 --2- 172.21.15.7:0/2068169316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc25567f60 0x55fc2559ebf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 >> 172.21.15.7:0/2068169316 conn(0x55fc25540370 msgr2=0x55fc255374b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d017fa700 0 client.5439 ms_handle_reset on v2:172.21.15.7:6832/1084131518 2023-10-14T19:04:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 shutdown_connections 2023-10-14T19:04:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 1 -- 172.21.15.7:0/2068169316 wait complete. 2023-10-14T19:04:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.725+0000 7f7d328f6b80 20 client.5439 trim_cache size 0 max 16384 2023-10-14T19:04:37.756 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:04:37.756 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:04:37.756 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:04:37.756 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5298, 2023-10-14T19:04:37.756 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:04:37.756 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:04:37.757 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:04:37.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.9072732449999998, 2023-10-14T19:04:37.757 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 30, 2023-10-14T19:04:37.757 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 52, 2023-10-14T19:04:37.757 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 52, 2023-10-14T19:04:37.757 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.954991914000001 2023-10-14T19:04:37.758 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:04:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7d04066f30 msgr2=0x7f7d040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7d04066f30 0x7f7d040693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0091e0 tx=0x7f7d1c01a000 comp rx=0 tx=0).stop 2023-10-14T19:04:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 msgr2=0x7f7d24154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 0x7f7d24154580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009d70 tx=0x7f7d1400b040 comp rx=0 tx=0).stop 2023-10-14T19:04:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 shutdown_connections 2023-10-14T19:04:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7d04066f30 0x7f7d040693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d10003a60 0x7f7d24141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d24154130 0x7f7d24154580 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 --2- 172.21.15.7:0/2983347540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d241426e0 0x7f7d24142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 >> 172.21.15.7:0/2983347540 conn(0x7f7d2406d170 msgr2=0x7f7d24069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 shutdown_connections 2023-10-14T19:04:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.726+0000 7f7d295fd700 1 -- 172.21.15.7:0/2983347540 wait complete. 2023-10-14T19:04:37.765 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:04:37.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.886+0000 7f9183ea8700 1 Processor -- start 2023-10-14T19:04:37.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.886+0000 7f9183ea8700 1 -- start start 2023-10-14T19:04:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9183ea8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9183ea8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f917c0cd9e0 0x7f917c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9183ea8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f917c0cde50 0x7f917c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9183ea8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c0d13f0 con 0x7f917c0cde50 2023-10-14T19:04:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9183ea8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c15a940 con 0x7f917c0cd9e0 2023-10-14T19:04:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9183ea8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c15ae40 con 0x7f917c0cb5a0 2023-10-14T19:04:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9182445700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f917c0cde50 0x7f917c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9182445700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f917c0cde50 0x7f917c15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49360/0 (socket says 172.21.15.7:49360) 2023-10-14T19:04:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9182445700 1 -- 172.21.15.7:0/2015944151 learned_addr learned my addr 172.21.15.7:0/2015944151 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9182445700 1 -- 172.21.15.7:0/2015944151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 msgr2=0x7f917c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9182445700 1 --2- 172.21.15.7:0/2015944151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.887+0000 7f9181443700 1 --2- 172.21.15.7:0/2015944151 >> v2:172.21.15.148:3300/0 conn(0x7f917c0cd9e0 0x7f917c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9182445700 1 -- 172.21.15.7:0/2015944151 >> v2:172.21.15.148:3300/0 conn(0x7f917c0cd9e0 msgr2=0x7f917c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9182445700 1 --2- 172.21.15.7:0/2015944151 >> v2:172.21.15.148:3300/0 conn(0x7f917c0cd9e0 0x7f917c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9182445700 1 -- 172.21.15.7:0/2015944151 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c15ab60 con 0x7f917c0cde50 2023-10-14T19:04:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9181443700 1 --2- 172.21.15.7:0/2015944151 >> v2:172.21.15.148:3300/0 conn(0x7f917c0cd9e0 0x7f917c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9182445700 1 --2- 172.21.15.7:0/2015944151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cde50 0x7f917c15a400 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f917c06ea90 tx=0x7f916c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caf09019c38345 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9180c42700 1 -- 172.21.15.7:0/2015944151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00e070 con 0x7f917c0cde50 2023-10-14T19:04:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9180c42700 1 -- 172.21.15.7:0/2015944151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00ba40 con 0x7f917c0cde50 2023-10-14T19:04:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9180c42700 1 -- 172.21.15.7:0/2015944151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0092e0 con 0x7f917c0cde50 2023-10-14T19:04:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 -- 172.21.15.7:0/2015944151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cde50 msgr2=0x7f917c15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2015944151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cde50 0x7f917c15a400 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f917c06ea90 tx=0x7f916c009840 comp rx=0 tx=0).stop 2023-10-14T19:04:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 -- 172.21.15.7:0/2015944151 shutdown_connections 2023-10-14T19:04:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2015944151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cde50 0x7f917c15a400 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2015944151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2015944151 >> v2:172.21.15.148:3300/0 conn(0x7f917c0cd9e0 0x7f917c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.888+0000 7f9183ea8700 1 -- 172.21.15.7:0/2015944151 >> 172.21.15.7:0/2015944151 conn(0x7f917c070e30 msgr2=0x7f917c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.889+0000 7f9183ea8700 1 -- 172.21.15.7:0/2015944151 shutdown_connections 2023-10-14T19:04:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.889+0000 7f9183ea8700 1 -- 172.21.15.7:0/2015944151 wait complete. 2023-10-14T19:04:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 Processor -- start 2023-10-14T19:04:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 -- start start 2023-10-14T19:04:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 0x7f917c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c0c96a0 0x7f917c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c1565e0 con 0x7f917c0cd9e0 2023-10-14T19:04:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c158bd0 con 0x7f917c0c96a0 2023-10-14T19:04:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9183ea8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c158e70 con 0x7f917c0cb5a0 2023-10-14T19:04:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9181443700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 0x7f917c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9181443700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 0x7f917c1560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49366/0 (socket says 172.21.15.7:49366) 2023-10-14T19:04:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.890+0000 7f9181443700 1 -- 172.21.15.7:0/2501975661 learned_addr learned my addr 172.21.15.7:0/2501975661 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9182445700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c0c96a0 0x7f917c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181c44700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181443700 1 -- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 msgr2=0x7f917c155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181443700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181443700 1 -- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c0c96a0 msgr2=0x7f917c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181443700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c0c96a0 0x7f917c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181443700 1 -- 172.21.15.7:0/2501975661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009ae0 con 0x7f917c0cd9e0 2023-10-14T19:04:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9181443700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 0x7f917c1560a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f917000c830 tx=0x7f9170008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011600 con 0x7f917c0cd9e0 2023-10-14T19:04:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170011760 con 0x7f917c0cd9e0 2023-10-14T19:04:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c159150 con 0x7f917c0cd9e0 2023-10-14T19:04:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011b20 con 0x7f917c0cd9e0 2023-10-14T19:04:37.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.891+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c159710 con 0x7f917c0cd9e0 2023-10-14T19:04:37.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.892+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c15f5d0 con 0x7f917c0cd9e0 2023-10-14T19:04:37.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.893+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9170018360 con 0x7f917c0cd9e0 2023-10-14T19:04:37.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.893+0000 7f9179ffb700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:37.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.893+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9170084470 con 0x7f917c0cd9e0 2023-10-14T19:04:37.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.893+0000 7f9181c44700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:37.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.894+0000 7f9181c44700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9168066f30 0x7f91680693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9174009bf0 tx=0x7f91740091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:37.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:37.898+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f917c15f5d0 con 0x7f917c0cd9e0 2023-10-14T19:04:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.136+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f917c15f5d0 con 0x7f917c0cd9e0 2023-10-14T19:04:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.136+0000 7f9179ffb700 1 -- 172.21.15.7:0/2501975661 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f917c15f5d0 con 0x7f917c0cd9e0 2023-10-14T19:04:38.137 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:04:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9168066f30 msgr2=0x7f91680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9168066f30 0x7f91680693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9174009bf0 tx=0x7f91740091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 msgr2=0x7f917c1560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 0x7f917c1560a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f917000c830 tx=0x7f9170008040 comp rx=0 tx=0).stop 2023-10-14T19:04:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 shutdown_connections 2023-10-14T19:04:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c0c96a0 0x7f917c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c0cb5a0 0x7f917c155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 --2- 172.21.15.7:0/2501975661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c0cd9e0 0x7f917c1560a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 >> 172.21.15.7:0/2501975661 conn(0x7f917c070e30 msgr2=0x7f917c0b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 shutdown_connections 2023-10-14T19:04:38.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.138+0000 7f9183ea8700 1 -- 172.21.15.7:0/2501975661 wait complete. 2023-10-14T19:04:38.150 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:04:38.151 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:04:38.151 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:04:38.151 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:04:38.152 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:38.152 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:04:38.152 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:04:38.153 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:04:38.153 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:04:38.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.154 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:04:38.170 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:04:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:04:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:04:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:04:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.171 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:38.172 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:04:38.172 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:38.172 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:38.172 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:04:38.173 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:04:38.173 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:38.173 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:04:38.173 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:04:38.173 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-10-14T19:04:38.174 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:04:38.174 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.174 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:38.174 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:38.175 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:04:38.175 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:04:38.175 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:38.176 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:04:38.176 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.176 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:04:38.176 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.176 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:38.177 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:04:38.177 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:04:38.177 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.178 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:38.179 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:04:38.179 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:04:38.179 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:38.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.180 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:04:38.234 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:04:38.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.236 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:04:38.293 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:04:38.293 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:04:38.293 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:04:38.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:04:38.294 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:04:38.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.295 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:04:38.295 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:04:38.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:04:38.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:04:38.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:04:38.297 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:04:38.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.396 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:04:38.411 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:04:38.412 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:04:38.412 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:04:38.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:04:38.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:38.477 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:38.532 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:04:38.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:38.533 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:38.588 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:04:38.589 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:04:38.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:38.668 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:38.668 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:04:38.669 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:04:38.676 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:38.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:04:38.677 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:04:38.677 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:38.677 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:38.699 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:04:38.699 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:04:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:04:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:04:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:04:38.701 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:04:38.702 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:04:38.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:38.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:38.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:04:38.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.929+0000 7fdf13095700 1 Processor -- start 2023-10-14T19:04:38.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.929+0000 7fdf13095700 1 -- start start 2023-10-14T19:04:38.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf13095700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf0c0a8be0 0x7fdf0c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:38.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf13095700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf0c06d280 0x7fdf0c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:38.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf13095700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0ce1a0 con 0x7fdf0c0ae780 2023-10-14T19:04:38.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf13095700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0cd5d0 con 0x7fdf0c06d280 2023-10-14T19:04:38.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf13095700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0cd870 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf0c06d280 0x7fdf0c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:38.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf0c06d280 0x7fdf0c0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49370/0 (socket says 172.21.15.7:49370) 2023-10-14T19:04:38.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1549541504 learned_addr learned my addr 172.21.15.7:0/1549541504 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:38.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf10e31700 1 --2- 172.21.15.7:0/1549541504 >> v2:172.21.15.148:3300/0 conn(0x7fdf0c0a8be0 0x7fdf0c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:38.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1549541504 >> v2:172.21.15.148:3300/0 conn(0x7fdf0c0a8be0 msgr2=0x7fdf0c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:38.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 --2- 172.21.15.7:0/1549541504 >> v2:172.21.15.148:3300/0 conn(0x7fdf0c0a8be0 0x7fdf0c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1549541504 >> v1:172.21.15.148:6789/0 conn(0x7fdf0c0ae780 legacy=0x7fdf0c0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:38.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1549541504 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0cdb50 con 0x7fdf0c06d280 2023-10-14T19:04:38.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.930+0000 7fdf0bfff700 1 --2- 172.21.15.7:0/1549541504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c06d280 0x7fdf0c0b08c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c06a9e0 tx=0x7fdef8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a5bc678554c9b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:38.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf0b7fe700 1 -- 172.21.15.7:0/1549541504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8005c10 con 0x7fdf0c06d280 2023-10-14T19:04:38.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf0b7fe700 1 -- 172.21.15.7:0/1549541504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef8005d70 con 0x7fdf0c06d280 2023-10-14T19:04:38.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf0b7fe700 1 -- 172.21.15.7:0/1549541504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800b910 con 0x7fdf0c06d280 2023-10-14T19:04:38.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 -- 172.21.15.7:0/1549541504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c06d280 msgr2=0x7fdf0c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:38.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 --2- 172.21.15.7:0/1549541504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c06d280 0x7fdf0c0b08c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c06a9e0 tx=0x7fdef8009220 comp rx=0 tx=0).stop 2023-10-14T19:04:38.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 -- 172.21.15.7:0/1549541504 shutdown_connections 2023-10-14T19:04:38.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 --2- 172.21.15.7:0/1549541504 >> v2:172.21.15.148:3300/0 conn(0x7fdf0c0a8be0 0x7fdf0c0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 --2- 172.21.15.7:0/1549541504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c06d280 0x7fdf0c0b08c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 -- 172.21.15.7:0/1549541504 >> 172.21.15.7:0/1549541504 conn(0x7fdf0c06ce80 msgr2=0x7fdf0c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:38.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 -- 172.21.15.7:0/1549541504 shutdown_connections 2023-10-14T19:04:38.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.931+0000 7fdf13095700 1 -- 172.21.15.7:0/1549541504 wait complete. 2023-10-14T19:04:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.932+0000 7fdf13095700 1 Processor -- start 2023-10-14T19:04:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.932+0000 7fdf13095700 1 -- start start 2023-10-14T19:04:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf13095700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0c06d280 0x7fdf0c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf13095700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 0x7fdf0c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf13095700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0c0ae780 0x7fdf0c1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf13095700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c168070 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf13095700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1674c0 con 0x7fdf0c06d280 2023-10-14T19:04:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf13095700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c167740 con 0x7fdf0c0ae780 2023-10-14T19:04:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 0x7fdf0c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 0x7fdf0c158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49382/0 (socket says 172.21.15.7:49382) 2023-10-14T19:04:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1206085187 learned_addr learned my addr 172.21.15.7:0/1206085187 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0c0ae780 msgr2=0x7fdf0c1592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf0bfff700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0c0ae780 0x7fdf0c1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0c06d280 msgr2=0x7fdf0c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.933+0000 7fdf10e31700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0c06d280 0x7fdf0c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf0bfff700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0c06d280 0x7fdf0c157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf0bfff700 1 -- 172.21.15.7:0/1206085187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009480 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf0bfff700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 0x7fdf0c158d60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdef800b3c0 tx=0x7fdef8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:38.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800bda0 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef8020070 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c167a20 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800b910 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.934+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1582c0 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.935+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c168220 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.935+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdef8022030 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.936+0000 7fdf08ff9700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdef0066f30 0x7fdef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.936+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdef8086330 con 0x7fdf0c0a8be0 2023-10-14T19:04:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.936+0000 7fdf10e31700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdef0066f30 0x7fdef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.936+0000 7fdf10e31700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdef0066f30 0x7fdef00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c16a9e0 tx=0x7fdf00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:38.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:38.940+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf0c168220 con 0x7fdf0c0a8be0 2023-10-14T19:04:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.179+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf0c168400 con 0x7fdf0c0a8be0 2023-10-14T19:04:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.179+0000 7fdf08ff9700 1 -- 172.21.15.7:0/1206085187 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdef8053500 con 0x7fdf0c0a8be0 2023-10-14T19:04:39.179 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:04:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdef0066f30 msgr2=0x7fdef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdef0066f30 0x7fdef00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c16a9e0 tx=0x7fdf00008040 comp rx=0 tx=0).stop 2023-10-14T19:04:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 msgr2=0x7fdf0c158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 0x7fdf0c158d60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdef800b3c0 tx=0x7fdef8016000 comp rx=0 tx=0).stop 2023-10-14T19:04:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 shutdown_connections 2023-10-14T19:04:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdef0066f30 0x7fdef00693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0c06d280 0x7fdf0c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0c0ae780 0x7fdf0c1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 --2- 172.21.15.7:0/1206085187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0c0a8be0 0x7fdf0c158d60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 >> 172.21.15.7:0/1206085187 conn(0x7fdf0c06ce80 msgr2=0x7fdf0c0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 shutdown_connections 2023-10-14T19:04:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.181+0000 7fdf13095700 1 -- 172.21.15.7:0/1206085187 wait complete. 2023-10-14T19:04:39.193 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:04:39.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:04:39.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:04:39.194 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:04:39.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:39.195 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:04:39.195 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:04:39.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:04:39.195 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:04:39.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.196 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:04:39.215 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:04:39.216 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:04:39.216 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:04:39.216 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.216 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:04:39.216 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.217 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:39.217 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:39.217 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:04:39.217 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:39.217 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:39.218 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:04:39.218 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:04:39.218 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:39.218 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:04:39.218 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:39.219 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:04:39.219 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-10-14T19:04:39.219 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:04:39.219 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.219 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:04:39.220 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:04:39.220 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:04:39.220 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.220 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:04:39.221 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.221 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:39.221 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:04:39.221 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:04:39.221 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.222 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:04:39.222 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:04:39.222 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:04:39.222 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:04:39.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.223 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:04:39.283 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:04:39.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.285 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:04:39.343 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:04:39.343 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:04:39.344 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:04:39.344 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:04:39.344 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:04:39.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.345 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:04:39.345 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:04:39.345 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:04:39.346 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:04:39.346 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:04:39.347 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:04:39.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.451 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:04:39.466 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:04:39.466 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:04:39.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:04:39.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:04:39.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:39.532 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:39.586 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:04:39.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:04:39.587 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:39.641 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:04:39.641 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:04:39.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:39.721 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:39.721 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:04:39.721 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:04:39.729 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:39.729 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:04:39.729 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:04:39.730 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:39.730 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:39.752 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:04:39.753 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:04:39.753 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:04:39.753 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:04:39.753 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:04:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:04:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:04:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:04:39.755 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:04:39.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:39.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:39.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:04:39.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.947+0000 7fbdf8ecb700 1 Processor -- start 2023-10-14T19:04:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.947+0000 7fbdf8ecb700 1 -- start start 2023-10-14T19:04:39.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf8ecb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf4159530 0x7fbdf40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:39.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf8ecb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdf40cb6f0 0x7fbdf40cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:39.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf8ecb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf40ccfd0 con 0x7fbdf406dcf0 2023-10-14T19:04:39.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf8ecb700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf40cc0b0 con 0x7fbdf40cb6f0 2023-10-14T19:04:39.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf8ecb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf415a410 con 0x7fbdf4159530 2023-10-14T19:04:39.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf2d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdf40cb6f0 0x7fbdf40cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:39.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbdf406dcf0 0x7fbdf4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47498/0 (socket says 172.21.15.7:47498) 2023-10-14T19:04:39.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.948+0000 7fbdf1d9b700 1 -- 172.21.15.7:0/823129048 learned_addr learned my addr 172.21.15.7:0/823129048 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:39.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf259c700 1 --2- 172.21.15.7:0/823129048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf4159530 0x7fbdf40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:39.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/823129048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf4159530 msgr2=0x7fbdf40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:39.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf2d9d700 1 --2- 172.21.15.7:0/823129048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf4159530 0x7fbdf40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/823129048 >> v1:172.21.15.7:6789/0 conn(0x7fbdf406dcf0 legacy=0x7fbdf4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:39.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/823129048 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf415a6f0 con 0x7fbdf40cb6f0 2023-10-14T19:04:39.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf159a700 1 -- 172.21.15.7:0/823129048 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720852997 0 0) 0x7fbdf40ccfd0 con 0x7fbdf406dcf0 2023-10-14T19:04:39.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf2d9d700 1 --2- 172.21.15.7:0/823129048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40cbb70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009e60 tx=0x7fbdec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a664a60e9a14238f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:39.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf159a700 1 -- 172.21.15.7:0/823129048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00e070 con 0x7fbdf40cb6f0 2023-10-14T19:04:39.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf159a700 1 -- 172.21.15.7:0/823129048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec00bb60 con 0x7fbdf40cb6f0 2023-10-14T19:04:39.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.949+0000 7fbdf159a700 1 -- 172.21.15.7:0/823129048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec012430 con 0x7fbdf40cb6f0 2023-10-14T19:04:39.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/823129048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf40cb6f0 msgr2=0x7fbdf40cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:39.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/823129048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40cbb70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009e60 tx=0x7fbdec009780 comp rx=0 tx=0).stop 2023-10-14T19:04:39.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/823129048 shutdown_connections 2023-10-14T19:04:39.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/823129048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40cbb70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/823129048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf4159530 0x7fbdf40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/823129048 >> 172.21.15.7:0/823129048 conn(0x7fbdf40703a0 msgr2=0x7fbdf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:39.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/823129048 shutdown_connections 2023-10-14T19:04:39.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.950+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/823129048 wait complete. 2023-10-14T19:04:39.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.951+0000 7fbdf8ecb700 1 Processor -- start 2023-10-14T19:04:39.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.951+0000 7fbdf8ecb700 1 -- start start 2023-10-14T19:04:39.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf8ecb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf406dcf0 0x7fbdf4156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf8ecb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf8ecb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 0x7fbdf4140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf8ecb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40c9220 con 0x7fbdf4159530 2023-10-14T19:04:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf8ecb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40c8610 con 0x7fbdf40cb6f0 2023-10-14T19:04:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf8ecb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40c88f0 con 0x7fbdf406dcf0 2023-10-14T19:04:39.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 0x7fbdf4140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:39.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 0x7fbdf4140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49398/0 (socket says 172.21.15.7:49398) 2023-10-14T19:04:39.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/2551320400 learned_addr learned my addr 172.21.15.7:0/2551320400 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:39.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf259c700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf406dcf0 0x7fbdf4156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:39.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf1d9b700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf406dcf0 msgr2=0x7fbdf4156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf406dcf0 0x7fbdf4156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf40cb6f0 msgr2=0x7fbdf40b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 -- 172.21.15.7:0/2551320400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec009a20 con 0x7fbdf4159530 2023-10-14T19:04:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.952+0000 7fbdf2d9d700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 0x7fbdf4140d00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0099f0 tx=0x7fbdec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.953+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec027470 con 0x7fbdf4159530 2023-10-14T19:04:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.953+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec027610 con 0x7fbdf4159530 2023-10-14T19:04:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.953+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf40c8bd0 con 0x7fbdf4159530 2023-10-14T19:04:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.953+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0279d0 con 0x7fbdf4159530 2023-10-14T19:04:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.953+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf415af60 con 0x7fbdf4159530 2023-10-14T19:04:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.953+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf40c9390 con 0x7fbdf4159530 2023-10-14T19:04:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.954+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdec024070 con 0x7fbdf4159530 2023-10-14T19:04:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.954+0000 7fbdea7fc700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbdd4066f30 0x7fbdd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.954+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdec086e10 con 0x7fbdf4159530 2023-10-14T19:04:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.955+0000 7fbdf259c700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbdd4066f30 0x7fbdd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.955+0000 7fbdf259c700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbdd4066f30 0x7fbdd40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40b28b0 tx=0x7fbde40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:39.959+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdec054080 con 0x7fbdf4159530 2023-10-14T19:04:40.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.195+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbdf404c3c0 con 0x7fbdf4159530 2023-10-14T19:04:40.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.855+0000 7fbdea7fc700 1 -- 172.21.15.7:0/2551320400 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 136+0+0 (secure 0 0 0) 0x7fbdec0576a0 con 0x7fbdf4159530 2023-10-14T19:04:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.858+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbdd4066f30 msgr2=0x7fbdd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.858+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbdd4066f30 0x7fbdd40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40b28b0 tx=0x7fbde40091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.858+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 msgr2=0x7fbdf4140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.858+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 0x7fbdf4140d00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0099f0 tx=0x7fbdec019000 comp rx=0 tx=0).stop 2023-10-14T19:04:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 shutdown_connections 2023-10-14T19:04:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbdd4066f30 0x7fbdd40693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdf4159530 0x7fbdf4140d00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdf406dcf0 0x7fbdf4156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 --2- 172.21.15.7:0/2551320400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf40cb6f0 0x7fbdf40b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 >> 172.21.15.7:0/2551320400 conn(0x7fbdf40703a0 msgr2=0x7fbdf40c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 shutdown_connections 2023-10-14T19:04:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:40.859+0000 7fbdf8ecb700 1 -- 172.21.15.7:0/2551320400 wait complete. 2023-10-14T19:04:40.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:04:40.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.000+0000 7fb390504700 1 Processor -- start 2023-10-14T19:04:41.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.000+0000 7fb390504700 1 -- start start 2023-10-14T19:04:41.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb390504700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb3880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb390504700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3880cd9e0 0x7fb388159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb390504700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38815ae40 con 0x7fb3880cde50 2023-10-14T19:04:41.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb390504700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880d13f0 con 0x7fb3880cd9e0 2023-10-14T19:04:41.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb390504700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38815ab60 con 0x7fb3880cb5a0 2023-10-14T19:04:41.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3880cd9e0 0x7fb388159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3880cd9e0 0x7fb388159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49414/0 (socket says 172.21.15.7:49414) 2023-10-14T19:04:41.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 -- 172.21.15.7:0/72079174 learned_addr learned my addr 172.21.15.7:0/72079174 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38e2a0700 1 --2- 172.21.15.7:0/72079174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb3880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 -- 172.21.15.7:0/72079174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 msgr2=0x7fb3880cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 --2- 172.21.15.7:0/72079174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb3880cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 -- 172.21.15.7:0/72079174 >> v1:172.21.15.148:6789/0 conn(0x7fb3880cde50 legacy=0x7fb388156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 -- 172.21.15.7:0/72079174 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880ccf00 con 0x7fb3880cd9e0 2023-10-14T19:04:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38da9f700 1 --2- 172.21.15.7:0/72079174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880cd9e0 0x7fb388159ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0099b0 tx=0x7fb37c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcceedbef77f174 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38d29e700 1 -- 172.21.15.7:0/72079174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c009ea0 con 0x7fb3880cd9e0 2023-10-14T19:04:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38d29e700 1 -- 172.21.15.7:0/72079174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c00b860 con 0x7fb3880cd9e0 2023-10-14T19:04:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.001+0000 7fb38d29e700 1 -- 172.21.15.7:0/72079174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00bc00 con 0x7fb3880cd9e0 2023-10-14T19:04:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 -- 172.21.15.7:0/72079174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880cd9e0 msgr2=0x7fb388159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 --2- 172.21.15.7:0/72079174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880cd9e0 0x7fb388159ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0099b0 tx=0x7fb37c009250 comp rx=0 tx=0).stop 2023-10-14T19:04:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 -- 172.21.15.7:0/72079174 shutdown_connections 2023-10-14T19:04:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 --2- 172.21.15.7:0/72079174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb3880cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 --2- 172.21.15.7:0/72079174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880cd9e0 0x7fb388159ec0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 -- 172.21.15.7:0/72079174 >> 172.21.15.7:0/72079174 conn(0x7fb388070e30 msgr2=0x7fb3880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:41.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 -- 172.21.15.7:0/72079174 shutdown_connections 2023-10-14T19:04:41.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.002+0000 7fb390504700 1 -- 172.21.15.7:0/72079174 wait complete. 2023-10-14T19:04:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.003+0000 7fb390504700 1 Processor -- start 2023-10-14T19:04:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.003+0000 7fb390504700 1 -- start start 2023-10-14T19:04:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb390504700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb38814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb390504700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880cd9e0 0x7fb38814eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb390504700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 0x7fb3881593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb390504700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388155560 con 0x7fb388156c60 2023-10-14T19:04:41.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb390504700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388157440 con 0x7fb3880cd9e0 2023-10-14T19:04:41.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb390504700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb388157160 con 0x7fb3880cb5a0 2023-10-14T19:04:41.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 0x7fb3881593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 0x7fb3881593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49420/0 (socket says 172.21.15.7:49420) 2023-10-14T19:04:41.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 -- 172.21.15.7:0/2634975097 learned_addr learned my addr 172.21.15.7:0/2634975097 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:41.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38e2a0700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb38814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38da9f700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880cd9e0 0x7fb38814eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 -- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 msgr2=0x7fb38814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb38814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 -- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880cd9e0 msgr2=0x7fb38814eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880cd9e0 0x7fb38814eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.004+0000 7fb38eaa1700 1 -- 172.21.15.7:0/2634975097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0094f0 con 0x7fb388156c60 2023-10-14T19:04:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.005+0000 7fb38eaa1700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 0x7fb3881593b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c840 tx=0x7fb380001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.005+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380012630 con 0x7fb388156c60 2023-10-14T19:04:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.005+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3800127b0 con 0x7fb388156c60 2023-10-14T19:04:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.005+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb388154fa0 con 0x7fb388156c60 2023-10-14T19:04:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.005+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380012b70 con 0x7fb388156c60 2023-10-14T19:04:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.005+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3881598f0 con 0x7fb388156c60 2023-10-14T19:04:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.006+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38814f1a0 con 0x7fb388156c60 2023-10-14T19:04:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.006+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb380003030 con 0x7fb388156c60 2023-10-14T19:04:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.006+0000 7fb3867fc700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.007+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3800844a0 con 0x7fb388156c60 2023-10-14T19:04:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.007+0000 7fb38e2a0700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.007+0000 7fb38e2a0700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb374066f30 0x7fb3740693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb378009d40 tx=0x7fb378008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.011+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb38814f1a0 con 0x7fb388156c60 2023-10-14T19:04:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.232+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb388154e20 con 0x7fb374066f30 2023-10-14T19:04:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.234+0000 7fb3867fc700 1 -- 172.21.15.7:0/2634975097 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb378009e80 con 0x7fb374066f30 2023-10-14T19:04:41.234 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:04:41.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:41.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:04:41.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:41.235 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:04:41.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb374066f30 msgr2=0x7fb3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb374066f30 0x7fb3740693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb378009d40 tx=0x7fb378008040 comp rx=0 tx=0).stop 2023-10-14T19:04:41.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 msgr2=0x7fb3881593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 0x7fb3881593b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c840 tx=0x7fb380001670 comp rx=0 tx=0).stop 2023-10-14T19:04:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 shutdown_connections 2023-10-14T19:04:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb388156c60 0x7fb3881593b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3880cb5a0 0x7fb38814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 --2- 172.21.15.7:0/2634975097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880cd9e0 0x7fb38814eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 >> 172.21.15.7:0/2634975097 conn(0x7fb388070e30 msgr2=0x7fb3880d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 shutdown_connections 2023-10-14T19:04:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.236+0000 7fb390504700 1 -- 172.21.15.7:0/2634975097 wait complete. 2023-10-14T19:04:41.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:04:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.370+0000 7ff265e5a700 1 Processor -- start 2023-10-14T19:04:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.370+0000 7ff265e5a700 1 -- start start 2023-10-14T19:04:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff265e5a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff260159530 0x7ff2600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff265e5a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff26006e0e0 0x7ff2600cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff265e5a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2600ccfd0 con 0x7ff26006dc70 2023-10-14T19:04:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff265e5a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2600cf0e0 con 0x7ff26006e0e0 2023-10-14T19:04:41.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff265e5a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26015a3d0 con 0x7ff260159530 2023-10-14T19:04:41.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff260159530 0x7ff2600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff26006e0e0 0x7ff2600cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff26006dc70 0x7ff260159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:46588/0 (socket says 172.21.15.7:46588) 2023-10-14T19:04:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25effd700 1 -- 172.21.15.7:0/2335472617 learned_addr learned my addr 172.21.15.7:0/2335472617 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25f7fe700 1 -- 172.21.15.7:0/2335472617 >> v2:172.21.15.148:3300/0 conn(0x7ff26006e0e0 msgr2=0x7ff2600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25f7fe700 1 --2- 172.21.15.7:0/2335472617 >> v2:172.21.15.148:3300/0 conn(0x7ff26006e0e0 0x7ff2600cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25f7fe700 1 -- 172.21.15.7:0/2335472617 >> v1:172.21.15.148:6789/0 conn(0x7ff26006dc70 legacy=0x7ff260159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25f7fe700 1 -- 172.21.15.7:0/2335472617 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26015a6b0 con 0x7ff260159530 2023-10-14T19:04:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25e7fc700 1 -- 172.21.15.7:0/2335472617 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861944471 0 0) 0x7ff2600ccfd0 con 0x7ff26006dc70 2023-10-14T19:04:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.371+0000 7ff25ffff700 1 --2- 172.21.15.7:0/2335472617 >> v2:172.21.15.148:3300/0 conn(0x7ff26006e0e0 0x7ff2600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff25f7fe700 1 --2- 172.21.15.7:0/2335472617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff260159530 0x7ff2600ceba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2500098e0 tx=0x7ff2500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ae18c7130110a89 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff25e7fc700 1 -- 172.21.15.7:0/2335472617 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000b640 con 0x7ff260159530 2023-10-14T19:04:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff25e7fc700 1 -- 172.21.15.7:0/2335472617 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25000b7a0 con 0x7ff260159530 2023-10-14T19:04:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff25e7fc700 1 -- 172.21.15.7:0/2335472617 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000bb40 con 0x7ff260159530 2023-10-14T19:04:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 -- 172.21.15.7:0/2335472617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff260159530 msgr2=0x7ff2600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 --2- 172.21.15.7:0/2335472617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff260159530 0x7ff2600ceba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2500098e0 tx=0x7ff2500091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 -- 172.21.15.7:0/2335472617 shutdown_connections 2023-10-14T19:04:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 --2- 172.21.15.7:0/2335472617 >> v2:172.21.15.148:3300/0 conn(0x7ff26006e0e0 0x7ff2600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 --2- 172.21.15.7:0/2335472617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff260159530 0x7ff2600ceba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 -- 172.21.15.7:0/2335472617 >> 172.21.15.7:0/2335472617 conn(0x7ff2600703a0 msgr2=0x7ff2600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:41.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 -- 172.21.15.7:0/2335472617 shutdown_connections 2023-10-14T19:04:41.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.372+0000 7ff265e5a700 1 -- 172.21.15.7:0/2335472617 wait complete. 2023-10-14T19:04:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.374+0000 7ff265e5a700 1 Processor -- start 2023-10-14T19:04:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.374+0000 7ff265e5a700 1 -- start start 2023-10-14T19:04:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.374+0000 7ff265e5a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26006dc70 0x7ff26016d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.374+0000 7ff265e5a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff26006e0e0 0x7ff2600af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.374+0000 7ff265e5a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 0x7ff260157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff265e5a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2600afce0 con 0x7ff260159530 2023-10-14T19:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff265e5a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2600c8950 con 0x7ff26006dc70 2023-10-14T19:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff265e5a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2600c8c30 con 0x7ff26006e0e0 2023-10-14T19:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 0x7ff260157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 0x7ff260157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49428/0 (socket says 172.21.15.7:49428) 2023-10-14T19:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 -- 172.21.15.7:0/4105736628 learned_addr learned my addr 172.21.15.7:0/4105736628 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25effd700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff26006e0e0 0x7ff2600af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25f7fe700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26006dc70 0x7ff26016d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 -- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff26006e0e0 msgr2=0x7ff2600af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff26006e0e0 0x7ff2600af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 -- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26006dc70 msgr2=0x7ff26016d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26006dc70 0x7ff26016d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 -- 172.21.15.7:0/4105736628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258009a20 con 0x7ff260159530 2023-10-14T19:04:41.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25f7fe700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26006dc70 0x7ff26016d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff25ffff700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 0x7ff260157530 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff25800ef90 tx=0x7ff25800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25800cc80 con 0x7ff260159530 2023-10-14T19:04:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25800f040 con 0x7ff260159530 2023-10-14T19:04:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258014480 con 0x7ff260159530 2023-10-14T19:04:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff250009420 con 0x7ff260159530 2023-10-14T19:04:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.375+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2600c91f0 con 0x7ff260159530 2023-10-14T19:04:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.376+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26004c3c0 con 0x7ff260159530 2023-10-14T19:04:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.377+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2580148b0 con 0x7ff260159530 2023-10-14T19:04:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.377+0000 7ff2477fe700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff24c066f30 0x7ff24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.377+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff258085380 con 0x7ff260159530 2023-10-14T19:04:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.377+0000 7ff25f7fe700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff24c066f30 0x7ff24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.378+0000 7ff25f7fe700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff24c066f30 0x7ff24c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff2500091e0 tx=0x7ff250017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.381+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2580525f0 con 0x7ff260159530 2023-10-14T19:04:41.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.575+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff26015a990 con 0x7ff260159530 2023-10-14T19:04:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.576+0000 7ff2477fe700 1 -- 172.21.15.7:0/4105736628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff258055c10 con 0x7ff260159530 2023-10-14T19:04:41.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff24c066f30 msgr2=0x7ff24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff24c066f30 0x7ff24c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff2500091e0 tx=0x7ff250017000 comp rx=0 tx=0).stop 2023-10-14T19:04:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 msgr2=0x7ff260157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 0x7ff260157530 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff25800ef90 tx=0x7ff25800b040 comp rx=0 tx=0).stop 2023-10-14T19:04:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 shutdown_connections 2023-10-14T19:04:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff24c066f30 0x7ff24c0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26006dc70 0x7ff26016d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff260159530 0x7ff260157530 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 --2- 172.21.15.7:0/4105736628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff26006e0e0 0x7ff2600af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 >> 172.21.15.7:0/4105736628 conn(0x7ff2600703a0 msgr2=0x7ff2600cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:41.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.577+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 shutdown_connections 2023-10-14T19:04:41.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.578+0000 7ff265e5a700 1 -- 172.21.15.7:0/4105736628 wait complete. 2023-10-14T19:04:41.590 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000195144 2023-10-14T19:04:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.711+0000 7fda11a84700 1 Processor -- start 2023-10-14T19:04:41.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.711+0000 7fda11a84700 1 -- start start 2023-10-14T19:04:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda11a84700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda0c159530 0x7fda0c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda11a84700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda0c06e0e0 0x7fda0c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda11a84700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c0ccfd0 con 0x7fda0c06dc70 2023-10-14T19:04:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda11a84700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0cf0e0 con 0x7fda0c06e0e0 2023-10-14T19:04:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda11a84700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c15a3d0 con 0x7fda0c159530 2023-10-14T19:04:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda0bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda0c06e0e0 0x7fda0c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda0affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fda0c06dc70 0x7fda0c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47504/0 (socket says 172.21.15.7:47504) 2023-10-14T19:04:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.712+0000 7fda0affd700 1 -- 172.21.15.7:0/49643267 learned_addr learned my addr 172.21.15.7:0/49643267 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0b7fe700 1 --2- 172.21.15.7:0/49643267 >> v2:172.21.15.148:3300/0 conn(0x7fda0c159530 0x7fda0c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0bfff700 1 -- 172.21.15.7:0/49643267 >> v2:172.21.15.148:3300/0 conn(0x7fda0c159530 msgr2=0x7fda0c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0bfff700 1 --2- 172.21.15.7:0/49643267 >> v2:172.21.15.148:3300/0 conn(0x7fda0c159530 0x7fda0c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0bfff700 1 -- 172.21.15.7:0/49643267 >> v1:172.21.15.7:6789/0 conn(0x7fda0c06dc70 legacy=0x7fda0c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0a7fc700 1 -- 172.21.15.7:0/49643267 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189804380 0 0) 0x7fda0c0ccfd0 con 0x7fda0c06dc70 2023-10-14T19:04:41.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0bfff700 1 -- 172.21.15.7:0/49643267 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c15a6b0 con 0x7fda0c06e0e0 2023-10-14T19:04:41.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0b7fe700 1 --2- 172.21.15.7:0/49643267 >> v2:172.21.15.148:3300/0 conn(0x7fda0c159530 0x7fda0c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:41.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0bfff700 1 --2- 172.21.15.7:0/49643267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c0cb6f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fda0c06d630 tx=0x7fda04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2813bdf7b021585 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0a7fc700 1 -- 172.21.15.7:0/49643267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400e070 con 0x7fda0c06e0e0 2023-10-14T19:04:41.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0a7fc700 1 -- 172.21.15.7:0/49643267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400bc30 con 0x7fda0c06e0e0 2023-10-14T19:04:41.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.713+0000 7fda0a7fc700 1 -- 172.21.15.7:0/49643267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04012430 con 0x7fda0c06e0e0 2023-10-14T19:04:41.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 -- 172.21.15.7:0/49643267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 msgr2=0x7fda0c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 --2- 172.21.15.7:0/49643267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c0cb6f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fda0c06d630 tx=0x7fda04009780 comp rx=0 tx=0).stop 2023-10-14T19:04:41.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 -- 172.21.15.7:0/49643267 shutdown_connections 2023-10-14T19:04:41.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 --2- 172.21.15.7:0/49643267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c0cb6f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 --2- 172.21.15.7:0/49643267 >> v2:172.21.15.148:3300/0 conn(0x7fda0c159530 0x7fda0c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 -- 172.21.15.7:0/49643267 >> 172.21.15.7:0/49643267 conn(0x7fda0c0703a0 msgr2=0x7fda0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:41.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 -- 172.21.15.7:0/49643267 shutdown_connections 2023-10-14T19:04:41.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.714+0000 7fda11a84700 1 -- 172.21.15.7:0/49643267 wait complete. 2023-10-14T19:04:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.715+0000 7fda11a84700 1 Processor -- start 2023-10-14T19:04:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.715+0000 7fda11a84700 1 -- start start 2023-10-14T19:04:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda11a84700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c06dc70 0x7fda0c140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda11a84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda11a84700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda0c159530 0x7fda0c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda11a84700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b56e0 con 0x7fda0c06e0e0 2023-10-14T19:04:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda11a84700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b4ad0 con 0x7fda0c06dc70 2023-10-14T19:04:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda11a84700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b4db0 con 0x7fda0c159530 2023-10-14T19:04:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49452/0 (socket says 172.21.15.7:49452) 2023-10-14T19:04:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 -- 172.21.15.7:0/1597180 learned_addr learned my addr 172.21.15.7:0/1597180 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0bfff700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda0c159530 0x7fda0c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0b7fe700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c06dc70 0x7fda0c140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 -- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda0c159530 msgr2=0x7fda0c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda0c159530 0x7fda0c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 -- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c06dc70 msgr2=0x7fda0c140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c06dc70 0x7fda0c140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 -- 172.21.15.7:0/1597180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009a20 con 0x7fda0c06e0e0 2023-10-14T19:04:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0bfff700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda0c159530 0x7fda0c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fda0affd700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c141650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c7e0 tx=0x7fda00007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.716+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00005b30 con 0x7fda0c06e0e0 2023-10-14T19:04:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.717+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00005c90 con 0x7fda0c06e0e0 2023-10-14T19:04:41.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.717+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00007300 con 0x7fda0c06e0e0 2023-10-14T19:04:41.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.717+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0b5090 con 0x7fda0c06e0e0 2023-10-14T19:04:41.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.717+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c1411f0 con 0x7fda0c06e0e0 2023-10-14T19:04:41.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.718+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c0b5890 con 0x7fda0c06e0e0 2023-10-14T19:04:41.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.718+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda0001b400 con 0x7fda0c06e0e0 2023-10-14T19:04:41.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.718+0000 7fd9f37fe700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd9f8066f30 0x7fd9f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:41.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.718+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda000841a0 con 0x7fda0c06e0e0 2023-10-14T19:04:41.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.719+0000 7fda0b7fe700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd9f8066f30 0x7fd9f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:41.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.719+0000 7fda0b7fe700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd9f8066f30 0x7fd9f80693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc006f00 tx=0x7fd9fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:41.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.723+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda0c0b5890 con 0x7fda0c06e0e0 2023-10-14T19:04:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.948+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000195144", "target": ["mon-mgr", ""]}) v1 -- 0x7fda0c0b4f20 con 0x7fd9f8066f30 2023-10-14T19:04:41.953 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:04:41.952+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:04:41.953 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:04:41.952+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:04:41.954 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:04:41.952+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:04:41.954 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:04:41.952+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:04:41.954 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:04:41.952+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:04:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.968+0000 7fd9f37fe700 1 -- 172.21.15.7:0/1597180 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fda0c0b4f20 con 0x7fd9f8066f30 2023-10-14T19:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd9f8066f30 msgr2=0x7fd9f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd9f8066f30 0x7fd9f80693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc006f00 tx=0x7fd9fc008040 comp rx=0 tx=0).stop 2023-10-14T19:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 msgr2=0x7fda0c141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c141650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c7e0 tx=0x7fda00007df0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 shutdown_connections 2023-10-14T19:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd9f8066f30 0x7fd9f80693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c06dc70 0x7fda0c140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda0c159530 0x7fda0c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 --2- 172.21.15.7:0/1597180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda0c06e0e0 0x7fda0c141650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:41.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.970+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 >> 172.21.15.7:0/1597180 conn(0x7fda0c0703a0 msgr2=0x7fda0c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:41.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.971+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 shutdown_connections 2023-10-14T19:04:41.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:41.971+0000 7fda11a84700 1 -- 172.21.15.7:0/1597180 wait complete. 2023-10-14T19:04:41.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-14T19:04:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.104+0000 7f3f38a16700 1 Processor -- start 2023-10-14T19:04:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.104+0000 7f3f38a16700 1 -- start start 2023-10-14T19:04:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.104+0000 7f3f38a16700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f34153a00 0x7f3f34153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f38a16700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f340cea00 0x7f3f340cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f38a16700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3415ac50 con 0x7f3f3415de50 2023-10-14T19:04:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f38a16700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3415d010 con 0x7f3f34153a00 2023-10-14T19:04:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f38a16700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340cf3c0 con 0x7f3f340cea00 2023-10-14T19:04:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f2bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3f3415de50 0x7f3f3415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47514/0 (socket says 172.21.15.7:47514) 2023-10-14T19:04:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f2bfff700 1 -- 172.21.15.7:0/1933722757 learned_addr learned my addr 172.21.15.7:0/1933722757 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f32d9d700 1 --2- 172.21.15.7:0/1933722757 >> v2:172.21.15.148:3300/0 conn(0x7f3f34153a00 0x7f3f34153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3359e700 1 --2- 172.21.15.7:0/1933722757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f340cea00 0x7f3f340cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3259c700 1 -- 172.21.15.7:0/1933722757 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625865834 0 0) 0x7f3f3415ac50 con 0x7f3f3415de50 2023-10-14T19:04:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3259c700 1 -- 172.21.15.7:0/1933722757 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f20003570 con 0x7f3f3415de50 2023-10-14T19:04:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3359e700 1 -- 172.21.15.7:0/1933722757 >> v2:172.21.15.148:3300/0 conn(0x7f3f34153a00 msgr2=0x7f3f34153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3359e700 1 --2- 172.21.15.7:0/1933722757 >> v2:172.21.15.148:3300/0 conn(0x7f3f34153a00 0x7f3f34153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3359e700 1 -- 172.21.15.7:0/1933722757 >> v1:172.21.15.7:6789/0 conn(0x7f3f3415de50 legacy=0x7f3f3415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3359e700 1 -- 172.21.15.7:0/1933722757 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3415af60 con 0x7f3f340cea00 2023-10-14T19:04:42.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.105+0000 7f3f3359e700 1 --2- 172.21.15.7:0/1933722757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f340cea00 0x7f3f340cee80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009e60 tx=0x7f3f2c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=491c789a33f2fc1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:42.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f3259c700 1 -- 172.21.15.7:0/1933722757 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00e070 con 0x7f3f340cea00 2023-10-14T19:04:42.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f3259c700 1 -- 172.21.15.7:0/1933722757 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00bab0 con 0x7f3f340cea00 2023-10-14T19:04:42.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f3259c700 1 -- 172.21.15.7:0/1933722757 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00be30 con 0x7f3f340cea00 2023-10-14T19:04:42.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 -- 172.21.15.7:0/1933722757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f340cea00 msgr2=0x7f3f340cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1933722757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f340cea00 0x7f3f340cee80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009e60 tx=0x7f3f2c009780 comp rx=0 tx=0).stop 2023-10-14T19:04:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 -- 172.21.15.7:0/1933722757 shutdown_connections 2023-10-14T19:04:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1933722757 >> v2:172.21.15.148:3300/0 conn(0x7f3f34153a00 0x7f3f34153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1933722757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f340cea00 0x7f3f340cee80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 -- 172.21.15.7:0/1933722757 >> 172.21.15.7:0/1933722757 conn(0x7f3f340703a0 msgr2=0x7f3f340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 -- 172.21.15.7:0/1933722757 shutdown_connections 2023-10-14T19:04:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.106+0000 7f3f38a16700 1 -- 172.21.15.7:0/1933722757 wait complete. 2023-10-14T19:04:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.107+0000 7f3f38a16700 1 Processor -- start 2023-10-14T19:04:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.107+0000 7f3f38a16700 1 -- start start 2023-10-14T19:04:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f38a16700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 0x7f3f34158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f38a16700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f34153a00 0x7f3f3416d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f38a16700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f3415de50 0x7f3f34157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f38a16700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f34158ba0 con 0x7f3f340cea00 2023-10-14T19:04:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f38a16700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341587a0 con 0x7f3f34153a00 2023-10-14T19:04:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f38a16700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340c9090 con 0x7f3f3415de50 2023-10-14T19:04:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 0x7f3f34158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 0x7f3f34158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49460/0 (socket says 172.21.15.7:49460) 2023-10-14T19:04:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 -- 172.21.15.7:0/1522978423 learned_addr learned my addr 172.21.15.7:0/1522978423 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 -- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f3415de50 msgr2=0x7f3f34157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f3415de50 0x7f3f34157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 -- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f34153a00 msgr2=0x7f3f3416d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f2bfff700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f34153a00 0x7f3f3416d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f34153a00 0x7f3f3416d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f32d9d700 1 -- 172.21.15.7:0/1522978423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009a20 con 0x7f3f340cea00 2023-10-14T19:04:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.108+0000 7f3f2bfff700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f34153a00 0x7f3f3416d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.109+0000 7f3f32d9d700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 0x7f3f34158260 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400ecb0 tx=0x7f3f240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.109+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400c9d0 con 0x7f3f340cea00 2023-10-14T19:04:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.109+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2400cb30 con 0x7f3f340cea00 2023-10-14T19:04:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.109+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3416d660 con 0x7f3f340cea00 2023-10-14T19:04:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.109+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400ced0 con 0x7f3f340cea00 2023-10-14T19:04:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.109+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f34169a20 con 0x7f3f340cea00 2023-10-14T19:04:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.110+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3404c3c0 con 0x7f3f340cea00 2023-10-14T19:04:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.110+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f24013680 con 0x7f3f340cea00 2023-10-14T19:04:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.111+0000 7f3f2affd700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f14066f30 0x7f3f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.111+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f24084910 con 0x7f3f340cea00 2023-10-14T19:04:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.111+0000 7f3f2bfff700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f14066f30 0x7f3f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.111+0000 7f3f2bfff700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f14066f30 0x7f3f140693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0058d0 tx=0x7f3f1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.115+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f24051b80 con 0x7f3f340cea00 2023-10-14T19:04:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.338+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f340caef0 con 0x7f3f14066f30 2023-10-14T19:04:42.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.341+0000 7f3f2affd700 1 -- 172.21.15.7:0/1522978423 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+529 (secure 0 0 0) 0x7f3f340caef0 con 0x7f3f14066f30 2023-10-14T19:04:42.341 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:04:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_addrs": [ 2023-10-14T19:04:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.7:6789", 2023-10-14T19:04:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6789", 2023-10-14T19:04:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6790" 2023-10-14T19:04:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:04:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "pending_subvolume_deletions": 0, 2023-10-14T19:04:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": { 2023-10-14T19:04:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "data": [ 2023-10-14T19:04:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": 365980286976, 2023-10-14T19:04:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_data", 2023-10-14T19:04:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "used": 0 2023-10-14T19:04:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:04:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": [ 2023-10-14T19:04:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": 365980286976, 2023-10-14T19:04:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_metadata", 2023-10-14T19:04:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "used": 65536 2023-10-14T19:04:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:04:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "used_size": 0 2023-10-14T19:04:42.346 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:04:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.343+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f14066f30 msgr2=0x7f3f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.343+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f14066f30 0x7f3f140693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0058d0 tx=0x7f3f1c009040 comp rx=0 tx=0).stop 2023-10-14T19:04:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.343+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 msgr2=0x7f3f34158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.343+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 0x7f3f34158260 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400ecb0 tx=0x7f3f240091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 shutdown_connections 2023-10-14T19:04:42.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f14066f30 0x7f3f140693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f3415de50 0x7f3f34157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f340cea00 0x7f3f34158260 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 --2- 172.21.15.7:0/1522978423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f34153a00 0x7f3f3416d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 >> 172.21.15.7:0/1522978423 conn(0x7f3f340703a0 msgr2=0x7f3f3415bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:42.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 shutdown_connections 2023-10-14T19:04:42.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.344+0000 7f3f38a16700 1 -- 172.21.15.7:0/1522978423 wait complete. 2023-10-14T19:04:42.355 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:04:42.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:42.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:42.439 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:04:42.440 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:04:42.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:04:42.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:04:42.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:04:42.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:42.478 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:04:42.533 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:04:42.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:04:42.534 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:04:42.579 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:04:42.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:04:42.580 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:04:42.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.756+0000 7ff80c87d700 1 Processor -- start 2023-10-14T19:04:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.756+0000 7ff80c87d700 1 -- start start 2023-10-14T19:04:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80c87d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff8080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80c87d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8080cef40 0x7ff80815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80c87d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80815afd0 con 0x7ff808153c30 2023-10-14T19:04:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80c87d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80815b2b0 con 0x7ff8080cef40 2023-10-14T19:04:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80c87d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80815b590 con 0x7ff80815de50 2023-10-14T19:04:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80759e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8080cef40 0x7ff80815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff806d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff808153c30 0x7ff80815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47522/0 (socket says 172.21.15.7:47522) 2023-10-14T19:04:42.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff806d9d700 1 -- 172.21.15.7:0/1848866427 learned_addr learned my addr 172.21.15.7:0/1848866427 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:42.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80759e700 1 -- 172.21.15.7:0/1848866427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 msgr2=0x7ff8080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:42.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80659c700 1 --2- 172.21.15.7:0/1848866427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff8080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff805d9b700 1 -- 172.21.15.7:0/1848866427 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461021575 0 0) 0x7ff80815afd0 con 0x7ff808153c30 2023-10-14T19:04:42.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80759e700 1 --2- 172.21.15.7:0/1848866427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff8080cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80759e700 1 -- 172.21.15.7:0/1848866427 >> v1:172.21.15.7:6789/0 conn(0x7ff808153c30 legacy=0x7ff80815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80759e700 1 -- 172.21.15.7:0/1848866427 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80815b870 con 0x7ff8080cef40 2023-10-14T19:04:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.757+0000 7ff80759e700 1 --2- 172.21.15.7:0/1848866427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff80815c070 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff800009e60 tx=0x7ff800009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5166e0e32d0b72b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff805d9b700 1 -- 172.21.15.7:0/1848866427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80000e070 con 0x7ff8080cef40 2023-10-14T19:04:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff805d9b700 1 -- 172.21.15.7:0/1848866427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80000bc30 con 0x7ff8080cef40 2023-10-14T19:04:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff805d9b700 1 -- 172.21.15.7:0/1848866427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800012430 con 0x7ff8080cef40 2023-10-14T19:04:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 -- 172.21.15.7:0/1848866427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 msgr2=0x7ff80815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 --2- 172.21.15.7:0/1848866427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff80815c070 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff800009e60 tx=0x7ff800009780 comp rx=0 tx=0).stop 2023-10-14T19:04:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 -- 172.21.15.7:0/1848866427 shutdown_connections 2023-10-14T19:04:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 --2- 172.21.15.7:0/1848866427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff80815c070 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 --2- 172.21.15.7:0/1848866427 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff8080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 -- 172.21.15.7:0/1848866427 >> 172.21.15.7:0/1848866427 conn(0x7ff8080703a0 msgr2=0x7ff8080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 -- 172.21.15.7:0/1848866427 shutdown_connections 2023-10-14T19:04:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.758+0000 7ff80c87d700 1 -- 172.21.15.7:0/1848866427 wait complete. 2023-10-14T19:04:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.759+0000 7ff80c87d700 1 Processor -- start 2023-10-14T19:04:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.759+0000 7ff80c87d700 1 -- start start 2023-10-14T19:04:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80c87d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff8080b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80c87d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff808153c30 0x7ff808158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80c87d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff808150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80c87d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081592a0 con 0x7ff8080cef40 2023-10-14T19:04:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80c87d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff808150b60 con 0x7ff808153c30 2023-10-14T19:04:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80c87d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080c75e0 con 0x7ff80815de50 2023-10-14T19:04:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff806d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff8080b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff806d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff8080b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49470/0 (socket says 172.21.15.7:49470) 2023-10-14T19:04:42.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff806d9d700 1 -- 172.21.15.7:0/2854490368 learned_addr learned my addr 172.21.15.7:0/2854490368 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:42.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80759e700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff808150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.760+0000 7ff80659c700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff808153c30 0x7ff808158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff806d9d700 1 -- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 msgr2=0x7ff808150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff806d9d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff808150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff806d9d700 1 -- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff808153c30 msgr2=0x7ff808158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff806d9d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff808153c30 0x7ff808158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff806d9d700 1 -- 172.21.15.7:0/2854490368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009a20 con 0x7ff8080cef40 2023-10-14T19:04:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff80759e700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff808150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff806d9d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff8080b32d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c810 tx=0x7ff7f8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8005b30 con 0x7ff8080cef40 2023-10-14T19:04:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8005c90 con 0x7ff8080cef40 2023-10-14T19:04:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8080b39b0 con 0x7ff8080cef40 2023-10-14T19:04:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8007300 con 0x7ff8080cef40 2023-10-14T19:04:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.761+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8080c7b80 con 0x7ff8080cef40 2023-10-14T19:04:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.762+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80804c3c0 con 0x7ff8080cef40 2023-10-14T19:04:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.762+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7f801b400 con 0x7ff8080cef40 2023-10-14T19:04:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.763+0000 7ff7feffd700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e8066f30 0x7ff7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.763+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7f80840f0 con 0x7ff8080cef40 2023-10-14T19:04:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.763+0000 7ff80659c700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e8066f30 0x7ff7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.763+0000 7ff80659c700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e8066f30 0x7ff7e80693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8080c8e60 tx=0x7ff7f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.767+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7f8051340 con 0x7ff8080cef40 2023-10-14T19:04:42.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:42.871+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff7f8082600 con 0x7ff8080cef40 2023-10-14T19:04:43.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.012+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8080caef0 con 0x7ff8080cef40 2023-10-14T19:04:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.012+0000 7ff7feffd700 1 -- 172.21.15.7:0/2854490368 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7ff7f8054dd0 con 0x7ff8080cef40 2023-10-14T19:04:43.077 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:43.077 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:31.225490+0000","modified":"2023-10-14T19:04:34.832188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/1084131518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1084131518},{"type":"v1","addr":"172.21.15.7:6834","nonce":1084131518}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T19:04:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e8066f30 msgr2=0x7ff7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e8066f30 0x7ff7e80693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8080c8e60 tx=0x7ff7f0008040 comp rx=0 tx=0).stop 2023-10-14T19:04:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 msgr2=0x7ff8080b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff8080b32d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c810 tx=0x7ff7f8007df0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 shutdown_connections 2023-10-14T19:04:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e8066f30 0x7ff7e80693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff80815de50 0x7ff808150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8080cef40 0x7ff8080b32d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 --2- 172.21.15.7:0/2854490368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff808153c30 0x7ff808158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 >> 172.21.15.7:0/2854490368 conn(0x7ff8080703a0 msgr2=0x7ff8080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 shutdown_connections 2023-10-14T19:04:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.014+0000 7ff80c87d700 1 -- 172.21.15.7:0/2854490368 wait complete. 2023-10-14T19:04:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2023-10-14T19:04:43.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.207+0000 7fda9b013700 1 Processor -- start 2023-10-14T19:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.207+0000 7fda9b013700 1 -- start start 2023-10-14T19:04:43.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.207+0000 7fda9b013700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda940cb5a0 0x7fda940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.207+0000 7fda9b013700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9415ae40 con 0x7fda940cd9e0 2023-10-14T19:04:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.207+0000 7fda9b013700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9415ab60 con 0x7fda9415a5d0 2023-10-14T19:04:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.207+0000 7fda9b013700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940d13f0 con 0x7fda940cb5a0 2023-10-14T19:04:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda98daf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda940cb5a0 0x7fda940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda93fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fda940cd9e0 0x7fda94159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47528/0 (socket says 172.21.15.7:47528) 2023-10-14T19:04:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda93fff700 1 -- 172.21.15.7:0/4106903285 learned_addr learned my addr 172.21.15.7:0/4106903285 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda98daf700 1 -- 172.21.15.7:0/4106903285 >> v1:172.21.15.148:6789/0 conn(0x7fda9415a5d0 legacy=0x7fda94156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda98daf700 1 -- 172.21.15.7:0/4106903285 >> v1:172.21.15.7:6789/0 conn(0x7fda940cd9e0 legacy=0x7fda94159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda98daf700 1 -- 172.21.15.7:0/4106903285 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940ccf00 con 0x7fda940cb5a0 2023-10-14T19:04:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda98daf700 1 --2- 172.21.15.7:0/4106903285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cb5a0 0x7fda940cb970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009910 tx=0x7fda7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b03784795c392c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda937fe700 1 -- 172.21.15.7:0/4106903285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00b820 con 0x7fda940cb5a0 2023-10-14T19:04:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda937fe700 1 -- 172.21.15.7:0/4106903285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c00b980 con 0x7fda940cb5a0 2023-10-14T19:04:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.208+0000 7fda937fe700 1 -- 172.21.15.7:0/4106903285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00bd20 con 0x7fda940cb5a0 2023-10-14T19:04:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 -- 172.21.15.7:0/4106903285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cb5a0 msgr2=0x7fda940cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 --2- 172.21.15.7:0/4106903285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cb5a0 0x7fda940cb970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009910 tx=0x7fda7c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 -- 172.21.15.7:0/4106903285 shutdown_connections 2023-10-14T19:04:43.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 --2- 172.21.15.7:0/4106903285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cb5a0 0x7fda940cb970 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 -- 172.21.15.7:0/4106903285 >> 172.21.15.7:0/4106903285 conn(0x7fda94070e30 msgr2=0x7fda940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:43.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 -- 172.21.15.7:0/4106903285 shutdown_connections 2023-10-14T19:04:43.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.209+0000 7fda9b013700 1 -- 172.21.15.7:0/4106903285 wait complete. 2023-10-14T19:04:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.210+0000 7fda9b013700 1 Processor -- start 2023-10-14T19:04:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.210+0000 7fda9b013700 1 -- start start 2023-10-14T19:04:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda9b013700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda940cb5a0 0x7fda94157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda9b013700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 0x7fda94156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda9b013700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda9415a5d0 0x7fda94169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda9b013700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9415bf60 con 0x7fda940cd9e0 2023-10-14T19:04:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda9b013700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9415b070 con 0x7fda9415a5d0 2023-10-14T19:04:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda9b013700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9415b350 con 0x7fda940cb5a0 2023-10-14T19:04:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 0x7fda94156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 0x7fda94156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49486/0 (socket says 172.21.15.7:49486) 2023-10-14T19:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 -- 172.21.15.7:0/662073390 learned_addr learned my addr 172.21.15.7:0/662073390 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda98daf700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda940cb5a0 0x7fda94157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda995b0700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda9415a5d0 0x7fda94169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 -- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda940cb5a0 msgr2=0x7fda94157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda940cb5a0 0x7fda94157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 -- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda9415a5d0 msgr2=0x7fda94169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda9415a5d0 0x7fda94169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 -- 172.21.15.7:0/662073390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009420 con 0x7fda940cd9e0 2023-10-14T19:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.211+0000 7fda93fff700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 0x7fda94156200 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fda8400cd30 tx=0x7fda84001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.212+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400ce30 con 0x7fda940cd9e0 2023-10-14T19:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.212+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84004bb0 con 0x7fda940cd9e0 2023-10-14T19:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.212+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400aac0 con 0x7fda940cd9e0 2023-10-14T19:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.212+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9415b630 con 0x7fda940cd9e0 2023-10-14T19:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.212+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9415bbf0 con 0x7fda940cd9e0 2023-10-14T19:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.212+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9415c0d0 con 0x7fda940cd9e0 2023-10-14T19:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.213+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fda840070f0 con 0x7fda940cd9e0 2023-10-14T19:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.213+0000 7fda90ff9700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda74066fc0 0x7fda74069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.214+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda84083eb0 con 0x7fda940cd9e0 2023-10-14T19:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.214+0000 7fda98daf700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda74066fc0 0x7fda74069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.214+0000 7fda98daf700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda74066fc0 0x7fda74069470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0093f0 tx=0x7fda7c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.218+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda84051130 con 0x7fda940cd9e0 2023-10-14T19:04:43.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.412+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9404c3c0 con 0x7fda940cd9e0 2023-10-14T19:04:43.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.412+0000 7fda90ff9700 1 -- 172.21.15.7:0/662073390 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fda84018090 con 0x7fda940cd9e0 2023-10-14T19:04:43.413 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:43.413 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:32.781544+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:29.657115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:30.193005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda74066fc0 msgr2=0x7fda74069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda74066fc0 0x7fda74069470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0093f0 tx=0x7fda7c017000 comp rx=0 tx=0).stop 2023-10-14T19:04:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 msgr2=0x7fda94156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 0x7fda94156200 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fda8400cd30 tx=0x7fda84001ad0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 shutdown_connections 2023-10-14T19:04:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda74066fc0 0x7fda74069470 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda9415a5d0 0x7fda94169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda940cb5a0 0x7fda94157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 --2- 172.21.15.7:0/662073390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda940cd9e0 0x7fda94156200 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 >> 172.21.15.7:0/662073390 conn(0x7fda94070e30 msgr2=0x7fda940b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:43.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 shutdown_connections 2023-10-14T19:04:43.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.415+0000 7fda9b013700 1 -- 172.21.15.7:0/662073390 wait complete. 2023-10-14T19:04:43.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:04:29.657115+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:04:30.193005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:04:43.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:04:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.550+0000 7f839f2e9700 1 Processor -- start 2023-10-14T19:04:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.551+0000 7f839f2e9700 1 -- start start 2023-10-14T19:04:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.551+0000 7f839f2e9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc320 0x7f839813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.551+0000 7f839f2e9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839806d7b0 con 0x7f839806a110 2023-10-14T19:04:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839f2e9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839806e330 con 0x7f83980cc6f0 2023-10-14T19:04:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839f2e9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839806a590 con 0x7f83980cc320 2023-10-14T19:04:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d886700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f839806a110 0x7f839806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47538/0 (socket says 172.21.15.7:47538) 2023-10-14T19:04:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d886700 1 -- 172.21.15.7:0/2159333395 learned_addr learned my addr 172.21.15.7:0/2159333395 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d085700 1 --2- 172.21.15.7:0/2159333395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc320 0x7f839813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25494888 0 0) 0x7f839806d7b0 con 0x7f839806a110 2023-10-14T19:04:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8380003570 con 0x7f839806a110 2023-10-14T19:04:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014920987 0 0) 0x7f839806e330 con 0x7f83980cc6f0 2023-10-14T19:04:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f839806d7b0 con 0x7f83980cc6f0 2023-10-14T19:04:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d085700 1 -- 172.21.15.7:0/2159333395 >> v1:172.21.15.148:6789/0 conn(0x7f83980cc6f0 legacy=0x7f8398069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d085700 1 -- 172.21.15.7:0/2159333395 >> v1:172.21.15.7:6789/0 conn(0x7f839806a110 legacy=0x7f839806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d085700 1 -- 172.21.15.7:0/2159333395 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839806da00 con 0x7f83980cc320 2023-10-14T19:04:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.552+0000 7f839d085700 1 --2- 172.21.15.7:0/2159333395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc320 0x7f839813c2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8390009910 tx=0x7f83900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea91fa91816ea54e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011630 con 0x7f83980cc320 2023-10-14T19:04:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390011790 con 0x7f83980cc320 2023-10-14T19:04:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f8397fff700 1 -- 172.21.15.7:0/2159333395 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011b30 con 0x7f83980cc320 2023-10-14T19:04:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 -- 172.21.15.7:0/2159333395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc320 msgr2=0x7f839813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2159333395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc320 0x7f839813c2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8390009910 tx=0x7f83900091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 -- 172.21.15.7:0/2159333395 shutdown_connections 2023-10-14T19:04:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2159333395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc320 0x7f839813c2a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 -- 172.21.15.7:0/2159333395 >> 172.21.15.7:0/2159333395 conn(0x7f8398067f00 msgr2=0x7f8398068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 -- 172.21.15.7:0/2159333395 shutdown_connections 2023-10-14T19:04:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.553+0000 7f839f2e9700 1 -- 172.21.15.7:0/2159333395 wait complete. 2023-10-14T19:04:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.554+0000 7f839f2e9700 1 Processor -- start 2023-10-14T19:04:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.554+0000 7f839f2e9700 1 -- start start 2023-10-14T19:04:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839f2e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f839806a110 0x7f83980ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839f2e9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 0x7f83980aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839f2e9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc6f0 0x7f839816a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839f2e9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980ac760 con 0x7f83980cc320 2023-10-14T19:04:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839f2e9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980acbf0 con 0x7f839806a110 2023-10-14T19:04:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839f2e9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980aafc0 con 0x7f83980cc6f0 2023-10-14T19:04:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839c884700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 0x7f83980aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839c884700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 0x7f83980aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49494/0 (socket says 172.21.15.7:49494) 2023-10-14T19:04:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.555+0000 7f839c884700 1 -- 172.21.15.7:0/2885813023 learned_addr learned my addr 172.21.15.7:0/2885813023 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839d085700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f839806a110 0x7f83980ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839d886700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc6f0 0x7f839816a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839c884700 1 -- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc6f0 msgr2=0x7f839816a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839c884700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc6f0 0x7f839816a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839c884700 1 -- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f839806a110 msgr2=0x7f83980ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839c884700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f839806a110 0x7f83980ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839c884700 1 -- 172.21.15.7:0/2885813023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009420 con 0x7f83980cc320 2023-10-14T19:04:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839d085700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f839806a110 0x7f83980ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839c884700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 0x7f83980aaa80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c580 tx=0x7f838c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c010510 con 0x7f83980cc320 2023-10-14T19:04:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c010670 con 0x7f83980cc320 2023-10-14T19:04:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980abb50 con 0x7f83980cc320 2023-10-14T19:04:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c010a30 con 0x7f83980cc320 2023-10-14T19:04:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.556+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980ac110 con 0x7f83980cc320 2023-10-14T19:04:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.557+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83980ac910 con 0x7f83980cc320 2023-10-14T19:04:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.557+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f838c01b400 con 0x7f83980cc320 2023-10-14T19:04:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.558+0000 7f83957fa700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8384066fc0 0x7f8384069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.558+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f838c084200 con 0x7f83980cc320 2023-10-14T19:04:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.558+0000 7f839d085700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8384066fc0 0x7f8384069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.559+0000 7f839d085700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8384066fc0 0x7f8384069470 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8390009860 tx=0x7f8390017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.562+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83980ac910 con 0x7f83980cc320 2023-10-14T19:04:43.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.754+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83980cddb0 con 0x7f83980cc320 2023-10-14T19:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.755+0000 7f83957fa700 1 -- 172.21.15.7:0/2885813023 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f838c051480 con 0x7f83980cc320 2023-10-14T19:04:43.755 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.756+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8384066fc0 msgr2=0x7f8384069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.756+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8384066fc0 0x7f8384069470 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8390009860 tx=0x7f8390017000 comp rx=0 tx=0).stop 2023-10-14T19:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.756+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 msgr2=0x7f83980aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 0x7f83980aaa80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c580 tx=0x7f838c007e10 comp rx=0 tx=0).stop 2023-10-14T19:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 shutdown_connections 2023-10-14T19:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8384066fc0 0x7f8384069470 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f839806a110 0x7f83980ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83980cc6f0 0x7f839816a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 --2- 172.21.15.7:0/2885813023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83980cc320 0x7f83980aaa80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 >> 172.21.15.7:0/2885813023 conn(0x7f8398067f00 msgr2=0x7f83980b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:43.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 shutdown_connections 2023-10-14T19:04:43.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.757+0000 7f839f2e9700 1 -- 172.21.15.7:0/2885813023 wait complete. 2023-10-14T19:04:43.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:04:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.892+0000 7fef6ceeb700 1 Processor -- start 2023-10-14T19:04:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.892+0000 7fef6ceeb700 1 -- start start 2023-10-14T19:04:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef6ceeb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 0x7fef680accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef6ceeb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680ac840 con 0x7fef6806d250 2023-10-14T19:04:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef6ceeb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680abf50 con 0x7fef68157420 2023-10-14T19:04:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef6ceeb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680aea60 con 0x7fef680af6b0 2023-10-14T19:04:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef66ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fef6806d250 0x7fef680aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47544/0 (socket says 172.21.15.7:47544) 2023-10-14T19:04:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef66ffd700 1 -- 172.21.15.7:0/1446108199 learned_addr learned my addr 172.21.15.7:0/1446108199 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef67fff700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 0x7fef680accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303089807 0 0) 0x7fef680ac840 con 0x7fef6806d250 2023-10-14T19:04:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.893+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef50003570 con 0x7fef6806d250 2023-10-14T19:04:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005126387 0 0) 0x7fef680abf50 con 0x7fef68157420 2023-10-14T19:04:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef680ac840 con 0x7fef68157420 2023-10-14T19:04:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2784120519 0 0) 0x7fef50003570 con 0x7fef6806d250 2023-10-14T19:04:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 msgr2=0x7fef680accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 0x7fef680accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 >> v1:172.21.15.148:6789/0 conn(0x7fef68157420 legacy=0x7fef680b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680ac1f0 con 0x7fef6806d250 2023-10-14T19:04:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fef5c001470 con 0x7fef6806d250 2023-10-14T19:04:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 >> v1:172.21.15.7:6789/0 conn(0x7fef6806d250 legacy=0x7fef680aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef50003c20 0x7fef50004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 0x7fef50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50004d50 0x7fef500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680aea60 con 0x7fef50003c20 2023-10-14T19:04:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5000bbf0 con 0x7fef50004d50 2023-10-14T19:04:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5000bd60 con 0x7fef680af6b0 2023-10-14T19:04:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef50003c20 0x7fef50004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef67fff700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50004d50 0x7fef500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef66ffd700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 0x7fef50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 -- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 msgr2=0x7fef50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef680af6b0 0x7fef50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 -- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50004d50 msgr2=0x7fef500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50004d50 0x7fef500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 -- 172.21.15.7:0/1446108199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50003570 con 0x7fef50003c20 2023-10-14T19:04:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.894+0000 7fef677fe700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef50003c20 0x7fef50004010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef580019e0 tx=0x7fef58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c55a54c6470da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800c5d0 con 0x7fef50003c20 2023-10-14T19:04:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800c730 con 0x7fef50003c20 2023-10-14T19:04:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef667fc700 1 -- 172.21.15.7:0/1446108199 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800cad0 con 0x7fef50003c20 2023-10-14T19:04:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1446108199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef50003c20 msgr2=0x7fef50004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1446108199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef50003c20 0x7fef50004010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef580019e0 tx=0x7fef58007d30 comp rx=0 tx=0).stop 2023-10-14T19:04:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef67fff700 1 -- 172.21.15.7:0/1446108199 reap_dead start 2023-10-14T19:04:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1446108199 shutdown_connections 2023-10-14T19:04:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1446108199 >> 172.21.15.7:0/1446108199 conn(0x7fef6806ce80 msgr2=0x7fef680ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1446108199 shutdown_connections 2023-10-14T19:04:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.895+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1446108199 wait complete. 2023-10-14T19:04:43.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.896+0000 7fef6ceeb700 1 Processor -- start 2023-10-14T19:04:43.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.896+0000 7fef6ceeb700 1 -- start start 2023-10-14T19:04:43.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef6ceeb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50003c20 0x7fef68147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef6ceeb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 0x7fef6815a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef6ceeb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef68152ae0 0x7fef68152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef6ceeb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681534c0 con 0x7fef68148850 2023-10-14T19:04:43.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef6ceeb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef68169a20 con 0x7fef50003c20 2023-10-14T19:04:43.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef6ceeb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef68147660 con 0x7fef68152ae0 2023-10-14T19:04:43.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef66ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 0x7fef6815a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef66ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 0x7fef6815a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49506/0 (socket says 172.21.15.7:49506) 2023-10-14T19:04:43.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef66ffd700 1 -- 172.21.15.7:0/1549572946 learned_addr learned my addr 172.21.15.7:0/1549572946 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:43.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef677fe700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50003c20 0x7fef68147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.897+0000 7fef67fff700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef68152ae0 0x7fef68152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef66ffd700 1 -- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef68152ae0 msgr2=0x7fef68152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef66ffd700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef68152ae0 0x7fef68152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef66ffd700 1 -- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50003c20 msgr2=0x7fef68147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:43.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef66ffd700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50003c20 0x7fef68147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:43.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef66ffd700 1 -- 172.21.15.7:0/1549572946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68168e10 con 0x7fef68148850 2023-10-14T19:04:43.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef66ffd700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 0x7fef6815a000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0073c0 tx=0x7fef5c001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c000c40 con 0x7fef68148850 2023-10-14T19:04:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00f5e0 con 0x7fef68148850 2023-10-14T19:04:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef681690f0 con 0x7fef68148850 2023-10-14T19:04:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00f9a0 con 0x7fef68148850 2023-10-14T19:04:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.898+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef681696b0 con 0x7fef68148850 2023-10-14T19:04:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.899+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef68169bb0 con 0x7fef68148850 2023-10-14T19:04:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.899+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fef5c00fd50 con 0x7fef68148850 2023-10-14T19:04:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.900+0000 7fef4f7fe700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef54066fc0 0x7fef54069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.900+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef5c084460 con 0x7fef68148850 2023-10-14T19:04:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.900+0000 7fef677fe700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef54066fc0 0x7fef54069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.901+0000 7fef677fe700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef54066fc0 0x7fef54069470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef58008fd0 tx=0x7fef58015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:43.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:43.904+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef5c0516e0 con 0x7fef68148850 2023-10-14T19:04:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.094+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef6804c3c0 con 0x7fef68148850 2023-10-14T19:04:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.094+0000 7fef4f7fe700 1 -- 172.21.15.7:0/1549572946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef5c054d00 con 0x7fef68148850 2023-10-14T19:04:44.094 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:04:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef54066fc0 msgr2=0x7fef54069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef54066fc0 0x7fef54069470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef58008fd0 tx=0x7fef58015000 comp rx=0 tx=0).stop 2023-10-14T19:04:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 msgr2=0x7fef6815a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 0x7fef6815a000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0073c0 tx=0x7fef5c001d20 comp rx=0 tx=0).stop 2023-10-14T19:04:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 shutdown_connections 2023-10-14T19:04:44.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef54066fc0 0x7fef54069470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef50003c20 0x7fef68147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef68152ae0 0x7fef68152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 --2- 172.21.15.7:0/1549572946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef68148850 0x7fef6815a000 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 >> 172.21.15.7:0/1549572946 conn(0x7fef6806ce80 msgr2=0x7fef68147a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 shutdown_connections 2023-10-14T19:04:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.096+0000 7fef6ceeb700 1 -- 172.21.15.7:0/1549572946 wait complete. 2023-10-14T19:04:44.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:04:44.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.231+0000 7f72c2a4f700 1 Processor -- start 2023-10-14T19:04:44.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.231+0000 7f72c2a4f700 1 -- start start 2023-10-14T19:04:44.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c2a4f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc159530 0x7f72bc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c2a4f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72bc06e0e0 0x7f72bc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c2a4f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0ccfd0 con 0x7f72bc06dc70 2023-10-14T19:04:44.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c2a4f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0cf0e0 con 0x7f72bc06e0e0 2023-10-14T19:04:44.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c2a4f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc15a3d0 con 0x7f72bc159530 2023-10-14T19:04:44.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72bc06e0e0 0x7f72bc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72bc06e0e0 0x7f72bc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49522/0 (socket says 172.21.15.7:49522) 2023-10-14T19:04:44.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 -- 172.21.15.7:0/1503881222 learned_addr learned my addr 172.21.15.7:0/1503881222 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:44.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72bbfff700 1 --2- 172.21.15.7:0/1503881222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc159530 0x7f72bc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 -- 172.21.15.7:0/1503881222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc159530 msgr2=0x7f72bc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:44.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 --2- 172.21.15.7:0/1503881222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc159530 0x7f72bc0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 -- 172.21.15.7:0/1503881222 >> v1:172.21.15.148:6789/0 conn(0x7f72bc06dc70 legacy=0x7f72bc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 -- 172.21.15.7:0/1503881222 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc15a6b0 con 0x7f72bc06e0e0 2023-10-14T19:04:44.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72c0fec700 1 --2- 172.21.15.7:0/1503881222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0cb6f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009f20 tx=0x7f72b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cd02e2c9be5f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.232+0000 7f72baffd700 1 -- 172.21.15.7:0/1503881222 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400e070 con 0x7f72bc06e0e0 2023-10-14T19:04:44.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72baffd700 1 -- 172.21.15.7:0/1503881222 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400b9d0 con 0x7f72bc06e0e0 2023-10-14T19:04:44.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72baffd700 1 -- 172.21.15.7:0/1503881222 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40092e0 con 0x7f72bc06e0e0 2023-10-14T19:04:44.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1503881222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc06e0e0 msgr2=0x7f72bc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1503881222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0cb6f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009f20 tx=0x7f72b4009840 comp rx=0 tx=0).stop 2023-10-14T19:04:44.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1503881222 shutdown_connections 2023-10-14T19:04:44.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1503881222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0cb6f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1503881222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc159530 0x7f72bc0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1503881222 >> 172.21.15.7:0/1503881222 conn(0x7f72bc0703a0 msgr2=0x7f72bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:44.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1503881222 shutdown_connections 2023-10-14T19:04:44.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.233+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1503881222 wait complete. 2023-10-14T19:04:44.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.234+0000 7f72c2a4f700 1 Processor -- start 2023-10-14T19:04:44.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.234+0000 7f72c2a4f700 1 -- start start 2023-10-14T19:04:44.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c2a4f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc06dc70 0x7f72bc14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c2a4f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c2a4f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 0x7f72bc0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c2a4f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc157cd0 con 0x7f72bc159530 2023-10-14T19:04:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c2a4f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc14d780 con 0x7f72bc06e0e0 2023-10-14T19:04:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c2a4f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c9d10 con 0x7f72bc06dc70 2023-10-14T19:04:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c0fec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 0x7f72bc0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c0fec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 0x7f72bc0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49524/0 (socket says 172.21.15.7:49524) 2023-10-14T19:04:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72c0fec700 1 -- 172.21.15.7:0/1533079519 learned_addr learned my addr 172.21.15.7:0/1533079519 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:44.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72bbfff700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc06dc70 0x7f72bc14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.235+0000 7f72bb7fe700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c0fec700 1 -- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc06dc70 msgr2=0x7f72bc14d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c0fec700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc06dc70 0x7f72bc14d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c0fec700 1 -- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc06e0e0 msgr2=0x7f72bc0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c0fec700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c0fec700 1 -- 172.21.15.7:0/1533079519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009ae0 con 0x7f72bc159530 2023-10-14T19:04:44.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72bb7fe700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:44.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c0fec700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 0x7f72bc0c8170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f72bc089650 tx=0x7f72b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4008b80 con 0x7f72bc159530 2023-10-14T19:04:44.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4008ce0 con 0x7f72bc159530 2023-10-14T19:04:44.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc0c86b0 con 0x7f72bc159530 2023-10-14T19:04:44.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40266b0 con 0x7f72bc159530 2023-10-14T19:04:44.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.236+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc0c8cf0 con 0x7f72bc159530 2023-10-14T19:04:44.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.237+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc04c3c0 con 0x7f72bc159530 2023-10-14T19:04:44.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.237+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f72b4003040 con 0x7f72bc159530 2023-10-14T19:04:44.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.238+0000 7f72a3fff700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f72a8066fc0 0x7f72a8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.238+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72b40864f0 con 0x7f72bc159530 2023-10-14T19:04:44.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.238+0000 7f72bbfff700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f72a8066fc0 0x7f72a8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.238+0000 7f72bbfff700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f72a8066fc0 0x7f72a8069470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009d10 tx=0x7f72ac0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.242+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72b4053660 con 0x7f72bc159530 2023-10-14T19:04:44.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.433+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72bc15a990 con 0x7f72bc159530 2023-10-14T19:04:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.434+0000 7f72a3fff700 1 -- 172.21.15.7:0/1533079519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72b4056c80 con 0x7f72bc159530 2023-10-14T19:04:44.435 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:04:44.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f72a8066fc0 msgr2=0x7f72a8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f72a8066fc0 0x7f72a8069470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009d10 tx=0x7f72ac0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 msgr2=0x7f72bc0c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 0x7f72bc0c8170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f72bc089650 tx=0x7f72b4018000 comp rx=0 tx=0).stop 2023-10-14T19:04:44.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 shutdown_connections 2023-10-14T19:04:44.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f72a8066fc0 0x7f72a8069470 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72bc159530 0x7f72bc0c8170 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72bc06dc70 0x7f72bc14d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 --2- 172.21.15.7:0/1533079519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc06e0e0 0x7f72bc0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 >> 172.21.15.7:0/1533079519 conn(0x7f72bc0703a0 msgr2=0x7f72bc0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 shutdown_connections 2023-10-14T19:04:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.436+0000 7f72c2a4f700 1 -- 172.21.15.7:0/1533079519 wait complete. 2023-10-14T19:04:44.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.568+0000 7fa4257bf700 1 Processor -- start 2023-10-14T19:04:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.569+0000 7fa4257bf700 1 -- start start 2023-10-14T19:04:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.569+0000 7fa4257bf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4200c29b0 0x7fa420156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.569+0000 7fa4257bf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa420070410 0x7fa420160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.569+0000 7fa4257bf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4200c3a30 con 0x7fa42013fcc0 2023-10-14T19:04:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.569+0000 7fa4257bf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4200c2e20 con 0x7fa420070410 2023-10-14T19:04:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.569+0000 7fa4257bf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4200c3100 con 0x7fa4200c29b0 2023-10-14T19:04:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa420070410 0x7fa420160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa420070410 0x7fa420160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49538/0 (socket says 172.21.15.7:49538) 2023-10-14T19:04:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 -- 172.21.15.7:0/2172977686 learned_addr learned my addr 172.21.15.7:0/2172977686 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41e7fc700 1 --2- 172.21.15.7:0/2172977686 >> v2:172.21.15.148:3300/0 conn(0x7fa4200c29b0 0x7fa420156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 -- 172.21.15.7:0/2172977686 >> v2:172.21.15.148:3300/0 conn(0x7fa4200c29b0 msgr2=0x7fa420156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 --2- 172.21.15.7:0/2172977686 >> v2:172.21.15.148:3300/0 conn(0x7fa4200c29b0 0x7fa420156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 -- 172.21.15.7:0/2172977686 >> v1:172.21.15.148:6789/0 conn(0x7fa42013fcc0 legacy=0x7fa4200c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 -- 172.21.15.7:0/2172977686 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200c33e0 con 0x7fa420070410 2023-10-14T19:04:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41f7fe700 1 --2- 172.21.15.7:0/2172977686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa420070410 0x7fa420160120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa42006bb80 tx=0x7fa418009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d0de627e2d6558 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41dffb700 1 -- 172.21.15.7:0/2172977686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800e070 con 0x7fa420070410 2023-10-14T19:04:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41dffb700 1 -- 172.21.15.7:0/2172977686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41800ba50 con 0x7fa420070410 2023-10-14T19:04:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.570+0000 7fa41dffb700 1 -- 172.21.15.7:0/2172977686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180092e0 con 0x7fa420070410 2023-10-14T19:04:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 -- 172.21.15.7:0/2172977686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa420070410 msgr2=0x7fa420160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 --2- 172.21.15.7:0/2172977686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa420070410 0x7fa420160120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa42006bb80 tx=0x7fa418009840 comp rx=0 tx=0).stop 2023-10-14T19:04:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 -- 172.21.15.7:0/2172977686 shutdown_connections 2023-10-14T19:04:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 --2- 172.21.15.7:0/2172977686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa420070410 0x7fa420160120 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 --2- 172.21.15.7:0/2172977686 >> v2:172.21.15.148:3300/0 conn(0x7fa4200c29b0 0x7fa420156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 -- 172.21.15.7:0/2172977686 >> 172.21.15.7:0/2172977686 conn(0x7fa4200ccb60 msgr2=0x7fa4200ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 -- 172.21.15.7:0/2172977686 shutdown_connections 2023-10-14T19:04:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.571+0000 7fa4257bf700 1 -- 172.21.15.7:0/2172977686 wait complete. 2023-10-14T19:04:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.572+0000 7fa4257bf700 1 Processor -- start 2023-10-14T19:04:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.572+0000 7fa4257bf700 1 -- start start 2023-10-14T19:04:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa4257bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa420070410 0x7fa42013b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa4257bf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4200c29b0 0x7fa4200ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa4257bf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 0x7fa420166230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa4257bf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa420166030 con 0x7fa42013fcc0 2023-10-14T19:04:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa4257bf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200c9ef0 con 0x7fa420070410 2023-10-14T19:04:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa4257bf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42013b850 con 0x7fa4200c29b0 2023-10-14T19:04:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 0x7fa420166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 0x7fa420166230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49542/0 (socket says 172.21.15.7:49542) 2023-10-14T19:04:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 -- 172.21.15.7:0/4239504739 learned_addr learned my addr 172.21.15.7:0/4239504739 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41effd700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa420070410 0x7fa42013b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41e7fc700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4200c29b0 0x7fa4200ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 -- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4200c29b0 msgr2=0x7fa4200ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4200c29b0 0x7fa4200ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 -- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa420070410 msgr2=0x7fa42013b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa420070410 0x7fa42013b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 -- 172.21.15.7:0/4239504739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418009ae0 con 0x7fa42013fcc0 2023-10-14T19:04:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa41f7fe700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 0x7fa420166230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa418012000 tx=0x7fa418018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.573+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180094e0 con 0x7fa42013fcc0 2023-10-14T19:04:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.574+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418008e80 con 0x7fa42013fcc0 2023-10-14T19:04:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.574+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4200c95c0 con 0x7fa42013fcc0 2023-10-14T19:04:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.574+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180266b0 con 0x7fa42013fcc0 2023-10-14T19:04:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.574+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4200c9b80 con 0x7fa42013fcc0 2023-10-14T19:04:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.574+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42004c3c0 con 0x7fa42013fcc0 2023-10-14T19:04:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.576+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa418003040 con 0x7fa42013fcc0 2023-10-14T19:04:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.576+0000 7fa406ffd700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa40c066fc0 0x7fa40c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.576+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa418086850 con 0x7fa42013fcc0 2023-10-14T19:04:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.576+0000 7fa41effd700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa40c066fc0 0x7fa40c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.577+0000 7fa41effd700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa40c066fc0 0x7fa40c069470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa4100037c0 tx=0x7fa410009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.579+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa418053a40 con 0x7fa42013fcc0 2023-10-14T19:04:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.817+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4200c36c0 con 0x7fa42013fcc0 2023-10-14T19:04:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.818+0000 7fa406ffd700 1 -- 172.21.15.7:0/4239504739 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fa418057060 con 0x7fa42013fcc0 2023-10-14T19:04:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:44.819 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:31.225490+0000","modified":"2023-10-14T19:04:34.832188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/1084131518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1084131518},{"type":"v1","addr":"172.21.15.7:6834","nonce":1084131518}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T19:04:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa40c066fc0 msgr2=0x7fa40c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa40c066fc0 0x7fa40c069470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa4100037c0 tx=0x7fa410009040 comp rx=0 tx=0).stop 2023-10-14T19:04:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 msgr2=0x7fa420166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 0x7fa420166230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa418012000 tx=0x7fa418018000 comp rx=0 tx=0).stop 2023-10-14T19:04:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 shutdown_connections 2023-10-14T19:04:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa40c066fc0 0x7fa40c069470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa420070410 0x7fa42013b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42013fcc0 0x7fa420166230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 --2- 172.21.15.7:0/4239504739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4200c29b0 0x7fa4200ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 >> 172.21.15.7:0/4239504739 conn(0x7fa4200ccb60 msgr2=0x7fa4200ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 shutdown_connections 2023-10-14T19:04:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.820+0000 7fa4257bf700 1 -- 172.21.15.7:0/4239504739 wait complete. 2023-10-14T19:04:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2023-10-14T19:04:44.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:44.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.951+0000 7fe5da872700 1 Processor -- start 2023-10-14T19:04:44.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.951+0000 7fe5da872700 1 -- start start 2023-10-14T19:04:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5da872700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d4159c80 0x7fe5d40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5da872700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d40ce9d0 con 0x7fe5d41598b0 2023-10-14T19:04:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5da872700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d40af960 con 0x7fe5d40cfe70 2023-10-14T19:04:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5da872700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40afc30 con 0x7fe5d4159c80 2023-10-14T19:04:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5d3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe5d41598b0 0x7fe5d40af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47558/0 (socket says 172.21.15.7:47558) 2023-10-14T19:04:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5d3fff700 1 -- 172.21.15.7:0/675439270 learned_addr learned my addr 172.21.15.7:0/675439270 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.952+0000 7fe5d37fe700 1 --2- 172.21.15.7:0/675439270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d4159c80 0x7fe5d40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329755164 0 0) 0x7fe5d40ce9d0 con 0x7fe5d41598b0 2023-10-14T19:04:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c0003570 con 0x7fe5d41598b0 2023-10-14T19:04:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373085967 0 0) 0x7fe5d40af960 con 0x7fe5d40cfe70 2023-10-14T19:04:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d40ce9d0 con 0x7fe5d40cfe70 2023-10-14T19:04:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d37fe700 1 -- 172.21.15.7:0/675439270 >> v1:172.21.15.148:6789/0 conn(0x7fe5d40cfe70 legacy=0x7fe5d4163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d37fe700 1 -- 172.21.15.7:0/675439270 >> v1:172.21.15.7:6789/0 conn(0x7fe5d41598b0 legacy=0x7fe5d40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051265669 0 0) 0x7fe5c0003570 con 0x7fe5d41598b0 2023-10-14T19:04:44.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d37fe700 1 -- 172.21.15.7:0/675439270 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40aff10 con 0x7fe5d4159c80 2023-10-14T19:04:44.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d37fe700 1 --2- 172.21.15.7:0/675439270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d4159c80 0x7fe5d40cb6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009910 tx=0x7fe5c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a223bb432730c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc001470 con 0x7fe5d4159c80 2023-10-14T19:04:44.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c4011420 con 0x7fe5d4159c80 2023-10-14T19:04:44.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.953+0000 7fe5d2ffd700 1 -- 172.21.15.7:0/675439270 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40117c0 con 0x7fe5d4159c80 2023-10-14T19:04:44.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 -- 172.21.15.7:0/675439270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d4159c80 msgr2=0x7fe5d40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 --2- 172.21.15.7:0/675439270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d4159c80 0x7fe5d40cb6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009910 tx=0x7fe5c40091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 -- 172.21.15.7:0/675439270 shutdown_connections 2023-10-14T19:04:44.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 --2- 172.21.15.7:0/675439270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d4159c80 0x7fe5d40cb6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 -- 172.21.15.7:0/675439270 >> 172.21.15.7:0/675439270 conn(0x7fe5d4070e30 msgr2=0x7fe5d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:44.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 -- 172.21.15.7:0/675439270 shutdown_connections 2023-10-14T19:04:44.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.954+0000 7fe5da872700 1 -- 172.21.15.7:0/675439270 wait complete. 2023-10-14T19:04:44.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.955+0000 7fe5da872700 1 Processor -- start 2023-10-14T19:04:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.955+0000 7fe5da872700 1 -- start start 2023-10-14T19:04:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5da872700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d40cfe70 0x7fe5d40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5da872700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5d41598b0 0x7fe5d40c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5da872700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 0x7fe5d41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5da872700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4156220 con 0x7fe5d4159c80 2023-10-14T19:04:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5da872700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4155ef0 con 0x7fe5d41598b0 2023-10-14T19:04:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5da872700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40c89b0 con 0x7fe5d40cfe70 2023-10-14T19:04:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 0x7fe5d41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 0x7fe5d41511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49548/0 (socket says 172.21.15.7:49548) 2023-10-14T19:04:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 -- 172.21.15.7:0/3121370553 learned_addr learned my addr 172.21.15.7:0/3121370553 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d37fe700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5d41598b0 0x7fe5d40c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d3fff700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d40cfe70 0x7fe5d40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 -- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d40cfe70 msgr2=0x7fe5d40ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d40cfe70 0x7fe5d40ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 -- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5d41598b0 msgr2=0x7fe5d40c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:44.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5d41598b0 0x7fe5d40c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:44.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.956+0000 7fe5d8e0f700 1 -- 172.21.15.7:0/3121370553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4009420 con 0x7fe5d4159c80 2023-10-14T19:04:44.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.957+0000 7fe5d8e0f700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 0x7fe5d41511b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c910 tx=0x7fe5cc002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.957+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00ce50 con 0x7fe5d4159c80 2023-10-14T19:04:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.957+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc00a7e0 con 0x7fe5d4159c80 2023-10-14T19:04:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.957+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d40c8c90 con 0x7fe5d4159c80 2023-10-14T19:04:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.957+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00aba0 con 0x7fe5d4159c80 2023-10-14T19:04:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.957+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d40c86b0 con 0x7fe5d4159c80 2023-10-14T19:04:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.958+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d40c91b0 con 0x7fe5d4159c80 2023-10-14T19:04:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.958+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe5cc012420 con 0x7fe5d4159c80 2023-10-14T19:04:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.959+0000 7fe5cbfff700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4066fc0 0x7fe5b4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.959+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5cc084920 con 0x7fe5d4159c80 2023-10-14T19:04:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.959+0000 7fe5d3fff700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4066fc0 0x7fe5b4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.959+0000 7fe5d3fff700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4066fc0 0x7fe5b4069470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0015a0 tx=0x7fe5bc000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:44.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:44.963+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5d40c91b0 con 0x7fe5d4159c80 2023-10-14T19:04:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.160+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5d40c91b0 con 0x7fe5d4159c80 2023-10-14T19:04:45.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.161+0000 7fe5cbfff700 1 -- 172.21.15.7:0/3121370553 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe5d40c91b0 con 0x7fe5d4159c80 2023-10-14T19:04:45.162 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:45.162 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:32.781544+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:29.657115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:30.193005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:45.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4066fc0 msgr2=0x7fe5b4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4066fc0 0x7fe5b4069470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0015a0 tx=0x7fe5bc000bc0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 msgr2=0x7fe5d41511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 0x7fe5d41511b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c910 tx=0x7fe5cc002720 comp rx=0 tx=0).stop 2023-10-14T19:04:45.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 shutdown_connections 2023-10-14T19:04:45.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4066fc0 0x7fe5b4069470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d4159c80 0x7fe5d41511b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5d40cfe70 0x7fe5d40ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 --2- 172.21.15.7:0/3121370553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5d41598b0 0x7fe5d40c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 >> 172.21.15.7:0/3121370553 conn(0x7fe5d4070e30 msgr2=0x7fe5d40c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:45.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 shutdown_connections 2023-10-14T19:04:45.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.163+0000 7fe5da872700 1 -- 172.21.15.7:0/3121370553 wait complete. 2023-10-14T19:04:45.176 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:04:45.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:45.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.295+0000 7fee267f3700 1 Processor -- start 2023-10-14T19:04:45.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.295+0000 7fee267f3700 1 -- start start 2023-10-14T19:04:45.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee267f3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee20153c30 0x7fee2015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee267f3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee2015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee267f3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2015afd0 con 0x7fee2015de50 2023-10-14T19:04:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee267f3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2015b2b0 con 0x7fee20153c30 2023-10-14T19:04:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee267f3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2015b590 con 0x7fee200cf110 2023-10-14T19:04:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee20153c30 0x7fee2015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee20153c30 0x7fee2015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49562/0 (socket says 172.21.15.7:49562) 2023-10-14T19:04:45.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee24ff0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fee2015de50 0x7fee200cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47562/0 (socket says 172.21.15.7:47562) 2023-10-14T19:04:45.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 -- 172.21.15.7:0/3561594533 learned_addr learned my addr 172.21.15.7:0/3561594533 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:45.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee25ff2700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee2015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 -- 172.21.15.7:0/3561594533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 msgr2=0x7fee2015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee2015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 -- 172.21.15.7:0/3561594533 >> v1:172.21.15.7:6789/0 conn(0x7fee2015de50 legacy=0x7fee200cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee257f1700 1 -- 172.21.15.7:0/3561594533 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2015b870 con 0x7fee20153c30 2023-10-14T19:04:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee1ffff700 1 -- 172.21.15.7:0/3561594533 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808378024 0 0) 0x7fee2015afd0 con 0x7fee2015de50 2023-10-14T19:04:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.296+0000 7fee25ff2700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee2015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee257f1700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2015a5e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fee10009f20 tx=0x7fee10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccd2e34d1f6e6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee1ffff700 1 -- 172.21.15.7:0/3561594533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000e070 con 0x7fee20153c30 2023-10-14T19:04:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee1ffff700 1 -- 172.21.15.7:0/3561594533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000ba80 con 0x7fee20153c30 2023-10-14T19:04:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee1ffff700 1 -- 172.21.15.7:0/3561594533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100092e0 con 0x7fee20153c30 2023-10-14T19:04:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 -- 172.21.15.7:0/3561594533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 msgr2=0x7fee2015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2015a5e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fee10009f20 tx=0x7fee10009840 comp rx=0 tx=0).stop 2023-10-14T19:04:45.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 -- 172.21.15.7:0/3561594533 shutdown_connections 2023-10-14T19:04:45.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2015a5e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 --2- 172.21.15.7:0/3561594533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee2015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 -- 172.21.15.7:0/3561594533 >> 172.21.15.7:0/3561594533 conn(0x7fee200703a0 msgr2=0x7fee200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:45.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 -- 172.21.15.7:0/3561594533 shutdown_connections 2023-10-14T19:04:45.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.297+0000 7fee267f3700 1 -- 172.21.15.7:0/3561594533 wait complete. 2023-10-14T19:04:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 Processor -- start 2023-10-14T19:04:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 -- start start 2023-10-14T19:04:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee200b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2014b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2015de50 0x7fee200b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200b26a0 con 0x7fee20153c30 2023-10-14T19:04:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200b0500 con 0x7fee2015de50 2023-10-14T19:04:45.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.299+0000 7fee267f3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2014b6e0 con 0x7fee200cf110 2023-10-14T19:04:45.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2014b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2014b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49578/0 (socket says 172.21.15.7:49578) 2023-10-14T19:04:45.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 -- 172.21.15.7:0/218832825 learned_addr learned my addr 172.21.15.7:0/218832825 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:45.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee257f1700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee200b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee25ff2700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2015de50 0x7fee200b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 -- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 msgr2=0x7fee200b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee200b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 -- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2015de50 msgr2=0x7fee200b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2015de50 0x7fee200b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 -- 172.21.15.7:0/218832825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10009ae0 con 0x7fee20153c30 2023-10-14T19:04:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee24ff0700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2014b1a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee1400c5e0 tx=0x7fee14001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14005a70 con 0x7fee20153c30 2023-10-14T19:04:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14005bd0 con 0x7fee20153c30 2023-10-14T19:04:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee200b1d60 con 0x7fee20153c30 2023-10-14T19:04:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140070d0 con 0x7fee20153c30 2023-10-14T19:04:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.300+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2016d0f0 con 0x7fee20153c30 2023-10-14T19:04:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.301+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee200b06b0 con 0x7fee20153c30 2023-10-14T19:04:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.302+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fee14007480 con 0x7fee20153c30 2023-10-14T19:04:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.302+0000 7fee1d7fa700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee0c066fc0 0x7fee0c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.302+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee14083a20 con 0x7fee20153c30 2023-10-14T19:04:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.302+0000 7fee257f1700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee0c066fc0 0x7fee0c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.303+0000 7fee257f1700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee0c066fc0 0x7fee0c069470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee10009880 tx=0x7fee10018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.307+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee200b06b0 con 0x7fee20153c30 2023-10-14T19:04:45.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.541+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee200b06b0 con 0x7fee20153c30 2023-10-14T19:04:45.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.542+0000 7fee1d7fa700 1 -- 172.21.15.7:0/218832825 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fee200b06b0 con 0x7fee20153c30 2023-10-14T19:04:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:45.543 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:31.225490+0000","modified":"2023-10-14T19:04:34.832188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/1084131518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1084131518},{"type":"v1","addr":"172.21.15.7:6834","nonce":1084131518}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T19:04:45.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee0c066fc0 msgr2=0x7fee0c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee0c066fc0 0x7fee0c069470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee10009880 tx=0x7fee10018000 comp rx=0 tx=0).stop 2023-10-14T19:04:45.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 msgr2=0x7fee2014b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2014b1a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee1400c5e0 tx=0x7fee14001040 comp rx=0 tx=0).stop 2023-10-14T19:04:45.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 shutdown_connections 2023-10-14T19:04:45.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee0c066fc0 0x7fee0c069470 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2015de50 0x7fee200b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200cf110 0x7fee200b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 --2- 172.21.15.7:0/218832825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee20153c30 0x7fee2014b1a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 >> 172.21.15.7:0/218832825 conn(0x7fee200703a0 msgr2=0x7fee200c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 shutdown_connections 2023-10-14T19:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.544+0000 7fee267f3700 1 -- 172.21.15.7:0/218832825 wait complete. 2023-10-14T19:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2023-10-14T19:04:45.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 Processor -- start 2023-10-14T19:04:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 -- start start 2023-10-14T19:04:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f118015cb50 0x7f11800b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f118015cf20 0x7f11800b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118015ad50 con 0x7f11800b0710 2023-10-14T19:04:45.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118015a140 con 0x7f118015cf20 2023-10-14T19:04:45.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.676+0000 7f1185b26700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118015a420 con 0x7f118015cb50 2023-10-14T19:04:45.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f118015cf20 0x7f11800b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f118015cf20 0x7f11800b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49588/0 (socket says 172.21.15.7:49588) 2023-10-14T19:04:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 -- 172.21.15.7:0/712060190 learned_addr learned my addr 172.21.15.7:0/712060190 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117f7fe700 1 --2- 172.21.15.7:0/712060190 >> v2:172.21.15.148:3300/0 conn(0x7f118015cb50 0x7f11800b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 -- 172.21.15.7:0/712060190 >> v2:172.21.15.148:3300/0 conn(0x7f118015cb50 msgr2=0x7f11800b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 --2- 172.21.15.7:0/712060190 >> v2:172.21.15.148:3300/0 conn(0x7f118015cb50 0x7f11800b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 -- 172.21.15.7:0/712060190 >> v1:172.21.15.148:6789/0 conn(0x7f11800b0710 legacy=0x7f11801536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 -- 172.21.15.7:0/712060190 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118015a700 con 0x7f118015cf20 2023-10-14T19:04:45.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117effd700 1 --2- 172.21.15.7:0/712060190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cf20 0x7f11800b27d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f118006d300 tx=0x7f1174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe15740fecd3fe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:45.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117e7fc700 1 -- 172.21.15.7:0/712060190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174009e70 con 0x7f118015cf20 2023-10-14T19:04:45.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117e7fc700 1 -- 172.21.15.7:0/712060190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117400b860 con 0x7f118015cf20 2023-10-14T19:04:45.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.677+0000 7f117e7fc700 1 -- 172.21.15.7:0/712060190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400bc00 con 0x7f118015cf20 2023-10-14T19:04:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 -- 172.21.15.7:0/712060190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cf20 msgr2=0x7f11800b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 --2- 172.21.15.7:0/712060190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cf20 0x7f11800b27d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f118006d300 tx=0x7f1174009250 comp rx=0 tx=0).stop 2023-10-14T19:04:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 -- 172.21.15.7:0/712060190 shutdown_connections 2023-10-14T19:04:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 --2- 172.21.15.7:0/712060190 >> v2:172.21.15.148:3300/0 conn(0x7f118015cb50 0x7f11800b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 --2- 172.21.15.7:0/712060190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cf20 0x7f11800b27d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 -- 172.21.15.7:0/712060190 >> 172.21.15.7:0/712060190 conn(0x7f11800cded0 msgr2=0x7f118006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 -- 172.21.15.7:0/712060190 shutdown_connections 2023-10-14T19:04:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.678+0000 7f1185b26700 1 -- 172.21.15.7:0/712060190 wait complete. 2023-10-14T19:04:45.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.679+0000 7f1185b26700 1 Processor -- start 2023-10-14T19:04:45.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.679+0000 7f1185b26700 1 -- start start 2023-10-14T19:04:45.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f1185b26700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11800b0710 0x7f118014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f1185b26700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 0x7f1180169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f1185b26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f118015cf20 0x7f11800aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f1185b26700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c21b0 con 0x7f118015cb50 2023-10-14T19:04:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f1185b26700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800a9bc0 con 0x7f118015cf20 2023-10-14T19:04:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f1185b26700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c2400 con 0x7f11800b0710 2023-10-14T19:04:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 0x7f1180169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 0x7f1180169710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49604/0 (socket says 172.21.15.7:49604) 2023-10-14T19:04:45.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 -- 172.21.15.7:0/43788503 learned_addr learned my addr 172.21.15.7:0/43788503 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:45.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117ffff700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f118015cf20 0x7f11800aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117f7fe700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11800b0710 0x7f118014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 -- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11800b0710 msgr2=0x7f118014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11800b0710 0x7f118014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 -- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f118015cf20 msgr2=0x7f11800aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f118015cf20 0x7f11800aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 -- 172.21.15.7:0/43788503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740094f0 con 0x7f118015cb50 2023-10-14T19:04:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117ffff700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f118015cf20 0x7f11800aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.680+0000 7f117effd700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 0x7f1180169710 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f118006f240 tx=0x7f1174017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.681+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011420 con 0x7f118015cb50 2023-10-14T19:04:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.681+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174011580 con 0x7f118015cb50 2023-10-14T19:04:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.681+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11800c26e0 con 0x7f118015cb50 2023-10-14T19:04:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.681+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011940 con 0x7f118015cb50 2023-10-14T19:04:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.681+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11800c2ca0 con 0x7f118015cb50 2023-10-14T19:04:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.681+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11800c2e90 con 0x7f118015cb50 2023-10-14T19:04:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.682+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f117402c3b0 con 0x7f118015cb50 2023-10-14T19:04:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.682+0000 7f11677fe700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f116c066fc0 0x7f116c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.682+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1174085a80 con 0x7f118015cb50 2023-10-14T19:04:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.683+0000 7f117f7fe700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f116c066fc0 0x7f116c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.683+0000 7f117f7fe700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f116c066fc0 0x7f116c069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d40 tx=0x7f1170008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.687+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1174052d00 con 0x7f118015cb50 2023-10-14T19:04:45.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.926+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f118004c3c0 con 0x7f118015cb50 2023-10-14T19:04:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.927+0000 7f11677fe700 1 -- 172.21.15.7:0/43788503 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1174015090 con 0x7f118015cb50 2023-10-14T19:04:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:45.928 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:31.225490+0000","modified":"2023-10-14T19:04:34.832188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/1084131518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1084131518},{"type":"v1","addr":"172.21.15.7:6834","nonce":1084131518}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T19:04:45.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f116c066fc0 msgr2=0x7f116c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f116c066fc0 0x7f116c069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d40 tx=0x7f1170008040 comp rx=0 tx=0).stop 2023-10-14T19:04:45.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 msgr2=0x7f1180169710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:45.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 0x7f1180169710 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f118006f240 tx=0x7f1174017000 comp rx=0 tx=0).stop 2023-10-14T19:04:45.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 shutdown_connections 2023-10-14T19:04:45.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f116c066fc0 0x7f116c069470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f118015cf20 0x7f11800aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11800b0710 0x7f118014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 --2- 172.21.15.7:0/43788503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f118015cb50 0x7f1180169710 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:45.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 >> 172.21.15.7:0/43788503 conn(0x7f11800cded0 msgr2=0x7f11800cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:45.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 shutdown_connections 2023-10-14T19:04:45.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:45.929+0000 7f1185b26700 1 -- 172.21.15.7:0/43788503 wait complete. 2023-10-14T19:04:45.933 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2023-10-14T19:04:45.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:46.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.061+0000 7fc798fe5700 1 Processor -- start 2023-10-14T19:04:46.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.061+0000 7fc798fe5700 1 -- start start 2023-10-14T19:04:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc798fe5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc794155b70 0x7fc7940b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc798fe5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 0x7fc7940b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc798fe5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc794157510 con 0x7fc794159940 2023-10-14T19:04:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc798fe5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7940ae2f0 con 0x7fc794155b70 2023-10-14T19:04:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc798fe5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940ae5d0 con 0x7fc7940add80 2023-10-14T19:04:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 0x7fc7940b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 0x7fc7940b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:47256/0 (socket says 172.21.15.7:47256) 2023-10-14T19:04:46.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc79259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc794155b70 0x7fc7940b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 -- 172.21.15.7:0/56835080 learned_addr learned my addr 172.21.15.7:0/56835080 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:46.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc792d9d700 1 --1- 172.21.15.7:0/56835080 >> v1:172.21.15.148:6789/0 conn(0x7fc794159940 0x7fc794155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:46658/0 (socket says 172.21.15.7:46658) 2023-10-14T19:04:46.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 -- 172.21.15.7:0/56835080 >> v2:172.21.15.148:3300/0 conn(0x7fc794155b70 msgr2=0x7fc7940b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 --2- 172.21.15.7:0/56835080 >> v2:172.21.15.148:3300/0 conn(0x7fc794155b70 0x7fc7940b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 -- 172.21.15.7:0/56835080 >> v1:172.21.15.148:6789/0 conn(0x7fc794159940 legacy=0x7fc794155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 -- 172.21.15.7:0/56835080 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940ae8b0 con 0x7fc7940add80 2023-10-14T19:04:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc79259c700 1 --2- 172.21.15.7:0/56835080 >> v2:172.21.15.148:3300/0 conn(0x7fc794155b70 0x7fc7940b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.062+0000 7fc791d9b700 1 --2- 172.21.15.7:0/56835080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 0x7fc7940b0740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0099b0 tx=0x7fc77c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7ff3131660518f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc79159a700 1 -- 172.21.15.7:0/56835080 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c009ea0 con 0x7fc7940add80 2023-10-14T19:04:46.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc79159a700 1 -- 172.21.15.7:0/56835080 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00b860 con 0x7fc7940add80 2023-10-14T19:04:46.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc79159a700 1 -- 172.21.15.7:0/56835080 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00bc00 con 0x7fc7940add80 2023-10-14T19:04:46.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 -- 172.21.15.7:0/56835080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 msgr2=0x7fc7940b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 --2- 172.21.15.7:0/56835080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 0x7fc7940b0740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0099b0 tx=0x7fc77c009250 comp rx=0 tx=0).stop 2023-10-14T19:04:46.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 -- 172.21.15.7:0/56835080 shutdown_connections 2023-10-14T19:04:46.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 --2- 172.21.15.7:0/56835080 >> v2:172.21.15.148:3300/0 conn(0x7fc794155b70 0x7fc7940b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 --2- 172.21.15.7:0/56835080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7940add80 0x7fc7940b0740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 -- 172.21.15.7:0/56835080 >> 172.21.15.7:0/56835080 conn(0x7fc79406d170 msgr2=0x7fc7940cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:46.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 -- 172.21.15.7:0/56835080 shutdown_connections 2023-10-14T19:04:46.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.063+0000 7fc798fe5700 1 -- 172.21.15.7:0/56835080 wait complete. 2023-10-14T19:04:46.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.064+0000 7fc798fe5700 1 Processor -- start 2023-10-14T19:04:46.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.064+0000 7fc798fe5700 1 -- start start 2023-10-14T19:04:46.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc798fe5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7940add80 0x7fc794147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc798fe5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc794155b70 0x7fc79414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc798fe5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 0x7fc79414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc798fe5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794150f70 con 0x7fc794159940 2023-10-14T19:04:46.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc798fe5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794151f20 con 0x7fc7940add80 2023-10-14T19:04:46.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc798fe5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc794150640 con 0x7fc794155b70 2023-10-14T19:04:46.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 0x7fc79414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 0x7fc79414bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49618/0 (socket says 172.21.15.7:49618) 2023-10-14T19:04:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc792d9d700 1 -- 172.21.15.7:0/910897810 learned_addr learned my addr 172.21.15.7:0/910897810 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.065+0000 7fc79259c700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7940add80 0x7fc794147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc791d9b700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc794155b70 0x7fc79414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc792d9d700 1 -- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc794155b70 msgr2=0x7fc79414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc792d9d700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc794155b70 0x7fc79414b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc792d9d700 1 -- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7940add80 msgr2=0x7fc794147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc792d9d700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7940add80 0x7fc794147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc792d9d700 1 -- 172.21.15.7:0/910897810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784009a20 con 0x7fc794159940 2023-10-14T19:04:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc791d9b700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc794155b70 0x7fc79414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc792d9d700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 0x7fc79414bdc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c790 tx=0x7fc78c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0062e0 con 0x7fc794159940 2023-10-14T19:04:46.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c006440 con 0x7fc794159940 2023-10-14T19:04:46.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c0094f0 con 0x7fc794159940 2023-10-14T19:04:46.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c004810 con 0x7fc794159940 2023-10-14T19:04:46.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.066+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc794150c00 con 0x7fc794159940 2023-10-14T19:04:46.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.067+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79404c3c0 con 0x7fc794159940 2023-10-14T19:04:46.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.067+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc78c004bc0 con 0x7fc794159940 2023-10-14T19:04:46.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.068+0000 7fc78a7fc700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc774066fc0 0x7fc774069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.068+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc78c083950 con 0x7fc794159940 2023-10-14T19:04:46.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.068+0000 7fc79259c700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc774066fc0 0x7fc774069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.068+0000 7fc79259c700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc774066fc0 0x7fc774069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7840099f0 tx=0x7fc78400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.072+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc78c04b5a0 con 0x7fc794159940 2023-10-14T19:04:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.265+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7941510b0 con 0x7fc794159940 2023-10-14T19:04:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.265+0000 7fc78a7fc700 1 -- 172.21.15.7:0/910897810 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc78c017090 con 0x7fc794159940 2023-10-14T19:04:46.267 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:46.267 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:32.781544+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:29.657115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:30.193005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc774066fc0 msgr2=0x7fc774069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc774066fc0 0x7fc774069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7840099f0 tx=0x7fc78400b040 comp rx=0 tx=0).stop 2023-10-14T19:04:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 msgr2=0x7fc79414bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 0x7fc79414bdc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c790 tx=0x7fc78c007f00 comp rx=0 tx=0).stop 2023-10-14T19:04:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 shutdown_connections 2023-10-14T19:04:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc774066fc0 0x7fc774069470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7940add80 0x7fc794147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc794159940 0x7fc79414bdc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 --2- 172.21.15.7:0/910897810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc794155b70 0x7fc79414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 >> 172.21.15.7:0/910897810 conn(0x7fc79406d170 msgr2=0x7fc794069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 shutdown_connections 2023-10-14T19:04:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.268+0000 7fc798fe5700 1 -- 172.21.15.7:0/910897810 wait complete. 2023-10-14T19:04:46.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:04:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.400+0000 7f813cb59700 1 Processor -- start 2023-10-14T19:04:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.400+0000 7f813cb59700 1 -- start start 2023-10-14T19:04:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f813cb59700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81380cb5a0 0x7f81380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f813cb59700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f81380cd9e0 0x7f8138159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f813cb59700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813815ae40 con 0x7f81380cde50 2023-10-14T19:04:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f813cb59700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380d13f0 con 0x7f81380cd9e0 2023-10-14T19:04:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f813cb59700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813815ab60 con 0x7f81380cb5a0 2023-10-14T19:04:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f813659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81380cb5a0 0x7f81380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f8135d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f81380cd9e0 0x7f8138159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.401+0000 7f8136d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f81380cde50 0x7f8138156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:46668/0 (socket says 172.21.15.7:46668) 2023-10-14T19:04:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f8136d9d700 1 -- 172.21.15.7:0/2011271341 learned_addr learned my addr 172.21.15.7:0/2011271341 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813659c700 1 -- 172.21.15.7:0/2011271341 >> v2:172.21.15.148:3300/0 conn(0x7f81380cd9e0 msgr2=0x7f8138159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813659c700 1 --2- 172.21.15.7:0/2011271341 >> v2:172.21.15.148:3300/0 conn(0x7f81380cd9e0 0x7f8138159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813659c700 1 -- 172.21.15.7:0/2011271341 >> v1:172.21.15.148:6789/0 conn(0x7f81380cde50 legacy=0x7f8138156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813659c700 1 -- 172.21.15.7:0/2011271341 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380ccf00 con 0x7f81380cb5a0 2023-10-14T19:04:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813559a700 1 -- 172.21.15.7:0/2011271341 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422646377 0 0) 0x7f813815ae40 con 0x7f81380cde50 2023-10-14T19:04:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f8135d9b700 1 --2- 172.21.15.7:0/2011271341 >> v2:172.21.15.148:3300/0 conn(0x7f81380cd9e0 0x7f8138159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:04:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813659c700 1 --2- 172.21.15.7:0/2011271341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81380cb5a0 0x7f81380cb970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81280098e0 tx=0x7f81280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9850111e7fe9f618 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813559a700 1 -- 172.21.15.7:0/2011271341 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800b640 con 0x7f81380cb5a0 2023-10-14T19:04:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813559a700 1 -- 172.21.15.7:0/2011271341 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800b7a0 con 0x7f81380cb5a0 2023-10-14T19:04:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.402+0000 7f813559a700 1 -- 172.21.15.7:0/2011271341 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800bb40 con 0x7f81380cb5a0 2023-10-14T19:04:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 -- 172.21.15.7:0/2011271341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81380cb5a0 msgr2=0x7f81380cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 --2- 172.21.15.7:0/2011271341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81380cb5a0 0x7f81380cb970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81280098e0 tx=0x7f81280091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 -- 172.21.15.7:0/2011271341 shutdown_connections 2023-10-14T19:04:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 --2- 172.21.15.7:0/2011271341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81380cb5a0 0x7f81380cb970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 --2- 172.21.15.7:0/2011271341 >> v2:172.21.15.148:3300/0 conn(0x7f81380cd9e0 0x7f8138159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 -- 172.21.15.7:0/2011271341 >> 172.21.15.7:0/2011271341 conn(0x7f8138070e30 msgr2=0x7f81380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 -- 172.21.15.7:0/2011271341 shutdown_connections 2023-10-14T19:04:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.403+0000 7f813cb59700 1 -- 172.21.15.7:0/2011271341 wait complete. 2023-10-14T19:04:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.404+0000 7f813cb59700 1 Processor -- start 2023-10-14T19:04:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.404+0000 7f813cb59700 1 -- start start 2023-10-14T19:04:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813cb59700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81380cb5a0 0x7f8138149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813cb59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 0x7f813816ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813cb59700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f813816cf90 0x7f813816d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813cb59700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813816d930 con 0x7f81380cd9e0 2023-10-14T19:04:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813cb59700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380c8190 con 0x7f81380cb5a0 2023-10-14T19:04:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813cb59700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81380b4690 con 0x7f813816cf90 2023-10-14T19:04:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 0x7f813816ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 0x7f813816ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49628/0 (socket says 172.21.15.7:49628) 2023-10-14T19:04:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 -- 172.21.15.7:0/3376053967 learned_addr learned my addr 172.21.15.7:0/3376053967 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813659c700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81380cb5a0 0x7f8138149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8136d9d700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f813816cf90 0x7f813816d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 -- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f813816cf90 msgr2=0x7f813816d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f813816cf90 0x7f813816d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 -- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81380cb5a0 msgr2=0x7f8138149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81380cb5a0 0x7f8138149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 -- 172.21.15.7:0/3376053967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009420 con 0x7f81380cd9e0 2023-10-14T19:04:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f813659c700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81380cb5a0 0x7f8138149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.405+0000 7f8135d9b700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 0x7f813816ca50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f812000ec80 tx=0x7f81200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.406+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000c9d0 con 0x7f81380cd9e0 2023-10-14T19:04:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.406+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000cb30 con 0x7f81380cd9e0 2023-10-14T19:04:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.406+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8128009420 con 0x7f81380cd9e0 2023-10-14T19:04:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.406+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000ceb0 con 0x7f81380cd9e0 2023-10-14T19:04:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.406+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81380c7b40 con 0x7f81380cd9e0 2023-10-14T19:04:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.407+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81380c8320 con 0x7f81380cd9e0 2023-10-14T19:04:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.407+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8120013680 con 0x7f81380cd9e0 2023-10-14T19:04:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.407+0000 7f812e7fc700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8118066fc0 0x7f8118069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.408+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81200849a0 con 0x7f81380cd9e0 2023-10-14T19:04:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.408+0000 7f813659c700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8118066fc0 0x7f8118069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.408+0000 7f813659c700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8118066fc0 0x7f8118069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f81280093f0 tx=0x7f8128017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.412+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8120051c20 con 0x7f81380cd9e0 2023-10-14T19:04:46.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.649+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f813804c3c0 con 0x7f81380cd9e0 2023-10-14T19:04:46.650 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:04:46.649+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:04:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.652+0000 7f812e7fc700 1 -- 172.21.15.7:0/3376053967 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8120055240 con 0x7f81380cd9e0 2023-10-14T19:04:46.655 INFO:tasks.ceph.mds.a.smithi007.stderr: -1764> 2023-10-14T19:04:37.160+0000 7f58391df700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:04:46.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8118066fc0 msgr2=0x7f8118069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8118066fc0 0x7f8118069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f81280093f0 tx=0x7f8128017000 comp rx=0 tx=0).stop 2023-10-14T19:04:46.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 msgr2=0x7f813816ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 0x7f813816ca50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f812000ec80 tx=0x7f81200091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 shutdown_connections 2023-10-14T19:04:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8118066fc0 0x7f8118069470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81380cb5a0 0x7f8138149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f813816cf90 0x7f813816d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 --2- 172.21.15.7:0/3376053967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81380cd9e0 0x7f813816ca50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 >> 172.21.15.7:0/3376053967 conn(0x7f8138070e30 msgr2=0x7f81380ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 shutdown_connections 2023-10-14T19:04:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.655+0000 7f813cb59700 1 -- 172.21.15.7:0/3376053967 wait complete. 2023-10-14T19:04:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:04:46.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:04:46.677 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:04:46.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.789+0000 7f6ca85bb700 1 Processor -- start 2023-10-14T19:04:46.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.789+0000 7f6ca85bb700 1 -- start start 2023-10-14T19:04:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca85bb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ca006dc70 0x7f6ca0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca85bb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00ccfd0 con 0x7f6ca006e0e0 2023-10-14T19:04:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca85bb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca015a3d0 con 0x7f6ca0159530 2023-10-14T19:04:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca85bb700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca015a6b0 con 0x7f6ca006dc70 2023-10-14T19:04:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca5b56700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ca006dc70 0x7f6ca0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca5b56700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ca006dc70 0x7f6ca0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35382/0 (socket says 172.21.15.7:35382) 2023-10-14T19:04:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca5b56700 1 -- 172.21.15.7:0/2206462422 learned_addr learned my addr 172.21.15.7:0/2206462422 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.790+0000 7f6ca6b58700 1 --1- 172.21.15.7:0/2206462422 >> v1:172.21.15.7:6789/0 conn(0x7f6ca006e0e0 0x7f6ca00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53224/0 (socket says 172.21.15.7:53224) 2023-10-14T19:04:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5b56700 1 -- 172.21.15.7:0/2206462422 >> v1:172.21.15.148:6789/0 conn(0x7f6ca0159530 legacy=0x7f6ca00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5b56700 1 -- 172.21.15.7:0/2206462422 >> v1:172.21.15.7:6789/0 conn(0x7f6ca006e0e0 legacy=0x7f6ca00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5b56700 1 -- 172.21.15.7:0/2206462422 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca015a990 con 0x7f6ca006dc70 2023-10-14T19:04:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5355700 1 -- 172.21.15.7:0/2206462422 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627044184 0 0) 0x7f6ca00ccfd0 con 0x7f6ca006e0e0 2023-10-14T19:04:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5b56700 1 --2- 172.21.15.7:0/2206462422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca006dc70 0x7f6ca0159900 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6c940099b0 tx=0x7f6c94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfe16109cbe78e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5355700 1 -- 172.21.15.7:0/2206462422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400b860 con 0x7f6ca006dc70 2023-10-14T19:04:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5355700 1 -- 172.21.15.7:0/2206462422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9400b9c0 con 0x7f6ca006dc70 2023-10-14T19:04:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca5355700 1 -- 172.21.15.7:0/2206462422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400bd60 con 0x7f6ca006dc70 2023-10-14T19:04:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca85bb700 1 -- 172.21.15.7:0/2206462422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca006dc70 msgr2=0x7f6ca0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.791+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/2206462422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca006dc70 0x7f6ca0159900 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6c940099b0 tx=0x7f6c94009250 comp rx=0 tx=0).stop 2023-10-14T19:04:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.792+0000 7f6ca85bb700 1 -- 172.21.15.7:0/2206462422 shutdown_connections 2023-10-14T19:04:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.792+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/2206462422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca006dc70 0x7f6ca0159900 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.792+0000 7f6ca85bb700 1 -- 172.21.15.7:0/2206462422 >> 172.21.15.7:0/2206462422 conn(0x7f6ca00703a0 msgr2=0x7f6ca00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.792+0000 7f6ca85bb700 1 -- 172.21.15.7:0/2206462422 shutdown_connections 2023-10-14T19:04:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.792+0000 7f6ca85bb700 1 -- 172.21.15.7:0/2206462422 wait complete. 2023-10-14T19:04:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 Processor -- start 2023-10-14T19:04:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 -- start start 2023-10-14T19:04:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ca006dc70 0x7f6ca00b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ca006e0e0 0x7f6ca00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 0x7f6ca00b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca014ba80 con 0x7f6ca0159530 2023-10-14T19:04:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00b6240 con 0x7f6ca006dc70 2023-10-14T19:04:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.793+0000 7f6ca85bb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00b2d00 con 0x7f6ca006e0e0 2023-10-14T19:04:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 0x7f6ca00b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 0x7f6ca00b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35386/0 (socket says 172.21.15.7:35386) 2023-10-14T19:04:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 -- 172.21.15.7:0/1665014353 learned_addr learned my addr 172.21.15.7:0/1665014353 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6357700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ca006dc70 0x7f6ca00b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca5b56700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ca006e0e0 0x7f6ca00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 -- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ca006e0e0 msgr2=0x7f6ca00b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ca006e0e0 0x7f6ca00b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 -- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ca006dc70 msgr2=0x7f6ca00b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ca006dc70 0x7f6ca00b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 -- 172.21.15.7:0/1665014353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940094f0 con 0x7f6ca0159530 2023-10-14T19:04:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca6b58700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 0x7f6ca00b39c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800ccc0 tx=0x7f6c98001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98005df0 con 0x7f6ca0159530 2023-10-14T19:04:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9800a670 con 0x7f6ca0159530 2023-10-14T19:04:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800aa30 con 0x7f6ca0159530 2023-10-14T19:04:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca00b1c10 con 0x7f6ca0159530 2023-10-14T19:04:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.794+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca00b21d0 con 0x7f6ca0159530 2023-10-14T19:04:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.795+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca004c3c0 con 0x7f6ca0159530 2023-10-14T19:04:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.796+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6c980070f0 con 0x7f6ca0159530 2023-10-14T19:04:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.796+0000 7f6c9e7fc700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c8c066fc0 0x7f6c8c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.796+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6c98084550 con 0x7f6ca0159530 2023-10-14T19:04:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.796+0000 7f6ca6357700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c8c066fc0 0x7f6c8c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.797+0000 7f6ca6357700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c8c066fc0 0x7f6c8c069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c90003a80 tx=0x7f6c90007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:46.800+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c98051800 con 0x7f6ca0159530 2023-10-14T19:04:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.042+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ca015ac70 con 0x7f6ca0159530 2023-10-14T19:04:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.654+0000 7f6c9e7fc700 1 -- 172.21.15.7:0/1665014353 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c98054e20 con 0x7f6ca0159530 2023-10-14T19:04:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c8c066fc0 msgr2=0x7f6c8c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c8c066fc0 0x7f6c8c069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c90003a80 tx=0x7f6c90007ec0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 msgr2=0x7f6ca00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 0x7f6ca00b39c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800ccc0 tx=0x7f6c98001a20 comp rx=0 tx=0).stop 2023-10-14T19:04:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 shutdown_connections 2023-10-14T19:04:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6c8c066fc0 0x7f6c8c069470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ca006dc70 0x7f6ca00b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca0159530 0x7f6ca00b39c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 --2- 172.21.15.7:0/1665014353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ca006e0e0 0x7f6ca00b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 >> 172.21.15.7:0/1665014353 conn(0x7f6ca00703a0 msgr2=0x7f6ca00c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 shutdown_connections 2023-10-14T19:04:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.657+0000 7f6ca85bb700 1 -- 172.21.15.7:0/1665014353 wait complete. 2023-10-14T19:04:47.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:04:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.842+0000 7fe84ab39700 1 Processor -- start 2023-10-14T19:04:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe84ab39700 1 -- start start 2023-10-14T19:04:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe84ab39700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8441599d0 0x7fe8441643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe84ab39700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440aa370 con 0x7fe8440cb030 2023-10-14T19:04:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe84ab39700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440a9a80 con 0x7fe844159600 2023-10-14T19:04:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe84ab39700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84406dd70 con 0x7fe8441599d0 2023-10-14T19:04:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe843fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe8440cb030 0x7fe84406d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53238/0 (socket says 172.21.15.7:53238) 2023-10-14T19:04:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.843+0000 7fe843fff700 1 -- 172.21.15.7:0/2276687714 learned_addr learned my addr 172.21.15.7:0/2276687714 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8490d6700 1 --2- 172.21.15.7:0/2276687714 >> v2:172.21.15.148:3300/0 conn(0x7fe8441599d0 0x7fe8441643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8437fe700 1 -- 172.21.15.7:0/2276687714 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458219654 0 0) 0x7fe8440aa370 con 0x7fe8440cb030 2023-10-14T19:04:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8437fe700 1 -- 172.21.15.7:0/2276687714 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe834003570 con 0x7fe8440cb030 2023-10-14T19:04:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8490d6700 1 -- 172.21.15.7:0/2276687714 >> v1:172.21.15.148:6789/0 conn(0x7fe844159600 legacy=0x7fe8440ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8490d6700 1 -- 172.21.15.7:0/2276687714 >> v1:172.21.15.7:6789/0 conn(0x7fe8440cb030 legacy=0x7fe84406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8437fe700 1 -- 172.21.15.7:0/2276687714 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815656490 0 0) 0x7fe834003570 con 0x7fe8440cb030 2023-10-14T19:04:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8490d6700 1 -- 172.21.15.7:0/2276687714 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440a9d20 con 0x7fe8441599d0 2023-10-14T19:04:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8490d6700 1 --2- 172.21.15.7:0/2276687714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8441599d0 0x7fe8441643b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d5d580741287b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8437fe700 1 -- 172.21.15.7:0/2276687714 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00e070 con 0x7fe8441599d0 2023-10-14T19:04:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8437fe700 1 -- 172.21.15.7:0/2276687714 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00b850 con 0x7fe8441599d0 2023-10-14T19:04:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.844+0000 7fe8437fe700 1 -- 172.21.15.7:0/2276687714 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830001470 con 0x7fe8441599d0 2023-10-14T19:04:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 -- 172.21.15.7:0/2276687714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8441599d0 msgr2=0x7fe8441643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 --2- 172.21.15.7:0/2276687714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8441599d0 0x7fe8441643b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).stop 2023-10-14T19:04:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 -- 172.21.15.7:0/2276687714 shutdown_connections 2023-10-14T19:04:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 --2- 172.21.15.7:0/2276687714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8441599d0 0x7fe8441643b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 -- 172.21.15.7:0/2276687714 >> 172.21.15.7:0/2276687714 conn(0x7fe84406edb0 msgr2=0x7fe84406f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 -- 172.21.15.7:0/2276687714 shutdown_connections 2023-10-14T19:04:47.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.845+0000 7fe84ab39700 1 -- 172.21.15.7:0/2276687714 wait complete. 2023-10-14T19:04:47.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.846+0000 7fe84ab39700 1 Processor -- start 2023-10-14T19:04:47.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.846+0000 7fe84ab39700 1 -- start start 2023-10-14T19:04:47.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe84ab39700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8440cb030 0x7fe844157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:47.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe84ab39700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 0x7fe8440b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:47.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe84ab39700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8441599d0 0x7fe844155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:47.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe84ab39700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84415e620 con 0x7fe844159600 2023-10-14T19:04:47.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe84ab39700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440b0950 con 0x7fe8440cb030 2023-10-14T19:04:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe84ab39700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440b0bd0 con 0x7fe8441599d0 2023-10-14T19:04:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 0x7fe8440b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 0x7fe8440b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35400/0 (socket says 172.21.15.7:35400) 2023-10-14T19:04:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 -- 172.21.15.7:0/4246793254 learned_addr learned my addr 172.21.15.7:0/4246793254 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe8488d5700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8440cb030 0x7fe844157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe8490d6700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8441599d0 0x7fe844155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 -- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8441599d0 msgr2=0x7fe844155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8441599d0 0x7fe844155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 -- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8440cb030 msgr2=0x7fe844157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.847+0000 7fe843fff700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8440cb030 0x7fe844157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe843fff700 1 -- 172.21.15.7:0/4246793254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009a20 con 0x7fe844159600 2023-10-14T19:04:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe843fff700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 0x7fe8440b0410 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe83000cbc0 tx=0x7fe830001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830007360 con 0x7fe844159600 2023-10-14T19:04:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8300074c0 con 0x7fe844159600 2023-10-14T19:04:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8440b0eb0 con 0x7fe844159600 2023-10-14T19:04:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830004830 con 0x7fe844159600 2023-10-14T19:04:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.848+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84415e870 con 0x7fe844159600 2023-10-14T19:04:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.849+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84415ea90 con 0x7fe844159600 2023-10-14T19:04:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.849+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe830004c20 con 0x7fe844159600 2023-10-14T19:04:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.850+0000 7fe840ff9700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe828066fc0 0x7fe828069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.850+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe830083d50 con 0x7fe844159600 2023-10-14T19:04:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.850+0000 7fe8488d5700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe828066fc0 0x7fe828069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.850+0000 7fe8488d5700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe828066fc0 0x7fe828069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe838003860 tx=0x7fe838009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:47.854+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe83004c5a0 con 0x7fe844159600 2023-10-14T19:04:48.032 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:04:48.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:04:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.046+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe84404c3c0 con 0x7fe844159600 2023-10-14T19:04:48.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.892+0000 7fe840ff9700 1 -- 172.21.15.7:0/4246793254 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe8300510b0 con 0x7fe844159600 2023-10-14T19:04:48.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe828066fc0 msgr2=0x7fe828069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe828066fc0 0x7fe828069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe838003860 tx=0x7fe838009040 comp rx=0 tx=0).stop 2023-10-14T19:04:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 msgr2=0x7fe8440b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 0x7fe8440b0410 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe83000cbc0 tx=0x7fe830001a80 comp rx=0 tx=0).stop 2023-10-14T19:04:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 shutdown_connections 2023-10-14T19:04:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe828066fc0 0x7fe828069470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8440cb030 0x7fe844157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8441599d0 0x7fe844155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 --2- 172.21.15.7:0/4246793254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe844159600 0x7fe8440b0410 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 >> 172.21.15.7:0/4246793254 conn(0x7fe84406edb0 msgr2=0x7fe84406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 shutdown_connections 2023-10-14T19:04:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:48.894+0000 7fe84ab39700 1 -- 172.21.15.7:0/4246793254 wait complete. 2023-10-14T19:04:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:04:48.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:04:49.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.042+0000 7fe98e26b700 1 Processor -- start 2023-10-14T19:04:49.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.042+0000 7fe98e26b700 1 -- start start 2023-10-14T19:04:49.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98e26b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe988159600 0x7fe9880ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98e26b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9881599d0 0x7fe9880cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98e26b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe98806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98e26b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98806dd70 con 0x7fe9881599d0 2023-10-14T19:04:49.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98e26b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880aa370 con 0x7fe988159600 2023-10-14T19:04:49.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98e26b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880a9a80 con 0x7fe98806d0b0 2023-10-14T19:04:49.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9881599d0 0x7fe9880cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9881599d0 0x7fe9880cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35402/0 (socket says 172.21.15.7:35402) 2023-10-14T19:04:49.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 -- 172.21.15.7:0/440979625 learned_addr learned my addr 172.21.15.7:0/440979625 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:49.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98c808700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe98806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe987fff700 1 --2- 172.21.15.7:0/440979625 >> v2:172.21.15.148:3300/0 conn(0x7fe988159600 0x7fe9880ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 -- 172.21.15.7:0/440979625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 msgr2=0x7fe98806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:49.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe98806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 -- 172.21.15.7:0/440979625 >> v2:172.21.15.148:3300/0 conn(0x7fe988159600 msgr2=0x7fe9880ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:49.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 --2- 172.21.15.7:0/440979625 >> v2:172.21.15.148:3300/0 conn(0x7fe988159600 0x7fe9880ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 -- 172.21.15.7:0/440979625 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880a9d20 con 0x7fe9881599d0 2023-10-14T19:04:49.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe987fff700 1 --2- 172.21.15.7:0/440979625 >> v2:172.21.15.148:3300/0 conn(0x7fe988159600 0x7fe9880ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:49.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe98c808700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe98806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:49.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.043+0000 7fe9877fe700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9881599d0 0x7fe9880cae60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe9880cdc30 tx=0x7fe970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778ae9f6a3e2c944 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:49.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe986ffd700 1 -- 172.21.15.7:0/440979625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97000b860 con 0x7fe9881599d0 2023-10-14T19:04:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe986ffd700 1 -- 172.21.15.7:0/440979625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97000b9c0 con 0x7fe9881599d0 2023-10-14T19:04:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe986ffd700 1 -- 172.21.15.7:0/440979625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97000bd60 con 0x7fe9881599d0 2023-10-14T19:04:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 -- 172.21.15.7:0/440979625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9881599d0 msgr2=0x7fe9880cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9881599d0 0x7fe9880cae60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe9880cdc30 tx=0x7fe970009250 comp rx=0 tx=0).stop 2023-10-14T19:04:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 -- 172.21.15.7:0/440979625 shutdown_connections 2023-10-14T19:04:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe98806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 --2- 172.21.15.7:0/440979625 >> v2:172.21.15.148:3300/0 conn(0x7fe988159600 0x7fe9880ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 --2- 172.21.15.7:0/440979625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9881599d0 0x7fe9880cae60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 -- 172.21.15.7:0/440979625 >> 172.21.15.7:0/440979625 conn(0x7fe98806edb0 msgr2=0x7fe98806f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 -- 172.21.15.7:0/440979625 shutdown_connections 2023-10-14T19:04:49.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.044+0000 7fe98e26b700 1 -- 172.21.15.7:0/440979625 wait complete. 2023-10-14T19:04:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.045+0000 7fe98e26b700 1 Processor -- start 2023-10-14T19:04:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 -- start start 2023-10-14T19:04:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe9880b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 0x7fe9880c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9881599d0 0x7fe988151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880c8f50 con 0x7fe988159600 2023-10-14T19:04:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880c8580 con 0x7fe9881599d0 2023-10-14T19:04:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98e26b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe988151c70 con 0x7fe98806d0b0 2023-10-14T19:04:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe9877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 0x7fe9880c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe9877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 0x7fe9880c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35418/0 (socket says 172.21.15.7:35418) 2023-10-14T19:04:49.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe9877fe700 1 -- 172.21.15.7:0/1876824717 learned_addr learned my addr 172.21.15.7:0/1876824717 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:49.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe987fff700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe9880b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.046+0000 7fe98c808700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9881599d0 0x7fe988151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe9877fe700 1 -- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 msgr2=0x7fe9880b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:49.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe9877fe700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe9880b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe9877fe700 1 -- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9881599d0 msgr2=0x7fe988151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:49.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe9877fe700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9881599d0 0x7fe988151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe9877fe700 1 -- 172.21.15.7:0/1876824717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700094f0 con 0x7fe988159600 2023-10-14T19:04:49.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe98c808700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9881599d0 0x7fe988151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:49.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe9877fe700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 0x7fe9880c8a10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe988069ec0 tx=0x7fe970017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:49.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970024440 con 0x7fe988159600 2023-10-14T19:04:49.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9700245e0 con 0x7fe988159600 2023-10-14T19:04:49.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9880c7970 con 0x7fe988159600 2023-10-14T19:04:49.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9700249a0 con 0x7fe988159600 2023-10-14T19:04:49.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.047+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880c7f30 con 0x7fe988159600 2023-10-14T19:04:49.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.048+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98804c3c0 con 0x7fe988159600 2023-10-14T19:04:49.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.048+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe97001a420 con 0x7fe988159600 2023-10-14T19:04:49.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.049+0000 7fe97ffff700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe968066fc0 0x7fe968069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:49.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.049+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe9700860d0 con 0x7fe988159600 2023-10-14T19:04:49.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.049+0000 7fe987fff700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe968066fc0 0x7fe968069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:49.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.050+0000 7fe987fff700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe968066fc0 0x7fe968069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe978006fd0 tx=0x7fe978008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:49.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.053+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9700534b0 con 0x7fe988159600 2023-10-14T19:04:49.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.246+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9880c86c0 con 0x7fe988159600 2023-10-14T19:04:49.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.898+0000 7fe97ffff700 1 -- 172.21.15.7:0/1876824717 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe970056ad0 con 0x7fe988159600 2023-10-14T19:04:49.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe968066fc0 msgr2=0x7fe968069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe968066fc0 0x7fe968069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe978006fd0 tx=0x7fe978008040 comp rx=0 tx=0).stop 2023-10-14T19:04:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 msgr2=0x7fe9880c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 0x7fe9880c8a10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe988069ec0 tx=0x7fe970017000 comp rx=0 tx=0).stop 2023-10-14T19:04:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 shutdown_connections 2023-10-14T19:04:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe968066fc0 0x7fe968069470 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe978006fd0 tx=0x7fe978008040 comp rx=0 tx=0).stop 2023-10-14T19:04:49.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9881599d0 0x7fe988151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe98806d0b0 0x7fe9880b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 --2- 172.21.15.7:0/1876824717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe988159600 0x7fe9880c8a10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:49.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 >> 172.21.15.7:0/1876824717 conn(0x7fe98806edb0 msgr2=0x7fe9880aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:49.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.902+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 shutdown_connections 2023-10-14T19:04:49.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:49.903+0000 7fe98e26b700 1 -- 172.21.15.7:0/1876824717 wait complete. 2023-10-14T19:04:49.906 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:04:49.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:04:50.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.043+0000 7f577773b700 1 Processor -- start 2023-10-14T19:04:50.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.044+0000 7f577773b700 1 -- start start 2023-10-14T19:04:50.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f577773b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f577006dc70 0x7f5770159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f577773b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700ccfd0 con 0x7f5770159530 2023-10-14T19:04:50.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f577773b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577015a3d0 con 0x7f577006e0e0 2023-10-14T19:04:50.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f577773b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577015a6b0 con 0x7f577006dc70 2023-10-14T19:04:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f577006dc70 0x7f5770159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f577006dc70 0x7f5770159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35424/0 (socket says 172.21.15.7:35424) 2023-10-14T19:04:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 -- 172.21.15.7:0/882003040 learned_addr learned my addr 172.21.15.7:0/882003040 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f57754d7700 1 --1- 172.21.15.7:0/882003040 >> v1:172.21.15.7:6789/0 conn(0x7f5770159530 0x7f57700ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53240/0 (socket says 172.21.15.7:53240) 2023-10-14T19:04:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 -- 172.21.15.7:0/882003040 >> v1:172.21.15.148:6789/0 conn(0x7f577006e0e0 legacy=0x7f57700cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 -- 172.21.15.7:0/882003040 >> v1:172.21.15.7:6789/0 conn(0x7f5770159530 legacy=0x7f57700ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 -- 172.21.15.7:0/882003040 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577015a990 con 0x7f577006dc70 2023-10-14T19:04:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f576ffff700 1 -- 172.21.15.7:0/882003040 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473948051 0 0) 0x7f57700ccfd0 con 0x7f5770159530 2023-10-14T19:04:50.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f5774cd6700 1 --2- 172.21.15.7:0/882003040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006dc70 0x7f5770159900 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57640099b0 tx=0x7f5764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d746df557ee3265 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:50.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f576ffff700 1 -- 172.21.15.7:0/882003040 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400b860 con 0x7f577006dc70 2023-10-14T19:04:50.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f576ffff700 1 -- 172.21.15.7:0/882003040 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400b9c0 con 0x7f577006dc70 2023-10-14T19:04:50.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.045+0000 7f576ffff700 1 -- 172.21.15.7:0/882003040 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400bd60 con 0x7f577006dc70 2023-10-14T19:04:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 -- 172.21.15.7:0/882003040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006dc70 msgr2=0x7f5770159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 --2- 172.21.15.7:0/882003040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006dc70 0x7f5770159900 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57640099b0 tx=0x7f5764009250 comp rx=0 tx=0).stop 2023-10-14T19:04:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 -- 172.21.15.7:0/882003040 shutdown_connections 2023-10-14T19:04:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 --2- 172.21.15.7:0/882003040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006dc70 0x7f5770159900 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 -- 172.21.15.7:0/882003040 >> 172.21.15.7:0/882003040 conn(0x7f57700703a0 msgr2=0x7f57700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:50.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 -- 172.21.15.7:0/882003040 shutdown_connections 2023-10-14T19:04:50.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.046+0000 7f577773b700 1 -- 172.21.15.7:0/882003040 wait complete. 2023-10-14T19:04:50.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.047+0000 7f577773b700 1 Processor -- start 2023-10-14T19:04:50.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.047+0000 7f577773b700 1 -- start start 2023-10-14T19:04:50.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f577773b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f577006dc70 0x7f57700b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f577773b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 0x7f57700b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f577773b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5770159530 0x7f57700b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f577773b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b5a50 con 0x7f577006e0e0 2023-10-14T19:04:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f577773b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700c9350 con 0x7f577006dc70 2023-10-14T19:04:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f577773b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b5700 con 0x7f5770159530 2023-10-14T19:04:50.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 0x7f57700b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 0x7f57700b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35434/0 (socket says 172.21.15.7:35434) 2023-10-14T19:04:50.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 -- 172.21.15.7:0/3516986095 learned_addr learned my addr 172.21.15.7:0/3516986095 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f57754d7700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f577006dc70 0x7f57700b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5775cd8700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5770159530 0x7f57700b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 -- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5770159530 msgr2=0x7f57700b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5770159530 0x7f57700b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 -- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f577006dc70 msgr2=0x7f57700b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f577006dc70 0x7f57700b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.048+0000 7f5774cd6700 1 -- 172.21.15.7:0/3516986095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640094f0 con 0x7f577006e0e0 2023-10-14T19:04:50.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.049+0000 7f5774cd6700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 0x7f57700b3480 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5764006f50 tx=0x7f5764017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:50.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.049+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576401f070 con 0x7f577006e0e0 2023-10-14T19:04:50.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.049+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764011bb0 con 0x7f577006e0e0 2023-10-14T19:04:50.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.049+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57700b6420 con 0x7f577006e0e0 2023-10-14T19:04:50.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.049+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764025420 con 0x7f577006e0e0 2023-10-14T19:04:50.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.049+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57700b4100 con 0x7f577006e0e0 2023-10-14T19:04:50.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.050+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57700b5bc0 con 0x7f577006e0e0 2023-10-14T19:04:50.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.050+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5764023070 con 0x7f577006e0e0 2023-10-14T19:04:50.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.050+0000 7f576d7fa700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f575c066fc0 0x7f575c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.051+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5764085730 con 0x7f577006e0e0 2023-10-14T19:04:50.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.051+0000 7f57754d7700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f575c066fc0 0x7f575c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.051+0000 7f57754d7700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f575c066fc0 0x7f575c069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5760001560 tx=0x7f5760001ae0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:50.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.055+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5764052bb0 con 0x7f577006e0e0 2023-10-14T19:04:50.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.249+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f57700b42f0 con 0x7f577006e0e0 2023-10-14T19:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.252+0000 7f576d7fa700 1 -- 172.21.15.7:0/3516986095 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f57640561d0 con 0x7f577006e0e0 2023-10-14T19:04:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f575c066fc0 msgr2=0x7f575c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f575c066fc0 0x7f575c069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5760001560 tx=0x7f5760001ae0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 msgr2=0x7f57700b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 0x7f57700b3480 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5764006f50 tx=0x7f5764017000 comp rx=0 tx=0).stop 2023-10-14T19:04:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 shutdown_connections 2023-10-14T19:04:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f575c066fc0 0x7f575c069470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f577006dc70 0x7f57700b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5770159530 0x7f57700b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 --2- 172.21.15.7:0/3516986095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f577006e0e0 0x7f57700b3480 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 >> 172.21.15.7:0/3516986095 conn(0x7f57700703a0 msgr2=0x7f577015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 shutdown_connections 2023-10-14T19:04:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.254+0000 7f577773b700 1 -- 172.21.15.7:0/3516986095 wait complete. 2023-10-14T19:04:50.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-14T19:04:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.385+0000 7f8aac731700 1 Processor -- start 2023-10-14T19:04:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.385+0000 7f8aac731700 1 -- start start 2023-10-14T19:04:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.386+0000 7f8aac731700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8aa415c210 0x7f8aa41536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.386+0000 7f8aac731700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa415ad50 con 0x7f8aa415cb50 2023-10-14T19:04:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.386+0000 7f8aac731700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa415a140 con 0x7f8aa415cf20 2023-10-14T19:04:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.386+0000 7f8aac731700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa415a420 con 0x7f8aa415c210 2023-10-14T19:04:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.386+0000 7f8aaa4cd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8aa415cb50 0x7f8aa40b01d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53250/0 (socket says 172.21.15.7:53250) 2023-10-14T19:04:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.386+0000 7f8aaa4cd700 1 -- 172.21.15.7:0/3049929227 learned_addr learned my addr 172.21.15.7:0/3049929227 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209685179 0 0) 0x7f8aa415ad50 con 0x7f8aa415cb50 2023-10-14T19:04:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a8c003570 con 0x7f8aa415cb50 2023-10-14T19:04:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aaacce700 1 --2- 172.21.15.7:0/3049929227 >> v2:172.21.15.148:3300/0 conn(0x7f8aa415c210 0x7f8aa41536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975643009 0 0) 0x7f8a8c003570 con 0x7f8aa415cb50 2023-10-14T19:04:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 >> v2:172.21.15.148:3300/0 conn(0x7f8aa415c210 msgr2=0x7f8aa41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 --2- 172.21.15.7:0/3049929227 >> v2:172.21.15.148:3300/0 conn(0x7f8aa415c210 0x7f8aa41536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 >> v1:172.21.15.148:6789/0 conn(0x7f8aa415cf20 legacy=0x7f8aa40b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa415a700 con 0x7f8aa415cb50 2023-10-14T19:04:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8a9c001470 con 0x7f8aa415cb50 2023-10-14T19:04:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 >> v1:172.21.15.7:6789/0 conn(0x7f8aa415cb50 legacy=0x7f8aa40b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a8c003a60 0x7f8a8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a8c004810 0x7f8a8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8a8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa415a420 con 0x7f8a8c0052e0 2023-10-14T19:04:50.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c00c190 con 0x7f8a8c004810 2023-10-14T19:04:50.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c00c350 con 0x7f8a8c003a60 2023-10-14T19:04:50.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aaacce700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8a8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aaa4cd700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a8c003a60 0x7f8a8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.387+0000 7f8aa9ccc700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a8c004810 0x7f8a8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 -- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a8c003a60 msgr2=0x7f8a8c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:50.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a8c003a60 0x7f8a8c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 -- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a8c004810 msgr2=0x7f8a8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:50.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a8c004810 0x7f8a8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 -- 172.21.15.7:0/3049929227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c003570 con 0x7f8a8c0052e0 2023-10-14T19:04:50.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 -- 172.21.15.7:0/3049929227 reap_dead start 2023-10-14T19:04:50.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aaacce700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8a8c00ba60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8a94007440 tx=0x7f8a94009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc65b2ea800ddbc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:50.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94009a40 con 0x7f8a8c0052e0 2023-10-14T19:04:50.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94007cf0 con 0x7f8a8c0052e0 2023-10-14T19:04:50.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aa94cb700 1 -- 172.21.15.7:0/3049929227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94014650 con 0x7f8a8c0052e0 2023-10-14T19:04:50.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aac731700 1 -- 172.21.15.7:0/3049929227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 msgr2=0x7f8a8c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aac731700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8a8c00ba60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8a94007440 tx=0x7f8a94009710 comp rx=0 tx=0).stop 2023-10-14T19:04:50.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aac731700 1 -- 172.21.15.7:0/3049929227 shutdown_connections 2023-10-14T19:04:50.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aac731700 1 --2- 172.21.15.7:0/3049929227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8a8c00ba60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.388+0000 7f8aac731700 1 -- 172.21.15.7:0/3049929227 >> 172.21.15.7:0/3049929227 conn(0x7f8aa40cded0 msgr2=0x7f8aa406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:50.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.389+0000 7f8aac731700 1 -- 172.21.15.7:0/3049929227 shutdown_connections 2023-10-14T19:04:50.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.389+0000 7f8aac731700 1 -- 172.21.15.7:0/3049929227 wait complete. 2023-10-14T19:04:50.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 Processor -- start 2023-10-14T19:04:50.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 -- start start 2023-10-14T19:04:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8aa40acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa416d950 0x7f8aa4142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa40ad860 0x7f8aa40adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40ae210 con 0x7f8a8c0052e0 2023-10-14T19:04:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40a98e0 con 0x7f8aa416d950 2023-10-14T19:04:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.390+0000 7f8aac731700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa414f870 con 0x7f8aa40ad860 2023-10-14T19:04:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8aa40acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8aa40acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35458/0 (socket says 172.21.15.7:35458) 2023-10-14T19:04:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 -- 172.21.15.7:0/1563739594 learned_addr learned my addr 172.21.15.7:0/1563739594 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aa9ccc700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa416d950 0x7f8aa4142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaacce700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa40ad860 0x7f8aa40adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 -- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa40ad860 msgr2=0x7f8aa40adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa40ad860 0x7f8aa40adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 -- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa416d950 msgr2=0x7f8aa4142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa416d950 0x7f8aa4142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 -- 172.21.15.7:0/1563739594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40a9b30 con 0x7f8a8c0052e0 2023-10-14T19:04:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aaa4cd700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8aa40acd10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007370 tx=0x7f8a9c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c018030 con 0x7f8a8c0052e0 2023-10-14T19:04:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c007860 con 0x7f8a8c0052e0 2023-10-14T19:04:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa40a9e10 con 0x7f8a8c0052e0 2023-10-14T19:04:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00fb20 con 0x7f8a8c0052e0 2023-10-14T19:04:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.391+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa40aa3d0 con 0x7f8a8c0052e0 2023-10-14T19:04:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.392+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa416dd20 con 0x7f8a8c0052e0 2023-10-14T19:04:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.392+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8a9c01b070 con 0x7f8a8c0052e0 2023-10-14T19:04:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.393+0000 7f8aa27fc700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a90066fc0 0x7f8a90069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.393+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8a9c019070 con 0x7f8a8c0052e0 2023-10-14T19:04:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.393+0000 7f8aa9ccc700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a90066fc0 0x7f8a90069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.394+0000 7f8aa9ccc700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a90066fc0 0x7f8a90069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4159210 tx=0x7f8a98007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.397+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8aa416dd20 con 0x7f8a8c0052e0 2023-10-14T19:04:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.671+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f8aa416dd20 con 0x7f8a8c0052e0 2023-10-14T19:04:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.899+0000 7f8aa27fc700 1 -- 172.21.15.7:0/1563739594 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v113) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8aa416dd20 con 0x7f8a8c0052e0 2023-10-14T19:04:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a90066fc0 msgr2=0x7f8a90069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a90066fc0 0x7f8a90069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4159210 tx=0x7f8a98007d30 comp rx=0 tx=0).stop 2023-10-14T19:04:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 msgr2=0x7f8aa40acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8aa40acd10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007370 tx=0x7f8a9c001e50 comp rx=0 tx=0).stop 2023-10-14T19:04:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 shutdown_connections 2023-10-14T19:04:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8a90066fc0 0x7f8a90069470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa40ad860 0x7f8aa40adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a8c0052e0 0x7f8aa40acd10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 --2- 172.21.15.7:0/1563739594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa416d950 0x7f8aa4142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 >> 172.21.15.7:0/1563739594 conn(0x7f8aa40cded0 msgr2=0x7f8aa40b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 shutdown_connections 2023-10-14T19:04:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:50.901+0000 7f8aac731700 1 -- 172.21.15.7:0/1563739594 wait complete. 2023-10-14T19:04:50.914 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-10-14T19:04:50.915 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-10-14T19:04:50.916 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:04:50.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-14T19:04:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.035+0000 7f39bd546700 1 Processor -- start 2023-10-14T19:04:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.035+0000 7f39bd546700 1 -- start start 2023-10-14T19:04:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.036+0000 7f39bd546700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b80cb5a0 0x7f39b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.036+0000 7f39bd546700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f39b815a5d0 0x7f39b8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.036+0000 7f39bd546700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b815ae40 con 0x7f39b80cd9e0 2023-10-14T19:04:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.036+0000 7f39bd546700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80d13f0 con 0x7f39b80cb5a0 2023-10-14T19:04:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.036+0000 7f39bd546700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b815ab60 con 0x7f39b815a5d0 2023-10-14T19:04:51.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.037+0000 7f39b67fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f39b80cd9e0 0x7f39b8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53256/0 (socket says 172.21.15.7:53256) 2023-10-14T19:04:51.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.037+0000 7f39b67fc700 1 -- 172.21.15.7:0/2627080473 learned_addr learned my addr 172.21.15.7:0/2627080473 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:51.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b77fe700 1 --2- 172.21.15.7:0/2627080473 >> v2:172.21.15.148:3300/0 conn(0x7f39b815a5d0 0x7f39b8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b5ffb700 1 -- 172.21.15.7:0/2627080473 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339119703 0 0) 0x7f39b815ae40 con 0x7f39b80cd9e0 2023-10-14T19:04:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b5ffb700 1 -- 172.21.15.7:0/2627080473 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a0003570 con 0x7f39b80cd9e0 2023-10-14T19:04:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b77fe700 1 -- 172.21.15.7:0/2627080473 >> v2:172.21.15.7:3300/0 conn(0x7f39b80cb5a0 msgr2=0x7f39b80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b77fe700 1 --2- 172.21.15.7:0/2627080473 >> v2:172.21.15.7:3300/0 conn(0x7f39b80cb5a0 0x7f39b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b77fe700 1 -- 172.21.15.7:0/2627080473 >> v1:172.21.15.7:6789/0 conn(0x7f39b80cd9e0 legacy=0x7f39b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:51.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.038+0000 7f39b77fe700 1 -- 172.21.15.7:0/2627080473 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80ccf00 con 0x7f39b815a5d0 2023-10-14T19:04:51.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.039+0000 7f39b77fe700 1 --2- 172.21.15.7:0/2627080473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8156e90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009e60 tx=0x7f39b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50aa295e646cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.041+0000 7f39b5ffb700 1 -- 172.21.15.7:0/2627080473 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000e070 con 0x7f39b815a5d0 2023-10-14T19:04:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.041+0000 7f39b5ffb700 1 -- 172.21.15.7:0/2627080473 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000bb20 con 0x7f39b815a5d0 2023-10-14T19:04:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.041+0000 7f39b5ffb700 1 -- 172.21.15.7:0/2627080473 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012430 con 0x7f39b815a5d0 2023-10-14T19:04:51.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.042+0000 7f39bd546700 1 -- 172.21.15.7:0/2627080473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 msgr2=0x7f39b8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:51.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.042+0000 7f39bd546700 1 --2- 172.21.15.7:0/2627080473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8156e90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009e60 tx=0x7f39b0009780 comp rx=0 tx=0).stop 2023-10-14T19:04:51.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.044+0000 7f39bd546700 1 -- 172.21.15.7:0/2627080473 shutdown_connections 2023-10-14T19:04:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.044+0000 7f39bd546700 1 --2- 172.21.15.7:0/2627080473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8156e90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.044+0000 7f39bd546700 1 --2- 172.21.15.7:0/2627080473 >> v2:172.21.15.7:3300/0 conn(0x7f39b80cb5a0 0x7f39b80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.044+0000 7f39bd546700 1 -- 172.21.15.7:0/2627080473 >> 172.21.15.7:0/2627080473 conn(0x7f39b8070e30 msgr2=0x7f39b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.044+0000 7f39bd546700 1 -- 172.21.15.7:0/2627080473 shutdown_connections 2023-10-14T19:04:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.044+0000 7f39bd546700 1 -- 172.21.15.7:0/2627080473 wait complete. 2023-10-14T19:04:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.046+0000 7f39bd546700 1 Processor -- start 2023-10-14T19:04:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.046+0000 7f39bd546700 1 -- start start 2023-10-14T19:04:51.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39b80cb5a0 0x7f39b815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:51.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 0x7f39b815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:51.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80b63b0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80b5f20 con 0x7f39b815a5d0 2023-10-14T19:04:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80b5370 con 0x7f39b80cb5a0 2023-10-14T19:04:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 0x7f39b815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 0x7f39b815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35478/0 (socket says 172.21.15.7:35478) 2023-10-14T19:04:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 -- 172.21.15.7:0/4223304320 learned_addr learned my addr 172.21.15.7:0/4223304320 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b77fe700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b6ffd700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39b80cb5a0 0x7f39b815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 -- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39b80cb5a0 msgr2=0x7f39b815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39b80cb5a0 0x7f39b815b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 -- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 msgr2=0x7f39b8153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 -- 172.21.15.7:0/4223304320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009a20 con 0x7f39b80cd9e0 2023-10-14T19:04:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39b67fc700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 0x7f39b815d9b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c7c0 tx=0x7f39ac007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac005cd0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac005e30 con 0x7f39b80cd9e0 2023-10-14T19:04:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b80b55f0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.047+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac007320 con 0x7f39b80cd9e0 2023-10-14T19:04:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.048+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b80b5bb0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.048+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b804c3c0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.049+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f39ac01b3b0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.049+0000 7f399effd700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f39a4066fc0 0x7f39a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.049+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f39ac0838f0 con 0x7f39b80cd9e0 2023-10-14T19:04:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.050+0000 7f39b6ffd700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f39a4066fc0 0x7f39a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.050+0000 7f39b6ffd700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f39a4066fc0 0x7f39a4069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009bf0 tx=0x7f39a80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.054+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39ac050e70 con 0x7f39b80cd9e0 2023-10-14T19:04:51.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.326+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f39b80b6060 con 0x7f39b80cd9e0 2023-10-14T19:04:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.905+0000 7f399effd700 1 -- 172.21.15.7:0/4223304320 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v114) v1 ==== 161+0+0 (secure 0 0 0) 0x7f39ac017020 con 0x7f39b80cd9e0 2023-10-14T19:04:51.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f39a4066fc0 msgr2=0x7f39a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f39a4066fc0 0x7f39a4069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009bf0 tx=0x7f39a80091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 msgr2=0x7f39b815d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 0x7f39b815d9b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c7c0 tx=0x7f39ac007e00 comp rx=0 tx=0).stop 2023-10-14T19:04:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 shutdown_connections 2023-10-14T19:04:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f39a4066fc0 0x7f39a4069470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39b815a5d0 0x7f39b8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39b80cb5a0 0x7f39b815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 --2- 172.21.15.7:0/4223304320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80cd9e0 0x7f39b815d9b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 >> 172.21.15.7:0/4223304320 conn(0x7f39b8070e30 msgr2=0x7f39b80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 shutdown_connections 2023-10-14T19:04:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:51.908+0000 7f39bd546700 1 -- 172.21.15.7:0/4223304320 wait complete. 2023-10-14T19:04:51.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:04:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.045+0000 7f48564cf700 1 Processor -- start 2023-10-14T19:04:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.045+0000 7f48564cf700 1 -- start start 2023-10-14T19:04:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.046+0000 7f48564cf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48501576d0 0x7f48500ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.046+0000 7f48564cf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500cc060 con 0x7f48500aead0 2023-10-14T19:04:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.046+0000 7f48564cf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500cb450 con 0x7f48500b1be0 2023-10-14T19:04:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.046+0000 7f48564cf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48500cb730 con 0x7f48501576d0 2023-10-14T19:04:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.046+0000 7f484f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f48500aead0 0x7f48500b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53260/0 (socket says 172.21.15.7:53260) 2023-10-14T19:04:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.046+0000 7f484f7fe700 1 -- 172.21.15.7:0/761110269 learned_addr learned my addr 172.21.15.7:0/761110269 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 --2- 172.21.15.7:0/761110269 >> v2:172.21.15.148:3300/0 conn(0x7f48501576d0 0x7f48500ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298014193 0 0) 0x7f48500cc060 con 0x7f48500aead0 2023-10-14T19:04:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4838003570 con 0x7f48500aead0 2023-10-14T19:04:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2545163555 0 0) 0x7f4838003570 con 0x7f48500aead0 2023-10-14T19:04:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 >> v2:172.21.15.148:3300/0 conn(0x7f48501576d0 msgr2=0x7f48500ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 --2- 172.21.15.7:0/761110269 >> v2:172.21.15.148:3300/0 conn(0x7f48501576d0 0x7f48500ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 >> v1:172.21.15.148:6789/0 conn(0x7f48500b1be0 legacy=0x7f4850161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500cba10 con 0x7f48500aead0 2023-10-14T19:04:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f4844001470 con 0x7f48500aead0 2023-10-14T19:04:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 >> v1:172.21.15.7:6789/0 conn(0x7f48500aead0 legacy=0x7f48500b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4838003a60 0x7f4838003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838004810 0x7f4838004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48380051c0 0x7f483800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500cb730 con 0x7f4838003a60 2023-10-14T19:04:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483800c050 con 0x7f48380051c0 2023-10-14T19:04:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483800c210 con 0x7f4838004810 2023-10-14T19:04:52.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4838003a60 0x7f4838003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f4854a6c700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48380051c0 0x7f483800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484f7fe700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838004810 0x7f4838004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 -- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838004810 msgr2=0x7f4838004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838004810 0x7f4838004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 -- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48380051c0 msgr2=0x7f483800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48380051c0 0x7f483800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484ffff700 1 -- 172.21.15.7:0/761110269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838003570 con 0x7f4838003a60 2023-10-14T19:04:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f4854a6c700 1 -- 172.21.15.7:0/761110269 reap_dead start 2023-10-14T19:04:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.047+0000 7f484f7fe700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838004810 0x7f4838004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f484ffff700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4838003a60 0x7f4838003e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4840009c00 tx=0x7f48400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d86009a7b4b248 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000e710 con 0x7f4838003a60 2023-10-14T19:04:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000e870 con 0x7f4838003a60 2023-10-14T19:04:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f484effd700 1 -- 172.21.15.7:0/761110269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000ec30 con 0x7f4838003a60 2023-10-14T19:04:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 -- 172.21.15.7:0/761110269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4838003a60 msgr2=0x7f4838003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4838003a60 0x7f4838003e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4840009c00 tx=0x7f48400091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 -- 172.21.15.7:0/761110269 shutdown_connections 2023-10-14T19:04:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 --2- 172.21.15.7:0/761110269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4838003a60 0x7f4838003e30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 -- 172.21.15.7:0/761110269 >> 172.21.15.7:0/761110269 conn(0x7f485006d170 msgr2=0x7f48500cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 -- 172.21.15.7:0/761110269 shutdown_connections 2023-10-14T19:04:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.048+0000 7f48564cf700 1 -- 172.21.15.7:0/761110269 wait complete. 2023-10-14T19:04:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.049+0000 7f48564cf700 1 Processor -- start 2023-10-14T19:04:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 -- start start 2023-10-14T19:04:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838003a60 0x7f485014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501591a0 0x7f4850159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 0x7f485015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850159b50 con 0x7f485015bfd0 2023-10-14T19:04:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850155d40 con 0x7f48501591a0 2023-10-14T19:04:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f48564cf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850155fb0 con 0x7f4838003a60 2023-10-14T19:04:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f4854a6c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 0x7f485015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f4854a6c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 0x7f485015c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35488/0 (socket says 172.21.15.7:35488) 2023-10-14T19:04:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.050+0000 7f4854a6c700 1 -- 172.21.15.7:0/3173208143 learned_addr learned my addr 172.21.15.7:0/3173208143 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f484ffff700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838003a60 0x7f485014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f484f7fe700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501591a0 0x7f4850159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4854a6c700 1 -- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838003a60 msgr2=0x7f485014bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4854a6c700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838003a60 0x7f485014bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4854a6c700 1 -- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501591a0 msgr2=0x7f4850159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4854a6c700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501591a0 0x7f4850159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4854a6c700 1 -- 172.21.15.7:0/3173208143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850156290 con 0x7f485015bfd0 2023-10-14T19:04:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4854a6c700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 0x7f485015c470 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f48500b1fe0 tx=0x7f4848001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848006e80 con 0x7f485015bfd0 2023-10-14T19:04:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484800c540 con 0x7f485015bfd0 2023-10-14T19:04:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4850156570 con 0x7f485015bfd0 2023-10-14T19:04:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800c8e0 con 0x7f485015bfd0 2023-10-14T19:04:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.051+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485014c4f0 con 0x7f485015bfd0 2023-10-14T19:04:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.052+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4850156a90 con 0x7f485015bfd0 2023-10-14T19:04:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.052+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f484800cd10 con 0x7f485015bfd0 2023-10-14T19:04:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.053+0000 7f4837fff700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f483c066fc0 0x7f483c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.053+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4848084320 con 0x7f485015bfd0 2023-10-14T19:04:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.053+0000 7f484ffff700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f483c066fc0 0x7f483c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.054+0000 7f484ffff700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f483c066fc0 0x7f483c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48400091e0 tx=0x7f484001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.058+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4850156a90 con 0x7f485015bfd0 2023-10-14T19:04:52.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.251+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4850156a90 con 0x7f485015bfd0 2023-10-14T19:04:52.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.255+0000 7f4837fff700 1 -- 172.21.15.7:0/3173208143 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4850156a90 con 0x7f485015bfd0 2023-10-14T19:04:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f483c066fc0 msgr2=0x7f483c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f483c066fc0 0x7f483c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48400091e0 tx=0x7f484001a000 comp rx=0 tx=0).stop 2023-10-14T19:04:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 msgr2=0x7f485015c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 0x7f485015c470 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f48500b1fe0 tx=0x7f4848001700 comp rx=0 tx=0).stop 2023-10-14T19:04:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 shutdown_connections 2023-10-14T19:04:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f483c066fc0 0x7f483c069470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485015bfd0 0x7f485015c470 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4838003a60 0x7f485014bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 --2- 172.21.15.7:0/3173208143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501591a0 0x7f4850159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 >> 172.21.15.7:0/3173208143 conn(0x7f485006d170 msgr2=0x7f4850151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:52.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 shutdown_connections 2023-10-14T19:04:52.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.257+0000 7f48564cf700 1 -- 172.21.15.7:0/3173208143 wait complete. 2023-10-14T19:04:52.269 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:04:52.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:52.314 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:04:52.365 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:04:52.366 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:04:52.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:04:52.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.485+0000 7fc7edf51700 1 Processor -- start 2023-10-14T19:04:52.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.485+0000 7fc7edf51700 1 -- start start 2023-10-14T19:04:52.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7edf51700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7e8140b70 0x7fc7e80c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7edf51700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e80cd170 con 0x7fc7e806d370 2023-10-14T19:04:52.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7edf51700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e80c9a20 con 0x7fc7e8140f40 2023-10-14T19:04:52.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7edf51700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e80cd400 con 0x7fc7e8140b70 2023-10-14T19:04:52.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7ecf4f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7e8140b70 0x7fc7e80c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7e7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc7e806d370 0x7fc7e80c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53268/0 (socket says 172.21.15.7:53268) 2023-10-14T19:04:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7e7fff700 1 -- 172.21.15.7:0/258826760 learned_addr learned my addr 172.21.15.7:0/258826760 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7ecf4f700 1 --2- 172.21.15.7:0/258826760 >> v2:172.21.15.7:3300/0 conn(0x7fc7e8140b70 0x7fc7e80c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35500/0 (socket says 172.21.15.7:35500) 2023-10-14T19:04:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/258826760 >> v1:172.21.15.148:6789/0 conn(0x7fc7e8140f40 legacy=0x7fc7e815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.486+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/258826760 >> v1:172.21.15.7:6789/0 conn(0x7fc7e806d370 legacy=0x7fc7e80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/258826760 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e80cd6e0 con 0x7fc7e8140b70 2023-10-14T19:04:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7e77fe700 1 -- 172.21.15.7:0/258826760 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605217432 0 0) 0x7fc7e80cd170 con 0x7fc7e806d370 2023-10-14T19:04:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7ecf4f700 1 --2- 172.21.15.7:0/258826760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e8140b70 0x7fc7e80c42f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80098e0 tx=0x7fc7d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd68eb1030a0d7df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7e77fe700 1 -- 172.21.15.7:0/258826760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8009e80 con 0x7fc7e8140b70 2023-10-14T19:04:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7e77fe700 1 -- 172.21.15.7:0/258826760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d800b820 con 0x7fc7e8140b70 2023-10-14T19:04:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7e77fe700 1 -- 172.21.15.7:0/258826760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800bba0 con 0x7fc7e8140b70 2023-10-14T19:04:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 -- 172.21.15.7:0/258826760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e8140b70 msgr2=0x7fc7e80c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 --2- 172.21.15.7:0/258826760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e8140b70 0x7fc7e80c42f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80098e0 tx=0x7fc7d80091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 -- 172.21.15.7:0/258826760 shutdown_connections 2023-10-14T19:04:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 --2- 172.21.15.7:0/258826760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e8140b70 0x7fc7e80c42f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 -- 172.21.15.7:0/258826760 >> 172.21.15.7:0/258826760 conn(0x7fc7e80675a0 msgr2=0x7fc7e80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 -- 172.21.15.7:0/258826760 shutdown_connections 2023-10-14T19:04:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.487+0000 7fc7edf51700 1 -- 172.21.15.7:0/258826760 wait complete. 2023-10-14T19:04:52.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.489+0000 7fc7edf51700 1 Processor -- start 2023-10-14T19:04:52.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.489+0000 7fc7edf51700 1 -- start start 2023-10-14T19:04:52.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.489+0000 7fc7edf51700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 0x7fc7e81680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.489+0000 7fc7edf51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e8140b70 0x7fc7e816a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.489+0000 7fc7edf51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7e8140f40 0x7fc7e813d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7edf51700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e8168610 con 0x7fc7e806d370 2023-10-14T19:04:52.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7edf51700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e816aab0 con 0x7fc7e8140b70 2023-10-14T19:04:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7edf51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e816b110 con 0x7fc7e8140f40 2023-10-14T19:04:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 0x7fc7e81680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 0x7fc7e81680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35508/0 (socket says 172.21.15.7:35508) 2023-10-14T19:04:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/3922257169 learned_addr learned my addr 172.21.15.7:0/3922257169 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7e7fff700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e8140b70 0x7fc7e816a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7e8140f40 msgr2=0x7fc7e813d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ed750700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7e8140f40 0x7fc7e813d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7e8140f40 0x7fc7e813d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e8140b70 msgr2=0x7fc7e816a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e8140b70 0x7fc7e816a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 -- 172.21.15.7:0/3922257169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d8009420 con 0x7fc7e806d370 2023-10-14T19:04:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7e7fff700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e8140b70 0x7fc7e816a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ed750700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7e8140f40 0x7fc7e813d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7ecf4f700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 0x7fc7e81680d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80030c0 tx=0x7fc7d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800ba10 con 0x7fc7e806d370 2023-10-14T19:04:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d8020070 con 0x7fc7e806d370 2023-10-14T19:04:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e816b3f0 con 0x7fc7e806d370 2023-10-14T19:04:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d801b6a0 con 0x7fc7e806d370 2023-10-14T19:04:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.490+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e816b9b0 con 0x7fc7e806d370 2023-10-14T19:04:52.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.491+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e8140400 con 0x7fc7e806d370 2023-10-14T19:04:52.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.492+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc7d8022030 con 0x7fc7e806d370 2023-10-14T19:04:52.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.492+0000 7fc7e4ff9700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc7d4066fc0 0x7fc7d4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.492+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc7d8086260 con 0x7fc7e806d370 2023-10-14T19:04:52.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.493+0000 7fc7e7fff700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc7d4066fc0 0x7fc7d4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.493+0000 7fc7e7fff700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc7d4066fc0 0x7fc7d4069470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80b2bb0 tx=0x7fc7dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.497+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7d80537e0 con 0x7fc7e806d370 2023-10-14T19:04:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.734+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7e8140400 con 0x7fc7e806d370 2023-10-14T19:04:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.734+0000 7fc7e4ff9700 1 -- 172.21.15.7:0/3922257169 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fc7d8056e00 con 0x7fc7e806d370 2023-10-14T19:04:52.736 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:52.736 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5173,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1923808700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1923808700},{"type":"v1","addr":"172.21.15.7:6835","nonce":1923808700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1276762387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1276762387},{"type":"v1","addr":"172.21.15.148:6836","nonce":1276762387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1643788814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1643788814},{"type":"v1","addr":"172.21.15.148:6837","nonce":1643788814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/827050319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":827050319},{"type":"v1","addr":"172.21.15.7:6834","nonce":827050319}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2023-10-14T19:04:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc7d4066fc0 msgr2=0x7fc7d4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc7d4066fc0 0x7fc7d4069470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80b2bb0 tx=0x7fc7dc009040 comp rx=0 tx=0).stop 2023-10-14T19:04:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 msgr2=0x7fc7e81680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 0x7fc7e81680d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80030c0 tx=0x7fc7d8016000 comp rx=0 tx=0).stop 2023-10-14T19:04:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 shutdown_connections 2023-10-14T19:04:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc7d4066fc0 0x7fc7d4069470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc7e8140f40 0x7fc7e813d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e806d370 0x7fc7e81680d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 --2- 172.21.15.7:0/3922257169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e8140b70 0x7fc7e816a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 >> 172.21.15.7:0/3922257169 conn(0x7fc7e80675a0 msgr2=0x7fc7e80c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 shutdown_connections 2023-10-14T19:04:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.737+0000 7fc7edf51700 1 -- 172.21.15.7:0/3922257169 wait complete. 2023-10-14T19:04:52.741 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 33 2023-10-14T19:04:52.750 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:04:52.751 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:04:52.751 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:04:52.751 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:52.752 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:04:52.752 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:04:52.752 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:04:52.753 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:52.753 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:04:52.753 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:04:52.754 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:04:52.754 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:52.754 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:04:52.755 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:04:52.755 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:04:52.755 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:04:52.760 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:04:52.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:04:52.762 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:04:52.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:04:52.765 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:04:52.765 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:04:52.766 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:04:52.766 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:04:52.803 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:04:52.804 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:52.805 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:04:52.805 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:52.808 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:04:52.808 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:52.809 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:04:52.810 DEBUG:teuthology.parallel:result is None 2023-10-14T19:04:52.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:04:52.879 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:04:52.882 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:04:52.892 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:04:52.892 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:04:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.940+0000 7f00e979f700 1 Processor -- start 2023-10-14T19:04:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.940+0000 7f00e979f700 1 -- start start 2023-10-14T19:04:52.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e979f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e415de50 0x7f00e40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e979f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e415afd0 con 0x7f00e4153c30 2023-10-14T19:04:52.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e979f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e415b2b0 con 0x7f00e40cef40 2023-10-14T19:04:52.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e979f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e415b590 con 0x7f00e415de50 2023-10-14T19:04:52.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00e4153c30 0x7f00e415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53280/0 (socket says 172.21.15.7:53280) 2023-10-14T19:04:52.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e3fff700 1 -- 172.21.15.7:0/2615212040 learned_addr learned my addr 172.21.15.7:0/2615212040 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e37fe700 1 --2- 172.21.15.7:0/2615212040 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e415de50 0x7f00e40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074485836 0 0) 0x7f00e415afd0 con 0x7f00e4153c30 2023-10-14T19:04:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00cc003570 con 0x7f00e4153c30 2023-10-14T19:04:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990880246 0 0) 0x7f00e415b2b0 con 0x7f00e40cef40 2023-10-14T19:04:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e415afd0 con 0x7f00e40cef40 2023-10-14T19:04:52.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298342264 0 0) 0x7f00cc003570 con 0x7f00e4153c30 2023-10-14T19:04:52.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e37fe700 1 -- 172.21.15.7:0/2615212040 >> v1:172.21.15.148:6789/0 conn(0x7f00e40cef40 legacy=0x7f00e415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e37fe700 1 -- 172.21.15.7:0/2615212040 >> v1:172.21.15.7:6789/0 conn(0x7f00e4153c30 legacy=0x7f00e415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.941+0000 7f00e37fe700 1 -- 172.21.15.7:0/2615212040 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e415b870 con 0x7f00e415de50 2023-10-14T19:04:52.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e37fe700 1 --2- 172.21.15.7:0/2615212040 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e415de50 0x7f00e40cea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009910 tx=0x7f00d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e69b6dd8323ee07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4001470 con 0x7f00e415de50 2023-10-14T19:04:52.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8011420 con 0x7f00e415de50 2023-10-14T19:04:52.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e2ffd700 1 -- 172.21.15.7:0/2615212040 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80117c0 con 0x7f00e415de50 2023-10-14T19:04:52.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 -- 172.21.15.7:0/2615212040 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e415de50 msgr2=0x7f00e40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 --2- 172.21.15.7:0/2615212040 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e415de50 0x7f00e40cea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009910 tx=0x7f00d80091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 -- 172.21.15.7:0/2615212040 shutdown_connections 2023-10-14T19:04:52.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 --2- 172.21.15.7:0/2615212040 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e415de50 0x7f00e40cea00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 -- 172.21.15.7:0/2615212040 >> 172.21.15.7:0/2615212040 conn(0x7f00e40703a0 msgr2=0x7f00e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:52.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 -- 172.21.15.7:0/2615212040 shutdown_connections 2023-10-14T19:04:52.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.942+0000 7f00e979f700 1 -- 172.21.15.7:0/2615212040 wait complete. 2023-10-14T19:04:52.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.943+0000 7f00e979f700 1 Processor -- start 2023-10-14T19:04:52.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 -- start start 2023-10-14T19:04:52.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e40cef40 0x7f00e4169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e4153c30 0x7f00e40b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 0x7f00e40b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40ca4d0 con 0x7f00e415de50 2023-10-14T19:04:52.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4169e90 con 0x7f00e40cef40 2023-10-14T19:04:52.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e979f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40b4730 con 0x7f00e4153c30 2023-10-14T19:04:52.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e8f9e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 0x7f00e40b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e8f9e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 0x7f00e40b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35568/0 (socket says 172.21.15.7:35568) 2023-10-14T19:04:52.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.944+0000 7f00e8f9e700 1 -- 172.21.15.7:0/3016434001 learned_addr learned my addr 172.21.15.7:0/3016434001 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:52.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e3fff700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e40cef40 0x7f00e4169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e37fe700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e4153c30 0x7f00e40b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e8f9e700 1 -- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e4153c30 msgr2=0x7f00e40b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e8f9e700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e4153c30 0x7f00e40b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e8f9e700 1 -- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e40cef40 msgr2=0x7f00e4169950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e8f9e700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e40cef40 0x7f00e4169950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e8f9e700 1 -- 172.21.15.7:0/3016434001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8009420 con 0x7f00e415de50 2023-10-14T19:04:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e3fff700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e40cef40 0x7f00e4169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e8f9e700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 0x7f00e40b5570 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c860 tx=0x7f00dc002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc002030 con 0x7f00e415de50 2023-10-14T19:04:52.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0021b0 con 0x7f00e415de50 2023-10-14T19:04:52.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e40b49d0 con 0x7f00e415de50 2023-10-14T19:04:52.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc012630 con 0x7f00e415de50 2023-10-14T19:04:52.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.945+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e40c7a60 con 0x7f00e415de50 2023-10-14T19:04:52.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.946+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e404c3c0 con 0x7f00e415de50 2023-10-14T19:04:52.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.947+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f00dc012a20 con 0x7f00e415de50 2023-10-14T19:04:52.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.947+0000 7f00cbfff700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00d0066fc0 0x7f00d0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:52.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.947+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f00dc084330 con 0x7f00e415de50 2023-10-14T19:04:52.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.947+0000 7f00e3fff700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00d0066fc0 0x7f00d0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:52.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.948+0000 7f00e3fff700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00d0066fc0 0x7f00d0069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00d40011e0 tx=0x7f00d4000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:52.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:52.951+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00dc0518b0 con 0x7f00e415de50 2023-10-14T19:04:53.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.159+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f00e40caef0 con 0x7f00e415de50 2023-10-14T19:04:53.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.922+0000 7f00cbfff700 1 -- 172.21.15.7:0/3016434001 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7f00dc054ed0 con 0x7f00e415de50 2023-10-14T19:04:53.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00d0066fc0 msgr2=0x7f00d0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:53.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00d0066fc0 0x7f00d0069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00d40011e0 tx=0x7f00d4000bc0 comp rx=0 tx=0).stop 2023-10-14T19:04:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 msgr2=0x7f00e40b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 0x7f00e40b5570 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c860 tx=0x7f00dc002700 comp rx=0 tx=0).stop 2023-10-14T19:04:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 shutdown_connections 2023-10-14T19:04:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00d0066fc0 0x7f00d0069470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e40cef40 0x7f00e4169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:53.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e415de50 0x7f00e40b5570 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:53.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 --2- 172.21.15.7:0/3016434001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00e4153c30 0x7f00e40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:53.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 >> 172.21.15.7:0/3016434001 conn(0x7f00e40703a0 msgr2=0x7f00e4153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:53.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 shutdown_connections 2023-10-14T19:04:53.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:53.924+0000 7f00e979f700 1 -- 172.21.15.7:0/3016434001 wait complete. 2023-10-14T19:04:53.928 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:04:53.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:04:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.060+0000 7f5a85ec0700 1 Processor -- start 2023-10-14T19:04:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.060+0000 7f5a85ec0700 1 -- start start 2023-10-14T19:04:54.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a85ec0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a800cb5a0 0x7f5a800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a85ec0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a8015a5d0 0x7f5a80156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a85ec0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8015ae40 con 0x7f5a800cd9e0 2023-10-14T19:04:54.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a85ec0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a800d13f0 con 0x7f5a8015a5d0 2023-10-14T19:04:54.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a85ec0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8015ab60 con 0x7f5a800cb5a0 2023-10-14T19:04:54.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a8015a5d0 0x7f5a80156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a8015a5d0 0x7f5a80156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35578/0 (socket says 172.21.15.7:35578) 2023-10-14T19:04:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 -- 172.21.15.7:0/2189294843 learned_addr learned my addr 172.21.15.7:0/2189294843 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 -- 172.21.15.7:0/2189294843 >> v2:172.21.15.148:3300/0 conn(0x7f5a800cb5a0 msgr2=0x7f5a800cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 --2- 172.21.15.7:0/2189294843 >> v2:172.21.15.148:3300/0 conn(0x7f5a800cb5a0 0x7f5a800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 -- 172.21.15.7:0/2189294843 >> v1:172.21.15.148:6789/0 conn(0x7f5a800cd9e0 legacy=0x7f5a80159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.061+0000 7f5a7ffff700 1 -- 172.21.15.7:0/2189294843 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800ccf00 con 0x7f5a8015a5d0 2023-10-14T19:04:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a7ffff700 1 --2- 172.21.15.7:0/2189294843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a8015a5d0 0x7f5a80156e90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009f20 tx=0x7f5a78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4cfb6de8ebae1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a7e7fc700 1 -- 172.21.15.7:0/2189294843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800e070 con 0x7f5a8015a5d0 2023-10-14T19:04:54.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a7e7fc700 1 -- 172.21.15.7:0/2189294843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800ba00 con 0x7f5a8015a5d0 2023-10-14T19:04:54.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a7e7fc700 1 -- 172.21.15.7:0/2189294843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a780092e0 con 0x7f5a8015a5d0 2023-10-14T19:04:54.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 -- 172.21.15.7:0/2189294843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a8015a5d0 msgr2=0x7f5a80156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/2189294843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a8015a5d0 0x7f5a80156e90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009f20 tx=0x7f5a78009840 comp rx=0 tx=0).stop 2023-10-14T19:04:54.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 -- 172.21.15.7:0/2189294843 shutdown_connections 2023-10-14T19:04:54.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/2189294843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a8015a5d0 0x7f5a80156e90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/2189294843 >> v2:172.21.15.148:3300/0 conn(0x7f5a800cb5a0 0x7f5a800cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 -- 172.21.15.7:0/2189294843 >> 172.21.15.7:0/2189294843 conn(0x7f5a80070e30 msgr2=0x7f5a800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:54.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 -- 172.21.15.7:0/2189294843 shutdown_connections 2023-10-14T19:04:54.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.062+0000 7f5a85ec0700 1 -- 172.21.15.7:0/2189294843 wait complete. 2023-10-14T19:04:54.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 Processor -- start 2023-10-14T19:04:54.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 -- start start 2023-10-14T19:04:54.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800cb5a0 0x7f5a800c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 0x7f5a800c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a8015a5d0 0x7f5a800c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8016d3b0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8016ca50 con 0x7f5a800cb5a0 2023-10-14T19:04:54.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a85ec0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800c83a0 con 0x7f5a8015a5d0 2023-10-14T19:04:54.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.064+0000 7f5a7effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 0x7f5a800c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 0x7f5a800c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35580/0 (socket says 172.21.15.7:35580) 2023-10-14T19:04:54.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 -- 172.21.15.7:0/1436422754 learned_addr learned my addr 172.21.15.7:0/1436422754 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:54.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7f7fe700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800cb5a0 0x7f5a800c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7ffff700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a8015a5d0 0x7f5a800c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 -- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a8015a5d0 msgr2=0x7f5a800c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a8015a5d0 0x7f5a800c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 -- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800cb5a0 msgr2=0x7f5a800c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800cb5a0 0x7f5a800c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 -- 172.21.15.7:0/1436422754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a78009ae0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7ffff700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a8015a5d0 0x7f5a800c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:54.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a7effd700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 0x7f5a800c77c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c5d0 tx=0x7f5a74007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011590 con 0x7f5a800cd9e0 2023-10-14T19:04:54.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74011710 con 0x7f5a800cd9e0 2023-10-14T19:04:54.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8016ccf0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011ad0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.065+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8016d7d0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.066+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8016d9f0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.067+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5a7401c460 con 0x7f5a800cd9e0 2023-10-14T19:04:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.067+0000 7f5a677fe700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a6c066fc0 0x7f5a6c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.067+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5a74083f60 con 0x7f5a800cd9e0 2023-10-14T19:04:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.067+0000 7f5a7f7fe700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a6c066fc0 0x7f5a6c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.068+0000 7f5a7f7fe700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a6c066fc0 0x7f5a6c069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5a800cbb20 tx=0x7f5a700091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.072+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a8016d9f0 con 0x7f5a800cd9e0 2023-10-14T19:04:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.342+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5a8016d190 con 0x7f5a800cd9e0 2023-10-14T19:04:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.342+0000 7f5a677fe700 1 -- 172.21.15.7:0/1436422754 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5a74051530 con 0x7f5a800cd9e0 2023-10-14T19:04:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:54.344 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:04:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:04:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:04:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:04:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:04:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:04:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:04:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:04:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:04:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:04:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:04:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:04:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.357 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:04:54.357 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:04:54.357 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.358 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.358 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.358 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.359 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:04:54.359 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:04:54.360 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.360 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.360 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.360 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.360 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.361 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:04:54.361 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:04:54.361 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.362 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.362 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.364 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.364 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.365 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:04:54.365 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:04:54.365 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.365 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.365 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.366 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.370 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:04:54.370 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:04:54.371 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.371 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.371 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.372 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:04:54.372 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:04:54.372 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.373 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:04:54.373 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:04:54.373 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.374 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:04:54.374 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:04:54.374 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.374 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.375 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:04:54.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:04:54.375 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.375 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:04:54.376 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:04:54.376 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.376 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.376 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:04:54.377 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:04:54.377 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:04:54.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.377 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:04:54.378 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:04:54.378 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.378 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.378 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:04:54.378 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:04:54.379 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:04:54.379 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.379 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:04:54.380 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:04:54.380 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.380 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:04:54.380 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:04:54.380 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:04:54.380 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:04:54.381 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.381 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:04:54.381 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:04:54.382 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.382 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:04:54.382 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:04:54.382 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:04:54.382 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.383 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:04:54.383 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:04:54.384 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.384 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:04:54.384 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:04:54.384 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:04:54.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:54.385 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:04:54.385 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:04:54.385 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:04:54.385 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:04:54.386 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:04:54.386 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:04:54.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:54.386 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:04:54.387 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:04:54.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a6c066fc0 msgr2=0x7f5a6c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a6c066fc0 0x7f5a6c069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5a800cbb20 tx=0x7f5a700091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 msgr2=0x7f5a800c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 0x7f5a800c77c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c5d0 tx=0x7f5a74007f60 comp rx=0 tx=0).stop 2023-10-14T19:04:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 shutdown_connections 2023-10-14T19:04:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a6c066fc0 0x7f5a6c069470 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800cb5a0 0x7f5a800c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a8015a5d0 0x7f5a800c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 --2- 172.21.15.7:0/1436422754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a800cd9e0 0x7f5a800c77c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 >> 172.21.15.7:0/1436422754 conn(0x7f5a80070e30 msgr2=0x7f5a80155e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 shutdown_connections 2023-10-14T19:04:54.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.345+0000 7f5a85ec0700 1 -- 172.21.15.7:0/1436422754 wait complete. 2023-10-14T19:04:54.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:54.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 Processor -- start 2023-10-14T19:04:54.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 -- start start 2023-10-14T19:04:54.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cb5a0 0x7f68580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68580cd9e0 0x7f6858159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685815ae40 con 0x7f68580cde50 2023-10-14T19:04:54.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580d13f0 con 0x7f68580cd9e0 2023-10-14T19:04:54.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.510+0000 7f685dfa4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685815ab60 con 0x7f68580cb5a0 2023-10-14T19:04:54.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68580cd9e0 0x7f6858159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6857fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f68580cde50 0x7f6858156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53284/0 (socket says 172.21.15.7:53284) 2023-10-14T19:04:54.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6857fff700 1 -- 172.21.15.7:0/3224318123 learned_addr learned my addr 172.21.15.7:0/3224318123 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:54.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68580cd9e0 0x7f6858159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35592/0 (socket says 172.21.15.7:35592) 2023-10-14T19:04:54.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f68577fe700 1 --2- 172.21.15.7:0/3224318123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cb5a0 0x7f68580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 -- 172.21.15.7:0/3224318123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cb5a0 msgr2=0x7f68580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:54.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 --2- 172.21.15.7:0/3224318123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cb5a0 0x7f68580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 -- 172.21.15.7:0/3224318123 >> v1:172.21.15.7:6789/0 conn(0x7f68580cde50 legacy=0x7f6858156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 -- 172.21.15.7:0/3224318123 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580ccf00 con 0x7f68580cd9e0 2023-10-14T19:04:54.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f68567fc700 1 -- 172.21.15.7:0/3224318123 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133999890 0 0) 0x7f685815ae40 con 0x7f68580cde50 2023-10-14T19:04:54.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f6856ffd700 1 --2- 172.21.15.7:0/3224318123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cd9e0 0x7f6858159ec0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f684c0098e0 tx=0x7f684c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505f39e67629092b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f68567fc700 1 -- 172.21.15.7:0/3224318123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c009e80 con 0x7f68580cd9e0 2023-10-14T19:04:54.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f68567fc700 1 -- 172.21.15.7:0/3224318123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c00b860 con 0x7f68580cd9e0 2023-10-14T19:04:54.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.511+0000 7f68567fc700 1 -- 172.21.15.7:0/3224318123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00bbe0 con 0x7f68580cd9e0 2023-10-14T19:04:54.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 -- 172.21.15.7:0/3224318123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cd9e0 msgr2=0x7f6858159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 --2- 172.21.15.7:0/3224318123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cd9e0 0x7f6858159ec0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f684c0098e0 tx=0x7f684c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 -- 172.21.15.7:0/3224318123 shutdown_connections 2023-10-14T19:04:54.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 --2- 172.21.15.7:0/3224318123 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cb5a0 0x7f68580cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 --2- 172.21.15.7:0/3224318123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cd9e0 0x7f6858159ec0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 -- 172.21.15.7:0/3224318123 >> 172.21.15.7:0/3224318123 conn(0x7f6858070e30 msgr2=0x7f68580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:54.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 -- 172.21.15.7:0/3224318123 shutdown_connections 2023-10-14T19:04:54.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.512+0000 7f685dfa4700 1 -- 172.21.15.7:0/3224318123 wait complete. 2023-10-14T19:04:54.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.513+0000 7f685dfa4700 1 Processor -- start 2023-10-14T19:04:54.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.513+0000 7f685dfa4700 1 -- start start 2023-10-14T19:04:54.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f685dfa4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 0x7f6858156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f685dfa4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cd9e0 0x7f68580c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f685dfa4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68580ca000 0x7f68580b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f685dfa4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b5320 con 0x7f68580cb5a0 2023-10-14T19:04:54.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f685dfa4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b4710 con 0x7f68580ca000 2023-10-14T19:04:54.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f685dfa4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b49f0 con 0x7f68580cd9e0 2023-10-14T19:04:54.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 0x7f6858156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 0x7f6858156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35606/0 (socket says 172.21.15.7:35606) 2023-10-14T19:04:54.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 -- 172.21.15.7:0/260781642 learned_addr learned my addr 172.21.15.7:0/260781642 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:54.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 -- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cd9e0 msgr2=0x7f68580c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cd9e0 0x7f68580c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 -- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68580ca000 msgr2=0x7f68580b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68580ca000 0x7f68580b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 -- 172.21.15.7:0/260781642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c009420 con 0x7f68580cb5a0 2023-10-14T19:04:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.514+0000 7f68577fe700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 0x7f6858156200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f684800e190 tx=0x7f6848009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.515+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684800ee30 con 0x7f68580cb5a0 2023-10-14T19:04:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.515+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848014420 con 0x7f68580cb5a0 2023-10-14T19:04:54.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.515+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68580b4cd0 con 0x7f68580cb5a0 2023-10-14T19:04:54.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.515+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480147e0 con 0x7f68580cb5a0 2023-10-14T19:04:54.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.515+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6858156740 con 0x7f68580cb5a0 2023-10-14T19:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.516+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685804c3c0 con 0x7f68580cb5a0 2023-10-14T19:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.516+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6848014b90 con 0x7f68580cb5a0 2023-10-14T19:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.516+0000 7f683f7fe700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6844066fc0 0x7f6844069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.517+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6848084a60 con 0x7f68580cb5a0 2023-10-14T19:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.517+0000 7f6856ffd700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6844066fc0 0x7f6844069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.517+0000 7f6856ffd700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6844066fc0 0x7f6844069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68580b6240 tx=0x7f684c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.521+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6848052030 con 0x7f68580cb5a0 2023-10-14T19:04:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.715+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68580cd1e0 con 0x7f68580cb5a0 2023-10-14T19:04:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.716+0000 7f683f7fe700 1 -- 172.21.15.7:0/260781642 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f6848009a60 con 0x7f68580cb5a0 2023-10-14T19:04:54.717 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:54.717 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:53.920912+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6844066fc0 msgr2=0x7f6844069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6844066fc0 0x7f6844069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68580b6240 tx=0x7f684c017000 comp rx=0 tx=0).stop 2023-10-14T19:04:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 msgr2=0x7f6858156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 0x7f6858156200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f684800e190 tx=0x7f6848009920 comp rx=0 tx=0).stop 2023-10-14T19:04:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 shutdown_connections 2023-10-14T19:04:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6844066fc0 0x7f6844069470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68580ca000 0x7f68580b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68580cb5a0 0x7f6858156200 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 --2- 172.21.15.7:0/260781642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68580cd9e0 0x7f68580c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 >> 172.21.15.7:0/260781642 conn(0x7f6858070e30 msgr2=0x7f68580b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:54.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 shutdown_connections 2023-10-14T19:04:54.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.718+0000 7f685dfa4700 1 -- 172.21.15.7:0/260781642 wait complete. 2023-10-14T19:04:54.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:04:54.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:04:54.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.853+0000 7f444d9d8700 1 Processor -- start 2023-10-14T19:04:54.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f444d9d8700 1 -- start start 2023-10-14T19:04:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f444d9d8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f4448159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f444d9d8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f444806e0e0 0x7f44480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f444d9d8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44480ccfd0 con 0x7f4448159530 2023-10-14T19:04:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f444d9d8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444815a3d0 con 0x7f444806e0e0 2023-10-14T19:04:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f444d9d8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444815a6b0 con 0x7f444806dc70 2023-10-14T19:04:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.854+0000 7f44477fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f444806e0e0 0x7f44480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f4446ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4448159530 0x7f44480ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53294/0 (socket says 172.21.15.7:53294) 2023-10-14T19:04:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f4446ffd700 1 -- 172.21.15.7:0/2015896888 learned_addr learned my addr 172.21.15.7:0/2015896888 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44467fc700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f4448159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44477fe700 1 -- 172.21.15.7:0/2015896888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 msgr2=0x7f4448159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44477fe700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f4448159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44477fe700 1 -- 172.21.15.7:0/2015896888 >> v1:172.21.15.7:6789/0 conn(0x7f4448159530 legacy=0x7f44480ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44477fe700 1 -- 172.21.15.7:0/2015896888 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444815a990 con 0x7f444806e0e0 2023-10-14T19:04:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f4445ffb700 1 -- 172.21.15.7:0/2015896888 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944192748 0 0) 0x7f44480ccfd0 con 0x7f4448159530 2023-10-14T19:04:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44467fc700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f4448159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f44477fe700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806e0e0 0x7f44480cb6f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44380098e0 tx=0x7f44380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9884a1fd753df3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f4445ffb700 1 -- 172.21.15.7:0/2015896888 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438009e80 con 0x7f444806e0e0 2023-10-14T19:04:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f4445ffb700 1 -- 172.21.15.7:0/2015896888 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800b860 con 0x7f444806e0e0 2023-10-14T19:04:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.855+0000 7f4445ffb700 1 -- 172.21.15.7:0/2015896888 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800bbe0 con 0x7f444806e0e0 2023-10-14T19:04:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 -- 172.21.15.7:0/2015896888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806e0e0 msgr2=0x7f44480cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806e0e0 0x7f44480cb6f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44380098e0 tx=0x7f44380091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 -- 172.21.15.7:0/2015896888 shutdown_connections 2023-10-14T19:04:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806e0e0 0x7f44480cb6f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2015896888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f4448159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 -- 172.21.15.7:0/2015896888 >> 172.21.15.7:0/2015896888 conn(0x7f44480703a0 msgr2=0x7f44480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 -- 172.21.15.7:0/2015896888 shutdown_connections 2023-10-14T19:04:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.856+0000 7f444d9d8700 1 -- 172.21.15.7:0/2015896888 wait complete. 2023-10-14T19:04:54.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.857+0000 7f444d9d8700 1 Processor -- start 2023-10-14T19:04:54.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.857+0000 7f444d9d8700 1 -- start start 2023-10-14T19:04:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f444d9d8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f444814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f444d9d8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444806e0e0 0x7f44480b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f444d9d8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 0x7f44480b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f444d9d8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480b5970 con 0x7f4448159530 2023-10-14T19:04:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f444d9d8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480b5c50 con 0x7f444806e0e0 2023-10-14T19:04:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f444d9d8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480b5f30 con 0x7f444806dc70 2023-10-14T19:04:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 0x7f44480b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 0x7f44480b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35632/0 (socket says 172.21.15.7:35632) 2023-10-14T19:04:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 -- 172.21.15.7:0/2748709402 learned_addr learned my addr 172.21.15.7:0/2748709402 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44467fc700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444806e0e0 0x7f44480b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f4446ffd700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f444814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 -- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 msgr2=0x7f444814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f444814f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 -- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444806e0e0 msgr2=0x7f44480b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444806e0e0 0x7f44480b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 -- 172.21.15.7:0/2748709402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438009420 con 0x7f4448159530 2023-10-14T19:04:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.858+0000 7f44477fe700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 0x7f44480b2010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4438013000 tx=0x7f4438017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.859+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438025420 con 0x7f4448159530 2023-10-14T19:04:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.859+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44380255a0 con 0x7f4448159530 2023-10-14T19:04:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.859+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44480b6210 con 0x7f4448159530 2023-10-14T19:04:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.859+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438025960 con 0x7f4448159530 2023-10-14T19:04:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.859+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444814f7d0 con 0x7f4448159530 2023-10-14T19:04:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.860+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44480c7a70 con 0x7f4448159530 2023-10-14T19:04:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.860+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4438025d50 con 0x7f4448159530 2023-10-14T19:04:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.860+0000 7f443effd700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4428066fc0 0x7f4428069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.860+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4438085d90 con 0x7f4448159530 2023-10-14T19:04:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.861+0000 7f4446ffd700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4428066fc0 0x7f4428069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.861+0000 7f4446ffd700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4428066fc0 0x7f4428069470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4440002230 tx=0x7f4440009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:54.865+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44480c7a70 con 0x7f4448159530 2023-10-14T19:04:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.059+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44480c7a70 con 0x7f4448159530 2023-10-14T19:04:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.059+0000 7f443effd700 1 -- 172.21.15.7:0/2748709402 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44480c7a70 con 0x7f4448159530 2023-10-14T19:04:55.060 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:04:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4428066fc0 msgr2=0x7f4428069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4428066fc0 0x7f4428069470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4440002230 tx=0x7f4440009040 comp rx=0 tx=0).stop 2023-10-14T19:04:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 msgr2=0x7f44480b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 0x7f44480b2010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4438013000 tx=0x7f4438017000 comp rx=0 tx=0).stop 2023-10-14T19:04:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 shutdown_connections 2023-10-14T19:04:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4428066fc0 0x7f4428069470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4448159530 0x7f44480b2010 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f444806dc70 0x7f444814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 --2- 172.21.15.7:0/2748709402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f444806e0e0 0x7f44480b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 >> 172.21.15.7:0/2748709402 conn(0x7f44480703a0 msgr2=0x7f44480cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 shutdown_connections 2023-10-14T19:04:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.061+0000 7f444d9d8700 1 -- 172.21.15.7:0/2748709402 wait complete. 2023-10-14T19:04:55.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:04:55.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.192+0000 7f05982d4700 1 Processor -- start 2023-10-14T19:04:55.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.192+0000 7f05982d4700 1 -- start start 2023-10-14T19:04:55.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.193+0000 7f05982d4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 0x7f05900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.193+0000 7f05982d4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059015ae40 con 0x7f05900cde50 2023-10-14T19:04:55.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.193+0000 7f05982d4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059015ab60 con 0x7f05900cd9e0 2023-10-14T19:04:55.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.193+0000 7f05982d4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05900d13f0 con 0x7f05900cb5a0 2023-10-14T19:04:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.193+0000 7f0596871700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f05900cde50 0x7f0590156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53310/0 (socket says 172.21.15.7:53310) 2023-10-14T19:04:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.193+0000 7f0596871700 1 -- 172.21.15.7:0/3531846867 learned_addr learned my addr 172.21.15.7:0/3531846867 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f0596070700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 0x7f05900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044935254 0 0) 0x7f059015ae40 con 0x7f05900cde50 2023-10-14T19:04:55.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0578003570 con 0x7f05900cde50 2023-10-14T19:04:55.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470781627 0 0) 0x7f059015ab60 con 0x7f05900cd9e0 2023-10-14T19:04:55.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f059015ae40 con 0x7f05900cd9e0 2023-10-14T19:04:55.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3229513299 0 0) 0x7f0578003570 con 0x7f05900cde50 2023-10-14T19:04:55.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 msgr2=0x7f05900cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:55.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 0x7f05900cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 >> v1:172.21.15.148:6789/0 conn(0x7f05900cd9e0 legacy=0x7f0590159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900ccf00 con 0x7f05900cde50 2023-10-14T19:04:55.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f0588001470 con 0x7f05900cde50 2023-10-14T19:04:55.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 >> v1:172.21.15.7:6789/0 conn(0x7f05900cde50 legacy=0x7f0590156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0578003c20 0x7f0578004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 0x7f0578004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0578004d50 0x7f05780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057800bb40 con 0x7f0578004d50 2023-10-14T19:04:55.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057800bc80 con 0x7f0578003c20 2023-10-14T19:04:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057800be40 con 0x7f05900cb5a0 2023-10-14T19:04:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f0596871700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0578004d50 0x7f05780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f0596070700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0578003c20 0x7f0578004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.194+0000 7f059586f700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 0x7f0578004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 -- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 msgr2=0x7f0578004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05900cb5a0 0x7f0578004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 -- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0578003c20 msgr2=0x7f0578004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0578003c20 0x7f0578004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 -- 172.21.15.7:0/3531846867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578003570 con 0x7f0578004d50 2023-10-14T19:04:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0578004d50 0x7f05780051c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f058800c2d0 tx=0x7f0588001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f651c0d1095c8bb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058800cbc0 con 0x7f0578004d50 2023-10-14T19:04:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058800cd20 con 0x7f0578004d50 2023-10-14T19:04:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f059506e700 1 -- 172.21.15.7:0/3531846867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005b70 con 0x7f0578004d50 2023-10-14T19:04:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f05982d4700 1 -- 172.21.15.7:0/3531846867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0578004d50 msgr2=0x7f05780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f05982d4700 1 --2- 172.21.15.7:0/3531846867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0578004d50 0x7f05780051c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f058800c2d0 tx=0x7f0588001e10 comp rx=0 tx=0).stop 2023-10-14T19:04:55.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f0596871700 1 -- 172.21.15.7:0/3531846867 reap_dead start 2023-10-14T19:04:55.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f05982d4700 1 -- 172.21.15.7:0/3531846867 shutdown_connections 2023-10-14T19:04:55.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f05982d4700 1 -- 172.21.15.7:0/3531846867 >> 172.21.15.7:0/3531846867 conn(0x7f0590070e30 msgr2=0x7f05900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:55.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.195+0000 7f05982d4700 1 -- 172.21.15.7:0/3531846867 shutdown_connections 2023-10-14T19:04:55.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.196+0000 7f05982d4700 1 -- 172.21.15.7:0/3531846867 wait complete. 2023-10-14T19:04:55.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 Processor -- start 2023-10-14T19:04:55.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 -- start start 2023-10-14T19:04:55.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0578004d50 0x7f059015cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 0x7f05900c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05901560f0 0x7f05900b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0590159c90 con 0x7f0590158bc0 2023-10-14T19:04:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05901593f0 con 0x7f05901560f0 2023-10-14T19:04:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f05982d4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05901596d0 con 0x7f0578004d50 2023-10-14T19:04:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.197+0000 7f059586f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 0x7f05900c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 0x7f05900c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35638/0 (socket says 172.21.15.7:35638) 2023-10-14T19:04:55.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 -- 172.21.15.7:0/1751895270 learned_addr learned my addr 172.21.15.7:0/1751895270 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:55.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f0596871700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05901560f0 0x7f05900b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f0596070700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0578004d50 0x7f059015cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 -- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0578004d50 msgr2=0x7f059015cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0578004d50 0x7f059015cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 -- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05901560f0 msgr2=0x7f05900b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05901560f0 0x7f05900b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 -- 172.21.15.7:0/1751895270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05901599b0 con 0x7f0590158bc0 2023-10-14T19:04:55.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f059586f700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 0x7f05900c89b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0584002b20 tx=0x7f0584007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:55.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058400f8d0 con 0x7f0590158bc0 2023-10-14T19:04:55.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058400fa50 con 0x7f0590158bc0 2023-10-14T19:04:55.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058400fe10 con 0x7f0590158bc0 2023-10-14T19:04:55.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05901570c0 con 0x7f0590158bc0 2023-10-14T19:04:55.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.198+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0590159030 con 0x7f0590158bc0 2023-10-14T19:04:55.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.199+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0590156f20 con 0x7f0590158bc0 2023-10-14T19:04:55.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.199+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0584013600 con 0x7f0590158bc0 2023-10-14T19:04:55.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.200+0000 7f058e7fc700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f057c066fc0 0x7f057c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.200+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0584084860 con 0x7f0590158bc0 2023-10-14T19:04:55.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.200+0000 7f0596070700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f057c066fc0 0x7f057c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.200+0000 7f0596070700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f057c066fc0 0x7f057c069470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f05800094d0 tx=0x7f058000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.204+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0590156f20 con 0x7f0590158bc0 2023-10-14T19:04:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.402+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0590156f20 con 0x7f0590158bc0 2023-10-14T19:04:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.402+0000 7f058e7fc700 1 -- 172.21.15.7:0/1751895270 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0590156f20 con 0x7f0590158bc0 2023-10-14T19:04:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:55.404 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:04:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:04:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:04:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:04:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:04:55.405 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:04:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f057c066fc0 msgr2=0x7f057c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f057c066fc0 0x7f057c069470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f05800094d0 tx=0x7f058000b040 comp rx=0 tx=0).stop 2023-10-14T19:04:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 msgr2=0x7f05900c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 0x7f05900c89b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0584002b20 tx=0x7f0584007d30 comp rx=0 tx=0).stop 2023-10-14T19:04:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 shutdown_connections 2023-10-14T19:04:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f057c066fc0 0x7f057c069470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05901560f0 0x7f05900b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0578004d50 0x7f059015cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 --2- 172.21.15.7:0/1751895270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0590158bc0 0x7f05900c89b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 >> 172.21.15.7:0/1751895270 conn(0x7f0590070e30 msgr2=0x7f05900b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 shutdown_connections 2023-10-14T19:04:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.404+0000 7f05982d4700 1 -- 172.21.15.7:0/1751895270 wait complete. 2023-10-14T19:04:55.417 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:04:55.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:04:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.540+0000 7fd04729e700 1 Processor -- start 2023-10-14T19:04:55.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.541+0000 7fd04729e700 1 -- start start 2023-10-14T19:04:55.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.541+0000 7fd04729e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd040159530 0x7fd0400ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.541+0000 7fd04729e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 0x7fd040159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.541+0000 7fd04729e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400ccfd0 con 0x7fd040159e40 2023-10-14T19:04:55.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.541+0000 7fd04729e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04015a410 con 0x7fd040159530 2023-10-14T19:04:55.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.541+0000 7fd04729e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04015a6f0 con 0x7fd04006dcf0 2023-10-14T19:04:55.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 0x7fd040159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 0x7fd040159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:52380/0 (socket says 172.21.15.7:52380) 2023-10-14T19:04:55.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 -- 172.21.15.7:0/1301404057 learned_addr learned my addr 172.21.15.7:0/1301404057 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:55.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd04503a700 1 --2- 172.21.15.7:0/1301404057 >> v2:172.21.15.148:3300/0 conn(0x7fd040159530 0x7fd0400ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd04583b700 1 --1- 172.21.15.7:0/1301404057 >> v1:172.21.15.148:6789/0 conn(0x7fd040159e40 0x7fd0400cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:51972/0 (socket says 172.21.15.7:51972) 2023-10-14T19:04:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 -- 172.21.15.7:0/1301404057 >> v2:172.21.15.148:3300/0 conn(0x7fd040159530 msgr2=0x7fd0400ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 --2- 172.21.15.7:0/1301404057 >> v2:172.21.15.148:3300/0 conn(0x7fd040159530 0x7fd0400ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd03ffff700 1 -- 172.21.15.7:0/1301404057 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99588986 0 0) 0x7fd0400ccfd0 con 0x7fd040159e40 2023-10-14T19:04:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 -- 172.21.15.7:0/1301404057 >> v1:172.21.15.148:6789/0 conn(0x7fd040159e40 legacy=0x7fd0400cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 -- 172.21.15.7:0/1301404057 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04015a9d0 con 0x7fd04006dcf0 2023-10-14T19:04:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.542+0000 7fd044839700 1 --2- 172.21.15.7:0/1301404057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 0x7fd040159900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0340099b0 tx=0x7fd034009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7218786180ae6df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd03ffff700 1 -- 172.21.15.7:0/1301404057 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034009ea0 con 0x7fd04006dcf0 2023-10-14T19:04:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd03ffff700 1 -- 172.21.15.7:0/1301404057 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400b860 con 0x7fd04006dcf0 2023-10-14T19:04:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd03ffff700 1 -- 172.21.15.7:0/1301404057 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400bc00 con 0x7fd04006dcf0 2023-10-14T19:04:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 -- 172.21.15.7:0/1301404057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 msgr2=0x7fd040159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 --2- 172.21.15.7:0/1301404057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 0x7fd040159900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0340099b0 tx=0x7fd034009250 comp rx=0 tx=0).stop 2023-10-14T19:04:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 -- 172.21.15.7:0/1301404057 shutdown_connections 2023-10-14T19:04:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 --2- 172.21.15.7:0/1301404057 >> v2:172.21.15.148:3300/0 conn(0x7fd040159530 0x7fd0400ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 --2- 172.21.15.7:0/1301404057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04006dcf0 0x7fd040159900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 -- 172.21.15.7:0/1301404057 >> 172.21.15.7:0/1301404057 conn(0x7fd0400703a0 msgr2=0x7fd0400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 -- 172.21.15.7:0/1301404057 shutdown_connections 2023-10-14T19:04:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.543+0000 7fd04729e700 1 -- 172.21.15.7:0/1301404057 wait complete. 2023-10-14T19:04:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.544+0000 7fd04729e700 1 Processor -- start 2023-10-14T19:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.544+0000 7fd04729e700 1 -- start start 2023-10-14T19:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04729e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04006dcf0 0x7fd0400c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04729e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040159530 0x7fd040157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04729e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 0x7fd0401695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04729e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400c8960 con 0x7fd040159e40 2023-10-14T19:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04729e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400b3f50 con 0x7fd04006dcf0 2023-10-14T19:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04729e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400b3620 con 0x7fd040159530 2023-10-14T19:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04583b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 0x7fd0401695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04583b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 0x7fd0401695f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35644/0 (socket says 172.21.15.7:35644) 2023-10-14T19:04:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04583b700 1 -- 172.21.15.7:0/514011314 learned_addr learned my addr 172.21.15.7:0/514011314 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd04503a700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04006dcf0 0x7fd0400c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.545+0000 7fd044839700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040159530 0x7fd040157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04583b700 1 -- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040159530 msgr2=0x7fd040157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04583b700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040159530 0x7fd040157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04583b700 1 -- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04006dcf0 msgr2=0x7fd0400c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04583b700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04006dcf0 0x7fd0400c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04583b700 1 -- 172.21.15.7:0/514011314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0340094f0 con 0x7fd040159e40 2023-10-14T19:04:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04583b700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 0x7fd0401695f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c4e0 tx=0x7fd030007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03000ce90 con 0x7fd040159e40 2023-10-14T19:04:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030005a70 con 0x7fd040159e40 2023-10-14T19:04:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400b3900 con 0x7fd040159e40 2023-10-14T19:04:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030005e30 con 0x7fd040159e40 2023-10-14T19:04:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.546+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0400c8680 con 0x7fd040159e40 2023-10-14T19:04:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.547+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400b40c0 con 0x7fd040159e40 2023-10-14T19:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.548+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd0300072e0 con 0x7fd040159e40 2023-10-14T19:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.548+0000 7fd03d7fa700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd02c066fc0 0x7fd02c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.548+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd030083560 con 0x7fd040159e40 2023-10-14T19:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.548+0000 7fd04503a700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd02c066fc0 0x7fd02c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.549+0000 7fd04503a700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd02c066fc0 0x7fd02c069470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd03800f570 tx=0x7fd03800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.552+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd030050b30 con 0x7fd040159e40 2023-10-14T19:04:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.748+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd04004c3c0 con 0x7fd040159e40 2023-10-14T19:04:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.927+0000 7fd03d7fa700 1 -- 172.21.15.7:0/514011314 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd030054150 con 0x7fd040159e40 2023-10-14T19:04:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd02c066fc0 msgr2=0x7fd02c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd02c066fc0 0x7fd02c069470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd03800f570 tx=0x7fd03800b040 comp rx=0 tx=0).stop 2023-10-14T19:04:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 msgr2=0x7fd0401695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 0x7fd0401695f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c4e0 tx=0x7fd030007f40 comp rx=0 tx=0).stop 2023-10-14T19:04:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 shutdown_connections 2023-10-14T19:04:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd02c066fc0 0x7fd02c069470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04006dcf0 0x7fd0400c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd040159e40 0x7fd0401695f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 --2- 172.21.15.7:0/514011314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040159530 0x7fd040157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:55.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 >> 172.21.15.7:0/514011314 conn(0x7fd0400703a0 msgr2=0x7fd0400c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:55.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 shutdown_connections 2023-10-14T19:04:55.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:55.932+0000 7fd04729e700 1 -- 172.21.15.7:0/514011314 wait complete. 2023-10-14T19:04:55.936 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:04:55.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:04:56.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.072+0000 7fd864571700 1 Processor -- start 2023-10-14T19:04:56.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.072+0000 7fd864571700 1 -- start start 2023-10-14T19:04:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd864571700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd85c06dc70 0x7fd85c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd864571700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd85c06e0e0 0x7fd85c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd864571700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0ccfd0 con 0x7fd85c159530 2023-10-14T19:04:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd864571700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c15a3d0 con 0x7fd85c06e0e0 2023-10-14T19:04:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd864571700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c15a6b0 con 0x7fd85c06dc70 2023-10-14T19:04:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd862b0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd85c06e0e0 0x7fd85c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd862b0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd85c06e0e0 0x7fd85c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35646/0 (socket says 172.21.15.7:35646) 2023-10-14T19:04:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd862b0e700 1 -- 172.21.15.7:0/1727250700 learned_addr learned my addr 172.21.15.7:0/1727250700 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd861b0c700 1 --2- 172.21.15.7:0/1727250700 >> v2:172.21.15.148:3300/0 conn(0x7fd85c06dc70 0x7fd85c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd862b0e700 1 -- 172.21.15.7:0/1727250700 >> v2:172.21.15.148:3300/0 conn(0x7fd85c06dc70 msgr2=0x7fd85c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:56.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd862b0e700 1 --2- 172.21.15.7:0/1727250700 >> v2:172.21.15.148:3300/0 conn(0x7fd85c06dc70 0x7fd85c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.073+0000 7fd862b0e700 1 -- 172.21.15.7:0/1727250700 >> v1:172.21.15.148:6789/0 conn(0x7fd85c159530 legacy=0x7fd85c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:56.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd862b0e700 1 -- 172.21.15.7:0/1727250700 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c15a990 con 0x7fd85c06e0e0 2023-10-14T19:04:56.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd861b0c700 1 --2- 172.21.15.7:0/1727250700 >> v2:172.21.15.148:3300/0 conn(0x7fd85c06dc70 0x7fd85c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:56.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd862b0e700 1 --2- 172.21.15.7:0/1727250700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06e0e0 0x7fd85c0cb6f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b66e0 tx=0x7fd854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196e3d1cc323dd1f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:56.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd86130b700 1 -- 172.21.15.7:0/1727250700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85400b860 con 0x7fd85c06e0e0 2023-10-14T19:04:56.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd86130b700 1 -- 172.21.15.7:0/1727250700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85400b9c0 con 0x7fd85c06e0e0 2023-10-14T19:04:56.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd86130b700 1 -- 172.21.15.7:0/1727250700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85400bd60 con 0x7fd85c06e0e0 2023-10-14T19:04:56.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd864571700 1 -- 172.21.15.7:0/1727250700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06e0e0 msgr2=0x7fd85c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:56.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd864571700 1 --2- 172.21.15.7:0/1727250700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06e0e0 0x7fd85c0cb6f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b66e0 tx=0x7fd854009250 comp rx=0 tx=0).stop 2023-10-14T19:04:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd864571700 1 -- 172.21.15.7:0/1727250700 shutdown_connections 2023-10-14T19:04:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd864571700 1 --2- 172.21.15.7:0/1727250700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06e0e0 0x7fd85c0cb6f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd864571700 1 --2- 172.21.15.7:0/1727250700 >> v2:172.21.15.148:3300/0 conn(0x7fd85c06dc70 0x7fd85c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.074+0000 7fd864571700 1 -- 172.21.15.7:0/1727250700 >> 172.21.15.7:0/1727250700 conn(0x7fd85c0703a0 msgr2=0x7fd85c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.075+0000 7fd864571700 1 -- 172.21.15.7:0/1727250700 shutdown_connections 2023-10-14T19:04:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.075+0000 7fd864571700 1 -- 172.21.15.7:0/1727250700 wait complete. 2023-10-14T19:04:56.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 Processor -- start 2023-10-14T19:04:56.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 -- start start 2023-10-14T19:04:56.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 0x7fd85c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:56.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd85c06e0e0 0x7fd85c146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:56.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd85c159530 0x7fd85c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:56.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b64d0 con 0x7fd85c06dc70 2023-10-14T19:04:56.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b4470 con 0x7fd85c06e0e0 2023-10-14T19:04:56.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd864571700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b3860 con 0x7fd85c159530 2023-10-14T19:04:56.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd86230d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 0x7fd85c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:56.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd86230d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 0x7fd85c0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35650/0 (socket says 172.21.15.7:35650) 2023-10-14T19:04:56.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.076+0000 7fd86230d700 1 -- 172.21.15.7:0/325268076 learned_addr learned my addr 172.21.15.7:0/325268076 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:56.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd861b0c700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd85c06e0e0 0x7fd85c146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:56.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd862b0e700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd85c159530 0x7fd85c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:56.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd86230d700 1 -- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd85c159530 msgr2=0x7fd85c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:56.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd86230d700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd85c159530 0x7fd85c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd86230d700 1 -- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd85c06e0e0 msgr2=0x7fd85c146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:56.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd86230d700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd85c06e0e0 0x7fd85c146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd86230d700 1 -- 172.21.15.7:0/325268076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540094f0 con 0x7fd85c06dc70 2023-10-14T19:04:56.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd86230d700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 0x7fd85c0b4900 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c940 tx=0x7fd84c0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:56.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c012630 con 0x7fd85c06dc70 2023-10-14T19:04:56.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c0127b0 con 0x7fd85c06dc70 2023-10-14T19:04:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c0b3b40 con 0x7fd85c06dc70 2023-10-14T19:04:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c012b70 con 0x7fd85c06dc70 2023-10-14T19:04:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.077+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c0b4100 con 0x7fd85c06dc70 2023-10-14T19:04:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.078+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c0b4750 con 0x7fd85c06dc70 2023-10-14T19:04:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.079+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd84c003030 con 0x7fd85c06dc70 2023-10-14T19:04:56.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.079+0000 7fd85a7fc700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd848066fc0 0x7fd848069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:56.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.080+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd84c0842b0 con 0x7fd85c06dc70 2023-10-14T19:04:56.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.080+0000 7fd861b0c700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd848066fc0 0x7fd848069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:56.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.080+0000 7fd861b0c700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd848066fc0 0x7fd848069470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b5ab0 tx=0x7fd850008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:56.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.084+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd84c0551a0 con 0x7fd85c06dc70 2023-10-14T19:04:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.278+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd85c0b4e40 con 0x7fd85c06dc70 2023-10-14T19:04:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.934+0000 7fd85a7fc700 1 -- 172.21.15.7:0/325268076 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd84c054d30 con 0x7fd85c06dc70 2023-10-14T19:04:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd848066fc0 msgr2=0x7fd848069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd848066fc0 0x7fd848069470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b5ab0 tx=0x7fd850008040 comp rx=0 tx=0).stop 2023-10-14T19:04:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 msgr2=0x7fd85c0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 0x7fd85c0b4900 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c940 tx=0x7fd84c0016b0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 shutdown_connections 2023-10-14T19:04:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd848066fc0 0x7fd848069470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd85c159530 0x7fd85c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd85c06dc70 0x7fd85c0b4900 secure :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c940 tx=0x7fd84c0016b0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.940+0000 7fd864571700 1 --2- 172.21.15.7:0/325268076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd85c06e0e0 0x7fd85c146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.941+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 >> 172.21.15.7:0/325268076 conn(0x7fd85c0703a0 msgr2=0x7fd85c153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.941+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 shutdown_connections 2023-10-14T19:04:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:56.941+0000 7fd864571700 1 -- 172.21.15.7:0/325268076 wait complete. 2023-10-14T19:04:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:04:56.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:04:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.090+0000 7fa518b76700 1 Processor -- start 2023-10-14T19:04:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.090+0000 7fa518b76700 1 -- start start 2023-10-14T19:04:57.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa518b76700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa514159530 0x7fa5140ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:57.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa518b76700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406dc70 0x7fa514159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa518b76700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5140ccfd0 con 0x7fa51406e0e0 2023-10-14T19:04:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa518b76700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5140cf0e0 con 0x7fa514159530 2023-10-14T19:04:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa518b76700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51415a3d0 con 0x7fa51406dc70 2023-10-14T19:04:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa51259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa514159530 0x7fa5140ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:57.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa512d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa51406e0e0 0x7fa5140cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50830/0 (socket says 172.21.15.7:50830) 2023-10-14T19:04:57.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa512d9d700 1 -- 172.21.15.7:0/1412566534 learned_addr learned my addr 172.21.15.7:0/1412566534 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:57.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa51259c700 1 -- 172.21.15.7:0/1412566534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406dc70 msgr2=0x7fa514159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:57.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa511d9b700 1 --2- 172.21.15.7:0/1412566534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406dc70 0x7fa514159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:57.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa51259c700 1 --2- 172.21.15.7:0/1412566534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406dc70 0x7fa514159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa51259c700 1 -- 172.21.15.7:0/1412566534 >> v1:172.21.15.7:6789/0 conn(0x7fa51406e0e0 legacy=0x7fa5140cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:57.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa51259c700 1 -- 172.21.15.7:0/1412566534 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51415a6b0 con 0x7fa514159530 2023-10-14T19:04:57.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.091+0000 7fa51159a700 1 -- 172.21.15.7:0/1412566534 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130677026 0 0) 0x7fa5140ccfd0 con 0x7fa51406e0e0 2023-10-14T19:04:57.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa51259c700 1 --2- 172.21.15.7:0/1412566534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa514159530 0x7fa5140ceba0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa5040098e0 tx=0x7fa5040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaf51110d2ad797 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:57.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa51159a700 1 -- 172.21.15.7:0/1412566534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504009e80 con 0x7fa514159530 2023-10-14T19:04:57.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa51159a700 1 -- 172.21.15.7:0/1412566534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400b860 con 0x7fa514159530 2023-10-14T19:04:57.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa51159a700 1 -- 172.21.15.7:0/1412566534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bbe0 con 0x7fa514159530 2023-10-14T19:04:57.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 -- 172.21.15.7:0/1412566534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa514159530 msgr2=0x7fa5140ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:57.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 --2- 172.21.15.7:0/1412566534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa514159530 0x7fa5140ceba0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa5040098e0 tx=0x7fa5040091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 -- 172.21.15.7:0/1412566534 shutdown_connections 2023-10-14T19:04:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 --2- 172.21.15.7:0/1412566534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa514159530 0x7fa5140ceba0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 --2- 172.21.15.7:0/1412566534 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406dc70 0x7fa514159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 -- 172.21.15.7:0/1412566534 >> 172.21.15.7:0/1412566534 conn(0x7fa5140703a0 msgr2=0x7fa5140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 -- 172.21.15.7:0/1412566534 shutdown_connections 2023-10-14T19:04:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.092+0000 7fa518b76700 1 -- 172.21.15.7:0/1412566534 wait complete. 2023-10-14T19:04:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.093+0000 7fa518b76700 1 Processor -- start 2023-10-14T19:04:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 -- start start 2023-10-14T19:04:57.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 0x7fa51414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406e0e0 0x7fa5140b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa514159530 0x7fa5140b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140b4230 con 0x7fa51406dc70 2023-10-14T19:04:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140b3620 con 0x7fa514159530 2023-10-14T19:04:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa518b76700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140b3900 con 0x7fa51406e0e0 2023-10-14T19:04:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa51259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 0x7fa51414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa51259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 0x7fa51414e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60082/0 (socket says 172.21.15.7:60082) 2023-10-14T19:04:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa51259c700 1 -- 172.21.15.7:0/819826140 learned_addr learned my addr 172.21.15.7:0/819826140 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.094+0000 7fa511d9b700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406e0e0 0x7fa5140b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa512d9d700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa514159530 0x7fa5140b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa51259c700 1 -- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406e0e0 msgr2=0x7fa5140b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa51259c700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406e0e0 0x7fa5140b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa51259c700 1 -- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa514159530 msgr2=0x7fa5140b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa51259c700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa514159530 0x7fa5140b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa51259c700 1 -- 172.21.15.7:0/819826140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009420 con 0x7fa51406dc70 2023-10-14T19:04:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa511d9b700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406e0e0 0x7fa5140b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa512d9d700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa514159530 0x7fa5140b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa51259c700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 0x7fa51414e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa514089650 tx=0x7fa504017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bbe0 con 0x7fa51406dc70 2023-10-14T19:04:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504011420 con 0x7fa51406dc70 2023-10-14T19:04:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140b3be0 con 0x7fa51406dc70 2023-10-14T19:04:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040117c0 con 0x7fa51406dc70 2023-10-14T19:04:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.095+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51414e830 con 0x7fa51406dc70 2023-10-14T19:04:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.096+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51404c3c0 con 0x7fa51406dc70 2023-10-14T19:04:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.096+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa504011bb0 con 0x7fa51406dc70 2023-10-14T19:04:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.097+0000 7fa50a7fc700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa4f4066fc0 0x7fa4f4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.097+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fa504085c00 con 0x7fa51406dc70 2023-10-14T19:04:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.097+0000 7fa511d9b700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa4f4066fc0 0x7fa4f4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.098+0000 7fa511d9b700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa4f4066fc0 0x7fa4f4069470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b2370 tx=0x7fa4fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.102+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa50408b020 con 0x7fa51406dc70 2023-10-14T19:04:57.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.339+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa51415a990 con 0x7fa51406dc70 2023-10-14T19:04:57.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.959+0000 7fa50a7fc700 1 -- 172.21.15.7:0/819826140 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa504011e60 con 0x7fa51406dc70 2023-10-14T19:04:57.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.963+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa4f4066fc0 msgr2=0x7fa4f4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:57.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.963+0000 7fa518b76700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa4f4066fc0 0x7fa4f4069470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b2370 tx=0x7fa4fc008040 comp rx=0 tx=0).stop 2023-10-14T19:04:57.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.963+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 msgr2=0x7fa51414e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:57.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.963+0000 7fa518b76700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 0x7fa51414e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa514089650 tx=0x7fa504017000 comp rx=0 tx=0).stop 2023-10-14T19:04:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 shutdown_connections 2023-10-14T19:04:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa4f4066fc0 0x7fa4f4069470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa514159530 0x7fa5140b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51406dc70 0x7fa51414e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 --2- 172.21.15.7:0/819826140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51406e0e0 0x7fa5140b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:57.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 >> 172.21.15.7:0/819826140 conn(0x7fa5140703a0 msgr2=0x7fa5140cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:57.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 shutdown_connections 2023-10-14T19:04:57.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:57.964+0000 7fa518b76700 1 -- 172.21.15.7:0/819826140 wait complete. 2023-10-14T19:04:57.967 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 10 and data pool 11 2023-10-14T19:04:57.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:58.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.098+0000 7fef0d32c700 1 Processor -- start 2023-10-14T19:04:58.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.098+0000 7fef0d32c700 1 -- start start 2023-10-14T19:04:58.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.098+0000 7fef0d32c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef080aec90 0x7fef0815df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.098+0000 7fef0d32c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0815a750 con 0x7fef0806cdb0 2023-10-14T19:04:58.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.098+0000 7fef0d32c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef08159e40 con 0x7fef0815d440 2023-10-14T19:04:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.098+0000 7fef0d32c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef080af110 con 0x7fef080aec90 2023-10-14T19:04:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef077fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef080aec90 0x7fef0815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef067fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fef0806cdb0 0x7fef0815d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50836/0 (socket says 172.21.15.7:50836) 2023-10-14T19:04:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef067fc700 1 -- 172.21.15.7:0/1486509787 learned_addr learned my addr 172.21.15.7:0/1486509787 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef05ffb700 1 -- 172.21.15.7:0/1486509787 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591761218 0 0) 0x7fef0815a750 con 0x7fef0806cdb0 2023-10-14T19:04:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef05ffb700 1 -- 172.21.15.7:0/1486509787 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feef4003570 con 0x7fef0806cdb0 2023-10-14T19:04:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef077fe700 1 -- 172.21.15.7:0/1486509787 >> v1:172.21.15.148:6789/0 conn(0x7fef0815d440 legacy=0x7fef0806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef077fe700 1 -- 172.21.15.7:0/1486509787 >> v1:172.21.15.7:6789/0 conn(0x7fef0806cdb0 legacy=0x7fef0815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef05ffb700 1 -- 172.21.15.7:0/1486509787 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340941578 0 0) 0x7fef08159e40 con 0x7fef0815d440 2023-10-14T19:04:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef077fe700 1 -- 172.21.15.7:0/1486509787 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080af300 con 0x7fef080aec90 2023-10-14T19:04:58.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef077fe700 1 --2- 172.21.15.7:0/1486509787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0815df20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feef80098e0 tx=0x7feef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674b6971f2c38327 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef05ffb700 1 -- 172.21.15.7:0/1486509787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800b640 con 0x7fef080aec90 2023-10-14T19:04:58.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef05ffb700 1 -- 172.21.15.7:0/1486509787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800b7a0 con 0x7fef080aec90 2023-10-14T19:04:58.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.099+0000 7fef05ffb700 1 -- 172.21.15.7:0/1486509787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800bb40 con 0x7fef080aec90 2023-10-14T19:04:58.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 -- 172.21.15.7:0/1486509787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 msgr2=0x7fef0815df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 --2- 172.21.15.7:0/1486509787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0815df20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feef80098e0 tx=0x7feef80091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 -- 172.21.15.7:0/1486509787 shutdown_connections 2023-10-14T19:04:58.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 --2- 172.21.15.7:0/1486509787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0815df20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 -- 172.21.15.7:0/1486509787 >> 172.21.15.7:0/1486509787 conn(0x7fef0806f190 msgr2=0x7fef080ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:58.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 -- 172.21.15.7:0/1486509787 shutdown_connections 2023-10-14T19:04:58.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.100+0000 7fef0d32c700 1 -- 172.21.15.7:0/1486509787 wait complete. 2023-10-14T19:04:58.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.101+0000 7fef0d32c700 1 Processor -- start 2023-10-14T19:04:58.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.101+0000 7fef0d32c700 1 -- start start 2023-10-14T19:04:58.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef0806cdb0 0x7fef08158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef0815d440 0x7fef08152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080b0920 con 0x7fef080aec90 2023-10-14T19:04:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080b0c00 con 0x7fef0815d440 2023-10-14T19:04:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0814ccf0 con 0x7fef0806cdb0 2023-10-14T19:04:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0814c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60110/0 (socket says 172.21.15.7:60110) 2023-10-14T19:04:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 -- 172.21.15.7:0/468420698 learned_addr learned my addr 172.21.15.7:0/468420698 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef077fe700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef0815d440 0x7fef08152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 -- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef0806cdb0 msgr2=0x7fef08158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef06ffd700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef0806cdb0 0x7fef08158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef0806cdb0 0x7fef08158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 -- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef0815d440 msgr2=0x7fef08152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef0815d440 0x7fef08152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 -- 172.21.15.7:0/468420698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009420 con 0x7fef080aec90 2023-10-14T19:04:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef077fe700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef0815d440 0x7fef08152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:04:58.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef067fc700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0814c7b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feef000c5c0 tx=0x7feef0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0005c00 con 0x7fef080aec90 2023-10-14T19:04:58.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0005d60 con 0x7fef080aec90 2023-10-14T19:04:58.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0806adb0 con 0x7fef080aec90 2023-10-14T19:04:58.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00072e0 con 0x7fef080aec90 2023-10-14T19:04:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.102+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef081519c0 con 0x7fef080aec90 2023-10-14T19:04:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.103+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0804c3c0 con 0x7fef080aec90 2023-10-14T19:04:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.104+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7feef0007690 con 0x7fef080aec90 2023-10-14T19:04:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.104+0000 7feefeffd700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feee8066fc0 0x7feee8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.104+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feef0083a00 con 0x7fef080aec90 2023-10-14T19:04:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.104+0000 7fef06ffd700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feee8066fc0 0x7feee8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.105+0000 7fef06ffd700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feee8066fc0 0x7feee8069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fef00001560 tx=0x7fef00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.109+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feef0050c80 con 0x7fef080aec90 2023-10-14T19:04:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.301+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef0806d490 con 0x7fef080aec90 2023-10-14T19:04:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.302+0000 7feefeffd700 1 -- 172.21.15.7:0/468420698 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15318 (secure 0 0 0) 0x7feef0017020 con 0x7fef080aec90 2023-10-14T19:04:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:58.303 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":63,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:57.340546+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:55.778802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:56.308884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feee8066fc0 msgr2=0x7feee8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feee8066fc0 0x7feee8069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fef00001560 tx=0x7fef00009040 comp rx=0 tx=0).stop 2023-10-14T19:04:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 msgr2=0x7fef0814c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0814c7b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feef000c5c0 tx=0x7feef0007d90 comp rx=0 tx=0).stop 2023-10-14T19:04:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 shutdown_connections 2023-10-14T19:04:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feee8066fc0 0x7feee8069470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef0815d440 0x7fef08152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef0806cdb0 0x7fef08158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 --2- 172.21.15.7:0/468420698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef080aec90 0x7fef0814c7b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 >> 172.21.15.7:0/468420698 conn(0x7fef0806f190 msgr2=0x7fef0815ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 shutdown_connections 2023-10-14T19:04:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.304+0000 7fef0d32c700 1 -- 172.21.15.7:0/468420698 wait complete. 2023-10-14T19:04:58.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:04:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 Processor -- start 2023-10-14T19:04:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 -- start start 2023-10-14T19:04:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8de80cb5a0 0x7f8de80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8de80cd9e0 0x7f8de8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de815ae40 con 0x7f8de815a400 2023-10-14T19:04:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80d13f0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.436+0000 7f8deda45700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de815ab60 con 0x7f8de80cd9e0 2023-10-14T19:04:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8de80cb5a0 0x7f8de80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de77fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8de815a400 0x7f8de8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50840/0 (socket says 172.21.15.7:50840) 2023-10-14T19:04:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de77fe700 1 -- 172.21.15.7:0/2555412993 learned_addr learned my addr 172.21.15.7:0/2555412993 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de67fc700 1 --2- 172.21.15.7:0/2555412993 >> v2:172.21.15.148:3300/0 conn(0x7f8de80cd9e0 0x7f8de8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de6ffd700 1 -- 172.21.15.7:0/2555412993 >> v2:172.21.15.148:3300/0 conn(0x7f8de80cd9e0 msgr2=0x7f8de8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de6ffd700 1 --2- 172.21.15.7:0/2555412993 >> v2:172.21.15.148:3300/0 conn(0x7f8de80cd9e0 0x7f8de8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de6ffd700 1 -- 172.21.15.7:0/2555412993 >> v1:172.21.15.7:6789/0 conn(0x7f8de815a400 legacy=0x7f8de8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de6ffd700 1 -- 172.21.15.7:0/2555412993 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80ccf00 con 0x7f8de80cb5a0 2023-10-14T19:04:58.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de67fc700 1 --2- 172.21.15.7:0/2555412993 >> v2:172.21.15.148:3300/0 conn(0x7f8de80cd9e0 0x7f8de8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:04:58.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de6ffd700 1 --2- 172.21.15.7:0/2555412993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80cb970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009e60 tx=0x7f8de0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f65ab735a32a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de5ffb700 1 -- 172.21.15.7:0/2555412993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000e070 con 0x7f8de80cb5a0 2023-10-14T19:04:58.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de5ffb700 1 -- 172.21.15.7:0/2555412993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de000bbf0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.437+0000 7f8de5ffb700 1 -- 172.21.15.7:0/2555412993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0012430 con 0x7f8de80cb5a0 2023-10-14T19:04:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 -- 172.21.15.7:0/2555412993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 msgr2=0x7f8de80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 --2- 172.21.15.7:0/2555412993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80cb970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009e60 tx=0x7f8de0009780 comp rx=0 tx=0).stop 2023-10-14T19:04:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 -- 172.21.15.7:0/2555412993 shutdown_connections 2023-10-14T19:04:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 --2- 172.21.15.7:0/2555412993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80cb970 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 --2- 172.21.15.7:0/2555412993 >> v2:172.21.15.148:3300/0 conn(0x7f8de80cd9e0 0x7f8de8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 -- 172.21.15.7:0/2555412993 >> 172.21.15.7:0/2555412993 conn(0x7f8de8070e30 msgr2=0x7f8de80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 -- 172.21.15.7:0/2555412993 shutdown_connections 2023-10-14T19:04:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.438+0000 7f8deda45700 1 -- 172.21.15.7:0/2555412993 wait complete. 2023-10-14T19:04:58.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.439+0000 7f8deda45700 1 Processor -- start 2023-10-14T19:04:58.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.439+0000 7f8deda45700 1 -- start start 2023-10-14T19:04:58.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8deda45700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8deda45700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8de80cd9e0 0x7f8de8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8deda45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de815a400 0x7f8de80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8deda45700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80c8890 con 0x7f8de80cb5a0 2023-10-14T19:04:58.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8deda45700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de816ade0 con 0x7f8de815a400 2023-10-14T19:04:58.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8deda45700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de816b0c0 con 0x7f8de80cd9e0 2023-10-14T19:04:58.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60134/0 (socket says 172.21.15.7:60134) 2023-10-14T19:04:58.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 -- 172.21.15.7:0/4068875722 learned_addr learned my addr 172.21.15.7:0/4068875722 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:58.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 -- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8de80cd9e0 msgr2=0x7f8de8153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8de80cd9e0 0x7f8de8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 -- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de815a400 msgr2=0x7f8de80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de815a400 0x7f8de80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 -- 172.21.15.7:0/4068875722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de0009a20 con 0x7f8de80cb5a0 2023-10-14T19:04:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.440+0000 7f8de6ffd700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80c8060 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8de00097c0 tx=0x7f8de0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.441+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0012e60 con 0x7f8de80cb5a0 2023-10-14T19:04:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.441+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0027470 con 0x7f8de80cb5a0 2023-10-14T19:04:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.441+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de816b3a0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.441+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0027810 con 0x7f8de80cb5a0 2023-10-14T19:04:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.441+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de80c85a0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.442+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de804c3c0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.442+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8de0024070 con 0x7f8de80cb5a0 2023-10-14T19:04:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.442+0000 7f8ddeffd700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8dc8066fc0 0x7f8dc8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.442+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8de0086c50 con 0x7f8de80cb5a0 2023-10-14T19:04:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.443+0000 7f8de67fc700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8dc8066fc0 0x7f8dc8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.443+0000 7f8de67fc700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8dc8066fc0 0x7f8dc8069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0006fd0 tx=0x7f8dd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.446+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8de0053ed0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.639+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8de80cd1e0 con 0x7f8de80cb5a0 2023-10-14T19:04:58.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.639+0000 7f8ddeffd700 1 -- 172.21.15.7:0/4068875722 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f8de0009880 con 0x7f8de80cb5a0 2023-10-14T19:04:58.640 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:04:58.641 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":63,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:57.340546+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:55.778802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:56.308884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:04:58.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8dc8066fc0 msgr2=0x7f8dc8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8dc8066fc0 0x7f8dc8069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0006fd0 tx=0x7f8dd0008040 comp rx=0 tx=0).stop 2023-10-14T19:04:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 msgr2=0x7f8de80c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80c8060 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8de00097c0 tx=0x7f8de0019000 comp rx=0 tx=0).stop 2023-10-14T19:04:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 shutdown_connections 2023-10-14T19:04:58.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8dc8066fc0 0x7f8dc8069470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de815a400 0x7f8de80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8de80cb5a0 0x7f8de80c8060 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 --2- 172.21.15.7:0/4068875722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8de80cd9e0 0x7f8de8153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 >> 172.21.15.7:0/4068875722 conn(0x7f8de8070e30 msgr2=0x7f8de80b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:58.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 shutdown_connections 2023-10-14T19:04:58.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.641+0000 7f8deda45700 1 -- 172.21.15.7:0/4068875722 wait complete. 2023-10-14T19:04:58.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:04:58.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.777+0000 7efe609af700 1 Processor -- start 2023-10-14T19:04:58.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.777+0000 7efe609af700 1 -- start start 2023-10-14T19:04:58.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe609af700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe5c159530 0x7efe5c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe609af700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe609af700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c0ccfd0 con 0x7efe5c06dc70 2023-10-14T19:04:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe609af700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c0cf0e0 con 0x7efe5c159530 2023-10-14T19:04:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe609af700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c15a3d0 con 0x7efe5c06e0e0 2023-10-14T19:04:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe5c159530 0x7efe5c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe59d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efe5c06dc70 0x7efe5c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50850/0 (socket says 172.21.15.7:50850) 2023-10-14T19:04:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe59d9b700 1 -- 172.21.15.7:0/2435003628 learned_addr learned my addr 172.21.15.7:0/2435003628 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:04:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5ad9d700 1 --2- 172.21.15.7:0/2435003628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5a59c700 1 -- 172.21.15.7:0/2435003628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 msgr2=0x7efe5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:04:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5a59c700 1 --2- 172.21.15.7:0/2435003628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5a59c700 1 -- 172.21.15.7:0/2435003628 >> v1:172.21.15.7:6789/0 conn(0x7efe5c06dc70 legacy=0x7efe5c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5a59c700 1 -- 172.21.15.7:0/2435003628 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c15a6b0 con 0x7efe5c159530 2023-10-14T19:04:58.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5959a700 1 -- 172.21.15.7:0/2435003628 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139345220 0 0) 0x7efe5c0ccfd0 con 0x7efe5c06dc70 2023-10-14T19:04:58.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5a59c700 1 --2- 172.21.15.7:0/2435003628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c159530 0x7efe5c0ceba0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efe540098e0 tx=0x7efe540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f24a1f8bfae309 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.778+0000 7efe5959a700 1 -- 172.21.15.7:0/2435003628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54009e80 con 0x7efe5c159530 2023-10-14T19:04:58.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe5959a700 1 -- 172.21.15.7:0/2435003628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5400b860 con 0x7efe5c159530 2023-10-14T19:04:58.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe5959a700 1 -- 172.21.15.7:0/2435003628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5400bbe0 con 0x7efe5c159530 2023-10-14T19:04:58.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 -- 172.21.15.7:0/2435003628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c159530 msgr2=0x7efe5c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 --2- 172.21.15.7:0/2435003628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c159530 0x7efe5c0ceba0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efe540098e0 tx=0x7efe540091a0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 -- 172.21.15.7:0/2435003628 shutdown_connections 2023-10-14T19:04:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 --2- 172.21.15.7:0/2435003628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c159530 0x7efe5c0ceba0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 --2- 172.21.15.7:0/2435003628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 -- 172.21.15.7:0/2435003628 >> 172.21.15.7:0/2435003628 conn(0x7efe5c0703a0 msgr2=0x7efe5c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 -- 172.21.15.7:0/2435003628 shutdown_connections 2023-10-14T19:04:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.779+0000 7efe609af700 1 -- 172.21.15.7:0/2435003628 wait complete. 2023-10-14T19:04:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.780+0000 7efe609af700 1 Processor -- start 2023-10-14T19:04:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.780+0000 7efe609af700 1 -- start start 2023-10-14T19:04:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe609af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 0x7efe5c0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe609af700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe609af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe5c159530 0x7efe5c147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe609af700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c154c30 con 0x7efe5c06dc70 2023-10-14T19:04:58.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe609af700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c0c8340 con 0x7efe5c159530 2023-10-14T19:04:58.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe609af700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c0c8620 con 0x7efe5c06e0e0 2023-10-14T19:04:58.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 0x7efe5c0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 0x7efe5c0cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60152/0 (socket says 172.21.15.7:60152) 2023-10-14T19:04:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 -- 172.21.15.7:0/4266321632 learned_addr learned my addr 172.21.15.7:0/4266321632 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:04:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 -- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 msgr2=0x7efe5c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 -- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe5c159530 msgr2=0x7efe5c147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe5c159530 0x7efe5c147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 -- 172.21.15.7:0/4266321632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009420 con 0x7efe5c06dc70 2023-10-14T19:04:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.781+0000 7efe5a59c700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 0x7efe5c0cb700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efe5c089650 tx=0x7efe54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.782+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5400bbe0 con 0x7efe5c06dc70 2023-10-14T19:04:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.782+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54011420 con 0x7efe5c06dc70 2023-10-14T19:04:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.782+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540117c0 con 0x7efe5c06dc70 2023-10-14T19:04:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.782+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c0c8900 con 0x7efe5c06dc70 2023-10-14T19:04:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.782+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c0c8ec0 con 0x7efe5c06dc70 2023-10-14T19:04:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.782+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c0c90e0 con 0x7efe5c06dc70 2023-10-14T19:04:58.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.783+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7efe54011bb0 con 0x7efe5c06dc70 2023-10-14T19:04:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.783+0000 7efe527fc700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe3c066fc0 0x7efe3c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:04:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.783+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe54085e90 con 0x7efe5c06dc70 2023-10-14T19:04:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.784+0000 7efe59d9b700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe3c066fc0 0x7efe3c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:04:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.784+0000 7efe59d9b700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe3c066fc0 0x7efe3c069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0b29e0 tx=0x7efe440079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:04:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:58.788+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe54053110 con 0x7efe5c06dc70 2023-10-14T19:04:59.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.032+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe5c04c3c0 con 0x7efe5c06dc70 2023-10-14T19:04:59.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.972+0000 7efe527fc700 1 -- 172.21.15.7:0/4266321632 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe54011e60 con 0x7efe5c06dc70 2023-10-14T19:04:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.974+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe3c066fc0 msgr2=0x7efe3c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.974+0000 7efe609af700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe3c066fc0 0x7efe3c069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0b29e0 tx=0x7efe440079d0 comp rx=0 tx=0).stop 2023-10-14T19:04:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 msgr2=0x7efe5c0cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:04:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 0x7efe5c0cb700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efe5c089650 tx=0x7efe54017000 comp rx=0 tx=0).stop 2023-10-14T19:04:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 shutdown_connections 2023-10-14T19:04:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe3c066fc0 0x7efe3c069470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe5c159530 0x7efe5c147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe5c06dc70 0x7efe5c0cb700 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 --2- 172.21.15.7:0/4266321632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe5c06e0e0 0x7efe5c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:04:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 >> 172.21.15.7:0/4266321632 conn(0x7efe5c0703a0 msgr2=0x7efe5c155000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:04:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 shutdown_connections 2023-10-14T19:04:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:04:59.975+0000 7efe609af700 1 -- 172.21.15.7:0/4266321632 wait complete. 2023-10-14T19:04:59.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:05:00.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.119+0000 7fd0899aa700 1 Processor -- start 2023-10-14T19:05:00.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.119+0000 7fd0899aa700 1 -- start start 2023-10-14T19:05:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0899aa700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 0x7fd0840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0899aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd08406e0e0 0x7fd0840cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0899aa700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840ccfd0 con 0x7fd08406dc70 2023-10-14T19:05:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0899aa700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840cf0e0 con 0x7fd08406e0e0 2023-10-14T19:05:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0899aa700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415a3d0 con 0x7fd084159530 2023-10-14T19:05:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0827fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd08406dc70 0x7fd084159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50860/0 (socket says 172.21.15.7:50860) 2023-10-14T19:05:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0827fc700 1 -- 172.21.15.7:0/4210333231 learned_addr learned my addr 172.21.15.7:0/4210333231 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd082ffd700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 0x7fd0840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd0837fe700 1 --2- 172.21.15.7:0/4210333231 >> v2:172.21.15.148:3300/0 conn(0x7fd08406e0e0 0x7fd0840cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284130700 0 0) 0x7fd0840ccfd0 con 0x7fd08406dc70 2023-10-14T19:05:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd06c003570 con 0x7fd08406dc70 2023-10-14T19:05:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615236998 0 0) 0x7fd06c003570 con 0x7fd08406dc70 2023-10-14T19:05:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 msgr2=0x7fd0840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 0x7fd0840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 >> v2:172.21.15.148:3300/0 conn(0x7fd08406e0e0 msgr2=0x7fd0840cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 --2- 172.21.15.7:0/4210333231 >> v2:172.21.15.148:3300/0 conn(0x7fd08406e0e0 0x7fd0840cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08415a6b0 con 0x7fd08406dc70 2023-10-14T19:05:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fd078001470 con 0x7fd08406dc70 2023-10-14T19:05:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 >> v1:172.21.15.7:6789/0 conn(0x7fd08406dc70 legacy=0x7fd084159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd06c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd06c004810 0x7fd06c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 0x7fd06c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840cf0e0 con 0x7fd06c003a60 2023-10-14T19:05:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415a3d0 con 0x7fd06c004810 2023-10-14T19:05:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.120+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00ba60 con 0x7fd084159530 2023-10-14T19:05:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd06c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd0827fc700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd06c004810 0x7fd06c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd0837fe700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 0x7fd06c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 -- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 msgr2=0x7fd06c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd084159530 0x7fd06c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 -- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd06c004810 msgr2=0x7fd06c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd06c004810 0x7fd06c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 -- 172.21.15.7:0/4210333231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c003570 con 0x7fd06c003a60 2023-10-14T19:05:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd082ffd700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd06c003e70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd074009c30 tx=0x7fd0740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fbffa9f8af837 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400e710 con 0x7fd06c003a60 2023-10-14T19:05:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400e870 con 0x7fd06c003a60 2023-10-14T19:05:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.121+0000 7fd081ffb700 1 -- 172.21.15.7:0/4210333231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400ec30 con 0x7fd06c003a60 2023-10-14T19:05:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0899aa700 1 -- 172.21.15.7:0/4210333231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 msgr2=0x7fd06c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0899aa700 1 --2- 172.21.15.7:0/4210333231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd06c003e70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd074009c30 tx=0x7fd0740091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0837fe700 1 -- 172.21.15.7:0/4210333231 reap_dead start 2023-10-14T19:05:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0899aa700 1 -- 172.21.15.7:0/4210333231 shutdown_connections 2023-10-14T19:05:00.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0899aa700 1 -- 172.21.15.7:0/4210333231 >> 172.21.15.7:0/4210333231 conn(0x7fd0840703a0 msgr2=0x7fd0840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0899aa700 1 -- 172.21.15.7:0/4210333231 shutdown_connections 2023-10-14T19:05:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.122+0000 7fd0899aa700 1 -- 172.21.15.7:0/4210333231 wait complete. 2023-10-14T19:05:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.123+0000 7fd0899aa700 1 Processor -- start 2023-10-14T19:05:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.123+0000 7fd0899aa700 1 -- start start 2023-10-14T19:05:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0899aa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd08414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0899aa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd08415d980 0x7fd08415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0899aa700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0840b5590 0x7fd0840b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0899aa700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b5f40 con 0x7fd06c003a60 2023-10-14T19:05:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0899aa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415e4d0 con 0x7fd08415d980 2023-10-14T19:05:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0899aa700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415e7b0 con 0x7fd0840b5590 2023-10-14T19:05:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd08414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd08414d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60172/0 (socket says 172.21.15.7:60172) 2023-10-14T19:05:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 -- 172.21.15.7:0/481316431 learned_addr learned my addr 172.21.15.7:0/481316431 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0827fc700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd08415d980 0x7fd08415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd0837fe700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0840b5590 0x7fd0840b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 -- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0840b5590 msgr2=0x7fd0840b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0840b5590 0x7fd0840b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 -- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd08415d980 msgr2=0x7fd08415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd08415d980 0x7fd08415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 -- 172.21.15.7:0/481316431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08415ea90 con 0x7fd06c003a60 2023-10-14T19:05:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.124+0000 7fd082ffd700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd08414d260 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0046d0 tx=0x7fd07401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.125+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074022070 con 0x7fd06c003a60 2023-10-14T19:05:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.125+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400e9e0 con 0x7fd06c003a60 2023-10-14T19:05:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.125+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08415ed70 con 0x7fd06c003a60 2023-10-14T19:05:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.125+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400e710 con 0x7fd06c003a60 2023-10-14T19:05:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.125+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0840b6300 con 0x7fd06c003a60 2023-10-14T19:05:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.126+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0840b3910 con 0x7fd06c003a60 2023-10-14T19:05:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.126+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd07401c660 con 0x7fd06c003a60 2023-10-14T19:05:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.126+0000 7fd06affd700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd070066fc0 0x7fd070069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.126+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd074085c70 con 0x7fd06c003a60 2023-10-14T19:05:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.127+0000 7fd0827fc700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd070066fc0 0x7fd070069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.127+0000 7fd0827fc700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd070066fc0 0x7fd070069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd078001620 tx=0x7fd078001e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.131+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd074052ef0 con 0x7fd06c003a60 2023-10-14T19:05:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.370+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd08404c3c0 con 0x7fd06c003a60 2023-10-14T19:05:00.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.972+0000 7fd06affd700 1 -- 172.21.15.7:0/481316431 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd07402b0c0 con 0x7fd06c003a60 2023-10-14T19:05:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd070066fc0 msgr2=0x7fd070069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd070066fc0 0x7fd070069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd078001620 tx=0x7fd078001e90 comp rx=0 tx=0).stop 2023-10-14T19:05:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 msgr2=0x7fd08414d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd08414d260 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0046d0 tx=0x7fd07401a000 comp rx=0 tx=0).stop 2023-10-14T19:05:00.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 shutdown_connections 2023-10-14T19:05:00.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd070066fc0 0x7fd070069470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0840b5590 0x7fd0840b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd06c003a60 0x7fd08414d260 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 --2- 172.21.15.7:0/481316431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd08415d980 0x7fd08415ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 >> 172.21.15.7:0/481316431 conn(0x7fd0840703a0 msgr2=0x7fd0840b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 shutdown_connections 2023-10-14T19:05:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:00.975+0000 7fd0899aa700 1 -- 172.21.15.7:0/481316431 wait complete. 2023-10-14T19:05:00.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:05:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.113+0000 7f13397f2700 1 Processor -- start 2023-10-14T19:05:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.113+0000 7f13397f2700 1 -- start start 2023-10-14T19:05:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13397f2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133415de50 0x7f13340cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13397f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f13340cef40 0x7f133415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13397f2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13340cf3c0 con 0x7f1334153c30 2023-10-14T19:05:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13397f2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133415afd0 con 0x7f133415de50 2023-10-14T19:05:01.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13397f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133415b2b0 con 0x7f13340cef40 2023-10-14T19:05:01.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f1333fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1334153c30 0x7f133415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50864/0 (socket says 172.21.15.7:50864) 2023-10-14T19:05:01.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f1333fff700 1 -- 172.21.15.7:0/4293374284 learned_addr learned my addr 172.21.15.7:0/4293374284 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:01.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13337fe700 1 --2- 172.21.15.7:0/4293374284 >> v2:172.21.15.7:3300/0 conn(0x7f133415de50 0x7f13340cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f1338ff1700 1 --2- 172.21.15.7:0/4293374284 >> v2:172.21.15.148:3300/0 conn(0x7f13340cef40 0x7f133415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f1332ffd700 1 -- 172.21.15.7:0/4293374284 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282920326 0 0) 0x7f13340cf3c0 con 0x7f1334153c30 2023-10-14T19:05:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f1332ffd700 1 -- 172.21.15.7:0/4293374284 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f131c003570 con 0x7f1334153c30 2023-10-14T19:05:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13337fe700 1 -- 172.21.15.7:0/4293374284 >> v2:172.21.15.148:3300/0 conn(0x7f13340cef40 msgr2=0x7f133415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13337fe700 1 --2- 172.21.15.7:0/4293374284 >> v2:172.21.15.148:3300/0 conn(0x7f13340cef40 0x7f133415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13337fe700 1 -- 172.21.15.7:0/4293374284 >> v1:172.21.15.7:6789/0 conn(0x7f1334153c30 legacy=0x7f133415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.114+0000 7f13337fe700 1 -- 172.21.15.7:0/4293374284 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133415b590 con 0x7f133415de50 2023-10-14T19:05:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13337fe700 1 --2- 172.21.15.7:0/4293374284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133415de50 0x7f13340cea00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f13340cdab0 tx=0x7f13240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1aa7bee18d04d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f1332ffd700 1 -- 172.21.15.7:0/4293374284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011630 con 0x7f133415de50 2023-10-14T19:05:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f1332ffd700 1 -- 172.21.15.7:0/4293374284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324011790 con 0x7f133415de50 2023-10-14T19:05:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f1332ffd700 1 -- 172.21.15.7:0/4293374284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011b30 con 0x7f133415de50 2023-10-14T19:05:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 -- 172.21.15.7:0/4293374284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133415de50 msgr2=0x7f13340cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 --2- 172.21.15.7:0/4293374284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133415de50 0x7f13340cea00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f13340cdab0 tx=0x7f13240091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 -- 172.21.15.7:0/4293374284 shutdown_connections 2023-10-14T19:05:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 --2- 172.21.15.7:0/4293374284 >> v2:172.21.15.148:3300/0 conn(0x7f13340cef40 0x7f133415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 --2- 172.21.15.7:0/4293374284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133415de50 0x7f13340cea00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 -- 172.21.15.7:0/4293374284 >> 172.21.15.7:0/4293374284 conn(0x7f13340703a0 msgr2=0x7f13340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 -- 172.21.15.7:0/4293374284 shutdown_connections 2023-10-14T19:05:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.115+0000 7f13397f2700 1 -- 172.21.15.7:0/4293374284 wait complete. 2023-10-14T19:05:01.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.116+0000 7f13397f2700 1 Processor -- start 2023-10-14T19:05:01.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 -- start start 2023-10-14T19:05:01.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13340cef40 0x7f13340c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 0x7f1334152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133415de50 0x7f13340cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340c7b20 con 0x7f1334153c30 2023-10-14T19:05:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340c8710 con 0x7f13340cef40 2023-10-14T19:05:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.117+0000 7f13397f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13340c89f0 con 0x7f133415de50 2023-10-14T19:05:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 0x7f1334152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 0x7f1334152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60198/0 (socket says 172.21.15.7:60198) 2023-10-14T19:05:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 -- 172.21.15.7:0/4077801143 learned_addr learned my addr 172.21.15.7:0/4077801143 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f1333fff700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13340cef40 0x7f13340c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 -- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133415de50 msgr2=0x7f13340cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133415de50 0x7f13340cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 -- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13340cef40 msgr2=0x7f13340c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13340cef40 0x7f13340c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 -- 172.21.15.7:0/4077801143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324009420 con 0x7f1334153c30 2023-10-14T19:05:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f1333fff700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13340cef40 0x7f13340c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:05:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13337fe700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 0x7f1334152f60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f133406eb00 tx=0x7f1324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011b10 con 0x7f1334153c30 2023-10-14T19:05:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13240253f0 con 0x7f1334153c30 2023-10-14T19:05:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13340c7d50 con 0x7f1334153c30 2023-10-14T19:05:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324025790 con 0x7f1334153c30 2023-10-14T19:05:01.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.118+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13340c8310 con 0x7f1334153c30 2023-10-14T19:05:01.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.119+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133404c3c0 con 0x7f1334153c30 2023-10-14T19:05:01.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.119+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1324025bc0 con 0x7f1334153c30 2023-10-14T19:05:01.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.120+0000 7f131bfff700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1320066fc0 0x7f1320069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.120+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1324085ee0 con 0x7f1334153c30 2023-10-14T19:05:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.120+0000 7f1333fff700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1320066fc0 0x7f1320069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.121+0000 7f1333fff700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1320066fc0 0x7f1320069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1328007fd0 tx=0x7f1328009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.124+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1324053160 con 0x7f1334153c30 2023-10-14T19:05:01.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.361+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13340c8b30 con 0x7f1334153c30 2023-10-14T19:05:01.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.361+0000 7f131bfff700 1 -- 172.21.15.7:0/4077801143 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f1324015020 con 0x7f1334153c30 2023-10-14T19:05:01.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:01.363 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:57.340873+0000","modified":"2023-10-14T19:05:00.971319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3259245177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3259245177},{"type":"v1","addr":"172.21.15.7:6835","nonce":3259245177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T19:05:01.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1320066fc0 msgr2=0x7f1320069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1320066fc0 0x7f1320069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1328007fd0 tx=0x7f1328009040 comp rx=0 tx=0).stop 2023-10-14T19:05:01.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 msgr2=0x7f1334152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 0x7f1334152f60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f133406eb00 tx=0x7f1324017000 comp rx=0 tx=0).stop 2023-10-14T19:05:01.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 shutdown_connections 2023-10-14T19:05:01.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1320066fc0 0x7f1320069470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13340cef40 0x7f13340c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f133415de50 0x7f13340cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 --2- 172.21.15.7:0/4077801143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1334153c30 0x7f1334152f60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.363+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 >> 172.21.15.7:0/4077801143 conn(0x7f13340703a0 msgr2=0x7f13340c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.364+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 shutdown_connections 2023-10-14T19:05:01.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.364+0000 7f13397f2700 1 -- 172.21.15.7:0/4077801143 wait complete. 2023-10-14T19:05:01.367 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 39 2023-10-14T19:05:01.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:05:01.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.494+0000 7fb108232700 1 Processor -- start 2023-10-14T19:05:01.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.495+0000 7fb108232700 1 -- start start 2023-10-14T19:05:01.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.495+0000 7fb108232700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1000cb5a0 0x7fb1000cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.495+0000 7fb108232700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1000cd9e0 0x7fb100159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.495+0000 7fb108232700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10015ae40 con 0x7fb10015a400 2023-10-14T19:05:01.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.495+0000 7fb108232700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000d13f0 con 0x7fb1000cd9e0 2023-10-14T19:05:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.495+0000 7fb108232700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10015ab60 con 0x7fb1000cb5a0 2023-10-14T19:05:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1057cd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1000cd9e0 0x7fb100159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1067cf700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb10015a400 0x7fb100156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50876/0 (socket says 172.21.15.7:50876) 2023-10-14T19:05:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1067cf700 1 -- 172.21.15.7:0/980835001 learned_addr learned my addr 172.21.15.7:0/980835001 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb105fce700 1 --2- 172.21.15.7:0/980835001 >> v2:172.21.15.148:3300/0 conn(0x7fb1000cb5a0 0x7fb1000cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1057cd700 1 -- 172.21.15.7:0/980835001 >> v2:172.21.15.148:3300/0 conn(0x7fb1000cb5a0 msgr2=0x7fb1000cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1057cd700 1 --2- 172.21.15.7:0/980835001 >> v2:172.21.15.148:3300/0 conn(0x7fb1000cb5a0 0x7fb1000cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1057cd700 1 -- 172.21.15.7:0/980835001 >> v1:172.21.15.7:6789/0 conn(0x7fb10015a400 legacy=0x7fb100156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1057cd700 1 -- 172.21.15.7:0/980835001 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000ccf00 con 0x7fb1000cd9e0 2023-10-14T19:05:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb104fcc700 1 -- 172.21.15.7:0/980835001 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107957736 0 0) 0x7fb10015ae40 con 0x7fb10015a400 2023-10-14T19:05:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb1057cd700 1 --2- 172.21.15.7:0/980835001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1000cd9e0 0x7fb100159ec0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40098e0 tx=0x7fb0f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6adc43259e0b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb104fcc700 1 -- 172.21.15.7:0/980835001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011630 con 0x7fb1000cd9e0 2023-10-14T19:05:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb104fcc700 1 -- 172.21.15.7:0/980835001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4011790 con 0x7fb1000cd9e0 2023-10-14T19:05:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.496+0000 7fb104fcc700 1 -- 172.21.15.7:0/980835001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011b30 con 0x7fb1000cd9e0 2023-10-14T19:05:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 -- 172.21.15.7:0/980835001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1000cd9e0 msgr2=0x7fb100159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 --2- 172.21.15.7:0/980835001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1000cd9e0 0x7fb100159ec0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40098e0 tx=0x7fb0f40091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 -- 172.21.15.7:0/980835001 shutdown_connections 2023-10-14T19:05:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 --2- 172.21.15.7:0/980835001 >> v2:172.21.15.148:3300/0 conn(0x7fb1000cb5a0 0x7fb1000cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 --2- 172.21.15.7:0/980835001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1000cd9e0 0x7fb100159ec0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 -- 172.21.15.7:0/980835001 >> 172.21.15.7:0/980835001 conn(0x7fb100070e30 msgr2=0x7fb1000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 -- 172.21.15.7:0/980835001 shutdown_connections 2023-10-14T19:05:01.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.497+0000 7fb108232700 1 -- 172.21.15.7:0/980835001 wait complete. 2023-10-14T19:05:01.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.498+0000 7fb108232700 1 Processor -- start 2023-10-14T19:05:01.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.498+0000 7fb108232700 1 -- start start 2023-10-14T19:05:01.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb108232700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1000cb5a0 0x7fb10015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb108232700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1000cd9e0 0x7fb1001503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb108232700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 0x7fb1000b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb108232700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10015ffc0 con 0x7fb10015a400 2023-10-14T19:05:01.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb108232700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10015f5f0 con 0x7fb1000cb5a0 2023-10-14T19:05:01.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb108232700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb100150910 con 0x7fb1000cd9e0 2023-10-14T19:05:01.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 0x7fb1000b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 0x7fb1000b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60216/0 (socket says 172.21.15.7:60216) 2023-10-14T19:05:01.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 -- 172.21.15.7:0/1821975978 learned_addr learned my addr 172.21.15.7:0/1821975978 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:01.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb105fce700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1000cb5a0 0x7fb10015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1057cd700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1000cd9e0 0x7fb1001503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 -- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1000cd9e0 msgr2=0x7fb1001503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1000cd9e0 0x7fb1001503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 -- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1000cb5a0 msgr2=0x7fb10015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1000cb5a0 0x7fb10015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 -- 172.21.15.7:0/1821975978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009420 con 0x7fb10015a400 2023-10-14T19:05:01.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb105fce700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1000cb5a0 0x7fb10015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:05:01.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.499+0000 7fb1067cf700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 0x7fb1000b34b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800cbf0 tx=0x7fb0f80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.500+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800a9c0 con 0x7fb10015a400 2023-10-14T19:05:01.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.500+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800ab20 con 0x7fb10015a400 2023-10-14T19:05:01.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.500+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10015e9e0 con 0x7fb10015a400 2023-10-14T19:05:01.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.500+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80070f0 con 0x7fb10015a400 2023-10-14T19:05:01.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.500+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10015efa0 con 0x7fb10015a400 2023-10-14T19:05:01.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.501+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10015f760 con 0x7fb10015a400 2023-10-14T19:05:01.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.501+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb0f80074e0 con 0x7fb10015a400 2023-10-14T19:05:01.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.501+0000 7fb0fdffb700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0ec066fc0 0x7fb0ec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.502+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0f8084920 con 0x7fb10015a400 2023-10-14T19:05:01.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.502+0000 7fb105fce700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0ec066fc0 0x7fb0ec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.502+0000 7fb105fce700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0ec066fc0 0x7fb0ec069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0006f00 tx=0x7fb0f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.506+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0f8051c20 con 0x7fb10015a400 2023-10-14T19:05:01.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.703+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb10004c3c0 con 0x7fb10015a400 2023-10-14T19:05:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.704+0000 7fb0fdffb700 1 -- 172.21.15.7:0/1821975978 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15305 (secure 0 0 0) 0x7fb0f8055240 con 0x7fb10015a400 2023-10-14T19:05:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:01.705 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:04:58.944803+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:55.778802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:56.308884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:05:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0ec066fc0 msgr2=0x7fb0ec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0ec066fc0 0x7fb0ec069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0006f00 tx=0x7fb0f0008040 comp rx=0 tx=0).stop 2023-10-14T19:05:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 msgr2=0x7fb1000b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 0x7fb1000b34b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800cbf0 tx=0x7fb0f80019b0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 shutdown_connections 2023-10-14T19:05:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb0ec066fc0 0x7fb0ec069470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1000cb5a0 0x7fb10015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb10015a400 0x7fb1000b34b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 --2- 172.21.15.7:0/1821975978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1000cd9e0 0x7fb1001503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 >> 172.21.15.7:0/1821975978 conn(0x7fb100070e30 msgr2=0x7fb1001552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 shutdown_connections 2023-10-14T19:05:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.706+0000 7fb108232700 1 -- 172.21.15.7:0/1821975978 wait complete. 2023-10-14T19:05:01.719 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:05:01.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:05:01.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.838+0000 7f9ea5a20700 1 Processor -- start 2023-10-14T19:05:01.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.838+0000 7f9ea5a20700 1 -- start start 2023-10-14T19:05:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9ea5a20700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00a8be0 0x7f9ea00a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9ea5a20700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ea006d280 0x7f9ea00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9ea5a20700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ea00ae780 0x7f9ea00aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9ea5a20700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea00af140 con 0x7f9ea00ae780 2023-10-14T19:05:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9ea5a20700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea00ce1a0 con 0x7f9ea006d280 2023-10-14T19:05:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9ea5a20700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00cd5d0 con 0x7f9ea00a8be0 2023-10-14T19:05:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9e9f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ea00ae780 0x7f9ea00aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9e9f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ea00ae780 0x7f9ea00aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60228/0 (socket says 172.21.15.7:60228) 2023-10-14T19:05:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.839+0000 7f9e9f7fe700 1 -- 172.21.15.7:0/3443425802 learned_addr learned my addr 172.21.15.7:0/3443425802 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9effd700 1 --2- 172.21.15.7:0/3443425802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00a8be0 0x7f9ea00a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9e7fc700 1 --2- 172.21.15.7:0/3443425802 >> v2:172.21.15.148:3300/0 conn(0x7f9ea006d280 0x7f9ea00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9f7fe700 1 -- 172.21.15.7:0/3443425802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00a8be0 msgr2=0x7f9ea00a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9f7fe700 1 --2- 172.21.15.7:0/3443425802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00a8be0 0x7f9ea00a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9f7fe700 1 -- 172.21.15.7:0/3443425802 >> v2:172.21.15.148:3300/0 conn(0x7f9ea006d280 msgr2=0x7f9ea00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9f7fe700 1 --2- 172.21.15.7:0/3443425802 >> v2:172.21.15.148:3300/0 conn(0x7f9ea006d280 0x7f9ea00b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9f7fe700 1 -- 172.21.15.7:0/3443425802 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00cd870 con 0x7f9ea00ae780 2023-10-14T19:05:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9f7fe700 1 --2- 172.21.15.7:0/3443425802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00ae780 0x7f9ea00aec00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00ce480 tx=0x7f9e90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2335921b1740b438 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9dffb700 1 -- 172.21.15.7:0/3443425802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000e070 con 0x7f9ea00ae780 2023-10-14T19:05:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9dffb700 1 -- 172.21.15.7:0/3443425802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000bae0 con 0x7f9ea00ae780 2023-10-14T19:05:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.840+0000 7f9e9dffb700 1 -- 172.21.15.7:0/3443425802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900092e0 con 0x7f9ea00ae780 2023-10-14T19:05:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 -- 172.21.15.7:0/3443425802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00ae780 msgr2=0x7f9ea00aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/3443425802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00ae780 0x7f9ea00aec00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00ce480 tx=0x7f9e90009840 comp rx=0 tx=0).stop 2023-10-14T19:05:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 -- 172.21.15.7:0/3443425802 shutdown_connections 2023-10-14T19:05:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/3443425802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00ae780 0x7f9ea00aec00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/3443425802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00a8be0 0x7f9ea00a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/3443425802 >> v2:172.21.15.148:3300/0 conn(0x7f9ea006d280 0x7f9ea00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 -- 172.21.15.7:0/3443425802 >> 172.21.15.7:0/3443425802 conn(0x7f9ea006ce80 msgr2=0x7f9ea00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:01.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 -- 172.21.15.7:0/3443425802 shutdown_connections 2023-10-14T19:05:01.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.841+0000 7f9ea5a20700 1 -- 172.21.15.7:0/3443425802 wait complete. 2023-10-14T19:05:01.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.842+0000 7f9ea5a20700 1 Processor -- start 2023-10-14T19:05:01.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.842+0000 7f9ea5a20700 1 -- start start 2023-10-14T19:05:01.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9ea5a20700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ea006d280 0x7f9ea015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9ea5a20700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 0x7f9ea00690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9ea5a20700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00ae780 0x7f9ea0069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9ea5a20700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea015b060 con 0x7f9ea00a8be0 2023-10-14T19:05:01.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9ea5a20700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00aba10 con 0x7f9ea006d280 2023-10-14T19:05:01.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9ea5a20700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00a8fb0 con 0x7f9ea00ae780 2023-10-14T19:05:01.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 0x7f9ea00690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 0x7f9ea00690d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60240/0 (socket says 172.21.15.7:60240) 2023-10-14T19:05:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 -- 172.21.15.7:0/88623987 learned_addr learned my addr 172.21.15.7:0/88623987 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9effd700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ea006d280 0x7f9ea015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9f7fe700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00ae780 0x7f9ea0069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 -- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00ae780 msgr2=0x7f9ea0069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00ae780 0x7f9ea0069610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 -- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ea006d280 msgr2=0x7f9ea015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ea006d280 0x7f9ea015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 -- 172.21.15.7:0/88623987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90009ae0 con 0x7f9ea00a8be0 2023-10-14T19:05:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e9e7fc700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 0x7f9ea00690d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800d870 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.843+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88014620 con 0x7f9ea00a8be0 2023-10-14T19:05:01.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.844+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88014780 con 0x7f9ea00a8be0 2023-10-14T19:05:01.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.844+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea00a9850 con 0x7f9ea00a8be0 2023-10-14T19:05:01.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.844+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88014b40 con 0x7f9ea00a8be0 2023-10-14T19:05:01.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.844+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea00a9200 con 0x7f9ea00a8be0 2023-10-14T19:05:01.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.845+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea00b01a0 con 0x7f9ea00a8be0 2023-10-14T19:05:01.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.845+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9e8801d400 con 0x7f9ea00a8be0 2023-10-14T19:05:01.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.845+0000 7f9e96ffd700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e80066fc0 0x7f9e80069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:01.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.845+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e88084df0 con 0x7f9ea00a8be0 2023-10-14T19:05:01.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.845+0000 7f9e9effd700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e80066fc0 0x7f9e80069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:01.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.846+0000 7f9e9effd700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e80066fc0 0x7f9e80069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e98006aa0 tx=0x7f9e98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:01.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:01.849+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e88052070 con 0x7f9ea00a8be0 2023-10-14T19:05:02.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.039+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ea00a99e0 con 0x7f9e80066fc0 2023-10-14T19:05:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.048+0000 7f9e96ffd700 1 -- 172.21.15.7:0/88623987 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286873 (secure 0 0 0) 0x7f9ea00a99e0 con 0x7f9e80066fc0 2023-10-14T19:05:02.052 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e80066fc0 msgr2=0x7f9e80069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e80066fc0 0x7f9e80069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e98006aa0 tx=0x7f9e98008040 comp rx=0 tx=0).stop 2023-10-14T19:05:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 msgr2=0x7f9ea00690d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 0x7f9ea00690d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800d870 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2023-10-14T19:05:02.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 shutdown_connections 2023-10-14T19:05:02.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e80066fc0 0x7f9e80069470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ea006d280 0x7f9ea015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ea00ae780 0x7f9ea0069610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 --2- 172.21.15.7:0/88623987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea00a8be0 0x7f9ea00690d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 >> 172.21.15.7:0/88623987 conn(0x7f9ea006ce80 msgr2=0x7f9ea00ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 shutdown_connections 2023-10-14T19:05:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.051+0000 7f9ea5a20700 1 -- 172.21.15.7:0/88623987 wait complete. 2023-10-14T19:05:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:05:02.064 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-14T19:05:01.648188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397640,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577080,"statfs":{"total":773094113280,"available":770638929920,"internally_reserved":0,"allocated":7217152,"data_stored":3719320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.720154"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.944063+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:26:07.338853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941575+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:26.019073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941142+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:26:58.398518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941517+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938590+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:36.989172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942994+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:18.468735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939237+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:00.033354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942155+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:17.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938401+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:10.234043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937485+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.946436+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:19.996006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941017+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939374+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937854+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:23.146926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938484+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937463+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937900+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:41.751751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941553+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941879+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:34.920916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939965+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937996+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937396+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945680+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:44.646695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940610+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937224+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938599+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940626+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:02.256630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936162+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940167+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:32.207725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936876+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938740+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940710+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:52.800022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941444+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953149+0000","last_change":"2023-10-14T19:04:56.953149+0000","last_active":"2023-10-14T19:04:56.953149+0000","last_peered":"2023-10-14T19:04:56.953149+0000","last_clean":"2023-10-14T19:04:56.953149+0000","last_became_active":"2023-10-14T19:04:56.952688+0000","last_became_peered":"2023-10-14T19:04:56.952688+0000","last_unstale":"2023-10-14T19:04:56.953149+0000","last_undegraded":"2023-10-14T19:04:56.953149+0000","last_fullsized":"2023-10-14T19:04:56.953149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:08.171627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937345+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:48.352293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950268+0000","last_change":"2023-10-14T19:04:56.950268+0000","last_active":"2023-10-14T19:04:56.950268+0000","last_peered":"2023-10-14T19:04:56.950268+0000","last_clean":"2023-10-14T19:04:56.950268+0000","last_became_active":"2023-10-14T19:04:56.949979+0000","last_became_peered":"2023-10-14T19:04:56.949979+0000","last_unstale":"2023-10-14T19:04:56.950268+0000","last_undegraded":"2023-10-14T19:04:56.950268+0000","last_fullsized":"2023-10-14T19:04:56.950268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941685+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:04.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951889+0000","last_change":"2023-10-14T19:04:56.951889+0000","last_active":"2023-10-14T19:04:56.951889+0000","last_peered":"2023-10-14T19:04:56.951889+0000","last_clean":"2023-10-14T19:04:56.951889+0000","last_became_active":"2023-10-14T19:04:56.951570+0000","last_became_peered":"2023-10-14T19:04:56.951570+0000","last_unstale":"2023-10-14T19:04:56.951889+0000","last_undegraded":"2023-10-14T19:04:56.951889+0000","last_fullsized":"2023-10-14T19:04:56.951889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945962+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:27.855130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948874+0000","last_change":"2023-10-14T19:04:56.948874+0000","last_active":"2023-10-14T19:04:56.948874+0000","last_peered":"2023-10-14T19:04:56.948874+0000","last_clean":"2023-10-14T19:04:56.948874+0000","last_became_active":"2023-10-14T19:04:56.948586+0000","last_became_peered":"2023-10-14T19:04:56.948586+0000","last_unstale":"2023-10-14T19:04:56.948874+0000","last_undegraded":"2023-10-14T19:04:56.948874+0000","last_fullsized":"2023-10-14T19:04:56.948874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:04.970618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936304+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:28.483829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.940818+0000","last_change":"2023-10-14T19:04:56.940818+0000","last_active":"2023-10-14T19:04:56.940818+0000","last_peered":"2023-10-14T19:04:56.940818+0000","last_clean":"2023-10-14T19:04:56.940818+0000","last_became_active":"2023-10-14T19:04:56.940545+0000","last_became_peered":"2023-10-14T19:04:56.940545+0000","last_unstale":"2023-10-14T19:04:56.940818+0000","last_undegraded":"2023-10-14T19:04:56.940818+0000","last_fullsized":"2023-10-14T19:04:56.940818+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:13.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937061+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950899+0000","last_change":"2023-10-14T19:04:56.950899+0000","last_active":"2023-10-14T19:04:56.950899+0000","last_peered":"2023-10-14T19:04:56.950899+0000","last_clean":"2023-10-14T19:04:56.950899+0000","last_became_active":"2023-10-14T19:04:56.950557+0000","last_became_peered":"2023-10-14T19:04:56.950557+0000","last_unstale":"2023-10-14T19:04:56.950899+0000","last_undegraded":"2023-10-14T19:04:56.950899+0000","last_fullsized":"2023-10-14T19:04:56.950899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:29.175822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937493+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:11.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949526+0000","last_change":"2023-10-14T19:04:56.949526+0000","last_active":"2023-10-14T19:04:56.949526+0000","last_peered":"2023-10-14T19:04:56.949526+0000","last_clean":"2023-10-14T19:04:56.949526+0000","last_became_active":"2023-10-14T19:04:56.949203+0000","last_became_peered":"2023-10-14T19:04:56.949203+0000","last_unstale":"2023-10-14T19:04:56.949526+0000","last_undegraded":"2023-10-14T19:04:56.949526+0000","last_fullsized":"2023-10-14T19:04:56.949526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936795+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948722+0000","last_change":"2023-10-14T19:04:56.948722+0000","last_active":"2023-10-14T19:04:56.948722+0000","last_peered":"2023-10-14T19:04:56.948722+0000","last_clean":"2023-10-14T19:04:56.948722+0000","last_became_active":"2023-10-14T19:04:56.948466+0000","last_became_peered":"2023-10-14T19:04:56.948466+0000","last_unstale":"2023-10-14T19:04:56.948722+0000","last_undegraded":"2023-10-14T19:04:56.948722+0000","last_fullsized":"2023-10-14T19:04:56.948722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:53.045006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938106+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943154+0000","last_change":"2023-10-14T19:04:56.943154+0000","last_active":"2023-10-14T19:04:56.943154+0000","last_peered":"2023-10-14T19:04:56.943154+0000","last_clean":"2023-10-14T19:04:56.943154+0000","last_became_active":"2023-10-14T19:04:56.942867+0000","last_became_peered":"2023-10-14T19:04:56.942867+0000","last_unstale":"2023-10-14T19:04:56.943154+0000","last_undegraded":"2023-10-14T19:04:56.943154+0000","last_fullsized":"2023-10-14T19:04:56.943154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943326+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:57.076623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949434+0000","last_change":"2023-10-14T19:04:56.949434+0000","last_active":"2023-10-14T19:04:56.949434+0000","last_peered":"2023-10-14T19:04:56.949434+0000","last_clean":"2023-10-14T19:04:56.949434+0000","last_became_active":"2023-10-14T19:04:56.949098+0000","last_became_peered":"2023-10-14T19:04:56.949098+0000","last_unstale":"2023-10-14T19:04:56.949434+0000","last_undegraded":"2023-10-14T19:04:56.949434+0000","last_fullsized":"2023-10-14T19:04:56.949434+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:34.768904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941246+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.842568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943590+0000","last_change":"2023-10-14T19:04:56.943590+0000","last_active":"2023-10-14T19:04:56.943590+0000","last_peered":"2023-10-14T19:04:56.943590+0000","last_clean":"2023-10-14T19:04:56.943590+0000","last_became_active":"2023-10-14T19:04:56.943234+0000","last_became_peered":"2023-10-14T19:04:56.943234+0000","last_unstale":"2023-10-14T19:04:56.943590+0000","last_undegraded":"2023-10-14T19:04:56.943590+0000","last_fullsized":"2023-10-14T19:04:56.943590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:05.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937960+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:02.462718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957104+0000","last_change":"2023-10-14T19:04:56.957104+0000","last_active":"2023-10-14T19:04:56.957104+0000","last_peered":"2023-10-14T19:04:56.957104+0000","last_clean":"2023-10-14T19:04:56.957104+0000","last_became_active":"2023-10-14T19:04:56.956797+0000","last_became_peered":"2023-10-14T19:04:56.956797+0000","last_unstale":"2023-10-14T19:04:56.957104+0000","last_undegraded":"2023-10-14T19:04:56.957104+0000","last_fullsized":"2023-10-14T19:04:56.957104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940913+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953495+0000","last_change":"2023-10-14T19:04:56.953495+0000","last_active":"2023-10-14T19:04:56.953495+0000","last_peered":"2023-10-14T19:04:56.953495+0000","last_clean":"2023-10-14T19:04:56.953495+0000","last_became_active":"2023-10-14T19:04:56.953230+0000","last_became_peered":"2023-10-14T19:04:56.953230+0000","last_unstale":"2023-10-14T19:04:56.953495+0000","last_undegraded":"2023-10-14T19:04:56.953495+0000","last_fullsized":"2023-10-14T19:04:56.953495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936767+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957152+0000","last_change":"2023-10-14T19:04:56.957152+0000","last_active":"2023-10-14T19:04:56.957152+0000","last_peered":"2023-10-14T19:04:56.957152+0000","last_clean":"2023-10-14T19:04:56.957152+0000","last_became_active":"2023-10-14T19:04:56.956860+0000","last_became_peered":"2023-10-14T19:04:56.956860+0000","last_unstale":"2023-10-14T19:04:56.957152+0000","last_undegraded":"2023-10-14T19:04:56.957152+0000","last_fullsized":"2023-10-14T19:04:56.957152+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:42.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936747+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948515+0000","last_change":"2023-10-14T19:04:56.948515+0000","last_active":"2023-10-14T19:04:56.948515+0000","last_peered":"2023-10-14T19:04:56.948515+0000","last_clean":"2023-10-14T19:04:56.948515+0000","last_became_active":"2023-10-14T19:04:56.948264+0000","last_became_peered":"2023-10-14T19:04:56.948264+0000","last_unstale":"2023-10-14T19:04:56.948515+0000","last_undegraded":"2023-10-14T19:04:56.948515+0000","last_fullsized":"2023-10-14T19:04:56.948515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937801+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:17:14.887218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948559+0000","last_change":"2023-10-14T19:04:56.948559+0000","last_active":"2023-10-14T19:04:56.948559+0000","last_peered":"2023-10-14T19:04:56.948559+0000","last_clean":"2023-10-14T19:04:56.948559+0000","last_became_active":"2023-10-14T19:04:56.947284+0000","last_became_peered":"2023-10-14T19:04:56.947284+0000","last_unstale":"2023-10-14T19:04:56.948559+0000","last_undegraded":"2023-10-14T19:04:56.948559+0000","last_fullsized":"2023-10-14T19:04:56.948559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936969+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949992+0000","last_change":"2023-10-14T19:04:56.949992+0000","last_active":"2023-10-14T19:04:56.949992+0000","last_peered":"2023-10-14T19:04:56.949992+0000","last_clean":"2023-10-14T19:04:56.949992+0000","last_became_active":"2023-10-14T19:04:56.948410+0000","last_became_peered":"2023-10-14T19:04:56.948410+0000","last_unstale":"2023-10-14T19:04:56.949992+0000","last_undegraded":"2023-10-14T19:04:56.949992+0000","last_fullsized":"2023-10-14T19:04:56.949992+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:07.355240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941764+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951828+0000","last_change":"2023-10-14T19:04:56.951828+0000","last_active":"2023-10-14T19:04:56.951828+0000","last_peered":"2023-10-14T19:04:56.951828+0000","last_clean":"2023-10-14T19:04:56.951828+0000","last_became_active":"2023-10-14T19:04:56.951553+0000","last_became_peered":"2023-10-14T19:04:56.951553+0000","last_unstale":"2023-10-14T19:04:56.951828+0000","last_undegraded":"2023-10-14T19:04:56.951828+0000","last_fullsized":"2023-10-14T19:04:56.951828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:16.439561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940525+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949648+0000","last_change":"2023-10-14T19:04:56.949648+0000","last_active":"2023-10-14T19:04:56.949648+0000","last_peered":"2023-10-14T19:04:56.949648+0000","last_clean":"2023-10-14T19:04:56.949648+0000","last_became_active":"2023-10-14T19:04:56.949331+0000","last_became_peered":"2023-10-14T19:04:56.949331+0000","last_unstale":"2023-10-14T19:04:56.949648+0000","last_undegraded":"2023-10-14T19:04:56.949648+0000","last_fullsized":"2023-10-14T19:04:56.949648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:27.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937380+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:07.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.954045+0000","last_change":"2023-10-14T19:04:56.954045+0000","last_active":"2023-10-14T19:04:56.954045+0000","last_peered":"2023-10-14T19:04:56.954045+0000","last_clean":"2023-10-14T19:04:56.954045+0000","last_became_active":"2023-10-14T19:04:56.953785+0000","last_became_peered":"2023-10-14T19:04:56.953785+0000","last_unstale":"2023-10-14T19:04:56.954045+0000","last_undegraded":"2023-10-14T19:04:56.954045+0000","last_fullsized":"2023-10-14T19:04:56.954045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:08.118011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939751+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:32.481265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948518+0000","last_change":"2023-10-14T19:04:56.948518+0000","last_active":"2023-10-14T19:04:56.948518+0000","last_peered":"2023-10-14T19:04:56.948518+0000","last_clean":"2023-10-14T19:04:56.948518+0000","last_became_active":"2023-10-14T19:04:56.948181+0000","last_became_peered":"2023-10-14T19:04:56.948181+0000","last_unstale":"2023-10-14T19:04:56.948518+0000","last_undegraded":"2023-10-14T19:04:56.948518+0000","last_fullsized":"2023-10-14T19:04:56.948518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:53.493556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939928+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:04.134284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951477+0000","last_change":"2023-10-14T19:04:56.951477+0000","last_active":"2023-10-14T19:04:56.951477+0000","last_peered":"2023-10-14T19:04:56.951477+0000","last_clean":"2023-10-14T19:04:56.951477+0000","last_became_active":"2023-10-14T19:04:56.950964+0000","last_became_peered":"2023-10-14T19:04:56.950964+0000","last_unstale":"2023-10-14T19:04:56.951477+0000","last_undegraded":"2023-10-14T19:04:56.951477+0000","last_fullsized":"2023-10-14T19:04:56.951477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:54.716290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939561+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:36:00.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948728+0000","last_change":"2023-10-14T19:04:56.948728+0000","last_active":"2023-10-14T19:04:56.948728+0000","last_peered":"2023-10-14T19:04:56.948728+0000","last_clean":"2023-10-14T19:04:56.948728+0000","last_became_active":"2023-10-14T19:04:56.948464+0000","last_became_peered":"2023-10-14T19:04:56.948464+0000","last_unstale":"2023-10-14T19:04:56.948728+0000","last_undegraded":"2023-10-14T19:04:56.948728+0000","last_fullsized":"2023-10-14T19:04:56.948728+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939449+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950501+0000","last_change":"2023-10-14T19:04:56.950501+0000","last_active":"2023-10-14T19:04:56.950501+0000","last_peered":"2023-10-14T19:04:56.950501+0000","last_clean":"2023-10-14T19:04:56.950501+0000","last_became_active":"2023-10-14T19:04:56.950244+0000","last_became_peered":"2023-10-14T19:04:56.950244+0000","last_unstale":"2023-10-14T19:04:56.950501+0000","last_undegraded":"2023-10-14T19:04:56.950501+0000","last_fullsized":"2023-10-14T19:04:56.950501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:14.719061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937920+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947400+0000","last_change":"2023-10-14T19:04:56.947400+0000","last_active":"2023-10-14T19:04:56.947400+0000","last_peered":"2023-10-14T19:04:56.947400+0000","last_clean":"2023-10-14T19:04:56.947400+0000","last_became_active":"2023-10-14T19:04:56.947088+0000","last_became_peered":"2023-10-14T19:04:56.947088+0000","last_unstale":"2023-10-14T19:04:56.947400+0000","last_undegraded":"2023-10-14T19:04:56.947400+0000","last_fullsized":"2023-10-14T19:04:56.947400+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945029+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:52.089440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947918+0000","last_change":"2023-10-14T19:04:56.947918+0000","last_active":"2023-10-14T19:04:56.947918+0000","last_peered":"2023-10-14T19:04:56.947918+0000","last_clean":"2023-10-14T19:04:56.947918+0000","last_became_active":"2023-10-14T19:04:56.947639+0000","last_became_peered":"2023-10-14T19:04:56.947639+0000","last_unstale":"2023-10-14T19:04:56.947918+0000","last_undegraded":"2023-10-14T19:04:56.947918+0000","last_fullsized":"2023-10-14T19:04:56.947918+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:18.543184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945487+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.069974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.945202+0000","last_change":"2023-10-14T19:04:56.945202+0000","last_active":"2023-10-14T19:04:56.945202+0000","last_peered":"2023-10-14T19:04:56.945202+0000","last_clean":"2023-10-14T19:04:56.945202+0000","last_became_active":"2023-10-14T19:04:56.944900+0000","last_became_peered":"2023-10-14T19:04:56.944900+0000","last_unstale":"2023-10-14T19:04:56.945202+0000","last_undegraded":"2023-10-14T19:04:56.945202+0000","last_fullsized":"2023-10-14T19:04:56.945202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:53.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937181+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:07.915000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943250+0000","last_change":"2023-10-14T19:04:56.943250+0000","last_active":"2023-10-14T19:04:56.943250+0000","last_peered":"2023-10-14T19:04:56.943250+0000","last_clean":"2023-10-14T19:04:56.943250+0000","last_became_active":"2023-10-14T19:04:56.942982+0000","last_became_peered":"2023-10-14T19:04:56.942982+0000","last_unstale":"2023-10-14T19:04:56.943250+0000","last_undegraded":"2023-10-14T19:04:56.943250+0000","last_fullsized":"2023-10-14T19:04:56.943250+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:25.285500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943328+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948061+0000","last_change":"2023-10-14T19:04:56.948061+0000","last_active":"2023-10-14T19:04:56.948061+0000","last_peered":"2023-10-14T19:04:56.948061+0000","last_clean":"2023-10-14T19:04:56.948061+0000","last_became_active":"2023-10-14T19:04:56.947691+0000","last_became_peered":"2023-10-14T19:04:56.947691+0000","last_unstale":"2023-10-14T19:04:56.948061+0000","last_undegraded":"2023-10-14T19:04:56.948061+0000","last_fullsized":"2023-10-14T19:04:56.948061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940987+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947490+0000","last_change":"2023-10-14T19:04:56.947490+0000","last_active":"2023-10-14T19:04:56.947490+0000","last_peered":"2023-10-14T19:04:56.947490+0000","last_clean":"2023-10-14T19:04:56.947490+0000","last_became_active":"2023-10-14T19:04:56.947216+0000","last_became_peered":"2023-10-14T19:04:56.947216+0000","last_unstale":"2023-10-14T19:04:56.947490+0000","last_undegraded":"2023-10-14T19:04:56.947490+0000","last_fullsized":"2023-10-14T19:04:56.947490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940763+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.382834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948930+0000","last_change":"2023-10-14T19:04:56.948930+0000","last_active":"2023-10-14T19:04:56.948930+0000","last_peered":"2023-10-14T19:04:56.948930+0000","last_clean":"2023-10-14T19:04:56.948930+0000","last_became_active":"2023-10-14T19:04:56.948670+0000","last_became_peered":"2023-10-14T19:04:56.948670+0000","last_unstale":"2023-10-14T19:04:56.948930+0000","last_undegraded":"2023-10-14T19:04:56.948930+0000","last_fullsized":"2023-10-14T19:04:56.948930+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:32.229711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942656+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.627193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949415+0000","last_change":"2023-10-14T19:04:56.949415+0000","last_active":"2023-10-14T19:04:56.949415+0000","last_peered":"2023-10-14T19:04:56.949415+0000","last_clean":"2023-10-14T19:04:56.949415+0000","last_became_active":"2023-10-14T19:04:56.948760+0000","last_became_peered":"2023-10-14T19:04:56.948760+0000","last_unstale":"2023-10-14T19:04:56.949415+0000","last_undegraded":"2023-10-14T19:04:56.949415+0000","last_fullsized":"2023-10-14T19:04:56.949415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:06.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-14T19:04:55.936594+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:55.936594+0000","last_peered":"2023-10-14T19:04:55.936594+0000","last_clean":"2023-10-14T19:04:55.936594+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:55.936594+0000","last_undegraded":"2023-10-14T19:04:55.936594+0000","last_fullsized":"2023-10-14T19:04:55.936594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073236,"statfs":{"total":96636764160,"available":96330993664,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.434},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.39300000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.40899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.318}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.375},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.438}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.374},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.313},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.434},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.495},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.309},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.498}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.441}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.503}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.432}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.623},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:05:02.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:05:02.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.223+0000 7f07f4bf7700 1 Processor -- start 2023-10-14T19:05:02.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.223+0000 7f07f4bf7700 1 -- start start 2023-10-14T19:05:02.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07f4bf7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f07f00cb5a0 0x7f07f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07f4bf7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f015a5d0 0x7f07f0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07f4bf7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f015ae40 con 0x7f07f00cd9e0 2023-10-14T19:05:02.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07f4bf7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f00d13f0 con 0x7f07f015a5d0 2023-10-14T19:05:02.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07f4bf7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f015ab60 con 0x7f07f00cb5a0 2023-10-14T19:05:02.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07eed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f015a5d0 0x7f07f0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07edd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f07f00cd9e0 0x7f07f0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50886/0 (socket says 172.21.15.7:50886) 2023-10-14T19:05:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07edd9b700 1 -- 172.21.15.7:0/3871759396 learned_addr learned my addr 172.21.15.7:0/3871759396 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07ee59c700 1 --2- 172.21.15.7:0/3871759396 >> v2:172.21.15.148:3300/0 conn(0x7f07f00cb5a0 0x7f07f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07eed9d700 1 -- 172.21.15.7:0/3871759396 >> v2:172.21.15.148:3300/0 conn(0x7f07f00cb5a0 msgr2=0x7f07f00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07eed9d700 1 --2- 172.21.15.7:0/3871759396 >> v2:172.21.15.148:3300/0 conn(0x7f07f00cb5a0 0x7f07f00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07eed9d700 1 -- 172.21.15.7:0/3871759396 >> v1:172.21.15.7:6789/0 conn(0x7f07f00cd9e0 legacy=0x7f07f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07ed59a700 1 -- 172.21.15.7:0/3871759396 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357635369 0 0) 0x7f07f015ae40 con 0x7f07f00cd9e0 2023-10-14T19:05:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07eed9d700 1 -- 172.21.15.7:0/3871759396 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00ccf00 con 0x7f07f015a5d0 2023-10-14T19:05:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07eed9d700 1 --2- 172.21.15.7:0/3871759396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0156e90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f07e80098e0 tx=0x7f07e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae603805a5ddda server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07ed59a700 1 -- 172.21.15.7:0/3871759396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8009e80 con 0x7f07f015a5d0 2023-10-14T19:05:02.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07ed59a700 1 -- 172.21.15.7:0/3871759396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800b820 con 0x7f07f015a5d0 2023-10-14T19:05:02.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.224+0000 7f07ed59a700 1 -- 172.21.15.7:0/3871759396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800bba0 con 0x7f07f015a5d0 2023-10-14T19:05:02.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3871759396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 msgr2=0x7f07f0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3871759396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0156e90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f07e80098e0 tx=0x7f07e80091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3871759396 shutdown_connections 2023-10-14T19:05:02.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3871759396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0156e90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3871759396 >> v2:172.21.15.148:3300/0 conn(0x7f07f00cb5a0 0x7f07f00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3871759396 >> 172.21.15.7:0/3871759396 conn(0x7f07f0070e30 msgr2=0x7f07f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:02.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3871759396 shutdown_connections 2023-10-14T19:05:02.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.225+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3871759396 wait complete. 2023-10-14T19:05:02.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.226+0000 7f07f4bf7700 1 Processor -- start 2023-10-14T19:05:02.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.226+0000 7f07f4bf7700 1 -- start start 2023-10-14T19:05:02.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07f4bf7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f00cb5a0 0x7f07f0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07f4bf7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07f00cd9e0 0x7f07f0159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07f4bf7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07f4bf7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00b6500 con 0x7f07f015a5d0 2023-10-14T19:05:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07f4bf7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c9140 con 0x7f07f00cb5a0 2023-10-14T19:05:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07f4bf7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c9990 con 0x7f07f00cd9e0 2023-10-14T19:05:02.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60258/0 (socket says 172.21.15.7:60258) 2023-10-14T19:05:02.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 -- 172.21.15.7:0/3932868626 learned_addr learned my addr 172.21.15.7:0/3932868626 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:02.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07ee59c700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f00cb5a0 0x7f07f0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07edd9b700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07f00cd9e0 0x7f07f0159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 -- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07f00cd9e0 msgr2=0x7f07f0159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07f00cd9e0 0x7f07f0159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 -- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f00cb5a0 msgr2=0x7f07f0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f00cb5a0 0x7f07f0156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 -- 172.21.15.7:0/3932868626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009420 con 0x7f07f015a5d0 2023-10-14T19:05:02.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07eed9d700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0169730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f07e80093f0 tx=0x7f07e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:02.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.227+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8011630 con 0x7f07f015a5d0 2023-10-14T19:05:02.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.228+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e8011790 con 0x7f07f015a5d0 2023-10-14T19:05:02.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.228+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f00b6220 con 0x7f07f015a5d0 2023-10-14T19:05:02.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.228+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8011b30 con 0x7f07f015a5d0 2023-10-14T19:05:02.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.228+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f00c9620 con 0x7f07f015a5d0 2023-10-14T19:05:02.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.228+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f004c3c0 con 0x7f07f015a5d0 2023-10-14T19:05:02.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.229+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f07e80253f0 con 0x7f07f015a5d0 2023-10-14T19:05:02.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.229+0000 7f07de7fc700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07d0066fc0 0x7f07d0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.229+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07e80860f0 con 0x7f07f015a5d0 2023-10-14T19:05:02.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.230+0000 7f07ee59c700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07d0066fc0 0x7f07d0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.230+0000 7f07ee59c700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07d0066fc0 0x7f07d0069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07f00af4b0 tx=0x7f07e00097c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:02.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.234+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07e8053370 con 0x7f07f015a5d0 2023-10-14T19:05:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.421+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07f00cd1e0 con 0x7f07d0066fc0 2023-10-14T19:05:02.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.430+0000 7f07de7fc700 1 -- 172.21.15.7:0/3932868626 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286873 (secure 0 0 0) 0x7f07f00cd1e0 con 0x7f07d0066fc0 2023-10-14T19:05:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.433+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07d0066fc0 msgr2=0x7f07d0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.433+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07d0066fc0 0x7f07d0069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07f00af4b0 tx=0x7f07e00097c0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 msgr2=0x7f07f0169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0169730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f07e80093f0 tx=0x7f07e8017000 comp rx=0 tx=0).stop 2023-10-14T19:05:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 shutdown_connections 2023-10-14T19:05:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f07d0066fc0 0x7f07d0069470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f00cb5a0 0x7f07f0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f015a5d0 0x7f07f0169730 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 --2- 172.21.15.7:0/3932868626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07f00cd9e0 0x7f07f0159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 >> 172.21.15.7:0/3932868626 conn(0x7f07f0070e30 msgr2=0x7f07f00cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 shutdown_connections 2023-10-14T19:05:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.434+0000 7f07f4bf7700 1 -- 172.21.15.7:0/3932868626 wait complete. 2023-10-14T19:05:02.439 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:05:02.446 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-14T19:05:01.648188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397640,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577080,"statfs":{"total":773094113280,"available":770638929920,"internally_reserved":0,"allocated":7217152,"data_stored":3719320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.720154"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.944063+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:26:07.338853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941575+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:26.019073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941142+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:26:58.398518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941517+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938590+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:36.989172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942994+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:18.468735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939237+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:00.033354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942155+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:17.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938401+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:10.234043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937485+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.946436+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:19.996006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941017+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939374+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937854+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:23.146926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938484+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937463+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937900+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:41.751751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941553+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941879+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:34.920916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939965+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937996+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937396+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945680+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:44.646695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940610+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937224+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938599+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940626+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:02.256630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936162+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940167+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:32.207725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936876+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938740+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940710+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:52.800022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941444+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953149+0000","last_change":"2023-10-14T19:04:56.953149+0000","last_active":"2023-10-14T19:04:56.953149+0000","last_peered":"2023-10-14T19:04:56.953149+0000","last_clean":"2023-10-14T19:04:56.953149+0000","last_became_active":"2023-10-14T19:04:56.952688+0000","last_became_peered":"2023-10-14T19:04:56.952688+0000","last_unstale":"2023-10-14T19:04:56.953149+0000","last_undegraded":"2023-10-14T19:04:56.953149+0000","last_fullsized":"2023-10-14T19:04:56.953149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:08.171627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937345+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:48.352293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950268+0000","last_change":"2023-10-14T19:04:56.950268+0000","last_active":"2023-10-14T19:04:56.950268+0000","last_peered":"2023-10-14T19:04:56.950268+0000","last_clean":"2023-10-14T19:04:56.950268+0000","last_became_active":"2023-10-14T19:04:56.949979+0000","last_became_peered":"2023-10-14T19:04:56.949979+0000","last_unstale":"2023-10-14T19:04:56.950268+0000","last_undegraded":"2023-10-14T19:04:56.950268+0000","last_fullsized":"2023-10-14T19:04:56.950268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941685+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:04.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951889+0000","last_change":"2023-10-14T19:04:56.951889+0000","last_active":"2023-10-14T19:04:56.951889+0000","last_peered":"2023-10-14T19:04:56.951889+0000","last_clean":"2023-10-14T19:04:56.951889+0000","last_became_active":"2023-10-14T19:04:56.951570+0000","last_became_peered":"2023-10-14T19:04:56.951570+0000","last_unstale":"2023-10-14T19:04:56.951889+0000","last_undegraded":"2023-10-14T19:04:56.951889+0000","last_fullsized":"2023-10-14T19:04:56.951889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945962+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:27.855130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948874+0000","last_change":"2023-10-14T19:04:56.948874+0000","last_active":"2023-10-14T19:04:56.948874+0000","last_peered":"2023-10-14T19:04:56.948874+0000","last_clean":"2023-10-14T19:04:56.948874+0000","last_became_active":"2023-10-14T19:04:56.948586+0000","last_became_peered":"2023-10-14T19:04:56.948586+0000","last_unstale":"2023-10-14T19:04:56.948874+0000","last_undegraded":"2023-10-14T19:04:56.948874+0000","last_fullsized":"2023-10-14T19:04:56.948874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:04.970618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936304+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:28.483829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.940818+0000","last_change":"2023-10-14T19:04:56.940818+0000","last_active":"2023-10-14T19:04:56.940818+0000","last_peered":"2023-10-14T19:04:56.940818+0000","last_clean":"2023-10-14T19:04:56.940818+0000","last_became_active":"2023-10-14T19:04:56.940545+0000","last_became_peered":"2023-10-14T19:04:56.940545+0000","last_unstale":"2023-10-14T19:04:56.940818+0000","last_undegraded":"2023-10-14T19:04:56.940818+0000","last_fullsized":"2023-10-14T19:04:56.940818+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:13.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937061+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950899+0000","last_change":"2023-10-14T19:04:56.950899+0000","last_active":"2023-10-14T19:04:56.950899+0000","last_peered":"2023-10-14T19:04:56.950899+0000","last_clean":"2023-10-14T19:04:56.950899+0000","last_became_active":"2023-10-14T19:04:56.950557+0000","last_became_peered":"2023-10-14T19:04:56.950557+0000","last_unstale":"2023-10-14T19:04:56.950899+0000","last_undegraded":"2023-10-14T19:04:56.950899+0000","last_fullsized":"2023-10-14T19:04:56.950899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:29.175822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937493+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:11.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949526+0000","last_change":"2023-10-14T19:04:56.949526+0000","last_active":"2023-10-14T19:04:56.949526+0000","last_peered":"2023-10-14T19:04:56.949526+0000","last_clean":"2023-10-14T19:04:56.949526+0000","last_became_active":"2023-10-14T19:04:56.949203+0000","last_became_peered":"2023-10-14T19:04:56.949203+0000","last_unstale":"2023-10-14T19:04:56.949526+0000","last_undegraded":"2023-10-14T19:04:56.949526+0000","last_fullsized":"2023-10-14T19:04:56.949526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936795+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948722+0000","last_change":"2023-10-14T19:04:56.948722+0000","last_active":"2023-10-14T19:04:56.948722+0000","last_peered":"2023-10-14T19:04:56.948722+0000","last_clean":"2023-10-14T19:04:56.948722+0000","last_became_active":"2023-10-14T19:04:56.948466+0000","last_became_peered":"2023-10-14T19:04:56.948466+0000","last_unstale":"2023-10-14T19:04:56.948722+0000","last_undegraded":"2023-10-14T19:04:56.948722+0000","last_fullsized":"2023-10-14T19:04:56.948722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:53.045006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938106+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943154+0000","last_change":"2023-10-14T19:04:56.943154+0000","last_active":"2023-10-14T19:04:56.943154+0000","last_peered":"2023-10-14T19:04:56.943154+0000","last_clean":"2023-10-14T19:04:56.943154+0000","last_became_active":"2023-10-14T19:04:56.942867+0000","last_became_peered":"2023-10-14T19:04:56.942867+0000","last_unstale":"2023-10-14T19:04:56.943154+0000","last_undegraded":"2023-10-14T19:04:56.943154+0000","last_fullsized":"2023-10-14T19:04:56.943154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943326+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:57.076623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949434+0000","last_change":"2023-10-14T19:04:56.949434+0000","last_active":"2023-10-14T19:04:56.949434+0000","last_peered":"2023-10-14T19:04:56.949434+0000","last_clean":"2023-10-14T19:04:56.949434+0000","last_became_active":"2023-10-14T19:04:56.949098+0000","last_became_peered":"2023-10-14T19:04:56.949098+0000","last_unstale":"2023-10-14T19:04:56.949434+0000","last_undegraded":"2023-10-14T19:04:56.949434+0000","last_fullsized":"2023-10-14T19:04:56.949434+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:34.768904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941246+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.842568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943590+0000","last_change":"2023-10-14T19:04:56.943590+0000","last_active":"2023-10-14T19:04:56.943590+0000","last_peered":"2023-10-14T19:04:56.943590+0000","last_clean":"2023-10-14T19:04:56.943590+0000","last_became_active":"2023-10-14T19:04:56.943234+0000","last_became_peered":"2023-10-14T19:04:56.943234+0000","last_unstale":"2023-10-14T19:04:56.943590+0000","last_undegraded":"2023-10-14T19:04:56.943590+0000","last_fullsized":"2023-10-14T19:04:56.943590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:05.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937960+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:02.462718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957104+0000","last_change":"2023-10-14T19:04:56.957104+0000","last_active":"2023-10-14T19:04:56.957104+0000","last_peered":"2023-10-14T19:04:56.957104+0000","last_clean":"2023-10-14T19:04:56.957104+0000","last_became_active":"2023-10-14T19:04:56.956797+0000","last_became_peered":"2023-10-14T19:04:56.956797+0000","last_unstale":"2023-10-14T19:04:56.957104+0000","last_undegraded":"2023-10-14T19:04:56.957104+0000","last_fullsized":"2023-10-14T19:04:56.957104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940913+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953495+0000","last_change":"2023-10-14T19:04:56.953495+0000","last_active":"2023-10-14T19:04:56.953495+0000","last_peered":"2023-10-14T19:04:56.953495+0000","last_clean":"2023-10-14T19:04:56.953495+0000","last_became_active":"2023-10-14T19:04:56.953230+0000","last_became_peered":"2023-10-14T19:04:56.953230+0000","last_unstale":"2023-10-14T19:04:56.953495+0000","last_undegraded":"2023-10-14T19:04:56.953495+0000","last_fullsized":"2023-10-14T19:04:56.953495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936767+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957152+0000","last_change":"2023-10-14T19:04:56.957152+0000","last_active":"2023-10-14T19:04:56.957152+0000","last_peered":"2023-10-14T19:04:56.957152+0000","last_clean":"2023-10-14T19:04:56.957152+0000","last_became_active":"2023-10-14T19:04:56.956860+0000","last_became_peered":"2023-10-14T19:04:56.956860+0000","last_unstale":"2023-10-14T19:04:56.957152+0000","last_undegraded":"2023-10-14T19:04:56.957152+0000","last_fullsized":"2023-10-14T19:04:56.957152+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:42.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936747+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948515+0000","last_change":"2023-10-14T19:04:56.948515+0000","last_active":"2023-10-14T19:04:56.948515+0000","last_peered":"2023-10-14T19:04:56.948515+0000","last_clean":"2023-10-14T19:04:56.948515+0000","last_became_active":"2023-10-14T19:04:56.948264+0000","last_became_peered":"2023-10-14T19:04:56.948264+0000","last_unstale":"2023-10-14T19:04:56.948515+0000","last_undegraded":"2023-10-14T19:04:56.948515+0000","last_fullsized":"2023-10-14T19:04:56.948515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937801+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:17:14.887218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948559+0000","last_change":"2023-10-14T19:04:56.948559+0000","last_active":"2023-10-14T19:04:56.948559+0000","last_peered":"2023-10-14T19:04:56.948559+0000","last_clean":"2023-10-14T19:04:56.948559+0000","last_became_active":"2023-10-14T19:04:56.947284+0000","last_became_peered":"2023-10-14T19:04:56.947284+0000","last_unstale":"2023-10-14T19:04:56.948559+0000","last_undegraded":"2023-10-14T19:04:56.948559+0000","last_fullsized":"2023-10-14T19:04:56.948559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936969+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949992+0000","last_change":"2023-10-14T19:04:56.949992+0000","last_active":"2023-10-14T19:04:56.949992+0000","last_peered":"2023-10-14T19:04:56.949992+0000","last_clean":"2023-10-14T19:04:56.949992+0000","last_became_active":"2023-10-14T19:04:56.948410+0000","last_became_peered":"2023-10-14T19:04:56.948410+0000","last_unstale":"2023-10-14T19:04:56.949992+0000","last_undegraded":"2023-10-14T19:04:56.949992+0000","last_fullsized":"2023-10-14T19:04:56.949992+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:07.355240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941764+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951828+0000","last_change":"2023-10-14T19:04:56.951828+0000","last_active":"2023-10-14T19:04:56.951828+0000","last_peered":"2023-10-14T19:04:56.951828+0000","last_clean":"2023-10-14T19:04:56.951828+0000","last_became_active":"2023-10-14T19:04:56.951553+0000","last_became_peered":"2023-10-14T19:04:56.951553+0000","last_unstale":"2023-10-14T19:04:56.951828+0000","last_undegraded":"2023-10-14T19:04:56.951828+0000","last_fullsized":"2023-10-14T19:04:56.951828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:16.439561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940525+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949648+0000","last_change":"2023-10-14T19:04:56.949648+0000","last_active":"2023-10-14T19:04:56.949648+0000","last_peered":"2023-10-14T19:04:56.949648+0000","last_clean":"2023-10-14T19:04:56.949648+0000","last_became_active":"2023-10-14T19:04:56.949331+0000","last_became_peered":"2023-10-14T19:04:56.949331+0000","last_unstale":"2023-10-14T19:04:56.949648+0000","last_undegraded":"2023-10-14T19:04:56.949648+0000","last_fullsized":"2023-10-14T19:04:56.949648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:27.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937380+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:07.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.954045+0000","last_change":"2023-10-14T19:04:56.954045+0000","last_active":"2023-10-14T19:04:56.954045+0000","last_peered":"2023-10-14T19:04:56.954045+0000","last_clean":"2023-10-14T19:04:56.954045+0000","last_became_active":"2023-10-14T19:04:56.953785+0000","last_became_peered":"2023-10-14T19:04:56.953785+0000","last_unstale":"2023-10-14T19:04:56.954045+0000","last_undegraded":"2023-10-14T19:04:56.954045+0000","last_fullsized":"2023-10-14T19:04:56.954045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:08.118011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939751+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:32.481265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948518+0000","last_change":"2023-10-14T19:04:56.948518+0000","last_active":"2023-10-14T19:04:56.948518+0000","last_peered":"2023-10-14T19:04:56.948518+0000","last_clean":"2023-10-14T19:04:56.948518+0000","last_became_active":"2023-10-14T19:04:56.948181+0000","last_became_peered":"2023-10-14T19:04:56.948181+0000","last_unstale":"2023-10-14T19:04:56.948518+0000","last_undegraded":"2023-10-14T19:04:56.948518+0000","last_fullsized":"2023-10-14T19:04:56.948518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:53.493556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939928+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:04.134284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951477+0000","last_change":"2023-10-14T19:04:56.951477+0000","last_active":"2023-10-14T19:04:56.951477+0000","last_peered":"2023-10-14T19:04:56.951477+0000","last_clean":"2023-10-14T19:04:56.951477+0000","last_became_active":"2023-10-14T19:04:56.950964+0000","last_became_peered":"2023-10-14T19:04:56.950964+0000","last_unstale":"2023-10-14T19:04:56.951477+0000","last_undegraded":"2023-10-14T19:04:56.951477+0000","last_fullsized":"2023-10-14T19:04:56.951477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:54.716290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939561+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:36:00.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948728+0000","last_change":"2023-10-14T19:04:56.948728+0000","last_active":"2023-10-14T19:04:56.948728+0000","last_peered":"2023-10-14T19:04:56.948728+0000","last_clean":"2023-10-14T19:04:56.948728+0000","last_became_active":"2023-10-14T19:04:56.948464+0000","last_became_peered":"2023-10-14T19:04:56.948464+0000","last_unstale":"2023-10-14T19:04:56.948728+0000","last_undegraded":"2023-10-14T19:04:56.948728+0000","last_fullsized":"2023-10-14T19:04:56.948728+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939449+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950501+0000","last_change":"2023-10-14T19:04:56.950501+0000","last_active":"2023-10-14T19:04:56.950501+0000","last_peered":"2023-10-14T19:04:56.950501+0000","last_clean":"2023-10-14T19:04:56.950501+0000","last_became_active":"2023-10-14T19:04:56.950244+0000","last_became_peered":"2023-10-14T19:04:56.950244+0000","last_unstale":"2023-10-14T19:04:56.950501+0000","last_undegraded":"2023-10-14T19:04:56.950501+0000","last_fullsized":"2023-10-14T19:04:56.950501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:14.719061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937920+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947400+0000","last_change":"2023-10-14T19:04:56.947400+0000","last_active":"2023-10-14T19:04:56.947400+0000","last_peered":"2023-10-14T19:04:56.947400+0000","last_clean":"2023-10-14T19:04:56.947400+0000","last_became_active":"2023-10-14T19:04:56.947088+0000","last_became_peered":"2023-10-14T19:04:56.947088+0000","last_unstale":"2023-10-14T19:04:56.947400+0000","last_undegraded":"2023-10-14T19:04:56.947400+0000","last_fullsized":"2023-10-14T19:04:56.947400+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945029+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:52.089440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947918+0000","last_change":"2023-10-14T19:04:56.947918+0000","last_active":"2023-10-14T19:04:56.947918+0000","last_peered":"2023-10-14T19:04:56.947918+0000","last_clean":"2023-10-14T19:04:56.947918+0000","last_became_active":"2023-10-14T19:04:56.947639+0000","last_became_peered":"2023-10-14T19:04:56.947639+0000","last_unstale":"2023-10-14T19:04:56.947918+0000","last_undegraded":"2023-10-14T19:04:56.947918+0000","last_fullsized":"2023-10-14T19:04:56.947918+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:18.543184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945487+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.069974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.945202+0000","last_change":"2023-10-14T19:04:56.945202+0000","last_active":"2023-10-14T19:04:56.945202+0000","last_peered":"2023-10-14T19:04:56.945202+0000","last_clean":"2023-10-14T19:04:56.945202+0000","last_became_active":"2023-10-14T19:04:56.944900+0000","last_became_peered":"2023-10-14T19:04:56.944900+0000","last_unstale":"2023-10-14T19:04:56.945202+0000","last_undegraded":"2023-10-14T19:04:56.945202+0000","last_fullsized":"2023-10-14T19:04:56.945202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:53.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937181+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:07.915000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943250+0000","last_change":"2023-10-14T19:04:56.943250+0000","last_active":"2023-10-14T19:04:56.943250+0000","last_peered":"2023-10-14T19:04:56.943250+0000","last_clean":"2023-10-14T19:04:56.943250+0000","last_became_active":"2023-10-14T19:04:56.942982+0000","last_became_peered":"2023-10-14T19:04:56.942982+0000","last_unstale":"2023-10-14T19:04:56.943250+0000","last_undegraded":"2023-10-14T19:04:56.943250+0000","last_fullsized":"2023-10-14T19:04:56.943250+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:25.285500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943328+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948061+0000","last_change":"2023-10-14T19:04:56.948061+0000","last_active":"2023-10-14T19:04:56.948061+0000","last_peered":"2023-10-14T19:04:56.948061+0000","last_clean":"2023-10-14T19:04:56.948061+0000","last_became_active":"2023-10-14T19:04:56.947691+0000","last_became_peered":"2023-10-14T19:04:56.947691+0000","last_unstale":"2023-10-14T19:04:56.948061+0000","last_undegraded":"2023-10-14T19:04:56.948061+0000","last_fullsized":"2023-10-14T19:04:56.948061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940987+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947490+0000","last_change":"2023-10-14T19:04:56.947490+0000","last_active":"2023-10-14T19:04:56.947490+0000","last_peered":"2023-10-14T19:04:56.947490+0000","last_clean":"2023-10-14T19:04:56.947490+0000","last_became_active":"2023-10-14T19:04:56.947216+0000","last_became_peered":"2023-10-14T19:04:56.947216+0000","last_unstale":"2023-10-14T19:04:56.947490+0000","last_undegraded":"2023-10-14T19:04:56.947490+0000","last_fullsized":"2023-10-14T19:04:56.947490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940763+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.382834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948930+0000","last_change":"2023-10-14T19:04:56.948930+0000","last_active":"2023-10-14T19:04:56.948930+0000","last_peered":"2023-10-14T19:04:56.948930+0000","last_clean":"2023-10-14T19:04:56.948930+0000","last_became_active":"2023-10-14T19:04:56.948670+0000","last_became_peered":"2023-10-14T19:04:56.948670+0000","last_unstale":"2023-10-14T19:04:56.948930+0000","last_undegraded":"2023-10-14T19:04:56.948930+0000","last_fullsized":"2023-10-14T19:04:56.948930+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:32.229711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942656+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.627193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949415+0000","last_change":"2023-10-14T19:04:56.949415+0000","last_active":"2023-10-14T19:04:56.949415+0000","last_peered":"2023-10-14T19:04:56.949415+0000","last_clean":"2023-10-14T19:04:56.949415+0000","last_became_active":"2023-10-14T19:04:56.948760+0000","last_became_peered":"2023-10-14T19:04:56.948760+0000","last_unstale":"2023-10-14T19:04:56.949415+0000","last_undegraded":"2023-10-14T19:04:56.949415+0000","last_fullsized":"2023-10-14T19:04:56.949415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:06.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-14T19:04:55.936594+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:55.936594+0000","last_peered":"2023-10-14T19:04:55.936594+0000","last_clean":"2023-10-14T19:04:55.936594+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:55.936594+0000","last_undegraded":"2023-10-14T19:04:55.936594+0000","last_fullsized":"2023-10-14T19:04:55.936594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073236,"statfs":{"total":96636764160,"available":96330993664,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.434},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.39300000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.40899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.318}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.375},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.438}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.374},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.313},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.434},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.495},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.309},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.498}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.441}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.503}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.432}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.623},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:05:02.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:05:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.605+0000 7f8939267700 1 Processor -- start 2023-10-14T19:05:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.605+0000 7f8939267700 1 -- start start 2023-10-14T19:05:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8939267700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8934153c30 0x7f893415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8939267700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893415afd0 con 0x7f89340cf110 2023-10-14T19:05:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8939267700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893415b2b0 con 0x7f893415de50 2023-10-14T19:05:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8939267700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893415b590 con 0x7f8934153c30 2023-10-14T19:05:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8938a66700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f89340cf110 0x7f893415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50894/0 (socket says 172.21.15.7:50894) 2023-10-14T19:05:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8938a66700 1 -- 172.21.15.7:0/2185663701 learned_addr learned my addr 172.21.15.7:0/2185663701 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8933fff700 1 --2- 172.21.15.7:0/2185663701 >> v2:172.21.15.148:3300/0 conn(0x7f8934153c30 0x7f893415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008848259 0 0) 0x7f893415afd0 con 0x7f89340cf110 2023-10-14T19:05:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.606+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f891c003570 con 0x7f89340cf110 2023-10-14T19:05:02.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529801447 0 0) 0x7f891c003570 con 0x7f89340cf110 2023-10-14T19:05:02.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 >> v2:172.21.15.148:3300/0 conn(0x7f8934153c30 msgr2=0x7f893415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:02.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 --2- 172.21.15.7:0/2185663701 >> v2:172.21.15.148:3300/0 conn(0x7f8934153c30 0x7f893415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 >> v1:172.21.15.148:6789/0 conn(0x7f893415de50 legacy=0x7f89340cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893415b870 con 0x7f89340cf110 2023-10-14T19:05:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f892c0017f0 con 0x7f89340cf110 2023-10-14T19:05:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 >> v1:172.21.15.7:6789/0 conn(0x7f89340cf110 legacy=0x7f893415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f891c003a60 0x7f891c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f891c004810 0x7f891c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c0051c0 0x7f891c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893415b590 con 0x7f891c004810 2023-10-14T19:05:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c00c0d0 con 0x7f891c003a60 2023-10-14T19:05:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c00c290 con 0x7f891c0051c0 2023-10-14T19:05:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f891c004810 0x7f891c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8933fff700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f891c003a60 0x7f891c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8938a66700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c0051c0 0x7f891c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 -- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c0051c0 msgr2=0x7f891c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c0051c0 0x7f891c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 -- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f891c003a60 msgr2=0x7f891c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:02.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f891c003a60 0x7f891c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8938a66700 1 -- 172.21.15.7:0/2185663701 reap_dead start 2023-10-14T19:05:02.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 -- 172.21.15.7:0/2185663701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c003570 con 0x7f891c004810 2023-10-14T19:05:02.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f89337fe700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f891c004810 0x7f891c004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f89240018b0 tx=0x7f8924007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d728d1b61529ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:02.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924012420 con 0x7f891c004810 2023-10-14T19:05:02.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8924012580 con 0x7f891c004810 2023-10-14T19:05:02.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.607+0000 7f8932ffd700 1 -- 172.21.15.7:0/2185663701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924012920 con 0x7f891c004810 2023-10-14T19:05:02.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 -- 172.21.15.7:0/2185663701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f891c004810 msgr2=0x7f891c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f891c004810 0x7f891c004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f89240018b0 tx=0x7f8924007d30 comp rx=0 tx=0).stop 2023-10-14T19:05:02.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 -- 172.21.15.7:0/2185663701 shutdown_connections 2023-10-14T19:05:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 --2- 172.21.15.7:0/2185663701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f891c004810 0x7f891c004c80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 -- 172.21.15.7:0/2185663701 >> 172.21.15.7:0/2185663701 conn(0x7f89340703a0 msgr2=0x7f89340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 -- 172.21.15.7:0/2185663701 shutdown_connections 2023-10-14T19:05:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.608+0000 7f8939267700 1 -- 172.21.15.7:0/2185663701 wait complete. 2023-10-14T19:05:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.609+0000 7f8939267700 1 Processor -- start 2023-10-14T19:05:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.609+0000 7f8939267700 1 -- start start 2023-10-14T19:05:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8939267700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c004810 0x7f89340c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8939267700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 0x7f89340c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8939267700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89340c6e60 0x7f8934142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8939267700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89340b0d70 con 0x7f893414e070 2023-10-14T19:05:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8939267700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893416a200 con 0x7f89340c6e60 2023-10-14T19:05:02.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8939267700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8934169940 con 0x7f891c004810 2023-10-14T19:05:02.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 0x7f89340c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 0x7f89340c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60276/0 (socket says 172.21.15.7:60276) 2023-10-14T19:05:02.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 -- 172.21.15.7:0/3109643402 learned_addr learned my addr 172.21.15.7:0/3109643402 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:02.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8938a66700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89340c6e60 0x7f8934142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8933fff700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c004810 0x7f89340c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 -- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c004810 msgr2=0x7f89340c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c004810 0x7f89340c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 -- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89340c6e60 msgr2=0x7f8934142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89340c6e60 0x7f8934142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f89337fe700 1 -- 172.21.15.7:0/3109643402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893416a690 con 0x7f893414e070 2023-10-14T19:05:02.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.610+0000 7f8938a66700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89340c6e60 0x7f8934142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:05:02.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.611+0000 7f89337fe700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 0x7f89340c6920 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8924001010 tx=0x7f8924015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:02.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.611+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924006b00 con 0x7f893414e070 2023-10-14T19:05:02.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.611+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8924006c60 con 0x7f893414e070 2023-10-14T19:05:02.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.611+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8934169bb0 con 0x7f893414e070 2023-10-14T19:05:02.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.611+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924007030 con 0x7f893414e070 2023-10-14T19:05:02.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.611+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89340ca360 con 0x7f893414e070 2023-10-14T19:05:02.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.612+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893404c3c0 con 0x7f893414e070 2023-10-14T19:05:02.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.612+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f89240073e0 con 0x7f893414e070 2023-10-14T19:05:02.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.613+0000 7f891bfff700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8920066fc0 0x7f8920069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:02.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.613+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8924085d00 con 0x7f893414e070 2023-10-14T19:05:02.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.613+0000 7f8933fff700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8920066fc0 0x7f8920069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:02.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.613+0000 7f8933fff700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8920066fc0 0x7f8920069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f893404cc40 tx=0x7f8928008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:02.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.617+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8924089030 con 0x7f893414e070 2023-10-14T19:05:02.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.805+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f893416a050 con 0x7f8920066fc0 2023-10-14T19:05:02.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.814+0000 7f891bfff700 1 -- 172.21.15.7:0/3109643402 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286873 (secure 0 0 0) 0x7f893416a050 con 0x7f8920066fc0 2023-10-14T19:05:02.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8920066fc0 msgr2=0x7f8920069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8920066fc0 0x7f8920069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f893404cc40 tx=0x7f8928008040 comp rx=0 tx=0).stop 2023-10-14T19:05:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 msgr2=0x7f89340c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 0x7f89340c6920 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8924001010 tx=0x7f8924015000 comp rx=0 tx=0).stop 2023-10-14T19:05:02.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 shutdown_connections 2023-10-14T19:05:02.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8920066fc0 0x7f8920069470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89340c6e60 0x7f8934142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f891c004810 0x7f89340c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 --2- 172.21.15.7:0/3109643402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f893414e070 0x7f89340c6920 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:02.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 >> 172.21.15.7:0/3109643402 conn(0x7f89340703a0 msgr2=0x7f8934151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:02.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 shutdown_connections 2023-10-14T19:05:02.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:02.817+0000 7f8939267700 1 -- 172.21.15.7:0/3109643402 wait complete. 2023-10-14T19:05:02.823 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:05:02.830 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-14T19:05:01.648188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397640,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577080,"statfs":{"total":773094113280,"available":770638929920,"internally_reserved":0,"allocated":7217152,"data_stored":3719320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.720154"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.944063+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:26:07.338853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941575+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:26.019073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941142+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:26:58.398518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941517+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938590+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:36.989172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942994+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:18.468735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939237+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:00.033354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942155+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:17.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938401+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:10.234043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937485+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.946436+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:19.996006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941017+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939374+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937854+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:23.146926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938484+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937463+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937900+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:41.751751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941553+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941879+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:34.920916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939965+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937996+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937396+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945680+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:44.646695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940610+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937224+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938599+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940626+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:02.256630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936162+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940167+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:32.207725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936876+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938740+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940710+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:52.800022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941444+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953149+0000","last_change":"2023-10-14T19:04:56.953149+0000","last_active":"2023-10-14T19:04:56.953149+0000","last_peered":"2023-10-14T19:04:56.953149+0000","last_clean":"2023-10-14T19:04:56.953149+0000","last_became_active":"2023-10-14T19:04:56.952688+0000","last_became_peered":"2023-10-14T19:04:56.952688+0000","last_unstale":"2023-10-14T19:04:56.953149+0000","last_undegraded":"2023-10-14T19:04:56.953149+0000","last_fullsized":"2023-10-14T19:04:56.953149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:08.171627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937345+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:48.352293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950268+0000","last_change":"2023-10-14T19:04:56.950268+0000","last_active":"2023-10-14T19:04:56.950268+0000","last_peered":"2023-10-14T19:04:56.950268+0000","last_clean":"2023-10-14T19:04:56.950268+0000","last_became_active":"2023-10-14T19:04:56.949979+0000","last_became_peered":"2023-10-14T19:04:56.949979+0000","last_unstale":"2023-10-14T19:04:56.950268+0000","last_undegraded":"2023-10-14T19:04:56.950268+0000","last_fullsized":"2023-10-14T19:04:56.950268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941685+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:04.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951889+0000","last_change":"2023-10-14T19:04:56.951889+0000","last_active":"2023-10-14T19:04:56.951889+0000","last_peered":"2023-10-14T19:04:56.951889+0000","last_clean":"2023-10-14T19:04:56.951889+0000","last_became_active":"2023-10-14T19:04:56.951570+0000","last_became_peered":"2023-10-14T19:04:56.951570+0000","last_unstale":"2023-10-14T19:04:56.951889+0000","last_undegraded":"2023-10-14T19:04:56.951889+0000","last_fullsized":"2023-10-14T19:04:56.951889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945962+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:27.855130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948874+0000","last_change":"2023-10-14T19:04:56.948874+0000","last_active":"2023-10-14T19:04:56.948874+0000","last_peered":"2023-10-14T19:04:56.948874+0000","last_clean":"2023-10-14T19:04:56.948874+0000","last_became_active":"2023-10-14T19:04:56.948586+0000","last_became_peered":"2023-10-14T19:04:56.948586+0000","last_unstale":"2023-10-14T19:04:56.948874+0000","last_undegraded":"2023-10-14T19:04:56.948874+0000","last_fullsized":"2023-10-14T19:04:56.948874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:04.970618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936304+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:28.483829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.940818+0000","last_change":"2023-10-14T19:04:56.940818+0000","last_active":"2023-10-14T19:04:56.940818+0000","last_peered":"2023-10-14T19:04:56.940818+0000","last_clean":"2023-10-14T19:04:56.940818+0000","last_became_active":"2023-10-14T19:04:56.940545+0000","last_became_peered":"2023-10-14T19:04:56.940545+0000","last_unstale":"2023-10-14T19:04:56.940818+0000","last_undegraded":"2023-10-14T19:04:56.940818+0000","last_fullsized":"2023-10-14T19:04:56.940818+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:13.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937061+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950899+0000","last_change":"2023-10-14T19:04:56.950899+0000","last_active":"2023-10-14T19:04:56.950899+0000","last_peered":"2023-10-14T19:04:56.950899+0000","last_clean":"2023-10-14T19:04:56.950899+0000","last_became_active":"2023-10-14T19:04:56.950557+0000","last_became_peered":"2023-10-14T19:04:56.950557+0000","last_unstale":"2023-10-14T19:04:56.950899+0000","last_undegraded":"2023-10-14T19:04:56.950899+0000","last_fullsized":"2023-10-14T19:04:56.950899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:29.175822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937493+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:11.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949526+0000","last_change":"2023-10-14T19:04:56.949526+0000","last_active":"2023-10-14T19:04:56.949526+0000","last_peered":"2023-10-14T19:04:56.949526+0000","last_clean":"2023-10-14T19:04:56.949526+0000","last_became_active":"2023-10-14T19:04:56.949203+0000","last_became_peered":"2023-10-14T19:04:56.949203+0000","last_unstale":"2023-10-14T19:04:56.949526+0000","last_undegraded":"2023-10-14T19:04:56.949526+0000","last_fullsized":"2023-10-14T19:04:56.949526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936795+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948722+0000","last_change":"2023-10-14T19:04:56.948722+0000","last_active":"2023-10-14T19:04:56.948722+0000","last_peered":"2023-10-14T19:04:56.948722+0000","last_clean":"2023-10-14T19:04:56.948722+0000","last_became_active":"2023-10-14T19:04:56.948466+0000","last_became_peered":"2023-10-14T19:04:56.948466+0000","last_unstale":"2023-10-14T19:04:56.948722+0000","last_undegraded":"2023-10-14T19:04:56.948722+0000","last_fullsized":"2023-10-14T19:04:56.948722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:53.045006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938106+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943154+0000","last_change":"2023-10-14T19:04:56.943154+0000","last_active":"2023-10-14T19:04:56.943154+0000","last_peered":"2023-10-14T19:04:56.943154+0000","last_clean":"2023-10-14T19:04:56.943154+0000","last_became_active":"2023-10-14T19:04:56.942867+0000","last_became_peered":"2023-10-14T19:04:56.942867+0000","last_unstale":"2023-10-14T19:04:56.943154+0000","last_undegraded":"2023-10-14T19:04:56.943154+0000","last_fullsized":"2023-10-14T19:04:56.943154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943326+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:57.076623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949434+0000","last_change":"2023-10-14T19:04:56.949434+0000","last_active":"2023-10-14T19:04:56.949434+0000","last_peered":"2023-10-14T19:04:56.949434+0000","last_clean":"2023-10-14T19:04:56.949434+0000","last_became_active":"2023-10-14T19:04:56.949098+0000","last_became_peered":"2023-10-14T19:04:56.949098+0000","last_unstale":"2023-10-14T19:04:56.949434+0000","last_undegraded":"2023-10-14T19:04:56.949434+0000","last_fullsized":"2023-10-14T19:04:56.949434+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:34.768904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941246+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.842568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943590+0000","last_change":"2023-10-14T19:04:56.943590+0000","last_active":"2023-10-14T19:04:56.943590+0000","last_peered":"2023-10-14T19:04:56.943590+0000","last_clean":"2023-10-14T19:04:56.943590+0000","last_became_active":"2023-10-14T19:04:56.943234+0000","last_became_peered":"2023-10-14T19:04:56.943234+0000","last_unstale":"2023-10-14T19:04:56.943590+0000","last_undegraded":"2023-10-14T19:04:56.943590+0000","last_fullsized":"2023-10-14T19:04:56.943590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:05.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937960+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:02.462718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957104+0000","last_change":"2023-10-14T19:04:56.957104+0000","last_active":"2023-10-14T19:04:56.957104+0000","last_peered":"2023-10-14T19:04:56.957104+0000","last_clean":"2023-10-14T19:04:56.957104+0000","last_became_active":"2023-10-14T19:04:56.956797+0000","last_became_peered":"2023-10-14T19:04:56.956797+0000","last_unstale":"2023-10-14T19:04:56.957104+0000","last_undegraded":"2023-10-14T19:04:56.957104+0000","last_fullsized":"2023-10-14T19:04:56.957104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940913+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953495+0000","last_change":"2023-10-14T19:04:56.953495+0000","last_active":"2023-10-14T19:04:56.953495+0000","last_peered":"2023-10-14T19:04:56.953495+0000","last_clean":"2023-10-14T19:04:56.953495+0000","last_became_active":"2023-10-14T19:04:56.953230+0000","last_became_peered":"2023-10-14T19:04:56.953230+0000","last_unstale":"2023-10-14T19:04:56.953495+0000","last_undegraded":"2023-10-14T19:04:56.953495+0000","last_fullsized":"2023-10-14T19:04:56.953495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936767+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957152+0000","last_change":"2023-10-14T19:04:56.957152+0000","last_active":"2023-10-14T19:04:56.957152+0000","last_peered":"2023-10-14T19:04:56.957152+0000","last_clean":"2023-10-14T19:04:56.957152+0000","last_became_active":"2023-10-14T19:04:56.956860+0000","last_became_peered":"2023-10-14T19:04:56.956860+0000","last_unstale":"2023-10-14T19:04:56.957152+0000","last_undegraded":"2023-10-14T19:04:56.957152+0000","last_fullsized":"2023-10-14T19:04:56.957152+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:42.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936747+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948515+0000","last_change":"2023-10-14T19:04:56.948515+0000","last_active":"2023-10-14T19:04:56.948515+0000","last_peered":"2023-10-14T19:04:56.948515+0000","last_clean":"2023-10-14T19:04:56.948515+0000","last_became_active":"2023-10-14T19:04:56.948264+0000","last_became_peered":"2023-10-14T19:04:56.948264+0000","last_unstale":"2023-10-14T19:04:56.948515+0000","last_undegraded":"2023-10-14T19:04:56.948515+0000","last_fullsized":"2023-10-14T19:04:56.948515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937801+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:17:14.887218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948559+0000","last_change":"2023-10-14T19:04:56.948559+0000","last_active":"2023-10-14T19:04:56.948559+0000","last_peered":"2023-10-14T19:04:56.948559+0000","last_clean":"2023-10-14T19:04:56.948559+0000","last_became_active":"2023-10-14T19:04:56.947284+0000","last_became_peered":"2023-10-14T19:04:56.947284+0000","last_unstale":"2023-10-14T19:04:56.948559+0000","last_undegraded":"2023-10-14T19:04:56.948559+0000","last_fullsized":"2023-10-14T19:04:56.948559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936969+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949992+0000","last_change":"2023-10-14T19:04:56.949992+0000","last_active":"2023-10-14T19:04:56.949992+0000","last_peered":"2023-10-14T19:04:56.949992+0000","last_clean":"2023-10-14T19:04:56.949992+0000","last_became_active":"2023-10-14T19:04:56.948410+0000","last_became_peered":"2023-10-14T19:04:56.948410+0000","last_unstale":"2023-10-14T19:04:56.949992+0000","last_undegraded":"2023-10-14T19:04:56.949992+0000","last_fullsized":"2023-10-14T19:04:56.949992+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:07.355240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941764+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951828+0000","last_change":"2023-10-14T19:04:56.951828+0000","last_active":"2023-10-14T19:04:56.951828+0000","last_peered":"2023-10-14T19:04:56.951828+0000","last_clean":"2023-10-14T19:04:56.951828+0000","last_became_active":"2023-10-14T19:04:56.951553+0000","last_became_peered":"2023-10-14T19:04:56.951553+0000","last_unstale":"2023-10-14T19:04:56.951828+0000","last_undegraded":"2023-10-14T19:04:56.951828+0000","last_fullsized":"2023-10-14T19:04:56.951828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:16.439561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940525+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949648+0000","last_change":"2023-10-14T19:04:56.949648+0000","last_active":"2023-10-14T19:04:56.949648+0000","last_peered":"2023-10-14T19:04:56.949648+0000","last_clean":"2023-10-14T19:04:56.949648+0000","last_became_active":"2023-10-14T19:04:56.949331+0000","last_became_peered":"2023-10-14T19:04:56.949331+0000","last_unstale":"2023-10-14T19:04:56.949648+0000","last_undegraded":"2023-10-14T19:04:56.949648+0000","last_fullsized":"2023-10-14T19:04:56.949648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:27.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937380+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:07.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.954045+0000","last_change":"2023-10-14T19:04:56.954045+0000","last_active":"2023-10-14T19:04:56.954045+0000","last_peered":"2023-10-14T19:04:56.954045+0000","last_clean":"2023-10-14T19:04:56.954045+0000","last_became_active":"2023-10-14T19:04:56.953785+0000","last_became_peered":"2023-10-14T19:04:56.953785+0000","last_unstale":"2023-10-14T19:04:56.954045+0000","last_undegraded":"2023-10-14T19:04:56.954045+0000","last_fullsized":"2023-10-14T19:04:56.954045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:08.118011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939751+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:32.481265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948518+0000","last_change":"2023-10-14T19:04:56.948518+0000","last_active":"2023-10-14T19:04:56.948518+0000","last_peered":"2023-10-14T19:04:56.948518+0000","last_clean":"2023-10-14T19:04:56.948518+0000","last_became_active":"2023-10-14T19:04:56.948181+0000","last_became_peered":"2023-10-14T19:04:56.948181+0000","last_unstale":"2023-10-14T19:04:56.948518+0000","last_undegraded":"2023-10-14T19:04:56.948518+0000","last_fullsized":"2023-10-14T19:04:56.948518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:53.493556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939928+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:04.134284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951477+0000","last_change":"2023-10-14T19:04:56.951477+0000","last_active":"2023-10-14T19:04:56.951477+0000","last_peered":"2023-10-14T19:04:56.951477+0000","last_clean":"2023-10-14T19:04:56.951477+0000","last_became_active":"2023-10-14T19:04:56.950964+0000","last_became_peered":"2023-10-14T19:04:56.950964+0000","last_unstale":"2023-10-14T19:04:56.951477+0000","last_undegraded":"2023-10-14T19:04:56.951477+0000","last_fullsized":"2023-10-14T19:04:56.951477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:54.716290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939561+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:36:00.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948728+0000","last_change":"2023-10-14T19:04:56.948728+0000","last_active":"2023-10-14T19:04:56.948728+0000","last_peered":"2023-10-14T19:04:56.948728+0000","last_clean":"2023-10-14T19:04:56.948728+0000","last_became_active":"2023-10-14T19:04:56.948464+0000","last_became_peered":"2023-10-14T19:04:56.948464+0000","last_unstale":"2023-10-14T19:04:56.948728+0000","last_undegraded":"2023-10-14T19:04:56.948728+0000","last_fullsized":"2023-10-14T19:04:56.948728+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939449+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950501+0000","last_change":"2023-10-14T19:04:56.950501+0000","last_active":"2023-10-14T19:04:56.950501+0000","last_peered":"2023-10-14T19:04:56.950501+0000","last_clean":"2023-10-14T19:04:56.950501+0000","last_became_active":"2023-10-14T19:04:56.950244+0000","last_became_peered":"2023-10-14T19:04:56.950244+0000","last_unstale":"2023-10-14T19:04:56.950501+0000","last_undegraded":"2023-10-14T19:04:56.950501+0000","last_fullsized":"2023-10-14T19:04:56.950501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:14.719061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937920+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947400+0000","last_change":"2023-10-14T19:04:56.947400+0000","last_active":"2023-10-14T19:04:56.947400+0000","last_peered":"2023-10-14T19:04:56.947400+0000","last_clean":"2023-10-14T19:04:56.947400+0000","last_became_active":"2023-10-14T19:04:56.947088+0000","last_became_peered":"2023-10-14T19:04:56.947088+0000","last_unstale":"2023-10-14T19:04:56.947400+0000","last_undegraded":"2023-10-14T19:04:56.947400+0000","last_fullsized":"2023-10-14T19:04:56.947400+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945029+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:52.089440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947918+0000","last_change":"2023-10-14T19:04:56.947918+0000","last_active":"2023-10-14T19:04:56.947918+0000","last_peered":"2023-10-14T19:04:56.947918+0000","last_clean":"2023-10-14T19:04:56.947918+0000","last_became_active":"2023-10-14T19:04:56.947639+0000","last_became_peered":"2023-10-14T19:04:56.947639+0000","last_unstale":"2023-10-14T19:04:56.947918+0000","last_undegraded":"2023-10-14T19:04:56.947918+0000","last_fullsized":"2023-10-14T19:04:56.947918+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:18.543184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945487+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.069974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.945202+0000","last_change":"2023-10-14T19:04:56.945202+0000","last_active":"2023-10-14T19:04:56.945202+0000","last_peered":"2023-10-14T19:04:56.945202+0000","last_clean":"2023-10-14T19:04:56.945202+0000","last_became_active":"2023-10-14T19:04:56.944900+0000","last_became_peered":"2023-10-14T19:04:56.944900+0000","last_unstale":"2023-10-14T19:04:56.945202+0000","last_undegraded":"2023-10-14T19:04:56.945202+0000","last_fullsized":"2023-10-14T19:04:56.945202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:53.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937181+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:07.915000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943250+0000","last_change":"2023-10-14T19:04:56.943250+0000","last_active":"2023-10-14T19:04:56.943250+0000","last_peered":"2023-10-14T19:04:56.943250+0000","last_clean":"2023-10-14T19:04:56.943250+0000","last_became_active":"2023-10-14T19:04:56.942982+0000","last_became_peered":"2023-10-14T19:04:56.942982+0000","last_unstale":"2023-10-14T19:04:56.943250+0000","last_undegraded":"2023-10-14T19:04:56.943250+0000","last_fullsized":"2023-10-14T19:04:56.943250+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:25.285500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943328+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948061+0000","last_change":"2023-10-14T19:04:56.948061+0000","last_active":"2023-10-14T19:04:56.948061+0000","last_peered":"2023-10-14T19:04:56.948061+0000","last_clean":"2023-10-14T19:04:56.948061+0000","last_became_active":"2023-10-14T19:04:56.947691+0000","last_became_peered":"2023-10-14T19:04:56.947691+0000","last_unstale":"2023-10-14T19:04:56.948061+0000","last_undegraded":"2023-10-14T19:04:56.948061+0000","last_fullsized":"2023-10-14T19:04:56.948061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940987+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947490+0000","last_change":"2023-10-14T19:04:56.947490+0000","last_active":"2023-10-14T19:04:56.947490+0000","last_peered":"2023-10-14T19:04:56.947490+0000","last_clean":"2023-10-14T19:04:56.947490+0000","last_became_active":"2023-10-14T19:04:56.947216+0000","last_became_peered":"2023-10-14T19:04:56.947216+0000","last_unstale":"2023-10-14T19:04:56.947490+0000","last_undegraded":"2023-10-14T19:04:56.947490+0000","last_fullsized":"2023-10-14T19:04:56.947490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940763+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.382834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948930+0000","last_change":"2023-10-14T19:04:56.948930+0000","last_active":"2023-10-14T19:04:56.948930+0000","last_peered":"2023-10-14T19:04:56.948930+0000","last_clean":"2023-10-14T19:04:56.948930+0000","last_became_active":"2023-10-14T19:04:56.948670+0000","last_became_peered":"2023-10-14T19:04:56.948670+0000","last_unstale":"2023-10-14T19:04:56.948930+0000","last_undegraded":"2023-10-14T19:04:56.948930+0000","last_fullsized":"2023-10-14T19:04:56.948930+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:32.229711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942656+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.627193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949415+0000","last_change":"2023-10-14T19:04:56.949415+0000","last_active":"2023-10-14T19:04:56.949415+0000","last_peered":"2023-10-14T19:04:56.949415+0000","last_clean":"2023-10-14T19:04:56.949415+0000","last_became_active":"2023-10-14T19:04:56.948760+0000","last_became_peered":"2023-10-14T19:04:56.948760+0000","last_unstale":"2023-10-14T19:04:56.949415+0000","last_undegraded":"2023-10-14T19:04:56.949415+0000","last_fullsized":"2023-10-14T19:04:56.949415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:06.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-14T19:04:55.936594+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:55.936594+0000","last_peered":"2023-10-14T19:04:55.936594+0000","last_clean":"2023-10-14T19:04:55.936594+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:55.936594+0000","last_undegraded":"2023-10-14T19:04:55.936594+0000","last_fullsized":"2023-10-14T19:04:55.936594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073236,"statfs":{"total":96636764160,"available":96330993664,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.434},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.39300000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.40899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.318}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.375},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.438}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.374},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.313},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.434},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.495},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.309},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.498}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.441}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.503}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.432}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.623},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:05:02.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-14T19:05:02.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.944063+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:26:07.338853+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-14T19:05:02.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941575+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:16:26.019073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-14T19:05:02.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941142+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:26:58.398518+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-14T19:05:02.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941517+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T19:05:02.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-14T19:05:02.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.938590+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:43:36.989172+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-14T19:05:02.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.942994+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:28:18.468735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-14T19:05:02.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939237+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:55:00.033354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-14T19:05:02.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.942155+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:09:17.443841+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-14T19:05:02.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.938401+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:38:10.234043+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-14T19:05:02.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937485+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-14T19:05:02.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.946436+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:32:19.996006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-14T19:05:02.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941017+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T19:05:02.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-14T19:05:02.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939374+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T19:05:02.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-14T19:05:02.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937854+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:30:23.146926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-14T19:05:02.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.938484+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T19:05:02.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-14T19:05:02.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937463+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-14T19:05:02.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937900+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T07:03:41.751751+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-14T19:05:02.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941553+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T19:05:02.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-14T19:05:02.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941879+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:33:34.920916+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-14T19:05:02.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939965+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T19:05:02.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-14T19:05:02.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937996+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-14T19:05:02.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937396+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-14T19:05:02.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.945680+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:12:44.646695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-14T19:05:02.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940610+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-14T19:05:02.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937224+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-14T19:05:02.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.938599+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-14T19:05:02.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940626+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:36:02.256630+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-14T19:05:02.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936162+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-14T19:05:02.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940167+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:10:32.207725+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-14T19:05:02.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936876+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-14T19:05:02.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.938740+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-14T19:05:02.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940710+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:51:52.800022+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-14T19:05:02.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941444+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-14T19:05:02.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937345+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:57:48.352293+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-14T19:05:02.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941685+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:39:04.370289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-14T19:05:02.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.945962+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:30:27.855130+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-14T19:05:02.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936304+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:39:28.483829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-14T19:05:02.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937061+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-14T19:05:02.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937493+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:54:11.025990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-14T19:05:02.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936795+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T19:05:02.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-14T19:05:02.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.938106+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-14T19:05:02.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.943326+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T07:00:57.076623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-14T19:05:02.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941246+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:49:24.842568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-14T19:05:02.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937960+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:44:02.462718+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-14T19:05:02.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940913+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-14T19:05:02.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936767+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-14T19:05:02.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936747+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T19:05:02.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-14T19:05:02.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937801+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:17:14.887218+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-14T19:05:02.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.936969+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T19:05:02.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-14T19:05:02.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.941764+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-14T19:05:02.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940525+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T19:05:02.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-14T19:05:02.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937380+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:49:07.005893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-14T19:05:02.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939751+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:29:32.481265+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-14T19:05:02.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939928+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:35:04.134284+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-14T19:05:02.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939561+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:36:00.651420+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-14T19:05:02.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.939449+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T19:05:02.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-14T19:05:02.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937920+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T19:05:02.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-14T19:05:02.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.945029+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:46:52.089440+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-14T19:05:02.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.945487+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:29:35.069974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T19:05:02.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-14T19:05:02.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.937181+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:28:07.915000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T19:05:02.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-14T19:05:02.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.943328+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-14T19:05:02.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940987+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T19:05:02.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-14T19:05:02.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.940763+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:15:53.382834+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T19:05:02.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-14T19:05:02.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T19:04:56.927545+0000', 'last_change': '2023-10-14T19:04:56.942656+0000', 'last_active': '2023-10-14T19:04:56.927545+0000', 'last_peered': '2023-10-14T19:04:56.927545+0000', 'last_clean': '2023-10-14T19:04:56.927545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T19:04:56.927545+0000', 'last_undegraded': '2023-10-14T19:04:56.927545+0000', 'last_fullsized': '2023-10-14T19:04:56.927545+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'last_clean_scrub_stamp': '2023-10-14T19:04:56.927545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:40:28.627193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T19:05:02.885 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T19:05:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.004+0000 7fbbbcef6700 1 Processor -- start 2023-10-14T19:05:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.004+0000 7fbbbcef6700 1 -- start start 2023-10-14T19:05:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbbcef6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbbb8153dd0 0x7fbbb815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbbcef6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbbb80cea00 0x7fbbb80ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbbcef6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb815ac50 con 0x7fbbb8153a00 2023-10-14T19:05:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbbcef6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb815d010 con 0x7fbbb8153dd0 2023-10-14T19:05:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbbcef6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80cf3e0 con 0x7fbbb80cea00 2023-10-14T19:05:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb77fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbbb8153a00 0x7fbbb815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50904/0 (socket says 172.21.15.7:50904) 2023-10-14T19:05:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb77fe700 1 -- 172.21.15.7:0/2744862090 learned_addr learned my addr 172.21.15.7:0/2744862090 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb6ffd700 1 --2- 172.21.15.7:0/2744862090 >> v2:172.21.15.7:3300/0 conn(0x7fbbb8153dd0 0x7fbbb815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb7fff700 1 --2- 172.21.15.7:0/2744862090 >> v2:172.21.15.148:3300/0 conn(0x7fbbb80cea00 0x7fbbb80ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb67fc700 1 -- 172.21.15.7:0/2744862090 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476383676 0 0) 0x7fbbb815ac50 con 0x7fbbb8153a00 2023-10-14T19:05:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb67fc700 1 -- 172.21.15.7:0/2744862090 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba0003570 con 0x7fbbb8153a00 2023-10-14T19:05:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/2744862090 >> v2:172.21.15.148:3300/0 conn(0x7fbbb80cea00 msgr2=0x7fbbb80ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb6ffd700 1 --2- 172.21.15.7:0/2744862090 >> v2:172.21.15.148:3300/0 conn(0x7fbbb80cea00 0x7fbbb80ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.005+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/2744862090 >> v1:172.21.15.7:6789/0 conn(0x7fbbb8153a00 legacy=0x7fbbb815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/2744862090 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb815af60 con 0x7fbbb8153dd0 2023-10-14T19:05:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbb6ffd700 1 --2- 172.21.15.7:0/2744862090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815de50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80d03b0 tx=0x7fbbac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11888b3a70b7820c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbb67fc700 1 -- 172.21.15.7:0/2744862090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac011630 con 0x7fbbb8153dd0 2023-10-14T19:05:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbb67fc700 1 -- 172.21.15.7:0/2744862090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0117b0 con 0x7fbbb8153dd0 2023-10-14T19:05:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbb67fc700 1 -- 172.21.15.7:0/2744862090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac011b70 con 0x7fbbb8153dd0 2023-10-14T19:05:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 -- 172.21.15.7:0/2744862090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153dd0 msgr2=0x7fbbb815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/2744862090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815de50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80d03b0 tx=0x7fbbac0091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 -- 172.21.15.7:0/2744862090 shutdown_connections 2023-10-14T19:05:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/2744862090 >> v2:172.21.15.148:3300/0 conn(0x7fbbb80cea00 0x7fbbb80ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/2744862090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815de50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 -- 172.21.15.7:0/2744862090 >> 172.21.15.7:0/2744862090 conn(0x7fbbb80703a0 msgr2=0x7fbbb80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 -- 172.21.15.7:0/2744862090 shutdown_connections 2023-10-14T19:05:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.006+0000 7fbbbcef6700 1 -- 172.21.15.7:0/2744862090 wait complete. 2023-10-14T19:05:03.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 Processor -- start 2023-10-14T19:05:03.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 -- start start 2023-10-14T19:05:03.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbb80cea00 0x7fbbb80c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 0x7fbbb8145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c7d20 con 0x7fbbb8153a00 2023-10-14T19:05:03.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80cd0c0 con 0x7fbbb8153dd0 2023-10-14T19:05:03.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbbcef6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c7710 con 0x7fbbb80cea00 2023-10-14T19:05:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbb6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 0x7fbbb8145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbb6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 0x7fbbb8145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60290/0 (socket says 172.21.15.7:60290) 2023-10-14T19:05:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.008+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/1664695913 learned_addr learned my addr 172.21.15.7:0/1664695913 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb7fff700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb77fe700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbb80cea00 0x7fbbb80c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbb80cea00 msgr2=0x7fbbb80c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb6ffd700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbb80cea00 0x7fbbb80c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbb8153dd0 msgr2=0x7fbbb815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb6ffd700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb6ffd700 1 -- 172.21.15.7:0/1664695913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009420 con 0x7fbbb8153a00 2023-10-14T19:05:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbb6ffd700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 0x7fbbb8145f20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbbac013000 tx=0x7fbbac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac01f070 con 0x7fbbb8153a00 2023-10-14T19:05:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac011920 con 0x7fbbb8153a00 2023-10-14T19:05:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb80ccde0 con 0x7fbbb8153a00 2023-10-14T19:05:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac023410 con 0x7fbbb8153a00 2023-10-14T19:05:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.009+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8146460 con 0x7fbbb8153a00 2023-10-14T19:05:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.010+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb80c7e90 con 0x7fbbb8153a00 2023-10-14T19:05:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.010+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fbbac0223b0 con 0x7fbbb8153a00 2023-10-14T19:05:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.011+0000 7fbb9f7fe700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbba4066fc0 0x7fbba4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.011+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbac0857e0 con 0x7fbbb8153a00 2023-10-14T19:05:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.011+0000 7fbbb77fe700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbba4066fc0 0x7fbba4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.012+0000 7fbbb77fe700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbba4066fc0 0x7fbba4069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbba8007fd0 tx=0x7fbba8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.015+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbac052a60 con 0x7fbbb8153a00 2023-10-14T19:05:03.260 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-14T19:05:03.259+0000 7fdabb3a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:05:03.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.287+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbbb804c3c0 con 0x7fbbb8153a00 2023-10-14T19:05:03.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.288+0000 7fbb9f7fe700 1 -- 172.21.15.7:0/1664695913 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1455 (secure 0 0 0) 0x7fbbac056080 con 0x7fbbb8153a00 2023-10-14T19:05:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:03.289 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":131,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1697310181,"num_in_osds":8,"osd_in_since":1697310174,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2455183360,"bytes_avail":770638929920,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5637}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-14T19:04:47.645280+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-14T19:05:03.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbba4066fc0 msgr2=0x7fbba4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbba4066fc0 0x7fbba4069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbba8007fd0 tx=0x7fbba8009040 comp rx=0 tx=0).stop 2023-10-14T19:05:03.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 msgr2=0x7fbbb8145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 0x7fbbb8145f20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbbac013000 tx=0x7fbbac017000 comp rx=0 tx=0).stop 2023-10-14T19:05:03.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 shutdown_connections 2023-10-14T19:05:03.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbba4066fc0 0x7fbba4069470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbb8153dd0 0x7fbbb815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbb80cea00 0x7fbbb80c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 --2- 172.21.15.7:0/1664695913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb8153a00 0x7fbbb8145f20 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 >> 172.21.15.7:0/1664695913 conn(0x7fbbb80703a0 msgr2=0x7fbbb8152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 shutdown_connections 2023-10-14T19:05:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.290+0000 7fbbbcef6700 1 -- 172.21.15.7:0/1664695913 wait complete. 2023-10-14T19:05:03.303 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T19:05:03.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:05:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.422+0000 7f3f84a36700 1 Processor -- start 2023-10-14T19:05:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.422+0000 7f3f84a36700 1 -- start start 2023-10-14T19:05:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f84a36700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f8015a5d0 0x7f3f80156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f84a36700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015ae40 con 0x7f3f800cb970 2023-10-14T19:05:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f84a36700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015ab60 con 0x7f3f800cb5a0 2023-10-14T19:05:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f84a36700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f800ce0f0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7ed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f8015a5d0 0x7f3f80156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7dd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3f800cb970 0x7f3f80159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50918/0 (socket says 172.21.15.7:50918) 2023-10-14T19:05:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7dd9b700 1 -- 172.21.15.7:0/1244571598 learned_addr learned my addr 172.21.15.7:0/1244571598 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/1244571598 >> v1:172.21.15.148:6789/0 conn(0x7f3f800cb5a0 legacy=0x7f3f800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/1244571598 >> v1:172.21.15.7:6789/0 conn(0x7f3f800cb970 legacy=0x7f3f80159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/1244571598 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f800ccf00 con 0x7f3f8015a5d0 2023-10-14T19:05:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7d59a700 1 -- 172.21.15.7:0/1244571598 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537901829 0 0) 0x7f3f8015ae40 con 0x7f3f800cb970 2023-10-14T19:05:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.423+0000 7f3f7ed9d700 1 --2- 172.21.15.7:0/1244571598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f80156e90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3f780098e0 tx=0x7f3f780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c0035d4b3d9fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f7d59a700 1 -- 172.21.15.7:0/1244571598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78009e80 con 0x7f3f8015a5d0 2023-10-14T19:05:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f7d59a700 1 -- 172.21.15.7:0/1244571598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7800b860 con 0x7f3f8015a5d0 2023-10-14T19:05:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f7d59a700 1 -- 172.21.15.7:0/1244571598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800bbe0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 -- 172.21.15.7:0/1244571598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 msgr2=0x7f3f80156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 --2- 172.21.15.7:0/1244571598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f80156e90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3f780098e0 tx=0x7f3f780091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 -- 172.21.15.7:0/1244571598 shutdown_connections 2023-10-14T19:05:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 --2- 172.21.15.7:0/1244571598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f80156e90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 -- 172.21.15.7:0/1244571598 >> 172.21.15.7:0/1244571598 conn(0x7f3f80070e30 msgr2=0x7f3f800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 -- 172.21.15.7:0/1244571598 shutdown_connections 2023-10-14T19:05:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.424+0000 7f3f84a36700 1 -- 172.21.15.7:0/1244571598 wait complete. 2023-10-14T19:05:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.425+0000 7f3f84a36700 1 Processor -- start 2023-10-14T19:05:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.425+0000 7f3f84a36700 1 -- start start 2023-10-14T19:05:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f84a36700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f800cb5a0 0x7f3f800ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f84a36700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f800cb970 0x7f3f80151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f84a36700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f800b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f84a36700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800b46f0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f84a36700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800c9f10 con 0x7f3f800cb5a0 2023-10-14T19:05:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f84a36700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800c95e0 con 0x7f3f800cb970 2023-10-14T19:05:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f800b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f800b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60308/0 (socket says 172.21.15.7:60308) 2023-10-14T19:05:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/3175501645 learned_addr learned my addr 172.21.15.7:0/3175501645 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f800cb970 msgr2=0x7f3f80151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f800cb970 0x7f3f80151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f800cb5a0 msgr2=0x7f3f800ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7e59c700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f800cb5a0 0x7f3f800ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.426+0000 7f3f7ed9d700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f800cb5a0 0x7f3f800ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f7ed9d700 1 -- 172.21.15.7:0/3175501645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78009420 con 0x7f3f8015a5d0 2023-10-14T19:05:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f7e59c700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f800cb5a0 0x7f3f800ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:05:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f7ed9d700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f800b3e70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3f8006ea60 tx=0x7f3f78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7801f070 con 0x7f3f8015a5d0 2023-10-14T19:05:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78011420 con 0x7f3f8015a5d0 2023-10-14T19:05:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f800c98c0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800bbe0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.427+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f80151880 con 0x7f3f8015a5d0 2023-10-14T19:05:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.428+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f800ca0a0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.428+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f3f780119d0 con 0x7f3f8015a5d0 2023-10-14T19:05:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.429+0000 7f3f767fc700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f60066fc0 0x7f3f60069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.429+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f78085c70 con 0x7f3f8015a5d0 2023-10-14T19:05:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.429+0000 7f3f7e59c700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f60066fc0 0x7f3f60069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.429+0000 7f3f7e59c700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f60066fc0 0x7f3f60069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f70007fd0 tx=0x7f3f70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.433+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f78052f30 con 0x7f3f8015a5d0 2023-10-14T19:05:03.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.620+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f8004c3c0 con 0x7f3f60066fc0 2023-10-14T19:05:03.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.628+0000 7f3f767fc700 1 -- 172.21.15.7:0/3175501645 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286873 (secure 0 0 0) 0x7f3f8004c3c0 con 0x7f3f60066fc0 2023-10-14T19:05:03.632 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:03.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f60066fc0 msgr2=0x7f3f60069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f60066fc0 0x7f3f60069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f70007fd0 tx=0x7f3f70009040 comp rx=0 tx=0).stop 2023-10-14T19:05:03.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 msgr2=0x7f3f800b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f800b3e70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3f8006ea60 tx=0x7f3f78017000 comp rx=0 tx=0).stop 2023-10-14T19:05:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 shutdown_connections 2023-10-14T19:05:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f60066fc0 0x7f3f60069470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f800cb5a0 0x7f3f800ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015a5d0 0x7f3f800b3e70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.631+0000 7f3f84a36700 1 --2- 172.21.15.7:0/3175501645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f800cb970 0x7f3f80151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.632+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 >> 172.21.15.7:0/3175501645 conn(0x7f3f80070e30 msgr2=0x7f3f800c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.632+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 shutdown_connections 2023-10-14T19:05:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:03.632+0000 7f3f84a36700 1 -- 172.21.15.7:0/3175501645 wait complete. 2023-10-14T19:05:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:05:03.644 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-14T19:05:01.648188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397640,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577080,"statfs":{"total":773094113280,"available":770638929920,"internally_reserved":0,"allocated":7217152,"data_stored":3719320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.720154"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.944063+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:26:07.338853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941575+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:26.019073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941142+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:26:58.398518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941517+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938590+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:36.989172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942994+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:18.468735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939237+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:00.033354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942155+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:17.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938401+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:10.234043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937485+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.946436+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:19.996006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941017+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939374+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937854+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:23.146926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938484+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937463+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937900+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:41.751751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941553+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941879+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:34.920916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939965+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937996+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937396+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945680+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:44.646695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940610+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937224+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938599+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940626+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:02.256630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936162+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940167+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:32.207725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936876+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938740+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:09.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940710+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:52.800022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941444+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953149+0000","last_change":"2023-10-14T19:04:56.953149+0000","last_active":"2023-10-14T19:04:56.953149+0000","last_peered":"2023-10-14T19:04:56.953149+0000","last_clean":"2023-10-14T19:04:56.953149+0000","last_became_active":"2023-10-14T19:04:56.952688+0000","last_became_peered":"2023-10-14T19:04:56.952688+0000","last_unstale":"2023-10-14T19:04:56.953149+0000","last_undegraded":"2023-10-14T19:04:56.953149+0000","last_fullsized":"2023-10-14T19:04:56.953149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:08.171627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937345+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:48.352293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950268+0000","last_change":"2023-10-14T19:04:56.950268+0000","last_active":"2023-10-14T19:04:56.950268+0000","last_peered":"2023-10-14T19:04:56.950268+0000","last_clean":"2023-10-14T19:04:56.950268+0000","last_became_active":"2023-10-14T19:04:56.949979+0000","last_became_peered":"2023-10-14T19:04:56.949979+0000","last_unstale":"2023-10-14T19:04:56.950268+0000","last_undegraded":"2023-10-14T19:04:56.950268+0000","last_fullsized":"2023-10-14T19:04:56.950268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941685+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:04.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951889+0000","last_change":"2023-10-14T19:04:56.951889+0000","last_active":"2023-10-14T19:04:56.951889+0000","last_peered":"2023-10-14T19:04:56.951889+0000","last_clean":"2023-10-14T19:04:56.951889+0000","last_became_active":"2023-10-14T19:04:56.951570+0000","last_became_peered":"2023-10-14T19:04:56.951570+0000","last_unstale":"2023-10-14T19:04:56.951889+0000","last_undegraded":"2023-10-14T19:04:56.951889+0000","last_fullsized":"2023-10-14T19:04:56.951889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945962+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:27.855130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948874+0000","last_change":"2023-10-14T19:04:56.948874+0000","last_active":"2023-10-14T19:04:56.948874+0000","last_peered":"2023-10-14T19:04:56.948874+0000","last_clean":"2023-10-14T19:04:56.948874+0000","last_became_active":"2023-10-14T19:04:56.948586+0000","last_became_peered":"2023-10-14T19:04:56.948586+0000","last_unstale":"2023-10-14T19:04:56.948874+0000","last_undegraded":"2023-10-14T19:04:56.948874+0000","last_fullsized":"2023-10-14T19:04:56.948874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:04.970618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936304+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:28.483829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.940818+0000","last_change":"2023-10-14T19:04:56.940818+0000","last_active":"2023-10-14T19:04:56.940818+0000","last_peered":"2023-10-14T19:04:56.940818+0000","last_clean":"2023-10-14T19:04:56.940818+0000","last_became_active":"2023-10-14T19:04:56.940545+0000","last_became_peered":"2023-10-14T19:04:56.940545+0000","last_unstale":"2023-10-14T19:04:56.940818+0000","last_undegraded":"2023-10-14T19:04:56.940818+0000","last_fullsized":"2023-10-14T19:04:56.940818+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:13.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937061+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950899+0000","last_change":"2023-10-14T19:04:56.950899+0000","last_active":"2023-10-14T19:04:56.950899+0000","last_peered":"2023-10-14T19:04:56.950899+0000","last_clean":"2023-10-14T19:04:56.950899+0000","last_became_active":"2023-10-14T19:04:56.950557+0000","last_became_peered":"2023-10-14T19:04:56.950557+0000","last_unstale":"2023-10-14T19:04:56.950899+0000","last_undegraded":"2023-10-14T19:04:56.950899+0000","last_fullsized":"2023-10-14T19:04:56.950899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:29.175822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937493+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:11.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949526+0000","last_change":"2023-10-14T19:04:56.949526+0000","last_active":"2023-10-14T19:04:56.949526+0000","last_peered":"2023-10-14T19:04:56.949526+0000","last_clean":"2023-10-14T19:04:56.949526+0000","last_became_active":"2023-10-14T19:04:56.949203+0000","last_became_peered":"2023-10-14T19:04:56.949203+0000","last_unstale":"2023-10-14T19:04:56.949526+0000","last_undegraded":"2023-10-14T19:04:56.949526+0000","last_fullsized":"2023-10-14T19:04:56.949526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936795+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948722+0000","last_change":"2023-10-14T19:04:56.948722+0000","last_active":"2023-10-14T19:04:56.948722+0000","last_peered":"2023-10-14T19:04:56.948722+0000","last_clean":"2023-10-14T19:04:56.948722+0000","last_became_active":"2023-10-14T19:04:56.948466+0000","last_became_peered":"2023-10-14T19:04:56.948466+0000","last_unstale":"2023-10-14T19:04:56.948722+0000","last_undegraded":"2023-10-14T19:04:56.948722+0000","last_fullsized":"2023-10-14T19:04:56.948722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:53.045006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.938106+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943154+0000","last_change":"2023-10-14T19:04:56.943154+0000","last_active":"2023-10-14T19:04:56.943154+0000","last_peered":"2023-10-14T19:04:56.943154+0000","last_clean":"2023-10-14T19:04:56.943154+0000","last_became_active":"2023-10-14T19:04:56.942867+0000","last_became_peered":"2023-10-14T19:04:56.942867+0000","last_unstale":"2023-10-14T19:04:56.943154+0000","last_undegraded":"2023-10-14T19:04:56.943154+0000","last_fullsized":"2023-10-14T19:04:56.943154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943326+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:57.076623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949434+0000","last_change":"2023-10-14T19:04:56.949434+0000","last_active":"2023-10-14T19:04:56.949434+0000","last_peered":"2023-10-14T19:04:56.949434+0000","last_clean":"2023-10-14T19:04:56.949434+0000","last_became_active":"2023-10-14T19:04:56.949098+0000","last_became_peered":"2023-10-14T19:04:56.949098+0000","last_unstale":"2023-10-14T19:04:56.949434+0000","last_undegraded":"2023-10-14T19:04:56.949434+0000","last_fullsized":"2023-10-14T19:04:56.949434+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:34.768904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941246+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.842568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943590+0000","last_change":"2023-10-14T19:04:56.943590+0000","last_active":"2023-10-14T19:04:56.943590+0000","last_peered":"2023-10-14T19:04:56.943590+0000","last_clean":"2023-10-14T19:04:56.943590+0000","last_became_active":"2023-10-14T19:04:56.943234+0000","last_became_peered":"2023-10-14T19:04:56.943234+0000","last_unstale":"2023-10-14T19:04:56.943590+0000","last_undegraded":"2023-10-14T19:04:56.943590+0000","last_fullsized":"2023-10-14T19:04:56.943590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:05.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937960+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:02.462718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957104+0000","last_change":"2023-10-14T19:04:56.957104+0000","last_active":"2023-10-14T19:04:56.957104+0000","last_peered":"2023-10-14T19:04:56.957104+0000","last_clean":"2023-10-14T19:04:56.957104+0000","last_became_active":"2023-10-14T19:04:56.956797+0000","last_became_peered":"2023-10-14T19:04:56.956797+0000","last_unstale":"2023-10-14T19:04:56.957104+0000","last_undegraded":"2023-10-14T19:04:56.957104+0000","last_fullsized":"2023-10-14T19:04:56.957104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940913+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.953495+0000","last_change":"2023-10-14T19:04:56.953495+0000","last_active":"2023-10-14T19:04:56.953495+0000","last_peered":"2023-10-14T19:04:56.953495+0000","last_clean":"2023-10-14T19:04:56.953495+0000","last_became_active":"2023-10-14T19:04:56.953230+0000","last_became_peered":"2023-10-14T19:04:56.953230+0000","last_unstale":"2023-10-14T19:04:56.953495+0000","last_undegraded":"2023-10-14T19:04:56.953495+0000","last_fullsized":"2023-10-14T19:04:56.953495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936767+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.957152+0000","last_change":"2023-10-14T19:04:56.957152+0000","last_active":"2023-10-14T19:04:56.957152+0000","last_peered":"2023-10-14T19:04:56.957152+0000","last_clean":"2023-10-14T19:04:56.957152+0000","last_became_active":"2023-10-14T19:04:56.956860+0000","last_became_peered":"2023-10-14T19:04:56.956860+0000","last_unstale":"2023-10-14T19:04:56.957152+0000","last_undegraded":"2023-10-14T19:04:56.957152+0000","last_fullsized":"2023-10-14T19:04:56.957152+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:42.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936747+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948515+0000","last_change":"2023-10-14T19:04:56.948515+0000","last_active":"2023-10-14T19:04:56.948515+0000","last_peered":"2023-10-14T19:04:56.948515+0000","last_clean":"2023-10-14T19:04:56.948515+0000","last_became_active":"2023-10-14T19:04:56.948264+0000","last_became_peered":"2023-10-14T19:04:56.948264+0000","last_unstale":"2023-10-14T19:04:56.948515+0000","last_undegraded":"2023-10-14T19:04:56.948515+0000","last_fullsized":"2023-10-14T19:04:56.948515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937801+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:17:14.887218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948559+0000","last_change":"2023-10-14T19:04:56.948559+0000","last_active":"2023-10-14T19:04:56.948559+0000","last_peered":"2023-10-14T19:04:56.948559+0000","last_clean":"2023-10-14T19:04:56.948559+0000","last_became_active":"2023-10-14T19:04:56.947284+0000","last_became_peered":"2023-10-14T19:04:56.947284+0000","last_unstale":"2023-10-14T19:04:56.948559+0000","last_undegraded":"2023-10-14T19:04:56.948559+0000","last_fullsized":"2023-10-14T19:04:56.948559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.936969+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949992+0000","last_change":"2023-10-14T19:04:56.949992+0000","last_active":"2023-10-14T19:04:56.949992+0000","last_peered":"2023-10-14T19:04:56.949992+0000","last_clean":"2023-10-14T19:04:56.949992+0000","last_became_active":"2023-10-14T19:04:56.948410+0000","last_became_peered":"2023-10-14T19:04:56.948410+0000","last_unstale":"2023-10-14T19:04:56.949992+0000","last_undegraded":"2023-10-14T19:04:56.949992+0000","last_fullsized":"2023-10-14T19:04:56.949992+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:07.355240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.941764+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951828+0000","last_change":"2023-10-14T19:04:56.951828+0000","last_active":"2023-10-14T19:04:56.951828+0000","last_peered":"2023-10-14T19:04:56.951828+0000","last_clean":"2023-10-14T19:04:56.951828+0000","last_became_active":"2023-10-14T19:04:56.951553+0000","last_became_peered":"2023-10-14T19:04:56.951553+0000","last_unstale":"2023-10-14T19:04:56.951828+0000","last_undegraded":"2023-10-14T19:04:56.951828+0000","last_fullsized":"2023-10-14T19:04:56.951828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:16.439561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940525+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949648+0000","last_change":"2023-10-14T19:04:56.949648+0000","last_active":"2023-10-14T19:04:56.949648+0000","last_peered":"2023-10-14T19:04:56.949648+0000","last_clean":"2023-10-14T19:04:56.949648+0000","last_became_active":"2023-10-14T19:04:56.949331+0000","last_became_peered":"2023-10-14T19:04:56.949331+0000","last_unstale":"2023-10-14T19:04:56.949648+0000","last_undegraded":"2023-10-14T19:04:56.949648+0000","last_fullsized":"2023-10-14T19:04:56.949648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:27.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937380+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:07.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.954045+0000","last_change":"2023-10-14T19:04:56.954045+0000","last_active":"2023-10-14T19:04:56.954045+0000","last_peered":"2023-10-14T19:04:56.954045+0000","last_clean":"2023-10-14T19:04:56.954045+0000","last_became_active":"2023-10-14T19:04:56.953785+0000","last_became_peered":"2023-10-14T19:04:56.953785+0000","last_unstale":"2023-10-14T19:04:56.954045+0000","last_undegraded":"2023-10-14T19:04:56.954045+0000","last_fullsized":"2023-10-14T19:04:56.954045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:08.118011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939751+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:32.481265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948518+0000","last_change":"2023-10-14T19:04:56.948518+0000","last_active":"2023-10-14T19:04:56.948518+0000","last_peered":"2023-10-14T19:04:56.948518+0000","last_clean":"2023-10-14T19:04:56.948518+0000","last_became_active":"2023-10-14T19:04:56.948181+0000","last_became_peered":"2023-10-14T19:04:56.948181+0000","last_unstale":"2023-10-14T19:04:56.948518+0000","last_undegraded":"2023-10-14T19:04:56.948518+0000","last_fullsized":"2023-10-14T19:04:56.948518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:53.493556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939928+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:04.134284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.951477+0000","last_change":"2023-10-14T19:04:56.951477+0000","last_active":"2023-10-14T19:04:56.951477+0000","last_peered":"2023-10-14T19:04:56.951477+0000","last_clean":"2023-10-14T19:04:56.951477+0000","last_became_active":"2023-10-14T19:04:56.950964+0000","last_became_peered":"2023-10-14T19:04:56.950964+0000","last_unstale":"2023-10-14T19:04:56.951477+0000","last_undegraded":"2023-10-14T19:04:56.951477+0000","last_fullsized":"2023-10-14T19:04:56.951477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:54.716290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939561+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:36:00.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948728+0000","last_change":"2023-10-14T19:04:56.948728+0000","last_active":"2023-10-14T19:04:56.948728+0000","last_peered":"2023-10-14T19:04:56.948728+0000","last_clean":"2023-10-14T19:04:56.948728+0000","last_became_active":"2023-10-14T19:04:56.948464+0000","last_became_peered":"2023-10-14T19:04:56.948464+0000","last_unstale":"2023-10-14T19:04:56.948728+0000","last_undegraded":"2023-10-14T19:04:56.948728+0000","last_fullsized":"2023-10-14T19:04:56.948728+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.939449+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:09.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.950501+0000","last_change":"2023-10-14T19:04:56.950501+0000","last_active":"2023-10-14T19:04:56.950501+0000","last_peered":"2023-10-14T19:04:56.950501+0000","last_clean":"2023-10-14T19:04:56.950501+0000","last_became_active":"2023-10-14T19:04:56.950244+0000","last_became_peered":"2023-10-14T19:04:56.950244+0000","last_unstale":"2023-10-14T19:04:56.950501+0000","last_undegraded":"2023-10-14T19:04:56.950501+0000","last_fullsized":"2023-10-14T19:04:56.950501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:14.719061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937920+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947400+0000","last_change":"2023-10-14T19:04:56.947400+0000","last_active":"2023-10-14T19:04:56.947400+0000","last_peered":"2023-10-14T19:04:56.947400+0000","last_clean":"2023-10-14T19:04:56.947400+0000","last_became_active":"2023-10-14T19:04:56.947088+0000","last_became_peered":"2023-10-14T19:04:56.947088+0000","last_unstale":"2023-10-14T19:04:56.947400+0000","last_undegraded":"2023-10-14T19:04:56.947400+0000","last_fullsized":"2023-10-14T19:04:56.947400+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945029+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:52.089440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947918+0000","last_change":"2023-10-14T19:04:56.947918+0000","last_active":"2023-10-14T19:04:56.947918+0000","last_peered":"2023-10-14T19:04:56.947918+0000","last_clean":"2023-10-14T19:04:56.947918+0000","last_became_active":"2023-10-14T19:04:56.947639+0000","last_became_peered":"2023-10-14T19:04:56.947639+0000","last_unstale":"2023-10-14T19:04:56.947918+0000","last_undegraded":"2023-10-14T19:04:56.947918+0000","last_fullsized":"2023-10-14T19:04:56.947918+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:18.543184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.945487+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.069974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.945202+0000","last_change":"2023-10-14T19:04:56.945202+0000","last_active":"2023-10-14T19:04:56.945202+0000","last_peered":"2023-10-14T19:04:56.945202+0000","last_clean":"2023-10-14T19:04:56.945202+0000","last_became_active":"2023-10-14T19:04:56.944900+0000","last_became_peered":"2023-10-14T19:04:56.944900+0000","last_unstale":"2023-10-14T19:04:56.945202+0000","last_undegraded":"2023-10-14T19:04:56.945202+0000","last_fullsized":"2023-10-14T19:04:56.945202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:53.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.937181+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:07.915000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.943250+0000","last_change":"2023-10-14T19:04:56.943250+0000","last_active":"2023-10-14T19:04:56.943250+0000","last_peered":"2023-10-14T19:04:56.943250+0000","last_clean":"2023-10-14T19:04:56.943250+0000","last_became_active":"2023-10-14T19:04:56.942982+0000","last_became_peered":"2023-10-14T19:04:56.942982+0000","last_unstale":"2023-10-14T19:04:56.943250+0000","last_undegraded":"2023-10-14T19:04:56.943250+0000","last_fullsized":"2023-10-14T19:04:56.943250+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:25.285500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.943328+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:52.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948061+0000","last_change":"2023-10-14T19:04:56.948061+0000","last_active":"2023-10-14T19:04:56.948061+0000","last_peered":"2023-10-14T19:04:56.948061+0000","last_clean":"2023-10-14T19:04:56.948061+0000","last_became_active":"2023-10-14T19:04:56.947691+0000","last_became_peered":"2023-10-14T19:04:56.947691+0000","last_unstale":"2023-10-14T19:04:56.948061+0000","last_undegraded":"2023-10-14T19:04:56.948061+0000","last_fullsized":"2023-10-14T19:04:56.948061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940987+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.947490+0000","last_change":"2023-10-14T19:04:56.947490+0000","last_active":"2023-10-14T19:04:56.947490+0000","last_peered":"2023-10-14T19:04:56.947490+0000","last_clean":"2023-10-14T19:04:56.947490+0000","last_became_active":"2023-10-14T19:04:56.947216+0000","last_became_peered":"2023-10-14T19:04:56.947216+0000","last_unstale":"2023-10-14T19:04:56.947490+0000","last_undegraded":"2023-10-14T19:04:56.947490+0000","last_fullsized":"2023-10-14T19:04:56.947490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.940763+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.382834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.948930+0000","last_change":"2023-10-14T19:04:56.948930+0000","last_active":"2023-10-14T19:04:56.948930+0000","last_peered":"2023-10-14T19:04:56.948930+0000","last_clean":"2023-10-14T19:04:56.948930+0000","last_became_active":"2023-10-14T19:04:56.948670+0000","last_became_peered":"2023-10-14T19:04:56.948670+0000","last_unstale":"2023-10-14T19:04:56.948930+0000","last_undegraded":"2023-10-14T19:04:56.948930+0000","last_fullsized":"2023-10-14T19:04:56.948930+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:32.229711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T19:04:56.927545+0000","last_change":"2023-10-14T19:04:56.942656+0000","last_active":"2023-10-14T19:04:56.927545+0000","last_peered":"2023-10-14T19:04:56.927545+0000","last_clean":"2023-10-14T19:04:56.927545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:04:56.927545+0000","last_undegraded":"2023-10-14T19:04:56.927545+0000","last_fullsized":"2023-10-14T19:04:56.927545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.627193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-14T19:04:56.949415+0000","last_change":"2023-10-14T19:04:56.949415+0000","last_active":"2023-10-14T19:04:56.949415+0000","last_peered":"2023-10-14T19:04:56.949415+0000","last_clean":"2023-10-14T19:04:56.949415+0000","last_became_active":"2023-10-14T19:04:56.948760+0000","last_became_peered":"2023-10-14T19:04:56.948760+0000","last_unstale":"2023-10-14T19:04:56.949415+0000","last_undegraded":"2023-10-14T19:04:56.949415+0000","last_fullsized":"2023-10-14T19:04:56.949415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:06.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-14T19:04:55.936594+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:55.936594+0000","last_peered":"2023-10-14T19:04:55.936594+0000","last_clean":"2023-10-14T19:04:55.936594+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:55.936594+0000","last_undegraded":"2023-10-14T19:04:55.936594+0000","last_fullsized":"2023-10-14T19:04:55.936594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073236,"statfs":{"total":96636764160,"available":96330993664,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.434},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.39300000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.40899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.318}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.375},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.438}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.374},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":907691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.313},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.434},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.495},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.309},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.498}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.441}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.503}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":317323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.432}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.623},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:05:06.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:05:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.783+0000 7f32d4bc4700 1 Processor -- start 2023-10-14T19:05:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.783+0000 7f32d4bc4700 1 -- start start 2023-10-14T19:05:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32d4bc4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f32d00af600 0x7f32d00c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32d4bc4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d00c6d50 con 0x7f32d0140a70 2023-10-14T19:05:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32d4bc4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d00c7030 con 0x7f32d0140e40 2023-10-14T19:05:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32d4bc4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d00c7310 con 0x7f32d00af600 2023-10-14T19:05:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32cf7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f32d0140a70 0x7f32d00c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38062/0 (socket says 172.21.15.7:38062) 2023-10-14T19:05:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32cf7fe700 1 -- 172.21.15.7:0/2879864456 learned_addr learned my addr 172.21.15.7:0/2879864456 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.784+0000 7f32cffff700 1 --2- 172.21.15.7:0/2879864456 >> v2:172.21.15.148:3300/0 conn(0x7f32d00af600 0x7f32d00c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32ce7fc700 1 -- 172.21.15.7:0/2879864456 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215778402 0 0) 0x7f32d00c7030 con 0x7f32d0140e40 2023-10-14T19:05:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32ce7fc700 1 -- 172.21.15.7:0/2879864456 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b8003570 con 0x7f32d0140e40 2023-10-14T19:05:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32cffff700 1 -- 172.21.15.7:0/2879864456 >> v1:172.21.15.148:6789/0 conn(0x7f32d0140e40 legacy=0x7f32d00aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32cffff700 1 -- 172.21.15.7:0/2879864456 >> v1:172.21.15.7:6789/0 conn(0x7f32d0140a70 legacy=0x7f32d00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32cffff700 1 -- 172.21.15.7:0/2879864456 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d00c75f0 con 0x7f32d00af600 2023-10-14T19:05:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32cffff700 1 --2- 172.21.15.7:0/2879864456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d00c6770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009e60 tx=0x7f32c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e894d47f63c7f60 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32ce7fc700 1 -- 172.21.15.7:0/2879864456 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800e070 con 0x7f32d00af600 2023-10-14T19:05:06.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32ce7fc700 1 -- 172.21.15.7:0/2879864456 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800bb60 con 0x7f32d00af600 2023-10-14T19:05:06.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.785+0000 7f32ce7fc700 1 -- 172.21.15.7:0/2879864456 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8012430 con 0x7f32d00af600 2023-10-14T19:05:06.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 -- 172.21.15.7:0/2879864456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 msgr2=0x7f32d00c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:06.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/2879864456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d00c6770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009e60 tx=0x7f32c8009780 comp rx=0 tx=0).stop 2023-10-14T19:05:06.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 -- 172.21.15.7:0/2879864456 shutdown_connections 2023-10-14T19:05:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/2879864456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d00c6770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 -- 172.21.15.7:0/2879864456 >> 172.21.15.7:0/2879864456 conn(0x7f32d006d170 msgr2=0x7f32d00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 -- 172.21.15.7:0/2879864456 shutdown_connections 2023-10-14T19:05:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.786+0000 7f32d4bc4700 1 -- 172.21.15.7:0/2879864456 wait complete. 2023-10-14T19:05:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.787+0000 7f32d4bc4700 1 Processor -- start 2023-10-14T19:05:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.787+0000 7f32d4bc4700 1 -- start start 2023-10-14T19:05:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32d4bc4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d013b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32d4bc4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0140a70 0x7f32d0139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32d4bc4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 0x7f32d00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32d4bc4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d0157ed0 con 0x7f32d0140e40 2023-10-14T19:05:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32d4bc4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d01581b0 con 0x7f32d00af600 2023-10-14T19:05:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32d4bc4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d0158490 con 0x7f32d0140a70 2023-10-14T19:05:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 0x7f32d00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32cf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d013b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 0x7f32d00b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39278/0 (socket says 172.21.15.7:39278) 2023-10-14T19:05:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32cffff700 1 -- 172.21.15.7:0/3527657317 learned_addr learned my addr 172.21.15.7:0/3527657317 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.788+0000 7f32ceffd700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0140a70 0x7f32d0139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32cffff700 1 -- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0140a70 msgr2=0x7f32d0139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32cffff700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0140a70 0x7f32d0139200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32cffff700 1 -- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 msgr2=0x7f32d013b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32cffff700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d013b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32cffff700 1 -- 172.21.15.7:0/3527657317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8009a20 con 0x7f32d0140e40 2023-10-14T19:05:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32cffff700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 0x7f32d00b0a80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f32d0071320 tx=0x7f32c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8027470 con 0x7f32d0140e40 2023-10-14T19:05:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c80275f0 con 0x7f32d0140e40 2023-10-14T19:05:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d0158770 con 0x7f32d0140e40 2023-10-14T19:05:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c80279b0 con 0x7f32d0140e40 2023-10-14T19:05:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.789+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d0157ad0 con 0x7f32d0140e40 2023-10-14T19:05:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.790+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d004c3c0 con 0x7f32d0140e40 2023-10-14T19:05:06.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.790+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f32c8024070 con 0x7f32d0140e40 2023-10-14T19:05:06.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.791+0000 7f32b77fe700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32bc066fc0 0x7f32bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.791+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32c8086e70 con 0x7f32d0140e40 2023-10-14T19:05:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.791+0000 7f32cf7fe700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32bc066fc0 0x7f32bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.792+0000 7f32cf7fe700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32bc066fc0 0x7f32bc069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f32c0007130 tx=0x7f32c0007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.795+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32c80540f0 con 0x7f32d0140e40 2023-10-14T19:05:06.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.986+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32d0158320 con 0x7f32bc066fc0 2023-10-14T19:05:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:06.997+0000 7f32b77fe700 1 -- 172.21.15.7:0/3527657317 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289840 (secure 0 0 0) 0x7f32d0158320 con 0x7f32bc066fc0 2023-10-14T19:05:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:07.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32bc066fc0 msgr2=0x7f32bc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32bc066fc0 0x7f32bc069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f32c0007130 tx=0x7f32c0007eb0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 msgr2=0x7f32d00b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 0x7f32d00b0a80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f32d0071320 tx=0x7f32c8019000 comp rx=0 tx=0).stop 2023-10-14T19:05:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 shutdown_connections 2023-10-14T19:05:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32bc066fc0 0x7f32bc069470 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d00af600 0x7f32d013b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d0140e40 0x7f32d00b0a80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 --2- 172.21.15.7:0/3527657317 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0140a70 0x7f32d0139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 >> 172.21.15.7:0/3527657317 conn(0x7f32d006d170 msgr2=0x7f32d015b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:07.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 shutdown_connections 2023-10-14T19:05:07.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.000+0000 7f32d4bc4700 1 -- 172.21.15.7:0/3527657317 wait complete. 2023-10-14T19:05:07.008 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:05:07.013 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-10-14T19:05:05.649418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397896,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752576824,"statfs":{"total":773094113280,"available":770638667776,"internally_reserved":0,"allocated":7479296,"data_stored":3828340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002133"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956713+0000","last_change":"2023-10-14T19:04:57.953111+0000","last_active":"2023-10-14T19:04:57.956713+0000","last_peered":"2023-10-14T19:04:57.956713+0000","last_clean":"2023-10-14T19:04:57.956713+0000","last_became_active":"2023-10-14T19:04:57.952565+0000","last_became_peered":"2023-10-14T19:04:57.952565+0000","last_unstale":"2023-10-14T19:04:57.956713+0000","last_undegraded":"2023-10-14T19:04:57.956713+0000","last_fullsized":"2023-10-14T19:04:57.956713+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:31.304223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.957864+0000","last_change":"2023-10-14T19:04:57.948868+0000","last_active":"2023-10-14T19:04:57.957864+0000","last_peered":"2023-10-14T19:04:57.957864+0000","last_clean":"2023-10-14T19:04:57.957864+0000","last_became_active":"2023-10-14T19:04:57.948611+0000","last_became_peered":"2023-10-14T19:04:57.948611+0000","last_unstale":"2023-10-14T19:04:57.957864+0000","last_undegraded":"2023-10-14T19:04:57.957864+0000","last_fullsized":"2023-10-14T19:04:57.957864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.950139+0000","last_change":"2023-10-14T19:04:57.948579+0000","last_active":"2023-10-14T19:04:57.950139+0000","last_peered":"2023-10-14T19:04:57.950139+0000","last_clean":"2023-10-14T19:04:57.950139+0000","last_became_active":"2023-10-14T19:04:57.946180+0000","last_became_peered":"2023-10-14T19:04:57.946180+0000","last_unstale":"2023-10-14T19:04:57.950139+0000","last_undegraded":"2023-10-14T19:04:57.950139+0000","last_fullsized":"2023-10-14T19:04:57.950139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:34.327198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.962603+0000","last_change":"2023-10-14T19:04:57.958891+0000","last_active":"2023-10-14T19:04:57.962603+0000","last_peered":"2023-10-14T19:04:57.962603+0000","last_clean":"2023-10-14T19:04:57.962603+0000","last_became_active":"2023-10-14T19:04:57.958625+0000","last_became_peered":"2023-10-14T19:04:57.958625+0000","last_unstale":"2023-10-14T19:04:57.962603+0000","last_undegraded":"2023-10-14T19:04:57.962603+0000","last_fullsized":"2023-10-14T19:04:57.962603+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958506+0000","last_change":"2023-10-14T19:04:57.954162+0000","last_active":"2023-10-14T19:04:57.958506+0000","last_peered":"2023-10-14T19:04:57.958506+0000","last_clean":"2023-10-14T19:04:57.958506+0000","last_became_active":"2023-10-14T19:04:57.953882+0000","last_became_peered":"2023-10-14T19:04:57.953882+0000","last_unstale":"2023-10-14T19:04:57.958506+0000","last_undegraded":"2023-10-14T19:04:57.958506+0000","last_fullsized":"2023-10-14T19:04:57.958506+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:07.608140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958621+0000","last_change":"2023-10-14T19:04:57.953838+0000","last_active":"2023-10-14T19:04:57.958621+0000","last_peered":"2023-10-14T19:04:57.958621+0000","last_clean":"2023-10-14T19:04:57.958621+0000","last_became_active":"2023-10-14T19:04:57.950683+0000","last_became_peered":"2023-10-14T19:04:57.950683+0000","last_unstale":"2023-10-14T19:04:57.958621+0000","last_undegraded":"2023-10-14T19:04:57.958621+0000","last_fullsized":"2023-10-14T19:04:57.958621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:03.292920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.953762+0000","last_change":"2023-10-14T19:04:57.951920+0000","last_active":"2023-10-14T19:04:57.953762+0000","last_peered":"2023-10-14T19:04:57.953762+0000","last_clean":"2023-10-14T19:04:57.953762+0000","last_became_active":"2023-10-14T19:04:57.951625+0000","last_became_peered":"2023-10-14T19:04:57.951625+0000","last_unstale":"2023-10-14T19:04:57.953762+0000","last_undegraded":"2023-10-14T19:04:57.953762+0000","last_fullsized":"2023-10-14T19:04:57.953762+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:57.076623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.957058+0000","last_change":"2023-10-14T19:04:57.946587+0000","last_active":"2023-10-14T19:04:57.957058+0000","last_peered":"2023-10-14T19:04:57.957058+0000","last_clean":"2023-10-14T19:04:57.957058+0000","last_became_active":"2023-10-14T19:04:57.946326+0000","last_became_peered":"2023-10-14T19:04:57.946326+0000","last_unstale":"2023-10-14T19:04:57.957058+0000","last_undegraded":"2023-10-14T19:04:57.957058+0000","last_fullsized":"2023-10-14T19:04:57.957058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:51.155977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958095+0000","last_change":"2023-10-14T19:04:57.956124+0000","last_active":"2023-10-14T19:04:57.958095+0000","last_peered":"2023-10-14T19:04:57.958095+0000","last_clean":"2023-10-14T19:04:57.958095+0000","last_became_active":"2023-10-14T19:04:57.955793+0000","last_became_peered":"2023-10-14T19:04:57.955793+0000","last_unstale":"2023-10-14T19:04:57.958095+0000","last_undegraded":"2023-10-14T19:04:57.958095+0000","last_fullsized":"2023-10-14T19:04:57.958095+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:05.974898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.955612+0000","last_change":"2023-10-14T19:04:57.951389+0000","last_active":"2023-10-14T19:04:57.955612+0000","last_peered":"2023-10-14T19:04:57.955612+0000","last_clean":"2023-10-14T19:04:57.955612+0000","last_became_active":"2023-10-14T19:04:57.951112+0000","last_became_peered":"2023-10-14T19:04:57.951112+0000","last_unstale":"2023-10-14T19:04:57.955612+0000","last_undegraded":"2023-10-14T19:04:57.955612+0000","last_fullsized":"2023-10-14T19:04:57.955612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:25.274526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956753+0000","last_change":"2023-10-14T19:04:57.950648+0000","last_active":"2023-10-14T19:04:57.956753+0000","last_peered":"2023-10-14T19:04:57.956753+0000","last_clean":"2023-10-14T19:04:57.956753+0000","last_became_active":"2023-10-14T19:04:57.950379+0000","last_became_peered":"2023-10-14T19:04:57.950379+0000","last_unstale":"2023-10-14T19:04:57.956753+0000","last_undegraded":"2023-10-14T19:04:57.956753+0000","last_fullsized":"2023-10-14T19:04:57.956753+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:06.422988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.962591+0000","last_change":"2023-10-14T19:04:57.950385+0000","last_active":"2023-10-14T19:04:57.962591+0000","last_peered":"2023-10-14T19:04:57.962591+0000","last_clean":"2023-10-14T19:04:57.962591+0000","last_became_active":"2023-10-14T19:04:57.950112+0000","last_became_peered":"2023-10-14T19:04:57.950112+0000","last_unstale":"2023-10-14T19:04:57.962591+0000","last_undegraded":"2023-10-14T19:04:57.962591+0000","last_fullsized":"2023-10-14T19:04:57.962591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:54.250536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.950571+0000","last_change":"2023-10-14T19:04:57.945558+0000","last_active":"2023-10-14T19:04:57.950571+0000","last_peered":"2023-10-14T19:04:57.950571+0000","last_clean":"2023-10-14T19:04:57.950571+0000","last_became_active":"2023-10-14T19:04:57.945243+0000","last_became_peered":"2023-10-14T19:04:57.945243+0000","last_unstale":"2023-10-14T19:04:57.950571+0000","last_undegraded":"2023-10-14T19:04:57.950571+0000","last_fullsized":"2023-10-14T19:04:57.950571+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958215+0000","last_change":"2023-10-14T19:04:57.956479+0000","last_active":"2023-10-14T19:04:57.958215+0000","last_peered":"2023-10-14T19:04:57.958215+0000","last_clean":"2023-10-14T19:04:57.958215+0000","last_became_active":"2023-10-14T19:04:57.956187+0000","last_became_peered":"2023-10-14T19:04:57.956187+0000","last_unstale":"2023-10-14T19:04:57.958215+0000","last_undegraded":"2023-10-14T19:04:57.958215+0000","last_fullsized":"2023-10-14T19:04:57.958215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:33.233991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.949851+0000","last_change":"2023-10-14T19:04:57.946201+0000","last_active":"2023-10-14T19:04:57.949851+0000","last_peered":"2023-10-14T19:04:57.949851+0000","last_clean":"2023-10-14T19:04:57.949851+0000","last_became_active":"2023-10-14T19:04:57.945906+0000","last_became_peered":"2023-10-14T19:04:57.945906+0000","last_unstale":"2023-10-14T19:04:57.949851+0000","last_undegraded":"2023-10-14T19:04:57.949851+0000","last_fullsized":"2023-10-14T19:04:57.949851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.953632+0000","last_change":"2023-10-14T19:04:57.950549+0000","last_active":"2023-10-14T19:04:57.953632+0000","last_peered":"2023-10-14T19:04:57.953632+0000","last_clean":"2023-10-14T19:04:57.953632+0000","last_became_active":"2023-10-14T19:04:57.950188+0000","last_became_peered":"2023-10-14T19:04:57.950188+0000","last_unstale":"2023-10-14T19:04:57.953632+0000","last_undegraded":"2023-10-14T19:04:57.953632+0000","last_fullsized":"2023-10-14T19:04:57.953632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:22.844797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958115+0000","last_change":"2023-10-14T19:04:57.956292+0000","last_active":"2023-10-14T19:04:57.958115+0000","last_peered":"2023-10-14T19:04:57.958115+0000","last_clean":"2023-10-14T19:04:57.958115+0000","last_became_active":"2023-10-14T19:04:57.955831+0000","last_became_peered":"2023-10-14T19:04:57.955831+0000","last_unstale":"2023-10-14T19:04:57.958115+0000","last_undegraded":"2023-10-14T19:04:57.958115+0000","last_fullsized":"2023-10-14T19:04:57.958115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:34.255417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.961005+0000","last_change":"2023-10-14T19:04:57.958960+0000","last_active":"2023-10-14T19:04:57.961005+0000","last_peered":"2023-10-14T19:04:57.961005+0000","last_clean":"2023-10-14T19:04:57.961005+0000","last_became_active":"2023-10-14T19:04:57.958670+0000","last_became_peered":"2023-10-14T19:04:57.958670+0000","last_unstale":"2023-10-14T19:04:57.961005+0000","last_undegraded":"2023-10-14T19:04:57.961005+0000","last_fullsized":"2023-10-14T19:04:57.961005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958405+0000","last_change":"2023-10-14T19:04:57.953370+0000","last_active":"2023-10-14T19:04:57.958405+0000","last_peered":"2023-10-14T19:04:57.958405+0000","last_clean":"2023-10-14T19:04:57.958405+0000","last_became_active":"2023-10-14T19:04:57.953129+0000","last_became_peered":"2023-10-14T19:04:57.953129+0000","last_unstale":"2023-10-14T19:04:57.958405+0000","last_undegraded":"2023-10-14T19:04:57.958405+0000","last_fullsized":"2023-10-14T19:04:57.958405+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:46.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.950466+0000","last_change":"2023-10-14T19:04:57.949116+0000","last_active":"2023-10-14T19:04:57.950466+0000","last_peered":"2023-10-14T19:04:57.950466+0000","last_clean":"2023-10-14T19:04:57.950466+0000","last_became_active":"2023-10-14T19:04:57.948826+0000","last_became_peered":"2023-10-14T19:04:57.948826+0000","last_unstale":"2023-10-14T19:04:57.950466+0000","last_undegraded":"2023-10-14T19:04:57.950466+0000","last_fullsized":"2023-10-14T19:04:57.950466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:20.607883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.948570+0000","last_change":"2023-10-14T19:04:57.946409+0000","last_active":"2023-10-14T19:04:57.948570+0000","last_peered":"2023-10-14T19:04:57.948570+0000","last_clean":"2023-10-14T19:04:57.948570+0000","last_became_active":"2023-10-14T19:04:57.946124+0000","last_became_peered":"2023-10-14T19:04:57.946124+0000","last_unstale":"2023-10-14T19:04:57.948570+0000","last_undegraded":"2023-10-14T19:04:57.948570+0000","last_fullsized":"2023-10-14T19:04:57.948570+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:28.483829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.948526+0000","last_change":"2023-10-14T19:04:57.946491+0000","last_active":"2023-10-14T19:04:57.948526+0000","last_peered":"2023-10-14T19:04:57.948526+0000","last_clean":"2023-10-14T19:04:57.948526+0000","last_became_active":"2023-10-14T19:04:57.946221+0000","last_became_peered":"2023-10-14T19:04:57.946221+0000","last_unstale":"2023-10-14T19:04:57.948526+0000","last_undegraded":"2023-10-14T19:04:57.948526+0000","last_fullsized":"2023-10-14T19:04:57.948526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:54.250536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956653+0000","last_change":"2023-10-14T19:04:57.953715+0000","last_active":"2023-10-14T19:04:57.956653+0000","last_peered":"2023-10-14T19:04:57.956653+0000","last_clean":"2023-10-14T19:04:57.956653+0000","last_became_active":"2023-10-14T19:04:57.952999+0000","last_became_peered":"2023-10-14T19:04:57.952999+0000","last_unstale":"2023-10-14T19:04:57.956653+0000","last_undegraded":"2023-10-14T19:04:57.956653+0000","last_fullsized":"2023-10-14T19:04:57.956653+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:29:32.481265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956836+0000","last_change":"2023-10-14T19:04:57.949206+0000","last_active":"2023-10-14T19:04:57.956836+0000","last_peered":"2023-10-14T19:04:57.956836+0000","last_clean":"2023-10-14T19:04:57.956836+0000","last_became_active":"2023-10-14T19:04:57.948943+0000","last_became_peered":"2023-10-14T19:04:57.948943+0000","last_unstale":"2023-10-14T19:04:57.956836+0000","last_undegraded":"2023-10-14T19:04:57.956836+0000","last_fullsized":"2023-10-14T19:04:57.956836+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:31.023019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958251+0000","last_change":"2023-10-14T19:04:57.953497+0000","last_active":"2023-10-14T19:04:57.958251+0000","last_peered":"2023-10-14T19:04:57.958251+0000","last_clean":"2023-10-14T19:04:57.958251+0000","last_became_active":"2023-10-14T19:04:57.953198+0000","last_became_peered":"2023-10-14T19:04:57.953198+0000","last_unstale":"2023-10-14T19:04:57.958251+0000","last_undegraded":"2023-10-14T19:04:57.958251+0000","last_fullsized":"2023-10-14T19:04:57.958251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:37.531203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.959774+0000","last_change":"2023-10-14T19:04:57.956429+0000","last_active":"2023-10-14T19:04:57.959774+0000","last_peered":"2023-10-14T19:04:57.959774+0000","last_clean":"2023-10-14T19:04:57.959774+0000","last_became_active":"2023-10-14T19:04:57.956190+0000","last_became_peered":"2023-10-14T19:04:57.956190+0000","last_unstale":"2023-10-14T19:04:57.959774+0000","last_undegraded":"2023-10-14T19:04:57.959774+0000","last_fullsized":"2023-10-14T19:04:57.959774+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956193+0000","last_change":"2023-10-14T19:04:57.953315+0000","last_active":"2023-10-14T19:04:57.956193+0000","last_peered":"2023-10-14T19:04:57.956193+0000","last_clean":"2023-10-14T19:04:57.956193+0000","last_became_active":"2023-10-14T19:04:57.953010+0000","last_became_peered":"2023-10-14T19:04:57.953010+0000","last_unstale":"2023-10-14T19:04:57.956193+0000","last_undegraded":"2023-10-14T19:04:57.956193+0000","last_fullsized":"2023-10-14T19:04:57.956193+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:10.453393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.949427+0000","last_change":"2023-10-14T19:04:57.947849+0000","last_active":"2023-10-14T19:04:57.949427+0000","last_peered":"2023-10-14T19:04:57.949427+0000","last_clean":"2023-10-14T19:04:57.949427+0000","last_became_active":"2023-10-14T19:04:57.947608+0000","last_became_peered":"2023-10-14T19:04:57.947608+0000","last_unstale":"2023-10-14T19:04:57.949427+0000","last_undegraded":"2023-10-14T19:04:57.949427+0000","last_fullsized":"2023-10-14T19:04:57.949427+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:51.155977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.955812+0000","last_change":"2023-10-14T19:04:57.953672+0000","last_active":"2023-10-14T19:04:57.955812+0000","last_peered":"2023-10-14T19:04:57.955812+0000","last_clean":"2023-10-14T19:04:57.955812+0000","last_became_active":"2023-10-14T19:04:57.953393+0000","last_became_peered":"2023-10-14T19:04:57.953393+0000","last_unstale":"2023-10-14T19:04:57.955812+0000","last_undegraded":"2023-10-14T19:04:57.955812+0000","last_fullsized":"2023-10-14T19:04:57.955812+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:49.672411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.962599+0000","last_change":"2023-10-14T19:04:57.958913+0000","last_active":"2023-10-14T19:04:57.962599+0000","last_peered":"2023-10-14T19:04:57.962599+0000","last_clean":"2023-10-14T19:04:57.962599+0000","last_became_active":"2023-10-14T19:04:57.958625+0000","last_became_peered":"2023-10-14T19:04:57.958625+0000","last_unstale":"2023-10-14T19:04:57.962599+0000","last_undegraded":"2023-10-14T19:04:57.962599+0000","last_fullsized":"2023-10-14T19:04:57.962599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:16:29.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.959924+0000","last_change":"2023-10-14T19:04:57.957468+0000","last_active":"2023-10-14T19:04:57.959924+0000","last_peered":"2023-10-14T19:04:57.959924+0000","last_clean":"2023-10-14T19:04:57.959924+0000","last_became_active":"2023-10-14T19:04:57.957216+0000","last_became_peered":"2023-10-14T19:04:57.957216+0000","last_unstale":"2023-10-14T19:04:57.959924+0000","last_undegraded":"2023-10-14T19:04:57.959924+0000","last_fullsized":"2023-10-14T19:04:57.959924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:44.646695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.959178+0000","last_change":"2023-10-14T19:04:57.952876+0000","last_active":"2023-10-14T19:04:57.959178+0000","last_peered":"2023-10-14T19:04:57.959178+0000","last_clean":"2023-10-14T19:04:57.959178+0000","last_became_active":"2023-10-14T19:04:57.952268+0000","last_became_peered":"2023-10-14T19:04:57.952268+0000","last_unstale":"2023-10-14T19:04:57.959178+0000","last_undegraded":"2023-10-14T19:04:57.959178+0000","last_fullsized":"2023-10-14T19:04:57.959178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:58.415743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.953544+0000","last_change":"2023-10-14T19:04:57.948557+0000","last_active":"2023-10-14T19:04:57.953544+0000","last_peered":"2023-10-14T19:04:57.953544+0000","last_clean":"2023-10-14T19:04:57.953544+0000","last_became_active":"2023-10-14T19:04:57.944060+0000","last_became_peered":"2023-10-14T19:04:57.944060+0000","last_unstale":"2023-10-14T19:04:57.953544+0000","last_undegraded":"2023-10-14T19:04:57.953544+0000","last_fullsized":"2023-10-14T19:04:57.953544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:10:13.630630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.964111+0000","last_change":"2023-10-14T19:04:56.953149+0000","last_active":"2023-10-14T19:04:57.964111+0000","last_peered":"2023-10-14T19:04:57.964111+0000","last_clean":"2023-10-14T19:04:57.964111+0000","last_became_active":"2023-10-14T19:04:56.952688+0000","last_became_peered":"2023-10-14T19:04:56.952688+0000","last_unstale":"2023-10-14T19:04:57.964111+0000","last_undegraded":"2023-10-14T19:04:57.964111+0000","last_fullsized":"2023-10-14T19:04:57.964111+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:08.171627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958075+0000","last_change":"2023-10-14T19:04:57.956089+0000","last_active":"2023-10-14T19:04:57.958075+0000","last_peered":"2023-10-14T19:04:57.958075+0000","last_clean":"2023-10-14T19:04:57.958075+0000","last_became_active":"2023-10-14T19:04:57.955414+0000","last_became_peered":"2023-10-14T19:04:57.955414+0000","last_unstale":"2023-10-14T19:04:57.958075+0000","last_undegraded":"2023-10-14T19:04:57.958075+0000","last_fullsized":"2023-10-14T19:04:57.958075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:56:55.457530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.960184+0000","last_change":"2023-10-14T19:04:56.950268+0000","last_active":"2023-10-14T19:04:57.960184+0000","last_peered":"2023-10-14T19:04:57.960184+0000","last_clean":"2023-10-14T19:04:57.960184+0000","last_became_active":"2023-10-14T19:04:56.949979+0000","last_became_peered":"2023-10-14T19:04:56.949979+0000","last_unstale":"2023-10-14T19:04:57.960184+0000","last_undegraded":"2023-10-14T19:04:57.960184+0000","last_fullsized":"2023-10-14T19:04:57.960184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.957498+0000","last_change":"2023-10-14T19:04:57.949553+0000","last_active":"2023-10-14T19:04:57.957498+0000","last_peered":"2023-10-14T19:04:57.957498+0000","last_clean":"2023-10-14T19:04:57.957498+0000","last_became_active":"2023-10-14T19:04:57.944533+0000","last_became_peered":"2023-10-14T19:04:57.944533+0000","last_unstale":"2023-10-14T19:04:57.957498+0000","last_undegraded":"2023-10-14T19:04:57.957498+0000","last_fullsized":"2023-10-14T19:04:57.957498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:55.720571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963855+0000","last_change":"2023-10-14T19:04:56.951889+0000","last_active":"2023-10-14T19:04:57.963855+0000","last_peered":"2023-10-14T19:04:57.963855+0000","last_clean":"2023-10-14T19:04:57.963855+0000","last_became_active":"2023-10-14T19:04:56.951570+0000","last_became_peered":"2023-10-14T19:04:56.951570+0000","last_unstale":"2023-10-14T19:04:57.963855+0000","last_undegraded":"2023-10-14T19:04:57.963855+0000","last_fullsized":"2023-10-14T19:04:57.963855+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956774+0000","last_change":"2023-10-14T19:04:57.952948+0000","last_active":"2023-10-14T19:04:57.956774+0000","last_peered":"2023-10-14T19:04:57.956774+0000","last_clean":"2023-10-14T19:04:57.956774+0000","last_became_active":"2023-10-14T19:04:57.952389+0000","last_became_peered":"2023-10-14T19:04:57.952389+0000","last_unstale":"2023-10-14T19:04:57.956774+0000","last_undegraded":"2023-10-14T19:04:57.956774+0000","last_fullsized":"2023-10-14T19:04:57.956774+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:36:00.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.964290+0000","last_change":"2023-10-14T19:04:56.948874+0000","last_active":"2023-10-14T19:04:57.964290+0000","last_peered":"2023-10-14T19:04:57.964290+0000","last_clean":"2023-10-14T19:04:57.964290+0000","last_became_active":"2023-10-14T19:04:56.948586+0000","last_became_peered":"2023-10-14T19:04:56.948586+0000","last_unstale":"2023-10-14T19:04:57.964290+0000","last_undegraded":"2023-10-14T19:04:57.964290+0000","last_fullsized":"2023-10-14T19:04:57.964290+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:04.970618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.953236+0000","last_change":"2023-10-14T19:04:57.951594+0000","last_active":"2023-10-14T19:04:57.953236+0000","last_peered":"2023-10-14T19:04:57.953236+0000","last_clean":"2023-10-14T19:04:57.953236+0000","last_became_active":"2023-10-14T19:04:57.951314+0000","last_became_peered":"2023-10-14T19:04:57.951314+0000","last_unstale":"2023-10-14T19:04:57.953236+0000","last_undegraded":"2023-10-14T19:04:57.953236+0000","last_fullsized":"2023-10-14T19:04:57.953236+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.960223+0000","last_change":"2023-10-14T19:04:56.940818+0000","last_active":"2023-10-14T19:04:57.960223+0000","last_peered":"2023-10-14T19:04:57.960223+0000","last_clean":"2023-10-14T19:04:57.960223+0000","last_became_active":"2023-10-14T19:04:56.940545+0000","last_became_peered":"2023-10-14T19:04:56.940545+0000","last_unstale":"2023-10-14T19:04:57.960223+0000","last_undegraded":"2023-10-14T19:04:57.960223+0000","last_fullsized":"2023-10-14T19:04:57.960223+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:13.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.948391+0000","last_change":"2023-10-14T19:04:57.945041+0000","last_active":"2023-10-14T19:04:57.948391+0000","last_peered":"2023-10-14T19:04:57.948391+0000","last_clean":"2023-10-14T19:04:57.948391+0000","last_became_active":"2023-10-14T19:04:57.944742+0000","last_became_peered":"2023-10-14T19:04:57.944742+0000","last_unstale":"2023-10-14T19:04:57.948391+0000","last_undegraded":"2023-10-14T19:04:57.948391+0000","last_fullsized":"2023-10-14T19:04:57.948391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:41.237537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963355+0000","last_change":"2023-10-14T19:04:56.950899+0000","last_active":"2023-10-14T19:04:57.963355+0000","last_peered":"2023-10-14T19:04:57.963355+0000","last_clean":"2023-10-14T19:04:57.963355+0000","last_became_active":"2023-10-14T19:04:56.950557+0000","last_became_peered":"2023-10-14T19:04:56.950557+0000","last_unstale":"2023-10-14T19:04:57.963355+0000","last_undegraded":"2023-10-14T19:04:57.963355+0000","last_fullsized":"2023-10-14T19:04:57.963355+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:29.175822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.954869+0000","last_change":"2023-10-14T19:04:57.946776+0000","last_active":"2023-10-14T19:04:57.954869+0000","last_peered":"2023-10-14T19:04:57.954869+0000","last_clean":"2023-10-14T19:04:57.954869+0000","last_became_active":"2023-10-14T19:04:57.946514+0000","last_became_peered":"2023-10-14T19:04:57.946514+0000","last_unstale":"2023-10-14T19:04:57.954869+0000","last_undegraded":"2023-10-14T19:04:57.954869+0000","last_fullsized":"2023-10-14T19:04:57.954869+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:46.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.941675+0000","last_change":"2023-10-14T19:04:56.949526+0000","last_active":"2023-10-14T19:04:57.941675+0000","last_peered":"2023-10-14T19:04:57.941675+0000","last_clean":"2023-10-14T19:04:57.941675+0000","last_became_active":"2023-10-14T19:04:56.949203+0000","last_became_peered":"2023-10-14T19:04:56.949203+0000","last_unstale":"2023-10-14T19:04:57.941675+0000","last_undegraded":"2023-10-14T19:04:57.941675+0000","last_fullsized":"2023-10-14T19:04:57.941675+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.954962+0000","last_change":"2023-10-14T19:04:57.952655+0000","last_active":"2023-10-14T19:04:57.954962+0000","last_peered":"2023-10-14T19:04:57.954962+0000","last_clean":"2023-10-14T19:04:57.954962+0000","last_became_active":"2023-10-14T19:04:57.952420+0000","last_became_peered":"2023-10-14T19:04:57.952420+0000","last_unstale":"2023-10-14T19:04:57.954962+0000","last_undegraded":"2023-10-14T19:04:57.954962+0000","last_fullsized":"2023-10-14T19:04:57.954962+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:38.247305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.940254+0000","last_change":"2023-10-14T19:04:56.948722+0000","last_active":"2023-10-14T19:04:57.940254+0000","last_peered":"2023-10-14T19:04:57.940254+0000","last_clean":"2023-10-14T19:04:57.940254+0000","last_became_active":"2023-10-14T19:04:56.948466+0000","last_became_peered":"2023-10-14T19:04:56.948466+0000","last_unstale":"2023-10-14T19:04:57.940254+0000","last_undegraded":"2023-10-14T19:04:57.940254+0000","last_fullsized":"2023-10-14T19:04:57.940254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:53.045006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958623+0000","last_change":"2023-10-14T19:04:57.954657+0000","last_active":"2023-10-14T19:04:57.958623+0000","last_peered":"2023-10-14T19:04:57.958623+0000","last_clean":"2023-10-14T19:04:57.958623+0000","last_became_active":"2023-10-14T19:04:57.954230+0000","last_became_peered":"2023-10-14T19:04:57.954230+0000","last_unstale":"2023-10-14T19:04:57.958623+0000","last_undegraded":"2023-10-14T19:04:57.958623+0000","last_fullsized":"2023-10-14T19:04:57.958623+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:26:07.338853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.937861+0000","last_change":"2023-10-14T19:04:56.943154+0000","last_active":"2023-10-14T19:04:57.937861+0000","last_peered":"2023-10-14T19:04:57.937861+0000","last_clean":"2023-10-14T19:04:57.937861+0000","last_became_active":"2023-10-14T19:04:56.942867+0000","last_became_peered":"2023-10-14T19:04:56.942867+0000","last_unstale":"2023-10-14T19:04:57.937861+0000","last_undegraded":"2023-10-14T19:04:57.937861+0000","last_fullsized":"2023-10-14T19:04:57.937861+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956663+0000","last_change":"2023-10-14T19:04:57.949573+0000","last_active":"2023-10-14T19:04:57.956663+0000","last_peered":"2023-10-14T19:04:57.956663+0000","last_clean":"2023-10-14T19:04:57.956663+0000","last_became_active":"2023-10-14T19:04:57.948971+0000","last_became_peered":"2023-10-14T19:04:57.948971+0000","last_unstale":"2023-10-14T19:04:57.956663+0000","last_undegraded":"2023-10-14T19:04:57.956663+0000","last_fullsized":"2023-10-14T19:04:57.956663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:14.590787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.940073+0000","last_change":"2023-10-14T19:04:56.949434+0000","last_active":"2023-10-14T19:04:57.940073+0000","last_peered":"2023-10-14T19:04:57.940073+0000","last_clean":"2023-10-14T19:04:57.940073+0000","last_became_active":"2023-10-14T19:04:56.949098+0000","last_became_peered":"2023-10-14T19:04:56.949098+0000","last_unstale":"2023-10-14T19:04:57.940073+0000","last_undegraded":"2023-10-14T19:04:57.940073+0000","last_fullsized":"2023-10-14T19:04:57.940073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:34.768904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.957473+0000","last_change":"2023-10-14T19:04:57.943338+0000","last_active":"2023-10-14T19:04:57.957473+0000","last_peered":"2023-10-14T19:04:57.957473+0000","last_clean":"2023-10-14T19:04:57.957473+0000","last_became_active":"2023-10-14T19:04:57.942975+0000","last_became_peered":"2023-10-14T19:04:57.942975+0000","last_unstale":"2023-10-14T19:04:57.957473+0000","last_undegraded":"2023-10-14T19:04:57.957473+0000","last_fullsized":"2023-10-14T19:04:57.957473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:43.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"63'3","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.962803+0000","last_change":"2023-10-14T19:04:56.943590+0000","last_active":"2023-10-14T19:04:57.962803+0000","last_peered":"2023-10-14T19:04:57.962803+0000","last_clean":"2023-10-14T19:04:57.962803+0000","last_became_active":"2023-10-14T19:04:56.943234+0000","last_became_peered":"2023-10-14T19:04:56.943234+0000","last_unstale":"2023-10-14T19:04:57.962803+0000","last_undegraded":"2023-10-14T19:04:57.962803+0000","last_fullsized":"2023-10-14T19:04:57.962803+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:05.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956647+0000","last_change":"2023-10-14T19:04:57.951082+0000","last_active":"2023-10-14T19:04:57.956647+0000","last_peered":"2023-10-14T19:04:57.956647+0000","last_clean":"2023-10-14T19:04:57.956647+0000","last_became_active":"2023-10-14T19:04:57.950920+0000","last_became_peered":"2023-10-14T19:04:57.950920+0000","last_unstale":"2023-10-14T19:04:57.956647+0000","last_undegraded":"2023-10-14T19:04:57.956647+0000","last_fullsized":"2023-10-14T19:04:57.956647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:54.497837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"63'6","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.965753+0000","last_change":"2023-10-14T19:04:56.957104+0000","last_active":"2023-10-14T19:04:57.965753+0000","last_peered":"2023-10-14T19:04:57.965753+0000","last_clean":"2023-10-14T19:04:57.965753+0000","last_became_active":"2023-10-14T19:04:56.956797+0000","last_became_peered":"2023-10-14T19:04:56.956797+0000","last_unstale":"2023-10-14T19:04:57.965753+0000","last_undegraded":"2023-10-14T19:04:57.965753+0000","last_fullsized":"2023-10-14T19:04:57.965753+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:23.838288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956621+0000","last_change":"2023-10-14T19:04:57.952753+0000","last_active":"2023-10-14T19:04:57.956621+0000","last_peered":"2023-10-14T19:04:57.956621+0000","last_clean":"2023-10-14T19:04:57.956621+0000","last_became_active":"2023-10-14T19:04:57.952420+0000","last_became_peered":"2023-10-14T19:04:57.952420+0000","last_unstale":"2023-10-14T19:04:57.956621+0000","last_undegraded":"2023-10-14T19:04:57.956621+0000","last_fullsized":"2023-10-14T19:04:57.956621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:14.632963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963994+0000","last_change":"2023-10-14T19:04:56.953495+0000","last_active":"2023-10-14T19:04:57.963994+0000","last_peered":"2023-10-14T19:04:57.963994+0000","last_clean":"2023-10-14T19:04:57.963994+0000","last_became_active":"2023-10-14T19:04:56.953230+0000","last_became_peered":"2023-10-14T19:04:56.953230+0000","last_unstale":"2023-10-14T19:04:57.963994+0000","last_undegraded":"2023-10-14T19:04:57.963994+0000","last_fullsized":"2023-10-14T19:04:57.963994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:33.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.952623+0000","last_change":"2023-10-14T19:04:57.949459+0000","last_active":"2023-10-14T19:04:57.952623+0000","last_peered":"2023-10-14T19:04:57.952623+0000","last_clean":"2023-10-14T19:04:57.952623+0000","last_became_active":"2023-10-14T19:04:57.949178+0000","last_became_peered":"2023-10-14T19:04:57.949178+0000","last_unstale":"2023-10-14T19:04:57.952623+0000","last_undegraded":"2023-10-14T19:04:57.952623+0000","last_fullsized":"2023-10-14T19:04:57.952623+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:20.607883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.937323+0000","last_change":"2023-10-14T19:04:56.957152+0000","last_active":"2023-10-14T19:04:57.937323+0000","last_peered":"2023-10-14T19:04:57.937323+0000","last_clean":"2023-10-14T19:04:57.937323+0000","last_became_active":"2023-10-14T19:04:56.956860+0000","last_became_peered":"2023-10-14T19:04:56.956860+0000","last_unstale":"2023-10-14T19:04:57.937323+0000","last_undegraded":"2023-10-14T19:04:57.937323+0000","last_fullsized":"2023-10-14T19:04:57.937323+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:42.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.949819+0000","last_change":"2023-10-14T19:04:57.945602+0000","last_active":"2023-10-14T19:04:57.949819+0000","last_peered":"2023-10-14T19:04:57.949819+0000","last_clean":"2023-10-14T19:04:57.949819+0000","last_became_active":"2023-10-14T19:04:57.945356+0000","last_became_peered":"2023-10-14T19:04:57.945356+0000","last_unstale":"2023-10-14T19:04:57.949819+0000","last_undegraded":"2023-10-14T19:04:57.949819+0000","last_fullsized":"2023-10-14T19:04:57.949819+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:48.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.947912+0000","last_change":"2023-10-14T19:04:56.948515+0000","last_active":"2023-10-14T19:04:57.947912+0000","last_peered":"2023-10-14T19:04:57.947912+0000","last_clean":"2023-10-14T19:04:57.947912+0000","last_became_active":"2023-10-14T19:04:56.948264+0000","last_became_peered":"2023-10-14T19:04:56.948264+0000","last_unstale":"2023-10-14T19:04:57.947912+0000","last_undegraded":"2023-10-14T19:04:57.947912+0000","last_fullsized":"2023-10-14T19:04:57.947912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956506+0000","last_change":"2023-10-14T19:04:57.950438+0000","last_active":"2023-10-14T19:04:57.956506+0000","last_peered":"2023-10-14T19:04:57.956506+0000","last_clean":"2023-10-14T19:04:57.956506+0000","last_became_active":"2023-10-14T19:04:57.949633+0000","last_became_peered":"2023-10-14T19:04:57.949633+0000","last_unstale":"2023-10-14T19:04:57.956506+0000","last_undegraded":"2023-10-14T19:04:57.956506+0000","last_fullsized":"2023-10-14T19:04:57.956506+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:54.232353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"63'8","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.964145+0000","last_change":"2023-10-14T19:04:56.948559+0000","last_active":"2023-10-14T19:04:57.964145+0000","last_peered":"2023-10-14T19:04:57.964145+0000","last_clean":"2023-10-14T19:04:57.964145+0000","last_became_active":"2023-10-14T19:04:56.947284+0000","last_became_peered":"2023-10-14T19:04:56.947284+0000","last_unstale":"2023-10-14T19:04:57.964145+0000","last_undegraded":"2023-10-14T19:04:57.964145+0000","last_fullsized":"2023-10-14T19:04:57.964145+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:39:03.366009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.948458+0000","last_change":"2023-10-14T19:04:57.945677+0000","last_active":"2023-10-14T19:04:57.948458+0000","last_peered":"2023-10-14T19:04:57.948458+0000","last_clean":"2023-10-14T19:04:57.948458+0000","last_became_active":"2023-10-14T19:04:57.945312+0000","last_became_peered":"2023-10-14T19:04:57.945312+0000","last_unstale":"2023-10-14T19:04:57.948458+0000","last_undegraded":"2023-10-14T19:04:57.948458+0000","last_fullsized":"2023-10-14T19:04:57.948458+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:30.556962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963659+0000","last_change":"2023-10-14T19:04:56.949992+0000","last_active":"2023-10-14T19:04:57.963659+0000","last_peered":"2023-10-14T19:04:57.963659+0000","last_clean":"2023-10-14T19:04:57.963659+0000","last_became_active":"2023-10-14T19:04:56.948410+0000","last_became_peered":"2023-10-14T19:04:56.948410+0000","last_unstale":"2023-10-14T19:04:57.963659+0000","last_undegraded":"2023-10-14T19:04:57.963659+0000","last_fullsized":"2023-10-14T19:04:57.963659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:07.355240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956695+0000","last_change":"2023-10-14T19:04:57.949741+0000","last_active":"2023-10-14T19:04:57.956695+0000","last_peered":"2023-10-14T19:04:57.956695+0000","last_clean":"2023-10-14T19:04:57.956695+0000","last_became_active":"2023-10-14T19:04:57.949312+0000","last_became_peered":"2023-10-14T19:04:57.949312+0000","last_unstale":"2023-10-14T19:04:57.956695+0000","last_undegraded":"2023-10-14T19:04:57.956695+0000","last_fullsized":"2023-10-14T19:04:57.956695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:35:04.134284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963603+0000","last_change":"2023-10-14T19:04:56.951828+0000","last_active":"2023-10-14T19:04:57.963603+0000","last_peered":"2023-10-14T19:04:57.963603+0000","last_clean":"2023-10-14T19:04:57.963603+0000","last_became_active":"2023-10-14T19:04:56.951553+0000","last_became_peered":"2023-10-14T19:04:56.951553+0000","last_unstale":"2023-10-14T19:04:57.963603+0000","last_undegraded":"2023-10-14T19:04:57.963603+0000","last_fullsized":"2023-10-14T19:04:57.963603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:16.439561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.949521+0000","last_change":"2023-10-14T19:04:57.947698+0000","last_active":"2023-10-14T19:04:57.949521+0000","last_peered":"2023-10-14T19:04:57.949521+0000","last_clean":"2023-10-14T19:04:57.949521+0000","last_became_active":"2023-10-14T19:04:57.947421+0000","last_became_peered":"2023-10-14T19:04:57.947421+0000","last_unstale":"2023-10-14T19:04:57.949521+0000","last_undegraded":"2023-10-14T19:04:57.949521+0000","last_fullsized":"2023-10-14T19:04:57.949521+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:51.155977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963585+0000","last_change":"2023-10-14T19:04:56.949648+0000","last_active":"2023-10-14T19:04:57.963585+0000","last_peered":"2023-10-14T19:04:57.963585+0000","last_clean":"2023-10-14T19:04:57.963585+0000","last_became_active":"2023-10-14T19:04:56.949331+0000","last_became_peered":"2023-10-14T19:04:56.949331+0000","last_unstale":"2023-10-14T19:04:57.963585+0000","last_undegraded":"2023-10-14T19:04:57.963585+0000","last_fullsized":"2023-10-14T19:04:57.963585+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:27.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.954602+0000","last_change":"2023-10-14T19:04:57.946560+0000","last_active":"2023-10-14T19:04:57.954602+0000","last_peered":"2023-10-14T19:04:57.954602+0000","last_clean":"2023-10-14T19:04:57.954602+0000","last_became_active":"2023-10-14T19:04:57.946262+0000","last_became_peered":"2023-10-14T19:04:57.946262+0000","last_unstale":"2023-10-14T19:04:57.954602+0000","last_undegraded":"2023-10-14T19:04:57.954602+0000","last_fullsized":"2023-10-14T19:04:57.954602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:07:04.728974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.938183+0000","last_change":"2023-10-14T19:04:56.954045+0000","last_active":"2023-10-14T19:04:57.938183+0000","last_peered":"2023-10-14T19:04:57.938183+0000","last_clean":"2023-10-14T19:04:57.938183+0000","last_became_active":"2023-10-14T19:04:56.953785+0000","last_became_peered":"2023-10-14T19:04:56.953785+0000","last_unstale":"2023-10-14T19:04:57.938183+0000","last_undegraded":"2023-10-14T19:04:57.938183+0000","last_fullsized":"2023-10-14T19:04:57.938183+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:08.118011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.950515+0000","last_change":"2023-10-14T19:04:57.948832+0000","last_active":"2023-10-14T19:04:57.950515+0000","last_peered":"2023-10-14T19:04:57.950515+0000","last_clean":"2023-10-14T19:04:57.950515+0000","last_became_active":"2023-10-14T19:04:57.948550+0000","last_became_peered":"2023-10-14T19:04:57.948550+0000","last_unstale":"2023-10-14T19:04:57.950515+0000","last_undegraded":"2023-10-14T19:04:57.950515+0000","last_fullsized":"2023-10-14T19:04:57.950515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:06:12.811363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.937401+0000","last_change":"2023-10-14T19:04:56.948518+0000","last_active":"2023-10-14T19:04:57.937401+0000","last_peered":"2023-10-14T19:04:57.937401+0000","last_clean":"2023-10-14T19:04:57.937401+0000","last_became_active":"2023-10-14T19:04:56.948181+0000","last_became_peered":"2023-10-14T19:04:56.948181+0000","last_unstale":"2023-10-14T19:04:57.937401+0000","last_undegraded":"2023-10-14T19:04:57.937401+0000","last_fullsized":"2023-10-14T19:04:57.937401+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:53.493556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.959184+0000","last_change":"2023-10-14T19:04:57.958044+0000","last_active":"2023-10-14T19:04:57.959184+0000","last_peered":"2023-10-14T19:04:57.959184+0000","last_clean":"2023-10-14T19:04:57.959184+0000","last_became_active":"2023-10-14T19:04:57.957815+0000","last_became_peered":"2023-10-14T19:04:57.957815+0000","last_unstale":"2023-10-14T19:04:57.959184+0000","last_undegraded":"2023-10-14T19:04:57.959184+0000","last_fullsized":"2023-10-14T19:04:57.959184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:10.646880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.948007+0000","last_change":"2023-10-14T19:04:56.951477+0000","last_active":"2023-10-14T19:04:57.948007+0000","last_peered":"2023-10-14T19:04:57.948007+0000","last_clean":"2023-10-14T19:04:57.948007+0000","last_became_active":"2023-10-14T19:04:56.950964+0000","last_became_peered":"2023-10-14T19:04:56.950964+0000","last_unstale":"2023-10-14T19:04:57.948007+0000","last_undegraded":"2023-10-14T19:04:57.948007+0000","last_fullsized":"2023-10-14T19:04:57.948007+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:54.716290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.959140+0000","last_change":"2023-10-14T19:04:57.957176+0000","last_active":"2023-10-14T19:04:57.959140+0000","last_peered":"2023-10-14T19:04:57.959140+0000","last_clean":"2023-10-14T19:04:57.959140+0000","last_became_active":"2023-10-14T19:04:57.956994+0000","last_became_peered":"2023-10-14T19:04:57.956994+0000","last_unstale":"2023-10-14T19:04:57.959140+0000","last_undegraded":"2023-10-14T19:04:57.959140+0000","last_fullsized":"2023-10-14T19:04:57.959140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.006089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.938394+0000","last_change":"2023-10-14T19:04:56.948728+0000","last_active":"2023-10-14T19:04:57.938394+0000","last_peered":"2023-10-14T19:04:57.938394+0000","last_clean":"2023-10-14T19:04:57.938394+0000","last_became_active":"2023-10-14T19:04:56.948464+0000","last_became_peered":"2023-10-14T19:04:56.948464+0000","last_unstale":"2023-10-14T19:04:57.938394+0000","last_undegraded":"2023-10-14T19:04:57.938394+0000","last_fullsized":"2023-10-14T19:04:57.938394+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:45.424606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.955033+0000","last_change":"2023-10-14T19:04:57.951349+0000","last_active":"2023-10-14T19:04:57.955033+0000","last_peered":"2023-10-14T19:04:57.955033+0000","last_clean":"2023-10-14T19:04:57.955033+0000","last_became_active":"2023-10-14T19:04:57.951079+0000","last_became_peered":"2023-10-14T19:04:57.951079+0000","last_unstale":"2023-10-14T19:04:57.955033+0000","last_undegraded":"2023-10-14T19:04:57.955033+0000","last_fullsized":"2023-10-14T19:04:57.955033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:00.033354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.963316+0000","last_change":"2023-10-14T19:04:56.950501+0000","last_active":"2023-10-14T19:04:57.963316+0000","last_peered":"2023-10-14T19:04:57.963316+0000","last_clean":"2023-10-14T19:04:57.963316+0000","last_became_active":"2023-10-14T19:04:56.950244+0000","last_became_peered":"2023-10-14T19:04:56.950244+0000","last_unstale":"2023-10-14T19:04:57.963316+0000","last_undegraded":"2023-10-14T19:04:57.963316+0000","last_fullsized":"2023-10-14T19:04:57.963316+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:14.719061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.953738+0000","last_change":"2023-10-14T19:04:57.952485+0000","last_active":"2023-10-14T19:04:57.953738+0000","last_peered":"2023-10-14T19:04:57.953738+0000","last_clean":"2023-10-14T19:04:57.953738+0000","last_became_active":"2023-10-14T19:04:57.952217+0000","last_became_peered":"2023-10-14T19:04:57.952217+0000","last_unstale":"2023-10-14T19:04:57.953738+0000","last_undegraded":"2023-10-14T19:04:57.953738+0000","last_fullsized":"2023-10-14T19:04:57.953738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:27:42.374848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.948243+0000","last_change":"2023-10-14T19:04:56.947400+0000","last_active":"2023-10-14T19:04:57.948243+0000","last_peered":"2023-10-14T19:04:57.948243+0000","last_clean":"2023-10-14T19:04:57.948243+0000","last_became_active":"2023-10-14T19:04:56.947088+0000","last_became_peered":"2023-10-14T19:04:56.947088+0000","last_unstale":"2023-10-14T19:04:57.948243+0000","last_undegraded":"2023-10-14T19:04:57.948243+0000","last_fullsized":"2023-10-14T19:04:57.948243+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:50.151697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956897+0000","last_change":"2023-10-14T19:04:57.944299+0000","last_active":"2023-10-14T19:04:57.956897+0000","last_peered":"2023-10-14T19:04:57.956897+0000","last_clean":"2023-10-14T19:04:57.956897+0000","last_became_active":"2023-10-14T19:04:57.944019+0000","last_became_peered":"2023-10-14T19:04:57.944019+0000","last_unstale":"2023-10-14T19:04:57.956897+0000","last_undegraded":"2023-10-14T19:04:57.956897+0000","last_fullsized":"2023-10-14T19:04:57.956897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:32.511217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.939263+0000","last_change":"2023-10-14T19:04:56.947918+0000","last_active":"2023-10-14T19:04:57.939263+0000","last_peered":"2023-10-14T19:04:57.939263+0000","last_clean":"2023-10-14T19:04:57.939263+0000","last_became_active":"2023-10-14T19:04:56.947639+0000","last_became_peered":"2023-10-14T19:04:56.947639+0000","last_unstale":"2023-10-14T19:04:57.939263+0000","last_undegraded":"2023-10-14T19:04:57.939263+0000","last_fullsized":"2023-10-14T19:04:57.939263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:18.543184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956791+0000","last_change":"2023-10-14T19:04:57.954608+0000","last_active":"2023-10-14T19:04:57.956791+0000","last_peered":"2023-10-14T19:04:57.956791+0000","last_clean":"2023-10-14T19:04:57.956791+0000","last_became_active":"2023-10-14T19:04:57.953779+0000","last_became_peered":"2023-10-14T19:04:57.953779+0000","last_unstale":"2023-10-14T19:04:57.956791+0000","last_undegraded":"2023-10-14T19:04:57.956791+0000","last_fullsized":"2023-10-14T19:04:57.956791+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.627193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.939312+0000","last_change":"2023-10-14T19:04:56.945202+0000","last_active":"2023-10-14T19:04:57.939312+0000","last_peered":"2023-10-14T19:04:57.939312+0000","last_clean":"2023-10-14T19:04:57.939312+0000","last_became_active":"2023-10-14T19:04:56.944900+0000","last_became_peered":"2023-10-14T19:04:56.944900+0000","last_unstale":"2023-10-14T19:04:57.939312+0000","last_undegraded":"2023-10-14T19:04:57.939312+0000","last_fullsized":"2023-10-14T19:04:57.939312+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:53.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.956717+0000","last_change":"2023-10-14T19:04:57.951619+0000","last_active":"2023-10-14T19:04:57.956717+0000","last_peered":"2023-10-14T19:04:57.956717+0000","last_clean":"2023-10-14T19:04:57.956717+0000","last_became_active":"2023-10-14T19:04:57.951390+0000","last_became_peered":"2023-10-14T19:04:57.951390+0000","last_unstale":"2023-10-14T19:04:57.956717+0000","last_undegraded":"2023-10-14T19:04:57.956717+0000","last_fullsized":"2023-10-14T19:04:57.956717+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:35.773184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.938499+0000","last_change":"2023-10-14T19:04:56.943250+0000","last_active":"2023-10-14T19:04:57.938499+0000","last_peered":"2023-10-14T19:04:57.938499+0000","last_clean":"2023-10-14T19:04:57.938499+0000","last_became_active":"2023-10-14T19:04:56.942982+0000","last_became_peered":"2023-10-14T19:04:56.942982+0000","last_unstale":"2023-10-14T19:04:57.938499+0000","last_undegraded":"2023-10-14T19:04:57.938499+0000","last_fullsized":"2023-10-14T19:04:57.938499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:25.285500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.958391+0000","last_change":"2023-10-14T19:04:57.954370+0000","last_active":"2023-10-14T19:04:57.958391+0000","last_peered":"2023-10-14T19:04:57.958391+0000","last_clean":"2023-10-14T19:04:57.958391+0000","last_became_active":"2023-10-14T19:04:57.954114+0000","last_became_peered":"2023-10-14T19:04:57.954114+0000","last_unstale":"2023-10-14T19:04:57.958391+0000","last_undegraded":"2023-10-14T19:04:57.958391+0000","last_fullsized":"2023-10-14T19:04:57.958391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:54.250536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.941879+0000","last_change":"2023-10-14T19:04:56.948061+0000","last_active":"2023-10-14T19:04:57.941879+0000","last_peered":"2023-10-14T19:04:57.941879+0000","last_clean":"2023-10-14T19:04:57.941879+0000","last_became_active":"2023-10-14T19:04:56.947691+0000","last_became_peered":"2023-10-14T19:04:56.947691+0000","last_unstale":"2023-10-14T19:04:57.941879+0000","last_undegraded":"2023-10-14T19:04:57.941879+0000","last_fullsized":"2023-10-14T19:04:57.941879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.960794+0000","last_change":"2023-10-14T19:04:57.952130+0000","last_active":"2023-10-14T19:04:57.960794+0000","last_peered":"2023-10-14T19:04:57.960794+0000","last_clean":"2023-10-14T19:04:57.960794+0000","last_became_active":"2023-10-14T19:04:57.951773+0000","last_became_peered":"2023-10-14T19:04:57.951773+0000","last_unstale":"2023-10-14T19:04:57.960794+0000","last_undegraded":"2023-10-14T19:04:57.960794+0000","last_fullsized":"2023-10-14T19:04:57.960794+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:05:43.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.938892+0000","last_change":"2023-10-14T19:04:56.947490+0000","last_active":"2023-10-14T19:04:57.938892+0000","last_peered":"2023-10-14T19:04:57.938892+0000","last_clean":"2023-10-14T19:04:57.938892+0000","last_became_active":"2023-10-14T19:04:56.947216+0000","last_became_peered":"2023-10-14T19:04:56.947216+0000","last_unstale":"2023-10-14T19:04:57.938892+0000","last_undegraded":"2023-10-14T19:04:57.938892+0000","last_fullsized":"2023-10-14T19:04:57.938892+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:25.014793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.960148+0000","last_change":"2023-10-14T19:04:57.954874+0000","last_active":"2023-10-14T19:04:57.960148+0000","last_peered":"2023-10-14T19:04:57.960148+0000","last_clean":"2023-10-14T19:04:57.960148+0000","last_became_active":"2023-10-14T19:04:57.954601+0000","last_became_peered":"2023-10-14T19:04:57.954601+0000","last_unstale":"2023-10-14T19:04:57.960148+0000","last_undegraded":"2023-10-14T19:04:57.960148+0000","last_fullsized":"2023-10-14T19:04:57.960148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:56.969700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.936769+0000","last_change":"2023-10-14T19:04:56.948930+0000","last_active":"2023-10-14T19:04:57.936769+0000","last_peered":"2023-10-14T19:04:57.936769+0000","last_clean":"2023-10-14T19:04:57.936769+0000","last_became_active":"2023-10-14T19:04:56.948670+0000","last_became_peered":"2023-10-14T19:04:56.948670+0000","last_unstale":"2023-10-14T19:04:57.936769+0000","last_undegraded":"2023-10-14T19:04:57.936769+0000","last_fullsized":"2023-10-14T19:04:57.936769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:32.229711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.959074+0000","last_change":"2023-10-14T19:04:57.956823+0000","last_active":"2023-10-14T19:04:57.959074+0000","last_peered":"2023-10-14T19:04:57.959074+0000","last_clean":"2023-10-14T19:04:57.959074+0000","last_became_active":"2023-10-14T19:04:57.956608+0000","last_became_peered":"2023-10-14T19:04:57.956608+0000","last_unstale":"2023-10-14T19:04:57.959074+0000","last_undegraded":"2023-10-14T19:04:57.959074+0000","last_fullsized":"2023-10-14T19:04:57.959074+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:56.927545+0000","last_clean_scrub_stamp":"2023-10-14T19:04:56.927545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:46.566622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.964166+0000","last_change":"2023-10-14T19:04:56.949415+0000","last_active":"2023-10-14T19:04:57.964166+0000","last_peered":"2023-10-14T19:04:57.964166+0000","last_clean":"2023-10-14T19:04:57.964166+0000","last_became_active":"2023-10-14T19:04:56.948760+0000","last_became_peered":"2023-10-14T19:04:56.948760+0000","last_unstale":"2023-10-14T19:04:57.964166+0000","last_undegraded":"2023-10-14T19:04:57.964166+0000","last_fullsized":"2023-10-14T19:04:57.964166+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:04:55.923264+0000","last_clean_scrub_stamp":"2023-10-14T19:04:55.923264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:06.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-14T19:04:57.938223+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:04:57.938223+0000","last_peered":"2023-10-14T19:04:57.938223+0000","last_clean":"2023-10-14T19:04:57.938223+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:04:57.938223+0000","last_undegraded":"2023-10-14T19:04:57.938223+0000","last_fullsized":"2023-10-14T19:04:57.938223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":921330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.753}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.3450000000000002,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":330466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7030000000000003,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.8680000000000003,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.496},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1120000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069676,"statfs":{"total":96636764160,"available":96327348224,"internally_reserved":0,"allocated":798720,"data_stored":332498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.27100000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70199999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":920742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.247},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.29599999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.313},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.628},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298060,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073780,"statfs":{"total":96636764160,"available":96331550720,"internally_reserved":0,"allocated":790528,"data_stored":331910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":11.269,"5min":11.269,"15min":11.269},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":11.318,"5min":11.318,"15min":11.318},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":11.404,"5min":11.404,"15min":11.404},"last":0.625},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":11.351000000000001,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":786432,"data_stored":330486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.435}]},{"osd":1,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.372},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.68500000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.69899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:04:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":330444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.503}]},{"osd":1,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":330464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.438},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.8639999999999999,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:04:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:05:07.019 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:05:07.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:05:07.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.179+0000 7f510dfe3700 1 Processor -- start 2023-10-14T19:05:07.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.179+0000 7f510dfe3700 1 -- start start 2023-10-14T19:05:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510dfe3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5108159380 0x7f5108159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510dfe3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f51080cb3f0 0x7f510815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510dfe3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080ccfa0 con 0x7f51080cea00 2023-10-14T19:05:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510dfe3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080cb880 con 0x7f51080cb3f0 2023-10-14T19:05:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510dfe3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080cbb60 con 0x7f5108159380 2023-10-14T19:05:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f5107fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f51080cb3f0 0x7f510815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510d7e2700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f51080cea00 0x7f510806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38074/0 (socket says 172.21.15.7:38074) 2023-10-14T19:05:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510d7e2700 1 -- 172.21.15.7:0/3289559950 learned_addr learned my addr 172.21.15.7:0/3289559950 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f510cfe1700 1 --2- 172.21.15.7:0/3289559950 >> v2:172.21.15.148:3300/0 conn(0x7f5108159380 0x7f5108159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f5107fff700 1 -- 172.21.15.7:0/3289559950 >> v2:172.21.15.148:3300/0 conn(0x7f5108159380 msgr2=0x7f5108159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f5107fff700 1 --2- 172.21.15.7:0/3289559950 >> v2:172.21.15.148:3300/0 conn(0x7f5108159380 0x7f5108159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f5107fff700 1 -- 172.21.15.7:0/3289559950 >> v1:172.21.15.7:6789/0 conn(0x7f51080cea00 legacy=0x7f510806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f5107fff700 1 -- 172.21.15.7:0/3289559950 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080cbe40 con 0x7f51080cb3f0 2023-10-14T19:05:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.180+0000 7f5107fff700 1 --2- 172.21.15.7:0/3289559950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cb3f0 0x7f510815dc00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5108089020 tx=0x7f50f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59559beaa1c19c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f51077fe700 1 -- 172.21.15.7:0/3289559950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400b6b0 con 0x7f51080cb3f0 2023-10-14T19:05:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f51077fe700 1 -- 172.21.15.7:0/3289559950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f400b810 con 0x7f51080cb3f0 2023-10-14T19:05:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f51077fe700 1 -- 172.21.15.7:0/3289559950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400bbb0 con 0x7f51080cb3f0 2023-10-14T19:05:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 -- 172.21.15.7:0/3289559950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cb3f0 msgr2=0x7f510815dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 --2- 172.21.15.7:0/3289559950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cb3f0 0x7f510815dc00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5108089020 tx=0x7f50f40091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 -- 172.21.15.7:0/3289559950 shutdown_connections 2023-10-14T19:05:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 --2- 172.21.15.7:0/3289559950 >> v2:172.21.15.148:3300/0 conn(0x7f5108159380 0x7f5108159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 --2- 172.21.15.7:0/3289559950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cb3f0 0x7f510815dc00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 -- 172.21.15.7:0/3289559950 >> 172.21.15.7:0/3289559950 conn(0x7f51080703a0 msgr2=0x7f51080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 -- 172.21.15.7:0/3289559950 shutdown_connections 2023-10-14T19:05:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.181+0000 7f510dfe3700 1 -- 172.21.15.7:0/3289559950 wait complete. 2023-10-14T19:05:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.182+0000 7f510dfe3700 1 Processor -- start 2023-10-14T19:05:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 -- start start 2023-10-14T19:05:07.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51080cb3f0 0x7f5108157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 0x7f51080b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5108159380 0x7f510815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510815cb40 con 0x7f51080cea00 2023-10-14T19:05:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51080b4f40 con 0x7f5108159380 2023-10-14T19:05:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f510dfe3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080b5220 con 0x7f51080cb3f0 2023-10-14T19:05:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f5107fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 0x7f51080b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f5107fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 0x7f51080b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39302/0 (socket says 172.21.15.7:39302) 2023-10-14T19:05:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.183+0000 7f5107fff700 1 -- 172.21.15.7:0/727863197 learned_addr learned my addr 172.21.15.7:0/727863197 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f510d7e2700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5108159380 0x7f510815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f510cfe1700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51080cb3f0 0x7f5108157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5107fff700 1 -- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51080cb3f0 msgr2=0x7f5108157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5107fff700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51080cb3f0 0x7f5108157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5107fff700 1 -- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5108159380 msgr2=0x7f510815a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5107fff700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5108159380 0x7f510815a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5107fff700 1 -- 172.21.15.7:0/727863197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4009420 con 0x7f51080cea00 2023-10-14T19:05:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5107fff700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 0x7f51080b5a50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f50f4013000 tx=0x7f50f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4011420 con 0x7f51080cea00 2023-10-14T19:05:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f4011580 con 0x7f51080cea00 2023-10-14T19:05:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4011940 con 0x7f51080cea00 2023-10-14T19:05:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51080b5500 con 0x7f51080cea00 2023-10-14T19:05:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.184+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51080c8ac0 con 0x7f51080cea00 2023-10-14T19:05:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.185+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51080c8cb0 con 0x7f51080cea00 2023-10-14T19:05:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.185+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f50f4011d30 con 0x7f51080cea00 2023-10-14T19:05:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.186+0000 7f5104ff9700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f50ec066fc0 0x7f50ec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.186+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50f4085a50 con 0x7f51080cea00 2023-10-14T19:05:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.186+0000 7f510cfe1700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f50ec066fc0 0x7f50ec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.187+0000 7f510cfe1700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f50ec066fc0 0x7f50ec069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.190+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50f4052d50 con 0x7f51080cea00 2023-10-14T19:05:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.461+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f510804c3c0 con 0x7f51080cea00 2023-10-14T19:05:07.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.465+0000 7f5104ff9700 1 -- 172.21.15.7:0/727863197 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f50f4015020 con 0x7f51080cea00 2023-10-14T19:05:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f50ec066fc0 msgr2=0x7f50ec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f50ec066fc0 0x7f50ec069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2023-10-14T19:05:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 msgr2=0x7f51080b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 0x7f51080b5a50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f50f4013000 tx=0x7f50f4017000 comp rx=0 tx=0).stop 2023-10-14T19:05:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 shutdown_connections 2023-10-14T19:05:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f50ec066fc0 0x7f50ec069470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5108159380 0x7f510815a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51080cb3f0 0x7f5108157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 --2- 172.21.15.7:0/727863197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51080cea00 0x7f51080b5a50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 >> 172.21.15.7:0/727863197 conn(0x7f51080703a0 msgr2=0x7f51080b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 shutdown_connections 2023-10-14T19:05:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.467+0000 7f510dfe3700 1 -- 172.21.15.7:0/727863197 wait complete. 2023-10-14T19:05:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:05:07.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:05:07.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.598+0000 7f318991b700 1 Processor -- start 2023-10-14T19:05:07.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.598+0000 7f318991b700 1 -- start start 2023-10-14T19:05:07.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f318991b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f318991b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f318406b650 0x7f3184157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f318991b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3184157650 0x7f31840aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f318991b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31840caa60 con 0x7f318406b650 2023-10-14T19:05:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f318991b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31840c9b70 con 0x7f3184157650 2023-10-14T19:05:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f318991b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31840c9e50 con 0x7f31840acda0 2023-10-14T19:05:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f31827fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f318406b650 0x7f3184157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f31827fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f318406b650 0x7f3184157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39306/0 (socket says 172.21.15.7:39306) 2023-10-14T19:05:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.599+0000 7f31827fc700 1 -- 172.21.15.7:0/1953058956 learned_addr learned my addr 172.21.15.7:0/1953058956 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31837fe700 1 --2- 172.21.15.7:0/1953058956 >> v2:172.21.15.148:3300/0 conn(0x7f3184157650 0x7f31840aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f3182ffd700 1 --2- 172.21.15.7:0/1953058956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31827fc700 1 -- 172.21.15.7:0/1953058956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 msgr2=0x7f31840ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31827fc700 1 --2- 172.21.15.7:0/1953058956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31827fc700 1 -- 172.21.15.7:0/1953058956 >> v2:172.21.15.148:3300/0 conn(0x7f3184157650 msgr2=0x7f31840aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31827fc700 1 --2- 172.21.15.7:0/1953058956 >> v2:172.21.15.148:3300/0 conn(0x7f3184157650 0x7f31840aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31827fc700 1 -- 172.21.15.7:0/1953058956 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840ca130 con 0x7f318406b650 2023-10-14T19:05:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f31827fc700 1 --2- 172.21.15.7:0/1953058956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f318406b650 0x7f3184157110 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3184068560 tx=0x7f316c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ead4ef78dacf02 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f3181ffb700 1 -- 172.21.15.7:0/1953058956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00b860 con 0x7f318406b650 2023-10-14T19:05:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f3181ffb700 1 -- 172.21.15.7:0/1953058956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00b9c0 con 0x7f318406b650 2023-10-14T19:05:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.600+0000 7f3181ffb700 1 -- 172.21.15.7:0/1953058956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00bd60 con 0x7f318406b650 2023-10-14T19:05:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 -- 172.21.15.7:0/1953058956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f318406b650 msgr2=0x7f3184157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 --2- 172.21.15.7:0/1953058956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f318406b650 0x7f3184157110 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3184068560 tx=0x7f316c009250 comp rx=0 tx=0).stop 2023-10-14T19:05:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 -- 172.21.15.7:0/1953058956 shutdown_connections 2023-10-14T19:05:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 --2- 172.21.15.7:0/1953058956 >> v2:172.21.15.148:3300/0 conn(0x7f3184157650 0x7f31840aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 --2- 172.21.15.7:0/1953058956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 --2- 172.21.15.7:0/1953058956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f318406b650 0x7f3184157110 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 -- 172.21.15.7:0/1953058956 >> 172.21.15.7:0/1953058956 conn(0x7f31840675a0 msgr2=0x7f31840679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 -- 172.21.15.7:0/1953058956 shutdown_connections 2023-10-14T19:05:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.601+0000 7f318991b700 1 -- 172.21.15.7:0/1953058956 wait complete. 2023-10-14T19:05:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.602+0000 7f318991b700 1 Processor -- start 2023-10-14T19:05:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.602+0000 7f318991b700 1 -- start start 2023-10-14T19:05:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f318991b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f318406b650 0x7f31840c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f318991b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f318991b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 0x7f31841698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f318991b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841552b0 con 0x7f3184157650 2023-10-14T19:05:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f318991b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318416a8a0 con 0x7f318406b650 2023-10-14T19:05:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f318991b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31840c7d60 con 0x7f31840acda0 2023-10-14T19:05:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 0x7f31841698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 0x7f31841698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39310/0 (socket says 172.21.15.7:39310) 2023-10-14T19:05:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 -- 172.21.15.7:0/387928513 learned_addr learned my addr 172.21.15.7:0/387928513 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f3182ffd700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f318406b650 0x7f31840c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31827fc700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 -- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 msgr2=0x7f31840c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 -- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f318406b650 msgr2=0x7f31840c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f318406b650 0x7f31840c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 -- 172.21.15.7:0/387928513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0094f0 con 0x7f3184157650 2023-10-14T19:05:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31827fc700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:05:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.603+0000 7f31837fe700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 0x7f31841698c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f317c00d860 tx=0x7f317c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.604+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0125f0 con 0x7f3184157650 2023-10-14T19:05:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.604+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c012770 con 0x7f3184157650 2023-10-14T19:05:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.604+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c012b30 con 0x7f3184157650 2023-10-14T19:05:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.604+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31840c7130 con 0x7f3184157650 2023-10-14T19:05:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.604+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318416a5c0 con 0x7f3184157650 2023-10-14T19:05:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.605+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318404c3c0 con 0x7f3184157650 2023-10-14T19:05:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.605+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f317c01e460 con 0x7f3184157650 2023-10-14T19:05:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.606+0000 7f317affd700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3164066fc0 0x7f3164069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.606+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f317c084af0 con 0x7f3184157650 2023-10-14T19:05:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.606+0000 7f3182ffd700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3164066fc0 0x7f3164069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.606+0000 7f3182ffd700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3164066fc0 0x7f3164069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31840b2890 tx=0x7f3174009850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.610+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f317c051d70 con 0x7f3184157650 2023-10-14T19:05:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.846+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31840ca4a0 con 0x7f3184157650 2023-10-14T19:05:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.846+0000 7f317affd700 1 -- 172.21.15.7:0/387928513 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f317c055390 con 0x7f3184157650 2023-10-14T19:05:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:05:07.848 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:57.340873+0000","modified":"2023-10-14T19:05:00.971319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3259245177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3259245177},{"type":"v1","addr":"172.21.15.7:6835","nonce":3259245177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T19:05:07.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3164066fc0 msgr2=0x7f3164069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3164066fc0 0x7f3164069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31840b2890 tx=0x7f3174009850 comp rx=0 tx=0).stop 2023-10-14T19:05:07.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 msgr2=0x7f31841698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:07.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 0x7f31841698c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f317c00d860 tx=0x7f317c008040 comp rx=0 tx=0).stop 2023-10-14T19:05:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 shutdown_connections 2023-10-14T19:05:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3164066fc0 0x7f3164069470 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f318406b650 0x7f31840c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3184157650 0x7f31841698c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 --2- 172.21.15.7:0/387928513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31840acda0 0x7f31840c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 >> 172.21.15.7:0/387928513 conn(0x7f31840675a0 msgr2=0x7f31840cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 shutdown_connections 2023-10-14T19:05:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:07.849+0000 7f318991b700 1 -- 172.21.15.7:0/387928513 wait complete. 2023-10-14T19:05:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 39 2023-10-14T19:05:08.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:04:57.340873+0000', 'modified': '2023-10-14T19:05:00.971319+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5637': {'gid': 5637, 'name': 'c', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/3259245177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3259245177}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 3259245177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:05:08.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:05:08.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T19:05:08.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.390+0000 7fbf73033700 1 Processor -- start 2023-10-14T19:05:08.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.390+0000 7fbf73033700 1 -- start start 2023-10-14T19:05:08.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf73033700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c153c30 0x7fbf6c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf73033700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf6c15de50 0x7fbf6c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf73033700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c15afd0 con 0x7fbf6c0cef40 2023-10-14T19:05:08.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf73033700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c15b2b0 con 0x7fbf6c15de50 2023-10-14T19:05:08.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf73033700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c15b590 con 0x7fbf6c153c30 2023-10-14T19:05:08.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf72832700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbf6c0cef40 0x7fbf6c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38078/0 (socket says 172.21.15.7:38078) 2023-10-14T19:05:08.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf72832700 1 -- 172.21.15.7:0/554181200 learned_addr learned my addr 172.21.15.7:0/554181200 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:08.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf71830700 1 --2- 172.21.15.7:0/554181200 >> v2:172.21.15.148:3300/0 conn(0x7fbf6c15de50 0x7fbf6c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf72031700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c153c30 0x7fbf6c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf7102f700 1 -- 172.21.15.7:0/554181200 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227013671 0 0) 0x7fbf6c15afd0 con 0x7fbf6c0cef40 2023-10-14T19:05:08.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf7102f700 1 -- 172.21.15.7:0/554181200 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf58003570 con 0x7fbf6c0cef40 2023-10-14T19:05:08.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf71830700 1 -- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c153c30 msgr2=0x7fbf6c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf71830700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c153c30 0x7fbf6c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf71830700 1 -- 172.21.15.7:0/554181200 >> v1:172.21.15.7:6789/0 conn(0x7fbf6c0cef40 legacy=0x7fbf6c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.391+0000 7fbf71830700 1 -- 172.21.15.7:0/554181200 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c15b870 con 0x7fbf6c15de50 2023-10-14T19:05:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf72031700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c153c30 0x7fbf6c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:05:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf71830700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c0cea00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0098e0 tx=0x7fbf5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b505ed3e5eb3a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf7102f700 1 -- 172.21.15.7:0/554181200 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c011630 con 0x7fbf6c15de50 2023-10-14T19:05:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf7102f700 1 -- 172.21.15.7:0/554181200 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c011790 con 0x7fbf6c15de50 2023-10-14T19:05:08.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf7102f700 1 -- 172.21.15.7:0/554181200 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c011b30 con 0x7fbf6c15de50 2023-10-14T19:05:08.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 -- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 msgr2=0x7fbf6c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c0cea00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0098e0 tx=0x7fbf5c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 -- 172.21.15.7:0/554181200 shutdown_connections 2023-10-14T19:05:08.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c153c30 0x7fbf6c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 --2- 172.21.15.7:0/554181200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c0cea00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 -- 172.21.15.7:0/554181200 >> 172.21.15.7:0/554181200 conn(0x7fbf6c0703a0 msgr2=0x7fbf6c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 -- 172.21.15.7:0/554181200 shutdown_connections 2023-10-14T19:05:08.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.392+0000 7fbf73033700 1 -- 172.21.15.7:0/554181200 wait complete. 2023-10-14T19:05:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 Processor -- start 2023-10-14T19:05:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 -- start start 2023-10-14T19:05:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c0cef40 0x7fbf6c16cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 0x7fbf6c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0b6250 con 0x7fbf6c153c30 2023-10-14T19:05:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0b3400 con 0x7fbf6c15de50 2023-10-14T19:05:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf73033700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c16ddb0 con 0x7fbf6c0cef40 2023-10-14T19:05:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf71830700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 0x7fbf6c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf71830700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 0x7fbf6c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39320/0 (socket says 172.21.15.7:39320) 2023-10-14T19:05:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf71830700 1 -- 172.21.15.7:0/3011638674 learned_addr learned my addr 172.21.15.7:0/3011638674 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf72832700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.394+0000 7fbf72031700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c0cef40 0x7fbf6c16cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf71830700 1 -- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c0cef40 msgr2=0x7fbf6c16cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf71830700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c0cef40 0x7fbf6c16cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf71830700 1 -- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 msgr2=0x7fbf6c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf71830700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf71830700 1 -- 172.21.15.7:0/3011638674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009420 con 0x7fbf6c153c30 2023-10-14T19:05:08.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf71830700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 0x7fbf6c154000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c06eb00 tx=0x7fbf5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf627fc700 1 -- 172.21.15.7:0/3011638674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c000c40 con 0x7fbf6c153c30 2023-10-14T19:05:08.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf627fc700 1 -- 172.21.15.7:0/3011638674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c011900 con 0x7fbf6c153c30 2023-10-14T19:05:08.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c009420 con 0x7fbf6c153c30 2023-10-14T19:05:08.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf627fc700 1 -- 172.21.15.7:0/3011638674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c025420 con 0x7fbf6c153c30 2023-10-14T19:05:08.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.395+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c16d7f0 con 0x7fbf6c153c30 2023-10-14T19:05:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.397+0000 7fbf627fc700 1 -- 172.21.15.7:0/3011638674 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fbf5c023070 con 0x7fbf6c153c30 2023-10-14T19:05:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.397+0000 7fbf627fc700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf50066fc0 0x7fbf50069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.397+0000 7fbf627fc700 1 -- 172.21.15.7:0/3011638674 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf5c085910 con 0x7fbf6c153c30 2023-10-14T19:05:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.397+0000 7fbf72031700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf50066fc0 0x7fbf50069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.398+0000 7fbf72031700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf50066fc0 0x7fbf50069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009f40 tx=0x7fbf680091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.399+0000 7fbf7d58eb80 1 Processor -- start 2023-10-14T19:05:08.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.399+0000 7fbf7d58eb80 1 -- start start 2023-10-14T19:05:08.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba11a47480 0x55ba11a267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 0x55ba11a47850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba119fcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba11953a70 con 0x55ba119fa5f0 2023-10-14T19:05:08.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba11951270 con 0x55ba11a47480 2023-10-14T19:05:08.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba1194d060 con 0x55ba119fcb80 2023-10-14T19:05:08.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf72031700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba11a47480 0x55ba11a267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 0x55ba11a47850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf72031700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba11a47480 0x55ba11a267d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:55572/0 (socket says 172.21.15.7:55572) 2023-10-14T19:05:08.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf72031700 1 -- 172.21.15.7:0/3556330207 learned_addr learned my addr 172.21.15.7:0/3556330207 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 0x55ba11a47850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39334/0 (socket says 172.21.15.7:39334) 2023-10-14T19:05:08.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf72832700 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba119fcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 -- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 msgr2=0x55ba119fcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba119fcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 -- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba11a47480 msgr2=0x55ba11a267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba11a47480 0x55ba11a267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 -- 172.21.15.7:0/3556330207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba117e7270 con 0x55ba119fa5f0 2023-10-14T19:05:08.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf71830700 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 0x55ba11a47850 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c083eb0 tx=0x7fbf5c083f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e2fed3440556d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf4f7fe700 1 -- 172.21.15.7:0/3556330207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c056850 con 0x55ba119fa5f0 2023-10-14T19:05:08.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf4f7fe700 1 -- 172.21.15.7:0/3556330207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c059aa0 con 0x55ba119fa5f0 2023-10-14T19:05:08.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.400+0000 7fbf4f7fe700 1 -- 172.21.15.7:0/3556330207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c05d7f0 con 0x55ba119fa5f0 2023-10-14T19:05:08.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/3556330207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 msgr2=0x55ba11a47850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 0x55ba11a47850 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c083eb0 tx=0x7fbf5c083f90 comp rx=0 tx=0).stop 2023-10-14T19:05:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/3556330207 shutdown_connections 2023-10-14T19:05:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba11a47480 0x55ba11a267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba119fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/3556330207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba119fa5f0 0x55ba11a47850 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/3556330207 >> 172.21.15.7:0/3556330207 conn(0x55ba119fe0c0 msgr2=0x55ba119fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/3556330207 shutdown_connections 2023-10-14T19:05:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.401+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/3556330207 wait complete. 2023-10-14T19:05:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.402+0000 7fbf7d58eb80 1 -- start start 2023-10-14T19:05:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.402+0000 7fbf7d58eb80 1 Processor -- start 2023-10-14T19:05:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fa5f0 0x55ba11a27610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba11a20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba118f8890 con 0x55ba11a47480 2023-10-14T19:05:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba11913ea0 con 0x55ba119fa5f0 2023-10-14T19:05:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba117cfe30 con 0x55ba119fcb80 2023-10-14T19:05:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 10 client.0 _ll_register_callbacks cb 0x55ba119c02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:05:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39346/0 (socket says 172.21.15.7:39346) 2023-10-14T19:05:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 -- 172.21.15.7:0/673643504 learned_addr learned my addr 172.21.15.7:0/673643504 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf71830700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba11a20e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72031700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fa5f0 0x55ba11a27610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 -- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 msgr2=0x55ba11a20e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba11a20e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 -- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fa5f0 msgr2=0x55ba11a27610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fa5f0 0x55ba11a27610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 -- 172.21.15.7:0/673643504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c16d7f0 con 0x55ba11a47480 2023-10-14T19:05:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf72832700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a463a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbf64012d70 tx=0x7fbf64009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a773173e51701 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:05:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf4cff9700 1 -- 172.21.15.7:0/673643504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64012e50 con 0x55ba11a47480 2023-10-14T19:05:08.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf4cff9700 1 -- 172.21.15.7:0/673643504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf64010cd0 con 0x55ba11a47480 2023-10-14T19:05:08.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.403+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba119f1cd0 con 0x55ba11a47480 2023-10-14T19:05:08.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf4cff9700 1 -- 172.21.15.7:0/673643504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf64010e90 con 0x55ba11a47480 2023-10-14T19:05:08.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 10 client.5823 fetch_fsmap learned FSMap version 39 2023-10-14T19:05:08.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55ba11789fe0 con 0x55ba11a47480 2023-10-14T19:05:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf4cff9700 1 -- 172.21.15.7:0/673643504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ba119f1cd0 con 0x55ba11a47480 2023-10-14T19:05:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf4cff9700 1 -- 172.21.15.7:0/673643504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbf64015650 con 0x55ba11a47480 2023-10-14T19:05:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 10 client.5823 fetch_fsmap finished waiting for FSMap version 39 2023-10-14T19:05:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 10 client.5823 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T19:05:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 20 client.5823 populate_metadata read hostname 'smithi007' 2023-10-14T19:05:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11a468e0 0x55ba11a2c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 4 client.5823 mds_command: new command op to 5637 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:05:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 --> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba119ceaa0 con 0x55ba11a468e0 2023-10-14T19:05:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf72031700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11a468e0 0x55ba11a2c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf4cff9700 10 client.5823 ms_handle_connect on v2:172.21.15.7:6834/3259245177 2023-10-14T19:05:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.404+0000 7fbf72031700 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11a468e0 0x55ba11a2c620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6801b970f2662098 server_cookie=d58146f55eb18ef5 in_seq=0 out_seq=0 2023-10-14T19:05:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf4cff9700 1 -- 172.21.15.7:0/673643504 <== mds.0 v2:172.21.15.7:6834/3259245177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ba119ceaa0 con 0x55ba11a468e0 2023-10-14T19:05:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf4cff9700 10 client.5823 handle_command_reply: tid=0 2023-10-14T19:05:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 client.5823 shutdown 2023-10-14T19:05:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 msgr2=0x55ba11a463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a463a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbf64012d70 tx=0x7fbf64009040 comp rx=0 tx=0).stop 2023-10-14T19:05:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 shutdown_connections 2023-10-14T19:05:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11a468e0 0x55ba11a2c620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fa5f0 0x55ba11a27610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf4cff9700 0 client.5823 ms_handle_reset on v2:172.21.15.7:6834/3259245177 2023-10-14T19:05:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a463a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/673643504 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fcb80 0x55ba11a20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 >> 172.21.15.7:0/673643504 conn(0x55ba119fe0c0 msgr2=0x55ba119fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 shutdown_connections 2023-10-14T19:05:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/673643504 wait complete. 2023-10-14T19:05:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.405+0000 7fbf7d58eb80 20 client.5823 trim_cache size 0 max 16384 2023-10-14T19:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.422+0000 7fbf7d58eb80 1 Processor -- start 2023-10-14T19:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.422+0000 7fbf7d58eb80 1 -- start start 2023-10-14T19:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba119fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba119fd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba11a23730 con 0x55ba11a47480 2023-10-14T19:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba119d54b0 con 0x55ba119fcb80 2023-10-14T19:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba11a23570 con 0x55ba119fa5f0 2023-10-14T19:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a20e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a20e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39356/0 (socket says 172.21.15.7:39356) 2023-10-14T19:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 -- 172.21.15.7:0/801656750 learned_addr learned my addr 172.21.15.7:0/801656750 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 -- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 msgr2=0x55ba119fcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba119fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf71830700 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba119fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 -- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 msgr2=0x55ba119fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba119fd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 -- 172.21.15.7:0/801656750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba1191b780 con 0x55ba11a47480 2023-10-14T19:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf71830700 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba119fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.423+0000 7fbf72832700 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a20e30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001220 tx=0x7fbf64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0724c28be29456 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf4ffff700 1 -- 172.21.15.7:0/801656750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64001d10 con 0x55ba11a47480 2023-10-14T19:05:08.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf4ffff700 1 -- 172.21.15.7:0/801656750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf64012e50 con 0x55ba11a47480 2023-10-14T19:05:08.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf4ffff700 1 -- 172.21.15.7:0/801656750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64015dc0 con 0x55ba11a47480 2023-10-14T19:05:08.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/801656750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 msgr2=0x55ba11a20e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a20e30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001220 tx=0x7fbf64018000 comp rx=0 tx=0).stop 2023-10-14T19:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/801656750 shutdown_connections 2023-10-14T19:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a20e30 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba119fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/801656750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba119fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/801656750 >> 172.21.15.7:0/801656750 conn(0x55ba119fe0c0 msgr2=0x55ba11a46160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/801656750 shutdown_connections 2023-10-14T19:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.424+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/801656750 wait complete. 2023-10-14T19:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.425+0000 7fbf7d58eb80 1 -- start start 2023-10-14T19:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.425+0000 7fbf7d58eb80 1 Processor -- start 2023-10-14T19:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba11a1ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba11a1f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a284e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba11a42ec0 con 0x55ba11a47480 2023-10-14T19:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba11aaa770 con 0x55ba119fcb80 2023-10-14T19:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba119f2fe0 con 0x55ba119fa5f0 2023-10-14T19:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 10 client.0 _ll_register_callbacks cb 0x55ba119c02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a284e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39362/0 (socket says 172.21.15.7:39362) 2023-10-14T19:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 -- 172.21.15.7:0/2304519046 learned_addr learned my addr 172.21.15.7:0/2304519046 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72031700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba11a1ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf71830700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba11a1f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 -- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 msgr2=0x55ba11a1ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba11a1ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 -- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 msgr2=0x55ba11a1f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba11a1f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 -- 172.21.15.7:0/2304519046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba11789fe0 con 0x55ba11a47480 2023-10-14T19:05:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf72832700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a284e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbf64021040 tx=0x7fbf64009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69eb4f7387aec6c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:05:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf4cff9700 1 -- 172.21.15.7:0/2304519046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64001d10 con 0x55ba11a47480 2023-10-14T19:05:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf4cff9700 1 -- 172.21.15.7:0/2304519046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf64012a20 con 0x55ba11a47480 2023-10-14T19:05:08.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.426+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf5c059aa0 con 0x55ba11a47480 2023-10-14T19:05:08.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf4cff9700 1 -- 172.21.15.7:0/2304519046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf64033440 con 0x55ba11a47480 2023-10-14T19:05:08.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 10 client.5829 fetch_fsmap learned FSMap version 39 2023-10-14T19:05:08.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55ba11902470 con 0x55ba11a47480 2023-10-14T19:05:08.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf4cff9700 1 -- 172.21.15.7:0/2304519046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c059aa0 con 0x55ba11a47480 2023-10-14T19:05:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf4cff9700 1 -- 172.21.15.7:0/2304519046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbf640335a0 con 0x55ba11a47480 2023-10-14T19:05:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 10 client.5829 fetch_fsmap finished waiting for FSMap version 39 2023-10-14T19:05:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 10 client.5829 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T19:05:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 20 client.5829 populate_metadata read hostname 'smithi007' 2023-10-14T19:05:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11aa8cc0 0x55ba11a28a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 4 client.5829 mds_command: new command op to 5637 tid=0[{"prefix": "status"}] 2023-10-14T19:05:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 --> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ba118efe00 con 0x55ba11aa8cc0 2023-10-14T19:05:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf72031700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11aa8cc0 0x55ba11a28a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf4cff9700 10 client.5829 ms_handle_connect on v2:172.21.15.7:6834/3259245177 2023-10-14T19:05:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf72031700 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11aa8cc0 0x55ba11a28a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cac02fa0f3f08800 server_cookie=a4aa4cb1be7bb5e7 in_seq=0 out_seq=0 2023-10-14T19:05:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf4cff9700 1 -- 172.21.15.7:0/2304519046 <== mds.0 v2:172.21.15.7:6834/3259245177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55ba118efe00 con 0x55ba11aa8cc0 2023-10-14T19:05:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf4cff9700 10 client.5829 handle_command_reply: tid=0 2023-10-14T19:05:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.427+0000 7fbf7d58eb80 1 client.5829 shutdown 2023-10-14T19:05:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 msgr2=0x55ba11a284e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a284e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbf64021040 tx=0x7fbf64009070 comp rx=0 tx=0).stop 2023-10-14T19:05:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 shutdown_connections 2023-10-14T19:05:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:6834/3259245177,v1:172.21.15.7:6835/3259245177] conn(0x55ba11aa8cc0 0x55ba11a28a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba11a47480 0x55ba11a284e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55ba119fa5f0 0x55ba11a1ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 --2- 172.21.15.7:0/2304519046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ba119fcb80 0x55ba11a1f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf4cff9700 0 client.5829 ms_handle_reset on v2:172.21.15.7:6834/3259245177 2023-10-14T19:05:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 >> 172.21.15.7:0/2304519046 conn(0x55ba119fe0c0 msgr2=0x55ba119fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 shutdown_connections 2023-10-14T19:05:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 1 -- 172.21.15.7:0/2304519046 wait complete. 2023-10-14T19:05:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf7d58eb80 20 client.5829 trim_cache size 0 max 16384 2023-10-14T19:05:08.456 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:05:08.456 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:05:08.456 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:05:08.456 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5637, 2023-10-14T19:05:08.456 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:05:08.457 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:05:08.457 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:05:08.457 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 10.483835954, 2023-10-14T19:05:08.457 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 39, 2023-10-14T19:05:08.457 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 64, 2023-10-14T19:05:08.458 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 64, 2023-10-14T19:05:08.458 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 15.544448291 2023-10-14T19:05:08.458 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:05:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf50066fc0 msgr2=0x7fbf50069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf50066fc0 0x7fbf50069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009f40 tx=0x7fbf680091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 msgr2=0x7fbf6c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 0x7fbf6c154000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c06eb00 tx=0x7fbf5c017000 comp rx=0 tx=0).stop 2023-10-14T19:05:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 shutdown_connections 2023-10-14T19:05:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf50066fc0 0x7fbf50069470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf6c15de50 0x7fbf6c153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf6c0cef40 0x7fbf6c16cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 --2- 172.21.15.7:0/3011638674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6c153c30 0x7fbf6c154000 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 >> 172.21.15.7:0/3011638674 conn(0x7fbf6c0703a0 msgr2=0x7fbf6c15bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 shutdown_connections 2023-10-14T19:05:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.428+0000 7fbf73033700 1 -- 172.21.15.7:0/3011638674 wait complete. 2023-10-14T19:05:08.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:05:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.580+0000 7fe10589b700 1 Processor -- start 2023-10-14T19:05:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.580+0000 7fe10589b700 1 -- start start 2023-10-14T19:05:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe10589b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe1001598b0 0x7fe1000af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe10589b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe100159c80 0x7fe1000cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe10589b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1000af790 0x7fe1000cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe10589b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000ce9d0 con 0x7fe100159c80 2023-10-14T19:05:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe10589b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000afc30 con 0x7fe1001598b0 2023-10-14T19:05:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe10589b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000aff10 con 0x7fe1000af790 2023-10-14T19:05:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe0fe7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe100159c80 0x7fe1000cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe0fe7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe100159c80 0x7fe1000cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39364/0 (socket says 172.21.15.7:39364) 2023-10-14T19:05:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.581+0000 7fe0fe7fc700 1 -- 172.21.15.7:0/2577351650 learned_addr learned my addr 172.21.15.7:0/2577351650 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0ff7fe700 1 --2- 172.21.15.7:0/2577351650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1000af790 0x7fe1000cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0feffd700 1 --2- 172.21.15.7:0/2577351650 >> v2:172.21.15.148:3300/0 conn(0x7fe1001598b0 0x7fe1000af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fe7fc700 1 -- 172.21.15.7:0/2577351650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1000af790 msgr2=0x7fe1000cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fe7fc700 1 --2- 172.21.15.7:0/2577351650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1000af790 0x7fe1000cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fe7fc700 1 -- 172.21.15.7:0/2577351650 >> v2:172.21.15.148:3300/0 conn(0x7fe1001598b0 msgr2=0x7fe1000af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fe7fc700 1 --2- 172.21.15.7:0/2577351650 >> v2:172.21.15.148:3300/0 conn(0x7fe1001598b0 0x7fe1000af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fe7fc700 1 -- 172.21.15.7:0/2577351650 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1000ce380 con 0x7fe100159c80 2023-10-14T19:05:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fe7fc700 1 --2- 172.21.15.7:0/2577351650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe100159c80 0x7fe1000cb6f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe100065860 tx=0x7fe0f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27332315ffbd11de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fdffb700 1 -- 172.21.15.7:0/2577351650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400b860 con 0x7fe100159c80 2023-10-14T19:05:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fdffb700 1 -- 172.21.15.7:0/2577351650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f400b9c0 con 0x7fe100159c80 2023-10-14T19:05:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.582+0000 7fe0fdffb700 1 -- 172.21.15.7:0/2577351650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400bd60 con 0x7fe100159c80 2023-10-14T19:05:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 -- 172.21.15.7:0/2577351650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe100159c80 msgr2=0x7fe1000cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 --2- 172.21.15.7:0/2577351650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe100159c80 0x7fe1000cb6f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe100065860 tx=0x7fe0f4009250 comp rx=0 tx=0).stop 2023-10-14T19:05:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 -- 172.21.15.7:0/2577351650 shutdown_connections 2023-10-14T19:05:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 --2- 172.21.15.7:0/2577351650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1000af790 0x7fe1000cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 --2- 172.21.15.7:0/2577351650 >> v2:172.21.15.148:3300/0 conn(0x7fe1001598b0 0x7fe1000af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 --2- 172.21.15.7:0/2577351650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe100159c80 0x7fe1000cb6f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 -- 172.21.15.7:0/2577351650 >> 172.21.15.7:0/2577351650 conn(0x7fe100070e30 msgr2=0x7fe1000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 -- 172.21.15.7:0/2577351650 shutdown_connections 2023-10-14T19:05:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.583+0000 7fe10589b700 1 -- 172.21.15.7:0/2577351650 wait complete. 2023-10-14T19:05:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.584+0000 7fe10589b700 1 Processor -- start 2023-10-14T19:05:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.584+0000 7fe10589b700 1 -- start start 2023-10-14T19:05:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 0x7fe100157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1001598b0 0x7fe1000c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe100159c80 0x7fe1000c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000ca2d0 con 0x7fe1000af790 2023-10-14T19:05:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100157e60 con 0x7fe100159c80 2023-10-14T19:05:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000c96c0 con 0x7fe1001598b0 2023-10-14T19:05:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 0x7fe100157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 0x7fe100157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39378/0 (socket says 172.21.15.7:39378) 2023-10-14T19:05:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 -- 172.21.15.7:0/1232807406 learned_addr learned my addr 172.21.15.7:0/1232807406 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0ff7fe700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe100159c80 0x7fe1000c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 -- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1001598b0 msgr2=0x7fe1000c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0fe7fc700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1001598b0 0x7fe1000c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1001598b0 0x7fe1000c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 -- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe100159c80 msgr2=0x7fe1000c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe100159c80 0x7fe1000c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 -- 172.21.15.7:0/1232807406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40094f0 con 0x7fe1000af790 2023-10-14T19:05:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0ff7fe700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe100159c80 0x7fe1000c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:05:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0feffd700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 0x7fe100157920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000d890 tx=0x7fe0f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000b600 con 0x7fe1000af790 2023-10-14T19:05:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000b760 con 0x7fe1000af790 2023-10-14T19:05:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.585+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1000c99a0 con 0x7fe1000af790 2023-10-14T19:05:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.586+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000bae0 con 0x7fe1000af790 2023-10-14T19:05:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.586+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1000c9f60 con 0x7fe1000af790 2023-10-14T19:05:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.586+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10004c3c0 con 0x7fe1000af790 2023-10-14T19:05:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.587+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe0f001e460 con 0x7fe1000af790 2023-10-14T19:05:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.587+0000 7fe0e6ffd700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0ec066fc0 0x7fe0ec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.587+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0f0084d00 con 0x7fe1000af790 2023-10-14T19:05:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.587+0000 7fe0fe7fc700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0ec066fc0 0x7fe0ec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.588+0000 7fe0fe7fc700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0ec066fc0 0x7fe0ec069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe100065860 tx=0x7fe0f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.591+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0f0051e80 con 0x7fe1000af790 2023-10-14T19:05:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.831+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1000ce660 con 0x7fe1000af790 2023-10-14T19:05:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.832+0000 7fe0e6ffd700 1 -- 172.21.15.7:0/1232807406 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe0f00554a0 con 0x7fe1000af790 2023-10-14T19:05:08.833 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:05:08.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0ec066fc0 msgr2=0x7fe0ec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0ec066fc0 0x7fe0ec069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe100065860 tx=0x7fe0f4017000 comp rx=0 tx=0).stop 2023-10-14T19:05:08.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 msgr2=0x7fe100157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:08.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 0x7fe100157920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000d890 tx=0x7fe0f0008040 comp rx=0 tx=0).stop 2023-10-14T19:05:08.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 shutdown_connections 2023-10-14T19:05:08.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0ec066fc0 0x7fe0ec069470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe100159c80 0x7fe1000c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1000af790 0x7fe100157920 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 --2- 172.21.15.7:0/1232807406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1001598b0 0x7fe1000c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 >> 172.21.15.7:0/1232807406 conn(0x7fe100070e30 msgr2=0x7fe1000b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 shutdown_connections 2023-10-14T19:05:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:08.834+0000 7fe10589b700 1 -- 172.21.15.7:0/1232807406 wait complete. 2023-10-14T19:05:08.849 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:05:08.850 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:05:08.850 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:05:08.851 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:05:08.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:05:08.851 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:05:08.852 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:05:08.852 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:05:08.852 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:05:08.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:08.853 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:05:08.869 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:05:08.869 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:05:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:05:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:05:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.871 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:05:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:05:08.871 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:05:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:05:08.872 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:05:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:05:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:05:08.873 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42345sec preferred_lft 42345sec 2023-10-14T19:05:08.873 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:05:08.873 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.873 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:05:08.873 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:08.874 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:05:08.874 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:05:08.874 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:08.874 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:05:08.874 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.875 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:05:08.875 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.875 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:05:08.875 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:05:08.875 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:05:08.875 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.876 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:05:08.876 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:05:08.876 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:05:08.876 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:08.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:08.877 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:05:08.933 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:05:08.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:08.935 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:05:08.991 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:05:08.991 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:05:08.991 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:05:08.992 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:05:08.992 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:05:08.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:08.993 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:05:08.993 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:05:08.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:05:08.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:05:08.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:05:08.995 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:05:09.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:09.095 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:05:09.110 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:05:09.111 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:05:09.111 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:05:09.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:09.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:05:09.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:05:09.176 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:05:09.231 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:05:09.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:05:09.231 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:05:09.285 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:05:09.286 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:05:09.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:05:09.366 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:05:09.367 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:05:09.367 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:05:09.375 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:05:09.375 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:05:09.375 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:05:09.375 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:05:09.376 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:05:09.397 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:05:09.397 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:05:09.397 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:05:09.397 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:05:09.398 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:05:09.398 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:05:09.398 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:05:09.398 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:05:09.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:05:09.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:09.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:05:09.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:05:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.624+0000 7f0f6800a700 1 Processor -- start 2023-10-14T19:05:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.624+0000 7f0f6800a700 1 -- start start 2023-10-14T19:05:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f6800a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f60159850 0x7f0f600adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f6800a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159c20 0x7f0f600ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f6800a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f600b0930 0x7f0f600b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f6800a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600ccdc0 con 0x7f0f60159850 2023-10-14T19:05:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f6800a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600b12f0 con 0x7f0f600b0930 2023-10-14T19:05:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f6800a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600adb20 con 0x7f0f60159c20 2023-10-14T19:05:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f65da6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f60159850 0x7f0f600adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f65da6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f60159850 0x7f0f600adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39392/0 (socket says 172.21.15.7:39392) 2023-10-14T19:05:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f65da6700 1 -- 172.21.15.7:0/4005396367 learned_addr learned my addr 172.21.15.7:0/4005396367 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f665a7700 1 --2- 172.21.15.7:0/4005396367 >> v2:172.21.15.148:3300/0 conn(0x7f0f600b0930 0x7f0f600b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f655a5700 1 --2- 172.21.15.7:0/4005396367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159c20 0x7f0f600ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f65da6700 1 -- 172.21.15.7:0/4005396367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159c20 msgr2=0x7f0f600ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f65da6700 1 --2- 172.21.15.7:0/4005396367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159c20 0x7f0f600ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.625+0000 7f0f65da6700 1 -- 172.21.15.7:0/4005396367 >> v2:172.21.15.148:3300/0 conn(0x7f0f600b0930 msgr2=0x7f0f600b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:09.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f65da6700 1 --2- 172.21.15.7:0/4005396367 >> v2:172.21.15.148:3300/0 conn(0x7f0f600b0930 0x7f0f600b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f65da6700 1 -- 172.21.15.7:0/4005396367 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600acf10 con 0x7f0f60159850 2023-10-14T19:05:09.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f65da6700 1 --2- 172.21.15.7:0/4005396367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60159850 0x7f0f600adfb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0f600cd360 tx=0x7f0f58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2e3e8e1964740f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:09.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f64da4700 1 -- 172.21.15.7:0/4005396367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800b640 con 0x7f0f60159850 2023-10-14T19:05:09.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f64da4700 1 -- 172.21.15.7:0/4005396367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800b7a0 con 0x7f0f60159850 2023-10-14T19:05:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f64da4700 1 -- 172.21.15.7:0/4005396367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800bb40 con 0x7f0f60159850 2023-10-14T19:05:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 -- 172.21.15.7:0/4005396367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60159850 msgr2=0x7f0f600adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 --2- 172.21.15.7:0/4005396367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60159850 0x7f0f600adfb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0f600cd360 tx=0x7f0f58009250 comp rx=0 tx=0).stop 2023-10-14T19:05:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 -- 172.21.15.7:0/4005396367 shutdown_connections 2023-10-14T19:05:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 --2- 172.21.15.7:0/4005396367 >> v2:172.21.15.148:3300/0 conn(0x7f0f600b0930 0x7f0f600b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 --2- 172.21.15.7:0/4005396367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60159850 0x7f0f600adfb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 --2- 172.21.15.7:0/4005396367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159c20 0x7f0f600ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.626+0000 7f0f6800a700 1 -- 172.21.15.7:0/4005396367 >> 172.21.15.7:0/4005396367 conn(0x7f0f6006d170 msgr2=0x7f0f600cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:09.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.627+0000 7f0f6800a700 1 -- 172.21.15.7:0/4005396367 shutdown_connections 2023-10-14T19:05:09.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.627+0000 7f0f6800a700 1 -- 172.21.15.7:0/4005396367 wait complete. 2023-10-14T19:05:09.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 Processor -- start 2023-10-14T19:05:09.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 -- start start 2023-10-14T19:05:09.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 0x7f0f60152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159850 0x7f0f60150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f60159c20 0x7f0f60154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60153d80 con 0x7f0f600b0930 2023-10-14T19:05:09.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60152e90 con 0x7f0f60159c20 2023-10-14T19:05:09.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f6800a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60153170 con 0x7f0f60159850 2023-10-14T19:05:09.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f65da6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 0x7f0f60152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:09.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f65da6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 0x7f0f60152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39408/0 (socket says 172.21.15.7:39408) 2023-10-14T19:05:09.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.628+0000 7f0f65da6700 1 -- 172.21.15.7:0/120817711 learned_addr learned my addr 172.21.15.7:0/120817711 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:09.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f65da6700 1 -- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159850 msgr2=0x7f0f60150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:09.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f65da6700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159850 0x7f0f60150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f65da6700 1 -- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f60159c20 msgr2=0x7f0f60154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f65da6700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f60159c20 0x7f0f60154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f65da6700 1 -- 172.21.15.7:0/120817711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580094f0 con 0x7f0f600b0930 2023-10-14T19:05:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f65da6700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 0x7f0f60152170 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0f580099b0 tx=0x7f0f58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800bb20 con 0x7f0f600b0930 2023-10-14T19:05:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58011420 con 0x7f0f600b0930 2023-10-14T19:05:09.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f60153450 con 0x7f0f600b0930 2023-10-14T19:05:09.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580117c0 con 0x7f0f600b0930 2023-10-14T19:05:09.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.629+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f60153a10 con 0x7f0f600b0930 2023-10-14T19:05:09.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.630+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f60154060 con 0x7f0f600b0930 2023-10-14T19:05:09.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.631+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0f58011bb0 con 0x7f0f600b0930 2023-10-14T19:05:09.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.631+0000 7f0f5dffb700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f4c066fc0 0x7f0f4c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:09.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.631+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f58085fb0 con 0x7f0f600b0930 2023-10-14T19:05:09.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.632+0000 7f0f655a5700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f4c066fc0 0x7f0f4c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:09.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.632+0000 7f0f655a5700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f4c066fc0 0x7f0f4c069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0f600cb1e0 tx=0x7f0f540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:09.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.636+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f58053230 con 0x7f0f600b0930 2023-10-14T19:05:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.873+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f6004c3c0 con 0x7f0f600b0930 2023-10-14T19:05:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.873+0000 7f0f5dffb700 1 -- 172.21.15.7:0/120817711 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f58011e60 con 0x7f0f600b0930 2023-10-14T19:05:09.874 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:05:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f4c066fc0 msgr2=0x7f0f4c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f4c066fc0 0x7f0f4c069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0f600cb1e0 tx=0x7f0f540091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 msgr2=0x7f0f60152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 0x7f0f60152170 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0f580099b0 tx=0x7f0f58017000 comp rx=0 tx=0).stop 2023-10-14T19:05:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 shutdown_connections 2023-10-14T19:05:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f4c066fc0 0x7f0f4c069470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f60159c20 0x7f0f60154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f600b0930 0x7f0f60152170 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 --2- 172.21.15.7:0/120817711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f60159850 0x7f0f60150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 >> 172.21.15.7:0/120817711 conn(0x7f0f6006d170 msgr2=0x7f0f60069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 shutdown_connections 2023-10-14T19:05:09.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:09.875+0000 7f0f6800a700 1 -- 172.21.15.7:0/120817711 wait complete. 2023-10-14T19:05:09.888 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:05:09.888 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:05:09.889 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:05:09.889 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:05:09.890 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:05:09.890 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:05:09.891 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:05:09.891 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:05:09.892 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:05:09.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:09.892 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:05:09.911 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:05:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:05:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:05:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:05:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.913 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:05:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:05:09.914 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:05:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:05:09.914 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:05:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:09.915 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:05:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:05:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42354sec preferred_lft 42354sec 2023-10-14T19:05:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:05:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.916 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:05:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:05:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:05:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:05:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.917 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:05:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:05:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:05:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.918 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:05:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:05:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:05:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:05:09.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:09.919 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:05:09.980 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:05:09.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:09.982 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:05:10.040 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:05:10.041 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:05:10.041 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:05:10.041 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:05:10.041 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:05:10.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:10.042 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:05:10.042 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:05:10.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:05:10.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:05:10.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:05:10.044 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:05:10.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:10.146 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:05:10.161 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:05:10.161 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:05:10.162 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:05:10.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:10.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:05:10.226 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:05:10.227 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:05:10.282 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:05:10.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:05:10.283 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:05:10.337 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:05:10.337 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:05:10.338 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:05:10.416 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:05:10.416 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:05:10.416 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:05:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:05:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:05:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:05:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:05:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:05:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:05:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:05:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:05:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:05:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:05:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:05:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:05:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:05:10.449 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:05:10.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:05:10.450 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:05:10.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:05:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.643+0000 7fad4359e700 1 Processor -- start 2023-10-14T19:05:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.643+0000 7fad4359e700 1 -- start start 2023-10-14T19:05:10.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad4359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fad440b24f0 0x7fad440b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:10.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad4359e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440b0c80 con 0x7fad44159800 2023-10-14T19:05:10.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad4359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440b0f60 con 0x7fad440b1d40 2023-10-14T19:05:10.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad4359e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440d10d0 con 0x7fad440b24f0 2023-10-14T19:05:10.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad4259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fad440b24f0 0x7fad440b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad42d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fad44159800 0x7fad440b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38080/0 (socket says 172.21.15.7:38080) 2023-10-14T19:05:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.644+0000 7fad42d9d700 1 -- 172.21.15.7:0/696462434 learned_addr learned my addr 172.21.15.7:0/696462434 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4259c700 1 -- 172.21.15.7:0/696462434 >> v1:172.21.15.148:6789/0 conn(0x7fad440b1d40 legacy=0x7fad441590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4259c700 1 -- 172.21.15.7:0/696462434 >> v1:172.21.15.7:6789/0 conn(0x7fad44159800 legacy=0x7fad440b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4259c700 1 -- 172.21.15.7:0/696462434 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440b1240 con 0x7fad440b24f0 2023-10-14T19:05:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4159a700 1 -- 172.21.15.7:0/696462434 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009532221 0 0) 0x7fad440b0c80 con 0x7fad44159800 2023-10-14T19:05:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4259c700 1 --2- 172.21.15.7:0/696462434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440b0580 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fad340098e0 tx=0x7fad340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7197f2f1173f496d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4159a700 1 -- 172.21.15.7:0/696462434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34009e80 con 0x7fad440b24f0 2023-10-14T19:05:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4159a700 1 -- 172.21.15.7:0/696462434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3400b860 con 0x7fad440b24f0 2023-10-14T19:05:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4159a700 1 -- 172.21.15.7:0/696462434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400bbe0 con 0x7fad440b24f0 2023-10-14T19:05:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4359e700 1 -- 172.21.15.7:0/696462434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 msgr2=0x7fad440b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.645+0000 7fad4359e700 1 --2- 172.21.15.7:0/696462434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440b0580 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fad340098e0 tx=0x7fad340091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.646+0000 7fad4359e700 1 -- 172.21.15.7:0/696462434 shutdown_connections 2023-10-14T19:05:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.646+0000 7fad4359e700 1 --2- 172.21.15.7:0/696462434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440b0580 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.646+0000 7fad4359e700 1 -- 172.21.15.7:0/696462434 >> 172.21.15.7:0/696462434 conn(0x7fad440703a0 msgr2=0x7fad440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.646+0000 7fad4359e700 1 -- 172.21.15.7:0/696462434 shutdown_connections 2023-10-14T19:05:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.646+0000 7fad4359e700 1 -- 172.21.15.7:0/696462434 wait complete. 2023-10-14T19:05:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 Processor -- start 2023-10-14T19:05:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 -- start start 2023-10-14T19:05:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440b1d40 0x7fad4415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad44159800 0x7fad44154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4415e680 con 0x7fad440b24f0 2023-10-14T19:05:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4415e100 con 0x7fad440b1d40 2023-10-14T19:05:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad4359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4415e3a0 con 0x7fad44159800 2023-10-14T19:05:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.647+0000 7fad41d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39424/0 (socket says 172.21.15.7:39424) 2023-10-14T19:05:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 -- 172.21.15.7:0/131598773 learned_addr learned my addr 172.21.15.7:0/131598773 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad42d9d700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad44159800 0x7fad44154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad4259c700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440b1d40 0x7fad4415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 -- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad44159800 msgr2=0x7fad44154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad44159800 0x7fad44154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 -- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440b1d40 msgr2=0x7fad4415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440b1d40 0x7fad4415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 -- 172.21.15.7:0/131598773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34009420 con 0x7fad440b24f0 2023-10-14T19:05:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad41d9b700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440cfac0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00c4e0 tx=0x7fad2c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c011590 con 0x7fad440b24f0 2023-10-14T19:05:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c011710 con 0x7fad440b24f0 2023-10-14T19:05:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad440c5430 con 0x7fad440b24f0 2023-10-14T19:05:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c011ad0 con 0x7fad440b24f0 2023-10-14T19:05:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.648+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad440c59f0 con 0x7fad440b24f0 2023-10-14T19:05:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.649+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad440c5c10 con 0x7fad440b24f0 2023-10-14T19:05:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.650+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fad2c01b3b0 con 0x7fad440b24f0 2023-10-14T19:05:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.650+0000 7fad3a7fc700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fad24066fc0 0x7fad24069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.650+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad2c0838e0 con 0x7fad440b24f0 2023-10-14T19:05:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.650+0000 7fad4259c700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fad24066fc0 0x7fad24069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.651+0000 7fad4259c700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fad24066fc0 0x7fad24069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fad340093f0 tx=0x7fad34017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.654+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad2c050b60 con 0x7fad440b24f0 2023-10-14T19:05:10.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:10.890+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad4404c3c0 con 0x7fad440b24f0 2023-10-14T19:05:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.002+0000 7fad3a7fc700 1 -- 172.21.15.7:0/131598773 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 136+0+0 (secure 0 0 0) 0x7fad2c0170c0 con 0x7fad440b24f0 2023-10-14T19:05:11.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fad24066fc0 msgr2=0x7fad24069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fad24066fc0 0x7fad24069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fad340093f0 tx=0x7fad34017000 comp rx=0 tx=0).stop 2023-10-14T19:05:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 msgr2=0x7fad440cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440cfac0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00c4e0 tx=0x7fad2c00c7f0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 shutdown_connections 2023-10-14T19:05:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fad24066fc0 0x7fad24069470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440b1d40 0x7fad4415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad44159800 0x7fad44154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 --2- 172.21.15.7:0/131598773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad440b24f0 0x7fad440cfac0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 >> 172.21.15.7:0/131598773 conn(0x7fad440703a0 msgr2=0x7fad440af410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 shutdown_connections 2023-10-14T19:05:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.004+0000 7fad4359e700 1 -- 172.21.15.7:0/131598773 wait complete. 2023-10-14T19:05:11.017 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:05:11.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.136+0000 7f7199bfc700 1 Processor -- start 2023-10-14T19:05:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.136+0000 7f7199bfc700 1 -- start start 2023-10-14T19:05:11.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f7199bfc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f71941598b0 0x7f71940af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f7199bfc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940ce9d0 con 0x7f7194159c80 2023-10-14T19:05:11.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f7199bfc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940afc30 con 0x7f71940af790 2023-10-14T19:05:11.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f7199bfc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940aff10 con 0x7f71941598b0 2023-10-14T19:05:11.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f71937fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f71941598b0 0x7f71940af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f7192ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7194159c80 0x7f71940cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38094/0 (socket says 172.21.15.7:38094) 2023-10-14T19:05:11.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.137+0000 7f7192ffd700 1 -- 172.21.15.7:0/751542532 learned_addr learned my addr 172.21.15.7:0/751542532 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:11.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71937fe700 1 -- 172.21.15.7:0/751542532 >> v1:172.21.15.148:6789/0 conn(0x7f71940af790 legacy=0x7f7194163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71937fe700 1 -- 172.21.15.7:0/751542532 >> v1:172.21.15.7:6789/0 conn(0x7f7194159c80 legacy=0x7f71940cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71937fe700 1 -- 172.21.15.7:0/751542532 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940ce380 con 0x7f71941598b0 2023-10-14T19:05:11.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71927fc700 1 -- 172.21.15.7:0/751542532 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331188510 0 0) 0x7f71940ce9d0 con 0x7f7194159c80 2023-10-14T19:05:11.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71937fe700 1 --2- 172.21.15.7:0/751542532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f71940af250 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f71840098e0 tx=0x7f71840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a998d9c9bda3cbe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71927fc700 1 -- 172.21.15.7:0/751542532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184009e80 con 0x7f71941598b0 2023-10-14T19:05:11.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71927fc700 1 -- 172.21.15.7:0/751542532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400b860 con 0x7f71941598b0 2023-10-14T19:05:11.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f71927fc700 1 -- 172.21.15.7:0/751542532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400bbe0 con 0x7f71941598b0 2023-10-14T19:05:11.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f7199bfc700 1 -- 172.21.15.7:0/751542532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 msgr2=0x7f71940af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.138+0000 7f7199bfc700 1 --2- 172.21.15.7:0/751542532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f71940af250 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f71840098e0 tx=0x7f71840091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.139+0000 7f7199bfc700 1 -- 172.21.15.7:0/751542532 shutdown_connections 2023-10-14T19:05:11.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.139+0000 7f7199bfc700 1 --2- 172.21.15.7:0/751542532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f71940af250 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.139+0000 7f7199bfc700 1 -- 172.21.15.7:0/751542532 >> 172.21.15.7:0/751542532 conn(0x7f7194070e30 msgr2=0x7f71940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:11.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.139+0000 7f7199bfc700 1 -- 172.21.15.7:0/751542532 shutdown_connections 2023-10-14T19:05:11.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.139+0000 7f7199bfc700 1 -- 172.21.15.7:0/751542532 wait complete. 2023-10-14T19:05:11.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.140+0000 7f7199bfc700 1 Processor -- start 2023-10-14T19:05:11.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.140+0000 7f7199bfc700 1 -- start start 2023-10-14T19:05:11.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71940af790 0x7f719415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f719416d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7194159c80 0x7f719416d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b4430 con 0x7f71941598b0 2023-10-14T19:05:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b3820 con 0x7f7194159c80 2023-10-14T19:05:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b3b00 con 0x7f71940af790 2023-10-14T19:05:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f719416d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f719416d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39450/0 (socket says 172.21.15.7:39450) 2023-10-14T19:05:11.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 -- 172.21.15.7:0/3176295497 learned_addr learned my addr 172.21.15.7:0/3176295497 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:11.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f71937fe700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71940af790 0x7f719415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7193fff700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7194159c80 0x7f719416d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 -- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71940af790 msgr2=0x7f719415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71940af790 0x7f719415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 -- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7194159c80 msgr2=0x7f719416d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7194159c80 0x7f719416d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 -- 172.21.15.7:0/3176295497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009420 con 0x7f71941598b0 2023-10-14T19:05:11.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7192ffd700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f719416d400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f718800c560 tx=0x7f7188000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188005b30 con 0x7f71941598b0 2023-10-14T19:05:11.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188005c90 con 0x7f71941598b0 2023-10-14T19:05:11.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71940b3de0 con 0x7f71941598b0 2023-10-14T19:05:11.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188007320 con 0x7f71941598b0 2023-10-14T19:05:11.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.141+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71940b34b0 con 0x7f71941598b0 2023-10-14T19:05:11.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.142+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71940d11f0 con 0x7f71941598b0 2023-10-14T19:05:11.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.143+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f718801b3b0 con 0x7f71941598b0 2023-10-14T19:05:11.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.143+0000 7f717b7fe700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7180066fc0 0x7f7180069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.143+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7188083970 con 0x7f71941598b0 2023-10-14T19:05:11.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.143+0000 7f71937fe700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7180066fc0 0x7f7180069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.144+0000 7f71937fe700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7180066fc0 0x7f7180069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f71840093f0 tx=0x7f7184017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.147+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7188050bf0 con 0x7f71941598b0 2023-10-14T19:05:11.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.367+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f719404c3c0 con 0x7f7180066fc0 2023-10-14T19:05:11.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.369+0000 7f717b7fe700 1 -- 172.21.15.7:0/3176295497 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f719404c3c0 con 0x7f7180066fc0 2023-10-14T19:05:11.370 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:05:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:05:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:05:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:05:11.371 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:05:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7180066fc0 msgr2=0x7f7180069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7180066fc0 0x7f7180069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f71840093f0 tx=0x7f7184017000 comp rx=0 tx=0).stop 2023-10-14T19:05:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 msgr2=0x7f719416d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f719416d400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f718800c560 tx=0x7f7188000fe0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 shutdown_connections 2023-10-14T19:05:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7180066fc0 0x7f7180069470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7194159c80 0x7f719416d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71940af790 0x7f719415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 --2- 172.21.15.7:0/3176295497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71941598b0 0x7f719416d400 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 >> 172.21.15.7:0/3176295497 conn(0x7f7194070e30 msgr2=0x7f71941551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 shutdown_connections 2023-10-14T19:05:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.371+0000 7f7199bfc700 1 -- 172.21.15.7:0/3176295497 wait complete. 2023-10-14T19:05:11.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:05:11.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.505+0000 7f122e0af700 1 Processor -- start 2023-10-14T19:05:11.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.505+0000 7f122e0af700 1 -- start start 2023-10-14T19:05:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f122e0af700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122806dc70 0x7f1228159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f122e0af700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f122806e0e0 0x7f12280cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f122e0af700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12280ccfd0 con 0x7f1228159530 2023-10-14T19:05:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f122e0af700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122815a3d0 con 0x7f122806e0e0 2023-10-14T19:05:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f122e0af700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122815a6b0 con 0x7f122806dc70 2023-10-14T19:05:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f1227fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f122806e0e0 0x7f12280cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f12277fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1228159530 0x7f12280ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38110/0 (socket says 172.21.15.7:38110) 2023-10-14T19:05:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.506+0000 7f12277fe700 1 -- 172.21.15.7:0/2259510379 learned_addr learned my addr 172.21.15.7:0/2259510379 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1226ffd700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122806dc70 0x7f1228159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1227fff700 1 -- 172.21.15.7:0/2259510379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122806dc70 msgr2=0x7f1228159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1227fff700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122806dc70 0x7f1228159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1227fff700 1 -- 172.21.15.7:0/2259510379 >> v1:172.21.15.7:6789/0 conn(0x7f1228159530 legacy=0x7f12280ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1227fff700 1 -- 172.21.15.7:0/2259510379 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122815a990 con 0x7f122806e0e0 2023-10-14T19:05:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f12267fc700 1 -- 172.21.15.7:0/2259510379 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524770320 0 0) 0x7f12280ccfd0 con 0x7f1228159530 2023-10-14T19:05:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1226ffd700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122806dc70 0x7f1228159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:05:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f1227fff700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280cb6f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1220009e60 tx=0x7f1220009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3264553b689eccb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f12267fc700 1 -- 172.21.15.7:0/2259510379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000e070 con 0x7f122806e0e0 2023-10-14T19:05:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f12267fc700 1 -- 172.21.15.7:0/2259510379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000bc30 con 0x7f122806e0e0 2023-10-14T19:05:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.507+0000 7f12267fc700 1 -- 172.21.15.7:0/2259510379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220012430 con 0x7f122806e0e0 2023-10-14T19:05:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 -- 172.21.15.7:0/2259510379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 msgr2=0x7f12280cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280cb6f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1220009e60 tx=0x7f1220009780 comp rx=0 tx=0).stop 2023-10-14T19:05:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 -- 172.21.15.7:0/2259510379 shutdown_connections 2023-10-14T19:05:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280cb6f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 --2- 172.21.15.7:0/2259510379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122806dc70 0x7f1228159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 -- 172.21.15.7:0/2259510379 >> 172.21.15.7:0/2259510379 conn(0x7f12280703a0 msgr2=0x7f12280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:11.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 -- 172.21.15.7:0/2259510379 shutdown_connections 2023-10-14T19:05:11.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.508+0000 7f122e0af700 1 -- 172.21.15.7:0/2259510379 wait complete. 2023-10-14T19:05:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.509+0000 7f122e0af700 1 Processor -- start 2023-10-14T19:05:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.509+0000 7f122e0af700 1 -- start start 2023-10-14T19:05:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122806dc70 0x7f12281588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1228159530 0x7f1228149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228158460 con 0x7f122806e0e0 2023-10-14T19:05:11.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228157850 con 0x7f122806dc70 2023-10-14T19:05:11.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1228157b30 con 0x7f1228159530 2023-10-14T19:05:11.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39468/0 (socket says 172.21.15.7:39468) 2023-10-14T19:05:11.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 -- 172.21.15.7:0/1418414400 learned_addr learned my addr 172.21.15.7:0/1418414400 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:11.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1227fff700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1228159530 0x7f1228149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f12277fe700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122806dc70 0x7f12281588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 -- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1228159530 msgr2=0x7f1228149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1228159530 0x7f1228149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 -- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122806dc70 msgr2=0x7f12281588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122806dc70 0x7f12281588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 -- 172.21.15.7:0/1418414400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220009a20 con 0x7f122806e0e0 2023-10-14T19:05:11.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1227fff700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1228159530 0x7f1228149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:05:11.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f1226ffd700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280b5dd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f121c00e8d0 tx=0x7f121c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00ee70 con 0x7f122806e0e0 2023-10-14T19:05:11.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c00c5e0 con 0x7f122806e0e0 2023-10-14T19:05:11.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00c980 con 0x7f122806e0e0 2023-10-14T19:05:11.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.510+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228157e10 con 0x7f122806e0e0 2023-10-14T19:05:11.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.511+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280b6310 con 0x7f122806e0e0 2023-10-14T19:05:11.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.511+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12281585d0 con 0x7f122806e0e0 2023-10-14T19:05:11.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.512+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f121c013410 con 0x7f122806e0e0 2023-10-14T19:05:11.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.512+0000 7f120f7fe700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1214066fc0 0x7f1214069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.512+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f121c084440 con 0x7f122806e0e0 2023-10-14T19:05:11.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.513+0000 7f12277fe700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1214066fc0 0x7f1214069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.513+0000 7f12277fe700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1214066fc0 0x7f1214069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f121800c8f0 tx=0x7f1218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.516+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f121c055040 con 0x7f122806e0e0 2023-10-14T19:05:11.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.711+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f122804c3c0 con 0x7f122806e0e0 2023-10-14T19:05:11.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.711+0000 7f120f7fe700 1 -- 172.21.15.7:0/1418414400 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f121c054bd0 con 0x7f122806e0e0 2023-10-14T19:05:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1214066fc0 msgr2=0x7f1214069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1214066fc0 0x7f1214069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f121800c8f0 tx=0x7f1218009040 comp rx=0 tx=0).stop 2023-10-14T19:05:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 msgr2=0x7f12280b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280b5dd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f121c00e8d0 tx=0x7f121c008040 comp rx=0 tx=0).stop 2023-10-14T19:05:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 shutdown_connections 2023-10-14T19:05:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1214066fc0 0x7f1214069470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122806dc70 0x7f12281588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1228159530 0x7f1228149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 --2- 172.21.15.7:0/1418414400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f122806e0e0 0x7f12280b5dd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 >> 172.21.15.7:0/1418414400 conn(0x7f12280703a0 msgr2=0x7f12280cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 shutdown_connections 2023-10-14T19:05:11.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.713+0000 7f122e0af700 1 -- 172.21.15.7:0/1418414400 wait complete. 2023-10-14T19:05:11.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000749443 --mode=777 2023-10-14T19:05:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.849+0000 7f2d78dd1700 1 Processor -- start 2023-10-14T19:05:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.849+0000 7f2d78dd1700 1 -- start start 2023-10-14T19:05:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d78dd1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 0x7f2d740b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d78dd1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740b4060 con 0x7f2d74159550 2023-10-14T19:05:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d78dd1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740cfec0 con 0x7f2d740b2580 2023-10-14T19:05:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d78dd1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740b2a00 con 0x7f2d74159920 2023-10-14T19:05:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d7259c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2d74159550 0x7f2d740cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38126/0 (socket says 172.21.15.7:38126) 2023-10-14T19:05:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d7259c700 1 -- 172.21.15.7:0/2784020920 learned_addr learned my addr 172.21.15.7:0/2784020920 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.850+0000 7f2d71d9b700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 0x7f2d740b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078450205 0 0) 0x7f2d740b4060 con 0x7f2d74159550 2023-10-14T19:05:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d60003570 con 0x7f2d74159550 2023-10-14T19:05:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644309131 0 0) 0x7f2d740cfec0 con 0x7f2d740b2580 2023-10-14T19:05:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d740b4060 con 0x7f2d740b2580 2023-10-14T19:05:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 120001151 0 0) 0x7f2d60003570 con 0x7f2d74159550 2023-10-14T19:05:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 msgr2=0x7f2d740b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 0x7f2d740b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 >> v1:172.21.15.148:6789/0 conn(0x7f2d740b2580 legacy=0x7f2d740b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740cf620 con 0x7f2d74159550 2023-10-14T19:05:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2d6c001470 con 0x7f2d74159550 2023-10-14T19:05:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 >> v1:172.21.15.7:6789/0 conn(0x7f2d74159550 legacy=0x7f2d740cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d60003c20 0x7f2d60004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 0x7f2d60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740b2a00 con 0x7f2d60003c20 2023-10-14T19:05:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6000bb40 con 0x7f2d60004d50 2023-10-14T19:05:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6000bd00 con 0x7f2d74159920 2023-10-14T19:05:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d60003c20 0x7f2d60004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d71d9b700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 0x7f2d60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d72d9d700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 -- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 msgr2=0x7f2d60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159920 0x7f2d60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 -- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60004d50 msgr2=0x7f2d600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 -- 172.21.15.7:0/2784020920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60003570 con 0x7f2d60003c20 2023-10-14T19:05:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.851+0000 7f2d7259c700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d60003c20 0x7f2d60004010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c2d0 tx=0x7f2d6c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a958cb0ce39513a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00cc00 con 0x7f2d60003c20 2023-10-14T19:05:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c00cd60 con 0x7f2d60003c20 2023-10-14T19:05:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d7159a700 1 -- 172.21.15.7:0/2784020920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c005b70 con 0x7f2d60003c20 2023-10-14T19:05:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d78dd1700 1 -- 172.21.15.7:0/2784020920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d60003c20 msgr2=0x7f2d60004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/2784020920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d60003c20 0x7f2d60004010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c2d0 tx=0x7f2d6c001e10 comp rx=0 tx=0).stop 2023-10-14T19:05:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d72d9d700 1 -- 172.21.15.7:0/2784020920 reap_dead start 2023-10-14T19:05:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d78dd1700 1 -- 172.21.15.7:0/2784020920 shutdown_connections 2023-10-14T19:05:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d78dd1700 1 -- 172.21.15.7:0/2784020920 >> 172.21.15.7:0/2784020920 conn(0x7f2d740703a0 msgr2=0x7f2d740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d78dd1700 1 -- 172.21.15.7:0/2784020920 shutdown_connections 2023-10-14T19:05:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.852+0000 7f2d78dd1700 1 -- 172.21.15.7:0/2784020920 wait complete. 2023-10-14T19:05:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.853+0000 7f2d78dd1700 1 Processor -- start 2023-10-14T19:05:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.853+0000 7f2d78dd1700 1 -- start start 2023-10-14T19:05:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d78dd1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60003c20 0x7f2d7416de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d78dd1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7415c370 0x7f2d74151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d78dd1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 0x7f2d7416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d78dd1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7416e360 con 0x7f2d74169ee0 2023-10-14T19:05:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d78dd1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415a900 con 0x7f2d7415c370 2023-10-14T19:05:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d78dd1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74156720 con 0x7f2d60003c20 2023-10-14T19:05:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 0x7f2d7416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 0x7f2d7416a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39498/0 (socket says 172.21.15.7:39498) 2023-10-14T19:05:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 -- 172.21.15.7:0/1451351729 learned_addr learned my addr 172.21.15.7:0/1451351729 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d71d9b700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7415c370 0x7f2d74151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d7259c700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60003c20 0x7f2d7416de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 -- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60003c20 msgr2=0x7f2d7416de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60003c20 0x7f2d7416de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 -- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7415c370 msgr2=0x7f2d74151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7415c370 0x7f2d74151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.854+0000 7f2d72d9d700 1 -- 172.21.15.7:0/1451351729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74159cf0 con 0x7f2d74169ee0 2023-10-14T19:05:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.855+0000 7f2d72d9d700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 0x7f2d7416a350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2d7415d2e0 tx=0x7f2d64009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.855+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64006db0 con 0x7f2d74169ee0 2023-10-14T19:05:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.855+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64003070 con 0x7f2d74169ee0 2023-10-14T19:05:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.855+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74159fd0 con 0x7f2d74169ee0 2023-10-14T19:05:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.855+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64003430 con 0x7f2d74169ee0 2023-10-14T19:05:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.855+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7415a590 con 0x7f2d74169ee0 2023-10-14T19:05:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.856+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7404c3c0 con 0x7f2d74169ee0 2023-10-14T19:05:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.856+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2d640018f0 con 0x7f2d74169ee0 2023-10-14T19:05:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.856+0000 7f2d6a7fc700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d54066fc0 0x7f2d54069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.857+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d64083c80 con 0x7f2d74169ee0 2023-10-14T19:05:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.857+0000 7f2d7259c700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d54066fc0 0x7f2d54069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.857+0000 7f2d7259c700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d54066fc0 0x7f2d54069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c001ed0 tx=0x7f2d6c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:11.861+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d6404c5a0 con 0x7f2d74169ee0 2023-10-14T19:05:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.087+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000749443", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d740cf900 con 0x7f2d54066fc0 2023-10-14T19:05:12.090 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:05:12.089+0000 7f53c0831700 -1 client.5335 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-14T19:04:41.962688+0000 mtime=2023-10-14T19:04:41.962688+0000 ctime=2023-10-14T19:04:41.968474+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000195144"] has_dir_layout 0x55968d612000) 2023-10-14T19:05:12.094 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:05:12.093+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:05:12.094 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:05:12.093+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:05:12.094 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:05:12.093+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:05:12.095 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:05:12.093+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:05:12.095 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:05:12.093+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:05:12.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.124+0000 7f2d6a7fc700 1 -- 172.21.15.7:0/1451351729 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2d740cf900 con 0x7f2d54066fc0 2023-10-14T19:05:12.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d54066fc0 msgr2=0x7f2d54069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d54066fc0 0x7f2d54069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c001ed0 tx=0x7f2d6c015000 comp rx=0 tx=0).stop 2023-10-14T19:05:12.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 msgr2=0x7f2d7416a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 0x7f2d7416a350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2d7415d2e0 tx=0x7f2d64009040 comp rx=0 tx=0).stop 2023-10-14T19:05:12.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 shutdown_connections 2023-10-14T19:05:12.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d54066fc0 0x7f2d54069470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74169ee0 0x7f2d7416a350 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60003c20 0x7f2d7416de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 --2- 172.21.15.7:0/1451351729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7415c370 0x7f2d74151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 >> 172.21.15.7:0/1451351729 conn(0x7f2d740703a0 msgr2=0x7f2d740b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 shutdown_connections 2023-10-14T19:05:12.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.126+0000 7f2d78dd1700 1 -- 172.21.15.7:0/1451351729 wait complete. 2023-10-14T19:05:12.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000749443 2023-10-14T19:05:12.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.261+0000 7f053bbf8700 1 Processor -- start 2023-10-14T19:05:12.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.261+0000 7f053bbf8700 1 -- start start 2023-10-14T19:05:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f053bbf8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0534159530 0x7f05340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f053bbf8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f053406e0e0 0x7f05340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f053bbf8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340ccfd0 con 0x7f053406dc70 2023-10-14T19:05:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f053bbf8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340cf0e0 con 0x7f053406e0e0 2023-10-14T19:05:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f053bbf8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053415a3d0 con 0x7f0534159530 2023-10-14T19:05:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f053a195700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f053406e0e0 0x7f05340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f0539193700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f053406dc70 0x7f0534159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38128/0 (socket says 172.21.15.7:38128) 2023-10-14T19:05:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.262+0000 7f0539193700 1 -- 172.21.15.7:0/1605416240 learned_addr learned my addr 172.21.15.7:0/1605416240 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:05:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f0539994700 1 --2- 172.21.15.7:0/1605416240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0534159530 0x7f05340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f053a195700 1 -- 172.21.15.7:0/1605416240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0534159530 msgr2=0x7f05340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:05:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f053a195700 1 --2- 172.21.15.7:0/1605416240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0534159530 0x7f05340ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f053a195700 1 -- 172.21.15.7:0/1605416240 >> v1:172.21.15.7:6789/0 conn(0x7f053406dc70 legacy=0x7f0534159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f053a195700 1 -- 172.21.15.7:0/1605416240 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053415a6b0 con 0x7f053406e0e0 2023-10-14T19:05:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f0538992700 1 -- 172.21.15.7:0/1605416240 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787890126 0 0) 0x7f05340ccfd0 con 0x7f053406dc70 2023-10-14T19:05:12.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f053a195700 1 --2- 172.21.15.7:0/1605416240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406e0e0 0x7f05340cb6f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098e0 tx=0x7f052c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2362f3a85d4a0e28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:12.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f0538992700 1 -- 172.21.15.7:0/1605416240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c009e80 con 0x7f053406e0e0 2023-10-14T19:05:12.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f0538992700 1 -- 172.21.15.7:0/1605416240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00b860 con 0x7f053406e0e0 2023-10-14T19:05:12.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.263+0000 7f0538992700 1 -- 172.21.15.7:0/1605416240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00bbe0 con 0x7f053406e0e0 2023-10-14T19:05:12.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 -- 172.21.15.7:0/1605416240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406e0e0 msgr2=0x7f05340cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 --2- 172.21.15.7:0/1605416240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406e0e0 0x7f05340cb6f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098e0 tx=0x7f052c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 -- 172.21.15.7:0/1605416240 shutdown_connections 2023-10-14T19:05:12.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 --2- 172.21.15.7:0/1605416240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406e0e0 0x7f05340cb6f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 --2- 172.21.15.7:0/1605416240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0534159530 0x7f05340ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 -- 172.21.15.7:0/1605416240 >> 172.21.15.7:0/1605416240 conn(0x7f05340703a0 msgr2=0x7f05340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:12.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 -- 172.21.15.7:0/1605416240 shutdown_connections 2023-10-14T19:05:12.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.264+0000 7f053bbf8700 1 -- 172.21.15.7:0/1605416240 wait complete. 2023-10-14T19:05:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 Processor -- start 2023-10-14T19:05:12.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 -- start start 2023-10-14T19:05:12.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 0x7f05340c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:12.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f053406e0e0 0x7f05340cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:12.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0534159530 0x7f05340cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:12.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053415d960 con 0x7f053406dc70 2023-10-14T19:05:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.265+0000 7f053bbf8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053415cd90 con 0x7f0534159530 2023-10-14T19:05:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f053bbf8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053415ddf0 con 0x7f053406e0e0 2023-10-14T19:05:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 0x7f05340c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 0x7f05340c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39512/0 (socket says 172.21.15.7:39512) 2023-10-14T19:05:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 -- 172.21.15.7:0/2132669312 learned_addr learned my addr 172.21.15.7:0/2132669312 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:05:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539193700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f053406e0e0 0x7f05340cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 -- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f053406e0e0 msgr2=0x7f05340cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f053406e0e0 0x7f05340cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 -- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0534159530 msgr2=0x7f05340cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f053a195700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0534159530 0x7f05340cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0534159530 0x7f05340cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 -- 172.21.15.7:0/2132669312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009420 con 0x7f053406dc70 2023-10-14T19:05:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539193700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f053406e0e0 0x7f05340cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:05:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0539994700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 0x7f05340c7790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0524009fa0 tx=0x7f0524009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400ed20 con 0x7f053406dc70 2023-10-14T19:05:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400ee80 con 0x7f053406dc70 2023-10-14T19:05:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053415d030 con 0x7f053406dc70 2023-10-14T19:05:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524014670 con 0x7f053406dc70 2023-10-14T19:05:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.266+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053415d5f0 con 0x7f053406dc70 2023-10-14T19:05:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.267+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053415dc40 con 0x7f053406dc70 2023-10-14T19:05:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.268+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f05240149e0 con 0x7f053406dc70 2023-10-14T19:05:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.268+0000 7f0531ffb700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0520066fc0 0x7f0520069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:05:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.268+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0524084de0 con 0x7f053406dc70 2023-10-14T19:05:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.268+0000 7f0539193700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0520066fc0 0x7f0520069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:05:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.269+0000 7f0539193700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0520066fc0 0x7f0520069470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f053416cb00 tx=0x7f0528009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:05:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.273+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0524051f60 con 0x7f053406dc70 2023-10-14T19:05:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.498+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000749443", "target": ["mon-mgr", ""]}) v1 -- 0x7f053415daa0 con 0x7f0520066fc0 2023-10-14T19:05:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.506+0000 7f0531ffb700 1 -- 172.21.15.7:0/2132669312 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f0528001d70 con 0x7f0520066fc0 2023-10-14T19:05:12.507 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999 2023-10-14T19:05:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.507+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0520066fc0 msgr2=0x7f0520069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.507+0000 7f053bbf8700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0520066fc0 0x7f0520069470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f053416cb00 tx=0x7f0528009040 comp rx=0 tx=0).stop 2023-10-14T19:05:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 msgr2=0x7f05340c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:05:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 0x7f05340c7790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0524009fa0 tx=0x7f0524009880 comp rx=0 tx=0).stop 2023-10-14T19:05:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 shutdown_connections 2023-10-14T19:05:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0520066fc0 0x7f0520069470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0534159530 0x7f05340cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f053406dc70 0x7f05340c7790 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 --2- 172.21.15.7:0/2132669312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f053406e0e0 0x7f05340cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:05:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 >> 172.21.15.7:0/2132669312 conn(0x7f05340703a0 msgr2=0x7f05340c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:05:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 shutdown_connections 2023-10-14T19:05:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:05:12.508+0000 7f053bbf8700 1 -- 172.21.15.7:0/2132669312 wait complete. 2023-10-14T19:05:12.521 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000749443 with 3000 files each 0.1MB size under directory volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999 2023-10-14T19:05:12.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.522 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.547 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0158e-05 s, 0.0 kB/s 2023-10-14T19:05:12.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.548 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.603 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0299e-05 s, 0.0 kB/s 2023-10-14T19:05:12.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.604 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.659 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.659 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-14T19:05:12.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.660 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.715 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4178e-05 s, 0.0 kB/s 2023-10-14T19:05:12.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.715 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.771 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.771 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0125e-05 s, 0.0 kB/s 2023-10-14T19:05:12.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.826 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.826 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.827 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0721e-05 s, 0.0 kB/s 2023-10-14T19:05:12.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.828 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.882 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.883 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1258e-05 s, 0.0 kB/s 2023-10-14T19:05:12.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.884 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2121e-05 s, 0.0 kB/s 2023-10-14T19:05:12.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.940 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:12.994 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:12.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:12.995 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-14T19:05:12.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:12.996 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.051 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3932e-05 s, 0.0 kB/s 2023-10-14T19:05:13.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.052 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.242e-05 s, 0.0 kB/s 2023-10-14T19:05:13.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.108 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.164 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.164 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3614e-05 s, 0.0 kB/s 2023-10-14T19:05:13.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.165 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2474e-05 s, 0.0 kB/s 2023-10-14T19:05:13.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.220 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2142e-05 s, 0.0 kB/s 2023-10-14T19:05:13.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.276 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1e-05 s, 0.0 kB/s 2023-10-14T19:05:13.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.331 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9573e-05 s, 0.0 kB/s 2023-10-14T19:05:13.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.386 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.442 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1587e-05 s, 0.0 kB/s 2023-10-14T19:05:13.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.442 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3201e-05 s, 0.0 kB/s 2023-10-14T19:05:13.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.498 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.553 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0656e-05 s, 0.0 kB/s 2023-10-14T19:05:13.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.554 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.610 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1921e-05 s, 0.0 kB/s 2023-10-14T19:05:13.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.610 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.666 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.44e-05 s, 0.0 kB/s 2023-10-14T19:05:13.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.667 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.722 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.088e-05 s, 0.0 kB/s 2023-10-14T19:05:13.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.723 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.777 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2387e-05 s, 0.0 kB/s 2023-10-14T19:05:13.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.778 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.353e-05 s, 0.0 kB/s 2023-10-14T19:05:13.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.834 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.927 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0001e-05 s, 0.0 kB/s 2023-10-14T19:05:13.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.929 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:13.947 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:13.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:13.948 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.5903e-05 s, 0.0 kB/s 2023-10-14T19:05:13.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:13.949 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.004 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1513e-05 s, 0.0 kB/s 2023-10-14T19:05:14.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.005 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.060 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3211e-05 s, 0.0 kB/s 2023-10-14T19:05:14.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.061 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2043e-05 s, 0.0 kB/s 2023-10-14T19:05:14.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.117 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.171 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.172 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2319e-05 s, 0.0 kB/s 2023-10-14T19:05:14.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.173 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.226 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.227 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.227 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5426e-05 s, 0.0 kB/s 2023-10-14T19:05:14.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.228 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.284 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2891e-05 s, 0.0 kB/s 2023-10-14T19:05:14.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.285 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1354e-05 s, 0.0 kB/s 2023-10-14T19:05:14.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.341 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4012e-05 s, 0.0 kB/s 2023-10-14T19:05:14.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.398 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0866e-05 s, 0.0 kB/s 2023-10-14T19:05:14.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.453 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0502e-05 s, 0.0 kB/s 2023-10-14T19:05:14.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.509 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.564 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.564 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.564 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9908e-05 s, 0.0 kB/s 2023-10-14T19:05:14.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.565 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.620 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4267e-05 s, 0.0 kB/s 2023-10-14T19:05:14.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.622 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4729e-05 s, 0.0 kB/s 2023-10-14T19:05:14.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.677 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.732 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2283e-05 s, 0.0 kB/s 2023-10-14T19:05:14.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.733 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9856e-05 s, 0.0 kB/s 2023-10-14T19:05:14.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.789 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.844 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.844 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.845 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.7897e-05 s, 0.0 kB/s 2023-10-14T19:05:14.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.845 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.900 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.900 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.900 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.935e-05 s, 0.0 kB/s 2023-10-14T19:05:14.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.901 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:14.955 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:14.955 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:14.955 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0333e-05 s, 0.0 kB/s 2023-10-14T19:05:14.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:14.956 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.010 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0595e-05 s, 0.0 kB/s 2023-10-14T19:05:15.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.012 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.067 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.067 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.067 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2477e-05 s, 0.0 kB/s 2023-10-14T19:05:15.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.068 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3108e-05 s, 0.0 kB/s 2023-10-14T19:05:15.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.123 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-14T19:05:15.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.180 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.808e-05 s, 0.0 kB/s 2023-10-14T19:05:15.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.237 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.291 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.292 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9989e-05 s, 0.0 kB/s 2023-10-14T19:05:15.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.294 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.852e-05 s, 0.0 kB/s 2023-10-14T19:05:15.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.350 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.406 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.406 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-14T19:05:15.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.409 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.462 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0327e-05 s, 0.0 kB/s 2023-10-14T19:05:15.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.463 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.517 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2195e-05 s, 0.0 kB/s 2023-10-14T19:05:15.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.518 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.573 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.573 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9237e-05 s, 0.0 kB/s 2023-10-14T19:05:15.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.574 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.630 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9673e-05 s, 0.0 kB/s 2023-10-14T19:05:15.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.630 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.685 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0778e-05 s, 0.0 kB/s 2023-10-14T19:05:15.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.687 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.741 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.741 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.742 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1698e-05 s, 0.0 kB/s 2023-10-14T19:05:15.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.742 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.036e-05 s, 0.0 kB/s 2023-10-14T19:05:15.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.799 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9794e-05 s, 0.0 kB/s 2023-10-14T19:05:15.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.854 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9623e-05 s, 0.0 kB/s 2023-10-14T19:05:15.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.911 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-14T19:05:15.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:15.966 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.021 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1144e-05 s, 0.0 kB/s 2023-10-14T19:05:16.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.023 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.077 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9855e-05 s, 0.0 kB/s 2023-10-14T19:05:16.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.079 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.133 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.134 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1823e-05 s, 0.0 kB/s 2023-10-14T19:05:16.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.135 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2124e-05 s, 0.0 kB/s 2023-10-14T19:05:16.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.191 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.259e-05 s, 0.0 kB/s 2023-10-14T19:05:16.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.249 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9755e-05 s, 0.0 kB/s 2023-10-14T19:05:16.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.7986e-05 s, 0.0 kB/s 2023-10-14T19:05:16.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.360 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0543e-05 s, 0.0 kB/s 2023-10-14T19:05:16.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.417 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.471 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.471 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.471 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1113e-05 s, 0.0 kB/s 2023-10-14T19:05:16.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.472 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2104e-05 s, 0.0 kB/s 2023-10-14T19:05:16.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.529 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.583 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.584 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.584 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2161e-05 s, 0.0 kB/s 2023-10-14T19:05:16.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.585 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.639 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.639 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9884e-05 s, 0.0 kB/s 2023-10-14T19:05:16.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.643 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.699 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.699 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2814e-05 s, 0.0 kB/s 2023-10-14T19:05:16.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.700 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.755 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.755 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.28e-05 s, 0.0 kB/s 2023-10-14T19:05:16.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.756 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9867e-05 s, 0.0 kB/s 2023-10-14T19:05:16.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.813 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-14T19:05:16.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.869 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.924 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1115e-05 s, 0.0 kB/s 2023-10-14T19:05:16.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.924 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1407e-05 s, 0.0 kB/s 2023-10-14T19:05:16.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:16.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-14T19:05:17.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.038 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.093 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.094 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-14T19:05:17.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.095 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.150 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9371e-05 s, 0.0 kB/s 2023-10-14T19:05:17.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.467e-05 s, 0.0 kB/s 2023-10-14T19:05:17.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.207 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2918e-05 s, 0.0 kB/s 2023-10-14T19:05:17.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.264 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8463e-05 s, 0.0 kB/s 2023-10-14T19:05:17.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.320 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.375 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1026e-05 s, 0.0 kB/s 2023-10-14T19:05:17.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.375 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.431 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2548e-05 s, 0.0 kB/s 2023-10-14T19:05:17.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.432 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.487 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.487 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0865e-05 s, 0.0 kB/s 2023-10-14T19:05:17.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.488 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4124e-05 s, 0.0 kB/s 2023-10-14T19:05:17.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.543 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.659e-05 s, 0.0 kB/s 2023-10-14T19:05:17.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.600 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.655 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.036e-05 s, 0.0 kB/s 2023-10-14T19:05:17.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.656 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.710 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.711 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0361e-05 s, 0.0 kB/s 2023-10-14T19:05:17.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-14T19:05:17.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.823 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4861e-05 s, 0.0 kB/s 2023-10-14T19:05:17.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.823 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.879 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.879 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.879 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0223e-05 s, 0.0 kB/s 2023-10-14T19:05:17.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.880 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3241e-05 s, 0.0 kB/s 2023-10-14T19:05:17.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.938 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1569e-05 s, 0.0 kB/s 2023-10-14T19:05:17.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:17.995 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3465e-05 s, 0.0 kB/s 2023-10-14T19:05:18.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.051 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.105 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.105 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.105 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1559e-05 s, 0.0 kB/s 2023-10-14T19:05:18.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.106 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:18.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:18.160 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.161 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.161 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2947e-05 s, 0.0 kB/s 2023-10-14T19:05:18.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.162 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2945e-05 s, 0.0 kB/s 2023-10-14T19:05:18.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.252 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1689e-05 s, 0.0 kB/s 2023-10-14T19:05:18.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2394e-05 s, 0.0 kB/s 2023-10-14T19:05:18.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.055e-05 s, 0.0 kB/s 2023-10-14T19:05:18.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2331e-05 s, 0.0 kB/s 2023-10-14T19:05:18.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.475 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9571e-05 s, 0.0 kB/s 2023-10-14T19:05:18.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.531 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1153e-05 s, 0.0 kB/s 2023-10-14T19:05:18.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.588 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0304e-05 s, 0.0 kB/s 2023-10-14T19:05:18.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0182e-05 s, 0.0 kB/s 2023-10-14T19:05:18.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.701 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0654e-05 s, 0.0 kB/s 2023-10-14T19:05:18.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.757 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.813 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9598e-05 s, 0.0 kB/s 2023-10-14T19:05:18.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.813 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2623e-05 s, 0.0 kB/s 2023-10-14T19:05:18.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.870 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9729e-05 s, 0.0 kB/s 2023-10-14T19:05:18.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.926 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1477e-05 s, 0.0 kB/s 2023-10-14T19:05:18.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:18.982 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.037 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3452e-05 s, 0.0 kB/s 2023-10-14T19:05:19.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.038 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.044e-05 s, 0.0 kB/s 2023-10-14T19:05:19.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.150 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7921e-05 s, 0.0 kB/s 2023-10-14T19:05:19.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9759e-05 s, 0.0 kB/s 2023-10-14T19:05:19.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.207 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8225e-05 s, 0.0 kB/s 2023-10-14T19:05:19.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.394e-05 s, 0.0 kB/s 2023-10-14T19:05:19.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3217e-05 s, 0.0 kB/s 2023-10-14T19:05:19.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.375 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.430 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1956e-05 s, 0.0 kB/s 2023-10-14T19:05:19.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.431 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.486 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1183e-05 s, 0.0 kB/s 2023-10-14T19:05:19.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.489 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.541 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0357e-05 s, 0.0 kB/s 2023-10-14T19:05:19.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.543 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2153e-05 s, 0.0 kB/s 2023-10-14T19:05:19.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.599 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.343e-05 s, 0.0 kB/s 2023-10-14T19:05:19.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.656 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.712 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2084e-05 s, 0.0 kB/s 2023-10-14T19:05:19.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.309e-05 s, 0.0 kB/s 2023-10-14T19:05:19.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.769 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.824 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.824 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1628e-05 s, 0.0 kB/s 2023-10-14T19:05:19.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.825 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.879 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0393e-05 s, 0.0 kB/s 2023-10-14T19:05:19.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.881 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.935 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2059e-05 s, 0.0 kB/s 2023-10-14T19:05:19.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.937 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2436e-05 s, 0.0 kB/s 2023-10-14T19:05:19.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:19.993 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.34e-05 s, 0.0 kB/s 2023-10-14T19:05:20.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.049 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3208e-05 s, 0.0 kB/s 2023-10-14T19:05:20.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.105 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9686e-05 s, 0.0 kB/s 2023-10-14T19:05:20.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.161 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.216 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.216 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.167e-05 s, 0.0 kB/s 2023-10-14T19:05:20.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.217 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.272 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.272 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.168e-05 s, 0.0 kB/s 2023-10-14T19:05:20.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.273 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.328 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3912e-05 s, 0.0 kB/s 2023-10-14T19:05:20.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.385 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9361e-05 s, 0.0 kB/s 2023-10-14T19:05:20.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.386 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0458e-05 s, 0.0 kB/s 2023-10-14T19:05:20.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.441 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0663e-05 s, 0.0 kB/s 2023-10-14T19:05:20.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.497 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.553 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4127e-05 s, 0.0 kB/s 2023-10-14T19:05:20.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.554 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9749e-05 s, 0.0 kB/s 2023-10-14T19:05:20.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.610 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.666 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.666 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0939e-05 s, 0.0 kB/s 2023-10-14T19:05:20.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.667 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.723 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1436e-05 s, 0.0 kB/s 2023-10-14T19:05:20.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.723 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.779 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2715e-05 s, 0.0 kB/s 2023-10-14T19:05:20.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.780 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.835 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1002e-05 s, 0.0 kB/s 2023-10-14T19:05:20.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.835 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1359e-05 s, 0.0 kB/s 2023-10-14T19:05:20.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.892 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:20.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:20.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:20.948 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9745e-05 s, 0.0 kB/s 2023-10-14T19:05:20.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:20.949 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.005 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1116e-05 s, 0.0 kB/s 2023-10-14T19:05:21.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.006 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.059 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.060 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5258e-05 s, 0.0 kB/s 2023-10-14T19:05:21.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.061 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.116 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2004e-05 s, 0.0 kB/s 2023-10-14T19:05:21.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.116 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4e-05 s, 0.0 kB/s 2023-10-14T19:05:21.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.173 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1358e-05 s, 0.0 kB/s 2023-10-14T19:05:21.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.229 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.283 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2844e-05 s, 0.0 kB/s 2023-10-14T19:05:21.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.285 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1703e-05 s, 0.0 kB/s 2023-10-14T19:05:21.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.341 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.394 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1626e-05 s, 0.0 kB/s 2023-10-14T19:05:21.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.397 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2447e-05 s, 0.0 kB/s 2023-10-14T19:05:21.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.453 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.508 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.508 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.509 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.89e-05 s, 0.0 kB/s 2023-10-14T19:05:21.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.510 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.565 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0753e-05 s, 0.0 kB/s 2023-10-14T19:05:21.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.565 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1991e-05 s, 0.0 kB/s 2023-10-14T19:05:21.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.622 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.677 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3906e-05 s, 0.0 kB/s 2023-10-14T19:05:21.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.677 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.732 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2625e-05 s, 0.0 kB/s 2023-10-14T19:05:21.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.733 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.788 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0112e-05 s, 0.0 kB/s 2023-10-14T19:05:21.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.789 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.843 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4067e-05 s, 0.0 kB/s 2023-10-14T19:05:21.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.845 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.899 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.899 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.899 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1653e-05 s, 0.0 kB/s 2023-10-14T19:05:21.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.900 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:21.956 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:21.956 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.467e-05 s, 0.0 kB/s 2023-10-14T19:05:21.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:21.957 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2514e-05 s, 0.0 kB/s 2023-10-14T19:05:22.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.014 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3389e-05 s, 0.0 kB/s 2023-10-14T19:05:22.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.070 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.124 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.124 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.124 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1836e-05 s, 0.0 kB/s 2023-10-14T19:05:22.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.125 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.180 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.181 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.181 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3152e-05 s, 0.0 kB/s 2023-10-14T19:05:22.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.182 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.236 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2746e-05 s, 0.0 kB/s 2023-10-14T19:05:22.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.237 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1519e-05 s, 0.0 kB/s 2023-10-14T19:05:22.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.293 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.347 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4047e-05 s, 0.0 kB/s 2023-10-14T19:05:22.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.348 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.406 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5349e-05 s, 0.0 kB/s 2023-10-14T19:05:22.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.406 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9986e-05 s, 0.0 kB/s 2023-10-14T19:05:22.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.463 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.112e-05 s, 0.0 kB/s 2023-10-14T19:05:22.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.519 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.573 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.574 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.071e-05 s, 0.0 kB/s 2023-10-14T19:05:22.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.575 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9495e-05 s, 0.0 kB/s 2023-10-14T19:05:22.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.630 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1051e-05 s, 0.0 kB/s 2023-10-14T19:05:22.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.687 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.743 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3035e-05 s, 0.0 kB/s 2023-10-14T19:05:22.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.744 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.797 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.797 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.797 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-14T19:05:22.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.798 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8422e-05 s, 0.0 kB/s 2023-10-14T19:05:22.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.855 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.911 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.911 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.911 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.334e-05 s, 0.0 kB/s 2023-10-14T19:05:22.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.912 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:22.966 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:22.966 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.974e-05 s, 0.0 kB/s 2023-10-14T19:05:22.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:22.967 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.022 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1828e-05 s, 0.0 kB/s 2023-10-14T19:05:23.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.024 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1228e-05 s, 0.0 kB/s 2023-10-14T19:05:23.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.080 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1101e-05 s, 0.0 kB/s 2023-10-14T19:05:23.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.136 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.191 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1531e-05 s, 0.0 kB/s 2023-10-14T19:05:23.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.192 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.246 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.247 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.247 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2409e-05 s, 0.0 kB/s 2023-10-14T19:05:23.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.248 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0226e-05 s, 0.0 kB/s 2023-10-14T19:05:23.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.303 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1622e-05 s, 0.0 kB/s 2023-10-14T19:05:23.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.359 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9617e-05 s, 0.0 kB/s 2023-10-14T19:05:23.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.416 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4692e-05 s, 0.0 kB/s 2023-10-14T19:05:23.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.471 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.526 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.526 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.527 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9948e-05 s, 0.0 kB/s 2023-10-14T19:05:23.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.527 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.582 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.582 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.583 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3269e-05 s, 0.0 kB/s 2023-10-14T19:05:23.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.583 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.639 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0132e-05 s, 0.0 kB/s 2023-10-14T19:05:23.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.639 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0358e-05 s, 0.0 kB/s 2023-10-14T19:05:23.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.696 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.750 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9579e-05 s, 0.0 kB/s 2023-10-14T19:05:23.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.751 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.806 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8991e-05 s, 0.0 kB/s 2023-10-14T19:05:23.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.807 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.861 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.861 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.861 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0565e-05 s, 0.0 kB/s 2023-10-14T19:05:23.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.862 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.917 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.918 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.918 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.117e-05 s, 0.0 kB/s 2023-10-14T19:05:23.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.919 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:23.973 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:23.974 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:23.974 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.4549e-05 s, 0.0 kB/s 2023-10-14T19:05:23.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:23.975 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4658e-05 s, 0.0 kB/s 2023-10-14T19:05:24.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.031 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2123e-05 s, 0.0 kB/s 2023-10-14T19:05:24.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.088 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9493e-05 s, 0.0 kB/s 2023-10-14T19:05:24.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.142 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5535e-05 s, 0.0 kB/s 2023-10-14T19:05:24.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.201 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.255 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.256 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.256 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1591e-05 s, 0.0 kB/s 2023-10-14T19:05:24.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.258 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.311 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.311 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.018e-05 s, 0.0 kB/s 2023-10-14T19:05:24.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.312 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9169e-05 s, 0.0 kB/s 2023-10-14T19:05:24.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.369 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0758e-05 s, 0.0 kB/s 2023-10-14T19:05:24.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.426 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1359e-05 s, 0.0 kB/s 2023-10-14T19:05:24.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.481 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.536 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.536 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0906e-05 s, 0.0 kB/s 2023-10-14T19:05:24.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.537 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.286e-05 s, 0.0 kB/s 2023-10-14T19:05:24.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.592 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.648 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2201e-05 s, 0.0 kB/s 2023-10-14T19:05:24.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.649 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9967e-05 s, 0.0 kB/s 2023-10-14T19:05:24.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.760 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.760 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9325e-05 s, 0.0 kB/s 2023-10-14T19:05:24.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.760 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2268e-05 s, 0.0 kB/s 2023-10-14T19:05:24.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.816 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.873 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-14T19:05:24.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.874 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.928 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1592e-05 s, 0.0 kB/s 2023-10-14T19:05:24.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.930 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.222e-05 s, 0.0 kB/s 2023-10-14T19:05:24.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:24.987 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0311e-05 s, 0.0 kB/s 2023-10-14T19:05:25.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.042 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.097 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2184e-05 s, 0.0 kB/s 2023-10-14T19:05:25.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.098 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9882e-05 s, 0.0 kB/s 2023-10-14T19:05:25.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.155 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.210 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.210 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8305e-05 s, 0.0 kB/s 2023-10-14T19:05:25.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.211 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1655e-05 s, 0.0 kB/s 2023-10-14T19:05:25.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.267 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.322 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0064e-05 s, 0.0 kB/s 2023-10-14T19:05:25.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.322 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0853e-05 s, 0.0 kB/s 2023-10-14T19:05:25.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.378 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.433 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1812e-05 s, 0.0 kB/s 2023-10-14T19:05:25.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.433 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9884e-05 s, 0.0 kB/s 2023-10-14T19:05:25.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.490 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0498e-05 s, 0.0 kB/s 2023-10-14T19:05:25.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.545 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0405e-05 s, 0.0 kB/s 2023-10-14T19:05:25.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.602 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.656 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.657 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.657 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0293e-05 s, 0.0 kB/s 2023-10-14T19:05:25.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.658 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.722 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1455e-05 s, 0.0 kB/s 2023-10-14T19:05:25.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.722 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3879e-05 s, 0.0 kB/s 2023-10-14T19:05:25.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.779 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.834 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9787e-05 s, 0.0 kB/s 2023-10-14T19:05:25.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.834 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2553e-05 s, 0.0 kB/s 2023-10-14T19:05:25.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.890 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2564e-05 s, 0.0 kB/s 2023-10-14T19:05:25.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:25.946 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8537e-05 s, 0.0 kB/s 2023-10-14T19:05:26.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.002 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.056 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.057 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.057 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1324e-05 s, 0.0 kB/s 2023-10-14T19:05:26.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.058 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.112 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0155e-05 s, 0.0 kB/s 2023-10-14T19:05:26.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.114 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.168 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.168 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-14T19:05:26.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.169 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.225 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.225 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.225 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.254e-05 s, 0.0 kB/s 2023-10-14T19:05:26.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.226 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.280 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0877e-05 s, 0.0 kB/s 2023-10-14T19:05:26.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.282 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.336 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.337 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.337 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0669e-05 s, 0.0 kB/s 2023-10-14T19:05:26.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.339 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0684e-05 s, 0.0 kB/s 2023-10-14T19:05:26.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.394 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.448 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.449 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.449 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-14T19:05:26.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.450 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3159e-05 s, 0.0 kB/s 2023-10-14T19:05:26.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.506 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.561 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.561 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.561 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0619e-05 s, 0.0 kB/s 2023-10-14T19:05:26.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.562 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.074e-05 s, 0.0 kB/s 2023-10-14T19:05:26.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.618 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9565e-05 s, 0.0 kB/s 2023-10-14T19:05:26.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.674 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.729 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.729 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0241e-05 s, 0.0 kB/s 2023-10-14T19:05:26.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.730 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.785 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0368e-05 s, 0.0 kB/s 2023-10-14T19:05:26.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.785 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.841 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1035e-05 s, 0.0 kB/s 2023-10-14T19:05:26.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.842 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.897 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4084e-05 s, 0.0 kB/s 2023-10-14T19:05:26.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0032e-05 s, 0.0 kB/s 2023-10-14T19:05:26.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:26.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.009 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1645e-05 s, 0.0 kB/s 2023-10-14T19:05:27.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.064 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.846e-05 s, 0.0 kB/s 2023-10-14T19:05:27.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.120 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.120 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2584e-05 s, 0.0 kB/s 2023-10-14T19:05:27.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.121 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.177 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8711e-05 s, 0.0 kB/s 2023-10-14T19:05:27.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.177 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 6.5239e-05 s, 0.0 kB/s 2023-10-14T19:05:27.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.234 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.288 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1413e-05 s, 0.0 kB/s 2023-10-14T19:05:27.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.289 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.344 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.345 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.345 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2987e-05 s, 0.0 kB/s 2023-10-14T19:05:27.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.346 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.400 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0924e-05 s, 0.0 kB/s 2023-10-14T19:05:27.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.401 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9979e-05 s, 0.0 kB/s 2023-10-14T19:05:27.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.456 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.512 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.512 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.001e-05 s, 0.0 kB/s 2023-10-14T19:05:27.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.513 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.568 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8835e-05 s, 0.0 kB/s 2023-10-14T19:05:27.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.623 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0313e-05 s, 0.0 kB/s 2023-10-14T19:05:27.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.624 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.680 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0503e-05 s, 0.0 kB/s 2023-10-14T19:05:27.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.682 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.736 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9586e-05 s, 0.0 kB/s 2023-10-14T19:05:27.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.738 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.793 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.793 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-14T19:05:27.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.794 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.848 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.849 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.849 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1706e-05 s, 0.0 kB/s 2023-10-14T19:05:27.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.850 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.2587e-05 s, 0.0 kB/s 2023-10-14T19:05:27.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.906 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1412e-05 s, 0.0 kB/s 2023-10-14T19:05:27.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:27.963 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1553e-05 s, 0.0 kB/s 2023-10-14T19:05:28.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.019 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1225e-05 s, 0.0 kB/s 2023-10-14T19:05:28.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.075 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.130 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.131 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2325e-05 s, 0.0 kB/s 2023-10-14T19:05:28.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.132 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.187 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-14T19:05:28.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.242 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.243 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1952e-05 s, 0.0 kB/s 2023-10-14T19:05:28.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.244 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.299 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2442e-05 s, 0.0 kB/s 2023-10-14T19:05:28.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.299 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1324e-05 s, 0.0 kB/s 2023-10-14T19:05:28.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.355 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.948e-05 s, 0.0 kB/s 2023-10-14T19:05:28.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.466 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0232e-05 s, 0.0 kB/s 2023-10-14T19:05:28.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.522 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2096e-05 s, 0.0 kB/s 2023-10-14T19:05:28.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.523 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0185e-05 s, 0.0 kB/s 2023-10-14T19:05:28.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.578 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0038e-05 s, 0.0 kB/s 2023-10-14T19:05:28.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.634 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.689 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2583e-05 s, 0.0 kB/s 2023-10-14T19:05:28.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.690 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2779e-05 s, 0.0 kB/s 2023-10-14T19:05:28.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.746 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.801 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.117e-05 s, 0.0 kB/s 2023-10-14T19:05:28.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.858 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1863e-05 s, 0.0 kB/s 2023-10-14T19:05:28.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2424e-05 s, 0.0 kB/s 2023-10-14T19:05:28.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3273e-05 s, 0.0 kB/s 2023-10-14T19:05:28.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:28.971 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3801e-05 s, 0.0 kB/s 2023-10-14T19:05:29.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.027 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3515e-05 s, 0.0 kB/s 2023-10-14T19:05:29.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0838e-05 s, 0.0 kB/s 2023-10-14T19:05:29.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.194 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9427e-05 s, 0.0 kB/s 2023-10-14T19:05:29.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1554e-05 s, 0.0 kB/s 2023-10-14T19:05:29.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1454e-05 s, 0.0 kB/s 2023-10-14T19:05:29.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.363 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.261e-05 s, 0.0 kB/s 2023-10-14T19:05:29.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.364 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0603e-05 s, 0.0 kB/s 2023-10-14T19:05:29.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.420 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.076e-05 s, 0.0 kB/s 2023-10-14T19:05:29.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.476 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.532 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0977e-05 s, 0.0 kB/s 2023-10-14T19:05:29.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.533 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.588 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.588 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.588 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3284e-05 s, 0.0 kB/s 2023-10-14T19:05:29.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.589 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0307e-05 s, 0.0 kB/s 2023-10-14T19:05:29.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.645 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.699 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0116e-05 s, 0.0 kB/s 2023-10-14T19:05:29.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.701 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.755 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.756 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0865e-05 s, 0.0 kB/s 2023-10-14T19:05:29.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.757 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.812 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-14T19:05:29.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.812 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3655e-05 s, 0.0 kB/s 2023-10-14T19:05:29.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.869 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3461e-05 s, 0.0 kB/s 2023-10-14T19:05:29.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.924 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:29.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4573e-05 s, 0.0 kB/s 2023-10-14T19:05:29.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:29.981 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3324e-05 s, 0.0 kB/s 2023-10-14T19:05:30.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.197e-05 s, 0.0 kB/s 2023-10-14T19:05:30.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0212e-05 s, 0.0 kB/s 2023-10-14T19:05:30.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.150 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2302e-05 s, 0.0 kB/s 2023-10-14T19:05:30.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.206 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1999e-05 s, 0.0 kB/s 2023-10-14T19:05:30.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.317 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1278e-05 s, 0.0 kB/s 2023-10-14T19:05:30.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.318 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.373 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1264e-05 s, 0.0 kB/s 2023-10-14T19:05:30.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.429 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1684e-05 s, 0.0 kB/s 2023-10-14T19:05:30.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.430 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0617e-05 s, 0.0 kB/s 2023-10-14T19:05:30.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.486 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.541 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5199e-05 s, 0.0 kB/s 2023-10-14T19:05:30.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.542 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.597 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.597 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.597 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1482e-05 s, 0.0 kB/s 2023-10-14T19:05:30.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.598 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0492e-05 s, 0.0 kB/s 2023-10-14T19:05:30.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.653 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.709 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.709 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.8465e-05 s, 0.0 kB/s 2023-10-14T19:05:30.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.710 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.764 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.765 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.765 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1917e-05 s, 0.0 kB/s 2023-10-14T19:05:30.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.766 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.821 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1431e-05 s, 0.0 kB/s 2023-10-14T19:05:30.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.822 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.877 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0319e-05 s, 0.0 kB/s 2023-10-14T19:05:30.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.877 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0042e-05 s, 0.0 kB/s 2023-10-14T19:05:30.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.933 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.138e-05 s, 0.0 kB/s 2023-10-14T19:05:30.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:30.990 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-14T19:05:31.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.046 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.101 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5691e-05 s, 0.0 kB/s 2023-10-14T19:05:31.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.102 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.158 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0656e-05 s, 0.0 kB/s 2023-10-14T19:05:31.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.159 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.213 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-14T19:05:31.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.215 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.269 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.270 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-14T19:05:31.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.271 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.325 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.326 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.326 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0468e-05 s, 0.0 kB/s 2023-10-14T19:05:31.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.327 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.382 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.275e-05 s, 0.0 kB/s 2023-10-14T19:05:31.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.382 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-14T19:05:31.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9559e-05 s, 0.0 kB/s 2023-10-14T19:05:31.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.494 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.550 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.550 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3114e-05 s, 0.0 kB/s 2023-10-14T19:05:31.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.551 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9604e-05 s, 0.0 kB/s 2023-10-14T19:05:31.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.607 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.023e-05 s, 0.0 kB/s 2023-10-14T19:05:31.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.662 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.717 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.717 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.717 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9697e-05 s, 0.0 kB/s 2023-10-14T19:05:31.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.718 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.774 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-14T19:05:31.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.775 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0699e-05 s, 0.0 kB/s 2023-10-14T19:05:31.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.831 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2601e-05 s, 0.0 kB/s 2023-10-14T19:05:31.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.887 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.942 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2757e-05 s, 0.0 kB/s 2023-10-14T19:05:31.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1192e-05 s, 0.0 kB/s 2023-10-14T19:05:31.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:31.999 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.054 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0316e-05 s, 0.0 kB/s 2023-10-14T19:05:32.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-14T19:05:32.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.110 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.215e-05 s, 0.0 kB/s 2023-10-14T19:05:32.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.166 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1769e-05 s, 0.0 kB/s 2023-10-14T19:05:32.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.223 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8807e-05 s, 0.0 kB/s 2023-10-14T19:05:32.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.333 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8072e-05 s, 0.0 kB/s 2023-10-14T19:05:32.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.334 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9596e-05 s, 0.0 kB/s 2023-10-14T19:05:32.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.391 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.445 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.445 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.446 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9752e-05 s, 0.0 kB/s 2023-10-14T19:05:32.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.447 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1672e-05 s, 0.0 kB/s 2023-10-14T19:05:32.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.557 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1774e-05 s, 0.0 kB/s 2023-10-14T19:05:32.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.559 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0236e-05 s, 0.0 kB/s 2023-10-14T19:05:32.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.670 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2123e-05 s, 0.0 kB/s 2023-10-14T19:05:32.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.672 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.212e-05 s, 0.0 kB/s 2023-10-14T19:05:32.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.727 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2094e-05 s, 0.0 kB/s 2023-10-14T19:05:32.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.784 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.838 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.839 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0899e-05 s, 0.0 kB/s 2023-10-14T19:05:32.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.840 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5426e-05 s, 0.0 kB/s 2023-10-14T19:05:32.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:32.954 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2034e-05 s, 0.0 kB/s 2023-10-14T19:05:32.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:32.956 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.010 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2236e-05 s, 0.0 kB/s 2023-10-14T19:05:33.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.6605e-05 s, 0.0 kB/s 2023-10-14T19:05:33.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.067 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3788e-05 s, 0.0 kB/s 2023-10-14T19:05:33.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.123 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.178 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.178 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.178 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2557e-05 s, 0.0 kB/s 2023-10-14T19:05:33.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.179 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0236e-05 s, 0.0 kB/s 2023-10-14T19:05:33.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.236 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.291 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.292 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1127e-05 s, 0.0 kB/s 2023-10-14T19:05:33.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.293 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1313e-05 s, 0.0 kB/s 2023-10-14T19:05:33.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.348 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.404 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-14T19:05:33.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.405 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.460 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2011e-05 s, 0.0 kB/s 2023-10-14T19:05:33.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.461 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.515 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.515 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.515 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9332e-05 s, 0.0 kB/s 2023-10-14T19:05:33.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.516 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.571 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.571 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1818e-05 s, 0.0 kB/s 2023-10-14T19:05:33.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.572 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.627 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.628 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.628 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0341e-05 s, 0.0 kB/s 2023-10-14T19:05:33.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.629 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8339e-05 s, 0.0 kB/s 2023-10-14T19:05:33.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.685 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.739 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1787e-05 s, 0.0 kB/s 2023-10-14T19:05:33.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.741 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.796 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.796 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3213e-05 s, 0.0 kB/s 2023-10-14T19:05:33.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1307e-05 s, 0.0 kB/s 2023-10-14T19:05:33.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.852 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.908 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2131e-05 s, 0.0 kB/s 2023-10-14T19:05:33.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:33.963 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1994e-05 s, 0.0 kB/s 2023-10-14T19:05:33.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:33.965 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.019 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.019 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.019 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-14T19:05:34.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.020 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.076 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1317e-05 s, 0.0 kB/s 2023-10-14T19:05:34.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.077 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.132 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2733e-05 s, 0.0 kB/s 2023-10-14T19:05:34.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.132 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.187 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.188 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.188 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3661e-05 s, 0.0 kB/s 2023-10-14T19:05:34.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.189 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.244 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9752e-05 s, 0.0 kB/s 2023-10-14T19:05:34.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.244 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.301 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.302 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3548e-05 s, 0.0 kB/s 2023-10-14T19:05:34.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.303 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-14T19:05:34.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.359 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.413 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.414 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.414 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3569e-05 s, 0.0 kB/s 2023-10-14T19:05:34.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.416 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.348e-05 s, 0.0 kB/s 2023-10-14T19:05:34.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.470 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.3357e-05 s, 0.0 kB/s 2023-10-14T19:05:34.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.528 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2278e-05 s, 0.0 kB/s 2023-10-14T19:05:34.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.585 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1893e-05 s, 0.0 kB/s 2023-10-14T19:05:34.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.640 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.695 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3168e-05 s, 0.0 kB/s 2023-10-14T19:05:34.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.697 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3879e-05 s, 0.0 kB/s 2023-10-14T19:05:34.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.753 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.808 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.154e-05 s, 0.0 kB/s 2023-10-14T19:05:34.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.809 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.317e-05 s, 0.0 kB/s 2023-10-14T19:05:34.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.865 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.920 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2043e-05 s, 0.0 kB/s 2023-10-14T19:05:34.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.920 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9525e-05 s, 0.0 kB/s 2023-10-14T19:05:34.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:34.976 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0388e-05 s, 0.0 kB/s 2023-10-14T19:05:35.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.032 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2502e-05 s, 0.0 kB/s 2023-10-14T19:05:35.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.090 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2723e-05 s, 0.0 kB/s 2023-10-14T19:05:35.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.145 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.201 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0284e-05 s, 0.0 kB/s 2023-10-14T19:05:35.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.201 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-14T19:05:35.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.257 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1563e-05 s, 0.0 kB/s 2023-10-14T19:05:35.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.313 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.367 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.367 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.367 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-14T19:05:35.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.368 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.423 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.423 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2165e-05 s, 0.0 kB/s 2023-10-14T19:05:35.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.424 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9969e-05 s, 0.0 kB/s 2023-10-14T19:05:35.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.480 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.536 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2128e-05 s, 0.0 kB/s 2023-10-14T19:05:35.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.592 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3471e-05 s, 0.0 kB/s 2023-10-14T19:05:35.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.593 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2354e-05 s, 0.0 kB/s 2023-10-14T19:05:35.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.648 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.704 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2444e-05 s, 0.0 kB/s 2023-10-14T19:05:35.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.705 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0332e-05 s, 0.0 kB/s 2023-10-14T19:05:35.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.761 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.816 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2774e-05 s, 0.0 kB/s 2023-10-14T19:05:35.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.817 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2208e-05 s, 0.0 kB/s 2023-10-14T19:05:35.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.873 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.927 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.927 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.928 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1915e-05 s, 0.0 kB/s 2023-10-14T19:05:35.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.928 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0029e-05 s, 0.0 kB/s 2023-10-14T19:05:35.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:35.984 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0904e-05 s, 0.0 kB/s 2023-10-14T19:05:36.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.041 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0115e-05 s, 0.0 kB/s 2023-10-14T19:05:36.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.097 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.152 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.152 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.153 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9718e-05 s, 0.0 kB/s 2023-10-14T19:05:36.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.153 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.208 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3699e-05 s, 0.0 kB/s 2023-10-14T19:05:36.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.210 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.265 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2224e-05 s, 0.0 kB/s 2023-10-14T19:05:36.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.265 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.322 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.322 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.297e-05 s, 0.0 kB/s 2023-10-14T19:05:36.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.323 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3063e-05 s, 0.0 kB/s 2023-10-14T19:05:36.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.379 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.282e-05 s, 0.0 kB/s 2023-10-14T19:05:36.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.435 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3738e-05 s, 0.0 kB/s 2023-10-14T19:05:36.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.492 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3689e-05 s, 0.0 kB/s 2023-10-14T19:05:36.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.548 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.603 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.141e-05 s, 0.0 kB/s 2023-10-14T19:05:36.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.604 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.659 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.659 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1795e-05 s, 0.0 kB/s 2023-10-14T19:05:36.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.660 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3653e-05 s, 0.0 kB/s 2023-10-14T19:05:36.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.716 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2069e-05 s, 0.0 kB/s 2023-10-14T19:05:36.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.772 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.828 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1763e-05 s, 0.0 kB/s 2023-10-14T19:05:36.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.829 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.884 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.276e-05 s, 0.0 kB/s 2023-10-14T19:05:36.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1811e-05 s, 0.0 kB/s 2023-10-14T19:05:36.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2585e-05 s, 0.0 kB/s 2023-10-14T19:05:36.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:36.998 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.052 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3533e-05 s, 0.0 kB/s 2023-10-14T19:05:37.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.054 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.109 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2048e-05 s, 0.0 kB/s 2023-10-14T19:05:37.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.110 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.195e-05 s, 0.0 kB/s 2023-10-14T19:05:37.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.167 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2373e-05 s, 0.0 kB/s 2023-10-14T19:05:37.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.223 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.279 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1256e-05 s, 0.0 kB/s 2023-10-14T19:05:37.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4516e-05 s, 0.0 kB/s 2023-10-14T19:05:37.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.336 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0529e-05 s, 0.0 kB/s 2023-10-14T19:05:37.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.391 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.447 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.122e-05 s, 0.0 kB/s 2023-10-14T19:05:37.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.448 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0855e-05 s, 0.0 kB/s 2023-10-14T19:05:37.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.559 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2797e-05 s, 0.0 kB/s 2023-10-14T19:05:37.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2309e-05 s, 0.0 kB/s 2023-10-14T19:05:37.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.670 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-14T19:05:37.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.672 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1689e-05 s, 0.0 kB/s 2023-10-14T19:05:37.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.728 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.783 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1786e-05 s, 0.0 kB/s 2023-10-14T19:05:37.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.784 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4145e-05 s, 0.0 kB/s 2023-10-14T19:05:37.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.840 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3091e-05 s, 0.0 kB/s 2023-10-14T19:05:37.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.896 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:37.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:37.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:37.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9099e-05 s, 0.0 kB/s 2023-10-14T19:05:37.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:37.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.93e-05 s, 0.0 kB/s 2023-10-14T19:05:38.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.011 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0403e-05 s, 0.0 kB/s 2023-10-14T19:05:38.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.067 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.122 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.059e-05 s, 0.0 kB/s 2023-10-14T19:05:38.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.123 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.177 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.178 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.178 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-14T19:05:38.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.179 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2982e-05 s, 0.0 kB/s 2023-10-14T19:05:38.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.235 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.289 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-14T19:05:38.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.290 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.345 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.346 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.346 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0702e-05 s, 0.0 kB/s 2023-10-14T19:05:38.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.347 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1997e-05 s, 0.0 kB/s 2023-10-14T19:05:38.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.402 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1927e-05 s, 0.0 kB/s 2023-10-14T19:05:38.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.458 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0851e-05 s, 0.0 kB/s 2023-10-14T19:05:38.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.515 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1853e-05 s, 0.0 kB/s 2023-10-14T19:05:38.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.572 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1939e-05 s, 0.0 kB/s 2023-10-14T19:05:38.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.630 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2345e-05 s, 0.0 kB/s 2023-10-14T19:05:38.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.685 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.741 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.741 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4329e-05 s, 0.0 kB/s 2023-10-14T19:05:38.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.742 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-14T19:05:38.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.852 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.853 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3462e-05 s, 0.0 kB/s 2023-10-14T19:05:38.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.854 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3363e-05 s, 0.0 kB/s 2023-10-14T19:05:38.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.910 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:38.964 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:38.965 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:38.965 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3631e-05 s, 0.0 kB/s 2023-10-14T19:05:38.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:38.967 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0589e-05 s, 0.0 kB/s 2023-10-14T19:05:39.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.022 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.033e-05 s, 0.0 kB/s 2023-10-14T19:05:39.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.078 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0704e-05 s, 0.0 kB/s 2023-10-14T19:05:39.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.133 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.190 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2713e-05 s, 0.0 kB/s 2023-10-14T19:05:39.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.191 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.403e-05 s, 0.0 kB/s 2023-10-14T19:05:39.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.246 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.301 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.301 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.301 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9613e-05 s, 0.0 kB/s 2023-10-14T19:05:39.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.302 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.294e-05 s, 0.0 kB/s 2023-10-14T19:05:39.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.359 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.413 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.413 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.414 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2922e-05 s, 0.0 kB/s 2023-10-14T19:05:39.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.414 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0488e-05 s, 0.0 kB/s 2023-10-14T19:05:39.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.470 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.526 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.526 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.434e-05 s, 0.0 kB/s 2023-10-14T19:05:39.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.527 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2059e-05 s, 0.0 kB/s 2023-10-14T19:05:39.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.583 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.637 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.638 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3953e-05 s, 0.0 kB/s 2023-10-14T19:05:39.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.639 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9331e-05 s, 0.0 kB/s 2023-10-14T19:05:39.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.694 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8535e-05 s, 0.0 kB/s 2023-10-14T19:05:39.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.752 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.807 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.807 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2125e-05 s, 0.0 kB/s 2023-10-14T19:05:39.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.809 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.863 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3783e-05 s, 0.0 kB/s 2023-10-14T19:05:39.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.864 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9496e-05 s, 0.0 kB/s 2023-10-14T19:05:39.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.920 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:39.974 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:39.974 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:39.975 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-14T19:05:39.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:39.976 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.030 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.031 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.031 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1948e-05 s, 0.0 kB/s 2023-10-14T19:05:40.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.032 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.087 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.087 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.087 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1008e-05 s, 0.0 kB/s 2023-10-14T19:05:40.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.088 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4889e-05 s, 0.0 kB/s 2023-10-14T19:05:40.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.145 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0454e-05 s, 0.0 kB/s 2023-10-14T19:05:40.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.201 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.256 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1281e-05 s, 0.0 kB/s 2023-10-14T19:05:40.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.257 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.311 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2455e-05 s, 0.0 kB/s 2023-10-14T19:05:40.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.313 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-14T19:05:40.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.369 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.423 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.424 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.424 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0898e-05 s, 0.0 kB/s 2023-10-14T19:05:40.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.425 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.480 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.480 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9752e-05 s, 0.0 kB/s 2023-10-14T19:05:40.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.481 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2248e-05 s, 0.0 kB/s 2023-10-14T19:05:40.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.537 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3934e-05 s, 0.0 kB/s 2023-10-14T19:05:40.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.593 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-14T19:05:40.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.649 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.002e-05 s, 0.0 kB/s 2023-10-14T19:05:40.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.704 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.760 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.760 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.760 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1718e-05 s, 0.0 kB/s 2023-10-14T19:05:40.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.761 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1438e-05 s, 0.0 kB/s 2023-10-14T19:05:40.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.818 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3553e-05 s, 0.0 kB/s 2023-10-14T19:05:40.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.874 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.928 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1632e-05 s, 0.0 kB/s 2023-10-14T19:05:40.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.930 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3653e-05 s, 0.0 kB/s 2023-10-14T19:05:40.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:40.985 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1506e-05 s, 0.0 kB/s 2023-10-14T19:05:41.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.041 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.097 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0443e-05 s, 0.0 kB/s 2023-10-14T19:05:41.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.098 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.152 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.152 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0883e-05 s, 0.0 kB/s 2023-10-14T19:05:41.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.153 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.208 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.208 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.209 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1755e-05 s, 0.0 kB/s 2023-10-14T19:05:41.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.209 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.266 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.266 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2299e-05 s, 0.0 kB/s 2023-10-14T19:05:41.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.267 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0225e-05 s, 0.0 kB/s 2023-10-14T19:05:41.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.322 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.379 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.983e-05 s, 0.0 kB/s 2023-10-14T19:05:41.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.379 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.433 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.433 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.434 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2392e-05 s, 0.0 kB/s 2023-10-14T19:05:41.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.435 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.490 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.490 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.490 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2521e-05 s, 0.0 kB/s 2023-10-14T19:05:41.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.491 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0163e-05 s, 0.0 kB/s 2023-10-14T19:05:41.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.547 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.602 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.602 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.602 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2051e-05 s, 0.0 kB/s 2023-10-14T19:05:41.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.603 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.945e-05 s, 0.0 kB/s 2023-10-14T19:05:41.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.659 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-14T19:05:41.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.716 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.771 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.772 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3935e-05 s, 0.0 kB/s 2023-10-14T19:05:41.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4448e-05 s, 0.0 kB/s 2023-10-14T19:05:41.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.829 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4542e-05 s, 0.0 kB/s 2023-10-14T19:05:41.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.940 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.87e-05 s, 0.0 kB/s 2023-10-14T19:05:41.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.941 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3441e-05 s, 0.0 kB/s 2023-10-14T19:05:41.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:41.997 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1998e-05 s, 0.0 kB/s 2023-10-14T19:05:42.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.053 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4212e-05 s, 0.0 kB/s 2023-10-14T19:05:42.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.109 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.164 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3457e-05 s, 0.0 kB/s 2023-10-14T19:05:42.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.164 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9726e-05 s, 0.0 kB/s 2023-10-14T19:05:42.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.220 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2882e-05 s, 0.0 kB/s 2023-10-14T19:05:42.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.276 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2488e-05 s, 0.0 kB/s 2023-10-14T19:05:42.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1329e-05 s, 0.0 kB/s 2023-10-14T19:05:42.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.389 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.444 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.444 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9976e-05 s, 0.0 kB/s 2023-10-14T19:05:42.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.445 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.501 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0795e-05 s, 0.0 kB/s 2023-10-14T19:05:42.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.502 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9706e-05 s, 0.0 kB/s 2023-10-14T19:05:42.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.559 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.613 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0801e-05 s, 0.0 kB/s 2023-10-14T19:05:42.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.615 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.670 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9276e-05 s, 0.0 kB/s 2023-10-14T19:05:42.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.670 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.725 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.725 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.725 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.922e-05 s, 0.0 kB/s 2023-10-14T19:05:42.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.726 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2009e-05 s, 0.0 kB/s 2023-10-14T19:05:42.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.783 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2136e-05 s, 0.0 kB/s 2023-10-14T19:05:42.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.839 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2052e-05 s, 0.0 kB/s 2023-10-14T19:05:42.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.895 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:42.950 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0949e-05 s, 0.0 kB/s 2023-10-14T19:05:42.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:42.952 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.006 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.006 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.007 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3114e-05 s, 0.0 kB/s 2023-10-14T19:05:43.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.007 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.063 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.063 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-14T19:05:43.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.064 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0532e-05 s, 0.0 kB/s 2023-10-14T19:05:43.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.120 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.175 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.175 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.175 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0999e-05 s, 0.0 kB/s 2023-10-14T19:05:43.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.176 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2777e-05 s, 0.0 kB/s 2023-10-14T19:05:43.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.287 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.288 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2069e-05 s, 0.0 kB/s 2023-10-14T19:05:43.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.289 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.343 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3822e-05 s, 0.0 kB/s 2023-10-14T19:05:43.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.345 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.400 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3431e-05 s, 0.0 kB/s 2023-10-14T19:05:43.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.401 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.456 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3913e-05 s, 0.0 kB/s 2023-10-14T19:05:43.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.456 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.512 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4757e-05 s, 0.0 kB/s 2023-10-14T19:05:43.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.514 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2684e-05 s, 0.0 kB/s 2023-10-14T19:05:43.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2041e-05 s, 0.0 kB/s 2023-10-14T19:05:43.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.625 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1545e-05 s, 0.0 kB/s 2023-10-14T19:05:43.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.681 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.736 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0821e-05 s, 0.0 kB/s 2023-10-14T19:05:43.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.737 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.792 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0812e-05 s, 0.0 kB/s 2023-10-14T19:05:43.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.793 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2666e-05 s, 0.0 kB/s 2023-10-14T19:05:43.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3599e-05 s, 0.0 kB/s 2023-10-14T19:05:43.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.904 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:43.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:43.960 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:43.960 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9401e-05 s, 0.0 kB/s 2023-10-14T19:05:43.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:43.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.015 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.016 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2239e-05 s, 0.0 kB/s 2023-10-14T19:05:44.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.017 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3014e-05 s, 0.0 kB/s 2023-10-14T19:05:44.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.073 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.128 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-14T19:05:44.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.130 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.184 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.185 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.185 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.7319e-05 s, 0.0 kB/s 2023-10-14T19:05:44.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.186 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.240 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.240 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.240 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9396e-05 s, 0.0 kB/s 2023-10-14T19:05:44.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.241 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.296 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.297 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.297 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0075e-05 s, 0.0 kB/s 2023-10-14T19:05:44.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.298 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.353 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2178e-05 s, 0.0 kB/s 2023-10-14T19:05:44.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.354 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8957e-05 s, 0.0 kB/s 2023-10-14T19:05:44.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.410 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3468e-05 s, 0.0 kB/s 2023-10-14T19:05:44.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.466 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.520 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.520 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.521 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9779e-05 s, 0.0 kB/s 2023-10-14T19:05:44.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.521 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1447e-05 s, 0.0 kB/s 2023-10-14T19:05:44.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.578 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8855e-05 s, 0.0 kB/s 2023-10-14T19:05:44.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.633 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1099e-05 s, 0.0 kB/s 2023-10-14T19:05:44.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.689 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0877e-05 s, 0.0 kB/s 2023-10-14T19:05:44.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.803 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1441e-05 s, 0.0 kB/s 2023-10-14T19:05:44.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.804 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.859 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-14T19:05:44.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.915 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.915 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9904e-05 s, 0.0 kB/s 2023-10-14T19:05:44.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.916 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:44.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:44.971 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:44.971 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5137e-05 s, 0.0 kB/s 2023-10-14T19:05:44.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:44.972 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.027 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1031e-05 s, 0.0 kB/s 2023-10-14T19:05:45.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.028 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.083 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.083 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3323e-05 s, 0.0 kB/s 2023-10-14T19:05:45.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.084 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9204e-05 s, 0.0 kB/s 2023-10-14T19:05:45.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.195 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-14T19:05:45.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.196 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.298e-05 s, 0.0 kB/s 2023-10-14T19:05:45.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.252 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0418e-05 s, 0.0 kB/s 2023-10-14T19:05:45.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1601e-05 s, 0.0 kB/s 2023-10-14T19:05:45.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1522e-05 s, 0.0 kB/s 2023-10-14T19:05:45.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.420 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.475 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2594e-05 s, 0.0 kB/s 2023-10-14T19:05:45.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.475 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.531 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2178e-05 s, 0.0 kB/s 2023-10-14T19:05:45.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.532 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.587 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0451e-05 s, 0.0 kB/s 2023-10-14T19:05:45.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.588 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2022e-05 s, 0.0 kB/s 2023-10-14T19:05:45.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.699 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0792e-05 s, 0.0 kB/s 2023-10-14T19:05:45.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.699 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.755 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2099e-05 s, 0.0 kB/s 2023-10-14T19:05:45.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.756 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0006e-05 s, 0.0 kB/s 2023-10-14T19:05:45.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.812 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2634e-05 s, 0.0 kB/s 2023-10-14T19:05:45.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.868 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3318e-05 s, 0.0 kB/s 2023-10-14T19:05:45.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.924 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0779e-05 s, 0.0 kB/s 2023-10-14T19:05:45.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:45.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.035 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2169e-05 s, 0.0 kB/s 2023-10-14T19:05:46.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.036 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2787e-05 s, 0.0 kB/s 2023-10-14T19:05:46.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.092 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3404e-05 s, 0.0 kB/s 2023-10-14T19:05:46.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.148 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.204 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0643e-05 s, 0.0 kB/s 2023-10-14T19:05:46.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.260 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1519e-05 s, 0.0 kB/s 2023-10-14T19:05:46.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.260 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.315 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.315 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.316 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0381e-05 s, 0.0 kB/s 2023-10-14T19:05:46.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.316 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9974e-05 s, 0.0 kB/s 2023-10-14T19:05:46.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.372 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3263e-05 s, 0.0 kB/s 2023-10-14T19:05:46.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.429 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.483 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.484 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.484 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1873e-05 s, 0.0 kB/s 2023-10-14T19:05:46.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.485 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.540 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1576e-05 s, 0.0 kB/s 2023-10-14T19:05:46.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.540 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.595 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.595 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.595 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3035e-05 s, 0.0 kB/s 2023-10-14T19:05:46.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.596 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.651 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.651 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9625e-05 s, 0.0 kB/s 2023-10-14T19:05:46.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.652 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.707 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0236e-05 s, 0.0 kB/s 2023-10-14T19:05:46.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.707 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3274e-05 s, 0.0 kB/s 2023-10-14T19:05:46.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.764 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-14T19:05:46.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.820 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.875 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.875 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1583e-05 s, 0.0 kB/s 2023-10-14T19:05:46.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.876 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.930 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0607e-05 s, 0.0 kB/s 2023-10-14T19:05:46.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.932 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0765e-05 s, 0.0 kB/s 2023-10-14T19:05:46.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:46.988 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0864e-05 s, 0.0 kB/s 2023-10-14T19:05:47.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.044 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2823e-05 s, 0.0 kB/s 2023-10-14T19:05:47.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.100 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2102e-05 s, 0.0 kB/s 2023-10-14T19:05:47.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.155 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3604e-05 s, 0.0 kB/s 2023-10-14T19:05:47.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.212 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0518e-05 s, 0.0 kB/s 2023-10-14T19:05:47.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.269 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-14T19:05:47.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.324 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1343e-05 s, 0.0 kB/s 2023-10-14T19:05:47.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.381 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.437 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.437 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.437 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2908e-05 s, 0.0 kB/s 2023-10-14T19:05:47.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9769e-05 s, 0.0 kB/s 2023-10-14T19:05:47.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.493 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1181e-05 s, 0.0 kB/s 2023-10-14T19:05:47.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.550 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.605 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.605 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0406e-05 s, 0.0 kB/s 2023-10-14T19:05:47.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.606 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1363e-05 s, 0.0 kB/s 2023-10-14T19:05:47.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8543e-05 s, 0.0 kB/s 2023-10-14T19:05:47.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.718 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.773 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0864e-05 s, 0.0 kB/s 2023-10-14T19:05:47.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.829 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0132e-05 s, 0.0 kB/s 2023-10-14T19:05:47.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.830 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1813e-05 s, 0.0 kB/s 2023-10-14T19:05:47.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.886 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.941 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0718e-05 s, 0.0 kB/s 2023-10-14T19:05:47.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9958e-05 s, 0.0 kB/s 2023-10-14T19:05:47.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:47.997 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.052 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.053 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2471e-05 s, 0.0 kB/s 2023-10-14T19:05:48.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.054 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3735e-05 s, 0.0 kB/s 2023-10-14T19:05:48.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.110 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.164 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.164 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.165 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-14T19:05:48.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.165 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:48.209 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:48.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4023e-05 s, 0.0 kB/s 2023-10-14T19:05:48.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.225 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0602e-05 s, 0.0 kB/s 2023-10-14T19:05:48.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.347 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.272e-05 s, 0.0 kB/s 2023-10-14T19:05:48.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.349 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.402 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.403 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2027e-05 s, 0.0 kB/s 2023-10-14T19:05:48.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.403 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5261e-05 s, 0.0 kB/s 2023-10-14T19:05:48.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.460 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.514 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.515 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.515 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1843e-05 s, 0.0 kB/s 2023-10-14T19:05:48.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.516 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9767e-05 s, 0.0 kB/s 2023-10-14T19:05:48.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.571 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.627 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-14T19:05:48.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.627 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.683 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1299e-05 s, 0.0 kB/s 2023-10-14T19:05:48.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.683 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.738 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9388e-05 s, 0.0 kB/s 2023-10-14T19:05:48.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.739 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2817e-05 s, 0.0 kB/s 2023-10-14T19:05:48.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.796 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2964e-05 s, 0.0 kB/s 2023-10-14T19:05:48.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.852 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.906 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3051e-05 s, 0.0 kB/s 2023-10-14T19:05:48.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.907 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:48.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:48.963 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:48.963 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4656e-05 s, 0.0 kB/s 2023-10-14T19:05:48.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:48.964 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2299e-05 s, 0.0 kB/s 2023-10-14T19:05:49.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.019 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.075 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3834e-05 s, 0.0 kB/s 2023-10-14T19:05:49.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.076 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.130 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.131 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2013e-05 s, 0.0 kB/s 2023-10-14T19:05:49.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.132 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.187 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.187 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0367e-05 s, 0.0 kB/s 2023-10-14T19:05:49.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.242 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.242 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.242 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3389e-05 s, 0.0 kB/s 2023-10-14T19:05:49.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.243 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.299 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2994e-05 s, 0.0 kB/s 2023-10-14T19:05:49.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.300 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0782e-05 s, 0.0 kB/s 2023-10-14T19:05:49.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.355 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9977e-05 s, 0.0 kB/s 2023-10-14T19:05:49.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4136e-05 s, 0.0 kB/s 2023-10-14T19:05:49.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4167e-05 s, 0.0 kB/s 2023-10-14T19:05:49.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.524 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.579 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3341e-05 s, 0.0 kB/s 2023-10-14T19:05:49.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.635 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1191e-05 s, 0.0 kB/s 2023-10-14T19:05:49.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.635 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0925e-05 s, 0.0 kB/s 2023-10-14T19:05:49.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.692 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.747 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8882e-05 s, 0.0 kB/s 2023-10-14T19:05:49.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.803 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2771e-05 s, 0.0 kB/s 2023-10-14T19:05:49.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.804 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.982e-05 s, 0.0 kB/s 2023-10-14T19:05:49.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1632e-05 s, 0.0 kB/s 2023-10-14T19:05:49.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:49.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:49.971 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:49.971 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0471e-05 s, 0.0 kB/s 2023-10-14T19:05:49.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:49.972 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.027 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9699e-05 s, 0.0 kB/s 2023-10-14T19:05:50.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.028 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.083 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.083 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9918e-05 s, 0.0 kB/s 2023-10-14T19:05:50.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.084 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3962e-05 s, 0.0 kB/s 2023-10-14T19:05:50.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.140 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.195 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0592e-05 s, 0.0 kB/s 2023-10-14T19:05:50.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0774e-05 s, 0.0 kB/s 2023-10-14T19:05:50.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.252 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9947e-05 s, 0.0 kB/s 2023-10-14T19:05:50.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9949e-05 s, 0.0 kB/s 2023-10-14T19:05:50.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.365 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9557e-05 s, 0.0 kB/s 2023-10-14T19:05:50.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.420 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.37e-05 s, 0.0 kB/s 2023-10-14T19:05:50.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.479 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2249e-05 s, 0.0 kB/s 2023-10-14T19:05:50.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.534 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.588 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.588 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.589 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4475e-05 s, 0.0 kB/s 2023-10-14T19:05:50.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.589 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.645 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2444e-05 s, 0.0 kB/s 2023-10-14T19:05:50.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.645 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3403e-05 s, 0.0 kB/s 2023-10-14T19:05:50.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.702 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.757 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5276e-05 s, 0.0 kB/s 2023-10-14T19:05:50.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.757 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.812 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9287e-05 s, 0.0 kB/s 2023-10-14T19:05:50.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.813 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8788e-05 s, 0.0 kB/s 2023-10-14T19:05:50.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.869 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3713e-05 s, 0.0 kB/s 2023-10-14T19:05:50.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.925 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1126e-05 s, 0.0 kB/s 2023-10-14T19:05:50.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:50.982 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.256e-05 s, 0.0 kB/s 2023-10-14T19:05:51.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.093 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.093 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3232e-05 s, 0.0 kB/s 2023-10-14T19:05:51.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.094 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0169e-05 s, 0.0 kB/s 2023-10-14T19:05:51.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3909e-05 s, 0.0 kB/s 2023-10-14T19:05:51.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.998e-05 s, 0.0 kB/s 2023-10-14T19:05:51.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.317 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1068e-05 s, 0.0 kB/s 2023-10-14T19:05:51.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.317 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.372 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3522e-05 s, 0.0 kB/s 2023-10-14T19:05:51.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.373 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-14T19:05:51.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.429 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.39e-05 s, 0.0 kB/s 2023-10-14T19:05:51.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.486 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.541 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2277e-05 s, 0.0 kB/s 2023-10-14T19:05:51.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.542 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.596 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4088e-05 s, 0.0 kB/s 2023-10-14T19:05:51.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.598 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.653 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.653 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.356e-05 s, 0.0 kB/s 2023-10-14T19:05:51.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.654 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1592e-05 s, 0.0 kB/s 2023-10-14T19:05:51.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.710 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.764 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.765 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.765 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0962e-05 s, 0.0 kB/s 2023-10-14T19:05:51.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.766 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.821 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.821 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2788e-05 s, 0.0 kB/s 2023-10-14T19:05:51.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.822 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3779e-05 s, 0.0 kB/s 2023-10-14T19:05:51.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.878 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.933 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.933 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1105e-05 s, 0.0 kB/s 2023-10-14T19:05:51.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.934 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:51.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:51.989 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:51.989 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0935e-05 s, 0.0 kB/s 2023-10-14T19:05:51.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:51.990 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9242e-05 s, 0.0 kB/s 2023-10-14T19:05:52.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.046 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1784e-05 s, 0.0 kB/s 2023-10-14T19:05:52.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.102 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.156 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.156 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.157 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2669e-05 s, 0.0 kB/s 2023-10-14T19:05:52.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.157 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.212 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.212 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.212 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2859e-05 s, 0.0 kB/s 2023-10-14T19:05:52.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.213 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.268 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2344e-05 s, 0.0 kB/s 2023-10-14T19:05:52.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.270 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.324 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.324 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.324 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8673e-05 s, 0.0 kB/s 2023-10-14T19:05:52.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.325 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2448e-05 s, 0.0 kB/s 2023-10-14T19:05:52.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.381 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.436 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0555e-05 s, 0.0 kB/s 2023-10-14T19:05:52.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.493 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0545e-05 s, 0.0 kB/s 2023-10-14T19:05:52.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.494 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.548 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.549 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4032e-05 s, 0.0 kB/s 2023-10-14T19:05:52.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.550 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.604 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.605 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.605 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0898e-05 s, 0.0 kB/s 2023-10-14T19:05:52.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.606 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.661 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.106e-05 s, 0.0 kB/s 2023-10-14T19:05:52.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.717 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3477e-05 s, 0.0 kB/s 2023-10-14T19:05:52.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.718 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1661e-05 s, 0.0 kB/s 2023-10-14T19:05:52.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0388e-05 s, 0.0 kB/s 2023-10-14T19:05:52.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.830 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.885 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0842e-05 s, 0.0 kB/s 2023-10-14T19:05:52.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.886 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.942 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.942 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5039e-05 s, 0.0 kB/s 2023-10-14T19:05:52.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:52.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:52.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:52.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0443e-05 s, 0.0 kB/s 2023-10-14T19:05:52.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:52.999 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2552e-05 s, 0.0 kB/s 2023-10-14T19:05:53.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.118e-05 s, 0.0 kB/s 2023-10-14T19:05:53.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0122e-05 s, 0.0 kB/s 2023-10-14T19:05:53.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.166 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2409e-05 s, 0.0 kB/s 2023-10-14T19:05:53.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.222 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0002e-05 s, 0.0 kB/s 2023-10-14T19:05:53.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.333 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9793e-05 s, 0.0 kB/s 2023-10-14T19:05:53.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.334 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-14T19:05:53.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.391 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.445 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.445 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.446 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0556e-05 s, 0.0 kB/s 2023-10-14T19:05:53.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.446 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.502 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3054e-05 s, 0.0 kB/s 2023-10-14T19:05:53.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1167e-05 s, 0.0 kB/s 2023-10-14T19:05:53.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.559 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.613 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.614 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0178e-05 s, 0.0 kB/s 2023-10-14T19:05:53.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.615 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.670 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.670 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5054e-05 s, 0.0 kB/s 2023-10-14T19:05:53.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.671 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.726 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3758e-05 s, 0.0 kB/s 2023-10-14T19:05:53.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.727 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.781 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.782 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1003e-05 s, 0.0 kB/s 2023-10-14T19:05:53.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.783 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2316e-05 s, 0.0 kB/s 2023-10-14T19:05:53.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.838 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1771e-05 s, 0.0 kB/s 2023-10-14T19:05:53.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:53.949 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:53.950 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:53.950 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1233e-05 s, 0.0 kB/s 2023-10-14T19:05:53.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:53.951 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.006 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.006 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3019e-05 s, 0.0 kB/s 2023-10-14T19:05:54.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.007 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.062 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.6471e-05 s, 0.0 kB/s 2023-10-14T19:05:54.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.063 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.304e-05 s, 0.0 kB/s 2023-10-14T19:05:54.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.119 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.174 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2957e-05 s, 0.0 kB/s 2023-10-14T19:05:54.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.174 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.230 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.230 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-14T19:05:54.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.231 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.287 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0649e-05 s, 0.0 kB/s 2023-10-14T19:05:54.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.288 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3853e-05 s, 0.0 kB/s 2023-10-14T19:05:54.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.344 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.397 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.398 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.136e-05 s, 0.0 kB/s 2023-10-14T19:05:54.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.399 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1097e-05 s, 0.0 kB/s 2023-10-14T19:05:54.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.454 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.511 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0928e-05 s, 0.0 kB/s 2023-10-14T19:05:54.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.512 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9952e-05 s, 0.0 kB/s 2023-10-14T19:05:54.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.623 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1708e-05 s, 0.0 kB/s 2023-10-14T19:05:54.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.624 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.679 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1597e-05 s, 0.0 kB/s 2023-10-14T19:05:54.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.680 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0798e-05 s, 0.0 kB/s 2023-10-14T19:05:54.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.736 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9425e-05 s, 0.0 kB/s 2023-10-14T19:05:54.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.794 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2098e-05 s, 0.0 kB/s 2023-10-14T19:05:54.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.903 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0844e-05 s, 0.0 kB/s 2023-10-14T19:05:54.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.903 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:54.960 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3842e-05 s, 0.0 kB/s 2023-10-14T19:05:54.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:54.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.014 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.014 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-14T19:05:55.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.016 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.262e-05 s, 0.0 kB/s 2023-10-14T19:05:55.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.072 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1912e-05 s, 0.0 kB/s 2023-10-14T19:05:55.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.128 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.182 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.182 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0873e-05 s, 0.0 kB/s 2023-10-14T19:05:55.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.184 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.239 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.240 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.240 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2981e-05 s, 0.0 kB/s 2023-10-14T19:05:55.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.241 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.295 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.296 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.296 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7783e-05 s, 0.0 kB/s 2023-10-14T19:05:55.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.296 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1854e-05 s, 0.0 kB/s 2023-10-14T19:05:55.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.353 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-14T19:05:55.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0292e-05 s, 0.0 kB/s 2023-10-14T19:05:55.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.526 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0295e-05 s, 0.0 kB/s 2023-10-14T19:05:55.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.527 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.582 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1758e-05 s, 0.0 kB/s 2023-10-14T19:05:55.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.583 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.636 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.636 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.637 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2744e-05 s, 0.0 kB/s 2023-10-14T19:05:55.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.637 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.692 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.692 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.693 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.22e-05 s, 0.0 kB/s 2023-10-14T19:05:55.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.693 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3157e-05 s, 0.0 kB/s 2023-10-14T19:05:55.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.750 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.804 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.805 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0312e-05 s, 0.0 kB/s 2023-10-14T19:05:55.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.806 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.04e-05 s, 0.0 kB/s 2023-10-14T19:05:55.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.862 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.091e-05 s, 0.0 kB/s 2023-10-14T19:05:55.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.918 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1379e-05 s, 0.0 kB/s 2023-10-14T19:05:55.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:55.973 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.028 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.029 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.029 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2536e-05 s, 0.0 kB/s 2023-10-14T19:05:56.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.030 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5574e-05 s, 0.0 kB/s 2023-10-14T19:05:56.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.086 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.140 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.140 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.141 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1717e-05 s, 0.0 kB/s 2023-10-14T19:05:56.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.142 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.196 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1497e-05 s, 0.0 kB/s 2023-10-14T19:05:56.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.198 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.253 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.253 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.253 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.009e-05 s, 0.0 kB/s 2023-10-14T19:05:56.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.254 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.309 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1412e-05 s, 0.0 kB/s 2023-10-14T19:05:56.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.311 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2919e-05 s, 0.0 kB/s 2023-10-14T19:05:56.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.367 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.421 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.423 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2001e-05 s, 0.0 kB/s 2023-10-14T19:05:56.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.424 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.477 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0416e-05 s, 0.0 kB/s 2023-10-14T19:05:56.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.479 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9425e-05 s, 0.0 kB/s 2023-10-14T19:05:56.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.591 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9802e-05 s, 0.0 kB/s 2023-10-14T19:05:56.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.592 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.646 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8731e-05 s, 0.0 kB/s 2023-10-14T19:05:56.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.648 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1892e-05 s, 0.0 kB/s 2023-10-14T19:05:56.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.705 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.758 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.759 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.759 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2027e-05 s, 0.0 kB/s 2023-10-14T19:05:56.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.760 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3187e-05 s, 0.0 kB/s 2023-10-14T19:05:56.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.816 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.870 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.870 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.871 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2675e-05 s, 0.0 kB/s 2023-10-14T19:05:56.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.871 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.926 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9443e-05 s, 0.0 kB/s 2023-10-14T19:05:56.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.928 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:56.982 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:56.983 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:56.983 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1549e-05 s, 0.0 kB/s 2023-10-14T19:05:56.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:56.984 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.038 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.068e-05 s, 0.0 kB/s 2023-10-14T19:05:57.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.039 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0093e-05 s, 0.0 kB/s 2023-10-14T19:05:57.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.096 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4767e-05 s, 0.0 kB/s 2023-10-14T19:05:57.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.152 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.207 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1449e-05 s, 0.0 kB/s 2023-10-14T19:05:57.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.208 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1684e-05 s, 0.0 kB/s 2023-10-14T19:05:57.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.266 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.320 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.320 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.320 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9277e-05 s, 0.0 kB/s 2023-10-14T19:05:57.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.321 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.377 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-14T19:05:57.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.378 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1873e-05 s, 0.0 kB/s 2023-10-14T19:05:57.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.433 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.489 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.489 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3041e-05 s, 0.0 kB/s 2023-10-14T19:05:57.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.490 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.544 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.545 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.545 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2068e-05 s, 0.0 kB/s 2023-10-14T19:05:57.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.546 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.601 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.601 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2937e-05 s, 0.0 kB/s 2023-10-14T19:05:57.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.602 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4573e-05 s, 0.0 kB/s 2023-10-14T19:05:57.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.659 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.714 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.715 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3617e-05 s, 0.0 kB/s 2023-10-14T19:05:57.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.716 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.771 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.771 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2678e-05 s, 0.0 kB/s 2023-10-14T19:05:57.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.772 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.827 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.827 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.827 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3956e-05 s, 0.0 kB/s 2023-10-14T19:05:57.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.828 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.884 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9211e-05 s, 0.0 kB/s 2023-10-14T19:05:57.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4507e-05 s, 0.0 kB/s 2023-10-14T19:05:57.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.941 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:57.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:57.996 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:57.996 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2283e-05 s, 0.0 kB/s 2023-10-14T19:05:57.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:57.997 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2395e-05 s, 0.0 kB/s 2023-10-14T19:05:58.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.053 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.108 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8922e-05 s, 0.0 kB/s 2023-10-14T19:05:58.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.109 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.164 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.164 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9168e-05 s, 0.0 kB/s 2023-10-14T19:05:58.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.165 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.221 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0552e-05 s, 0.0 kB/s 2023-10-14T19:05:58.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.222 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.276 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.277 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1249e-05 s, 0.0 kB/s 2023-10-14T19:05:58.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.278 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2488e-05 s, 0.0 kB/s 2023-10-14T19:05:58.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.334 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.389 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4334e-05 s, 0.0 kB/s 2023-10-14T19:05:58.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.390 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.445 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3555e-05 s, 0.0 kB/s 2023-10-14T19:05:58.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.445 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.500 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.501 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.945e-05 s, 0.0 kB/s 2023-10-14T19:05:58.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.502 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8917e-05 s, 0.0 kB/s 2023-10-14T19:05:58.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.558 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.612 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.613 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.613 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9875e-05 s, 0.0 kB/s 2023-10-14T19:05:58.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.614 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2882e-05 s, 0.0 kB/s 2023-10-14T19:05:58.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.670 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9905e-05 s, 0.0 kB/s 2023-10-14T19:05:58.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.726 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0409e-05 s, 0.0 kB/s 2023-10-14T19:05:58.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.782 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.837 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.837 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0418e-05 s, 0.0 kB/s 2023-10-14T19:05:58.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.838 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3239e-05 s, 0.0 kB/s 2023-10-14T19:05:58.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:58.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:58.949 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:58.949 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0301e-05 s, 0.0 kB/s 2023-10-14T19:05:58.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:58.950 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5484e-05 s, 0.0 kB/s 2023-10-14T19:05:59.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.006 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.061 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9811e-05 s, 0.0 kB/s 2023-10-14T19:05:59.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.062 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.117 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.118 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5381e-05 s, 0.0 kB/s 2023-10-14T19:05:59.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.119 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0318e-05 s, 0.0 kB/s 2023-10-14T19:05:59.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.174 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0973e-05 s, 0.0 kB/s 2023-10-14T19:05:59.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.231 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0994e-05 s, 0.0 kB/s 2023-10-14T19:05:59.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.287 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.342 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.342 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4331e-05 s, 0.0 kB/s 2023-10-14T19:05:59.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.343 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.397 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1661e-05 s, 0.0 kB/s 2023-10-14T19:05:59.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.399 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0583e-05 s, 0.0 kB/s 2023-10-14T19:05:59.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9714e-05 s, 0.0 kB/s 2023-10-14T19:05:59.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.511 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2503e-05 s, 0.0 kB/s 2023-10-14T19:05:59.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2254e-05 s, 0.0 kB/s 2023-10-14T19:05:59.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.624 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0414e-05 s, 0.0 kB/s 2023-10-14T19:05:59.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.680 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5411e-05 s, 0.0 kB/s 2023-10-14T19:05:59.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.736 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4634e-05 s, 0.0 kB/s 2023-10-14T19:05:59.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.793 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.846 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2639e-05 s, 0.0 kB/s 2023-10-14T19:05:59.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.904 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1025e-05 s, 0.0 kB/s 2023-10-14T19:05:59.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.906 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:05:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:05:59.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:05:59.962 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9836e-05 s, 0.0 kB/s 2023-10-14T19:05:59.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:05:59.963 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.017 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.017 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.018 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9824e-05 s, 0.0 kB/s 2023-10-14T19:06:00.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.018 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.073 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.073 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.074 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0673e-05 s, 0.0 kB/s 2023-10-14T19:06:00.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.074 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.130 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4134e-05 s, 0.0 kB/s 2023-10-14T19:06:00.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.131 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.186 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3402e-05 s, 0.0 kB/s 2023-10-14T19:06:00.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.242 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.243 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2653e-05 s, 0.0 kB/s 2023-10-14T19:06:00.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.243 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4088e-05 s, 0.0 kB/s 2023-10-14T19:06:00.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.299 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.354 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9579e-05 s, 0.0 kB/s 2023-10-14T19:06:00.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.355 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1931e-05 s, 0.0 kB/s 2023-10-14T19:06:00.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.466 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0563e-05 s, 0.0 kB/s 2023-10-14T19:06:00.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.466 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1803e-05 s, 0.0 kB/s 2023-10-14T19:06:00.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.523 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.578 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6307e-05 s, 0.0 kB/s 2023-10-14T19:06:00.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.634 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9703e-05 s, 0.0 kB/s 2023-10-14T19:06:00.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.635 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.690 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1787e-05 s, 0.0 kB/s 2023-10-14T19:06:00.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.102e-05 s, 0.0 kB/s 2023-10-14T19:06:00.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.802 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9887e-05 s, 0.0 kB/s 2023-10-14T19:06:00.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.858 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2286e-05 s, 0.0 kB/s 2023-10-14T19:06:00.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.858 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3004e-05 s, 0.0 kB/s 2023-10-14T19:06:00.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:00.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:00.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:00.970 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0371e-05 s, 0.0 kB/s 2023-10-14T19:06:00.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:00.971 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0848e-05 s, 0.0 kB/s 2023-10-14T19:06:01.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.027 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.081 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0267e-05 s, 0.0 kB/s 2023-10-14T19:06:01.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-14T19:06:01.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.194 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-14T19:06:01.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.250 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2575e-05 s, 0.0 kB/s 2023-10-14T19:06:01.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1656e-05 s, 0.0 kB/s 2023-10-14T19:06:01.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.361 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.362 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3875e-05 s, 0.0 kB/s 2023-10-14T19:06:01.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1085e-05 s, 0.0 kB/s 2023-10-14T19:06:01.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9834e-05 s, 0.0 kB/s 2023-10-14T19:06:01.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.474 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.530 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9024e-05 s, 0.0 kB/s 2023-10-14T19:06:01.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.530 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-14T19:06:01.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.641 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.641 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.642 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1648e-05 s, 0.0 kB/s 2023-10-14T19:06:01.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.642 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-14T19:06:01.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.699 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3606e-05 s, 0.0 kB/s 2023-10-14T19:06:01.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.758 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.809 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.810 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1722e-05 s, 0.0 kB/s 2023-10-14T19:06:01.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.811 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.866 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1767e-05 s, 0.0 kB/s 2023-10-14T19:06:01.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2821e-05 s, 0.0 kB/s 2023-10-14T19:06:01.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.922 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:01.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:01.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:01.979 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0146e-05 s, 0.0 kB/s 2023-10-14T19:06:01.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:01.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0311e-05 s, 0.0 kB/s 2023-10-14T19:06:02.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0728e-05 s, 0.0 kB/s 2023-10-14T19:06:02.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2942e-05 s, 0.0 kB/s 2023-10-14T19:06:02.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.148 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.204 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.295e-05 s, 0.0 kB/s 2023-10-14T19:06:02.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.260 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9996e-05 s, 0.0 kB/s 2023-10-14T19:06:02.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.261 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9118e-05 s, 0.0 kB/s 2023-10-14T19:06:02.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.316 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.371 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.371 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.372 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8663e-05 s, 0.0 kB/s 2023-10-14T19:06:02.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.372 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.427 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.427 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.428 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3936e-05 s, 0.0 kB/s 2023-10-14T19:06:02.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.428 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1532e-05 s, 0.0 kB/s 2023-10-14T19:06:02.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.484 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1551e-05 s, 0.0 kB/s 2023-10-14T19:06:02.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.540 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3024e-05 s, 0.0 kB/s 2023-10-14T19:06:02.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.597 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9394e-05 s, 0.0 kB/s 2023-10-14T19:06:02.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.654 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2651e-05 s, 0.0 kB/s 2023-10-14T19:06:02.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.710 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.764 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0811e-05 s, 0.0 kB/s 2023-10-14T19:06:02.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.766 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.821 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4182e-05 s, 0.0 kB/s 2023-10-14T19:06:02.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.822 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.877 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.878 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1316e-05 s, 0.0 kB/s 2023-10-14T19:06:02.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.879 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.934 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.935 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.935 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2472e-05 s, 0.0 kB/s 2023-10-14T19:06:02.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.936 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:02.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:02.993 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1203e-05 s, 0.0 kB/s 2023-10-14T19:06:02.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:02.994 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.049 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.049 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.050 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2175e-05 s, 0.0 kB/s 2023-10-14T19:06:03.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.051 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.107 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3393e-05 s, 0.0 kB/s 2023-10-14T19:06:03.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.108 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1989e-05 s, 0.0 kB/s 2023-10-14T19:06:03.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.164 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.219 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1881e-05 s, 0.0 kB/s 2023-10-14T19:06:03.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.220 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1709e-05 s, 0.0 kB/s 2023-10-14T19:06:03.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.276 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4465e-05 s, 0.0 kB/s 2023-10-14T19:06:03.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.386 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.387 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.387 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-14T19:06:03.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.388 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1516e-05 s, 0.0 kB/s 2023-10-14T19:06:03.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.444 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.499 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0254e-05 s, 0.0 kB/s 2023-10-14T19:06:03.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.499 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9029e-05 s, 0.0 kB/s 2023-10-14T19:06:03.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.556 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.612 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-14T19:06:03.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.614 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1573e-05 s, 0.0 kB/s 2023-10-14T19:06:03.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.670 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1021e-05 s, 0.0 kB/s 2023-10-14T19:06:03.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.726 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1166e-05 s, 0.0 kB/s 2023-10-14T19:06:03.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.782 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3033e-05 s, 0.0 kB/s 2023-10-14T19:06:03.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.839 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.895 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1659e-05 s, 0.0 kB/s 2023-10-14T19:06:03.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.896 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.254e-05 s, 0.0 kB/s 2023-10-14T19:06:03.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:03.952 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.008 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-14T19:06:04.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.009 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0613e-05 s, 0.0 kB/s 2023-10-14T19:06:04.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.121 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.171e-05 s, 0.0 kB/s 2023-10-14T19:06:04.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9759e-05 s, 0.0 kB/s 2023-10-14T19:06:04.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.178 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.233 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8993e-05 s, 0.0 kB/s 2023-10-14T19:06:04.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.234 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.427e-05 s, 0.0 kB/s 2023-10-14T19:06:04.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.290 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.344 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-14T19:06:04.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.346 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.401 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1393e-05 s, 0.0 kB/s 2023-10-14T19:06:04.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.402 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3755e-05 s, 0.0 kB/s 2023-10-14T19:06:04.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.459 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.514 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.514 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1489e-05 s, 0.0 kB/s 2023-10-14T19:06:04.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.515 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.570 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2729e-05 s, 0.0 kB/s 2023-10-14T19:06:04.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.571 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.627 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.627 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.627 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0654e-05 s, 0.0 kB/s 2023-10-14T19:06:04.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.628 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.683 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.684 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1004e-05 s, 0.0 kB/s 2023-10-14T19:06:04.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.685 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9909e-05 s, 0.0 kB/s 2023-10-14T19:06:04.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.741 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.796 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.796 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.971e-05 s, 0.0 kB/s 2023-10-14T19:06:04.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.852 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.852 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1101e-05 s, 0.0 kB/s 2023-10-14T19:06:04.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.853 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0358e-05 s, 0.0 kB/s 2023-10-14T19:06:04.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:04.963 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:04.963 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0519e-05 s, 0.0 kB/s 2023-10-14T19:06:04.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:04.964 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.021 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9217e-05 s, 0.0 kB/s 2023-10-14T19:06:05.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.021 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.076 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-14T19:06:05.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.078 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.133 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.134 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1282e-05 s, 0.0 kB/s 2023-10-14T19:06:05.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.135 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.022e-05 s, 0.0 kB/s 2023-10-14T19:06:05.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.190 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1079e-05 s, 0.0 kB/s 2023-10-14T19:06:05.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.248 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.303 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.303 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1787e-05 s, 0.0 kB/s 2023-10-14T19:06:05.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.304 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.358 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2264e-05 s, 0.0 kB/s 2023-10-14T19:06:05.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.360 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3178e-05 s, 0.0 kB/s 2023-10-14T19:06:05.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.416 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.471 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.471 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.01e-05 s, 0.0 kB/s 2023-10-14T19:06:05.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.472 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.526 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.526 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1504e-05 s, 0.0 kB/s 2023-10-14T19:06:05.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.527 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.584 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3319e-05 s, 0.0 kB/s 2023-10-14T19:06:05.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.585 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.639 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1537e-05 s, 0.0 kB/s 2023-10-14T19:06:05.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.641 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.695 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.696 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.696 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.381e-05 s, 0.0 kB/s 2023-10-14T19:06:05.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.697 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.752 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-14T19:06:05.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.752 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.807 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.808 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4642e-05 s, 0.0 kB/s 2023-10-14T19:06:05.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.809 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2259e-05 s, 0.0 kB/s 2023-10-14T19:06:05.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.865 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-14T19:06:05.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.920 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4728e-05 s, 0.0 kB/s 2023-10-14T19:06:05.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:05.977 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9304e-05 s, 0.0 kB/s 2023-10-14T19:06:06.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.034 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3205e-05 s, 0.0 kB/s 2023-10-14T19:06:06.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.090 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9733e-05 s, 0.0 kB/s 2023-10-14T19:06:06.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.148 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.202 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.203 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9176e-05 s, 0.0 kB/s 2023-10-14T19:06:06.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.204 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.258 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.259 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0141e-05 s, 0.0 kB/s 2023-10-14T19:06:06.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.259 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0881e-05 s, 0.0 kB/s 2023-10-14T19:06:06.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.316 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3921e-05 s, 0.0 kB/s 2023-10-14T19:06:06.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.371 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0635e-05 s, 0.0 kB/s 2023-10-14T19:06:06.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.428 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.482 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.482 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.483 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2903e-05 s, 0.0 kB/s 2023-10-14T19:06:06.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.483 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.539 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5163e-05 s, 0.0 kB/s 2023-10-14T19:06:06.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.540 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.594 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.594 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1124e-05 s, 0.0 kB/s 2023-10-14T19:06:06.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.595 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.651 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.651 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.651 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3637e-05 s, 0.0 kB/s 2023-10-14T19:06:06.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.652 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.707 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.708 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0723e-05 s, 0.0 kB/s 2023-10-14T19:06:06.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.709 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.763 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.763 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.764 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9251e-05 s, 0.0 kB/s 2023-10-14T19:06:06.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.764 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.820 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4163e-05 s, 0.0 kB/s 2023-10-14T19:06:06.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.821 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1689e-05 s, 0.0 kB/s 2023-10-14T19:06:06.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.877 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.933 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.933 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.142e-05 s, 0.0 kB/s 2023-10-14T19:06:06.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.934 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:06.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:06.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:06.988 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1087e-05 s, 0.0 kB/s 2023-10-14T19:06:06.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:06.990 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4642e-05 s, 0.0 kB/s 2023-10-14T19:06:07.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.047 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5056e-05 s, 0.0 kB/s 2023-10-14T19:06:07.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.103 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.159 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.159 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.367e-05 s, 0.0 kB/s 2023-10-14T19:06:07.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.160 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.215 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3425e-05 s, 0.0 kB/s 2023-10-14T19:06:07.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.215 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.271 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0956e-05 s, 0.0 kB/s 2023-10-14T19:06:07.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.271 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3937e-05 s, 0.0 kB/s 2023-10-14T19:06:07.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2094e-05 s, 0.0 kB/s 2023-10-14T19:06:07.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.384 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.438 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.438 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.439 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-14T19:06:07.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.439 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1888e-05 s, 0.0 kB/s 2023-10-14T19:06:07.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.496 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.550 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.551 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.551 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0074e-05 s, 0.0 kB/s 2023-10-14T19:06:07.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.552 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1472e-05 s, 0.0 kB/s 2023-10-14T19:06:07.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.608 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0763e-05 s, 0.0 kB/s 2023-10-14T19:06:07.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.664 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.718 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0512e-05 s, 0.0 kB/s 2023-10-14T19:06:07.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.720 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8801e-05 s, 0.0 kB/s 2023-10-14T19:06:07.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.775 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.831 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.831 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.831 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2947e-05 s, 0.0 kB/s 2023-10-14T19:06:07.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.832 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.888 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.888 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1517e-05 s, 0.0 kB/s 2023-10-14T19:06:07.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.889 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2847e-05 s, 0.0 kB/s 2023-10-14T19:06:07.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:07.945 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:07.999 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4577e-05 s, 0.0 kB/s 2023-10-14T19:06:08.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.001 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.055 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1586e-05 s, 0.0 kB/s 2023-10-14T19:06:08.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.057 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3936e-05 s, 0.0 kB/s 2023-10-14T19:06:08.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.113 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4296e-05 s, 0.0 kB/s 2023-10-14T19:06:08.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.169 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.224 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.224 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.224 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9921e-05 s, 0.0 kB/s 2023-10-14T19:06:08.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.225 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.280 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.280 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9641e-05 s, 0.0 kB/s 2023-10-14T19:06:08.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.281 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0929e-05 s, 0.0 kB/s 2023-10-14T19:06:08.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.337 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0275e-05 s, 0.0 kB/s 2023-10-14T19:06:08.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.393 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1499e-05 s, 0.0 kB/s 2023-10-14T19:06:08.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.449 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.504 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.504 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1056e-05 s, 0.0 kB/s 2023-10-14T19:06:08.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.505 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0433e-05 s, 0.0 kB/s 2023-10-14T19:06:08.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3737e-05 s, 0.0 kB/s 2023-10-14T19:06:08.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0611e-05 s, 0.0 kB/s 2023-10-14T19:06:08.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.673 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9738e-05 s, 0.0 kB/s 2023-10-14T19:06:08.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.728 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1778e-05 s, 0.0 kB/s 2023-10-14T19:06:08.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.784 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.840 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.462e-05 s, 0.0 kB/s 2023-10-14T19:06:08.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.841 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2987e-05 s, 0.0 kB/s 2023-10-14T19:06:08.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0163e-05 s, 0.0 kB/s 2023-10-14T19:06:08.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:08.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.009 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.479e-05 s, 0.0 kB/s 2023-10-14T19:06:09.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0779e-05 s, 0.0 kB/s 2023-10-14T19:06:09.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0116e-05 s, 0.0 kB/s 2023-10-14T19:06:09.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.177 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.177 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1228e-05 s, 0.0 kB/s 2023-10-14T19:06:09.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.177 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.233 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.269e-05 s, 0.0 kB/s 2023-10-14T19:06:09.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0661e-05 s, 0.0 kB/s 2023-10-14T19:06:09.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.289 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.344 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.344 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1963e-05 s, 0.0 kB/s 2023-10-14T19:06:09.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.345 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.457e-05 s, 0.0 kB/s 2023-10-14T19:06:09.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.402 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.456 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.457 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2874e-05 s, 0.0 kB/s 2023-10-14T19:06:09.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.458 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0326e-05 s, 0.0 kB/s 2023-10-14T19:06:09.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.514 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9852e-05 s, 0.0 kB/s 2023-10-14T19:06:09.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.569 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9357e-05 s, 0.0 kB/s 2023-10-14T19:06:09.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.625 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0317e-05 s, 0.0 kB/s 2023-10-14T19:06:09.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.682 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.737 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.737 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2305e-05 s, 0.0 kB/s 2023-10-14T19:06:09.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.738 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.793 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1271e-05 s, 0.0 kB/s 2023-10-14T19:06:09.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.793 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.849 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.849 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4541e-05 s, 0.0 kB/s 2023-10-14T19:06:09.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.850 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1965e-05 s, 0.0 kB/s 2023-10-14T19:06:09.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.906 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0714e-05 s, 0.0 kB/s 2023-10-14T19:06:09.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:09.962 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8393e-05 s, 0.0 kB/s 2023-10-14T19:06:10.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.019 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.073 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.074 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.074 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2489e-05 s, 0.0 kB/s 2023-10-14T19:06:10.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.075 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2067e-05 s, 0.0 kB/s 2023-10-14T19:06:10.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.131 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8804e-05 s, 0.0 kB/s 2023-10-14T19:06:10.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.186 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.242 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1214e-05 s, 0.0 kB/s 2023-10-14T19:06:10.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.242 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.297 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0773e-05 s, 0.0 kB/s 2023-10-14T19:06:10.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.299 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.354 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.365e-05 s, 0.0 kB/s 2023-10-14T19:06:10.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.355 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3141e-05 s, 0.0 kB/s 2023-10-14T19:06:10.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.466 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3733e-05 s, 0.0 kB/s 2023-10-14T19:06:10.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.467 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2563e-05 s, 0.0 kB/s 2023-10-14T19:06:10.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.522 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2366e-05 s, 0.0 kB/s 2023-10-14T19:06:10.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.931e-05 s, 0.0 kB/s 2023-10-14T19:06:10.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.634 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.690 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.1019e-05 s, 0.0 kB/s 2023-10-14T19:06:10.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-14T19:06:10.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.746 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.802 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2569e-05 s, 0.0 kB/s 2023-10-14T19:06:10.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0629e-05 s, 0.0 kB/s 2023-10-14T19:06:10.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1837e-05 s, 0.0 kB/s 2023-10-14T19:06:10.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:10.969 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:10.969 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2198e-05 s, 0.0 kB/s 2023-10-14T19:06:10.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:10.971 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.026 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.277e-05 s, 0.0 kB/s 2023-10-14T19:06:11.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.028 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.083 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.083 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.241e-05 s, 0.0 kB/s 2023-10-14T19:06:11.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.084 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.7904e-05 s, 0.0 kB/s 2023-10-14T19:06:11.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.195 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2604e-05 s, 0.0 kB/s 2023-10-14T19:06:11.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.196 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-14T19:06:11.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9883e-05 s, 0.0 kB/s 2023-10-14T19:06:11.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9633e-05 s, 0.0 kB/s 2023-10-14T19:06:11.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0339e-05 s, 0.0 kB/s 2023-10-14T19:06:11.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.420 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.475 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3307e-05 s, 0.0 kB/s 2023-10-14T19:06:11.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.531 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0978e-05 s, 0.0 kB/s 2023-10-14T19:06:11.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.532 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1727e-05 s, 0.0 kB/s 2023-10-14T19:06:11.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.588 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1037e-05 s, 0.0 kB/s 2023-10-14T19:06:11.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.646 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5137e-05 s, 0.0 kB/s 2023-10-14T19:06:11.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.702 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1417e-05 s, 0.0 kB/s 2023-10-14T19:06:11.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.757 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4709e-05 s, 0.0 kB/s 2023-10-14T19:06:11.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.814 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8618e-05 s, 0.0 kB/s 2023-10-14T19:06:11.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.870 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9329e-05 s, 0.0 kB/s 2023-10-14T19:06:11.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.925 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:11.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:11.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:11.981 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2725e-05 s, 0.0 kB/s 2023-10-14T19:06:11.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:11.982 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0756e-05 s, 0.0 kB/s 2023-10-14T19:06:12.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.038 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1445e-05 s, 0.0 kB/s 2023-10-14T19:06:12.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.094 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.150 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1824e-05 s, 0.0 kB/s 2023-10-14T19:06:12.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1289e-05 s, 0.0 kB/s 2023-10-14T19:06:12.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.207 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.466e-05 s, 0.0 kB/s 2023-10-14T19:06:12.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.318 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8787e-05 s, 0.0 kB/s 2023-10-14T19:06:12.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4318e-05 s, 0.0 kB/s 2023-10-14T19:06:12.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.376 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.431 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.302e-05 s, 0.0 kB/s 2023-10-14T19:06:12.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.432 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.487 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2137e-05 s, 0.0 kB/s 2023-10-14T19:06:12.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.487 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.543 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.185e-05 s, 0.0 kB/s 2023-10-14T19:06:12.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.544 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1947e-05 s, 0.0 kB/s 2023-10-14T19:06:12.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.600 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.655 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2437e-05 s, 0.0 kB/s 2023-10-14T19:06:12.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.656 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1979e-05 s, 0.0 kB/s 2023-10-14T19:06:12.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.766 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2225e-05 s, 0.0 kB/s 2023-10-14T19:06:12.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4861e-05 s, 0.0 kB/s 2023-10-14T19:06:12.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.824 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.879 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.879 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1686e-05 s, 0.0 kB/s 2023-10-14T19:06:12.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.879 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2926e-05 s, 0.0 kB/s 2023-10-14T19:06:12.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.936 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9433e-05 s, 0.0 kB/s 2023-10-14T19:06:12.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:12.993 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.049 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.049 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.050 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3627e-05 s, 0.0 kB/s 2023-10-14T19:06:13.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.050 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.106 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5039e-05 s, 0.0 kB/s 2023-10-14T19:06:13.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.107 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4207e-05 s, 0.0 kB/s 2023-10-14T19:06:13.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.165 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1235e-05 s, 0.0 kB/s 2023-10-14T19:06:13.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.220 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.276 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4697e-05 s, 0.0 kB/s 2023-10-14T19:06:13.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.276 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3417e-05 s, 0.0 kB/s 2023-10-14T19:06:13.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4374e-05 s, 0.0 kB/s 2023-10-14T19:06:13.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.389 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4729e-05 s, 0.0 kB/s 2023-10-14T19:06:13.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.445 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2339e-05 s, 0.0 kB/s 2023-10-14T19:06:13.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.500 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0632e-05 s, 0.0 kB/s 2023-10-14T19:06:13.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.556 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.612 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1245e-05 s, 0.0 kB/s 2023-10-14T19:06:13.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.612 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.668 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.668 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.978e-05 s, 0.0 kB/s 2023-10-14T19:06:13.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.724 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.724 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.724 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2268e-05 s, 0.0 kB/s 2023-10-14T19:06:13.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.725 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2514e-05 s, 0.0 kB/s 2023-10-14T19:06:13.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.780 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1448e-05 s, 0.0 kB/s 2023-10-14T19:06:13.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.838 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3917e-05 s, 0.0 kB/s 2023-10-14T19:06:13.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:13.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:13.949 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:13.949 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1179e-05 s, 0.0 kB/s 2023-10-14T19:06:13.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:13.950 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.005 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2945e-05 s, 0.0 kB/s 2023-10-14T19:06:14.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.006 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.061 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3331e-05 s, 0.0 kB/s 2023-10-14T19:06:14.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.062 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2439e-05 s, 0.0 kB/s 2023-10-14T19:06:14.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.118 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.173 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4672e-05 s, 0.0 kB/s 2023-10-14T19:06:14.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.173 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.228 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2303e-05 s, 0.0 kB/s 2023-10-14T19:06:14.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.230 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.286 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2747e-05 s, 0.0 kB/s 2023-10-14T19:06:14.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.287 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2377e-05 s, 0.0 kB/s 2023-10-14T19:06:14.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.342 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3777e-05 s, 0.0 kB/s 2023-10-14T19:06:14.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.399 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1679e-05 s, 0.0 kB/s 2023-10-14T19:06:14.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0861e-05 s, 0.0 kB/s 2023-10-14T19:06:14.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.510 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.565 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.565 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.565 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1159e-05 s, 0.0 kB/s 2023-10-14T19:06:14.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.566 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.46e-05 s, 0.0 kB/s 2023-10-14T19:06:14.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.622 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.065e-05 s, 0.0 kB/s 2023-10-14T19:06:14.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.679 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2628e-05 s, 0.0 kB/s 2023-10-14T19:06:14.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.735 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1373e-05 s, 0.0 kB/s 2023-10-14T19:06:14.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.791 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.846 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.846 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.846 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1446e-05 s, 0.0 kB/s 2023-10-14T19:06:14.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.847 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.901 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.902 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.902 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9602e-05 s, 0.0 kB/s 2023-10-14T19:06:14.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.903 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:14.958 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:14.958 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.3829e-05 s, 0.0 kB/s 2023-10-14T19:06:14.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:14.959 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.013 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.027e-05 s, 0.0 kB/s 2023-10-14T19:06:15.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.015 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.070 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.071 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.071 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4102e-05 s, 0.0 kB/s 2023-10-14T19:06:15.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.072 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.126 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.127 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.127 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3719e-05 s, 0.0 kB/s 2023-10-14T19:06:15.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.128 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3356e-05 s, 0.0 kB/s 2023-10-14T19:06:15.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.184 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.238 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.238 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2689e-05 s, 0.0 kB/s 2023-10-14T19:06:15.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.239 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.295 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.295 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.296 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3745e-05 s, 0.0 kB/s 2023-10-14T19:06:15.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.296 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3144e-05 s, 0.0 kB/s 2023-10-14T19:06:15.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.352 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.407 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.407 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.407 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-14T19:06:15.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.408 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0546e-05 s, 0.0 kB/s 2023-10-14T19:06:15.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.464 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.519 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.520 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.520 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-14T19:06:15.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.521 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.575 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.575 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.576 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1295e-05 s, 0.0 kB/s 2023-10-14T19:06:15.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.577 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.632 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3833e-05 s, 0.0 kB/s 2023-10-14T19:06:15.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.632 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.687 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.687 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.687 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1885e-05 s, 0.0 kB/s 2023-10-14T19:06:15.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.689 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.744 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.745 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4556e-05 s, 0.0 kB/s 2023-10-14T19:06:15.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.746 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0485e-05 s, 0.0 kB/s 2023-10-14T19:06:15.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.801 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.858 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2817e-05 s, 0.0 kB/s 2023-10-14T19:06:15.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2372e-05 s, 0.0 kB/s 2023-10-14T19:06:15.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:15.969 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-14T19:06:15.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:15.971 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9097e-05 s, 0.0 kB/s 2023-10-14T19:06:16.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.026 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3244e-05 s, 0.0 kB/s 2023-10-14T19:06:16.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1123e-05 s, 0.0 kB/s 2023-10-14T19:06:16.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.194 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1698e-05 s, 0.0 kB/s 2023-10-14T19:06:16.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2221e-05 s, 0.0 kB/s 2023-10-14T19:06:16.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.250 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4254e-05 s, 0.0 kB/s 2023-10-14T19:06:16.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-14T19:06:16.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.362 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1974e-05 s, 0.0 kB/s 2023-10-14T19:06:16.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.473 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1056e-05 s, 0.0 kB/s 2023-10-14T19:06:16.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.474 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0228e-05 s, 0.0 kB/s 2023-10-14T19:06:16.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.531 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.585 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.586 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2615e-05 s, 0.0 kB/s 2023-10-14T19:06:16.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.642 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2322e-05 s, 0.0 kB/s 2023-10-14T19:06:16.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.642 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.697 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.698 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4376e-05 s, 0.0 kB/s 2023-10-14T19:06:16.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.699 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.754 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8923e-05 s, 0.0 kB/s 2023-10-14T19:06:16.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.755 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0705e-05 s, 0.0 kB/s 2023-10-14T19:06:16.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.813 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-14T19:06:16.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.869 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.924 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2069e-05 s, 0.0 kB/s 2023-10-14T19:06:16.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.925 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4643e-05 s, 0.0 kB/s 2023-10-14T19:06:16.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:16.981 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0235e-05 s, 0.0 kB/s 2023-10-14T19:06:17.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.093 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-14T19:06:17.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.149 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2841e-05 s, 0.0 kB/s 2023-10-14T19:06:17.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1429e-05 s, 0.0 kB/s 2023-10-14T19:06:17.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.206 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9734e-05 s, 0.0 kB/s 2023-10-14T19:06:17.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-14T19:06:17.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.318 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1848e-05 s, 0.0 kB/s 2023-10-14T19:06:17.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.429 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3543e-05 s, 0.0 kB/s 2023-10-14T19:06:17.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.430 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.484 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3165e-05 s, 0.0 kB/s 2023-10-14T19:06:17.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.486 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3664e-05 s, 0.0 kB/s 2023-10-14T19:06:17.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.543 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4416e-05 s, 0.0 kB/s 2023-10-14T19:06:17.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.599 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.655 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4747e-05 s, 0.0 kB/s 2023-10-14T19:06:17.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.656 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.712 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.712 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.712 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1328e-05 s, 0.0 kB/s 2023-10-14T19:06:17.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.713 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3465e-05 s, 0.0 kB/s 2023-10-14T19:06:17.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4182e-05 s, 0.0 kB/s 2023-10-14T19:06:17.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.829 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.884 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.297e-05 s, 0.0 kB/s 2023-10-14T19:06:17.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3369e-05 s, 0.0 kB/s 2023-10-14T19:06:17.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9606e-05 s, 0.0 kB/s 2023-10-14T19:06:17.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:17.999 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1721e-05 s, 0.0 kB/s 2023-10-14T19:06:18.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2648e-05 s, 0.0 kB/s 2023-10-14T19:06:18.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2229e-05 s, 0.0 kB/s 2023-10-14T19:06:18.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.167 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2352e-05 s, 0.0 kB/s 2023-10-14T19:06:18.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.223 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0058e-05 s, 0.0 kB/s 2023-10-14T19:06:18.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.278 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:18.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.334 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.369e-05 s, 0.0 kB/s 2023-10-14T19:06:18.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.335 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.336 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5151e-05 s, 0.0 kB/s 2023-10-14T19:06:18.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.392 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3896e-05 s, 0.0 kB/s 2023-10-14T19:06:18.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.448 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1884e-05 s, 0.0 kB/s 2023-10-14T19:06:18.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4329e-05 s, 0.0 kB/s 2023-10-14T19:06:18.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0577e-05 s, 0.0 kB/s 2023-10-14T19:06:18.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.670 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9739e-05 s, 0.0 kB/s 2023-10-14T19:06:18.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.672 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.727 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2579e-05 s, 0.0 kB/s 2023-10-14T19:06:18.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.728 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2618e-05 s, 0.0 kB/s 2023-10-14T19:06:18.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.784 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4476e-05 s, 0.0 kB/s 2023-10-14T19:06:18.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.840 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2612e-05 s, 0.0 kB/s 2023-10-14T19:06:18.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.896 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:18.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:18.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:18.952 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0803e-05 s, 0.0 kB/s 2023-10-14T19:06:18.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:18.953 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.006 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.007 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.007 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3095e-05 s, 0.0 kB/s 2023-10-14T19:06:19.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.008 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.063 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.063 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.063 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3335e-05 s, 0.0 kB/s 2023-10-14T19:06:19.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.064 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3586e-05 s, 0.0 kB/s 2023-10-14T19:06:19.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.121 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1331e-05 s, 0.0 kB/s 2023-10-14T19:06:19.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.177 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1557e-05 s, 0.0 kB/s 2023-10-14T19:06:19.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.287 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-14T19:06:19.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.289 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1953e-05 s, 0.0 kB/s 2023-10-14T19:06:19.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.344 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5273e-05 s, 0.0 kB/s 2023-10-14T19:06:19.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.402 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.456 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4845e-05 s, 0.0 kB/s 2023-10-14T19:06:19.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.458 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.512 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.512 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.364e-05 s, 0.0 kB/s 2023-10-14T19:06:19.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.514 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3224e-05 s, 0.0 kB/s 2023-10-14T19:06:19.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.571 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.626 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1277e-05 s, 0.0 kB/s 2023-10-14T19:06:19.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.627 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3948e-05 s, 0.0 kB/s 2023-10-14T19:06:19.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.683 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.737 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.738 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9109e-05 s, 0.0 kB/s 2023-10-14T19:06:19.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.739 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.795 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2458e-05 s, 0.0 kB/s 2023-10-14T19:06:19.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.795 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0657e-05 s, 0.0 kB/s 2023-10-14T19:06:19.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.852 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.907 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3536e-05 s, 0.0 kB/s 2023-10-14T19:06:19.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.908 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2534e-05 s, 0.0 kB/s 2023-10-14T19:06:19.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:19.965 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.019 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.019 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2332e-05 s, 0.0 kB/s 2023-10-14T19:06:20.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.020 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.075 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2711e-05 s, 0.0 kB/s 2023-10-14T19:06:20.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.076 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.221e-05 s, 0.0 kB/s 2023-10-14T19:06:20.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.133 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.192 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-14T19:06:20.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.193 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.246 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.246 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.247 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2969e-05 s, 0.0 kB/s 2023-10-14T19:06:20.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.247 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.303 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2105e-05 s, 0.0 kB/s 2023-10-14T19:06:20.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.304 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.359 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0517e-05 s, 0.0 kB/s 2023-10-14T19:06:20.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.360 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.414 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.415 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2427e-05 s, 0.0 kB/s 2023-10-14T19:06:20.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.416 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.470 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.471 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.471 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9145e-05 s, 0.0 kB/s 2023-10-14T19:06:20.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.472 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.526 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.527 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.527 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3653e-05 s, 0.0 kB/s 2023-10-14T19:06:20.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.528 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.582 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.582 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.583 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0117e-05 s, 0.0 kB/s 2023-10-14T19:06:20.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.583 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1025e-05 s, 0.0 kB/s 2023-10-14T19:06:20.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.640 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.696 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.696 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.696 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1944e-05 s, 0.0 kB/s 2023-10-14T19:06:20.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.697 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2016e-05 s, 0.0 kB/s 2023-10-14T19:06:20.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.754 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9886e-05 s, 0.0 kB/s 2023-10-14T19:06:20.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.810 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0998e-05 s, 0.0 kB/s 2023-10-14T19:06:20.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3578e-05 s, 0.0 kB/s 2023-10-14T19:06:20.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1424e-05 s, 0.0 kB/s 2023-10-14T19:06:20.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:20.979 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.034 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.034 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.034 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1878e-05 s, 0.0 kB/s 2023-10-14T19:06:21.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.035 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0882e-05 s, 0.0 kB/s 2023-10-14T19:06:21.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.092 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2381e-05 s, 0.0 kB/s 2023-10-14T19:06:21.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.147 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0174e-05 s, 0.0 kB/s 2023-10-14T19:06:21.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.204 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.258 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.258 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.259 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1698e-05 s, 0.0 kB/s 2023-10-14T19:06:21.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.260 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.314 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.314 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.315 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-14T19:06:21.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.315 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1342e-05 s, 0.0 kB/s 2023-10-14T19:06:21.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.372 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.426 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.427 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.427 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1882e-05 s, 0.0 kB/s 2023-10-14T19:06:21.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.428 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.482 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.482 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4175e-05 s, 0.0 kB/s 2023-10-14T19:06:21.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.483 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.538 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.538 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.539 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4883e-05 s, 0.0 kB/s 2023-10-14T19:06:21.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.539 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1445e-05 s, 0.0 kB/s 2023-10-14T19:06:21.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.596 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.650 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.650 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.651 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.404e-05 s, 0.0 kB/s 2023-10-14T19:06:21.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.651 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.706 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.706 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.706 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2311e-05 s, 0.0 kB/s 2023-10-14T19:06:21.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.707 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1823e-05 s, 0.0 kB/s 2023-10-14T19:06:21.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.763 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.820 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5899e-05 s, 0.0 kB/s 2023-10-14T19:06:21.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.821 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3682e-05 s, 0.0 kB/s 2023-10-14T19:06:21.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.877 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2851e-05 s, 0.0 kB/s 2023-10-14T19:06:21.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.933 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.05e-05 s, 0.0 kB/s 2023-10-14T19:06:21.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:21.989 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1768e-05 s, 0.0 kB/s 2023-10-14T19:06:22.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.045 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.099 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.100 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.100 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2351e-05 s, 0.0 kB/s 2023-10-14T19:06:22.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.101 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2319e-05 s, 0.0 kB/s 2023-10-14T19:06:22.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.157 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.212 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.212 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3398e-05 s, 0.0 kB/s 2023-10-14T19:06:22.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.213 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-14T19:06:22.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.269 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.324 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.324 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9998e-05 s, 0.0 kB/s 2023-10-14T19:06:22.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.325 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.379 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.380 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.331e-05 s, 0.0 kB/s 2023-10-14T19:06:22.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.381 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.435 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.436 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.436 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3564e-05 s, 0.0 kB/s 2023-10-14T19:06:22.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.437 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.491 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.491 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.492 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4267e-05 s, 0.0 kB/s 2023-10-14T19:06:22.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.492 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.547 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.547 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.548 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.983e-05 s, 0.0 kB/s 2023-10-14T19:06:22.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.548 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.604 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3151e-05 s, 0.0 kB/s 2023-10-14T19:06:22.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.604 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1626e-05 s, 0.0 kB/s 2023-10-14T19:06:22.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.716 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2221e-05 s, 0.0 kB/s 2023-10-14T19:06:22.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.717 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2571e-05 s, 0.0 kB/s 2023-10-14T19:06:22.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3397e-05 s, 0.0 kB/s 2023-10-14T19:06:22.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.830 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1654e-05 s, 0.0 kB/s 2023-10-14T19:06:22.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.886 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.941 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1543e-05 s, 0.0 kB/s 2023-10-14T19:06:22.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2005e-05 s, 0.0 kB/s 2023-10-14T19:06:22.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:22.999 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.054 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2004e-05 s, 0.0 kB/s 2023-10-14T19:06:23.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2356e-05 s, 0.0 kB/s 2023-10-14T19:06:23.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3769e-05 s, 0.0 kB/s 2023-10-14T19:06:23.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.167 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0389e-05 s, 0.0 kB/s 2023-10-14T19:06:23.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.223 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1543e-05 s, 0.0 kB/s 2023-10-14T19:06:23.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.334 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2312e-05 s, 0.0 kB/s 2023-10-14T19:06:23.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.334 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1581e-05 s, 0.0 kB/s 2023-10-14T19:06:23.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.391 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.446 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-14T19:06:23.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.447 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.34e-05 s, 0.0 kB/s 2023-10-14T19:06:23.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8467e-05 s, 0.0 kB/s 2023-10-14T19:06:23.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.559 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1204e-05 s, 0.0 kB/s 2023-10-14T19:06:23.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4318e-05 s, 0.0 kB/s 2023-10-14T19:06:23.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.672 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5033e-05 s, 0.0 kB/s 2023-10-14T19:06:23.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.728 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.783 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2426e-05 s, 0.0 kB/s 2023-10-14T19:06:23.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.784 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.840 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5265e-05 s, 0.0 kB/s 2023-10-14T19:06:23.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.840 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4121e-05 s, 0.0 kB/s 2023-10-14T19:06:23.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:23.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:23.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:23.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2675e-05 s, 0.0 kB/s 2023-10-14T19:06:23.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:23.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3374e-05 s, 0.0 kB/s 2023-10-14T19:06:24.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3567e-05 s, 0.0 kB/s 2023-10-14T19:06:24.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.067 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1142e-05 s, 0.0 kB/s 2023-10-14T19:06:24.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.124 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.178 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2238e-05 s, 0.0 kB/s 2023-10-14T19:06:24.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.180 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.234 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.235 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.235 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0437e-05 s, 0.0 kB/s 2023-10-14T19:06:24.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.236 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.290 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.291 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.291 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2473e-05 s, 0.0 kB/s 2023-10-14T19:06:24.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.292 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0053e-05 s, 0.0 kB/s 2023-10-14T19:06:24.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.348 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.403 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9909e-05 s, 0.0 kB/s 2023-10-14T19:06:24.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.403 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0691e-05 s, 0.0 kB/s 2023-10-14T19:06:24.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.460 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.514 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.515 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.515 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0935e-05 s, 0.0 kB/s 2023-10-14T19:06:24.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.516 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0122e-05 s, 0.0 kB/s 2023-10-14T19:06:24.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.572 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1798e-05 s, 0.0 kB/s 2023-10-14T19:06:24.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.628 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9852e-05 s, 0.0 kB/s 2023-10-14T19:06:24.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.684 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.738 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8553e-05 s, 0.0 kB/s 2023-10-14T19:06:24.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.739 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2619e-05 s, 0.0 kB/s 2023-10-14T19:06:24.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.796 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.851 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.852 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.852 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.282e-05 s, 0.0 kB/s 2023-10-14T19:06:24.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.853 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1374e-05 s, 0.0 kB/s 2023-10-14T19:06:24.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:24.963 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:24.964 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:24.964 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3279e-05 s, 0.0 kB/s 2023-10-14T19:06:24.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:24.965 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.020 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5152e-05 s, 0.0 kB/s 2023-10-14T19:06:25.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.021 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5437e-05 s, 0.0 kB/s 2023-10-14T19:06:25.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.077 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.132 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.132 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1883e-05 s, 0.0 kB/s 2023-10-14T19:06:25.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.133 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8317e-05 s, 0.0 kB/s 2023-10-14T19:06:25.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.188 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-14T19:06:25.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.245 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.299 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.300 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.300 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3283e-05 s, 0.0 kB/s 2023-10-14T19:06:25.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.301 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4438e-05 s, 0.0 kB/s 2023-10-14T19:06:25.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.357 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.411 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.412 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.412 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2434e-05 s, 0.0 kB/s 2023-10-14T19:06:25.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.413 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.468 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.468 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-14T19:06:25.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.469 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2328e-05 s, 0.0 kB/s 2023-10-14T19:06:25.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.526 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.580 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.580 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.581 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-14T19:06:25.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.581 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.636 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0548e-05 s, 0.0 kB/s 2023-10-14T19:06:25.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.638 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0019e-05 s, 0.0 kB/s 2023-10-14T19:06:25.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.694 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.748 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0687e-05 s, 0.0 kB/s 2023-10-14T19:06:25.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.750 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.805 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.809 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.227e-05 s, 0.0 kB/s 2023-10-14T19:06:25.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.809 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.863 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6173e-05 s, 0.0 kB/s 2023-10-14T19:06:25.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.864 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.920 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.920 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4572e-05 s, 0.0 kB/s 2023-10-14T19:06:25.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.921 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:25.976 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:25.976 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.059e-05 s, 0.0 kB/s 2023-10-14T19:06:25.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:25.977 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.12e-05 s, 0.0 kB/s 2023-10-14T19:06:26.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.034 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.088 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2311e-05 s, 0.0 kB/s 2023-10-14T19:06:26.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.090 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1977e-05 s, 0.0 kB/s 2023-10-14T19:06:26.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.145 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.200 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.201 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.201 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3204e-05 s, 0.0 kB/s 2023-10-14T19:06:26.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.202 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.256 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5613e-05 s, 0.0 kB/s 2023-10-14T19:06:26.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.258 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.313 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1499e-05 s, 0.0 kB/s 2023-10-14T19:06:26.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.314 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1947e-05 s, 0.0 kB/s 2023-10-14T19:06:26.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.370 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.107e-05 s, 0.0 kB/s 2023-10-14T19:06:26.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.426 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.481 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0696e-05 s, 0.0 kB/s 2023-10-14T19:06:26.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.481 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.536 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.537 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.537 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1902e-05 s, 0.0 kB/s 2023-10-14T19:06:26.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.538 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8694e-05 s, 0.0 kB/s 2023-10-14T19:06:26.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.594 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.649 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2314e-05 s, 0.0 kB/s 2023-10-14T19:06:26.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.650 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1282e-05 s, 0.0 kB/s 2023-10-14T19:06:26.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7894e-05 s, 0.0 kB/s 2023-10-14T19:06:26.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.776 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0009e-05 s, 0.0 kB/s 2023-10-14T19:06:26.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.833 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.888 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.888 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.888 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-14T19:06:26.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.889 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2595e-05 s, 0.0 kB/s 2023-10-14T19:06:26.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:26.945 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2062e-05 s, 0.0 kB/s 2023-10-14T19:06:27.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.000 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.055 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-14T19:06:27.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.384e-05 s, 0.0 kB/s 2023-10-14T19:06:27.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.112 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.124e-05 s, 0.0 kB/s 2023-10-14T19:06:27.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.169 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.223 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.224 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.224 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.179e-05 s, 0.0 kB/s 2023-10-14T19:06:27.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.225 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3514e-05 s, 0.0 kB/s 2023-10-14T19:06:27.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.280 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0016e-05 s, 0.0 kB/s 2023-10-14T19:06:27.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.336 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.391 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0319e-05 s, 0.0 kB/s 2023-10-14T19:06:27.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.392 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2329e-05 s, 0.0 kB/s 2023-10-14T19:06:27.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.449 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.504 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.504 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2078e-05 s, 0.0 kB/s 2023-10-14T19:06:27.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.505 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9578e-05 s, 0.0 kB/s 2023-10-14T19:06:27.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.561 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.616 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.616 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1102e-05 s, 0.0 kB/s 2023-10-14T19:06:27.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.673 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6699e-05 s, 0.0 kB/s 2023-10-14T19:06:27.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.674 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.744 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.745 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8163e-05 s, 0.0 kB/s 2023-10-14T19:06:27.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.746 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.801 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.801 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.801 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.349e-05 s, 0.0 kB/s 2023-10-14T19:06:27.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.802 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2272e-05 s, 0.0 kB/s 2023-10-14T19:06:27.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.858 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.915 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.277e-05 s, 0.0 kB/s 2023-10-14T19:06:27.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.916 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:27.971 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:27.971 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2642e-05 s, 0.0 kB/s 2023-10-14T19:06:27.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:27.972 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.128e-05 s, 0.0 kB/s 2023-10-14T19:06:28.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.029 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.037e-05 s, 0.0 kB/s 2023-10-14T19:06:28.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.084 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.139 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.139 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1169e-05 s, 0.0 kB/s 2023-10-14T19:06:28.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.140 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.195 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0541e-05 s, 0.0 kB/s 2023-10-14T19:06:28.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0049e-05 s, 0.0 kB/s 2023-10-14T19:06:28.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.252 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9303e-05 s, 0.0 kB/s 2023-10-14T19:06:28.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2849e-05 s, 0.0 kB/s 2023-10-14T19:06:28.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-14T19:06:28.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-14T19:06:28.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.475 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.026e-05 s, 0.0 kB/s 2023-10-14T19:06:28.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.532 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4121e-05 s, 0.0 kB/s 2023-10-14T19:06:28.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.588 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2923e-05 s, 0.0 kB/s 2023-10-14T19:06:28.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.699 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.699 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0157e-05 s, 0.0 kB/s 2023-10-14T19:06:28.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.700 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0723e-05 s, 0.0 kB/s 2023-10-14T19:06:28.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.755 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2767e-05 s, 0.0 kB/s 2023-10-14T19:06:28.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.812 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.867 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3238e-05 s, 0.0 kB/s 2023-10-14T19:06:28.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.868 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1129e-05 s, 0.0 kB/s 2023-10-14T19:06:28.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.925 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9027e-05 s, 0.0 kB/s 2023-10-14T19:06:28.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:28.982 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4415e-05 s, 0.0 kB/s 2023-10-14T19:06:29.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.038 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3839e-05 s, 0.0 kB/s 2023-10-14T19:06:29.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.094 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.149 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0369e-05 s, 0.0 kB/s 2023-10-14T19:06:29.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.150 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2576e-05 s, 0.0 kB/s 2023-10-14T19:06:29.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0362e-05 s, 0.0 kB/s 2023-10-14T19:06:29.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.317 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0908e-05 s, 0.0 kB/s 2023-10-14T19:06:29.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.318 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.373 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9317e-05 s, 0.0 kB/s 2023-10-14T19:06:29.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.429 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2993e-05 s, 0.0 kB/s 2023-10-14T19:06:29.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.430 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.484 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.485 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3349e-05 s, 0.0 kB/s 2023-10-14T19:06:29.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.486 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.541 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0832e-05 s, 0.0 kB/s 2023-10-14T19:06:29.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.542 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.598 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0788e-05 s, 0.0 kB/s 2023-10-14T19:06:29.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.599 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.654 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2009e-05 s, 0.0 kB/s 2023-10-14T19:06:29.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.655 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.710 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.711 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1886e-05 s, 0.0 kB/s 2023-10-14T19:06:29.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.766 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4367e-05 s, 0.0 kB/s 2023-10-14T19:06:29.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.823 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.975e-05 s, 0.0 kB/s 2023-10-14T19:06:29.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.823 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.347e-05 s, 0.0 kB/s 2023-10-14T19:06:29.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.881 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.936 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.936 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.936 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3681e-05 s, 0.0 kB/s 2023-10-14T19:06:29.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.937 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:29.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:29.993 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:29.993 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2764e-05 s, 0.0 kB/s 2023-10-14T19:06:29.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:29.994 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1069e-05 s, 0.0 kB/s 2023-10-14T19:06:30.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.049 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.105 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1258e-05 s, 0.0 kB/s 2023-10-14T19:06:30.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.105 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.160 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2026e-05 s, 0.0 kB/s 2023-10-14T19:06:30.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.162 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4921e-05 s, 0.0 kB/s 2023-10-14T19:06:30.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.218 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3173e-05 s, 0.0 kB/s 2023-10-14T19:06:30.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.275 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.331 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1428e-05 s, 0.0 kB/s 2023-10-14T19:06:30.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2083e-05 s, 0.0 kB/s 2023-10-14T19:06:30.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.388 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.143e-05 s, 0.0 kB/s 2023-10-14T19:06:30.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.444 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.94e-05 s, 0.0 kB/s 2023-10-14T19:06:30.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.500 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.555 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0674e-05 s, 0.0 kB/s 2023-10-14T19:06:30.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.556 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3821e-05 s, 0.0 kB/s 2023-10-14T19:06:30.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.612 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.666 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.667 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4331e-05 s, 0.0 kB/s 2023-10-14T19:06:30.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.723 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4202e-05 s, 0.0 kB/s 2023-10-14T19:06:30.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.724 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.780 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2184e-05 s, 0.0 kB/s 2023-10-14T19:06:30.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.837 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0842e-05 s, 0.0 kB/s 2023-10-14T19:06:30.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.838 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.358e-05 s, 0.0 kB/s 2023-10-14T19:06:30.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2467e-05 s, 0.0 kB/s 2023-10-14T19:06:30.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:30.951 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3063e-05 s, 0.0 kB/s 2023-10-14T19:06:31.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.007 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1037e-05 s, 0.0 kB/s 2023-10-14T19:06:31.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.063 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.119 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2845e-05 s, 0.0 kB/s 2023-10-14T19:06:31.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.120 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3557e-05 s, 0.0 kB/s 2023-10-14T19:06:31.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.175 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.230 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.230 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2572e-05 s, 0.0 kB/s 2023-10-14T19:06:31.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.287 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9783e-05 s, 0.0 kB/s 2023-10-14T19:06:31.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.287 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2034e-05 s, 0.0 kB/s 2023-10-14T19:06:31.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.343 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.399 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.995e-05 s, 0.0 kB/s 2023-10-14T19:06:31.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.399 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3439e-05 s, 0.0 kB/s 2023-10-14T19:06:31.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.456 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.511 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4587e-05 s, 0.0 kB/s 2023-10-14T19:06:31.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.511 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2087e-05 s, 0.0 kB/s 2023-10-14T19:06:31.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.622 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9479e-05 s, 0.0 kB/s 2023-10-14T19:06:31.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.623 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.679 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1168e-05 s, 0.0 kB/s 2023-10-14T19:06:31.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.680 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.281e-05 s, 0.0 kB/s 2023-10-14T19:06:31.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.736 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3527e-05 s, 0.0 kB/s 2023-10-14T19:06:31.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2496e-05 s, 0.0 kB/s 2023-10-14T19:06:31.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7837e-05 s, 0.0 kB/s 2023-10-14T19:06:31.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.904 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0775e-05 s, 0.0 kB/s 2023-10-14T19:06:31.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:31.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.368e-05 s, 0.0 kB/s 2023-10-14T19:06:32.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.015 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1613e-05 s, 0.0 kB/s 2023-10-14T19:06:32.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.071 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8349e-05 s, 0.0 kB/s 2023-10-14T19:06:32.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.128 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.182 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.182 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.183 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9331e-05 s, 0.0 kB/s 2023-10-14T19:06:32.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.183 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.238 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.239 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.239 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3454e-05 s, 0.0 kB/s 2023-10-14T19:06:32.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.240 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0946e-05 s, 0.0 kB/s 2023-10-14T19:06:32.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.296 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.350 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3172e-05 s, 0.0 kB/s 2023-10-14T19:06:32.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.352 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.407 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.407 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.083e-05 s, 0.0 kB/s 2023-10-14T19:06:32.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.408 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.462 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.463 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.463 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.983e-05 s, 0.0 kB/s 2023-10-14T19:06:32.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.464 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.518 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-14T19:06:32.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.520 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4298e-05 s, 0.0 kB/s 2023-10-14T19:06:32.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.576 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.631 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2203e-05 s, 0.0 kB/s 2023-10-14T19:06:32.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.632 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2159e-05 s, 0.0 kB/s 2023-10-14T19:06:32.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.688 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.742 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.743 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.743 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.228e-05 s, 0.0 kB/s 2023-10-14T19:06:32.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.744 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.799 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1678e-05 s, 0.0 kB/s 2023-10-14T19:06:32.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.800 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.855 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.855 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.855 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2213e-05 s, 0.0 kB/s 2023-10-14T19:06:32.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.856 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.913 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.674e-05 s, 0.0 kB/s 2023-10-14T19:06:32.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.914 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:32.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:32.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:32.970 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2636e-05 s, 0.0 kB/s 2023-10-14T19:06:32.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:32.971 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3458e-05 s, 0.0 kB/s 2023-10-14T19:06:33.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.027 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0892e-05 s, 0.0 kB/s 2023-10-14T19:06:33.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1307e-05 s, 0.0 kB/s 2023-10-14T19:06:33.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.194 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1188e-05 s, 0.0 kB/s 2023-10-14T19:06:33.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.250 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3562e-05 s, 0.0 kB/s 2023-10-14T19:06:33.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0445e-05 s, 0.0 kB/s 2023-10-14T19:06:33.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.362 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8807e-05 s, 0.0 kB/s 2023-10-14T19:06:33.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.417 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.418 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2984e-05 s, 0.0 kB/s 2023-10-14T19:06:33.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.474 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0234e-05 s, 0.0 kB/s 2023-10-14T19:06:33.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.475 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.531 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0238e-05 s, 0.0 kB/s 2023-10-14T19:06:33.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.532 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.587 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3669e-05 s, 0.0 kB/s 2023-10-14T19:06:33.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.588 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0934e-05 s, 0.0 kB/s 2023-10-14T19:06:33.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.701 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.124e-05 s, 0.0 kB/s 2023-10-14T19:06:33.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.702 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2752e-05 s, 0.0 kB/s 2023-10-14T19:06:33.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.758 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1704e-05 s, 0.0 kB/s 2023-10-14T19:06:33.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.814 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0735e-05 s, 0.0 kB/s 2023-10-14T19:06:33.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.870 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2162e-05 s, 0.0 kB/s 2023-10-14T19:06:33.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.926 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3014e-05 s, 0.0 kB/s 2023-10-14T19:06:33.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:33.982 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1685e-05 s, 0.0 kB/s 2023-10-14T19:06:34.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.039 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-14T19:06:34.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.095 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3483e-05 s, 0.0 kB/s 2023-10-14T19:06:34.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2174e-05 s, 0.0 kB/s 2023-10-14T19:06:34.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.207 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0967e-05 s, 0.0 kB/s 2023-10-14T19:06:34.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2218e-05 s, 0.0 kB/s 2023-10-14T19:06:34.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9534e-05 s, 0.0 kB/s 2023-10-14T19:06:34.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.375 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0787e-05 s, 0.0 kB/s 2023-10-14T19:06:34.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.431 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2527e-05 s, 0.0 kB/s 2023-10-14T19:06:34.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.487 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.542 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0315e-05 s, 0.0 kB/s 2023-10-14T19:06:34.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.543 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.597 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.598 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.348e-05 s, 0.0 kB/s 2023-10-14T19:06:34.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.599 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.653 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.236e-05 s, 0.0 kB/s 2023-10-14T19:06:34.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.655 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.710 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0691e-05 s, 0.0 kB/s 2023-10-14T19:06:34.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.711 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.765 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.765 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4292e-05 s, 0.0 kB/s 2023-10-14T19:06:34.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.766 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3667e-05 s, 0.0 kB/s 2023-10-14T19:06:34.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.823 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.877 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-14T19:06:34.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.879 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1413e-05 s, 0.0 kB/s 2023-10-14T19:06:34.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.935 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:34.990 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:34.991 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:34.991 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4578e-05 s, 0.0 kB/s 2023-10-14T19:06:34.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:34.992 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0749e-05 s, 0.0 kB/s 2023-10-14T19:06:35.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.048 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.103 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3836e-05 s, 0.0 kB/s 2023-10-14T19:06:35.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.104 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.159 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.159 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2656e-05 s, 0.0 kB/s 2023-10-14T19:06:35.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.160 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.215 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.361e-05 s, 0.0 kB/s 2023-10-14T19:06:35.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.216 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.837e-05 s, 0.0 kB/s 2023-10-14T19:06:35.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.271 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1281e-05 s, 0.0 kB/s 2023-10-14T19:06:35.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8857e-05 s, 0.0 kB/s 2023-10-14T19:06:35.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.384 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-14T19:06:35.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.440 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.495 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.495 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0623e-05 s, 0.0 kB/s 2023-10-14T19:06:35.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.496 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.502e-05 s, 0.0 kB/s 2023-10-14T19:06:35.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.552 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.009e-05 s, 0.0 kB/s 2023-10-14T19:06:35.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.608 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.662 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1027e-05 s, 0.0 kB/s 2023-10-14T19:06:35.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.664 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4479e-05 s, 0.0 kB/s 2023-10-14T19:06:35.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.720 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.775 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.775 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-14T19:06:35.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.776 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.831 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.831 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.831 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2129e-05 s, 0.0 kB/s 2023-10-14T19:06:35.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.832 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.887 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.887 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.887 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9489e-05 s, 0.0 kB/s 2023-10-14T19:06:35.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.888 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2539e-05 s, 0.0 kB/s 2023-10-14T19:06:35.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:35.944 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1441e-05 s, 0.0 kB/s 2023-10-14T19:06:36.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.001 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.057 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.057 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.058 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1464e-05 s, 0.0 kB/s 2023-10-14T19:06:36.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.059 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.113 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4458e-05 s, 0.0 kB/s 2023-10-14T19:06:36.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.115 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.170 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.170 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2336e-05 s, 0.0 kB/s 2023-10-14T19:06:36.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.171 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2532e-05 s, 0.0 kB/s 2023-10-14T19:06:36.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.226 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0046e-05 s, 0.0 kB/s 2023-10-14T19:06:36.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.283 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.338 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.338 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3043e-05 s, 0.0 kB/s 2023-10-14T19:06:36.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.339 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.393 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.393 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.393 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3967e-05 s, 0.0 kB/s 2023-10-14T19:06:36.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.394 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.449 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0589e-05 s, 0.0 kB/s 2023-10-14T19:06:36.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.451 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.505 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.505 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.505 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2166e-05 s, 0.0 kB/s 2023-10-14T19:06:36.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.506 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.561 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.561 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.561 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9675e-05 s, 0.0 kB/s 2023-10-14T19:06:36.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.562 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.618 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.618 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-14T19:06:36.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.619 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.673 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.673 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.674 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3635e-05 s, 0.0 kB/s 2023-10-14T19:06:36.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.675 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.729 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3712e-05 s, 0.0 kB/s 2023-10-14T19:06:36.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.731 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1821e-05 s, 0.0 kB/s 2023-10-14T19:06:36.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.787 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5241e-05 s, 0.0 kB/s 2023-10-14T19:06:36.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.844 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.900 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.900 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.132e-05 s, 0.0 kB/s 2023-10-14T19:06:36.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.901 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:36.955 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:36.956 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:36.956 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3219e-05 s, 0.0 kB/s 2023-10-14T19:06:36.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:36.957 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.027 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8986e-05 s, 0.0 kB/s 2023-10-14T19:06:37.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.028 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.081 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2606e-05 s, 0.0 kB/s 2023-10-14T19:06:37.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2097e-05 s, 0.0 kB/s 2023-10-14T19:06:37.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.194 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0009e-05 s, 0.0 kB/s 2023-10-14T19:06:37.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.250 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0437e-05 s, 0.0 kB/s 2023-10-14T19:06:37.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9354e-05 s, 0.0 kB/s 2023-10-14T19:06:37.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1488e-05 s, 0.0 kB/s 2023-10-14T19:06:37.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.417 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.418 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1854e-05 s, 0.0 kB/s 2023-10-14T19:06:37.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.474 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0295e-05 s, 0.0 kB/s 2023-10-14T19:06:37.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.474 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.530 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.530 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0538e-05 s, 0.0 kB/s 2023-10-14T19:06:37.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.531 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0361e-05 s, 0.0 kB/s 2023-10-14T19:06:37.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4055e-05 s, 0.0 kB/s 2023-10-14T19:06:37.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.700 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1432e-05 s, 0.0 kB/s 2023-10-14T19:06:37.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.701 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1646e-05 s, 0.0 kB/s 2023-10-14T19:06:37.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.757 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.813 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2338e-05 s, 0.0 kB/s 2023-10-14T19:06:37.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.813 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.869 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1999e-05 s, 0.0 kB/s 2023-10-14T19:06:37.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.870 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.927 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4067e-05 s, 0.0 kB/s 2023-10-14T19:06:37.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.927 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:37.982 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:37.982 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:37.982 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1616e-05 s, 0.0 kB/s 2023-10-14T19:06:37.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:37.983 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.039 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.039 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2595e-05 s, 0.0 kB/s 2023-10-14T19:06:38.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.040 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.095 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3044e-05 s, 0.0 kB/s 2023-10-14T19:06:38.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.095 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2615e-05 s, 0.0 kB/s 2023-10-14T19:06:38.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.207 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0848e-05 s, 0.0 kB/s 2023-10-14T19:06:38.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.208 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3511e-05 s, 0.0 kB/s 2023-10-14T19:06:38.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.264 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.319 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.319 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4142e-05 s, 0.0 kB/s 2023-10-14T19:06:38.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.320 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0533e-05 s, 0.0 kB/s 2023-10-14T19:06:38.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.376 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-14T19:06:38.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.431 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.117e-05 s, 0.0 kB/s 2023-10-14T19:06:38.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.487 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0136e-05 s, 0.0 kB/s 2023-10-14T19:06:38.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.544 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1246e-05 s, 0.0 kB/s 2023-10-14T19:06:38.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.599 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0845e-05 s, 0.0 kB/s 2023-10-14T19:06:38.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.655 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.710 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.710 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.710 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2996e-05 s, 0.0 kB/s 2023-10-14T19:06:38.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.711 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1342e-05 s, 0.0 kB/s 2023-10-14T19:06:38.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.822 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.823 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.823 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2415e-05 s, 0.0 kB/s 2023-10-14T19:06:38.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.824 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3725e-05 s, 0.0 kB/s 2023-10-14T19:06:38.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.880 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.935 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.936 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.936 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1129e-05 s, 0.0 kB/s 2023-10-14T19:06:38.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.937 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:38.991 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:38.992 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:38.992 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.243e-05 s, 0.0 kB/s 2023-10-14T19:06:38.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:38.993 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.048 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.048 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0997e-05 s, 0.0 kB/s 2023-10-14T19:06:39.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.049 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3765e-05 s, 0.0 kB/s 2023-10-14T19:06:39.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.107 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.163 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3651e-05 s, 0.0 kB/s 2023-10-14T19:06:39.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.164 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.219 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1817e-05 s, 0.0 kB/s 2023-10-14T19:06:39.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.220 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0852e-05 s, 0.0 kB/s 2023-10-14T19:06:39.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.277 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.331 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.332 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.332 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0843e-05 s, 0.0 kB/s 2023-10-14T19:06:39.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.333 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0316e-05 s, 0.0 kB/s 2023-10-14T19:06:39.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.389 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2895e-05 s, 0.0 kB/s 2023-10-14T19:06:39.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.444 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.500 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1133e-05 s, 0.0 kB/s 2023-10-14T19:06:39.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.500 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-14T19:06:39.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.557 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2543e-05 s, 0.0 kB/s 2023-10-14T19:06:39.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.613 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.668 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.668 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2296e-05 s, 0.0 kB/s 2023-10-14T19:06:39.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.669 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.724 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.724 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3739e-05 s, 0.0 kB/s 2023-10-14T19:06:39.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.725 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.780 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4958e-05 s, 0.0 kB/s 2023-10-14T19:06:39.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.836 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2427e-05 s, 0.0 kB/s 2023-10-14T19:06:39.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.837 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4409e-05 s, 0.0 kB/s 2023-10-14T19:06:39.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:39.949 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:39.949 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.276e-05 s, 0.0 kB/s 2023-10-14T19:06:39.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:39.950 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9178e-05 s, 0.0 kB/s 2023-10-14T19:06:40.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.005 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.061 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3581e-05 s, 0.0 kB/s 2023-10-14T19:06:40.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.062 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.116 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.117 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.117 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1179e-05 s, 0.0 kB/s 2023-10-14T19:06:40.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.118 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1691e-05 s, 0.0 kB/s 2023-10-14T19:06:40.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.175 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.464e-05 s, 0.0 kB/s 2023-10-14T19:06:40.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.230 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.285 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2033e-05 s, 0.0 kB/s 2023-10-14T19:06:40.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.286 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2196e-05 s, 0.0 kB/s 2023-10-14T19:06:40.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.342 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.396 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.397 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.397 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3347e-05 s, 0.0 kB/s 2023-10-14T19:06:40.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.398 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.339e-05 s, 0.0 kB/s 2023-10-14T19:06:40.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.454 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0881e-05 s, 0.0 kB/s 2023-10-14T19:06:40.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.510 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0407e-05 s, 0.0 kB/s 2023-10-14T19:06:40.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.566 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.622 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2506e-05 s, 0.0 kB/s 2023-10-14T19:06:40.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.623 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.244e-05 s, 0.0 kB/s 2023-10-14T19:06:40.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.679 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2639e-05 s, 0.0 kB/s 2023-10-14T19:06:40.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.735 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9279e-05 s, 0.0 kB/s 2023-10-14T19:06:40.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2764e-05 s, 0.0 kB/s 2023-10-14T19:06:40.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.852 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4864e-05 s, 0.0 kB/s 2023-10-14T19:06:40.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4038e-05 s, 0.0 kB/s 2023-10-14T19:06:40.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:40.966 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.021 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.021 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5808e-05 s, 0.0 kB/s 2023-10-14T19:06:41.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.022 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0628e-05 s, 0.0 kB/s 2023-10-14T19:06:41.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.079 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.134 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.032e-05 s, 0.0 kB/s 2023-10-14T19:06:41.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.135 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.189 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-14T19:06:41.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.191 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.245 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.246 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.246 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0841e-05 s, 0.0 kB/s 2023-10-14T19:06:41.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.247 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9617e-05 s, 0.0 kB/s 2023-10-14T19:06:41.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.303 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2864e-05 s, 0.0 kB/s 2023-10-14T19:06:41.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.358 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2719e-05 s, 0.0 kB/s 2023-10-14T19:06:41.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.415 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.470 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1279e-05 s, 0.0 kB/s 2023-10-14T19:06:41.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.470 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-14T19:06:41.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.526 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.582 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-14T19:06:41.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.583 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.637 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.638 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3052e-05 s, 0.0 kB/s 2023-10-14T19:06:41.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.639 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.694 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.694 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1141e-05 s, 0.0 kB/s 2023-10-14T19:06:41.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.695 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.750 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4334e-05 s, 0.0 kB/s 2023-10-14T19:06:41.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.751 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.806 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9603e-05 s, 0.0 kB/s 2023-10-14T19:06:41.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.807 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.861 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1517e-05 s, 0.0 kB/s 2023-10-14T19:06:41.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.863 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0019e-05 s, 0.0 kB/s 2023-10-14T19:06:41.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.919 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:41.973 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1803e-05 s, 0.0 kB/s 2023-10-14T19:06:41.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:41.975 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.029 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.030 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.030 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3169e-05 s, 0.0 kB/s 2023-10-14T19:06:42.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.031 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2686e-05 s, 0.0 kB/s 2023-10-14T19:06:42.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.087 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.142 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2669e-05 s, 0.0 kB/s 2023-10-14T19:06:42.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.144 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1811e-05 s, 0.0 kB/s 2023-10-14T19:06:42.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.200 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.254 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3951e-05 s, 0.0 kB/s 2023-10-14T19:06:42.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.256 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.311 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.311 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.311 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2204e-05 s, 0.0 kB/s 2023-10-14T19:06:42.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.312 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.367 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.367 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0668e-05 s, 0.0 kB/s 2023-10-14T19:06:42.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.368 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.423 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.423 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1194e-05 s, 0.0 kB/s 2023-10-14T19:06:42.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.424 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0412e-05 s, 0.0 kB/s 2023-10-14T19:06:42.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.482 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.208e-05 s, 0.0 kB/s 2023-10-14T19:06:42.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-14T19:06:42.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.592 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.159e-05 s, 0.0 kB/s 2023-10-14T19:06:42.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.647 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.702 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.702 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-14T19:06:42.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.703 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-14T19:06:42.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.760 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0839e-05 s, 0.0 kB/s 2023-10-14T19:06:42.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.816 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.872 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8902e-05 s, 0.0 kB/s 2023-10-14T19:06:42.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.873 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.928 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.929 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9355e-05 s, 0.0 kB/s 2023-10-14T19:06:42.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.930 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:42.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:42.985 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:42.985 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2207e-05 s, 0.0 kB/s 2023-10-14T19:06:42.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:42.986 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2768e-05 s, 0.0 kB/s 2023-10-14T19:06:43.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.042 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3169e-05 s, 0.0 kB/s 2023-10-14T19:06:43.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.098 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4967e-05 s, 0.0 kB/s 2023-10-14T19:06:43.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.161 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-14T19:06:43.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.218 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.272 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-14T19:06:43.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.274 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.328 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.328 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0816e-05 s, 0.0 kB/s 2023-10-14T19:06:43.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.329 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.386 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.386 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4947e-05 s, 0.0 kB/s 2023-10-14T19:06:43.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.387 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.441 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.442 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8324e-05 s, 0.0 kB/s 2023-10-14T19:06:43.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.443 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.498 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0651e-05 s, 0.0 kB/s 2023-10-14T19:06:43.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.499 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2175e-05 s, 0.0 kB/s 2023-10-14T19:06:43.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.555 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.610 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3966e-05 s, 0.0 kB/s 2023-10-14T19:06:43.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.610 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.666 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1457e-05 s, 0.0 kB/s 2023-10-14T19:06:43.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.666 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.722 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0171e-05 s, 0.0 kB/s 2023-10-14T19:06:43.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.723 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-14T19:06:43.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.779 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.834 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9299e-05 s, 0.0 kB/s 2023-10-14T19:06:43.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.835 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9514e-05 s, 0.0 kB/s 2023-10-14T19:06:43.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.891 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:43.945 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:43.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:43.946 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0904e-05 s, 0.0 kB/s 2023-10-14T19:06:43.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:43.947 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.001 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.002 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.002 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3387e-05 s, 0.0 kB/s 2023-10-14T19:06:44.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.003 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0331e-05 s, 0.0 kB/s 2023-10-14T19:06:44.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.060 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.116 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1162e-05 s, 0.0 kB/s 2023-10-14T19:06:44.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.116 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.174 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3259e-05 s, 0.0 kB/s 2023-10-14T19:06:44.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.174 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.230 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.230 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1886e-05 s, 0.0 kB/s 2023-10-14T19:06:44.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.231 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.286 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1978e-05 s, 0.0 kB/s 2023-10-14T19:06:44.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.287 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9793e-05 s, 0.0 kB/s 2023-10-14T19:06:44.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.342 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.399 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3551e-05 s, 0.0 kB/s 2023-10-14T19:06:44.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.400 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2946e-05 s, 0.0 kB/s 2023-10-14T19:06:44.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.456 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2587e-05 s, 0.0 kB/s 2023-10-14T19:06:44.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.512 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0949e-05 s, 0.0 kB/s 2023-10-14T19:06:44.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2411e-05 s, 0.0 kB/s 2023-10-14T19:06:44.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.625 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2616e-05 s, 0.0 kB/s 2023-10-14T19:06:44.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.680 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1341e-05 s, 0.0 kB/s 2023-10-14T19:06:44.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.736 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4389e-05 s, 0.0 kB/s 2023-10-14T19:06:44.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.848 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.848 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0769e-05 s, 0.0 kB/s 2023-10-14T19:06:44.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.849 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.904 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.508e-05 s, 0.0 kB/s 2023-10-14T19:06:44.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.905 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:44.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:44.960 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:44.960 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1864e-05 s, 0.0 kB/s 2023-10-14T19:06:44.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:44.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.015 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.016 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1475e-05 s, 0.0 kB/s 2023-10-14T19:06:45.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.017 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.071 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2699e-05 s, 0.0 kB/s 2023-10-14T19:06:45.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.073 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.124e-05 s, 0.0 kB/s 2023-10-14T19:06:45.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.129 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.304e-05 s, 0.0 kB/s 2023-10-14T19:06:45.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.185 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1818e-05 s, 0.0 kB/s 2023-10-14T19:06:45.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.241 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.295 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.296 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.296 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0239e-05 s, 0.0 kB/s 2023-10-14T19:06:45.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.297 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.353 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9923e-05 s, 0.0 kB/s 2023-10-14T19:06:45.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.354 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1192e-05 s, 0.0 kB/s 2023-10-14T19:06:45.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.410 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-14T19:06:45.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.467 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.522 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1505e-05 s, 0.0 kB/s 2023-10-14T19:06:45.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.523 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.578 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2668e-05 s, 0.0 kB/s 2023-10-14T19:06:45.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0156e-05 s, 0.0 kB/s 2023-10-14T19:06:45.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.635 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.690 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0264e-05 s, 0.0 kB/s 2023-10-14T19:06:45.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.747 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.747 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2212e-05 s, 0.0 kB/s 2023-10-14T19:06:45.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.748 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0728e-05 s, 0.0 kB/s 2023-10-14T19:06:45.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.804 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0471e-05 s, 0.0 kB/s 2023-10-14T19:06:45.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.860 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1318e-05 s, 0.0 kB/s 2023-10-14T19:06:45.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.917 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5154e-05 s, 0.0 kB/s 2023-10-14T19:06:45.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:45.973 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2482e-05 s, 0.0 kB/s 2023-10-14T19:06:46.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.029 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.083 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1615e-05 s, 0.0 kB/s 2023-10-14T19:06:46.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.085 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2117e-05 s, 0.0 kB/s 2023-10-14T19:06:46.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.141 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2892e-05 s, 0.0 kB/s 2023-10-14T19:06:46.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.197 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2109e-05 s, 0.0 kB/s 2023-10-14T19:06:46.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.253 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.309 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.337 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.337 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1054e-05 s, 0.0 kB/s 2023-10-14T19:06:46.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.338 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.366 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.366 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.367 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0918e-05 s, 0.0 kB/s 2023-10-14T19:06:46.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.368 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.918e-05 s, 0.0 kB/s 2023-10-14T19:06:46.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.423 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4316e-05 s, 0.0 kB/s 2023-10-14T19:06:46.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.480 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3786e-05 s, 0.0 kB/s 2023-10-14T19:06:46.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.591 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9061e-05 s, 0.0 kB/s 2023-10-14T19:06:46.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.592 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.646 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4733e-05 s, 0.0 kB/s 2023-10-14T19:06:46.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.648 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4219e-05 s, 0.0 kB/s 2023-10-14T19:06:46.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.704 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0611e-05 s, 0.0 kB/s 2023-10-14T19:06:46.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.760 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.33e-05 s, 0.0 kB/s 2023-10-14T19:06:46.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.816 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2129e-05 s, 0.0 kB/s 2023-10-14T19:06:46.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.874 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.929 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2398e-05 s, 0.0 kB/s 2023-10-14T19:06:46.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.930 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:46.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:46.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:46.985 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8529e-05 s, 0.0 kB/s 2023-10-14T19:06:46.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:46.985 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-14T19:06:47.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.042 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.218e-05 s, 0.0 kB/s 2023-10-14T19:06:47.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.098 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-14T19:06:47.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.154 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0159e-05 s, 0.0 kB/s 2023-10-14T19:06:47.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.210 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.999e-05 s, 0.0 kB/s 2023-10-14T19:06:47.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.266 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.247e-05 s, 0.0 kB/s 2023-10-14T19:06:47.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.322 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.378 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.378 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.378 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0758e-05 s, 0.0 kB/s 2023-10-14T19:06:47.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.379 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0423e-05 s, 0.0 kB/s 2023-10-14T19:06:47.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.435 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.201e-05 s, 0.0 kB/s 2023-10-14T19:06:47.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.491 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9769e-05 s, 0.0 kB/s 2023-10-14T19:06:47.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.546 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4473e-05 s, 0.0 kB/s 2023-10-14T19:06:47.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.603 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1757e-05 s, 0.0 kB/s 2023-10-14T19:06:47.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.659 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2748e-05 s, 0.0 kB/s 2023-10-14T19:06:47.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.715 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.770 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2469e-05 s, 0.0 kB/s 2023-10-14T19:06:47.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.825 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.826 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.826 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1405e-05 s, 0.0 kB/s 2023-10-14T19:06:47.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.827 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.881 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2693e-05 s, 0.0 kB/s 2023-10-14T19:06:47.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.883 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1016e-05 s, 0.0 kB/s 2023-10-14T19:06:47.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.939 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1151e-05 s, 0.0 kB/s 2023-10-14T19:06:47.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:47.996 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.050 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2365e-05 s, 0.0 kB/s 2023-10-14T19:06:48.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.052 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0094e-05 s, 0.0 kB/s 2023-10-14T19:06:48.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.108 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.163 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5197e-05 s, 0.0 kB/s 2023-10-14T19:06:48.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.164 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.219 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0226e-05 s, 0.0 kB/s 2023-10-14T19:06:48.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.220 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.274 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.274 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.274 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0017e-05 s, 0.0 kB/s 2023-10-14T19:06:48.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.275 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4558e-05 s, 0.0 kB/s 2023-10-14T19:06:48.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3542e-05 s, 0.0 kB/s 2023-10-14T19:06:48.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.388 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:48.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3213e-05 s, 0.0 kB/s 2023-10-14T19:06:48.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.444 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.534 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0689e-05 s, 0.0 kB/s 2023-10-14T19:06:48.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.589 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.590 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.590 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9337e-05 s, 0.0 kB/s 2023-10-14T19:06:48.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.591 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.645 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.646 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.646 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2408e-05 s, 0.0 kB/s 2023-10-14T19:06:48.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.647 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.228e-05 s, 0.0 kB/s 2023-10-14T19:06:48.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.703 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 5.278e-05 s, 0.0 kB/s 2023-10-14T19:06:48.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.794 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2097e-05 s, 0.0 kB/s 2023-10-14T19:06:48.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.811 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.868 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.628e-05 s, 0.0 kB/s 2023-10-14T19:06:48.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.869 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-14T19:06:48.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.924 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5386e-05 s, 0.0 kB/s 2023-10-14T19:06:48.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:48.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-14T19:06:49.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3616e-05 s, 0.0 kB/s 2023-10-14T19:06:49.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6396e-05 s, 0.0 kB/s 2023-10-14T19:06:49.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9704e-05 s, 0.0 kB/s 2023-10-14T19:06:49.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.260 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0474e-05 s, 0.0 kB/s 2023-10-14T19:06:49.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.315 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.316 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2169e-05 s, 0.0 kB/s 2023-10-14T19:06:49.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.317 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3853e-05 s, 0.0 kB/s 2023-10-14T19:06:49.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.373 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2085e-05 s, 0.0 kB/s 2023-10-14T19:06:49.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.429 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-14T19:06:49.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.484 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.540 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3623e-05 s, 0.0 kB/s 2023-10-14T19:06:49.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.541 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.595 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.595 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.596 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1708e-05 s, 0.0 kB/s 2023-10-14T19:06:49.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.596 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.651 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.652 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2281e-05 s, 0.0 kB/s 2023-10-14T19:06:49.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.653 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.707 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.708 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2914e-05 s, 0.0 kB/s 2023-10-14T19:06:49.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.709 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.764 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2295e-05 s, 0.0 kB/s 2023-10-14T19:06:49.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.764 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.819 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.820 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.820 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9765e-05 s, 0.0 kB/s 2023-10-14T19:06:49.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.821 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9587e-05 s, 0.0 kB/s 2023-10-14T19:06:49.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.877 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.931 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.932 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5073e-05 s, 0.0 kB/s 2023-10-14T19:06:49.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.933 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:49.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:49.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:49.988 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3494e-05 s, 0.0 kB/s 2023-10-14T19:06:49.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:49.989 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.045 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.045 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.045 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.186e-05 s, 0.0 kB/s 2023-10-14T19:06:50.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.046 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2801e-05 s, 0.0 kB/s 2023-10-14T19:06:50.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.103 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1725e-05 s, 0.0 kB/s 2023-10-14T19:06:50.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.159 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3656e-05 s, 0.0 kB/s 2023-10-14T19:06:50.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.215 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.271 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1771e-05 s, 0.0 kB/s 2023-10-14T19:06:50.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.272 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.327 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.271e-05 s, 0.0 kB/s 2023-10-14T19:06:50.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3182e-05 s, 0.0 kB/s 2023-10-14T19:06:50.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.384 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.438 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4964e-05 s, 0.0 kB/s 2023-10-14T19:06:50.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.440 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3882e-05 s, 0.0 kB/s 2023-10-14T19:06:50.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.496 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.551 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.551 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.552 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0742e-05 s, 0.0 kB/s 2023-10-14T19:06:50.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.552 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.609 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3876e-05 s, 0.0 kB/s 2023-10-14T19:06:50.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.610 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.664 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.665 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0086e-05 s, 0.0 kB/s 2023-10-14T19:06:50.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.666 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0949e-05 s, 0.0 kB/s 2023-10-14T19:06:50.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.721 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.778 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3482e-05 s, 0.0 kB/s 2023-10-14T19:06:50.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.779 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.834 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9486e-05 s, 0.0 kB/s 2023-10-14T19:06:50.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.835 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2571e-05 s, 0.0 kB/s 2023-10-14T19:06:50.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.891 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:50.945 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:50.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:50.946 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1062e-05 s, 0.0 kB/s 2023-10-14T19:06:50.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:50.947 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.001 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0351e-05 s, 0.0 kB/s 2023-10-14T19:06:51.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.003 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.057 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.058 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.058 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1344e-05 s, 0.0 kB/s 2023-10-14T19:06:51.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.059 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1113e-05 s, 0.0 kB/s 2023-10-14T19:06:51.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.115 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.170 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.170 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3911e-05 s, 0.0 kB/s 2023-10-14T19:06:51.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.171 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.101e-05 s, 0.0 kB/s 2023-10-14T19:06:51.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.227 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.282 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.282 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.283 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3488e-05 s, 0.0 kB/s 2023-10-14T19:06:51.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.283 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4018e-05 s, 0.0 kB/s 2023-10-14T19:06:51.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.340 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.394 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.395 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.395 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1268e-05 s, 0.0 kB/s 2023-10-14T19:06:51.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.396 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9161e-05 s, 0.0 kB/s 2023-10-14T19:06:51.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.451 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.506 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.506 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.506 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0695e-05 s, 0.0 kB/s 2023-10-14T19:06:51.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.508 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.563 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9831e-05 s, 0.0 kB/s 2023-10-14T19:06:51.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.565 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.619 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2907e-05 s, 0.0 kB/s 2023-10-14T19:06:51.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.621 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.134e-05 s, 0.0 kB/s 2023-10-14T19:06:51.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.678 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.733 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.733 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3794e-05 s, 0.0 kB/s 2023-10-14T19:06:51.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.734 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1401e-05 s, 0.0 kB/s 2023-10-14T19:06:51.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.789 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0166e-05 s, 0.0 kB/s 2023-10-14T19:06:51.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.846 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.901 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.901 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.901 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4304e-05 s, 0.0 kB/s 2023-10-14T19:06:51.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.902 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:51.956 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:51.957 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:51.957 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1657e-05 s, 0.0 kB/s 2023-10-14T19:06:51.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:51.958 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.013 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.014 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.014 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3378e-05 s, 0.0 kB/s 2023-10-14T19:06:52.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.015 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3672e-05 s, 0.0 kB/s 2023-10-14T19:06:52.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.071 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.126 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.127 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.127 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3604e-05 s, 0.0 kB/s 2023-10-14T19:06:52.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.128 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.182 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.183 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.183 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0205e-05 s, 0.0 kB/s 2023-10-14T19:06:52.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.184 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.242 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9812e-05 s, 0.0 kB/s 2023-10-14T19:06:52.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.243 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0976e-05 s, 0.0 kB/s 2023-10-14T19:06:52.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.300 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.354 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2593e-05 s, 0.0 kB/s 2023-10-14T19:06:52.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.355 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1114e-05 s, 0.0 kB/s 2023-10-14T19:06:52.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.466 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.466 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.466 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1625e-05 s, 0.0 kB/s 2023-10-14T19:06:52.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.467 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4435e-05 s, 0.0 kB/s 2023-10-14T19:06:52.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.523 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.578 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.012e-05 s, 0.0 kB/s 2023-10-14T19:06:52.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.634 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.19e-05 s, 0.0 kB/s 2023-10-14T19:06:52.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.635 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.690 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9361e-05 s, 0.0 kB/s 2023-10-14T19:06:52.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3444e-05 s, 0.0 kB/s 2023-10-14T19:06:52.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2877e-05 s, 0.0 kB/s 2023-10-14T19:06:52.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.859 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.859 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3e-05 s, 0.0 kB/s 2023-10-14T19:06:52.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.860 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.915 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.915 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9762e-05 s, 0.0 kB/s 2023-10-14T19:06:52.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.917 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3423e-05 s, 0.0 kB/s 2023-10-14T19:06:52.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:52.974 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3617e-05 s, 0.0 kB/s 2023-10-14T19:06:53.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.031 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3955e-05 s, 0.0 kB/s 2023-10-14T19:06:53.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.086 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.142 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.142 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.142 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1536e-05 s, 0.0 kB/s 2023-10-14T19:06:53.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.143 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.197 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1018e-05 s, 0.0 kB/s 2023-10-14T19:06:53.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.199 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0498e-05 s, 0.0 kB/s 2023-10-14T19:06:53.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.255 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.309 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.310 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.310 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2029e-05 s, 0.0 kB/s 2023-10-14T19:06:53.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.311 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2035e-05 s, 0.0 kB/s 2023-10-14T19:06:53.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.367 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.421 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.422 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3744e-05 s, 0.0 kB/s 2023-10-14T19:06:53.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.423 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.477 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.477 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.478 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0875e-05 s, 0.0 kB/s 2023-10-14T19:06:53.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.478 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.533 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.534 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0907e-05 s, 0.0 kB/s 2023-10-14T19:06:53.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9857e-05 s, 0.0 kB/s 2023-10-14T19:06:53.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.591 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.646 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3001e-05 s, 0.0 kB/s 2023-10-14T19:06:53.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.648 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.702 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.386e-05 s, 0.0 kB/s 2023-10-14T19:06:53.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.704 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.758 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.759 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.759 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.307e-05 s, 0.0 kB/s 2023-10-14T19:06:53.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.760 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.329e-05 s, 0.0 kB/s 2023-10-14T19:06:53.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.816 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.908 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.6269e-05 s, 0.0 kB/s 2023-10-14T19:06:53.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.925 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-14T19:06:53.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.927 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:53.982 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:53.982 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3277e-05 s, 0.0 kB/s 2023-10-14T19:06:53.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:53.983 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.038 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2722e-05 s, 0.0 kB/s 2023-10-14T19:06:54.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.039 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9816e-05 s, 0.0 kB/s 2023-10-14T19:06:54.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.096 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.151 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.151 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.152 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5761e-05 s, 0.0 kB/s 2023-10-14T19:06:54.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.152 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0192e-05 s, 0.0 kB/s 2023-10-14T19:06:54.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.208 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.264 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0827e-05 s, 0.0 kB/s 2023-10-14T19:06:54.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.265 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.939e-05 s, 0.0 kB/s 2023-10-14T19:06:54.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.321 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.375 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.376 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.376 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0853e-05 s, 0.0 kB/s 2023-10-14T19:06:54.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.377 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9878e-05 s, 0.0 kB/s 2023-10-14T19:06:54.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.433 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.487 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.488 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3058e-05 s, 0.0 kB/s 2023-10-14T19:06:54.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.489 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1109e-05 s, 0.0 kB/s 2023-10-14T19:06:54.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.545 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6861e-05 s, 0.0 kB/s 2023-10-14T19:06:54.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.601 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0874e-05 s, 0.0 kB/s 2023-10-14T19:06:54.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.657 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1075e-05 s, 0.0 kB/s 2023-10-14T19:06:54.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.714 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1183e-05 s, 0.0 kB/s 2023-10-14T19:06:54.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.770 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2117e-05 s, 0.0 kB/s 2023-10-14T19:06:54.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.826 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.880 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.881 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.881 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1497e-05 s, 0.0 kB/s 2023-10-14T19:06:54.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.882 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3149e-05 s, 0.0 kB/s 2023-10-14T19:06:54.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.939 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:54.993 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:54.994 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:54.994 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.25e-05 s, 0.0 kB/s 2023-10-14T19:06:54.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:54.995 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3716e-05 s, 0.0 kB/s 2023-10-14T19:06:55.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.051 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.107 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8417e-05 s, 0.0 kB/s 2023-10-14T19:06:55.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.108 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2638e-05 s, 0.0 kB/s 2023-10-14T19:06:55.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.165 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.219 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.220 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.220 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4716e-05 s, 0.0 kB/s 2023-10-14T19:06:55.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.221 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4448e-05 s, 0.0 kB/s 2023-10-14T19:06:55.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.277 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-14T19:06:55.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.336 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0392e-05 s, 0.0 kB/s 2023-10-14T19:06:55.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.392 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.447 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9811e-05 s, 0.0 kB/s 2023-10-14T19:06:55.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.447 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9147e-05 s, 0.0 kB/s 2023-10-14T19:06:55.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3637e-05 s, 0.0 kB/s 2023-10-14T19:06:55.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1064e-05 s, 0.0 kB/s 2023-10-14T19:06:55.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1467e-05 s, 0.0 kB/s 2023-10-14T19:06:55.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.672 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.727 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9525e-05 s, 0.0 kB/s 2023-10-14T19:06:55.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.728 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.782 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.782 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.192e-05 s, 0.0 kB/s 2023-10-14T19:06:55.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.783 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1873e-05 s, 0.0 kB/s 2023-10-14T19:06:55.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.839 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1814e-05 s, 0.0 kB/s 2023-10-14T19:06:55.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:55.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:55.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:55.952 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1626e-05 s, 0.0 kB/s 2023-10-14T19:06:55.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:55.953 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.245e-05 s, 0.0 kB/s 2023-10-14T19:06:56.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.009 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3431e-05 s, 0.0 kB/s 2023-10-14T19:06:56.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.064 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.119 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.120 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.120 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8477e-05 s, 0.0 kB/s 2023-10-14T19:06:56.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.121 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.176 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6098e-05 s, 0.0 kB/s 2023-10-14T19:06:56.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.177 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.231 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.232 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.267e-05 s, 0.0 kB/s 2023-10-14T19:06:56.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5183e-05 s, 0.0 kB/s 2023-10-14T19:06:56.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.289 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-14T19:06:56.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.345 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.399 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.400 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.400 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3469e-05 s, 0.0 kB/s 2023-10-14T19:06:56.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.401 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2562e-05 s, 0.0 kB/s 2023-10-14T19:06:56.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.458 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.514 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.964e-05 s, 0.0 kB/s 2023-10-14T19:06:56.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.514 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9814e-05 s, 0.0 kB/s 2023-10-14T19:06:56.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.570 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0004e-05 s, 0.0 kB/s 2023-10-14T19:06:56.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.627 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.681 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.681 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.681 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2613e-05 s, 0.0 kB/s 2023-10-14T19:06:56.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.682 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.737 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.737 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.738 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2121e-05 s, 0.0 kB/s 2023-10-14T19:06:56.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.738 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.793 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.794 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3445e-05 s, 0.0 kB/s 2023-10-14T19:06:56.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.795 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.850 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1571e-05 s, 0.0 kB/s 2023-10-14T19:06:56.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.851 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0785e-05 s, 0.0 kB/s 2023-10-14T19:06:56.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:56.966 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:56.966 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:56.966 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4278e-05 s, 0.0 kB/s 2023-10-14T19:06:56.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:56.967 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.022 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1045e-05 s, 0.0 kB/s 2023-10-14T19:06:57.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.024 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.078 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.079 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.079 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2298e-05 s, 0.0 kB/s 2023-10-14T19:06:57.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.080 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1934e-05 s, 0.0 kB/s 2023-10-14T19:06:57.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.136 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1531e-05 s, 0.0 kB/s 2023-10-14T19:06:57.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.191 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3411e-05 s, 0.0 kB/s 2023-10-14T19:06:57.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.249 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0786e-05 s, 0.0 kB/s 2023-10-14T19:06:57.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.361 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4588e-05 s, 0.0 kB/s 2023-10-14T19:06:57.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.361 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.416 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-14T19:06:57.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.418 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.179e-05 s, 0.0 kB/s 2023-10-14T19:06:57.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.474 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.529 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3872e-05 s, 0.0 kB/s 2023-10-14T19:06:57.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.530 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.585 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.586 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3671e-05 s, 0.0 kB/s 2023-10-14T19:06:57.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.641 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.642 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2896e-05 s, 0.0 kB/s 2023-10-14T19:06:57.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.643 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.698 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6611e-05 s, 0.0 kB/s 2023-10-14T19:06:57.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.699 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.754 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-14T19:06:57.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.755 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.810 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0655e-05 s, 0.0 kB/s 2023-10-14T19:06:57.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.811 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-14T19:06:57.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1657e-05 s, 0.0 kB/s 2023-10-14T19:06:57.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.924 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:57.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:57.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:57.980 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1284e-05 s, 0.0 kB/s 2023-10-14T19:06:57.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:57.981 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3392e-05 s, 0.0 kB/s 2023-10-14T19:06:58.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4676e-05 s, 0.0 kB/s 2023-10-14T19:06:58.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-14T19:06:58.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9696e-05 s, 0.0 kB/s 2023-10-14T19:06:58.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.207 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1479e-05 s, 0.0 kB/s 2023-10-14T19:06:58.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.318 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-14T19:06:58.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.373 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0317e-05 s, 0.0 kB/s 2023-10-14T19:06:58.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3689e-05 s, 0.0 kB/s 2023-10-14T19:06:58.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.431 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.168e-05 s, 0.0 kB/s 2023-10-14T19:06:58.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.487 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.542 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1707e-05 s, 0.0 kB/s 2023-10-14T19:06:58.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.543 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-14T19:06:58.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.600 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.655 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-14T19:06:58.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.656 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8365e-05 s, 0.0 kB/s 2023-10-14T19:06:58.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4734e-05 s, 0.0 kB/s 2023-10-14T19:06:58.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.823 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.824 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.824 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1928e-05 s, 0.0 kB/s 2023-10-14T19:06:58.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.825 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.879 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.880 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.880 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2952e-05 s, 0.0 kB/s 2023-10-14T19:06:58.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.881 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:58.936 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:58.936 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:58.936 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.397e-05 s, 0.0 kB/s 2023-10-14T19:06:58.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:58.937 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.028 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.028 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.5185e-05 s, 0.0 kB/s 2023-10-14T19:06:59.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.030 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.046 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.047 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0443e-05 s, 0.0 kB/s 2023-10-14T19:06:59.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.048 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.103 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4536e-05 s, 0.0 kB/s 2023-10-14T19:06:59.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.104 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.159 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3949e-05 s, 0.0 kB/s 2023-10-14T19:06:59.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.160 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9836e-05 s, 0.0 kB/s 2023-10-14T19:06:59.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.216 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.271 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5356e-05 s, 0.0 kB/s 2023-10-14T19:06:59.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.272 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.326 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2666e-05 s, 0.0 kB/s 2023-10-14T19:06:59.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.386 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.386 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2155e-05 s, 0.0 kB/s 2023-10-14T19:06:59.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.387 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.442 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9829e-05 s, 0.0 kB/s 2023-10-14T19:06:59.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.443 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9079e-05 s, 0.0 kB/s 2023-10-14T19:06:59.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.499 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-14T19:06:59.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.555 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.610 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.610 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.610 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-14T19:06:59.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.611 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0597e-05 s, 0.0 kB/s 2023-10-14T19:06:59.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.724 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.724 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1539e-05 s, 0.0 kB/s 2023-10-14T19:06:59.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.725 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9199e-05 s, 0.0 kB/s 2023-10-14T19:06:59.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.836 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0446e-05 s, 0.0 kB/s 2023-10-14T19:06:59.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.837 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9194e-05 s, 0.0 kB/s 2023-10-14T19:06:59.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.893 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:06:59.947 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:06:59.948 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:06:59.948 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4041e-05 s, 0.0 kB/s 2023-10-14T19:06:59.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:06:59.949 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.003 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9116e-05 s, 0.0 kB/s 2023-10-14T19:07:00.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.005 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.059 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.059 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.060 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1764e-05 s, 0.0 kB/s 2023-10-14T19:07:00.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.060 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3283e-05 s, 0.0 kB/s 2023-10-14T19:07:00.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.117 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.171 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2551e-05 s, 0.0 kB/s 2023-10-14T19:07:00.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.173 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0916e-05 s, 0.0 kB/s 2023-10-14T19:07:00.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.229 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0719e-05 s, 0.0 kB/s 2023-10-14T19:07:00.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.285 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.340 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.340 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.340 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5297e-05 s, 0.0 kB/s 2023-10-14T19:07:00.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.341 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1595e-05 s, 0.0 kB/s 2023-10-14T19:07:00.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.397 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.455 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2975e-05 s, 0.0 kB/s 2023-10-14T19:07:00.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0691e-05 s, 0.0 kB/s 2023-10-14T19:07:00.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.512 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.567 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-14T19:07:00.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.568 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.623 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3576e-05 s, 0.0 kB/s 2023-10-14T19:07:00.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.623 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.679 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4413e-05 s, 0.0 kB/s 2023-10-14T19:07:00.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.680 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4655e-05 s, 0.0 kB/s 2023-10-14T19:07:00.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.736 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.791 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1409e-05 s, 0.0 kB/s 2023-10-14T19:07:00.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.846 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.502e-05 s, 0.0 kB/s 2023-10-14T19:07:00.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.904 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2757e-05 s, 0.0 kB/s 2023-10-14T19:07:00.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.906 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:00.960 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3707e-05 s, 0.0 kB/s 2023-10-14T19:07:00.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:00.962 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0306e-05 s, 0.0 kB/s 2023-10-14T19:07:01.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.020 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3769e-05 s, 0.0 kB/s 2023-10-14T19:07:01.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.076 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.130 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1878e-05 s, 0.0 kB/s 2023-10-14T19:07:01.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.132 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2238e-05 s, 0.0 kB/s 2023-10-14T19:07:01.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.188 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.244 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2413e-05 s, 0.0 kB/s 2023-10-14T19:07:01.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.244 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-14T19:07:01.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.301 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.356 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.356 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.356 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3384e-05 s, 0.0 kB/s 2023-10-14T19:07:01.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.357 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2231e-05 s, 0.0 kB/s 2023-10-14T19:07:01.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.413 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.468 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.468 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5398e-05 s, 0.0 kB/s 2023-10-14T19:07:01.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.469 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0211e-05 s, 0.0 kB/s 2023-10-14T19:07:01.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.525 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3529e-05 s, 0.0 kB/s 2023-10-14T19:07:01.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.580 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.635 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.635 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.636 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1025e-05 s, 0.0 kB/s 2023-10-14T19:07:01.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.636 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.692 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.692 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.692 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0495e-05 s, 0.0 kB/s 2023-10-14T19:07:01.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.693 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1798e-05 s, 0.0 kB/s 2023-10-14T19:07:01.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.748 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.803 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0044e-05 s, 0.0 kB/s 2023-10-14T19:07:01.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.804 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.860 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.860 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.860 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3601e-05 s, 0.0 kB/s 2023-10-14T19:07:01.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.861 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0787e-05 s, 0.0 kB/s 2023-10-14T19:07:01.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.918 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:01.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:01.973 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:01.973 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1174e-05 s, 0.0 kB/s 2023-10-14T19:07:01.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:01.974 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3581e-05 s, 0.0 kB/s 2023-10-14T19:07:02.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.031 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.086 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.086 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.087 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2688e-05 s, 0.0 kB/s 2023-10-14T19:07:02.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.087 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.142 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0242e-05 s, 0.0 kB/s 2023-10-14T19:07:02.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.144 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.198 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.199 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.199 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.44e-05 s, 0.0 kB/s 2023-10-14T19:07:02.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.200 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.255 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.255 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.255 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0805e-05 s, 0.0 kB/s 2023-10-14T19:07:02.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.256 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.311 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.312 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0759e-05 s, 0.0 kB/s 2023-10-14T19:07:02.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.313 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.369 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9812e-05 s, 0.0 kB/s 2023-10-14T19:07:02.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.370 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.425 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.425 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.425 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-14T19:07:02.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.426 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.481 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.481 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.481 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2631e-05 s, 0.0 kB/s 2023-10-14T19:07:02.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.482 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8843e-05 s, 0.0 kB/s 2023-10-14T19:07:02.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.538 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1555e-05 s, 0.0 kB/s 2023-10-14T19:07:02.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.594 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.648 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4307e-05 s, 0.0 kB/s 2023-10-14T19:07:02.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.650 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1578e-05 s, 0.0 kB/s 2023-10-14T19:07:02.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.762 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2966e-05 s, 0.0 kB/s 2023-10-14T19:07:02.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.763 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.818 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3319e-05 s, 0.0 kB/s 2023-10-14T19:07:02.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.819 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.875 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.875 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.875 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.267e-05 s, 0.0 kB/s 2023-10-14T19:07:02.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.876 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.931 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.931 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3614e-05 s, 0.0 kB/s 2023-10-14T19:07:02.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.932 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:02.987 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3977e-05 s, 0.0 kB/s 2023-10-14T19:07:02.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:02.988 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8623e-05 s, 0.0 kB/s 2023-10-14T19:07:03.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.043 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2719e-05 s, 0.0 kB/s 2023-10-14T19:07:03.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.100 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-14T19:07:03.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.156 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.210 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9822e-05 s, 0.0 kB/s 2023-10-14T19:07:03.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.212 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.937e-05 s, 0.0 kB/s 2023-10-14T19:07:03.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.268 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.324 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.325 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.325 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5825e-05 s, 0.0 kB/s 2023-10-14T19:07:03.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.326 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.381 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.381 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0332e-05 s, 0.0 kB/s 2023-10-14T19:07:03.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.382 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1919e-05 s, 0.0 kB/s 2023-10-14T19:07:03.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.493 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3628e-05 s, 0.0 kB/s 2023-10-14T19:07:03.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.494 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3467e-05 s, 0.0 kB/s 2023-10-14T19:07:03.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.550 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.605 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.606 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.606 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0855e-05 s, 0.0 kB/s 2023-10-14T19:07:03.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.607 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.661 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9967e-05 s, 0.0 kB/s 2023-10-14T19:07:03.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.663 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-14T19:07:03.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.719 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.301e-05 s, 0.0 kB/s 2023-10-14T19:07:03.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.775 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-14T19:07:03.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.831 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3457e-05 s, 0.0 kB/s 2023-10-14T19:07:03.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.887 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.942 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.942 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2637e-05 s, 0.0 kB/s 2023-10-14T19:07:03.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:03.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5284e-05 s, 0.0 kB/s 2023-10-14T19:07:03.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:03.999 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.054 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4489e-05 s, 0.0 kB/s 2023-10-14T19:07:04.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-14T19:07:04.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-14T19:07:04.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.167 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2674e-05 s, 0.0 kB/s 2023-10-14T19:07:04.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.224 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.279 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.279 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0395e-05 s, 0.0 kB/s 2023-10-14T19:07:04.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.280 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1827e-05 s, 0.0 kB/s 2023-10-14T19:07:04.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.335 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6845e-05 s, 0.0 kB/s 2023-10-14T19:07:04.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.392 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.447 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2994e-05 s, 0.0 kB/s 2023-10-14T19:07:04.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.448 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0751e-05 s, 0.0 kB/s 2023-10-14T19:07:04.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4975e-05 s, 0.0 kB/s 2023-10-14T19:07:04.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.616 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.616 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3072e-05 s, 0.0 kB/s 2023-10-14T19:07:04.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0193e-05 s, 0.0 kB/s 2023-10-14T19:07:04.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.673 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.729 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.729 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3526e-05 s, 0.0 kB/s 2023-10-14T19:07:04.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.730 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0833e-05 s, 0.0 kB/s 2023-10-14T19:07:04.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.785 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.841 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0242e-05 s, 0.0 kB/s 2023-10-14T19:07:04.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.842 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1086e-05 s, 0.0 kB/s 2023-10-14T19:07:04.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.898 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:04.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:04.954 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:04.954 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3918e-05 s, 0.0 kB/s 2023-10-14T19:07:04.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:04.955 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3453e-05 s, 0.0 kB/s 2023-10-14T19:07:05.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.012 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.068 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.068 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.068 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3671e-05 s, 0.0 kB/s 2023-10-14T19:07:05.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.069 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.126 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.126 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.327e-05 s, 0.0 kB/s 2023-10-14T19:07:05.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.127 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.186 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.323e-05 s, 0.0 kB/s 2023-10-14T19:07:05.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2937e-05 s, 0.0 kB/s 2023-10-14T19:07:05.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.244 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4612e-05 s, 0.0 kB/s 2023-10-14T19:07:05.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.300 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.355 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.355 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.355 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1591e-05 s, 0.0 kB/s 2023-10-14T19:07:05.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.356 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1663e-05 s, 0.0 kB/s 2023-10-14T19:07:05.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.413 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3886e-05 s, 0.0 kB/s 2023-10-14T19:07:05.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.469 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1116e-05 s, 0.0 kB/s 2023-10-14T19:07:05.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.526 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.581 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3753e-05 s, 0.0 kB/s 2023-10-14T19:07:05.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.582 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2182e-05 s, 0.0 kB/s 2023-10-14T19:07:05.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.638 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.693 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2835e-05 s, 0.0 kB/s 2023-10-14T19:07:05.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.694 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.750 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.254e-05 s, 0.0 kB/s 2023-10-14T19:07:05.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.751 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3906e-05 s, 0.0 kB/s 2023-10-14T19:07:05.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.807 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7933e-05 s, 0.0 kB/s 2023-10-14T19:07:05.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.863 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1736e-05 s, 0.0 kB/s 2023-10-14T19:07:05.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.919 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:05.975 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2389e-05 s, 0.0 kB/s 2023-10-14T19:07:05.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:05.977 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.032 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.032 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4846e-05 s, 0.0 kB/s 2023-10-14T19:07:06.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.033 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.088 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4129e-05 s, 0.0 kB/s 2023-10-14T19:07:06.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.090 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2486e-05 s, 0.0 kB/s 2023-10-14T19:07:06.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.146 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.200 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.201 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.201 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4998e-05 s, 0.0 kB/s 2023-10-14T19:07:06.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.202 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.257 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.257 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.257 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2748e-05 s, 0.0 kB/s 2023-10-14T19:07:06.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.258 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.313 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.313 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1547e-05 s, 0.0 kB/s 2023-10-14T19:07:06.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.314 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0307e-05 s, 0.0 kB/s 2023-10-14T19:07:06.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.370 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4176e-05 s, 0.0 kB/s 2023-10-14T19:07:06.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.426 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.481 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.481 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.482 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3695e-05 s, 0.0 kB/s 2023-10-14T19:07:06.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.482 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.537 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.537 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1493e-05 s, 0.0 kB/s 2023-10-14T19:07:06.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.538 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.593 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.594 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.594 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9564e-05 s, 0.0 kB/s 2023-10-14T19:07:06.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.595 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1314e-05 s, 0.0 kB/s 2023-10-14T19:07:06.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.651 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1057e-05 s, 0.0 kB/s 2023-10-14T19:07:06.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.707 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.762 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0009e-05 s, 0.0 kB/s 2023-10-14T19:07:06.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.762 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.817 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.818 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0674e-05 s, 0.0 kB/s 2023-10-14T19:07:06.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.819 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0318e-05 s, 0.0 kB/s 2023-10-14T19:07:06.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.876 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.931 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.931 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.931 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3532e-05 s, 0.0 kB/s 2023-10-14T19:07:06.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.932 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:06.989 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:06.989 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:06.989 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4176e-05 s, 0.0 kB/s 2023-10-14T19:07:06.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:06.990 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.045 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1943e-05 s, 0.0 kB/s 2023-10-14T19:07:07.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.046 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.100 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.101 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1045e-05 s, 0.0 kB/s 2023-10-14T19:07:07.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.102 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.156 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.157 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.157 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2748e-05 s, 0.0 kB/s 2023-10-14T19:07:07.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.158 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.213 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.214 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4195e-05 s, 0.0 kB/s 2023-10-14T19:07:07.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.215 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.271 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3849e-05 s, 0.0 kB/s 2023-10-14T19:07:07.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.271 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-14T19:07:07.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2029e-05 s, 0.0 kB/s 2023-10-14T19:07:07.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.385 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.441 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.442 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9832e-05 s, 0.0 kB/s 2023-10-14T19:07:07.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.443 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1e-05 s, 0.0 kB/s 2023-10-14T19:07:07.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.499 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3991e-05 s, 0.0 kB/s 2023-10-14T19:07:07.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.555 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0603e-05 s, 0.0 kB/s 2023-10-14T19:07:07.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.612 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8846e-05 s, 0.0 kB/s 2023-10-14T19:07:07.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.723 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2185e-05 s, 0.0 kB/s 2023-10-14T19:07:07.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.724 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9179e-05 s, 0.0 kB/s 2023-10-14T19:07:07.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.780 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8405e-05 s, 0.0 kB/s 2023-10-14T19:07:07.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.836 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3844e-05 s, 0.0 kB/s 2023-10-14T19:07:07.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.893 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6073e-05 s, 0.0 kB/s 2023-10-14T19:07:07.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:07.952 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.105e-05 s, 0.0 kB/s 2023-10-14T19:07:08.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.009 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1576e-05 s, 0.0 kB/s 2023-10-14T19:07:08.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.120 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1381e-05 s, 0.0 kB/s 2023-10-14T19:07:08.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.177 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9814e-05 s, 0.0 kB/s 2023-10-14T19:07:08.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.178 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.234 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2016e-05 s, 0.0 kB/s 2023-10-14T19:07:08.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.234 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.290 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.290 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4805e-05 s, 0.0 kB/s 2023-10-14T19:07:08.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.291 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.346 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.346 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.085e-05 s, 0.0 kB/s 2023-10-14T19:07:08.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.347 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.402 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.402 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-14T19:07:08.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.403 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.374e-05 s, 0.0 kB/s 2023-10-14T19:07:08.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.459 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.514 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.515 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2104e-05 s, 0.0 kB/s 2023-10-14T19:07:08.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.515 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1557e-05 s, 0.0 kB/s 2023-10-14T19:07:08.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.571 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9165e-05 s, 0.0 kB/s 2023-10-14T19:07:08.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.628 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1367e-05 s, 0.0 kB/s 2023-10-14T19:07:08.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.684 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.739 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.739 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0022e-05 s, 0.0 kB/s 2023-10-14T19:07:08.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.740 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.795 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9961e-05 s, 0.0 kB/s 2023-10-14T19:07:08.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.795 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4999e-05 s, 0.0 kB/s 2023-10-14T19:07:08.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.854 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.910 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.911 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.911 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2268e-05 s, 0.0 kB/s 2023-10-14T19:07:08.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.912 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4085e-05 s, 0.0 kB/s 2023-10-14T19:07:08.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:08.968 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.024 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.024 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.024 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1488e-05 s, 0.0 kB/s 2023-10-14T19:07:09.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.025 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.080 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.080 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.080 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4993e-05 s, 0.0 kB/s 2023-10-14T19:07:09.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.081 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4054e-05 s, 0.0 kB/s 2023-10-14T19:07:09.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.137 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3742e-05 s, 0.0 kB/s 2023-10-14T19:07:09.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.194 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.249 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0712e-05 s, 0.0 kB/s 2023-10-14T19:07:09.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2632e-05 s, 0.0 kB/s 2023-10-14T19:07:09.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2657e-05 s, 0.0 kB/s 2023-10-14T19:07:09.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.365 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4153e-05 s, 0.0 kB/s 2023-10-14T19:07:09.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.421 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.476 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.262e-05 s, 0.0 kB/s 2023-10-14T19:07:09.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0948e-05 s, 0.0 kB/s 2023-10-14T19:07:09.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.533 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2339e-05 s, 0.0 kB/s 2023-10-14T19:07:09.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.590 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.645 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.645 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0293e-05 s, 0.0 kB/s 2023-10-14T19:07:09.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.646 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1462e-05 s, 0.0 kB/s 2023-10-14T19:07:09.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.702 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.758 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.758 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1197e-05 s, 0.0 kB/s 2023-10-14T19:07:09.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.759 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2534e-05 s, 0.0 kB/s 2023-10-14T19:07:09.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.815 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.870 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.870 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.870 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2818e-05 s, 0.0 kB/s 2023-10-14T19:07:09.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.871 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.926 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.926 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.926 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2898e-05 s, 0.0 kB/s 2023-10-14T19:07:09.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.927 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4239e-05 s, 0.0 kB/s 2023-10-14T19:07:09.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:09.984 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2843e-05 s, 0.0 kB/s 2023-10-14T19:07:10.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.040 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2993e-05 s, 0.0 kB/s 2023-10-14T19:07:10.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.096 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.151 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.151 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5247e-05 s, 0.0 kB/s 2023-10-14T19:07:10.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.152 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4625e-05 s, 0.0 kB/s 2023-10-14T19:07:10.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.208 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.263 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.263 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2145e-05 s, 0.0 kB/s 2023-10-14T19:07:10.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.264 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1208e-05 s, 0.0 kB/s 2023-10-14T19:07:10.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.320 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1152e-05 s, 0.0 kB/s 2023-10-14T19:07:10.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.376 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.431 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2277e-05 s, 0.0 kB/s 2023-10-14T19:07:10.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.432 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2357e-05 s, 0.0 kB/s 2023-10-14T19:07:10.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.488 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1304e-05 s, 0.0 kB/s 2023-10-14T19:07:10.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.543 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.202e-05 s, 0.0 kB/s 2023-10-14T19:07:10.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.600 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4471e-05 s, 0.0 kB/s 2023-10-14T19:07:10.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.656 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2368e-05 s, 0.0 kB/s 2023-10-14T19:07:10.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4438e-05 s, 0.0 kB/s 2023-10-14T19:07:10.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.829 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4682e-05 s, 0.0 kB/s 2023-10-14T19:07:10.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.830 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3576e-05 s, 0.0 kB/s 2023-10-14T19:07:10.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.887 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3481e-05 s, 0.0 kB/s 2023-10-14T19:07:10.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:10.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:10.998 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:10.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0888e-05 s, 0.0 kB/s 2023-10-14T19:07:10.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:10.999 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.054 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4928e-05 s, 0.0 kB/s 2023-10-14T19:07:11.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2915e-05 s, 0.0 kB/s 2023-10-14T19:07:11.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3265e-05 s, 0.0 kB/s 2023-10-14T19:07:11.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.167 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7016e-05 s, 0.0 kB/s 2023-10-14T19:07:11.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.223 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.279 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.279 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9856e-05 s, 0.0 kB/s 2023-10-14T19:07:11.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.280 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.335 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1892e-05 s, 0.0 kB/s 2023-10-14T19:07:11.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.336 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9601e-05 s, 0.0 kB/s 2023-10-14T19:07:11.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.392 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.447 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.447 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1743e-05 s, 0.0 kB/s 2023-10-14T19:07:11.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.448 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0515e-05 s, 0.0 kB/s 2023-10-14T19:07:11.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.560 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.560 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2515e-05 s, 0.0 kB/s 2023-10-14T19:07:11.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.561 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3681e-05 s, 0.0 kB/s 2023-10-14T19:07:11.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.173e-05 s, 0.0 kB/s 2023-10-14T19:07:11.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.674 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.729 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.729 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1016e-05 s, 0.0 kB/s 2023-10-14T19:07:11.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.730 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2986e-05 s, 0.0 kB/s 2023-10-14T19:07:11.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.786 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4298e-05 s, 0.0 kB/s 2023-10-14T19:07:11.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.842 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.897 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.897 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3284e-05 s, 0.0 kB/s 2023-10-14T19:07:11.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.898 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4619e-05 s, 0.0 kB/s 2023-10-14T19:07:11.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:11.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.010 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.006e-05 s, 0.0 kB/s 2023-10-14T19:07:12.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.219e-05 s, 0.0 kB/s 2023-10-14T19:07:12.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.067 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.122 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1229e-05 s, 0.0 kB/s 2023-10-14T19:07:12.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.178 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.178 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0314e-05 s, 0.0 kB/s 2023-10-14T19:07:12.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.179 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1265e-05 s, 0.0 kB/s 2023-10-14T19:07:12.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.235 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.256e-05 s, 0.0 kB/s 2023-10-14T19:07:12.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.291 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.348 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1744e-05 s, 0.0 kB/s 2023-10-14T19:07:12.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.348 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.404 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8515e-05 s, 0.0 kB/s 2023-10-14T19:07:12.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.405 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.461 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2394e-05 s, 0.0 kB/s 2023-10-14T19:07:12.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.462 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1241e-05 s, 0.0 kB/s 2023-10-14T19:07:12.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.520 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.575 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.575 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2257e-05 s, 0.0 kB/s 2023-10-14T19:07:12.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.576 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.630 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.631 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1138e-05 s, 0.0 kB/s 2023-10-14T19:07:12.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.634 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.686 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.687 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.687 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.087e-05 s, 0.0 kB/s 2023-10-14T19:07:12.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.688 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1692e-05 s, 0.0 kB/s 2023-10-14T19:07:12.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.744 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.798 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.799 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1109e-05 s, 0.0 kB/s 2023-10-14T19:07:12.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.800 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.854 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.855 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.855 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3592e-05 s, 0.0 kB/s 2023-10-14T19:07:12.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.856 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2783e-05 s, 0.0 kB/s 2023-10-14T19:07:12.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.912 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:12.967 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4279e-05 s, 0.0 kB/s 2023-10-14T19:07:12.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:12.969 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3299e-05 s, 0.0 kB/s 2023-10-14T19:07:13.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.025 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.080 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.080 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.417e-05 s, 0.0 kB/s 2023-10-14T19:07:13.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.081 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.135 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.136 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.136 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0886e-05 s, 0.0 kB/s 2023-10-14T19:07:13.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.137 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.192 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.192 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4191e-05 s, 0.0 kB/s 2023-10-14T19:07:13.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.193 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0909e-05 s, 0.0 kB/s 2023-10-14T19:07:13.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.249 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.304 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.304 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0417e-05 s, 0.0 kB/s 2023-10-14T19:07:13.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1858e-05 s, 0.0 kB/s 2023-10-14T19:07:13.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.361 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.416 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.416 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2316e-05 s, 0.0 kB/s 2023-10-14T19:07:13.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.417 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2853e-05 s, 0.0 kB/s 2023-10-14T19:07:13.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.473 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4758e-05 s, 0.0 kB/s 2023-10-14T19:07:13.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.529 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.583 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.584 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.584 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.012e-05 s, 0.0 kB/s 2023-10-14T19:07:13.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.585 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.640 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.640 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1881e-05 s, 0.0 kB/s 2023-10-14T19:07:13.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.641 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-14T19:07:13.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.697 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.751 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.752 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3158e-05 s, 0.0 kB/s 2023-10-14T19:07:13.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.753 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.807 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.808 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1033e-05 s, 0.0 kB/s 2023-10-14T19:07:13.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.809 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.864 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0411e-05 s, 0.0 kB/s 2023-10-14T19:07:13.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.864 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.919 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3402e-05 s, 0.0 kB/s 2023-10-14T19:07:13.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.921 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-14T19:07:13.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:13.977 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2054e-05 s, 0.0 kB/s 2023-10-14T19:07:14.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.033 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.088 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.089 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.089 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-14T19:07:14.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.090 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.144 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2634e-05 s, 0.0 kB/s 2023-10-14T19:07:14.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.146 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.200 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.201 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.201 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4003e-05 s, 0.0 kB/s 2023-10-14T19:07:14.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.202 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.256 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0959e-05 s, 0.0 kB/s 2023-10-14T19:07:14.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.257 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5102e-05 s, 0.0 kB/s 2023-10-14T19:07:14.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.314 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.368 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.369 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.369 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0391e-05 s, 0.0 kB/s 2023-10-14T19:07:14.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.370 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.513e-05 s, 0.0 kB/s 2023-10-14T19:07:14.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.425 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.480 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.481 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.481 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.071e-05 s, 0.0 kB/s 2023-10-14T19:07:14.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.482 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0487e-05 s, 0.0 kB/s 2023-10-14T19:07:14.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.539 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1339e-05 s, 0.0 kB/s 2023-10-14T19:07:14.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.595 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4157e-05 s, 0.0 kB/s 2023-10-14T19:07:14.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.651 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9907e-05 s, 0.0 kB/s 2023-10-14T19:07:14.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.707 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1665e-05 s, 0.0 kB/s 2023-10-14T19:07:14.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.763 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.817 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.818 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0604e-05 s, 0.0 kB/s 2023-10-14T19:07:14.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.819 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1453e-05 s, 0.0 kB/s 2023-10-14T19:07:14.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.874 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.930 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.930 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0904e-05 s, 0.0 kB/s 2023-10-14T19:07:14.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.931 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1726e-05 s, 0.0 kB/s 2023-10-14T19:07:14.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:14.987 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-14T19:07:15.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.042 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.098 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.098 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9714e-05 s, 0.0 kB/s 2023-10-14T19:07:15.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.099 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.154 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.154 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9489e-05 s, 0.0 kB/s 2023-10-14T19:07:15.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.155 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.210 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.210 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.210 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2261e-05 s, 0.0 kB/s 2023-10-14T19:07:15.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.211 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.265 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.377e-05 s, 0.0 kB/s 2023-10-14T19:07:15.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.267 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9989e-05 s, 0.0 kB/s 2023-10-14T19:07:15.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.324 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9977e-05 s, 0.0 kB/s 2023-10-14T19:07:15.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.383 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.436 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0657e-05 s, 0.0 kB/s 2023-10-14T19:07:15.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1919e-05 s, 0.0 kB/s 2023-10-14T19:07:15.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.494 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0559e-05 s, 0.0 kB/s 2023-10-14T19:07:15.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.550 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.605 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2902e-05 s, 0.0 kB/s 2023-10-14T19:07:15.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.607 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2868e-05 s, 0.0 kB/s 2023-10-14T19:07:15.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.663 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2538e-05 s, 0.0 kB/s 2023-10-14T19:07:15.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.719 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2335e-05 s, 0.0 kB/s 2023-10-14T19:07:15.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.775 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.830 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.830 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3171e-05 s, 0.0 kB/s 2023-10-14T19:07:15.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.831 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0295e-05 s, 0.0 kB/s 2023-10-14T19:07:15.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.887 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.942 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.942 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.56e-05 s, 0.0 kB/s 2023-10-14T19:07:15.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:15.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:15.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:15.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0398e-05 s, 0.0 kB/s 2023-10-14T19:07:15.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:15.998 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2372e-05 s, 0.0 kB/s 2023-10-14T19:07:16.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.054 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1991e-05 s, 0.0 kB/s 2023-10-14T19:07:16.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2772e-05 s, 0.0 kB/s 2023-10-14T19:07:16.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.167 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0745e-05 s, 0.0 kB/s 2023-10-14T19:07:16.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.224 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.206e-05 s, 0.0 kB/s 2023-10-14T19:07:16.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-14T19:07:16.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.335 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2691e-05 s, 0.0 kB/s 2023-10-14T19:07:16.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.391 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.446 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5448e-05 s, 0.0 kB/s 2023-10-14T19:07:16.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.447 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2965e-05 s, 0.0 kB/s 2023-10-14T19:07:16.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1628e-05 s, 0.0 kB/s 2023-10-14T19:07:16.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.559 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0125e-05 s, 0.0 kB/s 2023-10-14T19:07:16.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.25e-05 s, 0.0 kB/s 2023-10-14T19:07:16.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.674 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.729 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.729 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.729 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3037e-05 s, 0.0 kB/s 2023-10-14T19:07:16.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.730 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.785 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.785 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0931e-05 s, 0.0 kB/s 2023-10-14T19:07:16.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.786 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1927e-05 s, 0.0 kB/s 2023-10-14T19:07:16.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.842 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4175e-05 s, 0.0 kB/s 2023-10-14T19:07:16.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.898 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2549e-05 s, 0.0 kB/s 2023-10-14T19:07:16.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:16.955 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3519e-05 s, 0.0 kB/s 2023-10-14T19:07:17.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.036 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.067 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1433e-05 s, 0.0 kB/s 2023-10-14T19:07:17.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.069 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.536e-05 s, 0.0 kB/s 2023-10-14T19:07:17.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.126 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.180 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1929e-05 s, 0.0 kB/s 2023-10-14T19:07:17.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.182 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2395e-05 s, 0.0 kB/s 2023-10-14T19:07:17.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.238 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9847e-05 s, 0.0 kB/s 2023-10-14T19:07:17.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.293 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1349e-05 s, 0.0 kB/s 2023-10-14T19:07:17.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.350 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.405 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9818e-05 s, 0.0 kB/s 2023-10-14T19:07:17.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.406 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.460 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1963e-05 s, 0.0 kB/s 2023-10-14T19:07:17.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.462 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3164e-05 s, 0.0 kB/s 2023-10-14T19:07:17.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.518 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1152e-05 s, 0.0 kB/s 2023-10-14T19:07:17.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.575 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.632 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4324e-05 s, 0.0 kB/s 2023-10-14T19:07:17.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.633 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.688 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.322e-05 s, 0.0 kB/s 2023-10-14T19:07:17.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.692 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.352e-05 s, 0.0 kB/s 2023-10-14T19:07:17.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3583e-05 s, 0.0 kB/s 2023-10-14T19:07:17.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.804 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.859 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.859 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.860 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4783e-05 s, 0.0 kB/s 2023-10-14T19:07:17.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.860 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.917 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.917 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.917 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2637e-05 s, 0.0 kB/s 2023-10-14T19:07:17.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.918 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:17.974 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:17.974 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:17.974 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4025e-05 s, 0.0 kB/s 2023-10-14T19:07:17.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:17.975 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.030 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.030 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1236e-05 s, 0.0 kB/s 2023-10-14T19:07:18.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.031 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.085 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.493e-05 s, 0.0 kB/s 2023-10-14T19:07:18.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.086 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.142 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.142 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2735e-05 s, 0.0 kB/s 2023-10-14T19:07:18.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.143 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1124e-05 s, 0.0 kB/s 2023-10-14T19:07:18.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.199 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.253 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.254 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.254 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0516e-05 s, 0.0 kB/s 2023-10-14T19:07:18.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.255 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.310 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.310 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2018e-05 s, 0.0 kB/s 2023-10-14T19:07:18.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.311 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0219e-05 s, 0.0 kB/s 2023-10-14T19:07:18.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.366 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6799e-05 s, 0.0 kB/s 2023-10-14T19:07:18.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.423 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0544e-05 s, 0.0 kB/s 2023-10-14T19:07:18.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.480 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:18.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2427e-05 s, 0.0 kB/s 2023-10-14T19:07:18.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4501e-05 s, 0.0 kB/s 2023-10-14T19:07:18.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.593 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.649 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5075e-05 s, 0.0 kB/s 2023-10-14T19:07:18.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.650 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2807e-05 s, 0.0 kB/s 2023-10-14T19:07:18.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.760 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.761 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2828e-05 s, 0.0 kB/s 2023-10-14T19:07:18.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.762 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.817 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.211e-05 s, 0.0 kB/s 2023-10-14T19:07:18.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.818 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.873 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.873 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4187e-05 s, 0.0 kB/s 2023-10-14T19:07:18.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.874 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.216e-05 s, 0.0 kB/s 2023-10-14T19:07:18.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.930 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:18.985 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:18.985 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3106e-05 s, 0.0 kB/s 2023-10-14T19:07:18.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:18.986 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0449e-05 s, 0.0 kB/s 2023-10-14T19:07:19.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.042 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2285e-05 s, 0.0 kB/s 2023-10-14T19:07:19.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.098 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.153 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3166e-05 s, 0.0 kB/s 2023-10-14T19:07:19.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.154 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3832e-05 s, 0.0 kB/s 2023-10-14T19:07:19.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.210 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4343e-05 s, 0.0 kB/s 2023-10-14T19:07:19.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.267 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.322 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.322 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.322 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2076e-05 s, 0.0 kB/s 2023-10-14T19:07:19.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.323 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2869e-05 s, 0.0 kB/s 2023-10-14T19:07:19.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.379 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.324e-05 s, 0.0 kB/s 2023-10-14T19:07:19.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.437 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.490 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.491 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.491 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.339e-05 s, 0.0 kB/s 2023-10-14T19:07:19.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.492 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9552e-05 s, 0.0 kB/s 2023-10-14T19:07:19.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.548 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.1115e-05 s, 0.0 kB/s 2023-10-14T19:07:19.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.604 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.155e-05 s, 0.0 kB/s 2023-10-14T19:07:19.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2742e-05 s, 0.0 kB/s 2023-10-14T19:07:19.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.717 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1837e-05 s, 0.0 kB/s 2023-10-14T19:07:19.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.255e-05 s, 0.0 kB/s 2023-10-14T19:07:19.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.829 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4209e-05 s, 0.0 kB/s 2023-10-14T19:07:19.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.940 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.621e-05 s, 0.0 kB/s 2023-10-14T19:07:19.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.941 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3329e-05 s, 0.0 kB/s 2023-10-14T19:07:19.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:19.997 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4416e-05 s, 0.0 kB/s 2023-10-14T19:07:20.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.053 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.108 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-14T19:07:20.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.109 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2679e-05 s, 0.0 kB/s 2023-10-14T19:07:20.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.164 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.220 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.220 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.220 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2721e-05 s, 0.0 kB/s 2023-10-14T19:07:20.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.221 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0994e-05 s, 0.0 kB/s 2023-10-14T19:07:20.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.277 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4275e-05 s, 0.0 kB/s 2023-10-14T19:07:20.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.333 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.388 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4045e-05 s, 0.0 kB/s 2023-10-14T19:07:20.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.390 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3901e-05 s, 0.0 kB/s 2023-10-14T19:07:20.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.447 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.349e-05 s, 0.0 kB/s 2023-10-14T19:07:20.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.559 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.559 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1548e-05 s, 0.0 kB/s 2023-10-14T19:07:20.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-14T19:07:20.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5322e-05 s, 0.0 kB/s 2023-10-14T19:07:20.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.673 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.728 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.395e-05 s, 0.0 kB/s 2023-10-14T19:07:20.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.729 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.784 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.784 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8642e-05 s, 0.0 kB/s 2023-10-14T19:07:20.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.785 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.840 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2615e-05 s, 0.0 kB/s 2023-10-14T19:07:20.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.841 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4491e-05 s, 0.0 kB/s 2023-10-14T19:07:20.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:20.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:20.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:20.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5665e-05 s, 0.0 kB/s 2023-10-14T19:07:20.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:20.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.045 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.045 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.9347e-05 s, 0.0 kB/s 2023-10-14T19:07:21.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.046 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2753e-05 s, 0.0 kB/s 2023-10-14T19:07:21.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.063 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2688e-05 s, 0.0 kB/s 2023-10-14T19:07:21.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.120 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.175 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.175 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1371e-05 s, 0.0 kB/s 2023-10-14T19:07:21.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.176 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3046e-05 s, 0.0 kB/s 2023-10-14T19:07:21.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.232 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4853e-05 s, 0.0 kB/s 2023-10-14T19:07:21.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.288 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.343 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.343 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.489e-05 s, 0.0 kB/s 2023-10-14T19:07:21.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.344 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.399 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.399 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1322e-05 s, 0.0 kB/s 2023-10-14T19:07:21.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.400 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.974e-05 s, 0.0 kB/s 2023-10-14T19:07:21.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.456 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.511 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.511 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5371e-05 s, 0.0 kB/s 2023-10-14T19:07:21.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.512 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.567 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4858e-05 s, 0.0 kB/s 2023-10-14T19:07:21.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.567 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7755e-05 s, 0.0 kB/s 2023-10-14T19:07:21.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.624 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.679 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.679 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4705e-05 s, 0.0 kB/s 2023-10-14T19:07:21.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.680 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.735 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-14T19:07:21.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.736 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.791 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3591e-05 s, 0.0 kB/s 2023-10-14T19:07:21.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.312e-05 s, 0.0 kB/s 2023-10-14T19:07:21.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.902 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.903 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.903 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6748e-05 s, 0.0 kB/s 2023-10-14T19:07:21.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.904 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3346e-05 s, 0.0 kB/s 2023-10-14T19:07:21.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:21.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4978e-05 s, 0.0 kB/s 2023-10-14T19:07:22.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.018 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-14T19:07:22.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.076 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.131 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.165e-05 s, 0.0 kB/s 2023-10-14T19:07:22.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.134 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9797e-05 s, 0.0 kB/s 2023-10-14T19:07:22.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.189 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2334e-05 s, 0.0 kB/s 2023-10-14T19:07:22.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.246 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1937e-05 s, 0.0 kB/s 2023-10-14T19:07:22.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.303 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-14T19:07:22.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.360 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.416 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2799e-05 s, 0.0 kB/s 2023-10-14T19:07:22.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.417 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4946e-05 s, 0.0 kB/s 2023-10-14T19:07:22.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.473 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.083e-05 s, 0.0 kB/s 2023-10-14T19:07:22.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.530 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.874e-05 s, 0.0 kB/s 2023-10-14T19:07:22.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.586 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0613e-05 s, 0.0 kB/s 2023-10-14T19:07:22.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3192e-05 s, 0.0 kB/s 2023-10-14T19:07:22.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.700 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.755 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.755 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0684e-05 s, 0.0 kB/s 2023-10-14T19:07:22.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.756 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2216e-05 s, 0.0 kB/s 2023-10-14T19:07:22.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.811 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.867 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4783e-05 s, 0.0 kB/s 2023-10-14T19:07:22.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.925 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.925 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.6326e-05 s, 0.0 kB/s 2023-10-14T19:07:22.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.926 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.421e-05 s, 0.0 kB/s 2023-10-14T19:07:22.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:22.982 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.038 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.038 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2465e-05 s, 0.0 kB/s 2023-10-14T19:07:23.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.039 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4434e-05 s, 0.0 kB/s 2023-10-14T19:07:23.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.095 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.150 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.150 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1523e-05 s, 0.0 kB/s 2023-10-14T19:07:23.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.153 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.207 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.208 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3788e-05 s, 0.0 kB/s 2023-10-14T19:07:23.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.208 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2315e-05 s, 0.0 kB/s 2023-10-14T19:07:23.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.265 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2209e-05 s, 0.0 kB/s 2023-10-14T19:07:23.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.321 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.375 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0509e-05 s, 0.0 kB/s 2023-10-14T19:07:23.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.377 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1894e-05 s, 0.0 kB/s 2023-10-14T19:07:23.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.433 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.786e-05 s, 0.0 kB/s 2023-10-14T19:07:23.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.489 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1946e-05 s, 0.0 kB/s 2023-10-14T19:07:23.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.545 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.599 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.600 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1009e-05 s, 0.0 kB/s 2023-10-14T19:07:23.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.601 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3152e-05 s, 0.0 kB/s 2023-10-14T19:07:23.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.657 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.712 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.712 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.713 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5324e-05 s, 0.0 kB/s 2023-10-14T19:07:23.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.713 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.770 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1476e-05 s, 0.0 kB/s 2023-10-14T19:07:23.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1699e-05 s, 0.0 kB/s 2023-10-14T19:07:23.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.827 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.882 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0403e-05 s, 0.0 kB/s 2023-10-14T19:07:23.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.884 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1259e-05 s, 0.0 kB/s 2023-10-14T19:07:23.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.940 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1235e-05 s, 0.0 kB/s 2023-10-14T19:07:23.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:23.996 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-14T19:07:24.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.053 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3522e-05 s, 0.0 kB/s 2023-10-14T19:07:24.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.109 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.165 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5537e-05 s, 0.0 kB/s 2023-10-14T19:07:24.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.166 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9029e-05 s, 0.0 kB/s 2023-10-14T19:07:24.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.222 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3725e-05 s, 0.0 kB/s 2023-10-14T19:07:24.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.278 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.334 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9707e-05 s, 0.0 kB/s 2023-10-14T19:07:24.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.335 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2098e-05 s, 0.0 kB/s 2023-10-14T19:07:24.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.391 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.447 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3164e-05 s, 0.0 kB/s 2023-10-14T19:07:24.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.448 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.503 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.503 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2291e-05 s, 0.0 kB/s 2023-10-14T19:07:24.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.504 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1802e-05 s, 0.0 kB/s 2023-10-14T19:07:24.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.560 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0047e-05 s, 0.0 kB/s 2023-10-14T19:07:24.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.672 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.672 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1067e-05 s, 0.0 kB/s 2023-10-14T19:07:24.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.673 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.727 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.728 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4823e-05 s, 0.0 kB/s 2023-10-14T19:07:24.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.729 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.783 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3477e-05 s, 0.0 kB/s 2023-10-14T19:07:24.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.786 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.840 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.840 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2678e-05 s, 0.0 kB/s 2023-10-14T19:07:24.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.841 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.383e-05 s, 0.0 kB/s 2023-10-14T19:07:24.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.898 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9859e-05 s, 0.0 kB/s 2023-10-14T19:07:24.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:24.954 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.009 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2004e-05 s, 0.0 kB/s 2023-10-14T19:07:25.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1039e-05 s, 0.0 kB/s 2023-10-14T19:07:25.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.121 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.121 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7969e-05 s, 0.0 kB/s 2023-10-14T19:07:25.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.177 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2235e-05 s, 0.0 kB/s 2023-10-14T19:07:25.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.177 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.91e-05 s, 0.0 kB/s 2023-10-14T19:07:25.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.288 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.289 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2703e-05 s, 0.0 kB/s 2023-10-14T19:07:25.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.290 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.344 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.345 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.427e-05 s, 0.0 kB/s 2023-10-14T19:07:25.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.346 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9877e-05 s, 0.0 kB/s 2023-10-14T19:07:25.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.403 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.457 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.458 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.458 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1619e-05 s, 0.0 kB/s 2023-10-14T19:07:25.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.459 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.513 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.201e-05 s, 0.0 kB/s 2023-10-14T19:07:25.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.515 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.569 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.570 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.570 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4711e-05 s, 0.0 kB/s 2023-10-14T19:07:25.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.571 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.625 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.626 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.626 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1501e-05 s, 0.0 kB/s 2023-10-14T19:07:25.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.627 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.3671e-05 s, 0.0 kB/s 2023-10-14T19:07:25.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.683 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.738 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.738 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2776e-05 s, 0.0 kB/s 2023-10-14T19:07:25.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.739 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.449e-05 s, 0.0 kB/s 2023-10-14T19:07:25.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.795 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.850 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.850 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.305e-05 s, 0.0 kB/s 2023-10-14T19:07:25.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.851 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3446e-05 s, 0.0 kB/s 2023-10-14T19:07:25.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.909 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:25.963 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:25.964 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:25.964 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3096e-05 s, 0.0 kB/s 2023-10-14T19:07:25.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:25.965 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.019 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.019 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.020 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0533e-05 s, 0.0 kB/s 2023-10-14T19:07:26.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.020 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.813e-05 s, 0.0 kB/s 2023-10-14T19:07:26.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.077 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.131 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.132 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.132 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2395e-05 s, 0.0 kB/s 2023-10-14T19:07:26.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.133 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.187 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5503e-05 s, 0.0 kB/s 2023-10-14T19:07:26.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.189 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.244 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.245 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.245 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2879e-05 s, 0.0 kB/s 2023-10-14T19:07:26.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.246 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.300 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.301 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.301 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0344e-05 s, 0.0 kB/s 2023-10-14T19:07:26.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.302 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0878e-05 s, 0.0 kB/s 2023-10-14T19:07:26.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.358 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3344e-05 s, 0.0 kB/s 2023-10-14T19:07:26.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.414 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.469 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.469 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2113e-05 s, 0.0 kB/s 2023-10-14T19:07:26.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.470 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.465e-05 s, 0.0 kB/s 2023-10-14T19:07:26.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.526 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9973e-05 s, 0.0 kB/s 2023-10-14T19:07:26.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.582 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.638 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3589e-05 s, 0.0 kB/s 2023-10-14T19:07:26.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.640 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.695 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4088e-05 s, 0.0 kB/s 2023-10-14T19:07:26.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.696 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.752 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1768e-05 s, 0.0 kB/s 2023-10-14T19:07:26.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.753 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2483e-05 s, 0.0 kB/s 2023-10-14T19:07:26.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.809 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.865 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3082e-05 s, 0.0 kB/s 2023-10-14T19:07:26.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.866 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.522e-05 s, 0.0 kB/s 2023-10-14T19:07:26.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:26.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:26.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:26.979 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1914e-05 s, 0.0 kB/s 2023-10-14T19:07:26.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:26.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.034 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.035 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9998e-05 s, 0.0 kB/s 2023-10-14T19:07:27.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.036 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.078e-05 s, 0.0 kB/s 2023-10-14T19:07:27.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.092 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0337e-05 s, 0.0 kB/s 2023-10-14T19:07:27.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.148 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.203 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1621e-05 s, 0.0 kB/s 2023-10-14T19:07:27.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.204 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3157e-05 s, 0.0 kB/s 2023-10-14T19:07:27.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.261 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.316 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2742e-05 s, 0.0 kB/s 2023-10-14T19:07:27.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.317 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.267e-05 s, 0.0 kB/s 2023-10-14T19:07:27.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.373 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.428 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1103e-05 s, 0.0 kB/s 2023-10-14T19:07:27.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.429 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.483 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.484 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.484 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-14T19:07:27.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.485 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.540 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-14T19:07:27.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.541 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.595 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.596 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.596 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6088e-05 s, 0.0 kB/s 2023-10-14T19:07:27.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.597 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.651 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.652 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.652 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0894e-05 s, 0.0 kB/s 2023-10-14T19:07:27.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.653 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.708 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.708 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4083e-05 s, 0.0 kB/s 2023-10-14T19:07:27.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.709 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.764 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.765 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.765 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-14T19:07:27.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.766 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.821 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.821 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3271e-05 s, 0.0 kB/s 2023-10-14T19:07:27.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.823 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.878 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.878 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.243e-05 s, 0.0 kB/s 2023-10-14T19:07:27.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.879 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8234e-05 s, 0.0 kB/s 2023-10-14T19:07:27.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.935 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:27.990 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:27.991 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:27.991 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2981e-05 s, 0.0 kB/s 2023-10-14T19:07:27.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:27.992 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1511e-05 s, 0.0 kB/s 2023-10-14T19:07:28.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.048 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.103 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8209e-05 s, 0.0 kB/s 2023-10-14T19:07:28.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.104 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1753e-05 s, 0.0 kB/s 2023-10-14T19:07:28.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.160 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.214 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9703e-05 s, 0.0 kB/s 2023-10-14T19:07:28.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.216 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.271 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1706e-05 s, 0.0 kB/s 2023-10-14T19:07:28.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.274 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3794e-05 s, 0.0 kB/s 2023-10-14T19:07:28.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.382 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.383 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.383 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1454e-05 s, 0.0 kB/s 2023-10-14T19:07:28.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.384 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.438 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.439 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.439 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0751e-05 s, 0.0 kB/s 2023-10-14T19:07:28.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.440 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.496 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.497 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9948e-05 s, 0.0 kB/s 2023-10-14T19:07:28.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.498 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1751e-05 s, 0.0 kB/s 2023-10-14T19:07:28.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.555 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.609 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4172e-05 s, 0.0 kB/s 2023-10-14T19:07:28.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.610 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.664 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.665 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3847e-05 s, 0.0 kB/s 2023-10-14T19:07:28.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.666 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1028e-05 s, 0.0 kB/s 2023-10-14T19:07:28.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.722 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.778 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3696e-05 s, 0.0 kB/s 2023-10-14T19:07:28.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.779 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.834 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.388e-05 s, 0.0 kB/s 2023-10-14T19:07:28.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.835 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.889 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.890 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0638e-05 s, 0.0 kB/s 2023-10-14T19:07:28.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.891 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.381e-05 s, 0.0 kB/s 2023-10-14T19:07:28.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:28.947 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.001 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.002 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.002 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2988e-05 s, 0.0 kB/s 2023-10-14T19:07:29.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.003 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2975e-05 s, 0.0 kB/s 2023-10-14T19:07:29.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.058 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.113 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1289e-05 s, 0.0 kB/s 2023-10-14T19:07:29.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.115 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.169 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.170 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.170 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5055e-05 s, 0.0 kB/s 2023-10-14T19:07:29.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.171 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2494e-05 s, 0.0 kB/s 2023-10-14T19:07:29.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.227 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.283 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.283 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.283 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5298e-05 s, 0.0 kB/s 2023-10-14T19:07:29.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.284 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2818e-05 s, 0.0 kB/s 2023-10-14T19:07:29.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.340 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.394 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.395 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.395 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1562e-05 s, 0.0 kB/s 2023-10-14T19:07:29.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.396 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-14T19:07:29.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.452 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.506 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.507 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.507 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1136e-05 s, 0.0 kB/s 2023-10-14T19:07:29.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.508 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.562 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.563 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.563 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2882e-05 s, 0.0 kB/s 2023-10-14T19:07:29.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.564 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.619 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.619 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.619 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5352e-05 s, 0.0 kB/s 2023-10-14T19:07:29.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.620 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.964e-05 s, 0.0 kB/s 2023-10-14T19:07:29.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.677 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.732 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1199e-05 s, 0.0 kB/s 2023-10-14T19:07:29.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.733 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8395e-05 s, 0.0 kB/s 2023-10-14T19:07:29.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.790 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.845 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.845 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.845 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1321e-05 s, 0.0 kB/s 2023-10-14T19:07:29.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.846 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5023e-05 s, 0.0 kB/s 2023-10-14T19:07:29.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.903 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:29.959 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:29.960 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:29.960 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6052e-05 s, 0.0 kB/s 2023-10-14T19:07:29.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:29.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5241e-05 s, 0.0 kB/s 2023-10-14T19:07:30.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.018 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1447e-05 s, 0.0 kB/s 2023-10-14T19:07:30.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.074 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3133e-05 s, 0.0 kB/s 2023-10-14T19:07:30.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.130 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.185 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.185 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.268e-05 s, 0.0 kB/s 2023-10-14T19:07:30.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.186 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.241 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0998e-05 s, 0.0 kB/s 2023-10-14T19:07:30.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.242 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.296 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.297 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.297 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-14T19:07:30.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.298 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.352 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1845e-05 s, 0.0 kB/s 2023-10-14T19:07:30.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.354 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.409 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.297e-05 s, 0.0 kB/s 2023-10-14T19:07:30.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.410 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1643e-05 s, 0.0 kB/s 2023-10-14T19:07:30.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.466 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.474e-05 s, 0.0 kB/s 2023-10-14T19:07:30.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.522 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3044e-05 s, 0.0 kB/s 2023-10-14T19:07:30.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.634 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2571e-05 s, 0.0 kB/s 2023-10-14T19:07:30.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.635 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2644e-05 s, 0.0 kB/s 2023-10-14T19:07:30.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5097e-05 s, 0.0 kB/s 2023-10-14T19:07:30.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.803 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1705e-05 s, 0.0 kB/s 2023-10-14T19:07:30.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.805 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1054e-05 s, 0.0 kB/s 2023-10-14T19:07:30.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.861 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6461e-05 s, 0.0 kB/s 2023-10-14T19:07:30.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.917 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:30.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:30.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:30.972 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3445e-05 s, 0.0 kB/s 2023-10-14T19:07:30.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:30.973 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.028 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0918e-05 s, 0.0 kB/s 2023-10-14T19:07:31.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.029 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.084 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.084 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.084 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2216e-05 s, 0.0 kB/s 2023-10-14T19:07:31.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.085 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1863e-05 s, 0.0 kB/s 2023-10-14T19:07:31.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.142 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.196 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0072e-05 s, 0.0 kB/s 2023-10-14T19:07:31.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.196 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4328e-05 s, 0.0 kB/s 2023-10-14T19:07:31.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.253 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.308 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.308 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.444e-05 s, 0.0 kB/s 2023-10-14T19:07:31.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.309 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1607e-05 s, 0.0 kB/s 2023-10-14T19:07:31.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.365 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-14T19:07:31.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.421 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1336e-05 s, 0.0 kB/s 2023-10-14T19:07:31.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.478 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.533 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.533 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1781e-05 s, 0.0 kB/s 2023-10-14T19:07:31.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.534 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4218e-05 s, 0.0 kB/s 2023-10-14T19:07:31.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.590 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.645 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3366e-05 s, 0.0 kB/s 2023-10-14T19:07:31.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.645 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.701 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.702 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.209e-05 s, 0.0 kB/s 2023-10-14T19:07:31.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.702 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.758 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.761 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2204e-05 s, 0.0 kB/s 2023-10-14T19:07:31.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.762 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5716e-05 s, 0.0 kB/s 2023-10-14T19:07:31.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.818 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.872 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.872 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6689e-05 s, 0.0 kB/s 2023-10-14T19:07:31.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.873 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.928 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.928 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.928 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1969e-05 s, 0.0 kB/s 2023-10-14T19:07:31.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.929 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:31.984 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3419e-05 s, 0.0 kB/s 2023-10-14T19:07:31.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:31.986 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.040 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4413e-05 s, 0.0 kB/s 2023-10-14T19:07:32.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.041 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9637e-05 s, 0.0 kB/s 2023-10-14T19:07:32.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.098 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.152 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.153 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.153 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2789e-05 s, 0.0 kB/s 2023-10-14T19:07:32.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.154 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.208 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3483e-05 s, 0.0 kB/s 2023-10-14T19:07:32.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.210 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.264 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2953e-05 s, 0.0 kB/s 2023-10-14T19:07:32.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.265 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.251e-05 s, 0.0 kB/s 2023-10-14T19:07:32.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.322 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.379 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.379 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.379 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0373e-05 s, 0.0 kB/s 2023-10-14T19:07:32.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.380 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.435 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.435 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.113e-05 s, 0.0 kB/s 2023-10-14T19:07:32.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.436 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1759e-05 s, 0.0 kB/s 2023-10-14T19:07:32.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.491 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.547 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2486e-05 s, 0.0 kB/s 2023-10-14T19:07:32.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.549 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.603 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.604 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.604 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.5353e-05 s, 0.0 kB/s 2023-10-14T19:07:32.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.605 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.660 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9174e-05 s, 0.0 kB/s 2023-10-14T19:07:32.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.716 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3682e-05 s, 0.0 kB/s 2023-10-14T19:07:32.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.717 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0946e-05 s, 0.0 kB/s 2023-10-14T19:07:32.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.774 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9396e-05 s, 0.0 kB/s 2023-10-14T19:07:32.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.904 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.905 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1969e-05 s, 0.0 kB/s 2023-10-14T19:07:32.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.905 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:32.962 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0928e-05 s, 0.0 kB/s 2023-10-14T19:07:32.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:32.962 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.018 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2398e-05 s, 0.0 kB/s 2023-10-14T19:07:33.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.019 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.073 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.073 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.074 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1478e-05 s, 0.0 kB/s 2023-10-14T19:07:33.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.075 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6162e-05 s, 0.0 kB/s 2023-10-14T19:07:33.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.131 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.185 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.186 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4204e-05 s, 0.0 kB/s 2023-10-14T19:07:33.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.242 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.242 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3958e-05 s, 0.0 kB/s 2023-10-14T19:07:33.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.243 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.298 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1417e-05 s, 0.0 kB/s 2023-10-14T19:07:33.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.299 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.019e-05 s, 0.0 kB/s 2023-10-14T19:07:33.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.355 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.409 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.410 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2089e-05 s, 0.0 kB/s 2023-10-14T19:07:33.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.411 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.465 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1305e-05 s, 0.0 kB/s 2023-10-14T19:07:33.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.467 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.521 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.522 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.522 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1765e-05 s, 0.0 kB/s 2023-10-14T19:07:33.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.523 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.203e-05 s, 0.0 kB/s 2023-10-14T19:07:33.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.633 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.634 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.634 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3291e-05 s, 0.0 kB/s 2023-10-14T19:07:33.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.635 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.689 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.690 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.690 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5782e-05 s, 0.0 kB/s 2023-10-14T19:07:33.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-14T19:07:33.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.802 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1975e-05 s, 0.0 kB/s 2023-10-14T19:07:33.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.858 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4712e-05 s, 0.0 kB/s 2023-10-14T19:07:33.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.913 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2663e-05 s, 0.0 kB/s 2023-10-14T19:07:33.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0572e-05 s, 0.0 kB/s 2023-10-14T19:07:33.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:33.971 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.026 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1503e-05 s, 0.0 kB/s 2023-10-14T19:07:34.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.027 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-14T19:07:34.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.083 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0014e-05 s, 0.0 kB/s 2023-10-14T19:07:34.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1609e-05 s, 0.0 kB/s 2023-10-14T19:07:34.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.196 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0139e-05 s, 0.0 kB/s 2023-10-14T19:07:34.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.252 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2183e-05 s, 0.0 kB/s 2023-10-14T19:07:34.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-14T19:07:34.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.365 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9932e-05 s, 0.0 kB/s 2023-10-14T19:07:34.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.421 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.055e-05 s, 0.0 kB/s 2023-10-14T19:07:34.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.532 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.532 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9967e-05 s, 0.0 kB/s 2023-10-14T19:07:34.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.533 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.108e-05 s, 0.0 kB/s 2023-10-14T19:07:34.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.589 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1615e-05 s, 0.0 kB/s 2023-10-14T19:07:34.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.645 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.700 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0461e-05 s, 0.0 kB/s 2023-10-14T19:07:34.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.700 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.755 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0043e-05 s, 0.0 kB/s 2023-10-14T19:07:34.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.757 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2675e-05 s, 0.0 kB/s 2023-10-14T19:07:34.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.813 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0316e-05 s, 0.0 kB/s 2023-10-14T19:07:34.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.870 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.924 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.925 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.925 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.063e-05 s, 0.0 kB/s 2023-10-14T19:07:34.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.926 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:34.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:34.980 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:34.981 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.8751e-05 s, 0.0 kB/s 2023-10-14T19:07:34.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:34.981 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2799e-05 s, 0.0 kB/s 2023-10-14T19:07:35.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.038 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.093 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1697e-05 s, 0.0 kB/s 2023-10-14T19:07:35.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0329e-05 s, 0.0 kB/s 2023-10-14T19:07:35.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.150 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9405e-05 s, 0.0 kB/s 2023-10-14T19:07:35.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3396e-05 s, 0.0 kB/s 2023-10-14T19:07:35.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0824e-05 s, 0.0 kB/s 2023-10-14T19:07:35.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.318 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.373 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1831e-05 s, 0.0 kB/s 2023-10-14T19:07:35.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.428 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.264e-05 s, 0.0 kB/s 2023-10-14T19:07:35.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.430 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3201e-05 s, 0.0 kB/s 2023-10-14T19:07:35.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.486 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.540 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.541 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.054e-05 s, 0.0 kB/s 2023-10-14T19:07:35.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.542 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.596 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.597 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.597 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1944e-05 s, 0.0 kB/s 2023-10-14T19:07:35.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.598 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.654 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2786e-05 s, 0.0 kB/s 2023-10-14T19:07:35.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.655 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.101e-05 s, 0.0 kB/s 2023-10-14T19:07:35.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.768 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.768 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0501e-05 s, 0.0 kB/s 2023-10-14T19:07:35.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.769 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.833e-05 s, 0.0 kB/s 2023-10-14T19:07:35.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.825 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4872e-05 s, 0.0 kB/s 2023-10-14T19:07:35.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.882 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4356e-05 s, 0.0 kB/s 2023-10-14T19:07:35.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.938 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:35.993 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3422e-05 s, 0.0 kB/s 2023-10-14T19:07:35.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:35.995 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.050 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.050 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0561e-05 s, 0.0 kB/s 2023-10-14T19:07:36.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.051 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.106 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1104e-05 s, 0.0 kB/s 2023-10-14T19:07:36.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.107 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.161 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-14T19:07:36.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.163 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.217 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.218 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.218 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0244e-05 s, 0.0 kB/s 2023-10-14T19:07:36.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.219 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.273 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.411e-05 s, 0.0 kB/s 2023-10-14T19:07:36.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.275 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.330 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.330 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1875e-05 s, 0.0 kB/s 2023-10-14T19:07:36.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.331 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.386 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0286e-05 s, 0.0 kB/s 2023-10-14T19:07:36.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.387 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.441 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2191e-05 s, 0.0 kB/s 2023-10-14T19:07:36.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.443 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.498 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.429e-05 s, 0.0 kB/s 2023-10-14T19:07:36.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.499 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.554 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2161e-05 s, 0.0 kB/s 2023-10-14T19:07:36.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.555 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2588e-05 s, 0.0 kB/s 2023-10-14T19:07:36.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.611 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.666 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.666 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2532e-05 s, 0.0 kB/s 2023-10-14T19:07:36.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.667 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2841e-05 s, 0.0 kB/s 2023-10-14T19:07:36.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.722 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5808e-05 s, 0.0 kB/s 2023-10-14T19:07:36.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.778 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2934e-05 s, 0.0 kB/s 2023-10-14T19:07:36.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.835 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.891 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3607e-05 s, 0.0 kB/s 2023-10-14T19:07:36.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.892 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7552e-05 s, 0.0 kB/s 2023-10-14T19:07:36.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:36.948 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.004 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.005 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.334e-05 s, 0.0 kB/s 2023-10-14T19:07:37.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.006 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9947e-05 s, 0.0 kB/s 2023-10-14T19:07:37.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.062 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.117 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.118 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.118 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2613e-05 s, 0.0 kB/s 2023-10-14T19:07:37.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.119 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.173 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2034e-05 s, 0.0 kB/s 2023-10-14T19:07:37.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.175 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1899e-05 s, 0.0 kB/s 2023-10-14T19:07:37.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.231 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0769e-05 s, 0.0 kB/s 2023-10-14T19:07:37.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.287 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.342 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.342 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4285e-05 s, 0.0 kB/s 2023-10-14T19:07:37.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.343 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9724e-05 s, 0.0 kB/s 2023-10-14T19:07:37.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.399 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.454 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.454 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4338e-05 s, 0.0 kB/s 2023-10-14T19:07:37.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.510 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.510 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3369e-05 s, 0.0 kB/s 2023-10-14T19:07:37.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.511 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4151e-05 s, 0.0 kB/s 2023-10-14T19:07:37.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.567 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1399e-05 s, 0.0 kB/s 2023-10-14T19:07:37.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.623 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.677 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.678 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.678 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1549e-05 s, 0.0 kB/s 2023-10-14T19:07:37.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.679 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2046e-05 s, 0.0 kB/s 2023-10-14T19:07:37.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.735 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0149e-05 s, 0.0 kB/s 2023-10-14T19:07:37.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.791 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.846 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.846 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.847 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.388e-05 s, 0.0 kB/s 2023-10-14T19:07:37.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.847 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.972 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.972 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.7975e-05 s, 0.0 kB/s 2023-10-14T19:07:37.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.973 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:37.991 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:37.991 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5627e-05 s, 0.0 kB/s 2023-10-14T19:07:37.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:37.992 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.047 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.047 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3428e-05 s, 0.0 kB/s 2023-10-14T19:07:38.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.048 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.102 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.103 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.103 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1132e-05 s, 0.0 kB/s 2023-10-14T19:07:38.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.104 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.159 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.159 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5544e-05 s, 0.0 kB/s 2023-10-14T19:07:38.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.160 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2226e-05 s, 0.0 kB/s 2023-10-14T19:07:38.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.217 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0601e-05 s, 0.0 kB/s 2023-10-14T19:07:38.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.273 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5613e-05 s, 0.0 kB/s 2023-10-14T19:07:38.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.330 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.384 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.385 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.385 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1253e-05 s, 0.0 kB/s 2023-10-14T19:07:38.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.386 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2347e-05 s, 0.0 kB/s 2023-10-14T19:07:38.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.442 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.244e-05 s, 0.0 kB/s 2023-10-14T19:07:38.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.498 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.553 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.553 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.345e-05 s, 0.0 kB/s 2023-10-14T19:07:38.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.554 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.610 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.610 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0732e-05 s, 0.0 kB/s 2023-10-14T19:07:38.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.611 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1812e-05 s, 0.0 kB/s 2023-10-14T19:07:38.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.669 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.722 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.722 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2389e-05 s, 0.0 kB/s 2023-10-14T19:07:38.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.724 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.779 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.780 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-14T19:07:38.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.836 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1823e-05 s, 0.0 kB/s 2023-10-14T19:07:38.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.837 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4936e-05 s, 0.0 kB/s 2023-10-14T19:07:38.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:38.949 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:38.949 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:38.949 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2321e-05 s, 0.0 kB/s 2023-10-14T19:07:38.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:38.950 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4422e-05 s, 0.0 kB/s 2023-10-14T19:07:39.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.007 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.062 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.062 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.22e-05 s, 0.0 kB/s 2023-10-14T19:07:39.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.063 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4016e-05 s, 0.0 kB/s 2023-10-14T19:07:39.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.119 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3267e-05 s, 0.0 kB/s 2023-10-14T19:07:39.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.176 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3601e-05 s, 0.0 kB/s 2023-10-14T19:07:39.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.289 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.290 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-14T19:07:39.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.290 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2869e-05 s, 0.0 kB/s 2023-10-14T19:07:39.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.348 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.403 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.403 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.403 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3372e-05 s, 0.0 kB/s 2023-10-14T19:07:39.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.404 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4645e-05 s, 0.0 kB/s 2023-10-14T19:07:39.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.460 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2458e-05 s, 0.0 kB/s 2023-10-14T19:07:39.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.517 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3858e-05 s, 0.0 kB/s 2023-10-14T19:07:39.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.573 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5098e-05 s, 0.0 kB/s 2023-10-14T19:07:39.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.629 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.684 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-14T19:07:39.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.685 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4469e-05 s, 0.0 kB/s 2023-10-14T19:07:39.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.741 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3813e-05 s, 0.0 kB/s 2023-10-14T19:07:39.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.798 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1615e-05 s, 0.0 kB/s 2023-10-14T19:07:39.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.854 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.910 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2565e-05 s, 0.0 kB/s 2023-10-14T19:07:39.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.911 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3634e-05 s, 0.0 kB/s 2023-10-14T19:07:39.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:39.970 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4546e-05 s, 0.0 kB/s 2023-10-14T19:07:40.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.027 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.081 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1153e-05 s, 0.0 kB/s 2023-10-14T19:07:40.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.082 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4534e-05 s, 0.0 kB/s 2023-10-14T19:07:40.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.139 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.195 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3054e-05 s, 0.0 kB/s 2023-10-14T19:07:40.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.196 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2474e-05 s, 0.0 kB/s 2023-10-14T19:07:40.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.252 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.308 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.308 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0914e-05 s, 0.0 kB/s 2023-10-14T19:07:40.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.309 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.217e-05 s, 0.0 kB/s 2023-10-14T19:07:40.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.366 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.420 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.420 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.420 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4091e-05 s, 0.0 kB/s 2023-10-14T19:07:40.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.421 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3862e-05 s, 0.0 kB/s 2023-10-14T19:07:40.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.478 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2647e-05 s, 0.0 kB/s 2023-10-14T19:07:40.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.495e-05 s, 0.0 kB/s 2023-10-14T19:07:40.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.591 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5025e-05 s, 0.0 kB/s 2023-10-14T19:07:40.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.648 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1837e-05 s, 0.0 kB/s 2023-10-14T19:07:40.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.763 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3029e-05 s, 0.0 kB/s 2023-10-14T19:07:40.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.764 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.819 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.819 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3756e-05 s, 0.0 kB/s 2023-10-14T19:07:40.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.820 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2752e-05 s, 0.0 kB/s 2023-10-14T19:07:40.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.876 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.932 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.932 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2041e-05 s, 0.0 kB/s 2023-10-14T19:07:40.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.933 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3028e-05 s, 0.0 kB/s 2023-10-14T19:07:40.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:40.989 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.044 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.045 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1599e-05 s, 0.0 kB/s 2023-10-14T19:07:41.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.045 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.101 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.101 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5144e-05 s, 0.0 kB/s 2023-10-14T19:07:41.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.102 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.158 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.159 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.159 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3556e-05 s, 0.0 kB/s 2023-10-14T19:07:41.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.161 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.215 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.215 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4552e-05 s, 0.0 kB/s 2023-10-14T19:07:41.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.216 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.271 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.272 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.272 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-14T19:07:41.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.273 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1686e-05 s, 0.0 kB/s 2023-10-14T19:07:41.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.330 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.386 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1269e-05 s, 0.0 kB/s 2023-10-14T19:07:41.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.388 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4821e-05 s, 0.0 kB/s 2023-10-14T19:07:41.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.444 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2478e-05 s, 0.0 kB/s 2023-10-14T19:07:41.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.500 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.554 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.555 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.555 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8701e-05 s, 0.0 kB/s 2023-10-14T19:07:41.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.556 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.326e-05 s, 0.0 kB/s 2023-10-14T19:07:41.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.612 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2285e-05 s, 0.0 kB/s 2023-10-14T19:07:41.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5149e-05 s, 0.0 kB/s 2023-10-14T19:07:41.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.724 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.780 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.780 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-14T19:07:41.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5556e-05 s, 0.0 kB/s 2023-10-14T19:07:41.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.837 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.118e-05 s, 0.0 kB/s 2023-10-14T19:07:41.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.894 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:41.952 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1968e-05 s, 0.0 kB/s 2023-10-14T19:07:41.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:41.953 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.009 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2964e-05 s, 0.0 kB/s 2023-10-14T19:07:42.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3252e-05 s, 0.0 kB/s 2023-10-14T19:07:42.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.123 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.123 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.123 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3591e-05 s, 0.0 kB/s 2023-10-14T19:07:42.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.124 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5841e-05 s, 0.0 kB/s 2023-10-14T19:07:42.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.180 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-14T19:07:42.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.237 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.291 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.292 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2863e-05 s, 0.0 kB/s 2023-10-14T19:07:42.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.293 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.348 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-14T19:07:42.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.349 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.8481e-05 s, 0.0 kB/s 2023-10-14T19:07:42.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.405 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.460 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.460 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.461 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2949e-05 s, 0.0 kB/s 2023-10-14T19:07:42.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.461 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.517 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-14T19:07:42.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.518 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.575 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.412e-05 s, 0.0 kB/s 2023-10-14T19:07:42.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.575 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2284e-05 s, 0.0 kB/s 2023-10-14T19:07:42.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.633 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2881e-05 s, 0.0 kB/s 2023-10-14T19:07:42.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.689 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.745 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.745 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4907e-05 s, 0.0 kB/s 2023-10-14T19:07:42.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.746 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4355e-05 s, 0.0 kB/s 2023-10-14T19:07:42.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0262e-05 s, 0.0 kB/s 2023-10-14T19:07:42.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.914 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.914 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2369e-05 s, 0.0 kB/s 2023-10-14T19:07:42.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.915 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:42.971 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:42.971 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7247e-05 s, 0.0 kB/s 2023-10-14T19:07:42.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:42.973 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.027 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.32e-05 s, 0.0 kB/s 2023-10-14T19:07:43.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.030 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.135e-05 s, 0.0 kB/s 2023-10-14T19:07:43.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.086 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.139 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.140 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.140 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0382e-05 s, 0.0 kB/s 2023-10-14T19:07:43.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.141 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-14T19:07:43.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.197 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.252 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.253 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.253 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.136e-05 s, 0.0 kB/s 2023-10-14T19:07:43.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.254 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.309 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.310 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.310 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3297e-05 s, 0.0 kB/s 2023-10-14T19:07:43.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.311 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.365 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.366 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.366 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3146e-05 s, 0.0 kB/s 2023-10-14T19:07:43.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.367 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.421 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.422 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.422 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.443e-05 s, 0.0 kB/s 2023-10-14T19:07:43.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.423 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.478 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.478 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3188e-05 s, 0.0 kB/s 2023-10-14T19:07:43.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.479 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.535 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.535 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2409e-05 s, 0.0 kB/s 2023-10-14T19:07:43.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.592 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.592 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.41e-05 s, 0.0 kB/s 2023-10-14T19:07:43.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.593 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2543e-05 s, 0.0 kB/s 2023-10-14T19:07:43.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.650 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9621e-05 s, 0.0 kB/s 2023-10-14T19:07:43.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.761 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0429e-05 s, 0.0 kB/s 2023-10-14T19:07:43.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.762 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2782e-05 s, 0.0 kB/s 2023-10-14T19:07:43.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.818 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.873 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.296e-05 s, 0.0 kB/s 2023-10-14T19:07:43.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.875 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1906e-05 s, 0.0 kB/s 2023-10-14T19:07:43.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.931 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:43.986 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:43.986 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:43.986 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0857e-05 s, 0.0 kB/s 2023-10-14T19:07:43.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:43.987 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.282e-05 s, 0.0 kB/s 2023-10-14T19:07:44.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.044 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0468e-05 s, 0.0 kB/s 2023-10-14T19:07:44.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.100 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.157 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-14T19:07:44.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.158 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3182e-05 s, 0.0 kB/s 2023-10-14T19:07:44.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.213 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.269 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.270 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.270 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3133e-05 s, 0.0 kB/s 2023-10-14T19:07:44.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.271 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.4164e-05 s, 0.0 kB/s 2023-10-14T19:07:44.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.327 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.382 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.382 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.382 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1466e-05 s, 0.0 kB/s 2023-10-14T19:07:44.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.383 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.597e-05 s, 0.0 kB/s 2023-10-14T19:07:44.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.440 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.496 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2434e-05 s, 0.0 kB/s 2023-10-14T19:07:44.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.496 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.551 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.551 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.551 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1177e-05 s, 0.0 kB/s 2023-10-14T19:07:44.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.552 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.606 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.607 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.607 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6768e-05 s, 0.0 kB/s 2023-10-14T19:07:44.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.608 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.663 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.664 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.664 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2175e-05 s, 0.0 kB/s 2023-10-14T19:07:44.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.666 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0845e-05 s, 0.0 kB/s 2023-10-14T19:07:44.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.722 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.778 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.778 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2972e-05 s, 0.0 kB/s 2023-10-14T19:07:44.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.779 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.834 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.835 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7302e-05 s, 0.0 kB/s 2023-10-14T19:07:44.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.836 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2948e-05 s, 0.0 kB/s 2023-10-14T19:07:44.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.891 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:44.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:44.946 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:44.946 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.259e-05 s, 0.0 kB/s 2023-10-14T19:07:44.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:44.948 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.003 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.003 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.004 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4277e-05 s, 0.0 kB/s 2023-10-14T19:07:45.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.004 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.059 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1494e-05 s, 0.0 kB/s 2023-10-14T19:07:45.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.061 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3116e-05 s, 0.0 kB/s 2023-10-14T19:07:45.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.117 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.171 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.172 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2456e-05 s, 0.0 kB/s 2023-10-14T19:07:45.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.173 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0889e-05 s, 0.0 kB/s 2023-10-14T19:07:45.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.232 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.521e-05 s, 0.0 kB/s 2023-10-14T19:07:45.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.285 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.341 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3081e-05 s, 0.0 kB/s 2023-10-14T19:07:45.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.342 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2144e-05 s, 0.0 kB/s 2023-10-14T19:07:45.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.398 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.452 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.453 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.453 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2941e-05 s, 0.0 kB/s 2023-10-14T19:07:45.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.454 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.508 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.509 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.509 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2748e-05 s, 0.0 kB/s 2023-10-14T19:07:45.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.510 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.565 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.565 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.565 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7885e-05 s, 0.0 kB/s 2023-10-14T19:07:45.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.566 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.620 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.621 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.621 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.37e-05 s, 0.0 kB/s 2023-10-14T19:07:45.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.622 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2033e-05 s, 0.0 kB/s 2023-10-14T19:07:45.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.678 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.733 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.733 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.733 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1902e-05 s, 0.0 kB/s 2023-10-14T19:07:45.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.734 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.788 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.789 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.789 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3092e-05 s, 0.0 kB/s 2023-10-14T19:07:45.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.790 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2738e-05 s, 0.0 kB/s 2023-10-14T19:07:45.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.846 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1727e-05 s, 0.0 kB/s 2023-10-14T19:07:45.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.902 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:45.958 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:45.958 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:45.958 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.977e-05 s, 0.0 kB/s 2023-10-14T19:07:45.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:45.959 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.016 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.017 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.3978e-05 s, 0.0 kB/s 2023-10-14T19:07:46.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.018 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.072 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.072 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.073 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3695e-05 s, 0.0 kB/s 2023-10-14T19:07:46.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.073 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5376e-05 s, 0.0 kB/s 2023-10-14T19:07:46.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.130 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.185 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-14T19:07:46.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1692e-05 s, 0.0 kB/s 2023-10-14T19:07:46.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.243 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.297 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1907e-05 s, 0.0 kB/s 2023-10-14T19:07:46.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.299 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2293e-05 s, 0.0 kB/s 2023-10-14T19:07:46.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.356 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4415e-05 s, 0.0 kB/s 2023-10-14T19:07:46.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.412 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1574e-05 s, 0.0 kB/s 2023-10-14T19:07:46.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.523 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.523 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.523 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1242e-05 s, 0.0 kB/s 2023-10-14T19:07:46.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.524 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.579 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2525e-05 s, 0.0 kB/s 2023-10-14T19:07:46.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.582 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0955e-05 s, 0.0 kB/s 2023-10-14T19:07:46.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.637 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.694 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.694 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.347e-05 s, 0.0 kB/s 2023-10-14T19:07:46.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.696 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.749 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3201e-05 s, 0.0 kB/s 2023-10-14T19:07:46.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.751 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.1156e-05 s, 0.0 kB/s 2023-10-14T19:07:46.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.808 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4671e-05 s, 0.0 kB/s 2023-10-14T19:07:46.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.864 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2264e-05 s, 0.0 kB/s 2023-10-14T19:07:46.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:46.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:46.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:46.980 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0436e-05 s, 0.0 kB/s 2023-10-14T19:07:46.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:46.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.253e-05 s, 0.0 kB/s 2023-10-14T19:07:47.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.036 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.361e-05 s, 0.0 kB/s 2023-10-14T19:07:47.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5457e-05 s, 0.0 kB/s 2023-10-14T19:07:47.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.203 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.204 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.364e-05 s, 0.0 kB/s 2023-10-14T19:07:47.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9675e-05 s, 0.0 kB/s 2023-10-14T19:07:47.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.260 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2983e-05 s, 0.0 kB/s 2023-10-14T19:07:47.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.318 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0367e-05 s, 0.0 kB/s 2023-10-14T19:07:47.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9709e-05 s, 0.0 kB/s 2023-10-14T19:07:47.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.431 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4361e-05 s, 0.0 kB/s 2023-10-14T19:07:47.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.487 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-14T19:07:47.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.544 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.597 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4759e-05 s, 0.0 kB/s 2023-10-14T19:07:47.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.599 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3163e-05 s, 0.0 kB/s 2023-10-14T19:07:47.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.655 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.748 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.748 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3862e-05 s, 0.0 kB/s 2023-10-14T19:07:47.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.749 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0139e-05 s, 0.0 kB/s 2023-10-14T19:07:47.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.768 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.823 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.823 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.823 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2837e-05 s, 0.0 kB/s 2023-10-14T19:07:47.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.824 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0012e-05 s, 0.0 kB/s 2023-10-14T19:07:47.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.881 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4495e-05 s, 0.0 kB/s 2023-10-14T19:07:47.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.940 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1862e-05 s, 0.0 kB/s 2023-10-14T19:07:47.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:47.996 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3842e-05 s, 0.0 kB/s 2023-10-14T19:07:48.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.052 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.762e-05 s, 0.0 kB/s 2023-10-14T19:07:48.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.109 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.165 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.166 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2145e-05 s, 0.0 kB/s 2023-10-14T19:07:48.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.166 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.221 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.222 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.222 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2615e-05 s, 0.0 kB/s 2023-10-14T19:07:48.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.223 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.277 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.278 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.278 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3239e-05 s, 0.0 kB/s 2023-10-14T19:07:48.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.279 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.333 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.334 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.334 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4888e-05 s, 0.0 kB/s 2023-10-14T19:07:48.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.335 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.390 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0377e-05 s, 0.0 kB/s 2023-10-14T19:07:48.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.390 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.445 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1002e-05 s, 0.0 kB/s 2023-10-14T19:07:48.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.447 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.501 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.502 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.502 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0747e-05 s, 0.0 kB/s 2023-10-14T19:07:48.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.557 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.558 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.558 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1009e-05 s, 0.0 kB/s 2023-10-14T19:07:48.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.559 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.614 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.356e-05 s, 0.0 kB/s 2023-10-14T19:07:48.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.615 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:48.657 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3566e-05 s, 0.0 kB/s 2023-10-14T19:07:48.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.672 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.728 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.728 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5532e-05 s, 0.0 kB/s 2023-10-14T19:07:48.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.729 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.785 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.785 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.785 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.261e-05 s, 0.0 kB/s 2023-10-14T19:07:48.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.786 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.841 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.842 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.842 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9769e-05 s, 0.0 kB/s 2023-10-14T19:07:48.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.843 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-14T19:07:48.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.900 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:48.954 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:48.954 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:48.955 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3001e-05 s, 0.0 kB/s 2023-10-14T19:07:48.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:48.955 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2609e-05 s, 0.0 kB/s 2023-10-14T19:07:49.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.012 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.067 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.067 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.068 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3162e-05 s, 0.0 kB/s 2023-10-14T19:07:49.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.068 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3153e-05 s, 0.0 kB/s 2023-10-14T19:07:49.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.125 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.181 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.181 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.181 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3972e-05 s, 0.0 kB/s 2023-10-14T19:07:49.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.182 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1486e-05 s, 0.0 kB/s 2023-10-14T19:07:49.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.238 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.292 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4794e-05 s, 0.0 kB/s 2023-10-14T19:07:49.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.294 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.349 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.349 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.349 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-14T19:07:49.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.350 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1462e-05 s, 0.0 kB/s 2023-10-14T19:07:49.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.406 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0885e-05 s, 0.0 kB/s 2023-10-14T19:07:49.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.463 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2047e-05 s, 0.0 kB/s 2023-10-14T19:07:49.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.519 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.671e-05 s, 0.0 kB/s 2023-10-14T19:07:49.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.578 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.629 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.629 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9104e-05 s, 0.0 kB/s 2023-10-14T19:07:49.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.631 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.6174e-05 s, 0.0 kB/s 2023-10-14T19:07:49.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.737 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.753 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.754 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2028e-05 s, 0.0 kB/s 2023-10-14T19:07:49.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.755 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.809 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.811 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0704e-05 s, 0.0 kB/s 2023-10-14T19:07:49.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.812 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.866 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2073e-05 s, 0.0 kB/s 2023-10-14T19:07:49.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.921 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1297e-05 s, 0.0 kB/s 2023-10-14T19:07:49.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5154e-05 s, 0.0 kB/s 2023-10-14T19:07:49.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:49.979 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4379e-05 s, 0.0 kB/s 2023-10-14T19:07:50.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.093 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2637e-05 s, 0.0 kB/s 2023-10-14T19:07:50.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.094 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1965e-05 s, 0.0 kB/s 2023-10-14T19:07:50.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.150 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.2367e-05 s, 0.0 kB/s 2023-10-14T19:07:50.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.206 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2375e-05 s, 0.0 kB/s 2023-10-14T19:07:50.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3634e-05 s, 0.0 kB/s 2023-10-14T19:07:50.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4087e-05 s, 0.0 kB/s 2023-10-14T19:07:50.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.375 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.430 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.431 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4668e-05 s, 0.0 kB/s 2023-10-14T19:07:50.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.432 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.487 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.487 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.487 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3243e-05 s, 0.0 kB/s 2023-10-14T19:07:50.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.488 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4812e-05 s, 0.0 kB/s 2023-10-14T19:07:50.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.544 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.603 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3763e-05 s, 0.0 kB/s 2023-10-14T19:07:50.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.603 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.659 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2205e-05 s, 0.0 kB/s 2023-10-14T19:07:50.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3608e-05 s, 0.0 kB/s 2023-10-14T19:07:50.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.717 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5527e-05 s, 0.0 kB/s 2023-10-14T19:07:50.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.828 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.829 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.829 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.542e-05 s, 0.0 kB/s 2023-10-14T19:07:50.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.830 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4401e-05 s, 0.0 kB/s 2023-10-14T19:07:50.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.886 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.0989e-05 s, 0.0 kB/s 2023-10-14T19:07:50.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:50.997 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2668e-05 s, 0.0 kB/s 2023-10-14T19:07:50.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:50.998 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4549e-05 s, 0.0 kB/s 2023-10-14T19:07:51.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.054 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.110 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.110 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2449e-05 s, 0.0 kB/s 2023-10-14T19:07:51.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.166 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.167 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.167 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1222e-05 s, 0.0 kB/s 2023-10-14T19:07:51.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.168 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.223 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.223 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.224 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.328e-05 s, 0.0 kB/s 2023-10-14T19:07:51.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.224 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.279 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.280 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.280 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0542e-05 s, 0.0 kB/s 2023-10-14T19:07:51.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.281 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.335 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.336 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3548e-05 s, 0.0 kB/s 2023-10-14T19:07:51.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.337 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.391 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.392 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.392 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2145e-05 s, 0.0 kB/s 2023-10-14T19:07:51.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.393 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.448 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.448 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.448 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2657e-05 s, 0.0 kB/s 2023-10-14T19:07:51.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.449 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.505 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.505 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.505 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.9134e-05 s, 0.0 kB/s 2023-10-14T19:07:51.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.506 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.561 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.561 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.561 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-14T19:07:51.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.562 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0906e-05 s, 0.0 kB/s 2023-10-14T19:07:51.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.619 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2502e-05 s, 0.0 kB/s 2023-10-14T19:07:51.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.676 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.731 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.731 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.731 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3013e-05 s, 0.0 kB/s 2023-10-14T19:07:51.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.732 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.787 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.787 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.787 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1695e-05 s, 0.0 kB/s 2023-10-14T19:07:51.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.788 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.843 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.843 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.843 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3621e-05 s, 0.0 kB/s 2023-10-14T19:07:51.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.844 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4106e-05 s, 0.0 kB/s 2023-10-14T19:07:51.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.900 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:51.956 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-14T19:07:51.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:51.956 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.012 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0776e-05 s, 0.0 kB/s 2023-10-14T19:07:52.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.013 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3186e-05 s, 0.0 kB/s 2023-10-14T19:07:52.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.070 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.125 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.125 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.125 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1428e-05 s, 0.0 kB/s 2023-10-14T19:07:52.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.126 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.181 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.182 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.182 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0571e-05 s, 0.0 kB/s 2023-10-14T19:07:52.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.183 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.238 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.238 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.238 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2304e-05 s, 0.0 kB/s 2023-10-14T19:07:52.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.242 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.293 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.294 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.294 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2316e-05 s, 0.0 kB/s 2023-10-14T19:07:52.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.295 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.349 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.350 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.350 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3828e-05 s, 0.0 kB/s 2023-10-14T19:07:52.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.351 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3884e-05 s, 0.0 kB/s 2023-10-14T19:07:52.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.407 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.461 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.462 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.462 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1666e-05 s, 0.0 kB/s 2023-10-14T19:07:52.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.463 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2891e-05 s, 0.0 kB/s 2023-10-14T19:07:52.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.520 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.574 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.575 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.575 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1895e-05 s, 0.0 kB/s 2023-10-14T19:07:52.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.576 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1903e-05 s, 0.0 kB/s 2023-10-14T19:07:52.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.632 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4712e-05 s, 0.0 kB/s 2023-10-14T19:07:52.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.688 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.742 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3662e-05 s, 0.0 kB/s 2023-10-14T19:07:52.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.744 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2252e-05 s, 0.0 kB/s 2023-10-14T19:07:52.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.800 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4191e-05 s, 0.0 kB/s 2023-10-14T19:07:52.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.856 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.912 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.912 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.912 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.9172e-05 s, 0.0 kB/s 2023-10-14T19:07:52.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.913 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4498e-05 s, 0.0 kB/s 2023-10-14T19:07:52.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:52.969 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.024 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.025 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.025 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4225e-05 s, 0.0 kB/s 2023-10-14T19:07:53.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.026 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1211e-05 s, 0.0 kB/s 2023-10-14T19:07:53.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.082 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.137 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.138 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4541e-05 s, 0.0 kB/s 2023-10-14T19:07:53.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.138 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2102e-05 s, 0.0 kB/s 2023-10-14T19:07:53.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.195 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.250 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.250 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7545e-05 s, 0.0 kB/s 2023-10-14T19:07:53.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4865e-05 s, 0.0 kB/s 2023-10-14T19:07:53.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.308 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.363 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2679e-05 s, 0.0 kB/s 2023-10-14T19:07:53.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.364 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.418 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0965e-05 s, 0.0 kB/s 2023-10-14T19:07:53.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.420 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.474 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.475 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.475 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0669e-05 s, 0.0 kB/s 2023-10-14T19:07:53.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.476 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.531 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.531 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0511e-05 s, 0.0 kB/s 2023-10-14T19:07:53.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.532 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.586 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.587 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.587 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.126e-05 s, 0.0 kB/s 2023-10-14T19:07:53.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.588 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.642 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.643 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.643 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2257e-05 s, 0.0 kB/s 2023-10-14T19:07:53.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.698 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.699 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2207e-05 s, 0.0 kB/s 2023-10-14T19:07:53.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.699 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3435e-05 s, 0.0 kB/s 2023-10-14T19:07:53.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.756 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2834e-05 s, 0.0 kB/s 2023-10-14T19:07:53.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.812 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3739e-05 s, 0.0 kB/s 2023-10-14T19:07:53.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.868 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.923 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.923 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1916e-05 s, 0.0 kB/s 2023-10-14T19:07:53.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.924 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1283e-05 s, 0.0 kB/s 2023-10-14T19:07:53.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:53.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0392e-05 s, 0.0 kB/s 2023-10-14T19:07:54.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.091 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4592e-05 s, 0.0 kB/s 2023-10-14T19:07:54.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2831e-05 s, 0.0 kB/s 2023-10-14T19:07:54.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2205e-05 s, 0.0 kB/s 2023-10-14T19:07:54.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.206 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4403e-05 s, 0.0 kB/s 2023-10-14T19:07:54.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3557e-05 s, 0.0 kB/s 2023-10-14T19:07:54.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.320 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.375 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.375 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.375 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7589e-05 s, 0.0 kB/s 2023-10-14T19:07:54.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.376 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.098e-05 s, 0.0 kB/s 2023-10-14T19:07:54.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.433 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.488 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1341e-05 s, 0.0 kB/s 2023-10-14T19:07:54.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.489 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5399e-05 s, 0.0 kB/s 2023-10-14T19:07:54.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.546 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-14T19:07:54.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.602 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.657 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.657 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.657 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5825e-05 s, 0.0 kB/s 2023-10-14T19:07:54.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.658 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0088e-05 s, 0.0 kB/s 2023-10-14T19:07:54.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.715 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.770 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1206e-05 s, 0.0 kB/s 2023-10-14T19:07:54.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.839 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.840 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.1267e-05 s, 0.0 kB/s 2023-10-14T19:07:54.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.840 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.896 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.896 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4849e-05 s, 0.0 kB/s 2023-10-14T19:07:54.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:54.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:54.952 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:54.952 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.7613e-05 s, 0.0 kB/s 2023-10-14T19:07:54.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:54.953 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2691e-05 s, 0.0 kB/s 2023-10-14T19:07:55.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.010 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2624e-05 s, 0.0 kB/s 2023-10-14T19:07:55.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.1361e-05 s, 0.0 kB/s 2023-10-14T19:07:55.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.123 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.355e-05 s, 0.0 kB/s 2023-10-14T19:07:55.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.180 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.236 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.236 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1143e-05 s, 0.0 kB/s 2023-10-14T19:07:55.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.237 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.292 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2839e-05 s, 0.0 kB/s 2023-10-14T19:07:55.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.292 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.347 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.348 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.348 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2762e-05 s, 0.0 kB/s 2023-10-14T19:07:55.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.349 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1259e-05 s, 0.0 kB/s 2023-10-14T19:07:55.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.405 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.460 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.460 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.460 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5518e-05 s, 0.0 kB/s 2023-10-14T19:07:55.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.461 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2436e-05 s, 0.0 kB/s 2023-10-14T19:07:55.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.517 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.572 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.572 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.572 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6148e-05 s, 0.0 kB/s 2023-10-14T19:07:55.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.573 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.627 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1808e-05 s, 0.0 kB/s 2023-10-14T19:07:55.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.629 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.684 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.684 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1249e-05 s, 0.0 kB/s 2023-10-14T19:07:55.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.685 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.740 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.740 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2756e-05 s, 0.0 kB/s 2023-10-14T19:07:55.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.741 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2165e-05 s, 0.0 kB/s 2023-10-14T19:07:55.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0231e-05 s, 0.0 kB/s 2023-10-14T19:07:55.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.854 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3957e-05 s, 0.0 kB/s 2023-10-14T19:07:55.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.910 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:55.966 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:55.966 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2159e-05 s, 0.0 kB/s 2023-10-14T19:07:55.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:55.967 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.552e-05 s, 0.0 kB/s 2023-10-14T19:07:56.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.023 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.078 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.079 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.079 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2e-05 s, 0 B/s 2023-10-14T19:07:56.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.080 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1549e-05 s, 0.0 kB/s 2023-10-14T19:07:56.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.136 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.191 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4328e-05 s, 0.0 kB/s 2023-10-14T19:07:56.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.192 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.247 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.248 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.248 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0053e-05 s, 0.0 kB/s 2023-10-14T19:07:56.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.249 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.303 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1012e-05 s, 0.0 kB/s 2023-10-14T19:07:56.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3586e-05 s, 0.0 kB/s 2023-10-14T19:07:56.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.361 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.415 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.416 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.416 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4416e-05 s, 0.0 kB/s 2023-10-14T19:07:56.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.417 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.471 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1906e-05 s, 0.0 kB/s 2023-10-14T19:07:56.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.473 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.518e-05 s, 0.0 kB/s 2023-10-14T19:07:56.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.529 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.584 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.585 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.585 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1516e-05 s, 0.0 kB/s 2023-10-14T19:07:56.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.586 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.641 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1218e-05 s, 0.0 kB/s 2023-10-14T19:07:56.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.641 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2023e-05 s, 0.0 kB/s 2023-10-14T19:07:56.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.698 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.752 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.752 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3445e-05 s, 0.0 kB/s 2023-10-14T19:07:56.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.754 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4018e-05 s, 0.0 kB/s 2023-10-14T19:07:56.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.811 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.865 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.866 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.866 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0706e-05 s, 0.0 kB/s 2023-10-14T19:07:56.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2779e-05 s, 0.0 kB/s 2023-10-14T19:07:56.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:56.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:56.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:56.978 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-14T19:07:56.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:56.979 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.036 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.036 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4402e-05 s, 0.0 kB/s 2023-10-14T19:07:57.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.107e-05 s, 0.0 kB/s 2023-10-14T19:07:57.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.093 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.148 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.148 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3404e-05 s, 0.0 kB/s 2023-10-14T19:07:57.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.204 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.205 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4851e-05 s, 0.0 kB/s 2023-10-14T19:07:57.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.205 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2366e-05 s, 0.0 kB/s 2023-10-14T19:07:57.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.317 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.318 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.318 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3815e-05 s, 0.0 kB/s 2023-10-14T19:07:57.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.374 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3766e-05 s, 0.0 kB/s 2023-10-14T19:07:57.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.376 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4789e-05 s, 0.0 kB/s 2023-10-14T19:07:57.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.432 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3537e-05 s, 0.0 kB/s 2023-10-14T19:07:57.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.489 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.543 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.544 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9101e-05 s, 0.0 kB/s 2023-10-14T19:07:57.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.545 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2088e-05 s, 0.0 kB/s 2023-10-14T19:07:57.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.601 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7344e-05 s, 0.0 kB/s 2023-10-14T19:07:57.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.657 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.713 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.714 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.714 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0863e-05 s, 0.0 kB/s 2023-10-14T19:07:57.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.716 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.769 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.770 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.770 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-14T19:07:57.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.826 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.827 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.827 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2966e-05 s, 0.0 kB/s 2023-10-14T19:07:57.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.828 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.883 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.883 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0957e-05 s, 0.0 kB/s 2023-10-14T19:07:57.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.884 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-14T19:07:57.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:57.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:57.997 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:57.998 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1707e-05 s, 0.0 kB/s 2023-10-14T19:07:57.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:57.998 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2356e-05 s, 0.0 kB/s 2023-10-14T19:07:58.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2762e-05 s, 0.0 kB/s 2023-10-14T19:07:58.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.112 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.167 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.167 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.168 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2794e-05 s, 0.0 kB/s 2023-10-14T19:07:58.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.168 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4218e-05 s, 0.0 kB/s 2023-10-14T19:07:58.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.226 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5549e-05 s, 0.0 kB/s 2023-10-14T19:07:58.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.282 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.337 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.338 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.338 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.041e-05 s, 0.0 kB/s 2023-10-14T19:07:58.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.339 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0014e-05 s, 0.0 kB/s 2023-10-14T19:07:58.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.395 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2707e-05 s, 0.0 kB/s 2023-10-14T19:07:58.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.452 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.507 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.507 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.507 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4901e-05 s, 0.0 kB/s 2023-10-14T19:07:58.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.508 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 2.9061e-05 s, 0.0 kB/s 2023-10-14T19:07:58.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.564 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.620 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.620 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.620 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.076e-05 s, 0.0 kB/s 2023-10-14T19:07:58.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.621 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3804e-05 s, 0.0 kB/s 2023-10-14T19:07:58.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.678 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3366e-05 s, 0.0 kB/s 2023-10-14T19:07:58.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.735 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.791 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.7603e-05 s, 0.0 kB/s 2023-10-14T19:07:58.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.793 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.848 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.848 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.849 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2523e-05 s, 0.0 kB/s 2023-10-14T19:07:58.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.850 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.905 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.905 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.905 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0767e-05 s, 0.0 kB/s 2023-10-14T19:07:58.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.906 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:58.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:58.962 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:58.963 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4345e-05 s, 0.0 kB/s 2023-10-14T19:07:58.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:58.963 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.019 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.020 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.020 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3306e-05 s, 0.0 kB/s 2023-10-14T19:07:59.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.021 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1534e-05 s, 0.0 kB/s 2023-10-14T19:07:59.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.077 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2982e-05 s, 0.0 kB/s 2023-10-14T19:07:59.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.134 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.192 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4199e-05 s, 0.0 kB/s 2023-10-14T19:07:59.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.192 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2245e-05 s, 0.0 kB/s 2023-10-14T19:07:59.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.250 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.272e-05 s, 0.0 kB/s 2023-10-14T19:07:59.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.306 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.363 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4002e-05 s, 0.0 kB/s 2023-10-14T19:07:59.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.364 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2252e-05 s, 0.0 kB/s 2023-10-14T19:07:59.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.420 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1114e-05 s, 0.0 kB/s 2023-10-14T19:07:59.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3824e-05 s, 0.0 kB/s 2023-10-14T19:07:59.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.534 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.591 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.591 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2162e-05 s, 0.0 kB/s 2023-10-14T19:07:59.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.592 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.647 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.647 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4187e-05 s, 0.0 kB/s 2023-10-14T19:07:59.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.648 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.704 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2488e-05 s, 0.0 kB/s 2023-10-14T19:07:59.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.137e-05 s, 0.0 kB/s 2023-10-14T19:07:59.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.763 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.818 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.819 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4665e-05 s, 0.0 kB/s 2023-10-14T19:07:59.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.819 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.874 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.874 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.875 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2934e-05 s, 0.0 kB/s 2023-10-14T19:07:59.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.876 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 4.716e-05 s, 0.0 kB/s 2023-10-14T19:07:59.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.962 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:07:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:07:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:07:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3033e-05 s, 0.0 kB/s 2023-10-14T19:07:59.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:07:59.980 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.041 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.041 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1471e-05 s, 0.0 kB/s 2023-10-14T19:08:00.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.042 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1378e-05 s, 0.0 kB/s 2023-10-14T19:08:00.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.099 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5194e-05 s, 0.0 kB/s 2023-10-14T19:08:00.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.155 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.209 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2875e-05 s, 0.0 kB/s 2023-10-14T19:08:00.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.211 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.265 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.266 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.266 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4267e-05 s, 0.0 kB/s 2023-10-14T19:08:00.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.267 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5436e-05 s, 0.0 kB/s 2023-10-14T19:08:00.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.325 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.379 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2007e-05 s, 0.0 kB/s 2023-10-14T19:08:00.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.381 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.436 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.436 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1236e-05 s, 0.0 kB/s 2023-10-14T19:08:00.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.437 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-14T19:08:00.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.493 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.552 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.552 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.553 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3413e-05 s, 0.0 kB/s 2023-10-14T19:08:00.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.554 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0789e-05 s, 0.0 kB/s 2023-10-14T19:08:00.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.610 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.665 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.665 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3141e-05 s, 0.0 kB/s 2023-10-14T19:08:00.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.666 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3523e-05 s, 0.0 kB/s 2023-10-14T19:08:00.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.722 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0895e-05 s, 0.0 kB/s 2023-10-14T19:08:00.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.778 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.0748e-05 s, 0.0 kB/s 2023-10-14T19:08:00.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.834 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.888 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.889 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.889 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.4224e-05 s, 0.0 kB/s 2023-10-14T19:08:00.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.890 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:00.945 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:00.945 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:00.945 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.5525e-05 s, 0.0 kB/s 2023-10-14T19:08:00.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:00.946 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.002 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.002 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.002 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2255e-05 s, 0.0 kB/s 2023-10-14T19:08:01.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.003 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2924e-05 s, 0.0 kB/s 2023-10-14T19:08:01.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.060 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.115 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.3534e-05 s, 0.0 kB/s 2023-10-14T19:08:01.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.117 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.171 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.172 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.172 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.2891e-05 s, 0.0 kB/s 2023-10-14T19:08:01.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.173 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.227 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.293e-05 s, 0.0 kB/s 2023-10-14T19:08:01.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.229 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.356e-05 s, 0.0 kB/s 2023-10-14T19:08:01.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.286 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.341 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.341 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.6237e-05 s, 0.0 kB/s 2023-10-14T19:08:01.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:01.342 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000749443/bcf665f3-4d31-4c6e-a3aa-c07da2fd8999/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T19:08:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records in 2023-10-14T19:08:01.399 INFO:teuthology.orchestra.run.smithi007.stderr:0+0 records out 2023-10-14T19:08:01.399 INFO:teuthology.orchestra.run.smithi007.stderr:0 bytes copied, 3.1651e-05 s, 0.0 kB/s 2023-10-14T19:08:01.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000749443 2023-10-14T19:08:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.561+0000 7fa48143a700 1 Processor -- start 2023-10-14T19:08:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.561+0000 7fa48143a700 1 -- start start 2023-10-14T19:08:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa48143a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 0x7fa47c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa48143a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 0x7fa47c0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa48143a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c15da00 con 0x7fa47c159580 2023-10-14T19:08:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa48143a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c0b0470 con 0x7fa47c159950 2023-10-14T19:08:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa48143a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c15e200 con 0x7fa47c0cd920 2023-10-14T19:08:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa47b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 0x7fa47c0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa47a7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 0x7fa47c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa47a7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 0x7fa47c0b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:33138/0 (socket says 172.21.15.7:33138) 2023-10-14T19:08:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa47a7fc700 1 -- 172.21.15.7:0/1452616891 learned_addr learned my addr 172.21.15.7:0/1452616891 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa47b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 0x7fa47c0aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56506/0 (socket says 172.21.15.7:56506) 2023-10-14T19:08:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.562+0000 7fa47affd700 1 --1- 172.21.15.7:0/1452616891 >> v1:172.21.15.148:6789/0 conn(0x7fa47c159580 0x7fa47c15d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:43324/0 (socket says 172.21.15.7:43324) 2023-10-14T19:08:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa47a7fc700 1 -- 172.21.15.7:0/1452616891 >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 msgr2=0x7fa47c0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa47a7fc700 1 --2- 172.21.15.7:0/1452616891 >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 0x7fa47c0aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa47a7fc700 1 -- 172.21.15.7:0/1452616891 >> v1:172.21.15.148:6789/0 conn(0x7fa47c159580 legacy=0x7fa47c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa479ffb700 1 -- 172.21.15.7:0/1452616891 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084349839 0 0) 0x7fa46c001110 con 0x7fa47c159580 2023-10-14T19:08:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa47a7fc700 1 -- 172.21.15.7:0/1452616891 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0b0140 con 0x7fa47c0cd920 2023-10-14T19:08:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa47b7fe700 1 --2- 172.21.15.7:0/1452616891 >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 0x7fa47c0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa47a7fc700 1 --2- 172.21.15.7:0/1452616891 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 0x7fa47c0b0900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4640099b0 tx=0x7fa464009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701252e7c5ba6a44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa479ffb700 1 -- 172.21.15.7:0/1452616891 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464009ea0 con 0x7fa47c0cd920 2023-10-14T19:08:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa479ffb700 1 -- 172.21.15.7:0/1452616891 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46400b860 con 0x7fa47c0cd920 2023-10-14T19:08:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa479ffb700 1 -- 172.21.15.7:0/1452616891 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400bc00 con 0x7fa47c0cd920 2023-10-14T19:08:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa48143a700 1 -- 172.21.15.7:0/1452616891 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 msgr2=0x7fa47c0b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.563+0000 7fa48143a700 1 --2- 172.21.15.7:0/1452616891 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 0x7fa47c0b0900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4640099b0 tx=0x7fa464009250 comp rx=0 tx=0).stop 2023-10-14T19:08:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.564+0000 7fa48143a700 1 -- 172.21.15.7:0/1452616891 shutdown_connections 2023-10-14T19:08:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.564+0000 7fa48143a700 1 --2- 172.21.15.7:0/1452616891 >> v2:172.21.15.148:3300/0 conn(0x7fa47c159950 0x7fa47c0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.564+0000 7fa48143a700 1 --2- 172.21.15.7:0/1452616891 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c0cd920 0x7fa47c0b0900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.564+0000 7fa48143a700 1 -- 172.21.15.7:0/1452616891 >> 172.21.15.7:0/1452616891 conn(0x7fa47c0675a0 msgr2=0x7fa47c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.564+0000 7fa48143a700 1 -- 172.21.15.7:0/1452616891 shutdown_connections 2023-10-14T19:08:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.564+0000 7fa48143a700 1 -- 172.21.15.7:0/1452616891 wait complete. 2023-10-14T19:08:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.565+0000 7fa48143a700 1 Processor -- start 2023-10-14T19:08:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.565+0000 7fa48143a700 1 -- start start 2023-10-14T19:08:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa48143a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 0x7fa47c16d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa48143a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa47c159580 0x7fa47c16a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa48143a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c159950 0x7fa47c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa48143a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c16e410 con 0x7fa47c0cd920 2023-10-14T19:08:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa48143a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c1537d0 con 0x7fa47c159580 2023-10-14T19:08:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa48143a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c1534c0 con 0x7fa47c159950 2023-10-14T19:08:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 0x7fa47c16d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 0x7fa47c16d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41560/0 (socket says 172.21.15.7:41560) 2023-10-14T19:08:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 -- 172.21.15.7:0/1418982479 learned_addr learned my addr 172.21.15.7:0/1418982479 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47a7fc700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa47c159580 0x7fa47c16a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47b7fe700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c159950 0x7fa47c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 -- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c159950 msgr2=0x7fa47c13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c159950 0x7fa47c13f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 -- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa47c159580 msgr2=0x7fa47c16a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa47c159580 0x7fa47c16a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 -- 172.21.15.7:0/1418982479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474009a20 con 0x7fa47c0cd920 2023-10-14T19:08:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.566+0000 7fa47affd700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 0x7fa47c16d4e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00c810 tx=0x7fa46c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.567+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c005a70 con 0x7fa47c0cd920 2023-10-14T19:08:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.567+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c005bd0 con 0x7fa47c0cd920 2023-10-14T19:08:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.567+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0070d0 con 0x7fa47c0cd920 2023-10-14T19:08:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.567+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4640094f0 con 0x7fa47c0cd920 2023-10-14T19:08:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.567+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c16de50 con 0x7fa47c0cd920 2023-10-14T19:08:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.568+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c04c3c0 con 0x7fa47c0cd920 2023-10-14T19:08:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.568+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa46c007500 con 0x7fa47c0cd920 2023-10-14T19:08:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.568+0000 7fa472ffd700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa45c066fc0 0x7fa45c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.569+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa46c083880 con 0x7fa47c0cd920 2023-10-14T19:08:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.569+0000 7fa47a7fc700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa45c066fc0 0x7fa45c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.569+0000 7fa47a7fc700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa45c066fc0 0x7fa45c069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa4640099b0 tx=0x7fa464017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.573+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa46c050b80 con 0x7fa47c0cd920 2023-10-14T19:08:01.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.797+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000749443", "target": ["mon-mgr", ""]}) v1 -- 0x7fa47c153910 con 0x7fa45c066fc0 2023-10-14T19:08:01.802 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.801+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.802 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.801+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.802 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.801+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.802 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.801+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.802 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.801+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.859+0000 7fa472ffd700 1 -- 172.21.15.7:0/1418982479 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa46400b9d0 con 0x7fa45c066fc0 2023-10-14T19:08:01.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa45c066fc0 msgr2=0x7fa45c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:01.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa45c066fc0 0x7fa45c069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa4640099b0 tx=0x7fa464017000 comp rx=0 tx=0).stop 2023-10-14T19:08:01.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 msgr2=0x7fa47c16d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:01.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 0x7fa47c16d4e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00c810 tx=0x7fa46c007c50 comp rx=0 tx=0).stop 2023-10-14T19:08:01.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 shutdown_connections 2023-10-14T19:08:01.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa45c066fc0 0x7fa45c069470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa47c159950 0x7fa47c13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c0cd920 0x7fa47c16d4e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 --2- 172.21.15.7:0/1418982479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa47c159580 0x7fa47c16a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:01.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 >> 172.21.15.7:0/1418982479 conn(0x7fa47c0675a0 msgr2=0x7fa47c158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:01.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 shutdown_connections 2023-10-14T19:08:01.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:01.862+0000 7fa48143a700 1 -- 172.21.15.7:0/1418982479 wait complete. 2023-10-14T19:08:01.865 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.862+0000 7f53c2835700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.865 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.862+0000 7f53c2835700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.865 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.862+0000 7f53c2835700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.865 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.862+0000 7f53c2835700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.865 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.862+0000 7f53c2835700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-14T19:08:01.876 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.875+0000 7f53c3837700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.876 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.875+0000 7f53c3837700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.877 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.875+0000 7f53c3837700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.877 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.875+0000 7f53c3837700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:01.877 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:01.875+0000 7f53c3837700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:02.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.015+0000 7f722629c700 1 Processor -- start 2023-10-14T19:08:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.015+0000 7f722629c700 1 -- start start 2023-10-14T19:08:02.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f722629c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142c00 0x7f722006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:02.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f722629c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f722006bd20 0x7f72200c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:02.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f722629c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72200ca480 con 0x7f7220142fd0 2023-10-14T19:08:02.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f722629c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722015e240 con 0x7f722006bd20 2023-10-14T19:08:02.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f722629c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722006b350 con 0x7f7220142c00 2023-10-14T19:08:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f7224a99700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f722006bd20 0x7f72200c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f7225a9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7220142fd0 0x7f722006c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50794/0 (socket says 172.21.15.7:50794) 2023-10-14T19:08:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.016+0000 7f7225a9b700 1 -- 172.21.15.7:0/3975716692 learned_addr learned my addr 172.21.15.7:0/3975716692 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f722529a700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142c00 0x7f722006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f7224a99700 1 -- 172.21.15.7:0/3975716692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142c00 msgr2=0x7f722006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f7224a99700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142c00 0x7f722006b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f7224a99700 1 -- 172.21.15.7:0/3975716692 >> v1:172.21.15.7:6789/0 conn(0x7f7220142fd0 legacy=0x7f722006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f7224a99700 1 -- 172.21.15.7:0/3975716692 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722015df60 con 0x7f722006bd20 2023-10-14T19:08:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f721ffff700 1 -- 172.21.15.7:0/3975716692 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888568017 0 0) 0x7f72200ca480 con 0x7f7220142fd0 2023-10-14T19:08:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f722529a700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142c00 0x7f722006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f7224a99700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72200c7880 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f72140098e0 tx=0x7f72140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5664b079ff6ad07b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f721ffff700 1 -- 172.21.15.7:0/3975716692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214009e80 con 0x7f722006bd20 2023-10-14T19:08:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f721ffff700 1 -- 172.21.15.7:0/3975716692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400b860 con 0x7f722006bd20 2023-10-14T19:08:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f721ffff700 1 -- 172.21.15.7:0/3975716692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400bbe0 con 0x7f722006bd20 2023-10-14T19:08:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f722629c700 1 -- 172.21.15.7:0/3975716692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 msgr2=0x7f72200c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.017+0000 7f722629c700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72200c7880 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f72140098e0 tx=0x7f72140091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.018+0000 7f722629c700 1 -- 172.21.15.7:0/3975716692 shutdown_connections 2023-10-14T19:08:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.018+0000 7f722629c700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142c00 0x7f722006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.018+0000 7f722629c700 1 --2- 172.21.15.7:0/3975716692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72200c7880 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.018+0000 7f722629c700 1 -- 172.21.15.7:0/3975716692 >> 172.21.15.7:0/3975716692 conn(0x7f72200675a0 msgr2=0x7f72200679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.018+0000 7f722629c700 1 -- 172.21.15.7:0/3975716692 shutdown_connections 2023-10-14T19:08:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.018+0000 7f722629c700 1 -- 172.21.15.7:0/3975716692 wait complete. 2023-10-14T19:08:02.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.019+0000 7f722629c700 1 Processor -- start 2023-10-14T19:08:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.019+0000 7f722629c700 1 -- start start 2023-10-14T19:08:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722629c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72201590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722629c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7220142c00 0x7f72200affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722629c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142fd0 0x7f72200b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722629c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72200c5e40 con 0x7f722006bd20 2023-10-14T19:08:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722629c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72200c4da0 con 0x7f7220142c00 2023-10-14T19:08:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722629c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72200c5080 con 0x7f7220142fd0 2023-10-14T19:08:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72201590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72201590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41572/0 (socket says 172.21.15.7:41572) 2023-10-14T19:08:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 -- 172.21.15.7:0/442407956 learned_addr learned my addr 172.21.15.7:0/442407956 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f7225a9b700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142fd0 0x7f72200b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f7224a99700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7220142c00 0x7f72200affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 -- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142fd0 msgr2=0x7f72200b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142fd0 0x7f72200b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 -- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7220142c00 msgr2=0x7f72200affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7220142c00 0x7f72200affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 -- 172.21.15.7:0/442407956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009420 con 0x7f722006bd20 2023-10-14T19:08:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f7224a99700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7220142c00 0x7f72200affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.020+0000 7f722529a700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72201590e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f721000a400 tx=0x7f7210007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.021+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000ae20 con 0x7f722006bd20 2023-10-14T19:08:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.021+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721000d650 con 0x7f722006bd20 2023-10-14T19:08:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.021+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72200c5360 con 0x7f722006bd20 2023-10-14T19:08:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.021+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000d9f0 con 0x7f722006bd20 2023-10-14T19:08:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.021+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72200c5920 con 0x7f722006bd20 2023-10-14T19:08:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.022+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7210015440 con 0x7f722006bd20 2023-10-14T19:08:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.022+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722006f940 con 0x7f722006bd20 2023-10-14T19:08:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.022+0000 7f721d7fa700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f720c066fc0 0x7f720c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.022+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7210084db0 con 0x7f722006bd20 2023-10-14T19:08:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.023+0000 7f7224a99700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f720c066fc0 0x7f720c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:02.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.023+0000 7f7224a99700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f720c066fc0 0x7f720c069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f72200b0fc0 tx=0x7f7214017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:02.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.027+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f721004e5a0 con 0x7f722006bd20 2023-10-14T19:08:02.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.289+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f72200c51f0 con 0x7f720c066fc0 2023-10-14T19:08:02.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.297+0000 7f721d7fa700 1 -- 172.21.15.7:0/442407956 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+537 (secure 0 0 0) 0x7f72200c51f0 con 0x7f720c066fc0 2023-10-14T19:08:02.297 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:02.297 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_addrs": [ 2023-10-14T19:08:02.297 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.7:6789", 2023-10-14T19:08:02.297 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6789", 2023-10-14T19:08:02.297 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6790" 2023-10-14T19:08:02.298 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:08:02.298 INFO:teuthology.orchestra.run.smithi007.stdout: "pending_subvolume_deletions": 1, 2023-10-14T19:08:02.298 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": { 2023-10-14T19:08:02.298 INFO:teuthology.orchestra.run.smithi007.stdout: "data": [ 2023-10-14T19:08:02.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:02.299 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": 365959020544, 2023-10-14T19:08:02.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_data", 2023-10-14T19:08:02.299 INFO:teuthology.orchestra.run.smithi007.stdout: "used": 8192 2023-10-14T19:08:02.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:02.300 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:08:02.300 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": [ 2023-10-14T19:08:02.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:02.300 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": 365959020544, 2023-10-14T19:08:02.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_metadata", 2023-10-14T19:08:02.301 INFO:teuthology.orchestra.run.smithi007.stdout: "used": 19914752 2023-10-14T19:08:02.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:02.301 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:08:02.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:02.302 INFO:teuthology.orchestra.run.smithi007.stdout: "used_size": 145 2023-10-14T19:08:02.302 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:02.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f720c066fc0 msgr2=0x7f720c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:02.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f720c066fc0 0x7f720c069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f72200b0fc0 tx=0x7f7214017000 comp rx=0 tx=0).stop 2023-10-14T19:08:02.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 msgr2=0x7f72201590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:02.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72201590e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f721000a400 tx=0x7f7210007910 comp rx=0 tx=0).stop 2023-10-14T19:08:02.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 shutdown_connections 2023-10-14T19:08:02.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f720c066fc0 0x7f720c069470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7220142fd0 0x7f72200b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f722006bd20 0x7f72201590e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 --2- 172.21.15.7:0/442407956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7220142c00 0x7f72200affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:02.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.299+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 >> 172.21.15.7:0/442407956 conn(0x7f72200675a0 msgr2=0x7f72200cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:02.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.300+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 shutdown_connections 2023-10-14T19:08:02.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:02.300+0000 7f722629c700 1 -- 172.21.15.7:0/442407956 wait complete. 2023-10-14T19:08:02.316 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:08:02.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:02.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:02.401 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:08:02.401 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:08:02.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:02.402 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:02.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:08:02.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:02.947 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:08:02.963 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:08:02.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:02.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:03.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:08:03.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:03.491 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:08:03.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:03.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.633+0000 7f277bcd0700 1 Processor -- start 2023-10-14T19:08:03.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.633+0000 7f277bcd0700 1 -- start start 2023-10-14T19:08:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f277bcd0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f2774159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f277bcd0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27740c3250 0x7f277415a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f277bcd0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277406c7d0 con 0x7f277415a850 2023-10-14T19:08:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f277bcd0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27741171e0 con 0x7f27740c3250 2023-10-14T19:08:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f277bcd0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277415acb0 con 0x7f2774143200 2023-10-14T19:08:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f2774159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f2774159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:33176/0 (socket says 172.21.15.7:33176) 2023-10-14T19:08:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f277926b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27740c3250 0x7f277415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:03.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 -- 172.21.15.7:0/2057382541 learned_addr learned my addr 172.21.15.7:0/2057382541 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:03.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 -- 172.21.15.7:0/2057382541 >> v2:172.21.15.148:3300/0 conn(0x7f27740c3250 msgr2=0x7f277415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:03.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 --2- 172.21.15.7:0/2057382541 >> v2:172.21.15.148:3300/0 conn(0x7f27740c3250 0x7f277415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 -- 172.21.15.7:0/2057382541 >> v1:172.21.15.148:6789/0 conn(0x7f277415a850 legacy=0x7f277406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:03.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.634+0000 7f2779a6c700 1 -- 172.21.15.7:0/2057382541 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740c37a0 con 0x7f2774143200 2023-10-14T19:08:03.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.635+0000 7f277926b700 1 --2- 172.21.15.7:0/2057382541 >> v2:172.21.15.148:3300/0 conn(0x7f27740c3250 0x7f277415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:03.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.635+0000 7f2779a6c700 1 --2- 172.21.15.7:0/2057382541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f2774159dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f27700099b0 tx=0x7f2770009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b802c2249bc4b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:03.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.635+0000 7f2778a6a700 1 -- 172.21.15.7:0/2057382541 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770009ea0 con 0x7f2774143200 2023-10-14T19:08:03.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.635+0000 7f2778a6a700 1 -- 172.21.15.7:0/2057382541 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000b860 con 0x7f2774143200 2023-10-14T19:08:03.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.635+0000 7f2778a6a700 1 -- 172.21.15.7:0/2057382541 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000bc00 con 0x7f2774143200 2023-10-14T19:08:03.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 -- 172.21.15.7:0/2057382541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 msgr2=0x7f2774159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 --2- 172.21.15.7:0/2057382541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f2774159dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f27700099b0 tx=0x7f2770009250 comp rx=0 tx=0).stop 2023-10-14T19:08:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 -- 172.21.15.7:0/2057382541 shutdown_connections 2023-10-14T19:08:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 --2- 172.21.15.7:0/2057382541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f2774159dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 --2- 172.21.15.7:0/2057382541 >> v2:172.21.15.148:3300/0 conn(0x7f27740c3250 0x7f277415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 -- 172.21.15.7:0/2057382541 >> 172.21.15.7:0/2057382541 conn(0x7f27740ccb60 msgr2=0x7f27740ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:03.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 -- 172.21.15.7:0/2057382541 shutdown_connections 2023-10-14T19:08:03.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.636+0000 7f277bcd0700 1 -- 172.21.15.7:0/2057382541 wait complete. 2023-10-14T19:08:03.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.637+0000 7f277bcd0700 1 Processor -- start 2023-10-14T19:08:03.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.637+0000 7f277bcd0700 1 -- start start 2023-10-14T19:08:03.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.638+0000 7f277bcd0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 0x7f2774128c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:03.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.638+0000 7f277bcd0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f277416cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:03.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277bcd0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277415a850 0x7f27741392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:03.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277bcd0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2774136ae0 con 0x7f277415a850 2023-10-14T19:08:03.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277bcd0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741370a0 con 0x7f27740c3250 2023-10-14T19:08:03.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277bcd0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277416d990 con 0x7f2774143200 2023-10-14T19:08:03.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 0x7f2774128c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:03.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277a26d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277415a850 0x7f27741392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:03.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 0x7f2774128c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56550/0 (socket says 172.21.15.7:56550) 2023-10-14T19:08:03.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277a26d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277415a850 0x7f27741392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41576/0 (socket says 172.21.15.7:41576) 2023-10-14T19:08:03.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 -- 172.21.15.7:0/1082171111 learned_addr learned my addr 172.21.15.7:0/1082171111 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:03.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f277926b700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f277416cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:03.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 -- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 msgr2=0x7f277416cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:03.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f277416cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 -- 172.21.15.7:0/1082171111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277415a850 msgr2=0x7f27741392f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:03.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277415a850 0x7f27741392f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 -- 172.21.15.7:0/1082171111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764009420 con 0x7f27740c3250 2023-10-14T19:08:03.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2779a6c700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 0x7f2774128c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f277415adf0 tx=0x7f2770017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:03.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770000d10 con 0x7f27740c3250 2023-10-14T19:08:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.639+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000bbe0 con 0x7f27740c3250 2023-10-14T19:08:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.640+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700094f0 con 0x7f27740c3250 2023-10-14T19:08:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.640+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011670 con 0x7f27740c3250 2023-10-14T19:08:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.640+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2774136d30 con 0x7f27740c3250 2023-10-14T19:08:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.641+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277404c3c0 con 0x7f27740c3250 2023-10-14T19:08:03.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.641+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2770011aa0 con 0x7f27740c3250 2023-10-14T19:08:03.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.642+0000 7f2769ffb700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2758066fc0 0x7f2758069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:03.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.642+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2770085e70 con 0x7f27740c3250 2023-10-14T19:08:03.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.642+0000 7f277926b700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2758066fc0 0x7f2758069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:03.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.642+0000 7f277926b700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2758066fc0 0x7f2758069470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2774138cf0 tx=0x7f27640091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:03.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.646+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2770052fb0 con 0x7f27740c3250 2023-10-14T19:08:03.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.904+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27740cc090 con 0x7f27740c3250 2023-10-14T19:08:03.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.905+0000 7f2769ffb700 1 -- 172.21.15.7:0/1082171111 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f27700565d0 con 0x7f27740c3250 2023-10-14T19:08:03.906 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:03.907 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:57.340873+0000","modified":"2023-10-14T19:05:00.971319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3259245177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3259245177},{"type":"v1","addr":"172.21.15.7:6835","nonce":3259245177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T19:08:03.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2758066fc0 msgr2=0x7f2758069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:03.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2758066fc0 0x7f2758069470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2774138cf0 tx=0x7f27640091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 msgr2=0x7f2774128c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:03.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 0x7f2774128c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f277415adf0 tx=0x7f2770017000 comp rx=0 tx=0).stop 2023-10-14T19:08:03.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 shutdown_connections 2023-10-14T19:08:03.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2758066fc0 0x7f2758069470 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27740c3250 0x7f2774128c20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277415a850 0x7f27741392f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 --2- 172.21.15.7:0/1082171111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2774143200 0x7f277416cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:03.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 >> 172.21.15.7:0/1082171111 conn(0x7f27740ccb60 msgr2=0x7f27740c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 shutdown_connections 2023-10-14T19:08:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:03.907+0000 7f277bcd0700 1 -- 172.21.15.7:0/1082171111 wait complete. 2023-10-14T19:08:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2023-10-14T19:08:03.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:04.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.070+0000 7ff7fd62a700 1 Processor -- start 2023-10-14T19:08:04.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.070+0000 7ff7fd62a700 1 -- start start 2023-10-14T19:08:04.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7fd62a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7f80c9d30 0x7ff7f80ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7fd62a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff7f815d830 0x7ff7f806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7fd62a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f806c6a0 con 0x7ff7f815d390 2023-10-14T19:08:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7fd62a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f806cc60 con 0x7ff7f80c9d30 2023-10-14T19:08:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7fd62a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f815dde0 con 0x7ff7f815d830 2023-10-14T19:08:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7f6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7f80c9d30 0x7ff7f80ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7f6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7f80c9d30 0x7ff7f80ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41586/0 (socket says 172.21.15.7:41586) 2023-10-14T19:08:04.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.071+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/1628396378 learned_addr learned my addr 172.21.15.7:0/1628396378 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:04.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f77fe700 1 --2- 172.21.15.7:0/1628396378 >> v2:172.21.15.148:3300/0 conn(0x7ff7f815d830 0x7ff7f806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/1628396378 >> v2:172.21.15.148:3300/0 conn(0x7ff7f815d830 msgr2=0x7ff7f806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:04.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f6ffd700 1 --2- 172.21.15.7:0/1628396378 >> v2:172.21.15.148:3300/0 conn(0x7ff7f815d830 0x7ff7f806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/1628396378 >> v1:172.21.15.148:6789/0 conn(0x7ff7f815d390 legacy=0x7ff7f80a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:04.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/1628396378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f815e0c0 con 0x7ff7f80c9d30 2023-10-14T19:08:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f6ffd700 1 --2- 172.21.15.7:0/1628396378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f80ca100 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff7f806cbd0 tx=0x7ff7e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560f2bc023c7445f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f5ffb700 1 -- 172.21.15.7:0/1628396378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800b820 con 0x7ff7f80c9d30 2023-10-14T19:08:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f5ffb700 1 -- 172.21.15.7:0/1628396378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e800b980 con 0x7ff7f80c9d30 2023-10-14T19:08:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.072+0000 7ff7f5ffb700 1 -- 172.21.15.7:0/1628396378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800bd20 con 0x7ff7f80c9d30 2023-10-14T19:08:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 -- 172.21.15.7:0/1628396378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 msgr2=0x7ff7f80ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/1628396378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f80ca100 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff7f806cbd0 tx=0x7ff7e8009250 comp rx=0 tx=0).stop 2023-10-14T19:08:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 -- 172.21.15.7:0/1628396378 shutdown_connections 2023-10-14T19:08:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/1628396378 >> v2:172.21.15.148:3300/0 conn(0x7ff7f815d830 0x7ff7f806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/1628396378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f80ca100 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 -- 172.21.15.7:0/1628396378 >> 172.21.15.7:0/1628396378 conn(0x7ff7f80675a0 msgr2=0x7ff7f80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:04.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 -- 172.21.15.7:0/1628396378 shutdown_connections 2023-10-14T19:08:04.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.073+0000 7ff7fd62a700 1 -- 172.21.15.7:0/1628396378 wait complete. 2023-10-14T19:08:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.074+0000 7ff7fd62a700 1 Processor -- start 2023-10-14T19:08:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.074+0000 7ff7fd62a700 1 -- start start 2023-10-14T19:08:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7fd62a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7fd62a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7f815d390 0x7ff7f80cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7fd62a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f815d830 0x7ff7f80c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7fd62a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80ae810 con 0x7ff7f80c9d30 2023-10-14T19:08:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7fd62a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8155e80 con 0x7ff7f815d830 2023-10-14T19:08:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7fd62a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80cbc70 con 0x7ff7f815d390 2023-10-14T19:08:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7f6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7f6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f8155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41596/0 (socket says 172.21.15.7:41596) 2023-10-14T19:08:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.075+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/785552929 learned_addr learned my addr 172.21.15.7:0/785552929 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f67fc700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7f815d390 0x7ff7f80cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f77fe700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f815d830 0x7ff7f80c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7f815d390 msgr2=0x7ff7f80cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f6ffd700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7f815d390 0x7ff7f80cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f815d830 msgr2=0x7ff7f80c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f6ffd700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f815d830 0x7ff7f80c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f6ffd700 1 -- 172.21.15.7:0/785552929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80094f0 con 0x7ff7f80c9d30 2023-10-14T19:08:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7f6ffd700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f8155940 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80030c0 tx=0x7ff7e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8011d00 con 0x7ff7f80c9d30 2023-10-14T19:08:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8020070 con 0x7ff7f80c9d30 2023-10-14T19:08:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e801b6a0 con 0x7ff7f80c9d30 2023-10-14T19:08:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f80cbf10 con 0x7ff7f80c9d30 2023-10-14T19:08:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.076+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f80ae4a0 con 0x7ff7f80c9d30 2023-10-14T19:08:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.078+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f80ae300 con 0x7ff7f80c9d30 2023-10-14T19:08:04.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.078+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff7e8022030 con 0x7ff7f80c9d30 2023-10-14T19:08:04.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.078+0000 7ff7deffd700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e4067170 0x7ff7e4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.078+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff7e80865f0 con 0x7ff7f80c9d30 2023-10-14T19:08:04.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.078+0000 7ff7f67fc700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e4067170 0x7ff7e4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.079+0000 7ff7f67fc700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e4067170 0x7ff7e4069620 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80c42e0 tx=0x7ff7ec007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.082+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7f80ae300 con 0x7ff7f80c9d30 2023-10-14T19:08:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.322+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7f80ae300 con 0x7ff7f80c9d30 2023-10-14T19:08:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.323+0000 7ff7deffd700 1 -- 172.21.15.7:0/785552929 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15402 (secure 0 0 0) 0x7ff7f80ae300 con 0x7ff7f80c9d30 2023-10-14T19:08:04.324 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:05:59.072619+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:55.778802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:56.308884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:04.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e4067170 msgr2=0x7ff7e4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e4067170 0x7ff7e4069620 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80c42e0 tx=0x7ff7ec007ea0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 msgr2=0x7ff7f8155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f8155940 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80030c0 tx=0x7ff7e8016000 comp rx=0 tx=0).stop 2023-10-14T19:08:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 shutdown_connections 2023-10-14T19:08:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff7e4067170 0x7ff7e4069620 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f815d830 0x7ff7f80c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7f80c9d30 0x7ff7f8155940 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 --2- 172.21.15.7:0/785552929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7f815d390 0x7ff7f80cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 >> 172.21.15.7:0/785552929 conn(0x7ff7f80675a0 msgr2=0x7ff7f8156170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 shutdown_connections 2023-10-14T19:08:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.325+0000 7ff7fd62a700 1 -- 172.21.15.7:0/785552929 wait complete. 2023-10-14T19:08:04.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:04:55.778802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:04:56.308884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:08:04.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:08:04.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.462+0000 7fdaf79c8700 1 Processor -- start 2023-10-14T19:08:04.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.463+0000 7fdaf79c8700 1 -- start start 2023-10-14T19:08:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.463+0000 7fdaf79c8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdaf013c9b0 0x7fdaf0069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.463+0000 7fdaf79c8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdaf00cc6f0 0x7fdaf0069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.463+0000 7fdaf79c8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf006d7b0 con 0x7fdaf00cc320 2023-10-14T19:08:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.463+0000 7fdaf79c8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf006f7d0 con 0x7fdaf013c9b0 2023-10-14T19:08:04.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.463+0000 7fdaf79c8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf006e330 con 0x7fdaf00cc6f0 2023-10-14T19:08:04.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdaf013c9b0 0x7fdaf0069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdaf013c9b0 0x7fdaf0069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41602/0 (socket says 172.21.15.7:41602) 2023-10-14T19:08:04.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 -- 172.21.15.7:0/1631510767 learned_addr learned my addr 172.21.15.7:0/1631510767 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:04.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf5f65700 1 --2- 172.21.15.7:0/1631510767 >> v2:172.21.15.148:3300/0 conn(0x7fdaf00cc6f0 0x7fdaf0069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 -- 172.21.15.7:0/1631510767 >> v2:172.21.15.148:3300/0 conn(0x7fdaf00cc6f0 msgr2=0x7fdaf0069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 --2- 172.21.15.7:0/1631510767 >> v2:172.21.15.148:3300/0 conn(0x7fdaf00cc6f0 0x7fdaf0069f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 -- 172.21.15.7:0/1631510767 >> v1:172.21.15.148:6789/0 conn(0x7fdaf00cc320 legacy=0x7fdaf013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 -- 172.21.15.7:0/1631510767 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf006da00 con 0x7fdaf013c9b0 2023-10-14T19:08:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdaf4f63700 1 --2- 172.21.15.7:0/1631510767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf0069a00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0154440 tx=0x7fdae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3095af30a416814 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdae7fff700 1 -- 172.21.15.7:0/1631510767 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0009e70 con 0x7fdaf013c9b0 2023-10-14T19:08:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdae7fff700 1 -- 172.21.15.7:0/1631510767 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000b860 con 0x7fdaf013c9b0 2023-10-14T19:08:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.464+0000 7fdae7fff700 1 -- 172.21.15.7:0/1631510767 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000bc00 con 0x7fdaf013c9b0 2023-10-14T19:08:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 -- 172.21.15.7:0/1631510767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 msgr2=0x7fdaf0069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/1631510767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf0069a00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0154440 tx=0x7fdae0009250 comp rx=0 tx=0).stop 2023-10-14T19:08:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 -- 172.21.15.7:0/1631510767 shutdown_connections 2023-10-14T19:08:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/1631510767 >> v2:172.21.15.148:3300/0 conn(0x7fdaf00cc6f0 0x7fdaf0069f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/1631510767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf0069a00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 -- 172.21.15.7:0/1631510767 >> 172.21.15.7:0/1631510767 conn(0x7fdaf0067f00 msgr2=0x7fdaf0068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 -- 172.21.15.7:0/1631510767 shutdown_connections 2023-10-14T19:08:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.465+0000 7fdaf79c8700 1 -- 172.21.15.7:0/1631510767 wait complete. 2023-10-14T19:08:04.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.466+0000 7fdaf79c8700 1 Processor -- start 2023-10-14T19:08:04.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.466+0000 7fdaf79c8700 1 -- start start 2023-10-14T19:08:04.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf79c8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdaf00cc320 0x7fdaf00c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf79c8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf00cc6f0 0x7fdaf013acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf79c8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf79c8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00c77f0 con 0x7fdaf013c9b0 2023-10-14T19:08:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf79c8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf016d8d0 con 0x7fdaf00cc6f0 2023-10-14T19:08:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf79c8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf016dbb0 con 0x7fdaf00cc320 2023-10-14T19:08:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf5f65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf5f65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf00cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41606/0 (socket says 172.21.15.7:41606) 2023-10-14T19:08:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf5f65700 1 -- 172.21.15.7:0/970753327 learned_addr learned my addr 172.21.15.7:0/970753327 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf4f63700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf00cc6f0 0x7fdaf013acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.467+0000 7fdaf5764700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdaf00cc320 0x7fdaf00c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf5f65700 1 -- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdaf00cc320 msgr2=0x7fdaf00c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf5f65700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdaf00cc320 0x7fdaf00c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf5f65700 1 -- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf00cc6f0 msgr2=0x7fdaf013acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf5f65700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf00cc6f0 0x7fdaf013acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf5f65700 1 -- 172.21.15.7:0/970753327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00094f0 con 0x7fdaf013c9b0 2023-10-14T19:08:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf5f65700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf00cab40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009e90 tx=0x7fdae800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800cb70 con 0x7fdaf013c9b0 2023-10-14T19:08:04.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae800f040 con 0x7fdaf013c9b0 2023-10-14T19:08:04.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8014480 con 0x7fdaf013c9b0 2023-10-14T19:08:04.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf016de90 con 0x7fdaf013c9b0 2023-10-14T19:08:04.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.468+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf00c8540 con 0x7fdaf013c9b0 2023-10-14T19:08:04.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.469+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf016e390 con 0x7fdaf013c9b0 2023-10-14T19:08:04.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.469+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fdae8014830 con 0x7fdaf013c9b0 2023-10-14T19:08:04.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.470+0000 7fdae57fa700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdad4067170 0x7fdad4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.470+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdae8085380 con 0x7fdaf013c9b0 2023-10-14T19:08:04.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.470+0000 7fdaf5764700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdad4067170 0x7fdad4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.471+0000 7fdaf5764700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdad4067170 0x7fdad4069620 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0039f0 tx=0x7fdaec007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.474+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdae8052210 con 0x7fdaf013c9b0 2023-10-14T19:08:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.736+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdaf004c3c0 con 0x7fdaf013c9b0 2023-10-14T19:08:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.737+0000 7fdae57fa700 1 -- 172.21.15.7:0/970753327 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdae8059e60 con 0x7fdaf013c9b0 2023-10-14T19:08:04.738 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:08:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdad4067170 msgr2=0x7fdad4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdad4067170 0x7fdad4069620 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0039f0 tx=0x7fdaec007ec0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 msgr2=0x7fdaf00cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf00cab40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009e90 tx=0x7fdae800b040 comp rx=0 tx=0).stop 2023-10-14T19:08:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 shutdown_connections 2023-10-14T19:08:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdad4067170 0x7fdad4069620 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf013c9b0 0x7fdaf00cab40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdaf00cc320 0x7fdaf00c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 --2- 172.21.15.7:0/970753327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf00cc6f0 0x7fdaf013acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 >> 172.21.15.7:0/970753327 conn(0x7fdaf0067f00 msgr2=0x7fdaf0069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 shutdown_connections 2023-10-14T19:08:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.739+0000 7fdaf79c8700 1 -- 172.21.15.7:0/970753327 wait complete. 2023-10-14T19:08:04.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:08:04.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.891+0000 7f0f810e0700 1 Processor -- start 2023-10-14T19:08:04.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.891+0000 7f0f810e0700 1 -- start start 2023-10-14T19:08:04.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f810e0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 0x7f0f7c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f810e0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 0x7f0f7c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f810e0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c15b1c0 con 0x7f0f7c157ca0 2023-10-14T19:08:04.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f810e0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c15ba60 con 0x7f0f7c1518a0 2023-10-14T19:08:04.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f810e0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0b2e40 con 0x7f0f7c0b24b0 2023-10-14T19:08:04.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 0x7f0f7c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 0x7f0f7c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 0x7f0f7c151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56608/0 (socket says 172.21.15.7:56608) 2023-10-14T19:08:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 0x7f0f7c0b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:33202/0 (socket says 172.21.15.7:33202) 2023-10-14T19:08:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7ad9d700 1 -- 172.21.15.7:0/1374853067 learned_addr learned my addr 172.21.15.7:0/1374853067 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7a59c700 1 -- 172.21.15.7:0/1374853067 >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 msgr2=0x7f0f7c151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7a59c700 1 --2- 172.21.15.7:0/1374853067 >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 0x7f0f7c151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7a59c700 1 -- 172.21.15.7:0/1374853067 >> v1:172.21.15.148:6789/0 conn(0x7f0f7c157ca0 legacy=0x7f0f7c158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7a59c700 1 -- 172.21.15.7:0/1374853067 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c1589d0 con 0x7f0f7c0b24b0 2023-10-14T19:08:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.892+0000 7f0f7ad9d700 1 --2- 172.21.15.7:0/1374853067 >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 0x7f0f7c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:04.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f7a59c700 1 --2- 172.21.15.7:0/1374853067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 0x7f0f7c0b2900 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000dd10 tx=0x7f0f7000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a06c7dd1e3c8b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f79d9b700 1 -- 172.21.15.7:0/1374853067 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70012070 con 0x7f0f7c0b24b0 2023-10-14T19:08:04.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f79d9b700 1 -- 172.21.15.7:0/1374853067 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000de70 con 0x7f0f7c0b24b0 2023-10-14T19:08:04.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f79d9b700 1 -- 172.21.15.7:0/1374853067 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000fb60 con 0x7f0f7c0b24b0 2023-10-14T19:08:04.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 -- 172.21.15.7:0/1374853067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 msgr2=0x7f0f7c0b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1374853067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 0x7f0f7c0b2900 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000dd10 tx=0x7f0f7000d630 comp rx=0 tx=0).stop 2023-10-14T19:08:04.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 -- 172.21.15.7:0/1374853067 shutdown_connections 2023-10-14T19:08:04.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1374853067 >> v2:172.21.15.148:3300/0 conn(0x7f0f7c1518a0 0x7f0f7c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1374853067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c0b24b0 0x7f0f7c0b2900 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 -- 172.21.15.7:0/1374853067 >> 172.21.15.7:0/1374853067 conn(0x7f0f7c06d7b0 msgr2=0x7f0f7c06dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:04.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 -- 172.21.15.7:0/1374853067 shutdown_connections 2023-10-14T19:08:04.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.893+0000 7f0f810e0700 1 -- 172.21.15.7:0/1374853067 wait complete. 2023-10-14T19:08:04.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.895+0000 7f0f810e0700 1 Processor -- start 2023-10-14T19:08:04.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.895+0000 7f0f810e0700 1 -- start start 2023-10-14T19:08:04.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.895+0000 7f0f810e0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7c0b24b0 0x7f0f7c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.895+0000 7f0f810e0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c1518a0 0x7f0f7c169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.895+0000 7f0f810e0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c157ca0 0x7f0f7c067d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f810e0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c16a0c0 con 0x7f0f7c0b24b0 2023-10-14T19:08:04.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f810e0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c169820 con 0x7f0f7c1518a0 2023-10-14T19:08:04.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f810e0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c169b00 con 0x7f0f7c157ca0 2023-10-14T19:08:04.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7c0b24b0 0x7f0f7c14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c1518a0 0x7f0f7c169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7c0b24b0 0x7f0f7c14afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41610/0 (socket says 172.21.15.7:41610) 2023-10-14T19:08:04.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7ad9d700 1 -- 172.21.15.7:0/1920916978 learned_addr learned my addr 172.21.15.7:0/1920916978 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:04.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7b59e700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c157ca0 0x7f0f7c067d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 -- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c157ca0 msgr2=0x7f0f7c067d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c157ca0 0x7f0f7c067d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 -- 172.21.15.7:0/1920916978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7c0b24b0 msgr2=0x7f0f7c14afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:04.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7c0b24b0 0x7f0f7c14afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:04.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 -- 172.21.15.7:0/1920916978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0094f0 con 0x7f0f7c1518a0 2023-10-14T19:08:04.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f7a59c700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c1518a0 0x7f0f7c169120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f70019000 tx=0x7f0f7001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000c8c0 con 0x7f0f7c1518a0 2023-10-14T19:08:04.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000ca40 con 0x7f0f7c1518a0 2023-10-14T19:08:04.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7000d8d0 con 0x7f0f7c1518a0 2023-10-14T19:08:04.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.896+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000ce00 con 0x7f0f7c1518a0 2023-10-14T19:08:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.897+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c14be30 con 0x7f0f7c1518a0 2023-10-14T19:08:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.898+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c14bc90 con 0x7f0f7c1518a0 2023-10-14T19:08:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.898+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0f70020650 con 0x7f0f7c1518a0 2023-10-14T19:08:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.898+0000 7f0f62ffd700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f68067170 0x7f0f68069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:04.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.899+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0f70089df0 con 0x7f0f7c1518a0 2023-10-14T19:08:04.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.899+0000 7f0f7ad9d700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f68067170 0x7f0f68069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:04.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.899+0000 7f0f7ad9d700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f68067170 0x7f0f68069620 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006e80 tx=0x7f0f6c009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:04.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:04.903+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f7c14bc90 con 0x7f0f7c1518a0 2023-10-14T19:08:05.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.103+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f7c14bc90 con 0x7f0f7c1518a0 2023-10-14T19:08:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.103+0000 7f0f62ffd700 1 -- 172.21.15.7:0/1920916978 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f7c14bc90 con 0x7f0f7c1518a0 2023-10-14T19:08:05.105 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:08:05.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f68067170 msgr2=0x7f0f68069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f68067170 0x7f0f68069620 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006e80 tx=0x7f0f6c009250 comp rx=0 tx=0).stop 2023-10-14T19:08:05.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c1518a0 msgr2=0x7f0f7c169120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c1518a0 0x7f0f7c169120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f70019000 tx=0x7f0f7001c000 comp rx=0 tx=0).stop 2023-10-14T19:08:05.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 shutdown_connections 2023-10-14T19:08:05.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f68067170 0x7f0f68069620 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f7c157ca0 0x7f0f7c067d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7c0b24b0 0x7f0f7c14afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 --2- 172.21.15.7:0/1920916978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c1518a0 0x7f0f7c169120 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 >> 172.21.15.7:0/1920916978 conn(0x7f0f7c06d7b0 msgr2=0x7f0f7c1501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 shutdown_connections 2023-10-14T19:08:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.106+0000 7f0f810e0700 1 -- 172.21.15.7:0/1920916978 wait complete. 2023-10-14T19:08:05.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:08:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.242+0000 7f894aec0700 1 Processor -- start 2023-10-14T19:08:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.242+0000 7f894aec0700 1 -- start start 2023-10-14T19:08:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894aec0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894406d250 0x7f89440aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894aec0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89440ceac0 0x7f89440af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894aec0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440ac840 con 0x7f8944157420 2023-10-14T19:08:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894aec0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440abf50 con 0x7f89440ceac0 2023-10-14T19:08:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894aec0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440aea60 con 0x7f894406d250 2023-10-14T19:08:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894a6bf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89440ceac0 0x7f89440af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894a6bf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89440ceac0 0x7f89440af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41612/0 (socket says 172.21.15.7:41612) 2023-10-14T19:08:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f894a6bf700 1 -- 172.21.15.7:0/2231673717 learned_addr learned my addr 172.21.15.7:0/2231673717 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.243+0000 7f89496bd700 1 --2- 172.21.15.7:0/2231673717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894406d250 0x7f89440aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f894a6bf700 1 -- 172.21.15.7:0/2231673717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894406d250 msgr2=0x7f89440aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f894a6bf700 1 --2- 172.21.15.7:0/2231673717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894406d250 0x7f89440aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f894a6bf700 1 -- 172.21.15.7:0/2231673717 >> v1:172.21.15.148:6789/0 conn(0x7f8944157420 legacy=0x7f89440b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f894a6bf700 1 -- 172.21.15.7:0/2231673717 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440ac1f0 con 0x7f89440ceac0 2023-10-14T19:08:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f894a6bf700 1 --2- 172.21.15.7:0/2231673717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89440ceac0 0x7f89440af4e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f893c009f20 tx=0x7f893c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b40983c8ea0377 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f8948ebc700 1 -- 172.21.15.7:0/2231673717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00e070 con 0x7f89440ceac0 2023-10-14T19:08:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f8948ebc700 1 -- 172.21.15.7:0/2231673717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c00b9d0 con 0x7f89440ceac0 2023-10-14T19:08:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.244+0000 7f8948ebc700 1 -- 172.21.15.7:0/2231673717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0092e0 con 0x7f89440ceac0 2023-10-14T19:08:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 -- 172.21.15.7:0/2231673717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89440ceac0 msgr2=0x7f89440af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 --2- 172.21.15.7:0/2231673717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89440ceac0 0x7f89440af4e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f893c009f20 tx=0x7f893c009840 comp rx=0 tx=0).stop 2023-10-14T19:08:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 -- 172.21.15.7:0/2231673717 shutdown_connections 2023-10-14T19:08:05.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 --2- 172.21.15.7:0/2231673717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89440ceac0 0x7f89440af4e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 --2- 172.21.15.7:0/2231673717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894406d250 0x7f89440aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 -- 172.21.15.7:0/2231673717 >> 172.21.15.7:0/2231673717 conn(0x7f894406ce80 msgr2=0x7f89440ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:05.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 -- 172.21.15.7:0/2231673717 shutdown_connections 2023-10-14T19:08:05.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.245+0000 7f894aec0700 1 -- 172.21.15.7:0/2231673717 wait complete. 2023-10-14T19:08:05.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.246+0000 7f894aec0700 1 Processor -- start 2023-10-14T19:08:05.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.246+0000 7f894aec0700 1 -- start start 2023-10-14T19:08:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894aec0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 0x7f8944156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894aec0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89440ceac0 0x7f89441593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894aec0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944157420 0x7f894415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894aec0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944158890 con 0x7f894406d250 2023-10-14T19:08:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894aec0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89441577f0 con 0x7f8944157420 2023-10-14T19:08:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894aec0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8944157ad0 con 0x7f89440ceac0 2023-10-14T19:08:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f8949ebe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 0x7f8944156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f8949ebe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 0x7f8944156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41624/0 (socket says 172.21.15.7:41624) 2023-10-14T19:08:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f8949ebe700 1 -- 172.21.15.7:0/1361273939 learned_addr learned my addr 172.21.15.7:0/1361273939 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:05.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f894a6bf700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944157420 0x7f894415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.247+0000 7f89496bd700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89440ceac0 0x7f89441593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8949ebe700 1 -- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89440ceac0 msgr2=0x7f89441593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8949ebe700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89440ceac0 0x7f89441593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8949ebe700 1 -- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944157420 msgr2=0x7f894415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8949ebe700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944157420 0x7f894415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8949ebe700 1 -- 172.21.15.7:0/1361273939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009ae0 con 0x7f894406d250 2023-10-14T19:08:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8949ebe700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 0x7f8944156280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f893800c590 tx=0x7f893800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938011590 con 0x7f894406d250 2023-10-14T19:08:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938011710 con 0x7f894406d250 2023-10-14T19:08:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8944157db0 con 0x7f894406d250 2023-10-14T19:08:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938011ad0 con 0x7f894406d250 2023-10-14T19:08:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.248+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8944158370 con 0x7f894406d250 2023-10-14T19:08:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.249+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8944158590 con 0x7f894406d250 2023-10-14T19:08:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.250+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f893801b3b0 con 0x7f894406d250 2023-10-14T19:08:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.250+0000 7f8935ffb700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8928067170 0x7f8928069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.250+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8938083cd0 con 0x7f894406d250 2023-10-14T19:08:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.250+0000 7f89496bd700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8928067170 0x7f8928069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.251+0000 7f89496bd700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8928067170 0x7f8928069620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f894415e1c0 tx=0x7f89400091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.254+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8938050c70 con 0x7f894406d250 2023-10-14T19:08:05.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.452+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f894404c3c0 con 0x7f894406d250 2023-10-14T19:08:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.453+0000 7f8935ffb700 1 -- 172.21.15.7:0/1361273939 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8938017070 con 0x7f894406d250 2023-10-14T19:08:05.454 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:08:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8928067170 msgr2=0x7f8928069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8928067170 0x7f8928069620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f894415e1c0 tx=0x7f89400091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 msgr2=0x7f8944156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 0x7f8944156280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f893800c590 tx=0x7f893800c8a0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 shutdown_connections 2023-10-14T19:08:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8928067170 0x7f8928069620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944157420 0x7f894415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f894406d250 0x7f8944156280 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 --2- 172.21.15.7:0/1361273939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89440ceac0 0x7f89441593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 >> 172.21.15.7:0/1361273939 conn(0x7f894406ce80 msgr2=0x7f89440b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 shutdown_connections 2023-10-14T19:08:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.456+0000 7f894aec0700 1 -- 172.21.15.7:0/1361273939 wait complete. 2023-10-14T19:08:05.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.620+0000 7fa4b978d700 1 Processor -- start 2023-10-14T19:08:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.620+0000 7fa4b978d700 1 -- start start 2023-10-14T19:08:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b978d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4b40aee90 0x7fa4b40a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b978d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b40ce1a0 con 0x7fa4b40a8be0 2023-10-14T19:08:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b978d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b40cd5d0 con 0x7fa4b406d280 2023-10-14T19:08:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b978d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b40cd870 con 0x7fa4b40aee90 2023-10-14T19:08:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa4b40a8be0 0x7fa4b40ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50804/0 (socket says 172.21.15.7:50804) 2023-10-14T19:08:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b2ffd700 1 -- 172.21.15.7:0/3281995628 learned_addr learned my addr 172.21.15.7:0/3281995628 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.621+0000 7fa4b27fc700 1 --2- 172.21.15.7:0/3281995628 >> v2:172.21.15.148:3300/0 conn(0x7fa4b40aee90 0x7fa4b40a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b1ffb700 1 -- 172.21.15.7:0/3281995628 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827692057 0 0) 0x7fa4b40ce1a0 con 0x7fa4b40a8be0 2023-10-14T19:08:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b1ffb700 1 -- 172.21.15.7:0/3281995628 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a0003570 con 0x7fa4b40a8be0 2023-10-14T19:08:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b27fc700 1 -- 172.21.15.7:0/3281995628 >> v1:172.21.15.148:6789/0 conn(0x7fa4b406d280 legacy=0x7fa4b40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b27fc700 1 -- 172.21.15.7:0/3281995628 >> v1:172.21.15.7:6789/0 conn(0x7fa4b40a8be0 legacy=0x7fa4b40ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b27fc700 1 -- 172.21.15.7:0/3281995628 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40cdb50 con 0x7fa4b40aee90 2023-10-14T19:08:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b27fc700 1 --2- 172.21.15.7:0/3281995628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40aee90 0x7fa4b40a8fb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0098d0 tx=0x7fa49c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf835e0195170437 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b1ffb700 1 -- 172.21.15.7:0/3281995628 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c005c10 con 0x7fa4b40aee90 2023-10-14T19:08:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b1ffb700 1 -- 172.21.15.7:0/3281995628 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c005d70 con 0x7fa4b40aee90 2023-10-14T19:08:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.622+0000 7fa4b1ffb700 1 -- 172.21.15.7:0/3281995628 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c006280 con 0x7fa4b40aee90 2023-10-14T19:08:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 -- 172.21.15.7:0/3281995628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40aee90 msgr2=0x7fa4b40a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 --2- 172.21.15.7:0/3281995628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40aee90 0x7fa4b40a8fb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0098d0 tx=0x7fa49c009120 comp rx=0 tx=0).stop 2023-10-14T19:08:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 -- 172.21.15.7:0/3281995628 shutdown_connections 2023-10-14T19:08:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 --2- 172.21.15.7:0/3281995628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40aee90 0x7fa4b40a8fb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 -- 172.21.15.7:0/3281995628 >> 172.21.15.7:0/3281995628 conn(0x7fa4b406ce80 msgr2=0x7fa4b40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 -- 172.21.15.7:0/3281995628 shutdown_connections 2023-10-14T19:08:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.623+0000 7fa4b978d700 1 -- 172.21.15.7:0/3281995628 wait complete. 2023-10-14T19:08:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.625+0000 7fa4b978d700 1 Processor -- start 2023-10-14T19:08:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.625+0000 7fa4b978d700 1 -- start start 2023-10-14T19:08:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b978d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 0x7fa4b4158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b978d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40a8be0 0x7fa4b4098ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b978d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b40aee90 0x7fa4b4167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b978d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b4099ab0 con 0x7fa4b406d280 2023-10-14T19:08:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b978d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40abff0 con 0x7fa4b40a8be0 2023-10-14T19:08:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b978d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40997d0 con 0x7fa4b40aee90 2023-10-14T19:08:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 0x7fa4b4158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b2ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 0x7fa4b4158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41638/0 (socket says 172.21.15.7:41638) 2023-10-14T19:08:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b2ffd700 1 -- 172.21.15.7:0/4016581589 learned_addr learned my addr 172.21.15.7:0/4016581589 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b27fc700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40a8be0 0x7fa4b4098ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.626+0000 7fa4b37fe700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b40aee90 0x7fa4b4167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b2ffd700 1 -- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b40aee90 msgr2=0x7fa4b4167870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b2ffd700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b40aee90 0x7fa4b4167870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b2ffd700 1 -- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40a8be0 msgr2=0x7fa4b4098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b2ffd700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40a8be0 0x7fa4b4098ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b2ffd700 1 -- 172.21.15.7:0/4016581589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0093c0 con 0x7fa4b406d280 2023-10-14T19:08:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b2ffd700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 0x7fa4b4158d90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400cb40 tx=0x7fa4a40027e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400ce50 con 0x7fa4b406d280 2023-10-14T19:08:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4005d80 con 0x7fa4b406d280 2023-10-14T19:08:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b40ab9a0 con 0x7fa4b406d280 2023-10-14T19:08:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400a7a0 con 0x7fa4b406d280 2023-10-14T19:08:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.627+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b41592d0 con 0x7fa4b406d280 2023-10-14T19:08:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.628+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa4a400abd0 con 0x7fa4b406d280 2023-10-14T19:08:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.629+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b4067830 con 0x7fa4b406d280 2023-10-14T19:08:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.629+0000 7fa4aaffd700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa494067170 0x7fa494069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.629+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa4a40845d0 con 0x7fa4b406d280 2023-10-14T19:08:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.629+0000 7fa4b27fc700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa494067170 0x7fa494069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.630+0000 7fa4b27fc700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa494067170 0x7fa494069620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40af290 tx=0x7fa49c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.633+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4a40515f0 con 0x7fa4b406d280 2023-10-14T19:08:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.916+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4b404c3c0 con 0x7fa4b406d280 2023-10-14T19:08:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.917+0000 7fa4aaffd700 1 -- 172.21.15.7:0/4016581589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa4a4054c10 con 0x7fa4b406d280 2023-10-14T19:08:05.918 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:05.918 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:57.340873+0000","modified":"2023-10-14T19:05:00.971319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3259245177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3259245177},{"type":"v1","addr":"172.21.15.7:6835","nonce":3259245177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T19:08:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa494067170 msgr2=0x7fa494069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa494067170 0x7fa494069620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40af290 tx=0x7fa49c016000 comp rx=0 tx=0).stop 2023-10-14T19:08:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 msgr2=0x7fa4b4158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 0x7fa4b4158d90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400cb40 tx=0x7fa4a40027e0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 shutdown_connections 2023-10-14T19:08:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa494067170 0x7fa494069620 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b40aee90 0x7fa4b4167870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4b406d280 0x7fa4b4158d90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 --2- 172.21.15.7:0/4016581589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40a8be0 0x7fa4b4098ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 >> 172.21.15.7:0/4016581589 conn(0x7fa4b406ce80 msgr2=0x7fa4b40b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 shutdown_connections 2023-10-14T19:08:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:05.919+0000 7fa4b978d700 1 -- 172.21.15.7:0/4016581589 wait complete. 2023-10-14T19:08:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2023-10-14T19:08:05.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:06.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.065+0000 7f2f3a16f700 1 Processor -- start 2023-10-14T19:08:06.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.065+0000 7f2f3a16f700 1 -- start start 2023-10-14T19:08:06.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f3a16f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2f340aee90 0x7f2f340a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f3a16f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340ce1a0 con 0x7f2f3406d280 2023-10-14T19:08:06.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f3a16f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340cd5d0 con 0x7f2f340a8be0 2023-10-14T19:08:06.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f3a16f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340cd870 con 0x7f2f340aee90 2023-10-14T19:08:06.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f33fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2f3406d280 0x7f2f340b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50816/0 (socket says 172.21.15.7:50816) 2023-10-14T19:08:06.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f33fff700 1 -- 172.21.15.7:0/4024532851 learned_addr learned my addr 172.21.15.7:0/4024532851 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:06.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.066+0000 7f2f32ffd700 1 --2- 172.21.15.7:0/4024532851 >> v2:172.21.15.148:3300/0 conn(0x7f2f340aee90 0x7f2f340a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f327fc700 1 -- 172.21.15.7:0/4024532851 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154019266 0 0) 0x7f2f340ce1a0 con 0x7f2f3406d280 2023-10-14T19:08:06.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f327fc700 1 -- 172.21.15.7:0/4024532851 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f1c003570 con 0x7f2f3406d280 2023-10-14T19:08:06.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f32ffd700 1 -- 172.21.15.7:0/4024532851 >> v1:172.21.15.148:6789/0 conn(0x7f2f340a8be0 legacy=0x7f2f340ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f32ffd700 1 -- 172.21.15.7:0/4024532851 >> v1:172.21.15.7:6789/0 conn(0x7f2f3406d280 legacy=0x7f2f340b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f32ffd700 1 -- 172.21.15.7:0/4024532851 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340cdb50 con 0x7f2f340aee90 2023-10-14T19:08:06.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f32ffd700 1 --2- 172.21.15.7:0/4024532851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340aee90 0x7f2f340a8fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098d0 tx=0x7f2f28009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dec147544b6250e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f327fc700 1 -- 172.21.15.7:0/4024532851 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28005c10 con 0x7f2f340aee90 2023-10-14T19:08:06.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f327fc700 1 -- 172.21.15.7:0/4024532851 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28005d70 con 0x7f2f340aee90 2023-10-14T19:08:06.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.067+0000 7f2f327fc700 1 -- 172.21.15.7:0/4024532851 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28006240 con 0x7f2f340aee90 2023-10-14T19:08:06.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 -- 172.21.15.7:0/4024532851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340aee90 msgr2=0x7f2f340a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/4024532851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340aee90 0x7f2f340a8fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098d0 tx=0x7f2f28009120 comp rx=0 tx=0).stop 2023-10-14T19:08:06.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 -- 172.21.15.7:0/4024532851 shutdown_connections 2023-10-14T19:08:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/4024532851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340aee90 0x7f2f340a8fb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 -- 172.21.15.7:0/4024532851 >> 172.21.15.7:0/4024532851 conn(0x7f2f3406ce80 msgr2=0x7f2f340ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 -- 172.21.15.7:0/4024532851 shutdown_connections 2023-10-14T19:08:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.068+0000 7f2f3a16f700 1 -- 172.21.15.7:0/4024532851 wait complete. 2023-10-14T19:08:06.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.069+0000 7f2f3a16f700 1 Processor -- start 2023-10-14T19:08:06.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.069+0000 7f2f3a16f700 1 -- start start 2023-10-14T19:08:06.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f3a16f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 0x7f2f340ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f3a16f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340a8be0 0x7f2f3414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f3a16f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f340aee90 0x7f2f3414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f3a16f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3414f000 con 0x7f2f3406d280 2023-10-14T19:08:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f3a16f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3414f2e0 con 0x7f2f340a8be0 2023-10-14T19:08:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f3a16f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3414f5c0 con 0x7f2f340aee90 2023-10-14T19:08:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 0x7f2f340ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 0x7f2f340ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41650/0 (socket says 172.21.15.7:41650) 2023-10-14T19:08:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 -- 172.21.15.7:0/3263118744 learned_addr learned my addr 172.21.15.7:0/3263118744 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f32ffd700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340a8be0 0x7f2f3414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f33fff700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f340aee90 0x7f2f3414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 -- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f340aee90 msgr2=0x7f2f3414d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f340aee90 0x7f2f3414d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 -- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340a8be0 msgr2=0x7f2f3414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340a8be0 0x7f2f3414e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f337fe700 1 -- 172.21.15.7:0/3263118744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280093c0 con 0x7f2f3406d280 2023-10-14T19:08:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.070+0000 7f2f33fff700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f340aee90 0x7f2f3414d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.071+0000 7f2f337fe700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 0x7f2f340ac2d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400c790 tx=0x7f2f24007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.071+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24011590 con 0x7f2f3406d280 2023-10-14T19:08:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.071+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240116f0 con 0x7f2f3406d280 2023-10-14T19:08:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.071+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24011ab0 con 0x7f2f3406d280 2023-10-14T19:08:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.071+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3414f8a0 con 0x7f2f3406d280 2023-10-14T19:08:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.071+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f34159380 con 0x7f2f3406d280 2023-10-14T19:08:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.072+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3414fdc0 con 0x7f2f3406d280 2023-10-14T19:08:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.072+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2f2401b3b0 con 0x7f2f3406d280 2023-10-14T19:08:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.073+0000 7f2f1b7fe700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f20067170 0x7f2f20069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.073+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2f24083e10 con 0x7f2f3406d280 2023-10-14T19:08:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.073+0000 7f2f32ffd700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f20067170 0x7f2f20069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.074+0000 7f2f32ffd700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f20067170 0x7f2f20069620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f340af290 tx=0x7f2f28016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.081+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f3414fdc0 con 0x7f2f3406d280 2023-10-14T19:08:06.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.293+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f3414fdc0 con 0x7f2f3406d280 2023-10-14T19:08:06.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.294+0000 7f2f1b7fe700 1 -- 172.21.15.7:0/3263118744 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15402 (secure 0 0 0) 0x7f2f3414fdc0 con 0x7f2f3406d280 2023-10-14T19:08:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:06.296 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:05:59.072619+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:55.778802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:56.308884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f20067170 msgr2=0x7f2f20069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f20067170 0x7f2f20069620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f340af290 tx=0x7f2f28016000 comp rx=0 tx=0).stop 2023-10-14T19:08:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 msgr2=0x7f2f340ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 0x7f2f340ac2d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400c790 tx=0x7f2f24007f20 comp rx=0 tx=0).stop 2023-10-14T19:08:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 shutdown_connections 2023-10-14T19:08:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f20067170 0x7f2f20069620 secure :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f340af290 tx=0x7f2f28016000 comp rx=0 tx=0).stop 2023-10-14T19:08:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f340aee90 0x7f2f3414d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406d280 0x7f2f340ac2d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 --2- 172.21.15.7:0/3263118744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f340a8be0 0x7f2f3414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 >> 172.21.15.7:0/3263118744 conn(0x7f2f3406ce80 msgr2=0x7f2f34159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 shutdown_connections 2023-10-14T19:08:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.296+0000 7f2f3a16f700 1 -- 172.21.15.7:0/3263118744 wait complete. 2023-10-14T19:08:06.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:08:06.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:06.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.431+0000 7fdf7873f700 1 Processor -- start 2023-10-14T19:08:06.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.431+0000 7fdf7873f700 1 -- start start 2023-10-14T19:08:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf7873f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf700cb970 0x7fdf70159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf7873f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf7015a400 0x7fdf70156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf7873f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7015ae40 con 0x7fdf700cb5a0 2023-10-14T19:08:06.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf7873f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700ce0f0 con 0x7fdf700cb970 2023-10-14T19:08:06.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf7873f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700d13f0 con 0x7fdf7015a400 2023-10-14T19:08:06.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf75cda700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf700cb970 0x7fdf70159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf764db700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdf700cb5a0 0x7fdf700cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50832/0 (socket says 172.21.15.7:50832) 2023-10-14T19:08:06.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.432+0000 7fdf764db700 1 -- 172.21.15.7:0/275475895 learned_addr learned my addr 172.21.15.7:0/275475895 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:06.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf76cdc700 1 --2- 172.21.15.7:0/275475895 >> v2:172.21.15.148:3300/0 conn(0x7fdf7015a400 0x7fdf70156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf75cda700 1 -- 172.21.15.7:0/275475895 >> v2:172.21.15.148:3300/0 conn(0x7fdf7015a400 msgr2=0x7fdf70156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:06.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf75cda700 1 --2- 172.21.15.7:0/275475895 >> v2:172.21.15.148:3300/0 conn(0x7fdf7015a400 0x7fdf70156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf75cda700 1 -- 172.21.15.7:0/275475895 >> v1:172.21.15.7:6789/0 conn(0x7fdf700cb5a0 legacy=0x7fdf700cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf754d9700 1 -- 172.21.15.7:0/275475895 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823331453 0 0) 0x7fdf7015ae40 con 0x7fdf700cb5a0 2023-10-14T19:08:06.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf75cda700 1 -- 172.21.15.7:0/275475895 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7015ab60 con 0x7fdf700cb970 2023-10-14T19:08:06.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf76cdc700 1 --2- 172.21.15.7:0/275475895 >> v2:172.21.15.148:3300/0 conn(0x7fdf7015a400 0x7fdf70156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:06.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf75cda700 1 --2- 172.21.15.7:0/275475895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb970 0x7fdf70159ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdf700ccdf0 tx=0x7fdf600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9103621f26329a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf754d9700 1 -- 172.21.15.7:0/275475895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000b6b0 con 0x7fdf700cb970 2023-10-14T19:08:06.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf754d9700 1 -- 172.21.15.7:0/275475895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6000b810 con 0x7fdf700cb970 2023-10-14T19:08:06.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.433+0000 7fdf754d9700 1 -- 172.21.15.7:0/275475895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000bbb0 con 0x7fdf700cb970 2023-10-14T19:08:06.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 -- 172.21.15.7:0/275475895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb970 msgr2=0x7fdf70159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 --2- 172.21.15.7:0/275475895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb970 0x7fdf70159ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdf700ccdf0 tx=0x7fdf600091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 -- 172.21.15.7:0/275475895 shutdown_connections 2023-10-14T19:08:06.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 --2- 172.21.15.7:0/275475895 >> v2:172.21.15.148:3300/0 conn(0x7fdf7015a400 0x7fdf70156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 --2- 172.21.15.7:0/275475895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb970 0x7fdf70159ec0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 -- 172.21.15.7:0/275475895 >> 172.21.15.7:0/275475895 conn(0x7fdf70070e30 msgr2=0x7fdf700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:06.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 -- 172.21.15.7:0/275475895 shutdown_connections 2023-10-14T19:08:06.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.434+0000 7fdf7873f700 1 -- 172.21.15.7:0/275475895 wait complete. 2023-10-14T19:08:06.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.436+0000 7fdf7873f700 1 Processor -- start 2023-10-14T19:08:06.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.436+0000 7fdf7873f700 1 -- start start 2023-10-14T19:08:06.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 0x7fdf700af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700cb970 0x7fdf700c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf7015a400 0x7fdf7016a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70152ab0 con 0x7fdf700cb5a0 2023-10-14T19:08:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70154e80 con 0x7fdf700cb970 2023-10-14T19:08:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70154270 con 0x7fdf7015a400 2023-10-14T19:08:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 0x7fdf700af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 0x7fdf700af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41660/0 (socket says 172.21.15.7:41660) 2023-10-14T19:08:06.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 -- 172.21.15.7:0/4052794493 learned_addr learned my addr 172.21.15.7:0/4052794493 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:06.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf75cda700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700cb970 0x7fdf700c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf76cdc700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf7015a400 0x7fdf7016a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 -- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf7015a400 msgr2=0x7fdf7016a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf7015a400 0x7fdf7016a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 -- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700cb970 msgr2=0x7fdf700c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700cb970 0x7fdf700c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 -- 172.21.15.7:0/4052794493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60009420 con 0x7fdf700cb5a0 2023-10-14T19:08:06.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf76cdc700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf7015a400 0x7fdf7016a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:06.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf764db700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 0x7fdf700af4c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c7e0 tx=0x7fdf6c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c005b30 con 0x7fdf700cb5a0 2023-10-14T19:08:06.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c005c90 con 0x7fdf700cb5a0 2023-10-14T19:08:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.437+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70154550 con 0x7fdf700cb5a0 2023-10-14T19:08:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.438+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c007300 con 0x7fdf700cb5a0 2023-10-14T19:08:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.438+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70154b10 con 0x7fdf700cb5a0 2023-10-14T19:08:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.438+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7004c3c0 con 0x7fdf700cb5a0 2023-10-14T19:08:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.439+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fdf6c01b400 con 0x7fdf700cb5a0 2023-10-14T19:08:06.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.439+0000 7fdf667fc700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf54067170 0x7fdf54069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.439+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdf6c084490 con 0x7fdf700cb5a0 2023-10-14T19:08:06.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.440+0000 7fdf75cda700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf54067170 0x7fdf54069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.440+0000 7fdf75cda700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf54067170 0x7fdf54069620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdf600093f0 tx=0x7fdf60017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.444+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf6c0513e0 con 0x7fdf700cb5a0 2023-10-14T19:08:06.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.694+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf700ccf00 con 0x7fdf700cb5a0 2023-10-14T19:08:06.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.695+0000 7fdf667fc700 1 -- 172.21.15.7:0/4052794493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fdf6c054a00 con 0x7fdf700cb5a0 2023-10-14T19:08:06.697 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:06.697 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:57.340873+0000","modified":"2023-10-14T19:05:00.971319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3259245177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3259245177},{"type":"v1","addr":"172.21.15.7:6835","nonce":3259245177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T19:08:06.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf54067170 msgr2=0x7fdf54069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf54067170 0x7fdf54069620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdf600093f0 tx=0x7fdf60017000 comp rx=0 tx=0).stop 2023-10-14T19:08:06.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 msgr2=0x7fdf700af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 0x7fdf700af4c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c7e0 tx=0x7fdf6c007df0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 shutdown_connections 2023-10-14T19:08:06.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf54067170 0x7fdf54069620 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf7015a400 0x7fdf7016a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf700cb5a0 0x7fdf700af4c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 --2- 172.21.15.7:0/4052794493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700cb970 0x7fdf700c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 >> 172.21.15.7:0/4052794493 conn(0x7fdf70070e30 msgr2=0x7fdf700b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:06.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 shutdown_connections 2023-10-14T19:08:06.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.697+0000 7fdf7873f700 1 -- 172.21.15.7:0/4052794493 wait complete. 2023-10-14T19:08:06.704 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2023-10-14T19:08:06.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:06.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.838+0000 7f84acf23700 1 Processor -- start 2023-10-14T19:08:06.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.838+0000 7f84acf23700 1 -- start start 2023-10-14T19:08:06.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84acf23700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84a80cb5a0 0x7f84a80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84acf23700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f84a80cd9e0 0x7f84a8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84acf23700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a815a400 0x7f84a8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84acf23700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80d13f0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84acf23700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a815ae40 con 0x7f84a80cd9e0 2023-10-14T19:08:06.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84acf23700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a815ab60 con 0x7f84a815a400 2023-10-14T19:08:06.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84a80cb5a0 0x7f84a80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84a80cb5a0 0x7f84a80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54998/0 (socket says 172.21.15.7:54998) 2023-10-14T19:08:06.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 -- 172.21.15.7:0/3184482350 learned_addr learned my addr 172.21.15.7:0/3184482350 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:06.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a5d9b700 1 --2- 172.21.15.7:0/3184482350 >> v2:172.21.15.148:3300/0 conn(0x7f84a80cd9e0 0x7f84a8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a6d9d700 1 --2- 172.21.15.7:0/3184482350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a815a400 0x7f84a8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 -- 172.21.15.7:0/3184482350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a815a400 msgr2=0x7f84a8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:06.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 --2- 172.21.15.7:0/3184482350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a815a400 0x7f84a8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 -- 172.21.15.7:0/3184482350 >> v2:172.21.15.148:3300/0 conn(0x7f84a80cd9e0 msgr2=0x7f84a8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:06.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 --2- 172.21.15.7:0/3184482350 >> v2:172.21.15.148:3300/0 conn(0x7f84a80cd9e0 0x7f84a8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 -- 172.21.15.7:0/3184482350 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80ccf00 con 0x7f84a80cb5a0 2023-10-14T19:08:06.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.840+0000 7f84a659c700 1 --2- 172.21.15.7:0/3184482350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a80cb970 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f84980099b0 tx=0x7f8498009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3558d1ffdfd14c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84a559a700 1 -- 172.21.15.7:0/3184482350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800b640 con 0x7f84a80cb5a0 2023-10-14T19:08:06.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84a559a700 1 -- 172.21.15.7:0/3184482350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849800b7a0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84a559a700 1 -- 172.21.15.7:0/3184482350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800bb40 con 0x7f84a80cb5a0 2023-10-14T19:08:06.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 -- 172.21.15.7:0/3184482350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 msgr2=0x7f84a80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 --2- 172.21.15.7:0/3184482350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a80cb970 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f84980099b0 tx=0x7f8498009250 comp rx=0 tx=0).stop 2023-10-14T19:08:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 -- 172.21.15.7:0/3184482350 shutdown_connections 2023-10-14T19:08:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 --2- 172.21.15.7:0/3184482350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a815a400 0x7f84a8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 --2- 172.21.15.7:0/3184482350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a80cb970 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 --2- 172.21.15.7:0/3184482350 >> v2:172.21.15.148:3300/0 conn(0x7f84a80cd9e0 0x7f84a8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 -- 172.21.15.7:0/3184482350 >> 172.21.15.7:0/3184482350 conn(0x7f84a8070e30 msgr2=0x7f84a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:06.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 -- 172.21.15.7:0/3184482350 shutdown_connections 2023-10-14T19:08:06.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.841+0000 7f84acf23700 1 -- 172.21.15.7:0/3184482350 wait complete. 2023-10-14T19:08:06.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 Processor -- start 2023-10-14T19:08:06.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 -- start start 2023-10-14T19:08:06.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a8152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a80cd9e0 0x7f84a80b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a815a400 0x7f84a80af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c94f0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c88e0 con 0x7f84a815a400 2023-10-14T19:08:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84acf23700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c8bc0 con 0x7f84a80cd9e0 2023-10-14T19:08:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84a659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a8152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84a659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a8152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55000/0 (socket says 172.21.15.7:55000) 2023-10-14T19:08:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.843+0000 7f84a659c700 1 -- 172.21.15.7:0/3403623985 learned_addr learned my addr 172.21.15.7:0/3403623985 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a6d9d700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a815a400 0x7f84a80af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a5d9b700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a80cd9e0 0x7f84a80b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a659c700 1 -- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a80cd9e0 msgr2=0x7f84a80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a659c700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a80cd9e0 0x7f84a80b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a659c700 1 -- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a815a400 msgr2=0x7f84a80af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a659c700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a815a400 0x7f84a80af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a659c700 1 -- 172.21.15.7:0/3403623985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980094f0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84a659c700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a8152680 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8498009fd0 tx=0x7f8498017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800bb20 con 0x7f84a80cb5a0 2023-10-14T19:08:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8498000c90 con 0x7f84a80cb5a0 2023-10-14T19:08:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a80c8ea0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498011630 con 0x7f84a80cb5a0 2023-10-14T19:08:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.844+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a8159990 con 0x7f84a80cb5a0 2023-10-14T19:08:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.846+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a804c3c0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.846+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8498011a60 con 0x7f84a80cb5a0 2023-10-14T19:08:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.847+0000 7f84967fc700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8488067170 0x7f8488069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.847+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8498085cc0 con 0x7f84a80cb5a0 2023-10-14T19:08:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.847+0000 7f84a5d9b700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8488067170 0x7f8488069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.847+0000 7f84a5d9b700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8488067170 0x7f8488069620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ccc30 tx=0x7f849c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:06.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:06.851+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8498052c60 con 0x7f84a80cb5a0 2023-10-14T19:08:07.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.100+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84a80cd1e0 con 0x7f84a80cb5a0 2023-10-14T19:08:07.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.100+0000 7f84967fc700 1 -- 172.21.15.7:0/3403623985 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f8498056280 con 0x7f84a80cb5a0 2023-10-14T19:08:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:07.102 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:04:57.340873+0000","modified":"2023-10-14T19:05:00.971319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3259245177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3259245177},{"type":"v1","addr":"172.21.15.7:6835","nonce":3259245177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T19:08:07.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8488067170 msgr2=0x7f8488069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8488067170 0x7f8488069620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ccc30 tx=0x7f849c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 msgr2=0x7f84a8152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a8152680 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8498009fd0 tx=0x7f8498017000 comp rx=0 tx=0).stop 2023-10-14T19:08:07.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 shutdown_connections 2023-10-14T19:08:07.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8488067170 0x7f8488069620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a815a400 0x7f84a80af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84a80cb5a0 0x7f84a8152680 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 --2- 172.21.15.7:0/3403623985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84a80cd9e0 0x7f84a80b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 >> 172.21.15.7:0/3403623985 conn(0x7f84a8070e30 msgr2=0x7f84a80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:07.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 shutdown_connections 2023-10-14T19:08:07.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.103+0000 7f84acf23700 1 -- 172.21.15.7:0/3403623985 wait complete. 2023-10-14T19:08:07.107 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2023-10-14T19:08:07.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.241+0000 7f657d537700 1 Processor -- start 2023-10-14T19:08:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 -- start start 2023-10-14T19:08:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6578153c30 0x7f657815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657815de50 0x7f65780cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65780cef40 0x7f657806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657815afd0 con 0x7f65780cef40 2023-10-14T19:08:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657815b2b0 con 0x7f6578153c30 2023-10-14T19:08:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657d537700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657815b590 con 0x7f657815de50 2023-10-14T19:08:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.242+0000 7f657cd36700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65780cef40 0x7f657806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65780cef40 0x7f657806d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55008/0 (socket says 172.21.15.7:55008) 2023-10-14T19:08:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 -- 172.21.15.7:0/2513137403 learned_addr learned my addr 172.21.15.7:0/2513137403 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f65777fe700 1 --2- 172.21.15.7:0/2513137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657815de50 0x7f65780cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f6577fff700 1 --2- 172.21.15.7:0/2513137403 >> v2:172.21.15.148:3300/0 conn(0x7f6578153c30 0x7f657815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 -- 172.21.15.7:0/2513137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657815de50 msgr2=0x7f65780cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 --2- 172.21.15.7:0/2513137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657815de50 0x7f65780cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 -- 172.21.15.7:0/2513137403 >> v2:172.21.15.148:3300/0 conn(0x7f6578153c30 msgr2=0x7f657815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 --2- 172.21.15.7:0/2513137403 >> v2:172.21.15.148:3300/0 conn(0x7f6578153c30 0x7f657815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 -- 172.21.15.7:0/2513137403 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657815b870 con 0x7f65780cef40 2023-10-14T19:08:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f657cd36700 1 --2- 172.21.15.7:0/2513137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65780cef40 0x7f657806d790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f657806ead0 tx=0x7f6570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab6c28dde649cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f6576ffd700 1 -- 172.21.15.7:0/2513137403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657000e070 con 0x7f65780cef40 2023-10-14T19:08:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f6576ffd700 1 -- 172.21.15.7:0/2513137403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000b970 con 0x7f65780cef40 2023-10-14T19:08:07.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.243+0000 7f6576ffd700 1 -- 172.21.15.7:0/2513137403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65700092e0 con 0x7f65780cef40 2023-10-14T19:08:07.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 -- 172.21.15.7:0/2513137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65780cef40 msgr2=0x7f657806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 --2- 172.21.15.7:0/2513137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65780cef40 0x7f657806d790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f657806ead0 tx=0x7f6570009840 comp rx=0 tx=0).stop 2023-10-14T19:08:07.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 -- 172.21.15.7:0/2513137403 shutdown_connections 2023-10-14T19:08:07.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 --2- 172.21.15.7:0/2513137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65780cef40 0x7f657806d790 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 --2- 172.21.15.7:0/2513137403 >> v2:172.21.15.148:3300/0 conn(0x7f6578153c30 0x7f657815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 --2- 172.21.15.7:0/2513137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657815de50 0x7f65780cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 -- 172.21.15.7:0/2513137403 >> 172.21.15.7:0/2513137403 conn(0x7f65780703a0 msgr2=0x7f65780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:07.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 -- 172.21.15.7:0/2513137403 shutdown_connections 2023-10-14T19:08:07.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.244+0000 7f657d537700 1 -- 172.21.15.7:0/2513137403 wait complete. 2023-10-14T19:08:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.245+0000 7f657d537700 1 Processor -- start 2023-10-14T19:08:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.246+0000 7f657d537700 1 -- start start 2023-10-14T19:08:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.246+0000 7f657d537700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 0x7f6578151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.246+0000 7f657d537700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6578153c30 0x7f6578153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.246+0000 7f657d537700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657815de50 0x7f6578141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f657d537700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6578152b70 con 0x7f657815de50 2023-10-14T19:08:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f657d537700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781424b0 con 0x7f65780cef40 2023-10-14T19:08:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f657d537700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6578151f60 con 0x7f6578153c30 2023-10-14T19:08:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 0x7f6578151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f657cd36700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657815de50 0x7f6578141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 0x7f6578151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:38180/0 (socket says 172.21.15.7:38180) 2023-10-14T19:08:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f65777fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6578153c30 0x7f6578153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 -- 172.21.15.7:0/1294918510 learned_addr learned my addr 172.21.15.7:0/1294918510 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 -- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6578153c30 msgr2=0x7f6578153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6578153c30 0x7f6578153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 -- 172.21.15.7:0/1294918510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657815de50 msgr2=0x7f6578141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657815de50 0x7f6578141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 -- 172.21.15.7:0/1294918510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570009ae0 con 0x7f65780cef40 2023-10-14T19:08:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f657cd36700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657815de50 0x7f6578141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f65777fe700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6578153c30 0x7f6578153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f6577fff700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 0x7f6578151980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f656800ec80 tx=0x7f65680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800c850 con 0x7f65780cef40 2023-10-14T19:08:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800c9b0 con 0x7f65780cef40 2023-10-14T19:08:07.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6578152240 con 0x7f65780cef40 2023-10-14T19:08:07.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.247+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800cd50 con 0x7f65780cef40 2023-10-14T19:08:07.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.248+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6578152800 con 0x7f65780cef40 2023-10-14T19:08:07.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.248+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6578152e50 con 0x7f65780cef40 2023-10-14T19:08:07.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.249+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6568013680 con 0x7f65780cef40 2023-10-14T19:08:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.249+0000 7f655ffff700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6564067170 0x7f6564069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.250+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6568084aa0 con 0x7f65780cef40 2023-10-14T19:08:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.250+0000 7f65777fe700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6564067170 0x7f6564069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.250+0000 7f65777fe700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6564067170 0x7f6564069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f65780c7dd0 tx=0x7f656c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:07.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.254+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6568051a40 con 0x7f65780cef40 2023-10-14T19:08:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.486+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f657804c3c0 con 0x7f65780cef40 2023-10-14T19:08:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.487+0000 7f655ffff700 1 -- 172.21.15.7:0/1294918510 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15402 (secure 0 0 0) 0x7f6568055060 con 0x7f65780cef40 2023-10-14T19:08:07.488 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:07.488 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:05:59.072619+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:04:55.778802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T19:04:56.308884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6564067170 msgr2=0x7f6564069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6564067170 0x7f6564069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f65780c7dd0 tx=0x7f656c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 msgr2=0x7f6578151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 0x7f6578151980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f656800ec80 tx=0x7f65680091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 shutdown_connections 2023-10-14T19:08:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6564067170 0x7f6564069620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65780cef40 0x7f6578151980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657815de50 0x7f6578141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 --2- 172.21.15.7:0/1294918510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6578153c30 0x7f6578153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 >> 172.21.15.7:0/1294918510 conn(0x7f65780703a0 msgr2=0x7f657815bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 shutdown_connections 2023-10-14T19:08:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.489+0000 7f657d537700 1 -- 172.21.15.7:0/1294918510 wait complete. 2023-10-14T19:08:07.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:08:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.627+0000 7f2bb7c19700 1 Processor -- start 2023-10-14T19:08:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.627+0000 7f2bb7c19700 1 -- start start 2023-10-14T19:08:07.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb7c19700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2bb0156250 0x7f2bb0156620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb7c19700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb006b190 0x7f2bb00cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb7c19700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb00cceb0 con 0x7f2bb006acf0 2023-10-14T19:08:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb7c19700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb00c9c20 con 0x7f2bb0156250 2023-10-14T19:08:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb7c19700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00685b0 con 0x7f2bb006b190 2023-10-14T19:08:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb59b5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2bb0156250 0x7f2bb0156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb51b4700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2bb006acf0 0x7f2bb00cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33866/0 (socket says 172.21.15.7:33866) 2023-10-14T19:08:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb51b4700 1 -- 172.21.15.7:0/2084007592 learned_addr learned my addr 172.21.15.7:0/2084007592 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb61b6700 1 --2- 172.21.15.7:0/2084007592 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb006b190 0x7f2bb00cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb49b3700 1 -- 172.21.15.7:0/2084007592 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975582762 0 0) 0x7f2bb00cceb0 con 0x7f2bb006acf0 2023-10-14T19:08:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.628+0000 7f2bb49b3700 1 -- 172.21.15.7:0/2084007592 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b9c003570 con 0x7f2bb006acf0 2023-10-14T19:08:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb61b6700 1 -- 172.21.15.7:0/2084007592 >> v2:172.21.15.7:3300/0 conn(0x7f2bb0156250 msgr2=0x7f2bb0156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb61b6700 1 --2- 172.21.15.7:0/2084007592 >> v2:172.21.15.7:3300/0 conn(0x7f2bb0156250 0x7f2bb0156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb61b6700 1 -- 172.21.15.7:0/2084007592 >> v1:172.21.15.7:6789/0 conn(0x7f2bb006acf0 legacy=0x7f2bb00cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb61b6700 1 -- 172.21.15.7:0/2084007592 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb00c8b80 con 0x7f2bb006b190 2023-10-14T19:08:07.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb59b5700 1 --2- 172.21.15.7:0/2084007592 >> v2:172.21.15.7:3300/0 conn(0x7f2bb0156250 0x7f2bb0156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:07.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb61b6700 1 --2- 172.21.15.7:0/2084007592 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb006b190 0x7f2bb00cc970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009e60 tx=0x7f2ba8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=306c270dd7402904 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:07.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb49b3700 1 -- 172.21.15.7:0/2084007592 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800e070 con 0x7f2bb006b190 2023-10-14T19:08:07.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb49b3700 1 -- 172.21.15.7:0/2084007592 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba800bab0 con 0x7f2bb006b190 2023-10-14T19:08:07.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.629+0000 7f2bb49b3700 1 -- 172.21.15.7:0/2084007592 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800be70 con 0x7f2bb006b190 2023-10-14T19:08:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 -- 172.21.15.7:0/2084007592 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb006b190 msgr2=0x7f2bb00cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/2084007592 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb006b190 0x7f2bb00cc970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009e60 tx=0x7f2ba8009780 comp rx=0 tx=0).stop 2023-10-14T19:08:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 -- 172.21.15.7:0/2084007592 shutdown_connections 2023-10-14T19:08:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/2084007592 >> v2:172.21.15.7:3300/0 conn(0x7f2bb0156250 0x7f2bb0156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/2084007592 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb006b190 0x7f2bb00cc970 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 -- 172.21.15.7:0/2084007592 >> 172.21.15.7:0/2084007592 conn(0x7f2bb00cd400 msgr2=0x7f2bb00cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 -- 172.21.15.7:0/2084007592 shutdown_connections 2023-10-14T19:08:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.630+0000 7f2bb7c19700 1 -- 172.21.15.7:0/2084007592 wait complete. 2023-10-14T19:08:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.631+0000 7f2bb7c19700 1 Processor -- start 2023-10-14T19:08:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 -- start start 2023-10-14T19:08:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb006acf0 0x7f2bb014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 0x7f2bb0150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb0156250 0x7f2bb015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0151e20 con 0x7f2bb006b190 2023-10-14T19:08:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0152c80 con 0x7f2bb006acf0 2023-10-14T19:08:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb7c19700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c5160 con 0x7f2bb0156250 2023-10-14T19:08:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb51b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 0x7f2bb0150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb51b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 0x7f2bb0150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55018/0 (socket says 172.21.15.7:55018) 2023-10-14T19:08:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb51b4700 1 -- 172.21.15.7:0/3316398799 learned_addr learned my addr 172.21.15.7:0/3316398799 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb61b6700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb0156250 0x7f2bb015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.632+0000 7f2bb59b5700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb006acf0 0x7f2bb014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb51b4700 1 -- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb0156250 msgr2=0x7f2bb015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb51b4700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb0156250 0x7f2bb015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb51b4700 1 -- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb006acf0 msgr2=0x7f2bb014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb51b4700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb006acf0 0x7f2bb014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb51b4700 1 -- 172.21.15.7:0/3316398799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac00b6d0 con 0x7f2bb006b190 2023-10-14T19:08:07.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb51b4700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 0x7f2bb0150f00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c820 tx=0x7f2ba0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:07.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0005cd0 con 0x7f2bb006b190 2023-10-14T19:08:07.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0005e50 con 0x7f2bb006b190 2023-10-14T19:08:07.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba8009a20 con 0x7f2bb006b190 2023-10-14T19:08:07.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0007320 con 0x7f2bb006b190 2023-10-14T19:08:07.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.633+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb0152350 con 0x7f2bb006b190 2023-10-14T19:08:07.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.635+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb004c3c0 con 0x7f2bb006b190 2023-10-14T19:08:07.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.636+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2ba0007690 con 0x7f2bb006b190 2023-10-14T19:08:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.636+0000 7f2ba5ffb700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b94067170 0x7f2b94069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.636+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2ba00842f0 con 0x7f2bb006b190 2023-10-14T19:08:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.636+0000 7f2bb59b5700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b94067170 0x7f2b94069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:07.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.637+0000 7f2bb59b5700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b94067170 0x7f2b94069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00bfa0 tx=0x7f2bac00b430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:07.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.642+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ba0051310 con 0x7f2bb006b190 2023-10-14T19:08:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.884+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2bb0152dc0 con 0x7f2bb006b190 2023-10-14T19:08:07.885 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:08:07.884+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:08:07.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.888+0000 7f2ba5ffb700 1 -- 172.21.15.7:0/3316398799 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2ba0054930 con 0x7f2bb006b190 2023-10-14T19:08:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b94067170 msgr2=0x7f2b94069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b94067170 0x7f2b94069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00bfa0 tx=0x7f2bac00b430 comp rx=0 tx=0).stop 2023-10-14T19:08:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 msgr2=0x7f2bb0150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 0x7f2bb0150f00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c820 tx=0x7f2ba0007e00 comp rx=0 tx=0).stop 2023-10-14T19:08:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 shutdown_connections 2023-10-14T19:08:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b94067170 0x7f2b94069620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.890+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb006acf0 0x7f2bb014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.891+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bb0156250 0x7f2bb015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.891+0000 7f2bb7c19700 1 --2- 172.21.15.7:0/3316398799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bb006b190 0x7f2bb0150f00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:07.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.891+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 >> 172.21.15.7:0/3316398799 conn(0x7f2bb00cd400 msgr2=0x7f2bb01553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:07.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.891+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 shutdown_connections 2023-10-14T19:08:07.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:07.891+0000 7f2bb7c19700 1 -- 172.21.15.7:0/3316398799 wait complete. 2023-10-14T19:08:07.894 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:08:07.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:08:07.927 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:08:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.028+0000 7f7b5f59e700 1 Processor -- start 2023-10-14T19:08:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.028+0000 7f7b5f59e700 1 -- start start 2023-10-14T19:08:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.029+0000 7f7b5f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b600cf110 0x7f7b6015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.029+0000 7f7b5f59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6015ac50 con 0x7f7b60153dd0 2023-10-14T19:08:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.029+0000 7f7b5f59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6015d010 con 0x7f7b60153a00 2023-10-14T19:08:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.029+0000 7f7b5f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6015af60 con 0x7f7b600cf110 2023-10-14T19:08:08.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.029+0000 7f7b5dd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7b60153dd0 0x7f7b600cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33886/0 (socket says 172.21.15.7:33886) 2023-10-14T19:08:08.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.029+0000 7f7b5dd9b700 1 -- 172.21.15.7:0/1980813725 learned_addr learned my addr 172.21.15.7:0/1980813725 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:08.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5ed9d700 1 --2- 172.21.15.7:0/1980813725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b600cf110 0x7f7b6015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:08.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277786629 0 0) 0x7f7b6015ac50 con 0x7f7b60153dd0 2023-10-14T19:08:08.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b4c003570 con 0x7f7b60153dd0 2023-10-14T19:08:08.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314238193 0 0) 0x7f7b6015d010 con 0x7f7b60153a00 2023-10-14T19:08:08.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b6015ac50 con 0x7f7b60153a00 2023-10-14T19:08:08.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5ed9d700 1 -- 172.21.15.7:0/1980813725 >> v1:172.21.15.148:6789/0 conn(0x7f7b60153a00 legacy=0x7f7b6015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5ed9d700 1 -- 172.21.15.7:0/1980813725 >> v1:172.21.15.7:6789/0 conn(0x7f7b60153dd0 legacy=0x7f7b600cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5ed9d700 1 -- 172.21.15.7:0/1980813725 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6015b240 con 0x7f7b600cf110 2023-10-14T19:08:08.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5ed9d700 1 --2- 172.21.15.7:0/1980813725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b600cf110 0x7f7b6015de50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009910 tx=0x7f7b580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d33839e6d3ed8fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:08.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011630 con 0x7f7b600cf110 2023-10-14T19:08:08.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58011790 con 0x7f7b600cf110 2023-10-14T19:08:08.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.030+0000 7f7b5d59a700 1 -- 172.21.15.7:0/1980813725 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011b10 con 0x7f7b600cf110 2023-10-14T19:08:08.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 -- 172.21.15.7:0/1980813725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b600cf110 msgr2=0x7f7b6015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/1980813725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b600cf110 0x7f7b6015de50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009910 tx=0x7f7b580091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 -- 172.21.15.7:0/1980813725 shutdown_connections 2023-10-14T19:08:08.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/1980813725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b600cf110 0x7f7b6015de50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 -- 172.21.15.7:0/1980813725 >> 172.21.15.7:0/1980813725 conn(0x7f7b600703a0 msgr2=0x7f7b600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:08.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 -- 172.21.15.7:0/1980813725 shutdown_connections 2023-10-14T19:08:08.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.031+0000 7f7b5f59e700 1 -- 172.21.15.7:0/1980813725 wait complete. 2023-10-14T19:08:08.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.032+0000 7f7b5f59e700 1 Processor -- start 2023-10-14T19:08:08.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.032+0000 7f7b5f59e700 1 -- start start 2023-10-14T19:08:08.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 0x7f7b60153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:08.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b60153a00 0x7f7b6016d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:08.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b60153dd0 0x7f7b600c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:08.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5f59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b60157c00 con 0x7f7b600cf110 2023-10-14T19:08:08.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600c8ba0 con 0x7f7b60153dd0 2023-10-14T19:08:08.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601575f0 con 0x7f7b60153a00 2023-10-14T19:08:08.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 0x7f7b60153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 0x7f7b60153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55044/0 (socket says 172.21.15.7:55044) 2023-10-14T19:08:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 -- 172.21.15.7:0/710636106 learned_addr learned my addr 172.21.15.7:0/710636106 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5ed9d700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b60153dd0 0x7f7b600c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5dd9b700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b60153a00 0x7f7b6016d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 -- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b60153a00 msgr2=0x7f7b6016d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b60153a00 0x7f7b6016d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 -- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b60153dd0 msgr2=0x7f7b600c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b60153dd0 0x7f7b600c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 -- 172.21.15.7:0/710636106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009420 con 0x7f7b600cf110 2023-10-14T19:08:08.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.033+0000 7f7b5e59c700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 0x7f7b60153190 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000cb40 tx=0x7f7b500027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:08.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.034+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500040f0 con 0x7f7b600cf110 2023-10-14T19:08:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.034+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000a7e0 con 0x7f7b600cf110 2023-10-14T19:08:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.034+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b600c8e00 con 0x7f7b600cf110 2023-10-14T19:08:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.034+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000aba0 con 0x7f7b600cf110 2023-10-14T19:08:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.034+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b600c90e0 con 0x7f7b600cf110 2023-10-14T19:08:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.035+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6004c3c0 con 0x7f7b600cf110 2023-10-14T19:08:08.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.035+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7b50012420 con 0x7f7b600cf110 2023-10-14T19:08:08.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.036+0000 7f7b567fc700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b40067170 0x7f7b40069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:08.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.036+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f7b500848a0 con 0x7f7b600cf110 2023-10-14T19:08:08.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.036+0000 7f7b5dd9b700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b40067170 0x7f7b40069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:08.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.036+0000 7f7b5dd9b700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b40067170 0x7f7b40069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7b600cce30 tx=0x7f7b48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.040+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b500518b0 con 0x7f7b600cf110 2023-10-14T19:08:08.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.278+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7b6015b520 con 0x7f7b600cf110 2023-10-14T19:08:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.889+0000 7f7b567fc700 1 -- 172.21.15.7:0/710636106 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7b50054ed0 con 0x7f7b600cf110 2023-10-14T19:08:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b40067170 msgr2=0x7f7b40069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b40067170 0x7f7b40069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7b600cce30 tx=0x7f7b48009040 comp rx=0 tx=0).stop 2023-10-14T19:08:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 msgr2=0x7f7b60153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 0x7f7b60153190 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000cb40 tx=0x7f7b500027a0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 shutdown_connections 2023-10-14T19:08:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b40067170 0x7f7b40069620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b60153dd0 0x7f7b600c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b600cf110 0x7f7b60153190 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 --2- 172.21.15.7:0/710636106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b60153a00 0x7f7b6016d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 >> 172.21.15.7:0/710636106 conn(0x7f7b600703a0 msgr2=0x7f7b600b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 shutdown_connections 2023-10-14T19:08:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:08.892+0000 7f7b5f59e700 1 -- 172.21.15.7:0/710636106 wait complete. 2023-10-14T19:08:08.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:08:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.080+0000 7f6ec7135700 1 Processor -- start 2023-10-14T19:08:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.080+0000 7f6ec7135700 1 -- start start 2023-10-14T19:08:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.080+0000 7f6ec7135700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00cb880 0x7f6ec00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec7135700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6ec00cd770 0x7f6ec01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec7135700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec00cf330 con 0x7f6ec00b04f0 2023-10-14T19:08:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec7135700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec00cdbd0 con 0x7f6ec00cd770 2023-10-14T19:08:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec7135700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00cead0 con 0x7f6ec00cb880 2023-10-14T19:08:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ebffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6ec00b04f0 0x7f6ec00cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33902/0 (socket says 172.21.15.7:33902) 2023-10-14T19:08:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ebffff700 1 -- 172.21.15.7:0/2261406302 learned_addr learned my addr 172.21.15.7:0/2261406302 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2261406302 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00cb880 0x7f6ec00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec56d2700 1 --2- 172.21.15.7:0/2261406302 >> v2:172.21.15.148:3300/0 conn(0x7f6ec00cd770 0x7f6ec01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ebf7fe700 1 -- 172.21.15.7:0/2261406302 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278535419 0 0) 0x7f6ec00cf330 con 0x7f6ec00b04f0 2023-10-14T19:08:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ebf7fe700 1 -- 172.21.15.7:0/2261406302 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eac003570 con 0x7f6ec00b04f0 2023-10-14T19:08:09.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec4ed1700 1 -- 172.21.15.7:0/2261406302 >> v2:172.21.15.148:3300/0 conn(0x7f6ec00cd770 msgr2=0x7f6ec01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:09.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2261406302 >> v2:172.21.15.148:3300/0 conn(0x7f6ec00cd770 0x7f6ec01591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec4ed1700 1 -- 172.21.15.7:0/2261406302 >> v1:172.21.15.7:6789/0 conn(0x7f6ec00b04f0 legacy=0x7f6ec00cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:09.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec4ed1700 1 -- 172.21.15.7:0/2261406302 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00cddd0 con 0x7f6ec00cb880 2023-10-14T19:08:09.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.081+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2261406302 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00cb880 0x7f6ec00cbc50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009e60 tx=0x7f6eb8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2e5540f7050ad9d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ebf7fe700 1 -- 172.21.15.7:0/2261406302 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800e070 con 0x7f6ec00cb880 2023-10-14T19:08:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ebf7fe700 1 -- 172.21.15.7:0/2261406302 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb800bab0 con 0x7f6ec00cb880 2023-10-14T19:08:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ebf7fe700 1 -- 172.21.15.7:0/2261406302 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800be30 con 0x7f6ec00cb880 2023-10-14T19:08:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 -- 172.21.15.7:0/2261406302 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00cb880 msgr2=0x7f6ec00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2261406302 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00cb880 0x7f6ec00cbc50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009e60 tx=0x7f6eb8009780 comp rx=0 tx=0).stop 2023-10-14T19:08:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 -- 172.21.15.7:0/2261406302 shutdown_connections 2023-10-14T19:08:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2261406302 >> v2:172.21.15.148:3300/0 conn(0x7f6ec00cd770 0x7f6ec01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2261406302 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00cb880 0x7f6ec00cbc50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 -- 172.21.15.7:0/2261406302 >> 172.21.15.7:0/2261406302 conn(0x7f6ec00703a0 msgr2=0x7f6ec00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 -- 172.21.15.7:0/2261406302 shutdown_connections 2023-10-14T19:08:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.082+0000 7f6ec7135700 1 -- 172.21.15.7:0/2261406302 wait complete. 2023-10-14T19:08:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.083+0000 7f6ec7135700 1 Processor -- start 2023-10-14T19:08:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.083+0000 7f6ec7135700 1 -- start start 2023-10-14T19:08:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec7135700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00b04f0 0x7f6ec00b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:09.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec7135700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:09.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec7135700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ec00cd770 0x7f6ec01572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:09.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec7135700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00b4f60 con 0x7f6ec00cb880 2023-10-14T19:08:09.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec7135700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00c7e00 con 0x7f6ec00cd770 2023-10-14T19:08:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec7135700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00c80e0 con 0x7f6ec00b04f0 2023-10-14T19:08:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ebffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ebffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55048/0 (socket says 172.21.15.7:55048) 2023-10-14T19:08:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ebffff700 1 -- 172.21.15.7:0/2415768938 learned_addr learned my addr 172.21.15.7:0/2415768938 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec56d2700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ec00cd770 0x7f6ec01572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:09.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.084+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00b04f0 0x7f6ec00b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:09.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebffff700 1 -- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00b04f0 msgr2=0x7f6ec00b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:09.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebffff700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00b04f0 0x7f6ec00b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebffff700 1 -- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ec00cd770 msgr2=0x7f6ec01572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:09.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebffff700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ec00cd770 0x7f6ec01572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebffff700 1 -- 172.21.15.7:0/2415768938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8009a20 con 0x7f6ec00cb880 2023-10-14T19:08:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00b04f0 0x7f6ec00b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebffff700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00011e0 tx=0x7f6eb0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0005b30 con 0x7f6ec00cb880 2023-10-14T19:08:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0005c90 con 0x7f6ec00cb880 2023-10-14T19:08:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec00c83c0 con 0x7f6ec00cb880 2023-10-14T19:08:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0007320 con 0x7f6ec00cb880 2023-10-14T19:08:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.085+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec0157830 con 0x7f6ec00cb880 2023-10-14T19:08:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.086+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec004c3c0 con 0x7f6ec00cb880 2023-10-14T19:08:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.086+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6eb0007690 con 0x7f6ec00cb880 2023-10-14T19:08:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.087+0000 7f6ebcff9700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ea0067170 0x7f6ea0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.087+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f6eb0083e40 con 0x7f6ec00cb880 2023-10-14T19:08:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.087+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ea0067170 0x7f6ea0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.088+0000 7f6ec4ed1700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ea0067170 0x7f6ea0069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80097c0 tx=0x7f6eb8019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.091+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eb0050cc0 con 0x7f6ec00cb880 2023-10-14T19:08:09.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.282+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ec00ce680 con 0x7f6ec00cb880 2023-10-14T19:08:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.976+0000 7f6ebcff9700 1 -- 172.21.15.7:0/2415768938 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6eb0017020 con 0x7f6ec00cb880 2023-10-14T19:08:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ea0067170 msgr2=0x7f6ea0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ea0067170 0x7f6ea0069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80097c0 tx=0x7f6eb8019000 comp rx=0 tx=0).stop 2023-10-14T19:08:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 msgr2=0x7f6ec00c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00011e0 tx=0x7f6eb0007df0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 shutdown_connections 2023-10-14T19:08:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ea0067170 0x7f6ea0069620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ec00cd770 0x7f6ec01572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ec00b04f0 0x7f6ec00b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 --2- 172.21.15.7:0/2415768938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7790 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 >> 172.21.15.7:0/2415768938 conn(0x7f6ec00703a0 msgr2=0x7f6ec0157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 shutdown_connections 2023-10-14T19:08:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:09.979+0000 7f6ec7135700 1 -- 172.21.15.7:0/2415768938 wait complete. 2023-10-14T19:08:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:08:09.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:08:10.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.125+0000 7f9fa62cd700 1 Processor -- start 2023-10-14T19:08:10.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.125+0000 7f9fa62cd700 1 -- start start 2023-10-14T19:08:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9fa62cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9fa0159530 0x7f9fa00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9fa62cd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa00cb6f0 0x7f9fa00cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9fa62cd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa00cc090 con 0x7f9fa006dcf0 2023-10-14T19:08:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9fa62cd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa00ccfd0 con 0x7f9fa0159530 2023-10-14T19:08:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9fa62cd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa015a410 con 0x7f9fa00cb6f0 2023-10-14T19:08:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9f9f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9fa006dcf0 0x7f9fa0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33914/0 (socket says 172.21.15.7:33914) 2023-10-14T19:08:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.126+0000 7f9f9f7fe700 1 -- 172.21.15.7:0/2437740577 learned_addr learned my addr 172.21.15.7:0/2437740577 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9fa486a700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa00cb6f0 0x7f9fa00cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9ffff700 1 --2- 172.21.15.7:0/2437740577 >> v2:172.21.15.148:3300/0 conn(0x7f9fa0159530 0x7f9fa00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821984608 0 0) 0x7f9f94001110 con 0x7f9fa006dcf0 2023-10-14T19:08:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f88003570 con 0x7f9fa006dcf0 2023-10-14T19:08:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2513581272 0 0) 0x7f9f88003570 con 0x7f9fa006dcf0 2023-10-14T19:08:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa00cb6f0 msgr2=0x7f9fa00cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa00cb6f0 0x7f9fa00cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 >> v2:172.21.15.148:3300/0 conn(0x7f9fa0159530 msgr2=0x7f9fa00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 --2- 172.21.15.7:0/2437740577 >> v2:172.21.15.148:3300/0 conn(0x7f9fa0159530 0x7f9fa00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa015a6f0 con 0x7f9fa006dcf0 2023-10-14T19:08:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f9f94001600 con 0x7f9fa006dcf0 2023-10-14T19:08:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 >> v1:172.21.15.7:6789/0 conn(0x7f9fa006dcf0 legacy=0x7f9fa0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f88003a60 0x7f9f88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f88004810 0x7f9f88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f880051c0 0x7f9f8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00ccfd0 con 0x7f9f880051c0 2023-10-14T19:08:10.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa015a410 con 0x7f9f88003a60 2023-10-14T19:08:10.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8800bfa0 con 0x7f9f88004810 2023-10-14T19:08:10.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9fa486a700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa00cb6f0 0x7f9fa00cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:10.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9ffff700 1 --2- 172.21.15.7:0/2437740577 >> v2:172.21.15.148:3300/0 conn(0x7f9fa0159530 0x7f9fa00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:10.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9fa486a700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f880051c0 0x7f9f8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9f7fe700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f88004810 0x7f9f88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.127+0000 7f9f9ffff700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f88003a60 0x7f9f88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 -- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f88004810 msgr2=0x7f9f88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f88004810 0x7f9f88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 -- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f88003a60 msgr2=0x7f9f88003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f88003a60 0x7f9f88003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 -- 172.21.15.7:0/2437740577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88003570 con 0x7f9f880051c0 2023-10-14T19:08:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f880051c0 0x7f9f8800ba60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e280 tx=0x7f9f9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba93820f6a470bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800ea70 con 0x7f9f880051c0 2023-10-14T19:08:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800f040 con 0x7f9f880051c0 2023-10-14T19:08:10.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9f9effd700 1 -- 172.21.15.7:0/2437740577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800ee00 con 0x7f9f880051c0 2023-10-14T19:08:10.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa62cd700 1 -- 172.21.15.7:0/2437740577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f880051c0 msgr2=0x7f9f8800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:10.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/2437740577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f880051c0 0x7f9f8800ba60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e280 tx=0x7f9f9800b040 comp rx=0 tx=0).stop 2023-10-14T19:08:10.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa486a700 1 -- 172.21.15.7:0/2437740577 reap_dead start 2023-10-14T19:08:10.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa62cd700 1 -- 172.21.15.7:0/2437740577 shutdown_connections 2023-10-14T19:08:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.128+0000 7f9fa62cd700 1 -- 172.21.15.7:0/2437740577 >> 172.21.15.7:0/2437740577 conn(0x7f9fa00703a0 msgr2=0x7f9fa00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.129+0000 7f9fa62cd700 1 -- 172.21.15.7:0/2437740577 shutdown_connections 2023-10-14T19:08:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.129+0000 7f9fa62cd700 1 -- 172.21.15.7:0/2437740577 wait complete. 2023-10-14T19:08:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 Processor -- start 2023-10-14T19:08:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 -- start start 2023-10-14T19:08:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 0x7f9fa01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa016a5e0 0x7f9fa00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fa0157410 0x7f9fa0157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0156050 con 0x7f9fa016a210 2023-10-14T19:08:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0157dc0 con 0x7f9fa0157410 2023-10-14T19:08:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.130+0000 7f9fa62cd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0155440 con 0x7f9fa016a5e0 2023-10-14T19:08:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 0x7f9fa01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 0x7f9fa01564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55052/0 (socket says 172.21.15.7:55052) 2023-10-14T19:08:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 -- 172.21.15.7:0/3293202029 learned_addr learned my addr 172.21.15.7:0/3293202029 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9fa486a700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fa0157410 0x7f9fa0157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9f7fe700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa016a5e0 0x7f9fa00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 -- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa016a5e0 msgr2=0x7f9fa00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa016a5e0 0x7f9fa00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 -- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fa0157410 msgr2=0x7f9fa0157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fa0157410 0x7f9fa0157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 -- 172.21.15.7:0/3293202029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0155720 con 0x7f9fa016a210 2023-10-14T19:08:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f9ffff700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 0x7f9fa01564e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9f90011d70 tx=0x7f9f900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90011e70 con 0x7f9fa016a210 2023-10-14T19:08:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9000fc20 con 0x7f9fa016a210 2023-10-14T19:08:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9001d480 con 0x7f9fa016a210 2023-10-14T19:08:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa0155a00 con 0x7f9fa016a210 2023-10-14T19:08:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.131+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa016aa50 con 0x7f9fa016a210 2023-10-14T19:08:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.132+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa004c3c0 con 0x7f9fa016a210 2023-10-14T19:08:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.133+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9f9001d870 con 0x7f9fa016a210 2023-10-14T19:08:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.133+0000 7f9f87fff700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f8c067170 0x7f9f8c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.133+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f9f90018070 con 0x7f9fa016a210 2023-10-14T19:08:10.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.133+0000 7f9f9f7fe700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f8c067170 0x7f9f8c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:10.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.134+0000 7f9f9f7fe700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f8c067170 0x7f9f8c069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9f94007fd0 tx=0x7f9f94007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:10.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.137+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f90052680 con 0x7f9fa016a210 2023-10-14T19:08:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.329+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9fa015a9d0 con 0x7f9fa016a210 2023-10-14T19:08:10.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.978+0000 7f9f87fff700 1 -- 172.21.15.7:0/3293202029 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9f90055ca0 con 0x7f9fa016a210 2023-10-14T19:08:10.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f8c067170 msgr2=0x7f9f8c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:10.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f8c067170 0x7f9f8c069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9f94007fd0 tx=0x7f9f94007a80 comp rx=0 tx=0).stop 2023-10-14T19:08:10.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 msgr2=0x7f9fa01564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:10.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 0x7f9fa01564e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9f90011d70 tx=0x7f9f900091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 shutdown_connections 2023-10-14T19:08:10.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f8c067170 0x7f9f8c069620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fa0157410 0x7f9fa0157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fa016a210 0x7f9fa01564e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 --2- 172.21.15.7:0/3293202029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9fa016a5e0 0x7f9fa00b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 >> 172.21.15.7:0/3293202029 conn(0x7f9fa00703a0 msgr2=0x7f9fa00b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 shutdown_connections 2023-10-14T19:08:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:10.980+0000 7f9fa62cd700 1 -- 172.21.15.7:0/3293202029 wait complete. 2023-10-14T19:08:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:08:10.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:08:11.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.120+0000 7f2e45f03700 1 Processor -- start 2023-10-14T19:08:11.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.120+0000 7f2e45f03700 1 -- start start 2023-10-14T19:08:11.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45f03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e40153dd0 0x7f2e4015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45f03700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e400cea00 0x7f2e400cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45f03700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4015ac50 con 0x7f2e40153a00 2023-10-14T19:08:11.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45f03700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4015d010 con 0x7f2e400cea00 2023-10-14T19:08:11.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45f03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4015af60 con 0x7f2e40153dd0 2023-10-14T19:08:11.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45702700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e400cea00 0x7f2e400cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e44f01700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2e40153a00 0x7f2e4015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33926/0 (socket says 172.21.15.7:33926) 2023-10-14T19:08:11.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e44f01700 1 -- 172.21.15.7:0/3185161956 learned_addr learned my addr 172.21.15.7:0/3185161956 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:11.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e3ffff700 1 --2- 172.21.15.7:0/3185161956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e40153dd0 0x7f2e4015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45702700 1 -- 172.21.15.7:0/3185161956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e40153dd0 msgr2=0x7f2e4015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:11.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45702700 1 --2- 172.21.15.7:0/3185161956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e40153dd0 0x7f2e4015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e45702700 1 -- 172.21.15.7:0/3185161956 >> v1:172.21.15.7:6789/0 conn(0x7f2e40153a00 legacy=0x7f2e4015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.121+0000 7f2e3f7fe700 1 -- 172.21.15.7:0/3185161956 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540432624 0 0) 0x7f2e4015ac50 con 0x7f2e40153a00 2023-10-14T19:08:11.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45702700 1 -- 172.21.15.7:0/3185161956 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4015b240 con 0x7f2e400cea00 2023-10-14T19:08:11.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45702700 1 --2- 172.21.15.7:0/3185161956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e400cea00 0x7f2e400cee60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009910 tx=0x7f2e280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d3848cf3f9365f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:11.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e3f7fe700 1 -- 172.21.15.7:0/3185161956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800b820 con 0x7f2e400cea00 2023-10-14T19:08:11.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e3f7fe700 1 -- 172.21.15.7:0/3185161956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800b980 con 0x7f2e400cea00 2023-10-14T19:08:11.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e3f7fe700 1 -- 172.21.15.7:0/3185161956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800bd20 con 0x7f2e400cea00 2023-10-14T19:08:11.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 -- 172.21.15.7:0/3185161956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e400cea00 msgr2=0x7f2e400cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3185161956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e400cea00 0x7f2e400cee60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009910 tx=0x7f2e280091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 -- 172.21.15.7:0/3185161956 shutdown_connections 2023-10-14T19:08:11.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3185161956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e400cea00 0x7f2e400cee60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3185161956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e40153dd0 0x7f2e4015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 -- 172.21.15.7:0/3185161956 >> 172.21.15.7:0/3185161956 conn(0x7f2e400703a0 msgr2=0x7f2e400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:11.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 -- 172.21.15.7:0/3185161956 shutdown_connections 2023-10-14T19:08:11.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.122+0000 7f2e45f03700 1 -- 172.21.15.7:0/3185161956 wait complete. 2023-10-14T19:08:11.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.123+0000 7f2e45f03700 1 Processor -- start 2023-10-14T19:08:11.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 -- start start 2023-10-14T19:08:11.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e400cea00 0x7f2e40156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 0x7f2e4016a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e40153dd0 0x7f2e400cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400ccda0 con 0x7f2e40153a00 2023-10-14T19:08:11.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400ccfb0 con 0x7f2e40153dd0 2023-10-14T19:08:11.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e45f03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400cd290 con 0x7f2e400cea00 2023-10-14T19:08:11.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e3ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 0x7f2e4016a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.124+0000 7f2e3ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 0x7f2e4016a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55068/0 (socket says 172.21.15.7:55068) 2023-10-14T19:08:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 -- 172.21.15.7:0/3640164541 learned_addr learned my addr 172.21.15.7:0/3640164541 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e44f01700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e400cea00 0x7f2e40156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e45702700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e40153dd0 0x7f2e400cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 -- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e400cea00 msgr2=0x7f2e40156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e400cea00 0x7f2e40156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 -- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e40153dd0 msgr2=0x7f2e400cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e40153dd0 0x7f2e400cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 -- 172.21.15.7:0/3640164541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28009420 con 0x7f2e40153a00 2023-10-14T19:08:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3ffff700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 0x7f2e4016a290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c880 tx=0x7f2e30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30011600 con 0x7f2e40153a00 2023-10-14T19:08:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e30011760 con 0x7f2e40153a00 2023-10-14T19:08:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e40169ab0 con 0x7f2e40153a00 2023-10-14T19:08:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30011b20 con 0x7f2e40153a00 2023-10-14T19:08:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.125+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e40169780 con 0x7f2e40153a00 2023-10-14T19:08:11.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.126+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e40169f50 con 0x7f2e40153a00 2023-10-14T19:08:11.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.127+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2e30018350 con 0x7f2e40153a00 2023-10-14T19:08:11.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.127+0000 7f2e3cff9700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e20067170 0x7f2e20069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.127+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2e300844d0 con 0x7f2e40153a00 2023-10-14T19:08:11.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.127+0000 7f2e44f01700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e20067170 0x7f2e20069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.128+0000 7f2e44f01700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e20067170 0x7f2e20069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e38001560 tx=0x7f2e38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.131+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e30055130 con 0x7f2e40153a00 2023-10-14T19:08:11.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.323+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2e4004c3c0 con 0x7f2e40153a00 2023-10-14T19:08:11.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.326+0000 7f2e3cff9700 1 -- 172.21.15.7:0/3640164541 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e30054cc0 con 0x7f2e40153a00 2023-10-14T19:08:11.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e20067170 msgr2=0x7f2e20069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e20067170 0x7f2e20069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e38001560 tx=0x7f2e38009040 comp rx=0 tx=0).stop 2023-10-14T19:08:11.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 msgr2=0x7f2e4016a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 0x7f2e4016a290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c880 tx=0x7f2e30008040 comp rx=0 tx=0).stop 2023-10-14T19:08:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 shutdown_connections 2023-10-14T19:08:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e20067170 0x7f2e20069620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e40153dd0 0x7f2e400cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e400cea00 0x7f2e40156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 --2- 172.21.15.7:0/3640164541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e40153a00 0x7f2e4016a290 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 >> 172.21.15.7:0/3640164541 conn(0x7f2e400703a0 msgr2=0x7f2e400d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 shutdown_connections 2023-10-14T19:08:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.329+0000 7f2e45f03700 1 -- 172.21.15.7:0/3640164541 wait complete. 2023-10-14T19:08:11.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-14T19:08:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 Processor -- start 2023-10-14T19:08:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 -- start start 2023-10-14T19:08:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38700cb5a0 0x7f38700cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38700cd9e0 0x7f3870159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f3870156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38700d13f0 con 0x7f38700cd9e0 2023-10-14T19:08:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387015ae40 con 0x7f38700cb5a0 2023-10-14T19:08:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.463+0000 7f3875658700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387015ab60 con 0x7f387015a400 2023-10-14T19:08:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38700cd9e0 0x7f3870159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38700cd9e0 0x7f3870159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55072/0 (socket says 172.21.15.7:55072) 2023-10-14T19:08:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 -- 172.21.15.7:0/2246020591 learned_addr learned my addr 172.21.15.7:0/2246020591 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386f7fe700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f3870156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386effd700 1 --2- 172.21.15.7:0/2246020591 >> v2:172.21.15.148:3300/0 conn(0x7f38700cb5a0 0x7f38700cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 -- 172.21.15.7:0/2246020591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 msgr2=0x7f3870156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f3870156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 -- 172.21.15.7:0/2246020591 >> v2:172.21.15.148:3300/0 conn(0x7f38700cb5a0 msgr2=0x7f38700cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 --2- 172.21.15.7:0/2246020591 >> v2:172.21.15.148:3300/0 conn(0x7f38700cb5a0 0x7f38700cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 -- 172.21.15.7:0/2246020591 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700ccf00 con 0x7f38700cd9e0 2023-10-14T19:08:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386effd700 1 --2- 172.21.15.7:0/2246020591 >> v2:172.21.15.148:3300/0 conn(0x7f38700cb5a0 0x7f38700cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386f7fe700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f3870156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386e7fc700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cd9e0 0x7f3870159ec0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f38580099b0 tx=0x7f3858009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7f19ca72f3e71e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386dffb700 1 -- 172.21.15.7:0/2246020591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385800b820 con 0x7f38700cd9e0 2023-10-14T19:08:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386dffb700 1 -- 172.21.15.7:0/2246020591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385800b980 con 0x7f38700cd9e0 2023-10-14T19:08:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.464+0000 7f386dffb700 1 -- 172.21.15.7:0/2246020591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385800bd20 con 0x7f38700cd9e0 2023-10-14T19:08:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 -- 172.21.15.7:0/2246020591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cd9e0 msgr2=0x7f3870159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cd9e0 0x7f3870159ec0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f38580099b0 tx=0x7f3858009250 comp rx=0 tx=0).stop 2023-10-14T19:08:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 -- 172.21.15.7:0/2246020591 shutdown_connections 2023-10-14T19:08:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f3870156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 --2- 172.21.15.7:0/2246020591 >> v2:172.21.15.148:3300/0 conn(0x7f38700cb5a0 0x7f38700cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 --2- 172.21.15.7:0/2246020591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cd9e0 0x7f3870159ec0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 -- 172.21.15.7:0/2246020591 >> 172.21.15.7:0/2246020591 conn(0x7f3870070e30 msgr2=0x7f38700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 -- 172.21.15.7:0/2246020591 shutdown_connections 2023-10-14T19:08:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.465+0000 7f3875658700 1 -- 172.21.15.7:0/2246020591 wait complete. 2023-10-14T19:08:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.466+0000 7f3875658700 1 Processor -- start 2023-10-14T19:08:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.466+0000 7f3875658700 1 -- start start 2023-10-14T19:08:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3875658700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 0x7f3870151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3875658700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38700cd9e0 0x7f38700b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3875658700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f38700b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3875658700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38700c7b30 con 0x7f38700cb5a0 2023-10-14T19:08:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3875658700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3870151690 con 0x7f38700cd9e0 2023-10-14T19:08:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3875658700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38700b5dc0 con 0x7f387015a400 2023-10-14T19:08:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 0x7f3870151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 0x7f3870151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55086/0 (socket says 172.21.15.7:55086) 2023-10-14T19:08:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 -- 172.21.15.7:0/3738252433 learned_addr learned my addr 172.21.15.7:0/3738252433 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 -- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 msgr2=0x7f38700b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f38700b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 -- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38700cd9e0 msgr2=0x7f38700b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38700cd9e0 0x7f38700b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 -- 172.21.15.7:0/3738252433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580094f0 con 0x7f38700cb5a0 2023-10-14T19:08:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f386effd700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 0x7f3870151150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f386800c8b0 tx=0x7f3868008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.467+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868011660 con 0x7f38700cb5a0 2023-10-14T19:08:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.468+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38680117c0 con 0x7f38700cb5a0 2023-10-14T19:08:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.468+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38700b60a0 con 0x7f38700cb5a0 2023-10-14T19:08:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.468+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868011b40 con 0x7f38700cb5a0 2023-10-14T19:08:11.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.468+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38700c77c0 con 0x7f38700cb5a0 2023-10-14T19:08:11.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.469+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387004c3c0 con 0x7f38700cb5a0 2023-10-14T19:08:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.469+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f3868010350 con 0x7f38700cb5a0 2023-10-14T19:08:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.469+0000 7f3866ffd700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38500671a0 0x7f3850069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.470+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3868084600 con 0x7f38700cb5a0 2023-10-14T19:08:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.470+0000 7f386e7fc700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38500671a0 0x7f3850069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:11.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.470+0000 7f386e7fc700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38500671a0 0x7f3850069650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38580099b0 tx=0x7f3858017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:11.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.474+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3868055260 con 0x7f38700cb5a0 2023-10-14T19:08:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.748+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f38701517d0 con 0x7f38700cb5a0 2023-10-14T19:08:11.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.989+0000 7f3866ffd700 1 -- 172.21.15.7:0/3738252433 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v230) v1 ==== 158+0+0 (secure 0 0 0) 0x7f38701517d0 con 0x7f38700cb5a0 2023-10-14T19:08:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38500671a0 msgr2=0x7f3850069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38500671a0 0x7f3850069650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38580099b0 tx=0x7f3858017000 comp rx=0 tx=0).stop 2023-10-14T19:08:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 msgr2=0x7f3870151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 0x7f3870151150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f386800c8b0 tx=0x7f3868008040 comp rx=0 tx=0).stop 2023-10-14T19:08:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 shutdown_connections 2023-10-14T19:08:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38500671a0 0x7f3850069650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.991+0000 7f3875658700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f387015a400 0x7f38700b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.992+0000 7f3875658700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38700cb5a0 0x7f3870151150 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.992+0000 7f3875658700 1 --2- 172.21.15.7:0/3738252433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38700cd9e0 0x7f38700b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.992+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 >> 172.21.15.7:0/3738252433 conn(0x7f3870070e30 msgr2=0x7f38700cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.992+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 shutdown_connections 2023-10-14T19:08:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:11.992+0000 7f3875658700 1 -- 172.21.15.7:0/3738252433 wait complete. 2023-10-14T19:08:12.007 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ok 2023-10-14T19:08:12.008 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command 2023-10-14T19:08:12.008 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:08:12.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-14T19:08:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.128+0000 7f2b521e4700 1 Processor -- start 2023-10-14T19:08:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.128+0000 7f2b521e4700 1 -- start start 2023-10-14T19:08:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b521e4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b4c0cb5a0 0x7f2b4c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:12.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b521e4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b4c0cd9e0 0x7f2b4c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:12.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b521e4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c15ae40 con 0x7f2b4c15a400 2023-10-14T19:08:12.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b521e4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c0d13f0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b521e4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c15ab60 con 0x7f2b4c0cb5a0 2023-10-14T19:08:12.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b4c0cd9e0 0x7f2b4c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:12.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b4c15a400 0x7f2b4c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33942/0 (socket says 172.21.15.7:33942) 2023-10-14T19:08:12.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4bfff700 1 -- 172.21.15.7:0/152980292 learned_addr learned my addr 172.21.15.7:0/152980292 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:12.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4b7fe700 1 --2- 172.21.15.7:0/152980292 >> v2:172.21.15.148:3300/0 conn(0x7f2b4c0cb5a0 0x7f2b4c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:12.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4affd700 1 -- 172.21.15.7:0/152980292 >> v2:172.21.15.148:3300/0 conn(0x7f2b4c0cb5a0 msgr2=0x7f2b4c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:12.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4affd700 1 --2- 172.21.15.7:0/152980292 >> v2:172.21.15.148:3300/0 conn(0x7f2b4c0cb5a0 0x7f2b4c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4affd700 1 -- 172.21.15.7:0/152980292 >> v1:172.21.15.7:6789/0 conn(0x7f2b4c15a400 legacy=0x7f2b4c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:12.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4affd700 1 -- 172.21.15.7:0/152980292 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0ccf00 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4a7fc700 1 -- 172.21.15.7:0/152980292 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479677618 0 0) 0x7f2b4c15ae40 con 0x7f2b4c15a400 2023-10-14T19:08:12.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.129+0000 7f2b4b7fe700 1 --2- 172.21.15.7:0/152980292 >> v2:172.21.15.148:3300/0 conn(0x7f2b4c0cb5a0 0x7f2b4c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:12.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b4affd700 1 --2- 172.21.15.7:0/152980292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c159ec0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2b400098e0 tx=0x7f2b400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc0dcd076bf465c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:12.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b4a7fc700 1 -- 172.21.15.7:0/152980292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40009e80 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b4a7fc700 1 -- 172.21.15.7:0/152980292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4000b820 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b4a7fc700 1 -- 172.21.15.7:0/152980292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000bba0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 -- 172.21.15.7:0/152980292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 msgr2=0x7f2b4c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:12.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 --2- 172.21.15.7:0/152980292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c159ec0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2b400098e0 tx=0x7f2b400091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 -- 172.21.15.7:0/152980292 shutdown_connections 2023-10-14T19:08:12.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 --2- 172.21.15.7:0/152980292 >> v2:172.21.15.148:3300/0 conn(0x7f2b4c0cb5a0 0x7f2b4c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 --2- 172.21.15.7:0/152980292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c159ec0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 -- 172.21.15.7:0/152980292 >> 172.21.15.7:0/152980292 conn(0x7f2b4c070e30 msgr2=0x7f2b4c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 -- 172.21.15.7:0/152980292 shutdown_connections 2023-10-14T19:08:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.130+0000 7f2b521e4700 1 -- 172.21.15.7:0/152980292 wait complete. 2023-10-14T19:08:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 Processor -- start 2023-10-14T19:08:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 -- start start 2023-10-14T19:08:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b4c0cb5a0 0x7f2b4c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:12.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b4c15a400 0x7f2b4c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:12.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c9810 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c9af0 con 0x7f2b4c15a400 2023-10-14T19:08:12.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b521e4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c9dd0 con 0x7f2b4c0cb5a0 2023-10-14T19:08:12.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:12.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c0c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55106/0 (socket says 172.21.15.7:55106) 2023-10-14T19:08:12.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.132+0000 7f2b4affd700 1 -- 172.21.15.7:0/2154529718 learned_addr learned my addr 172.21.15.7:0/2154529718 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:12.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4bfff700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b4c15a400 0x7f2b4c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:12.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4b7fe700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b4c0cb5a0 0x7f2b4c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:12.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4affd700 1 -- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b4c0cb5a0 msgr2=0x7f2b4c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:12.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4affd700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b4c0cb5a0 0x7f2b4c0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4affd700 1 -- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b4c15a400 msgr2=0x7f2b4c15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:12.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4affd700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b4c15a400 0x7f2b4c15c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4affd700 1 -- 172.21.15.7:0/2154529718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b40009420 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b4affd700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c0c8f80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c06ea60 tx=0x7f2b40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000bba0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40011420 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c0ca0b0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400117e0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.133+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c152820 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.134+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c04c3c0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.135+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2b40011b50 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.135+0000 7f2b337fe700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b38067170 0x7f2b38069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:12.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.135+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2b400859b0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.135+0000 7f2b4b7fe700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b38067170 0x7f2b38069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:12.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.136+0000 7f2b4b7fe700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b38067170 0x7f2b38069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c006f00 tx=0x7f2b3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:12.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.139+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b40052d10 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.417+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f2b4c0cd1e0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.991+0000 7f2b337fe700 1 -- 172.21.15.7:0/2154529718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v231) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2b400150e0 con 0x7f2b4c0cd9e0 2023-10-14T19:08:12.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b38067170 msgr2=0x7f2b38069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:12.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b38067170 0x7f2b38069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c006f00 tx=0x7f2b3c008040 comp rx=0 tx=0).stop 2023-10-14T19:08:12.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 msgr2=0x7f2b4c0c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:12.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c0c8f80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c06ea60 tx=0x7f2b40017000 comp rx=0 tx=0).stop 2023-10-14T19:08:12.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 shutdown_connections 2023-10-14T19:08:12.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b38067170 0x7f2b38069620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b4c15a400 0x7f2b4c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b4c0cb5a0 0x7f2b4c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 --2- 172.21.15.7:0/2154529718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4c0cd9e0 0x7f2b4c0c8f80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:12.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 >> 172.21.15.7:0/2154529718 conn(0x7f2b4c070e30 msgr2=0x7f2b4c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:12.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 shutdown_connections 2023-10-14T19:08:12.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:12.994+0000 7f2b521e4700 1 -- 172.21.15.7:0/2154529718 wait complete. 2023-10-14T19:08:13.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:08:13.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.134+0000 7f9d250b9700 1 Processor -- start 2023-10-14T19:08:13.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d250b9700 1 -- start start 2023-10-14T19:08:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d250b9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d2006dc70 0x7f9d20159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d250b9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200ccfd0 con 0x7f9d2006e0e0 2023-10-14T19:08:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d250b9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2015a3d0 con 0x7f9d20159530 2023-10-14T19:08:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d250b9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2015a6b0 con 0x7f9d2006dc70 2023-10-14T19:08:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d1e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d2006dc70 0x7f9d20159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.135+0000 7f9d1f59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9d2006e0e0 0x7f9d200cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33946/0 (socket says 172.21.15.7:33946) 2023-10-14T19:08:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1f59e700 1 -- 172.21.15.7:0/3172106940 learned_addr learned my addr 172.21.15.7:0/3172106940 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1e59c700 1 -- 172.21.15.7:0/3172106940 >> v1:172.21.15.148:6789/0 conn(0x7f9d20159530 legacy=0x7f9d200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1e59c700 1 -- 172.21.15.7:0/3172106940 >> v1:172.21.15.7:6789/0 conn(0x7f9d2006e0e0 legacy=0x7f9d200cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1e59c700 1 -- 172.21.15.7:0/3172106940 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2015a990 con 0x7f9d2006dc70 2023-10-14T19:08:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1e59c700 1 --2- 172.21.15.7:0/3172106940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006dc70 0x7f9d20159900 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098e0 tx=0x7f9d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3f502ea4559b44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1dd9b700 1 -- 172.21.15.7:0/3172106940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08009e80 con 0x7f9d2006dc70 2023-10-14T19:08:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1dd9b700 1 -- 172.21.15.7:0/3172106940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0800b820 con 0x7f9d2006dc70 2023-10-14T19:08:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.136+0000 7f9d1dd9b700 1 -- 172.21.15.7:0/3172106940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800bba0 con 0x7f9d2006dc70 2023-10-14T19:08:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 -- 172.21.15.7:0/3172106940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006dc70 msgr2=0x7f9d20159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 --2- 172.21.15.7:0/3172106940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006dc70 0x7f9d20159900 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098e0 tx=0x7f9d080091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 -- 172.21.15.7:0/3172106940 shutdown_connections 2023-10-14T19:08:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 --2- 172.21.15.7:0/3172106940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006dc70 0x7f9d20159900 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 -- 172.21.15.7:0/3172106940 >> 172.21.15.7:0/3172106940 conn(0x7f9d200703a0 msgr2=0x7f9d200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:13.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 -- 172.21.15.7:0/3172106940 shutdown_connections 2023-10-14T19:08:13.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.137+0000 7f9d250b9700 1 -- 172.21.15.7:0/3172106940 wait complete. 2023-10-14T19:08:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.138+0000 7f9d250b9700 1 Processor -- start 2023-10-14T19:08:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.138+0000 7f9d250b9700 1 -- start start 2023-10-14T19:08:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d2006dc70 0x7f9d2016a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 0x7f9d200b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d20159530 0x7f9d2015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200b4f00 con 0x7f9d2006e0e0 2023-10-14T19:08:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2015d900 con 0x7f9d2006dc70 2023-10-14T19:08:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2015db10 con 0x7f9d20159530 2023-10-14T19:08:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 0x7f9d200b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 0x7f9d200b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55120/0 (socket says 172.21.15.7:55120) 2023-10-14T19:08:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 -- 172.21.15.7:0/266593757 learned_addr learned my addr 172.21.15.7:0/266593757 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1ed9d700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d2006dc70 0x7f9d2016a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1f59e700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d20159530 0x7f9d2015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 -- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d20159530 msgr2=0x7f9d2015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d20159530 0x7f9d2015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 -- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d2006dc70 msgr2=0x7f9d2016a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d2006dc70 0x7f9d2016a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 -- 172.21.15.7:0/266593757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009420 con 0x7f9d2006e0e0 2023-10-14T19:08:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1ed9d700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d2006dc70 0x7f9d2016a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d1e59c700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 0x7f9d200b49c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9d080030c0 tx=0x7f9d08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800bae0 con 0x7f9d2006e0e0 2023-10-14T19:08:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08020070 con 0x7f9d2006e0e0 2023-10-14T19:08:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2015ddf0 con 0x7f9d2006e0e0 2023-10-14T19:08:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0801b6a0 con 0x7f9d2006e0e0 2023-10-14T19:08:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.139+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2015e180 con 0x7f9d2006e0e0 2023-10-14T19:08:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.140+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2015df80 con 0x7f9d2006e0e0 2023-10-14T19:08:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.141+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9d08022030 con 0x7f9d2006e0e0 2023-10-14T19:08:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.141+0000 7f9d16ffd700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d00067170 0x7f9d00069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.141+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9d08086550 con 0x7f9d2006e0e0 2023-10-14T19:08:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.141+0000 7f9d1ed9d700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d00067170 0x7f9d00069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.142+0000 7f9d1ed9d700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d00067170 0x7f9d00069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d10001370 tx=0x7f9d10009680 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.146+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d080538e0 con 0x7f9d2006e0e0 2023-10-14T19:08:13.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.339+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9d2015df80 con 0x7f9d2006e0e0 2023-10-14T19:08:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.342+0000 7f9d16ffd700 1 -- 172.21.15.7:0/266593757 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d08056f00 con 0x7f9d2006e0e0 2023-10-14T19:08:13.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d00067170 msgr2=0x7f9d00069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d00067170 0x7f9d00069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d10001370 tx=0x7f9d10009680 comp rx=0 tx=0).stop 2023-10-14T19:08:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 msgr2=0x7f9d200b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 0x7f9d200b49c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9d080030c0 tx=0x7f9d08016000 comp rx=0 tx=0).stop 2023-10-14T19:08:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 shutdown_connections 2023-10-14T19:08:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d00067170 0x7f9d00069620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d2006dc70 0x7f9d2016a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d20159530 0x7f9d2015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 --2- 172.21.15.7:0/266593757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d2006e0e0 0x7f9d200b49c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 >> 172.21.15.7:0/266593757 conn(0x7f9d200703a0 msgr2=0x7f9d2015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 shutdown_connections 2023-10-14T19:08:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.344+0000 7f9d250b9700 1 -- 172.21.15.7:0/266593757 wait complete. 2023-10-14T19:08:13.357 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:08:13.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:13.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:13.450 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:08:13.451 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:08:13.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.570+0000 7f19761c3700 1 Processor -- start 2023-10-14T19:08:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.570+0000 7f19761c3700 1 -- start start 2023-10-14T19:08:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19761c3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1970153c30 0x7f197015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19761c3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19700cf110 0x7f197015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19761c3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197015afd0 con 0x7f197015de50 2023-10-14T19:08:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19761c3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197015b2b0 con 0x7f19700cf110 2023-10-14T19:08:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19761c3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197015b590 con 0x7f1970153c30 2023-10-14T19:08:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19759c2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19700cf110 0x7f197015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19749c0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f197015de50 0x7f19700cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33958/0 (socket says 172.21.15.7:33958) 2023-10-14T19:08:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19749c0700 1 -- 172.21.15.7:0/4214770129 learned_addr learned my addr 172.21.15.7:0/4214770129 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19751c1700 1 --2- 172.21.15.7:0/4214770129 >> v2:172.21.15.148:3300/0 conn(0x7f1970153c30 0x7f197015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19759c2700 1 -- 172.21.15.7:0/4214770129 >> v2:172.21.15.148:3300/0 conn(0x7f1970153c30 msgr2=0x7f197015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19759c2700 1 --2- 172.21.15.7:0/4214770129 >> v2:172.21.15.148:3300/0 conn(0x7f1970153c30 0x7f197015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19759c2700 1 -- 172.21.15.7:0/4214770129 >> v1:172.21.15.7:6789/0 conn(0x7f197015de50 legacy=0x7f19700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f196ffff700 1 -- 172.21.15.7:0/4214770129 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046463701 0 0) 0x7f197015afd0 con 0x7f197015de50 2023-10-14T19:08:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.571+0000 7f19759c2700 1 -- 172.21.15.7:0/4214770129 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197015b870 con 0x7f19700cf110 2023-10-14T19:08:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19751c1700 1 --2- 172.21.15.7:0/4214770129 >> v2:172.21.15.148:3300/0 conn(0x7f1970153c30 0x7f197015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19759c2700 1 --2- 172.21.15.7:0/4214770129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19700cf110 0x7f197015c070 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f197006ead0 tx=0x7f1960009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a659bb70044936 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:13.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f196ffff700 1 -- 172.21.15.7:0/4214770129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000e070 con 0x7f19700cf110 2023-10-14T19:08:13.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f196ffff700 1 -- 172.21.15.7:0/4214770129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000bc30 con 0x7f19700cf110 2023-10-14T19:08:13.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f196ffff700 1 -- 172.21.15.7:0/4214770129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960012430 con 0x7f19700cf110 2023-10-14T19:08:13.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 -- 172.21.15.7:0/4214770129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19700cf110 msgr2=0x7f197015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 --2- 172.21.15.7:0/4214770129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19700cf110 0x7f197015c070 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f197006ead0 tx=0x7f1960009780 comp rx=0 tx=0).stop 2023-10-14T19:08:13.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 -- 172.21.15.7:0/4214770129 shutdown_connections 2023-10-14T19:08:13.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 --2- 172.21.15.7:0/4214770129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19700cf110 0x7f197015c070 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 --2- 172.21.15.7:0/4214770129 >> v2:172.21.15.148:3300/0 conn(0x7f1970153c30 0x7f197015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 -- 172.21.15.7:0/4214770129 >> 172.21.15.7:0/4214770129 conn(0x7f19700703a0 msgr2=0x7f19700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 -- 172.21.15.7:0/4214770129 shutdown_connections 2023-10-14T19:08:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.572+0000 7f19761c3700 1 -- 172.21.15.7:0/4214770129 wait complete. 2023-10-14T19:08:13.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.573+0000 7f19761c3700 1 Processor -- start 2023-10-14T19:08:13.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 -- start start 2023-10-14T19:08:13.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19700cf110 0x7f197014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 0x7f19700c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f197015de50 0x7f197015f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970151290 con 0x7f1970153c30 2023-10-14T19:08:13.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970150680 con 0x7f19700cf110 2023-10-14T19:08:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.574+0000 7f19761c3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1970150960 con 0x7f197015de50 2023-10-14T19:08:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 0x7f19700c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 0x7f19700c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55140/0 (socket says 172.21.15.7:55140) 2023-10-14T19:08:13.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 -- 172.21.15.7:0/4272178660 learned_addr learned my addr 172.21.15.7:0/4272178660 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19751c1700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19700cf110 0x7f197014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19759c2700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f197015de50 0x7f197015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 -- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f197015de50 msgr2=0x7f197015f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f197015de50 0x7f197015f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 -- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19700cf110 msgr2=0x7f197014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19700cf110 0x7f197014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 -- 172.21.15.7:0/4272178660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960009a20 con 0x7f1970153c30 2023-10-14T19:08:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19749c0700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 0x7f19700c9bc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f196400c5b0 tx=0x7f1964001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964005b30 con 0x7f1970153c30 2023-10-14T19:08:13.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964005c90 con 0x7f1970153c30 2023-10-14T19:08:13.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1970150c40 con 0x7f1970153c30 2023-10-14T19:08:13.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964007300 con 0x7f1970153c30 2023-10-14T19:08:13.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.575+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197014ff10 con 0x7f1970153c30 2023-10-14T19:08:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.576+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197004c3c0 con 0x7f1970153c30 2023-10-14T19:08:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.577+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f196401b3b0 con 0x7f1970153c30 2023-10-14T19:08:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.577+0000 7f196d7fa700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f195c067170 0x7f195c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.577+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1964083a50 con 0x7f1970153c30 2023-10-14T19:08:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.577+0000 7f19751c1700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f195c067170 0x7f195c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.578+0000 7f19751c1700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f195c067170 0x7f195c069620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f196800adc0 tx=0x7f1968006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.581+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1964050d30 con 0x7f1970153c30 2023-10-14T19:08:13.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.818+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f197015bb50 con 0x7f1970153c30 2023-10-14T19:08:13.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.819+0000 7f196d7fa700 1 -- 172.21.15.7:0/4272178660 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f1964017090 con 0x7f1970153c30 2023-10-14T19:08:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:13.820 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1560228278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1560228278},{"type":"v1","addr":"172.21.15.148:6837","nonce":1560228278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3754112010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3754112010},{"type":"v1","addr":"172.21.15.148:6836","nonce":3754112010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/698364446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":698364446},{"type":"v1","addr":"172.21.15.7:6833","nonce":698364446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/611303536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":611303536},{"type":"v1","addr":"172.21.15.7:6835","nonce":611303536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-10-14T19:08:13.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f195c067170 msgr2=0x7f195c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f195c067170 0x7f195c069620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f196800adc0 tx=0x7f1968006f90 comp rx=0 tx=0).stop 2023-10-14T19:08:13.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 msgr2=0x7f19700c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:13.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 0x7f19700c9bc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f196400c5b0 tx=0x7f1964001070 comp rx=0 tx=0).stop 2023-10-14T19:08:13.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 shutdown_connections 2023-10-14T19:08:13.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f195c067170 0x7f195c069620 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19700cf110 0x7f197014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f197015de50 0x7f197015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 --2- 172.21.15.7:0/4272178660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1970153c30 0x7f19700c9bc0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:13.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 >> 172.21.15.7:0/4272178660 conn(0x7f19700703a0 msgr2=0x7f1970159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:13.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 shutdown_connections 2023-10-14T19:08:13.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:13.821+0000 7f19761c3700 1 -- 172.21.15.7:0/4272178660 wait complete. 2023-10-14T19:08:13.825 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 42 2023-10-14T19:08:13.834 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:08:13.834 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:08:13.835 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:08:13.835 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:13.835 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:08:13.836 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:08:13.836 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:08:13.836 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:13.837 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:08:13.837 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:08:13.837 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:08:13.837 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:13.838 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:08:13.838 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:08:13.839 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:08:13.839 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:13.843 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:08:13.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:08:13.845 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:08:13.845 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:08:13.848 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:08:13.849 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:08:13.850 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:08:13.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:08:13.887 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:08:13.888 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:13.889 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:08:13.889 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:13.893 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:08:13.893 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:13.894 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:08:13.895 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:13.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:08:13.964 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:08:13.964 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:08:13.977 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:08:13.977 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:08:13.978 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-10-14T19:08:13.978+0000 7ffa02eae700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2023-10-14T19:08:14.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.021+0000 7f64a56a7700 1 Processor -- start 2023-10-14T19:08:14.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.021+0000 7f64a56a7700 1 -- start start 2023-10-14T19:08:14.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f64a56a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:14.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f64a56a7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a015ae40 con 0x7f64a00cde50 2023-10-14T19:08:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f64a56a7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a015ab60 con 0x7f64a00cd9e0 2023-10-14T19:08:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f64a56a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00d13f0 con 0x7f64a00cb5a0 2023-10-14T19:08:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f649f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f64a00cde50 0x7f64a0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33994/0 (socket says 172.21.15.7:33994) 2023-10-14T19:08:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f649f7fe700 1 -- 172.21.15.7:0/2239984481 learned_addr learned my addr 172.21.15.7:0/2239984481 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.022+0000 7f649effd700 1 --2- 172.21.15.7:0/2239984481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094080688 0 0) 0x7f64a015ae40 con 0x7f64a00cde50 2023-10-14T19:08:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f648c003570 con 0x7f64a00cde50 2023-10-14T19:08:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115753369 0 0) 0x7f64a015ab60 con 0x7f64a00cd9e0 2023-10-14T19:08:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a015ae40 con 0x7f64a00cd9e0 2023-10-14T19:08:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649effd700 1 -- 172.21.15.7:0/2239984481 >> v1:172.21.15.148:6789/0 conn(0x7f64a00cd9e0 legacy=0x7f64a0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649effd700 1 -- 172.21.15.7:0/2239984481 >> v1:172.21.15.7:6789/0 conn(0x7f64a00cde50 legacy=0x7f64a0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649effd700 1 -- 172.21.15.7:0/2239984481 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00ccf00 con 0x7f64a00cb5a0 2023-10-14T19:08:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649effd700 1 --2- 172.21.15.7:0/2239984481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a00cb970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6490009910 tx=0x7f64900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d6954fc87026bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490011630 con 0x7f64a00cb5a0 2023-10-14T19:08:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490011790 con 0x7f64a00cb5a0 2023-10-14T19:08:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.023+0000 7f649dffb700 1 -- 172.21.15.7:0/2239984481 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490011b30 con 0x7f64a00cb5a0 2023-10-14T19:08:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 -- 172.21.15.7:0/2239984481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 msgr2=0x7f64a00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2239984481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a00cb970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6490009910 tx=0x7f64900091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 -- 172.21.15.7:0/2239984481 shutdown_connections 2023-10-14T19:08:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2239984481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a00cb970 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 -- 172.21.15.7:0/2239984481 >> 172.21.15.7:0/2239984481 conn(0x7f64a0070e30 msgr2=0x7f64a00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 -- 172.21.15.7:0/2239984481 shutdown_connections 2023-10-14T19:08:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.024+0000 7f64a56a7700 1 -- 172.21.15.7:0/2239984481 wait complete. 2023-10-14T19:08:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.025+0000 7f64a56a7700 1 Processor -- start 2023-10-14T19:08:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.025+0000 7f64a56a7700 1 -- start start 2023-10-14T19:08:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f64a56a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a0169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f64a56a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 0x7f64a01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f64a56a7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a00c98e0 0x7f64a015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f64a56a7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00c96c0 con 0x7f64a00cd9e0 2023-10-14T19:08:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f64a56a7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00c79f0 con 0x7f64a00c98e0 2023-10-14T19:08:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f64a56a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a016a9b0 con 0x7f64a00cb5a0 2023-10-14T19:08:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 0x7f64a01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 0x7f64a01531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55174/0 (socket says 172.21.15.7:55174) 2023-10-14T19:08:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 -- 172.21.15.7:0/2552589326 learned_addr learned my addr 172.21.15.7:0/2552589326 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649effd700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a0169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649f7fe700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a00c98e0 0x7f64a015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 -- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 msgr2=0x7f64a0169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a0169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 -- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a00c98e0 msgr2=0x7f64a015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a00c98e0 0x7f64a015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 -- 172.21.15.7:0/2552589326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009420 con 0x7f64a00cd9e0 2023-10-14T19:08:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649effd700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a0169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649f7fe700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a00c98e0 0x7f64a015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.026+0000 7f649e7fc700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 0x7f64a01531f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f648800c7c0 tx=0x7f6488007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.027+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488010510 con 0x7f64a00cd9e0 2023-10-14T19:08:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.027+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6488010690 con 0x7f64a00cd9e0 2023-10-14T19:08:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.027+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a0169eb0 con 0x7f64a00cd9e0 2023-10-14T19:08:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.027+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488010a50 con 0x7f64a00cd9e0 2023-10-14T19:08:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.027+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a016a3f0 con 0x7f64a00cd9e0 2023-10-14T19:08:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.027+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a00c77a0 con 0x7f64a00cd9e0 2023-10-14T19:08:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.028+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f648801b400 con 0x7f64a00cd9e0 2023-10-14T19:08:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.028+0000 7f6496ffd700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6480067170 0x7f6480069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.028+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f64880842a0 con 0x7f64a00cd9e0 2023-10-14T19:08:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.029+0000 7f649effd700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6480067170 0x7f6480069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.029+0000 7f649effd700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6480067170 0x7f6480069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6490009860 tx=0x7f6490017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.033+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6488051580 con 0x7f64a00cd9e0 2023-10-14T19:08:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:14.242+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f64a004c3c0 con 0x7f64a00cd9e0 2023-10-14T19:08:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.017+0000 7f6496ffd700 1 -- 172.21.15.7:0/2552589326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6488054ba0 con 0x7f64a00cd9e0 2023-10-14T19:08:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6480067170 msgr2=0x7f6480069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6480067170 0x7f6480069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6490009860 tx=0x7f6490017000 comp rx=0 tx=0).stop 2023-10-14T19:08:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 msgr2=0x7f64a01531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 0x7f64a01531f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f648800c7c0 tx=0x7f6488007e10 comp rx=0 tx=0).stop 2023-10-14T19:08:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 shutdown_connections 2023-10-14T19:08:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6480067170 0x7f6480069620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64a00c98e0 0x7f64a015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64a00cb5a0 0x7f64a0169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 --2- 172.21.15.7:0/2552589326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64a00cd9e0 0x7f64a01531f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 >> 172.21.15.7:0/2552589326 conn(0x7f64a0070e30 msgr2=0x7f64a00b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 shutdown_connections 2023-10-14T19:08:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.020+0000 7f64a56a7700 1 -- 172.21.15.7:0/2552589326 wait complete. 2023-10-14T19:08:15.023 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:08:15.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:08:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.162+0000 7f6431df4700 1 Processor -- start 2023-10-14T19:08:15.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.162+0000 7f6431df4700 1 -- start start 2023-10-14T19:08:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.162+0000 7f6431df4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f642c0cb5a0 0x7f642c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f6431df4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c15a5d0 0x7f642c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f6431df4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c15ae40 con 0x7f642c0cd9e0 2023-10-14T19:08:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f6431df4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c0d13f0 con 0x7f642c0cb5a0 2023-10-14T19:08:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f6431df4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c15ab60 con 0x7f642c15a5d0 2023-10-14T19:08:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f642c0cb5a0 0x7f642c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f6422ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f642c0cd9e0 0x7f642c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34006/0 (socket says 172.21.15.7:34006) 2023-10-14T19:08:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f6422ffd700 1 -- 172.21.15.7:0/4170254462 learned_addr learned my addr 172.21.15.7:0/4170254462 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:15.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642bfff700 1 --2- 172.21.15.7:0/4170254462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c15a5d0 0x7f642c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642b7fe700 1 -- 172.21.15.7:0/4170254462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c15a5d0 msgr2=0x7f642c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:15.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642b7fe700 1 --2- 172.21.15.7:0/4170254462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c15a5d0 0x7f642c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642b7fe700 1 -- 172.21.15.7:0/4170254462 >> v1:172.21.15.7:6789/0 conn(0x7f642c0cd9e0 legacy=0x7f642c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642b7fe700 1 -- 172.21.15.7:0/4170254462 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0ccf00 con 0x7f642c0cb5a0 2023-10-14T19:08:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642affd700 1 -- 172.21.15.7:0/4170254462 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067332674 0 0) 0x7f642c15ae40 con 0x7f642c0cd9e0 2023-10-14T19:08:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642b7fe700 1 --2- 172.21.15.7:0/4170254462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c0cb5a0 0x7f642c0cb970 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f641c009910 tx=0x7f641c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6925e182c75aab52 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642affd700 1 -- 172.21.15.7:0/4170254462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00b820 con 0x7f642c0cb5a0 2023-10-14T19:08:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642affd700 1 -- 172.21.15.7:0/4170254462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00b980 con 0x7f642c0cb5a0 2023-10-14T19:08:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.163+0000 7f642affd700 1 -- 172.21.15.7:0/4170254462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00bd20 con 0x7f642c0cb5a0 2023-10-14T19:08:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 -- 172.21.15.7:0/4170254462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c0cb5a0 msgr2=0x7f642c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 --2- 172.21.15.7:0/4170254462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c0cb5a0 0x7f642c0cb970 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f641c009910 tx=0x7f641c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 -- 172.21.15.7:0/4170254462 shutdown_connections 2023-10-14T19:08:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 --2- 172.21.15.7:0/4170254462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c0cb5a0 0x7f642c0cb970 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 --2- 172.21.15.7:0/4170254462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c15a5d0 0x7f642c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 -- 172.21.15.7:0/4170254462 >> 172.21.15.7:0/4170254462 conn(0x7f642c070e30 msgr2=0x7f642c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 -- 172.21.15.7:0/4170254462 shutdown_connections 2023-10-14T19:08:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.164+0000 7f6431df4700 1 -- 172.21.15.7:0/4170254462 wait complete. 2023-10-14T19:08:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.165+0000 7f6431df4700 1 Processor -- start 2023-10-14T19:08:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.165+0000 7f6431df4700 1 -- start start 2023-10-14T19:08:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6431df4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f642c0cb5a0 0x7f642c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6431df4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c0cd9e0 0x7f642c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6431df4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 0x7f642c1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6431df4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c152100 con 0x7f642c15a5d0 2023-10-14T19:08:15.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6431df4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c151820 con 0x7f642c0cb5a0 2023-10-14T19:08:15.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6431df4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c0c8640 con 0x7f642c0cd9e0 2023-10-14T19:08:15.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f642bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 0x7f642c1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f642bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 0x7f642c1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55190/0 (socket says 172.21.15.7:55190) 2023-10-14T19:08:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f642bfff700 1 -- 172.21.15.7:0/274811304 learned_addr learned my addr 172.21.15.7:0/274811304 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f6422ffd700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c0cd9e0 0x7f642c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f642b7fe700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f642c0cb5a0 0x7f642c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.166+0000 7f642bfff700 1 -- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c0cd9e0 msgr2=0x7f642c0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f642bfff700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c0cd9e0 0x7f642c0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f642bfff700 1 -- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f642c0cb5a0 msgr2=0x7f642c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f642bfff700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f642c0cb5a0 0x7f642c1512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f642bfff700 1 -- 172.21.15.7:0/274811304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c009420 con 0x7f642c15a5d0 2023-10-14T19:08:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f642b7fe700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f642c0cb5a0 0x7f642c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f642bfff700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 0x7f642c1523e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6424007f20 tx=0x7f6424009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400ebf0 con 0x7f642c15a5d0 2023-10-14T19:08:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642400ed70 con 0x7f642c15a5d0 2023-10-14T19:08:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c0c8920 con 0x7f642c15a5d0 2023-10-14T19:08:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424014670 con 0x7f642c15a5d0 2023-10-14T19:08:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.167+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c1532a0 con 0x7f642c15a5d0 2023-10-14T19:08:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.168+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c04c3c0 con 0x7f642c15a5d0 2023-10-14T19:08:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.168+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f64240149e0 con 0x7f642c15a5d0 2023-10-14T19:08:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.169+0000 7f6423fff700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f640c067170 0x7f640c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.169+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6424084b80 con 0x7f642c15a5d0 2023-10-14T19:08:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.169+0000 7f642b7fe700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f640c067170 0x7f640c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.169+0000 7f642b7fe700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f640c067170 0x7f640c069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f641c0091e0 tx=0x7f641c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.173+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6424051eb0 con 0x7f642c15a5d0 2023-10-14T19:08:15.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.442+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f642c0d11d0 con 0x7f642c15a5d0 2023-10-14T19:08:15.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.442+0000 7f6423fff700 1 -- 172.21.15.7:0/274811304 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f64240554d0 con 0x7f642c15a5d0 2023-10-14T19:08:15.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:15.444 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:15.444 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:08:15.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.445 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:08:15.445 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:08:15.445 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.446 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.446 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:15.446 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:15.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.446 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.447 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:08:15.447 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:08:15.447 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.447 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.448 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:15.448 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:15.448 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.449 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:08:15.449 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:08:15.449 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.449 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.450 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:15.450 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:15.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.450 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:15.452 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:15.452 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.453 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:08:15.453 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:08:15.453 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.453 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.453 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.454 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.454 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:08:15.455 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:08:15.455 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.455 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.455 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.455 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.456 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:08:15.456 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:08:15.456 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.457 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.457 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.457 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.457 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.458 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:08:15.458 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:08:15.458 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.458 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.459 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.459 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.460 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:08:15.460 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:08:15.460 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.460 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.460 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.460 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.461 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:08:15.461 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:08:15.462 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.462 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.462 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.462 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.462 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.463 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:08:15.463 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:08:15.463 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.464 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.464 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.464 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.465 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:08:15.465 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:08:15.465 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.465 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:15.465 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:15.466 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.466 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:08:15.467 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:08:15.467 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.467 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.467 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:08:15.467 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:08:15.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.468 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:08:15.469 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:08:15.469 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.469 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.469 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:08:15.469 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:08:15.470 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:08:15.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.470 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:08:15.471 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:08:15.471 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.471 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.471 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:08:15.471 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:08:15.471 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:08:15.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.472 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:08:15.472 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:08:15.473 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.473 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:15.473 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:08:15.473 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:08:15.473 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:08:15.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.474 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:08:15.474 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:08:15.474 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.475 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:08:15.475 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:15.475 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:15.475 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.476 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:08:15.476 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:08:15.477 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.477 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:08:15.477 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:08:15.477 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:15.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:15.478 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:08:15.478 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:08:15.478 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:15.479 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:08:15.479 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:08:15.479 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:15.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:15.480 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:08:15.480 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:15.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f640c067170 msgr2=0x7f640c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f640c067170 0x7f640c069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f641c0091e0 tx=0x7f641c017000 comp rx=0 tx=0).stop 2023-10-14T19:08:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 msgr2=0x7f642c1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 0x7f642c1523e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6424007f20 tx=0x7f6424009860 comp rx=0 tx=0).stop 2023-10-14T19:08:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 shutdown_connections 2023-10-14T19:08:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f640c067170 0x7f640c069620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f642c0cb5a0 0x7f642c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f642c15a5d0 0x7f642c1523e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 --2- 172.21.15.7:0/274811304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f642c0cd9e0 0x7f642c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 >> 172.21.15.7:0/274811304 conn(0x7f642c070e30 msgr2=0x7f642c0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:15.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.444+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 shutdown_connections 2023-10-14T19:08:15.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.445+0000 7f6431df4700 1 -- 172.21.15.7:0/274811304 wait complete. 2023-10-14T19:08:15.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:15.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.603+0000 7f5f40451700 1 Processor -- start 2023-10-14T19:08:15.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.603+0000 7f5f40451700 1 -- start start 2023-10-14T19:08:15.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f40451700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f380cb5a0 0x7f5f380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f40451700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f380cd9e0 0x7f5f38159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f40451700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3815ae40 con 0x7f5f3815a400 2023-10-14T19:08:15.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f40451700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380d13f0 con 0x7f5f380cd9e0 2023-10-14T19:08:15.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f40451700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3815ab60 con 0x7f5f380cb5a0 2023-10-14T19:08:15.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d9ec700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f380cd9e0 0x7f5f38159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3e9ee700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5f3815a400 0x7f5f38156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34008/0 (socket says 172.21.15.7:34008) 2023-10-14T19:08:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3e9ee700 1 -- 172.21.15.7:0/3180943916 learned_addr learned my addr 172.21.15.7:0/3180943916 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3e1ed700 1 --2- 172.21.15.7:0/3180943916 >> v2:172.21.15.148:3300/0 conn(0x7f5f380cb5a0 0x7f5f380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d9ec700 1 -- 172.21.15.7:0/3180943916 >> v2:172.21.15.148:3300/0 conn(0x7f5f380cb5a0 msgr2=0x7f5f380cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d9ec700 1 --2- 172.21.15.7:0/3180943916 >> v2:172.21.15.148:3300/0 conn(0x7f5f380cb5a0 0x7f5f380cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d9ec700 1 -- 172.21.15.7:0/3180943916 >> v1:172.21.15.7:6789/0 conn(0x7f5f3815a400 legacy=0x7f5f38156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d1eb700 1 -- 172.21.15.7:0/3180943916 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504332665 0 0) 0x7f5f3815ae40 con 0x7f5f3815a400 2023-10-14T19:08:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d9ec700 1 -- 172.21.15.7:0/3180943916 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380ccf00 con 0x7f5f380cd9e0 2023-10-14T19:08:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.604+0000 7f5f3d9ec700 1 --2- 172.21.15.7:0/3180943916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f380cd9e0 0x7f5f38159ec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098e0 tx=0x7f5f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db6327ab28268d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f3d1eb700 1 -- 172.21.15.7:0/3180943916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28009e80 con 0x7f5f380cd9e0 2023-10-14T19:08:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f3d1eb700 1 -- 172.21.15.7:0/3180943916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2800b820 con 0x7f5f380cd9e0 2023-10-14T19:08:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f3d1eb700 1 -- 172.21.15.7:0/3180943916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800bba0 con 0x7f5f380cd9e0 2023-10-14T19:08:15.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 -- 172.21.15.7:0/3180943916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f380cd9e0 msgr2=0x7f5f38159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 --2- 172.21.15.7:0/3180943916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f380cd9e0 0x7f5f38159ec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098e0 tx=0x7f5f280091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 -- 172.21.15.7:0/3180943916 shutdown_connections 2023-10-14T19:08:15.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 --2- 172.21.15.7:0/3180943916 >> v2:172.21.15.148:3300/0 conn(0x7f5f380cb5a0 0x7f5f380cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 --2- 172.21.15.7:0/3180943916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f380cd9e0 0x7f5f38159ec0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 -- 172.21.15.7:0/3180943916 >> 172.21.15.7:0/3180943916 conn(0x7f5f38070e30 msgr2=0x7f5f380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 -- 172.21.15.7:0/3180943916 shutdown_connections 2023-10-14T19:08:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.605+0000 7f5f40451700 1 -- 172.21.15.7:0/3180943916 wait complete. 2023-10-14T19:08:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.606+0000 7f5f40451700 1 Processor -- start 2023-10-14T19:08:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.606+0000 7f5f40451700 1 -- start start 2023-10-14T19:08:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f40451700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f380cb5a0 0x7f5f380b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f40451700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f380cd9e0 0x7f5f38153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f40451700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 0x7f5f3815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f40451700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c8a50 con 0x7f5f3815a400 2023-10-14T19:08:15.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f40451700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c9010 con 0x7f5f380cd9e0 2023-10-14T19:08:15.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f40451700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b6050 con 0x7f5f380cb5a0 2023-10-14T19:08:15.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f3e9ee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 0x7f5f3815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f3e9ee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 0x7f5f3815d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55206/0 (socket says 172.21.15.7:55206) 2023-10-14T19:08:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.607+0000 7f5f3e9ee700 1 -- 172.21.15.7:0/3245039835 learned_addr learned my addr 172.21.15.7:0/3245039835 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3d9ec700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f380cd9e0 0x7f5f38153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3e9ee700 1 -- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f380cb5a0 msgr2=0x7f5f380b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3e9ee700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f380cb5a0 0x7f5f380b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3e9ee700 1 -- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f380cd9e0 msgr2=0x7f5f38153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3e9ee700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f380cd9e0 0x7f5f38153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3e9ee700 1 -- 172.21.15.7:0/3245039835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009420 con 0x7f5f3815a400 2023-10-14T19:08:15.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f3e9ee700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 0x7f5f3815d8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000cc20 tx=0x7f5f300019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30004bb0 con 0x7f5f3815a400 2023-10-14T19:08:15.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30004d10 con 0x7f5f3815a400 2023-10-14T19:08:15.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f380b6330 con 0x7f5f3815a400 2023-10-14T19:08:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000abd0 con 0x7f5f3815a400 2023-10-14T19:08:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.608+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3815b2b0 con 0x7f5f3815a400 2023-10-14T19:08:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.609+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3804c3c0 con 0x7f5f3815a400 2023-10-14T19:08:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.609+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5f300070f0 con 0x7f5f3815a400 2023-10-14T19:08:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.610+0000 7f5f2e7fc700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f1c067170 0x7f5f1c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.610+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5f30084360 con 0x7f5f3815a400 2023-10-14T19:08:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.610+0000 7f5f3e1ed700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f1c067170 0x7f5f1c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.610+0000 7f5f3e1ed700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f1c067170 0x7f5f1c069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009a60 tx=0x7f5f34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.614+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f30051710 con 0x7f5f3815a400 2023-10-14T19:08:15.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.809+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f380cd1e0 con 0x7f5f3815a400 2023-10-14T19:08:15.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.810+0000 7f5f2e7fc700 1 -- 172.21.15.7:0/3245039835 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f5f30018020 con 0x7f5f3815a400 2023-10-14T19:08:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:15.811 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":74,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:15.015769+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f1c067170 msgr2=0x7f5f1c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f1c067170 0x7f5f1c069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009a60 tx=0x7f5f34008040 comp rx=0 tx=0).stop 2023-10-14T19:08:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 msgr2=0x7f5f3815d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 0x7f5f3815d8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000cc20 tx=0x7f5f300019b0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 shutdown_connections 2023-10-14T19:08:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f1c067170 0x7f5f1c069620 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815a400 0x7f5f3815d8f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f380cb5a0 0x7f5f380b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 --2- 172.21.15.7:0/3245039835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f380cd9e0 0x7f5f38153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 >> 172.21.15.7:0/3245039835 conn(0x7f5f38070e30 msgr2=0x7f5f380b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 shutdown_connections 2023-10-14T19:08:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.812+0000 7f5f40451700 1 -- 172.21.15.7:0/3245039835 wait complete. 2023-10-14T19:08:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:08:15.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:08:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.947+0000 7f33517a0700 1 Processor -- start 2023-10-14T19:08:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.947+0000 7f33517a0700 1 -- start start 2023-10-14T19:08:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f33517a0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f334c06d250 0x7f334c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f33517a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c0ceac0 0x7f334c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f33517a0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334c0ac840 con 0x7f334c157420 2023-10-14T19:08:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f33517a0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334c0abf50 con 0x7f334c06d250 2023-10-14T19:08:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f33517a0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334c0aea60 con 0x7f334c0ceac0 2023-10-14T19:08:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f334b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f334c06d250 0x7f334c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f334bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f334c157420 0x7f334c0b13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34020/0 (socket says 172.21.15.7:34020) 2023-10-14T19:08:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.948+0000 7f334bfff700 1 -- 172.21.15.7:0/3418887522 learned_addr learned my addr 172.21.15.7:0/3418887522 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334b7fe700 1 -- 172.21.15.7:0/3418887522 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c0ceac0 msgr2=0x7f334c0af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f3350f9f700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c0ceac0 0x7f334c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334b7fe700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c0ceac0 0x7f334c0af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334b7fe700 1 -- 172.21.15.7:0/3418887522 >> v1:172.21.15.7:6789/0 conn(0x7f334c157420 legacy=0x7f334c0b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334b7fe700 1 -- 172.21.15.7:0/3418887522 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0ac1f0 con 0x7f334c06d250 2023-10-14T19:08:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334affd700 1 -- 172.21.15.7:0/3418887522 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585804489 0 0) 0x7f334c0ac840 con 0x7f334c157420 2023-10-14T19:08:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f3350f9f700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c0ceac0 0x7f334c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334b7fe700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c06d250 0x7f334c0aefa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f33400098e0 tx=0x7f33400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ec6285d6bfc85f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334affd700 1 -- 172.21.15.7:0/3418887522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340009e80 con 0x7f334c06d250 2023-10-14T19:08:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334affd700 1 -- 172.21.15.7:0/3418887522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000b860 con 0x7f334c06d250 2023-10-14T19:08:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f334affd700 1 -- 172.21.15.7:0/3418887522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000bbe0 con 0x7f334c06d250 2023-10-14T19:08:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f33517a0700 1 -- 172.21.15.7:0/3418887522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c06d250 msgr2=0x7f334c0aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f33517a0700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c06d250 0x7f334c0aefa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f33400098e0 tx=0x7f33400091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f33517a0700 1 -- 172.21.15.7:0/3418887522 shutdown_connections 2023-10-14T19:08:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f33517a0700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c0ceac0 0x7f334c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f33517a0700 1 --2- 172.21.15.7:0/3418887522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c06d250 0x7f334c0aefa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.949+0000 7f33517a0700 1 -- 172.21.15.7:0/3418887522 >> 172.21.15.7:0/3418887522 conn(0x7f334c06ce80 msgr2=0x7f334c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.950+0000 7f33517a0700 1 -- 172.21.15.7:0/3418887522 shutdown_connections 2023-10-14T19:08:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.950+0000 7f33517a0700 1 -- 172.21.15.7:0/3418887522 wait complete. 2023-10-14T19:08:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.951+0000 7f33517a0700 1 Processor -- start 2023-10-14T19:08:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.951+0000 7f33517a0700 1 -- start start 2023-10-14T19:08:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c06d250 0x7f334c144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 0x7f334c09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f334c157420 0x7f334c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c098a10 con 0x7f334c0ceac0 2023-10-14T19:08:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c0980e0 con 0x7f334c157420 2023-10-14T19:08:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334c0983c0 con 0x7f334c06d250 2023-10-14T19:08:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 0x7f334c09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 0x7f334c09b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55218/0 (socket says 172.21.15.7:55218) 2023-10-14T19:08:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 -- 172.21.15.7:0/1116054975 learned_addr learned my addr 172.21.15.7:0/1116054975 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334bfff700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c06d250 0x7f334c144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f3350f9f700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f334c157420 0x7f334c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 -- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c06d250 msgr2=0x7f334c144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c06d250 0x7f334c144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 -- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f334c157420 msgr2=0x7f334c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f334c157420 0x7f334c1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 -- 172.21.15.7:0/1116054975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340009420 con 0x7f334c0ceac0 2023-10-14T19:08:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334bfff700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c06d250 0x7f334c144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f3350f9f700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f334c157420 0x7f334c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f334b7fe700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 0x7f334c09b800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3340013000 tx=0x7f3340017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000bbe0 con 0x7f334c0ceac0 2023-10-14T19:08:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340011420 con 0x7f334c0ceac0 2023-10-14T19:08:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334c0986a0 con 0x7f334c0ceac0 2023-10-14T19:08:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400117e0 con 0x7f334c0ceac0 2023-10-14T19:08:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.952+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334c154a30 con 0x7f334c0ceac0 2023-10-14T19:08:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.953+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334c098b80 con 0x7f334c0ceac0 2023-10-14T19:08:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.954+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f3340011bd0 con 0x7f334c0ceac0 2023-10-14T19:08:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.954+0000 7f3333fff700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3338067170 0x7f3338069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.954+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3340085f50 con 0x7f334c0ceac0 2023-10-14T19:08:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.954+0000 7f334bfff700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3338067170 0x7f3338069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.955+0000 7f334bfff700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3338067170 0x7f3338069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f333c0018d0 tx=0x7f333c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:15.959+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3340053280 con 0x7f334c0ceac0 2023-10-14T19:08:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.151+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f334c04c3c0 con 0x7f334c0ceac0 2023-10-14T19:08:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.152+0000 7f3333fff700 1 -- 172.21.15.7:0/1116054975 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33400568a0 con 0x7f334c0ceac0 2023-10-14T19:08:16.153 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:08:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3338067170 msgr2=0x7f3338069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3338067170 0x7f3338069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f333c0018d0 tx=0x7f333c009040 comp rx=0 tx=0).stop 2023-10-14T19:08:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 msgr2=0x7f334c09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 0x7f334c09b800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3340013000 tx=0x7f3340017000 comp rx=0 tx=0).stop 2023-10-14T19:08:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 shutdown_connections 2023-10-14T19:08:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3338067170 0x7f3338069620 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f334c157420 0x7f334c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f334c06d250 0x7f334c144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 --2- 172.21.15.7:0/1116054975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c0ceac0 0x7f334c09b800 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 >> 172.21.15.7:0/1116054975 conn(0x7f334c06ce80 msgr2=0x7f334c150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 shutdown_connections 2023-10-14T19:08:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.154+0000 7f33517a0700 1 -- 172.21.15.7:0/1116054975 wait complete. 2023-10-14T19:08:16.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:08:16.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.286+0000 7f614503b700 1 Processor -- start 2023-10-14T19:08:16.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.286+0000 7f614503b700 1 -- start start 2023-10-14T19:08:16.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.286+0000 7f614503b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f614015a5d0 0x7f6140156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.286+0000 7f614503b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614015ae40 con 0x7f61400cb5a0 2023-10-14T19:08:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.286+0000 7f614503b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614015ab60 con 0x7f61400cb970 2023-10-14T19:08:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.286+0000 7f614503b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61400ce0f0 con 0x7f614015a5d0 2023-10-14T19:08:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613ed9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61400cb5a0 0x7f61400cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34028/0 (socket says 172.21.15.7:34028) 2023-10-14T19:08:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613ed9d700 1 -- 172.21.15.7:0/4006694380 learned_addr learned my addr 172.21.15.7:0/4006694380 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:16.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613f59e700 1 --2- 172.21.15.7:0/4006694380 >> v2:172.21.15.148:3300/0 conn(0x7f614015a5d0 0x7f6140156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291486761 0 0) 0x7f614015ae40 con 0x7f61400cb5a0 2023-10-14T19:08:16.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f612c003570 con 0x7f61400cb5a0 2023-10-14T19:08:16.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240601318 0 0) 0x7f614015ab60 con 0x7f61400cb970 2023-10-14T19:08:16.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614015ae40 con 0x7f61400cb970 2023-10-14T19:08:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620437136 0 0) 0x7f612c003570 con 0x7f61400cb5a0 2023-10-14T19:08:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 >> v2:172.21.15.148:3300/0 conn(0x7f614015a5d0 msgr2=0x7f6140156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 --2- 172.21.15.7:0/4006694380 >> v2:172.21.15.148:3300/0 conn(0x7f614015a5d0 0x7f6140156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 >> v1:172.21.15.148:6789/0 conn(0x7f61400cb970 legacy=0x7f6140159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400ccf00 con 0x7f61400cb5a0 2023-10-14T19:08:16.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f6130001470 con 0x7f61400cb5a0 2023-10-14T19:08:16.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 >> v1:172.21.15.7:6789/0 conn(0x7f61400cb5a0 legacy=0x7f61400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f612c003bf0 0x7f612c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f612c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f612c0051c0 0x7f612c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61400ce0f0 con 0x7f612c004810 2023-10-14T19:08:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c00c0b0 con 0x7f612c0051c0 2023-10-14T19:08:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c00c270 con 0x7f612c003bf0 2023-10-14T19:08:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613e59c700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f612c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613f59e700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f612c0051c0 0x7f612c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.287+0000 7f613ed9d700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f612c003bf0 0x7f612c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613e59c700 1 -- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f612c003bf0 msgr2=0x7f612c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613e59c700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f612c003bf0 0x7f612c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613e59c700 1 -- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f612c0051c0 msgr2=0x7f612c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613e59c700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f612c0051c0 0x7f612c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613e59c700 1 -- 172.21.15.7:0/4006694380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c003570 con 0x7f612c004810 2023-10-14T19:08:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613f59e700 1 -- 172.21.15.7:0/4006694380 reap_dead start 2023-10-14T19:08:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613e59c700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f612c004c80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6128001a10 tx=0x7f6128007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f5577f52b39788 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800c5d0 con 0x7f612c004810 2023-10-14T19:08:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612800c730 con 0x7f612c004810 2023-10-14T19:08:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f613dd9b700 1 -- 172.21.15.7:0/4006694380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800c8e0 con 0x7f612c004810 2023-10-14T19:08:16.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f614503b700 1 -- 172.21.15.7:0/4006694380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 msgr2=0x7f612c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f614503b700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f612c004c80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6128001a10 tx=0x7f6128007d30 comp rx=0 tx=0).stop 2023-10-14T19:08:16.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f614503b700 1 -- 172.21.15.7:0/4006694380 shutdown_connections 2023-10-14T19:08:16.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.288+0000 7f614503b700 1 --2- 172.21.15.7:0/4006694380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f612c004c80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.289+0000 7f614503b700 1 -- 172.21.15.7:0/4006694380 >> 172.21.15.7:0/4006694380 conn(0x7f6140070e30 msgr2=0x7f61400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:16.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.289+0000 7f614503b700 1 -- 172.21.15.7:0/4006694380 shutdown_connections 2023-10-14T19:08:16.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.289+0000 7f614503b700 1 -- 172.21.15.7:0/4006694380 wait complete. 2023-10-14T19:08:16.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 Processor -- start 2023-10-14T19:08:16.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 -- start start 2023-10-14T19:08:16.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f61400b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61400c7110 0x7f6140150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61400b3e70 0x7f614015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61400b5320 con 0x7f612c004810 2023-10-14T19:08:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.290+0000 7f614503b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401508a0 con 0x7f61400c7110 2023-10-14T19:08:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f614503b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400b4710 con 0x7f61400b3e70 2023-10-14T19:08:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f61400b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f61400b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55230/0 (socket says 172.21.15.7:55230) 2023-10-14T19:08:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 -- 172.21.15.7:0/1915740785 learned_addr learned my addr 172.21.15.7:0/1915740785 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613e59c700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61400c7110 0x7f6140150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613f59e700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61400b3e70 0x7f614015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 -- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61400b3e70 msgr2=0x7f614015edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61400b3e70 0x7f614015edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 -- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61400c7110 msgr2=0x7f6140150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61400c7110 0x7f6140150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 -- 172.21.15.7:0/1915740785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400b49f0 con 0x7f612c004810 2023-10-14T19:08:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f613ed9d700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f61400b57b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f61300073c0 tx=0x7f6130001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130001040 con 0x7f612c004810 2023-10-14T19:08:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613000f640 con 0x7f612c004810 2023-10-14T19:08:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61400b4cd0 con 0x7f612c004810 2023-10-14T19:08:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000fa00 con 0x7f612c004810 2023-10-14T19:08:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.291+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61400b4310 con 0x7f612c004810 2023-10-14T19:08:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.292+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614004c3c0 con 0x7f612c004810 2023-10-14T19:08:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.293+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f613001d460 con 0x7f612c004810 2023-10-14T19:08:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.293+0000 7f6136ffd700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6120067170 0x7f6120069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.293+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f61300844e0 con 0x7f612c004810 2023-10-14T19:08:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.293+0000 7f613e59c700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6120067170 0x7f6120069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.294+0000 7f613e59c700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6120067170 0x7f6120069620 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6140160510 tx=0x7f6128015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.297+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61300518c0 con 0x7f612c004810 2023-10-14T19:08:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.493+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f61400b05b0 con 0x7f612c004810 2023-10-14T19:08:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.493+0000 7f6136ffd700 1 -- 172.21.15.7:0/1915740785 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6130084020 con 0x7f612c004810 2023-10-14T19:08:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:16.495 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:08:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:08:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:08:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:16.497 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:08:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6120067170 msgr2=0x7f6120069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6120067170 0x7f6120069620 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6140160510 tx=0x7f6128015000 comp rx=0 tx=0).stop 2023-10-14T19:08:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 msgr2=0x7f61400b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f61400b57b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f61300073c0 tx=0x7f6130001df0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 shutdown_connections 2023-10-14T19:08:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6120067170 0x7f6120069620 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61400b3e70 0x7f614015edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612c004810 0x7f61400b57b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 --2- 172.21.15.7:0/1915740785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61400c7110 0x7f6140150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 >> 172.21.15.7:0/1915740785 conn(0x7f6140070e30 msgr2=0x7f61400d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 shutdown_connections 2023-10-14T19:08:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.495+0000 7f614503b700 1 -- 172.21.15.7:0/1915740785 wait complete. 2023-10-14T19:08:16.509 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:08:16.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:08:16.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.633+0000 7f6d115ed700 1 Processor -- start 2023-10-14T19:08:16.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.633+0000 7f6d115ed700 1 -- start start 2023-10-14T19:08:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d115ed700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6d0c159850 0x7f6d0c0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d115ed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 0x7f6d0c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d115ed700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c0aa860 con 0x7f6d0c06dac0 2023-10-14T19:08:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d115ed700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c0a9c50 con 0x7f6d0c159850 2023-10-14T19:08:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d115ed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0a9f30 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 0x7f6d0c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 0x7f6d0c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:55048/0 (socket says 172.21.15.7:55048) 2023-10-14T19:08:16.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6d0c159850 0x7f6d0c0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/954817502 learned_addr learned my addr 172.21.15.7:0/954817502 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:16.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0b7fe700 1 --1- 172.21.15.7:0/954817502 >> v1:172.21.15.148:6789/0 conn(0x7f6d0c06dac0 0x7f6d0c0ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:58040/0 (socket says 172.21.15.7:58040) 2023-10-14T19:08:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/954817502 >> v2:172.21.15.148:3300/0 conn(0x7f6d0c159850 msgr2=0x7f6d0c0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 --2- 172.21.15.7:0/954817502 >> v2:172.21.15.148:3300/0 conn(0x7f6d0c159850 0x7f6d0c0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/954817502 >> v1:172.21.15.148:6789/0 conn(0x7f6d0c06dac0 legacy=0x7f6d0c0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.634+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/954817502 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0aa210 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d0a7fc700 1 --2- 172.21.15.7:0/954817502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 0x7f6d0c06d580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40099b0 tx=0x7f6cf4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b9e3e21b593160 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d09ffb700 1 -- 172.21.15.7:0/954817502 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4009ea0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d09ffb700 1 -- 172.21.15.7:0/954817502 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400b860 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d09ffb700 1 -- 172.21.15.7:0/954817502 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400bc00 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 -- 172.21.15.7:0/954817502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 msgr2=0x7f6d0c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 --2- 172.21.15.7:0/954817502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 0x7f6d0c06d580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40099b0 tx=0x7f6cf4009250 comp rx=0 tx=0).stop 2023-10-14T19:08:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 -- 172.21.15.7:0/954817502 shutdown_connections 2023-10-14T19:08:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 --2- 172.21.15.7:0/954817502 >> v2:172.21.15.148:3300/0 conn(0x7f6d0c159850 0x7f6d0c0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 --2- 172.21.15.7:0/954817502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c0c76c0 0x7f6d0c06d580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 -- 172.21.15.7:0/954817502 >> 172.21.15.7:0/954817502 conn(0x7f6d0c06edb0 msgr2=0x7f6d0c06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 -- 172.21.15.7:0/954817502 shutdown_connections 2023-10-14T19:08:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.635+0000 7f6d115ed700 1 -- 172.21.15.7:0/954817502 wait complete. 2023-10-14T19:08:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 Processor -- start 2023-10-14T19:08:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 -- start start 2023-10-14T19:08:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 0x7f6d0c16a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 0x7f6d0c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c159850 0x7f6d0c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c15c820 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c16a5d0 con 0x7f6d0c159850 2023-10-14T19:08:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.637+0000 7f6d115ed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c15a100 con 0x7f6d0c06dac0 2023-10-14T19:08:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 0x7f6d0c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 0x7f6d0c16a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 0x7f6d0c157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44174/0 (socket says 172.21.15.7:44174) 2023-10-14T19:08:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 0x7f6d0c16a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:34302/0 (socket says 172.21.15.7:34302) 2023-10-14T19:08:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/3083182838 learned_addr learned my addr 172.21.15.7:0/3083182838 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0b7fe700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c159850 0x7f6d0c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 msgr2=0x7f6d0c16a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 0x7f6d0c16a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c159850 msgr2=0x7f6d0c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c159850 0x7f6d0c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 -- 172.21.15.7:0/3083182838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40094f0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0affd700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 0x7f6d0c16a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d0a7fc700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 0x7f6d0c157060 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0aa070 tx=0x7f6cf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4000d10 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400bbe0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c15a3e0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011670 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.638+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c15aa20 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.639+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c04c3c0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.640+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6cf4011aa0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.640+0000 7f6d02ffd700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cec067170 0x7f6cec069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.640+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6cf4085cc0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.641+0000 7f6d0affd700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cec067170 0x7f6cec069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.641+0000 7f6d0affd700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cec067170 0x7f6cec069620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0113e0 tx=0x7f6cfc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:16.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.645+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cf4052ff0 con 0x7f6d0c0c76c0 2023-10-14T19:08:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:16.838+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6d0c0aa4f0 con 0x7f6d0c0c76c0 2023-10-14T19:08:17.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.821+0000 7f6d02ffd700 1 -- 172.21.15.7:0/3083182838 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6cf4056610 con 0x7f6d0c0c76c0 2023-10-14T19:08:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.825+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cec067170 msgr2=0x7f6cec069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.825+0000 7f6d115ed700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cec067170 0x7f6cec069620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0113e0 tx=0x7f6cfc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.825+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 msgr2=0x7f6d0c157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.825+0000 7f6d115ed700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 0x7f6d0c157060 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0aa070 tx=0x7f6cf4017000 comp rx=0 tx=0).stop 2023-10-14T19:08:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 shutdown_connections 2023-10-14T19:08:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6cec067170 0x7f6cec069620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c159850 0x7f6d0c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6d0c06dac0 0x7f6d0c16a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 --2- 172.21.15.7:0/3083182838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c0c76c0 0x7f6d0c157060 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 >> 172.21.15.7:0/3083182838 conn(0x7f6d0c06edb0 msgr2=0x7f6d0c0ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.826+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 shutdown_connections 2023-10-14T19:08:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.827+0000 7f6d115ed700 1 -- 172.21.15.7:0/3083182838 wait complete. 2023-10-14T19:08:17.832 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:08:17.845 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:08:17.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 Processor -- start 2023-10-14T19:08:17.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 -- start start 2023-10-14T19:08:17.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4ef8159860 0x7f4ef80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:17.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ef80cbd90 0x7f4ef80cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:17.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80cf510 con 0x7f4ef80ccfa0 2023-10-14T19:08:17.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80cc210 con 0x7f4ef80cbd90 2023-10-14T19:08:17.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.981+0000 7f4efec0e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80ce900 con 0x7f4ef8159860 2023-10-14T19:08:17.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ef80cbd90 0x7f4ef80cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ef80cbd90 0x7f4ef80cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44178/0 (socket says 172.21.15.7:44178) 2023-10-14T19:08:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 -- 172.21.15.7:0/3738984823 learned_addr learned my addr 172.21.15.7:0/3738984823 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 -- 172.21.15.7:0/3738984823 >> v2:172.21.15.148:3300/0 conn(0x7f4ef8159860 msgr2=0x7f4ef80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4efc9aa700 1 --2- 172.21.15.7:0/3738984823 >> v2:172.21.15.148:3300/0 conn(0x7f4ef8159860 0x7f4ef80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 --2- 172.21.15.7:0/3738984823 >> v2:172.21.15.148:3300/0 conn(0x7f4ef8159860 0x7f4ef80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 -- 172.21.15.7:0/3738984823 >> v1:172.21.15.148:6789/0 conn(0x7f4ef80ccfa0 legacy=0x7f4ef80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 -- 172.21.15.7:0/3738984823 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80cebe0 con 0x7f4ef80cbd90 2023-10-14T19:08:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4efc9aa700 1 --2- 172.21.15.7:0/3738984823 >> v2:172.21.15.148:3300/0 conn(0x7f4ef8159860 0x7f4ef80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:17.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef7fff700 1 --2- 172.21.15.7:0/3738984823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef80cf9a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8088e40 tx=0x7f4ee4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fe1e628301edbb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:17.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef77fe700 1 -- 172.21.15.7:0/3738984823 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4005c10 con 0x7f4ef80cbd90 2023-10-14T19:08:17.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef77fe700 1 -- 172.21.15.7:0/3738984823 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4005d70 con 0x7f4ef80cbd90 2023-10-14T19:08:17.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.982+0000 7f4ef77fe700 1 -- 172.21.15.7:0/3738984823 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400b840 con 0x7f4ef80cbd90 2023-10-14T19:08:17.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 -- 172.21.15.7:0/3738984823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 msgr2=0x7f4ef80cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3738984823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef80cf9a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8088e40 tx=0x7f4ee4009220 comp rx=0 tx=0).stop 2023-10-14T19:08:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 -- 172.21.15.7:0/3738984823 shutdown_connections 2023-10-14T19:08:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3738984823 >> v2:172.21.15.148:3300/0 conn(0x7f4ef8159860 0x7f4ef80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3738984823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef80cf9a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 -- 172.21.15.7:0/3738984823 >> 172.21.15.7:0/3738984823 conn(0x7f4ef80999b0 msgr2=0x7f4ef8070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 -- 172.21.15.7:0/3738984823 shutdown_connections 2023-10-14T19:08:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.983+0000 7f4efec0e700 1 -- 172.21.15.7:0/3738984823 wait complete. 2023-10-14T19:08:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.984+0000 7f4efec0e700 1 Processor -- start 2023-10-14T19:08:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.984+0000 7f4efec0e700 1 -- start start 2023-10-14T19:08:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efec0e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef8158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efec0e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ef80ccfa0 0x7f4ef80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efec0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8159860 0x7f4ef80c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efec0e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815abc0 con 0x7f4ef80cbd90 2023-10-14T19:08:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efec0e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef81591c0 con 0x7f4ef8159860 2023-10-14T19:08:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efec0e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c87b0 con 0x7f4ef80ccfa0 2023-10-14T19:08:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef8158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef8158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44184/0 (socket says 172.21.15.7:44184) 2023-10-14T19:08:17.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 -- 172.21.15.7:0/3813005676 learned_addr learned my addr 172.21.15.7:0/3813005676 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:17.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efd1ab700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8159860 0x7f4ef80c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4ef7fff700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ef80ccfa0 0x7f4ef80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 -- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ef80ccfa0 msgr2=0x7f4ef80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ef80ccfa0 0x7f4ef80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 -- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8159860 msgr2=0x7f4ef80c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8159860 0x7f4ef80c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 -- 172.21.15.7:0/3813005676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009480 con 0x7f4ef80cbd90 2023-10-14T19:08:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efd1ab700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8159860 0x7f4ef80c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:17.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.985+0000 7f4efc9aa700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef8158c80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c880 tx=0x7f4eec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.986+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec005a00 con 0x7f4ef80cbd90 2023-10-14T19:08:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.986+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec005b60 con 0x7f4ef80cbd90 2023-10-14T19:08:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.986+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80c7c40 con 0x7f4ef80cbd90 2023-10-14T19:08:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.986+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec011600 con 0x7f4ef80cbd90 2023-10-14T19:08:17.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.986+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80c81f0 con 0x7f4ef80cbd90 2023-10-14T19:08:17.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.986+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef815a990 con 0x7f4ef80cbd90 2023-10-14T19:08:17.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.987+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f4eec0119f0 con 0x7f4ef80cbd90 2023-10-14T19:08:17.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.987+0000 7f4ef4ff9700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4edc067170 0x7f4edc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:17.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.988+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4eec0845c0 con 0x7f4ef80cbd90 2023-10-14T19:08:17.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.988+0000 7f4ef7fff700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4edc067170 0x7f4edc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.988+0000 7f4ef7fff700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4edc067170 0x7f4edc069620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4003080 tx=0x7f4ee4015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:18.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:17.992+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ef815a990 con 0x7f4ef80cbd90 2023-10-14T19:08:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.187+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4ef815a990 con 0x7f4ef80cbd90 2023-10-14T19:08:18.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:18.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.825+0000 7f4ef4ff9700 1 -- 172.21.15.7:0/3813005676 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4ef815a990 con 0x7f4ef80cbd90 2023-10-14T19:08:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4edc067170 msgr2=0x7f4edc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4edc067170 0x7f4edc069620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4003080 tx=0x7f4ee4015000 comp rx=0 tx=0).stop 2023-10-14T19:08:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 msgr2=0x7f4ef8158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef8158c80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c880 tx=0x7f4eec008040 comp rx=0 tx=0).stop 2023-10-14T19:08:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 shutdown_connections 2023-10-14T19:08:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4edc067170 0x7f4edc069620 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4003080 tx=0x7f4ee4015000 comp rx=0 tx=0).stop 2023-10-14T19:08:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8159860 0x7f4ef80c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80cbd90 0x7f4ef8158c80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 --2- 172.21.15.7:0/3813005676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ef80ccfa0 0x7f4ef80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.830+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 >> 172.21.15.7:0/3813005676 conn(0x7f4ef80999b0 msgr2=0x7f4ef80b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.831+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 shutdown_connections 2023-10-14T19:08:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.832+0000 7f4efec0e700 1 -- 172.21.15.7:0/3813005676 wait complete. 2023-10-14T19:08:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:08:18.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:08:18.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.976+0000 7f965f4b1700 1 Processor -- start 2023-10-14T19:08:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.977+0000 7f965f4b1700 1 -- start start 2023-10-14T19:08:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.977+0000 7f965f4b1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9658159530 0x7f96580ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.977+0000 7f965f4b1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f965806e0e0 0x7f96580cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.977+0000 7f965f4b1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96580ccfd0 con 0x7f965806dc70 2023-10-14T19:08:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.977+0000 7f965f4b1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96580cf0e0 con 0x7f965806e0e0 2023-10-14T19:08:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.977+0000 7f965f4b1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965815a3d0 con 0x7f9658159530 2023-10-14T19:08:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f965806e0e0 0x7f96580cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f965806e0e0 0x7f96580cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44190/0 (socket says 172.21.15.7:44190) 2023-10-14T19:08:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 -- 172.21.15.7:0/947564783 learned_addr learned my addr 172.21.15.7:0/947564783 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965d24d700 1 --2- 172.21.15.7:0/947564783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9658159530 0x7f96580ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 -- 172.21.15.7:0/947564783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9658159530 msgr2=0x7f96580ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 --2- 172.21.15.7:0/947564783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9658159530 0x7f96580ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 -- 172.21.15.7:0/947564783 >> v1:172.21.15.148:6789/0 conn(0x7f965806dc70 legacy=0x7f9658159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 -- 172.21.15.7:0/947564783 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965815a6b0 con 0x7f965806e0e0 2023-10-14T19:08:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f965da4e700 1 --2- 172.21.15.7:0/947564783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f96580cb6f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9648009f20 tx=0x7f9648009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ae5cf813fb14bc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f9657fff700 1 -- 172.21.15.7:0/947564783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800e070 con 0x7f965806e0e0 2023-10-14T19:08:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f9657fff700 1 -- 172.21.15.7:0/947564783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964800ba40 con 0x7f965806e0e0 2023-10-14T19:08:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.978+0000 7f9657fff700 1 -- 172.21.15.7:0/947564783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480092e0 con 0x7f965806e0e0 2023-10-14T19:08:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 -- 172.21.15.7:0/947564783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 msgr2=0x7f96580cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 --2- 172.21.15.7:0/947564783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f96580cb6f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9648009f20 tx=0x7f9648009840 comp rx=0 tx=0).stop 2023-10-14T19:08:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 -- 172.21.15.7:0/947564783 shutdown_connections 2023-10-14T19:08:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 --2- 172.21.15.7:0/947564783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f96580cb6f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 --2- 172.21.15.7:0/947564783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9658159530 0x7f96580ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 -- 172.21.15.7:0/947564783 >> 172.21.15.7:0/947564783 conn(0x7f96580703a0 msgr2=0x7f96580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 -- 172.21.15.7:0/947564783 shutdown_connections 2023-10-14T19:08:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.979+0000 7f965f4b1700 1 -- 172.21.15.7:0/947564783 wait complete. 2023-10-14T19:08:18.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.980+0000 7f965f4b1700 1 Processor -- start 2023-10-14T19:08:18.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.980+0000 7f965f4b1700 1 -- start start 2023-10-14T19:08:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965f4b1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965806dc70 0x7f96580c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965f4b1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f965816a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965f4b1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658159530 0x7f965814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965f4b1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96581429f0 con 0x7f965806e0e0 2023-10-14T19:08:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965f4b1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96580caa90 con 0x7f9658159530 2023-10-14T19:08:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965f4b1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965816aad0 con 0x7f965806dc70 2023-10-14T19:08:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f965816a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f965816a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44202/0 (socket says 172.21.15.7:44202) 2023-10-14T19:08:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 -- 172.21.15.7:0/3237445870 learned_addr learned my addr 172.21.15.7:0/3237445870 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965d24d700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965806dc70 0x7f96580c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965da4e700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658159530 0x7f965814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 -- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965806dc70 msgr2=0x7f96580c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965806dc70 0x7f96580c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 -- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658159530 msgr2=0x7f965814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:18.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658159530 0x7f965814fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:18.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 -- 172.21.15.7:0/3237445870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648009ae0 con 0x7f965806e0e0 2023-10-14T19:08:18.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.981+0000 7f965ca4c700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f965816a590 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f964c00c5d0 tx=0x7f964c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:18.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.982+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c011590 con 0x7f965806e0e0 2023-10-14T19:08:18.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.982+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c011710 con 0x7f965806e0e0 2023-10-14T19:08:18.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.982+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96580c7c70 con 0x7f965806e0e0 2023-10-14T19:08:18.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.982+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c011ad0 con 0x7f965806e0e0 2023-10-14T19:08:18.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.982+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96580c8230 con 0x7f965806e0e0 2023-10-14T19:08:18.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.982+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965804c3c0 con 0x7f965806e0e0 2023-10-14T19:08:18.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.983+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f964c01c460 con 0x7f965806e0e0 2023-10-14T19:08:18.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.983+0000 7f96557fa700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9644067170 0x7f9644069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:18.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.984+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f964c0844b0 con 0x7f965806e0e0 2023-10-14T19:08:18.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.984+0000 7f965d24d700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9644067170 0x7f9644069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:18.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.984+0000 7f965d24d700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9644067170 0x7f9644069620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:18.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:18.988+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f964c0514f0 con 0x7f965806e0e0 2023-10-14T19:08:19.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.224+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f965815a990 con 0x7f965806e0e0 2023-10-14T19:08:19.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.843+0000 7f96557fa700 1 -- 172.21.15.7:0/3237445870 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f964c054b10 con 0x7f965806e0e0 2023-10-14T19:08:19.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.848+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9644067170 msgr2=0x7f9644069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.848+0000 7f965f4b1700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9644067170 0x7f9644069620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).stop 2023-10-14T19:08:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.848+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 msgr2=0x7f965816a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.848+0000 7f965f4b1700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f965816a590 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f964c00c5d0 tx=0x7f964c007f60 comp rx=0 tx=0).stop 2023-10-14T19:08:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.849+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 shutdown_connections 2023-10-14T19:08:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.849+0000 7f965f4b1700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9644067170 0x7f9644069620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.849+0000 7f965f4b1700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658159530 0x7f965814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.849+0000 7f965f4b1700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965806dc70 0x7f96580c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.849+0000 7f965f4b1700 1 --2- 172.21.15.7:0/3237445870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965806e0e0 0x7f965816a590 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:19.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.849+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 >> 172.21.15.7:0/3237445870 conn(0x7f96580703a0 msgr2=0x7f96580cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:19.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.851+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 shutdown_connections 2023-10-14T19:08:19.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.851+0000 7f965f4b1700 1 -- 172.21.15.7:0/3237445870 wait complete. 2023-10-14T19:08:19.858 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 12 and data pool 13 2023-10-14T19:08:19.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.988+0000 7fd5b6e18700 1 Processor -- start 2023-10-14T19:08:19.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.988+0000 7fd5b6e18700 1 -- start start 2023-10-14T19:08:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b6e18700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5b00d0780 0x7fd5b00d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b6e18700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b00ced70 con 0x7fd5b01599e0 2023-10-14T19:08:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b6e18700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b00cf050 con 0x7fd5b00ce7b0 2023-10-14T19:08:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b6e18700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b00cf330 con 0x7fd5b00d0780 2023-10-14T19:08:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b4bb4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5b00d0780 0x7fd5b00d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b53b5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd5b01599e0 0x7fd5b00b0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37648/0 (socket says 172.21.15.7:37648) 2023-10-14T19:08:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.989+0000 7fd5b53b5700 1 -- 172.21.15.7:0/3684750387 learned_addr learned my addr 172.21.15.7:0/3684750387 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5af7fe700 1 -- 172.21.15.7:0/3684750387 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960567864 0 0) 0x7fd5b00ced70 con 0x7fd5b01599e0 2023-10-14T19:08:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5af7fe700 1 -- 172.21.15.7:0/3684750387 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd59c003570 con 0x7fd5b01599e0 2023-10-14T19:08:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5b4bb4700 1 -- 172.21.15.7:0/3684750387 >> v1:172.21.15.148:6789/0 conn(0x7fd5b00ce7b0 legacy=0x7fd5b01592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5b4bb4700 1 -- 172.21.15.7:0/3684750387 >> v1:172.21.15.7:6789/0 conn(0x7fd5b01599e0 legacy=0x7fd5b00b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5b4bb4700 1 -- 172.21.15.7:0/3684750387 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00cf610 con 0x7fd5b00d0780 2023-10-14T19:08:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5b4bb4700 1 --2- 172.21.15.7:0/3684750387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b00d0b50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80098e0 tx=0x7fd5a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22025e3d8ae95c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5af7fe700 1 -- 172.21.15.7:0/3684750387 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800b640 con 0x7fd5b00d0780 2023-10-14T19:08:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5af7fe700 1 -- 172.21.15.7:0/3684750387 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800b7a0 con 0x7fd5b00d0780 2023-10-14T19:08:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5af7fe700 1 -- 172.21.15.7:0/3684750387 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800bb40 con 0x7fd5b00d0780 2023-10-14T19:08:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5b6e18700 1 -- 172.21.15.7:0/3684750387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 msgr2=0x7fd5b00d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.990+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/3684750387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b00d0b50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80098e0 tx=0x7fd5a80091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.991+0000 7fd5b6e18700 1 -- 172.21.15.7:0/3684750387 shutdown_connections 2023-10-14T19:08:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.991+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/3684750387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b00d0b50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.991+0000 7fd5b6e18700 1 -- 172.21.15.7:0/3684750387 >> 172.21.15.7:0/3684750387 conn(0x7fd5b00703a0 msgr2=0x7fd5b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.991+0000 7fd5b6e18700 1 -- 172.21.15.7:0/3684750387 shutdown_connections 2023-10-14T19:08:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.991+0000 7fd5b6e18700 1 -- 172.21.15.7:0/3684750387 wait complete. 2023-10-14T19:08:19.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.992+0000 7fd5b6e18700 1 Processor -- start 2023-10-14T19:08:19.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.992+0000 7fd5b6e18700 1 -- start start 2023-10-14T19:08:20.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5b00ce7b0 0x7fd5b00c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b0151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5b01599e0 0x7fd5b015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00ca080 con 0x7fd5b00d0780 2023-10-14T19:08:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b015b500 con 0x7fd5b00ce7b0 2023-10-14T19:08:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0151f40 con 0x7fd5b01599e0 2023-10-14T19:08:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b0151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b0151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44212/0 (socket says 172.21.15.7:44212) 2023-10-14T19:08:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 -- 172.21.15.7:0/2765364564 learned_addr learned my addr 172.21.15.7:0/2765364564 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b4bb4700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5b00ce7b0 0x7fd5b00c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b53b5700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5b01599e0 0x7fd5b015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 -- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5b01599e0 msgr2=0x7fd5b015e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5b01599e0 0x7fd5b015e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 -- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5b00ce7b0 msgr2=0x7fd5b00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5b00ce7b0 0x7fd5b00c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 -- 172.21.15.7:0/2765364564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009420 con 0x7fd5b00d0780 2023-10-14T19:08:20.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b53b5700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5b01599e0 0x7fd5b015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:20.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5affff700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b0151a00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000cb10 tx=0x7fd5a00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00020c0 con 0x7fd5b00d0780 2023-10-14T19:08:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a000a7e0 con 0x7fd5b00d0780 2023-10-14T19:08:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b016d380 con 0x7fd5b00d0780 2023-10-14T19:08:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.993+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a000ab80 con 0x7fd5b00d0780 2023-10-14T19:08:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.994+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b016d940 con 0x7fd5b00d0780 2023-10-14T19:08:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.995+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b004c3c0 con 0x7fd5b00d0780 2023-10-14T19:08:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.995+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd5a0003030 con 0x7fd5b00d0780 2023-10-14T19:08:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.995+0000 7fd5acff9700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd590067170 0x7fd590069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.996+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5a0084850 con 0x7fd5b00d0780 2023-10-14T19:08:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.996+0000 7fd5b4bb4700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd590067170 0x7fd590069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:19.996+0000 7fd5b4bb4700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd590067170 0x7fd590069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80093f0 tx=0x7fd5a8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.000+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5a0051830 con 0x7fd5b00d0780 2023-10-14T19:08:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.193+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5b00cf8f0 con 0x7fd5b00d0780 2023-10-14T19:08:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.194+0000 7fd5acff9700 1 -- 172.21.15.7:0/2765364564 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fd5a0054e50 con 0x7fd5b00d0780 2023-10-14T19:08:20.195 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:20.196 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:19.226373+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:16.869015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:18.218167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd590067170 msgr2=0x7fd590069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd590067170 0x7fd590069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80093f0 tx=0x7fd5a8017000 comp rx=0 tx=0).stop 2023-10-14T19:08:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 msgr2=0x7fd5b0151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b0151a00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000cb10 tx=0x7fd5a00017b0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 shutdown_connections 2023-10-14T19:08:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd590067170 0x7fd590069620 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5b00ce7b0 0x7fd5b00c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5b01599e0 0x7fd5b015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 --2- 172.21.15.7:0/2765364564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b00d0780 0x7fd5b0151a00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 >> 172.21.15.7:0/2765364564 conn(0x7fd5b00703a0 msgr2=0x7fd5b015d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 shutdown_connections 2023-10-14T19:08:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.196+0000 7fd5b6e18700 1 -- 172.21.15.7:0/2765364564 wait complete. 2023-10-14T19:08:20.209 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:20.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.328+0000 7f7229745700 1 Processor -- start 2023-10-14T19:08:20.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.328+0000 7f7229745700 1 -- start start 2023-10-14T19:08:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7229745700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72240cb5a0 0x7f72240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7229745700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722415ae40 con 0x7f72240cd9e0 2023-10-14T19:08:20.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7229745700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722415ab60 con 0x7f722415a5d0 2023-10-14T19:08:20.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7229745700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72240d13f0 con 0x7f72240cb5a0 2023-10-14T19:08:20.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7222ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72240cb5a0 0x7f72240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f72227fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72240cd9e0 0x7f7224159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37658/0 (socket says 172.21.15.7:37658) 2023-10-14T19:08:20.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f72227fc700 1 -- 172.21.15.7:0/2677952932 learned_addr learned my addr 172.21.15.7:0/2677952932 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:20.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7222ffd700 1 -- 172.21.15.7:0/2677952932 >> v1:172.21.15.148:6789/0 conn(0x7f722415a5d0 legacy=0x7f7224156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7222ffd700 1 -- 172.21.15.7:0/2677952932 >> v1:172.21.15.7:6789/0 conn(0x7f72240cd9e0 legacy=0x7f7224159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7222ffd700 1 -- 172.21.15.7:0/2677952932 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240ccf00 con 0x7f72240cb5a0 2023-10-14T19:08:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7221ffb700 1 -- 172.21.15.7:0/2677952932 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960162559 0 0) 0x7f722415ae40 con 0x7f72240cd9e0 2023-10-14T19:08:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7222ffd700 1 --2- 172.21.15.7:0/2677952932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f72240cb970 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7214009910 tx=0x7f72140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f43879317e60cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7221ffb700 1 -- 172.21.15.7:0/2677952932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400b7e0 con 0x7f72240cb5a0 2023-10-14T19:08:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7221ffb700 1 -- 172.21.15.7:0/2677952932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400b940 con 0x7f72240cb5a0 2023-10-14T19:08:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.329+0000 7f7221ffb700 1 -- 172.21.15.7:0/2677952932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400bce0 con 0x7f72240cb5a0 2023-10-14T19:08:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 -- 172.21.15.7:0/2677952932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 msgr2=0x7f72240cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 --2- 172.21.15.7:0/2677952932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f72240cb970 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7214009910 tx=0x7f72140091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 -- 172.21.15.7:0/2677952932 shutdown_connections 2023-10-14T19:08:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 --2- 172.21.15.7:0/2677952932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f72240cb970 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 -- 172.21.15.7:0/2677952932 >> 172.21.15.7:0/2677952932 conn(0x7f7224070e30 msgr2=0x7f72240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 -- 172.21.15.7:0/2677952932 shutdown_connections 2023-10-14T19:08:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.330+0000 7f7229745700 1 -- 172.21.15.7:0/2677952932 wait complete. 2023-10-14T19:08:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.331+0000 7f7229745700 1 Processor -- start 2023-10-14T19:08:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.331+0000 7f7229745700 1 -- start start 2023-10-14T19:08:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7229745700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f7224152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7229745700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72240cd9e0 0x7f72241593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7229745700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f722415a5d0 0x7f7224155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7229745700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224158120 con 0x7f72240cb5a0 2023-10-14T19:08:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7229745700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224158f40 con 0x7f72240cd9e0 2023-10-14T19:08:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7229745700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7224158330 con 0x7f722415a5d0 2023-10-14T19:08:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f7224152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f7224152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44222/0 (socket says 172.21.15.7:44222) 2023-10-14T19:08:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 -- 172.21.15.7:0/3212170098 learned_addr learned my addr 172.21.15.7:0/3212170098 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f72227fc700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72240cd9e0 0x7f72241593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 -- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f722415a5d0 msgr2=0x7f7224155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f72237fe700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f722415a5d0 0x7f7224155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f722415a5d0 0x7f7224155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 -- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72240cd9e0 msgr2=0x7f72241593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72240cd9e0 0x7f72241593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f7222ffd700 1 -- 172.21.15.7:0/3212170098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009420 con 0x7f72240cb5a0 2023-10-14T19:08:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f72227fc700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72240cd9e0 0x7f72241593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.332+0000 7f72237fe700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f722415a5d0 0x7f7224155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.333+0000 7f7222ffd700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f7224152820 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f72140030c0 tx=0x7f7214016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.333+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214011dd0 con 0x7f72240cb5a0 2023-10-14T19:08:20.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.333+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214020070 con 0x7f72240cb5a0 2023-10-14T19:08:20.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.333+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721401b6a0 con 0x7f72240cb5a0 2023-10-14T19:08:20.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.333+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7224158610 con 0x7f72240cb5a0 2023-10-14T19:08:20.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.333+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7224158bd0 con 0x7f72240cb5a0 2023-10-14T19:08:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.334+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7224159220 con 0x7f72240cb5a0 2023-10-14T19:08:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.334+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7214022030 con 0x7f72240cb5a0 2023-10-14T19:08:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.335+0000 7f720affd700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7210067170 0x7f7210069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.335+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7214086910 con 0x7f72240cb5a0 2023-10-14T19:08:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.335+0000 7f72227fc700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7210067170 0x7f7210069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.335+0000 7f72227fc700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7210067170 0x7f7210069620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f72240b6640 tx=0x7f7218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.339+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72140538f0 con 0x7f72240cb5a0 2023-10-14T19:08:20.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.531+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7224159220 con 0x7f72240cb5a0 2023-10-14T19:08:20.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.532+0000 7f720affd700 1 -- 172.21.15.7:0/3212170098 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f7214056f10 con 0x7f72240cb5a0 2023-10-14T19:08:20.533 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:20.534 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:19.226373+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:16.869015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:18.218167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:20.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.534+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7210067170 msgr2=0x7f7210069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.534+0000 7f7229745700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7210067170 0x7f7210069620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f72240b6640 tx=0x7f7218009040 comp rx=0 tx=0).stop 2023-10-14T19:08:20.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.534+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 msgr2=0x7f7224152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.534+0000 7f7229745700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f7224152820 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f72140030c0 tx=0x7f7214016000 comp rx=0 tx=0).stop 2023-10-14T19:08:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 shutdown_connections 2023-10-14T19:08:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7210067170 0x7f7210069620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f722415a5d0 0x7f7224155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72240cb5a0 0x7f7224152820 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 --2- 172.21.15.7:0/3212170098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72240cd9e0 0x7f72241593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 >> 172.21.15.7:0/3212170098 conn(0x7f7224070e30 msgr2=0x7f72240b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 shutdown_connections 2023-10-14T19:08:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.535+0000 7f7229745700 1 -- 172.21.15.7:0/3212170098 wait complete. 2023-10-14T19:08:20.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:08:20.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.669+0000 7fc1950cf700 1 Processor -- start 2023-10-14T19:08:20.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.669+0000 7fc1950cf700 1 -- start start 2023-10-14T19:08:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc1950cf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc190159530 0x7fc1900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc1950cf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006dc70 0x7fc190159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc1950cf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc19006e0e0 0x7fc1900cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc1950cf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900ccfd0 con 0x7fc19006e0e0 2023-10-14T19:08:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc1950cf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900cf0e0 con 0x7fc190159530 2023-10-14T19:08:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc1950cf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015a3d0 con 0x7fc19006dc70 2023-10-14T19:08:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc18f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc19006e0e0 0x7fc1900cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc18f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc19006e0e0 0x7fc1900cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44226/0 (socket says 172.21.15.7:44226) 2023-10-14T19:08:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc18f59e700 1 -- 172.21.15.7:0/2272557483 learned_addr learned my addr 172.21.15.7:0/2272557483 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:20.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc18ed9d700 1 --2- 172.21.15.7:0/2272557483 >> v2:172.21.15.148:3300/0 conn(0x7fc190159530 0x7fc1900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.670+0000 7fc18e59c700 1 --2- 172.21.15.7:0/2272557483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006dc70 0x7fc190159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18f59e700 1 -- 172.21.15.7:0/2272557483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006dc70 msgr2=0x7fc190159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:20.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18f59e700 1 --2- 172.21.15.7:0/2272557483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006dc70 0x7fc190159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18f59e700 1 -- 172.21.15.7:0/2272557483 >> v2:172.21.15.148:3300/0 conn(0x7fc190159530 msgr2=0x7fc1900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:20.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18f59e700 1 --2- 172.21.15.7:0/2272557483 >> v2:172.21.15.148:3300/0 conn(0x7fc190159530 0x7fc1900ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18f59e700 1 -- 172.21.15.7:0/2272557483 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19015a6b0 con 0x7fc19006e0e0 2023-10-14T19:08:20.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18ed9d700 1 --2- 172.21.15.7:0/2272557483 >> v2:172.21.15.148:3300/0 conn(0x7fc190159530 0x7fc1900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:20.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18f59e700 1 --2- 172.21.15.7:0/2272557483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc19006e0e0 0x7fc1900cb6f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc19006d630 tx=0x7fc188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3888098e74376bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18dd9b700 1 -- 172.21.15.7:0/2272557483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800b860 con 0x7fc19006e0e0 2023-10-14T19:08:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18dd9b700 1 -- 172.21.15.7:0/2272557483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18800b9c0 con 0x7fc19006e0e0 2023-10-14T19:08:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc18dd9b700 1 -- 172.21.15.7:0/2272557483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800bd60 con 0x7fc19006e0e0 2023-10-14T19:08:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 -- 172.21.15.7:0/2272557483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc19006e0e0 msgr2=0x7fc1900cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 --2- 172.21.15.7:0/2272557483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc19006e0e0 0x7fc1900cb6f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc19006d630 tx=0x7fc188009250 comp rx=0 tx=0).stop 2023-10-14T19:08:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 -- 172.21.15.7:0/2272557483 shutdown_connections 2023-10-14T19:08:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 --2- 172.21.15.7:0/2272557483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc19006e0e0 0x7fc1900cb6f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 --2- 172.21.15.7:0/2272557483 >> v2:172.21.15.148:3300/0 conn(0x7fc190159530 0x7fc1900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 --2- 172.21.15.7:0/2272557483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006dc70 0x7fc190159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.671+0000 7fc1950cf700 1 -- 172.21.15.7:0/2272557483 >> 172.21.15.7:0/2272557483 conn(0x7fc1900703a0 msgr2=0x7fc1900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.672+0000 7fc1950cf700 1 -- 172.21.15.7:0/2272557483 shutdown_connections 2023-10-14T19:08:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.672+0000 7fc1950cf700 1 -- 172.21.15.7:0/2272557483 wait complete. 2023-10-14T19:08:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 Processor -- start 2023-10-14T19:08:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 -- start start 2023-10-14T19:08:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc19006dc70 0x7fc19015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006e0e0 0x7fc1900c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 0x7fc190147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b4b40 con 0x7fc190159530 2023-10-14T19:08:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b3f30 con 0x7fc19006dc70 2023-10-14T19:08:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.673+0000 7fc1950cf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b4210 con 0x7fc19006e0e0 2023-10-14T19:08:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 0x7fc190147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 0x7fc190147270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44234/0 (socket says 172.21.15.7:44234) 2023-10-14T19:08:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 -- 172.21.15.7:0/1894365720 learned_addr learned my addr 172.21.15.7:0/1894365720 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18e59c700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006e0e0 0x7fc1900c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18ed9d700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc19006dc70 0x7fc19015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 -- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006e0e0 msgr2=0x7fc1900c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006e0e0 0x7fc1900c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 -- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc19006dc70 msgr2=0x7fc19015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc19006dc70 0x7fc19015c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 -- 172.21.15.7:0/1894365720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880094f0 con 0x7fc190159530 2023-10-14T19:08:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc18f59e700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 0x7fc190147270 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc1880090b0 tx=0x7fc188017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18801a640 con 0x7fc190159530 2023-10-14T19:08:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18801f070 con 0x7fc190159530 2023-10-14T19:08:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1900b44f0 con 0x7fc190159530 2023-10-14T19:08:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18801aa10 con 0x7fc190159530 2023-10-14T19:08:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.674+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1901477b0 con 0x7fc190159530 2023-10-14T19:08:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.675+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1900b4990 con 0x7fc190159530 2023-10-14T19:08:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.676+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc18801b430 con 0x7fc190159530 2023-10-14T19:08:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.676+0000 7fc186ffd700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc170067170 0x7fc170069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.676+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc188021070 con 0x7fc190159530 2023-10-14T19:08:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.676+0000 7fc18ed9d700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc170067170 0x7fc170069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.677+0000 7fc18ed9d700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc170067170 0x7fc170069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc180007600 tx=0x7fc180009850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.681+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc188053990 con 0x7fc190159530 2023-10-14T19:08:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:20.921+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc1900c86b0 con 0x7fc190159530 2023-10-14T19:08:21.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.851+0000 7fc186ffd700 1 -- 172.21.15.7:0/1894365720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc1900c86b0 con 0x7fc190159530 2023-10-14T19:08:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc170067170 msgr2=0x7fc170069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc170067170 0x7fc170069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc180007600 tx=0x7fc180009850 comp rx=0 tx=0).stop 2023-10-14T19:08:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 msgr2=0x7fc190147270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 0x7fc190147270 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc1880090b0 tx=0x7fc188017000 comp rx=0 tx=0).stop 2023-10-14T19:08:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 shutdown_connections 2023-10-14T19:08:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc170067170 0x7fc170069620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc19006dc70 0x7fc19015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc190159530 0x7fc190147270 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 --2- 172.21.15.7:0/1894365720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc19006e0e0 0x7fc1900c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 >> 172.21.15.7:0/1894365720 conn(0x7fc1900703a0 msgr2=0x7fc1900c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 shutdown_connections 2023-10-14T19:08:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:21.854+0000 7fc1950cf700 1 -- 172.21.15.7:0/1894365720 wait complete. 2023-10-14T19:08:21.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:08:22.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.000+0000 7f1447d2b700 1 Processor -- start 2023-10-14T19:08:22.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.000+0000 7f1447d2b700 1 -- start start 2023-10-14T19:08:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1447d2b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f144013c9b0 0x7f1440069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1447d2b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14400cc6f0 0x7f1440069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1447d2b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144006d7b0 con 0x7f14400cc320 2023-10-14T19:08:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1447d2b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144006f7d0 con 0x7f14400cc6f0 2023-10-14T19:08:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1447d2b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144006e330 con 0x7f144013c9b0 2023-10-14T19:08:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f14462c8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14400cc6f0 0x7f1440069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1445ac7700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14400cc320 0x7f144013c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37670/0 (socket says 172.21.15.7:37670) 2023-10-14T19:08:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f1445ac7700 1 -- 172.21.15.7:0/3805600552 learned_addr learned my addr 172.21.15.7:0/3805600552 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f14452c6700 1 --2- 172.21.15.7:0/3805600552 >> v2:172.21.15.148:3300/0 conn(0x7f144013c9b0 0x7f1440069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f14462c8700 1 -- 172.21.15.7:0/3805600552 >> v2:172.21.15.148:3300/0 conn(0x7f144013c9b0 msgr2=0x7f1440069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:22.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f14462c8700 1 --2- 172.21.15.7:0/3805600552 >> v2:172.21.15.148:3300/0 conn(0x7f144013c9b0 0x7f1440069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.001+0000 7f14462c8700 1 -- 172.21.15.7:0/3805600552 >> v1:172.21.15.7:6789/0 conn(0x7f14400cc320 legacy=0x7f144013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:22.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f14462c8700 1 -- 172.21.15.7:0/3805600552 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144006da00 con 0x7f14400cc6f0 2023-10-14T19:08:22.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1444ac5700 1 -- 172.21.15.7:0/3805600552 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650437460 0 0) 0x7f144006d7b0 con 0x7f14400cc320 2023-10-14T19:08:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f14462c8700 1 --2- 172.21.15.7:0/3805600552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc6f0 0x7f1440069f40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f14400647f0 tx=0x7f1430009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbed506342bf789 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1444ac5700 1 -- 172.21.15.7:0/3805600552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000e070 con 0x7f14400cc6f0 2023-10-14T19:08:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1444ac5700 1 -- 172.21.15.7:0/3805600552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000bc30 con 0x7f14400cc6f0 2023-10-14T19:08:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1444ac5700 1 -- 172.21.15.7:0/3805600552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430012430 con 0x7f14400cc6f0 2023-10-14T19:08:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 -- 172.21.15.7:0/3805600552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc6f0 msgr2=0x7f1440069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 --2- 172.21.15.7:0/3805600552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc6f0 0x7f1440069f40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f14400647f0 tx=0x7f1430009780 comp rx=0 tx=0).stop 2023-10-14T19:08:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 -- 172.21.15.7:0/3805600552 shutdown_connections 2023-10-14T19:08:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 --2- 172.21.15.7:0/3805600552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc6f0 0x7f1440069f40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 --2- 172.21.15.7:0/3805600552 >> v2:172.21.15.148:3300/0 conn(0x7f144013c9b0 0x7f1440069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 -- 172.21.15.7:0/3805600552 >> 172.21.15.7:0/3805600552 conn(0x7f1440067f00 msgr2=0x7f1440068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 -- 172.21.15.7:0/3805600552 shutdown_connections 2023-10-14T19:08:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.002+0000 7f1447d2b700 1 -- 172.21.15.7:0/3805600552 wait complete. 2023-10-14T19:08:22.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 Processor -- start 2023-10-14T19:08:22.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 -- start start 2023-10-14T19:08:22.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 0x7f144016a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14400cc6f0 0x7f14400c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f144013c9b0 0x7f14400b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c7960 con 0x7f14400cc320 2023-10-14T19:08:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c7c00 con 0x7f144013c9b0 2023-10-14T19:08:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1447d2b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c7ee0 con 0x7f14400cc6f0 2023-10-14T19:08:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1445ac7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 0x7f144016a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1445ac7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 0x7f144016a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44252/0 (socket says 172.21.15.7:44252) 2023-10-14T19:08:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.004+0000 7f1445ac7700 1 -- 172.21.15.7:0/115739873 learned_addr learned my addr 172.21.15.7:0/115739873 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f14462c8700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f144013c9b0 0x7f14400b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f14452c6700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14400cc6f0 0x7f14400c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1445ac7700 1 -- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14400cc6f0 msgr2=0x7f14400c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1445ac7700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14400cc6f0 0x7f14400c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1445ac7700 1 -- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f144013c9b0 msgr2=0x7f14400b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1445ac7700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f144013c9b0 0x7f14400b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1445ac7700 1 -- 172.21.15.7:0/115739873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009a20 con 0x7f14400cc320 2023-10-14T19:08:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1445ac7700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 0x7f144016a5a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f143800c7e0 tx=0x7f1438007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438005b30 con 0x7f14400cc320 2023-10-14T19:08:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438005c90 con 0x7f14400cc320 2023-10-14T19:08:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400c81c0 con 0x7f14400cc320 2023-10-14T19:08:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438007300 con 0x7f14400cc320 2023-10-14T19:08:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.005+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400b09d0 con 0x7f14400cc320 2023-10-14T19:08:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.006+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144004c3c0 con 0x7f14400cc320 2023-10-14T19:08:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.007+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f143801b3b0 con 0x7f14400cc320 2023-10-14T19:08:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.007+0000 7f143dffb700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f142c067170 0x7f142c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.007+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1438083e20 con 0x7f14400cc320 2023-10-14T19:08:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.007+0000 7f14452c6700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f142c067170 0x7f142c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.008+0000 7f14452c6700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f142c067170 0x7f142c069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1440153560 tx=0x7f1434008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.012+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1438050d30 con 0x7f14400cc320 2023-10-14T19:08:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.252+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1440139910 con 0x7f14400cc320 2023-10-14T19:08:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.857+0000 7f143dffb700 1 -- 172.21.15.7:0/115739873 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f14380170c0 con 0x7f14400cc320 2023-10-14T19:08:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f142c067170 msgr2=0x7f142c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f142c067170 0x7f142c069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1440153560 tx=0x7f1434008040 comp rx=0 tx=0).stop 2023-10-14T19:08:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 msgr2=0x7f144016a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 0x7f144016a5a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f143800c7e0 tx=0x7f1438007df0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 shutdown_connections 2023-10-14T19:08:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f142c067170 0x7f142c069620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.859+0000 7f1447d2b700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f144013c9b0 0x7f14400b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.860+0000 7f1447d2b700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14400cc320 0x7f144016a5a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.860+0000 7f1447d2b700 1 --2- 172.21.15.7:0/115739873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14400cc6f0 0x7f14400c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.860+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 >> 172.21.15.7:0/115739873 conn(0x7f1440067f00 msgr2=0x7f14400b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.860+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 shutdown_connections 2023-10-14T19:08:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.860+0000 7f1447d2b700 1 -- 172.21.15.7:0/115739873 wait complete. 2023-10-14T19:08:22.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.996+0000 7f2155aaf700 1 Processor -- start 2023-10-14T19:08:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.996+0000 7f2155aaf700 1 -- start start 2023-10-14T19:08:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f2155aaf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f215015a5d0 0x7f2150156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f2155aaf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215015ae40 con 0x7f21500cb970 2023-10-14T19:08:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f2155aaf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215015ab60 con 0x7f21500cb5a0 2023-10-14T19:08:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f2155aaf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500ce0f0 con 0x7f215015a5d0 2023-10-14T19:08:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f215015a5d0 0x7f2150156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f215015a5d0 0x7f2150156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44260/0 (socket says 172.21.15.7:44260) 2023-10-14T19:08:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 -- 172.21.15.7:0/1294893633 learned_addr learned my addr 172.21.15.7:0/1294893633 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214effd700 1 --1- 172.21.15.7:0/1294893633 >> v1:172.21.15.7:6789/0 conn(0x7f21500cb970 0x7f2150159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37686/0 (socket says 172.21.15.7:37686) 2023-10-14T19:08:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 -- 172.21.15.7:0/1294893633 >> v1:172.21.15.148:6789/0 conn(0x7f21500cb5a0 legacy=0x7f21500cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 -- 172.21.15.7:0/1294893633 >> v1:172.21.15.7:6789/0 conn(0x7f21500cb970 legacy=0x7f2150159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 -- 172.21.15.7:0/1294893633 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500ccf00 con 0x7f215015a5d0 2023-10-14T19:08:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214e7fc700 1 -- 172.21.15.7:0/1294893633 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755196835 0 0) 0x7f215015ae40 con 0x7f21500cb970 2023-10-14T19:08:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.997+0000 7f214ffff700 1 --2- 172.21.15.7:0/1294893633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f215015a5d0 0x7f2150156e90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2148009f20 tx=0x7f2148009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e7c7bf8e377986 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f214e7fc700 1 -- 172.21.15.7:0/1294893633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800e070 con 0x7f215015a5d0 2023-10-14T19:08:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f214e7fc700 1 -- 172.21.15.7:0/1294893633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214800ba80 con 0x7f215015a5d0 2023-10-14T19:08:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f214e7fc700 1 -- 172.21.15.7:0/1294893633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21480092e0 con 0x7f215015a5d0 2023-10-14T19:08:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 -- 172.21.15.7:0/1294893633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f215015a5d0 msgr2=0x7f2150156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 --2- 172.21.15.7:0/1294893633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f215015a5d0 0x7f2150156e90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2148009f20 tx=0x7f2148009840 comp rx=0 tx=0).stop 2023-10-14T19:08:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 -- 172.21.15.7:0/1294893633 shutdown_connections 2023-10-14T19:08:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 --2- 172.21.15.7:0/1294893633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f215015a5d0 0x7f2150156e90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 -- 172.21.15.7:0/1294893633 >> 172.21.15.7:0/1294893633 conn(0x7f2150070e30 msgr2=0x7f21500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 -- 172.21.15.7:0/1294893633 shutdown_connections 2023-10-14T19:08:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.998+0000 7f2155aaf700 1 -- 172.21.15.7:0/1294893633 wait complete. 2023-10-14T19:08:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:22.999+0000 7f2155aaf700 1 Processor -- start 2023-10-14T19:08:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 -- start start 2023-10-14T19:08:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 0x7f21500ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21500cb970 0x7f2150151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f215015a5d0 0x7f21500b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b46f0 con 0x7f21500cb5a0 2023-10-14T19:08:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21500c9f10 con 0x7f21500cb970 2023-10-14T19:08:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f2155aaf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500c95e0 con 0x7f215015a5d0 2023-10-14T19:08:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f214f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 0x7f21500ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f214f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 0x7f21500ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44264/0 (socket says 172.21.15.7:44264) 2023-10-14T19:08:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.000+0000 7f214f7fe700 1 -- 172.21.15.7:0/2561491880 learned_addr learned my addr 172.21.15.7:0/2561491880 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214f7fe700 1 -- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f215015a5d0 msgr2=0x7f21500b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214f7fe700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f215015a5d0 0x7f21500b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214effd700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21500cb970 0x7f2150151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214f7fe700 1 -- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21500cb970 msgr2=0x7f2150151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214f7fe700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21500cb970 0x7f2150151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214f7fe700 1 -- 172.21.15.7:0/2561491880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2148009ae0 con 0x7f21500cb5a0 2023-10-14T19:08:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214effd700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21500cb970 0x7f2150151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f214f7fe700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 0x7f21500ca3a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f214000c590 tx=0x7f214000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140011590 con 0x7f21500cb5a0 2023-10-14T19:08:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400116f0 con 0x7f21500cb5a0 2023-10-14T19:08:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140011ab0 con 0x7f21500cb5a0 2023-10-14T19:08:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21500c98c0 con 0x7f21500cb5a0 2023-10-14T19:08:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.001+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2150151880 con 0x7f21500cb5a0 2023-10-14T19:08:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.002+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215004c3c0 con 0x7f21500cb5a0 2023-10-14T19:08:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.002+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f214001b3b0 con 0x7f21500cb5a0 2023-10-14T19:08:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.003+0000 7f21377fe700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f213c067170 0x7f213c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.003+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2140083e90 con 0x7f21500cb5a0 2023-10-14T19:08:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.003+0000 7f214effd700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f213c067170 0x7f213c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.004+0000 7f214effd700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f213c067170 0x7f213c069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f215016d380 tx=0x7f2144009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.007+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2140050e70 con 0x7f21500cb5a0 2023-10-14T19:08:23.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.247+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21500afa90 con 0x7f21500cb5a0 2023-10-14T19:08:23.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.247+0000 7f21377fe700 1 -- 172.21.15.7:0/2561491880 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f2140017020 con 0x7f21500cb5a0 2023-10-14T19:08:23.249 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:23.249 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:19.226680+0000","modified":"2023-10-14T19:08:22.851427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/491623181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":491623181},{"type":"v1","addr":"172.21.15.7:6834","nonce":491623181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T19:08:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f213c067170 msgr2=0x7f213c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f213c067170 0x7f213c069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f215016d380 tx=0x7f2144009040 comp rx=0 tx=0).stop 2023-10-14T19:08:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 msgr2=0x7f21500ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 0x7f21500ca3a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f214000c590 tx=0x7f214000c950 comp rx=0 tx=0).stop 2023-10-14T19:08:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 shutdown_connections 2023-10-14T19:08:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f213c067170 0x7f213c069620 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f215015a5d0 0x7f21500b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21500cb5a0 0x7f21500ca3a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 --2- 172.21.15.7:0/2561491880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21500cb970 0x7f2150151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.249+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 >> 172.21.15.7:0/2561491880 conn(0x7f2150070e30 msgr2=0x7f21500c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.250+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 shutdown_connections 2023-10-14T19:08:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.250+0000 7f2155aaf700 1 -- 172.21.15.7:0/2561491880 wait complete. 2023-10-14T19:08:23.254 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 48 2023-10-14T19:08:23.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.382+0000 7f919a5f2700 1 Processor -- start 2023-10-14T19:08:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.382+0000 7f919a5f2700 1 -- start start 2023-10-14T19:08:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f919a5f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9194159850 0x7f91940adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f919a5f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 0x7f91940ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f919a5f2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91940adb20 con 0x7f91940b0930 2023-10-14T19:08:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f919a5f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91940ccdc0 con 0x7f9194159850 2023-10-14T19:08:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f919a5f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91940acf10 con 0x7f9194159c20 2023-10-14T19:08:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9198b8f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f91940b0930 0x7f91940c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37702/0 (socket says 172.21.15.7:37702) 2023-10-14T19:08:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9198b8f700 1 -- 172.21.15.7:0/3218427941 learned_addr learned my addr 172.21.15.7:0/3218427941 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9193fff700 1 --2- 172.21.15.7:0/3218427941 >> v2:172.21.15.148:3300/0 conn(0x7f9194159850 0x7f91940adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f91937fe700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 0x7f91940ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894554007 0 0) 0x7f91940adb20 con 0x7f91940b0930 2023-10-14T19:08:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f917c003570 con 0x7f91940b0930 2023-10-14T19:08:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 518865659 0 0) 0x7f917c003570 con 0x7f91940b0930 2023-10-14T19:08:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 msgr2=0x7f91940ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 0x7f91940ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 >> v2:172.21.15.148:3300/0 conn(0x7f9194159850 msgr2=0x7f91940adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 --2- 172.21.15.7:0/3218427941 >> v2:172.21.15.148:3300/0 conn(0x7f9194159850 0x7f91940adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940ad1f0 con 0x7f91940b0930 2023-10-14T19:08:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f918c0017f0 con 0x7f91940b0930 2023-10-14T19:08:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 >> v1:172.21.15.7:6789/0 conn(0x7f91940b0930 legacy=0x7f91940c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 0x7f917c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c003fe0 0x7f917c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c004d50 0x7f917c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91940ccdc0 con 0x7f917c003fe0 2023-10-14T19:08:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91940acf10 con 0x7f917c004d50 2023-10-14T19:08:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.383+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c00ba90 con 0x7f9194159c20 2023-10-14T19:08:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c003fe0 0x7f917c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f9193fff700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 0x7f917c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f9198b8f700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c004d50 0x7f917c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 -- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 msgr2=0x7f917c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9194159c20 0x7f917c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 -- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c004d50 msgr2=0x7f917c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c004d50 0x7f917c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 -- 172.21.15.7:0/3218427941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c003570 con 0x7f917c003fe0 2023-10-14T19:08:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f91937fe700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c003fe0 0x7f917c004810 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9188009c00 tx=0x7f9188008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2744814be7f7ef8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880118d0 con 0x7f917c003fe0 2023-10-14T19:08:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188011a30 con 0x7f917c003fe0 2023-10-14T19:08:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.384+0000 7f9192ffd700 1 -- 172.21.15.7:0/3218427941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188011df0 con 0x7f917c003fe0 2023-10-14T19:08:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f919a5f2700 1 -- 172.21.15.7:0/3218427941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c003fe0 msgr2=0x7f917c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f919a5f2700 1 --2- 172.21.15.7:0/3218427941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917c003fe0 0x7f917c004810 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9188009c00 tx=0x7f9188008040 comp rx=0 tx=0).stop 2023-10-14T19:08:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f9198b8f700 1 -- 172.21.15.7:0/3218427941 reap_dead start 2023-10-14T19:08:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f919a5f2700 1 -- 172.21.15.7:0/3218427941 shutdown_connections 2023-10-14T19:08:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f919a5f2700 1 -- 172.21.15.7:0/3218427941 >> 172.21.15.7:0/3218427941 conn(0x7f919406d170 msgr2=0x7f91940cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f919a5f2700 1 -- 172.21.15.7:0/3218427941 shutdown_connections 2023-10-14T19:08:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.385+0000 7f919a5f2700 1 -- 172.21.15.7:0/3218427941 wait complete. 2023-10-14T19:08:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.386+0000 7f919a5f2700 1 Processor -- start 2023-10-14T19:08:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.386+0000 7f919a5f2700 1 -- start start 2023-10-14T19:08:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c003fe0 0x7f91940a6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9194141110 0x7f91940abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 0x7f9194157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194154400 con 0x7f91940ac0d0 2023-10-14T19:08:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194167310 con 0x7f9194141110 2023-10-14T19:08:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91941675f0 con 0x7f917c003fe0 2023-10-14T19:08:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 0x7f9194157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 0x7f9194157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44288/0 (socket says 172.21.15.7:44288) 2023-10-14T19:08:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 -- 172.21.15.7:0/1307889665 learned_addr learned my addr 172.21.15.7:0/1307889665 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f91937fe700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9194141110 0x7f91940abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9193fff700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c003fe0 0x7f91940a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 -- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c003fe0 msgr2=0x7f91940a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c003fe0 0x7f91940a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 -- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9194141110 msgr2=0x7f91940abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9194141110 0x7f91940abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 -- 172.21.15.7:0/1307889665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940ab390 con 0x7f91940ac0d0 2023-10-14T19:08:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f9198b8f700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 0x7f9194157500 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f918c000f80 tx=0x7f918c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00acd0 con 0x7f91940ac0d0 2023-10-14T19:08:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c00ae70 con 0x7f91940ac0d0 2023-10-14T19:08:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91940ab670 con 0x7f91940ac0d0 2023-10-14T19:08:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c013620 con 0x7f91940ac0d0 2023-10-14T19:08:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.387+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91940a6b90 con 0x7f91940ac0d0 2023-10-14T19:08:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.388+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91940ab860 con 0x7f91940ac0d0 2023-10-14T19:08:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.389+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f918c013990 con 0x7f91940ac0d0 2023-10-14T19:08:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.389+0000 7f917bfff700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9180067170 0x7f9180069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.389+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f918c0851e0 con 0x7f91940ac0d0 2023-10-14T19:08:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.389+0000 7f9193fff700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9180067170 0x7f9180069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.390+0000 7f9193fff700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9180067170 0x7f9180069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9184006f00 tx=0x7f91840091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.393+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f918c0521c0 con 0x7f91940ac0d0 2023-10-14T19:08:23.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.588+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f919404c3c0 con 0x7f91940ac0d0 2023-10-14T19:08:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.589+0000 7f917bfff700 1 -- 172.21.15.7:0/1307889665 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f918c0557e0 con 0x7f91940ac0d0 2023-10-14T19:08:23.590 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:23.591 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:20.826897+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:16.869015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:18.218167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9180067170 msgr2=0x7f9180069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9180067170 0x7f9180069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9184006f00 tx=0x7f91840091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 msgr2=0x7f9194157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 0x7f9194157500 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f918c000f80 tx=0x7f918c002210 comp rx=0 tx=0).stop 2023-10-14T19:08:23.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 shutdown_connections 2023-10-14T19:08:23.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9180067170 0x7f9180069620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91940ac0d0 0x7f9194157500 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c003fe0 0x7f91940a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 --2- 172.21.15.7:0/1307889665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9194141110 0x7f91940abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 >> 172.21.15.7:0/1307889665 conn(0x7f919406d170 msgr2=0x7f91940b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:23.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 shutdown_connections 2023-10-14T19:08:23.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.591+0000 7f919a5f2700 1 -- 172.21.15.7:0/1307889665 wait complete. 2023-10-14T19:08:23.605 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:08:23.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:08:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.724+0000 7f2c3ad10700 1 Processor -- start 2023-10-14T19:08:23.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.724+0000 7f2c3ad10700 1 -- start start 2023-10-14T19:08:23.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c3ad10700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cb5a0 0x7f2c340cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c3ad10700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c340cd9e0 0x7f2c34159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c3ad10700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2c340cde50 0x7f2c3415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c3ad10700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c340d13f0 con 0x7f2c340cde50 2023-10-14T19:08:23.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c3ad10700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3415a940 con 0x7f2c340cd9e0 2023-10-14T19:08:23.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c3ad10700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3415ae40 con 0x7f2c340cb5a0 2023-10-14T19:08:23.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.725+0000 7f2c392ad700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2c340cde50 0x7f2c3415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2c340cde50 0x7f2c3415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44294/0 (socket says 172.21.15.7:44294) 2023-10-14T19:08:23.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 -- 172.21.15.7:0/1580448367 learned_addr learned my addr 172.21.15.7:0/1580448367 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:23.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c38aac700 1 --2- 172.21.15.7:0/1580448367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cb5a0 0x7f2c340cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c33fff700 1 --2- 172.21.15.7:0/1580448367 >> v2:172.21.15.148:3300/0 conn(0x7f2c340cd9e0 0x7f2c34159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 -- 172.21.15.7:0/1580448367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cb5a0 msgr2=0x7f2c340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:23.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 --2- 172.21.15.7:0/1580448367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cb5a0 0x7f2c340cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 -- 172.21.15.7:0/1580448367 >> v2:172.21.15.148:3300/0 conn(0x7f2c340cd9e0 msgr2=0x7f2c34159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:23.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 --2- 172.21.15.7:0/1580448367 >> v2:172.21.15.148:3300/0 conn(0x7f2c340cd9e0 0x7f2c34159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 -- 172.21.15.7:0/1580448367 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3415ab60 con 0x7f2c340cde50 2023-10-14T19:08:23.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c392ad700 1 --2- 172.21.15.7:0/1580448367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c340cde50 0x7f2c3415a400 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2c3406ea90 tx=0x7f2c1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d523be62e7da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c337fe700 1 -- 172.21.15.7:0/1580448367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00b640 con 0x7f2c340cde50 2023-10-14T19:08:23.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c337fe700 1 -- 172.21.15.7:0/1580448367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c00b7a0 con 0x7f2c340cde50 2023-10-14T19:08:23.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.726+0000 7f2c337fe700 1 -- 172.21.15.7:0/1580448367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00bb40 con 0x7f2c340cde50 2023-10-14T19:08:23.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 -- 172.21.15.7:0/1580448367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c340cde50 msgr2=0x7f2c3415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/1580448367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c340cde50 0x7f2c3415a400 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2c3406ea90 tx=0x7f2c1c009250 comp rx=0 tx=0).stop 2023-10-14T19:08:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 -- 172.21.15.7:0/1580448367 shutdown_connections 2023-10-14T19:08:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/1580448367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c340cde50 0x7f2c3415a400 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/1580448367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cb5a0 0x7f2c340cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/1580448367 >> v2:172.21.15.148:3300/0 conn(0x7f2c340cd9e0 0x7f2c34159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 -- 172.21.15.7:0/1580448367 >> 172.21.15.7:0/1580448367 conn(0x7f2c34070e30 msgr2=0x7f2c340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:23.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 -- 172.21.15.7:0/1580448367 shutdown_connections 2023-10-14T19:08:23.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.727+0000 7f2c3ad10700 1 -- 172.21.15.7:0/1580448367 wait complete. 2023-10-14T19:08:23.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.728+0000 7f2c3ad10700 1 Processor -- start 2023-10-14T19:08:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.728+0000 7f2c3ad10700 1 -- start start 2023-10-14T19:08:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c3ad10700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c340cb5a0 0x7f2c3416a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c3ad10700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cd9e0 0x7f2c34158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c3ad10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 0x7f2c3416bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c3ad10700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34159860 con 0x7f2c341699e0 2023-10-14T19:08:23.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c3ad10700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34156c60 con 0x7f2c340cb5a0 2023-10-14T19:08:23.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c3ad10700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34169e80 con 0x7f2c340cd9e0 2023-10-14T19:08:23.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 0x7f2c3416bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 0x7f2c3416bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44304/0 (socket says 172.21.15.7:44304) 2023-10-14T19:08:23.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 -- 172.21.15.7:0/2203355144 learned_addr learned my addr 172.21.15.7:0/2203355144 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:23.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c38aac700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c340cb5a0 0x7f2c3416a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c33fff700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cd9e0 0x7f2c34158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 -- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cd9e0 msgr2=0x7f2c34158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cd9e0 0x7f2c34158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 -- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c340cb5a0 msgr2=0x7f2c3416a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c340cb5a0 0x7f2c3416a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 -- 172.21.15.7:0/2203355144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0094f0 con 0x7f2c341699e0 2023-10-14T19:08:23.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c33fff700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cd9e0 0x7f2c34158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:23.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.729+0000 7f2c392ad700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 0x7f2c3416bc90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0094c0 tx=0x7f2c1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.730+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00b9e0 con 0x7f2c341699e0 2023-10-14T19:08:23.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.730+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c025420 con 0x7f2c341699e0 2023-10-14T19:08:23.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.730+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c341592a0 con 0x7f2c341699e0 2023-10-14T19:08:23.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.730+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0257e0 con 0x7f2c341699e0 2023-10-14T19:08:23.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.730+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c34156e70 con 0x7f2c341699e0 2023-10-14T19:08:23.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.731+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3404c3c0 con 0x7f2c341699e0 2023-10-14T19:08:23.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.731+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2c1c023070 con 0x7f2c341699e0 2023-10-14T19:08:23.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.731+0000 7f2c30ff9700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c14067170 0x7f2c14069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.732+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c1c085eb0 con 0x7f2c341699e0 2023-10-14T19:08:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.732+0000 7f2c38aac700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c14067170 0x7f2c14069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.732+0000 7f2c38aac700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c14067170 0x7f2c14069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009d40 tx=0x7f2c2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.736+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c1c052e90 con 0x7f2c341699e0 2023-10-14T19:08:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.925+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c340ccf00 con 0x7f2c14067170 2023-10-14T19:08:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.934+0000 7f2c30ff9700 1 -- 172.21.15.7:0/2203355144 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289560 (secure 0 0 0) 0x7f2c340ccf00 con 0x7f2c14067170 2023-10-14T19:08:23.939 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c14067170 msgr2=0x7f2c14069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c14067170 0x7f2c14069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009d40 tx=0x7f2c2c008040 comp rx=0 tx=0).stop 2023-10-14T19:08:23.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 msgr2=0x7f2c3416bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:23.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 0x7f2c3416bc90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0094c0 tx=0x7f2c1c017000 comp rx=0 tx=0).stop 2023-10-14T19:08:23.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 shutdown_connections 2023-10-14T19:08:23.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2c14067170 0x7f2c14069620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c340cb5a0 0x7f2c3416a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c341699e0 0x7f2c3416bc90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 --2- 172.21.15.7:0/2203355144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c340cd9e0 0x7f2c34158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:23.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 >> 172.21.15.7:0/2203355144 conn(0x7f2c34070e30 msgr2=0x7f2c340d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:23.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 shutdown_connections 2023-10-14T19:08:23.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:23.938+0000 7f2c3ad10700 1 -- 172.21.15.7:0/2203355144 wait complete. 2023-10-14T19:08:23.944 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:08:23.951 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-10-14T19:08:23.699122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2407496,"kb_used_data":8712,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752567224,"statfs":{"total":773094113280,"available":770628837376,"internally_reserved":0,"allocated":8921088,"data_stored":4472380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877486"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852772+0000","last_change":"2023-10-14T19:08:19.842640+0000","last_active":"2023-10-14T19:08:19.852772+0000","last_peered":"2023-10-14T19:08:19.852772+0000","last_clean":"2023-10-14T19:08:19.852772+0000","last_became_active":"2023-10-14T19:08:19.842375+0000","last_became_peered":"2023-10-14T19:08:19.842375+0000","last_unstale":"2023-10-14T19:08:19.852772+0000","last_undegraded":"2023-10-14T19:08:19.852772+0000","last_fullsized":"2023-10-14T19:08:19.852772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:34.783981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.842893+0000","last_change":"2023-10-14T19:08:19.835591+0000","last_active":"2023-10-14T19:08:19.842893+0000","last_peered":"2023-10-14T19:08:19.842893+0000","last_clean":"2023-10-14T19:08:19.842893+0000","last_became_active":"2023-10-14T19:08:19.835384+0000","last_became_peered":"2023-10-14T19:08:19.835384+0000","last_unstale":"2023-10-14T19:08:19.842893+0000","last_undegraded":"2023-10-14T19:08:19.842893+0000","last_fullsized":"2023-10-14T19:08:19.842893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:02.625808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853602+0000","last_change":"2023-10-14T19:08:19.851581+0000","last_active":"2023-10-14T19:08:19.853602+0000","last_peered":"2023-10-14T19:08:19.853602+0000","last_clean":"2023-10-14T19:08:19.853602+0000","last_became_active":"2023-10-14T19:08:19.851265+0000","last_became_peered":"2023-10-14T19:08:19.851265+0000","last_unstale":"2023-10-14T19:08:19.853602+0000","last_undegraded":"2023-10-14T19:08:19.853602+0000","last_fullsized":"2023-10-14T19:08:19.853602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:05:36.593381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.848862+0000","last_change":"2023-10-14T19:08:19.845802+0000","last_active":"2023-10-14T19:08:19.848862+0000","last_peered":"2023-10-14T19:08:19.848862+0000","last_clean":"2023-10-14T19:08:19.848862+0000","last_became_active":"2023-10-14T19:08:19.845512+0000","last_became_peered":"2023-10-14T19:08:19.845512+0000","last_unstale":"2023-10-14T19:08:19.848862+0000","last_undegraded":"2023-10-14T19:08:19.848862+0000","last_fullsized":"2023-10-14T19:08:19.848862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:15.216037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853525+0000","last_change":"2023-10-14T19:08:19.846606+0000","last_active":"2023-10-14T19:08:19.853525+0000","last_peered":"2023-10-14T19:08:19.853525+0000","last_clean":"2023-10-14T19:08:19.853525+0000","last_became_active":"2023-10-14T19:08:19.846337+0000","last_became_peered":"2023-10-14T19:08:19.846337+0000","last_unstale":"2023-10-14T19:08:19.853525+0000","last_undegraded":"2023-10-14T19:08:19.853525+0000","last_fullsized":"2023-10-14T19:08:19.853525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:56.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.854394+0000","last_change":"2023-10-14T19:08:19.848473+0000","last_active":"2023-10-14T19:08:19.854394+0000","last_peered":"2023-10-14T19:08:19.854394+0000","last_clean":"2023-10-14T19:08:19.854394+0000","last_became_active":"2023-10-14T19:08:19.848195+0000","last_became_peered":"2023-10-14T19:08:19.848195+0000","last_unstale":"2023-10-14T19:08:19.854394+0000","last_undegraded":"2023-10-14T19:08:19.854394+0000","last_fullsized":"2023-10-14T19:08:19.854394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:48:35.139882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.848932+0000","last_change":"2023-10-14T19:08:19.846230+0000","last_active":"2023-10-14T19:08:19.848932+0000","last_peered":"2023-10-14T19:08:19.848932+0000","last_clean":"2023-10-14T19:08:19.848932+0000","last_became_active":"2023-10-14T19:08:19.845878+0000","last_became_peered":"2023-10-14T19:08:19.845878+0000","last_unstale":"2023-10-14T19:08:19.848932+0000","last_undegraded":"2023-10-14T19:08:19.848932+0000","last_fullsized":"2023-10-14T19:08:19.848932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:06.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856319+0000","last_change":"2023-10-14T19:08:19.854560+0000","last_active":"2023-10-14T19:08:19.856319+0000","last_peered":"2023-10-14T19:08:19.856319+0000","last_clean":"2023-10-14T19:08:19.856319+0000","last_became_active":"2023-10-14T19:08:19.854208+0000","last_became_peered":"2023-10-14T19:08:19.854208+0000","last_unstale":"2023-10-14T19:08:19.856319+0000","last_undegraded":"2023-10-14T19:08:19.856319+0000","last_fullsized":"2023-10-14T19:08:19.856319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:32.054211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856388+0000","last_change":"2023-10-14T19:08:19.854746+0000","last_active":"2023-10-14T19:08:19.856388+0000","last_peered":"2023-10-14T19:08:19.856388+0000","last_clean":"2023-10-14T19:08:19.856388+0000","last_became_active":"2023-10-14T19:08:19.854128+0000","last_became_peered":"2023-10-14T19:08:19.854128+0000","last_unstale":"2023-10-14T19:08:19.856388+0000","last_undegraded":"2023-10-14T19:08:19.856388+0000","last_fullsized":"2023-10-14T19:08:19.856388+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:32:35.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850858+0000","last_change":"2023-10-14T19:08:19.839064+0000","last_active":"2023-10-14T19:08:19.850858+0000","last_peered":"2023-10-14T19:08:19.850858+0000","last_clean":"2023-10-14T19:08:19.850858+0000","last_became_active":"2023-10-14T19:08:19.838813+0000","last_became_peered":"2023-10-14T19:08:19.838813+0000","last_unstale":"2023-10-14T19:08:19.850858+0000","last_undegraded":"2023-10-14T19:08:19.850858+0000","last_fullsized":"2023-10-14T19:08:19.850858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.624318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852830+0000","last_change":"2023-10-14T19:08:19.844621+0000","last_active":"2023-10-14T19:08:19.852830+0000","last_peered":"2023-10-14T19:08:19.852830+0000","last_clean":"2023-10-14T19:08:19.852830+0000","last_became_active":"2023-10-14T19:08:19.844359+0000","last_became_peered":"2023-10-14T19:08:19.844359+0000","last_unstale":"2023-10-14T19:08:19.852830+0000","last_undegraded":"2023-10-14T19:08:19.852830+0000","last_fullsized":"2023-10-14T19:08:19.852830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:41.639763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850952+0000","last_change":"2023-10-14T19:08:19.840461+0000","last_active":"2023-10-14T19:08:19.850952+0000","last_peered":"2023-10-14T19:08:19.850952+0000","last_clean":"2023-10-14T19:08:19.850952+0000","last_became_active":"2023-10-14T19:08:19.840163+0000","last_became_peered":"2023-10-14T19:08:19.840163+0000","last_unstale":"2023-10-14T19:08:19.850952+0000","last_undegraded":"2023-10-14T19:08:19.850952+0000","last_fullsized":"2023-10-14T19:08:19.850952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:56.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852046+0000","last_change":"2023-10-14T19:08:19.843654+0000","last_active":"2023-10-14T19:08:19.852046+0000","last_peered":"2023-10-14T19:08:19.852046+0000","last_clean":"2023-10-14T19:08:19.852046+0000","last_became_active":"2023-10-14T19:08:19.843339+0000","last_became_peered":"2023-10-14T19:08:19.843339+0000","last_unstale":"2023-10-14T19:08:19.852046+0000","last_undegraded":"2023-10-14T19:08:19.852046+0000","last_fullsized":"2023-10-14T19:08:19.852046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:57.180996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849020+0000","last_change":"2023-10-14T19:08:19.847440+0000","last_active":"2023-10-14T19:08:19.849020+0000","last_peered":"2023-10-14T19:08:19.849020+0000","last_clean":"2023-10-14T19:08:19.849020+0000","last_became_active":"2023-10-14T19:08:19.846965+0000","last_became_peered":"2023-10-14T19:08:19.846965+0000","last_unstale":"2023-10-14T19:08:19.849020+0000","last_undegraded":"2023-10-14T19:08:19.849020+0000","last_fullsized":"2023-10-14T19:08:19.849020+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:36.531908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.851745+0000","last_change":"2023-10-14T19:08:19.845381+0000","last_active":"2023-10-14T19:08:19.851745+0000","last_peered":"2023-10-14T19:08:19.851745+0000","last_clean":"2023-10-14T19:08:19.851745+0000","last_became_active":"2023-10-14T19:08:19.844779+0000","last_became_peered":"2023-10-14T19:08:19.844779+0000","last_unstale":"2023-10-14T19:08:19.851745+0000","last_undegraded":"2023-10-14T19:08:19.851745+0000","last_fullsized":"2023-10-14T19:08:19.851745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:05:36.593381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850059+0000","last_change":"2023-10-14T19:08:19.842813+0000","last_active":"2023-10-14T19:08:19.850059+0000","last_peered":"2023-10-14T19:08:19.850059+0000","last_clean":"2023-10-14T19:08:19.850059+0000","last_became_active":"2023-10-14T19:08:19.842554+0000","last_became_peered":"2023-10-14T19:08:19.842554+0000","last_unstale":"2023-10-14T19:08:19.850059+0000","last_undegraded":"2023-10-14T19:08:19.850059+0000","last_fullsized":"2023-10-14T19:08:19.850059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:07:11.580964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849975+0000","last_change":"2023-10-14T19:08:19.841961+0000","last_active":"2023-10-14T19:08:19.849975+0000","last_peered":"2023-10-14T19:08:19.849975+0000","last_clean":"2023-10-14T19:08:19.849975+0000","last_became_active":"2023-10-14T19:08:19.841674+0000","last_became_peered":"2023-10-14T19:08:19.841674+0000","last_unstale":"2023-10-14T19:08:19.849975+0000","last_undegraded":"2023-10-14T19:08:19.849975+0000","last_fullsized":"2023-10-14T19:08:19.849975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:56.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839113+0000","last_change":"2023-10-14T19:08:19.837525+0000","last_active":"2023-10-14T19:08:19.839113+0000","last_peered":"2023-10-14T19:08:19.839113+0000","last_clean":"2023-10-14T19:08:19.839113+0000","last_became_active":"2023-10-14T19:08:19.837242+0000","last_became_peered":"2023-10-14T19:08:19.837242+0000","last_unstale":"2023-10-14T19:08:19.839113+0000","last_undegraded":"2023-10-14T19:08:19.839113+0000","last_fullsized":"2023-10-14T19:08:19.839113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:11.514947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853747+0000","last_change":"2023-10-14T19:08:19.850053+0000","last_active":"2023-10-14T19:08:19.853747+0000","last_peered":"2023-10-14T19:08:19.853747+0000","last_clean":"2023-10-14T19:08:19.853747+0000","last_became_active":"2023-10-14T19:08:19.843902+0000","last_became_peered":"2023-10-14T19:08:19.843902+0000","last_unstale":"2023-10-14T19:08:19.853747+0000","last_undegraded":"2023-10-14T19:08:19.853747+0000","last_fullsized":"2023-10-14T19:08:19.853747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:56.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.847069+0000","last_change":"2023-10-14T19:08:19.841769+0000","last_active":"2023-10-14T19:08:19.847069+0000","last_peered":"2023-10-14T19:08:19.847069+0000","last_clean":"2023-10-14T19:08:19.847069+0000","last_became_active":"2023-10-14T19:08:19.840294+0000","last_became_peered":"2023-10-14T19:08:19.840294+0000","last_unstale":"2023-10-14T19:08:19.847069+0000","last_undegraded":"2023-10-14T19:08:19.847069+0000","last_fullsized":"2023-10-14T19:08:19.847069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:26.319047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839227+0000","last_change":"2023-10-14T19:08:19.837762+0000","last_active":"2023-10-14T19:08:19.839227+0000","last_peered":"2023-10-14T19:08:19.839227+0000","last_clean":"2023-10-14T19:08:19.839227+0000","last_became_active":"2023-10-14T19:08:19.837462+0000","last_became_peered":"2023-10-14T19:08:19.837462+0000","last_unstale":"2023-10-14T19:08:19.839227+0000","last_undegraded":"2023-10-14T19:08:19.839227+0000","last_fullsized":"2023-10-14T19:08:19.839227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:37:28.981675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.845009+0000","last_change":"2023-10-14T19:08:19.839131+0000","last_active":"2023-10-14T19:08:19.845009+0000","last_peered":"2023-10-14T19:08:19.845009+0000","last_clean":"2023-10-14T19:08:19.845009+0000","last_became_active":"2023-10-14T19:08:19.838887+0000","last_became_peered":"2023-10-14T19:08:19.838887+0000","last_unstale":"2023-10-14T19:08:19.845009+0000","last_undegraded":"2023-10-14T19:08:19.845009+0000","last_fullsized":"2023-10-14T19:08:19.845009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:35.984479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850958+0000","last_change":"2023-10-14T19:08:19.841056+0000","last_active":"2023-10-14T19:08:19.850958+0000","last_peered":"2023-10-14T19:08:19.850958+0000","last_clean":"2023-10-14T19:08:19.850958+0000","last_became_active":"2023-10-14T19:08:19.840759+0000","last_became_peered":"2023-10-14T19:08:19.840759+0000","last_unstale":"2023-10-14T19:08:19.850958+0000","last_undegraded":"2023-10-14T19:08:19.850958+0000","last_fullsized":"2023-10-14T19:08:19.850958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:24.073959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.841023+0000","last_change":"2023-10-14T19:08:19.839469+0000","last_active":"2023-10-14T19:08:19.841023+0000","last_peered":"2023-10-14T19:08:19.841023+0000","last_clean":"2023-10-14T19:08:19.841023+0000","last_became_active":"2023-10-14T19:08:19.839204+0000","last_became_peered":"2023-10-14T19:08:19.839204+0000","last_unstale":"2023-10-14T19:08:19.841023+0000","last_undegraded":"2023-10-14T19:08:19.841023+0000","last_fullsized":"2023-10-14T19:08:19.841023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:19.410989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835982+0000","last_change":"2023-10-14T19:08:19.835005+0000","last_active":"2023-10-14T19:08:19.835982+0000","last_peered":"2023-10-14T19:08:19.835982+0000","last_clean":"2023-10-14T19:08:19.835982+0000","last_became_active":"2023-10-14T19:08:19.834720+0000","last_became_peered":"2023-10-14T19:08:19.834720+0000","last_unstale":"2023-10-14T19:08:19.835982+0000","last_undegraded":"2023-10-14T19:08:19.835982+0000","last_fullsized":"2023-10-14T19:08:19.835982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:45.244486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855775+0000","last_change":"2023-10-14T19:08:19.853420+0000","last_active":"2023-10-14T19:08:19.855775+0000","last_peered":"2023-10-14T19:08:19.855775+0000","last_clean":"2023-10-14T19:08:19.855775+0000","last_became_active":"2023-10-14T19:08:19.853166+0000","last_became_peered":"2023-10-14T19:08:19.853166+0000","last_unstale":"2023-10-14T19:08:19.855775+0000","last_undegraded":"2023-10-14T19:08:19.855775+0000","last_fullsized":"2023-10-14T19:08:19.855775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:23.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853282+0000","last_change":"2023-10-14T19:08:19.844713+0000","last_active":"2023-10-14T19:08:19.853282+0000","last_peered":"2023-10-14T19:08:19.853282+0000","last_clean":"2023-10-14T19:08:19.853282+0000","last_became_active":"2023-10-14T19:08:19.844433+0000","last_became_peered":"2023-10-14T19:08:19.844433+0000","last_unstale":"2023-10-14T19:08:19.853282+0000","last_undegraded":"2023-10-14T19:08:19.853282+0000","last_fullsized":"2023-10-14T19:08:19.853282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:32.054211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852619+0000","last_change":"2023-10-14T19:08:19.842683+0000","last_active":"2023-10-14T19:08:19.852619+0000","last_peered":"2023-10-14T19:08:19.852619+0000","last_clean":"2023-10-14T19:08:19.852619+0000","last_became_active":"2023-10-14T19:08:19.842392+0000","last_became_peered":"2023-10-14T19:08:19.842392+0000","last_unstale":"2023-10-14T19:08:19.852619+0000","last_undegraded":"2023-10-14T19:08:19.852619+0000","last_fullsized":"2023-10-14T19:08:19.852619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:55.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852311+0000","last_change":"2023-10-14T19:08:19.840639+0000","last_active":"2023-10-14T19:08:19.852311+0000","last_peered":"2023-10-14T19:08:19.852311+0000","last_clean":"2023-10-14T19:08:19.852311+0000","last_became_active":"2023-10-14T19:08:19.840373+0000","last_became_peered":"2023-10-14T19:08:19.840373+0000","last_unstale":"2023-10-14T19:08:19.852311+0000","last_undegraded":"2023-10-14T19:08:19.852311+0000","last_fullsized":"2023-10-14T19:08:19.852311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:46.976025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852540+0000","last_change":"2023-10-14T19:08:19.841739+0000","last_active":"2023-10-14T19:08:19.852540+0000","last_peered":"2023-10-14T19:08:19.852540+0000","last_clean":"2023-10-14T19:08:19.852540+0000","last_became_active":"2023-10-14T19:08:19.841480+0000","last_became_peered":"2023-10-14T19:08:19.841480+0000","last_unstale":"2023-10-14T19:08:19.852540+0000","last_undegraded":"2023-10-14T19:08:19.852540+0000","last_fullsized":"2023-10-14T19:08:19.852540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:24.073959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853035+0000","last_change":"2023-10-14T19:08:19.844006+0000","last_active":"2023-10-14T19:08:19.853035+0000","last_peered":"2023-10-14T19:08:19.853035+0000","last_clean":"2023-10-14T19:08:19.853035+0000","last_became_active":"2023-10-14T19:08:19.843742+0000","last_became_peered":"2023-10-14T19:08:19.843742+0000","last_unstale":"2023-10-14T19:08:19.853035+0000","last_undegraded":"2023-10-14T19:08:19.853035+0000","last_fullsized":"2023-10-14T19:08:19.853035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:57.978082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849949+0000","last_change":"2023-10-14T19:08:19.836519+0000","last_active":"2023-10-14T19:08:19.849949+0000","last_peered":"2023-10-14T19:08:19.849949+0000","last_clean":"2023-10-14T19:08:19.849949+0000","last_became_active":"2023-10-14T19:08:19.836232+0000","last_became_peered":"2023-10-14T19:08:19.836232+0000","last_unstale":"2023-10-14T19:08:19.849949+0000","last_undegraded":"2023-10-14T19:08:19.849949+0000","last_fullsized":"2023-10-14T19:08:19.849949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:34.493283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850522+0000","last_change":"2023-10-14T19:08:19.843039+0000","last_active":"2023-10-14T19:08:19.850522+0000","last_peered":"2023-10-14T19:08:19.850522+0000","last_clean":"2023-10-14T19:08:19.850522+0000","last_became_active":"2023-10-14T19:08:19.842775+0000","last_became_peered":"2023-10-14T19:08:19.842775+0000","last_unstale":"2023-10-14T19:08:19.850522+0000","last_undegraded":"2023-10-14T19:08:19.850522+0000","last_fullsized":"2023-10-14T19:08:19.850522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:24.479205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"77'4","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856169+0000","last_change":"2023-10-14T19:08:18.841776+0000","last_active":"2023-10-14T19:08:19.856169+0000","last_peered":"2023-10-14T19:08:19.856169+0000","last_clean":"2023-10-14T19:08:19.856169+0000","last_became_active":"2023-10-14T19:08:18.841501+0000","last_became_peered":"2023-10-14T19:08:18.841501+0000","last_unstale":"2023-10-14T19:08:19.856169+0000","last_undegraded":"2023-10-14T19:08:19.856169+0000","last_fullsized":"2023-10-14T19:08:19.856169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:07.157720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852751+0000","last_change":"2023-10-14T19:08:19.840940+0000","last_active":"2023-10-14T19:08:19.852751+0000","last_peered":"2023-10-14T19:08:19.852751+0000","last_clean":"2023-10-14T19:08:19.852751+0000","last_became_active":"2023-10-14T19:08:19.840649+0000","last_became_peered":"2023-10-14T19:08:19.840649+0000","last_unstale":"2023-10-14T19:08:19.852751+0000","last_undegraded":"2023-10-14T19:08:19.852751+0000","last_fullsized":"2023-10-14T19:08:19.852751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:29.373240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855648+0000","last_change":"2023-10-14T19:08:18.843527+0000","last_active":"2023-10-14T19:08:19.855648+0000","last_peered":"2023-10-14T19:08:19.855648+0000","last_clean":"2023-10-14T19:08:19.855648+0000","last_became_active":"2023-10-14T19:08:18.843086+0000","last_became_peered":"2023-10-14T19:08:18.843086+0000","last_unstale":"2023-10-14T19:08:19.855648+0000","last_undegraded":"2023-10-14T19:08:19.855648+0000","last_fullsized":"2023-10-14T19:08:19.855648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:33.490940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850933+0000","last_change":"2023-10-14T19:08:19.838773+0000","last_active":"2023-10-14T19:08:19.850933+0000","last_peered":"2023-10-14T19:08:19.850933+0000","last_clean":"2023-10-14T19:08:19.850933+0000","last_became_active":"2023-10-14T19:08:19.838501+0000","last_became_peered":"2023-10-14T19:08:19.838501+0000","last_unstale":"2023-10-14T19:08:19.850933+0000","last_undegraded":"2023-10-14T19:08:19.850933+0000","last_fullsized":"2023-10-14T19:08:19.850933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:28.511075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858139+0000","last_change":"2023-10-14T19:08:18.841640+0000","last_active":"2023-10-14T19:08:19.858139+0000","last_peered":"2023-10-14T19:08:19.858139+0000","last_clean":"2023-10-14T19:08:19.858139+0000","last_became_active":"2023-10-14T19:08:18.841337+0000","last_became_peered":"2023-10-14T19:08:18.841337+0000","last_unstale":"2023-10-14T19:08:19.858139+0000","last_undegraded":"2023-10-14T19:08:19.858139+0000","last_fullsized":"2023-10-14T19:08:19.858139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:39.621975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852952+0000","last_change":"2023-10-14T19:08:19.847477+0000","last_active":"2023-10-14T19:08:19.852952+0000","last_peered":"2023-10-14T19:08:19.852952+0000","last_clean":"2023-10-14T19:08:19.852952+0000","last_became_active":"2023-10-14T19:08:19.846902+0000","last_became_peered":"2023-10-14T19:08:19.846902+0000","last_unstale":"2023-10-14T19:08:19.852952+0000","last_undegraded":"2023-10-14T19:08:19.852952+0000","last_fullsized":"2023-10-14T19:08:19.852952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:48.704924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858069+0000","last_change":"2023-10-14T19:08:18.841826+0000","last_active":"2023-10-14T19:08:19.858069+0000","last_peered":"2023-10-14T19:08:19.858069+0000","last_clean":"2023-10-14T19:08:19.858069+0000","last_became_active":"2023-10-14T19:08:18.841343+0000","last_became_peered":"2023-10-14T19:08:18.841343+0000","last_unstale":"2023-10-14T19:08:19.858069+0000","last_undegraded":"2023-10-14T19:08:19.858069+0000","last_fullsized":"2023-10-14T19:08:19.858069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:13.660190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852528+0000","last_change":"2023-10-14T19:08:19.841438+0000","last_active":"2023-10-14T19:08:19.852528+0000","last_peered":"2023-10-14T19:08:19.852528+0000","last_clean":"2023-10-14T19:08:19.852528+0000","last_became_active":"2023-10-14T19:08:19.841166+0000","last_became_peered":"2023-10-14T19:08:19.841166+0000","last_unstale":"2023-10-14T19:08:19.852528+0000","last_undegraded":"2023-10-14T19:08:19.852528+0000","last_fullsized":"2023-10-14T19:08:19.852528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:53.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855629+0000","last_change":"2023-10-14T19:08:18.842675+0000","last_active":"2023-10-14T19:08:19.855629+0000","last_peered":"2023-10-14T19:08:19.855629+0000","last_clean":"2023-10-14T19:08:19.855629+0000","last_became_active":"2023-10-14T19:08:18.842321+0000","last_became_peered":"2023-10-14T19:08:18.842321+0000","last_unstale":"2023-10-14T19:08:19.855629+0000","last_undegraded":"2023-10-14T19:08:19.855629+0000","last_fullsized":"2023-10-14T19:08:19.855629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:14.368229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850712+0000","last_change":"2023-10-14T19:08:19.843047+0000","last_active":"2023-10-14T19:08:19.850712+0000","last_peered":"2023-10-14T19:08:19.850712+0000","last_clean":"2023-10-14T19:08:19.850712+0000","last_became_active":"2023-10-14T19:08:19.842230+0000","last_became_peered":"2023-10-14T19:08:19.842230+0000","last_unstale":"2023-10-14T19:08:19.850712+0000","last_undegraded":"2023-10-14T19:08:19.850712+0000","last_fullsized":"2023-10-14T19:08:19.850712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.624318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855601+0000","last_change":"2023-10-14T19:08:18.842427+0000","last_active":"2023-10-14T19:08:19.855601+0000","last_peered":"2023-10-14T19:08:19.855601+0000","last_clean":"2023-10-14T19:08:19.855601+0000","last_became_active":"2023-10-14T19:08:18.841998+0000","last_became_peered":"2023-10-14T19:08:18.841998+0000","last_unstale":"2023-10-14T19:08:19.855601+0000","last_undegraded":"2023-10-14T19:08:19.855601+0000","last_fullsized":"2023-10-14T19:08:19.855601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:14.229654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850624+0000","last_change":"2023-10-14T19:08:19.843876+0000","last_active":"2023-10-14T19:08:19.850624+0000","last_peered":"2023-10-14T19:08:19.850624+0000","last_clean":"2023-10-14T19:08:19.850624+0000","last_became_active":"2023-10-14T19:08:19.843566+0000","last_became_peered":"2023-10-14T19:08:19.843566+0000","last_unstale":"2023-10-14T19:08:19.850624+0000","last_undegraded":"2023-10-14T19:08:19.850624+0000","last_fullsized":"2023-10-14T19:08:19.850624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:39:11.610472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839045+0000","last_change":"2023-10-14T19:08:18.841704+0000","last_active":"2023-10-14T19:08:19.839045+0000","last_peered":"2023-10-14T19:08:19.839045+0000","last_clean":"2023-10-14T19:08:19.839045+0000","last_became_active":"2023-10-14T19:08:18.841372+0000","last_became_peered":"2023-10-14T19:08:18.841372+0000","last_unstale":"2023-10-14T19:08:19.839045+0000","last_undegraded":"2023-10-14T19:08:19.839045+0000","last_fullsized":"2023-10-14T19:08:19.839045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.051868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.851765+0000","last_change":"2023-10-14T19:08:19.845556+0000","last_active":"2023-10-14T19:08:19.851765+0000","last_peered":"2023-10-14T19:08:19.851765+0000","last_clean":"2023-10-14T19:08:19.851765+0000","last_became_active":"2023-10-14T19:08:19.845134+0000","last_became_peered":"2023-10-14T19:08:19.845134+0000","last_unstale":"2023-10-14T19:08:19.851765+0000","last_undegraded":"2023-10-14T19:08:19.851765+0000","last_fullsized":"2023-10-14T19:08:19.851765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:05.868663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.831344+0000","last_change":"2023-10-14T19:08:18.847762+0000","last_active":"2023-10-14T19:08:19.831344+0000","last_peered":"2023-10-14T19:08:19.831344+0000","last_clean":"2023-10-14T19:08:19.831344+0000","last_became_active":"2023-10-14T19:08:18.847404+0000","last_became_peered":"2023-10-14T19:08:18.847404+0000","last_unstale":"2023-10-14T19:08:19.831344+0000","last_undegraded":"2023-10-14T19:08:19.831344+0000","last_fullsized":"2023-10-14T19:08:19.831344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:29.069495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.844180+0000","last_change":"2023-10-14T19:08:19.837922+0000","last_active":"2023-10-14T19:08:19.844180+0000","last_peered":"2023-10-14T19:08:19.844180+0000","last_clean":"2023-10-14T19:08:19.844180+0000","last_became_active":"2023-10-14T19:08:19.837656+0000","last_became_peered":"2023-10-14T19:08:19.837656+0000","last_unstale":"2023-10-14T19:08:19.844180+0000","last_undegraded":"2023-10-14T19:08:19.844180+0000","last_fullsized":"2023-10-14T19:08:19.844180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:23.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.831571+0000","last_change":"2023-10-14T19:08:18.843957+0000","last_active":"2023-10-14T19:08:19.831571+0000","last_peered":"2023-10-14T19:08:19.831571+0000","last_clean":"2023-10-14T19:08:19.831571+0000","last_became_active":"2023-10-14T19:08:18.843633+0000","last_became_peered":"2023-10-14T19:08:18.843633+0000","last_unstale":"2023-10-14T19:08:19.831571+0000","last_undegraded":"2023-10-14T19:08:19.831571+0000","last_fullsized":"2023-10-14T19:08:19.831571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:54.980217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.854619+0000","last_change":"2023-10-14T19:08:19.847722+0000","last_active":"2023-10-14T19:08:19.854619+0000","last_peered":"2023-10-14T19:08:19.854619+0000","last_clean":"2023-10-14T19:08:19.854619+0000","last_became_active":"2023-10-14T19:08:19.847467+0000","last_became_peered":"2023-10-14T19:08:19.847467+0000","last_unstale":"2023-10-14T19:08:19.854619+0000","last_undegraded":"2023-10-14T19:08:19.854619+0000","last_fullsized":"2023-10-14T19:08:19.854619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:14.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.831095+0000","last_change":"2023-10-14T19:08:18.844401+0000","last_active":"2023-10-14T19:08:19.831095+0000","last_peered":"2023-10-14T19:08:19.831095+0000","last_clean":"2023-10-14T19:08:19.831095+0000","last_became_active":"2023-10-14T19:08:18.844154+0000","last_became_peered":"2023-10-14T19:08:18.844154+0000","last_unstale":"2023-10-14T19:08:19.831095+0000","last_undegraded":"2023-10-14T19:08:19.831095+0000","last_fullsized":"2023-10-14T19:08:19.831095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:47.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.857392+0000","last_change":"2023-10-14T19:08:19.852338+0000","last_active":"2023-10-14T19:08:19.857392+0000","last_peered":"2023-10-14T19:08:19.857392+0000","last_clean":"2023-10-14T19:08:19.857392+0000","last_became_active":"2023-10-14T19:08:19.852028+0000","last_became_peered":"2023-10-14T19:08:19.852028+0000","last_unstale":"2023-10-14T19:08:19.857392+0000","last_undegraded":"2023-10-14T19:08:19.857392+0000","last_fullsized":"2023-10-14T19:08:19.857392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:23.327993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"77'3","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856870+0000","last_change":"2023-10-14T19:08:18.843380+0000","last_active":"2023-10-14T19:08:19.856870+0000","last_peered":"2023-10-14T19:08:19.856870+0000","last_clean":"2023-10-14T19:08:19.856870+0000","last_became_active":"2023-10-14T19:08:18.843103+0000","last_became_peered":"2023-10-14T19:08:18.843103+0000","last_unstale":"2023-10-14T19:08:19.856870+0000","last_undegraded":"2023-10-14T19:08:19.856870+0000","last_fullsized":"2023-10-14T19:08:19.856870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:09.248290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853319+0000","last_change":"2023-10-14T19:08:19.845574+0000","last_active":"2023-10-14T19:08:19.853319+0000","last_peered":"2023-10-14T19:08:19.853319+0000","last_clean":"2023-10-14T19:08:19.853319+0000","last_became_active":"2023-10-14T19:08:19.845301+0000","last_became_peered":"2023-10-14T19:08:19.845301+0000","last_unstale":"2023-10-14T19:08:19.853319+0000","last_undegraded":"2023-10-14T19:08:19.853319+0000","last_fullsized":"2023-10-14T19:08:19.853319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:32:35.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"77'6","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.861291+0000","last_change":"2023-10-14T19:08:18.841730+0000","last_active":"2023-10-14T19:08:19.861291+0000","last_peered":"2023-10-14T19:08:19.861291+0000","last_clean":"2023-10-14T19:08:19.861291+0000","last_became_active":"2023-10-14T19:08:18.841479+0000","last_became_peered":"2023-10-14T19:08:18.841479+0000","last_unstale":"2023-10-14T19:08:19.861291+0000","last_undegraded":"2023-10-14T19:08:19.861291+0000","last_fullsized":"2023-10-14T19:08:19.861291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:34.982136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.851904+0000","last_change":"2023-10-14T19:08:19.843865+0000","last_active":"2023-10-14T19:08:19.851904+0000","last_peered":"2023-10-14T19:08:19.851904+0000","last_clean":"2023-10-14T19:08:19.851904+0000","last_became_active":"2023-10-14T19:08:19.843588+0000","last_became_peered":"2023-10-14T19:08:19.843588+0000","last_unstale":"2023-10-14T19:08:19.851904+0000","last_undegraded":"2023-10-14T19:08:19.851904+0000","last_fullsized":"2023-10-14T19:08:19.851904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:25.245663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858242+0000","last_change":"2023-10-14T19:08:18.840751+0000","last_active":"2023-10-14T19:08:19.858242+0000","last_peered":"2023-10-14T19:08:19.858242+0000","last_clean":"2023-10-14T19:08:19.858242+0000","last_became_active":"2023-10-14T19:08:18.840429+0000","last_became_peered":"2023-10-14T19:08:18.840429+0000","last_unstale":"2023-10-14T19:08:19.858242+0000","last_undegraded":"2023-10-14T19:08:19.858242+0000","last_fullsized":"2023-10-14T19:08:19.858242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:09.248290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852069+0000","last_change":"2023-10-14T19:08:19.844112+0000","last_active":"2023-10-14T19:08:19.852069+0000","last_peered":"2023-10-14T19:08:19.852069+0000","last_clean":"2023-10-14T19:08:19.852069+0000","last_became_active":"2023-10-14T19:08:19.843867+0000","last_became_peered":"2023-10-14T19:08:19.843867+0000","last_unstale":"2023-10-14T19:08:19.852069+0000","last_undegraded":"2023-10-14T19:08:19.852069+0000","last_fullsized":"2023-10-14T19:08:19.852069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:16.289101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.833475+0000","last_change":"2023-10-14T19:08:18.844067+0000","last_active":"2023-10-14T19:08:19.833475+0000","last_peered":"2023-10-14T19:08:19.833475+0000","last_clean":"2023-10-14T19:08:19.833475+0000","last_became_active":"2023-10-14T19:08:18.843800+0000","last_became_peered":"2023-10-14T19:08:18.843800+0000","last_unstale":"2023-10-14T19:08:19.833475+0000","last_undegraded":"2023-10-14T19:08:19.833475+0000","last_fullsized":"2023-10-14T19:08:19.833475+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:18.875481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852385+0000","last_change":"2023-10-14T19:08:19.839759+0000","last_active":"2023-10-14T19:08:19.852385+0000","last_peered":"2023-10-14T19:08:19.852385+0000","last_clean":"2023-10-14T19:08:19.852385+0000","last_became_active":"2023-10-14T19:08:19.839514+0000","last_became_peered":"2023-10-14T19:08:19.839514+0000","last_unstale":"2023-10-14T19:08:19.852385+0000","last_undegraded":"2023-10-14T19:08:19.852385+0000","last_fullsized":"2023-10-14T19:08:19.852385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:55.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.840099+0000","last_change":"2023-10-14T19:08:18.844383+0000","last_active":"2023-10-14T19:08:19.840099+0000","last_peered":"2023-10-14T19:08:19.840099+0000","last_clean":"2023-10-14T19:08:19.840099+0000","last_became_active":"2023-10-14T19:08:18.844120+0000","last_became_peered":"2023-10-14T19:08:18.844120+0000","last_unstale":"2023-10-14T19:08:19.840099+0000","last_undegraded":"2023-10-14T19:08:19.840099+0000","last_fullsized":"2023-10-14T19:08:19.840099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:44.242143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835988+0000","last_change":"2023-10-14T19:08:19.834948+0000","last_active":"2023-10-14T19:08:19.835988+0000","last_peered":"2023-10-14T19:08:19.835988+0000","last_clean":"2023-10-14T19:08:19.835988+0000","last_became_active":"2023-10-14T19:08:19.834671+0000","last_became_peered":"2023-10-14T19:08:19.834671+0000","last_unstale":"2023-10-14T19:08:19.835988+0000","last_undegraded":"2023-10-14T19:08:19.835988+0000","last_fullsized":"2023-10-14T19:08:19.835988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:55.915193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"77'8","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.861786+0000","last_change":"2023-10-14T19:08:18.838105+0000","last_active":"2023-10-14T19:08:19.861786+0000","last_peered":"2023-10-14T19:08:19.861786+0000","last_clean":"2023-10-14T19:08:19.861786+0000","last_became_active":"2023-10-14T19:08:18.837842+0000","last_became_peered":"2023-10-14T19:08:18.837842+0000","last_unstale":"2023-10-14T19:08:19.861786+0000","last_undegraded":"2023-10-14T19:08:19.861786+0000","last_fullsized":"2023-10-14T19:08:19.861786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:55.059659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853123+0000","last_change":"2023-10-14T19:08:19.851783+0000","last_active":"2023-10-14T19:08:19.853123+0000","last_peered":"2023-10-14T19:08:19.853123+0000","last_clean":"2023-10-14T19:08:19.853123+0000","last_became_active":"2023-10-14T19:08:19.851477+0000","last_became_peered":"2023-10-14T19:08:19.851477+0000","last_unstale":"2023-10-14T19:08:19.853123+0000","last_undegraded":"2023-10-14T19:08:19.853123+0000","last_fullsized":"2023-10-14T19:08:19.853123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:00.094148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855855+0000","last_change":"2023-10-14T19:08:18.846105+0000","last_active":"2023-10-14T19:08:19.855855+0000","last_peered":"2023-10-14T19:08:19.855855+0000","last_clean":"2023-10-14T19:08:19.855855+0000","last_became_active":"2023-10-14T19:08:18.845850+0000","last_became_peered":"2023-10-14T19:08:18.845850+0000","last_unstale":"2023-10-14T19:08:19.855855+0000","last_undegraded":"2023-10-14T19:08:19.855855+0000","last_fullsized":"2023-10-14T19:08:19.855855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:36.418948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852790+0000","last_change":"2023-10-14T19:08:19.843960+0000","last_active":"2023-10-14T19:08:19.852790+0000","last_peered":"2023-10-14T19:08:19.852790+0000","last_clean":"2023-10-14T19:08:19.852790+0000","last_became_active":"2023-10-14T19:08:19.843598+0000","last_became_peered":"2023-10-14T19:08:19.843598+0000","last_unstale":"2023-10-14T19:08:19.852790+0000","last_undegraded":"2023-10-14T19:08:19.852790+0000","last_fullsized":"2023-10-14T19:08:19.852790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:57.978082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.859213+0000","last_change":"2023-10-14T19:08:18.844177+0000","last_active":"2023-10-14T19:08:19.859213+0000","last_peered":"2023-10-14T19:08:19.859213+0000","last_clean":"2023-10-14T19:08:19.859213+0000","last_became_active":"2023-10-14T19:08:18.843934+0000","last_became_peered":"2023-10-14T19:08:18.843934+0000","last_unstale":"2023-10-14T19:08:19.859213+0000","last_undegraded":"2023-10-14T19:08:19.859213+0000","last_fullsized":"2023-10-14T19:08:19.859213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853337+0000","last_change":"2023-10-14T19:08:19.846485+0000","last_active":"2023-10-14T19:08:19.853337+0000","last_peered":"2023-10-14T19:08:19.853337+0000","last_clean":"2023-10-14T19:08:19.853337+0000","last_became_active":"2023-10-14T19:08:19.846215+0000","last_became_peered":"2023-10-14T19:08:19.846215+0000","last_unstale":"2023-10-14T19:08:19.853337+0000","last_undegraded":"2023-10-14T19:08:19.853337+0000","last_fullsized":"2023-10-14T19:08:19.853337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:48:35.139882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.842469+0000","last_change":"2023-10-14T19:08:18.846136+0000","last_active":"2023-10-14T19:08:19.842469+0000","last_peered":"2023-10-14T19:08:19.842469+0000","last_clean":"2023-10-14T19:08:19.842469+0000","last_became_active":"2023-10-14T19:08:18.845834+0000","last_became_peered":"2023-10-14T19:08:18.845834+0000","last_unstale":"2023-10-14T19:08:19.842469+0000","last_undegraded":"2023-10-14T19:08:19.842469+0000","last_fullsized":"2023-10-14T19:08:19.842469+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:56.975739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849001+0000","last_change":"2023-10-14T19:08:19.847207+0000","last_active":"2023-10-14T19:08:19.849001+0000","last_peered":"2023-10-14T19:08:19.849001+0000","last_clean":"2023-10-14T19:08:19.849001+0000","last_became_active":"2023-10-14T19:08:19.846547+0000","last_became_peered":"2023-10-14T19:08:19.846547+0000","last_unstale":"2023-10-14T19:08:19.849001+0000","last_undegraded":"2023-10-14T19:08:19.849001+0000","last_fullsized":"2023-10-14T19:08:19.849001+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:47.574705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858206+0000","last_change":"2023-10-14T19:08:18.835076+0000","last_active":"2023-10-14T19:08:19.858206+0000","last_peered":"2023-10-14T19:08:19.858206+0000","last_clean":"2023-10-14T19:08:19.858206+0000","last_became_active":"2023-10-14T19:08:18.834740+0000","last_became_peered":"2023-10-14T19:08:18.834740+0000","last_unstale":"2023-10-14T19:08:19.858206+0000","last_undegraded":"2023-10-14T19:08:19.858206+0000","last_fullsized":"2023-10-14T19:08:19.858206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:39:10.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.854265+0000","last_change":"2023-10-14T19:08:19.844941+0000","last_active":"2023-10-14T19:08:19.854265+0000","last_peered":"2023-10-14T19:08:19.854265+0000","last_clean":"2023-10-14T19:08:19.854265+0000","last_became_active":"2023-10-14T19:08:19.844680+0000","last_became_peered":"2023-10-14T19:08:19.844680+0000","last_unstale":"2023-10-14T19:08:19.854265+0000","last_undegraded":"2023-10-14T19:08:19.854265+0000","last_fullsized":"2023-10-14T19:08:19.854265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:40.537756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.834493+0000","last_change":"2023-10-14T19:08:18.845719+0000","last_active":"2023-10-14T19:08:19.834493+0000","last_peered":"2023-10-14T19:08:19.834493+0000","last_clean":"2023-10-14T19:08:19.834493+0000","last_became_active":"2023-10-14T19:08:18.845132+0000","last_became_peered":"2023-10-14T19:08:18.845132+0000","last_unstale":"2023-10-14T19:08:19.834493+0000","last_undegraded":"2023-10-14T19:08:19.834493+0000","last_fullsized":"2023-10-14T19:08:19.834493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:05.915258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.846989+0000","last_change":"2023-10-14T19:08:19.842651+0000","last_active":"2023-10-14T19:08:19.846989+0000","last_peered":"2023-10-14T19:08:19.846989+0000","last_clean":"2023-10-14T19:08:19.846989+0000","last_became_active":"2023-10-14T19:08:19.842399+0000","last_became_peered":"2023-10-14T19:08:19.842399+0000","last_unstale":"2023-10-14T19:08:19.846989+0000","last_undegraded":"2023-10-14T19:08:19.846989+0000","last_fullsized":"2023-10-14T19:08:19.846989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:58.890046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.832160+0000","last_change":"2023-10-14T19:08:18.841556+0000","last_active":"2023-10-14T19:08:19.832160+0000","last_peered":"2023-10-14T19:08:19.832160+0000","last_clean":"2023-10-14T19:08:19.832160+0000","last_became_active":"2023-10-14T19:08:18.841302+0000","last_became_peered":"2023-10-14T19:08:18.841302+0000","last_unstale":"2023-10-14T19:08:19.832160+0000","last_undegraded":"2023-10-14T19:08:19.832160+0000","last_fullsized":"2023-10-14T19:08:19.832160+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:18:19.662199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856340+0000","last_change":"2023-10-14T19:08:19.854703+0000","last_active":"2023-10-14T19:08:19.856340+0000","last_peered":"2023-10-14T19:08:19.856340+0000","last_clean":"2023-10-14T19:08:19.856340+0000","last_became_active":"2023-10-14T19:08:19.854379+0000","last_became_peered":"2023-10-14T19:08:19.854379+0000","last_unstale":"2023-10-14T19:08:19.856340+0000","last_undegraded":"2023-10-14T19:08:19.856340+0000","last_fullsized":"2023-10-14T19:08:19.856340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:56.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.833321+0000","last_change":"2023-10-14T19:08:18.843432+0000","last_active":"2023-10-14T19:08:19.833321+0000","last_peered":"2023-10-14T19:08:19.833321+0000","last_clean":"2023-10-14T19:08:19.833321+0000","last_became_active":"2023-10-14T19:08:18.843177+0000","last_became_peered":"2023-10-14T19:08:18.843177+0000","last_unstale":"2023-10-14T19:08:19.833321+0000","last_undegraded":"2023-10-14T19:08:19.833321+0000","last_fullsized":"2023-10-14T19:08:19.833321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:39.915842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853009+0000","last_change":"2023-10-14T19:08:19.845111+0000","last_active":"2023-10-14T19:08:19.853009+0000","last_peered":"2023-10-14T19:08:19.853009+0000","last_clean":"2023-10-14T19:08:19.853009+0000","last_became_active":"2023-10-14T19:08:19.844819+0000","last_became_peered":"2023-10-14T19:08:19.844819+0000","last_unstale":"2023-10-14T19:08:19.853009+0000","last_undegraded":"2023-10-14T19:08:19.853009+0000","last_fullsized":"2023-10-14T19:08:19.853009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:58:57.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.857219+0000","last_change":"2023-10-14T19:08:18.844610+0000","last_active":"2023-10-14T19:08:19.857219+0000","last_peered":"2023-10-14T19:08:19.857219+0000","last_clean":"2023-10-14T19:08:19.857219+0000","last_became_active":"2023-10-14T19:08:18.844341+0000","last_became_peered":"2023-10-14T19:08:18.844341+0000","last_unstale":"2023-10-14T19:08:19.857219+0000","last_undegraded":"2023-10-14T19:08:19.857219+0000","last_fullsized":"2023-10-14T19:08:19.857219+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:47.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853158+0000","last_change":"2023-10-14T19:08:19.851564+0000","last_active":"2023-10-14T19:08:19.853158+0000","last_peered":"2023-10-14T19:08:19.853158+0000","last_clean":"2023-10-14T19:08:19.853158+0000","last_became_active":"2023-10-14T19:08:19.851236+0000","last_became_peered":"2023-10-14T19:08:19.851236+0000","last_unstale":"2023-10-14T19:08:19.853158+0000","last_undegraded":"2023-10-14T19:08:19.853158+0000","last_fullsized":"2023-10-14T19:08:19.853158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:05.868663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.830578+0000","last_change":"2023-10-14T19:08:18.837555+0000","last_active":"2023-10-14T19:08:19.830578+0000","last_peered":"2023-10-14T19:08:19.830578+0000","last_clean":"2023-10-14T19:08:19.830578+0000","last_became_active":"2023-10-14T19:08:18.837224+0000","last_became_peered":"2023-10-14T19:08:18.837224+0000","last_unstale":"2023-10-14T19:08:19.830578+0000","last_undegraded":"2023-10-14T19:08:19.830578+0000","last_fullsized":"2023-10-14T19:08:19.830578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:36.418948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850911+0000","last_change":"2023-10-14T19:08:19.837316+0000","last_active":"2023-10-14T19:08:19.850911+0000","last_peered":"2023-10-14T19:08:19.850911+0000","last_clean":"2023-10-14T19:08:19.850911+0000","last_became_active":"2023-10-14T19:08:19.837039+0000","last_became_peered":"2023-10-14T19:08:19.837039+0000","last_unstale":"2023-10-14T19:08:19.850911+0000","last_undegraded":"2023-10-14T19:08:19.850911+0000","last_fullsized":"2023-10-14T19:08:19.850911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:40.537756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.829675+0000","last_change":"2023-10-14T19:08:18.839551+0000","last_active":"2023-10-14T19:08:19.829675+0000","last_peered":"2023-10-14T19:08:19.829675+0000","last_clean":"2023-10-14T19:08:19.829675+0000","last_became_active":"2023-10-14T19:08:18.839257+0000","last_became_peered":"2023-10-14T19:08:18.839257+0000","last_unstale":"2023-10-14T19:08:19.829675+0000","last_undegraded":"2023-10-14T19:08:19.829675+0000","last_fullsized":"2023-10-14T19:08:19.829675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:39.801910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853302+0000","last_change":"2023-10-14T19:08:19.845478+0000","last_active":"2023-10-14T19:08:19.853302+0000","last_peered":"2023-10-14T19:08:19.853302+0000","last_clean":"2023-10-14T19:08:19.853302+0000","last_became_active":"2023-10-14T19:08:19.845224+0000","last_became_peered":"2023-10-14T19:08:19.845224+0000","last_unstale":"2023-10-14T19:08:19.853302+0000","last_undegraded":"2023-10-14T19:08:19.853302+0000","last_fullsized":"2023-10-14T19:08:19.853302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:14.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.829545+0000","last_change":"2023-10-14T19:08:18.847186+0000","last_active":"2023-10-14T19:08:19.829545+0000","last_peered":"2023-10-14T19:08:19.829545+0000","last_clean":"2023-10-14T19:08:19.829545+0000","last_became_active":"2023-10-14T19:08:18.846932+0000","last_became_peered":"2023-10-14T19:08:18.846932+0000","last_unstale":"2023-10-14T19:08:19.829545+0000","last_undegraded":"2023-10-14T19:08:19.829545+0000","last_fullsized":"2023-10-14T19:08:19.829545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:38.262731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853933+0000","last_change":"2023-10-14T19:08:19.844411+0000","last_active":"2023-10-14T19:08:19.853933+0000","last_peered":"2023-10-14T19:08:19.853933+0000","last_clean":"2023-10-14T19:08:19.853933+0000","last_became_active":"2023-10-14T19:08:19.844152+0000","last_became_peered":"2023-10-14T19:08:19.844152+0000","last_unstale":"2023-10-14T19:08:19.853933+0000","last_undegraded":"2023-10-14T19:08:19.853933+0000","last_fullsized":"2023-10-14T19:08:19.853933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:57.978082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839971+0000","last_change":"2023-10-14T19:08:18.838675+0000","last_active":"2023-10-14T19:08:19.839971+0000","last_peered":"2023-10-14T19:08:19.839971+0000","last_clean":"2023-10-14T19:08:19.839971+0000","last_became_active":"2023-10-14T19:08:18.838443+0000","last_became_peered":"2023-10-14T19:08:18.838443+0000","last_unstale":"2023-10-14T19:08:19.839971+0000","last_undegraded":"2023-10-14T19:08:19.839971+0000","last_fullsized":"2023-10-14T19:08:19.839971+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:27.508732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850875+0000","last_change":"2023-10-14T19:08:19.843492+0000","last_active":"2023-10-14T19:08:19.850875+0000","last_peered":"2023-10-14T19:08:19.850875+0000","last_clean":"2023-10-14T19:08:19.850875+0000","last_became_active":"2023-10-14T19:08:19.843261+0000","last_became_peered":"2023-10-14T19:08:19.843261+0000","last_unstale":"2023-10-14T19:08:19.850875+0000","last_undegraded":"2023-10-14T19:08:19.850875+0000","last_fullsized":"2023-10-14T19:08:19.850875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:42.014326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835988+0000","last_change":"2023-10-14T19:08:18.842157+0000","last_active":"2023-10-14T19:08:19.835988+0000","last_peered":"2023-10-14T19:08:19.835988+0000","last_clean":"2023-10-14T19:08:19.835988+0000","last_became_active":"2023-10-14T19:08:18.841739+0000","last_became_peered":"2023-10-14T19:08:18.841739+0000","last_unstale":"2023-10-14T19:08:19.835988+0000","last_undegraded":"2023-10-14T19:08:19.835988+0000","last_fullsized":"2023-10-14T19:08:19.835988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:29:47.414543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855756+0000","last_change":"2023-10-14T19:08:19.853372+0000","last_active":"2023-10-14T19:08:19.855756+0000","last_peered":"2023-10-14T19:08:19.855756+0000","last_clean":"2023-10-14T19:08:19.855756+0000","last_became_active":"2023-10-14T19:08:19.853103+0000","last_became_peered":"2023-10-14T19:08:19.853103+0000","last_unstale":"2023-10-14T19:08:19.855756+0000","last_undegraded":"2023-10-14T19:08:19.855756+0000","last_fullsized":"2023-10-14T19:08:19.855756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:58:46.423764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.830326+0000","last_change":"2023-10-14T19:08:18.840759+0000","last_active":"2023-10-14T19:08:19.830326+0000","last_peered":"2023-10-14T19:08:19.830326+0000","last_clean":"2023-10-14T19:08:19.830326+0000","last_became_active":"2023-10-14T19:08:18.840474+0000","last_became_peered":"2023-10-14T19:08:18.840474+0000","last_unstale":"2023-10-14T19:08:19.830326+0000","last_undegraded":"2023-10-14T19:08:19.830326+0000","last_fullsized":"2023-10-14T19:08:19.830326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:57.345151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849898+0000","last_change":"2023-10-14T19:08:19.837295+0000","last_active":"2023-10-14T19:08:19.849898+0000","last_peered":"2023-10-14T19:08:19.849898+0000","last_clean":"2023-10-14T19:08:19.849898+0000","last_became_active":"2023-10-14T19:08:19.837047+0000","last_became_peered":"2023-10-14T19:08:19.837047+0000","last_unstale":"2023-10-14T19:08:19.849898+0000","last_undegraded":"2023-10-14T19:08:19.849898+0000","last_fullsized":"2023-10-14T19:08:19.849898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:55.915193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835630+0000","last_change":"2023-10-14T19:08:18.844086+0000","last_active":"2023-10-14T19:08:19.835630+0000","last_peered":"2023-10-14T19:08:19.835630+0000","last_clean":"2023-10-14T19:08:19.835630+0000","last_became_active":"2023-10-14T19:08:18.843806+0000","last_became_peered":"2023-10-14T19:08:18.843806+0000","last_unstale":"2023-10-14T19:08:19.835630+0000","last_undegraded":"2023-10-14T19:08:19.835630+0000","last_fullsized":"2023-10-14T19:08:19.835630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:03.307513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852898+0000","last_change":"2023-10-14T19:08:19.851931+0000","last_active":"2023-10-14T19:08:19.852898+0000","last_peered":"2023-10-14T19:08:19.852898+0000","last_clean":"2023-10-14T19:08:19.852898+0000","last_became_active":"2023-10-14T19:08:19.851694+0000","last_became_peered":"2023-10-14T19:08:19.851694+0000","last_unstale":"2023-10-14T19:08:19.852898+0000","last_undegraded":"2023-10-14T19:08:19.852898+0000","last_fullsized":"2023-10-14T19:08:19.852898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:11:35.083551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856771+0000","last_change":"2023-10-14T19:08:18.843473+0000","last_active":"2023-10-14T19:08:19.856771+0000","last_peered":"2023-10-14T19:08:19.856771+0000","last_clean":"2023-10-14T19:08:19.856771+0000","last_became_active":"2023-10-14T19:08:18.843164+0000","last_became_peered":"2023-10-14T19:08:18.843164+0000","last_unstale":"2023-10-14T19:08:19.856771+0000","last_undegraded":"2023-10-14T19:08:19.856771+0000","last_fullsized":"2023-10-14T19:08:19.856771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.051868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.836032+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:08:19.836032+0000","last_peered":"2023-10-14T19:08:19.836032+0000","last_clean":"2023-10-14T19:08:19.836032+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:08:19.836032+0000","last_undegraded":"2023-10-14T19:08:19.836032+0000","last_fullsized":"2023-10-14T19:08:19.836032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1556480,"data_stored":1001317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56999999999999995,"15min":0.68799999999999994},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75700000000000001,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.497},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.56999999999999995,"15min":0.68700000000000006},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.432}]},{"osd":1,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58299999999999996,"15min":0.68500000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55200000000000005,"15min":0.626},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.77700000000000002},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.65300000000000002,"15min":0.76000000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70099999999999996,"5min":3.23,"15min":3.23},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63,"15min":0.80400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71399999999999997,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65700000000000003,"15min":0.77800000000000002},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79300000000000004,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.497,"15min":0.58299999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.56699999999999995,"15min":0.71999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.65100000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68500000000000005,"5min":2.883,"15min":2.883},"last":0.46999999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59299999999999997,"15min":0.68100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83399999999999996,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.64000000000000001,"15min":0.81299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":5.383,"15min":5.383},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":411545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.59099999999999997,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72699999999999998,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60199999999999998,"15min":0.76800000000000002},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.498},{"interface":"front","average":{"1min":0.505,"5min":0.60399999999999998,"15min":0.78800000000000003},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.80400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.85799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.63100000000000001,"15min":0.81899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.63800000000000001,"15min":0.83799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75900000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73899999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40999999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.433}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":970752,"data_stored":411073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.495,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54700000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.438}]},{"osd":2,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52300000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.499},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":1.032,"15min":1.032},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.625,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.079,"15min":1.079},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1556480,"data_stored":1001281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.497,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.375},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.62,"15min":0.62},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72999999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80000000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61299999999999999,"15min":0.64300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":962560,"data_stored":411433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.36099999999999999},"min":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46100000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.37,"15min":0.44800000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.496,"5min":2.028,"15min":2.028},"last":0.27300000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.373,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54200000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.315},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.48699999999999999,"15min":0.80700000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55300000000000005,"5min":11.269,"15min":11.269},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.46200000000000002,"15min":0.77800000000000002},"min":{"1min":0.248,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":11.318,"15min":11.318},"last":0.252},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.434},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58699999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.67800000000000005},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.69299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.73399999999999999,"15min":1.0700000000000001},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93200000000000005,"5min":11.379,"15min":11.379},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.73199999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":11.404,"15min":11.404},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.65600000000000003},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.85199999999999998,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.74299999999999999,"15min":1.087},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99299999999999999,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.48299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":970752,"data_stored":412415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36099999999999999,"15min":0.39100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.311}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33300000000000002,"15min":0.371},"min":{"1min":0.21299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32900000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41699999999999998,"15min":0.45100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72699999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42599999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80600000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":410879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.67800000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":3.488,"15min":3.488},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.436}]},{"osd":3,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64300000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.502,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63900000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66400000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68500000000000005,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":412437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.504}]},{"osd":2,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.876,"15min":0.876},"last":0.441},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.61699999999999999,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.375}]},{"osd":6,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:08:23.958 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:08:24.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.110+0000 7f8d51ab3700 1 Processor -- start 2023-10-14T19:08:24.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.110+0000 7f8d51ab3700 1 -- start start 2023-10-14T19:08:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d51ab3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d4c0cb5a0 0x7f8d4c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d51ab3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d51ab3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c15ae40 con 0x7f8d4c0cde50 2023-10-14T19:08:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d51ab3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c0d13f0 con 0x7f8d4c0cb5a0 2023-10-14T19:08:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d51ab3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c15ab60 con 0x7f8d4c0cd9e0 2023-10-14T19:08:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d4bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8d4c0cde50 0x7f8d4c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37706/0 (socket says 172.21.15.7:37706) 2023-10-14T19:08:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d4bfff700 1 -- 172.21.15.7:0/1891510932 learned_addr learned my addr 172.21.15.7:0/1891510932 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d4affd700 1 --2- 172.21.15.7:0/1891510932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.111+0000 7f8d4b7fe700 1 --2- 172.21.15.7:0/1891510932 >> v2:172.21.15.148:3300/0 conn(0x7f8d4c0cb5a0 0x7f8d4c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4a7fc700 1 -- 172.21.15.7:0/1891510932 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796395200 0 0) 0x7f8d4c15ae40 con 0x7f8d4c0cde50 2023-10-14T19:08:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4a7fc700 1 -- 172.21.15.7:0/1891510932 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d34003570 con 0x7f8d4c0cde50 2023-10-14T19:08:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4affd700 1 -- 172.21.15.7:0/1891510932 >> v2:172.21.15.148:3300/0 conn(0x7f8d4c0cb5a0 msgr2=0x7f8d4c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4affd700 1 --2- 172.21.15.7:0/1891510932 >> v2:172.21.15.148:3300/0 conn(0x7f8d4c0cb5a0 0x7f8d4c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4affd700 1 -- 172.21.15.7:0/1891510932 >> v1:172.21.15.7:6789/0 conn(0x7f8d4c0cde50 legacy=0x7f8d4c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4a7fc700 1 -- 172.21.15.7:0/1891510932 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253716828 0 0) 0x7f8d34003570 con 0x7f8d4c0cde50 2023-10-14T19:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4affd700 1 -- 172.21.15.7:0/1891510932 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0ccf00 con 0x7f8d4c0cd9e0 2023-10-14T19:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4b7fe700 1 --2- 172.21.15.7:0/1891510932 >> v2:172.21.15.148:3300/0 conn(0x7f8d4c0cb5a0 0x7f8d4c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4affd700 1 --2- 172.21.15.7:0/1891510932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c159ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d400098e0 tx=0x7f8d400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72021527056ecf76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4a7fc700 1 -- 172.21.15.7:0/1891510932 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440017f0 con 0x7f8d4c0cd9e0 2023-10-14T19:08:24.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4a7fc700 1 -- 172.21.15.7:0/1891510932 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40011420 con 0x7f8d4c0cd9e0 2023-10-14T19:08:24.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.112+0000 7f8d4a7fc700 1 -- 172.21.15.7:0/1891510932 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400117c0 con 0x7f8d4c0cd9e0 2023-10-14T19:08:24.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 -- 172.21.15.7:0/1891510932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 msgr2=0x7f8d4c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/1891510932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c159ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d400098e0 tx=0x7f8d400091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 -- 172.21.15.7:0/1891510932 shutdown_connections 2023-10-14T19:08:24.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/1891510932 >> v2:172.21.15.148:3300/0 conn(0x7f8d4c0cb5a0 0x7f8d4c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/1891510932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c159ec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 -- 172.21.15.7:0/1891510932 >> 172.21.15.7:0/1891510932 conn(0x7f8d4c070e30 msgr2=0x7f8d4c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:24.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 -- 172.21.15.7:0/1891510932 shutdown_connections 2023-10-14T19:08:24.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.113+0000 7f8d51ab3700 1 -- 172.21.15.7:0/1891510932 wait complete. 2023-10-14T19:08:24.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.114+0000 7f8d51ab3700 1 Processor -- start 2023-10-14T19:08:24.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.114+0000 7f8d51ab3700 1 -- start start 2023-10-14T19:08:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d51ab3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d4c0cb5a0 0x7f8d4c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d51ab3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d51ab3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 0x7f8d4c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d51ab3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0caac0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d51ab3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0ca630 con 0x7f8d4c0cb5a0 2023-10-14T19:08:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d51ab3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0c9a20 con 0x7f8d4c0cd9e0 2023-10-14T19:08:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 0x7f8d4c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 0x7f8d4c0b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44316/0 (socket says 172.21.15.7:44316) 2023-10-14T19:08:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d4c0cb5a0 0x7f8d4c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 -- 172.21.15.7:0/2829988640 learned_addr learned my addr 172.21.15.7:0/2829988640 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4affd700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 -- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 msgr2=0x7f8d4c0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c0c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 -- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d4c0cb5a0 msgr2=0x7f8d4c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d4c0cb5a0 0x7f8d4c1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 -- 172.21.15.7:0/2829988640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c009420 con 0x7f8d4c0c9530 2023-10-14T19:08:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.115+0000 7f8d4bfff700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 0x7f8d4c0b44f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400cbe0 tx=0x7f8d44001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.116+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44004dc0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.116+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400a590 con 0x7f8d4c0c9530 2023-10-14T19:08:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.116+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d40009420 con 0x7f8d4c0c9530 2023-10-14T19:08:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.116+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400a950 con 0x7f8d4c0c9530 2023-10-14T19:08:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.116+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c0c9fe0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.117+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c04c3c0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.117+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8d4400acc0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.117+0000 7f8d337fe700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d380671a0 0x7f8d38069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.117+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d44083ea0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.118+0000 7f8d4b7fe700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d380671a0 0x7f8d38069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.118+0000 7f8d4b7fe700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d380671a0 0x7f8d38069650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009f40 tx=0x7f8d3c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.122+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d44050db0 con 0x7f8d4c0c9530 2023-10-14T19:08:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.312+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d4c0cd1e0 con 0x7f8d380671a0 2023-10-14T19:08:24.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.321+0000 7f8d337fe700 1 -- 172.21.15.7:0/2829988640 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289560 (secure 0 0 0) 0x7f8d4c0cd1e0 con 0x7f8d380671a0 2023-10-14T19:08:24.325 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d380671a0 msgr2=0x7f8d38069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d380671a0 0x7f8d38069650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009f40 tx=0x7f8d3c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 msgr2=0x7f8d4c0b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 0x7f8d4c0b44f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400cbe0 tx=0x7f8d44001640 comp rx=0 tx=0).stop 2023-10-14T19:08:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 shutdown_connections 2023-10-14T19:08:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d380671a0 0x7f8d38069650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d4c0cb5a0 0x7f8d4c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d4c0c9530 0x7f8d4c0b44f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 --2- 172.21.15.7:0/2829988640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4c0cd9e0 0x7f8d4c0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 >> 172.21.15.7:0/2829988640 conn(0x7f8d4c070e30 msgr2=0x7f8d4c0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 shutdown_connections 2023-10-14T19:08:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.324+0000 7f8d51ab3700 1 -- 172.21.15.7:0/2829988640 wait complete. 2023-10-14T19:08:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:08:24.337 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-10-14T19:08:23.699122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2407496,"kb_used_data":8712,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752567224,"statfs":{"total":773094113280,"available":770628837376,"internally_reserved":0,"allocated":8921088,"data_stored":4472380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877486"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852772+0000","last_change":"2023-10-14T19:08:19.842640+0000","last_active":"2023-10-14T19:08:19.852772+0000","last_peered":"2023-10-14T19:08:19.852772+0000","last_clean":"2023-10-14T19:08:19.852772+0000","last_became_active":"2023-10-14T19:08:19.842375+0000","last_became_peered":"2023-10-14T19:08:19.842375+0000","last_unstale":"2023-10-14T19:08:19.852772+0000","last_undegraded":"2023-10-14T19:08:19.852772+0000","last_fullsized":"2023-10-14T19:08:19.852772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:34.783981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.842893+0000","last_change":"2023-10-14T19:08:19.835591+0000","last_active":"2023-10-14T19:08:19.842893+0000","last_peered":"2023-10-14T19:08:19.842893+0000","last_clean":"2023-10-14T19:08:19.842893+0000","last_became_active":"2023-10-14T19:08:19.835384+0000","last_became_peered":"2023-10-14T19:08:19.835384+0000","last_unstale":"2023-10-14T19:08:19.842893+0000","last_undegraded":"2023-10-14T19:08:19.842893+0000","last_fullsized":"2023-10-14T19:08:19.842893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:02.625808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853602+0000","last_change":"2023-10-14T19:08:19.851581+0000","last_active":"2023-10-14T19:08:19.853602+0000","last_peered":"2023-10-14T19:08:19.853602+0000","last_clean":"2023-10-14T19:08:19.853602+0000","last_became_active":"2023-10-14T19:08:19.851265+0000","last_became_peered":"2023-10-14T19:08:19.851265+0000","last_unstale":"2023-10-14T19:08:19.853602+0000","last_undegraded":"2023-10-14T19:08:19.853602+0000","last_fullsized":"2023-10-14T19:08:19.853602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:05:36.593381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.848862+0000","last_change":"2023-10-14T19:08:19.845802+0000","last_active":"2023-10-14T19:08:19.848862+0000","last_peered":"2023-10-14T19:08:19.848862+0000","last_clean":"2023-10-14T19:08:19.848862+0000","last_became_active":"2023-10-14T19:08:19.845512+0000","last_became_peered":"2023-10-14T19:08:19.845512+0000","last_unstale":"2023-10-14T19:08:19.848862+0000","last_undegraded":"2023-10-14T19:08:19.848862+0000","last_fullsized":"2023-10-14T19:08:19.848862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:15.216037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853525+0000","last_change":"2023-10-14T19:08:19.846606+0000","last_active":"2023-10-14T19:08:19.853525+0000","last_peered":"2023-10-14T19:08:19.853525+0000","last_clean":"2023-10-14T19:08:19.853525+0000","last_became_active":"2023-10-14T19:08:19.846337+0000","last_became_peered":"2023-10-14T19:08:19.846337+0000","last_unstale":"2023-10-14T19:08:19.853525+0000","last_undegraded":"2023-10-14T19:08:19.853525+0000","last_fullsized":"2023-10-14T19:08:19.853525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:56.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.854394+0000","last_change":"2023-10-14T19:08:19.848473+0000","last_active":"2023-10-14T19:08:19.854394+0000","last_peered":"2023-10-14T19:08:19.854394+0000","last_clean":"2023-10-14T19:08:19.854394+0000","last_became_active":"2023-10-14T19:08:19.848195+0000","last_became_peered":"2023-10-14T19:08:19.848195+0000","last_unstale":"2023-10-14T19:08:19.854394+0000","last_undegraded":"2023-10-14T19:08:19.854394+0000","last_fullsized":"2023-10-14T19:08:19.854394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:48:35.139882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.848932+0000","last_change":"2023-10-14T19:08:19.846230+0000","last_active":"2023-10-14T19:08:19.848932+0000","last_peered":"2023-10-14T19:08:19.848932+0000","last_clean":"2023-10-14T19:08:19.848932+0000","last_became_active":"2023-10-14T19:08:19.845878+0000","last_became_peered":"2023-10-14T19:08:19.845878+0000","last_unstale":"2023-10-14T19:08:19.848932+0000","last_undegraded":"2023-10-14T19:08:19.848932+0000","last_fullsized":"2023-10-14T19:08:19.848932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:06.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856319+0000","last_change":"2023-10-14T19:08:19.854560+0000","last_active":"2023-10-14T19:08:19.856319+0000","last_peered":"2023-10-14T19:08:19.856319+0000","last_clean":"2023-10-14T19:08:19.856319+0000","last_became_active":"2023-10-14T19:08:19.854208+0000","last_became_peered":"2023-10-14T19:08:19.854208+0000","last_unstale":"2023-10-14T19:08:19.856319+0000","last_undegraded":"2023-10-14T19:08:19.856319+0000","last_fullsized":"2023-10-14T19:08:19.856319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:32.054211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856388+0000","last_change":"2023-10-14T19:08:19.854746+0000","last_active":"2023-10-14T19:08:19.856388+0000","last_peered":"2023-10-14T19:08:19.856388+0000","last_clean":"2023-10-14T19:08:19.856388+0000","last_became_active":"2023-10-14T19:08:19.854128+0000","last_became_peered":"2023-10-14T19:08:19.854128+0000","last_unstale":"2023-10-14T19:08:19.856388+0000","last_undegraded":"2023-10-14T19:08:19.856388+0000","last_fullsized":"2023-10-14T19:08:19.856388+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:32:35.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850858+0000","last_change":"2023-10-14T19:08:19.839064+0000","last_active":"2023-10-14T19:08:19.850858+0000","last_peered":"2023-10-14T19:08:19.850858+0000","last_clean":"2023-10-14T19:08:19.850858+0000","last_became_active":"2023-10-14T19:08:19.838813+0000","last_became_peered":"2023-10-14T19:08:19.838813+0000","last_unstale":"2023-10-14T19:08:19.850858+0000","last_undegraded":"2023-10-14T19:08:19.850858+0000","last_fullsized":"2023-10-14T19:08:19.850858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.624318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852830+0000","last_change":"2023-10-14T19:08:19.844621+0000","last_active":"2023-10-14T19:08:19.852830+0000","last_peered":"2023-10-14T19:08:19.852830+0000","last_clean":"2023-10-14T19:08:19.852830+0000","last_became_active":"2023-10-14T19:08:19.844359+0000","last_became_peered":"2023-10-14T19:08:19.844359+0000","last_unstale":"2023-10-14T19:08:19.852830+0000","last_undegraded":"2023-10-14T19:08:19.852830+0000","last_fullsized":"2023-10-14T19:08:19.852830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:41.639763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850952+0000","last_change":"2023-10-14T19:08:19.840461+0000","last_active":"2023-10-14T19:08:19.850952+0000","last_peered":"2023-10-14T19:08:19.850952+0000","last_clean":"2023-10-14T19:08:19.850952+0000","last_became_active":"2023-10-14T19:08:19.840163+0000","last_became_peered":"2023-10-14T19:08:19.840163+0000","last_unstale":"2023-10-14T19:08:19.850952+0000","last_undegraded":"2023-10-14T19:08:19.850952+0000","last_fullsized":"2023-10-14T19:08:19.850952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:56.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852046+0000","last_change":"2023-10-14T19:08:19.843654+0000","last_active":"2023-10-14T19:08:19.852046+0000","last_peered":"2023-10-14T19:08:19.852046+0000","last_clean":"2023-10-14T19:08:19.852046+0000","last_became_active":"2023-10-14T19:08:19.843339+0000","last_became_peered":"2023-10-14T19:08:19.843339+0000","last_unstale":"2023-10-14T19:08:19.852046+0000","last_undegraded":"2023-10-14T19:08:19.852046+0000","last_fullsized":"2023-10-14T19:08:19.852046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:57.180996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849020+0000","last_change":"2023-10-14T19:08:19.847440+0000","last_active":"2023-10-14T19:08:19.849020+0000","last_peered":"2023-10-14T19:08:19.849020+0000","last_clean":"2023-10-14T19:08:19.849020+0000","last_became_active":"2023-10-14T19:08:19.846965+0000","last_became_peered":"2023-10-14T19:08:19.846965+0000","last_unstale":"2023-10-14T19:08:19.849020+0000","last_undegraded":"2023-10-14T19:08:19.849020+0000","last_fullsized":"2023-10-14T19:08:19.849020+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:36.531908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.851745+0000","last_change":"2023-10-14T19:08:19.845381+0000","last_active":"2023-10-14T19:08:19.851745+0000","last_peered":"2023-10-14T19:08:19.851745+0000","last_clean":"2023-10-14T19:08:19.851745+0000","last_became_active":"2023-10-14T19:08:19.844779+0000","last_became_peered":"2023-10-14T19:08:19.844779+0000","last_unstale":"2023-10-14T19:08:19.851745+0000","last_undegraded":"2023-10-14T19:08:19.851745+0000","last_fullsized":"2023-10-14T19:08:19.851745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:05:36.593381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850059+0000","last_change":"2023-10-14T19:08:19.842813+0000","last_active":"2023-10-14T19:08:19.850059+0000","last_peered":"2023-10-14T19:08:19.850059+0000","last_clean":"2023-10-14T19:08:19.850059+0000","last_became_active":"2023-10-14T19:08:19.842554+0000","last_became_peered":"2023-10-14T19:08:19.842554+0000","last_unstale":"2023-10-14T19:08:19.850059+0000","last_undegraded":"2023-10-14T19:08:19.850059+0000","last_fullsized":"2023-10-14T19:08:19.850059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:07:11.580964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849975+0000","last_change":"2023-10-14T19:08:19.841961+0000","last_active":"2023-10-14T19:08:19.849975+0000","last_peered":"2023-10-14T19:08:19.849975+0000","last_clean":"2023-10-14T19:08:19.849975+0000","last_became_active":"2023-10-14T19:08:19.841674+0000","last_became_peered":"2023-10-14T19:08:19.841674+0000","last_unstale":"2023-10-14T19:08:19.849975+0000","last_undegraded":"2023-10-14T19:08:19.849975+0000","last_fullsized":"2023-10-14T19:08:19.849975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:56.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839113+0000","last_change":"2023-10-14T19:08:19.837525+0000","last_active":"2023-10-14T19:08:19.839113+0000","last_peered":"2023-10-14T19:08:19.839113+0000","last_clean":"2023-10-14T19:08:19.839113+0000","last_became_active":"2023-10-14T19:08:19.837242+0000","last_became_peered":"2023-10-14T19:08:19.837242+0000","last_unstale":"2023-10-14T19:08:19.839113+0000","last_undegraded":"2023-10-14T19:08:19.839113+0000","last_fullsized":"2023-10-14T19:08:19.839113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:11.514947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853747+0000","last_change":"2023-10-14T19:08:19.850053+0000","last_active":"2023-10-14T19:08:19.853747+0000","last_peered":"2023-10-14T19:08:19.853747+0000","last_clean":"2023-10-14T19:08:19.853747+0000","last_became_active":"2023-10-14T19:08:19.843902+0000","last_became_peered":"2023-10-14T19:08:19.843902+0000","last_unstale":"2023-10-14T19:08:19.853747+0000","last_undegraded":"2023-10-14T19:08:19.853747+0000","last_fullsized":"2023-10-14T19:08:19.853747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:56.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.847069+0000","last_change":"2023-10-14T19:08:19.841769+0000","last_active":"2023-10-14T19:08:19.847069+0000","last_peered":"2023-10-14T19:08:19.847069+0000","last_clean":"2023-10-14T19:08:19.847069+0000","last_became_active":"2023-10-14T19:08:19.840294+0000","last_became_peered":"2023-10-14T19:08:19.840294+0000","last_unstale":"2023-10-14T19:08:19.847069+0000","last_undegraded":"2023-10-14T19:08:19.847069+0000","last_fullsized":"2023-10-14T19:08:19.847069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:26.319047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839227+0000","last_change":"2023-10-14T19:08:19.837762+0000","last_active":"2023-10-14T19:08:19.839227+0000","last_peered":"2023-10-14T19:08:19.839227+0000","last_clean":"2023-10-14T19:08:19.839227+0000","last_became_active":"2023-10-14T19:08:19.837462+0000","last_became_peered":"2023-10-14T19:08:19.837462+0000","last_unstale":"2023-10-14T19:08:19.839227+0000","last_undegraded":"2023-10-14T19:08:19.839227+0000","last_fullsized":"2023-10-14T19:08:19.839227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:37:28.981675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.845009+0000","last_change":"2023-10-14T19:08:19.839131+0000","last_active":"2023-10-14T19:08:19.845009+0000","last_peered":"2023-10-14T19:08:19.845009+0000","last_clean":"2023-10-14T19:08:19.845009+0000","last_became_active":"2023-10-14T19:08:19.838887+0000","last_became_peered":"2023-10-14T19:08:19.838887+0000","last_unstale":"2023-10-14T19:08:19.845009+0000","last_undegraded":"2023-10-14T19:08:19.845009+0000","last_fullsized":"2023-10-14T19:08:19.845009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:35.984479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850958+0000","last_change":"2023-10-14T19:08:19.841056+0000","last_active":"2023-10-14T19:08:19.850958+0000","last_peered":"2023-10-14T19:08:19.850958+0000","last_clean":"2023-10-14T19:08:19.850958+0000","last_became_active":"2023-10-14T19:08:19.840759+0000","last_became_peered":"2023-10-14T19:08:19.840759+0000","last_unstale":"2023-10-14T19:08:19.850958+0000","last_undegraded":"2023-10-14T19:08:19.850958+0000","last_fullsized":"2023-10-14T19:08:19.850958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:24.073959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.841023+0000","last_change":"2023-10-14T19:08:19.839469+0000","last_active":"2023-10-14T19:08:19.841023+0000","last_peered":"2023-10-14T19:08:19.841023+0000","last_clean":"2023-10-14T19:08:19.841023+0000","last_became_active":"2023-10-14T19:08:19.839204+0000","last_became_peered":"2023-10-14T19:08:19.839204+0000","last_unstale":"2023-10-14T19:08:19.841023+0000","last_undegraded":"2023-10-14T19:08:19.841023+0000","last_fullsized":"2023-10-14T19:08:19.841023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:19.410989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835982+0000","last_change":"2023-10-14T19:08:19.835005+0000","last_active":"2023-10-14T19:08:19.835982+0000","last_peered":"2023-10-14T19:08:19.835982+0000","last_clean":"2023-10-14T19:08:19.835982+0000","last_became_active":"2023-10-14T19:08:19.834720+0000","last_became_peered":"2023-10-14T19:08:19.834720+0000","last_unstale":"2023-10-14T19:08:19.835982+0000","last_undegraded":"2023-10-14T19:08:19.835982+0000","last_fullsized":"2023-10-14T19:08:19.835982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:45.244486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855775+0000","last_change":"2023-10-14T19:08:19.853420+0000","last_active":"2023-10-14T19:08:19.855775+0000","last_peered":"2023-10-14T19:08:19.855775+0000","last_clean":"2023-10-14T19:08:19.855775+0000","last_became_active":"2023-10-14T19:08:19.853166+0000","last_became_peered":"2023-10-14T19:08:19.853166+0000","last_unstale":"2023-10-14T19:08:19.855775+0000","last_undegraded":"2023-10-14T19:08:19.855775+0000","last_fullsized":"2023-10-14T19:08:19.855775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:23.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853282+0000","last_change":"2023-10-14T19:08:19.844713+0000","last_active":"2023-10-14T19:08:19.853282+0000","last_peered":"2023-10-14T19:08:19.853282+0000","last_clean":"2023-10-14T19:08:19.853282+0000","last_became_active":"2023-10-14T19:08:19.844433+0000","last_became_peered":"2023-10-14T19:08:19.844433+0000","last_unstale":"2023-10-14T19:08:19.853282+0000","last_undegraded":"2023-10-14T19:08:19.853282+0000","last_fullsized":"2023-10-14T19:08:19.853282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:32.054211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852619+0000","last_change":"2023-10-14T19:08:19.842683+0000","last_active":"2023-10-14T19:08:19.852619+0000","last_peered":"2023-10-14T19:08:19.852619+0000","last_clean":"2023-10-14T19:08:19.852619+0000","last_became_active":"2023-10-14T19:08:19.842392+0000","last_became_peered":"2023-10-14T19:08:19.842392+0000","last_unstale":"2023-10-14T19:08:19.852619+0000","last_undegraded":"2023-10-14T19:08:19.852619+0000","last_fullsized":"2023-10-14T19:08:19.852619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:55.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852311+0000","last_change":"2023-10-14T19:08:19.840639+0000","last_active":"2023-10-14T19:08:19.852311+0000","last_peered":"2023-10-14T19:08:19.852311+0000","last_clean":"2023-10-14T19:08:19.852311+0000","last_became_active":"2023-10-14T19:08:19.840373+0000","last_became_peered":"2023-10-14T19:08:19.840373+0000","last_unstale":"2023-10-14T19:08:19.852311+0000","last_undegraded":"2023-10-14T19:08:19.852311+0000","last_fullsized":"2023-10-14T19:08:19.852311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:46.976025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852540+0000","last_change":"2023-10-14T19:08:19.841739+0000","last_active":"2023-10-14T19:08:19.852540+0000","last_peered":"2023-10-14T19:08:19.852540+0000","last_clean":"2023-10-14T19:08:19.852540+0000","last_became_active":"2023-10-14T19:08:19.841480+0000","last_became_peered":"2023-10-14T19:08:19.841480+0000","last_unstale":"2023-10-14T19:08:19.852540+0000","last_undegraded":"2023-10-14T19:08:19.852540+0000","last_fullsized":"2023-10-14T19:08:19.852540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:24.073959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853035+0000","last_change":"2023-10-14T19:08:19.844006+0000","last_active":"2023-10-14T19:08:19.853035+0000","last_peered":"2023-10-14T19:08:19.853035+0000","last_clean":"2023-10-14T19:08:19.853035+0000","last_became_active":"2023-10-14T19:08:19.843742+0000","last_became_peered":"2023-10-14T19:08:19.843742+0000","last_unstale":"2023-10-14T19:08:19.853035+0000","last_undegraded":"2023-10-14T19:08:19.853035+0000","last_fullsized":"2023-10-14T19:08:19.853035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:57.978082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849949+0000","last_change":"2023-10-14T19:08:19.836519+0000","last_active":"2023-10-14T19:08:19.849949+0000","last_peered":"2023-10-14T19:08:19.849949+0000","last_clean":"2023-10-14T19:08:19.849949+0000","last_became_active":"2023-10-14T19:08:19.836232+0000","last_became_peered":"2023-10-14T19:08:19.836232+0000","last_unstale":"2023-10-14T19:08:19.849949+0000","last_undegraded":"2023-10-14T19:08:19.849949+0000","last_fullsized":"2023-10-14T19:08:19.849949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:34.493283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850522+0000","last_change":"2023-10-14T19:08:19.843039+0000","last_active":"2023-10-14T19:08:19.850522+0000","last_peered":"2023-10-14T19:08:19.850522+0000","last_clean":"2023-10-14T19:08:19.850522+0000","last_became_active":"2023-10-14T19:08:19.842775+0000","last_became_peered":"2023-10-14T19:08:19.842775+0000","last_unstale":"2023-10-14T19:08:19.850522+0000","last_undegraded":"2023-10-14T19:08:19.850522+0000","last_fullsized":"2023-10-14T19:08:19.850522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:01:24.479205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"77'4","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856169+0000","last_change":"2023-10-14T19:08:18.841776+0000","last_active":"2023-10-14T19:08:19.856169+0000","last_peered":"2023-10-14T19:08:19.856169+0000","last_clean":"2023-10-14T19:08:19.856169+0000","last_became_active":"2023-10-14T19:08:18.841501+0000","last_became_peered":"2023-10-14T19:08:18.841501+0000","last_unstale":"2023-10-14T19:08:19.856169+0000","last_undegraded":"2023-10-14T19:08:19.856169+0000","last_fullsized":"2023-10-14T19:08:19.856169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:07.157720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852751+0000","last_change":"2023-10-14T19:08:19.840940+0000","last_active":"2023-10-14T19:08:19.852751+0000","last_peered":"2023-10-14T19:08:19.852751+0000","last_clean":"2023-10-14T19:08:19.852751+0000","last_became_active":"2023-10-14T19:08:19.840649+0000","last_became_peered":"2023-10-14T19:08:19.840649+0000","last_unstale":"2023-10-14T19:08:19.852751+0000","last_undegraded":"2023-10-14T19:08:19.852751+0000","last_fullsized":"2023-10-14T19:08:19.852751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:29.373240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855648+0000","last_change":"2023-10-14T19:08:18.843527+0000","last_active":"2023-10-14T19:08:19.855648+0000","last_peered":"2023-10-14T19:08:19.855648+0000","last_clean":"2023-10-14T19:08:19.855648+0000","last_became_active":"2023-10-14T19:08:18.843086+0000","last_became_peered":"2023-10-14T19:08:18.843086+0000","last_unstale":"2023-10-14T19:08:19.855648+0000","last_undegraded":"2023-10-14T19:08:19.855648+0000","last_fullsized":"2023-10-14T19:08:19.855648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:33.490940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850933+0000","last_change":"2023-10-14T19:08:19.838773+0000","last_active":"2023-10-14T19:08:19.850933+0000","last_peered":"2023-10-14T19:08:19.850933+0000","last_clean":"2023-10-14T19:08:19.850933+0000","last_became_active":"2023-10-14T19:08:19.838501+0000","last_became_peered":"2023-10-14T19:08:19.838501+0000","last_unstale":"2023-10-14T19:08:19.850933+0000","last_undegraded":"2023-10-14T19:08:19.850933+0000","last_fullsized":"2023-10-14T19:08:19.850933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:28.511075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858139+0000","last_change":"2023-10-14T19:08:18.841640+0000","last_active":"2023-10-14T19:08:19.858139+0000","last_peered":"2023-10-14T19:08:19.858139+0000","last_clean":"2023-10-14T19:08:19.858139+0000","last_became_active":"2023-10-14T19:08:18.841337+0000","last_became_peered":"2023-10-14T19:08:18.841337+0000","last_unstale":"2023-10-14T19:08:19.858139+0000","last_undegraded":"2023-10-14T19:08:19.858139+0000","last_fullsized":"2023-10-14T19:08:19.858139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:39.621975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852952+0000","last_change":"2023-10-14T19:08:19.847477+0000","last_active":"2023-10-14T19:08:19.852952+0000","last_peered":"2023-10-14T19:08:19.852952+0000","last_clean":"2023-10-14T19:08:19.852952+0000","last_became_active":"2023-10-14T19:08:19.846902+0000","last_became_peered":"2023-10-14T19:08:19.846902+0000","last_unstale":"2023-10-14T19:08:19.852952+0000","last_undegraded":"2023-10-14T19:08:19.852952+0000","last_fullsized":"2023-10-14T19:08:19.852952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:48.704924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858069+0000","last_change":"2023-10-14T19:08:18.841826+0000","last_active":"2023-10-14T19:08:19.858069+0000","last_peered":"2023-10-14T19:08:19.858069+0000","last_clean":"2023-10-14T19:08:19.858069+0000","last_became_active":"2023-10-14T19:08:18.841343+0000","last_became_peered":"2023-10-14T19:08:18.841343+0000","last_unstale":"2023-10-14T19:08:19.858069+0000","last_undegraded":"2023-10-14T19:08:19.858069+0000","last_fullsized":"2023-10-14T19:08:19.858069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:13.660190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852528+0000","last_change":"2023-10-14T19:08:19.841438+0000","last_active":"2023-10-14T19:08:19.852528+0000","last_peered":"2023-10-14T19:08:19.852528+0000","last_clean":"2023-10-14T19:08:19.852528+0000","last_became_active":"2023-10-14T19:08:19.841166+0000","last_became_peered":"2023-10-14T19:08:19.841166+0000","last_unstale":"2023-10-14T19:08:19.852528+0000","last_undegraded":"2023-10-14T19:08:19.852528+0000","last_fullsized":"2023-10-14T19:08:19.852528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:53.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855629+0000","last_change":"2023-10-14T19:08:18.842675+0000","last_active":"2023-10-14T19:08:19.855629+0000","last_peered":"2023-10-14T19:08:19.855629+0000","last_clean":"2023-10-14T19:08:19.855629+0000","last_became_active":"2023-10-14T19:08:18.842321+0000","last_became_peered":"2023-10-14T19:08:18.842321+0000","last_unstale":"2023-10-14T19:08:19.855629+0000","last_undegraded":"2023-10-14T19:08:19.855629+0000","last_fullsized":"2023-10-14T19:08:19.855629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:14.368229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850712+0000","last_change":"2023-10-14T19:08:19.843047+0000","last_active":"2023-10-14T19:08:19.850712+0000","last_peered":"2023-10-14T19:08:19.850712+0000","last_clean":"2023-10-14T19:08:19.850712+0000","last_became_active":"2023-10-14T19:08:19.842230+0000","last_became_peered":"2023-10-14T19:08:19.842230+0000","last_unstale":"2023-10-14T19:08:19.850712+0000","last_undegraded":"2023-10-14T19:08:19.850712+0000","last_fullsized":"2023-10-14T19:08:19.850712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.624318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855601+0000","last_change":"2023-10-14T19:08:18.842427+0000","last_active":"2023-10-14T19:08:19.855601+0000","last_peered":"2023-10-14T19:08:19.855601+0000","last_clean":"2023-10-14T19:08:19.855601+0000","last_became_active":"2023-10-14T19:08:18.841998+0000","last_became_peered":"2023-10-14T19:08:18.841998+0000","last_unstale":"2023-10-14T19:08:19.855601+0000","last_undegraded":"2023-10-14T19:08:19.855601+0000","last_fullsized":"2023-10-14T19:08:19.855601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:14.229654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850624+0000","last_change":"2023-10-14T19:08:19.843876+0000","last_active":"2023-10-14T19:08:19.850624+0000","last_peered":"2023-10-14T19:08:19.850624+0000","last_clean":"2023-10-14T19:08:19.850624+0000","last_became_active":"2023-10-14T19:08:19.843566+0000","last_became_peered":"2023-10-14T19:08:19.843566+0000","last_unstale":"2023-10-14T19:08:19.850624+0000","last_undegraded":"2023-10-14T19:08:19.850624+0000","last_fullsized":"2023-10-14T19:08:19.850624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:39:11.610472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839045+0000","last_change":"2023-10-14T19:08:18.841704+0000","last_active":"2023-10-14T19:08:19.839045+0000","last_peered":"2023-10-14T19:08:19.839045+0000","last_clean":"2023-10-14T19:08:19.839045+0000","last_became_active":"2023-10-14T19:08:18.841372+0000","last_became_peered":"2023-10-14T19:08:18.841372+0000","last_unstale":"2023-10-14T19:08:19.839045+0000","last_undegraded":"2023-10-14T19:08:19.839045+0000","last_fullsized":"2023-10-14T19:08:19.839045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.051868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.851765+0000","last_change":"2023-10-14T19:08:19.845556+0000","last_active":"2023-10-14T19:08:19.851765+0000","last_peered":"2023-10-14T19:08:19.851765+0000","last_clean":"2023-10-14T19:08:19.851765+0000","last_became_active":"2023-10-14T19:08:19.845134+0000","last_became_peered":"2023-10-14T19:08:19.845134+0000","last_unstale":"2023-10-14T19:08:19.851765+0000","last_undegraded":"2023-10-14T19:08:19.851765+0000","last_fullsized":"2023-10-14T19:08:19.851765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:05.868663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.831344+0000","last_change":"2023-10-14T19:08:18.847762+0000","last_active":"2023-10-14T19:08:19.831344+0000","last_peered":"2023-10-14T19:08:19.831344+0000","last_clean":"2023-10-14T19:08:19.831344+0000","last_became_active":"2023-10-14T19:08:18.847404+0000","last_became_peered":"2023-10-14T19:08:18.847404+0000","last_unstale":"2023-10-14T19:08:19.831344+0000","last_undegraded":"2023-10-14T19:08:19.831344+0000","last_fullsized":"2023-10-14T19:08:19.831344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:29.069495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.844180+0000","last_change":"2023-10-14T19:08:19.837922+0000","last_active":"2023-10-14T19:08:19.844180+0000","last_peered":"2023-10-14T19:08:19.844180+0000","last_clean":"2023-10-14T19:08:19.844180+0000","last_became_active":"2023-10-14T19:08:19.837656+0000","last_became_peered":"2023-10-14T19:08:19.837656+0000","last_unstale":"2023-10-14T19:08:19.844180+0000","last_undegraded":"2023-10-14T19:08:19.844180+0000","last_fullsized":"2023-10-14T19:08:19.844180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:23.604722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.831571+0000","last_change":"2023-10-14T19:08:18.843957+0000","last_active":"2023-10-14T19:08:19.831571+0000","last_peered":"2023-10-14T19:08:19.831571+0000","last_clean":"2023-10-14T19:08:19.831571+0000","last_became_active":"2023-10-14T19:08:18.843633+0000","last_became_peered":"2023-10-14T19:08:18.843633+0000","last_unstale":"2023-10-14T19:08:19.831571+0000","last_undegraded":"2023-10-14T19:08:19.831571+0000","last_fullsized":"2023-10-14T19:08:19.831571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:54.980217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.854619+0000","last_change":"2023-10-14T19:08:19.847722+0000","last_active":"2023-10-14T19:08:19.854619+0000","last_peered":"2023-10-14T19:08:19.854619+0000","last_clean":"2023-10-14T19:08:19.854619+0000","last_became_active":"2023-10-14T19:08:19.847467+0000","last_became_peered":"2023-10-14T19:08:19.847467+0000","last_unstale":"2023-10-14T19:08:19.854619+0000","last_undegraded":"2023-10-14T19:08:19.854619+0000","last_fullsized":"2023-10-14T19:08:19.854619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:14.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.831095+0000","last_change":"2023-10-14T19:08:18.844401+0000","last_active":"2023-10-14T19:08:19.831095+0000","last_peered":"2023-10-14T19:08:19.831095+0000","last_clean":"2023-10-14T19:08:19.831095+0000","last_became_active":"2023-10-14T19:08:18.844154+0000","last_became_peered":"2023-10-14T19:08:18.844154+0000","last_unstale":"2023-10-14T19:08:19.831095+0000","last_undegraded":"2023-10-14T19:08:19.831095+0000","last_fullsized":"2023-10-14T19:08:19.831095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:47.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.857392+0000","last_change":"2023-10-14T19:08:19.852338+0000","last_active":"2023-10-14T19:08:19.857392+0000","last_peered":"2023-10-14T19:08:19.857392+0000","last_clean":"2023-10-14T19:08:19.857392+0000","last_became_active":"2023-10-14T19:08:19.852028+0000","last_became_peered":"2023-10-14T19:08:19.852028+0000","last_unstale":"2023-10-14T19:08:19.857392+0000","last_undegraded":"2023-10-14T19:08:19.857392+0000","last_fullsized":"2023-10-14T19:08:19.857392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:23.327993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"77'3","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856870+0000","last_change":"2023-10-14T19:08:18.843380+0000","last_active":"2023-10-14T19:08:19.856870+0000","last_peered":"2023-10-14T19:08:19.856870+0000","last_clean":"2023-10-14T19:08:19.856870+0000","last_became_active":"2023-10-14T19:08:18.843103+0000","last_became_peered":"2023-10-14T19:08:18.843103+0000","last_unstale":"2023-10-14T19:08:19.856870+0000","last_undegraded":"2023-10-14T19:08:19.856870+0000","last_fullsized":"2023-10-14T19:08:19.856870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:09.248290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853319+0000","last_change":"2023-10-14T19:08:19.845574+0000","last_active":"2023-10-14T19:08:19.853319+0000","last_peered":"2023-10-14T19:08:19.853319+0000","last_clean":"2023-10-14T19:08:19.853319+0000","last_became_active":"2023-10-14T19:08:19.845301+0000","last_became_peered":"2023-10-14T19:08:19.845301+0000","last_unstale":"2023-10-14T19:08:19.853319+0000","last_undegraded":"2023-10-14T19:08:19.853319+0000","last_fullsized":"2023-10-14T19:08:19.853319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:32:35.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"77'6","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.861291+0000","last_change":"2023-10-14T19:08:18.841730+0000","last_active":"2023-10-14T19:08:19.861291+0000","last_peered":"2023-10-14T19:08:19.861291+0000","last_clean":"2023-10-14T19:08:19.861291+0000","last_became_active":"2023-10-14T19:08:18.841479+0000","last_became_peered":"2023-10-14T19:08:18.841479+0000","last_unstale":"2023-10-14T19:08:19.861291+0000","last_undegraded":"2023-10-14T19:08:19.861291+0000","last_fullsized":"2023-10-14T19:08:19.861291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:34.982136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.851904+0000","last_change":"2023-10-14T19:08:19.843865+0000","last_active":"2023-10-14T19:08:19.851904+0000","last_peered":"2023-10-14T19:08:19.851904+0000","last_clean":"2023-10-14T19:08:19.851904+0000","last_became_active":"2023-10-14T19:08:19.843588+0000","last_became_peered":"2023-10-14T19:08:19.843588+0000","last_unstale":"2023-10-14T19:08:19.851904+0000","last_undegraded":"2023-10-14T19:08:19.851904+0000","last_fullsized":"2023-10-14T19:08:19.851904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:25.245663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858242+0000","last_change":"2023-10-14T19:08:18.840751+0000","last_active":"2023-10-14T19:08:19.858242+0000","last_peered":"2023-10-14T19:08:19.858242+0000","last_clean":"2023-10-14T19:08:19.858242+0000","last_became_active":"2023-10-14T19:08:18.840429+0000","last_became_peered":"2023-10-14T19:08:18.840429+0000","last_unstale":"2023-10-14T19:08:19.858242+0000","last_undegraded":"2023-10-14T19:08:19.858242+0000","last_fullsized":"2023-10-14T19:08:19.858242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:09.248290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852069+0000","last_change":"2023-10-14T19:08:19.844112+0000","last_active":"2023-10-14T19:08:19.852069+0000","last_peered":"2023-10-14T19:08:19.852069+0000","last_clean":"2023-10-14T19:08:19.852069+0000","last_became_active":"2023-10-14T19:08:19.843867+0000","last_became_peered":"2023-10-14T19:08:19.843867+0000","last_unstale":"2023-10-14T19:08:19.852069+0000","last_undegraded":"2023-10-14T19:08:19.852069+0000","last_fullsized":"2023-10-14T19:08:19.852069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:48:16.289101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.833475+0000","last_change":"2023-10-14T19:08:18.844067+0000","last_active":"2023-10-14T19:08:19.833475+0000","last_peered":"2023-10-14T19:08:19.833475+0000","last_clean":"2023-10-14T19:08:19.833475+0000","last_became_active":"2023-10-14T19:08:18.843800+0000","last_became_peered":"2023-10-14T19:08:18.843800+0000","last_unstale":"2023-10-14T19:08:19.833475+0000","last_undegraded":"2023-10-14T19:08:19.833475+0000","last_fullsized":"2023-10-14T19:08:19.833475+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:18.875481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852385+0000","last_change":"2023-10-14T19:08:19.839759+0000","last_active":"2023-10-14T19:08:19.852385+0000","last_peered":"2023-10-14T19:08:19.852385+0000","last_clean":"2023-10-14T19:08:19.852385+0000","last_became_active":"2023-10-14T19:08:19.839514+0000","last_became_peered":"2023-10-14T19:08:19.839514+0000","last_unstale":"2023-10-14T19:08:19.852385+0000","last_undegraded":"2023-10-14T19:08:19.852385+0000","last_fullsized":"2023-10-14T19:08:19.852385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:55.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.840099+0000","last_change":"2023-10-14T19:08:18.844383+0000","last_active":"2023-10-14T19:08:19.840099+0000","last_peered":"2023-10-14T19:08:19.840099+0000","last_clean":"2023-10-14T19:08:19.840099+0000","last_became_active":"2023-10-14T19:08:18.844120+0000","last_became_peered":"2023-10-14T19:08:18.844120+0000","last_unstale":"2023-10-14T19:08:19.840099+0000","last_undegraded":"2023-10-14T19:08:19.840099+0000","last_fullsized":"2023-10-14T19:08:19.840099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:44.242143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835988+0000","last_change":"2023-10-14T19:08:19.834948+0000","last_active":"2023-10-14T19:08:19.835988+0000","last_peered":"2023-10-14T19:08:19.835988+0000","last_clean":"2023-10-14T19:08:19.835988+0000","last_became_active":"2023-10-14T19:08:19.834671+0000","last_became_peered":"2023-10-14T19:08:19.834671+0000","last_unstale":"2023-10-14T19:08:19.835988+0000","last_undegraded":"2023-10-14T19:08:19.835988+0000","last_fullsized":"2023-10-14T19:08:19.835988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:55.915193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"77'8","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.861786+0000","last_change":"2023-10-14T19:08:18.838105+0000","last_active":"2023-10-14T19:08:19.861786+0000","last_peered":"2023-10-14T19:08:19.861786+0000","last_clean":"2023-10-14T19:08:19.861786+0000","last_became_active":"2023-10-14T19:08:18.837842+0000","last_became_peered":"2023-10-14T19:08:18.837842+0000","last_unstale":"2023-10-14T19:08:19.861786+0000","last_undegraded":"2023-10-14T19:08:19.861786+0000","last_fullsized":"2023-10-14T19:08:19.861786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:55.059659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853123+0000","last_change":"2023-10-14T19:08:19.851783+0000","last_active":"2023-10-14T19:08:19.853123+0000","last_peered":"2023-10-14T19:08:19.853123+0000","last_clean":"2023-10-14T19:08:19.853123+0000","last_became_active":"2023-10-14T19:08:19.851477+0000","last_became_peered":"2023-10-14T19:08:19.851477+0000","last_unstale":"2023-10-14T19:08:19.853123+0000","last_undegraded":"2023-10-14T19:08:19.853123+0000","last_fullsized":"2023-10-14T19:08:19.853123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:00.094148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855855+0000","last_change":"2023-10-14T19:08:18.846105+0000","last_active":"2023-10-14T19:08:19.855855+0000","last_peered":"2023-10-14T19:08:19.855855+0000","last_clean":"2023-10-14T19:08:19.855855+0000","last_became_active":"2023-10-14T19:08:18.845850+0000","last_became_peered":"2023-10-14T19:08:18.845850+0000","last_unstale":"2023-10-14T19:08:19.855855+0000","last_undegraded":"2023-10-14T19:08:19.855855+0000","last_fullsized":"2023-10-14T19:08:19.855855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:36.418948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852790+0000","last_change":"2023-10-14T19:08:19.843960+0000","last_active":"2023-10-14T19:08:19.852790+0000","last_peered":"2023-10-14T19:08:19.852790+0000","last_clean":"2023-10-14T19:08:19.852790+0000","last_became_active":"2023-10-14T19:08:19.843598+0000","last_became_peered":"2023-10-14T19:08:19.843598+0000","last_unstale":"2023-10-14T19:08:19.852790+0000","last_undegraded":"2023-10-14T19:08:19.852790+0000","last_fullsized":"2023-10-14T19:08:19.852790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:57.978082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.859213+0000","last_change":"2023-10-14T19:08:18.844177+0000","last_active":"2023-10-14T19:08:19.859213+0000","last_peered":"2023-10-14T19:08:19.859213+0000","last_clean":"2023-10-14T19:08:19.859213+0000","last_became_active":"2023-10-14T19:08:18.843934+0000","last_became_peered":"2023-10-14T19:08:18.843934+0000","last_unstale":"2023-10-14T19:08:19.859213+0000","last_undegraded":"2023-10-14T19:08:19.859213+0000","last_fullsized":"2023-10-14T19:08:19.859213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:28.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853337+0000","last_change":"2023-10-14T19:08:19.846485+0000","last_active":"2023-10-14T19:08:19.853337+0000","last_peered":"2023-10-14T19:08:19.853337+0000","last_clean":"2023-10-14T19:08:19.853337+0000","last_became_active":"2023-10-14T19:08:19.846215+0000","last_became_peered":"2023-10-14T19:08:19.846215+0000","last_unstale":"2023-10-14T19:08:19.853337+0000","last_undegraded":"2023-10-14T19:08:19.853337+0000","last_fullsized":"2023-10-14T19:08:19.853337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:48:35.139882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.842469+0000","last_change":"2023-10-14T19:08:18.846136+0000","last_active":"2023-10-14T19:08:19.842469+0000","last_peered":"2023-10-14T19:08:19.842469+0000","last_clean":"2023-10-14T19:08:19.842469+0000","last_became_active":"2023-10-14T19:08:18.845834+0000","last_became_peered":"2023-10-14T19:08:18.845834+0000","last_unstale":"2023-10-14T19:08:19.842469+0000","last_undegraded":"2023-10-14T19:08:19.842469+0000","last_fullsized":"2023-10-14T19:08:19.842469+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:56.975739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849001+0000","last_change":"2023-10-14T19:08:19.847207+0000","last_active":"2023-10-14T19:08:19.849001+0000","last_peered":"2023-10-14T19:08:19.849001+0000","last_clean":"2023-10-14T19:08:19.849001+0000","last_became_active":"2023-10-14T19:08:19.846547+0000","last_became_peered":"2023-10-14T19:08:19.846547+0000","last_unstale":"2023-10-14T19:08:19.849001+0000","last_undegraded":"2023-10-14T19:08:19.849001+0000","last_fullsized":"2023-10-14T19:08:19.849001+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:47.574705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.858206+0000","last_change":"2023-10-14T19:08:18.835076+0000","last_active":"2023-10-14T19:08:19.858206+0000","last_peered":"2023-10-14T19:08:19.858206+0000","last_clean":"2023-10-14T19:08:19.858206+0000","last_became_active":"2023-10-14T19:08:18.834740+0000","last_became_peered":"2023-10-14T19:08:18.834740+0000","last_unstale":"2023-10-14T19:08:19.858206+0000","last_undegraded":"2023-10-14T19:08:19.858206+0000","last_fullsized":"2023-10-14T19:08:19.858206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:39:10.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.854265+0000","last_change":"2023-10-14T19:08:19.844941+0000","last_active":"2023-10-14T19:08:19.854265+0000","last_peered":"2023-10-14T19:08:19.854265+0000","last_clean":"2023-10-14T19:08:19.854265+0000","last_became_active":"2023-10-14T19:08:19.844680+0000","last_became_peered":"2023-10-14T19:08:19.844680+0000","last_unstale":"2023-10-14T19:08:19.854265+0000","last_undegraded":"2023-10-14T19:08:19.854265+0000","last_fullsized":"2023-10-14T19:08:19.854265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:40.537756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.834493+0000","last_change":"2023-10-14T19:08:18.845719+0000","last_active":"2023-10-14T19:08:19.834493+0000","last_peered":"2023-10-14T19:08:19.834493+0000","last_clean":"2023-10-14T19:08:19.834493+0000","last_became_active":"2023-10-14T19:08:18.845132+0000","last_became_peered":"2023-10-14T19:08:18.845132+0000","last_unstale":"2023-10-14T19:08:19.834493+0000","last_undegraded":"2023-10-14T19:08:19.834493+0000","last_fullsized":"2023-10-14T19:08:19.834493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:05.915258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.846989+0000","last_change":"2023-10-14T19:08:19.842651+0000","last_active":"2023-10-14T19:08:19.846989+0000","last_peered":"2023-10-14T19:08:19.846989+0000","last_clean":"2023-10-14T19:08:19.846989+0000","last_became_active":"2023-10-14T19:08:19.842399+0000","last_became_peered":"2023-10-14T19:08:19.842399+0000","last_unstale":"2023-10-14T19:08:19.846989+0000","last_undegraded":"2023-10-14T19:08:19.846989+0000","last_fullsized":"2023-10-14T19:08:19.846989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:58.890046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.832160+0000","last_change":"2023-10-14T19:08:18.841556+0000","last_active":"2023-10-14T19:08:19.832160+0000","last_peered":"2023-10-14T19:08:19.832160+0000","last_clean":"2023-10-14T19:08:19.832160+0000","last_became_active":"2023-10-14T19:08:18.841302+0000","last_became_peered":"2023-10-14T19:08:18.841302+0000","last_unstale":"2023-10-14T19:08:19.832160+0000","last_undegraded":"2023-10-14T19:08:19.832160+0000","last_fullsized":"2023-10-14T19:08:19.832160+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:18:19.662199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856340+0000","last_change":"2023-10-14T19:08:19.854703+0000","last_active":"2023-10-14T19:08:19.856340+0000","last_peered":"2023-10-14T19:08:19.856340+0000","last_clean":"2023-10-14T19:08:19.856340+0000","last_became_active":"2023-10-14T19:08:19.854379+0000","last_became_peered":"2023-10-14T19:08:19.854379+0000","last_unstale":"2023-10-14T19:08:19.856340+0000","last_undegraded":"2023-10-14T19:08:19.856340+0000","last_fullsized":"2023-10-14T19:08:19.856340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:56.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.833321+0000","last_change":"2023-10-14T19:08:18.843432+0000","last_active":"2023-10-14T19:08:19.833321+0000","last_peered":"2023-10-14T19:08:19.833321+0000","last_clean":"2023-10-14T19:08:19.833321+0000","last_became_active":"2023-10-14T19:08:18.843177+0000","last_became_peered":"2023-10-14T19:08:18.843177+0000","last_unstale":"2023-10-14T19:08:19.833321+0000","last_undegraded":"2023-10-14T19:08:19.833321+0000","last_fullsized":"2023-10-14T19:08:19.833321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:39.915842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853009+0000","last_change":"2023-10-14T19:08:19.845111+0000","last_active":"2023-10-14T19:08:19.853009+0000","last_peered":"2023-10-14T19:08:19.853009+0000","last_clean":"2023-10-14T19:08:19.853009+0000","last_became_active":"2023-10-14T19:08:19.844819+0000","last_became_peered":"2023-10-14T19:08:19.844819+0000","last_unstale":"2023-10-14T19:08:19.853009+0000","last_undegraded":"2023-10-14T19:08:19.853009+0000","last_fullsized":"2023-10-14T19:08:19.853009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:58:57.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"77'2","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.857219+0000","last_change":"2023-10-14T19:08:18.844610+0000","last_active":"2023-10-14T19:08:19.857219+0000","last_peered":"2023-10-14T19:08:19.857219+0000","last_clean":"2023-10-14T19:08:19.857219+0000","last_became_active":"2023-10-14T19:08:18.844341+0000","last_became_peered":"2023-10-14T19:08:18.844341+0000","last_unstale":"2023-10-14T19:08:19.857219+0000","last_undegraded":"2023-10-14T19:08:19.857219+0000","last_fullsized":"2023-10-14T19:08:19.857219+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:47.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853158+0000","last_change":"2023-10-14T19:08:19.851564+0000","last_active":"2023-10-14T19:08:19.853158+0000","last_peered":"2023-10-14T19:08:19.853158+0000","last_clean":"2023-10-14T19:08:19.853158+0000","last_became_active":"2023-10-14T19:08:19.851236+0000","last_became_peered":"2023-10-14T19:08:19.851236+0000","last_unstale":"2023-10-14T19:08:19.853158+0000","last_undegraded":"2023-10-14T19:08:19.853158+0000","last_fullsized":"2023-10-14T19:08:19.853158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:05.868663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.830578+0000","last_change":"2023-10-14T19:08:18.837555+0000","last_active":"2023-10-14T19:08:19.830578+0000","last_peered":"2023-10-14T19:08:19.830578+0000","last_clean":"2023-10-14T19:08:19.830578+0000","last_became_active":"2023-10-14T19:08:18.837224+0000","last_became_peered":"2023-10-14T19:08:18.837224+0000","last_unstale":"2023-10-14T19:08:19.830578+0000","last_undegraded":"2023-10-14T19:08:19.830578+0000","last_fullsized":"2023-10-14T19:08:19.830578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:00:36.418948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850911+0000","last_change":"2023-10-14T19:08:19.837316+0000","last_active":"2023-10-14T19:08:19.850911+0000","last_peered":"2023-10-14T19:08:19.850911+0000","last_clean":"2023-10-14T19:08:19.850911+0000","last_became_active":"2023-10-14T19:08:19.837039+0000","last_became_peered":"2023-10-14T19:08:19.837039+0000","last_unstale":"2023-10-14T19:08:19.850911+0000","last_undegraded":"2023-10-14T19:08:19.850911+0000","last_fullsized":"2023-10-14T19:08:19.850911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:40.537756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.829675+0000","last_change":"2023-10-14T19:08:18.839551+0000","last_active":"2023-10-14T19:08:19.829675+0000","last_peered":"2023-10-14T19:08:19.829675+0000","last_clean":"2023-10-14T19:08:19.829675+0000","last_became_active":"2023-10-14T19:08:18.839257+0000","last_became_peered":"2023-10-14T19:08:18.839257+0000","last_unstale":"2023-10-14T19:08:19.829675+0000","last_undegraded":"2023-10-14T19:08:19.829675+0000","last_fullsized":"2023-10-14T19:08:19.829675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:39.801910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853302+0000","last_change":"2023-10-14T19:08:19.845478+0000","last_active":"2023-10-14T19:08:19.853302+0000","last_peered":"2023-10-14T19:08:19.853302+0000","last_clean":"2023-10-14T19:08:19.853302+0000","last_became_active":"2023-10-14T19:08:19.845224+0000","last_became_peered":"2023-10-14T19:08:19.845224+0000","last_unstale":"2023-10-14T19:08:19.853302+0000","last_undegraded":"2023-10-14T19:08:19.853302+0000","last_fullsized":"2023-10-14T19:08:19.853302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:14.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.829545+0000","last_change":"2023-10-14T19:08:18.847186+0000","last_active":"2023-10-14T19:08:19.829545+0000","last_peered":"2023-10-14T19:08:19.829545+0000","last_clean":"2023-10-14T19:08:19.829545+0000","last_became_active":"2023-10-14T19:08:18.846932+0000","last_became_peered":"2023-10-14T19:08:18.846932+0000","last_unstale":"2023-10-14T19:08:19.829545+0000","last_undegraded":"2023-10-14T19:08:19.829545+0000","last_fullsized":"2023-10-14T19:08:19.829545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:38.262731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.853933+0000","last_change":"2023-10-14T19:08:19.844411+0000","last_active":"2023-10-14T19:08:19.853933+0000","last_peered":"2023-10-14T19:08:19.853933+0000","last_clean":"2023-10-14T19:08:19.853933+0000","last_became_active":"2023-10-14T19:08:19.844152+0000","last_became_peered":"2023-10-14T19:08:19.844152+0000","last_unstale":"2023-10-14T19:08:19.853933+0000","last_undegraded":"2023-10-14T19:08:19.853933+0000","last_fullsized":"2023-10-14T19:08:19.853933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:22:57.978082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.839971+0000","last_change":"2023-10-14T19:08:18.838675+0000","last_active":"2023-10-14T19:08:19.839971+0000","last_peered":"2023-10-14T19:08:19.839971+0000","last_clean":"2023-10-14T19:08:19.839971+0000","last_became_active":"2023-10-14T19:08:18.838443+0000","last_became_peered":"2023-10-14T19:08:18.838443+0000","last_unstale":"2023-10-14T19:08:19.839971+0000","last_undegraded":"2023-10-14T19:08:19.839971+0000","last_fullsized":"2023-10-14T19:08:19.839971+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:27.508732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.850875+0000","last_change":"2023-10-14T19:08:19.843492+0000","last_active":"2023-10-14T19:08:19.850875+0000","last_peered":"2023-10-14T19:08:19.850875+0000","last_clean":"2023-10-14T19:08:19.850875+0000","last_became_active":"2023-10-14T19:08:19.843261+0000","last_became_peered":"2023-10-14T19:08:19.843261+0000","last_unstale":"2023-10-14T19:08:19.850875+0000","last_undegraded":"2023-10-14T19:08:19.850875+0000","last_fullsized":"2023-10-14T19:08:19.850875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:42.014326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835988+0000","last_change":"2023-10-14T19:08:18.842157+0000","last_active":"2023-10-14T19:08:19.835988+0000","last_peered":"2023-10-14T19:08:19.835988+0000","last_clean":"2023-10-14T19:08:19.835988+0000","last_became_active":"2023-10-14T19:08:18.841739+0000","last_became_peered":"2023-10-14T19:08:18.841739+0000","last_unstale":"2023-10-14T19:08:19.835988+0000","last_undegraded":"2023-10-14T19:08:19.835988+0000","last_fullsized":"2023-10-14T19:08:19.835988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:29:47.414543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.855756+0000","last_change":"2023-10-14T19:08:19.853372+0000","last_active":"2023-10-14T19:08:19.855756+0000","last_peered":"2023-10-14T19:08:19.855756+0000","last_clean":"2023-10-14T19:08:19.855756+0000","last_became_active":"2023-10-14T19:08:19.853103+0000","last_became_peered":"2023-10-14T19:08:19.853103+0000","last_unstale":"2023-10-14T19:08:19.855756+0000","last_undegraded":"2023-10-14T19:08:19.855756+0000","last_fullsized":"2023-10-14T19:08:19.855756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:58:46.423764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.830326+0000","last_change":"2023-10-14T19:08:18.840759+0000","last_active":"2023-10-14T19:08:19.830326+0000","last_peered":"2023-10-14T19:08:19.830326+0000","last_clean":"2023-10-14T19:08:19.830326+0000","last_became_active":"2023-10-14T19:08:18.840474+0000","last_became_peered":"2023-10-14T19:08:18.840474+0000","last_unstale":"2023-10-14T19:08:19.830326+0000","last_undegraded":"2023-10-14T19:08:19.830326+0000","last_fullsized":"2023-10-14T19:08:19.830326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:57.345151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.849898+0000","last_change":"2023-10-14T19:08:19.837295+0000","last_active":"2023-10-14T19:08:19.849898+0000","last_peered":"2023-10-14T19:08:19.849898+0000","last_clean":"2023-10-14T19:08:19.849898+0000","last_became_active":"2023-10-14T19:08:19.837047+0000","last_became_peered":"2023-10-14T19:08:19.837047+0000","last_unstale":"2023-10-14T19:08:19.849898+0000","last_undegraded":"2023-10-14T19:08:19.849898+0000","last_fullsized":"2023-10-14T19:08:19.849898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:55.915193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.835630+0000","last_change":"2023-10-14T19:08:18.844086+0000","last_active":"2023-10-14T19:08:19.835630+0000","last_peered":"2023-10-14T19:08:19.835630+0000","last_clean":"2023-10-14T19:08:19.835630+0000","last_became_active":"2023-10-14T19:08:18.843806+0000","last_became_peered":"2023-10-14T19:08:18.843806+0000","last_unstale":"2023-10-14T19:08:19.835630+0000","last_undegraded":"2023-10-14T19:08:19.835630+0000","last_fullsized":"2023-10-14T19:08:19.835630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:03.307513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.852898+0000","last_change":"2023-10-14T19:08:19.851931+0000","last_active":"2023-10-14T19:08:19.852898+0000","last_peered":"2023-10-14T19:08:19.852898+0000","last_clean":"2023-10-14T19:08:19.852898+0000","last_became_active":"2023-10-14T19:08:19.851694+0000","last_became_peered":"2023-10-14T19:08:19.851694+0000","last_unstale":"2023-10-14T19:08:19.852898+0000","last_undegraded":"2023-10-14T19:08:19.852898+0000","last_fullsized":"2023-10-14T19:08:19.852898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:18.820740+0000","last_clean_scrub_stamp":"2023-10-14T19:08:18.820740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:11:35.083551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.856771+0000","last_change":"2023-10-14T19:08:18.843473+0000","last_active":"2023-10-14T19:08:19.856771+0000","last_peered":"2023-10-14T19:08:19.856771+0000","last_clean":"2023-10-14T19:08:19.856771+0000","last_became_active":"2023-10-14T19:08:18.843164+0000","last_became_peered":"2023-10-14T19:08:18.843164+0000","last_unstale":"2023-10-14T19:08:19.856771+0000","last_undegraded":"2023-10-14T19:08:19.856771+0000","last_fullsized":"2023-10-14T19:08:19.856771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:17.818397+0000","last_clean_scrub_stamp":"2023-10-14T19:08:17.818397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.051868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-14T19:08:19.836032+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:08:19.836032+0000","last_peered":"2023-10-14T19:08:19.836032+0000","last_clean":"2023-10-14T19:08:19.836032+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:08:19.836032+0000","last_undegraded":"2023-10-14T19:08:19.836032+0000","last_fullsized":"2023-10-14T19:08:19.836032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1556480,"data_stored":1001317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56999999999999995,"15min":0.68799999999999994},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75700000000000001,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.497},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.56999999999999995,"15min":0.68700000000000006},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.432}]},{"osd":1,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58299999999999996,"15min":0.68500000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55200000000000005,"15min":0.626},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.77700000000000002},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.65300000000000002,"15min":0.76000000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70099999999999996,"5min":3.23,"15min":3.23},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63,"15min":0.80400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71399999999999997,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65700000000000003,"15min":0.77800000000000002},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79300000000000004,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.497,"15min":0.58299999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.56699999999999995,"15min":0.71999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.65100000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68500000000000005,"5min":2.883,"15min":2.883},"last":0.46999999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59299999999999997,"15min":0.68100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83399999999999996,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.64000000000000001,"15min":0.81299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":5.383,"15min":5.383},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":411545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.59099999999999997,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72699999999999998,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60199999999999998,"15min":0.76800000000000002},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.498},{"interface":"front","average":{"1min":0.505,"5min":0.60399999999999998,"15min":0.78800000000000003},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.80400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.85799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.63100000000000001,"15min":0.81899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.63800000000000001,"15min":0.83799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75900000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73899999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40999999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.433}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":970752,"data_stored":411073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.495,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54700000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.438}]},{"osd":2,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52300000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.499},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":1.032,"15min":1.032},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.625,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.079,"15min":1.079},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1556480,"data_stored":1001281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.497,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.375},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.62,"15min":0.62},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72999999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80000000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61299999999999999,"15min":0.64300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":962560,"data_stored":411433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.36099999999999999},"min":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46100000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.37,"15min":0.44800000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.496,"5min":2.028,"15min":2.028},"last":0.27300000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.373,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54200000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.315},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.48699999999999999,"15min":0.80700000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55300000000000005,"5min":11.269,"15min":11.269},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.46200000000000002,"15min":0.77800000000000002},"min":{"1min":0.248,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":11.318,"15min":11.318},"last":0.252},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.434},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58699999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.67800000000000005},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.69299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.73399999999999999,"15min":1.0700000000000001},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93200000000000005,"5min":11.379,"15min":11.379},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.73199999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":11.404,"15min":11.404},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.65600000000000003},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.85199999999999998,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.74299999999999999,"15min":1.087},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99299999999999999,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.48299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":970752,"data_stored":412415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36099999999999999,"15min":0.39100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.311}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33300000000000002,"15min":0.371},"min":{"1min":0.21299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32900000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41699999999999998,"15min":0.45100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72699999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42599999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80600000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":410879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.67800000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":3.488,"15min":3.488},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.436}]},{"osd":3,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64300000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.502,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63900000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66400000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68500000000000005,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":412437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.504}]},{"osd":2,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.876,"15min":0.876},"last":0.441},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.61699999999999999,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.375}]},{"osd":6,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:08:24.343 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:08:24.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:08:24.351 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-14T19:08:24.351+0000 7f79b0528700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:08:24.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.476+0000 7f40a9262700 1 Processor -- start 2023-10-14T19:08:24.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.476+0000 7f40a9262700 1 -- start start 2023-10-14T19:08:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a9262700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a40cf110 0x7f40a4164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a9262700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a415afd0 con 0x7f40a4153c30 2023-10-14T19:08:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a9262700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a415b2b0 con 0x7f40a415de50 2023-10-14T19:08:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a9262700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a415b590 con 0x7f40a40cf110 2023-10-14T19:08:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f40a4153c30 0x7f40a415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37714/0 (socket says 172.21.15.7:37714) 2023-10-14T19:08:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a3fff700 1 -- 172.21.15.7:0/1873439469 learned_addr learned my addr 172.21.15.7:0/1873439469 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a8a61700 1 --2- 172.21.15.7:0/1873439469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a40cf110 0x7f40a4164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a2ffd700 1 -- 172.21.15.7:0/1873439469 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090197180 0 0) 0x7f40a415afd0 con 0x7f40a4153c30 2023-10-14T19:08:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.477+0000 7f40a2ffd700 1 -- 172.21.15.7:0/1873439469 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f408c003570 con 0x7f40a4153c30 2023-10-14T19:08:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a2ffd700 1 -- 172.21.15.7:0/1873439469 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937592142 0 0) 0x7f40a415b2b0 con 0x7f40a415de50 2023-10-14T19:08:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a8a61700 1 -- 172.21.15.7:0/1873439469 >> v1:172.21.15.148:6789/0 conn(0x7f40a415de50 legacy=0x7f40a40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a8a61700 1 -- 172.21.15.7:0/1873439469 >> v1:172.21.15.7:6789/0 conn(0x7f40a4153c30 legacy=0x7f40a415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a8a61700 1 -- 172.21.15.7:0/1873439469 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a415b870 con 0x7f40a40cf110 2023-10-14T19:08:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a8a61700 1 --2- 172.21.15.7:0/1873439469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a40cf110 0x7f40a4164600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f409c009e90 tx=0x7f409c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97493dc435c9cf07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a2ffd700 1 -- 172.21.15.7:0/1873439469 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00e070 con 0x7f40a40cf110 2023-10-14T19:08:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a2ffd700 1 -- 172.21.15.7:0/1873439469 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c00b920 con 0x7f40a40cf110 2023-10-14T19:08:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.478+0000 7f40a2ffd700 1 -- 172.21.15.7:0/1873439469 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098001470 con 0x7f40a40cf110 2023-10-14T19:08:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 -- 172.21.15.7:0/1873439469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a40cf110 msgr2=0x7f40a4164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 --2- 172.21.15.7:0/1873439469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a40cf110 0x7f40a4164600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f409c009e90 tx=0x7f409c009780 comp rx=0 tx=0).stop 2023-10-14T19:08:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 -- 172.21.15.7:0/1873439469 shutdown_connections 2023-10-14T19:08:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 --2- 172.21.15.7:0/1873439469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a40cf110 0x7f40a4164600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 -- 172.21.15.7:0/1873439469 >> 172.21.15.7:0/1873439469 conn(0x7f40a40703a0 msgr2=0x7f40a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 -- 172.21.15.7:0/1873439469 shutdown_connections 2023-10-14T19:08:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.479+0000 7f40a9262700 1 -- 172.21.15.7:0/1873439469 wait complete. 2023-10-14T19:08:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.480+0000 7f40a9262700 1 Processor -- start 2023-10-14T19:08:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.480+0000 7f40a9262700 1 -- start start 2023-10-14T19:08:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.480+0000 7f40a9262700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 0x7f40a40b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a4153c30 0x7f40a40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a415de50 0x7f40a40cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a416d120 con 0x7f40a40cf110 2023-10-14T19:08:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a416c7f0 con 0x7f40a4153c30 2023-10-14T19:08:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a416cad0 con 0x7f40a415de50 2023-10-14T19:08:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 0x7f40a40b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 0x7f40a40b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44326/0 (socket says 172.21.15.7:44326) 2023-10-14T19:08:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 -- 172.21.15.7:0/65678098 learned_addr learned my addr 172.21.15.7:0/65678098 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a8a61700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a415de50 0x7f40a40cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a37fe700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a4153c30 0x7f40a40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 -- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a415de50 msgr2=0x7f40a40cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a415de50 0x7f40a40cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 -- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a4153c30 msgr2=0x7f40a40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a4153c30 0x7f40a40ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 -- 172.21.15.7:0/65678098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009a20 con 0x7f40a40cf110 2023-10-14T19:08:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a3fff700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 0x7f40a40b5900 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f40980015a0 tx=0x7f4098001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098007360 con 0x7f40a40cf110 2023-10-14T19:08:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40980074e0 con 0x7f40a40cf110 2023-10-14T19:08:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a416cdb0 con 0x7f40a40cf110 2023-10-14T19:08:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098004830 con 0x7f40a40cf110 2023-10-14T19:08:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.481+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a40b5e40 con 0x7f40a40cf110 2023-10-14T19:08:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.482+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a416d400 con 0x7f40a40cf110 2023-10-14T19:08:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.483+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f4098004bc0 con 0x7f40a40cf110 2023-10-14T19:08:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.483+0000 7f408bfff700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4090067170 0x7f4090069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.483+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4098084100 con 0x7f40a40cf110 2023-10-14T19:08:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.483+0000 7f40a37fe700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4090067170 0x7f4090069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.484+0000 7f40a37fe700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4090067170 0x7f4090069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f40a4153460 tx=0x7f4094009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.487+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4098051160 con 0x7f40a40cf110 2023-10-14T19:08:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.758+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f40a404c3c0 con 0x7f40a40cf110 2023-10-14T19:08:24.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.762+0000 7f408bfff700 1 -- 172.21.15.7:0/65678098 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4098054780 con 0x7f40a40cf110 2023-10-14T19:08:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4090067170 msgr2=0x7f4090069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4090067170 0x7f4090069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f40a4153460 tx=0x7f4094009040 comp rx=0 tx=0).stop 2023-10-14T19:08:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 msgr2=0x7f40a40b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 0x7f40a40b5900 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f40980015a0 tx=0x7f4098001bf0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 shutdown_connections 2023-10-14T19:08:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4090067170 0x7f4090069620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a415de50 0x7f40a40cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40a40cf110 0x7f40a40b5900 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 --2- 172.21.15.7:0/65678098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a4153c30 0x7f40a40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 >> 172.21.15.7:0/65678098 conn(0x7f40a40703a0 msgr2=0x7f40a4070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 shutdown_connections 2023-10-14T19:08:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.765+0000 7f40a9262700 1 -- 172.21.15.7:0/65678098 wait complete. 2023-10-14T19:08:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:08:24.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.896+0000 7ffbbb396700 1 Processor -- start 2023-10-14T19:08:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbbb396700 1 -- start start 2023-10-14T19:08:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbbb396700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffbb415cf20 0x7ffbb40b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbbb396700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffbb40b2d10 0x7ffbb41536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbbb396700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb415ad50 con 0x7ffbb415cb50 2023-10-14T19:08:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbbb396700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb415a140 con 0x7ffbb415cf20 2023-10-14T19:08:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbbb396700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb415a420 con 0x7ffbb40b2d10 2023-10-14T19:08:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.897+0000 7ffbb8931700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffbb415cf20 0x7ffbb40b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffbb415cf20 0x7ffbb40b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44336/0 (socket says 172.21.15.7:44336) 2023-10-14T19:08:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 -- 172.21.15.7:0/839224027 learned_addr learned my addr 172.21.15.7:0/839224027 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb9933700 1 --2- 172.21.15.7:0/839224027 >> v2:172.21.15.148:3300/0 conn(0x7ffbb40b2d10 0x7ffbb41536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 -- 172.21.15.7:0/839224027 >> v2:172.21.15.148:3300/0 conn(0x7ffbb40b2d10 msgr2=0x7ffbb41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 --2- 172.21.15.7:0/839224027 >> v2:172.21.15.148:3300/0 conn(0x7ffbb40b2d10 0x7ffbb41536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 -- 172.21.15.7:0/839224027 >> v1:172.21.15.148:6789/0 conn(0x7ffbb415cb50 legacy=0x7ffbb40b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 -- 172.21.15.7:0/839224027 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb415a700 con 0x7ffbb415cf20 2023-10-14T19:08:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb9933700 1 --2- 172.21.15.7:0/839224027 >> v2:172.21.15.148:3300/0 conn(0x7ffbb40b2d10 0x7ffbb41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb8931700 1 --2- 172.21.15.7:0/839224027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb415cf20 0x7ffbb40b27d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffbb41579c0 tx=0x7ffba8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3bea4e72399d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb3fff700 1 -- 172.21.15.7:0/839224027 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba800b860 con 0x7ffbb415cf20 2023-10-14T19:08:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb3fff700 1 -- 172.21.15.7:0/839224027 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba800b9c0 con 0x7ffbb415cf20 2023-10-14T19:08:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.898+0000 7ffbb3fff700 1 -- 172.21.15.7:0/839224027 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba800bd60 con 0x7ffbb415cf20 2023-10-14T19:08:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 -- 172.21.15.7:0/839224027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb415cf20 msgr2=0x7ffbb40b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 --2- 172.21.15.7:0/839224027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb415cf20 0x7ffbb40b27d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffbb41579c0 tx=0x7ffba8009250 comp rx=0 tx=0).stop 2023-10-14T19:08:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 -- 172.21.15.7:0/839224027 shutdown_connections 2023-10-14T19:08:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 --2- 172.21.15.7:0/839224027 >> v2:172.21.15.148:3300/0 conn(0x7ffbb40b2d10 0x7ffbb41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 --2- 172.21.15.7:0/839224027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb415cf20 0x7ffbb40b27d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 -- 172.21.15.7:0/839224027 >> 172.21.15.7:0/839224027 conn(0x7ffbb40cded0 msgr2=0x7ffbb406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 -- 172.21.15.7:0/839224027 shutdown_connections 2023-10-14T19:08:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.899+0000 7ffbbb396700 1 -- 172.21.15.7:0/839224027 wait complete. 2023-10-14T19:08:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.900+0000 7ffbbb396700 1 Processor -- start 2023-10-14T19:08:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.900+0000 7ffbbb396700 1 -- start start 2023-10-14T19:08:24.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbbb396700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 0x7ffbb40af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbbb396700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbb415cb50 0x7ffbb41690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbbb396700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbb415cf20 0x7ffbb4169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbbb396700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb416a680 con 0x7ffbb40b2d10 2023-10-14T19:08:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbbb396700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4169b50 con 0x7ffbb415cb50 2023-10-14T19:08:24.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbbb396700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb416a8c0 con 0x7ffbb415cf20 2023-10-14T19:08:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 0x7ffbb40af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 0x7ffbb40af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44346/0 (socket says 172.21.15.7:44346) 2023-10-14T19:08:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 -- 172.21.15.7:0/1678293556 learned_addr learned my addr 172.21.15.7:0/1678293556 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb8931700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbb415cb50 0x7ffbb41690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9933700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbb415cf20 0x7ffbb4169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 -- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbb415cf20 msgr2=0x7ffbb4169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbb415cf20 0x7ffbb4169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 -- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbb415cb50 msgr2=0x7ffbb41690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbb415cb50 0x7ffbb41690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:24.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 -- 172.21.15.7:0/1678293556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80094f0 con 0x7ffbb40b2d10 2023-10-14T19:08:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9933700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbb415cf20 0x7ffbb4169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.901+0000 7ffbb9132700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 0x7ffbb40af0b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00c5c0 tx=0x7ffbac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.902+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011590 con 0x7ffbb40b2d10 2023-10-14T19:08:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.902+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac011710 con 0x7ffbb40b2d10 2023-10-14T19:08:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.902+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb416adf0 con 0x7ffbb40b2d10 2023-10-14T19:08:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.902+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011ad0 con 0x7ffbb40b2d10 2023-10-14T19:08:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.902+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb416b3b0 con 0x7ffbb40b2d10 2023-10-14T19:08:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.902+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb404c3c0 con 0x7ffbb40b2d10 2023-10-14T19:08:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.903+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ffbac01b3b0 con 0x7ffbb40b2d10 2023-10-14T19:08:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.903+0000 7ffbb17fa700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffba0067170 0x7ffba0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.903+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffbac083d60 con 0x7ffbb40b2d10 2023-10-14T19:08:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.904+0000 7ffbb8931700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffba0067170 0x7ffba0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.904+0000 7ffbb8931700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffba0067170 0x7ffba0069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffbb41579c0 tx=0x7ffba8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:24.908+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbac050d40 con 0x7ffbb40b2d10 2023-10-14T19:08:25.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.147+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbb416b5a0 con 0x7ffbb40b2d10 2023-10-14T19:08:25.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.147+0000 7ffbb17fa700 1 -- 172.21.15.7:0/1678293556 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4593 (secure 0 0 0) 0x7ffbac017070 con 0x7ffbb40b2d10 2023-10-14T19:08:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:25.149 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:19.226680+0000","modified":"2023-10-14T19:08:22.851427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/491623181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":491623181},{"type":"v1","addr":"172.21.15.7:6834","nonce":491623181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T19:08:25.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffba0067170 msgr2=0x7ffba0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffba0067170 0x7ffba0069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffbb41579c0 tx=0x7ffba8017000 comp rx=0 tx=0).stop 2023-10-14T19:08:25.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 msgr2=0x7ffbb40af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 0x7ffbb40af0b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00c5c0 tx=0x7ffbac00c8d0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 shutdown_connections 2023-10-14T19:08:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffba0067170 0x7ffba0069620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbb415cf20 0x7ffbb4169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb40b2d10 0x7ffbb40af0b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 --2- 172.21.15.7:0/1678293556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbb415cb50 0x7ffbb41690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 >> 172.21.15.7:0/1678293556 conn(0x7ffbb40cded0 msgr2=0x7ffbb41590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 shutdown_connections 2023-10-14T19:08:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.150+0000 7ffbbb396700 1 -- 172.21.15.7:0/1678293556 wait complete. 2023-10-14T19:08:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 48 2023-10-14T19:08:25.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:08:19.226680+0000', 'modified': '2023-10-14T19:08:22.851427+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6060}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6060': {'gid': 6060, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6834/491623181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6832', 'nonce': 491623181}, {'type': 'v1', 'addr': '172.21.15.7:6834', 'nonce': 491623181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:08:25.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:08:25.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T19:08:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.689+0000 7f278a732700 1 Processor -- start 2023-10-14T19:08:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.689+0000 7f278a732700 1 -- start start 2023-10-14T19:08:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.690+0000 7f278a732700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f278406e550 0x7f2784164860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.690+0000 7f278a732700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27840aeee0 con 0x7f27840a8d00 2023-10-14T19:08:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.690+0000 7f278a732700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27840cf490 con 0x7f27840a90d0 2023-10-14T19:08:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.690+0000 7f278a732700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27840ae680 con 0x7f278406e550 2023-10-14T19:08:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.690+0000 7f2783fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f27840a8d00 0x7f27840cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37728/0 (socket says 172.21.15.7:37728) 2023-10-14T19:08:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.690+0000 7f2783fff700 1 -- 172.21.15.7:0/1322405427 learned_addr learned my addr 172.21.15.7:0/1322405427 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2788ccf700 1 --2- 172.21.15.7:0/1322405427 >> v2:172.21.15.148:3300/0 conn(0x7f278406e550 0x7f2784164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240977808 0 0) 0x7f27840aeee0 con 0x7f27840a8d00 2023-10-14T19:08:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f276c003570 con 0x7f27840a8d00 2023-10-14T19:08:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735315848 0 0) 0x7f27840cf490 con 0x7f27840a90d0 2023-10-14T19:08:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27840aeee0 con 0x7f27840a90d0 2023-10-14T19:08:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2788ccf700 1 -- 172.21.15.7:0/1322405427 >> v1:172.21.15.148:6789/0 conn(0x7f27840a90d0 legacy=0x7f278406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4109628934 0 0) 0x7f276c003570 con 0x7f27840a8d00 2023-10-14T19:08:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2788ccf700 1 -- 172.21.15.7:0/1322405427 >> v1:172.21.15.7:6789/0 conn(0x7f27840a8d00 legacy=0x7f27840cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2788ccf700 1 -- 172.21.15.7:0/1322405427 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27840cf1b0 con 0x7f278406e550 2023-10-14T19:08:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2788ccf700 1 --2- 172.21.15.7:0/1322405427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f2784164860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f277c009e60 tx=0x7f277c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b596530269f6f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00e070 con 0x7f278406e550 2023-10-14T19:08:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c00b7a0 con 0x7f278406e550 2023-10-14T19:08:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.691+0000 7f2782ffd700 1 -- 172.21.15.7:0/1322405427 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740015f0 con 0x7f278406e550 2023-10-14T19:08:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 -- 172.21.15.7:0/1322405427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 msgr2=0x7f2784164860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 --2- 172.21.15.7:0/1322405427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f2784164860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f277c009e60 tx=0x7f277c009780 comp rx=0 tx=0).stop 2023-10-14T19:08:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 -- 172.21.15.7:0/1322405427 shutdown_connections 2023-10-14T19:08:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 --2- 172.21.15.7:0/1322405427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f2784164860 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 -- 172.21.15.7:0/1322405427 >> 172.21.15.7:0/1322405427 conn(0x7f278406ce80 msgr2=0x7f27840ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 -- 172.21.15.7:0/1322405427 shutdown_connections 2023-10-14T19:08:25.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.692+0000 7f278a732700 1 -- 172.21.15.7:0/1322405427 wait complete. 2023-10-14T19:08:25.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.693+0000 7f278a732700 1 Processor -- start 2023-10-14T19:08:25.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.693+0000 7f278a732700 1 -- start start 2023-10-14T19:08:25.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f278a732700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f27841538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f278a732700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 0x7f278415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f278a732700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27840a90d0 0x7f278415ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f278a732700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784169ba0 con 0x7f27840a8d00 2023-10-14T19:08:25.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f278a732700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784169e60 con 0x7f278406e550 2023-10-14T19:08:25.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f278a732700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278416a140 con 0x7f27840a90d0 2023-10-14T19:08:25.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 0x7f278415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 0x7f278415e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44362/0 (socket says 172.21.15.7:44362) 2023-10-14T19:08:25.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 -- 172.21.15.7:0/3485169874 learned_addr learned my addr 172.21.15.7:0/3485169874 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f2788ccf700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27840a90d0 0x7f278415ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f2783fff700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f27841538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 -- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27840a90d0 msgr2=0x7f278415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27840a90d0 0x7f278415ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 -- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 msgr2=0x7f27841538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f27841538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 -- 172.21.15.7:0/3485169874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009a20 con 0x7f27840a8d00 2023-10-14T19:08:25.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f2788ccf700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27840a90d0 0x7f278415ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:25.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f2783fff700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f27841538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:25.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.694+0000 7f27837fe700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 0x7f278415e850 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f277800c7c0 tx=0x7f2778007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.695+0000 7f276bfff700 1 -- 172.21.15.7:0/3485169874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778001530 con 0x7f27840a8d00 2023-10-14T19:08:25.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.695+0000 7f276bfff700 1 -- 172.21.15.7:0/3485169874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778001690 con 0x7f27840a8d00 2023-10-14T19:08:25.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.695+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278416a420 con 0x7f27840a8d00 2023-10-14T19:08:25.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.695+0000 7f276bfff700 1 -- 172.21.15.7:0/3485169874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778001a50 con 0x7f27840a8d00 2023-10-14T19:08:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.695+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784153e30 con 0x7f27840a8d00 2023-10-14T19:08:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.696+0000 7f276bfff700 1 -- 172.21.15.7:0/3485169874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f277801b400 con 0x7f27840a8d00 2023-10-14T19:08:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.696+0000 7f276bfff700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2770067170 0x7f2770069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.696+0000 7f276bfff700 1 -- 172.21.15.7:0/3485169874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27780846d0 con 0x7f27840a8d00 2023-10-14T19:08:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.697+0000 7f2783fff700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2770067170 0x7f2770069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.697+0000 7f2783fff700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2770067170 0x7f2770069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2774001720 tx=0x7f2774009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.698+0000 7f2793a2bb80 1 Processor -- start 2023-10-14T19:08:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.698+0000 7f2793a2bb80 1 -- start start 2023-10-14T19:08:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa24e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa4da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa20cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639a97ba70 con 0x55639aa6ed00 2023-10-14T19:08:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639a979270 con 0x55639aa24a50 2023-10-14T19:08:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55639a975060 con 0x55639aa4df60 2023-10-14T19:08:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa4da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa4da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44370/0 (socket says 172.21.15.7:44370) 2023-10-14T19:08:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 -- 172.21.15.7:0/1170373463 learned_addr learned my addr 172.21.15.7:0/1170373463 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2788ccf700 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa20cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f2783fff700 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa24e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 -- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 msgr2=0x55639aa20cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa20cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 -- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 msgr2=0x55639aa24e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa24e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.699+0000 7f27837fe700 1 -- 172.21.15.7:0/1170373463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55639a80f270 con 0x55639aa6ed00 2023-10-14T19:08:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f27837fe700 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa4da20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2778007fd0 tx=0x7f2778055150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66af7399f6e0ea17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f27697fa700 1 -- 172.21.15.7:0/1170373463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778058520 con 0x55639aa6ed00 2023-10-14T19:08:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f27697fa700 1 -- 172.21.15.7:0/1170373463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277805c270 con 0x55639aa6ed00 2023-10-14T19:08:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f27697fa700 1 -- 172.21.15.7:0/1170373463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778053670 con 0x55639aa6ed00 2023-10-14T19:08:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1170373463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 msgr2=0x55639aa4da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa4da20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2778007fd0 tx=0x7f2778055150 comp rx=0 tx=0).stop 2023-10-14T19:08:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1170373463 shutdown_connections 2023-10-14T19:08:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa24e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa20cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1170373463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa4da20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1170373463 >> 172.21.15.7:0/1170373463 conn(0x55639aa26370 msgr2=0x55639aa26740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1170373463 shutdown_connections 2023-10-14T19:08:25.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.700+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1170373463 wait complete. 2023-10-14T19:08:25.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.701+0000 7f2793a2bb80 1 -- start start 2023-10-14T19:08:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.701+0000 7f2793a2bb80 1 Processor -- start 2023-10-14T19:08:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa4a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa661d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639a920890 con 0x55639aa6ed00 2023-10-14T19:08:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639a93bea0 con 0x55639aa24a50 2023-10-14T19:08:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55639a7f7e30 con 0x55639aa4df60 2023-10-14T19:08:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2793a2bb80 10 client.0 _ll_register_callbacks cb 0x55639a9e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:08:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa64e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44380/0 (socket says 172.21.15.7:44380) 2023-10-14T19:08:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 -- 172.21.15.7:0/139586152 learned_addr learned my addr 172.21.15.7:0/139586152 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2783fff700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa4a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f27837fe700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 -- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 msgr2=0x55639aa661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 -- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 msgr2=0x55639aa4a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa4a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 -- 172.21.15.7:0/139586152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784153e30 con 0x55639aa6ed00 2023-10-14T19:08:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f27837fe700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f2788ccf700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa64e70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f278406aa60 tx=0x7f277c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a71fabfd84828e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.702+0000 7f27627fc700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:08:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f27627fc700 1 -- 172.21.15.7:0/139586152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c0032f0 con 0x55639aa6ed00 2023-10-14T19:08:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f27627fc700 1 -- 172.21.15.7:0/139586152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f277c00bda0 con 0x55639aa6ed00 2023-10-14T19:08:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55639aa19b70 con 0x55639aa6ed00 2023-10-14T19:08:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f27627fc700 1 -- 172.21.15.7:0/139586152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f277c028d10 con 0x55639aa6ed00 2023-10-14T19:08:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 10 client.6213 fetch_fsmap learned FSMap version 48 2023-10-14T19:08:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55639a7b1fe0 con 0x55639aa6ed00 2023-10-14T19:08:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f27627fc700 1 -- 172.21.15.7:0/139586152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55639aa19b70 con 0x55639aa6ed00 2023-10-14T19:08:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f27627fc700 1 -- 172.21.15.7:0/139586152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f277c028020 con 0x55639aa6ed00 2023-10-14T19:08:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 10 client.6213 fetch_fsmap finished waiting for FSMap version 48 2023-10-14T19:08:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 10 client.6213 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:08:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 20 client.6213 populate_metadata read hostname 'smithi007' 2023-10-14T19:08:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa6e260 0x55639aa6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 4 client.6213 mds_command: new command op to 6060 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:08:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 --> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55639a9f6aa0 con 0x55639aa6e260 2023-10-14T19:08:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.703+0000 7f2783fff700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa6e260 0x55639aa6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f27627fc700 10 client.6213 ms_handle_connect on v2:172.21.15.7:6832/491623181 2023-10-14T19:08:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2783fff700 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa6e260 0x55639aa6e630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ee51f690d502d78 server_cookie=712e2e13d8ef4a1f in_seq=0 out_seq=0 2023-10-14T19:08:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f27627fc700 1 -- 172.21.15.7:0/139586152 <== mds.0 v2:172.21.15.7:6832/491623181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55639a9f6aa0 con 0x55639aa6e260 2023-10-14T19:08:25.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f27627fc700 10 client.6213 handle_command_reply: tid=0 2023-10-14T19:08:25.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 client.6213 shutdown 2023-10-14T19:08:25.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 msgr2=0x55639aa64e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa64e70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f278406aa60 tx=0x7f277c017000 comp rx=0 tx=0).stop 2023-10-14T19:08:25.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 shutdown_connections 2023-10-14T19:08:25.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa6e260 0x55639aa6e630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa4a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa64e70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f27627fc700 0 client.6213 ms_handle_reset on v2:172.21.15.7:6832/491623181 2023-10-14T19:08:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/139586152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 >> 172.21.15.7:0/139586152 conn(0x55639aa26370 msgr2=0x55639aa27a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 shutdown_connections 2023-10-14T19:08:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.704+0000 7f2793a2bb80 1 -- 172.21.15.7:0/139586152 wait complete. 2023-10-14T19:08:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.705+0000 7f2793a2bb80 20 client.6213 trim_cache size 0 max 16384 2023-10-14T19:08:25.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.721+0000 7f2793a2bb80 1 Processor -- start 2023-10-14T19:08:25.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.721+0000 7f2793a2bb80 1 -- start start 2023-10-14T19:08:25.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 0x55639aa54360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa6c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa6ed00 0x55639aa6caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639aa66270 con 0x55639aa24a50 2023-10-14T19:08:25.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639aa4dce0 con 0x55639aa6ed00 2023-10-14T19:08:25.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55639aa19b30 con 0x55639aa4df60 2023-10-14T19:08:25.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 0x55639aa54360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 0x55639aa54360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44396/0 (socket says 172.21.15.7:44396) 2023-10-14T19:08:25.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 -- 172.21.15.7:0/1814010014 learned_addr learned my addr 172.21.15.7:0/1814010014 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 -- 172.21.15.7:0/1814010014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 msgr2=0x55639aa6c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa6c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 -- 172.21.15.7:0/1814010014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa6ed00 msgr2=0x55639aa6caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa6ed00 0x55639aa6caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.722+0000 7f2783fff700 1 -- 172.21.15.7:0/1814010014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55639a943780 con 0x55639aa24a50 2023-10-14T19:08:25.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2783fff700 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 0x55639aa54360 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2774002bd0 tx=0x7f2774012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458020542795a22b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2769ffb700 1 -- 172.21.15.7:0/1814010014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400d7a0 con 0x55639aa24a50 2023-10-14T19:08:25.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2769ffb700 1 -- 172.21.15.7:0/1814010014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2774029070 con 0x55639aa24a50 2023-10-14T19:08:25.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2769ffb700 1 -- 172.21.15.7:0/1814010014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400d900 con 0x55639aa24a50 2023-10-14T19:08:25.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1814010014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 msgr2=0x55639aa54360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 0x55639aa54360 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2774002bd0 tx=0x7f2774012000 comp rx=0 tx=0).stop 2023-10-14T19:08:25.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1814010014 shutdown_connections 2023-10-14T19:08:25.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa6ed00 0x55639aa6caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa24a50 0x55639aa54360 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1814010014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aa6c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1814010014 >> 172.21.15.7:0/1814010014 conn(0x55639aa26370 msgr2=0x55639aa1d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1814010014 shutdown_connections 2023-10-14T19:08:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.723+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1814010014 wait complete. 2023-10-14T19:08:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.724+0000 7f2793a2bb80 1 -- start start 2023-10-14T19:08:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.724+0000 7f2793a2bb80 1 Processor -- start 2023-10-14T19:08:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aad0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa54690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639aa6cfb0 con 0x55639aa6ed00 2023-10-14T19:08:25.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55639aa61d10 con 0x55639aa24a50 2023-10-14T19:08:25.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55639aa6ccd0 con 0x55639aa4df60 2023-10-14T19:08:25.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2793a2bb80 10 client.0 _ll_register_callbacks cb 0x55639a9e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:08:25.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa54690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa54690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44400/0 (socket says 172.21.15.7:44400) 2023-10-14T19:08:25.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 -- 172.21.15.7:0/1775261967 learned_addr learned my addr 172.21.15.7:0/1775261967 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2783fff700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f27837fe700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aad0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 -- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 msgr2=0x55639aad0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aad0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 -- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 msgr2=0x55639aa621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 -- 172.21.15.7:0/1775261967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277401c040 con 0x55639aa6ed00 2023-10-14T19:08:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f27837fe700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aad0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:25.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f2788ccf700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa54690 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f277c009e60 tx=0x7f277c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941a4dcf456e0ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.725+0000 7f27627fc700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:08:25.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f27627fc700 1 -- 172.21.15.7:0/1775261967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00bd30 con 0x55639aa6ed00 2023-10-14T19:08:25.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f27627fc700 1 -- 172.21.15.7:0/1775261967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f277c031470 con 0x55639aa6ed00 2023-10-14T19:08:25.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f277805c270 con 0x55639aa6ed00 2023-10-14T19:08:25.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f27627fc700 1 -- 172.21.15.7:0/1775261967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f277c00be90 con 0x55639aa6ed00 2023-10-14T19:08:25.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 10 client.6219 fetch_fsmap learned FSMap version 48 2023-10-14T19:08:25.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55639a92a470 con 0x55639aa6ed00 2023-10-14T19:08:25.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f27627fc700 1 -- 172.21.15.7:0/1775261967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277805c270 con 0x55639aa6ed00 2023-10-14T19:08:25.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f27627fc700 1 -- 172.21.15.7:0/1775261967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f277c031860 con 0x55639aa6ed00 2023-10-14T19:08:25.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 10 client.6219 fetch_fsmap finished waiting for FSMap version 48 2023-10-14T19:08:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 10 client.6219 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:08:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 20 client.6219 populate_metadata read hostname 'smithi007' 2023-10-14T19:08:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa48910 0x55639aa48ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 4 client.6219 mds_command: new command op to 6060 tid=0[{"prefix": "status"}] 2023-10-14T19:08:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 --> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55639a917e00 con 0x55639aa48910 2023-10-14T19:08:25.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2783fff700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa48910 0x55639aa48ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f27627fc700 10 client.6219 ms_handle_connect on v2:172.21.15.7:6832/491623181 2023-10-14T19:08:25.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.726+0000 7f2783fff700 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa48910 0x55639aa48ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60de3f0c3a830913 server_cookie=2eb6ba7e82415748 in_seq=0 out_seq=0 2023-10-14T19:08:25.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f27627fc700 1 -- 172.21.15.7:0/1775261967 <== mds.0 v2:172.21.15.7:6832/491623181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55639a917e00 con 0x55639aa48910 2023-10-14T19:08:25.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f27627fc700 10 client.6219 handle_command_reply: tid=0 2023-10-14T19:08:25.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 client.6219 shutdown 2023-10-14T19:08:25.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 msgr2=0x55639aa54690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa54690 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f277c009e60 tx=0x7f277c020040 comp rx=0 tx=0).stop 2023-10-14T19:08:25.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 shutdown_connections 2023-10-14T19:08:25.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:6832/491623181,v1:172.21.15.7:6834/491623181] conn(0x55639aa48910 0x55639aa48ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55639aa24a50 0x55639aa621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f27627fc700 0 client.6219 ms_handle_reset on v2:172.21.15.7:6832/491623181 2023-10-14T19:08:25.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aa6ed00 0x55639aa54690 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 --2- 172.21.15.7:0/1775261967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55639aa4df60 0x55639aad0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 >> 172.21.15.7:0/1775261967 conn(0x55639aa26370 msgr2=0x55639aa663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 shutdown_connections 2023-10-14T19:08:25.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 1 -- 172.21.15.7:0/1775261967 wait complete. 2023-10-14T19:08:25.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f2793a2bb80 20 client.6219 trim_cache size 0 max 16384 2023-10-14T19:08:25.756 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:08:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:08:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6060, 2023-10-14T19:08:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:08:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:08:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:08:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.8873550659999996, 2023-10-14T19:08:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 48, 2023-10-14T19:08:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 78, 2023-10-14T19:08:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 78, 2023-10-14T19:08:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 11.761835404999999 2023-10-14T19:08:25.759 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:25.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2770067170 msgr2=0x7f2770069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2770067170 0x7f2770069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2774001720 tx=0x7f2774009040 comp rx=0 tx=0).stop 2023-10-14T19:08:25.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 msgr2=0x7f278415e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 0x7f278415e850 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f277800c7c0 tx=0x7f2778007dd0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 shutdown_connections 2023-10-14T19:08:25.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2770067170 0x7f2770069620 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f278406e550 0x7f27841538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27840a90d0 0x7f278415ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 --2- 172.21.15.7:0/3485169874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27840a8d00 0x7f278415e850 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.727+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 >> 172.21.15.7:0/3485169874 conn(0x7f278406ce80 msgr2=0x7f2784155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.728+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 shutdown_connections 2023-10-14T19:08:25.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.728+0000 7f278a732700 1 -- 172.21.15.7:0/3485169874 wait complete. 2023-10-14T19:08:25.764 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:08:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.882+0000 7f34455c2700 1 Processor -- start 2023-10-14T19:08:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.882+0000 7f34455c2700 1 -- start start 2023-10-14T19:08:25.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f34455c2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 0x7f34400af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f34455c2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f3440163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f34455c2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34400ce9d0 con 0x7f3440159c80 2023-10-14T19:08:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f34455c2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34400afc30 con 0x7f34401598b0 2023-10-14T19:08:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f34455c2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400aff10 con 0x7f34400af790 2023-10-14T19:08:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f343f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f3440163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.883+0000 7f343effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 0x7f34400af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 0x7f34400af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:58458/0 (socket says 172.21.15.7:58458) 2023-10-14T19:08:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343e7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3440159c80 0x7f34400cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:48188/0 (socket says 172.21.15.7:48188) 2023-10-14T19:08:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f3440163590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:34538/0 (socket says 172.21.15.7:34538) 2023-10-14T19:08:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343effd700 1 -- 172.21.15.7:0/1205816636 learned_addr learned my addr 172.21.15.7:0/1205816636 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343f7fe700 1 -- 172.21.15.7:0/1205816636 >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 msgr2=0x7f34400af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343f7fe700 1 --2- 172.21.15.7:0/1205816636 >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 0x7f34400af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343f7fe700 1 -- 172.21.15.7:0/1205816636 >> v1:172.21.15.148:6789/0 conn(0x7f3440159c80 legacy=0x7f34400cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343f7fe700 1 -- 172.21.15.7:0/1205816636 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400ce380 con 0x7f34400af790 2023-10-14T19:08:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343effd700 1 --2- 172.21.15.7:0/1205816636 >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 0x7f34400af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343f7fe700 1 --2- 172.21.15.7:0/1205816636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f3440163590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34380098e0 tx=0x7f34380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55296c96508bc4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343dffb700 1 -- 172.21.15.7:0/1205816636 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800b640 con 0x7f34400af790 2023-10-14T19:08:25.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343dffb700 1 -- 172.21.15.7:0/1205816636 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343800b7a0 con 0x7f34400af790 2023-10-14T19:08:25.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.884+0000 7f343dffb700 1 -- 172.21.15.7:0/1205816636 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800bb40 con 0x7f34400af790 2023-10-14T19:08:25.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 -- 172.21.15.7:0/1205816636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 msgr2=0x7f3440163590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 --2- 172.21.15.7:0/1205816636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f3440163590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34380098e0 tx=0x7f34380091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 -- 172.21.15.7:0/1205816636 shutdown_connections 2023-10-14T19:08:25.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 --2- 172.21.15.7:0/1205816636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f3440163590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 --2- 172.21.15.7:0/1205816636 >> v2:172.21.15.148:3300/0 conn(0x7f34401598b0 0x7f34400af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 -- 172.21.15.7:0/1205816636 >> 172.21.15.7:0/1205816636 conn(0x7f3440070e30 msgr2=0x7f34400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:25.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 -- 172.21.15.7:0/1205816636 shutdown_connections 2023-10-14T19:08:25.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.885+0000 7f34455c2700 1 -- 172.21.15.7:0/1205816636 wait complete. 2023-10-14T19:08:25.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.886+0000 7f34455c2700 1 Processor -- start 2023-10-14T19:08:25.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.886+0000 7f34455c2700 1 -- start start 2023-10-14T19:08:25.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f34455c2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f34400b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f34455c2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 0x7f3440155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f34455c2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3440159c80 0x7f3440153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f34455c2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440157a90 con 0x7f34401598b0 2023-10-14T19:08:25.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f34455c2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34401588b0 con 0x7f3440159c80 2023-10-14T19:08:25.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f34455c2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3440157ca0 con 0x7f34400af790 2023-10-14T19:08:25.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 0x7f3440155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 0x7f3440155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44416/0 (socket says 172.21.15.7:44416) 2023-10-14T19:08:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 -- 172.21.15.7:0/422749091 learned_addr learned my addr 172.21.15.7:0/422749091 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343effd700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f34400b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343f7fe700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3440159c80 0x7f3440153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 -- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 msgr2=0x7f34400b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f34400b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 -- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3440159c80 msgr2=0x7f3440153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:25.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3440159c80 0x7f3440153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:25.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 -- 172.21.15.7:0/422749091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009ae0 con 0x7f34401598b0 2023-10-14T19:08:25.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.887+0000 7f343e7fc700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 0x7f3440155d00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f342800c560 tx=0x7f3428007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.888+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428005a70 con 0x7f34401598b0 2023-10-14T19:08:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.888+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428005bd0 con 0x7f34401598b0 2023-10-14T19:08:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.888+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3438009420 con 0x7f34401598b0 2023-10-14T19:08:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.888+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280070d0 con 0x7f34401598b0 2023-10-14T19:08:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.888+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3440158260 con 0x7f34401598b0 2023-10-14T19:08:25.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.889+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344004c3c0 con 0x7f34401598b0 2023-10-14T19:08:25.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.889+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f3428007480 con 0x7f34401598b0 2023-10-14T19:08:25.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.889+0000 7f3436ffd700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3420067170 0x7f3420069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:25.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.890+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3428083e90 con 0x7f34401598b0 2023-10-14T19:08:25.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.890+0000 7f343effd700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3420067170 0x7f3420069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:25.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.890+0000 7f343effd700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3420067170 0x7f3420069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3430009ab0 tx=0x7f343000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:25.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:25.894+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3428050dd0 con 0x7f34401598b0 2023-10-14T19:08:26.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.133+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34400ce660 con 0x7f34401598b0 2023-10-14T19:08:26.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.133+0000 7f3436ffd700 1 -- 172.21.15.7:0/422749091 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3428085020 con 0x7f34401598b0 2023-10-14T19:08:26.134 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:08:26.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3420067170 msgr2=0x7f3420069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:26.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3420067170 0x7f3420069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3430009ab0 tx=0x7f343000b040 comp rx=0 tx=0).stop 2023-10-14T19:08:26.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 msgr2=0x7f3440155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:26.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 0x7f3440155d00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f342800c560 tx=0x7f3428007f70 comp rx=0 tx=0).stop 2023-10-14T19:08:26.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 shutdown_connections 2023-10-14T19:08:26.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3420067170 0x7f3420069620 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3440159c80 0x7f3440153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34400af790 0x7f34400b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 --2- 172.21.15.7:0/422749091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34401598b0 0x7f3440155d00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 >> 172.21.15.7:0/422749091 conn(0x7f3440070e30 msgr2=0x7f3440154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 shutdown_connections 2023-10-14T19:08:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.135+0000 7f34455c2700 1 -- 172.21.15.7:0/422749091 wait complete. 2023-10-14T19:08:26.148 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:08:26.149 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:08:26.149 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:08:26.149 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:08:26.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:26.150 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:08:26.150 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:08:26.150 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:08:26.151 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:08:26.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.152 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:08:26.167 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:08:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:08:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:08:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:08:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.169 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:08:26.169 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:08:26.170 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:08:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:08:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:08:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42148sec preferred_lft 42148sec 2023-10-14T19:08:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:08:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.172 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:08:26.172 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:08:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:08:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:08:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.174 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:08:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:08:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.175 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:08:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:08:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:26.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.176 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:08:26.231 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:08:26.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.233 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:08:26.289 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:08:26.290 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:08:26.290 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:08:26.291 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:08:26.291 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:08:26.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.292 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:08:26.292 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:08:26.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:08:26.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:08:26.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:08:26.294 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:08:26.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.393 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:08:26.408 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:08:26.408 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:08:26.409 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:08:26.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:08:26.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:26.475 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:26.530 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:08:26.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:26.531 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:26.585 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:08:26.586 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:08:26.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:08:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:08:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:08:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:08:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:08:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:08:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:08:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:08:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:08:26.703 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:08:26.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:26.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:26.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:08:26.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.929+0000 7f480b47e700 1 Processor -- start 2023-10-14T19:08:26.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.929+0000 7f480b47e700 1 -- start start 2023-10-14T19:08:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480b47e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480b47e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48040cd9e0 0x7f4804159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480b47e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48040cde50 0x7f480415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480b47e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040d13f0 con 0x7f48040cde50 2023-10-14T19:08:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480b47e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480415a940 con 0x7f48040cd9e0 2023-10-14T19:08:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480b47e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480415ae40 con 0x7f48040cb5a0 2023-10-14T19:08:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48040cde50 0x7f480415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48040cde50 0x7f480415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44854/0 (socket says 172.21.15.7:44854) 2023-10-14T19:08:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 -- 172.21.15.7:0/1931850383 learned_addr learned my addr 172.21.15.7:0/1931850383 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480921a700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4808a19700 1 --2- 172.21.15.7:0/1931850383 >> v2:172.21.15.148:3300/0 conn(0x7f48040cd9e0 0x7f4804159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 -- 172.21.15.7:0/1931850383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 msgr2=0x7f48040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 -- 172.21.15.7:0/1931850383 >> v2:172.21.15.148:3300/0 conn(0x7f48040cd9e0 msgr2=0x7f4804159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 --2- 172.21.15.7:0/1931850383 >> v2:172.21.15.148:3300/0 conn(0x7f48040cd9e0 0x7f4804159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 -- 172.21.15.7:0/1931850383 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480415ab60 con 0x7f48040cde50 2023-10-14T19:08:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4808a19700 1 --2- 172.21.15.7:0/1931850383 >> v2:172.21.15.148:3300/0 conn(0x7f48040cd9e0 0x7f4804159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:26.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f480921a700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:26.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4809a1b700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040cde50 0x7f480415a400 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f480406ea90 tx=0x7f47fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bd019698753c82 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:26.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.930+0000 7f4803fff700 1 -- 172.21.15.7:0/1931850383 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00e070 con 0x7f48040cde50 2023-10-14T19:08:26.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f4803fff700 1 -- 172.21.15.7:0/1931850383 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc00ba40 con 0x7f48040cde50 2023-10-14T19:08:26.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f4803fff700 1 -- 172.21.15.7:0/1931850383 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0092e0 con 0x7f48040cde50 2023-10-14T19:08:26.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 -- 172.21.15.7:0/1931850383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040cde50 msgr2=0x7f480415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:26.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040cde50 0x7f480415a400 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f480406ea90 tx=0x7f47fc009840 comp rx=0 tx=0).stop 2023-10-14T19:08:26.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 -- 172.21.15.7:0/1931850383 shutdown_connections 2023-10-14T19:08:26.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040cde50 0x7f480415a400 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 --2- 172.21.15.7:0/1931850383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 --2- 172.21.15.7:0/1931850383 >> v2:172.21.15.148:3300/0 conn(0x7f48040cd9e0 0x7f4804159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 -- 172.21.15.7:0/1931850383 >> 172.21.15.7:0/1931850383 conn(0x7f4804070e30 msgr2=0x7f48040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:26.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 -- 172.21.15.7:0/1931850383 shutdown_connections 2023-10-14T19:08:26.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.931+0000 7f480b47e700 1 -- 172.21.15.7:0/1931850383 wait complete. 2023-10-14T19:08:26.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.932+0000 7f480b47e700 1 Processor -- start 2023-10-14T19:08:26.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.932+0000 7f480b47e700 1 -- start start 2023-10-14T19:08:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480b47e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48041560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480b47e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48040cd9e0 0x7f48040c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480b47e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 0x7f4804159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480b47e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804159ea0 con 0x7f48040c7d00 2023-10-14T19:08:26.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480b47e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480415c1b0 con 0x7f48040cd9e0 2023-10-14T19:08:26.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480b47e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480415c490 con 0x7f48040cb5a0 2023-10-14T19:08:26.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f4809a1b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 0x7f4804159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f4809a1b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 0x7f4804159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44856/0 (socket says 172.21.15.7:44856) 2023-10-14T19:08:26.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f4809a1b700 1 -- 172.21.15.7:0/1075543207 learned_addr learned my addr 172.21.15.7:0/1075543207 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:26.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.933+0000 7f480921a700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48041560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4808a19700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48040cd9e0 0x7f48040c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4809a1b700 1 -- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 msgr2=0x7f48041560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4809a1b700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48041560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4809a1b700 1 -- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48040cd9e0 msgr2=0x7f48040c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4809a1b700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48040cd9e0 0x7f48040c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4809a1b700 1 -- 172.21.15.7:0/1075543207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc009ae0 con 0x7f48040c7d00 2023-10-14T19:08:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4808a19700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48040cd9e0 0x7f48040c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f4809a1b700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 0x7f4804159350 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f480406ea60 tx=0x7f47fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc008e40 con 0x7f48040c7d00 2023-10-14T19:08:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc01c410 con 0x7f48040c7d00 2023-10-14T19:08:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480415c770 con 0x7f48040c7d00 2023-10-14T19:08:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc01c7b0 con 0x7f48040c7d00 2023-10-14T19:08:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.934+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480415dec0 con 0x7f48040c7d00 2023-10-14T19:08:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.935+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480404c3c0 con 0x7f48040c7d00 2023-10-14T19:08:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.935+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f47fc003040 con 0x7f48040c7d00 2023-10-14T19:08:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.936+0000 7f48017fa700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47f0067170 0x7f47f0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.936+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47fc086300 con 0x7f48040c7d00 2023-10-14T19:08:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.936+0000 7f480921a700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47f0067170 0x7f47f0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.936+0000 7f480921a700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47f0067170 0x7f47f0069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47f400ab30 tx=0x7f47f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:26.940+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47fc0531d0 con 0x7f48040c7d00 2023-10-14T19:08:27.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.183+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48040ccf00 con 0x7f48040c7d00 2023-10-14T19:08:27.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.183+0000 7f48017fa700 1 -- 172.21.15.7:0/1075543207 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f47fc0567f0 con 0x7f48040c7d00 2023-10-14T19:08:27.184 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:08:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47f0067170 msgr2=0x7f47f0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47f0067170 0x7f47f0069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47f400ab30 tx=0x7f47f4008040 comp rx=0 tx=0).stop 2023-10-14T19:08:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 msgr2=0x7f4804159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 0x7f4804159350 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f480406ea60 tx=0x7f47fc018000 comp rx=0 tx=0).stop 2023-10-14T19:08:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 shutdown_connections 2023-10-14T19:08:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47f0067170 0x7f47f0069620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48040c7d00 0x7f4804159350 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48040cb5a0 0x7f48041560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 --2- 172.21.15.7:0/1075543207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48040cd9e0 0x7f48040c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 >> 172.21.15.7:0/1075543207 conn(0x7f4804070e30 msgr2=0x7f48040c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:27.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 shutdown_connections 2023-10-14T19:08:27.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.185+0000 7f480b47e700 1 -- 172.21.15.7:0/1075543207 wait complete. 2023-10-14T19:08:27.199 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:08:27.199 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:08:27.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:08:27.200 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:08:27.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:27.200 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:08:27.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:08:27.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:08:27.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:08:27.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.202 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:08:27.221 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:08:27.222 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:08:27.223 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:08:27.223 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.223 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:08:27.223 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.224 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:27.225 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:27.225 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:08:27.225 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:27.226 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:27.226 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:08:27.227 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:27.227 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:27.227 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:08:27.227 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:27.228 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:08:27.228 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42157sec preferred_lft 42157sec 2023-10-14T19:08:27.228 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:08:27.228 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.228 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:08:27.229 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:27.229 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:08:27.229 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.229 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:08:27.229 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.230 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:27.230 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:08:27.230 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:08:27.230 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.230 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:27.231 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:08:27.231 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:08:27.231 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:27.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.232 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:08:27.290 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:08:27.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.291 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:08:27.350 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:08:27.351 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:08:27.351 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:08:27.351 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:08:27.351 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:08:27.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.352 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:08:27.353 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:08:27.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:08:27.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:08:27.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:08:27.354 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:08:27.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.457 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:08:27.472 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:08:27.472 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:08:27.473 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:08:27.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.473 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:08:27.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:27.537 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:27.591 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:08:27.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:27.592 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:27.646 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:08:27.646 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:08:27.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:27.726 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:27.726 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:08:27.726 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:08:27.734 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:27.735 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:08:27.735 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:08:27.735 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:27.735 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:27.757 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:27.758 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:08:27.758 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:08:27.758 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:27.758 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:27.759 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:08:27.759 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:08:27.759 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:08:27.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:08:27.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:27.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:27.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:08:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.956+0000 7f2122375700 1 Processor -- start 2023-10-14T19:08:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.956+0000 7f2122375700 1 -- start start 2023-10-14T19:08:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2122375700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f211c06dcf0 0x7f211c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2122375700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 0x7f211c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2122375700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0ccfd0 con 0x7f211c159530 2023-10-14T19:08:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2122375700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c15a410 con 0x7f211c06dcf0 2023-10-14T19:08:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2122375700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15a6f0 con 0x7f211c159e40 2023-10-14T19:08:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f211c06dcf0 0x7f211c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2120912700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 0x7f211c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f211c159530 0x7f211c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:47932/0 (socket says 172.21.15.7:47932) 2023-10-14T19:08:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f211c06dcf0 0x7f211c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56090/0 (socket says 172.21.15.7:56090) 2023-10-14T19:08:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2120912700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 0x7f211c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:45790/0 (socket says 172.21.15.7:45790) 2023-10-14T19:08:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211bfff700 1 -- 172.21.15.7:0/3187095006 learned_addr learned my addr 172.21.15.7:0/3187095006 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211b7fe700 1 -- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 msgr2=0x7f211c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211b7fe700 1 --2- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 0x7f211c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211b7fe700 1 -- 172.21.15.7:0/3187095006 >> v1:172.21.15.148:6789/0 conn(0x7f211c159530 legacy=0x7f211c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211b7fe700 1 -- 172.21.15.7:0/3187095006 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c15a9d0 con 0x7f211c06dcf0 2023-10-14T19:08:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f211affd700 1 -- 172.21.15.7:0/3187095006 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187473947 0 0) 0x7f211c0ccfd0 con 0x7f211c159530 2023-10-14T19:08:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.957+0000 7f2120912700 1 --2- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 0x7f211c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f211b7fe700 1 --2- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c06dcf0 0x7f211c159900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f210c0098e0 tx=0x7f210c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c066fb80532b55 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f211affd700 1 -- 172.21.15.7:0/3187095006 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c00b640 con 0x7f211c06dcf0 2023-10-14T19:08:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f211affd700 1 -- 172.21.15.7:0/3187095006 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00b7a0 con 0x7f211c06dcf0 2023-10-14T19:08:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f211affd700 1 -- 172.21.15.7:0/3187095006 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c00bb40 con 0x7f211c06dcf0 2023-10-14T19:08:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 -- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c06dcf0 msgr2=0x7f211c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 --2- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c06dcf0 0x7f211c159900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f210c0098e0 tx=0x7f210c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 -- 172.21.15.7:0/3187095006 shutdown_connections 2023-10-14T19:08:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 --2- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c159e40 0x7f211c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 --2- 172.21.15.7:0/3187095006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c06dcf0 0x7f211c159900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 -- 172.21.15.7:0/3187095006 >> 172.21.15.7:0/3187095006 conn(0x7f211c0703a0 msgr2=0x7f211c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 -- 172.21.15.7:0/3187095006 shutdown_connections 2023-10-14T19:08:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.958+0000 7f2122375700 1 -- 172.21.15.7:0/3187095006 wait complete. 2023-10-14T19:08:27.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 Processor -- start 2023-10-14T19:08:27.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 -- start start 2023-10-14T19:08:27.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c06dcf0 0x7f211c169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:27.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 0x7f211c168c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:27.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f211c159e40 0x7f211c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c157d70 con 0x7f211c159e40 2023-10-14T19:08:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c16a370 con 0x7f211c159530 2023-10-14T19:08:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.960+0000 7f2122375700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c16ce10 con 0x7f211c06dcf0 2023-10-14T19:08:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 0x7f211c168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f2120912700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f211c159e40 0x7f211c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c06dcf0 0x7f211c169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 0x7f211c168c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56094/0 (socket says 172.21.15.7:56094) 2023-10-14T19:08:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 -- 172.21.15.7:0/3453143812 learned_addr learned my addr 172.21.15.7:0/3453143812 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 -- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c06dcf0 msgr2=0x7f211c169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:27.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c06dcf0 0x7f211c169e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 -- 172.21.15.7:0/3453143812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f211c159e40 msgr2=0x7f211c0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:27.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f211c159e40 0x7f211c0d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:27.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 -- 172.21.15.7:0/3453143812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009a20 con 0x7f211c159530 2023-10-14T19:08:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f211b7fe700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 0x7f211c168c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f211c089650 tx=0x7f210c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c000d10 con 0x7f211c159530 2023-10-14T19:08:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00bb20 con 0x7f211c159530 2023-10-14T19:08:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c009420 con 0x7f211c159530 2023-10-14T19:08:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c011670 con 0x7f211c159530 2023-10-14T19:08:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.961+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c16d3d0 con 0x7f211c159530 2023-10-14T19:08:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.962+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c04c3c0 con 0x7f211c159530 2023-10-14T19:08:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.963+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f210c011a20 con 0x7f211c159530 2023-10-14T19:08:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.963+0000 7f2103fff700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2108067170 0x7f2108069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.963+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f210c085d80 con 0x7f211c159530 2023-10-14T19:08:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.963+0000 7f211bfff700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2108067170 0x7f2108069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.964+0000 7f211bfff700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2108067170 0x7f2108069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2110007fd0 tx=0x7f2110007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:27.968+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f210c052e20 con 0x7f211c159530 2023-10-14T19:08:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.208+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f211c0ce6a0 con 0x7f211c159530 2023-10-14T19:08:28.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.877+0000 7f2103fff700 1 -- 172.21.15.7:0/3453143812 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 136+0+0 (secure 0 0 0) 0x7f210c056440 con 0x7f211c159530 2023-10-14T19:08:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2108067170 msgr2=0x7f2108069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2108067170 0x7f2108069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2110007fd0 tx=0x7f2110007d30 comp rx=0 tx=0).stop 2023-10-14T19:08:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 msgr2=0x7f211c168c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 0x7f211c168c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f211c089650 tx=0x7f210c017000 comp rx=0 tx=0).stop 2023-10-14T19:08:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 shutdown_connections 2023-10-14T19:08:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2108067170 0x7f2108069620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f211c159e40 0x7f211c0d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f211c06dcf0 0x7f211c169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 --2- 172.21.15.7:0/3453143812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c159530 0x7f211c168c90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.880+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 >> 172.21.15.7:0/3453143812 conn(0x7f211c0703a0 msgr2=0x7f211c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.881+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 shutdown_connections 2023-10-14T19:08:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:28.881+0000 7f2122375700 1 -- 172.21.15.7:0/3453143812 wait complete. 2023-10-14T19:08:28.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:08:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.024+0000 7faf55ff5700 1 Processor -- start 2023-10-14T19:08:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.024+0000 7faf55ff5700 1 -- start start 2023-10-14T19:08:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf55ff5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faf500cb970 0x7faf50159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf55ff5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf50156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf55ff5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5015ae40 con 0x7faf500cb5a0 2023-10-14T19:08:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf55ff5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf500ce0f0 con 0x7faf500cb970 2023-10-14T19:08:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf55ff5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf500d13f0 con 0x7faf5015a400 2023-10-14T19:08:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faf500cb970 0x7faf50159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faf500cb5a0 0x7faf500cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58136/0 (socket says 172.21.15.7:58136) 2023-10-14T19:08:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4f7fe700 1 -- 172.21.15.7:0/1905693616 learned_addr learned my addr 172.21.15.7:0/1905693616 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4ffff700 1 --2- 172.21.15.7:0/1905693616 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf50156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4e7fc700 1 -- 172.21.15.7:0/1905693616 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321959934 0 0) 0x7faf5015ae40 con 0x7faf500cb5a0 2023-10-14T19:08:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4e7fc700 1 -- 172.21.15.7:0/1905693616 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c003570 con 0x7faf500cb5a0 2023-10-14T19:08:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4effd700 1 -- 172.21.15.7:0/1905693616 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 msgr2=0x7faf50156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4effd700 1 --2- 172.21.15.7:0/1905693616 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf50156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4effd700 1 -- 172.21.15.7:0/1905693616 >> v1:172.21.15.7:6789/0 conn(0x7faf500cb5a0 legacy=0x7faf500cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4effd700 1 -- 172.21.15.7:0/1905693616 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5015ab60 con 0x7faf500cb970 2023-10-14T19:08:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4effd700 1 --2- 172.21.15.7:0/1905693616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf50159ec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faf380098e0 tx=0x7faf380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c4618810b08b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.025+0000 7faf4e7fc700 1 -- 172.21.15.7:0/1905693616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38011630 con 0x7faf500cb970 2023-10-14T19:08:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf4e7fc700 1 -- 172.21.15.7:0/1905693616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38011790 con 0x7faf500cb970 2023-10-14T19:08:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf4e7fc700 1 -- 172.21.15.7:0/1905693616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38011b30 con 0x7faf500cb970 2023-10-14T19:08:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 -- 172.21.15.7:0/1905693616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 msgr2=0x7faf50159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 --2- 172.21.15.7:0/1905693616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf50159ec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faf380098e0 tx=0x7faf380091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 -- 172.21.15.7:0/1905693616 shutdown_connections 2023-10-14T19:08:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 --2- 172.21.15.7:0/1905693616 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf50156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 --2- 172.21.15.7:0/1905693616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf50159ec0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 -- 172.21.15.7:0/1905693616 >> 172.21.15.7:0/1905693616 conn(0x7faf50070e30 msgr2=0x7faf500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 -- 172.21.15.7:0/1905693616 shutdown_connections 2023-10-14T19:08:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.026+0000 7faf55ff5700 1 -- 172.21.15.7:0/1905693616 wait complete. 2023-10-14T19:08:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.027+0000 7faf55ff5700 1 Processor -- start 2023-10-14T19:08:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.027+0000 7faf55ff5700 1 -- start start 2023-10-14T19:08:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf55ff5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf500cb5a0 0x7faf50159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf55ff5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf5016cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf55ff5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf5016d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf55ff5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50157470 con 0x7faf500cb970 2023-10-14T19:08:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf55ff5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf501540f0 con 0x7faf500cb5a0 2023-10-14T19:08:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf55ff5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf50152b20 con 0x7faf5015a400 2023-10-14T19:08:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf4effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf5016cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf4effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf5016cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44892/0 (socket says 172.21.15.7:44892) 2023-10-14T19:08:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf4effd700 1 -- 172.21.15.7:0/978999060 learned_addr learned my addr 172.21.15.7:0/978999060 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf4ffff700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf5016d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.028+0000 7faf4f7fe700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf500cb5a0 0x7faf50159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4effd700 1 -- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 msgr2=0x7faf5016d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4effd700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf5016d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4effd700 1 -- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf500cb5a0 msgr2=0x7faf50159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4effd700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf500cb5a0 0x7faf50159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4effd700 1 -- 172.21.15.7:0/978999060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38009420 con 0x7faf500cb970 2023-10-14T19:08:29.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4f7fe700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf500cb5a0 0x7faf50159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:29.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf4effd700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf5016cc60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7faf38009ed0 tx=0x7faf38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38000d10 con 0x7faf500cb970 2023-10-14T19:08:29.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38011b10 con 0x7faf500cb970 2023-10-14T19:08:29.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf50156c60 con 0x7faf500cb970 2023-10-14T19:08:29.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38025640 con 0x7faf500cb970 2023-10-14T19:08:29.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.029+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf50154670 con 0x7faf500cb970 2023-10-14T19:08:29.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.030+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf50154800 con 0x7faf500cb970 2023-10-14T19:08:29.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.030+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7faf38025a30 con 0x7faf500cb970 2023-10-14T19:08:29.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.031+0000 7faf477fe700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faf30067170 0x7faf30069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.031+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf380860a0 con 0x7faf500cb970 2023-10-14T19:08:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.031+0000 7faf4f7fe700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faf30067170 0x7faf30069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.032+0000 7faf4f7fe700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faf30067170 0x7faf30069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faf5015e070 tx=0x7faf40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.035+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf38053080 con 0x7faf500cb970 2023-10-14T19:08:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.257+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faf5004c3c0 con 0x7faf30067170 2023-10-14T19:08:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.259+0000 7faf477fe700 1 -- 172.21.15.7:0/978999060 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7faf5004c3c0 con 0x7faf30067170 2023-10-14T19:08:29.260 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:08:29.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:29.260 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:08:29.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:29.261 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:08:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faf30067170 msgr2=0x7faf30069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faf30067170 0x7faf30069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faf5015e070 tx=0x7faf40009040 comp rx=0 tx=0).stop 2023-10-14T19:08:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 msgr2=0x7faf5016cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf5016cc60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7faf38009ed0 tx=0x7faf38017000 comp rx=0 tx=0).stop 2023-10-14T19:08:29.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 shutdown_connections 2023-10-14T19:08:29.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faf30067170 0x7faf30069620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf500cb5a0 0x7faf50159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf5015a400 0x7faf5016d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 --2- 172.21.15.7:0/978999060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf500cb970 0x7faf5016cc60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 >> 172.21.15.7:0/978999060 conn(0x7faf50070e30 msgr2=0x7faf500b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:29.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 shutdown_connections 2023-10-14T19:08:29.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.261+0000 7faf55ff5700 1 -- 172.21.15.7:0/978999060 wait complete. 2023-10-14T19:08:29.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:08:29.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.396+0000 7f271762d700 1 Processor -- start 2023-10-14T19:08:29.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.396+0000 7f271762d700 1 -- start start 2023-10-14T19:08:29.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f271762d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006dc70 0x7f2710159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f271762d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f271006e0e0 0x7f27100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f271762d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27100ccfd0 con 0x7f2710159530 2023-10-14T19:08:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f271762d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271015a3d0 con 0x7f271006e0e0 2023-10-14T19:08:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f271762d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271015a6b0 con 0x7f271006dc70 2023-10-14T19:08:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2715bca700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f271006e0e0 0x7f27100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2714bc8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006dc70 0x7f2710159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f27153c9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2710159530 0x7f27100ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:47940/0 (socket says 172.21.15.7:47940) 2023-10-14T19:08:29.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f27153c9700 1 -- 172.21.15.7:0/463440047 learned_addr learned my addr 172.21.15.7:0/463440047 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:29.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2714bc8700 1 -- 172.21.15.7:0/463440047 >> v2:172.21.15.148:3300/0 conn(0x7f271006e0e0 msgr2=0x7f27100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:29.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2714bc8700 1 --2- 172.21.15.7:0/463440047 >> v2:172.21.15.148:3300/0 conn(0x7f271006e0e0 0x7f27100cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2714bc8700 1 -- 172.21.15.7:0/463440047 >> v1:172.21.15.148:6789/0 conn(0x7f2710159530 legacy=0x7f27100ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2714bc8700 1 -- 172.21.15.7:0/463440047 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271015a990 con 0x7f271006dc70 2023-10-14T19:08:29.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.397+0000 7f2714bc8700 1 --2- 172.21.15.7:0/463440047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006dc70 0x7f2710159900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27000098e0 tx=0x7f27000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d8629df5050d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f2707fff700 1 -- 172.21.15.7:0/463440047 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000b640 con 0x7f271006dc70 2023-10-14T19:08:29.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f2707fff700 1 -- 172.21.15.7:0/463440047 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000b7a0 con 0x7f271006dc70 2023-10-14T19:08:29.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f2707fff700 1 -- 172.21.15.7:0/463440047 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000bb40 con 0x7f271006dc70 2023-10-14T19:08:29.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 -- 172.21.15.7:0/463440047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006dc70 msgr2=0x7f2710159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 --2- 172.21.15.7:0/463440047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006dc70 0x7f2710159900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27000098e0 tx=0x7f27000091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 -- 172.21.15.7:0/463440047 shutdown_connections 2023-10-14T19:08:29.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 --2- 172.21.15.7:0/463440047 >> v2:172.21.15.148:3300/0 conn(0x7f271006e0e0 0x7f27100cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 --2- 172.21.15.7:0/463440047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006dc70 0x7f2710159900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 -- 172.21.15.7:0/463440047 >> 172.21.15.7:0/463440047 conn(0x7f27100703a0 msgr2=0x7f27100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:29.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 -- 172.21.15.7:0/463440047 shutdown_connections 2023-10-14T19:08:29.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.398+0000 7f271762d700 1 -- 172.21.15.7:0/463440047 wait complete. 2023-10-14T19:08:29.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.399+0000 7f271762d700 1 Processor -- start 2023-10-14T19:08:29.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.399+0000 7f271762d700 1 -- start start 2023-10-14T19:08:29.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.400+0000 7f271762d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006dc70 0x7f2710140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.400+0000 7f271762d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006e0e0 0x7f27100c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.400+0000 7f271762d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 0x7f27100ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.400+0000 7f271762d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710140fc0 con 0x7f2710159530 2023-10-14T19:08:29.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.400+0000 7f271762d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27101536c0 con 0x7f271006dc70 2023-10-14T19:08:29.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.400+0000 7f271762d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2710157b20 con 0x7f271006e0e0 2023-10-14T19:08:29.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 0x7f27100ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 0x7f27100ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44902/0 (socket says 172.21.15.7:44902) 2023-10-14T19:08:29.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 -- 172.21.15.7:0/1032556069 learned_addr learned my addr 172.21.15.7:0/1032556069 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:29.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2714bc8700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006e0e0 0x7f27100c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f27153c9700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006dc70 0x7f2710140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 -- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006e0e0 msgr2=0x7f27100c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006e0e0 0x7f27100c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 -- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006dc70 msgr2=0x7f2710140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006dc70 0x7f2710140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 -- 172.21.15.7:0/1032556069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700009420 con 0x7f2710159530 2023-10-14T19:08:29.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f27153c9700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006dc70 0x7f2710140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:29.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2714bc8700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006e0e0 0x7f27100c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:29.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f2715bca700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 0x7f27100ca270 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2708009ef0 tx=0x7f270800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800cc50 con 0x7f2710159530 2023-10-14T19:08:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800f040 con 0x7f2710159530 2023-10-14T19:08:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2710157dc0 con 0x7f2710159530 2023-10-14T19:08:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708014480 con 0x7f2710159530 2023-10-14T19:08:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.401+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2710158380 con 0x7f2710159530 2023-10-14T19:08:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.402+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271004c3c0 con 0x7f2710159530 2023-10-14T19:08:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.403+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2708014830 con 0x7f2710159530 2023-10-14T19:08:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.403+0000 7f27057fa700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26f40671a0 0x7f26f4069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.403+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2708085730 con 0x7f2710159530 2023-10-14T19:08:29.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.404+0000 7f27153c9700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26f40671a0 0x7f26f4069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.404+0000 7f27153c9700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26f40671a0 0x7f26f4069650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f270c0017a0 tx=0x7f270c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.407+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2708052600 con 0x7f2710159530 2023-10-14T19:08:29.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.600+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f271015ac70 con 0x7f2710159530 2023-10-14T19:08:29.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.601+0000 7f27057fa700 1 -- 172.21.15.7:0/1032556069 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2708055c20 con 0x7f2710159530 2023-10-14T19:08:29.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26f40671a0 msgr2=0x7f26f4069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26f40671a0 0x7f26f4069650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f270c0017a0 tx=0x7f270c009040 comp rx=0 tx=0).stop 2023-10-14T19:08:29.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 msgr2=0x7f27100ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 0x7f27100ca270 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2708009ef0 tx=0x7f270800b040 comp rx=0 tx=0).stop 2023-10-14T19:08:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 shutdown_connections 2023-10-14T19:08:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26f40671a0 0x7f26f4069650 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006dc70 0x7f2710140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2710159530 0x7f27100ca270 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 --2- 172.21.15.7:0/1032556069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271006e0e0 0x7f27100c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 >> 172.21.15.7:0/1032556069 conn(0x7f27100703a0 msgr2=0x7f27100cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:29.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 shutdown_connections 2023-10-14T19:08:29.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.603+0000 7f271762d700 1 -- 172.21.15.7:0/1032556069 wait complete. 2023-10-14T19:08:29.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000693312 2023-10-14T19:08:29.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.738+0000 7f94b0e67700 1 Processor -- start 2023-10-14T19:08:29.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.738+0000 7f94b0e67700 1 -- start start 2023-10-14T19:08:29.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.739+0000 7f94b0e67700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac06dc70 0x7f94ac159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.739+0000 7f94b0e67700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94ac06e0e0 0x7f94ac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.739+0000 7f94b0e67700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0ccfd0 con 0x7f94ac159530 2023-10-14T19:08:29.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.739+0000 7f94b0e67700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac15a3d0 con 0x7f94ac06e0e0 2023-10-14T19:08:29.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.739+0000 7f94b0e67700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac15a6b0 con 0x7f94ac06dc70 2023-10-14T19:08:29.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94aad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94ac06e0e0 0x7f94ac0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94aa59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f94ac159530 0x7f94ac0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:47946/0 (socket says 172.21.15.7:47946) 2023-10-14T19:08:29.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a9d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac06dc70 0x7f94ac159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94aa59c700 1 -- 172.21.15.7:0/291785138 learned_addr learned my addr 172.21.15.7:0/291785138 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:29.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a9d9b700 1 -- 172.21.15.7:0/291785138 >> v2:172.21.15.148:3300/0 conn(0x7f94ac06e0e0 msgr2=0x7f94ac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:29.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a9d9b700 1 --2- 172.21.15.7:0/291785138 >> v2:172.21.15.148:3300/0 conn(0x7f94ac06e0e0 0x7f94ac0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a9d9b700 1 -- 172.21.15.7:0/291785138 >> v1:172.21.15.148:6789/0 conn(0x7f94ac159530 legacy=0x7f94ac0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a959a700 1 -- 172.21.15.7:0/291785138 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870722170 0 0) 0x7f94ac0ccfd0 con 0x7f94ac159530 2023-10-14T19:08:29.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a9d9b700 1 -- 172.21.15.7:0/291785138 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac15a990 con 0x7f94ac06dc70 2023-10-14T19:08:29.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94aad9d700 1 --2- 172.21.15.7:0/291785138 >> v2:172.21.15.148:3300/0 conn(0x7f94ac06e0e0 0x7f94ac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:29.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.740+0000 7f94a9d9b700 1 --2- 172.21.15.7:0/291785138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac06dc70 0x7f94ac159900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94940098e0 tx=0x7f94940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4e44c4c5d17221 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94a959a700 1 -- 172.21.15.7:0/291785138 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400b640 con 0x7f94ac06dc70 2023-10-14T19:08:29.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94a959a700 1 -- 172.21.15.7:0/291785138 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949400b7a0 con 0x7f94ac06dc70 2023-10-14T19:08:29.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94a959a700 1 -- 172.21.15.7:0/291785138 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400bb40 con 0x7f94ac06dc70 2023-10-14T19:08:29.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 -- 172.21.15.7:0/291785138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac06dc70 msgr2=0x7f94ac159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 --2- 172.21.15.7:0/291785138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac06dc70 0x7f94ac159900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94940098e0 tx=0x7f94940091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 -- 172.21.15.7:0/291785138 shutdown_connections 2023-10-14T19:08:29.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 --2- 172.21.15.7:0/291785138 >> v2:172.21.15.148:3300/0 conn(0x7f94ac06e0e0 0x7f94ac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 --2- 172.21.15.7:0/291785138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac06dc70 0x7f94ac159900 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 -- 172.21.15.7:0/291785138 >> 172.21.15.7:0/291785138 conn(0x7f94ac0703a0 msgr2=0x7f94ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:29.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 -- 172.21.15.7:0/291785138 shutdown_connections 2023-10-14T19:08:29.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.741+0000 7f94b0e67700 1 -- 172.21.15.7:0/291785138 wait complete. 2023-10-14T19:08:29.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.742+0000 7f94b0e67700 1 Processor -- start 2023-10-14T19:08:29.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.742+0000 7f94b0e67700 1 -- start start 2023-10-14T19:08:29.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94b0e67700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 0x7f94ac0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94b0e67700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ac06e0e0 0x7f94ac0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94b0e67700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac159530 0x7f94ac0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94b0e67700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b26d0 con 0x7f94ac06dc70 2023-10-14T19:08:29.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94b0e67700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b1ac0 con 0x7f94ac06e0e0 2023-10-14T19:08:29.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94b0e67700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b1da0 con 0x7f94ac159530 2023-10-14T19:08:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 0x7f94ac0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 0x7f94ac0b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44916/0 (socket says 172.21.15.7:44916) 2023-10-14T19:08:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 -- 172.21.15.7:0/3838103593 learned_addr learned my addr 172.21.15.7:0/3838103593 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94a9d9b700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ac06e0e0 0x7f94ac0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aad9d700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac159530 0x7f94ac0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 -- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac159530 msgr2=0x7f94ac0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac159530 0x7f94ac0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 -- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ac06e0e0 msgr2=0x7f94ac0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.743+0000 7f94aa59c700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ac06e0e0 0x7f94ac0b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:29.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94aa59c700 1 -- 172.21.15.7:0/3838103593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009420 con 0x7f94ac06dc70 2023-10-14T19:08:29.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94aa59c700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 0x7f94ac0b2b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f949c00cc70 tx=0x7f949c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00ce80 con 0x7f94ac06dc70 2023-10-14T19:08:29.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00ab70 con 0x7f94ac06dc70 2023-10-14T19:08:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494009420 con 0x7f94ac06dc70 2023-10-14T19:08:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0070f0 con 0x7f94ac06dc70 2023-10-14T19:08:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.744+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0b2360 con 0x7f94ac06dc70 2023-10-14T19:08:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.745+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac0b29b0 con 0x7f94ac06dc70 2023-10-14T19:08:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.745+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f949c0074e0 con 0x7f94ac06dc70 2023-10-14T19:08:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.746+0000 7f94a27fc700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f948c067170 0x7f948c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.746+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f949c084ce0 con 0x7f94ac06dc70 2023-10-14T19:08:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.746+0000 7f94a9d9b700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f948c067170 0x7f948c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.746+0000 7f94a9d9b700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f948c067170 0x7f948c069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94940093f0 tx=0x7f9494017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.750+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f949c051d40 con 0x7f94ac06dc70 2023-10-14T19:08:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.975+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000693312", "target": ["mon-mgr", ""]}) v1 -- 0x7f94ac0b2810 con 0x7f948c067170 2023-10-14T19:08:29.983 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:29.982+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:29.983 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:29.982+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:29.983 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:29.982+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:29.983 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:29.982+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:29.984 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:29.982+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:29.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.997+0000 7f94a27fc700 1 -- 172.21.15.7:0/3838103593 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f949400b910 con 0x7f948c067170 2023-10-14T19:08:30.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f948c067170 msgr2=0x7f948c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f948c067170 0x7f948c069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94940093f0 tx=0x7f9494017000 comp rx=0 tx=0).stop 2023-10-14T19:08:30.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 msgr2=0x7f94ac0b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 0x7f94ac0b2b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f949c00cc70 tx=0x7f949c001a30 comp rx=0 tx=0).stop 2023-10-14T19:08:30.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 shutdown_connections 2023-10-14T19:08:30.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f948c067170 0x7f948c069620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94ac159530 0x7f94ac0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94ac06dc70 0x7f94ac0b2b60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 --2- 172.21.15.7:0/3838103593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ac06e0e0 0x7f94ac0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 >> 172.21.15.7:0/3838103593 conn(0x7f94ac0703a0 msgr2=0x7f94ac153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 shutdown_connections 2023-10-14T19:08:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:29.999+0000 7f94b0e67700 1 -- 172.21.15.7:0/3838103593 wait complete. 2023-10-14T19:08:30.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-14T19:08:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.134+0000 7f87fbe24700 1 Processor -- start 2023-10-14T19:08:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.134+0000 7f87fbe24700 1 -- start start 2023-10-14T19:08:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fbe24700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f406e0e0 0x7f87f40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fbe24700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40ccfd0 con 0x7f87f406dc70 2023-10-14T19:08:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fbe24700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f415a3d0 con 0x7f87f4159530 2023-10-14T19:08:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fbe24700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f415a6b0 con 0x7f87f406e0e0 2023-10-14T19:08:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87f93bf700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f87f406dc70 0x7f87f4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58138/0 (socket says 172.21.15.7:58138) 2023-10-14T19:08:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87f93bf700 1 -- 172.21.15.7:0/3338137515 learned_addr learned my addr 172.21.15.7:0/3338137515 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fa3c1700 1 --2- 172.21.15.7:0/3338137515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f406e0e0 0x7f87f40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87f8bbe700 1 -- 172.21.15.7:0/3338137515 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985939606 0 0) 0x7f87f40ccfd0 con 0x7f87f406dc70 2023-10-14T19:08:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87f8bbe700 1 -- 172.21.15.7:0/3338137515 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87dc003570 con 0x7f87f406dc70 2023-10-14T19:08:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fa3c1700 1 -- 172.21.15.7:0/3338137515 >> v1:172.21.15.148:6789/0 conn(0x7f87f4159530 legacy=0x7f87f40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.135+0000 7f87fa3c1700 1 -- 172.21.15.7:0/3338137515 >> v1:172.21.15.7:6789/0 conn(0x7f87f406dc70 legacy=0x7f87f4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fa3c1700 1 -- 172.21.15.7:0/3338137515 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f415a990 con 0x7f87f406e0e0 2023-10-14T19:08:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fa3c1700 1 --2- 172.21.15.7:0/3338137515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f406e0e0 0x7f87f40cb6f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009890 tx=0x7f87ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00762e7e9c2b4f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87f8bbe700 1 -- 172.21.15.7:0/3338137515 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011630 con 0x7f87f406e0e0 2023-10-14T19:08:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87f8bbe700 1 -- 172.21.15.7:0/3338137515 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec011790 con 0x7f87f406e0e0 2023-10-14T19:08:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87f8bbe700 1 -- 172.21.15.7:0/3338137515 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011b50 con 0x7f87f406e0e0 2023-10-14T19:08:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fbe24700 1 -- 172.21.15.7:0/3338137515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f406e0e0 msgr2=0x7f87f40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3338137515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f406e0e0 0x7f87f40cb6f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009890 tx=0x7f87ec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fbe24700 1 -- 172.21.15.7:0/3338137515 shutdown_connections 2023-10-14T19:08:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3338137515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f406e0e0 0x7f87f40cb6f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.136+0000 7f87fbe24700 1 -- 172.21.15.7:0/3338137515 >> 172.21.15.7:0/3338137515 conn(0x7f87f40703a0 msgr2=0x7f87f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.137+0000 7f87fbe24700 1 -- 172.21.15.7:0/3338137515 shutdown_connections 2023-10-14T19:08:30.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.137+0000 7f87fbe24700 1 -- 172.21.15.7:0/3338137515 wait complete. 2023-10-14T19:08:30.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 Processor -- start 2023-10-14T19:08:30.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 -- start start 2023-10-14T19:08:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87f406dc70 0x7f87f416db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 0x7f87f4147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f4159530 0x7f87f40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f416d050 con 0x7f87f406e0e0 2023-10-14T19:08:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40b5820 con 0x7f87f406dc70 2023-10-14T19:08:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87fbe24700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40b5b00 con 0x7f87f4159530 2023-10-14T19:08:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87f93bf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 0x7f87f4147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87f93bf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 0x7f87f4147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44920/0 (socket says 172.21.15.7:44920) 2023-10-14T19:08:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.138+0000 7f87f93bf700 1 -- 172.21.15.7:0/3286683519 learned_addr learned my addr 172.21.15.7:0/3286683519 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87fa3c1700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f4159530 0x7f87f40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f9bc0700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87f406dc70 0x7f87f416db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f93bf700 1 -- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f4159530 msgr2=0x7f87f40b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f93bf700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f4159530 0x7f87f40b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f93bf700 1 -- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87f406dc70 msgr2=0x7f87f416db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f93bf700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87f406dc70 0x7f87f416db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f93bf700 1 -- 172.21.15.7:0/3286683519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009420 con 0x7f87f406e0e0 2023-10-14T19:08:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f93bf700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 0x7f87f4147040 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c590 tx=0x7f87e8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8005b30 con 0x7f87f406e0e0 2023-10-14T19:08:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8005cb0 con 0x7f87f406e0e0 2023-10-14T19:08:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f416d310 con 0x7f87f406e0e0 2023-10-14T19:08:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8007320 con 0x7f87f406e0e0 2023-10-14T19:08:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.139+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4147580 con 0x7f87f406e0e0 2023-10-14T19:08:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.140+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f416d830 con 0x7f87f406e0e0 2023-10-14T19:08:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.141+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f87e801b3b0 con 0x7f87f406e0e0 2023-10-14T19:08:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.141+0000 7f87f1ffb700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f87e0067170 0x7f87e0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.141+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87e8083d80 con 0x7f87f406e0e0 2023-10-14T19:08:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.141+0000 7f87f9bc0700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f87e0067170 0x7f87e0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.142+0000 7f87f9bc0700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f87e0067170 0x7f87e0069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007fd0 tx=0x7f87e4001860 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.145+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87f416d830 con 0x7f87f406e0e0 2023-10-14T19:08:30.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.368+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f87f416d190 con 0x7f87e0067170 2023-10-14T19:08:30.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.371+0000 7f87f1ffb700 1 -- 172.21.15.7:0/3286683519 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+533 (secure 0 0 0) 0x7f87e4014e50 con 0x7f87e0067170 2023-10-14T19:08:30.372 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:30.372 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_addrs": [ 2023-10-14T19:08:30.373 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.7:6789", 2023-10-14T19:08:30.373 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6789", 2023-10-14T19:08:30.373 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6790" 2023-10-14T19:08:30.373 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:08:30.373 INFO:teuthology.orchestra.run.smithi007.stdout: "pending_subvolume_deletions": 0, 2023-10-14T19:08:30.374 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": { 2023-10-14T19:08:30.374 INFO:teuthology.orchestra.run.smithi007.stdout: "data": [ 2023-10-14T19:08:30.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:30.374 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": " 340G", 2023-10-14T19:08:30.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_data", 2023-10-14T19:08:30.374 INFO:teuthology.orchestra.run.smithi007.stdout: "used": " 0 " 2023-10-14T19:08:30.375 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:30.375 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:08:30.375 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": [ 2023-10-14T19:08:30.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:30.375 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": " 340G", 2023-10-14T19:08:30.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_metadata", 2023-10-14T19:08:30.376 INFO:teuthology.orchestra.run.smithi007.stdout: "used": "64.0k" 2023-10-14T19:08:30.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:30.376 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:08:30.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:30.377 INFO:teuthology.orchestra.run.smithi007.stdout: "used_size": " 0 " 2023-10-14T19:08:30.377 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f87e0067170 msgr2=0x7f87e0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f87e0067170 0x7f87e0069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007fd0 tx=0x7f87e4001860 comp rx=0 tx=0).stop 2023-10-14T19:08:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 msgr2=0x7f87f4147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 0x7f87f4147040 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c590 tx=0x7f87e8007e00 comp rx=0 tx=0).stop 2023-10-14T19:08:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 shutdown_connections 2023-10-14T19:08:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f87e0067170 0x7f87e0069620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87f406dc70 0x7f87f416db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87f4159530 0x7f87f40b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 --2- 172.21.15.7:0/3286683519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87f406e0e0 0x7f87f4147040 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 >> 172.21.15.7:0/3286683519 conn(0x7f87f40703a0 msgr2=0x7f87f4153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:30.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 shutdown_connections 2023-10-14T19:08:30.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.373+0000 7f87fbe24700 1 -- 172.21.15.7:0/3286683519 wait complete. 2023-10-14T19:08:30.386 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:08:30.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:30.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:30.477 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:08:30.478 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:08:30.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:30.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:30.516 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:08:30.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:30.518 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:08:30.572 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:08:30.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:30.574 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:30.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:08:30.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:30.633 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:08:30.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:30.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.771+0000 7ff31c6a1700 1 Processor -- start 2023-10-14T19:08:30.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.771+0000 7ff31c6a1700 1 -- start start 2023-10-14T19:08:30.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31c6a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140cb5a0 0x7ff3140cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31c6a1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff3140cd9e0 0x7ff314159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31c6a1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3140cde50 0x7ff31415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31c6a1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140d13f0 con 0x7ff3140cd9e0 2023-10-14T19:08:30.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31c6a1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31415a940 con 0x7ff3140cde50 2023-10-14T19:08:30.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31c6a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31415ae40 con 0x7ff3140cb5a0 2023-10-14T19:08:30.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff3140cd9e0 0x7ff314159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff3140cd9e0 0x7ff314159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44924/0 (socket says 172.21.15.7:44924) 2023-10-14T19:08:30.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 -- 172.21.15.7:0/111920552 learned_addr learned my addr 172.21.15.7:0/111920552 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:30.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31a43d700 1 --2- 172.21.15.7:0/111920552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140cb5a0 0x7ff3140cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff31ac3e700 1 --2- 172.21.15.7:0/111920552 >> v2:172.21.15.148:3300/0 conn(0x7ff3140cde50 0x7ff31415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 -- 172.21.15.7:0/111920552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140cb5a0 msgr2=0x7ff3140cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:30.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 --2- 172.21.15.7:0/111920552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140cb5a0 0x7ff3140cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 -- 172.21.15.7:0/111920552 >> v2:172.21.15.148:3300/0 conn(0x7ff3140cde50 msgr2=0x7ff31415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:30.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 --2- 172.21.15.7:0/111920552 >> v2:172.21.15.148:3300/0 conn(0x7ff3140cde50 0x7ff31415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 -- 172.21.15.7:0/111920552 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31415ab60 con 0x7ff3140cd9e0 2023-10-14T19:08:30.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.772+0000 7ff319c3c700 1 --2- 172.21.15.7:0/111920552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff314159ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff3140cbeb0 tx=0x7ff304009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9728f371a94193 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:30.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31943b700 1 -- 172.21.15.7:0/111920552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400b820 con 0x7ff3140cd9e0 2023-10-14T19:08:30.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31943b700 1 -- 172.21.15.7:0/111920552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30400b980 con 0x7ff3140cd9e0 2023-10-14T19:08:30.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31943b700 1 -- 172.21.15.7:0/111920552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400bd20 con 0x7ff3140cd9e0 2023-10-14T19:08:30.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 -- 172.21.15.7:0/111920552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 msgr2=0x7ff314159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/111920552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff314159ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff3140cbeb0 tx=0x7ff304009250 comp rx=0 tx=0).stop 2023-10-14T19:08:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 -- 172.21.15.7:0/111920552 shutdown_connections 2023-10-14T19:08:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/111920552 >> v2:172.21.15.148:3300/0 conn(0x7ff3140cde50 0x7ff31415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/111920552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140cb5a0 0x7ff3140cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/111920552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff314159ec0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 -- 172.21.15.7:0/111920552 >> 172.21.15.7:0/111920552 conn(0x7ff314070e30 msgr2=0x7ff3140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:30.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 -- 172.21.15.7:0/111920552 shutdown_connections 2023-10-14T19:08:30.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.773+0000 7ff31c6a1700 1 -- 172.21.15.7:0/111920552 wait complete. 2023-10-14T19:08:30.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.774+0000 7ff31c6a1700 1 Processor -- start 2023-10-14T19:08:30.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 -- start start 2023-10-14T19:08:30.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3140cb5a0 0x7ff31415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff3141560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140c96e0 0x7ff31415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140ca520 con 0x7ff3140cd9e0 2023-10-14T19:08:30.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140c9c80 con 0x7ff3140cb5a0 2023-10-14T19:08:30.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff31c6a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140c9f60 con 0x7ff3140c96e0 2023-10-14T19:08:30.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff319c3c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff3141560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff319c3c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff3141560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44934/0 (socket says 172.21.15.7:44934) 2023-10-14T19:08:30.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.775+0000 7ff319c3c700 1 -- 172.21.15.7:0/4195663519 learned_addr learned my addr 172.21.15.7:0/4195663519 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:30.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff319c3c700 1 -- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140c96e0 msgr2=0x7ff31415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff319c3c700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140c96e0 0x7ff31415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff319c3c700 1 -- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3140cb5a0 msgr2=0x7ff31415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:30.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff319c3c700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3140cb5a0 0x7ff31415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:30.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff319c3c700 1 -- 172.21.15.7:0/4195663519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040094f0 con 0x7ff3140cd9e0 2023-10-14T19:08:30.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff319c3c700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff3141560e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff3040094c0 tx=0x7ff304017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:30.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304024440 con 0x7ff3140cd9e0 2023-10-14T19:08:30.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3040245c0 con 0x7ff3140cd9e0 2023-10-14T19:08:30.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3140ca240 con 0x7ff3140cd9e0 2023-10-14T19:08:30.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304024980 con 0x7ff3140cd9e0 2023-10-14T19:08:30.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.776+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31415df20 con 0x7ff3140cd9e0 2023-10-14T19:08:30.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.777+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140b3790 con 0x7ff3140cd9e0 2023-10-14T19:08:30.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.777+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff30401a420 con 0x7ff3140cd9e0 2023-10-14T19:08:30.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.778+0000 7ff30a7fc700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f8067170 0x7ff2f8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:30.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.778+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff304086650 con 0x7ff3140cd9e0 2023-10-14T19:08:30.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.778+0000 7ff31a43d700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f8067170 0x7ff2f8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:30.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.778+0000 7ff31a43d700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f8067170 0x7ff2f8069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff310009a60 tx=0x7ff310008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:30.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:30.782+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3140b3790 con 0x7ff3140cd9e0 2023-10-14T19:08:31.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.019+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3140b3790 con 0x7ff3140cd9e0 2023-10-14T19:08:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.020+0000 7ff30a7fc700 1 -- 172.21.15.7:0/4195663519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7ff3140b3790 con 0x7ff3140cd9e0 2023-10-14T19:08:31.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:31.021 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:19.226680+0000","modified":"2023-10-14T19:08:22.851427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/491623181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":491623181},{"type":"v1","addr":"172.21.15.7:6834","nonce":491623181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T19:08:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f8067170 msgr2=0x7ff2f8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f8067170 0x7ff2f8069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff310009a60 tx=0x7ff310008040 comp rx=0 tx=0).stop 2023-10-14T19:08:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 msgr2=0x7ff3141560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff3141560e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff3040094c0 tx=0x7ff304017000 comp rx=0 tx=0).stop 2023-10-14T19:08:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 shutdown_connections 2023-10-14T19:08:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f8067170 0x7ff2f8069620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3140cb5a0 0x7ff31415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3140c96e0 0x7ff31415ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 --2- 172.21.15.7:0/4195663519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3140cd9e0 0x7ff3141560e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 >> 172.21.15.7:0/4195663519 conn(0x7ff314070e30 msgr2=0x7ff3140d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:31.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 shutdown_connections 2023-10-14T19:08:31.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.022+0000 7ff31c6a1700 1 -- 172.21.15.7:0/4195663519 wait complete. 2023-10-14T19:08:31.026 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 49 2023-10-14T19:08:31.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:31.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.155+0000 7ff86a5bb700 1 Processor -- start 2023-10-14T19:08:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.155+0000 7ff86a5bb700 1 -- start start 2023-10-14T19:08:31.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.155+0000 7ff86a5bb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8641598b0 0x7ff8640af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff86a5bb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8640ce9d0 con 0x7ff8640af790 2023-10-14T19:08:31.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff86a5bb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8640afc30 con 0x7ff864159c80 2023-10-14T19:08:31.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff86a5bb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8640aff10 con 0x7ff8641598b0 2023-10-14T19:08:31.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff868b58700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8640af790 0x7ff864163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58152/0 (socket says 172.21.15.7:58152) 2023-10-14T19:08:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff868b58700 1 -- 172.21.15.7:0/3935380920 learned_addr learned my addr 172.21.15.7:0/3935380920 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff863fff700 1 --2- 172.21.15.7:0/3935380920 >> v2:172.21.15.148:3300/0 conn(0x7ff8641598b0 0x7ff8640af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446484263 0 0) 0x7ff8640ce9d0 con 0x7ff8640af790 2023-10-14T19:08:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff850003570 con 0x7ff8640af790 2023-10-14T19:08:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1322083021 0 0) 0x7ff850003570 con 0x7ff8640af790 2023-10-14T19:08:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 >> v2:172.21.15.148:3300/0 conn(0x7ff8641598b0 msgr2=0x7ff8640af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 --2- 172.21.15.7:0/3935380920 >> v2:172.21.15.148:3300/0 conn(0x7ff8641598b0 0x7ff8640af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 >> v1:172.21.15.148:6789/0 conn(0x7ff864159c80 legacy=0x7ff8640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8640ce380 con 0x7ff8640af790 2023-10-14T19:08:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff84c001470 con 0x7ff8640af790 2023-10-14T19:08:31.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 >> v1:172.21.15.7:6789/0 conn(0x7ff8640af790 legacy=0x7ff864163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff850003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff850004810 0x7ff850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8500051c0 0x7ff85000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640aff10 con 0x7ff850003a60 2023-10-14T19:08:31.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85000c0d0 con 0x7ff850004810 2023-10-14T19:08:31.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.156+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85000c290 con 0x7ff8500051c0 2023-10-14T19:08:31.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff850003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff8637fe700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff850004810 0x7ff850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff868b58700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8500051c0 0x7ff85000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 -- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8500051c0 msgr2=0x7ff85000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:31.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8500051c0 0x7ff85000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 -- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff850004810 msgr2=0x7ff850004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:31.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff850004810 0x7ff850004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 -- 172.21.15.7:0/3935380920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850003570 con 0x7ff850003a60 2023-10-14T19:08:31.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff868b58700 1 -- 172.21.15.7:0/3935380920 reap_dead start 2023-10-14T19:08:31.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff863fff700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff850003e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00e210 tx=0x7ff85c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b31d6aedd43f922 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00eac0 con 0x7ff850003a60 2023-10-14T19:08:31.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c00f040 con 0x7ff850003a60 2023-10-14T19:08:31.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.157+0000 7ff862ffd700 1 -- 172.21.15.7:0/3935380920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00ee70 con 0x7ff850003a60 2023-10-14T19:08:31.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 -- 172.21.15.7:0/3935380920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 msgr2=0x7ff850003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff850003e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00e210 tx=0x7ff85c00b040 comp rx=0 tx=0).stop 2023-10-14T19:08:31.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 -- 172.21.15.7:0/3935380920 shutdown_connections 2023-10-14T19:08:31.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/3935380920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff850003e70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 -- 172.21.15.7:0/3935380920 >> 172.21.15.7:0/3935380920 conn(0x7ff864070e30 msgr2=0x7ff8640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:31.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 -- 172.21.15.7:0/3935380920 shutdown_connections 2023-10-14T19:08:31.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.158+0000 7ff86a5bb700 1 -- 172.21.15.7:0/3935380920 wait complete. 2023-10-14T19:08:31.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.159+0000 7ff86a5bb700 1 Processor -- start 2023-10-14T19:08:31.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.159+0000 7ff86a5bb700 1 -- start start 2023-10-14T19:08:31.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff8640cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff86414ae40 0x7ff86414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864154030 0x7ff864154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff864154d60 con 0x7ff850003a60 2023-10-14T19:08:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86414b7f0 con 0x7ff864154030 2023-10-14T19:08:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff864152010 con 0x7ff86414ae40 2023-10-14T19:08:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff8640cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff8640cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44948/0 (socket says 172.21.15.7:44948) 2023-10-14T19:08:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 -- 172.21.15.7:0/1990934517 learned_addr learned my addr 172.21.15.7:0/1990934517 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff868b58700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864154030 0x7ff864154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff8637fe700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff86414ae40 0x7ff86414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 -- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff86414ae40 msgr2=0x7ff86414b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff86414ae40 0x7ff86414b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 -- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864154030 msgr2=0x7ff864154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864154030 0x7ff864154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 -- 172.21.15.7:0/1990934517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8641522f0 con 0x7ff850003a60 2023-10-14T19:08:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff8637fe700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff86414ae40 0x7ff86414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff868b58700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864154030 0x7ff864154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff863fff700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff8640cb7b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff85000c0a0 tx=0x7ff85c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c01d420 con 0x7ff850003a60 2023-10-14T19:08:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c01d580 con 0x7ff850003a60 2023-10-14T19:08:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8641525d0 con 0x7ff850003a60 2023-10-14T19:08:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.160+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c01d980 con 0x7ff850003a60 2023-10-14T19:08:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.161+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff864152dd0 con 0x7ff850003a60 2023-10-14T19:08:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.162+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86404c3c0 con 0x7ff850003a60 2023-10-14T19:08:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.162+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff85c003040 con 0x7ff850003a60 2023-10-14T19:08:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.162+0000 7ff85bfff700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff8440671a0 0x7ff844069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.162+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff85c086d10 con 0x7ff850003a60 2023-10-14T19:08:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.162+0000 7ff8637fe700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff8440671a0 0x7ff844069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.163+0000 7ff8637fe700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff8440671a0 0x7ff844069650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff854000f60 tx=0x7ff854009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.166+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff85c053be0 con 0x7ff850003a60 2023-10-14T19:08:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.358+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8640ce660 con 0x7ff850003a60 2023-10-14T19:08:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.358+0000 7ff85bfff700 1 -- 172.21.15.7:0/1990934517 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15305 (secure 0 0 0) 0x7ff85c018090 con 0x7ff850003a60 2023-10-14T19:08:31.359 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:31.360 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:20.826897+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:16.869015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:18.218167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff8440671a0 msgr2=0x7ff844069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff8440671a0 0x7ff844069650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff854000f60 tx=0x7ff854009040 comp rx=0 tx=0).stop 2023-10-14T19:08:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 msgr2=0x7ff8640cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff8640cb7b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff85000c0a0 tx=0x7ff85c01a000 comp rx=0 tx=0).stop 2023-10-14T19:08:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 shutdown_connections 2023-10-14T19:08:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff8440671a0 0x7ff844069650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864154030 0x7ff864154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff850003a60 0x7ff8640cb7b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 --2- 172.21.15.7:0/1990934517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff86414ae40 0x7ff86414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 >> 172.21.15.7:0/1990934517 conn(0x7ff864070e30 msgr2=0x7ff8640b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 shutdown_connections 2023-10-14T19:08:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.361+0000 7ff86a5bb700 1 -- 172.21.15.7:0/1990934517 wait complete. 2023-10-14T19:08:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:08:16.869015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:08:18.218167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:08:31.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:08:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.496+0000 7f5f6b781700 1 Processor -- start 2023-10-14T19:08:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.496+0000 7f5f6b781700 1 -- start start 2023-10-14T19:08:31.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f6b781700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f64159530 0x7f5f640ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f6b781700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f6406dc70 0x7f5f64159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f6b781700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640ccfd0 con 0x7f5f6406e0e0 2023-10-14T19:08:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f6b781700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640cf0e0 con 0x7f5f6406dc70 2023-10-14T19:08:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f6b781700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6415a3d0 con 0x7f5f64159530 2023-10-14T19:08:31.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f68d1c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f6406dc70 0x7f5f64159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f69d1e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5f6406e0e0 0x7f5f640cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58164/0 (socket says 172.21.15.7:58164) 2023-10-14T19:08:31.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f69d1e700 1 -- 172.21.15.7:0/2585048471 learned_addr learned my addr 172.21.15.7:0/2585048471 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:31.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f6951d700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f64159530 0x7f5f640ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f68d1c700 1 -- 172.21.15.7:0/2585048471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f64159530 msgr2=0x7f5f640ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:31.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.497+0000 7f5f68d1c700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f64159530 0x7f5f640ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f68d1c700 1 -- 172.21.15.7:0/2585048471 >> v1:172.21.15.7:6789/0 conn(0x7f5f6406e0e0 legacy=0x7f5f640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f63fff700 1 -- 172.21.15.7:0/2585048471 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035939393 0 0) 0x7f5f640ccfd0 con 0x7f5f6406e0e0 2023-10-14T19:08:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f68d1c700 1 -- 172.21.15.7:0/2585048471 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6415a6b0 con 0x7f5f6406dc70 2023-10-14T19:08:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6951d700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f64159530 0x7f5f640ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f68d1c700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f64159900 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098e0 tx=0x7f5f580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4cd6d85427a749 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f63fff700 1 -- 172.21.15.7:0/2585048471 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58009e80 con 0x7f5f6406dc70 2023-10-14T19:08:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f63fff700 1 -- 172.21.15.7:0/2585048471 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800b860 con 0x7f5f6406dc70 2023-10-14T19:08:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f63fff700 1 -- 172.21.15.7:0/2585048471 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800bbe0 con 0x7f5f6406dc70 2023-10-14T19:08:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 -- 172.21.15.7:0/2585048471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 msgr2=0x7f5f64159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f64159900 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098e0 tx=0x7f5f580091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 -- 172.21.15.7:0/2585048471 shutdown_connections 2023-10-14T19:08:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f64159530 0x7f5f640ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 --2- 172.21.15.7:0/2585048471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f64159900 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 -- 172.21.15.7:0/2585048471 >> 172.21.15.7:0/2585048471 conn(0x7f5f640703a0 msgr2=0x7f5f640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.498+0000 7f5f6b781700 1 -- 172.21.15.7:0/2585048471 shutdown_connections 2023-10-14T19:08:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.499+0000 7f5f6b781700 1 -- 172.21.15.7:0/2585048471 wait complete. 2023-10-14T19:08:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 Processor -- start 2023-10-14T19:08:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 -- start start 2023-10-14T19:08:31.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f640c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f6406e0e0 0x7f5f6414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64159530 0x7f5f6414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6414fba0 con 0x7f5f6406dc70 2023-10-14T19:08:31.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.500+0000 7f5f6b781700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640b5d80 con 0x7f5f64159530 2023-10-14T19:08:31.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6b781700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6414d8e0 con 0x7f5f6406e0e0 2023-10-14T19:08:31.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f640c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f640c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44958/0 (socket says 172.21.15.7:44958) 2023-10-14T19:08:31.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 -- 172.21.15.7:0/3811548189 learned_addr learned my addr 172.21.15.7:0/3811548189 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:31.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f68d1c700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f6406e0e0 0x7f5f6414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f69d1e700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64159530 0x7f5f6414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 -- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f6406e0e0 msgr2=0x7f5f6414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f6406e0e0 0x7f5f6414e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 -- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64159530 msgr2=0x7f5f6414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64159530 0x7f5f6414e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 -- 172.21.15.7:0/3811548189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009420 con 0x7f5f6406dc70 2023-10-14T19:08:31.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6951d700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f640c7790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00c850 tx=0x7f5f5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c011600 con 0x7f5f6406dc70 2023-10-14T19:08:31.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c011760 con 0x7f5f6406dc70 2023-10-14T19:08:31.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6414ef90 con 0x7f5f6406dc70 2023-10-14T19:08:31.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c011b00 con 0x7f5f6406dc70 2023-10-14T19:08:31.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.501+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6414f550 con 0x7f5f6406dc70 2023-10-14T19:08:31.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.502+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6414fe80 con 0x7f5f6406dc70 2023-10-14T19:08:31.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.503+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5f5c0073b0 con 0x7f5f6406dc70 2023-10-14T19:08:31.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.503+0000 7f5f617fa700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f50067170 0x7f5f50069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.503+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f5c084920 con 0x7f5f6406dc70 2023-10-14T19:08:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.504+0000 7f5f68d1c700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f50067170 0x7f5f50069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.504+0000 7f5f68d1c700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f50067170 0x7f5f50069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f640884a0 tx=0x7f5f58017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.507+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f5c0517f0 con 0x7f5f6406dc70 2023-10-14T19:08:31.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.700+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f6404c3c0 con 0x7f5f6406dc70 2023-10-14T19:08:31.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.700+0000 7f5f617fa700 1 -- 172.21.15.7:0/3811548189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f5c01e0a0 con 0x7f5f6406dc70 2023-10-14T19:08:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:08:31.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f50067170 msgr2=0x7f5f50069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f50067170 0x7f5f50069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f640884a0 tx=0x7f5f58017000 comp rx=0 tx=0).stop 2023-10-14T19:08:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 msgr2=0x7f5f640c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f640c7790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00c850 tx=0x7f5f5c008040 comp rx=0 tx=0).stop 2023-10-14T19:08:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 shutdown_connections 2023-10-14T19:08:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f50067170 0x7f5f50069620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64159530 0x7f5f6414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6406dc70 0x7f5f640c7790 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 --2- 172.21.15.7:0/3811548189 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f6406e0e0 0x7f5f6414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 >> 172.21.15.7:0/3811548189 conn(0x7f5f640703a0 msgr2=0x7f5f640c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 shutdown_connections 2023-10-14T19:08:31.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.702+0000 7f5f6b781700 1 -- 172.21.15.7:0/3811548189 wait complete. 2023-10-14T19:08:31.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:08:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.838+0000 7fccb7909700 1 Processor -- start 2023-10-14T19:08:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.838+0000 7fccb7909700 1 -- start start 2023-10-14T19:08:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb7909700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb01598c0 0x7fccb00c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb7909700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccb0159c90 0x7fccb00c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb7909700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb00c9310 con 0x7fccb00cd460 2023-10-14T19:08:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb7909700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb00ad990 con 0x7fccb0159c90 2023-10-14T19:08:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb7909700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00ce090 con 0x7fccb01598c0 2023-10-14T19:08:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb4ea4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccb0159c90 0x7fccb00c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb4ea4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccb0159c90 0x7fccb00c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44964/0 (socket says 172.21.15.7:44964) 2023-10-14T19:08:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.839+0000 7fccb4ea4700 1 -- 172.21.15.7:0/1385980305 learned_addr learned my addr 172.21.15.7:0/1385980305 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fccb56a5700 1 --2- 172.21.15.7:0/1385980305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb01598c0 0x7fccb00c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fccb4ea4700 1 -- 172.21.15.7:0/1385980305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb01598c0 msgr2=0x7fccb00c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fccb4ea4700 1 --2- 172.21.15.7:0/1385980305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb01598c0 0x7fccb00c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fccb4ea4700 1 -- 172.21.15.7:0/1385980305 >> v1:172.21.15.148:6789/0 conn(0x7fccb00cd460 legacy=0x7fccb00cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fccb4ea4700 1 -- 172.21.15.7:0/1385980305 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00c8cc0 con 0x7fccb0159c90 2023-10-14T19:08:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fccb4ea4700 1 --2- 172.21.15.7:0/1385980305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb0159c90 0x7fccb00c43b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcca00099b0 tx=0x7fcca0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5441fa8e1e7bb0a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fcca7fff700 1 -- 172.21.15.7:0/1385980305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000b860 con 0x7fccb0159c90 2023-10-14T19:08:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fcca7fff700 1 -- 172.21.15.7:0/1385980305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000b9c0 con 0x7fccb0159c90 2023-10-14T19:08:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.840+0000 7fcca7fff700 1 -- 172.21.15.7:0/1385980305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000bd60 con 0x7fccb0159c90 2023-10-14T19:08:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 -- 172.21.15.7:0/1385980305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb0159c90 msgr2=0x7fccb00c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 --2- 172.21.15.7:0/1385980305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb0159c90 0x7fccb00c43b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcca00099b0 tx=0x7fcca0009250 comp rx=0 tx=0).stop 2023-10-14T19:08:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 -- 172.21.15.7:0/1385980305 shutdown_connections 2023-10-14T19:08:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 --2- 172.21.15.7:0/1385980305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb01598c0 0x7fccb00c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 --2- 172.21.15.7:0/1385980305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb0159c90 0x7fccb00c43b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 -- 172.21.15.7:0/1385980305 >> 172.21.15.7:0/1385980305 conn(0x7fccb0088000 msgr2=0x7fccb00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 -- 172.21.15.7:0/1385980305 shutdown_connections 2023-10-14T19:08:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.841+0000 7fccb7909700 1 -- 172.21.15.7:0/1385980305 wait complete. 2023-10-14T19:08:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.842+0000 7fccb7909700 1 Processor -- start 2023-10-14T19:08:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.842+0000 7fccb7909700 1 -- start start 2023-10-14T19:08:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb7909700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb00cd460 0x7fccb006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb7909700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 0x7fccb00c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb7909700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccb0159c90 0x7fccb0169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb7909700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb006ec60 con 0x7fccb01598c0 2023-10-14T19:08:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb7909700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb006f080 con 0x7fccb0159c90 2023-10-14T19:08:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb7909700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb006dfe0 con 0x7fccb00cd460 2023-10-14T19:08:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 0x7fccb00c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 0x7fccb00c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44974/0 (socket says 172.21.15.7:44974) 2023-10-14T19:08:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 -- 172.21.15.7:0/723746909 learned_addr learned my addr 172.21.15.7:0/723746909 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb56a5700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb00cd460 0x7fccb006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb5ea6700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccb0159c90 0x7fccb0169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 -- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb00cd460 msgr2=0x7fccb006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb00cd460 0x7fccb006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 -- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccb0159c90 msgr2=0x7fccb0169880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccb0159c90 0x7fccb0169880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb4ea4700 1 -- 172.21.15.7:0/723746909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00094f0 con 0x7fccb01598c0 2023-10-14T19:08:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb56a5700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb00cd460 0x7fccb006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.843+0000 7fccb5ea6700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccb0159c90 0x7fccb0169880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.844+0000 7fccb4ea4700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 0x7fccb00c61d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009290 tx=0x7fcca0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.844+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca001a450 con 0x7fccb01598c0 2023-10-14T19:08:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.844+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca001a5b0 con 0x7fccb01598c0 2023-10-14T19:08:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.844+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb006e2c0 con 0x7fccb01598c0 2023-10-14T19:08:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.844+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca001a970 con 0x7fccb01598c0 2023-10-14T19:08:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.844+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb006e880 con 0x7fccb01598c0 2023-10-14T19:08:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.845+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb006eda0 con 0x7fccb01598c0 2023-10-14T19:08:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.845+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcca001b430 con 0x7fccb01598c0 2023-10-14T19:08:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.846+0000 7fcca57fa700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcc94067170 0x7fcc94069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.846+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcca0086370 con 0x7fccb01598c0 2023-10-14T19:08:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.846+0000 7fccb56a5700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcc94067170 0x7fcc94069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:31.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.846+0000 7fccb56a5700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcc94067170 0x7fcc94069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fccac006fd0 tx=0x7fccac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:31.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.850+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccb006eda0 con 0x7fccb01598c0 2023-10-14T19:08:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:31.894+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fcca0053720 con 0x7fccb01598c0 2023-10-14T19:08:32.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.051+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccb006eda0 con 0x7fccb01598c0 2023-10-14T19:08:32.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.052+0000 7fcca57fa700 1 -- 172.21.15.7:0/723746909 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccb006eda0 con 0x7fccb01598c0 2023-10-14T19:08:32.053 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:08:32.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcc94067170 msgr2=0x7fcc94069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcc94067170 0x7fcc94069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fccac006fd0 tx=0x7fccac008040 comp rx=0 tx=0).stop 2023-10-14T19:08:32.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 msgr2=0x7fccb00c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 0x7fccb00c61d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009290 tx=0x7fcca0017000 comp rx=0 tx=0).stop 2023-10-14T19:08:32.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 shutdown_connections 2023-10-14T19:08:32.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcc94067170 0x7fcc94069620 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccb0159c90 0x7fccb0169880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fccb00cd460 0x7fccb006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 --2- 172.21.15.7:0/723746909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccb01598c0 0x7fccb00c61d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 >> 172.21.15.7:0/723746909 conn(0x7fccb0088000 msgr2=0x7fccb00694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 shutdown_connections 2023-10-14T19:08:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.054+0000 7fccb7909700 1 -- 172.21.15.7:0/723746909 wait complete. 2023-10-14T19:08:32.067 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:08:32.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.188+0000 7f9d62f75700 1 Processor -- start 2023-10-14T19:08:32.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.188+0000 7f9d62f75700 1 -- start start 2023-10-14T19:08:32.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.189+0000 7f9d62f75700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 0x7f9d5c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.189+0000 7f9d62f75700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c0ccfd0 con 0x7f9d5c06e0e0 2023-10-14T19:08:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.189+0000 7f9d62f75700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c15a3d0 con 0x7f9d5c159530 2023-10-14T19:08:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.189+0000 7f9d62f75700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c15a6b0 con 0x7f9d5c06dc70 2023-10-14T19:08:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.189+0000 7f9d61512700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9d5c06e0e0 0x7f9d5c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58170/0 (socket says 172.21.15.7:58170) 2023-10-14T19:08:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.189+0000 7f9d61512700 1 -- 172.21.15.7:0/619921736 learned_addr learned my addr 172.21.15.7:0/619921736 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931296493 0 0) 0x7f9d5c0ccfd0 con 0x7f9d5c06e0e0 2023-10-14T19:08:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d48003570 con 0x7f9d5c06e0e0 2023-10-14T19:08:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 0x7f9d5c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994059618 0 0) 0x7f9d48003570 con 0x7f9d5c06e0e0 2023-10-14T19:08:32.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 msgr2=0x7f9d5c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 0x7f9d5c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 >> v1:172.21.15.148:6789/0 conn(0x7f9d5c159530 legacy=0x7f9d5c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c15a990 con 0x7f9d5c06e0e0 2023-10-14T19:08:32.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f9d44001470 con 0x7f9d5c06e0e0 2023-10-14T19:08:32.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 >> v1:172.21.15.7:6789/0 conn(0x7f9d5c06e0e0 legacy=0x7f9d5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 0x7f9d48003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d48004d50 0x7f9d480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c15a6b0 con 0x7f9d48004010 2023-10-14T19:08:32.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4800bbf0 con 0x7f9d48004d50 2023-10-14T19:08:32.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4800bdb0 con 0x7f9d5c06dc70 2023-10-14T19:08:32.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d60d11700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 0x7f9d48003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d61512700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d48004d50 0x7f9d480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 -- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 msgr2=0x7f9d48003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c06dc70 0x7f9d48003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 -- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d48004d50 msgr2=0x7f9d480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d48004d50 0x7f9d480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.190+0000 7f9d5bfff700 1 -- 172.21.15.7:0/619921736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48003570 con 0x7f9d48004010 2023-10-14T19:08:32.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d48004810 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006f00 tx=0x7f9d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b181bbea32abd2e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00e710 con 0x7f9d48004010 2023-10-14T19:08:32.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c00e870 con 0x7f9d48004010 2023-10-14T19:08:32.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d5b7fe700 1 -- 172.21.15.7:0/619921736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00ec30 con 0x7f9d48004010 2023-10-14T19:08:32.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d62f75700 1 -- 172.21.15.7:0/619921736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 msgr2=0x7f9d48004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d62f75700 1 --2- 172.21.15.7:0/619921736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d48004810 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006f00 tx=0x7f9d4c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d61512700 1 -- 172.21.15.7:0/619921736 reap_dead start 2023-10-14T19:08:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d62f75700 1 -- 172.21.15.7:0/619921736 shutdown_connections 2023-10-14T19:08:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d62f75700 1 -- 172.21.15.7:0/619921736 >> 172.21.15.7:0/619921736 conn(0x7f9d5c0703a0 msgr2=0x7f9d5c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d62f75700 1 -- 172.21.15.7:0/619921736 shutdown_connections 2023-10-14T19:08:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.191+0000 7f9d62f75700 1 -- 172.21.15.7:0/619921736 wait complete. 2023-10-14T19:08:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.192+0000 7f9d62f75700 1 Processor -- start 2023-10-14T19:08:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 -- start start 2023-10-14T19:08:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d5c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c16cfd0 0x7f9d5c16a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d5c0b3480 0x7f9d5c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c16b230 con 0x7f9d48004010 2023-10-14T19:08:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0d0b60 con 0x7f9d5c0b3480 2023-10-14T19:08:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d62f75700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c16d440 con 0x7f9d5c16cfd0 2023-10-14T19:08:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d60d11700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d5c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.193+0000 7f9d60d11700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d5c0b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45002/0 (socket says 172.21.15.7:45002) 2023-10-14T19:08:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 -- 172.21.15.7:0/1143218078 learned_addr learned my addr 172.21.15.7:0/1143218078 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d61512700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d5c0b3480 0x7f9d5c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c16cfd0 0x7f9d5c16a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 -- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c16cfd0 msgr2=0x7f9d5c16a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c16cfd0 0x7f9d5c16a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 -- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d5c0b3480 msgr2=0x7f9d5c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d5c0b3480 0x7f9d5c0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 -- 172.21.15.7:0/1143218078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0b3e40 con 0x7f9d48004010 2023-10-14T19:08:32.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d61512700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d5c0b3480 0x7f9d5c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:32.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d60d11700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d5c0b52f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400eb40 tx=0x7f9d54001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400c910 con 0x7f9d48004010 2023-10-14T19:08:32.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400ca70 con 0x7f9d48004010 2023-10-14T19:08:32.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0b5960 con 0x7f9d48004010 2023-10-14T19:08:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400ce10 con 0x7f9d48004010 2023-10-14T19:08:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.194+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0b5f20 con 0x7f9d48004010 2023-10-14T19:08:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.195+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c04c3c0 con 0x7f9d48004010 2023-10-14T19:08:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.196+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9d54013630 con 0x7f9d48004010 2023-10-14T19:08:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.196+0000 7f9d58ff9700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d3c067230 0x7f9d3c0696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.196+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d54084ea0 con 0x7f9d48004010 2023-10-14T19:08:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.196+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d3c067230 0x7f9d3c0696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.197+0000 7f9d5bfff700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d3c067230 0x7f9d3c0696e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0091e0 tx=0x7f9d4c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.200+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d54051e40 con 0x7f9d48004010 2023-10-14T19:08:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.390+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d5c15ac70 con 0x7f9d48004010 2023-10-14T19:08:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.390+0000 7f9d58ff9700 1 -- 172.21.15.7:0/1143218078 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d54055460 con 0x7f9d48004010 2023-10-14T19:08:32.392 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:08:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d3c067230 msgr2=0x7f9d3c0696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d3c067230 0x7f9d3c0696e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0091e0 tx=0x7f9d4c01a000 comp rx=0 tx=0).stop 2023-10-14T19:08:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 msgr2=0x7f9d5c0b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d5c0b52f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400eb40 tx=0x7f9d54001670 comp rx=0 tx=0).stop 2023-10-14T19:08:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 shutdown_connections 2023-10-14T19:08:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d3c067230 0x7f9d3c0696e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d5c0b3480 0x7f9d5c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d48004010 0x7f9d5c0b52f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 --2- 172.21.15.7:0/1143218078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d5c16cfd0 0x7f9d5c16a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 >> 172.21.15.7:0/1143218078 conn(0x7f9d5c0703a0 msgr2=0x7f9d5c0cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 shutdown_connections 2023-10-14T19:08:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.392+0000 7f9d62f75700 1 -- 172.21.15.7:0/1143218078 wait complete. 2023-10-14T19:08:32.406 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.524+0000 7fc67215d700 1 Processor -- start 2023-10-14T19:08:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.524+0000 7fc67215d700 1 -- start start 2023-10-14T19:08:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc67215d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc66c0cf200 0x7fc66c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc67215d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b0ba0 0x7fc66c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc67215d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66c15a280 con 0x7fc66c0b07d0 2023-10-14T19:08:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc67215d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66c06e180 con 0x7fc66c0cf200 2023-10-14T19:08:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc67215d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c06d850 con 0x7fc66c0b0ba0 2023-10-14T19:08:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc66affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc66c0cf200 0x7fc66c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc66b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc66c0b07d0 0x7fc66c0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58180/0 (socket says 172.21.15.7:58180) 2023-10-14T19:08:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc66b7fe700 1 -- 172.21.15.7:0/659905029 learned_addr learned my addr 172.21.15.7:0/659905029 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66affd700 1 -- 172.21.15.7:0/659905029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b0ba0 msgr2=0x7fc66c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.525+0000 7fc66bfff700 1 --2- 172.21.15.7:0/659905029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b0ba0 0x7fc66c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66affd700 1 --2- 172.21.15.7:0/659905029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b0ba0 0x7fc66c06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66a7fc700 1 -- 172.21.15.7:0/659905029 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299070353 0 0) 0x7fc66c15a280 con 0x7fc66c0b07d0 2023-10-14T19:08:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66affd700 1 -- 172.21.15.7:0/659905029 >> v1:172.21.15.7:6789/0 conn(0x7fc66c0b07d0 legacy=0x7fc66c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66affd700 1 -- 172.21.15.7:0/659905029 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c06db30 con 0x7fc66c0cf200 2023-10-14T19:08:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66affd700 1 --2- 172.21.15.7:0/659905029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c0c42c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc6600098e0 tx=0x7fc6600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8782242b4422cbf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66a7fc700 1 -- 172.21.15.7:0/659905029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660009e80 con 0x7fc66c0cf200 2023-10-14T19:08:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66a7fc700 1 -- 172.21.15.7:0/659905029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66000b860 con 0x7fc66c0cf200 2023-10-14T19:08:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc66a7fc700 1 -- 172.21.15.7:0/659905029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000bbe0 con 0x7fc66c0cf200 2023-10-14T19:08:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 -- 172.21.15.7:0/659905029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 msgr2=0x7fc66c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 --2- 172.21.15.7:0/659905029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c0c42c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc6600098e0 tx=0x7fc6600091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 -- 172.21.15.7:0/659905029 shutdown_connections 2023-10-14T19:08:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 --2- 172.21.15.7:0/659905029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b0ba0 0x7fc66c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 --2- 172.21.15.7:0/659905029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c0c42c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 -- 172.21.15.7:0/659905029 >> 172.21.15.7:0/659905029 conn(0x7fc66c06ce80 msgr2=0x7fc66c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 -- 172.21.15.7:0/659905029 shutdown_connections 2023-10-14T19:08:32.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.526+0000 7fc67215d700 1 -- 172.21.15.7:0/659905029 wait complete. 2023-10-14T19:08:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 Processor -- start 2023-10-14T19:08:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 -- start start 2023-10-14T19:08:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b07d0 0x7fc66c068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc66c0b0ba0 0x7fc66c0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c153fb0 con 0x7fc66c0cf200 2023-10-14T19:08:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c0c8860 con 0x7fc66c0b0ba0 2023-10-14T19:08:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.528+0000 7fc67215d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c0c7ce0 con 0x7fc66c0b07d0 2023-10-14T19:08:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c14f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45012/0 (socket says 172.21.15.7:45012) 2023-10-14T19:08:32.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 -- 172.21.15.7:0/3268547029 learned_addr learned my addr 172.21.15.7:0/3268547029 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:32.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66b7fe700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b07d0 0x7fc66c068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66affd700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc66c0b0ba0 0x7fc66c0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 -- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b07d0 msgr2=0x7fc66c068590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b07d0 0x7fc66c068590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 -- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc66c0b0ba0 msgr2=0x7fc66c0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc66c0b0ba0 0x7fc66c0c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 -- 172.21.15.7:0/3268547029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009420 con 0x7fc66c0cf200 2023-10-14T19:08:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66b7fe700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b07d0 0x7fc66c068590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc66bfff700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c14f940 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc66400ceb0 tx=0x7fc664007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400ae40 con 0x7fc66c0cf200 2023-10-14T19:08:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc664016430 con 0x7fc66c0cf200 2023-10-14T19:08:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c0c82a0 con 0x7fc66c0cf200 2023-10-14T19:08:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640167d0 con 0x7fc66c0cf200 2023-10-14T19:08:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.529+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c150720 con 0x7fc66c0cf200 2023-10-14T19:08:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.530+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66c04c3c0 con 0x7fc66c0cf200 2023-10-14T19:08:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.531+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc664003020 con 0x7fc66c0cf200 2023-10-14T19:08:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.531+0000 7fc6537fe700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc658067200 0x7fc6580696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.531+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc664012070 con 0x7fc66c0cf200 2023-10-14T19:08:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.531+0000 7fc66b7fe700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc658067200 0x7fc6580696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.532+0000 7fc66b7fe700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc658067200 0x7fc6580696b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc65c001890 tx=0x7fc65c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.535+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc664052700 con 0x7fc66c0cf200 2023-10-14T19:08:32.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.774+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc66c06de10 con 0x7fc66c0cf200 2023-10-14T19:08:32.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.775+0000 7fc6537fe700 1 -- 172.21.15.7:0/3268547029 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fc664055d20 con 0x7fc66c0cf200 2023-10-14T19:08:32.776 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:32.776 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:19.226680+0000","modified":"2023-10-14T19:08:22.851427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/491623181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":491623181},{"type":"v1","addr":"172.21.15.7:6834","nonce":491623181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T19:08:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc658067200 msgr2=0x7fc6580696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc658067200 0x7fc6580696b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc65c001890 tx=0x7fc65c009040 comp rx=0 tx=0).stop 2023-10-14T19:08:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 msgr2=0x7fc66c14f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c14f940 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc66400ceb0 tx=0x7fc664007870 comp rx=0 tx=0).stop 2023-10-14T19:08:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 shutdown_connections 2023-10-14T19:08:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc658067200 0x7fc6580696b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0cf200 0x7fc66c14f940 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66c0b07d0 0x7fc66c068590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 --2- 172.21.15.7:0/3268547029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc66c0b0ba0 0x7fc66c0c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 >> 172.21.15.7:0/3268547029 conn(0x7fc66c06ce80 msgr2=0x7fc66c069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 shutdown_connections 2023-10-14T19:08:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.777+0000 7fc67215d700 1 -- 172.21.15.7:0/3268547029 wait complete. 2023-10-14T19:08:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 49 2023-10-14T19:08:32.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:32.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.910+0000 7f384a31f700 1 Processor -- start 2023-10-14T19:08:32.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.910+0000 7f384a31f700 1 -- start start 2023-10-14T19:08:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f384a31f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 0x7f38440cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f384a31f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384415afd0 con 0x7f38440cef40 2023-10-14T19:08:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f384a31f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384415b2b0 con 0x7f3844153c30 2023-10-14T19:08:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f384a31f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384415b590 con 0x7f384415de50 2023-10-14T19:08:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f3849b1e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38440cef40 0x7f384415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58192/0 (socket says 172.21.15.7:58192) 2023-10-14T19:08:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f3849b1e700 1 -- 172.21.15.7:0/4212347940 learned_addr learned my addr 172.21.15.7:0/4212347940 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f3848b1c700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 0x7f38440cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235527873 0 0) 0x7f384415afd0 con 0x7f38440cef40 2023-10-14T19:08:32.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3830003570 con 0x7f38440cef40 2023-10-14T19:08:32.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.911+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3736261427 0 0) 0x7f3830003570 con 0x7f38440cef40 2023-10-14T19:08:32.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 msgr2=0x7f38440cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 0x7f38440cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 >> v1:172.21.15.148:6789/0 conn(0x7f3844153c30 legacy=0x7f384415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384415b870 con 0x7f38440cef40 2023-10-14T19:08:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f383c0017f0 con 0x7f38440cef40 2023-10-14T19:08:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 >> v1:172.21.15.7:6789/0 conn(0x7f38440cef40 legacy=0x7f384415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3830003a90 0x7f3830003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3830004810 0x7f3830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 0x7f38300051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384415b590 con 0x7f3830004810 2023-10-14T19:08:32.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383000bb90 con 0x7f3830003a90 2023-10-14T19:08:32.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383000bd50 con 0x7f384415de50 2023-10-14T19:08:32.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3830004810 0x7f3830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3849b1e700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 0x7f38300051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f384931d700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3830003a90 0x7f3830003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 -- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 msgr2=0x7f38300051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f384415de50 0x7f38300051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 -- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3830003a90 msgr2=0x7f3830003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3830003a90 0x7f3830003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 -- 172.21.15.7:0/4212347940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830003570 con 0x7f3830004810 2023-10-14T19:08:32.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f3848b1c700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3830004810 0x7f3830004c80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3834009c00 tx=0x7f38340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcada14de3e281c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400e710 con 0x7f3830004810 2023-10-14T19:08:32.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383400e870 con 0x7f3830004810 2023-10-14T19:08:32.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.912+0000 7f383bfff700 1 -- 172.21.15.7:0/4212347940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400ec30 con 0x7f3830004810 2023-10-14T19:08:32.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f384a31f700 1 -- 172.21.15.7:0/4212347940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3830004810 msgr2=0x7f3830004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f384a31f700 1 --2- 172.21.15.7:0/4212347940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3830004810 0x7f3830004c80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3834009c00 tx=0x7f38340091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f3849b1e700 1 -- 172.21.15.7:0/4212347940 reap_dead start 2023-10-14T19:08:32.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f384a31f700 1 -- 172.21.15.7:0/4212347940 shutdown_connections 2023-10-14T19:08:32.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f384a31f700 1 -- 172.21.15.7:0/4212347940 >> 172.21.15.7:0/4212347940 conn(0x7f38440703a0 msgr2=0x7f38440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:32.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f384a31f700 1 -- 172.21.15.7:0/4212347940 shutdown_connections 2023-10-14T19:08:32.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.913+0000 7f384a31f700 1 -- 172.21.15.7:0/4212347940 wait complete. 2023-10-14T19:08:32.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.914+0000 7f384a31f700 1 Processor -- start 2023-10-14T19:08:32.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.914+0000 7f384a31f700 1 -- start start 2023-10-14T19:08:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384a31f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3830004810 0x7f38440b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384a31f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 0x7f38440c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384a31f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38440ca0d0 0x7f3844169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384a31f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440c8d60 con 0x7f38441525d0 2023-10-14T19:08:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384a31f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440b61d0 con 0x7f38440ca0d0 2023-10-14T19:08:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384a31f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38440c8a80 con 0x7f3830004810 2023-10-14T19:08:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 0x7f38440c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 0x7f38440c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45020/0 (socket says 172.21.15.7:45020) 2023-10-14T19:08:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 -- 172.21.15.7:0/288768974 learned_addr learned my addr 172.21.15.7:0/288768974 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f384931d700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3830004810 0x7f38440b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 -- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3830004810 msgr2=0x7f38440b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3849b1e700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38440ca0d0 0x7f3844169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3830004810 0x7f38440b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 -- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38440ca0d0 msgr2=0x7f3844169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38440ca0d0 0x7f3844169c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.915+0000 7f3848b1c700 1 -- 172.21.15.7:0/288768974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440c90b0 con 0x7f38441525d0 2023-10-14T19:08:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.916+0000 7f3848b1c700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 0x7f38440c9b90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f383400e4b0 tx=0x7f383401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.916+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834023070 con 0x7f38441525d0 2023-10-14T19:08:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.916+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383400e9e0 con 0x7f38441525d0 2023-10-14T19:08:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.916+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440c9390 con 0x7f38441525d0 2023-10-14T19:08:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.916+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383401e030 con 0x7f38441525d0 2023-10-14T19:08:32.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.916+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844153030 con 0x7f38441525d0 2023-10-14T19:08:32.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.917+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384404c3c0 con 0x7f38441525d0 2023-10-14T19:08:32.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.917+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f383401e1b0 con 0x7f38441525d0 2023-10-14T19:08:32.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.918+0000 7f38397fa700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3828067200 0x7f38280696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:32.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.918+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3834086110 con 0x7f38441525d0 2023-10-14T19:08:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.918+0000 7f384931d700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3828067200 0x7f38280696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.919+0000 7f384931d700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3828067200 0x7f38280696b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3840000f60 tx=0x7f3840009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:32.922+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3834053030 con 0x7f38441525d0 2023-10-14T19:08:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.117+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38440caef0 con 0x7f38441525d0 2023-10-14T19:08:33.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.118+0000 7f38397fa700 1 -- 172.21.15.7:0/288768974 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f3834056650 con 0x7f38441525d0 2023-10-14T19:08:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:33.120 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:20.826897+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:16.869015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:18.218167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3828067200 msgr2=0x7f38280696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3828067200 0x7f38280696b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3840000f60 tx=0x7f3840009040 comp rx=0 tx=0).stop 2023-10-14T19:08:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 msgr2=0x7f38440c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 0x7f38440c9b90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f383400e4b0 tx=0x7f383401a000 comp rx=0 tx=0).stop 2023-10-14T19:08:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 shutdown_connections 2023-10-14T19:08:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3828067200 0x7f38280696b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38440ca0d0 0x7f3844169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3830004810 0x7f38440b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 --2- 172.21.15.7:0/288768974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38441525d0 0x7f38440c9b90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 >> 172.21.15.7:0/288768974 conn(0x7f38440703a0 msgr2=0x7f38440d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 shutdown_connections 2023-10-14T19:08:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.120+0000 7f384a31f700 1 -- 172.21.15.7:0/288768974 wait complete. 2023-10-14T19:08:33.133 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:08:33.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.252+0000 7facadddc700 1 Processor -- start 2023-10-14T19:08:33.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.252+0000 7facadddc700 1 -- start start 2023-10-14T19:08:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7facadddc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faca80cb970 0x7faca8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7facadddc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7facadddc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca815ae40 con 0x7faca80cb5a0 2023-10-14T19:08:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7facadddc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca80ce0f0 con 0x7faca80cb970 2023-10-14T19:08:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7facadddc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca80d13f0 con 0x7faca815a400 2023-10-14T19:08:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7faca6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faca80cb970 0x7faca8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7faca6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faca80cb970 0x7faca8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45034/0 (socket says 172.21.15.7:45034) 2023-10-14T19:08:33.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7faca6ffd700 1 -- 172.21.15.7:0/4058933739 learned_addr learned my addr 172.21.15.7:0/4058933739 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:33.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.253+0000 7faca7fff700 1 --2- 172.21.15.7:0/4058933739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca6ffd700 1 -- 172.21.15.7:0/4058933739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 msgr2=0x7faca8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:33.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca6ffd700 1 --2- 172.21.15.7:0/4058933739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca6ffd700 1 -- 172.21.15.7:0/4058933739 >> v1:172.21.15.148:6789/0 conn(0x7faca80cb5a0 legacy=0x7faca80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca6ffd700 1 -- 172.21.15.7:0/4058933739 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca815ab60 con 0x7faca80cb970 2023-10-14T19:08:33.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca6ffd700 1 --2- 172.21.15.7:0/4058933739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb970 0x7faca8159ec0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a9087e2c37a690 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:33.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca67fc700 1 -- 172.21.15.7:0/4058933739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00b860 con 0x7faca80cb970 2023-10-14T19:08:33.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca67fc700 1 -- 172.21.15.7:0/4058933739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00b9c0 con 0x7faca80cb970 2023-10-14T19:08:33.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7faca67fc700 1 -- 172.21.15.7:0/4058933739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00bd60 con 0x7faca80cb970 2023-10-14T19:08:33.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 -- 172.21.15.7:0/4058933739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb970 msgr2=0x7faca8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 --2- 172.21.15.7:0/4058933739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb970 0x7faca8159ec0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c009250 comp rx=0 tx=0).stop 2023-10-14T19:08:33.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 -- 172.21.15.7:0/4058933739 shutdown_connections 2023-10-14T19:08:33.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 --2- 172.21.15.7:0/4058933739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 --2- 172.21.15.7:0/4058933739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb970 0x7faca8159ec0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 -- 172.21.15.7:0/4058933739 >> 172.21.15.7:0/4058933739 conn(0x7faca8070e30 msgr2=0x7faca80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:33.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 -- 172.21.15.7:0/4058933739 shutdown_connections 2023-10-14T19:08:33.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.254+0000 7facadddc700 1 -- 172.21.15.7:0/4058933739 wait complete. 2023-10-14T19:08:33.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 Processor -- start 2023-10-14T19:08:33.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 -- start start 2023-10-14T19:08:33.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 0x7faca814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faca80cb970 0x7faca80c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80c66f0 con 0x7faca80cb5a0 2023-10-14T19:08:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80c5ae0 con 0x7faca80cb970 2023-10-14T19:08:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.256+0000 7facadddc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca80c5dc0 con 0x7faca815a400 2023-10-14T19:08:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 0x7faca814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 0x7faca814e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45036/0 (socket says 172.21.15.7:45036) 2023-10-14T19:08:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 -- 172.21.15.7:0/721873733 learned_addr learned my addr 172.21.15.7:0/721873733 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca6ffd700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faca80cb970 0x7faca80c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca7fff700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 -- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 msgr2=0x7faca81527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca81527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 -- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faca80cb970 msgr2=0x7faca80c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faca80cb970 0x7faca80c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 -- 172.21.15.7:0/721873733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0094f0 con 0x7faca80cb5a0 2023-10-14T19:08:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7faca77fe700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 0x7faca814e180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c590 tx=0x7fac9800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98011590 con 0x7faca80cb5a0 2023-10-14T19:08:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac98011710 con 0x7faca80cb5a0 2023-10-14T19:08:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca80c60a0 con 0x7faca80cb5a0 2023-10-14T19:08:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98011ad0 con 0x7faca80cb5a0 2023-10-14T19:08:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.257+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca814e6c0 con 0x7faca80cb5a0 2023-10-14T19:08:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.258+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca80c69d0 con 0x7faca80cb5a0 2023-10-14T19:08:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.259+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fac9801b3b0 con 0x7faca80cb5a0 2023-10-14T19:08:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.259+0000 7fac8f7fe700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac94067200 0x7fac940696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.259+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac98083e10 con 0x7faca80cb5a0 2023-10-14T19:08:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.259+0000 7faca6ffd700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac94067200 0x7fac940696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.260+0000 7faca6ffd700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac94067200 0x7fac940696b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.263+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac98050d30 con 0x7faca80cb5a0 2023-10-14T19:08:33.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.501+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faca804c3c0 con 0x7faca80cb5a0 2023-10-14T19:08:33.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.501+0000 7fac8f7fe700 1 -- 172.21.15.7:0/721873733 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fac98017070 con 0x7faca80cb5a0 2023-10-14T19:08:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:33.503 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:19.226680+0000","modified":"2023-10-14T19:08:22.851427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/491623181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":491623181},{"type":"v1","addr":"172.21.15.7:6834","nonce":491623181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T19:08:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac94067200 msgr2=0x7fac940696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac94067200 0x7fac940696b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c017000 comp rx=0 tx=0).stop 2023-10-14T19:08:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 msgr2=0x7faca814e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 0x7faca814e180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c590 tx=0x7fac9800c8a0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 shutdown_connections 2023-10-14T19:08:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac94067200 0x7fac940696b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faca815a400 0x7faca81527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca80cb5a0 0x7faca814e180 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 --2- 172.21.15.7:0/721873733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faca80cb970 0x7faca80c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 >> 172.21.15.7:0/721873733 conn(0x7faca8070e30 msgr2=0x7faca80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:33.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 shutdown_connections 2023-10-14T19:08:33.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.503+0000 7facadddc700 1 -- 172.21.15.7:0/721873733 wait complete. 2023-10-14T19:08:33.507 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 49 2023-10-14T19:08:33.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:33.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.635+0000 7f4e9d816700 1 Processor -- start 2023-10-14T19:08:33.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.635+0000 7f4e9d816700 1 -- start start 2023-10-14T19:08:33.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e9d816700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e9d816700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e9815a400 0x7f4e98156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e9d816700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9815ae40 con 0x7f4e980cb5a0 2023-10-14T19:08:33.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e9d816700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980ce0f0 con 0x7f4e9815a400 2023-10-14T19:08:33.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e9d816700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980cbde0 con 0x7f4e980cb970 2023-10-14T19:08:33.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e9815a400 0x7f4e98156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e9815a400 0x7f4e98156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45042/0 (socket says 172.21.15.7:45042) 2023-10-14T19:08:33.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 -- 172.21.15.7:0/2917764179 learned_addr learned my addr 172.21.15.7:0/2917764179 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:33.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e967fc700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 -- 172.21.15.7:0/2917764179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 msgr2=0x7f4e98159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:33.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 -- 172.21.15.7:0/2917764179 >> v1:172.21.15.148:6789/0 conn(0x7f4e980cb5a0 legacy=0x7f4e980cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 -- 172.21.15.7:0/2917764179 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9815ab60 con 0x7f4e9815a400 2023-10-14T19:08:33.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e967fc700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:33.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.636+0000 7f4e977fe700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98156e90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4e900099e0 tx=0x7f4e90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca0797cc49135df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:33.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e95ffb700 1 -- 172.21.15.7:0/2917764179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000b820 con 0x7f4e9815a400 2023-10-14T19:08:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e95ffb700 1 -- 172.21.15.7:0/2917764179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000b980 con 0x7f4e9815a400 2023-10-14T19:08:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e95ffb700 1 -- 172.21.15.7:0/2917764179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000bd20 con 0x7f4e9815a400 2023-10-14T19:08:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 -- 172.21.15.7:0/2917764179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 msgr2=0x7f4e98156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98156e90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4e900099e0 tx=0x7f4e90009250 comp rx=0 tx=0).stop 2023-10-14T19:08:33.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 -- 172.21.15.7:0/2917764179 shutdown_connections 2023-10-14T19:08:33.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98156e90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 --2- 172.21.15.7:0/2917764179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 -- 172.21.15.7:0/2917764179 >> 172.21.15.7:0/2917764179 conn(0x7f4e98070e30 msgr2=0x7f4e980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:33.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 -- 172.21.15.7:0/2917764179 shutdown_connections 2023-10-14T19:08:33.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.637+0000 7f4e9d816700 1 -- 172.21.15.7:0/2917764179 wait complete. 2023-10-14T19:08:33.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.638+0000 7f4e9d816700 1 Processor -- start 2023-10-14T19:08:33.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 -- start start 2023-10-14T19:08:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e980cb5a0 0x7f4e980ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98159180 con 0x7f4e9815a400 2023-10-14T19:08:33.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98159b50 con 0x7f4e980cb5a0 2023-10-14T19:08:33.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e9d816700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981582d0 con 0x7f4e980cb970 2023-10-14T19:08:33.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45048/0 (socket says 172.21.15.7:45048) 2023-10-14T19:08:33.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e977fe700 1 -- 172.21.15.7:0/1111492493 learned_addr learned my addr 172.21.15.7:0/1111492493 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:33.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e967fc700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.639+0000 7f4e96ffd700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e980cb5a0 0x7f4e980ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e977fe700 1 -- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 msgr2=0x7f4e98159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e977fe700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e977fe700 1 -- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e980cb5a0 msgr2=0x7f4e980ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e977fe700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e980cb5a0 0x7f4e980ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e977fe700 1 -- 172.21.15.7:0/1111492493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900094f0 con 0x7f4e9815a400 2023-10-14T19:08:33.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e967fc700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:33.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e977fe700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98157d90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009290 tx=0x7f4e90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000b820 con 0x7f4e9815a400 2023-10-14T19:08:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9001f070 con 0x7f4e9815a400 2023-10-14T19:08:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e98158570 con 0x7f4e9815a400 2023-10-14T19:08:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9001a870 con 0x7f4e9815a400 2023-10-14T19:08:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.640+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e98158b30 con 0x7f4e9815a400 2023-10-14T19:08:33.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.641+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9815a860 con 0x7f4e9815a400 2023-10-14T19:08:33.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.641+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4e9001aca0 con 0x7f4e9815a400 2023-10-14T19:08:33.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.642+0000 7f4e8effd700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e78067200 0x7f4e780696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:33.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.642+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e90021070 con 0x7f4e9815a400 2023-10-14T19:08:33.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.642+0000 7f4e96ffd700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e78067200 0x7f4e780696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:33.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.643+0000 7f4e96ffd700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e78067200 0x7f4e780696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e88007fd0 tx=0x7f4e88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:33.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.646+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e90053880 con 0x7f4e9815a400 2023-10-14T19:08:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.887+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e9804c3c0 con 0x7f4e9815a400 2023-10-14T19:08:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.887+0000 7f4e8effd700 1 -- 172.21.15.7:0/1111492493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f4e90015090 con 0x7f4e9815a400 2023-10-14T19:08:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:33.889 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:19.226680+0000","modified":"2023-10-14T19:08:22.851427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6834/491623181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":491623181},{"type":"v1","addr":"172.21.15.7:6834","nonce":491623181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T19:08:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.889+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e78067200 msgr2=0x7f4e780696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.889+0000 7f4e9d816700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e78067200 0x7f4e780696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e88007fd0 tx=0x7f4e88009040 comp rx=0 tx=0).stop 2023-10-14T19:08:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.889+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 msgr2=0x7f4e98157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.889+0000 7f4e9d816700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98157d90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009290 tx=0x7f4e90017000 comp rx=0 tx=0).stop 2023-10-14T19:08:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 shutdown_connections 2023-10-14T19:08:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4e78067200 0x7f4e780696b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e980cb5a0 0x7f4e980ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9815a400 0x7f4e98157d90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 --2- 172.21.15.7:0/1111492493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e980cb970 0x7f4e98159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 >> 172.21.15.7:0/1111492493 conn(0x7f4e98070e30 msgr2=0x7f4e980b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 shutdown_connections 2023-10-14T19:08:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:33.890+0000 7f4e9d816700 1 -- 172.21.15.7:0/1111492493 wait complete. 2023-10-14T19:08:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 49 2023-10-14T19:08:33.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.023+0000 7fe33f50a700 1 Processor -- start 2023-10-14T19:08:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.023+0000 7fe33f50a700 1 -- start start 2023-10-14T19:08:34.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33f50a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe338153c30 0x7fe33815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33f50a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe33815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33f50a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33815afd0 con 0x7fe33815de50 2023-10-14T19:08:34.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33f50a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33815b2b0 con 0x7fe338153c30 2023-10-14T19:08:34.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33f50a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33815b590 con 0x7fe3380cf110 2023-10-14T19:08:34.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33e508700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe338153c30 0x7fe33815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33dd07700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe33815de50 0x7fe3380cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58196/0 (socket says 172.21.15.7:58196) 2023-10-14T19:08:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33dd07700 1 -- 172.21.15.7:0/3185050490 learned_addr learned my addr 172.21.15.7:0/3185050490 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33ed09700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe33815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33e508700 1 -- 172.21.15.7:0/3185050490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 msgr2=0x7fe33815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33e508700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe33815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.024+0000 7fe33e508700 1 -- 172.21.15.7:0/3185050490 >> v1:172.21.15.7:6789/0 conn(0x7fe33815de50 legacy=0x7fe3380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33d506700 1 -- 172.21.15.7:0/3185050490 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067663354 0 0) 0x7fe33815afd0 con 0x7fe33815de50 2023-10-14T19:08:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33e508700 1 -- 172.21.15.7:0/3185050490 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33815b870 con 0x7fe338153c30 2023-10-14T19:08:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33ed09700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe33815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33e508700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe338153c30 0x7fe33815a5e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe3300098e0 tx=0x7fe3300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae6f1c7147b67d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33d506700 1 -- 172.21.15.7:0/3185050490 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330009e80 con 0x7fe338153c30 2023-10-14T19:08:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33d506700 1 -- 172.21.15.7:0/3185050490 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33000b860 con 0x7fe338153c30 2023-10-14T19:08:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33d506700 1 -- 172.21.15.7:0/3185050490 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33000bbe0 con 0x7fe338153c30 2023-10-14T19:08:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 -- 172.21.15.7:0/3185050490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe338153c30 msgr2=0x7fe33815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe338153c30 0x7fe33815a5e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe3300098e0 tx=0x7fe3300091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 -- 172.21.15.7:0/3185050490 shutdown_connections 2023-10-14T19:08:34.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe338153c30 0x7fe33815a5e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 --2- 172.21.15.7:0/3185050490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe33815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 -- 172.21.15.7:0/3185050490 >> 172.21.15.7:0/3185050490 conn(0x7fe3380703a0 msgr2=0x7fe3380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:34.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 -- 172.21.15.7:0/3185050490 shutdown_connections 2023-10-14T19:08:34.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.025+0000 7fe33f50a700 1 -- 172.21.15.7:0/3185050490 wait complete. 2023-10-14T19:08:34.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 Processor -- start 2023-10-14T19:08:34.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 -- start start 2023-10-14T19:08:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe3381526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe338153c30 0x7fe3380b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 0x7fe3380b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338152c00 con 0x7fe33815de50 2023-10-14T19:08:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338151620 con 0x7fe338153c30 2023-10-14T19:08:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33f50a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe338151900 con 0x7fe3380cf110 2023-10-14T19:08:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33ed09700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 0x7fe3380b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33ed09700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 0x7fe3380b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45078/0 (socket says 172.21.15.7:45078) 2023-10-14T19:08:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.027+0000 7fe33ed09700 1 -- 172.21.15.7:0/1415311731 learned_addr learned my addr 172.21.15.7:0/1415311731 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33e508700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe3381526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33ed09700 1 -- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 msgr2=0x7fe3381526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33ed09700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe3381526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33dd07700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe338153c30 0x7fe3380b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33ed09700 1 -- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe338153c30 msgr2=0x7fe3380b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33ed09700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe338153c30 0x7fe3380b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33ed09700 1 -- 172.21.15.7:0/1415311731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009420 con 0x7fe33815de50 2023-10-14T19:08:34.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33dd07700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe338153c30 0x7fe3380b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33ed09700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 0x7fe3380b5c80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe32800a380 tx=0x7fe328007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800ae10 con 0x7fe33815de50 2023-10-14T19:08:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32800d650 con 0x7fe33815de50 2023-10-14T19:08:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe338151be0 con 0x7fe33815de50 2023-10-14T19:08:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800da10 con 0x7fe33815de50 2023-10-14T19:08:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.028+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3381521a0 con 0x7fe33815de50 2023-10-14T19:08:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.029+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33804c3c0 con 0x7fe33815de50 2023-10-14T19:08:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.029+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe32801e3b0 con 0x7fe33815de50 2023-10-14T19:08:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.030+0000 7fe3367fc700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe324067200 0x7fe3240696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.030+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe328085460 con 0x7fe33815de50 2023-10-14T19:08:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.030+0000 7fe33e508700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe324067200 0x7fe3240696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.031+0000 7fe33e508700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe324067200 0x7fe3240696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe33815a2e0 tx=0x7fe330017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.034+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3280522a0 con 0x7fe33815de50 2023-10-14T19:08:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.227+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe33815bb50 con 0x7fe33815de50 2023-10-14T19:08:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.228+0000 7fe3367fc700 1 -- 172.21.15.7:0/1415311731 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15305 (secure 0 0 0) 0x7fe3280558c0 con 0x7fe33815de50 2023-10-14T19:08:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:34.230 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:20.826897+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:16.869015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:18.218167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe324067200 msgr2=0x7fe3240696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe324067200 0x7fe3240696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe33815a2e0 tx=0x7fe330017000 comp rx=0 tx=0).stop 2023-10-14T19:08:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 msgr2=0x7fe3380b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 0x7fe3380b5c80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe32800a380 tx=0x7fe328007900 comp rx=0 tx=0).stop 2023-10-14T19:08:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 shutdown_connections 2023-10-14T19:08:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe324067200 0x7fe3240696b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33815de50 0x7fe3380b5c80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3380cf110 0x7fe3381526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 --2- 172.21.15.7:0/1415311731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe338153c30 0x7fe3380b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 >> 172.21.15.7:0/1415311731 conn(0x7fe3380703a0 msgr2=0x7fe3380c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 shutdown_connections 2023-10-14T19:08:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.230+0000 7fe33f50a700 1 -- 172.21.15.7:0/1415311731 wait complete. 2023-10-14T19:08:34.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:08:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.363+0000 7f32d689b700 1 Processor -- start 2023-10-14T19:08:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.363+0000 7f32d689b700 1 -- start start 2023-10-14T19:08:34.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.364+0000 7f32d689b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 0x7f32d01645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.364+0000 7f32d689b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d00ce9d0 con 0x7f32d01598b0 2023-10-14T19:08:34.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.364+0000 7f32d689b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d00af960 con 0x7f32d0159c80 2023-10-14T19:08:34.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.364+0000 7f32d689b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d00afc30 con 0x7f32d00cbe00 2023-10-14T19:08:34.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.364+0000 7f32cffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f32d01598b0 0x7f32d00af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58212/0 (socket says 172.21.15.7:58212) 2023-10-14T19:08:34.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.364+0000 7f32cffff700 1 -- 172.21.15.7:0/708367694 learned_addr learned my addr 172.21.15.7:0/708367694 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:34.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32d4e38700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 0x7f32d01645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933333707 0 0) 0x7f32d00ce9d0 con 0x7f32d01598b0 2023-10-14T19:08:34.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32bc003570 con 0x7f32d01598b0 2023-10-14T19:08:34.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901845543 0 0) 0x7f32d00af960 con 0x7f32d0159c80 2023-10-14T19:08:34.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d00ce9d0 con 0x7f32d0159c80 2023-10-14T19:08:34.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274256274 0 0) 0x7f32bc003570 con 0x7f32d01598b0 2023-10-14T19:08:34.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 msgr2=0x7f32d01645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:34.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 0x7f32d01645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 >> v1:172.21.15.148:6789/0 conn(0x7f32d0159c80 legacy=0x7f32d00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d00aff10 con 0x7f32d01598b0 2023-10-14T19:08:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f32b8001470 con 0x7f32d01598b0 2023-10-14T19:08:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 >> v1:172.21.15.7:6789/0 conn(0x7f32d01598b0 legacy=0x7f32d00af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32bc003c20 0x7f32bc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 0x7f32bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc004d50 0x7f32bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d00afc30 con 0x7f32bc003c20 2023-10-14T19:08:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc00bb40 con 0x7f32bc004d50 2023-10-14T19:08:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc00bd00 con 0x7f32d00cbe00 2023-10-14T19:08:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cffff700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32bc003c20 0x7f32bc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cf7fe700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 0x7f32bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32d4e38700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc004d50 0x7f32bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cffff700 1 -- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 msgr2=0x7f32bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cffff700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d00cbe00 0x7f32bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cffff700 1 -- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc004d50 msgr2=0x7f32bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:34.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cffff700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc004d50 0x7f32bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.365+0000 7f32cffff700 1 -- 172.21.15.7:0/708367694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc003570 con 0x7f32bc003c20 2023-10-14T19:08:34.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32cffff700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32bc003c20 0x7f32bc004010 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c2d0 tx=0x7f32b8001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72adec61263db4ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800cba0 con 0x7f32bc003c20 2023-10-14T19:08:34.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800cd00 con 0x7f32bc003c20 2023-10-14T19:08:34.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32ceffd700 1 -- 172.21.15.7:0/708367694 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8005b70 con 0x7f32bc003c20 2023-10-14T19:08:34.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d689b700 1 -- 172.21.15.7:0/708367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32bc003c20 msgr2=0x7f32bc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d689b700 1 --2- 172.21.15.7:0/708367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32bc003c20 0x7f32bc004010 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c2d0 tx=0x7f32b8001e10 comp rx=0 tx=0).stop 2023-10-14T19:08:34.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d4e38700 1 -- 172.21.15.7:0/708367694 reap_dead start 2023-10-14T19:08:34.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d689b700 1 -- 172.21.15.7:0/708367694 shutdown_connections 2023-10-14T19:08:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d689b700 1 -- 172.21.15.7:0/708367694 >> 172.21.15.7:0/708367694 conn(0x7f32d0070e30 msgr2=0x7f32d00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d689b700 1 -- 172.21.15.7:0/708367694 shutdown_connections 2023-10-14T19:08:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.366+0000 7f32d689b700 1 -- 172.21.15.7:0/708367694 wait complete. 2023-10-14T19:08:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.367+0000 7f32d689b700 1 Processor -- start 2023-10-14T19:08:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 -- start start 2023-10-14T19:08:34.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc003c20 0x7f32d00b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 0x7f32d00b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0153250 0x7f32d01536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d00b4b60 con 0x7f32d00b34b0 2023-10-14T19:08:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d0153bf0 con 0x7f32bc003c20 2023-10-14T19:08:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32d689b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d01573f0 con 0x7f32d0153250 2023-10-14T19:08:34.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32cf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 0x7f32d00b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32cf7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 0x7f32d00b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45094/0 (socket says 172.21.15.7:45094) 2023-10-14T19:08:34.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32cf7fe700 1 -- 172.21.15.7:0/217689310 learned_addr learned my addr 172.21.15.7:0/217689310 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:34.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.368+0000 7f32cffff700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc003c20 0x7f32d00b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32d4e38700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0153250 0x7f32d01536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32cf7fe700 1 -- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0153250 msgr2=0x7f32d01536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32cf7fe700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0153250 0x7f32d01536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32cf7fe700 1 -- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc003c20 msgr2=0x7f32d00b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32cf7fe700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc003c20 0x7f32d00b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32cf7fe700 1 -- 172.21.15.7:0/217689310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d00b3f50 con 0x7f32d00b34b0 2023-10-14T19:08:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32d4e38700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0153250 0x7f32d01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32cf7fe700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 0x7f32d00b3900 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e810 tx=0x7f32c0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0013630 con 0x7f32d00b34b0 2023-10-14T19:08:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c00137b0 con 0x7f32d00b34b0 2023-10-14T19:08:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d00b4230 con 0x7f32d00b34b0 2023-10-14T19:08:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0013b70 con 0x7f32d00b34b0 2023-10-14T19:08:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.369+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d00b47f0 con 0x7f32d00b34b0 2023-10-14T19:08:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.370+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d00b4d10 con 0x7f32d00b34b0 2023-10-14T19:08:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.370+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f32c001c400 con 0x7f32d00b34b0 2023-10-14T19:08:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.371+0000 7f32c7fff700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32b0067230 0x7f32b00696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.371+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32c0084f60 con 0x7f32d00b34b0 2023-10-14T19:08:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.371+0000 7f32cffff700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32b0067230 0x7f32b00696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.372+0000 7f32cffff700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32b0067230 0x7f32b00696e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f32b8001e50 tx=0x7f32b8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.375+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32d00b4d10 con 0x7f32d00b34b0 2023-10-14T19:08:34.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.615+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f32d00b4ed0 con 0x7f32d00b34b0 2023-10-14T19:08:34.616 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:08:34.616+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:08:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.619+0000 7f32c7fff700 1 -- 172.21.15.7:0/217689310 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f32c0017020 con 0x7f32d00b34b0 2023-10-14T19:08:34.621 INFO:tasks.ceph.mds.a.smithi007.stderr: -1807> 2023-10-14T19:08:24.351+0000 7f79b0528700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:08:34.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32b0067230 msgr2=0x7f32b00696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32b0067230 0x7f32b00696e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f32b8001e50 tx=0x7f32b8015000 comp rx=0 tx=0).stop 2023-10-14T19:08:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 msgr2=0x7f32d00b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 0x7f32d00b3900 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e810 tx=0x7f32c0009040 comp rx=0 tx=0).stop 2023-10-14T19:08:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 shutdown_connections 2023-10-14T19:08:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f32b0067230 0x7f32b00696e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32bc003c20 0x7f32d00b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32d0153250 0x7f32d01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 --2- 172.21.15.7:0/217689310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d00b34b0 0x7f32d00b3900 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.621+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 >> 172.21.15.7:0/217689310 conn(0x7f32d0070e30 msgr2=0x7f32d00b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.622+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 shutdown_connections 2023-10-14T19:08:34.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.622+0000 7f32d689b700 1 -- 172.21.15.7:0/217689310 wait complete. 2023-10-14T19:08:34.625 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:08:34.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:08:34.644 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:08:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.756+0000 7f452e91e700 1 Processor -- start 2023-10-14T19:08:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.756+0000 7f452e91e700 1 -- start start 2023-10-14T19:08:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452e91e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f45280ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452e91e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f452806e0e0 0x7f45280cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452e91e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45280ccfd0 con 0x7f452806dc70 2023-10-14T19:08:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452e91e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45280cf0e0 con 0x7f452806e0e0 2023-10-14T19:08:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452e91e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452815a3d0 con 0x7f4528159530 2023-10-14T19:08:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452cebb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f452806e0e0 0x7f45280cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452cebb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f452806e0e0 0x7f45280cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45116/0 (socket says 172.21.15.7:45116) 2023-10-14T19:08:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.757+0000 7f452cebb700 1 -- 172.21.15.7:0/2577292034 learned_addr learned my addr 172.21.15.7:0/2577292034 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f4527fff700 1 --2- 172.21.15.7:0/2577292034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f45280ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452cebb700 1 -- 172.21.15.7:0/2577292034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 msgr2=0x7f45280ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452cebb700 1 --2- 172.21.15.7:0/2577292034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f45280ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452cebb700 1 -- 172.21.15.7:0/2577292034 >> v1:172.21.15.148:6789/0 conn(0x7f452806dc70 legacy=0x7f4528159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452cebb700 1 -- 172.21.15.7:0/2577292034 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452815a6b0 con 0x7f452806e0e0 2023-10-14T19:08:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452cebb700 1 --2- 172.21.15.7:0/2577292034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280cb6f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4520009f20 tx=0x7f4520009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89286cb3d5519e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f4526ffd700 1 -- 172.21.15.7:0/2577292034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000e070 con 0x7f452806e0e0 2023-10-14T19:08:34.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f4526ffd700 1 -- 172.21.15.7:0/2577292034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452000ba80 con 0x7f452806e0e0 2023-10-14T19:08:34.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f4526ffd700 1 -- 172.21.15.7:0/2577292034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45200092e0 con 0x7f452806e0e0 2023-10-14T19:08:34.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452e91e700 1 -- 172.21.15.7:0/2577292034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 msgr2=0x7f45280cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.758+0000 7f452e91e700 1 --2- 172.21.15.7:0/2577292034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280cb6f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4520009f20 tx=0x7f4520009840 comp rx=0 tx=0).stop 2023-10-14T19:08:34.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.759+0000 7f452e91e700 1 -- 172.21.15.7:0/2577292034 shutdown_connections 2023-10-14T19:08:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.759+0000 7f452e91e700 1 --2- 172.21.15.7:0/2577292034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280cb6f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.759+0000 7f452e91e700 1 --2- 172.21.15.7:0/2577292034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f45280ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.759+0000 7f452e91e700 1 -- 172.21.15.7:0/2577292034 >> 172.21.15.7:0/2577292034 conn(0x7f45280703a0 msgr2=0x7f45280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.759+0000 7f452e91e700 1 -- 172.21.15.7:0/2577292034 shutdown_connections 2023-10-14T19:08:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.759+0000 7f452e91e700 1 -- 172.21.15.7:0/2577292034 wait complete. 2023-10-14T19:08:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.760+0000 7f452e91e700 1 Processor -- start 2023-10-14T19:08:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.760+0000 7f452e91e700 1 -- start start 2023-10-14T19:08:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452806dc70 0x7f45280c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f4528155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280c8e20 con 0x7f452806e0e0 2023-10-14T19:08:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280c8210 con 0x7f452806dc70 2023-10-14T19:08:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45280c84f0 con 0x7f4528159530 2023-10-14T19:08:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45122/0 (socket says 172.21.15.7:45122) 2023-10-14T19:08:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 -- 172.21.15.7:0/1018866247 learned_addr learned my addr 172.21.15.7:0/1018866247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f4527fff700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452806dc70 0x7f45280c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452cebb700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f4528155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 -- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 msgr2=0x7f4528155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f4528155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 -- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452806dc70 msgr2=0x7f45280c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452806dc70 0x7f45280c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 -- 172.21.15.7:0/1018866247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520009ae0 con 0x7f452806e0e0 2023-10-14T19:08:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f45277fe700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280c7c10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f451800c590 tx=0x7f451800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518011590 con 0x7f452806e0e0 2023-10-14T19:08:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45280c87d0 con 0x7f452806e0e0 2023-10-14T19:08:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518011710 con 0x7f452806e0e0 2023-10-14T19:08:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518011ad0 con 0x7f452806e0e0 2023-10-14T19:08:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.761+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4528158240 con 0x7f452806e0e0 2023-10-14T19:08:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.762+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452804c3c0 con 0x7f452806e0e0 2023-10-14T19:08:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.763+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f451801b3b0 con 0x7f452806e0e0 2023-10-14T19:08:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.763+0000 7f450ffff700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4514067200 0x7f45140696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.763+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4518083ea0 con 0x7f452806e0e0 2023-10-14T19:08:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.763+0000 7f4527fff700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4514067200 0x7f45140696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:34.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.764+0000 7f4527fff700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4514067200 0x7f45140696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f451c006fd0 tx=0x7f451c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:34.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:34.767+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4518050d70 con 0x7f452806e0e0 2023-10-14T19:08:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.009+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f452815a990 con 0x7f452806e0e0 2023-10-14T19:08:35.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.620+0000 7f450ffff700 1 -- 172.21.15.7:0/1018866247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4518017020 con 0x7f452806e0e0 2023-10-14T19:08:35.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4514067200 msgr2=0x7f45140696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:35.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4514067200 0x7f45140696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f451c006fd0 tx=0x7f451c008040 comp rx=0 tx=0).stop 2023-10-14T19:08:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 msgr2=0x7f45280c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280c7c10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f451800c590 tx=0x7f451800c8a0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 shutdown_connections 2023-10-14T19:08:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4514067200 0x7f45140696b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452806dc70 0x7f45280c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4528159530 0x7f4528155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 --2- 172.21.15.7:0/1018866247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f452806e0e0 0x7f45280c7c10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 >> 172.21.15.7:0/1018866247 conn(0x7f45280703a0 msgr2=0x7f45280d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 shutdown_connections 2023-10-14T19:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.624+0000 7f452e91e700 1 -- 172.21.15.7:0/1018866247 wait complete. 2023-10-14T19:08:35.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:08:35.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.812+0000 7fbc98687700 1 Processor -- start 2023-10-14T19:08:35.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.813+0000 7fbc98687700 1 -- start start 2023-10-14T19:08:35.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.813+0000 7fbc98687700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc9006dcf0 0x7fbc90159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:35.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.813+0000 7fbc98687700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc90159e40 0x7fbc900cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:35.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc98687700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc900ccfd0 con 0x7fbc90159530 2023-10-14T19:08:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc98687700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9015a410 con 0x7fbc90159e40 2023-10-14T19:08:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc98687700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9015a6f0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc90159e40 0x7fbc900cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc90159e40 0x7fbc900cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45132/0 (socket says 172.21.15.7:45132) 2023-10-14T19:08:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 -- 172.21.15.7:0/2065677669 learned_addr learned my addr 172.21.15.7:0/2065677669 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc95c22700 1 --2- 172.21.15.7:0/2065677669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc9006dcf0 0x7fbc90159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 -- 172.21.15.7:0/2065677669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc9006dcf0 msgr2=0x7fbc90159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 --2- 172.21.15.7:0/2065677669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc9006dcf0 0x7fbc90159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 -- 172.21.15.7:0/2065677669 >> v1:172.21.15.148:6789/0 conn(0x7fbc90159530 legacy=0x7fbc900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 -- 172.21.15.7:0/2065677669 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9015a9d0 con 0x7fbc90159e40 2023-10-14T19:08:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc96c24700 1 --2- 172.21.15.7:0/2065677669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90159e40 0x7fbc900cb6f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbc880099b0 tx=0x7fbc88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e0f8dda6650883 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc95421700 1 -- 172.21.15.7:0/2065677669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b860 con 0x7fbc90159e40 2023-10-14T19:08:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc95421700 1 -- 172.21.15.7:0/2065677669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800b9c0 con 0x7fbc90159e40 2023-10-14T19:08:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.814+0000 7fbc95421700 1 -- 172.21.15.7:0/2065677669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bd60 con 0x7fbc90159e40 2023-10-14T19:08:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 -- 172.21.15.7:0/2065677669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90159e40 msgr2=0x7fbc900cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 --2- 172.21.15.7:0/2065677669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90159e40 0x7fbc900cb6f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbc880099b0 tx=0x7fbc88009250 comp rx=0 tx=0).stop 2023-10-14T19:08:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 -- 172.21.15.7:0/2065677669 shutdown_connections 2023-10-14T19:08:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 --2- 172.21.15.7:0/2065677669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90159e40 0x7fbc900cb6f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 --2- 172.21.15.7:0/2065677669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc9006dcf0 0x7fbc90159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 -- 172.21.15.7:0/2065677669 >> 172.21.15.7:0/2065677669 conn(0x7fbc900703a0 msgr2=0x7fbc900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 -- 172.21.15.7:0/2065677669 shutdown_connections 2023-10-14T19:08:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.815+0000 7fbc98687700 1 -- 172.21.15.7:0/2065677669 wait complete. 2023-10-14T19:08:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.816+0000 7fbc98687700 1 Processor -- start 2023-10-14T19:08:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.816+0000 7fbc98687700 1 -- start start 2023-10-14T19:08:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc98687700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 0x7fbc9016a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:35.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc98687700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc90159530 0x7fbc901570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:35.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc98687700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc90159e40 0x7fbc9015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:35.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc98687700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9015bca0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc98687700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9016a560 con 0x7fbc90159530 2023-10-14T19:08:35.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc98687700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90157610 con 0x7fbc90159e40 2023-10-14T19:08:35.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 0x7fbc9016a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:35.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 0x7fbc9016a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45144/0 (socket says 172.21.15.7:45144) 2023-10-14T19:08:35.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 -- 172.21.15.7:0/792452046 learned_addr learned my addr 172.21.15.7:0/792452046 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:35.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96c24700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc90159e40 0x7fbc9015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:35.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc95c22700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc90159530 0x7fbc901570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:35.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 -- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc90159e40 msgr2=0x7fbc9015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:35.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc90159e40 0x7fbc9015d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 -- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc90159530 msgr2=0x7fbc901570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:35.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc90159530 0x7fbc901570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:35.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 -- 172.21.15.7:0/792452046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880094f0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96c24700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc90159e40 0x7fbc9015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:35.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.817+0000 7fbc96423700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 0x7fbc9016a020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000cb40 tx=0x7fbc800017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:35.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.818+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000a7a0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.818+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8000a920 con 0x7fbc9006dcf0 2023-10-14T19:08:35.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.818+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000ace0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.818+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9015b090 con 0x7fbc9006dcf0 2023-10-14T19:08:35.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.818+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9015b650 con 0x7fbc9006dcf0 2023-10-14T19:08:35.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.819+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9004c3c0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.819+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fbc80003030 con 0x7fbc9006dcf0 2023-10-14T19:08:35.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.820+0000 7fbc8e7fc700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc7c067200 0x7fbc7c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:35.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.820+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbc80084ab0 con 0x7fbc9006dcf0 2023-10-14T19:08:35.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.820+0000 7fbc95c22700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc7c067200 0x7fbc7c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:35.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.820+0000 7fbc95c22700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc7c067200 0x7fbc7c0696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbc900b11a0 tx=0x7fbc84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:35.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:35.824+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc80051980 con 0x7fbc9006dcf0 2023-10-14T19:08:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.019+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc9015acb0 con 0x7fbc9006dcf0 2023-10-14T19:08:36.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.907+0000 7fbc8e7fc700 1 -- 172.21.15.7:0/792452046 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbc80054fa0 con 0x7fbc9006dcf0 2023-10-14T19:08:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.910+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc7c067200 msgr2=0x7fbc7c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.910+0000 7fbc98687700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc7c067200 0x7fbc7c0696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbc900b11a0 tx=0x7fbc84008040 comp rx=0 tx=0).stop 2023-10-14T19:08:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.910+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 msgr2=0x7fbc9016a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.910+0000 7fbc98687700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 0x7fbc9016a020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000cb40 tx=0x7fbc800017b0 comp rx=0 tx=0).stop 2023-10-14T19:08:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.911+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 shutdown_connections 2023-10-14T19:08:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.911+0000 7fbc98687700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc7c067200 0x7fbc7c0696b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.911+0000 7fbc98687700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc90159e40 0x7fbc9015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.911+0000 7fbc98687700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9006dcf0 0x7fbc9016a020 secure :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000cb40 tx=0x7fbc800017b0 comp rx=0 tx=0).stop 2023-10-14T19:08:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.911+0000 7fbc98687700 1 --2- 172.21.15.7:0/792452046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc90159530 0x7fbc901570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.911+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 >> 172.21.15.7:0/792452046 conn(0x7fbc900703a0 msgr2=0x7fbc900c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.912+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 shutdown_connections 2023-10-14T19:08:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:36.912+0000 7fbc98687700 1 -- 172.21.15.7:0/792452046 wait complete. 2023-10-14T19:08:36.917 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:08:36.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:08:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 Processor -- start 2023-10-14T19:08:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 -- start start 2023-10-14T19:08:37.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe0d006dcf0 0x7fe0d0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:37.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0d0159e40 0x7fe0d00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00ccfd0 con 0x7fe0d0159530 2023-10-14T19:08:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d015a410 con 0x7fe0d006dcf0 2023-10-14T19:08:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.059+0000 7fe0d6c54700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d015a6f0 con 0x7fe0d0159e40 2023-10-14T19:08:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe0d006dcf0 0x7fe0d0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe0d006dcf0 0x7fe0d0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56800/0 (socket says 172.21.15.7:56800) 2023-10-14T19:08:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 -- 172.21.15.7:0/3074592839 learned_addr learned my addr 172.21.15.7:0/3074592839 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0d51f1700 1 --2- 172.21.15.7:0/3074592839 >> v2:172.21.15.148:3300/0 conn(0x7fe0d0159e40 0x7fe0d00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 -- 172.21.15.7:0/3074592839 >> v2:172.21.15.148:3300/0 conn(0x7fe0d0159e40 msgr2=0x7fe0d00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 --2- 172.21.15.7:0/3074592839 >> v2:172.21.15.148:3300/0 conn(0x7fe0d0159e40 0x7fe0d00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 -- 172.21.15.7:0/3074592839 >> v1:172.21.15.148:6789/0 conn(0x7fe0d0159530 legacy=0x7fe0d00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:37.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 -- 172.21.15.7:0/3074592839 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d015a9d0 con 0x7fe0d006dcf0 2023-10-14T19:08:37.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0d51f1700 1 --2- 172.21.15.7:0/3074592839 >> v2:172.21.15.148:3300/0 conn(0x7fe0d0159e40 0x7fe0d00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:37.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cffff700 1 --2- 172.21.15.7:0/3074592839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d006dcf0 0x7fe0d0159900 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe0d00caef0 tx=0x7fe0c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7203a87ad600b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:37.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cf7fe700 1 -- 172.21.15.7:0/3074592839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000b820 con 0x7fe0d006dcf0 2023-10-14T19:08:37.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cf7fe700 1 -- 172.21.15.7:0/3074592839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c000b980 con 0x7fe0d006dcf0 2023-10-14T19:08:37.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.060+0000 7fe0cf7fe700 1 -- 172.21.15.7:0/3074592839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000bd20 con 0x7fe0d006dcf0 2023-10-14T19:08:37.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3074592839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d006dcf0 msgr2=0x7fe0d0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:37.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3074592839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d006dcf0 0x7fe0d0159900 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe0d00caef0 tx=0x7fe0c0009250 comp rx=0 tx=0).stop 2023-10-14T19:08:37.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3074592839 shutdown_connections 2023-10-14T19:08:37.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3074592839 >> v2:172.21.15.148:3300/0 conn(0x7fe0d0159e40 0x7fe0d00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3074592839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d006dcf0 0x7fe0d0159900 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3074592839 >> 172.21.15.7:0/3074592839 conn(0x7fe0d00703a0 msgr2=0x7fe0d00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:37.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3074592839 shutdown_connections 2023-10-14T19:08:37.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.061+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3074592839 wait complete. 2023-10-14T19:08:37.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.062+0000 7fe0d6c54700 1 Processor -- start 2023-10-14T19:08:37.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.062+0000 7fe0d6c54700 1 -- start start 2023-10-14T19:08:37.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d6c54700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0d006dcf0 0x7fe0d00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:37.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d6c54700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 0x7fe0d015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:37.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d6c54700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0d0159e40 0x7fe0d015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:37.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d6c54700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00b5350 con 0x7fe0d0159530 2023-10-14T19:08:37.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d6c54700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d013fe40 con 0x7fe0d006dcf0 2023-10-14T19:08:37.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d6c54700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00c7a50 con 0x7fe0d0159e40 2023-10-14T19:08:37.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 0x7fe0d015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:37.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 0x7fe0d015c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56816/0 (socket says 172.21.15.7:56816) 2023-10-14T19:08:37.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 -- 172.21.15.7:0/3048306618 learned_addr learned my addr 172.21.15.7:0/3048306618 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:37.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d49f0700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0d006dcf0 0x7fe0d00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:37.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d51f1700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0d0159e40 0x7fe0d015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:37.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 -- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0d0159e40 msgr2=0x7fe0d015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:37.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0d0159e40 0x7fe0d015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 -- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0d006dcf0 msgr2=0x7fe0d00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:37.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0d006dcf0 0x7fe0d00b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 -- 172.21.15.7:0/3048306618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00094f0 con 0x7fe0d0159530 2023-10-14T19:08:37.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0d49f0700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0d006dcf0 0x7fe0d00b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:37.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.063+0000 7fe0cffff700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 0x7fe0d015c8c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00030c0 tx=0x7fe0c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:37.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.064+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0011e60 con 0x7fe0d0159530 2023-10-14T19:08:37.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.064+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c001b680 con 0x7fe0d0159530 2023-10-14T19:08:37.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.064+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d00b4d90 con 0x7fe0d0159530 2023-10-14T19:08:37.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.064+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c001ba20 con 0x7fe0d0159530 2023-10-14T19:08:37.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.064+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d00c7cf0 con 0x7fe0d0159530 2023-10-14T19:08:37.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.065+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d00c7ee0 con 0x7fe0d0159530 2023-10-14T19:08:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.065+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe0c001c450 con 0x7fe0d0159530 2023-10-14T19:08:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.065+0000 7fe0ccff9700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0b0067280 0x7fe0b0069730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.066+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe0c0086500 con 0x7fe0d0159530 2023-10-14T19:08:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.066+0000 7fe0d49f0700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0b0067280 0x7fe0b0069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.066+0000 7fe0d49f0700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0b0067280 0x7fe0b0069730 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8001410 tx=0x7fe0c80096a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.070+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0c0053540 con 0x7fe0d0159530 2023-10-14T19:08:37.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.264+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0d004c3c0 con 0x7fe0d0159530 2023-10-14T19:08:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.915+0000 7fe0ccff9700 1 -- 172.21.15.7:0/3048306618 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe0c0056b60 con 0x7fe0d0159530 2023-10-14T19:08:37.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.920+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0b0067280 msgr2=0x7fe0b0069730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.920+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0b0067280 0x7fe0b0069730 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8001410 tx=0x7fe0c80096a0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.920+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 msgr2=0x7fe0d015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.920+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 0x7fe0d015c8c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00030c0 tx=0x7fe0c0016000 comp rx=0 tx=0).stop 2023-10-14T19:08:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 shutdown_connections 2023-10-14T19:08:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe0b0067280 0x7fe0b0069730 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0d006dcf0 0x7fe0d00b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0d0159e40 0x7fe0d015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 --2- 172.21.15.7:0/3048306618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0d0159530 0x7fe0d015c8c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 >> 172.21.15.7:0/3048306618 conn(0x7fe0d00703a0 msgr2=0x7fe0d00ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 shutdown_connections 2023-10-14T19:08:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:37.921+0000 7fe0d6c54700 1 -- 172.21.15.7:0/3048306618 wait complete. 2023-10-14T19:08:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:08:37.936 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:08:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.065+0000 7f9aa015a700 1 Processor -- start 2023-10-14T19:08:38.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.065+0000 7f9aa015a700 1 -- start start 2023-10-14T19:08:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.066+0000 7f9aa015a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 0x7f9a980cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.066+0000 7f9aa015a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 0x7f9a980cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.066+0000 7f9aa015a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980cf510 con 0x7f9a98159860 2023-10-14T19:08:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.066+0000 7f9aa015a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980d00b0 con 0x7f9a980ccfa0 2023-10-14T19:08:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.066+0000 7f9aa015a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980ce670 con 0x7f9a980ce220 2023-10-14T19:08:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9e6f7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 0x7f9a980cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 0x7f9a980cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 0x7f9a980cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:36812/0 (socket says 172.21.15.7:36812) 2023-10-14T19:08:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9e6f7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 0x7f9a980cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:54380/0 (socket says 172.21.15.7:54380) 2023-10-14T19:08:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 -- 172.21.15.7:0/3079807027 learned_addr learned my addr 172.21.15.7:0/3079807027 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 -- 172.21.15.7:0/3079807027 >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 msgr2=0x7f9a980cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 --2- 172.21.15.7:0/3079807027 >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 0x7f9a980cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 -- 172.21.15.7:0/3079807027 >> v1:172.21.15.148:6789/0 conn(0x7f9a98159860 legacy=0x7f9a980cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 -- 172.21.15.7:0/3079807027 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980cd960 con 0x7f9a980ce220 2023-10-14T19:08:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9e6f7700 1 --2- 172.21.15.7:0/3079807027 >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 0x7f9a980cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.067+0000 7f9a9d6f5700 1 --2- 172.21.15.7:0/3079807027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 0x7f9a980cbd90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009990 tx=0x7f9a8c009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3639d3dfc42399ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9a9cef4700 1 -- 172.21.15.7:0/3079807027 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c009e80 con 0x7f9a980ce220 2023-10-14T19:08:38.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9a9cef4700 1 -- 172.21.15.7:0/3079807027 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c005c10 con 0x7f9a980ce220 2023-10-14T19:08:38.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9a9cef4700 1 -- 172.21.15.7:0/3079807027 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00b650 con 0x7f9a980ce220 2023-10-14T19:08:38.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 -- 172.21.15.7:0/3079807027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 msgr2=0x7f9a980cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 --2- 172.21.15.7:0/3079807027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 0x7f9a980cbd90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009990 tx=0x7f9a8c009220 comp rx=0 tx=0).stop 2023-10-14T19:08:38.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 -- 172.21.15.7:0/3079807027 shutdown_connections 2023-10-14T19:08:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 --2- 172.21.15.7:0/3079807027 >> v2:172.21.15.148:3300/0 conn(0x7f9a980ccfa0 0x7f9a980cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 --2- 172.21.15.7:0/3079807027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a980ce220 0x7f9a980cbd90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 -- 172.21.15.7:0/3079807027 >> 172.21.15.7:0/3079807027 conn(0x7f9a980999b0 msgr2=0x7f9a98070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 -- 172.21.15.7:0/3079807027 shutdown_connections 2023-10-14T19:08:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.068+0000 7f9aa015a700 1 -- 172.21.15.7:0/3079807027 wait complete. 2023-10-14T19:08:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.069+0000 7f9aa015a700 1 Processor -- start 2023-10-14T19:08:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.069+0000 7f9aa015a700 1 -- start start 2023-10-14T19:08:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9aa015a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 0x7f9a9816b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9aa015a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a980ce220 0x7f9a980ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9aa015a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a98159860 0x7f9a9816aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9aa015a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9809bc00 con 0x7f9a980ccfa0 2023-10-14T19:08:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9aa015a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9809c4a0 con 0x7f9a980ce220 2023-10-14T19:08:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9aa015a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980ae330 con 0x7f9a98159860 2023-10-14T19:08:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9a9def6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 0x7f9a9816b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9a9def6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 0x7f9a9816b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56824/0 (socket says 172.21.15.7:56824) 2023-10-14T19:08:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9a9def6700 1 -- 172.21.15.7:0/2879287326 learned_addr learned my addr 172.21.15.7:0/2879287326 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9a9e6f7700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a98159860 0x7f9a9816aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.070+0000 7f9a9d6f5700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a980ce220 0x7f9a980ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a9def6700 1 -- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a98159860 msgr2=0x7f9a9816aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a9def6700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a98159860 0x7f9a9816aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a9def6700 1 -- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a980ce220 msgr2=0x7f9a980ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a9def6700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a980ce220 0x7f9a980ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a9def6700 1 -- 172.21.15.7:0/2879287326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009420 con 0x7f9a980ccfa0 2023-10-14T19:08:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a9def6700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 0x7f9a9816b690 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800cdb0 tx=0x7f9a88001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800ab70 con 0x7f9a980ccfa0 2023-10-14T19:08:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8800acd0 con 0x7f9a980ccfa0 2023-10-14T19:08:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c009480 con 0x7f9a980ccfa0 2023-10-14T19:08:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88012670 con 0x7f9a980ccfa0 2023-10-14T19:08:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.071+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9809c130 con 0x7f9a980ccfa0 2023-10-14T19:08:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.072+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9804c3c0 con 0x7f9a980ccfa0 2023-10-14T19:08:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.072+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9a88012a60 con 0x7f9a980ccfa0 2023-10-14T19:08:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.073+0000 7f9a95ffb700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a84067200 0x7f9a840696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.073+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9a88084d40 con 0x7f9a980ccfa0 2023-10-14T19:08:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.073+0000 7f9a9d6f5700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a84067200 0x7f9a840696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.073+0000 7f9a9d6f5700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a84067200 0x7f9a840696b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c007fd0 tx=0x7f9a8c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.077+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a88052020 con 0x7f9a980ccfa0 2023-10-14T19:08:38.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.273+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9a9808a9c0 con 0x7f9a980ccfa0 2023-10-14T19:08:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.276+0000 7f9a95ffb700 1 -- 172.21.15.7:0/2879287326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9a88055640 con 0x7f9a980ccfa0 2023-10-14T19:08:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a84067200 msgr2=0x7f9a840696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a84067200 0x7f9a840696b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c007fd0 tx=0x7f9a8c016000 comp rx=0 tx=0).stop 2023-10-14T19:08:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 msgr2=0x7f9a9816b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 0x7f9a9816b690 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800cdb0 tx=0x7f9a88001be0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 shutdown_connections 2023-10-14T19:08:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a84067200 0x7f9a840696b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a98159860 0x7f9a9816aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a980ccfa0 0x7f9a9816b690 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 --2- 172.21.15.7:0/2879287326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a980ce220 0x7f9a980ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 >> 172.21.15.7:0/2879287326 conn(0x7f9a980999b0 msgr2=0x7f9a980b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:38.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 shutdown_connections 2023-10-14T19:08:38.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.279+0000 7f9aa015a700 1 -- 172.21.15.7:0/2879287326 wait complete. 2023-10-14T19:08:38.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-14T19:08:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.410+0000 7fd281414700 1 Processor -- start 2023-10-14T19:08:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.410+0000 7fd281414700 1 -- start start 2023-10-14T19:08:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd281414700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c153c30 0x7fd27c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd281414700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd27c0cf110 0x7fd27c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd281414700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c15afd0 con 0x7fd27c15de50 2023-10-14T19:08:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd281414700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c15b2b0 con 0x7fd27c0cf110 2023-10-14T19:08:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd281414700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c15b590 con 0x7fd27c153c30 2023-10-14T19:08:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd280c13700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd27c0cf110 0x7fd27c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd27b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd27c15de50 0x7fd27c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54024/0 (socket says 172.21.15.7:54024) 2023-10-14T19:08:38.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.411+0000 7fd27b7fe700 1 -- 172.21.15.7:0/279755480 learned_addr learned my addr 172.21.15.7:0/279755480 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:38.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd27bfff700 1 --2- 172.21.15.7:0/279755480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c153c30 0x7fd27c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd27affd700 1 -- 172.21.15.7:0/279755480 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663655168 0 0) 0x7fd27c15afd0 con 0x7fd27c15de50 2023-10-14T19:08:38.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd27affd700 1 -- 172.21.15.7:0/279755480 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd264003570 con 0x7fd27c15de50 2023-10-14T19:08:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd280c13700 1 -- 172.21.15.7:0/279755480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c153c30 msgr2=0x7fd27c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd280c13700 1 --2- 172.21.15.7:0/279755480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c153c30 0x7fd27c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd280c13700 1 -- 172.21.15.7:0/279755480 >> v1:172.21.15.7:6789/0 conn(0x7fd27c15de50 legacy=0x7fd27c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd280c13700 1 -- 172.21.15.7:0/279755480 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c15b870 con 0x7fd27c0cf110 2023-10-14T19:08:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd280c13700 1 --2- 172.21.15.7:0/279755480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c0cf110 0x7fd27c15c070 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd274009e60 tx=0x7fd274009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5518d44a4dd0daec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd27affd700 1 -- 172.21.15.7:0/279755480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400e070 con 0x7fd27c0cf110 2023-10-14T19:08:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd27affd700 1 -- 172.21.15.7:0/279755480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27400bab0 con 0x7fd27c0cf110 2023-10-14T19:08:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.412+0000 7fd27affd700 1 -- 172.21.15.7:0/279755480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400be70 con 0x7fd27c0cf110 2023-10-14T19:08:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 -- 172.21.15.7:0/279755480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c0cf110 msgr2=0x7fd27c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 --2- 172.21.15.7:0/279755480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c0cf110 0x7fd27c15c070 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd274009e60 tx=0x7fd274009780 comp rx=0 tx=0).stop 2023-10-14T19:08:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 -- 172.21.15.7:0/279755480 shutdown_connections 2023-10-14T19:08:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 --2- 172.21.15.7:0/279755480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c0cf110 0x7fd27c15c070 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 --2- 172.21.15.7:0/279755480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c153c30 0x7fd27c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 -- 172.21.15.7:0/279755480 >> 172.21.15.7:0/279755480 conn(0x7fd27c0703a0 msgr2=0x7fd27c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 -- 172.21.15.7:0/279755480 shutdown_connections 2023-10-14T19:08:38.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.413+0000 7fd281414700 1 -- 172.21.15.7:0/279755480 wait complete. 2023-10-14T19:08:38.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.414+0000 7fd281414700 1 Processor -- start 2023-10-14T19:08:38.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.414+0000 7fd281414700 1 -- start start 2023-10-14T19:08:38.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c0cf110 0x7fd27c13ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 0x7fd27c0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c15de50 0x7fd27c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c13f490 con 0x7fd27c153c30 2023-10-14T19:08:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0b32d0 con 0x7fd27c15de50 2023-10-14T19:08:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0b35b0 con 0x7fd27c0cf110 2023-10-14T19:08:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 0x7fd27c0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 0x7fd27c0c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56844/0 (socket says 172.21.15.7:56844) 2023-10-14T19:08:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 -- 172.21.15.7:0/2196342479 learned_addr learned my addr 172.21.15.7:0/2196342479 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27bfff700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c0cf110 0x7fd27c13ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd280c13700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c15de50 0x7fd27c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 -- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c0cf110 msgr2=0x7fd27c13ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c0cf110 0x7fd27c13ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 -- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c15de50 msgr2=0x7fd27c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c15de50 0x7fd27c0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 -- 172.21.15.7:0/2196342479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009a20 con 0x7fd27c153c30 2023-10-14T19:08:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd280c13700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c15de50 0x7fd27c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd27b7fe700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 0x7fd27c0c5c20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c590 tx=0x7fd270007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270005b30 con 0x7fd27c153c30 2023-10-14T19:08:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270005cb0 con 0x7fd27c153c30 2023-10-14T19:08:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c0b3890 con 0x7fd27c153c30 2023-10-14T19:08:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270007320 con 0x7fd27c153c30 2023-10-14T19:08:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.415+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c0b3e50 con 0x7fd27c153c30 2023-10-14T19:08:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.416+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c04c3c0 con 0x7fd27c153c30 2023-10-14T19:08:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.417+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd27001b3b0 con 0x7fd27c153c30 2023-10-14T19:08:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.417+0000 7fd263fff700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd268067200 0x7fd2680696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.417+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd270083c40 con 0x7fd27c153c30 2023-10-14T19:08:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.417+0000 7fd27bfff700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd268067200 0x7fd2680696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.418+0000 7fd27bfff700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd268067200 0x7fd2680696b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009d40 tx=0x7fd26c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.421+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd27008a080 con 0x7fd27c153c30 2023-10-14T19:08:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.695+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7fd27c15bb50 con 0x7fd27c153c30 2023-10-14T19:08:38.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.912+0000 7fd263fff700 1 -- 172.21.15.7:0/2196342479 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v256) v1 ==== 158+0+0 (secure 0 0 0) 0x7fd270017020 con 0x7fd27c153c30 2023-10-14T19:08:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd268067200 msgr2=0x7fd2680696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd268067200 0x7fd2680696b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009d40 tx=0x7fd26c008040 comp rx=0 tx=0).stop 2023-10-14T19:08:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 msgr2=0x7fd27c0c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 0x7fd27c0c5c20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c590 tx=0x7fd270007e00 comp rx=0 tx=0).stop 2023-10-14T19:08:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 shutdown_connections 2023-10-14T19:08:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd268067200 0x7fd2680696b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c15de50 0x7fd27c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd27c0cf110 0x7fd27c13ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 --2- 172.21.15.7:0/2196342479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd27c153c30 0x7fd27c0c5c20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.914+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 >> 172.21.15.7:0/2196342479 conn(0x7fd27c0703a0 msgr2=0x7fd27c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.915+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 shutdown_connections 2023-10-14T19:08:38.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:38.915+0000 7fd281414700 1 -- 172.21.15.7:0/2196342479 wait complete. 2023-10-14T19:08:38.928 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command ... ok 2023-10-14T19:08:38.928 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command without subvolume group 2023-10-14T19:08:38.928 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:08:38.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-14T19:08:39.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.048+0000 7fc165ebd700 1 Processor -- start 2023-10-14T19:08:39.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.048+0000 7fc165ebd700 1 -- start start 2023-10-14T19:08:39.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc165ebd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 0x7fc160159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc165ebd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16015ae40 con 0x7fc16015a400 2023-10-14T19:08:39.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc165ebd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16015ab60 con 0x7fc1600cb5a0 2023-10-14T19:08:39.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc165ebd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600ce0f0 con 0x7fc1600cb970 2023-10-14T19:08:39.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc16015a400 0x7fc160156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54036/0 (socket says 172.21.15.7:54036) 2023-10-14T19:08:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15ffff700 1 -- 172.21.15.7:0/1120648639 learned_addr learned my addr 172.21.15.7:0/1120648639 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15effd700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 0x7fc160159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985764267 0 0) 0x7fc16015ae40 con 0x7fc16015a400 2023-10-14T19:08:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc148003570 con 0x7fc16015a400 2023-10-14T19:08:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3841459361 0 0) 0x7fc148003570 con 0x7fc16015a400 2023-10-14T19:08:39.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 msgr2=0x7fc160159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:39.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 0x7fc160159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 >> v1:172.21.15.148:6789/0 conn(0x7fc1600cb5a0 legacy=0x7fc1600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1600ccf00 con 0x7fc16015a400 2023-10-14T19:08:39.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fc1580017f0 con 0x7fc16015a400 2023-10-14T19:08:39.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 >> v1:172.21.15.7:6789/0 conn(0x7fc16015a400 legacy=0x7fc160156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.049+0000 7fc15e7fc700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 0x7fc148003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148003fd0 0x7fc148004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148004d50 0x7fc1480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600ce0f0 con 0x7fc148003fd0 2023-10-14T19:08:39.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14800bb40 con 0x7fc148004d50 2023-10-14T19:08:39.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14800bd00 con 0x7fc1600cb970 2023-10-14T19:08:39.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148003fd0 0x7fc148004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15f7fe700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 0x7fc148003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15ffff700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148004d50 0x7fc1480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 -- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 msgr2=0x7fc148003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:39.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1600cb970 0x7fc148003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 -- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148004d50 msgr2=0x7fc1480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:39.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148004d50 0x7fc1480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 -- 172.21.15.7:0/1120648639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148003570 con 0x7fc148003fd0 2023-10-14T19:08:39.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15effd700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148003fd0 0x7fc148004810 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc154009c00 tx=0x7fc1540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16afd3d58839d523 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:39.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e710 con 0x7fc148003fd0 2023-10-14T19:08:39.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400e870 con 0x7fc148003fd0 2023-10-14T19:08:39.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.050+0000 7fc15e7fc700 1 -- 172.21.15.7:0/1120648639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400ec30 con 0x7fc148003fd0 2023-10-14T19:08:39.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc165ebd700 1 -- 172.21.15.7:0/1120648639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148003fd0 msgr2=0x7fc148004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc165ebd700 1 --2- 172.21.15.7:0/1120648639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148003fd0 0x7fc148004810 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc154009c00 tx=0x7fc1540091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc15ffff700 1 -- 172.21.15.7:0/1120648639 reap_dead start 2023-10-14T19:08:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc165ebd700 1 -- 172.21.15.7:0/1120648639 shutdown_connections 2023-10-14T19:08:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc165ebd700 1 -- 172.21.15.7:0/1120648639 >> 172.21.15.7:0/1120648639 conn(0x7fc160070e30 msgr2=0x7fc1600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc165ebd700 1 -- 172.21.15.7:0/1120648639 shutdown_connections 2023-10-14T19:08:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.051+0000 7fc165ebd700 1 -- 172.21.15.7:0/1120648639 wait complete. 2023-10-14T19:08:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.052+0000 7fc165ebd700 1 Processor -- start 2023-10-14T19:08:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.052+0000 7fc165ebd700 1 -- start start 2023-10-14T19:08:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc165ebd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148003fd0 0x7fc16015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc165ebd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 0x7fc1600b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc165ebd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc160153510 0x7fc1600b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc165ebd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600cbde0 con 0x7fc1601530a0 2023-10-14T19:08:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc165ebd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16015bfc0 con 0x7fc148003fd0 2023-10-14T19:08:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc165ebd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16015cb20 con 0x7fc160153510 2023-10-14T19:08:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 0x7fc1600b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 0x7fc1600b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56860/0 (socket says 172.21.15.7:56860) 2023-10-14T19:08:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 -- 172.21.15.7:0/2541364706 learned_addr learned my addr 172.21.15.7:0/2541364706 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15ffff700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc160153510 0x7fc1600b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15f7fe700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148003fd0 0x7fc16015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 -- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc160153510 msgr2=0x7fc1600b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc160153510 0x7fc1600b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 -- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148003fd0 msgr2=0x7fc16015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148003fd0 0x7fc16015ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 -- 172.21.15.7:0/2541364706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1600c8180 con 0x7fc1601530a0 2023-10-14T19:08:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15f7fe700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148003fd0 0x7fc16015ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:39.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15ffff700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc160153510 0x7fc1600b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:39.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc15effd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 0x7fc1600b4ee0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc14800bb10 tx=0x7fc15401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154022070 con 0x7fc1601530a0 2023-10-14T19:08:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.053+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400ebf0 con 0x7fc1601530a0 2023-10-14T19:08:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.054+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15401c6a0 con 0x7fc1601530a0 2023-10-14T19:08:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.054+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16015c580 con 0x7fc1601530a0 2023-10-14T19:08:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.054+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1600c79e0 con 0x7fc1601530a0 2023-10-14T19:08:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.054+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16004c3c0 con 0x7fc1601530a0 2023-10-14T19:08:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.055+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc15401ca50 con 0x7fc1601530a0 2023-10-14T19:08:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.055+0000 7fc1477fe700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc14c067200 0x7fc14c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.055+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc154085fd0 con 0x7fc1601530a0 2023-10-14T19:08:39.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.056+0000 7fc15f7fe700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc14c067200 0x7fc14c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:39.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.056+0000 7fc15f7fe700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc14c067200 0x7fc14c0696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc150000f60 tx=0x7fc150009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:39.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.059+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1540b75a0 con 0x7fc1601530a0 2023-10-14T19:08:39.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.334+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7fc16015c8e0 con 0x7fc1601530a0 2023-10-14T19:08:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.916+0000 7fc1477fe700 1 -- 172.21.15.7:0/2541364706 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v257) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc154056c80 con 0x7fc1601530a0 2023-10-14T19:08:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc14c067200 msgr2=0x7fc14c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc14c067200 0x7fc14c0696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc150000f60 tx=0x7fc150009040 comp rx=0 tx=0).stop 2023-10-14T19:08:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 msgr2=0x7fc1600b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 0x7fc1600b4ee0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc14800bb10 tx=0x7fc15401a000 comp rx=0 tx=0).stop 2023-10-14T19:08:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 shutdown_connections 2023-10-14T19:08:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc14c067200 0x7fc14c0696b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc148003fd0 0x7fc16015ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc160153510 0x7fc1600b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 --2- 172.21.15.7:0/2541364706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1601530a0 0x7fc1600b4ee0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 >> 172.21.15.7:0/2541364706 conn(0x7fc160070e30 msgr2=0x7fc1600cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 shutdown_connections 2023-10-14T19:08:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:39.919+0000 7fc165ebd700 1 -- 172.21.15.7:0/2541364706 wait complete. 2023-10-14T19:08:39.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:08:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.059+0000 7fa8f9f71700 1 Processor -- start 2023-10-14T19:08:40.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.059+0000 7fa8f9f71700 1 -- start start 2023-10-14T19:08:40.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f9f71700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa8f4159860 0x7fa8f40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f9f71700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8f40ccfa0 0x7fa8f40cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f9f71700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40cf510 con 0x7fa8f40cbd90 2023-10-14T19:08:40.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f9f71700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40d00b0 con 0x7fa8f4159860 2023-10-14T19:08:40.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f9f71700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40cc210 con 0x7fa8f40ccfa0 2023-10-14T19:08:40.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa8f4159860 0x7fa8f40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa8f40cbd90 0x7fa8f40cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54046/0 (socket says 172.21.15.7:54046) 2023-10-14T19:08:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f2ffd700 1 -- 172.21.15.7:0/669302288 learned_addr learned my addr 172.21.15.7:0/669302288 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.060+0000 7fa8f37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa8f4159860 0x7fa8f40ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56874/0 (socket says 172.21.15.7:56874) 2023-10-14T19:08:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f3fff700 1 --2- 172.21.15.7:0/669302288 >> v2:172.21.15.148:3300/0 conn(0x7fa8f40ccfa0 0x7fa8f40cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f37fe700 1 -- 172.21.15.7:0/669302288 >> v2:172.21.15.148:3300/0 conn(0x7fa8f40ccfa0 msgr2=0x7fa8f40cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f37fe700 1 --2- 172.21.15.7:0/669302288 >> v2:172.21.15.148:3300/0 conn(0x7fa8f40ccfa0 0x7fa8f40cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f37fe700 1 -- 172.21.15.7:0/669302288 >> v1:172.21.15.7:6789/0 conn(0x7fa8f40cbd90 legacy=0x7fa8f40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f37fe700 1 -- 172.21.15.7:0/669302288 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40ce900 con 0x7fa8f4159860 2023-10-14T19:08:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f3fff700 1 --2- 172.21.15.7:0/669302288 >> v2:172.21.15.148:3300/0 conn(0x7fa8f40ccfa0 0x7fa8f40cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f37fe700 1 --2- 172.21.15.7:0/669302288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f40ce220 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4088690 tx=0x7fa8e4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf80a755d0d4c632 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f27fc700 1 -- 172.21.15.7:0/669302288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4005c10 con 0x7fa8f4159860 2023-10-14T19:08:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f27fc700 1 -- 172.21.15.7:0/669302288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4005d70 con 0x7fa8f4159860 2023-10-14T19:08:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.061+0000 7fa8f27fc700 1 -- 172.21.15.7:0/669302288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4006260 con 0x7fa8f4159860 2023-10-14T19:08:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 -- 172.21.15.7:0/669302288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 msgr2=0x7fa8f40ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/669302288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f40ce220 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4088690 tx=0x7fa8e4009120 comp rx=0 tx=0).stop 2023-10-14T19:08:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 -- 172.21.15.7:0/669302288 shutdown_connections 2023-10-14T19:08:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/669302288 >> v2:172.21.15.148:3300/0 conn(0x7fa8f40ccfa0 0x7fa8f40cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/669302288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f40ce220 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 -- 172.21.15.7:0/669302288 >> 172.21.15.7:0/669302288 conn(0x7fa8f40999b0 msgr2=0x7fa8f4070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 -- 172.21.15.7:0/669302288 shutdown_connections 2023-10-14T19:08:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.062+0000 7fa8f9f71700 1 -- 172.21.15.7:0/669302288 wait complete. 2023-10-14T19:08:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.063+0000 7fa8f9f71700 1 Processor -- start 2023-10-14T19:08:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.063+0000 7fa8f9f71700 1 -- start start 2023-10-14T19:08:40.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8f40cbd90 0x7fa8f40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8f40ccfa0 0x7fa8f415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f4157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f415c7e0 con 0x7fa8f4159860 2023-10-14T19:08:40.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40c8a10 con 0x7fa8f40cbd90 2023-10-14T19:08:40.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40c7e00 con 0x7fa8f40ccfa0 2023-10-14T19:08:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f4157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f4157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56882/0 (socket says 172.21.15.7:56882) 2023-10-14T19:08:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 -- 172.21.15.7:0/4092823779 learned_addr learned my addr 172.21.15.7:0/4092823779 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f37fe700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8f40cbd90 0x7fa8f40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f2ffd700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8f40ccfa0 0x7fa8f415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 -- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8f40ccfa0 msgr2=0x7fa8f415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8f40ccfa0 0x7fa8f415c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 -- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8f40cbd90 msgr2=0x7fa8f40c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8f40cbd90 0x7fa8f40c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 -- 172.21.15.7:0/4092823779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40093c0 con 0x7fa8f4159860 2023-10-14T19:08:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f2ffd700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8f40ccfa0 0x7fa8f415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f3fff700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f4157c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00a380 tx=0x7fa8ec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00ae10 con 0x7fa8f4159860 2023-10-14T19:08:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec00d650 con 0x7fa8f4159860 2023-10-14T19:08:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40c80e0 con 0x7fa8f4159860 2023-10-14T19:08:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.064+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00da10 con 0x7fa8f4159860 2023-10-14T19:08:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.065+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f40c86a0 con 0x7fa8f4159860 2023-10-14T19:08:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.066+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f404c3c0 con 0x7fa8f4159860 2023-10-14T19:08:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.066+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa8ec01e3b0 con 0x7fa8f4159860 2023-10-14T19:08:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.066+0000 7fa8db7fe700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8e0067200 0x7fa8e00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.067+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa8ec0850d0 con 0x7fa8f4159860 2023-10-14T19:08:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.067+0000 7fa8f37fe700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8e0067200 0x7fa8e00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.067+0000 7fa8f37fe700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8e0067200 0x7fa8e00696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009160 tx=0x7fa8e4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.071+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8ec0522f0 con 0x7fa8f4159860 2023-10-14T19:08:40.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.265+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa8f40cebe0 con 0x7fa8f4159860 2023-10-14T19:08:40.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.268+0000 7fa8db7fe700 1 -- 172.21.15.7:0/4092823779 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8ec055910 con 0x7fa8f4159860 2023-10-14T19:08:40.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8e0067200 msgr2=0x7fa8e00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8e0067200 0x7fa8e00696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009160 tx=0x7fa8e4016000 comp rx=0 tx=0).stop 2023-10-14T19:08:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 msgr2=0x7fa8f4157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f4157c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00a380 tx=0x7fa8ec007900 comp rx=0 tx=0).stop 2023-10-14T19:08:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 shutdown_connections 2023-10-14T19:08:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8e0067200 0x7fa8e00696b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8f40cbd90 0x7fa8f40c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8f4159860 0x7fa8f4157c50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 --2- 172.21.15.7:0/4092823779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8f40ccfa0 0x7fa8f415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 >> 172.21.15.7:0/4092823779 conn(0x7fa8f40999b0 msgr2=0x7fa8f40b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:40.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 shutdown_connections 2023-10-14T19:08:40.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.270+0000 7fa8f9f71700 1 -- 172.21.15.7:0/4092823779 wait complete. 2023-10-14T19:08:40.283 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:08:40.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:40.328 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:40.368 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:08:40.369 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:08:40.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:40.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.488+0000 7fb3c88a1700 1 Processor -- start 2023-10-14T19:08:40.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.488+0000 7fb3c88a1700 1 -- start start 2023-10-14T19:08:40.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c88a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40cb5a0 0x7fb3c40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c88a1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3c40cd9e0 0x7fb3c4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c88a1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3c40cde50 0x7fb3c415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c88a1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40d13f0 con 0x7fb3c40cd9e0 2023-10-14T19:08:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c88a1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c415a940 con 0x7fb3c40cde50 2023-10-14T19:08:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c88a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c415ae40 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c1d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3c40cd9e0 0x7fb3c4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c1d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3c40cd9e0 0x7fb3c4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56886/0 (socket says 172.21.15.7:56886) 2023-10-14T19:08:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c1d9b700 1 -- 172.21.15.7:0/2657032906 learned_addr learned my addr 172.21.15.7:0/2657032906 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c2d9d700 1 --2- 172.21.15.7:0/2657032906 >> v2:172.21.15.148:3300/0 conn(0x7fb3c40cde50 0x7fb3c415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.489+0000 7fb3c259c700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40cb5a0 0x7fb3c40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c1d9b700 1 -- 172.21.15.7:0/2657032906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40cb5a0 msgr2=0x7fb3c40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c1d9b700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40cb5a0 0x7fb3c40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c1d9b700 1 -- 172.21.15.7:0/2657032906 >> v2:172.21.15.148:3300/0 conn(0x7fb3c40cde50 msgr2=0x7fb3c415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:40.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c1d9b700 1 --2- 172.21.15.7:0/2657032906 >> v2:172.21.15.148:3300/0 conn(0x7fb3c40cde50 0x7fb3c415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c1d9b700 1 -- 172.21.15.7:0/2657032906 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c415ab60 con 0x7fb3c40cd9e0 2023-10-14T19:08:40.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c259c700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40cb5a0 0x7fb3c40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:40.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c1d9b700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c4159ec0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40cbeb0 tx=0x7fb3b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f516691f506270b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c159a700 1 -- 172.21.15.7:0/2657032906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8009ea0 con 0x7fb3c40cd9e0 2023-10-14T19:08:40.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c159a700 1 -- 172.21.15.7:0/2657032906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800b820 con 0x7fb3c40cd9e0 2023-10-14T19:08:40.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c159a700 1 -- 172.21.15.7:0/2657032906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800bbc0 con 0x7fb3c40cd9e0 2023-10-14T19:08:40.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c88a1700 1 -- 172.21.15.7:0/2657032906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cd9e0 msgr2=0x7fb3c4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.490+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c4159ec0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40cbeb0 tx=0x7fb3b8009250 comp rx=0 tx=0).stop 2023-10-14T19:08:40.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 -- 172.21.15.7:0/2657032906 shutdown_connections 2023-10-14T19:08:40.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/2657032906 >> v2:172.21.15.148:3300/0 conn(0x7fb3c40cde50 0x7fb3c415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40cb5a0 0x7fb3c40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/2657032906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c4159ec0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 -- 172.21.15.7:0/2657032906 >> 172.21.15.7:0/2657032906 conn(0x7fb3c4070e30 msgr2=0x7fb3c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:40.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 -- 172.21.15.7:0/2657032906 shutdown_connections 2023-10-14T19:08:40.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.491+0000 7fb3c88a1700 1 -- 172.21.15.7:0/2657032906 wait complete. 2023-10-14T19:08:40.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 Processor -- start 2023-10-14T19:08:40.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 -- start start 2023-10-14T19:08:40.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 0x7fb3c41450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c40ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40b5630 0x7fb3c416a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40b4590 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40b4870 con 0x7fb3c40cd9e0 2023-10-14T19:08:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.492+0000 7fb3c88a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40b4b50 con 0x7fb3c40b5630 2023-10-14T19:08:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 0x7fb3c41450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 0x7fb3c41450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56890/0 (socket says 172.21.15.7:56890) 2023-10-14T19:08:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 -- 172.21.15.7:0/1999844749 learned_addr learned my addr 172.21.15.7:0/1999844749 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c1d9b700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c40ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c2d9d700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40b5630 0x7fb3c416a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 -- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40b5630 msgr2=0x7fb3c416a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40b5630 0x7fb3c416a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 -- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3c40cd9e0 msgr2=0x7fb3c40ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c40ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 -- 172.21.15.7:0/1999844749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80094f0 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c259c700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 0x7fb3c41450f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400e8d0 tx=0x7fb3b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4013410 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4013570 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40b4e30 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4013910 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.493+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c4145630 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.494+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c404c3c0 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.495+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb3b4013d00 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.495+0000 7fb3b27fc700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb3a4067200 0x7fb3a40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.495+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb3b40844d0 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.495+0000 7fb3c1d9b700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb3a4067200 0x7fb3a40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.496+0000 7fb3c1d9b700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb3a4067200 0x7fb3a40696b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40cbeb0 tx=0x7fb3b8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.499+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3b4055070 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.735+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3c40ccf00 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.736+0000 7fb3b27fc700 1 -- 172.21.15.7:0/1999844749 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fb3b4020de0 con 0x7fb3c40cb5a0 2023-10-14T19:08:40.737 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:40.738 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/255267801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":255267801},{"type":"v1","addr":"172.21.15.7:6835","nonce":255267801}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4200692380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4200692380},{"type":"v1","addr":"172.21.15.148:6837","nonce":4200692380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5821,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/4004789085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4004789085},{"type":"v1","addr":"172.21.15.148:6836","nonce":4004789085}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1736945939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1736945939},{"type":"v1","addr":"172.21.15.7:6834","nonce":1736945939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-10-14T19:08:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb3a4067200 msgr2=0x7fb3a40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb3a4067200 0x7fb3a40696b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40cbeb0 tx=0x7fb3b8017000 comp rx=0 tx=0).stop 2023-10-14T19:08:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 msgr2=0x7fb3c41450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 0x7fb3c41450f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400e8d0 tx=0x7fb3b4008040 comp rx=0 tx=0).stop 2023-10-14T19:08:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 shutdown_connections 2023-10-14T19:08:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb3a4067200 0x7fb3a40696b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3c40b5630 0x7fb3c416a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3c40cb5a0 0x7fb3c41450f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 --2- 172.21.15.7:0/1999844749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3c40cd9e0 0x7fb3c40ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 >> 172.21.15.7:0/1999844749 conn(0x7fb3c4070e30 msgr2=0x7fb3c40d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 shutdown_connections 2023-10-14T19:08:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.738+0000 7fb3c88a1700 1 -- 172.21.15.7:0/1999844749 wait complete. 2023-10-14T19:08:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 51 2023-10-14T19:08:40.751 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:08:40.751 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:08:40.752 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:08:40.752 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:40.752 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:08:40.753 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:08:40.753 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:08:40.753 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:40.754 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:08:40.754 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:08:40.754 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:08:40.755 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:40.755 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:08:40.755 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:08:40.756 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:08:40.757 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:08:40.760 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:08:40.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:08:40.762 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:08:40.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:08:40.765 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:08:40.765 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:08:40.766 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:08:40.767 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:08:40.803 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:08:40.804 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:40.805 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:08:40.805 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:40.808 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:08:40.809 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:40.810 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:08:40.810 DEBUG:teuthology.parallel:result is None 2023-10-14T19:08:40.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:08:40.878 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:08:40.879 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:08:40.891 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:08:40.891 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:08:40.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.938+0000 7ff1a4866700 1 Processor -- start 2023-10-14T19:08:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.938+0000 7ff1a4866700 1 -- start start 2023-10-14T19:08:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff1a4866700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1a0153c30 0x7ff1a015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff1a4866700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff1a4866700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a015afd0 con 0x7ff1a00cef40 2023-10-14T19:08:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff1a4866700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a015b2b0 con 0x7ff1a0153c30 2023-10-14T19:08:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff1a4866700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a015b590 con 0x7ff1a015de50 2023-10-14T19:08:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff19f59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff1a00cef40 0x7ff1a006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54070/0 (socket says 172.21.15.7:54070) 2023-10-14T19:08:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff19f59e700 1 -- 172.21.15.7:0/1080257359 learned_addr learned my addr 172.21.15.7:0/1080257359 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff19ed9d700 1 --2- 172.21.15.7:0/1080257359 >> v2:172.21.15.148:3300/0 conn(0x7ff1a0153c30 0x7ff1a015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.939+0000 7ff19e59c700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19dd9b700 1 -- 172.21.15.7:0/1080257359 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77351229 0 0) 0x7ff1a015afd0 con 0x7ff1a00cef40 2023-10-14T19:08:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19dd9b700 1 -- 172.21.15.7:0/1080257359 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff188003570 con 0x7ff1a00cef40 2023-10-14T19:08:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19ed9d700 1 -- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 msgr2=0x7ff1a00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19ed9d700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19ed9d700 1 -- 172.21.15.7:0/1080257359 >> v1:172.21.15.7:6789/0 conn(0x7ff1a00cef40 legacy=0x7ff1a006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19ed9d700 1 -- 172.21.15.7:0/1080257359 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a015b870 con 0x7ff1a0153c30 2023-10-14T19:08:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19e59c700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19ed9d700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a015a5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff1900098e0 tx=0x7ff1900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45858c206f5070ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19dd9b700 1 -- 172.21.15.7:0/1080257359 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011630 con 0x7ff1a0153c30 2023-10-14T19:08:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19dd9b700 1 -- 172.21.15.7:0/1080257359 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190011790 con 0x7ff1a0153c30 2023-10-14T19:08:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.940+0000 7ff19dd9b700 1 -- 172.21.15.7:0/1080257359 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011b30 con 0x7ff1a0153c30 2023-10-14T19:08:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 msgr2=0x7ff1a015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a015a5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff1900098e0 tx=0x7ff1900091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/1080257359 shutdown_connections 2023-10-14T19:08:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a015a5e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/1080257359 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/1080257359 >> 172.21.15.7:0/1080257359 conn(0x7ff1a00703a0 msgr2=0x7ff1a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/1080257359 shutdown_connections 2023-10-14T19:08:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/1080257359 wait complete. 2023-10-14T19:08:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.942+0000 7ff1a4866700 1 Processor -- start 2023-10-14T19:08:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.942+0000 7ff1a4866700 1 -- start start 2023-10-14T19:08:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff1a4866700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 0x7ff1a0169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff1a4866700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff1a4866700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff1a4866700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00c8650 con 0x7ff1a00cef40 2023-10-14T19:08:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff1a4866700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00c8040 con 0x7ff1a0153c30 2023-10-14T19:08:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff1a4866700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00b3d70 con 0x7ff1a015de50 2023-10-14T19:08:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 0x7ff1a0169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 0x7ff1a0169860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56920/0 (socket says 172.21.15.7:56920) 2023-10-14T19:08:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 -- 172.21.15.7:0/621782494 learned_addr learned my addr 172.21.15.7:0/621782494 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19f59e700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19e59c700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 -- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 msgr2=0x7ff1a00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 -- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 msgr2=0x7ff1a0151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a0151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 -- 172.21.15.7:0/621782494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194009420 con 0x7ff1a00cef40 2023-10-14T19:08:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19f59e700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19e59c700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.943+0000 7ff19ed9d700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 0x7ff1a0169860 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff1a006eb00 tx=0x7ff190017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.944+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011b10 con 0x7ff1a00cef40 2023-10-14T19:08:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.944+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1900253f0 con 0x7ff1a00cef40 2023-10-14T19:08:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.944+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff190009420 con 0x7ff1a00cef40 2023-10-14T19:08:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.944+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190025790 con 0x7ff1a00cef40 2023-10-14T19:08:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.944+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a00b4050 con 0x7ff1a00cef40 2023-10-14T19:08:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.945+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a004c3c0 con 0x7ff1a00cef40 2023-10-14T19:08:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.945+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ff190025b80 con 0x7ff1a00cef40 2023-10-14T19:08:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.946+0000 7ff186ffd700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff18c067200 0x7ff18c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.946+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff190085f40 con 0x7ff1a00cef40 2023-10-14T19:08:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.946+0000 7ff19e59c700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff18c067200 0x7ff18c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.946+0000 7ff19e59c700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff18c067200 0x7ff18c0696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff1940093f0 tx=0x7ff194008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:40.950+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff190053160 con 0x7ff1a00cef40 2023-10-14T19:08:41.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.160+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff1a00caef0 con 0x7ff1a00cef40 2023-10-14T19:08:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.938+0000 7ff186ffd700 1 -- 172.21.15.7:0/621782494 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff190056780 con 0x7ff1a00cef40 2023-10-14T19:08:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff18c067200 msgr2=0x7ff18c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff18c067200 0x7ff18c0696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff1940093f0 tx=0x7ff194008040 comp rx=0 tx=0).stop 2023-10-14T19:08:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 msgr2=0x7ff1a0169860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 0x7ff1a0169860 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff1a006eb00 tx=0x7ff190017000 comp rx=0 tx=0).stop 2023-10-14T19:08:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 shutdown_connections 2023-10-14T19:08:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff18c067200 0x7ff18c0696b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1a015de50 0x7ff1a00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a00cef40 0x7ff1a0169860 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 --2- 172.21.15.7:0/621782494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1a0153c30 0x7ff1a0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 >> 172.21.15.7:0/621782494 conn(0x7ff1a00703a0 msgr2=0x7ff1a00c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 shutdown_connections 2023-10-14T19:08:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:41.941+0000 7ff1a4866700 1 -- 172.21.15.7:0/621782494 wait complete. 2023-10-14T19:08:41.945 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:08:41.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:08:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.083+0000 7f4f2c894700 1 Processor -- start 2023-10-14T19:08:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.083+0000 7f4f2c894700 1 -- start start 2023-10-14T19:08:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f2c894700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f280a8be0 0x7f4f280a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f2c894700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f280aee90 0x7f4f280b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f2c894700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280ce1a0 con 0x7f4f2806d280 2023-10-14T19:08:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f2c894700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280cd5d0 con 0x7f4f280aee90 2023-10-14T19:08:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f2c894700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280cd870 con 0x7f4f280a8be0 2023-10-14T19:08:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f280aee90 0x7f4f280b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f280aee90 0x7f4f280b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56932/0 (socket says 172.21.15.7:56932) 2023-10-14T19:08:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 -- 172.21.15.7:0/1420137077 learned_addr learned my addr 172.21.15.7:0/1420137077 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f2659c700 1 --2- 172.21.15.7:0/1420137077 >> v2:172.21.15.148:3300/0 conn(0x7f4f280a8be0 0x7f4f280a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 -- 172.21.15.7:0/1420137077 >> v2:172.21.15.148:3300/0 conn(0x7f4f280a8be0 msgr2=0x7f4f280a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 --2- 172.21.15.7:0/1420137077 >> v2:172.21.15.148:3300/0 conn(0x7f4f280a8be0 0x7f4f280a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 -- 172.21.15.7:0/1420137077 >> v1:172.21.15.148:6789/0 conn(0x7f4f2806d280 legacy=0x7f4f280ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.084+0000 7f4f26d9d700 1 -- 172.21.15.7:0/1420137077 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280cdb50 con 0x7f4f280aee90 2023-10-14T19:08:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f26d9d700 1 --2- 172.21.15.7:0/1420137077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f280b08c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4f2806a9e0 tx=0x7f4f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77042a7d08f40175 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2559a700 1 -- 172.21.15.7:0/1420137077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000b8b0 con 0x7f4f280aee90 2023-10-14T19:08:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2559a700 1 -- 172.21.15.7:0/1420137077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000ba10 con 0x7f4f280aee90 2023-10-14T19:08:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2559a700 1 -- 172.21.15.7:0/1420137077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000bdb0 con 0x7f4f280aee90 2023-10-14T19:08:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 -- 172.21.15.7:0/1420137077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 msgr2=0x7f4f280b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 --2- 172.21.15.7:0/1420137077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f280b08c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4f2806a9e0 tx=0x7f4f20009250 comp rx=0 tx=0).stop 2023-10-14T19:08:42.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 -- 172.21.15.7:0/1420137077 shutdown_connections 2023-10-14T19:08:42.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 --2- 172.21.15.7:0/1420137077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f280b08c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 --2- 172.21.15.7:0/1420137077 >> v2:172.21.15.148:3300/0 conn(0x7f4f280a8be0 0x7f4f280a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 -- 172.21.15.7:0/1420137077 >> 172.21.15.7:0/1420137077 conn(0x7f4f2806ce80 msgr2=0x7f4f280ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 -- 172.21.15.7:0/1420137077 shutdown_connections 2023-10-14T19:08:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.085+0000 7f4f2c894700 1 -- 172.21.15.7:0/1420137077 wait complete. 2023-10-14T19:08:42.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.086+0000 7f4f2c894700 1 Processor -- start 2023-10-14T19:08:42.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 -- start start 2023-10-14T19:08:42.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f2806d280 0x7f4f28156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f280a8be0 0x7f4f280aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f2809a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280a9ee0 con 0x7f4f280aee90 2023-10-14T19:08:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280a8ff0 con 0x7f4f280a8be0 2023-10-14T19:08:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2c894700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280a92d0 con 0x7f4f2806d280 2023-10-14T19:08:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f26d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f2809a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f26d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f2809a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56934/0 (socket says 172.21.15.7:56934) 2023-10-14T19:08:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f26d9d700 1 -- 172.21.15.7:0/2349488382 learned_addr learned my addr 172.21.15.7:0/2349488382 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f2659c700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f2806d280 0x7f4f28156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.087+0000 7f4f25d9b700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f280a8be0 0x7f4f280aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f26d9d700 1 -- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f2806d280 msgr2=0x7f4f28156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f26d9d700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f2806d280 0x7f4f28156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f26d9d700 1 -- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f280a8be0 msgr2=0x7f4f280aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f26d9d700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f280a8be0 0x7f4f280aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f26d9d700 1 -- 172.21.15.7:0/2349488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200094f0 con 0x7f4f280aee90 2023-10-14T19:08:42.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f2659c700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f2806d280 0x7f4f28156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:42.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f25d9b700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f280a8be0 0x7f4f280aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:42.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f26d9d700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f2809a6c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009290 tx=0x7f4f20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001b520 con 0x7f4f280aee90 2023-10-14T19:08:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20020070 con 0x7f4f280aee90 2023-10-14T19:08:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f280a95b0 con 0x7f4f280aee90 2023-10-14T19:08:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001b8d0 con 0x7f4f280aee90 2023-10-14T19:08:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.088+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280a9b70 con 0x7f4f280aee90 2023-10-14T19:08:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.089+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280aa050 con 0x7f4f280aee90 2023-10-14T19:08:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.089+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4f20022030 con 0x7f4f280aee90 2023-10-14T19:08:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.090+0000 7f4f1e7fc700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4f08067200 0x7f4f080696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.090+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4f20086810 con 0x7f4f280aee90 2023-10-14T19:08:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.090+0000 7f4f2659c700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4f08067200 0x7f4f080696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.091+0000 7f4f2659c700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4f08067200 0x7f4f080696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f18007620 tx=0x7f4f18009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.094+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f20053a80 con 0x7f4f280aee90 2023-10-14T19:08:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.365+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f280aa020 con 0x7f4f280aee90 2023-10-14T19:08:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.365+0000 7f4f1e7fc700 1 -- 172.21.15.7:0/2349488382 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4f200570a0 con 0x7f4f280aee90 2023-10-14T19:08:42.367 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:42.367 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:42.367 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:08:42.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.367 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:08:42.368 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:08:42.368 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.368 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.368 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:42.368 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:08:42.370 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:08:42.370 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.370 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.370 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:42.370 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:42.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.371 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:08:42.372 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:08:42.372 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.372 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.372 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:42.372 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:42.373 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.373 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:08:42.373 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:08:42.374 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.374 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.374 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:42.374 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:42.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.375 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.375 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:08:42.375 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:08:42.376 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.376 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.376 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.377 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:08:42.377 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:08:42.377 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.378 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.378 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.378 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.378 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.379 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:08:42.379 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:08:42.379 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.380 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.380 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.380 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.380 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.381 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:08:42.381 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:08:42.381 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.381 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.382 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.382 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.383 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:08:42.383 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:08:42.383 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.383 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.383 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.383 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.384 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:08:42.384 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:08:42.385 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.385 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.385 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.385 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.386 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:08:42.386 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:08:42.386 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.387 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.387 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.387 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.387 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.388 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:08:42.388 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:08:42.388 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.388 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:08:42.389 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:08:42.389 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.390 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:08:42.390 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:08:42.390 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.390 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.390 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:08:42.391 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:08:42.391 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.391 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:08:42.391 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:08:42.392 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.392 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.392 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:08:42.392 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:08:42.392 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:08:42.393 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.393 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:08:42.393 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:08:42.394 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.394 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.394 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:08:42.394 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:08:42.394 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:08:42.395 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.395 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:08:42.395 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:08:42.395 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.396 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:08:42.396 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:08:42.396 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:08:42.396 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:08:42.396 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.397 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:08:42.397 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:08:42.397 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.398 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:08:42.398 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:08:42.398 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:08:42.398 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.398 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.399 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:08:42.399 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:08:42.399 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.400 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:08:42.400 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:08:42.400 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.400 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:08:42.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:42.401 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:08:42.401 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:08:42.401 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:08:42.401 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:08:42.401 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:08:42.402 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:08:42.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:42.402 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:08:42.402 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4f08067200 msgr2=0x7f4f080696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4f08067200 0x7f4f080696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f18007620 tx=0x7f4f18009830 comp rx=0 tx=0).stop 2023-10-14T19:08:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 msgr2=0x7f4f2809a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f2809a6c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009290 tx=0x7f4f20016000 comp rx=0 tx=0).stop 2023-10-14T19:08:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 shutdown_connections 2023-10-14T19:08:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4f08067200 0x7f4f080696b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f280aee90 0x7f4f2809a6c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f2806d280 0x7f4f28156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 --2- 172.21.15.7:0/2349488382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f280a8be0 0x7f4f280aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.367+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 >> 172.21.15.7:0/2349488382 conn(0x7f4f2806ce80 msgr2=0x7f4f280b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.368+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 shutdown_connections 2023-10-14T19:08:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.368+0000 7f4f2c894700 1 -- 172.21.15.7:0/2349488382 wait complete. 2023-10-14T19:08:42.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:42.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.529+0000 7f9d1e624700 1 Processor -- start 2023-10-14T19:08:42.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.529+0000 7f9d1e624700 1 -- start start 2023-10-14T19:08:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1e624700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d180cf110 0x7f9d18164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1e624700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1815afd0 con 0x7f9d18153c30 2023-10-14T19:08:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1e624700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1815b2b0 con 0x7f9d1815de50 2023-10-14T19:08:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1e624700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1815b590 con 0x7f9d180cf110 2023-10-14T19:08:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1de23700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d180cf110 0x7f9d18164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1d622700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9d18153c30 0x7f9d1815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54072/0 (socket says 172.21.15.7:54072) 2023-10-14T19:08:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.530+0000 7f9d1d622700 1 -- 172.21.15.7:0/963164929 learned_addr learned my addr 172.21.15.7:0/963164929 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1de23700 1 -- 172.21.15.7:0/963164929 >> v1:172.21.15.148:6789/0 conn(0x7f9d1815de50 legacy=0x7f9d180cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1de23700 1 -- 172.21.15.7:0/963164929 >> v1:172.21.15.7:6789/0 conn(0x7f9d18153c30 legacy=0x7f9d1815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1de23700 1 -- 172.21.15.7:0/963164929 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1815b870 con 0x7f9d180cf110 2023-10-14T19:08:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d17fff700 1 -- 172.21.15.7:0/963164929 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263369088 0 0) 0x7f9d1815afd0 con 0x7f9d18153c30 2023-10-14T19:08:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1de23700 1 --2- 172.21.15.7:0/963164929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18164600 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098e0 tx=0x7f9d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466a12e8a257bf88 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d17fff700 1 -- 172.21.15.7:0/963164929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08009e80 con 0x7f9d180cf110 2023-10-14T19:08:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d17fff700 1 -- 172.21.15.7:0/963164929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0800b820 con 0x7f9d180cf110 2023-10-14T19:08:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d17fff700 1 -- 172.21.15.7:0/963164929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800bba0 con 0x7f9d180cf110 2023-10-14T19:08:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1e624700 1 -- 172.21.15.7:0/963164929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 msgr2=0x7f9d18164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1e624700 1 --2- 172.21.15.7:0/963164929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18164600 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098e0 tx=0x7f9d080091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1e624700 1 -- 172.21.15.7:0/963164929 shutdown_connections 2023-10-14T19:08:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1e624700 1 --2- 172.21.15.7:0/963164929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18164600 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1e624700 1 -- 172.21.15.7:0/963164929 >> 172.21.15.7:0/963164929 conn(0x7f9d180703a0 msgr2=0x7f9d180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:42.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.531+0000 7f9d1e624700 1 -- 172.21.15.7:0/963164929 shutdown_connections 2023-10-14T19:08:42.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.532+0000 7f9d1e624700 1 -- 172.21.15.7:0/963164929 wait complete. 2023-10-14T19:08:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 Processor -- start 2023-10-14T19:08:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 -- start start 2023-10-14T19:08:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d18153c30 0x7f9d180b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1815de50 0x7f9d180b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180c8f20 con 0x7f9d180cf110 2023-10-14T19:08:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180c8310 con 0x7f9d1815de50 2023-10-14T19:08:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.533+0000 7f9d1e624700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180c85f0 con 0x7f9d18153c30 2023-10-14T19:08:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56962/0 (socket says 172.21.15.7:56962) 2023-10-14T19:08:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 -- 172.21.15.7:0/2560536589 learned_addr learned my addr 172.21.15.7:0/2560536589 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 -- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d18153c30 msgr2=0x7f9d180b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d18153c30 0x7f9d180b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 -- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1815de50 msgr2=0x7f9d180b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1de23700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1815de50 0x7f9d180b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1815de50 0x7f9d180b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 -- 172.21.15.7:0/2560536589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009420 con 0x7f9d180cf110 2023-10-14T19:08:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1de23700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1815de50 0x7f9d180b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1d622700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18146e10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000cd80 tx=0x7f9d10001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000ab10 con 0x7f9d180cf110 2023-10-14T19:08:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000ac70 con 0x7f9d180cf110 2023-10-14T19:08:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d100070f0 con 0x7f9d180cf110 2023-10-14T19:08:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d180c88d0 con 0x7f9d180cf110 2023-10-14T19:08:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.534+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d18147350 con 0x7f9d180cf110 2023-10-14T19:08:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.535+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1804c3c0 con 0x7f9d180cf110 2023-10-14T19:08:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.535+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9d100074e0 con 0x7f9d180cf110 2023-10-14T19:08:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.536+0000 7f9d157fa700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d04067200 0x7f9d040696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.536+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d10084b60 con 0x7f9d180cf110 2023-10-14T19:08:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.536+0000 7f9d1ce21700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d04067200 0x7f9d040696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.537+0000 7f9d1ce21700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d04067200 0x7f9d040696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d18159d40 tx=0x7f9d0c006c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.540+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d10051e50 con 0x7f9d180cf110 2023-10-14T19:08:42.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.737+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d180b2e80 con 0x7f9d180cf110 2023-10-14T19:08:42.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.738+0000 7f9d157fa700 1 -- 172.21.15.7:0/2560536589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f9d10055470 con 0x7f9d180cf110 2023-10-14T19:08:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:42.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:41.936671+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:42.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d04067200 msgr2=0x7f9d040696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d04067200 0x7f9d040696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d18159d40 tx=0x7f9d0c006c60 comp rx=0 tx=0).stop 2023-10-14T19:08:42.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 msgr2=0x7f9d18146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18146e10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000cd80 tx=0x7f9d10001ae0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 shutdown_connections 2023-10-14T19:08:42.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9d04067200 0x7f9d040696b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1815de50 0x7f9d180b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d180cf110 0x7f9d18146e10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 --2- 172.21.15.7:0/2560536589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d18153c30 0x7f9d180b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 >> 172.21.15.7:0/2560536589 conn(0x7f9d180703a0 msgr2=0x7f9d180ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:42.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 shutdown_connections 2023-10-14T19:08:42.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.740+0000 7f9d1e624700 1 -- 172.21.15.7:0/2560536589 wait complete. 2023-10-14T19:08:42.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:08:42.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:08:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.875+0000 7f409ec7e700 1 Processor -- start 2023-10-14T19:08:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.875+0000 7f409ec7e700 1 -- start start 2023-10-14T19:08:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409ec7e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4098159580 0x7f40980b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409ec7e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f409806ded0 0x7f40980b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409ec7e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409815bc40 con 0x7f40980cb1e0 2023-10-14T19:08:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409ec7e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409815b070 con 0x7f4098159580 2023-10-14T19:08:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409ec7e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409815b310 con 0x7f409806ded0 2023-10-14T19:08:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409dc7c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4098159580 0x7f40980b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409d47b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f40980cb1e0 0x7f409806d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54086/0 (socket says 172.21.15.7:54086) 2023-10-14T19:08:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409d47b700 1 -- 172.21.15.7:0/2350745713 learned_addr learned my addr 172.21.15.7:0/2350745713 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409e47d700 1 --2- 172.21.15.7:0/2350745713 >> v2:172.21.15.148:3300/0 conn(0x7f409806ded0 0x7f40980b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409dc7c700 1 -- 172.21.15.7:0/2350745713 >> v2:172.21.15.148:3300/0 conn(0x7f409806ded0 msgr2=0x7f40980b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409dc7c700 1 --2- 172.21.15.7:0/2350745713 >> v2:172.21.15.148:3300/0 conn(0x7f409806ded0 0x7f40980b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409dc7c700 1 -- 172.21.15.7:0/2350745713 >> v1:172.21.15.7:6789/0 conn(0x7f40980cb1e0 legacy=0x7f409806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409cc7a700 1 -- 172.21.15.7:0/2350745713 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013017624 0 0) 0x7f409815bc40 con 0x7f40980cb1e0 2023-10-14T19:08:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.876+0000 7f409dc7c700 1 -- 172.21.15.7:0/2350745713 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409815b5f0 con 0x7f4098159580 2023-10-14T19:08:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409dc7c700 1 --2- 172.21.15.7:0/2350745713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980b23f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f40980b13e0 tx=0x7f40940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318a6ab0a69bdea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409cc7a700 1 -- 172.21.15.7:0/2350745713 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400b6b0 con 0x7f4098159580 2023-10-14T19:08:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409cc7a700 1 -- 172.21.15.7:0/2350745713 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409400b810 con 0x7f4098159580 2023-10-14T19:08:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409cc7a700 1 -- 172.21.15.7:0/2350745713 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400bbb0 con 0x7f4098159580 2023-10-14T19:08:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 -- 172.21.15.7:0/2350745713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 msgr2=0x7f40980b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 --2- 172.21.15.7:0/2350745713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980b23f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f40980b13e0 tx=0x7f40940091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 -- 172.21.15.7:0/2350745713 shutdown_connections 2023-10-14T19:08:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 --2- 172.21.15.7:0/2350745713 >> v2:172.21.15.148:3300/0 conn(0x7f409806ded0 0x7f40980b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 --2- 172.21.15.7:0/2350745713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980b23f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 -- 172.21.15.7:0/2350745713 >> 172.21.15.7:0/2350745713 conn(0x7f40980703a0 msgr2=0x7f40980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:42.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 -- 172.21.15.7:0/2350745713 shutdown_connections 2023-10-14T19:08:42.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.877+0000 7f409ec7e700 1 -- 172.21.15.7:0/2350745713 wait complete. 2023-10-14T19:08:42.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.878+0000 7f409ec7e700 1 Processor -- start 2023-10-14T19:08:42.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.878+0000 7f409ec7e700 1 -- start start 2023-10-14T19:08:42.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409ec7e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f409806ded0 0x7f4098153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409ec7e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40980cb1e0 0x7f40980c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409ec7e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409ec7e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4098154f20 con 0x7f4098159580 2023-10-14T19:08:42.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409ec7e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981553b0 con 0x7f409806ded0 2023-10-14T19:08:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409ec7e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4098154310 con 0x7f40980cb1e0 2023-10-14T19:08:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409e47d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409e47d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56992/0 (socket says 172.21.15.7:56992) 2023-10-14T19:08:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409e47d700 1 -- 172.21.15.7:0/1295237901 learned_addr learned my addr 172.21.15.7:0/1295237901 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409dc7c700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f409806ded0 0x7f4098153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.879+0000 7f409d47b700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40980cb1e0 0x7f40980c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409e47d700 1 -- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40980cb1e0 msgr2=0x7f40980c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409e47d700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40980cb1e0 0x7f40980c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409e47d700 1 -- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f409806ded0 msgr2=0x7f4098153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409e47d700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f409806ded0 0x7f4098153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409e47d700 1 -- 172.21.15.7:0/1295237901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094009420 con 0x7f4098159580 2023-10-14T19:08:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409e47d700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980cc600 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4090007f20 tx=0x7f40900098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000eb90 con 0x7f4098159580 2023-10-14T19:08:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000ed10 con 0x7f4098159580 2023-10-14T19:08:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40981545f0 con 0x7f4098159580 2023-10-14T19:08:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090014670 con 0x7f4098159580 2023-10-14T19:08:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.880+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4098154bb0 con 0x7f4098159580 2023-10-14T19:08:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.881+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098088b50 con 0x7f4098159580 2023-10-14T19:08:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.882+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4090014a60 con 0x7f4098159580 2023-10-14T19:08:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.882+0000 7f408dffb700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f407c067200 0x7f407c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.882+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4090084c60 con 0x7f4098159580 2023-10-14T19:08:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.882+0000 7f409dc7c700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f407c067200 0x7f407c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.883+0000 7f409dc7c700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f407c067200 0x7f407c0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f40940091e0 tx=0x7f4094017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:42.886+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4090051ed0 con 0x7f4098159580 2023-10-14T19:08:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.079+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f409815b8d0 con 0x7f4098159580 2023-10-14T19:08:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.079+0000 7f408dffb700 1 -- 172.21.15.7:0/1295237901 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40900554f0 con 0x7f4098159580 2023-10-14T19:08:43.081 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:08:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.081+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f407c067200 msgr2=0x7f407c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.081+0000 7f409ec7e700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f407c067200 0x7f407c0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f40940091e0 tx=0x7f4094017000 comp rx=0 tx=0).stop 2023-10-14T19:08:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.081+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 msgr2=0x7f40980cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.081+0000 7f409ec7e700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980cc600 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4090007f20 tx=0x7f40900098a0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.081+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 shutdown_connections 2023-10-14T19:08:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.081+0000 7f409ec7e700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f407c067200 0x7f407c0696b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.082+0000 7f409ec7e700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f409806ded0 0x7f4098153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.082+0000 7f409ec7e700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4098159580 0x7f40980cc600 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.082+0000 7f409ec7e700 1 --2- 172.21.15.7:0/1295237901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40980cb1e0 0x7f40980c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.082+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 >> 172.21.15.7:0/1295237901 conn(0x7f40980703a0 msgr2=0x7f40981571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.082+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 shutdown_connections 2023-10-14T19:08:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.082+0000 7f409ec7e700 1 -- 172.21.15.7:0/1295237901 wait complete. 2023-10-14T19:08:43.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:08:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.213+0000 7f3c8e9bd700 1 Processor -- start 2023-10-14T19:08:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.213+0000 7f3c8e9bd700 1 -- start start 2023-10-14T19:08:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c8e9bd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c880cb5a0 0x7f3c880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c8e9bd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c8815a5d0 0x7f3c88156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c8e9bd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8815ae40 con 0x7f3c880cd9e0 2023-10-14T19:08:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c8e9bd700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880d13f0 con 0x7f3c880cb5a0 2023-10-14T19:08:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c8e9bd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8815ab60 con 0x7f3c8815a5d0 2023-10-14T19:08:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c87fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c880cb5a0 0x7f3c880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c87fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c880cb5a0 0x7f3c880cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57002/0 (socket says 172.21.15.7:57002) 2023-10-14T19:08:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.214+0000 7f3c87fff700 1 -- 172.21.15.7:0/1579164441 learned_addr learned my addr 172.21.15.7:0/1579164441 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8cf5a700 1 --2- 172.21.15.7:0/1579164441 >> v2:172.21.15.148:3300/0 conn(0x7f3c8815a5d0 0x7f3c88156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c87fff700 1 -- 172.21.15.7:0/1579164441 >> v2:172.21.15.148:3300/0 conn(0x7f3c8815a5d0 msgr2=0x7f3c88156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c87fff700 1 --2- 172.21.15.7:0/1579164441 >> v2:172.21.15.148:3300/0 conn(0x7f3c8815a5d0 0x7f3c88156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c87fff700 1 -- 172.21.15.7:0/1579164441 >> v1:172.21.15.148:6789/0 conn(0x7f3c880cd9e0 legacy=0x7f3c88159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c87fff700 1 -- 172.21.15.7:0/1579164441 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880ccf00 con 0x7f3c880cb5a0 2023-10-14T19:08:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c87fff700 1 --2- 172.21.15.7:0/1579164441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cb5a0 0x7f3c880cb970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3c780099b0 tx=0x7f3c78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5b91bf440f8ac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c86ffd700 1 -- 172.21.15.7:0/1579164441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800b7e0 con 0x7f3c880cb5a0 2023-10-14T19:08:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c86ffd700 1 -- 172.21.15.7:0/1579164441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800b940 con 0x7f3c880cb5a0 2023-10-14T19:08:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c86ffd700 1 -- 172.21.15.7:0/1579164441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800bce0 con 0x7f3c880cb5a0 2023-10-14T19:08:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/1579164441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cb5a0 msgr2=0x7f3c880cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/1579164441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cb5a0 0x7f3c880cb970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3c780099b0 tx=0x7f3c78009250 comp rx=0 tx=0).stop 2023-10-14T19:08:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/1579164441 shutdown_connections 2023-10-14T19:08:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/1579164441 >> v2:172.21.15.148:3300/0 conn(0x7f3c8815a5d0 0x7f3c88156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/1579164441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cb5a0 0x7f3c880cb970 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.215+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/1579164441 >> 172.21.15.7:0/1579164441 conn(0x7f3c88070e30 msgr2=0x7f3c880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.216+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/1579164441 shutdown_connections 2023-10-14T19:08:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.216+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/1579164441 wait complete. 2023-10-14T19:08:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 Processor -- start 2023-10-14T19:08:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 -- start start 2023-10-14T19:08:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c880cb5a0 0x7f3c8815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 0x7f3c88156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c8815a5d0 0x7f3c880b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880ca7b0 con 0x7f3c880cd9e0 2023-10-14T19:08:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c881586d0 con 0x7f3c880cb5a0 2023-10-14T19:08:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.217+0000 7f3c8e9bd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88157870 con 0x7f3c8815a5d0 2023-10-14T19:08:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 0x7f3c88156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 0x7f3c88156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57016/0 (socket says 172.21.15.7:57016) 2023-10-14T19:08:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 -- 172.21.15.7:0/3714145767 learned_addr learned my addr 172.21.15.7:0/3714145767 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c87fff700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c880cb5a0 0x7f3c8815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c8cf5a700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c8815a5d0 0x7f3c880b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 -- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c8815a5d0 msgr2=0x7f3c880b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c8815a5d0 0x7f3c880b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 -- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c880cb5a0 msgr2=0x7f3c8815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c880cb5a0 0x7f3c8815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 -- 172.21.15.7:0/3714145767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780094f0 con 0x7f3c880cd9e0 2023-10-14T19:08:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c877fe700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 0x7f3c88156110 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000b600 tx=0x7f3c700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000f510 con 0x7f3c880cd9e0 2023-10-14T19:08:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000f670 con 0x7f3c880cd9e0 2023-10-14T19:08:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c88157b50 con 0x7f3c880cd9e0 2023-10-14T19:08:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000fa30 con 0x7f3c880cd9e0 2023-10-14T19:08:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.218+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c88158360 con 0x7f3c880cd9e0 2023-10-14T19:08:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.219+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c88158880 con 0x7f3c880cd9e0 2023-10-14T19:08:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.220+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3c7001a400 con 0x7f3c880cd9e0 2023-10-14T19:08:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.220+0000 7f3c7ffff700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c68067200 0x7f3c680696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.220+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c700841f0 con 0x7f3c880cd9e0 2023-10-14T19:08:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.220+0000 7f3c87fff700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c68067200 0x7f3c680696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.221+0000 7f3c87fff700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c68067200 0x7f3c680696b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3c780099b0 tx=0x7f3c78016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:43.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.224+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c88158880 con 0x7f3c880cd9e0 2023-10-14T19:08:43.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.418+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3c88158840 con 0x7f3c880cd9e0 2023-10-14T19:08:43.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.418+0000 7f3c7ffff700 1 -- 172.21.15.7:0/3714145767 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3c70051460 con 0x7f3c880cd9e0 2023-10-14T19:08:43.420 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:43.420 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:08:43.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:43.420 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:08:43.420 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:08:43.421 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:43.421 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:08:43.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c68067200 msgr2=0x7f3c680696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c68067200 0x7f3c680696b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3c780099b0 tx=0x7f3c78016000 comp rx=0 tx=0).stop 2023-10-14T19:08:43.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 msgr2=0x7f3c88156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 0x7f3c88156110 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000b600 tx=0x7f3c700091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 shutdown_connections 2023-10-14T19:08:43.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c68067200 0x7f3c680696b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c880cb5a0 0x7f3c8815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c8815a5d0 0x7f3c880b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 --2- 172.21.15.7:0/3714145767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c880cd9e0 0x7f3c88156110 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.420+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 >> 172.21.15.7:0/3714145767 conn(0x7f3c88070e30 msgr2=0x7f3c880b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:43.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.421+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 shutdown_connections 2023-10-14T19:08:43.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.421+0000 7f3c8e9bd700 1 -- 172.21.15.7:0/3714145767 wait complete. 2023-10-14T19:08:43.433 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:08:43.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:08:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.558+0000 7fa030883700 1 Processor -- start 2023-10-14T19:08:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.558+0000 7fa030883700 1 -- start start 2023-10-14T19:08:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa030883700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa02c159530 0x7fa02c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa030883700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c06dcf0 0x7fa02c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa030883700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0ccfd0 con 0x7fa02c159e40 2023-10-14T19:08:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa030883700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c15a410 con 0x7fa02c159530 2023-10-14T19:08:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa030883700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c15a6f0 con 0x7fa02c06dcf0 2023-10-14T19:08:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa02c159530 0x7fa02c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa02c159530 0x7fa02c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57024/0 (socket says 172.21.15.7:57024) 2023-10-14T19:08:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 -- 172.21.15.7:0/4195053384 learned_addr learned my addr 172.21.15.7:0/4195053384 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa029d9b700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c06dcf0 0x7fa02c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 -- 172.21.15.7:0/4195053384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c06dcf0 msgr2=0x7fa02c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c06dcf0 0x7fa02c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 -- 172.21.15.7:0/4195053384 >> v1:172.21.15.148:6789/0 conn(0x7fa02c159e40 legacy=0x7fa02c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 -- 172.21.15.7:0/4195053384 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c15a9d0 con 0x7fa02c159530 2023-10-14T19:08:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa029d9b700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c06dcf0 0x7fa02c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02a59c700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c0ceba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa0240099b0 tx=0x7fa024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35580f6afb58eff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.559+0000 7fa02959a700 1 -- 172.21.15.7:0/4195053384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400b860 con 0x7fa02c159530 2023-10-14T19:08:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa02959a700 1 -- 172.21.15.7:0/4195053384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400b9c0 con 0x7fa02c159530 2023-10-14T19:08:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa02959a700 1 -- 172.21.15.7:0/4195053384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400bd60 con 0x7fa02c159530 2023-10-14T19:08:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 -- 172.21.15.7:0/4195053384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 msgr2=0x7fa02c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c0ceba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa0240099b0 tx=0x7fa024009250 comp rx=0 tx=0).stop 2023-10-14T19:08:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 -- 172.21.15.7:0/4195053384 shutdown_connections 2023-10-14T19:08:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c0ceba0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 --2- 172.21.15.7:0/4195053384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c06dcf0 0x7fa02c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 -- 172.21.15.7:0/4195053384 >> 172.21.15.7:0/4195053384 conn(0x7fa02c0703a0 msgr2=0x7fa02c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 -- 172.21.15.7:0/4195053384 shutdown_connections 2023-10-14T19:08:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.560+0000 7fa030883700 1 -- 172.21.15.7:0/4195053384 wait complete. 2023-10-14T19:08:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.561+0000 7fa030883700 1 Processor -- start 2023-10-14T19:08:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.561+0000 7fa030883700 1 -- start start 2023-10-14T19:08:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa030883700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa02c06dcf0 0x7fa02c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa030883700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c16b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa030883700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c159e40 0x7fa02c0c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa030883700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c155500 con 0x7fa02c159530 2023-10-14T19:08:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa030883700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b4dc0 con 0x7fa02c06dcf0 2023-10-14T19:08:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa030883700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b50a0 con 0x7fa02c159e40 2023-10-14T19:08:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa029d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c16b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa029d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c16b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57030/0 (socket says 172.21.15.7:57030) 2023-10-14T19:08:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa029d9b700 1 -- 172.21.15.7:0/3287853098 learned_addr learned my addr 172.21.15.7:0/3287853098 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa02a59c700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa02c06dcf0 0x7fa02c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa02ad9d700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c159e40 0x7fa02c0c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.562+0000 7fa029d9b700 1 -- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c159e40 msgr2=0x7fa02c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa029d9b700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c159e40 0x7fa02c0c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa029d9b700 1 -- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa02c06dcf0 msgr2=0x7fa02c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa029d9b700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa02c06dcf0 0x7fa02c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa029d9b700 1 -- 172.21.15.7:0/3287853098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240094f0 con 0x7fa02c159530 2023-10-14T19:08:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa02ad9d700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c159e40 0x7fa02c0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa029d9b700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c16b170 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa01400e8d0 tx=0x7fa014008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400ee70 con 0x7fa02c159530 2023-10-14T19:08:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400c5e0 con 0x7fa02c159530 2023-10-14T19:08:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400c980 con 0x7fa02c159530 2023-10-14T19:08:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c0b5380 con 0x7fa02c159530 2023-10-14T19:08:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.563+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c0b4990 con 0x7fa02c159530 2023-10-14T19:08:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.564+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c1556b0 con 0x7fa02c159530 2023-10-14T19:08:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.564+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa014013410 con 0x7fa02c159530 2023-10-14T19:08:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.565+0000 7fa0227fc700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa00c067200 0x7fa00c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.565+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa0140845e0 con 0x7fa02c159530 2023-10-14T19:08:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.565+0000 7fa02a59c700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa00c067200 0x7fa00c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.565+0000 7fa02a59c700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa00c067200 0x7fa00c0696b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0240099b0 tx=0x7fa024017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:43.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.569+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa02c1556b0 con 0x7fa02c159530 2023-10-14T19:08:43.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.762+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa02c0caaf0 con 0x7fa02c159530 2023-10-14T19:08:43.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.944+0000 7fa0227fc700 1 -- 172.21.15.7:0/3287853098 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa0140551d0 con 0x7fa02c159530 2023-10-14T19:08:43.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa00c067200 msgr2=0x7fa00c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa00c067200 0x7fa00c0696b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0240099b0 tx=0x7fa024017000 comp rx=0 tx=0).stop 2023-10-14T19:08:43.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 msgr2=0x7fa02c16b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:43.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c16b170 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa01400e8d0 tx=0x7fa014008040 comp rx=0 tx=0).stop 2023-10-14T19:08:43.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 shutdown_connections 2023-10-14T19:08:43.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa00c067200 0x7fa00c0696b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa02c06dcf0 0x7fa02c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa02c159e40 0x7fa02c0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 --2- 172.21.15.7:0/3287853098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c159530 0x7fa02c16b170 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:43.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.949+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 >> 172.21.15.7:0/3287853098 conn(0x7fa02c0703a0 msgr2=0x7fa02c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:43.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.950+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 shutdown_connections 2023-10-14T19:08:43.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:43.950+0000 7fa030883700 1 -- 172.21.15.7:0/3287853098 wait complete. 2023-10-14T19:08:43.953 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:08:43.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:08:44.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 Processor -- start 2023-10-14T19:08:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 -- start start 2023-10-14T19:08:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2220159970 0x7f22200686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22200c9ab0 0x7f22200c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2220068350 con 0x7f22200cbbc0 2023-10-14T19:08:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2220067740 con 0x7f22200c9ab0 2023-10-14T19:08:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.089+0000 7f2226049700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2220067a20 con 0x7f2220159970 2023-10-14T19:08:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22200c9ab0 0x7f22200c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f22200cbbc0 0x7f22200c93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54102/0 (socket says 172.21.15.7:54102) 2023-10-14T19:08:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22200c9ab0 0x7f22200c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57042/0 (socket says 172.21.15.7:57042) 2023-10-14T19:08:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221effd700 1 -- 172.21.15.7:0/3271837664 learned_addr learned my addr 172.21.15.7:0/3271837664 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221f7fe700 1 --2- 172.21.15.7:0/3271837664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2220159970 0x7f22200686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 -- 172.21.15.7:0/3271837664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2220159970 msgr2=0x7f22200686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 --2- 172.21.15.7:0/3271837664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2220159970 0x7f22200686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 -- 172.21.15.7:0/3271837664 >> v1:172.21.15.7:6789/0 conn(0x7f22200cbbc0 legacy=0x7f22200c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221e7fc700 1 -- 172.21.15.7:0/3271837664 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211983986 0 0) 0x7f2220068350 con 0x7f22200cbbc0 2023-10-14T19:08:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 -- 172.21.15.7:0/3271837664 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220067d00 con 0x7f22200c9ab0 2023-10-14T19:08:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221ffff700 1 --2- 172.21.15.7:0/3271837664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200c7d20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f22180098e0 tx=0x7f22180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eb693a2ce66715 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221e7fc700 1 -- 172.21.15.7:0/3271837664 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218009e80 con 0x7f22200c9ab0 2023-10-14T19:08:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221e7fc700 1 -- 172.21.15.7:0/3271837664 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221800b860 con 0x7f22200c9ab0 2023-10-14T19:08:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.090+0000 7f221e7fc700 1 -- 172.21.15.7:0/3271837664 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800bbe0 con 0x7f22200c9ab0 2023-10-14T19:08:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 -- 172.21.15.7:0/3271837664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 msgr2=0x7f22200c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 --2- 172.21.15.7:0/3271837664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200c7d20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f22180098e0 tx=0x7f22180091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 -- 172.21.15.7:0/3271837664 shutdown_connections 2023-10-14T19:08:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 --2- 172.21.15.7:0/3271837664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200c7d20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 --2- 172.21.15.7:0/3271837664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2220159970 0x7f22200686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 -- 172.21.15.7:0/3271837664 >> 172.21.15.7:0/3271837664 conn(0x7f222006e250 msgr2=0x7f22200cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 -- 172.21.15.7:0/3271837664 shutdown_connections 2023-10-14T19:08:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.091+0000 7f2226049700 1 -- 172.21.15.7:0/3271837664 wait complete. 2023-10-14T19:08:44.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.092+0000 7f2226049700 1 Processor -- start 2023-10-14T19:08:44.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.092+0000 7f2226049700 1 -- start start 2023-10-14T19:08:44.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f2226049700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:44.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f2226049700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200cbbc0 0x7f222015f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:44.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f2226049700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2220159970 0x7f22200b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:44.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f2226049700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c5110 con 0x7f22200c9ab0 2023-10-14T19:08:44.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f2226049700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200b3300 con 0x7f2220159970 2023-10-14T19:08:44.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f2226049700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c4e30 con 0x7f22200cbbc0 2023-10-14T19:08:44.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:44.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57050/0 (socket says 172.21.15.7:57050) 2023-10-14T19:08:44.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 -- 172.21.15.7:0/3742919976 learned_addr learned my addr 172.21.15.7:0/3742919976 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:44.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 -- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200cbbc0 msgr2=0x7f222015f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:44.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200cbbc0 0x7f222015f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 -- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2220159970 msgr2=0x7f22200b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:44.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2220159970 0x7f22200b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.093+0000 7f221f7fe700 1 -- 172.21.15.7:0/3742919976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2218009420 con 0x7f22200c9ab0 2023-10-14T19:08:44.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.094+0000 7f221f7fe700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200b2dc0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2210007f60 tx=0x7f2210009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:44.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.094+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000ecf0 con 0x7f22200c9ab0 2023-10-14T19:08:44.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.094+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000ee70 con 0x7f22200c9ab0 2023-10-14T19:08:44.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.094+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222015a4c0 con 0x7f22200c9ab0 2023-10-14T19:08:44.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.094+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210014650 con 0x7f22200c9ab0 2023-10-14T19:08:44.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.094+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222015aa80 con 0x7f22200c9ab0 2023-10-14T19:08:44.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.095+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222015aca0 con 0x7f22200c9ab0 2023-10-14T19:08:44.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.095+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f22100149c0 con 0x7f22200c9ab0 2023-10-14T19:08:44.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.096+0000 7f22177fe700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2200067200 0x7f22000696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:44.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.096+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2210084ef0 con 0x7f22200c9ab0 2023-10-14T19:08:44.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.096+0000 7f221effd700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2200067200 0x7f22000696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:44.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.097+0000 7f221effd700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2200067200 0x7f22000696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f22080011e0 tx=0x7f22080079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:44.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.100+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2210051ff0 con 0x7f22200c9ab0 2023-10-14T19:08:44.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.296+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f222004c3c0 con 0x7f22200c9ab0 2023-10-14T19:08:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.947+0000 7f22177fe700 1 -- 172.21.15.7:0/3742919976 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2210055610 con 0x7f22200c9ab0 2023-10-14T19:08:44.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2200067200 msgr2=0x7f22000696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:44.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2200067200 0x7f22000696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f22080011e0 tx=0x7f22080079d0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 msgr2=0x7f22200b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:44.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200b2dc0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2210007f60 tx=0x7f2210009860 comp rx=0 tx=0).stop 2023-10-14T19:08:44.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 shutdown_connections 2023-10-14T19:08:44.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2200067200 0x7f22000696b0 secure :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f22080011e0 tx=0x7f22080079d0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2220159970 0x7f22200b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c9ab0 0x7f22200b2dc0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 --2- 172.21.15.7:0/3742919976 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200cbbc0 0x7f222015f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:44.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.952+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 >> 172.21.15.7:0/3742919976 conn(0x7f222006e250 msgr2=0x7f222006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:44.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.961+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 shutdown_connections 2023-10-14T19:08:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:44.962+0000 7f2226049700 1 -- 172.21.15.7:0/3742919976 wait complete. 2023-10-14T19:08:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:08:44.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:08:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.106+0000 7f9c1892a700 1 Processor -- start 2023-10-14T19:08:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.106+0000 7f9c1892a700 1 -- start start 2023-10-14T19:08:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.107+0000 7f9c1892a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c14159530 0x7f9c140ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.107+0000 7f9c1892a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c14159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.107+0000 7f9c1892a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c140ccfd0 con 0x7f9c1406e0e0 2023-10-14T19:08:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.107+0000 7f9c1892a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c140cf0e0 con 0x7f9c14159530 2023-10-14T19:08:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.107+0000 7f9c1892a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1415a3d0 con 0x7f9c1406dc70 2023-10-14T19:08:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c12d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9c1406e0e0 0x7f9c140cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54106/0 (socket says 172.21.15.7:54106) 2023-10-14T19:08:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c12d9d700 1 -- 172.21.15.7:0/3962948506 learned_addr learned my addr 172.21.15.7:0/3962948506 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c14159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1259c700 1 --2- 172.21.15.7:0/3962948506 >> v2:172.21.15.148:3300/0 conn(0x7f9c14159530 0x7f9c140ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150471941 0 0) 0x7f9c140ccfd0 con 0x7f9c1406e0e0 2023-10-14T19:08:45.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00003570 con 0x7f9c1406e0e0 2023-10-14T19:08:45.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2924082241 0 0) 0x7f9c00003570 con 0x7f9c1406e0e0 2023-10-14T19:08:45.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 msgr2=0x7f9c14159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:45.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c14159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 >> v2:172.21.15.148:3300/0 conn(0x7f9c14159530 msgr2=0x7f9c140ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:45.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 --2- 172.21.15.7:0/3962948506 >> v2:172.21.15.148:3300/0 conn(0x7f9c14159530 0x7f9c140ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1415a6b0 con 0x7f9c1406e0e0 2023-10-14T19:08:45.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f9c04001470 con 0x7f9c1406e0e0 2023-10-14T19:08:45.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1259c700 1 --2- 172.21.15.7:0/3962948506 >> v2:172.21.15.148:3300/0 conn(0x7f9c14159530 0x7f9c140ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:45.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 >> v1:172.21.15.7:6789/0 conn(0x7f9c1406e0e0 legacy=0x7f9c140cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c00003a60 0x7f9c00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c00004810 0x7f9c00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140cf0e0 con 0x7f9c00004810 2023-10-14T19:08:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1415a3d0 con 0x7f9c00003a60 2023-10-14T19:08:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0000ba60 con 0x7f9c1406dc70 2023-10-14T19:08:45.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c00004810 0x7f9c00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c1259c700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c00003a60 0x7f9c00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.108+0000 7f9c12d9d700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 msgr2=0x7f9c000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:45.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c00003a60 msgr2=0x7f9c00003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:45.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c00003a60 0x7f9c00003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3962948506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00003570 con 0x7f9c00004810 2023-10-14T19:08:45.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c12d9d700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c1406dc70 0x7f9c000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:45.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c00004810 0x7f9c00004c80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009c30 tx=0x7f9bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75afd6077f5b75a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00e710 con 0x7f9c00004810 2023-10-14T19:08:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00e870 con 0x7f9c00004810 2023-10-14T19:08:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c1159a700 1 -- 172.21.15.7:0/3962948506 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00ec30 con 0x7f9c00004810 2023-10-14T19:08:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c1892a700 1 -- 172.21.15.7:0/3962948506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c00004810 msgr2=0x7f9c00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3962948506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c00004810 0x7f9c00004c80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009c30 tx=0x7f9bfc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.109+0000 7f9c12d9d700 1 -- 172.21.15.7:0/3962948506 reap_dead start 2023-10-14T19:08:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.110+0000 7f9c1892a700 1 -- 172.21.15.7:0/3962948506 shutdown_connections 2023-10-14T19:08:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.110+0000 7f9c1892a700 1 -- 172.21.15.7:0/3962948506 >> 172.21.15.7:0/3962948506 conn(0x7f9c140703a0 msgr2=0x7f9c140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.110+0000 7f9c1892a700 1 -- 172.21.15.7:0/3962948506 shutdown_connections 2023-10-14T19:08:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.110+0000 7f9c1892a700 1 -- 172.21.15.7:0/3962948506 wait complete. 2023-10-14T19:08:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 Processor -- start 2023-10-14T19:08:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 -- start start 2023-10-14T19:08:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c00004810 0x7f9c140c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 0x7f9c1416a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c140b1890 0x7f9c140b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14169c80 con 0x7f9c1414e040 2023-10-14T19:08:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1416a240 con 0x7f9c140b1890 2023-10-14T19:08:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.111+0000 7f9c1892a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1416ac10 con 0x7f9c00004810 2023-10-14T19:08:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 0x7f9c1416a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 0x7f9c1416a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57066/0 (socket says 172.21.15.7:57066) 2023-10-14T19:08:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3642205888 learned_addr learned my addr 172.21.15.7:0/3642205888 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c1259c700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c00004810 0x7f9c140c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c12d9d700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c140b1890 0x7f9c140b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c00004810 msgr2=0x7f9c140c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c00004810 0x7f9c140c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c140b1890 msgr2=0x7f9c140b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c140b1890 0x7f9c140b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 -- 172.21.15.7:0/3642205888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140c8e90 con 0x7f9c1414e040 2023-10-14T19:08:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c11d9b700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 0x7f9c1416a6d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc013f80 tx=0x7f9bfc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc022070 con 0x7f9c1414e040 2023-10-14T19:08:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00e9e0 con 0x7f9c1414e040 2023-10-14T19:08:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c140c9170 con 0x7f9c1414e040 2023-10-14T19:08:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc01c450 con 0x7f9c1414e040 2023-10-14T19:08:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.112+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c140b1d00 con 0x7f9c1414e040 2023-10-14T19:08:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.113+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1404c3c0 con 0x7f9c1414e040 2023-10-14T19:08:45.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.114+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9bfc01c800 con 0x7f9c1414e040 2023-10-14T19:08:45.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.114+0000 7f9c0a7fc700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9bf4067200 0x7f9bf40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:45.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.114+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9bfc085f50 con 0x7f9c1414e040 2023-10-14T19:08:45.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.114+0000 7f9c1259c700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9bf4067200 0x7f9bf40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:45.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.115+0000 7f9c1259c700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9bf4067200 0x7f9bf40696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0094d0 tx=0x7f9c0c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:45.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.119+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bfc053010 con 0x7f9c1414e040 2023-10-14T19:08:45.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.355+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9c1415a990 con 0x7f9c1414e040 2023-10-14T19:08:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.986+0000 7f9c0a7fc700 1 -- 172.21.15.7:0/3642205888 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9bfc02b0c0 con 0x7f9c1414e040 2023-10-14T19:08:45.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9bf4067200 msgr2=0x7f9bf40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:45.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9bf4067200 0x7f9bf40696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0094d0 tx=0x7f9c0c00b040 comp rx=0 tx=0).stop 2023-10-14T19:08:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 msgr2=0x7f9c1416a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 0x7f9c1416a6d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc013f80 tx=0x7f9bfc01a000 comp rx=0 tx=0).stop 2023-10-14T19:08:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 shutdown_connections 2023-10-14T19:08:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9bf4067200 0x7f9bf40696b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c140b1890 0x7f9c140b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c00004810 0x7f9c140c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 --2- 172.21.15.7:0/3642205888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1414e040 0x7f9c1416a6d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 >> 172.21.15.7:0/3642205888 conn(0x7f9c140703a0 msgr2=0x7f9c1415ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.991+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 shutdown_connections 2023-10-14T19:08:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:45.992+0000 7f9c1892a700 1 -- 172.21.15.7:0/3642205888 wait complete. 2023-10-14T19:08:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 14 and data pool 15 2023-10-14T19:08:46.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:46.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.131+0000 7fdea9e6c700 1 Processor -- start 2023-10-14T19:08:46.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.131+0000 7fdea9e6c700 1 -- start start 2023-10-14T19:08:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea9e6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea9e6c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdea406aaa0 0x7fdea40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea9e6c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea415ae70 con 0x7fdea413fef0 2023-10-14T19:08:46.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea9e6c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea406af60 con 0x7fdea406aaa0 2023-10-14T19:08:46.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea9e6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea406b240 con 0x7fdea413fb20 2023-10-14T19:08:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea966b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdea406aaa0 0x7fdea40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdea413fef0 0x7fdea40c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54110/0 (socket says 172.21.15.7:54110) 2023-10-14T19:08:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea3fff700 1 -- 172.21.15.7:0/2639568787 learned_addr learned my addr 172.21.15.7:0/2639568787 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea8e6a700 1 --2- 172.21.15.7:0/2639568787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea966b700 1 -- 172.21.15.7:0/2639568787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 msgr2=0x7fdea415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea966b700 1 --2- 172.21.15.7:0/2639568787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea966b700 1 -- 172.21.15.7:0/2639568787 >> v1:172.21.15.7:6789/0 conn(0x7fdea413fef0 legacy=0x7fdea40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea37fe700 1 -- 172.21.15.7:0/2639568787 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464431836 0 0) 0x7fde90001290 con 0x7fdea413fef0 2023-10-14T19:08:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.132+0000 7fdea966b700 1 -- 172.21.15.7:0/2639568787 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea406b520 con 0x7fdea406aaa0 2023-10-14T19:08:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea966b700 1 --2- 172.21.15.7:0/2639568787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea40c9d00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009e60 tx=0x7fde9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a89ae9d402885e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea37fe700 1 -- 172.21.15.7:0/2639568787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00e070 con 0x7fdea406aaa0 2023-10-14T19:08:46.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea37fe700 1 -- 172.21.15.7:0/2639568787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00bc30 con 0x7fdea406aaa0 2023-10-14T19:08:46.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea37fe700 1 -- 172.21.15.7:0/2639568787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c012430 con 0x7fdea406aaa0 2023-10-14T19:08:46.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 -- 172.21.15.7:0/2639568787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 msgr2=0x7fdea40c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/2639568787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea40c9d00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009e60 tx=0x7fde9c009780 comp rx=0 tx=0).stop 2023-10-14T19:08:46.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 -- 172.21.15.7:0/2639568787 shutdown_connections 2023-10-14T19:08:46.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/2639568787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea40c9d00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/2639568787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 -- 172.21.15.7:0/2639568787 >> 172.21.15.7:0/2639568787 conn(0x7fdea406d170 msgr2=0x7fdea40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:46.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 -- 172.21.15.7:0/2639568787 shutdown_connections 2023-10-14T19:08:46.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.133+0000 7fdea9e6c700 1 -- 172.21.15.7:0/2639568787 wait complete. 2023-10-14T19:08:46.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.134+0000 7fdea9e6c700 1 Processor -- start 2023-10-14T19:08:46.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 -- start start 2023-10-14T19:08:46.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea413aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea413fef0 0x7fdea413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea413aa10 con 0x7fdea406aaa0 2023-10-14T19:08:46.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea413b3e0 con 0x7fdea413fef0 2023-10-14T19:08:46.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea9e6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4139e00 con 0x7fdea413fb20 2023-10-14T19:08:46.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea8e6a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea413aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea8e6a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea413aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57080/0 (socket says 172.21.15.7:57080) 2023-10-14T19:08:46.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.135+0000 7fdea8e6a700 1 -- 172.21.15.7:0/3580720420 learned_addr learned my addr 172.21.15.7:0/3580720420 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea8e6a700 1 -- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 msgr2=0x7fdea413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea8e6a700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea8e6a700 1 -- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea413fef0 msgr2=0x7fdea413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea8e6a700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea413fef0 0x7fdea413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea8e6a700 1 -- 172.21.15.7:0/3580720420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009a20 con 0x7fdea406aaa0 2023-10-14T19:08:46.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea8e6a700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea413aea0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fde9800c7d0 tx=0x7fde98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011600 con 0x7fdea406aaa0 2023-10-14T19:08:46.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98011760 con 0x7fdea406aaa0 2023-10-14T19:08:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea413a0e0 con 0x7fdea406aaa0 2023-10-14T19:08:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011b20 con 0x7fdea406aaa0 2023-10-14T19:08:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.136+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea413a6a0 con 0x7fdea406aaa0 2023-10-14T19:08:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.137+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea404c3c0 con 0x7fdea406aaa0 2023-10-14T19:08:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.137+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fde980193f0 con 0x7fdea406aaa0 2023-10-14T19:08:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.138+0000 7fdea0ff9700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde88067200 0x7fde880696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.138+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde98084ee0 con 0x7fdea406aaa0 2023-10-14T19:08:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.138+0000 7fdea3fff700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde88067200 0x7fde880696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.138+0000 7fdea3fff700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde88067200 0x7fde880696b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae780 tx=0x7fde90007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.142+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde98051cb0 con 0x7fdea406aaa0 2023-10-14T19:08:46.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.338+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdea413acf0 con 0x7fdea406aaa0 2023-10-14T19:08:46.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.339+0000 7fdea0ff9700 1 -- 172.21.15.7:0/3580720420 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fde980552d0 con 0x7fdea406aaa0 2023-10-14T19:08:46.340 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:46.340 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":89,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:45.357158+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:43.793528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:44.327457+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:46.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde88067200 msgr2=0x7fde880696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde88067200 0x7fde880696b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae780 tx=0x7fde90007a40 comp rx=0 tx=0).stop 2023-10-14T19:08:46.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 msgr2=0x7fdea413aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea413aea0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fde9800c7d0 tx=0x7fde98008040 comp rx=0 tx=0).stop 2023-10-14T19:08:46.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 shutdown_connections 2023-10-14T19:08:46.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde88067200 0x7fde880696b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea413fef0 0x7fdea413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdea406aaa0 0x7fdea413aea0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 --2- 172.21.15.7:0/3580720420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdea413fb20 0x7fdea413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 >> 172.21.15.7:0/3580720420 conn(0x7fdea406d170 msgr2=0x7fdea40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:46.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 shutdown_connections 2023-10-14T19:08:46.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.341+0000 7fdea9e6c700 1 -- 172.21.15.7:0/3580720420 wait complete. 2023-10-14T19:08:46.354 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.473+0000 7fa296fed700 1 Processor -- start 2023-10-14T19:08:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.473+0000 7fa296fed700 1 -- start start 2023-10-14T19:08:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa296fed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa290153c30 0x7fa29015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa296fed700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2900cf110 0x7fa29015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa296fed700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29015afd0 con 0x7fa29015de50 2023-10-14T19:08:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa296fed700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29015b2b0 con 0x7fa2900cf110 2023-10-14T19:08:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa296fed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29015b590 con 0x7fa290153c30 2023-10-14T19:08:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa2967ec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2900cf110 0x7fa29015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa295feb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa290153c30 0x7fa29015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa2957ea700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa29015de50 0x7fa2900cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:40478/0 (socket says 172.21.15.7:40478) 2023-10-14T19:08:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.474+0000 7fa2957ea700 1 -- 172.21.15.7:0/1726032147 learned_addr learned my addr 172.21.15.7:0/1726032147 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa2967ec700 1 -- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa290153c30 msgr2=0x7fa29015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa2967ec700 1 --2- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa290153c30 0x7fa29015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa2967ec700 1 -- 172.21.15.7:0/1726032147 >> v1:172.21.15.148:6789/0 conn(0x7fa29015de50 legacy=0x7fa2900cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa2967ec700 1 -- 172.21.15.7:0/1726032147 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29015b870 con 0x7fa2900cf110 2023-10-14T19:08:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa294fe9700 1 -- 172.21.15.7:0/1726032147 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246401717 0 0) 0x7fa29015afd0 con 0x7fa29015de50 2023-10-14T19:08:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa295feb700 1 --2- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa290153c30 0x7fa29015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa2967ec700 1 --2- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2900cf110 0x7fa29015c070 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa280009e60 tx=0x7fa280009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278b8512d36d9ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa294fe9700 1 -- 172.21.15.7:0/1726032147 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28000e070 con 0x7fa2900cf110 2023-10-14T19:08:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa294fe9700 1 -- 172.21.15.7:0/1726032147 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28000bb60 con 0x7fa2900cf110 2023-10-14T19:08:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.475+0000 7fa294fe9700 1 -- 172.21.15.7:0/1726032147 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280012430 con 0x7fa2900cf110 2023-10-14T19:08:46.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 -- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2900cf110 msgr2=0x7fa29015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 --2- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2900cf110 0x7fa29015c070 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa280009e60 tx=0x7fa280009780 comp rx=0 tx=0).stop 2023-10-14T19:08:46.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 -- 172.21.15.7:0/1726032147 shutdown_connections 2023-10-14T19:08:46.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 --2- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2900cf110 0x7fa29015c070 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 --2- 172.21.15.7:0/1726032147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa290153c30 0x7fa29015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 -- 172.21.15.7:0/1726032147 >> 172.21.15.7:0/1726032147 conn(0x7fa2900703a0 msgr2=0x7fa2900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:46.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 -- 172.21.15.7:0/1726032147 shutdown_connections 2023-10-14T19:08:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.476+0000 7fa296fed700 1 -- 172.21.15.7:0/1726032147 wait complete. 2023-10-14T19:08:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.477+0000 7fa296fed700 1 Processor -- start 2023-10-14T19:08:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.477+0000 7fa296fed700 1 -- start start 2023-10-14T19:08:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa296fed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2900cf110 0x7fa290151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa296fed700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 0x7fa2900c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa296fed700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa29015de50 0x7fa2900c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa296fed700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901520d0 con 0x7fa290153c30 2023-10-14T19:08:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa296fed700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900b4db0 con 0x7fa29015de50 2023-10-14T19:08:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa296fed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900b41a0 con 0x7fa2900cf110 2023-10-14T19:08:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 0x7fa2900c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 0x7fa2900c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57090/0 (socket says 172.21.15.7:57090) 2023-10-14T19:08:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 -- 172.21.15.7:0/89570073 learned_addr learned my addr 172.21.15.7:0/89570073 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa295feb700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2900cf110 0x7fa290151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2967ec700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa29015de50 0x7fa2900c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 -- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2900cf110 msgr2=0x7fa290151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2900cf110 0x7fa290151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 -- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa29015de50 msgr2=0x7fa2900c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa29015de50 0x7fa2900c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 -- 172.21.15.7:0/89570073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288009420 con 0x7fa290153c30 2023-10-14T19:08:46.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa2957ea700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 0x7fa2900c89d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c5b0 tx=0x7fa284001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.478+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284005b30 con 0x7fa290153c30 2023-10-14T19:08:46.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.479+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284005c90 con 0x7fa290153c30 2023-10-14T19:08:46.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.479+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284007300 con 0x7fa290153c30 2023-10-14T19:08:46.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.479+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa280009a20 con 0x7fa290153c30 2023-10-14T19:08:46.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.479+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900b4760 con 0x7fa290153c30 2023-10-14T19:08:46.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.480+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2900b4f20 con 0x7fa290153c30 2023-10-14T19:08:46.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.480+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa2840076b0 con 0x7fa290153c30 2023-10-14T19:08:46.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.480+0000 7fa28dffb700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa27c067200 0x7fa27c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.481+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa284083e60 con 0x7fa290153c30 2023-10-14T19:08:46.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.481+0000 7fa295feb700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa27c067200 0x7fa27c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.481+0000 7fa295feb700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa27c067200 0x7fa27c0696b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2880093f0 tx=0x7fa288008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.485+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa284050d40 con 0x7fa290153c30 2023-10-14T19:08:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.684+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa29004c3c0 con 0x7fa290153c30 2023-10-14T19:08:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.685+0000 7fa28dffb700 1 -- 172.21.15.7:0/89570073 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fa284017090 con 0x7fa290153c30 2023-10-14T19:08:46.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:46.686 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":89,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:45.357158+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:43.793528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:44.327457+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa27c067200 msgr2=0x7fa27c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa27c067200 0x7fa27c0696b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2880093f0 tx=0x7fa288008040 comp rx=0 tx=0).stop 2023-10-14T19:08:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 msgr2=0x7fa2900c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 0x7fa2900c89d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c5b0 tx=0x7fa284001070 comp rx=0 tx=0).stop 2023-10-14T19:08:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 shutdown_connections 2023-10-14T19:08:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa27c067200 0x7fa27c0696b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa29015de50 0x7fa2900c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2900cf110 0x7fa290151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 --2- 172.21.15.7:0/89570073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa290153c30 0x7fa2900c89d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 >> 172.21.15.7:0/89570073 conn(0x7fa2900703a0 msgr2=0x7fa290070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 shutdown_connections 2023-10-14T19:08:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.687+0000 7fa296fed700 1 -- 172.21.15.7:0/89570073 wait complete. 2023-10-14T19:08:46.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:08:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.823+0000 7ff27543d700 1 Processor -- start 2023-10-14T19:08:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.823+0000 7ff27543d700 1 -- start start 2023-10-14T19:08:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff27543d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff2701562c0 0x7ff2700ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff27543d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2700af5c0 0x7ff27006b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff27543d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700ca2b0 con 0x7ff270156690 2023-10-14T19:08:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff27543d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700c96e0 con 0x7ff2700af5c0 2023-10-14T19:08:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff27543d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27006bb30 con 0x7ff2701562c0 2023-10-14T19:08:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26e7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2700af5c0 0x7ff27006b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff270156690 0x7ff27006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53708/0 (socket says 172.21.15.7:53708) 2023-10-14T19:08:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26f7fe700 1 -- 172.21.15.7:0/2383889819 learned_addr learned my addr 172.21.15.7:0/2383889819 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:46.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26effd700 1 --2- 172.21.15.7:0/2383889819 >> v2:172.21.15.148:3300/0 conn(0x7ff2701562c0 0x7ff2700ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26dffb700 1 -- 172.21.15.7:0/2383889819 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187470503 0 0) 0x7ff2700ca2b0 con 0x7ff270156690 2023-10-14T19:08:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26dffb700 1 -- 172.21.15.7:0/2383889819 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff258003570 con 0x7ff270156690 2023-10-14T19:08:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26e7fc700 1 -- 172.21.15.7:0/2383889819 >> v2:172.21.15.148:3300/0 conn(0x7ff2701562c0 msgr2=0x7ff2700ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26e7fc700 1 --2- 172.21.15.7:0/2383889819 >> v2:172.21.15.148:3300/0 conn(0x7ff2701562c0 0x7ff2700ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26e7fc700 1 -- 172.21.15.7:0/2383889819 >> v1:172.21.15.7:6789/0 conn(0x7ff270156690 legacy=0x7ff27006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26e7fc700 1 -- 172.21.15.7:0/2383889819 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27006be10 con 0x7ff2700af5c0 2023-10-14T19:08:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.824+0000 7ff26effd700 1 --2- 172.21.15.7:0/2383889819 >> v2:172.21.15.148:3300/0 conn(0x7ff2701562c0 0x7ff2700ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff26e7fc700 1 --2- 172.21.15.7:0/2383889819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff27006b1c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff27006aa40 tx=0x7ff2600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e871065307077df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff26dffb700 1 -- 172.21.15.7:0/2383889819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260011630 con 0x7ff2700af5c0 2023-10-14T19:08:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff26dffb700 1 -- 172.21.15.7:0/2383889819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff260011790 con 0x7ff2700af5c0 2023-10-14T19:08:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff26dffb700 1 -- 172.21.15.7:0/2383889819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260011b30 con 0x7ff2700af5c0 2023-10-14T19:08:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 -- 172.21.15.7:0/2383889819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 msgr2=0x7ff27006b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 --2- 172.21.15.7:0/2383889819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff27006b1c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff27006aa40 tx=0x7ff2600091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 -- 172.21.15.7:0/2383889819 shutdown_connections 2023-10-14T19:08:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 --2- 172.21.15.7:0/2383889819 >> v2:172.21.15.148:3300/0 conn(0x7ff2701562c0 0x7ff2700ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 --2- 172.21.15.7:0/2383889819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff27006b1c0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 -- 172.21.15.7:0/2383889819 >> 172.21.15.7:0/2383889819 conn(0x7ff2700675a0 msgr2=0x7ff2700679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.825+0000 7ff27543d700 1 -- 172.21.15.7:0/2383889819 shutdown_connections 2023-10-14T19:08:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.826+0000 7ff27543d700 1 -- 172.21.15.7:0/2383889819 wait complete. 2023-10-14T19:08:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.827+0000 7ff27543d700 1 Processor -- start 2023-10-14T19:08:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.827+0000 7ff27543d700 1 -- start start 2023-10-14T19:08:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff2701582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2701562c0 0x7ff27016aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff270156690 0x7ff270149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700b1910 con 0x7ff2700af5c0 2023-10-14T19:08:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27016b1e0 con 0x7ff270156690 2023-10-14T19:08:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270149fe0 con 0x7ff2701562c0 2023-10-14T19:08:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff2701582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff2701582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55672/0 (socket says 172.21.15.7:55672) 2023-10-14T19:08:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 -- 172.21.15.7:0/492466345 learned_addr learned my addr 172.21.15.7:0/492466345 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26e7fc700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2701562c0 0x7ff27016aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26f7fe700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff270156690 0x7ff270149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 -- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2701562c0 msgr2=0x7ff27016aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2701562c0 0x7ff27016aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 -- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff270156690 msgr2=0x7ff270149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff270156690 0x7ff270149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 -- 172.21.15.7:0/492466345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff260009420 con 0x7ff2700af5c0 2023-10-14T19:08:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26f7fe700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff270156690 0x7ff270149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff26effd700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff2701582b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff26400e8d0 tx=0x7ff264008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264013410 con 0x7ff2700af5c0 2023-10-14T19:08:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264013570 con 0x7ff2700af5c0 2023-10-14T19:08:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264013910 con 0x7ff2700af5c0 2023-10-14T19:08:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.828+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27016b480 con 0x7ff2700af5c0 2023-10-14T19:08:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.829+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27016ba40 con 0x7ff2700af5c0 2023-10-14T19:08:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.829+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2700b1bf0 con 0x7ff2700af5c0 2023-10-14T19:08:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.830+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ff264013d00 con 0x7ff2700af5c0 2023-10-14T19:08:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.830+0000 7ff256ffd700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff25c067200 0x7ff25c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.830+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff264084800 con 0x7ff2700af5c0 2023-10-14T19:08:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.830+0000 7ff26e7fc700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff25c067200 0x7ff25c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.831+0000 7ff26e7fc700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff25c067200 0x7ff25c0696b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff2700af990 tx=0x7ff260017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:46.835+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2640550a0 con 0x7ff2700af5c0 2023-10-14T19:08:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.076+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff27004c3c0 con 0x7ff2700af5c0 2023-10-14T19:08:47.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.986+0000 7ff256ffd700 1 -- 172.21.15.7:0/492466345 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff264054c30 con 0x7ff2700af5c0 2023-10-14T19:08:47.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff25c067200 msgr2=0x7ff25c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:47.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff25c067200 0x7ff25c0696b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff2700af990 tx=0x7ff260017000 comp rx=0 tx=0).stop 2023-10-14T19:08:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 msgr2=0x7ff2701582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff2701582b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff26400e8d0 tx=0x7ff264008040 comp rx=0 tx=0).stop 2023-10-14T19:08:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 shutdown_connections 2023-10-14T19:08:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff25c067200 0x7ff25c0696b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff270156690 0x7ff270149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2700af5c0 0x7ff2701582b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 --2- 172.21.15.7:0/492466345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2701562c0 0x7ff27016aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 >> 172.21.15.7:0/492466345 conn(0x7ff2700675a0 msgr2=0x7ff2700c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 shutdown_connections 2023-10-14T19:08:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:47.989+0000 7ff27543d700 1 -- 172.21.15.7:0/492466345 wait complete. 2023-10-14T19:08:48.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:08:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.133+0000 7f0cca7f2700 1 Processor -- start 2023-10-14T19:08:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.133+0000 7f0cca7f2700 1 -- start start 2023-10-14T19:08:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cca7f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 0x7f0cc4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cca7f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc406e0e0 0x7f0cc40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cca7f2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40ccfd0 con 0x7f0cc4159530 2023-10-14T19:08:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cca7f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc415a3d0 con 0x7f0cc406dc70 2023-10-14T19:08:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cca7f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415a6b0 con 0x7f0cc406e0e0 2023-10-14T19:08:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cc37fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 0x7f0cc4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.134+0000 7f0cc8d8f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc406e0e0 0x7f0cc40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc37fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 0x7f0cc4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59484/0 (socket says 172.21.15.7:59484) 2023-10-14T19:08:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc37fe700 1 -- 172.21.15.7:0/1060191053 learned_addr learned my addr 172.21.15.7:0/1060191053 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc8d8f700 1 -- 172.21.15.7:0/1060191053 >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 msgr2=0x7f0cc4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc8d8f700 1 --2- 172.21.15.7:0/1060191053 >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 0x7f0cc4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc8d8f700 1 -- 172.21.15.7:0/1060191053 >> v1:172.21.15.148:6789/0 conn(0x7f0cc4159530 legacy=0x7f0cc40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc2ffd700 1 -- 172.21.15.7:0/1060191053 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550185329 0 0) 0x7f0cc40ccfd0 con 0x7f0cc4159530 2023-10-14T19:08:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc8d8f700 1 -- 172.21.15.7:0/1060191053 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc415a990 con 0x7f0cc406e0e0 2023-10-14T19:08:48.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/1060191053 >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 0x7f0cc4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:48.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc8d8f700 1 --2- 172.21.15.7:0/1060191053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc406e0e0 0x7f0cc40cb6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009e60 tx=0x7f0cbc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8776d09ff51c84bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:48.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc2ffd700 1 -- 172.21.15.7:0/1060191053 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00e070 con 0x7f0cc406e0e0 2023-10-14T19:08:48.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc2ffd700 1 -- 172.21.15.7:0/1060191053 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00bb60 con 0x7f0cc406e0e0 2023-10-14T19:08:48.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.135+0000 7f0cc2ffd700 1 -- 172.21.15.7:0/1060191053 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc012430 con 0x7f0cc406e0e0 2023-10-14T19:08:48.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 -- 172.21.15.7:0/1060191053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc406e0e0 msgr2=0x7f0cc40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:48.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/1060191053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc406e0e0 0x7f0cc40cb6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009e60 tx=0x7f0cbc009780 comp rx=0 tx=0).stop 2023-10-14T19:08:48.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 -- 172.21.15.7:0/1060191053 shutdown_connections 2023-10-14T19:08:48.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/1060191053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc406e0e0 0x7f0cc40cb6f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/1060191053 >> v2:172.21.15.148:3300/0 conn(0x7f0cc406dc70 0x7f0cc4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 -- 172.21.15.7:0/1060191053 >> 172.21.15.7:0/1060191053 conn(0x7f0cc40703a0 msgr2=0x7f0cc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:48.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 -- 172.21.15.7:0/1060191053 shutdown_connections 2023-10-14T19:08:48.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.136+0000 7f0cca7f2700 1 -- 172.21.15.7:0/1060191053 wait complete. 2023-10-14T19:08:48.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.137+0000 7f0cca7f2700 1 Processor -- start 2023-10-14T19:08:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.137+0000 7f0cca7f2700 1 -- start start 2023-10-14T19:08:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cca7f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cc406dc70 0x7f0cc415d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cca7f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 0x7f0cc416cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cca7f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc4159530 0x7f0cc416d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cca7f2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40b4240 con 0x7f0cc406e0e0 2023-10-14T19:08:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cca7f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4151900 con 0x7f0cc406dc70 2023-10-14T19:08:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cca7f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc416db30 con 0x7f0cc4159530 2023-10-14T19:08:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 0x7f0cc416cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 0x7f0cc416cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55682/0 (socket says 172.21.15.7:55682) 2023-10-14T19:08:48.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 -- 172.21.15.7:0/3461490323 learned_addr learned my addr 172.21.15.7:0/3461490323 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:48.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc8d8f700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc4159530 0x7f0cc416d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:48.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cc406dc70 0x7f0cc415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:48.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 -- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc4159530 msgr2=0x7f0cc416d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:48.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc4159530 0x7f0cc416d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 -- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cc406dc70 msgr2=0x7f0cc415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cc406dc70 0x7f0cc415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.138+0000 7f0cc37fe700 1 -- 172.21.15.7:0/3461490323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac0094f0 con 0x7f0cc406e0e0 2023-10-14T19:08:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.139+0000 7f0cc37fe700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 0x7f0cc416cf90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00ec80 tx=0x7f0cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.139+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00c9d0 con 0x7f0cc406e0e0 2023-10-14T19:08:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.139+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00cb30 con 0x7f0cc406e0e0 2023-10-14T19:08:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.139+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc009a20 con 0x7f0cc406e0e0 2023-10-14T19:08:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.139+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00ceb0 con 0x7f0cc406e0e0 2023-10-14T19:08:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.139+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc40b3f50 con 0x7f0cc406e0e0 2023-10-14T19:08:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.140+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc404c3c0 con 0x7f0cc406e0e0 2023-10-14T19:08:48.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.140+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0cac013680 con 0x7f0cc406e0e0 2023-10-14T19:08:48.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.141+0000 7f0cbbfff700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ca4067200 0x7f0ca40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:48.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.141+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0cac085170 con 0x7f0cc406e0e0 2023-10-14T19:08:48.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.141+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ca4067200 0x7f0ca40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:48.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.141+0000 7f0cc3fff700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ca4067200 0x7f0ca40696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4003820 tx=0x7f0cb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:48.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.145+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cac052090 con 0x7f0cc406e0e0 2023-10-14T19:08:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.386+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0cc40b4380 con 0x7f0cc406e0e0 2023-10-14T19:08:48.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:48.808 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.987+0000 7f0cbbfff700 1 -- 172.21.15.7:0/3461490323 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0cac0556b0 con 0x7f0cc406e0e0 2023-10-14T19:08:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ca4067200 msgr2=0x7f0ca40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ca4067200 0x7f0ca40696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4003820 tx=0x7f0cb4009040 comp rx=0 tx=0).stop 2023-10-14T19:08:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 msgr2=0x7f0cc416cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 0x7f0cc416cf90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00ec80 tx=0x7f0cac009250 comp rx=0 tx=0).stop 2023-10-14T19:08:48.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 shutdown_connections 2023-10-14T19:08:48.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ca4067200 0x7f0ca40696b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cc406dc70 0x7f0cc415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0cc4159530 0x7f0cc416d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 --2- 172.21.15.7:0/3461490323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc406e0e0 0x7f0cc416cf90 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 >> 172.21.15.7:0/3461490323 conn(0x7f0cc40703a0 msgr2=0x7f0cc40cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 shutdown_connections 2023-10-14T19:08:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:48.990+0000 7f0cca7f2700 1 -- 172.21.15.7:0/3461490323 wait complete. 2023-10-14T19:08:49.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.127+0000 7f3fe4d81700 1 Processor -- start 2023-10-14T19:08:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.128+0000 7f3fe4d81700 1 -- start start 2023-10-14T19:08:49.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.128+0000 7f3fe4d81700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3fe00cb5a0 0x7f3fe00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.128+0000 7f3fe4d81700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 0x7f3fe0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fe4d81700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe015ae40 con 0x7f3fe00cd9e0 2023-10-14T19:08:49.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fe4d81700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00d13f0 con 0x7f3fe00cb5a0 2023-10-14T19:08:49.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fe4d81700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe015ab60 con 0x7f3fe015a5d0 2023-10-14T19:08:49.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fded9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 0x7f3fe0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3fe00cb5a0 0x7f3fe00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3fe00cb5a0 0x7f3fe00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59498/0 (socket says 172.21.15.7:59498) 2023-10-14T19:08:49.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 -- 172.21.15.7:0/3530239850 learned_addr learned my addr 172.21.15.7:0/3530239850 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:49.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fded9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 0x7f3fe0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:37766/0 (socket says 172.21.15.7:37766) 2023-10-14T19:08:49.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fddd9b700 1 --1- 172.21.15.7:0/3530239850 >> v1:172.21.15.148:6789/0 conn(0x7f3fe00cd9e0 0x7f3fe0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36958/0 (socket says 172.21.15.7:36958) 2023-10-14T19:08:49.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 -- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 msgr2=0x7f3fe0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:49.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 --2- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 0x7f3fe0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 -- 172.21.15.7:0/3530239850 >> v1:172.21.15.148:6789/0 conn(0x7f3fe00cd9e0 legacy=0x7f3fe0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 -- 172.21.15.7:0/3530239850 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00ccf00 con 0x7f3fe00cb5a0 2023-10-14T19:08:49.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fded9d700 1 --2- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 0x7f3fe0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:49.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.129+0000 7f3fde59c700 1 --2- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cb5a0 0x7f3fe00cb970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80099e0 tx=0x7f3fd8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6fe5924ed5e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fdd59a700 1 -- 172.21.15.7:0/3530239850 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800b820 con 0x7f3fe00cb5a0 2023-10-14T19:08:49.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fdd59a700 1 -- 172.21.15.7:0/3530239850 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800b980 con 0x7f3fe00cb5a0 2023-10-14T19:08:49.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fdd59a700 1 -- 172.21.15.7:0/3530239850 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800bd20 con 0x7f3fe00cb5a0 2023-10-14T19:08:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 -- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cb5a0 msgr2=0x7f3fe00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cb5a0 0x7f3fe00cb970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80099e0 tx=0x7f3fd8009250 comp rx=0 tx=0).stop 2023-10-14T19:08:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 -- 172.21.15.7:0/3530239850 shutdown_connections 2023-10-14T19:08:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe015a5d0 0x7f3fe0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/3530239850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cb5a0 0x7f3fe00cb970 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 -- 172.21.15.7:0/3530239850 >> 172.21.15.7:0/3530239850 conn(0x7f3fe0070e30 msgr2=0x7f3fe00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 -- 172.21.15.7:0/3530239850 shutdown_connections 2023-10-14T19:08:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.130+0000 7f3fe4d81700 1 -- 172.21.15.7:0/3530239850 wait complete. 2023-10-14T19:08:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.131+0000 7f3fe4d81700 1 Processor -- start 2023-10-14T19:08:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.131+0000 7f3fe4d81700 1 -- start start 2023-10-14T19:08:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fe4d81700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe00cb5a0 0x7f3fe0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fe4d81700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cd9e0 0x7f3fe016a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fe4d81700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 0x7f3fe0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fe4d81700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe016c100 con 0x7f3fe015a5d0 2023-10-14T19:08:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fe4d81700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe016aed0 con 0x7f3fe00cd9e0 2023-10-14T19:08:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fe4d81700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0158ff0 con 0x7f3fe00cb5a0 2023-10-14T19:08:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fded9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 0x7f3fe0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fded9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 0x7f3fe0158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55694/0 (socket says 172.21.15.7:55694) 2023-10-14T19:08:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fded9d700 1 -- 172.21.15.7:0/39040841 learned_addr learned my addr 172.21.15.7:0/39040841 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fde59c700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe00cb5a0 0x7f3fe0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.132+0000 7f3fddd9b700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cd9e0 0x7f3fe016a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fded9d700 1 -- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe00cb5a0 msgr2=0x7f3fe0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fded9d700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe00cb5a0 0x7f3fe0156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fded9d700 1 -- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cd9e0 msgr2=0x7f3fe016a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fded9d700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cd9e0 0x7f3fe016a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fded9d700 1 -- 172.21.15.7:0/39040841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009a20 con 0x7f3fe015a5d0 2023-10-14T19:08:49.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fded9d700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 0x7f3fe0158ab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009f20 tx=0x7f3fd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000cb70 con 0x7f3fe015a5d0 2023-10-14T19:08:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000f040 con 0x7f3fe015a5d0 2023-10-14T19:08:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd80094f0 con 0x7f3fe015a5d0 2023-10-14T19:08:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0014480 con 0x7f3fe015a5d0 2023-10-14T19:08:49.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.133+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe016b7d0 con 0x7f3fe015a5d0 2023-10-14T19:08:49.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.134+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe016c270 con 0x7f3fe015a5d0 2023-10-14T19:08:49.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.134+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3fd0003020 con 0x7f3fe015a5d0 2023-10-14T19:08:49.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.135+0000 7f3fd67fc700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3fc0067200 0x7f3fc00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.135+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fd00852f0 con 0x7f3fe015a5d0 2023-10-14T19:08:49.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.135+0000 7f3fde59c700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3fc0067200 0x7f3fc00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.135+0000 7f3fde59c700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3fc0067200 0x7f3fc00696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80099e0 tx=0x7f3fd8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.139+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd0052100 con 0x7f3fe015a5d0 2023-10-14T19:08:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.374+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe004c3c0 con 0x7f3fe015a5d0 2023-10-14T19:08:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.375+0000 7f3fd67fc700 1 -- 172.21.15.7:0/39040841 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3fd0055720 con 0x7f3fe015a5d0 2023-10-14T19:08:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:49.377 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:45.357460+0000","modified":"2023-10-14T19:08:48.985870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6408":{"gid":6408,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/2588094250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2588094250},{"type":"v1","addr":"172.21.15.7:6835","nonce":2588094250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T19:08:49.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3fc0067200 msgr2=0x7f3fc00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3fc0067200 0x7f3fc00696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80099e0 tx=0x7f3fd8017000 comp rx=0 tx=0).stop 2023-10-14T19:08:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 msgr2=0x7f3fe0158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 0x7f3fe0158ab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009f20 tx=0x7f3fd000b040 comp rx=0 tx=0).stop 2023-10-14T19:08:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 shutdown_connections 2023-10-14T19:08:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3fc0067200 0x7f3fc00696b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe015a5d0 0x7f3fe0158ab0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fe00cb5a0 0x7f3fe0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 --2- 172.21.15.7:0/39040841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe00cd9e0 0x7f3fe016a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 >> 172.21.15.7:0/39040841 conn(0x7f3fe0070e30 msgr2=0x7f3fe00b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 shutdown_connections 2023-10-14T19:08:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.377+0000 7f3fe4d81700 1 -- 172.21.15.7:0/39040841 wait complete. 2023-10-14T19:08:49.381 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 56 2023-10-14T19:08:49.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.510+0000 7f8e5deae700 1 Processor -- start 2023-10-14T19:08:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.510+0000 7f8e5deae700 1 -- start start 2023-10-14T19:08:49.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e5deae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 0x7f8e58159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e5deae700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e5815aa20 0x7f8e58163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e5deae700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5806c7d0 con 0x7f8e580c3250 2023-10-14T19:08:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e5deae700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e581171e0 con 0x7f8e5815aa20 2023-10-14T19:08:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e5deae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c37a0 con 0x7f8e58143200 2023-10-14T19:08:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e56ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8e580c3250 0x7f8e5815a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53714/0 (socket says 172.21.15.7:53714) 2023-10-14T19:08:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.511+0000 7f8e56ffd700 1 -- 172.21.15.7:0/4285252591 learned_addr learned my addr 172.21.15.7:0/4285252591 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e57fff700 1 --2- 172.21.15.7:0/4285252591 >> v2:172.21.15.148:3300/0 conn(0x7f8e5815aa20 0x7f8e58163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e577fe700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 0x7f8e58159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569550599 0 0) 0x7f8e5806c7d0 con 0x7f8e580c3250 2023-10-14T19:08:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e40003570 con 0x7f8e580c3250 2023-10-14T19:08:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700494929 0 0) 0x7f8e40003570 con 0x7f8e580c3250 2023-10-14T19:08:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 msgr2=0x7f8e58159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 0x7f8e58159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 >> v2:172.21.15.148:3300/0 conn(0x7f8e5815aa20 msgr2=0x7f8e58163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 --2- 172.21.15.7:0/4285252591 >> v2:172.21.15.148:3300/0 conn(0x7f8e5815aa20 0x7f8e58163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e580cc090 con 0x7f8e580c3250 2023-10-14T19:08:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8e4c001470 con 0x7f8e580c3250 2023-10-14T19:08:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 >> v1:172.21.15.7:6789/0 conn(0x7f8e580c3250 legacy=0x7f8e5815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e40003a60 0x7f8e40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 0x7f8e40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e40004d50 0x7f8e400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c37a0 con 0x7f8e40003a60 2023-10-14T19:08:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4000ba60 con 0x7f8e40004d50 2023-10-14T19:08:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4000bba0 con 0x7f8e58143200 2023-10-14T19:08:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e57fff700 1 --2- 172.21.15.7:0/4285252591 >> v2:172.21.15.148:3300/0 conn(0x7f8e5815aa20 0x7f8e58163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e577fe700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e40003a60 0x7f8e40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e56ffd700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 0x7f8e40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.512+0000 7f8e57fff700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e40004d50 0x7f8e400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e577fe700 1 -- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 msgr2=0x7f8e40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e577fe700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e58143200 0x7f8e40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e577fe700 1 -- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e40004d50 msgr2=0x7f8e400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e577fe700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e40004d50 0x7f8e400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e577fe700 1 -- 172.21.15.7:0/4285252591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40003570 con 0x7f8e40003a60 2023-10-14T19:08:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e57fff700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e40004d50 0x7f8e400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e577fe700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e40003a60 0x7f8e40003e70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009c00 tx=0x7f8e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8806208f74712f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800e6b0 con 0x7f8e40003a60 2023-10-14T19:08:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800e810 con 0x7f8e40003a60 2023-10-14T19:08:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e567fc700 1 -- 172.21.15.7:0/4285252591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800ebd0 con 0x7f8e40003a60 2023-10-14T19:08:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e5deae700 1 -- 172.21.15.7:0/4285252591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e40003a60 msgr2=0x7f8e40003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e5deae700 1 --2- 172.21.15.7:0/4285252591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e40003a60 0x7f8e40003e70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009c00 tx=0x7f8e480091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e57fff700 1 -- 172.21.15.7:0/4285252591 reap_dead start 2023-10-14T19:08:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e5deae700 1 -- 172.21.15.7:0/4285252591 shutdown_connections 2023-10-14T19:08:49.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e5deae700 1 -- 172.21.15.7:0/4285252591 >> 172.21.15.7:0/4285252591 conn(0x7f8e580ccb60 msgr2=0x7f8e580ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:49.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e5deae700 1 -- 172.21.15.7:0/4285252591 shutdown_connections 2023-10-14T19:08:49.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.513+0000 7f8e5deae700 1 -- 172.21.15.7:0/4285252591 wait complete. 2023-10-14T19:08:49.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 Processor -- start 2023-10-14T19:08:49.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 -- start start 2023-10-14T19:08:49.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e40003a60 0x7f8e5813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 0x7f8e5815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58143f90 0x7f8e58144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5815e8c0 con 0x7f8e5815df10 2023-10-14T19:08:49.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58169690 con 0x7f8e58143f90 2023-10-14T19:08:49.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.515+0000 7f8e5deae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58144c80 con 0x7f8e40003a60 2023-10-14T19:08:49.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 0x7f8e5815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 0x7f8e5815e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55718/0 (socket says 172.21.15.7:55718) 2023-10-14T19:08:49.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 -- 172.21.15.7:0/1379526493 learned_addr learned my addr 172.21.15.7:0/1379526493 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:49.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e577fe700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e40003a60 0x7f8e5813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e57fff700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58143f90 0x7f8e58144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 -- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e40003a60 msgr2=0x7f8e5813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e40003a60 0x7f8e5813cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 -- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58143f90 msgr2=0x7f8e58144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58143f90 0x7f8e58144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 -- 172.21.15.7:0/1379526493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58144f60 con 0x7f8e5815df10 2023-10-14T19:08:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e56ffd700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 0x7f8e5815e380 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007390 tx=0x7f8e580cd850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c018030 con 0x7f8e5815df10 2023-10-14T19:08:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00f920 con 0x7f8e5815df10 2023-10-14T19:08:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e58145240 con 0x7f8e5815df10 2023-10-14T19:08:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00fcc0 con 0x7f8e5815df10 2023-10-14T19:08:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.516+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5813d170 con 0x7f8e5815df10 2023-10-14T19:08:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.517+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5804c3c0 con 0x7f8e5815df10 2023-10-14T19:08:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.518+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8e4c01b070 con 0x7f8e5815df10 2023-10-14T19:08:49.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.518+0000 7f8e3f7fe700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e44067200 0x7f8e440696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.518+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e4c019070 con 0x7f8e5815df10 2023-10-14T19:08:49.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.518+0000 7f8e577fe700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e44067200 0x7f8e440696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.519+0000 7f8e577fe700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e44067200 0x7f8e440696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e480091e0 tx=0x7f8e4801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.522+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e4c051940 con 0x7f8e5815df10 2023-10-14T19:08:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.717+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e580cc370 con 0x7f8e5815df10 2023-10-14T19:08:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.718+0000 7f8e3f7fe700 1 -- 172.21.15.7:0/1379526493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f8e4c054f60 con 0x7f8e5815df10 2023-10-14T19:08:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:49.719 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:46.969334+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:43.793528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:44.327457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e44067200 msgr2=0x7f8e440696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e44067200 0x7f8e440696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e480091e0 tx=0x7f8e4801a000 comp rx=0 tx=0).stop 2023-10-14T19:08:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 msgr2=0x7f8e5815e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 0x7f8e5815e380 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007390 tx=0x7f8e580cd850 comp rx=0 tx=0).stop 2023-10-14T19:08:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 shutdown_connections 2023-10-14T19:08:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e44067200 0x7f8e440696b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58143f90 0x7f8e58144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e40003a60 0x7f8e5813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 --2- 172.21.15.7:0/1379526493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5815df10 0x7f8e5815e380 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 >> 172.21.15.7:0/1379526493 conn(0x7f8e580ccb60 msgr2=0x7f8e58140b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 shutdown_connections 2023-10-14T19:08:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.720+0000 7f8e5deae700 1 -- 172.21.15.7:0/1379526493 wait complete. 2023-10-14T19:08:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:08:49.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:08:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.852+0000 7f8e8ba44700 1 Processor -- start 2023-10-14T19:08:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.852+0000 7f8e8ba44700 1 -- start start 2023-10-14T19:08:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e8ba44700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e840b07d0 0x7f8e840ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e8ba44700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8415a280 con 0x7f8e840cf200 2023-10-14T19:08:49.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e8ba44700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8406e180 con 0x7f8e840b0ba0 2023-10-14T19:08:49.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e8ba44700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8406d850 con 0x7f8e840b07d0 2023-10-14T19:08:49.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e897e0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e840b07d0 0x7f8e840ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e88fdf700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8e840cf200 0x7f8e8406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53726/0 (socket says 172.21.15.7:53726) 2023-10-14T19:08:49.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e88fdf700 1 -- 172.21.15.7:0/3428178623 learned_addr learned my addr 172.21.15.7:0/3428178623 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:49.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e897e0700 1 -- 172.21.15.7:0/3428178623 >> v1:172.21.15.148:6789/0 conn(0x7f8e840b0ba0 legacy=0x7f8e8406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:49.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e897e0700 1 -- 172.21.15.7:0/3428178623 >> v1:172.21.15.7:6789/0 conn(0x7f8e840cf200 legacy=0x7f8e8406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e897e0700 1 -- 172.21.15.7:0/3428178623 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8406db30 con 0x7f8e840b07d0 2023-10-14T19:08:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.853+0000 7f8e83fff700 1 -- 172.21.15.7:0/3428178623 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045659979 0 0) 0x7f8e8415a280 con 0x7f8e840cf200 2023-10-14T19:08:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e897e0700 1 --2- 172.21.15.7:0/3428178623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840ccac0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009eb0 tx=0x7f8e7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7603c06208c2b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e83fff700 1 -- 172.21.15.7:0/3428178623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00e070 con 0x7f8e840b07d0 2023-10-14T19:08:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e83fff700 1 -- 172.21.15.7:0/3428178623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c00bc80 con 0x7f8e840b07d0 2023-10-14T19:08:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e83fff700 1 -- 172.21.15.7:0/3428178623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c012430 con 0x7f8e840b07d0 2023-10-14T19:08:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 -- 172.21.15.7:0/3428178623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 msgr2=0x7f8e840ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/3428178623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840ccac0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009eb0 tx=0x7f8e7c009780 comp rx=0 tx=0).stop 2023-10-14T19:08:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 -- 172.21.15.7:0/3428178623 shutdown_connections 2023-10-14T19:08:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/3428178623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840ccac0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 -- 172.21.15.7:0/3428178623 >> 172.21.15.7:0/3428178623 conn(0x7f8e8406ce80 msgr2=0x7f8e840ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 -- 172.21.15.7:0/3428178623 shutdown_connections 2023-10-14T19:08:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.854+0000 7f8e8ba44700 1 -- 172.21.15.7:0/3428178623 wait complete. 2023-10-14T19:08:49.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 Processor -- start 2023-10-14T19:08:49.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 -- start start 2023-10-14T19:08:49.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e840b0ba0 0x7f8e8409bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e840cf200 0x7f8e84098e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8409b7d0 con 0x7f8e840b07d0 2023-10-14T19:08:49.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8409c1a0 con 0x7f8e840cf200 2023-10-14T19:08:49.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.856+0000 7f8e8ba44700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8409af20 con 0x7f8e840b0ba0 2023-10-14T19:08:49.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55746/0 (socket says 172.21.15.7:55746) 2023-10-14T19:08:49.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 -- 172.21.15.7:0/1518752804 learned_addr learned my addr 172.21.15.7:0/1518752804 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:49.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e88fdf700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e840b0ba0 0x7f8e8409bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e89fe1700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e840cf200 0x7f8e84098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 -- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e840b0ba0 msgr2=0x7f8e8409bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e840b0ba0 0x7f8e8409bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 -- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e840cf200 msgr2=0x7f8e84098e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:49.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e840cf200 0x7f8e84098e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:49.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 -- 172.21.15.7:0/1518752804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009a20 con 0x7f8e840b07d0 2023-10-14T19:08:49.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e897e0700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840b3e30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097c0 tx=0x7f8e7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c027470 con 0x7f8e840b07d0 2023-10-14T19:08:49.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0275d0 con 0x7f8e840b07d0 2023-10-14T19:08:49.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c027990 con 0x7f8e840b07d0 2023-10-14T19:08:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8409b1c0 con 0x7f8e840b07d0 2023-10-14T19:08:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.857+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e840997a0 con 0x7f8e840b07d0 2023-10-14T19:08:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.858+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8404c3c0 con 0x7f8e840b07d0 2023-10-14T19:08:49.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.859+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8e7c024070 con 0x7f8e840b07d0 2023-10-14T19:08:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.859+0000 7f8e817fa700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e70067200 0x7f8e700696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.859+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e7c087170 con 0x7f8e840b07d0 2023-10-14T19:08:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.859+0000 7f8e88fdf700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e70067200 0x7f8e700696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:49.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.860+0000 7f8e88fdf700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e70067200 0x7f8e700696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e84098cd0 tx=0x7f8e78007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:49.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:49.864+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e7c054090 con 0x7f8e840b07d0 2023-10-14T19:08:50.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.053+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e8409b910 con 0x7f8e70067200 2023-10-14T19:08:50.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.062+0000 7f8e817fa700 1 -- 172.21.15.7:0/1518752804 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289634 (secure 0 0 0) 0x7f8e780058a0 con 0x7f8e70067200 2023-10-14T19:08:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:50.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e70067200 msgr2=0x7f8e700696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e70067200 0x7f8e700696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e84098cd0 tx=0x7f8e78007f50 comp rx=0 tx=0).stop 2023-10-14T19:08:50.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 msgr2=0x7f8e840b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840b3e30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097c0 tx=0x7f8e7c016000 comp rx=0 tx=0).stop 2023-10-14T19:08:50.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 shutdown_connections 2023-10-14T19:08:50.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8e70067200 0x7f8e700696b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e840cf200 0x7f8e84098e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e840b07d0 0x7f8e840b3e30 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 --2- 172.21.15.7:0/1518752804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e840b0ba0 0x7f8e8409bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 >> 172.21.15.7:0/1518752804 conn(0x7f8e8406ce80 msgr2=0x7f8e84069020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:50.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 shutdown_connections 2023-10-14T19:08:50.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.065+0000 7f8e8ba44700 1 -- 172.21.15.7:0/1518752804 wait complete. 2023-10-14T19:08:50.071 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:08:50.078 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2023-10-14T19:08:49.705007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408664,"kb_used_data":9880,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566056,"statfs":{"total":773094113280,"available":770627641344,"internally_reserved":0,"allocated":10117120,"data_stored":4994196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.759916"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983634+0000","last_change":"2023-10-14T19:08:45.983634+0000","last_active":"2023-10-14T19:08:45.983634+0000","last_peered":"2023-10-14T19:08:45.983634+0000","last_clean":"2023-10-14T19:08:45.983634+0000","last_became_active":"2023-10-14T19:08:45.983379+0000","last_became_peered":"2023-10-14T19:08:45.983379+0000","last_unstale":"2023-10-14T19:08:45.983634+0000","last_undegraded":"2023-10-14T19:08:45.983634+0000","last_fullsized":"2023-10-14T19:08:45.983634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:40.006894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981989+0000","last_change":"2023-10-14T19:08:45.974462+0000","last_active":"2023-10-14T19:08:45.981989+0000","last_peered":"2023-10-14T19:08:45.981989+0000","last_clean":"2023-10-14T19:08:45.981989+0000","last_became_active":"2023-10-14T19:08:45.974111+0000","last_became_peered":"2023-10-14T19:08:45.974111+0000","last_unstale":"2023-10-14T19:08:45.981989+0000","last_undegraded":"2023-10-14T19:08:45.981989+0000","last_fullsized":"2023-10-14T19:08:45.981989+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:53.552708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981664+0000","last_change":"2023-10-14T19:08:45.981664+0000","last_active":"2023-10-14T19:08:45.981664+0000","last_peered":"2023-10-14T19:08:45.981664+0000","last_clean":"2023-10-14T19:08:45.981664+0000","last_became_active":"2023-10-14T19:08:45.981363+0000","last_became_peered":"2023-10-14T19:08:45.981363+0000","last_unstale":"2023-10-14T19:08:45.981664+0000","last_undegraded":"2023-10-14T19:08:45.981664+0000","last_fullsized":"2023-10-14T19:08:45.981664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:44.899339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.975014+0000","last_change":"2023-10-14T19:08:45.975014+0000","last_active":"2023-10-14T19:08:45.975014+0000","last_peered":"2023-10-14T19:08:45.975014+0000","last_clean":"2023-10-14T19:08:45.975014+0000","last_became_active":"2023-10-14T19:08:45.974744+0000","last_became_peered":"2023-10-14T19:08:45.974744+0000","last_unstale":"2023-10-14T19:08:45.975014+0000","last_undegraded":"2023-10-14T19:08:45.975014+0000","last_fullsized":"2023-10-14T19:08:45.975014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:05:24.393337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987069+0000","last_change":"2023-10-14T19:08:45.980473+0000","last_active":"2023-10-14T19:08:45.987069+0000","last_peered":"2023-10-14T19:08:45.987069+0000","last_clean":"2023-10-14T19:08:45.987069+0000","last_became_active":"2023-10-14T19:08:45.980220+0000","last_became_peered":"2023-10-14T19:08:45.980220+0000","last_unstale":"2023-10-14T19:08:45.987069+0000","last_undegraded":"2023-10-14T19:08:45.987069+0000","last_fullsized":"2023-10-14T19:08:45.987069+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:38.017926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985108+0000","last_change":"2023-10-14T19:08:45.985108+0000","last_active":"2023-10-14T19:08:45.985108+0000","last_peered":"2023-10-14T19:08:45.985108+0000","last_clean":"2023-10-14T19:08:45.985108+0000","last_became_active":"2023-10-14T19:08:45.984852+0000","last_became_peered":"2023-10-14T19:08:45.984852+0000","last_unstale":"2023-10-14T19:08:45.985108+0000","last_undegraded":"2023-10-14T19:08:45.985108+0000","last_fullsized":"2023-10-14T19:08:45.985108+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:27.853080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985288+0000","last_change":"2023-10-14T19:08:45.985288+0000","last_active":"2023-10-14T19:08:45.985288+0000","last_peered":"2023-10-14T19:08:45.985288+0000","last_clean":"2023-10-14T19:08:45.985288+0000","last_became_active":"2023-10-14T19:08:45.983684+0000","last_became_peered":"2023-10-14T19:08:45.983684+0000","last_unstale":"2023-10-14T19:08:45.985288+0000","last_undegraded":"2023-10-14T19:08:45.985288+0000","last_fullsized":"2023-10-14T19:08:45.985288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:43.390840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985207+0000","last_change":"2023-10-14T19:08:45.980163+0000","last_active":"2023-10-14T19:08:45.985207+0000","last_peered":"2023-10-14T19:08:45.985207+0000","last_clean":"2023-10-14T19:08:45.985207+0000","last_became_active":"2023-10-14T19:08:45.979895+0000","last_became_peered":"2023-10-14T19:08:45.979895+0000","last_unstale":"2023-10-14T19:08:45.985207+0000","last_undegraded":"2023-10-14T19:08:45.985207+0000","last_fullsized":"2023-10-14T19:08:45.985207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:30.669427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985788+0000","last_change":"2023-10-14T19:08:45.980169+0000","last_active":"2023-10-14T19:08:45.985788+0000","last_peered":"2023-10-14T19:08:45.985788+0000","last_clean":"2023-10-14T19:08:45.985788+0000","last_became_active":"2023-10-14T19:08:45.979893+0000","last_became_peered":"2023-10-14T19:08:45.979893+0000","last_unstale":"2023-10-14T19:08:45.985788+0000","last_undegraded":"2023-10-14T19:08:45.985788+0000","last_fullsized":"2023-10-14T19:08:45.985788+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:51:44.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986835+0000","last_change":"2023-10-14T19:08:45.981786+0000","last_active":"2023-10-14T19:08:45.986835+0000","last_peered":"2023-10-14T19:08:45.986835+0000","last_clean":"2023-10-14T19:08:45.986835+0000","last_became_active":"2023-10-14T19:08:45.981514+0000","last_became_peered":"2023-10-14T19:08:45.981514+0000","last_unstale":"2023-10-14T19:08:45.986835+0000","last_undegraded":"2023-10-14T19:08:45.986835+0000","last_fullsized":"2023-10-14T19:08:45.986835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:23.382757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985089+0000","last_change":"2023-10-14T19:08:45.985089+0000","last_active":"2023-10-14T19:08:45.985089+0000","last_peered":"2023-10-14T19:08:45.985089+0000","last_clean":"2023-10-14T19:08:45.985089+0000","last_became_active":"2023-10-14T19:08:45.984793+0000","last_became_peered":"2023-10-14T19:08:45.984793+0000","last_unstale":"2023-10-14T19:08:45.985089+0000","last_undegraded":"2023-10-14T19:08:45.985089+0000","last_fullsized":"2023-10-14T19:08:45.985089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:21.897908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991820+0000","last_change":"2023-10-14T19:08:45.984005+0000","last_active":"2023-10-14T19:08:45.991820+0000","last_peered":"2023-10-14T19:08:45.991820+0000","last_clean":"2023-10-14T19:08:45.991820+0000","last_became_active":"2023-10-14T19:08:45.983760+0000","last_became_peered":"2023-10-14T19:08:45.983760+0000","last_unstale":"2023-10-14T19:08:45.991820+0000","last_undegraded":"2023-10-14T19:08:45.991820+0000","last_fullsized":"2023-10-14T19:08:45.991820+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:21:40.105654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980482+0000","last_change":"2023-10-14T19:08:45.980482+0000","last_active":"2023-10-14T19:08:45.980482+0000","last_peered":"2023-10-14T19:08:45.980482+0000","last_clean":"2023-10-14T19:08:45.980482+0000","last_became_active":"2023-10-14T19:08:45.980202+0000","last_became_peered":"2023-10-14T19:08:45.980202+0000","last_unstale":"2023-10-14T19:08:45.980482+0000","last_undegraded":"2023-10-14T19:08:45.980482+0000","last_fullsized":"2023-10-14T19:08:45.980482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:43.390840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984686+0000","last_change":"2023-10-14T19:08:45.981674+0000","last_active":"2023-10-14T19:08:45.984686+0000","last_peered":"2023-10-14T19:08:45.984686+0000","last_clean":"2023-10-14T19:08:45.984686+0000","last_became_active":"2023-10-14T19:08:45.981043+0000","last_became_peered":"2023-10-14T19:08:45.981043+0000","last_unstale":"2023-10-14T19:08:45.984686+0000","last_undegraded":"2023-10-14T19:08:45.984686+0000","last_fullsized":"2023-10-14T19:08:45.984686+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:12.546499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983378+0000","last_change":"2023-10-14T19:08:45.983378+0000","last_active":"2023-10-14T19:08:45.983378+0000","last_peered":"2023-10-14T19:08:45.983378+0000","last_clean":"2023-10-14T19:08:45.983378+0000","last_became_active":"2023-10-14T19:08:45.983100+0000","last_became_peered":"2023-10-14T19:08:45.983100+0000","last_unstale":"2023-10-14T19:08:45.983378+0000","last_undegraded":"2023-10-14T19:08:45.983378+0000","last_fullsized":"2023-10-14T19:08:45.983378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:26.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986100+0000","last_change":"2023-10-14T19:08:45.986100+0000","last_active":"2023-10-14T19:08:45.986100+0000","last_peered":"2023-10-14T19:08:45.986100+0000","last_clean":"2023-10-14T19:08:45.986100+0000","last_became_active":"2023-10-14T19:08:45.985699+0000","last_became_peered":"2023-10-14T19:08:45.985699+0000","last_unstale":"2023-10-14T19:08:45.986100+0000","last_undegraded":"2023-10-14T19:08:45.986100+0000","last_fullsized":"2023-10-14T19:08:45.986100+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:40.059172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.977417+0000","last_change":"2023-10-14T19:08:45.970500+0000","last_active":"2023-10-14T19:08:45.977417+0000","last_peered":"2023-10-14T19:08:45.977417+0000","last_clean":"2023-10-14T19:08:45.977417+0000","last_became_active":"2023-10-14T19:08:45.970223+0000","last_became_peered":"2023-10-14T19:08:45.970223+0000","last_unstale":"2023-10-14T19:08:45.977417+0000","last_undegraded":"2023-10-14T19:08:45.977417+0000","last_fullsized":"2023-10-14T19:08:45.977417+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:19.807986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.974372+0000","last_change":"2023-10-14T19:08:45.974372+0000","last_active":"2023-10-14T19:08:45.974372+0000","last_peered":"2023-10-14T19:08:45.974372+0000","last_clean":"2023-10-14T19:08:45.974372+0000","last_became_active":"2023-10-14T19:08:45.974051+0000","last_became_peered":"2023-10-14T19:08:45.974051+0000","last_unstale":"2023-10-14T19:08:45.974372+0000","last_undegraded":"2023-10-14T19:08:45.974372+0000","last_fullsized":"2023-10-14T19:08:45.974372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:27.853080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984673+0000","last_change":"2023-10-14T19:08:45.982376+0000","last_active":"2023-10-14T19:08:45.984673+0000","last_peered":"2023-10-14T19:08:45.984673+0000","last_clean":"2023-10-14T19:08:45.984673+0000","last_became_active":"2023-10-14T19:08:45.982072+0000","last_became_peered":"2023-10-14T19:08:45.982072+0000","last_unstale":"2023-10-14T19:08:45.984673+0000","last_undegraded":"2023-10-14T19:08:45.984673+0000","last_fullsized":"2023-10-14T19:08:45.984673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:52:40.325412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981127+0000","last_change":"2023-10-14T19:08:45.977700+0000","last_active":"2023-10-14T19:08:45.981127+0000","last_peered":"2023-10-14T19:08:45.981127+0000","last_clean":"2023-10-14T19:08:45.981127+0000","last_became_active":"2023-10-14T19:08:45.977408+0000","last_became_peered":"2023-10-14T19:08:45.977408+0000","last_unstale":"2023-10-14T19:08:45.981127+0000","last_undegraded":"2023-10-14T19:08:45.981127+0000","last_fullsized":"2023-10-14T19:08:45.981127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:33.399863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.976546+0000","last_change":"2023-10-14T19:08:45.973900+0000","last_active":"2023-10-14T19:08:45.976546+0000","last_peered":"2023-10-14T19:08:45.976546+0000","last_clean":"2023-10-14T19:08:45.976546+0000","last_became_active":"2023-10-14T19:08:45.973629+0000","last_became_peered":"2023-10-14T19:08:45.973629+0000","last_unstale":"2023-10-14T19:08:45.976546+0000","last_undegraded":"2023-10-14T19:08:45.976546+0000","last_fullsized":"2023-10-14T19:08:45.976546+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:49.727457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981591+0000","last_change":"2023-10-14T19:08:45.973209+0000","last_active":"2023-10-14T19:08:45.981591+0000","last_peered":"2023-10-14T19:08:45.981591+0000","last_clean":"2023-10-14T19:08:45.981591+0000","last_became_active":"2023-10-14T19:08:45.972923+0000","last_became_peered":"2023-10-14T19:08:45.972923+0000","last_unstale":"2023-10-14T19:08:45.981591+0000","last_undegraded":"2023-10-14T19:08:45.981591+0000","last_fullsized":"2023-10-14T19:08:45.981591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:25:03.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981624+0000","last_change":"2023-10-14T19:08:45.973906+0000","last_active":"2023-10-14T19:08:45.981624+0000","last_peered":"2023-10-14T19:08:45.981624+0000","last_clean":"2023-10-14T19:08:45.981624+0000","last_became_active":"2023-10-14T19:08:45.973627+0000","last_became_peered":"2023-10-14T19:08:45.973627+0000","last_unstale":"2023-10-14T19:08:45.981624+0000","last_undegraded":"2023-10-14T19:08:45.981624+0000","last_fullsized":"2023-10-14T19:08:45.981624+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:45:24.131888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.992089+0000","last_change":"2023-10-14T19:08:45.992089+0000","last_active":"2023-10-14T19:08:45.992089+0000","last_peered":"2023-10-14T19:08:45.992089+0000","last_clean":"2023-10-14T19:08:45.992089+0000","last_became_active":"2023-10-14T19:08:45.991797+0000","last_became_peered":"2023-10-14T19:08:45.991797+0000","last_unstale":"2023-10-14T19:08:45.992089+0000","last_undegraded":"2023-10-14T19:08:45.992089+0000","last_fullsized":"2023-10-14T19:08:45.992089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:19.807986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978569+0000","last_change":"2023-10-14T19:08:45.971901+0000","last_active":"2023-10-14T19:08:45.978569+0000","last_peered":"2023-10-14T19:08:45.978569+0000","last_clean":"2023-10-14T19:08:45.978569+0000","last_became_active":"2023-10-14T19:08:45.971635+0000","last_became_peered":"2023-10-14T19:08:45.971635+0000","last_unstale":"2023-10-14T19:08:45.978569+0000","last_undegraded":"2023-10-14T19:08:45.978569+0000","last_fullsized":"2023-10-14T19:08:45.978569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:12.314568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986521+0000","last_change":"2023-10-14T19:08:45.981785+0000","last_active":"2023-10-14T19:08:45.986521+0000","last_peered":"2023-10-14T19:08:45.986521+0000","last_clean":"2023-10-14T19:08:45.986521+0000","last_became_active":"2023-10-14T19:08:45.981523+0000","last_became_peered":"2023-10-14T19:08:45.981523+0000","last_unstale":"2023-10-14T19:08:45.986521+0000","last_undegraded":"2023-10-14T19:08:45.986521+0000","last_fullsized":"2023-10-14T19:08:45.986521+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:02.829460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984252+0000","last_change":"2023-10-14T19:08:45.984252+0000","last_active":"2023-10-14T19:08:45.984252+0000","last_peered":"2023-10-14T19:08:45.984252+0000","last_clean":"2023-10-14T19:08:45.984252+0000","last_became_active":"2023-10-14T19:08:45.983979+0000","last_became_peered":"2023-10-14T19:08:45.983979+0000","last_unstale":"2023-10-14T19:08:45.984252+0000","last_undegraded":"2023-10-14T19:08:45.984252+0000","last_fullsized":"2023-10-14T19:08:45.984252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:44.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983083+0000","last_change":"2023-10-14T19:08:45.977610+0000","last_active":"2023-10-14T19:08:45.983083+0000","last_peered":"2023-10-14T19:08:45.983083+0000","last_clean":"2023-10-14T19:08:45.983083+0000","last_became_active":"2023-10-14T19:08:45.976632+0000","last_became_peered":"2023-10-14T19:08:45.976632+0000","last_unstale":"2023-10-14T19:08:45.983083+0000","last_undegraded":"2023-10-14T19:08:45.983083+0000","last_fullsized":"2023-10-14T19:08:45.983083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:02.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985163+0000","last_change":"2023-10-14T19:08:45.981704+0000","last_active":"2023-10-14T19:08:45.985163+0000","last_peered":"2023-10-14T19:08:45.985163+0000","last_clean":"2023-10-14T19:08:45.985163+0000","last_became_active":"2023-10-14T19:08:45.981377+0000","last_became_peered":"2023-10-14T19:08:45.981377+0000","last_unstale":"2023-10-14T19:08:45.985163+0000","last_undegraded":"2023-10-14T19:08:45.985163+0000","last_fullsized":"2023-10-14T19:08:45.985163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:44.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984718+0000","last_change":"2023-10-14T19:08:45.982392+0000","last_active":"2023-10-14T19:08:45.984718+0000","last_peered":"2023-10-14T19:08:45.984718+0000","last_clean":"2023-10-14T19:08:45.984718+0000","last_became_active":"2023-10-14T19:08:45.982112+0000","last_became_peered":"2023-10-14T19:08:45.982112+0000","last_unstale":"2023-10-14T19:08:45.984718+0000","last_undegraded":"2023-10-14T19:08:45.984718+0000","last_fullsized":"2023-10-14T19:08:45.984718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:05.824580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986171+0000","last_change":"2023-10-14T19:08:45.986171+0000","last_active":"2023-10-14T19:08:45.986171+0000","last_peered":"2023-10-14T19:08:45.986171+0000","last_clean":"2023-10-14T19:08:45.986171+0000","last_became_active":"2023-10-14T19:08:45.983402+0000","last_became_peered":"2023-10-14T19:08:45.983402+0000","last_unstale":"2023-10-14T19:08:45.986171+0000","last_undegraded":"2023-10-14T19:08:45.986171+0000","last_fullsized":"2023-10-14T19:08:45.986171+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:26.751840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991154+0000","last_change":"2023-10-14T19:08:45.991154+0000","last_active":"2023-10-14T19:08:45.991154+0000","last_peered":"2023-10-14T19:08:45.991154+0000","last_clean":"2023-10-14T19:08:45.991154+0000","last_became_active":"2023-10-14T19:08:45.990838+0000","last_became_peered":"2023-10-14T19:08:45.990838+0000","last_unstale":"2023-10-14T19:08:45.991154+0000","last_undegraded":"2023-10-14T19:08:45.991154+0000","last_fullsized":"2023-10-14T19:08:45.991154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:42.367679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986268+0000","last_change":"2023-10-14T19:08:45.983113+0000","last_active":"2023-10-14T19:08:45.986268+0000","last_peered":"2023-10-14T19:08:45.986268+0000","last_clean":"2023-10-14T19:08:45.986268+0000","last_became_active":"2023-10-14T19:08:45.982801+0000","last_became_peered":"2023-10-14T19:08:45.982801+0000","last_unstale":"2023-10-14T19:08:45.986268+0000","last_undegraded":"2023-10-14T19:08:45.986268+0000","last_fullsized":"2023-10-14T19:08:45.986268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:34:07.969334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.997814+0000","last_change":"2023-10-14T19:08:44.963356+0000","last_active":"2023-10-14T19:08:45.997814+0000","last_peered":"2023-10-14T19:08:45.997814+0000","last_clean":"2023-10-14T19:08:45.997814+0000","last_became_active":"2023-10-14T19:08:44.963077+0000","last_became_peered":"2023-10-14T19:08:44.963077+0000","last_unstale":"2023-10-14T19:08:45.997814+0000","last_undegraded":"2023-10-14T19:08:45.997814+0000","last_fullsized":"2023-10-14T19:08:45.997814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:06:32.457474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985656+0000","last_change":"2023-10-14T19:08:45.985656+0000","last_active":"2023-10-14T19:08:45.985656+0000","last_peered":"2023-10-14T19:08:45.985656+0000","last_clean":"2023-10-14T19:08:45.985656+0000","last_became_active":"2023-10-14T19:08:45.985366+0000","last_became_peered":"2023-10-14T19:08:45.985366+0000","last_unstale":"2023-10-14T19:08:45.985656+0000","last_undegraded":"2023-10-14T19:08:45.985656+0000","last_fullsized":"2023-10-14T19:08:45.985656+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:42.096880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.976961+0000","last_change":"2023-10-14T19:08:44.968097+0000","last_active":"2023-10-14T19:08:45.976961+0000","last_peered":"2023-10-14T19:08:45.976961+0000","last_clean":"2023-10-14T19:08:45.976961+0000","last_became_active":"2023-10-14T19:08:44.967828+0000","last_became_peered":"2023-10-14T19:08:44.967828+0000","last_unstale":"2023-10-14T19:08:45.976961+0000","last_undegraded":"2023-10-14T19:08:45.976961+0000","last_fullsized":"2023-10-14T19:08:45.976961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:11.310490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.989959+0000","last_change":"2023-10-14T19:08:45.989959+0000","last_active":"2023-10-14T19:08:45.989959+0000","last_peered":"2023-10-14T19:08:45.989959+0000","last_clean":"2023-10-14T19:08:45.989959+0000","last_became_active":"2023-10-14T19:08:45.989714+0000","last_became_peered":"2023-10-14T19:08:45.989714+0000","last_unstale":"2023-10-14T19:08:45.989959+0000","last_undegraded":"2023-10-14T19:08:45.989959+0000","last_fullsized":"2023-10-14T19:08:45.989959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:03.104759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995797+0000","last_change":"2023-10-14T19:08:44.962139+0000","last_active":"2023-10-14T19:08:45.995797+0000","last_peered":"2023-10-14T19:08:45.995797+0000","last_clean":"2023-10-14T19:08:45.995797+0000","last_became_active":"2023-10-14T19:08:44.961590+0000","last_became_peered":"2023-10-14T19:08:44.961590+0000","last_unstale":"2023-10-14T19:08:45.995797+0000","last_undegraded":"2023-10-14T19:08:45.995797+0000","last_fullsized":"2023-10-14T19:08:45.995797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:41.011151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985943+0000","last_change":"2023-10-14T19:08:45.980716+0000","last_active":"2023-10-14T19:08:45.985943+0000","last_peered":"2023-10-14T19:08:45.985943+0000","last_clean":"2023-10-14T19:08:45.985943+0000","last_became_active":"2023-10-14T19:08:45.980453+0000","last_became_peered":"2023-10-14T19:08:45.980453+0000","last_unstale":"2023-10-14T19:08:45.985943+0000","last_undegraded":"2023-10-14T19:08:45.985943+0000","last_fullsized":"2023-10-14T19:08:45.985943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:12.314568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994930+0000","last_change":"2023-10-14T19:08:44.966287+0000","last_active":"2023-10-14T19:08:45.994930+0000","last_peered":"2023-10-14T19:08:45.994930+0000","last_clean":"2023-10-14T19:08:45.994930+0000","last_became_active":"2023-10-14T19:08:44.965950+0000","last_became_peered":"2023-10-14T19:08:44.965950+0000","last_unstale":"2023-10-14T19:08:45.994930+0000","last_undegraded":"2023-10-14T19:08:45.994930+0000","last_fullsized":"2023-10-14T19:08:45.994930+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:48:12.110598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983317+0000","last_change":"2023-10-14T19:08:45.978824+0000","last_active":"2023-10-14T19:08:45.983317+0000","last_peered":"2023-10-14T19:08:45.983317+0000","last_clean":"2023-10-14T19:08:45.983317+0000","last_became_active":"2023-10-14T19:08:45.978575+0000","last_became_peered":"2023-10-14T19:08:45.978575+0000","last_unstale":"2023-10-14T19:08:45.983317+0000","last_undegraded":"2023-10-14T19:08:45.983317+0000","last_fullsized":"2023-10-14T19:08:45.983317+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:07.888741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.977395+0000","last_change":"2023-10-14T19:08:44.971701+0000","last_active":"2023-10-14T19:08:45.977395+0000","last_peered":"2023-10-14T19:08:45.977395+0000","last_clean":"2023-10-14T19:08:45.977395+0000","last_became_active":"2023-10-14T19:08:44.971424+0000","last_became_peered":"2023-10-14T19:08:44.971424+0000","last_unstale":"2023-10-14T19:08:45.977395+0000","last_undegraded":"2023-10-14T19:08:45.977395+0000","last_fullsized":"2023-10-14T19:08:45.977395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:22:52.554783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984416+0000","last_change":"2023-10-14T19:08:45.984416+0000","last_active":"2023-10-14T19:08:45.984416+0000","last_peered":"2023-10-14T19:08:45.984416+0000","last_clean":"2023-10-14T19:08:45.984416+0000","last_became_active":"2023-10-14T19:08:45.984157+0000","last_became_peered":"2023-10-14T19:08:45.984157+0000","last_unstale":"2023-10-14T19:08:45.984416+0000","last_undegraded":"2023-10-14T19:08:45.984416+0000","last_fullsized":"2023-10-14T19:08:45.984416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:26.751840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994041+0000","last_change":"2023-10-14T19:08:44.968661+0000","last_active":"2023-10-14T19:08:45.994041+0000","last_peered":"2023-10-14T19:08:45.994041+0000","last_clean":"2023-10-14T19:08:45.994041+0000","last_became_active":"2023-10-14T19:08:44.968374+0000","last_became_peered":"2023-10-14T19:08:44.968374+0000","last_unstale":"2023-10-14T19:08:45.994041+0000","last_undegraded":"2023-10-14T19:08:45.994041+0000","last_fullsized":"2023-10-14T19:08:45.994041+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:32.395784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978138+0000","last_change":"2023-10-14T19:08:45.978138+0000","last_active":"2023-10-14T19:08:45.978138+0000","last_peered":"2023-10-14T19:08:45.978138+0000","last_clean":"2023-10-14T19:08:45.978138+0000","last_became_active":"2023-10-14T19:08:45.977788+0000","last_became_peered":"2023-10-14T19:08:45.977788+0000","last_unstale":"2023-10-14T19:08:45.978138+0000","last_undegraded":"2023-10-14T19:08:45.978138+0000","last_fullsized":"2023-10-14T19:08:45.978138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:47:24.744588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967116+0000","last_change":"2023-10-14T19:08:44.959401+0000","last_active":"2023-10-14T19:08:45.967116+0000","last_peered":"2023-10-14T19:08:45.967116+0000","last_clean":"2023-10-14T19:08:45.967116+0000","last_became_active":"2023-10-14T19:08:44.959116+0000","last_became_peered":"2023-10-14T19:08:44.959116+0000","last_unstale":"2023-10-14T19:08:45.967116+0000","last_undegraded":"2023-10-14T19:08:45.967116+0000","last_fullsized":"2023-10-14T19:08:45.967116+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:53:42.838156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987591+0000","last_change":"2023-10-14T19:08:45.982674+0000","last_active":"2023-10-14T19:08:45.987591+0000","last_peered":"2023-10-14T19:08:45.987591+0000","last_clean":"2023-10-14T19:08:45.987591+0000","last_became_active":"2023-10-14T19:08:45.982409+0000","last_became_peered":"2023-10-14T19:08:45.982409+0000","last_unstale":"2023-10-14T19:08:45.987591+0000","last_undegraded":"2023-10-14T19:08:45.987591+0000","last_fullsized":"2023-10-14T19:08:45.987591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:02.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.967880+0000","last_change":"2023-10-14T19:08:44.962911+0000","last_active":"2023-10-14T19:08:44.967880+0000","last_peered":"2023-10-14T19:08:44.967880+0000","last_clean":"2023-10-14T19:08:44.967880+0000","last_became_active":"2023-10-14T19:08:44.962641+0000","last_became_peered":"2023-10-14T19:08:44.962641+0000","last_unstale":"2023-10-14T19:08:44.967880+0000","last_undegraded":"2023-10-14T19:08:44.967880+0000","last_fullsized":"2023-10-14T19:08:44.967880+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:32.672479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986508+0000","last_change":"2023-10-14T19:08:45.979491+0000","last_active":"2023-10-14T19:08:45.986508+0000","last_peered":"2023-10-14T19:08:45.986508+0000","last_clean":"2023-10-14T19:08:45.986508+0000","last_became_active":"2023-10-14T19:08:45.979195+0000","last_became_peered":"2023-10-14T19:08:45.979195+0000","last_unstale":"2023-10-14T19:08:45.986508+0000","last_undegraded":"2023-10-14T19:08:45.986508+0000","last_fullsized":"2023-10-14T19:08:45.986508+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:59.299713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.967919+0000","last_change":"2023-10-14T19:08:44.963972+0000","last_active":"2023-10-14T19:08:44.967919+0000","last_peered":"2023-10-14T19:08:44.967919+0000","last_clean":"2023-10-14T19:08:44.967919+0000","last_became_active":"2023-10-14T19:08:44.963700+0000","last_became_peered":"2023-10-14T19:08:44.963700+0000","last_unstale":"2023-10-14T19:08:44.967919+0000","last_undegraded":"2023-10-14T19:08:44.967919+0000","last_fullsized":"2023-10-14T19:08:44.967919+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:16.948419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987671+0000","last_change":"2023-10-14T19:08:45.982947+0000","last_active":"2023-10-14T19:08:45.987671+0000","last_peered":"2023-10-14T19:08:45.987671+0000","last_clean":"2023-10-14T19:08:45.987671+0000","last_became_active":"2023-10-14T19:08:45.982679+0000","last_became_peered":"2023-10-14T19:08:45.982679+0000","last_unstale":"2023-10-14T19:08:45.987671+0000","last_undegraded":"2023-10-14T19:08:45.987671+0000","last_fullsized":"2023-10-14T19:08:45.987671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:23.382757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.968456+0000","last_change":"2023-10-14T19:08:44.966343+0000","last_active":"2023-10-14T19:08:44.968456+0000","last_peered":"2023-10-14T19:08:44.968456+0000","last_clean":"2023-10-14T19:08:44.968456+0000","last_became_active":"2023-10-14T19:08:44.966052+0000","last_became_peered":"2023-10-14T19:08:44.966052+0000","last_unstale":"2023-10-14T19:08:44.968456+0000","last_undegraded":"2023-10-14T19:08:44.968456+0000","last_fullsized":"2023-10-14T19:08:44.968456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:01.497573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983055+0000","last_change":"2023-10-14T19:08:45.975989+0000","last_active":"2023-10-14T19:08:45.983055+0000","last_peered":"2023-10-14T19:08:45.983055+0000","last_clean":"2023-10-14T19:08:45.983055+0000","last_became_active":"2023-10-14T19:08:45.975710+0000","last_became_peered":"2023-10-14T19:08:45.975710+0000","last_unstale":"2023-10-14T19:08:45.983055+0000","last_undegraded":"2023-10-14T19:08:45.983055+0000","last_fullsized":"2023-10-14T19:08:45.983055+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:51:44.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"89'3","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994312+0000","last_change":"2023-10-14T19:08:44.965982+0000","last_active":"2023-10-14T19:08:45.994312+0000","last_peered":"2023-10-14T19:08:45.994312+0000","last_clean":"2023-10-14T19:08:45.994312+0000","last_became_active":"2023-10-14T19:08:44.965756+0000","last_became_peered":"2023-10-14T19:08:44.965756+0000","last_unstale":"2023-10-14T19:08:45.994312+0000","last_undegraded":"2023-10-14T19:08:45.994312+0000","last_fullsized":"2023-10-14T19:08:45.994312+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:37.013848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986421+0000","last_change":"2023-10-14T19:08:45.986421+0000","last_active":"2023-10-14T19:08:45.986421+0000","last_peered":"2023-10-14T19:08:45.986421+0000","last_clean":"2023-10-14T19:08:45.986421+0000","last_became_active":"2023-10-14T19:08:45.985798+0000","last_became_peered":"2023-10-14T19:08:45.985798+0000","last_unstale":"2023-10-14T19:08:45.986421+0000","last_undegraded":"2023-10-14T19:08:45.986421+0000","last_fullsized":"2023-10-14T19:08:45.986421+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:45:24.131888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"89'6","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.997315+0000","last_change":"2023-10-14T19:08:44.964779+0000","last_active":"2023-10-14T19:08:45.997315+0000","last_peered":"2023-10-14T19:08:45.997315+0000","last_clean":"2023-10-14T19:08:45.997315+0000","last_became_active":"2023-10-14T19:08:44.964257+0000","last_became_peered":"2023-10-14T19:08:44.964257+0000","last_unstale":"2023-10-14T19:08:45.997315+0000","last_undegraded":"2023-10-14T19:08:45.997315+0000","last_fullsized":"2023-10-14T19:08:45.997315+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:39.002815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.979761+0000","last_change":"2023-10-14T19:08:45.979761+0000","last_active":"2023-10-14T19:08:45.979761+0000","last_peered":"2023-10-14T19:08:45.979761+0000","last_clean":"2023-10-14T19:08:45.979761+0000","last_became_active":"2023-10-14T19:08:45.979472+0000","last_became_peered":"2023-10-14T19:08:45.979472+0000","last_unstale":"2023-10-14T19:08:45.979761+0000","last_undegraded":"2023-10-14T19:08:45.979761+0000","last_fullsized":"2023-10-14T19:08:45.979761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:22.470921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994584+0000","last_change":"2023-10-14T19:08:44.967103+0000","last_active":"2023-10-14T19:08:45.994584+0000","last_peered":"2023-10-14T19:08:45.994584+0000","last_clean":"2023-10-14T19:08:45.994584+0000","last_became_active":"2023-10-14T19:08:44.966811+0000","last_became_peered":"2023-10-14T19:08:44.966811+0000","last_unstale":"2023-10-14T19:08:45.994584+0000","last_undegraded":"2023-10-14T19:08:45.994584+0000","last_fullsized":"2023-10-14T19:08:45.994584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:57.172867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981439+0000","last_change":"2023-10-14T19:08:45.981439+0000","last_active":"2023-10-14T19:08:45.981439+0000","last_peered":"2023-10-14T19:08:45.981439+0000","last_clean":"2023-10-14T19:08:45.981439+0000","last_became_active":"2023-10-14T19:08:45.981145+0000","last_became_peered":"2023-10-14T19:08:45.981145+0000","last_unstale":"2023-10-14T19:08:45.981439+0000","last_undegraded":"2023-10-14T19:08:45.981439+0000","last_fullsized":"2023-10-14T19:08:45.981439+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:07.888741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967900+0000","last_change":"2023-10-14T19:08:44.968311+0000","last_active":"2023-10-14T19:08:45.967900+0000","last_peered":"2023-10-14T19:08:45.967900+0000","last_clean":"2023-10-14T19:08:45.967900+0000","last_became_active":"2023-10-14T19:08:44.968035+0000","last_became_peered":"2023-10-14T19:08:44.968035+0000","last_unstale":"2023-10-14T19:08:45.967900+0000","last_undegraded":"2023-10-14T19:08:45.967900+0000","last_fullsized":"2023-10-14T19:08:45.967900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:00.258538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987650+0000","last_change":"2023-10-14T19:08:45.982916+0000","last_active":"2023-10-14T19:08:45.987650+0000","last_peered":"2023-10-14T19:08:45.987650+0000","last_clean":"2023-10-14T19:08:45.987650+0000","last_became_active":"2023-10-14T19:08:45.982457+0000","last_became_peered":"2023-10-14T19:08:45.982457+0000","last_unstale":"2023-10-14T19:08:45.987650+0000","last_undegraded":"2023-10-14T19:08:45.987650+0000","last_fullsized":"2023-10-14T19:08:45.987650+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:38.017926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.971208+0000","last_change":"2023-10-14T19:08:44.962503+0000","last_active":"2023-10-14T19:08:45.971208+0000","last_peered":"2023-10-14T19:08:45.971208+0000","last_clean":"2023-10-14T19:08:45.971208+0000","last_became_active":"2023-10-14T19:08:44.962221+0000","last_became_peered":"2023-10-14T19:08:44.962221+0000","last_unstale":"2023-10-14T19:08:45.971208+0000","last_undegraded":"2023-10-14T19:08:45.971208+0000","last_fullsized":"2023-10-14T19:08:45.971208+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:41.363601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980789+0000","last_change":"2023-10-14T19:08:45.979846+0000","last_active":"2023-10-14T19:08:45.980789+0000","last_peered":"2023-10-14T19:08:45.980789+0000","last_clean":"2023-10-14T19:08:45.980789+0000","last_became_active":"2023-10-14T19:08:45.979512+0000","last_became_peered":"2023-10-14T19:08:45.979512+0000","last_unstale":"2023-10-14T19:08:45.980789+0000","last_undegraded":"2023-10-14T19:08:45.980789+0000","last_fullsized":"2023-10-14T19:08:45.980789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:02.716116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"89'8","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.998001+0000","last_change":"2023-10-14T19:08:44.968008+0000","last_active":"2023-10-14T19:08:45.998001+0000","last_peered":"2023-10-14T19:08:45.998001+0000","last_clean":"2023-10-14T19:08:45.998001+0000","last_became_active":"2023-10-14T19:08:44.967680+0000","last_became_peered":"2023-10-14T19:08:44.967680+0000","last_unstale":"2023-10-14T19:08:45.998001+0000","last_undegraded":"2023-10-14T19:08:45.998001+0000","last_fullsized":"2023-10-14T19:08:45.998001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:11:00.662294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986721+0000","last_change":"2023-10-14T19:08:45.979824+0000","last_active":"2023-10-14T19:08:45.986721+0000","last_peered":"2023-10-14T19:08:45.986721+0000","last_clean":"2023-10-14T19:08:45.986721+0000","last_became_active":"2023-10-14T19:08:45.979592+0000","last_became_peered":"2023-10-14T19:08:45.979592+0000","last_unstale":"2023-10-14T19:08:45.986721+0000","last_undegraded":"2023-10-14T19:08:45.986721+0000","last_fullsized":"2023-10-14T19:08:45.986721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:19.057989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995474+0000","last_change":"2023-10-14T19:08:44.966457+0000","last_active":"2023-10-14T19:08:45.995474+0000","last_peered":"2023-10-14T19:08:45.995474+0000","last_clean":"2023-10-14T19:08:45.995474+0000","last_became_active":"2023-10-14T19:08:44.966222+0000","last_became_peered":"2023-10-14T19:08:44.966222+0000","last_unstale":"2023-10-14T19:08:45.995474+0000","last_undegraded":"2023-10-14T19:08:45.995474+0000","last_fullsized":"2023-10-14T19:08:45.995474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:23.740404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984867+0000","last_change":"2023-10-14T19:08:45.981560+0000","last_active":"2023-10-14T19:08:45.984867+0000","last_peered":"2023-10-14T19:08:45.984867+0000","last_clean":"2023-10-14T19:08:45.984867+0000","last_became_active":"2023-10-14T19:08:45.981255+0000","last_became_peered":"2023-10-14T19:08:45.981255+0000","last_unstale":"2023-10-14T19:08:45.984867+0000","last_undegraded":"2023-10-14T19:08:45.984867+0000","last_fullsized":"2023-10-14T19:08:45.984867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:13:56.938980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.992090+0000","last_change":"2023-10-14T19:08:44.960156+0000","last_active":"2023-10-14T19:08:45.992090+0000","last_peered":"2023-10-14T19:08:45.992090+0000","last_clean":"2023-10-14T19:08:45.992090+0000","last_became_active":"2023-10-14T19:08:44.959872+0000","last_became_peered":"2023-10-14T19:08:44.959872+0000","last_unstale":"2023-10-14T19:08:45.992090+0000","last_undegraded":"2023-10-14T19:08:45.992090+0000","last_fullsized":"2023-10-14T19:08:45.992090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:46.213063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985224+0000","last_change":"2023-10-14T19:08:45.985224+0000","last_active":"2023-10-14T19:08:45.985224+0000","last_peered":"2023-10-14T19:08:45.985224+0000","last_clean":"2023-10-14T19:08:45.985224+0000","last_became_active":"2023-10-14T19:08:45.984905+0000","last_became_peered":"2023-10-14T19:08:45.984905+0000","last_unstale":"2023-10-14T19:08:45.985224+0000","last_undegraded":"2023-10-14T19:08:45.985224+0000","last_fullsized":"2023-10-14T19:08:45.985224+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:26.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.962970+0000","last_change":"2023-10-14T19:08:44.966700+0000","last_active":"2023-10-14T19:08:45.962970+0000","last_peered":"2023-10-14T19:08:45.962970+0000","last_clean":"2023-10-14T19:08:45.962970+0000","last_became_active":"2023-10-14T19:08:44.966412+0000","last_became_peered":"2023-10-14T19:08:44.966412+0000","last_unstale":"2023-10-14T19:08:45.962970+0000","last_undegraded":"2023-10-14T19:08:45.962970+0000","last_fullsized":"2023-10-14T19:08:45.962970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:37.013848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978062+0000","last_change":"2023-10-14T19:08:45.976479+0000","last_active":"2023-10-14T19:08:45.978062+0000","last_peered":"2023-10-14T19:08:45.978062+0000","last_clean":"2023-10-14T19:08:45.978062+0000","last_became_active":"2023-10-14T19:08:45.974802+0000","last_became_peered":"2023-10-14T19:08:45.974802+0000","last_unstale":"2023-10-14T19:08:45.978062+0000","last_undegraded":"2023-10-14T19:08:45.978062+0000","last_fullsized":"2023-10-14T19:08:45.978062+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:18.521834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995437+0000","last_change":"2023-10-14T19:08:44.964594+0000","last_active":"2023-10-14T19:08:45.995437+0000","last_peered":"2023-10-14T19:08:45.995437+0000","last_clean":"2023-10-14T19:08:45.995437+0000","last_became_active":"2023-10-14T19:08:44.961547+0000","last_became_peered":"2023-10-14T19:08:44.961547+0000","last_unstale":"2023-10-14T19:08:45.995437+0000","last_undegraded":"2023-10-14T19:08:45.995437+0000","last_fullsized":"2023-10-14T19:08:45.995437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:51:43.724411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.973309+0000","last_change":"2023-10-14T19:08:45.970336+0000","last_active":"2023-10-14T19:08:45.973309+0000","last_peered":"2023-10-14T19:08:45.973309+0000","last_clean":"2023-10-14T19:08:45.973309+0000","last_became_active":"2023-10-14T19:08:45.969915+0000","last_became_peered":"2023-10-14T19:08:45.969915+0000","last_unstale":"2023-10-14T19:08:45.973309+0000","last_undegraded":"2023-10-14T19:08:45.973309+0000","last_fullsized":"2023-10-14T19:08:45.973309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:19:28.583319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967022+0000","last_change":"2023-10-14T19:08:44.968163+0000","last_active":"2023-10-14T19:08:45.967022+0000","last_peered":"2023-10-14T19:08:45.967022+0000","last_clean":"2023-10-14T19:08:45.967022+0000","last_became_active":"2023-10-14T19:08:44.967846+0000","last_became_peered":"2023-10-14T19:08:44.967846+0000","last_unstale":"2023-10-14T19:08:45.967022+0000","last_undegraded":"2023-10-14T19:08:45.967022+0000","last_fullsized":"2023-10-14T19:08:45.967022+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:23.740404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980300+0000","last_change":"2023-10-14T19:08:45.973762+0000","last_active":"2023-10-14T19:08:45.980300+0000","last_peered":"2023-10-14T19:08:45.980300+0000","last_clean":"2023-10-14T19:08:45.980300+0000","last_became_active":"2023-10-14T19:08:45.973483+0000","last_became_peered":"2023-10-14T19:08:45.973483+0000","last_unstale":"2023-10-14T19:08:45.980300+0000","last_undegraded":"2023-10-14T19:08:45.980300+0000","last_fullsized":"2023-10-14T19:08:45.980300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:06.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967372+0000","last_change":"2023-10-14T19:08:44.959988+0000","last_active":"2023-10-14T19:08:45.967372+0000","last_peered":"2023-10-14T19:08:45.967372+0000","last_clean":"2023-10-14T19:08:45.967372+0000","last_became_active":"2023-10-14T19:08:44.959725+0000","last_became_peered":"2023-10-14T19:08:44.959725+0000","last_unstale":"2023-10-14T19:08:45.967372+0000","last_undegraded":"2023-10-14T19:08:45.967372+0000","last_fullsized":"2023-10-14T19:08:45.967372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:39.002815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991121+0000","last_change":"2023-10-14T19:08:45.983215+0000","last_active":"2023-10-14T19:08:45.991121+0000","last_peered":"2023-10-14T19:08:45.991121+0000","last_clean":"2023-10-14T19:08:45.991121+0000","last_became_active":"2023-10-14T19:08:45.982912+0000","last_became_peered":"2023-10-14T19:08:45.982912+0000","last_unstale":"2023-10-14T19:08:45.991121+0000","last_undegraded":"2023-10-14T19:08:45.991121+0000","last_fullsized":"2023-10-14T19:08:45.991121+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:33.399863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.962820+0000","last_change":"2023-10-14T19:08:44.967354+0000","last_active":"2023-10-14T19:08:45.962820+0000","last_peered":"2023-10-14T19:08:45.962820+0000","last_clean":"2023-10-14T19:08:45.962820+0000","last_became_active":"2023-10-14T19:08:44.967075+0000","last_became_peered":"2023-10-14T19:08:44.967075+0000","last_unstale":"2023-10-14T19:08:45.962820+0000","last_undegraded":"2023-10-14T19:08:45.962820+0000","last_fullsized":"2023-10-14T19:08:45.962820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:22.378678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981968+0000","last_change":"2023-10-14T19:08:45.974115+0000","last_active":"2023-10-14T19:08:45.981968+0000","last_peered":"2023-10-14T19:08:45.981968+0000","last_clean":"2023-10-14T19:08:45.981968+0000","last_became_active":"2023-10-14T19:08:45.973764+0000","last_became_peered":"2023-10-14T19:08:45.973764+0000","last_unstale":"2023-10-14T19:08:45.981968+0000","last_undegraded":"2023-10-14T19:08:45.981968+0000","last_fullsized":"2023-10-14T19:08:45.981968+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:56.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995120+0000","last_change":"2023-10-14T19:08:44.965842+0000","last_active":"2023-10-14T19:08:45.995120+0000","last_peered":"2023-10-14T19:08:45.995120+0000","last_clean":"2023-10-14T19:08:45.995120+0000","last_became_active":"2023-10-14T19:08:44.965583+0000","last_became_peered":"2023-10-14T19:08:44.965583+0000","last_unstale":"2023-10-14T19:08:45.995120+0000","last_undegraded":"2023-10-14T19:08:45.995120+0000","last_fullsized":"2023-10-14T19:08:45.995120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:41.363601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.979393+0000","last_change":"2023-10-14T19:08:45.979393+0000","last_active":"2023-10-14T19:08:45.979393+0000","last_peered":"2023-10-14T19:08:45.979393+0000","last_clean":"2023-10-14T19:08:45.979393+0000","last_became_active":"2023-10-14T19:08:45.979107+0000","last_became_peered":"2023-10-14T19:08:45.979107+0000","last_unstale":"2023-10-14T19:08:45.979393+0000","last_undegraded":"2023-10-14T19:08:45.979393+0000","last_fullsized":"2023-10-14T19:08:45.979393+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:23.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.963809+0000","last_change":"2023-10-14T19:08:44.969564+0000","last_active":"2023-10-14T19:08:45.963809+0000","last_peered":"2023-10-14T19:08:45.963809+0000","last_clean":"2023-10-14T19:08:45.963809+0000","last_became_active":"2023-10-14T19:08:44.969128+0000","last_became_peered":"2023-10-14T19:08:44.969128+0000","last_unstale":"2023-10-14T19:08:45.963809+0000","last_undegraded":"2023-10-14T19:08:45.963809+0000","last_fullsized":"2023-10-14T19:08:45.963809+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:21:39.101576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991644+0000","last_change":"2023-10-14T19:08:45.991644+0000","last_active":"2023-10-14T19:08:45.991644+0000","last_peered":"2023-10-14T19:08:45.991644+0000","last_clean":"2023-10-14T19:08:45.991644+0000","last_became_active":"2023-10-14T19:08:45.991378+0000","last_became_peered":"2023-10-14T19:08:45.991378+0000","last_unstale":"2023-10-14T19:08:45.991644+0000","last_undegraded":"2023-10-14T19:08:45.991644+0000","last_fullsized":"2023-10-14T19:08:45.991644+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:09.891078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.963303+0000","last_change":"2023-10-14T19:08:44.966052+0000","last_active":"2023-10-14T19:08:45.963303+0000","last_peered":"2023-10-14T19:08:45.963303+0000","last_clean":"2023-10-14T19:08:45.963303+0000","last_became_active":"2023-10-14T19:08:44.965774+0000","last_became_peered":"2023-10-14T19:08:44.965774+0000","last_unstale":"2023-10-14T19:08:45.963303+0000","last_undegraded":"2023-10-14T19:08:45.963303+0000","last_fullsized":"2023-10-14T19:08:45.963303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:01.497573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983181+0000","last_change":"2023-10-14T19:08:45.977055+0000","last_active":"2023-10-14T19:08:45.983181+0000","last_peered":"2023-10-14T19:08:45.983181+0000","last_clean":"2023-10-14T19:08:45.983181+0000","last_became_active":"2023-10-14T19:08:45.976748+0000","last_became_peered":"2023-10-14T19:08:45.976748+0000","last_unstale":"2023-10-14T19:08:45.983181+0000","last_undegraded":"2023-10-14T19:08:45.983181+0000","last_fullsized":"2023-10-14T19:08:45.983181+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:18.861808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.965812+0000","last_change":"2023-10-14T19:08:44.962416+0000","last_active":"2023-10-14T19:08:45.965812+0000","last_peered":"2023-10-14T19:08:45.965812+0000","last_clean":"2023-10-14T19:08:45.965812+0000","last_became_active":"2023-10-14T19:08:44.962161+0000","last_became_peered":"2023-10-14T19:08:44.962161+0000","last_unstale":"2023-10-14T19:08:45.965812+0000","last_undegraded":"2023-10-14T19:08:45.965812+0000","last_fullsized":"2023-10-14T19:08:45.965812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:01.642960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984703+0000","last_change":"2023-10-14T19:08:45.981856+0000","last_active":"2023-10-14T19:08:45.984703+0000","last_peered":"2023-10-14T19:08:45.984703+0000","last_clean":"2023-10-14T19:08:45.984703+0000","last_became_active":"2023-10-14T19:08:45.981401+0000","last_became_peered":"2023-10-14T19:08:45.981401+0000","last_unstale":"2023-10-14T19:08:45.984703+0000","last_undegraded":"2023-10-14T19:08:45.984703+0000","last_fullsized":"2023-10-14T19:08:45.984703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:28.509720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.963367+0000","last_change":"2023-10-14T19:08:44.961227+0000","last_active":"2023-10-14T19:08:45.963367+0000","last_peered":"2023-10-14T19:08:45.963367+0000","last_clean":"2023-10-14T19:08:45.963367+0000","last_became_active":"2023-10-14T19:08:44.960946+0000","last_became_peered":"2023-10-14T19:08:44.960946+0000","last_unstale":"2023-10-14T19:08:45.963367+0000","last_undegraded":"2023-10-14T19:08:45.963367+0000","last_fullsized":"2023-10-14T19:08:45.963367+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:11.310490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986400+0000","last_change":"2023-10-14T19:08:45.980367+0000","last_active":"2023-10-14T19:08:45.986400+0000","last_peered":"2023-10-14T19:08:45.986400+0000","last_clean":"2023-10-14T19:08:45.986400+0000","last_became_active":"2023-10-14T19:08:45.980108+0000","last_became_peered":"2023-10-14T19:08:45.980108+0000","last_unstale":"2023-10-14T19:08:45.986400+0000","last_undegraded":"2023-10-14T19:08:45.986400+0000","last_fullsized":"2023-10-14T19:08:45.986400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:19.057989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.965093+0000","last_change":"2023-10-14T19:08:44.967643+0000","last_active":"2023-10-14T19:08:45.965093+0000","last_peered":"2023-10-14T19:08:45.965093+0000","last_clean":"2023-10-14T19:08:45.965093+0000","last_became_active":"2023-10-14T19:08:44.967348+0000","last_became_peered":"2023-10-14T19:08:44.967348+0000","last_unstale":"2023-10-14T19:08:45.965093+0000","last_undegraded":"2023-10-14T19:08:45.965093+0000","last_fullsized":"2023-10-14T19:08:45.965093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:23.019477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980324+0000","last_change":"2023-10-14T19:08:45.978886+0000","last_active":"2023-10-14T19:08:45.980324+0000","last_peered":"2023-10-14T19:08:45.980324+0000","last_clean":"2023-10-14T19:08:45.980324+0000","last_became_active":"2023-10-14T19:08:45.978598+0000","last_became_peered":"2023-10-14T19:08:45.978598+0000","last_unstale":"2023-10-14T19:08:45.980324+0000","last_undegraded":"2023-10-14T19:08:45.980324+0000","last_fullsized":"2023-10-14T19:08:45.980324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:31.991397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.968932+0000","last_change":"2023-10-14T19:08:44.967808+0000","last_active":"2023-10-14T19:08:44.968932+0000","last_peered":"2023-10-14T19:08:44.968932+0000","last_clean":"2023-10-14T19:08:44.968932+0000","last_became_active":"2023-10-14T19:08:44.967505+0000","last_became_peered":"2023-10-14T19:08:44.967505+0000","last_unstale":"2023-10-14T19:08:44.968932+0000","last_undegraded":"2023-10-14T19:08:44.968932+0000","last_fullsized":"2023-10-14T19:08:44.968932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:18.053911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978476+0000","last_change":"2023-10-14T19:08:45.972581+0000","last_active":"2023-10-14T19:08:45.978476+0000","last_peered":"2023-10-14T19:08:45.978476+0000","last_clean":"2023-10-14T19:08:45.978476+0000","last_became_active":"2023-10-14T19:08:45.972273+0000","last_became_peered":"2023-10-14T19:08:45.972273+0000","last_unstale":"2023-10-14T19:08:45.978476+0000","last_undegraded":"2023-10-14T19:08:45.978476+0000","last_fullsized":"2023-10-14T19:08:45.978476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:04.439567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.968798+0000","last_change":"2023-10-14T19:08:44.964692+0000","last_active":"2023-10-14T19:08:45.968798+0000","last_peered":"2023-10-14T19:08:45.968798+0000","last_clean":"2023-10-14T19:08:45.968798+0000","last_became_active":"2023-10-14T19:08:44.964395+0000","last_became_peered":"2023-10-14T19:08:44.964395+0000","last_unstale":"2023-10-14T19:08:45.968798+0000","last_undegraded":"2023-10-14T19:08:45.968798+0000","last_fullsized":"2023-10-14T19:08:45.968798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:39.781189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978035+0000","last_change":"2023-10-14T19:08:45.975552+0000","last_active":"2023-10-14T19:08:45.978035+0000","last_peered":"2023-10-14T19:08:45.978035+0000","last_clean":"2023-10-14T19:08:45.978035+0000","last_became_active":"2023-10-14T19:08:45.975188+0000","last_became_peered":"2023-10-14T19:08:45.975188+0000","last_unstale":"2023-10-14T19:08:45.978035+0000","last_undegraded":"2023-10-14T19:08:45.978035+0000","last_fullsized":"2023-10-14T19:08:45.978035+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:38.200054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.977090+0000","last_change":"2023-10-14T19:08:44.964512+0000","last_active":"2023-10-14T19:08:45.977090+0000","last_peered":"2023-10-14T19:08:45.977090+0000","last_clean":"2023-10-14T19:08:45.977090+0000","last_became_active":"2023-10-14T19:08:44.964232+0000","last_became_peered":"2023-10-14T19:08:44.964232+0000","last_unstale":"2023-10-14T19:08:45.977090+0000","last_undegraded":"2023-10-14T19:08:45.977090+0000","last_fullsized":"2023-10-14T19:08:45.977090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:22.378678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.957360+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:08:44.957360+0000","last_peered":"2023-10-14T19:08:44.957360+0000","last_clean":"2023-10-14T19:08:44.957360+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:08:44.957360+0000","last_undegraded":"2023-10-14T19:08:44.957360+0000","last_fullsized":"2023-10-14T19:08:44.957360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":1063442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56999999999999995,"15min":0.68799999999999994},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75700000000000001,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.56999999999999995,"15min":0.68700000000000006},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58299999999999996,"15min":0.68500000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55200000000000005,"15min":0.626},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.77700000000000002},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.65300000000000002,"15min":0.76000000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70099999999999996,"5min":3.23,"15min":3.23},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63,"15min":0.80400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71399999999999997,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65700000000000003,"15min":0.77800000000000002},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79300000000000004,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.497,"15min":0.58299999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.56699999999999995,"15min":0.71999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.65100000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68500000000000005,"5min":2.883,"15min":2.883},"last":0.68999999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59299999999999997,"15min":0.68100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83399999999999996,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.64000000000000001,"15min":0.81299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":5.383,"15min":5.383},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298372,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073468,"statfs":{"total":96636764160,"available":96331231232,"internally_reserved":0,"allocated":1110016,"data_stored":473586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.59099999999999997,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72699999999999998,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60199999999999998,"15min":0.76800000000000002},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.60399999999999998,"15min":0.78800000000000003},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.80400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.85799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.63100000000000001,"15min":0.81899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.63800000000000001,"15min":0.83799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75900000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73899999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":472962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.495,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54700000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.34200000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.28799999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":1.032,"15min":1.032},"last":0.54800000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.625,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.079,"15min":1.079},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303056,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068784,"statfs":{"total":96636764160,"available":96326434816,"internally_reserved":0,"allocated":1712128,"data_stored":1070172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.497,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.62,"15min":0.62},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.499}]},{"osd":4,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72999999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80000000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61299999999999999,"15min":0.64300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.755},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":479284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.36099999999999999},"min":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46100000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.37,"15min":0.44800000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.496,"5min":2.028,"15min":2.028},"last":0.24199999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.373,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54200000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.48699999999999999,"15min":0.80700000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55300000000000005,"5min":11.269,"15min":11.269},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.46200000000000002,"15min":0.77800000000000002},"min":{"1min":0.248,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":11.318,"15min":11.318},"last":0.311},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.434},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58699999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.67800000000000005},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.69299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.73399999999999999,"15min":1.0700000000000001},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93200000000000005,"5min":11.379,"15min":11.379},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.73199999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":11.404,"15min":11.404},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.65600000000000003},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.85199999999999998,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.74299999999999999,"15min":1.087},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99299999999999999,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":474520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.376},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36099999999999999,"15min":0.39100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.29099999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33300000000000002,"15min":0.371},"min":{"1min":0.21299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.314},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26300000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41699999999999998,"15min":0.45100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72699999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.435},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80600000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":480910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.67800000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.436}]},{"osd":1,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":3.488,"15min":3.488},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64300000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.502,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63900000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66400000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.497}]},{"osd":6,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68500000000000005,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.34000000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.55900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298380,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073460,"statfs":{"total":96636764160,"available":96331223040,"internally_reserved":0,"allocated":1118208,"data_stored":479320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.876,"15min":0.876},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.61699999999999999,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.621},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:08:50.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:08:50.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.235+0000 7f0b33761700 1 Processor -- start 2023-10-14T19:08:50.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 -- start start 2023-10-14T19:08:50.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0b2c0cb5a0 0x7f0b2c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b2c0cd9e0 0x7f0b2c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2c0d13f0 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2c15ae40 con 0x7f0b2c0cb5a0 2023-10-14T19:08:50.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.236+0000 7f0b33761700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c15ab60 con 0x7f0b2c15a400 2023-10-14T19:08:50.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b2c0cd9e0 0x7f0b2c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b2c0cd9e0 0x7f0b2c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55760/0 (socket says 172.21.15.7:55760) 2023-10-14T19:08:50.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 -- 172.21.15.7:0/2071008806 learned_addr learned my addr 172.21.15.7:0/2071008806 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:50.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b31cfe700 1 --2- 172.21.15.7:0/2071008806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b314fd700 1 --2- 172.21.15.7:0/2071008806 >> v2:172.21.15.148:3300/0 conn(0x7f0b2c0cb5a0 0x7f0b2c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 -- 172.21.15.7:0/2071008806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 msgr2=0x7f0b2c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 --2- 172.21.15.7:0/2071008806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 -- 172.21.15.7:0/2071008806 >> v2:172.21.15.148:3300/0 conn(0x7f0b2c0cb5a0 msgr2=0x7f0b2c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 --2- 172.21.15.7:0/2071008806 >> v2:172.21.15.148:3300/0 conn(0x7f0b2c0cb5a0 0x7f0b2c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 -- 172.21.15.7:0/2071008806 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0ccf00 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b30cfc700 1 --2- 172.21.15.7:0/2071008806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c159ec0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0b200099b0 tx=0x7f0b20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4716e7f946ba43 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b2bfff700 1 -- 172.21.15.7:0/2071008806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000b820 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b2bfff700 1 -- 172.21.15.7:0/2071008806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2000b980 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.237+0000 7f0b2bfff700 1 -- 172.21.15.7:0/2071008806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000bd20 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 -- 172.21.15.7:0/2071008806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 msgr2=0x7f0b2c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 --2- 172.21.15.7:0/2071008806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c159ec0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0b200099b0 tx=0x7f0b20009250 comp rx=0 tx=0).stop 2023-10-14T19:08:50.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 -- 172.21.15.7:0/2071008806 shutdown_connections 2023-10-14T19:08:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 --2- 172.21.15.7:0/2071008806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 --2- 172.21.15.7:0/2071008806 >> v2:172.21.15.148:3300/0 conn(0x7f0b2c0cb5a0 0x7f0b2c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 --2- 172.21.15.7:0/2071008806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c159ec0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 -- 172.21.15.7:0/2071008806 >> 172.21.15.7:0/2071008806 conn(0x7f0b2c070e30 msgr2=0x7f0b2c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 -- 172.21.15.7:0/2071008806 shutdown_connections 2023-10-14T19:08:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.238+0000 7f0b33761700 1 -- 172.21.15.7:0/2071008806 wait complete. 2023-10-14T19:08:50.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.239+0000 7f0b33761700 1 Processor -- start 2023-10-14T19:08:50.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.239+0000 7f0b33761700 1 -- start start 2023-10-14T19:08:50.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b33761700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b2c0cb5a0 0x7f0b2c169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b33761700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b33761700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c1668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b33761700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0b4d60 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b33761700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c15c150 con 0x7f0b2c0cb5a0 2023-10-14T19:08:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b33761700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0b4a30 con 0x7f0b2c15a400 2023-10-14T19:08:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c0af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55774/0 (socket says 172.21.15.7:55774) 2023-10-14T19:08:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 -- 172.21.15.7:0/3993385643 learned_addr learned my addr 172.21.15.7:0/3993385643 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b314fd700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b2c0cb5a0 0x7f0b2c169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b31cfe700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c1668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 -- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 msgr2=0x7f0b2c1668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c1668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 -- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b2c0cb5a0 msgr2=0x7f0b2c169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b2c0cb5a0 0x7f0b2c169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 -- 172.21.15.7:0/3993385643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200094f0 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b314fd700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b2c0cb5a0 0x7f0b2c169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.240+0000 7f0b30cfc700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c0af640 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c06ea60 tx=0x7f0b20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.241+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011e70 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.241+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20024440 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.241+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20024800 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.241+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c0c81d0 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.241+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c166df0 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.241+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c0b4f10 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.242+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0b2001a420 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.242+0000 7f0b297fa700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0b18067200 0x7f0b180696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.242+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b200868c0 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.243+0000 7f0b314fd700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0b18067200 0x7f0b180696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.243+0000 7f0b314fd700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0b18067200 0x7f0b180696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c007540 tx=0x7f0b1c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.247+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b2c0b4f10 con 0x7f0b2c0cd9e0 2023-10-14T19:08:50.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.435+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b2c0b4f10 con 0x7f0b18067200 2023-10-14T19:08:50.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.443+0000 7f0b297fa700 1 -- 172.21.15.7:0/3993385643 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289634 (secure 0 0 0) 0x7f0b2c0b4f10 con 0x7f0b18067200 2023-10-14T19:08:50.448 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0b18067200 msgr2=0x7f0b180696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0b18067200 0x7f0b180696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c007540 tx=0x7f0b1c00b040 comp rx=0 tx=0).stop 2023-10-14T19:08:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 msgr2=0x7f0b2c0af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c0af640 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c06ea60 tx=0x7f0b20017000 comp rx=0 tx=0).stop 2023-10-14T19:08:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 shutdown_connections 2023-10-14T19:08:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0b18067200 0x7f0b180696b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b2c0cb5a0 0x7f0b2c169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b2c15a400 0x7f0b2c1668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 --2- 172.21.15.7:0/3993385643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b2c0cd9e0 0x7f0b2c0af640 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 >> 172.21.15.7:0/3993385643 conn(0x7f0b2c070e30 msgr2=0x7f0b2c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:50.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 shutdown_connections 2023-10-14T19:08:50.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.447+0000 7f0b33761700 1 -- 172.21.15.7:0/3993385643 wait complete. 2023-10-14T19:08:50.454 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:08:50.460 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2023-10-14T19:08:49.705007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408664,"kb_used_data":9880,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566056,"statfs":{"total":773094113280,"available":770627641344,"internally_reserved":0,"allocated":10117120,"data_stored":4994196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.759916"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983634+0000","last_change":"2023-10-14T19:08:45.983634+0000","last_active":"2023-10-14T19:08:45.983634+0000","last_peered":"2023-10-14T19:08:45.983634+0000","last_clean":"2023-10-14T19:08:45.983634+0000","last_became_active":"2023-10-14T19:08:45.983379+0000","last_became_peered":"2023-10-14T19:08:45.983379+0000","last_unstale":"2023-10-14T19:08:45.983634+0000","last_undegraded":"2023-10-14T19:08:45.983634+0000","last_fullsized":"2023-10-14T19:08:45.983634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:40.006894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981989+0000","last_change":"2023-10-14T19:08:45.974462+0000","last_active":"2023-10-14T19:08:45.981989+0000","last_peered":"2023-10-14T19:08:45.981989+0000","last_clean":"2023-10-14T19:08:45.981989+0000","last_became_active":"2023-10-14T19:08:45.974111+0000","last_became_peered":"2023-10-14T19:08:45.974111+0000","last_unstale":"2023-10-14T19:08:45.981989+0000","last_undegraded":"2023-10-14T19:08:45.981989+0000","last_fullsized":"2023-10-14T19:08:45.981989+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:53.552708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981664+0000","last_change":"2023-10-14T19:08:45.981664+0000","last_active":"2023-10-14T19:08:45.981664+0000","last_peered":"2023-10-14T19:08:45.981664+0000","last_clean":"2023-10-14T19:08:45.981664+0000","last_became_active":"2023-10-14T19:08:45.981363+0000","last_became_peered":"2023-10-14T19:08:45.981363+0000","last_unstale":"2023-10-14T19:08:45.981664+0000","last_undegraded":"2023-10-14T19:08:45.981664+0000","last_fullsized":"2023-10-14T19:08:45.981664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:44.899339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.975014+0000","last_change":"2023-10-14T19:08:45.975014+0000","last_active":"2023-10-14T19:08:45.975014+0000","last_peered":"2023-10-14T19:08:45.975014+0000","last_clean":"2023-10-14T19:08:45.975014+0000","last_became_active":"2023-10-14T19:08:45.974744+0000","last_became_peered":"2023-10-14T19:08:45.974744+0000","last_unstale":"2023-10-14T19:08:45.975014+0000","last_undegraded":"2023-10-14T19:08:45.975014+0000","last_fullsized":"2023-10-14T19:08:45.975014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:05:24.393337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987069+0000","last_change":"2023-10-14T19:08:45.980473+0000","last_active":"2023-10-14T19:08:45.987069+0000","last_peered":"2023-10-14T19:08:45.987069+0000","last_clean":"2023-10-14T19:08:45.987069+0000","last_became_active":"2023-10-14T19:08:45.980220+0000","last_became_peered":"2023-10-14T19:08:45.980220+0000","last_unstale":"2023-10-14T19:08:45.987069+0000","last_undegraded":"2023-10-14T19:08:45.987069+0000","last_fullsized":"2023-10-14T19:08:45.987069+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:38.017926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985108+0000","last_change":"2023-10-14T19:08:45.985108+0000","last_active":"2023-10-14T19:08:45.985108+0000","last_peered":"2023-10-14T19:08:45.985108+0000","last_clean":"2023-10-14T19:08:45.985108+0000","last_became_active":"2023-10-14T19:08:45.984852+0000","last_became_peered":"2023-10-14T19:08:45.984852+0000","last_unstale":"2023-10-14T19:08:45.985108+0000","last_undegraded":"2023-10-14T19:08:45.985108+0000","last_fullsized":"2023-10-14T19:08:45.985108+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:27.853080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985288+0000","last_change":"2023-10-14T19:08:45.985288+0000","last_active":"2023-10-14T19:08:45.985288+0000","last_peered":"2023-10-14T19:08:45.985288+0000","last_clean":"2023-10-14T19:08:45.985288+0000","last_became_active":"2023-10-14T19:08:45.983684+0000","last_became_peered":"2023-10-14T19:08:45.983684+0000","last_unstale":"2023-10-14T19:08:45.985288+0000","last_undegraded":"2023-10-14T19:08:45.985288+0000","last_fullsized":"2023-10-14T19:08:45.985288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:43.390840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985207+0000","last_change":"2023-10-14T19:08:45.980163+0000","last_active":"2023-10-14T19:08:45.985207+0000","last_peered":"2023-10-14T19:08:45.985207+0000","last_clean":"2023-10-14T19:08:45.985207+0000","last_became_active":"2023-10-14T19:08:45.979895+0000","last_became_peered":"2023-10-14T19:08:45.979895+0000","last_unstale":"2023-10-14T19:08:45.985207+0000","last_undegraded":"2023-10-14T19:08:45.985207+0000","last_fullsized":"2023-10-14T19:08:45.985207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:30.669427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985788+0000","last_change":"2023-10-14T19:08:45.980169+0000","last_active":"2023-10-14T19:08:45.985788+0000","last_peered":"2023-10-14T19:08:45.985788+0000","last_clean":"2023-10-14T19:08:45.985788+0000","last_became_active":"2023-10-14T19:08:45.979893+0000","last_became_peered":"2023-10-14T19:08:45.979893+0000","last_unstale":"2023-10-14T19:08:45.985788+0000","last_undegraded":"2023-10-14T19:08:45.985788+0000","last_fullsized":"2023-10-14T19:08:45.985788+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:51:44.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986835+0000","last_change":"2023-10-14T19:08:45.981786+0000","last_active":"2023-10-14T19:08:45.986835+0000","last_peered":"2023-10-14T19:08:45.986835+0000","last_clean":"2023-10-14T19:08:45.986835+0000","last_became_active":"2023-10-14T19:08:45.981514+0000","last_became_peered":"2023-10-14T19:08:45.981514+0000","last_unstale":"2023-10-14T19:08:45.986835+0000","last_undegraded":"2023-10-14T19:08:45.986835+0000","last_fullsized":"2023-10-14T19:08:45.986835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:23.382757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985089+0000","last_change":"2023-10-14T19:08:45.985089+0000","last_active":"2023-10-14T19:08:45.985089+0000","last_peered":"2023-10-14T19:08:45.985089+0000","last_clean":"2023-10-14T19:08:45.985089+0000","last_became_active":"2023-10-14T19:08:45.984793+0000","last_became_peered":"2023-10-14T19:08:45.984793+0000","last_unstale":"2023-10-14T19:08:45.985089+0000","last_undegraded":"2023-10-14T19:08:45.985089+0000","last_fullsized":"2023-10-14T19:08:45.985089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:21.897908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991820+0000","last_change":"2023-10-14T19:08:45.984005+0000","last_active":"2023-10-14T19:08:45.991820+0000","last_peered":"2023-10-14T19:08:45.991820+0000","last_clean":"2023-10-14T19:08:45.991820+0000","last_became_active":"2023-10-14T19:08:45.983760+0000","last_became_peered":"2023-10-14T19:08:45.983760+0000","last_unstale":"2023-10-14T19:08:45.991820+0000","last_undegraded":"2023-10-14T19:08:45.991820+0000","last_fullsized":"2023-10-14T19:08:45.991820+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:21:40.105654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980482+0000","last_change":"2023-10-14T19:08:45.980482+0000","last_active":"2023-10-14T19:08:45.980482+0000","last_peered":"2023-10-14T19:08:45.980482+0000","last_clean":"2023-10-14T19:08:45.980482+0000","last_became_active":"2023-10-14T19:08:45.980202+0000","last_became_peered":"2023-10-14T19:08:45.980202+0000","last_unstale":"2023-10-14T19:08:45.980482+0000","last_undegraded":"2023-10-14T19:08:45.980482+0000","last_fullsized":"2023-10-14T19:08:45.980482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:43.390840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984686+0000","last_change":"2023-10-14T19:08:45.981674+0000","last_active":"2023-10-14T19:08:45.984686+0000","last_peered":"2023-10-14T19:08:45.984686+0000","last_clean":"2023-10-14T19:08:45.984686+0000","last_became_active":"2023-10-14T19:08:45.981043+0000","last_became_peered":"2023-10-14T19:08:45.981043+0000","last_unstale":"2023-10-14T19:08:45.984686+0000","last_undegraded":"2023-10-14T19:08:45.984686+0000","last_fullsized":"2023-10-14T19:08:45.984686+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:12.546499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983378+0000","last_change":"2023-10-14T19:08:45.983378+0000","last_active":"2023-10-14T19:08:45.983378+0000","last_peered":"2023-10-14T19:08:45.983378+0000","last_clean":"2023-10-14T19:08:45.983378+0000","last_became_active":"2023-10-14T19:08:45.983100+0000","last_became_peered":"2023-10-14T19:08:45.983100+0000","last_unstale":"2023-10-14T19:08:45.983378+0000","last_undegraded":"2023-10-14T19:08:45.983378+0000","last_fullsized":"2023-10-14T19:08:45.983378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:26.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986100+0000","last_change":"2023-10-14T19:08:45.986100+0000","last_active":"2023-10-14T19:08:45.986100+0000","last_peered":"2023-10-14T19:08:45.986100+0000","last_clean":"2023-10-14T19:08:45.986100+0000","last_became_active":"2023-10-14T19:08:45.985699+0000","last_became_peered":"2023-10-14T19:08:45.985699+0000","last_unstale":"2023-10-14T19:08:45.986100+0000","last_undegraded":"2023-10-14T19:08:45.986100+0000","last_fullsized":"2023-10-14T19:08:45.986100+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:40.059172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.977417+0000","last_change":"2023-10-14T19:08:45.970500+0000","last_active":"2023-10-14T19:08:45.977417+0000","last_peered":"2023-10-14T19:08:45.977417+0000","last_clean":"2023-10-14T19:08:45.977417+0000","last_became_active":"2023-10-14T19:08:45.970223+0000","last_became_peered":"2023-10-14T19:08:45.970223+0000","last_unstale":"2023-10-14T19:08:45.977417+0000","last_undegraded":"2023-10-14T19:08:45.977417+0000","last_fullsized":"2023-10-14T19:08:45.977417+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:19.807986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.974372+0000","last_change":"2023-10-14T19:08:45.974372+0000","last_active":"2023-10-14T19:08:45.974372+0000","last_peered":"2023-10-14T19:08:45.974372+0000","last_clean":"2023-10-14T19:08:45.974372+0000","last_became_active":"2023-10-14T19:08:45.974051+0000","last_became_peered":"2023-10-14T19:08:45.974051+0000","last_unstale":"2023-10-14T19:08:45.974372+0000","last_undegraded":"2023-10-14T19:08:45.974372+0000","last_fullsized":"2023-10-14T19:08:45.974372+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:27.853080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984673+0000","last_change":"2023-10-14T19:08:45.982376+0000","last_active":"2023-10-14T19:08:45.984673+0000","last_peered":"2023-10-14T19:08:45.984673+0000","last_clean":"2023-10-14T19:08:45.984673+0000","last_became_active":"2023-10-14T19:08:45.982072+0000","last_became_peered":"2023-10-14T19:08:45.982072+0000","last_unstale":"2023-10-14T19:08:45.984673+0000","last_undegraded":"2023-10-14T19:08:45.984673+0000","last_fullsized":"2023-10-14T19:08:45.984673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:52:40.325412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981127+0000","last_change":"2023-10-14T19:08:45.977700+0000","last_active":"2023-10-14T19:08:45.981127+0000","last_peered":"2023-10-14T19:08:45.981127+0000","last_clean":"2023-10-14T19:08:45.981127+0000","last_became_active":"2023-10-14T19:08:45.977408+0000","last_became_peered":"2023-10-14T19:08:45.977408+0000","last_unstale":"2023-10-14T19:08:45.981127+0000","last_undegraded":"2023-10-14T19:08:45.981127+0000","last_fullsized":"2023-10-14T19:08:45.981127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:33.399863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.976546+0000","last_change":"2023-10-14T19:08:45.973900+0000","last_active":"2023-10-14T19:08:45.976546+0000","last_peered":"2023-10-14T19:08:45.976546+0000","last_clean":"2023-10-14T19:08:45.976546+0000","last_became_active":"2023-10-14T19:08:45.973629+0000","last_became_peered":"2023-10-14T19:08:45.973629+0000","last_unstale":"2023-10-14T19:08:45.976546+0000","last_undegraded":"2023-10-14T19:08:45.976546+0000","last_fullsized":"2023-10-14T19:08:45.976546+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:49.727457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981591+0000","last_change":"2023-10-14T19:08:45.973209+0000","last_active":"2023-10-14T19:08:45.981591+0000","last_peered":"2023-10-14T19:08:45.981591+0000","last_clean":"2023-10-14T19:08:45.981591+0000","last_became_active":"2023-10-14T19:08:45.972923+0000","last_became_peered":"2023-10-14T19:08:45.972923+0000","last_unstale":"2023-10-14T19:08:45.981591+0000","last_undegraded":"2023-10-14T19:08:45.981591+0000","last_fullsized":"2023-10-14T19:08:45.981591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:25:03.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981624+0000","last_change":"2023-10-14T19:08:45.973906+0000","last_active":"2023-10-14T19:08:45.981624+0000","last_peered":"2023-10-14T19:08:45.981624+0000","last_clean":"2023-10-14T19:08:45.981624+0000","last_became_active":"2023-10-14T19:08:45.973627+0000","last_became_peered":"2023-10-14T19:08:45.973627+0000","last_unstale":"2023-10-14T19:08:45.981624+0000","last_undegraded":"2023-10-14T19:08:45.981624+0000","last_fullsized":"2023-10-14T19:08:45.981624+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:45:24.131888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.992089+0000","last_change":"2023-10-14T19:08:45.992089+0000","last_active":"2023-10-14T19:08:45.992089+0000","last_peered":"2023-10-14T19:08:45.992089+0000","last_clean":"2023-10-14T19:08:45.992089+0000","last_became_active":"2023-10-14T19:08:45.991797+0000","last_became_peered":"2023-10-14T19:08:45.991797+0000","last_unstale":"2023-10-14T19:08:45.992089+0000","last_undegraded":"2023-10-14T19:08:45.992089+0000","last_fullsized":"2023-10-14T19:08:45.992089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:19.807986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978569+0000","last_change":"2023-10-14T19:08:45.971901+0000","last_active":"2023-10-14T19:08:45.978569+0000","last_peered":"2023-10-14T19:08:45.978569+0000","last_clean":"2023-10-14T19:08:45.978569+0000","last_became_active":"2023-10-14T19:08:45.971635+0000","last_became_peered":"2023-10-14T19:08:45.971635+0000","last_unstale":"2023-10-14T19:08:45.978569+0000","last_undegraded":"2023-10-14T19:08:45.978569+0000","last_fullsized":"2023-10-14T19:08:45.978569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:12.314568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986521+0000","last_change":"2023-10-14T19:08:45.981785+0000","last_active":"2023-10-14T19:08:45.986521+0000","last_peered":"2023-10-14T19:08:45.986521+0000","last_clean":"2023-10-14T19:08:45.986521+0000","last_became_active":"2023-10-14T19:08:45.981523+0000","last_became_peered":"2023-10-14T19:08:45.981523+0000","last_unstale":"2023-10-14T19:08:45.986521+0000","last_undegraded":"2023-10-14T19:08:45.986521+0000","last_fullsized":"2023-10-14T19:08:45.986521+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:02.829460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984252+0000","last_change":"2023-10-14T19:08:45.984252+0000","last_active":"2023-10-14T19:08:45.984252+0000","last_peered":"2023-10-14T19:08:45.984252+0000","last_clean":"2023-10-14T19:08:45.984252+0000","last_became_active":"2023-10-14T19:08:45.983979+0000","last_became_peered":"2023-10-14T19:08:45.983979+0000","last_unstale":"2023-10-14T19:08:45.984252+0000","last_undegraded":"2023-10-14T19:08:45.984252+0000","last_fullsized":"2023-10-14T19:08:45.984252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:44.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983083+0000","last_change":"2023-10-14T19:08:45.977610+0000","last_active":"2023-10-14T19:08:45.983083+0000","last_peered":"2023-10-14T19:08:45.983083+0000","last_clean":"2023-10-14T19:08:45.983083+0000","last_became_active":"2023-10-14T19:08:45.976632+0000","last_became_peered":"2023-10-14T19:08:45.976632+0000","last_unstale":"2023-10-14T19:08:45.983083+0000","last_undegraded":"2023-10-14T19:08:45.983083+0000","last_fullsized":"2023-10-14T19:08:45.983083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:02.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985163+0000","last_change":"2023-10-14T19:08:45.981704+0000","last_active":"2023-10-14T19:08:45.985163+0000","last_peered":"2023-10-14T19:08:45.985163+0000","last_clean":"2023-10-14T19:08:45.985163+0000","last_became_active":"2023-10-14T19:08:45.981377+0000","last_became_peered":"2023-10-14T19:08:45.981377+0000","last_unstale":"2023-10-14T19:08:45.985163+0000","last_undegraded":"2023-10-14T19:08:45.985163+0000","last_fullsized":"2023-10-14T19:08:45.985163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:44.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984718+0000","last_change":"2023-10-14T19:08:45.982392+0000","last_active":"2023-10-14T19:08:45.984718+0000","last_peered":"2023-10-14T19:08:45.984718+0000","last_clean":"2023-10-14T19:08:45.984718+0000","last_became_active":"2023-10-14T19:08:45.982112+0000","last_became_peered":"2023-10-14T19:08:45.982112+0000","last_unstale":"2023-10-14T19:08:45.984718+0000","last_undegraded":"2023-10-14T19:08:45.984718+0000","last_fullsized":"2023-10-14T19:08:45.984718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:05.824580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986171+0000","last_change":"2023-10-14T19:08:45.986171+0000","last_active":"2023-10-14T19:08:45.986171+0000","last_peered":"2023-10-14T19:08:45.986171+0000","last_clean":"2023-10-14T19:08:45.986171+0000","last_became_active":"2023-10-14T19:08:45.983402+0000","last_became_peered":"2023-10-14T19:08:45.983402+0000","last_unstale":"2023-10-14T19:08:45.986171+0000","last_undegraded":"2023-10-14T19:08:45.986171+0000","last_fullsized":"2023-10-14T19:08:45.986171+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:26.751840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991154+0000","last_change":"2023-10-14T19:08:45.991154+0000","last_active":"2023-10-14T19:08:45.991154+0000","last_peered":"2023-10-14T19:08:45.991154+0000","last_clean":"2023-10-14T19:08:45.991154+0000","last_became_active":"2023-10-14T19:08:45.990838+0000","last_became_peered":"2023-10-14T19:08:45.990838+0000","last_unstale":"2023-10-14T19:08:45.991154+0000","last_undegraded":"2023-10-14T19:08:45.991154+0000","last_fullsized":"2023-10-14T19:08:45.991154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:42.367679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986268+0000","last_change":"2023-10-14T19:08:45.983113+0000","last_active":"2023-10-14T19:08:45.986268+0000","last_peered":"2023-10-14T19:08:45.986268+0000","last_clean":"2023-10-14T19:08:45.986268+0000","last_became_active":"2023-10-14T19:08:45.982801+0000","last_became_peered":"2023-10-14T19:08:45.982801+0000","last_unstale":"2023-10-14T19:08:45.986268+0000","last_undegraded":"2023-10-14T19:08:45.986268+0000","last_fullsized":"2023-10-14T19:08:45.986268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:34:07.969334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.997814+0000","last_change":"2023-10-14T19:08:44.963356+0000","last_active":"2023-10-14T19:08:45.997814+0000","last_peered":"2023-10-14T19:08:45.997814+0000","last_clean":"2023-10-14T19:08:45.997814+0000","last_became_active":"2023-10-14T19:08:44.963077+0000","last_became_peered":"2023-10-14T19:08:44.963077+0000","last_unstale":"2023-10-14T19:08:45.997814+0000","last_undegraded":"2023-10-14T19:08:45.997814+0000","last_fullsized":"2023-10-14T19:08:45.997814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:06:32.457474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985656+0000","last_change":"2023-10-14T19:08:45.985656+0000","last_active":"2023-10-14T19:08:45.985656+0000","last_peered":"2023-10-14T19:08:45.985656+0000","last_clean":"2023-10-14T19:08:45.985656+0000","last_became_active":"2023-10-14T19:08:45.985366+0000","last_became_peered":"2023-10-14T19:08:45.985366+0000","last_unstale":"2023-10-14T19:08:45.985656+0000","last_undegraded":"2023-10-14T19:08:45.985656+0000","last_fullsized":"2023-10-14T19:08:45.985656+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:42.096880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.976961+0000","last_change":"2023-10-14T19:08:44.968097+0000","last_active":"2023-10-14T19:08:45.976961+0000","last_peered":"2023-10-14T19:08:45.976961+0000","last_clean":"2023-10-14T19:08:45.976961+0000","last_became_active":"2023-10-14T19:08:44.967828+0000","last_became_peered":"2023-10-14T19:08:44.967828+0000","last_unstale":"2023-10-14T19:08:45.976961+0000","last_undegraded":"2023-10-14T19:08:45.976961+0000","last_fullsized":"2023-10-14T19:08:45.976961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:11.310490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.989959+0000","last_change":"2023-10-14T19:08:45.989959+0000","last_active":"2023-10-14T19:08:45.989959+0000","last_peered":"2023-10-14T19:08:45.989959+0000","last_clean":"2023-10-14T19:08:45.989959+0000","last_became_active":"2023-10-14T19:08:45.989714+0000","last_became_peered":"2023-10-14T19:08:45.989714+0000","last_unstale":"2023-10-14T19:08:45.989959+0000","last_undegraded":"2023-10-14T19:08:45.989959+0000","last_fullsized":"2023-10-14T19:08:45.989959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:03.104759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995797+0000","last_change":"2023-10-14T19:08:44.962139+0000","last_active":"2023-10-14T19:08:45.995797+0000","last_peered":"2023-10-14T19:08:45.995797+0000","last_clean":"2023-10-14T19:08:45.995797+0000","last_became_active":"2023-10-14T19:08:44.961590+0000","last_became_peered":"2023-10-14T19:08:44.961590+0000","last_unstale":"2023-10-14T19:08:45.995797+0000","last_undegraded":"2023-10-14T19:08:45.995797+0000","last_fullsized":"2023-10-14T19:08:45.995797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:41.011151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985943+0000","last_change":"2023-10-14T19:08:45.980716+0000","last_active":"2023-10-14T19:08:45.985943+0000","last_peered":"2023-10-14T19:08:45.985943+0000","last_clean":"2023-10-14T19:08:45.985943+0000","last_became_active":"2023-10-14T19:08:45.980453+0000","last_became_peered":"2023-10-14T19:08:45.980453+0000","last_unstale":"2023-10-14T19:08:45.985943+0000","last_undegraded":"2023-10-14T19:08:45.985943+0000","last_fullsized":"2023-10-14T19:08:45.985943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:12.314568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994930+0000","last_change":"2023-10-14T19:08:44.966287+0000","last_active":"2023-10-14T19:08:45.994930+0000","last_peered":"2023-10-14T19:08:45.994930+0000","last_clean":"2023-10-14T19:08:45.994930+0000","last_became_active":"2023-10-14T19:08:44.965950+0000","last_became_peered":"2023-10-14T19:08:44.965950+0000","last_unstale":"2023-10-14T19:08:45.994930+0000","last_undegraded":"2023-10-14T19:08:45.994930+0000","last_fullsized":"2023-10-14T19:08:45.994930+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:48:12.110598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983317+0000","last_change":"2023-10-14T19:08:45.978824+0000","last_active":"2023-10-14T19:08:45.983317+0000","last_peered":"2023-10-14T19:08:45.983317+0000","last_clean":"2023-10-14T19:08:45.983317+0000","last_became_active":"2023-10-14T19:08:45.978575+0000","last_became_peered":"2023-10-14T19:08:45.978575+0000","last_unstale":"2023-10-14T19:08:45.983317+0000","last_undegraded":"2023-10-14T19:08:45.983317+0000","last_fullsized":"2023-10-14T19:08:45.983317+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:07.888741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.977395+0000","last_change":"2023-10-14T19:08:44.971701+0000","last_active":"2023-10-14T19:08:45.977395+0000","last_peered":"2023-10-14T19:08:45.977395+0000","last_clean":"2023-10-14T19:08:45.977395+0000","last_became_active":"2023-10-14T19:08:44.971424+0000","last_became_peered":"2023-10-14T19:08:44.971424+0000","last_unstale":"2023-10-14T19:08:45.977395+0000","last_undegraded":"2023-10-14T19:08:45.977395+0000","last_fullsized":"2023-10-14T19:08:45.977395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:22:52.554783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984416+0000","last_change":"2023-10-14T19:08:45.984416+0000","last_active":"2023-10-14T19:08:45.984416+0000","last_peered":"2023-10-14T19:08:45.984416+0000","last_clean":"2023-10-14T19:08:45.984416+0000","last_became_active":"2023-10-14T19:08:45.984157+0000","last_became_peered":"2023-10-14T19:08:45.984157+0000","last_unstale":"2023-10-14T19:08:45.984416+0000","last_undegraded":"2023-10-14T19:08:45.984416+0000","last_fullsized":"2023-10-14T19:08:45.984416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:26.751840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994041+0000","last_change":"2023-10-14T19:08:44.968661+0000","last_active":"2023-10-14T19:08:45.994041+0000","last_peered":"2023-10-14T19:08:45.994041+0000","last_clean":"2023-10-14T19:08:45.994041+0000","last_became_active":"2023-10-14T19:08:44.968374+0000","last_became_peered":"2023-10-14T19:08:44.968374+0000","last_unstale":"2023-10-14T19:08:45.994041+0000","last_undegraded":"2023-10-14T19:08:45.994041+0000","last_fullsized":"2023-10-14T19:08:45.994041+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:32.395784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978138+0000","last_change":"2023-10-14T19:08:45.978138+0000","last_active":"2023-10-14T19:08:45.978138+0000","last_peered":"2023-10-14T19:08:45.978138+0000","last_clean":"2023-10-14T19:08:45.978138+0000","last_became_active":"2023-10-14T19:08:45.977788+0000","last_became_peered":"2023-10-14T19:08:45.977788+0000","last_unstale":"2023-10-14T19:08:45.978138+0000","last_undegraded":"2023-10-14T19:08:45.978138+0000","last_fullsized":"2023-10-14T19:08:45.978138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:47:24.744588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967116+0000","last_change":"2023-10-14T19:08:44.959401+0000","last_active":"2023-10-14T19:08:45.967116+0000","last_peered":"2023-10-14T19:08:45.967116+0000","last_clean":"2023-10-14T19:08:45.967116+0000","last_became_active":"2023-10-14T19:08:44.959116+0000","last_became_peered":"2023-10-14T19:08:44.959116+0000","last_unstale":"2023-10-14T19:08:45.967116+0000","last_undegraded":"2023-10-14T19:08:45.967116+0000","last_fullsized":"2023-10-14T19:08:45.967116+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:53:42.838156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987591+0000","last_change":"2023-10-14T19:08:45.982674+0000","last_active":"2023-10-14T19:08:45.987591+0000","last_peered":"2023-10-14T19:08:45.987591+0000","last_clean":"2023-10-14T19:08:45.987591+0000","last_became_active":"2023-10-14T19:08:45.982409+0000","last_became_peered":"2023-10-14T19:08:45.982409+0000","last_unstale":"2023-10-14T19:08:45.987591+0000","last_undegraded":"2023-10-14T19:08:45.987591+0000","last_fullsized":"2023-10-14T19:08:45.987591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:02.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.967880+0000","last_change":"2023-10-14T19:08:44.962911+0000","last_active":"2023-10-14T19:08:44.967880+0000","last_peered":"2023-10-14T19:08:44.967880+0000","last_clean":"2023-10-14T19:08:44.967880+0000","last_became_active":"2023-10-14T19:08:44.962641+0000","last_became_peered":"2023-10-14T19:08:44.962641+0000","last_unstale":"2023-10-14T19:08:44.967880+0000","last_undegraded":"2023-10-14T19:08:44.967880+0000","last_fullsized":"2023-10-14T19:08:44.967880+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:32.672479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986508+0000","last_change":"2023-10-14T19:08:45.979491+0000","last_active":"2023-10-14T19:08:45.986508+0000","last_peered":"2023-10-14T19:08:45.986508+0000","last_clean":"2023-10-14T19:08:45.986508+0000","last_became_active":"2023-10-14T19:08:45.979195+0000","last_became_peered":"2023-10-14T19:08:45.979195+0000","last_unstale":"2023-10-14T19:08:45.986508+0000","last_undegraded":"2023-10-14T19:08:45.986508+0000","last_fullsized":"2023-10-14T19:08:45.986508+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:59.299713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.967919+0000","last_change":"2023-10-14T19:08:44.963972+0000","last_active":"2023-10-14T19:08:44.967919+0000","last_peered":"2023-10-14T19:08:44.967919+0000","last_clean":"2023-10-14T19:08:44.967919+0000","last_became_active":"2023-10-14T19:08:44.963700+0000","last_became_peered":"2023-10-14T19:08:44.963700+0000","last_unstale":"2023-10-14T19:08:44.967919+0000","last_undegraded":"2023-10-14T19:08:44.967919+0000","last_fullsized":"2023-10-14T19:08:44.967919+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:16.948419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987671+0000","last_change":"2023-10-14T19:08:45.982947+0000","last_active":"2023-10-14T19:08:45.987671+0000","last_peered":"2023-10-14T19:08:45.987671+0000","last_clean":"2023-10-14T19:08:45.987671+0000","last_became_active":"2023-10-14T19:08:45.982679+0000","last_became_peered":"2023-10-14T19:08:45.982679+0000","last_unstale":"2023-10-14T19:08:45.987671+0000","last_undegraded":"2023-10-14T19:08:45.987671+0000","last_fullsized":"2023-10-14T19:08:45.987671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:23.382757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.968456+0000","last_change":"2023-10-14T19:08:44.966343+0000","last_active":"2023-10-14T19:08:44.968456+0000","last_peered":"2023-10-14T19:08:44.968456+0000","last_clean":"2023-10-14T19:08:44.968456+0000","last_became_active":"2023-10-14T19:08:44.966052+0000","last_became_peered":"2023-10-14T19:08:44.966052+0000","last_unstale":"2023-10-14T19:08:44.968456+0000","last_undegraded":"2023-10-14T19:08:44.968456+0000","last_fullsized":"2023-10-14T19:08:44.968456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:01.497573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983055+0000","last_change":"2023-10-14T19:08:45.975989+0000","last_active":"2023-10-14T19:08:45.983055+0000","last_peered":"2023-10-14T19:08:45.983055+0000","last_clean":"2023-10-14T19:08:45.983055+0000","last_became_active":"2023-10-14T19:08:45.975710+0000","last_became_peered":"2023-10-14T19:08:45.975710+0000","last_unstale":"2023-10-14T19:08:45.983055+0000","last_undegraded":"2023-10-14T19:08:45.983055+0000","last_fullsized":"2023-10-14T19:08:45.983055+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:51:44.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"89'3","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994312+0000","last_change":"2023-10-14T19:08:44.965982+0000","last_active":"2023-10-14T19:08:45.994312+0000","last_peered":"2023-10-14T19:08:45.994312+0000","last_clean":"2023-10-14T19:08:45.994312+0000","last_became_active":"2023-10-14T19:08:44.965756+0000","last_became_peered":"2023-10-14T19:08:44.965756+0000","last_unstale":"2023-10-14T19:08:45.994312+0000","last_undegraded":"2023-10-14T19:08:45.994312+0000","last_fullsized":"2023-10-14T19:08:45.994312+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:37.013848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986421+0000","last_change":"2023-10-14T19:08:45.986421+0000","last_active":"2023-10-14T19:08:45.986421+0000","last_peered":"2023-10-14T19:08:45.986421+0000","last_clean":"2023-10-14T19:08:45.986421+0000","last_became_active":"2023-10-14T19:08:45.985798+0000","last_became_peered":"2023-10-14T19:08:45.985798+0000","last_unstale":"2023-10-14T19:08:45.986421+0000","last_undegraded":"2023-10-14T19:08:45.986421+0000","last_fullsized":"2023-10-14T19:08:45.986421+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:45:24.131888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"89'6","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.997315+0000","last_change":"2023-10-14T19:08:44.964779+0000","last_active":"2023-10-14T19:08:45.997315+0000","last_peered":"2023-10-14T19:08:45.997315+0000","last_clean":"2023-10-14T19:08:45.997315+0000","last_became_active":"2023-10-14T19:08:44.964257+0000","last_became_peered":"2023-10-14T19:08:44.964257+0000","last_unstale":"2023-10-14T19:08:45.997315+0000","last_undegraded":"2023-10-14T19:08:45.997315+0000","last_fullsized":"2023-10-14T19:08:45.997315+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:39.002815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.979761+0000","last_change":"2023-10-14T19:08:45.979761+0000","last_active":"2023-10-14T19:08:45.979761+0000","last_peered":"2023-10-14T19:08:45.979761+0000","last_clean":"2023-10-14T19:08:45.979761+0000","last_became_active":"2023-10-14T19:08:45.979472+0000","last_became_peered":"2023-10-14T19:08:45.979472+0000","last_unstale":"2023-10-14T19:08:45.979761+0000","last_undegraded":"2023-10-14T19:08:45.979761+0000","last_fullsized":"2023-10-14T19:08:45.979761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:22.470921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.994584+0000","last_change":"2023-10-14T19:08:44.967103+0000","last_active":"2023-10-14T19:08:45.994584+0000","last_peered":"2023-10-14T19:08:45.994584+0000","last_clean":"2023-10-14T19:08:45.994584+0000","last_became_active":"2023-10-14T19:08:44.966811+0000","last_became_peered":"2023-10-14T19:08:44.966811+0000","last_unstale":"2023-10-14T19:08:45.994584+0000","last_undegraded":"2023-10-14T19:08:45.994584+0000","last_fullsized":"2023-10-14T19:08:45.994584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:57.172867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981439+0000","last_change":"2023-10-14T19:08:45.981439+0000","last_active":"2023-10-14T19:08:45.981439+0000","last_peered":"2023-10-14T19:08:45.981439+0000","last_clean":"2023-10-14T19:08:45.981439+0000","last_became_active":"2023-10-14T19:08:45.981145+0000","last_became_peered":"2023-10-14T19:08:45.981145+0000","last_unstale":"2023-10-14T19:08:45.981439+0000","last_undegraded":"2023-10-14T19:08:45.981439+0000","last_fullsized":"2023-10-14T19:08:45.981439+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:07.888741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967900+0000","last_change":"2023-10-14T19:08:44.968311+0000","last_active":"2023-10-14T19:08:45.967900+0000","last_peered":"2023-10-14T19:08:45.967900+0000","last_clean":"2023-10-14T19:08:45.967900+0000","last_became_active":"2023-10-14T19:08:44.968035+0000","last_became_peered":"2023-10-14T19:08:44.968035+0000","last_unstale":"2023-10-14T19:08:45.967900+0000","last_undegraded":"2023-10-14T19:08:45.967900+0000","last_fullsized":"2023-10-14T19:08:45.967900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:00.258538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.987650+0000","last_change":"2023-10-14T19:08:45.982916+0000","last_active":"2023-10-14T19:08:45.987650+0000","last_peered":"2023-10-14T19:08:45.987650+0000","last_clean":"2023-10-14T19:08:45.987650+0000","last_became_active":"2023-10-14T19:08:45.982457+0000","last_became_peered":"2023-10-14T19:08:45.982457+0000","last_unstale":"2023-10-14T19:08:45.987650+0000","last_undegraded":"2023-10-14T19:08:45.987650+0000","last_fullsized":"2023-10-14T19:08:45.987650+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:38.017926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.971208+0000","last_change":"2023-10-14T19:08:44.962503+0000","last_active":"2023-10-14T19:08:45.971208+0000","last_peered":"2023-10-14T19:08:45.971208+0000","last_clean":"2023-10-14T19:08:45.971208+0000","last_became_active":"2023-10-14T19:08:44.962221+0000","last_became_peered":"2023-10-14T19:08:44.962221+0000","last_unstale":"2023-10-14T19:08:45.971208+0000","last_undegraded":"2023-10-14T19:08:45.971208+0000","last_fullsized":"2023-10-14T19:08:45.971208+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:41.363601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980789+0000","last_change":"2023-10-14T19:08:45.979846+0000","last_active":"2023-10-14T19:08:45.980789+0000","last_peered":"2023-10-14T19:08:45.980789+0000","last_clean":"2023-10-14T19:08:45.980789+0000","last_became_active":"2023-10-14T19:08:45.979512+0000","last_became_peered":"2023-10-14T19:08:45.979512+0000","last_unstale":"2023-10-14T19:08:45.980789+0000","last_undegraded":"2023-10-14T19:08:45.980789+0000","last_fullsized":"2023-10-14T19:08:45.980789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:02.716116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"89'8","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.998001+0000","last_change":"2023-10-14T19:08:44.968008+0000","last_active":"2023-10-14T19:08:45.998001+0000","last_peered":"2023-10-14T19:08:45.998001+0000","last_clean":"2023-10-14T19:08:45.998001+0000","last_became_active":"2023-10-14T19:08:44.967680+0000","last_became_peered":"2023-10-14T19:08:44.967680+0000","last_unstale":"2023-10-14T19:08:45.998001+0000","last_undegraded":"2023-10-14T19:08:45.998001+0000","last_fullsized":"2023-10-14T19:08:45.998001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:11:00.662294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986721+0000","last_change":"2023-10-14T19:08:45.979824+0000","last_active":"2023-10-14T19:08:45.986721+0000","last_peered":"2023-10-14T19:08:45.986721+0000","last_clean":"2023-10-14T19:08:45.986721+0000","last_became_active":"2023-10-14T19:08:45.979592+0000","last_became_peered":"2023-10-14T19:08:45.979592+0000","last_unstale":"2023-10-14T19:08:45.986721+0000","last_undegraded":"2023-10-14T19:08:45.986721+0000","last_fullsized":"2023-10-14T19:08:45.986721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:19.057989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995474+0000","last_change":"2023-10-14T19:08:44.966457+0000","last_active":"2023-10-14T19:08:45.995474+0000","last_peered":"2023-10-14T19:08:45.995474+0000","last_clean":"2023-10-14T19:08:45.995474+0000","last_became_active":"2023-10-14T19:08:44.966222+0000","last_became_peered":"2023-10-14T19:08:44.966222+0000","last_unstale":"2023-10-14T19:08:45.995474+0000","last_undegraded":"2023-10-14T19:08:45.995474+0000","last_fullsized":"2023-10-14T19:08:45.995474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:23.740404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984867+0000","last_change":"2023-10-14T19:08:45.981560+0000","last_active":"2023-10-14T19:08:45.984867+0000","last_peered":"2023-10-14T19:08:45.984867+0000","last_clean":"2023-10-14T19:08:45.984867+0000","last_became_active":"2023-10-14T19:08:45.981255+0000","last_became_peered":"2023-10-14T19:08:45.981255+0000","last_unstale":"2023-10-14T19:08:45.984867+0000","last_undegraded":"2023-10-14T19:08:45.984867+0000","last_fullsized":"2023-10-14T19:08:45.984867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:13:56.938980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.992090+0000","last_change":"2023-10-14T19:08:44.960156+0000","last_active":"2023-10-14T19:08:45.992090+0000","last_peered":"2023-10-14T19:08:45.992090+0000","last_clean":"2023-10-14T19:08:45.992090+0000","last_became_active":"2023-10-14T19:08:44.959872+0000","last_became_peered":"2023-10-14T19:08:44.959872+0000","last_unstale":"2023-10-14T19:08:45.992090+0000","last_undegraded":"2023-10-14T19:08:45.992090+0000","last_fullsized":"2023-10-14T19:08:45.992090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:46.213063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.985224+0000","last_change":"2023-10-14T19:08:45.985224+0000","last_active":"2023-10-14T19:08:45.985224+0000","last_peered":"2023-10-14T19:08:45.985224+0000","last_clean":"2023-10-14T19:08:45.985224+0000","last_became_active":"2023-10-14T19:08:45.984905+0000","last_became_peered":"2023-10-14T19:08:45.984905+0000","last_unstale":"2023-10-14T19:08:45.985224+0000","last_undegraded":"2023-10-14T19:08:45.985224+0000","last_fullsized":"2023-10-14T19:08:45.985224+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:26.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.962970+0000","last_change":"2023-10-14T19:08:44.966700+0000","last_active":"2023-10-14T19:08:45.962970+0000","last_peered":"2023-10-14T19:08:45.962970+0000","last_clean":"2023-10-14T19:08:45.962970+0000","last_became_active":"2023-10-14T19:08:44.966412+0000","last_became_peered":"2023-10-14T19:08:44.966412+0000","last_unstale":"2023-10-14T19:08:45.962970+0000","last_undegraded":"2023-10-14T19:08:45.962970+0000","last_fullsized":"2023-10-14T19:08:45.962970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:37.013848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978062+0000","last_change":"2023-10-14T19:08:45.976479+0000","last_active":"2023-10-14T19:08:45.978062+0000","last_peered":"2023-10-14T19:08:45.978062+0000","last_clean":"2023-10-14T19:08:45.978062+0000","last_became_active":"2023-10-14T19:08:45.974802+0000","last_became_peered":"2023-10-14T19:08:45.974802+0000","last_unstale":"2023-10-14T19:08:45.978062+0000","last_undegraded":"2023-10-14T19:08:45.978062+0000","last_fullsized":"2023-10-14T19:08:45.978062+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:18.521834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995437+0000","last_change":"2023-10-14T19:08:44.964594+0000","last_active":"2023-10-14T19:08:45.995437+0000","last_peered":"2023-10-14T19:08:45.995437+0000","last_clean":"2023-10-14T19:08:45.995437+0000","last_became_active":"2023-10-14T19:08:44.961547+0000","last_became_peered":"2023-10-14T19:08:44.961547+0000","last_unstale":"2023-10-14T19:08:45.995437+0000","last_undegraded":"2023-10-14T19:08:45.995437+0000","last_fullsized":"2023-10-14T19:08:45.995437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:51:43.724411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.973309+0000","last_change":"2023-10-14T19:08:45.970336+0000","last_active":"2023-10-14T19:08:45.973309+0000","last_peered":"2023-10-14T19:08:45.973309+0000","last_clean":"2023-10-14T19:08:45.973309+0000","last_became_active":"2023-10-14T19:08:45.969915+0000","last_became_peered":"2023-10-14T19:08:45.969915+0000","last_unstale":"2023-10-14T19:08:45.973309+0000","last_undegraded":"2023-10-14T19:08:45.973309+0000","last_fullsized":"2023-10-14T19:08:45.973309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:19:28.583319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967022+0000","last_change":"2023-10-14T19:08:44.968163+0000","last_active":"2023-10-14T19:08:45.967022+0000","last_peered":"2023-10-14T19:08:45.967022+0000","last_clean":"2023-10-14T19:08:45.967022+0000","last_became_active":"2023-10-14T19:08:44.967846+0000","last_became_peered":"2023-10-14T19:08:44.967846+0000","last_unstale":"2023-10-14T19:08:45.967022+0000","last_undegraded":"2023-10-14T19:08:45.967022+0000","last_fullsized":"2023-10-14T19:08:45.967022+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:23.740404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980300+0000","last_change":"2023-10-14T19:08:45.973762+0000","last_active":"2023-10-14T19:08:45.980300+0000","last_peered":"2023-10-14T19:08:45.980300+0000","last_clean":"2023-10-14T19:08:45.980300+0000","last_became_active":"2023-10-14T19:08:45.973483+0000","last_became_peered":"2023-10-14T19:08:45.973483+0000","last_unstale":"2023-10-14T19:08:45.980300+0000","last_undegraded":"2023-10-14T19:08:45.980300+0000","last_fullsized":"2023-10-14T19:08:45.980300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:06.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.967372+0000","last_change":"2023-10-14T19:08:44.959988+0000","last_active":"2023-10-14T19:08:45.967372+0000","last_peered":"2023-10-14T19:08:45.967372+0000","last_clean":"2023-10-14T19:08:45.967372+0000","last_became_active":"2023-10-14T19:08:44.959725+0000","last_became_peered":"2023-10-14T19:08:44.959725+0000","last_unstale":"2023-10-14T19:08:45.967372+0000","last_undegraded":"2023-10-14T19:08:45.967372+0000","last_fullsized":"2023-10-14T19:08:45.967372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:39.002815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991121+0000","last_change":"2023-10-14T19:08:45.983215+0000","last_active":"2023-10-14T19:08:45.991121+0000","last_peered":"2023-10-14T19:08:45.991121+0000","last_clean":"2023-10-14T19:08:45.991121+0000","last_became_active":"2023-10-14T19:08:45.982912+0000","last_became_peered":"2023-10-14T19:08:45.982912+0000","last_unstale":"2023-10-14T19:08:45.991121+0000","last_undegraded":"2023-10-14T19:08:45.991121+0000","last_fullsized":"2023-10-14T19:08:45.991121+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:33.399863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.962820+0000","last_change":"2023-10-14T19:08:44.967354+0000","last_active":"2023-10-14T19:08:45.962820+0000","last_peered":"2023-10-14T19:08:45.962820+0000","last_clean":"2023-10-14T19:08:45.962820+0000","last_became_active":"2023-10-14T19:08:44.967075+0000","last_became_peered":"2023-10-14T19:08:44.967075+0000","last_unstale":"2023-10-14T19:08:45.962820+0000","last_undegraded":"2023-10-14T19:08:45.962820+0000","last_fullsized":"2023-10-14T19:08:45.962820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:22.378678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.981968+0000","last_change":"2023-10-14T19:08:45.974115+0000","last_active":"2023-10-14T19:08:45.981968+0000","last_peered":"2023-10-14T19:08:45.981968+0000","last_clean":"2023-10-14T19:08:45.981968+0000","last_became_active":"2023-10-14T19:08:45.973764+0000","last_became_peered":"2023-10-14T19:08:45.973764+0000","last_unstale":"2023-10-14T19:08:45.981968+0000","last_undegraded":"2023-10-14T19:08:45.981968+0000","last_fullsized":"2023-10-14T19:08:45.981968+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:56.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.995120+0000","last_change":"2023-10-14T19:08:44.965842+0000","last_active":"2023-10-14T19:08:45.995120+0000","last_peered":"2023-10-14T19:08:45.995120+0000","last_clean":"2023-10-14T19:08:45.995120+0000","last_became_active":"2023-10-14T19:08:44.965583+0000","last_became_peered":"2023-10-14T19:08:44.965583+0000","last_unstale":"2023-10-14T19:08:45.995120+0000","last_undegraded":"2023-10-14T19:08:45.995120+0000","last_fullsized":"2023-10-14T19:08:45.995120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:41.363601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.979393+0000","last_change":"2023-10-14T19:08:45.979393+0000","last_active":"2023-10-14T19:08:45.979393+0000","last_peered":"2023-10-14T19:08:45.979393+0000","last_clean":"2023-10-14T19:08:45.979393+0000","last_became_active":"2023-10-14T19:08:45.979107+0000","last_became_peered":"2023-10-14T19:08:45.979107+0000","last_unstale":"2023-10-14T19:08:45.979393+0000","last_undegraded":"2023-10-14T19:08:45.979393+0000","last_fullsized":"2023-10-14T19:08:45.979393+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:23.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.963809+0000","last_change":"2023-10-14T19:08:44.969564+0000","last_active":"2023-10-14T19:08:45.963809+0000","last_peered":"2023-10-14T19:08:45.963809+0000","last_clean":"2023-10-14T19:08:45.963809+0000","last_became_active":"2023-10-14T19:08:44.969128+0000","last_became_peered":"2023-10-14T19:08:44.969128+0000","last_unstale":"2023-10-14T19:08:45.963809+0000","last_undegraded":"2023-10-14T19:08:45.963809+0000","last_fullsized":"2023-10-14T19:08:45.963809+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:21:39.101576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.991644+0000","last_change":"2023-10-14T19:08:45.991644+0000","last_active":"2023-10-14T19:08:45.991644+0000","last_peered":"2023-10-14T19:08:45.991644+0000","last_clean":"2023-10-14T19:08:45.991644+0000","last_became_active":"2023-10-14T19:08:45.991378+0000","last_became_peered":"2023-10-14T19:08:45.991378+0000","last_unstale":"2023-10-14T19:08:45.991644+0000","last_undegraded":"2023-10-14T19:08:45.991644+0000","last_fullsized":"2023-10-14T19:08:45.991644+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:09.891078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.963303+0000","last_change":"2023-10-14T19:08:44.966052+0000","last_active":"2023-10-14T19:08:45.963303+0000","last_peered":"2023-10-14T19:08:45.963303+0000","last_clean":"2023-10-14T19:08:45.963303+0000","last_became_active":"2023-10-14T19:08:44.965774+0000","last_became_peered":"2023-10-14T19:08:44.965774+0000","last_unstale":"2023-10-14T19:08:45.963303+0000","last_undegraded":"2023-10-14T19:08:45.963303+0000","last_fullsized":"2023-10-14T19:08:45.963303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:39:01.497573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.983181+0000","last_change":"2023-10-14T19:08:45.977055+0000","last_active":"2023-10-14T19:08:45.983181+0000","last_peered":"2023-10-14T19:08:45.983181+0000","last_clean":"2023-10-14T19:08:45.983181+0000","last_became_active":"2023-10-14T19:08:45.976748+0000","last_became_peered":"2023-10-14T19:08:45.976748+0000","last_unstale":"2023-10-14T19:08:45.983181+0000","last_undegraded":"2023-10-14T19:08:45.983181+0000","last_fullsized":"2023-10-14T19:08:45.983181+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:18.861808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.965812+0000","last_change":"2023-10-14T19:08:44.962416+0000","last_active":"2023-10-14T19:08:45.965812+0000","last_peered":"2023-10-14T19:08:45.965812+0000","last_clean":"2023-10-14T19:08:45.965812+0000","last_became_active":"2023-10-14T19:08:44.962161+0000","last_became_peered":"2023-10-14T19:08:44.962161+0000","last_unstale":"2023-10-14T19:08:45.965812+0000","last_undegraded":"2023-10-14T19:08:45.965812+0000","last_fullsized":"2023-10-14T19:08:45.965812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:01.642960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.984703+0000","last_change":"2023-10-14T19:08:45.981856+0000","last_active":"2023-10-14T19:08:45.984703+0000","last_peered":"2023-10-14T19:08:45.984703+0000","last_clean":"2023-10-14T19:08:45.984703+0000","last_became_active":"2023-10-14T19:08:45.981401+0000","last_became_peered":"2023-10-14T19:08:45.981401+0000","last_unstale":"2023-10-14T19:08:45.984703+0000","last_undegraded":"2023-10-14T19:08:45.984703+0000","last_fullsized":"2023-10-14T19:08:45.984703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:28.509720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.963367+0000","last_change":"2023-10-14T19:08:44.961227+0000","last_active":"2023-10-14T19:08:45.963367+0000","last_peered":"2023-10-14T19:08:45.963367+0000","last_clean":"2023-10-14T19:08:45.963367+0000","last_became_active":"2023-10-14T19:08:44.960946+0000","last_became_peered":"2023-10-14T19:08:44.960946+0000","last_unstale":"2023-10-14T19:08:45.963367+0000","last_undegraded":"2023-10-14T19:08:45.963367+0000","last_fullsized":"2023-10-14T19:08:45.963367+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:11.310490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.986400+0000","last_change":"2023-10-14T19:08:45.980367+0000","last_active":"2023-10-14T19:08:45.986400+0000","last_peered":"2023-10-14T19:08:45.986400+0000","last_clean":"2023-10-14T19:08:45.986400+0000","last_became_active":"2023-10-14T19:08:45.980108+0000","last_became_peered":"2023-10-14T19:08:45.980108+0000","last_unstale":"2023-10-14T19:08:45.986400+0000","last_undegraded":"2023-10-14T19:08:45.986400+0000","last_fullsized":"2023-10-14T19:08:45.986400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:19.057989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.965093+0000","last_change":"2023-10-14T19:08:44.967643+0000","last_active":"2023-10-14T19:08:45.965093+0000","last_peered":"2023-10-14T19:08:45.965093+0000","last_clean":"2023-10-14T19:08:45.965093+0000","last_became_active":"2023-10-14T19:08:44.967348+0000","last_became_peered":"2023-10-14T19:08:44.967348+0000","last_unstale":"2023-10-14T19:08:45.965093+0000","last_undegraded":"2023-10-14T19:08:45.965093+0000","last_fullsized":"2023-10-14T19:08:45.965093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:23.019477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.980324+0000","last_change":"2023-10-14T19:08:45.978886+0000","last_active":"2023-10-14T19:08:45.980324+0000","last_peered":"2023-10-14T19:08:45.980324+0000","last_clean":"2023-10-14T19:08:45.980324+0000","last_became_active":"2023-10-14T19:08:45.978598+0000","last_became_peered":"2023-10-14T19:08:45.978598+0000","last_unstale":"2023-10-14T19:08:45.980324+0000","last_undegraded":"2023-10-14T19:08:45.980324+0000","last_fullsized":"2023-10-14T19:08:45.980324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:31.991397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.968932+0000","last_change":"2023-10-14T19:08:44.967808+0000","last_active":"2023-10-14T19:08:44.968932+0000","last_peered":"2023-10-14T19:08:44.968932+0000","last_clean":"2023-10-14T19:08:44.968932+0000","last_became_active":"2023-10-14T19:08:44.967505+0000","last_became_peered":"2023-10-14T19:08:44.967505+0000","last_unstale":"2023-10-14T19:08:44.968932+0000","last_undegraded":"2023-10-14T19:08:44.968932+0000","last_fullsized":"2023-10-14T19:08:44.968932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:18.053911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978476+0000","last_change":"2023-10-14T19:08:45.972581+0000","last_active":"2023-10-14T19:08:45.978476+0000","last_peered":"2023-10-14T19:08:45.978476+0000","last_clean":"2023-10-14T19:08:45.978476+0000","last_became_active":"2023-10-14T19:08:45.972273+0000","last_became_peered":"2023-10-14T19:08:45.972273+0000","last_unstale":"2023-10-14T19:08:45.978476+0000","last_undegraded":"2023-10-14T19:08:45.978476+0000","last_fullsized":"2023-10-14T19:08:45.978476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:04.439567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.968798+0000","last_change":"2023-10-14T19:08:44.964692+0000","last_active":"2023-10-14T19:08:45.968798+0000","last_peered":"2023-10-14T19:08:45.968798+0000","last_clean":"2023-10-14T19:08:45.968798+0000","last_became_active":"2023-10-14T19:08:44.964395+0000","last_became_peered":"2023-10-14T19:08:44.964395+0000","last_unstale":"2023-10-14T19:08:45.968798+0000","last_undegraded":"2023-10-14T19:08:45.968798+0000","last_fullsized":"2023-10-14T19:08:45.968798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:39.781189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.978035+0000","last_change":"2023-10-14T19:08:45.975552+0000","last_active":"2023-10-14T19:08:45.978035+0000","last_peered":"2023-10-14T19:08:45.978035+0000","last_clean":"2023-10-14T19:08:45.978035+0000","last_became_active":"2023-10-14T19:08:45.975188+0000","last_became_peered":"2023-10-14T19:08:45.975188+0000","last_unstale":"2023-10-14T19:08:45.978035+0000","last_undegraded":"2023-10-14T19:08:45.978035+0000","last_fullsized":"2023-10-14T19:08:45.978035+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:44.943475+0000","last_clean_scrub_stamp":"2023-10-14T19:08:44.943475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:38.200054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"89'1","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-14T19:08:45.977090+0000","last_change":"2023-10-14T19:08:44.964512+0000","last_active":"2023-10-14T19:08:45.977090+0000","last_peered":"2023-10-14T19:08:45.977090+0000","last_clean":"2023-10-14T19:08:45.977090+0000","last_became_active":"2023-10-14T19:08:44.964232+0000","last_became_peered":"2023-10-14T19:08:44.964232+0000","last_unstale":"2023-10-14T19:08:45.977090+0000","last_undegraded":"2023-10-14T19:08:45.977090+0000","last_fullsized":"2023-10-14T19:08:45.977090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:08:43.939396+0000","last_clean_scrub_stamp":"2023-10-14T19:08:43.939396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:22.378678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-14T19:08:44.957360+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:08:44.957360+0000","last_peered":"2023-10-14T19:08:44.957360+0000","last_clean":"2023-10-14T19:08:44.957360+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:08:44.957360+0000","last_undegraded":"2023-10-14T19:08:44.957360+0000","last_fullsized":"2023-10-14T19:08:44.957360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":1063442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56999999999999995,"15min":0.68799999999999994},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75700000000000001,"5min":4.2080000000000002,"15min":4.2080000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.56999999999999995,"15min":0.68700000000000006},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58299999999999996,"15min":0.68500000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55200000000000005,"15min":0.626},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.77700000000000002},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.65300000000000002,"15min":0.76000000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70099999999999996,"5min":3.23,"15min":3.23},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63,"15min":0.80400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71399999999999997,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65700000000000003,"15min":0.77800000000000002},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79300000000000004,"5min":3.3450000000000002,"15min":3.3450000000000002},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.497,"15min":0.58299999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.56699999999999995,"15min":0.71999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":4.5389999999999997,"15min":4.5389999999999997},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.65100000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68500000000000005,"5min":2.883,"15min":2.883},"last":0.68999999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59299999999999997,"15min":0.68100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83399999999999996,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.64000000000000001,"15min":0.81299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":5.383,"15min":5.383},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298372,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073468,"statfs":{"total":96636764160,"available":96331231232,"internally_reserved":0,"allocated":1110016,"data_stored":473586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.59099999999999997,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72699999999999998,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":5.7030000000000003,"15min":5.7030000000000003},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60199999999999998,"15min":0.76800000000000002},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.60399999999999998,"15min":0.78800000000000003},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":7.8250000000000002,"15min":7.8250000000000002},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.80400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.85799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":8.0090000000000003,"15min":8.0090000000000003},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.63100000000000001,"15min":0.81899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.63800000000000001,"15min":0.83799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75900000000000001,"5min":8.1120000000000001,"15min":8.1120000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73899999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":472962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.495,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54700000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.34200000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.28799999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":1.032,"15min":1.032},"last":0.54800000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.625,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.079,"15min":1.079},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303056,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068784,"statfs":{"total":96636764160,"available":96326434816,"internally_reserved":0,"allocated":1712128,"data_stored":1070172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.497,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.62,"15min":0.62},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.499}]},{"osd":4,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72999999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80000000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61299999999999999,"15min":0.64300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.755},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":479284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.36099999999999999},"min":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46100000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.37,"15min":0.44800000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.496,"5min":2.028,"15min":2.028},"last":0.24199999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.373,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54200000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.48699999999999999,"15min":0.80700000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55300000000000005,"5min":11.269,"15min":11.269},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.46200000000000002,"15min":0.77800000000000002},"min":{"1min":0.248,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":11.318,"15min":11.318},"last":0.311},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.434},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58699999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.67800000000000005},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.69299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.73399999999999999,"15min":1.0700000000000001},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93200000000000005,"5min":11.379,"15min":11.379},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.73199999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":11.404,"15min":11.404},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.65600000000000003},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.85199999999999998,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.74299999999999999,"15min":1.087},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99299999999999999,"5min":11.351000000000001,"15min":11.351000000000001},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":474520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.376},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36099999999999999,"15min":0.39100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.29099999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33300000000000002,"15min":0.371},"min":{"1min":0.21299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.314},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26300000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41699999999999998,"15min":0.45100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72699999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.435},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80600000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":480910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.67800000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.436}]},{"osd":1,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":3.488,"15min":3.488},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64300000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.502,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63900000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66400000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.497}]},{"osd":6,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68500000000000005,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.34000000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.55900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298380,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073460,"statfs":{"total":96636764160,"available":96331223040,"internally_reserved":0,"allocated":1118208,"data_stored":479320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.876,"15min":0.876},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.61699999999999999,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.621},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:08:50.466 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:08:50.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:08:50.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.625+0000 7f23f1347700 1 Processor -- start 2023-10-14T19:08:50.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.625+0000 7f23f1347700 1 -- start start 2023-10-14T19:08:50.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23f1347700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23ec159530 0x7f23ec0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23f1347700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23ec06dc70 0x7f23ec159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23f1347700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec0ccfd0 con 0x7f23ec06e0e0 2023-10-14T19:08:50.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23f1347700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec0cf0e0 con 0x7f23ec06dc70 2023-10-14T19:08:50.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23f1347700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec15a3d0 con 0x7f23ec159530 2023-10-14T19:08:50.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23ea7fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23ec06dc70 0x7f23ec159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23eb7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f23ec06e0e0 0x7f23ec0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53740/0 (socket says 172.21.15.7:53740) 2023-10-14T19:08:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23eb7fe700 1 -- 172.21.15.7:0/4248312624 learned_addr learned my addr 172.21.15.7:0/4248312624 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23eaffd700 1 --2- 172.21.15.7:0/4248312624 >> v2:172.21.15.148:3300/0 conn(0x7f23ec159530 0x7f23ec0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23ea7fc700 1 -- 172.21.15.7:0/4248312624 >> v2:172.21.15.148:3300/0 conn(0x7f23ec159530 msgr2=0x7f23ec0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:50.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23ea7fc700 1 --2- 172.21.15.7:0/4248312624 >> v2:172.21.15.148:3300/0 conn(0x7f23ec159530 0x7f23ec0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23ea7fc700 1 -- 172.21.15.7:0/4248312624 >> v1:172.21.15.7:6789/0 conn(0x7f23ec06e0e0 legacy=0x7f23ec0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23ea7fc700 1 -- 172.21.15.7:0/4248312624 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec15a6b0 con 0x7f23ec06dc70 2023-10-14T19:08:50.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.626+0000 7f23e9ffb700 1 -- 172.21.15.7:0/4248312624 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363770162 0 0) 0x7f23ec0ccfd0 con 0x7f23ec06e0e0 2023-10-14T19:08:50.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23ea7fc700 1 --2- 172.21.15.7:0/4248312624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec159900 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f23ec06d630 tx=0x7f23d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b967da71c04167 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:50.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23e9ffb700 1 -- 172.21.15.7:0/4248312624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4011630 con 0x7f23ec06dc70 2023-10-14T19:08:50.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23e9ffb700 1 -- 172.21.15.7:0/4248312624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4011790 con 0x7f23ec06dc70 2023-10-14T19:08:50.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23e9ffb700 1 -- 172.21.15.7:0/4248312624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4011b30 con 0x7f23ec06dc70 2023-10-14T19:08:50.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 -- 172.21.15.7:0/4248312624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 msgr2=0x7f23ec159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 --2- 172.21.15.7:0/4248312624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec159900 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f23ec06d630 tx=0x7f23d40091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 -- 172.21.15.7:0/4248312624 shutdown_connections 2023-10-14T19:08:50.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 --2- 172.21.15.7:0/4248312624 >> v2:172.21.15.148:3300/0 conn(0x7f23ec159530 0x7f23ec0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 --2- 172.21.15.7:0/4248312624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec159900 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 -- 172.21.15.7:0/4248312624 >> 172.21.15.7:0/4248312624 conn(0x7f23ec0703a0 msgr2=0x7f23ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:50.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 -- 172.21.15.7:0/4248312624 shutdown_connections 2023-10-14T19:08:50.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.627+0000 7f23f1347700 1 -- 172.21.15.7:0/4248312624 wait complete. 2023-10-14T19:08:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 Processor -- start 2023-10-14T19:08:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 -- start start 2023-10-14T19:08:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23ec06e0e0 0x7f23ec0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23ec159530 0x7f23ec0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec142fc0 con 0x7f23ec06dc70 2023-10-14T19:08:50.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec169f30 con 0x7f23ec06e0e0 2023-10-14T19:08:50.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23f1347700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec16b290 con 0x7f23ec159530 2023-10-14T19:08:50.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23eaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23eaffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55804/0 (socket says 172.21.15.7:55804) 2023-10-14T19:08:50.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.629+0000 7f23eaffd700 1 -- 172.21.15.7:0/3924414258 learned_addr learned my addr 172.21.15.7:0/3924414258 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:50.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23ea7fc700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23ec06e0e0 0x7f23ec0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eb7fe700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23ec159530 0x7f23ec0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eaffd700 1 -- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23ec159530 msgr2=0x7f23ec0c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eaffd700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23ec159530 0x7f23ec0c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eaffd700 1 -- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23ec06e0e0 msgr2=0x7f23ec0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eaffd700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23ec06e0e0 0x7f23ec0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eaffd700 1 -- 172.21.15.7:0/3924414258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4009420 con 0x7f23ec06dc70 2023-10-14T19:08:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eb7fe700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23ec159530 0x7f23ec0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23ea7fc700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23ec06e0e0 0x7f23ec0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:50.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23eaffd700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec142a80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f23e400e960 tx=0x7f23e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:50.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400c850 con 0x7f23ec06dc70 2023-10-14T19:08:50.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e400c9b0 con 0x7f23ec06dc70 2023-10-14T19:08:50.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec0c9340 con 0x7f23ec06dc70 2023-10-14T19:08:50.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400cd50 con 0x7f23ec06dc70 2023-10-14T19:08:50.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.630+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec16af20 con 0x7f23ec06dc70 2023-10-14T19:08:50.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.631+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec16ad80 con 0x7f23ec06dc70 2023-10-14T19:08:50.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.631+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f23e4013680 con 0x7f23ec06dc70 2023-10-14T19:08:50.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.632+0000 7f23e2ffd700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23cc067200 0x7f23cc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:50.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.632+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23e4084b80 con 0x7f23ec06dc70 2023-10-14T19:08:50.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.632+0000 7f23ea7fc700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23cc067200 0x7f23cc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:50.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.633+0000 7f23ea7fc700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23cc067200 0x7f23cc0696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f23d40097b0 tx=0x7f23d4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:50.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.636+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23ec16ad80 con 0x7f23ec06dc70 2023-10-14T19:08:50.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.909+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f23ec16ad80 con 0x7f23ec06dc70 2023-10-14T19:08:50.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.913+0000 7f23e2ffd700 1 -- 172.21.15.7:0/3924414258 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f23ec16ad80 con 0x7f23ec06dc70 2023-10-14T19:08:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23cc067200 msgr2=0x7f23cc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23cc067200 0x7f23cc0696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f23d40097b0 tx=0x7f23d4017000 comp rx=0 tx=0).stop 2023-10-14T19:08:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 msgr2=0x7f23ec142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec142a80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f23e400e960 tx=0x7f23e40091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 shutdown_connections 2023-10-14T19:08:50.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23cc067200 0x7f23cc0696b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23ec159530 0x7f23ec0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ec06dc70 0x7f23ec142a80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 --2- 172.21.15.7:0/3924414258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23ec06e0e0 0x7f23ec0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:50.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.915+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 >> 172.21.15.7:0/3924414258 conn(0x7f23ec0703a0 msgr2=0x7f23ec0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.916+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 shutdown_connections 2023-10-14T19:08:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:50.916+0000 7f23f1347700 1 -- 172.21.15.7:0/3924414258 wait complete. 2023-10-14T19:08:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:08:50.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:51.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.048+0000 7f996867d700 1 Processor -- start 2023-10-14T19:08:51.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.048+0000 7f996867d700 1 -- start start 2023-10-14T19:08:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.048+0000 7f996867d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99600cb5a0 0x7f99600cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.048+0000 7f996867d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99600cd9e0 0x7f9960159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f996867d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996015ae40 con 0x7f99600cde50 2023-10-14T19:08:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f996867d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600d13f0 con 0x7f99600cd9e0 2023-10-14T19:08:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f996867d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996015ab60 con 0x7f99600cb5a0 2023-10-14T19:08:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9966c1a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f99600cde50 0x7f9960156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53752/0 (socket says 172.21.15.7:53752) 2023-10-14T19:08:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9966c1a700 1 -- 172.21.15.7:0/1105300186 learned_addr learned my addr 172.21.15.7:0/1105300186 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965c18700 1 --2- 172.21.15.7:0/1105300186 >> v2:172.21.15.7:3300/0 conn(0x7f99600cd9e0 0x7f9960159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965417700 1 -- 172.21.15.7:0/1105300186 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547837845 0 0) 0x7f996015ae40 con 0x7f99600cde50 2023-10-14T19:08:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9966419700 1 --2- 172.21.15.7:0/1105300186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99600cb5a0 0x7f99600cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965417700 1 -- 172.21.15.7:0/1105300186 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9948003570 con 0x7f99600cde50 2023-10-14T19:08:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965c18700 1 -- 172.21.15.7:0/1105300186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99600cb5a0 msgr2=0x7f99600cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965c18700 1 --2- 172.21.15.7:0/1105300186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99600cb5a0 0x7f99600cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965c18700 1 -- 172.21.15.7:0/1105300186 >> v1:172.21.15.7:6789/0 conn(0x7f99600cde50 legacy=0x7f9960156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965c18700 1 -- 172.21.15.7:0/1105300186 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600ccf00 con 0x7f99600cd9e0 2023-10-14T19:08:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965c18700 1 --2- 172.21.15.7:0/1105300186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cd9e0 0x7f9960159ec0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f99540098e0 tx=0x7f99540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b6cec4b4a81036 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965417700 1 -- 172.21.15.7:0/1105300186 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995400b640 con 0x7f99600cd9e0 2023-10-14T19:08:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965417700 1 -- 172.21.15.7:0/1105300186 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995400b7a0 con 0x7f99600cd9e0 2023-10-14T19:08:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.049+0000 7f9965417700 1 -- 172.21.15.7:0/1105300186 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995400bb40 con 0x7f99600cd9e0 2023-10-14T19:08:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 -- 172.21.15.7:0/1105300186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cd9e0 msgr2=0x7f9960159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 --2- 172.21.15.7:0/1105300186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cd9e0 0x7f9960159ec0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f99540098e0 tx=0x7f99540091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 -- 172.21.15.7:0/1105300186 shutdown_connections 2023-10-14T19:08:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 --2- 172.21.15.7:0/1105300186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99600cb5a0 0x7f99600cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 --2- 172.21.15.7:0/1105300186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cd9e0 0x7f9960159ec0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 -- 172.21.15.7:0/1105300186 >> 172.21.15.7:0/1105300186 conn(0x7f9960070e30 msgr2=0x7f99600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 -- 172.21.15.7:0/1105300186 shutdown_connections 2023-10-14T19:08:51.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.050+0000 7f996867d700 1 -- 172.21.15.7:0/1105300186 wait complete. 2023-10-14T19:08:51.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.051+0000 7f996867d700 1 Processor -- start 2023-10-14T19:08:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.051+0000 7f996867d700 1 -- start start 2023-10-14T19:08:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f996867d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 0x7f996015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f996867d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99600cd9e0 0x7f9960158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f996867d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9960158760 0x7f9960159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f996867d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99600b3fd0 con 0x7f99600cb5a0 2023-10-14T19:08:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f996867d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960158c20 con 0x7f99600cd9e0 2023-10-14T19:08:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f996867d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99600b44f0 con 0x7f9960158760 2023-10-14T19:08:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 0x7f996015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 0x7f996015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55824/0 (socket says 172.21.15.7:55824) 2023-10-14T19:08:51.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 -- 172.21.15.7:0/2464528420 learned_addr learned my addr 172.21.15.7:0/2464528420 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9965c18700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99600cd9e0 0x7f9960158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966c1a700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9960158760 0x7f9960159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 -- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9960158760 msgr2=0x7f9960159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9960158760 0x7f9960159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 -- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99600cd9e0 msgr2=0x7f9960158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99600cd9e0 0x7f9960158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 -- 172.21.15.7:0/2464528420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954009420 con 0x7f99600cb5a0 2023-10-14T19:08:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9965c18700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99600cd9e0 0x7f9960158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.052+0000 7f9966419700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 0x7f996015d880 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f995000e190 tx=0x7f9950009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.053+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000ee30 con 0x7f99600cb5a0 2023-10-14T19:08:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.053+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950014420 con 0x7f99600cb5a0 2023-10-14T19:08:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.053+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99601577a0 con 0x7f99600cb5a0 2023-10-14T19:08:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.053+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99500147e0 con 0x7f99600cb5a0 2023-10-14T19:08:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.053+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9960157d60 con 0x7f99600cb5a0 2023-10-14T19:08:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.054+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99600b4800 con 0x7f99600cb5a0 2023-10-14T19:08:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.054+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9950014bd0 con 0x7f99600cb5a0 2023-10-14T19:08:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.055+0000 7f995e7fc700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f994c067200 0x7f994c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.055+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99500851c0 con 0x7f99600cb5a0 2023-10-14T19:08:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.055+0000 7f9965c18700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f994c067200 0x7f994c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.055+0000 7f9965c18700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f994c067200 0x7f994c0696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f99540093f0 tx=0x7f9954017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.059+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99500520e0 con 0x7f99600cb5a0 2023-10-14T19:08:51.274 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-14T19:08:51.273+0000 7f5b44769700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:08:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.296+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99600b4630 con 0x7f99600cb5a0 2023-10-14T19:08:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.296+0000 7f995e7fc700 1 -- 172.21.15.7:0/2464528420 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9950009a60 con 0x7f99600cb5a0 2023-10-14T19:08:51.297 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:51.297 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:45.357460+0000","modified":"2023-10-14T19:08:48.985870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6408":{"gid":6408,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/2588094250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2588094250},{"type":"v1","addr":"172.21.15.7:6835","nonce":2588094250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T19:08:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f994c067200 msgr2=0x7f994c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f994c067200 0x7f994c0696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f99540093f0 tx=0x7f9954017000 comp rx=0 tx=0).stop 2023-10-14T19:08:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 msgr2=0x7f996015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 0x7f996015d880 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f995000e190 tx=0x7f9950009920 comp rx=0 tx=0).stop 2023-10-14T19:08:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 shutdown_connections 2023-10-14T19:08:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f994c067200 0x7f994c0696b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9960158760 0x7f9960159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99600cb5a0 0x7f996015d880 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 --2- 172.21.15.7:0/2464528420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99600cd9e0 0x7f9960158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 >> 172.21.15.7:0/2464528420 conn(0x7f9960070e30 msgr2=0x7f99600b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 shutdown_connections 2023-10-14T19:08:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.298+0000 7f996867d700 1 -- 172.21.15.7:0/2464528420 wait complete. 2023-10-14T19:08:51.302 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 56 2023-10-14T19:08:51.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:08:45.357460+0000', 'modified': '2023-10-14T19:08:48.985870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6408}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6408': {'gid': 6408, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/2588094250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6833', 'nonce': 2588094250}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 2588094250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:08:51.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:08:51.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T19:08:51.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.839+0000 7fc0a1a5f700 1 Processor -- start 2023-10-14T19:08:51.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.839+0000 7fc0a1a5f700 1 -- start start 2023-10-14T19:08:51.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.840+0000 7fc0a1a5f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc09c1598b0 0x7fc09c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.840+0000 7fc0a1a5f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c0af790 0x7fc09c163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.840+0000 7fc0a1a5f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0ce9d0 con 0x7fc09c159c80 2023-10-14T19:08:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.840+0000 7fc0a1a5f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c0afc30 con 0x7fc09c1598b0 2023-10-14T19:08:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.840+0000 7fc0a1a5f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0aff10 con 0x7fc09c0af790 2023-10-14T19:08:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc09c1598b0 0x7fc09c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c0af790 0x7fc09c163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc09c1598b0 0x7fc09c0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59596/0 (socket says 172.21.15.7:59596) 2023-10-14T19:08:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 -- 172.21.15.7:0/1100576538 learned_addr learned my addr 172.21.15.7:0/1100576538 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09a7fc700 1 --1- 172.21.15.7:0/1100576538 >> v1:172.21.15.148:6789/0 conn(0x7fc09c159c80 0x7fc09c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36982/0 (socket says 172.21.15.7:36982) 2023-10-14T19:08:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 -- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c0af790 msgr2=0x7fc09c163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 --2- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c0af790 0x7fc09c163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 -- 172.21.15.7:0/1100576538 >> v1:172.21.15.148:6789/0 conn(0x7fc09c159c80 legacy=0x7fc09c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 -- 172.21.15.7:0/1100576538 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0ce380 con 0x7fc09c1598b0 2023-10-14T19:08:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c0af790 0x7fc09c163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.841+0000 7fc09affd700 1 --2- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0af250 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc094009f20 tx=0x7fc094009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f416f3ac4e9999 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc099ffb700 1 -- 172.21.15.7:0/1100576538 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400e070 con 0x7fc09c1598b0 2023-10-14T19:08:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc099ffb700 1 -- 172.21.15.7:0/1100576538 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400b9d0 con 0x7fc09c1598b0 2023-10-14T19:08:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc099ffb700 1 -- 172.21.15.7:0/1100576538 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940092e0 con 0x7fc09c1598b0 2023-10-14T19:08:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 msgr2=0x7fc09c0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0af250 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc094009f20 tx=0x7fc094009840 comp rx=0 tx=0).stop 2023-10-14T19:08:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/1100576538 shutdown_connections 2023-10-14T19:08:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c0af790 0x7fc09c163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/1100576538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0af250 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/1100576538 >> 172.21.15.7:0/1100576538 conn(0x7fc09c070e30 msgr2=0x7fc09c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/1100576538 shutdown_connections 2023-10-14T19:08:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.842+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/1100576538 wait complete. 2023-10-14T19:08:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.843+0000 7fc0a1a5f700 1 Processor -- start 2023-10-14T19:08:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.843+0000 7fc0a1a5f700 1 -- start start 2023-10-14T19:08:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc0a1a5f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 0x7fc09c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc0a1a5f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc0a1a5f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c159c80 0x7fc09c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc0a1a5f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c15cbd0 con 0x7fc09c0af790 2023-10-14T19:08:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc0a1a5f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0ca7e0 con 0x7fc09c1598b0 2023-10-14T19:08:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc0a1a5f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c15c580 con 0x7fc09c159c80 2023-10-14T19:08:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc09affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 0x7fc09c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc09affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 0x7fc09c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55834/0 (socket says 172.21.15.7:55834) 2023-10-14T19:08:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc09affd700 1 -- 172.21.15.7:0/3254652127 learned_addr learned my addr 172.21.15.7:0/3254652127 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.844+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c159c80 0x7fc09c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc09affd700 1 -- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c159c80 msgr2=0x7fc09c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc09affd700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c159c80 0x7fc09c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc09affd700 1 -- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 msgr2=0x7fc09c0c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc09affd700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc09affd700 1 -- 172.21.15.7:0/3254652127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009420 con 0x7fc09c0af790 2023-10-14T19:08:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc09affd700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 0x7fc09c0b5ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc09400b610 tx=0x7fc094018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc092ffd700 1 -- 172.21.15.7:0/3254652127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940089a0 con 0x7fc09c0af790 2023-10-14T19:08:51.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc092ffd700 1 -- 172.21.15.7:0/3254652127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094008b00 con 0x7fc09c0af790 2023-10-14T19:08:51.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094009ae0 con 0x7fc09c0af790 2023-10-14T19:08:51.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc092ffd700 1 -- 172.21.15.7:0/3254652127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094026460 con 0x7fc09c0af790 2023-10-14T19:08:51.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.845+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c0c7e90 con 0x7fc09c0af790 2023-10-14T19:08:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.847+0000 7fc092ffd700 1 -- 172.21.15.7:0/3254652127 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc094003040 con 0x7fc09c0af790 2023-10-14T19:08:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.847+0000 7fc092ffd700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc07c067200 0x7fc07c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.847+0000 7fc092ffd700 1 -- 172.21.15.7:0/3254652127 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0940867b0 con 0x7fc09c0af790 2023-10-14T19:08:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.847+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc07c067200 0x7fc07c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.848+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc07c067200 0x7fc07c0696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0c72f0 tx=0x7fc084007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.849+0000 7fc0aad58b80 1 Processor -- start 2023-10-14T19:08:51.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.849+0000 7fc0aad58b80 1 -- start start 2023-10-14T19:08:51.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9ba3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9b9fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9afaa70 con 0x560cd9bccf60 2023-10-14T19:08:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9af8270 con 0x560cd9bedd00 2023-10-14T19:08:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cd9af4060 con 0x560cd9ba3a50 2023-10-14T19:08:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9b9fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9b9fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55844/0 (socket says 172.21.15.7:55844) 2023-10-14T19:08:51.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 -- 172.21.15.7:0/3709359627 learned_addr learned my addr 172.21.15.7:0/3709359627 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09affd700 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9ba3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 -- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 msgr2=0x560cd9ba3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9ba3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 -- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 msgr2=0x560cd9bcca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 -- 172.21.15.7:0/3709359627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cd998e270 con 0x560cd9bccf60 2023-10-14T19:08:51.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9b9fcf0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009e00 tx=0x7fc08c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c0b0818607ac02 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.850+0000 7fc07bfff700 1 -- 172.21.15.7:0/3709359627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011d70 con 0x560cd9bccf60 2023-10-14T19:08:51.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc07bfff700 1 -- 172.21.15.7:0/3709359627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c011ed0 con 0x560cd9bccf60 2023-10-14T19:08:51.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc07bfff700 1 -- 172.21.15.7:0/3709359627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c014650 con 0x560cd9bccf60 2023-10-14T19:08:51.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3709359627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 msgr2=0x560cd9b9fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9b9fcf0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009e00 tx=0x7fc08c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3709359627 shutdown_connections 2023-10-14T19:08:51.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9b9fcf0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9ba3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3709359627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3709359627 >> 172.21.15.7:0/3709359627 conn(0x560cd9ba5370 msgr2=0x560cd9ba5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3709359627 shutdown_connections 2023-10-14T19:08:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.851+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3709359627 wait complete. 2023-10-14T19:08:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.852+0000 7fc0aad58b80 1 -- start start 2023-10-14T19:08:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.852+0000 7fc0aad58b80 1 Processor -- start 2023-10-14T19:08:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9bfdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9b9f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9a9f890 con 0x560cd9ba3a50 2023-10-14T19:08:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9abaea0 con 0x560cd9bedd00 2023-10-14T19:08:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cd9976e30 con 0x560cd9bccf60 2023-10-14T19:08:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0aad58b80 10 client.0 _ll_register_callbacks cb 0x560cd9b67110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:08:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9bfdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9bfdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55856/0 (socket says 172.21.15.7:55856) 2023-10-14T19:08:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 -- 172.21.15.7:0/3602119245 learned_addr learned my addr 172.21.15.7:0/3602119245 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9b9f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 -- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 msgr2=0x560cd9b9f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9b9f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 -- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 msgr2=0x560cd9bed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 -- 172.21.15.7:0/3602119245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c009a50 con 0x560cd9ba3a50 2023-10-14T19:08:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc09affd700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9bfdf40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc094003440 tx=0x7fc0940573b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf2815d824efa11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.853+0000 7fc0797fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:08:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0797fa700 1 -- 172.21.15.7:0/3602119245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400e030 con 0x560cd9ba3a50 2023-10-14T19:08:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0797fa700 1 -- 172.21.15.7:0/3602119245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc09405e2a0 con 0x560cd9ba3a50 2023-10-14T19:08:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cd9b98b70 con 0x560cd9ba3a50 2023-10-14T19:08:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0797fa700 1 -- 172.21.15.7:0/3602119245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc094057770 con 0x560cd9ba3a50 2023-10-14T19:08:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 10 client.6558 fetch_fsmap learned FSMap version 56 2023-10-14T19:08:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x560cd9930fe0 con 0x560cd9ba3a50 2023-10-14T19:08:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0797fa700 1 -- 172.21.15.7:0/3602119245 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094078080 con 0x560cd9ba3a50 2023-10-14T19:08:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0797fa700 1 -- 172.21.15.7:0/3602119245 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc0940567f0 con 0x560cd9ba3a50 2023-10-14T19:08:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 10 client.6558 fetch_fsmap finished waiting for FSMap version 56 2023-10-14T19:08:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 10 client.6558 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T19:08:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 20 client.6558 populate_metadata read hostname 'smithi007' 2023-10-14T19:08:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9be1c20 0x560cd9be1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 4 client.6558 mds_command: new command op to 6408 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:08:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 --> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cd9b75aa0 con 0x560cd9be1c20 2023-10-14T19:08:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.854+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9be1c20 0x560cd9be1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9be1c20 0x560cd9be1ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e463b4700a2b34c8 server_cookie=79f6591650ce095a in_seq=0 out_seq=0 2023-10-14T19:08:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0797fa700 10 client.6558 ms_handle_connect on v2:172.21.15.7:6833/2588094250 2023-10-14T19:08:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0797fa700 1 -- 172.21.15.7:0/3602119245 <== mds.0 v2:172.21.15.7:6833/2588094250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560cd9b75aa0 con 0x560cd9be1c20 2023-10-14T19:08:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0797fa700 10 client.6558 handle_command_reply: tid=0 2023-10-14T19:08:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 client.6558 shutdown 2023-10-14T19:08:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 msgr2=0x560cd9bfdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9bfdf40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc094003440 tx=0x7fc0940573b0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 shutdown_connections 2023-10-14T19:08:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9be1c20 0x560cd9be1ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0797fa700 0 client.6558 ms_handle_reset on v2:172.21.15.7:6833/2588094250 2023-10-14T19:08:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9bfdf40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/3602119245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9b9f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 >> 172.21.15.7:0/3602119245 conn(0x560cd9ba5370 msgr2=0x560cd9ba4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 shutdown_connections 2023-10-14T19:08:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.855+0000 7fc0aad58b80 1 -- 172.21.15.7:0/3602119245 wait complete. 2023-10-14T19:08:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.856+0000 7fc0aad58b80 20 client.6558 trim_cache size 0 max 16384 2023-10-14T19:08:51.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.872+0000 7fc0aad58b80 1 Processor -- start 2023-10-14T19:08:51.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.872+0000 7fc0aad58b80 1 -- start start 2023-10-14T19:08:51.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9be4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9ba4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9b9e830 con 0x560cd9bccf60 2023-10-14T19:08:51.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9be63c0 con 0x560cd9bedd00 2023-10-14T19:08:51.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cd9be90a0 con 0x560cd9ba3a50 2023-10-14T19:08:51.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9ba4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9ba4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55860/0 (socket says 172.21.15.7:55860) 2023-10-14T19:08:51.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 -- 172.21.15.7:0/2940066185 learned_addr learned my addr 172.21.15.7:0/2940066185 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 -- 172.21.15.7:0/2940066185 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 msgr2=0x560cd9be4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9be4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 -- 172.21.15.7:0/2940066185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 msgr2=0x560cd9bcb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 -- 172.21.15.7:0/2940066185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cd9ac2780 con 0x560cd9bccf60 2023-10-14T19:08:51.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.873+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9ba4240 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc084004960 tx=0x7fc08400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6c5787721d0a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc090ff9700 1 -- 172.21.15.7:0/2940066185 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08402b420 con 0x560cd9bccf60 2023-10-14T19:08:51.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc090ff9700 1 -- 172.21.15.7:0/2940066185 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400b030 con 0x560cd9bccf60 2023-10-14T19:08:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc090ff9700 1 -- 172.21.15.7:0/2940066185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08402b790 con 0x560cd9bccf60 2023-10-14T19:08:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 -- 172.21.15.7:0/2940066185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 msgr2=0x560cd9ba4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9ba4240 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc084004960 tx=0x7fc08400a000 comp rx=0 tx=0).stop 2023-10-14T19:08:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 -- 172.21.15.7:0/2940066185 shutdown_connections 2023-10-14T19:08:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9ba3a50 0x560cd9be4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/2940066185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9bccf60 0x560cd9ba4240 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 -- 172.21.15.7:0/2940066185 >> 172.21.15.7:0/2940066185 conn(0x560cd9ba5370 msgr2=0x560cd9b9c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 -- 172.21.15.7:0/2940066185 shutdown_connections 2023-10-14T19:08:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.874+0000 7fc0aad58b80 1 -- 172.21.15.7:0/2940066185 wait complete. 2023-10-14T19:08:51.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.875+0000 7fc0aad58b80 1 -- start start 2023-10-14T19:08:51.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.875+0000 7fc0aad58b80 1 Processor -- start 2023-10-14T19:08:51.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9ba00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9c03d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9bfd580 con 0x560cd9ba3a50 2023-10-14T19:08:51.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cd9b9f620 con 0x560cd9bedd00 2023-10-14T19:08:51.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cd9ba0600 con 0x560cd9bccf60 2023-10-14T19:08:51.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 10 client.0 _ll_register_callbacks cb 0x560cd9b67110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:08:51.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9ba00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9ba00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55876/0 (socket says 172.21.15.7:55876) 2023-10-14T19:08:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 -- 172.21.15.7:0/1412115109 learned_addr learned my addr 172.21.15.7:0/1412115109 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9c03d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09b7fe700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 -- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 msgr2=0x560cd9c03d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9c03d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 -- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 msgr2=0x560cd9bcbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 -- 172.21.15.7:0/1412115109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c0ce9d0 con 0x560cd9ba3a50 2023-10-14T19:08:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9c03d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc09affd700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9ba00c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc09400bfc0 tx=0x7fc094072000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546d1e5c3e157970 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:51.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0797fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:08:51.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0797fa700 1 -- 172.21.15.7:0/1412115109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400e040 con 0x560cd9ba3a50 2023-10-14T19:08:51.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0797fa700 1 -- 172.21.15.7:0/1412115109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc09405e2a0 con 0x560cd9ba3a50 2023-10-14T19:08:51.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.876+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc08c011ed0 con 0x560cd9ba3a50 2023-10-14T19:08:51.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0797fa700 1 -- 172.21.15.7:0/1412115109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09405de10 con 0x560cd9ba3a50 2023-10-14T19:08:51.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 10 client.6564 fetch_fsmap learned FSMap version 56 2023-10-14T19:08:51.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x560cd9aa9470 con 0x560cd9ba3a50 2023-10-14T19:08:51.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0797fa700 1 -- 172.21.15.7:0/1412115109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c011ed0 con 0x560cd9ba3a50 2023-10-14T19:08:51.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0797fa700 1 -- 172.21.15.7:0/1412115109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc09405c300 con 0x560cd9ba3a50 2023-10-14T19:08:51.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 10 client.6564 fetch_fsmap finished waiting for FSMap version 56 2023-10-14T19:08:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 10 client.6564 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T19:08:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 20 client.6564 populate_metadata read hostname 'smithi007' 2023-10-14T19:08:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9bcc340 0x560cd9be5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 4 client.6564 mds_command: new command op to 6408 tid=0[{"prefix": "status"}] 2023-10-14T19:08:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 --> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560cd9a96e00 con 0x560cd9bcc340 2023-10-14T19:08:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9bcc340 0x560cd9be5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0797fa700 10 client.6564 ms_handle_connect on v2:172.21.15.7:6833/2588094250 2023-10-14T19:08:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc09a7fc700 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9bcc340 0x560cd9be5070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6588663f25c17b9a server_cookie=fb8d5c288d09315f in_seq=0 out_seq=0 2023-10-14T19:08:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0797fa700 1 -- 172.21.15.7:0/1412115109 <== mds.0 v2:172.21.15.7:6833/2588094250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560cd9a96e00 con 0x560cd9bcc340 2023-10-14T19:08:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.877+0000 7fc0797fa700 10 client.6564 handle_command_reply: tid=0 2023-10-14T19:08:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 client.6564 shutdown 2023-10-14T19:08:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 msgr2=0x560cd9ba00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9ba00c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc09400bfc0 tx=0x7fc094072000 comp rx=0 tx=0).stop 2023-10-14T19:08:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 shutdown_connections 2023-10-14T19:08:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:6833/2588094250,v1:172.21.15.7:6835/2588094250] conn(0x560cd9bcc340 0x560cd9be5070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560cd9bedd00 0x560cd9bcbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560cd9ba3a50 0x560cd9ba00c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0797fa700 0 client.6564 ms_handle_reset on v2:172.21.15.7:6833/2588094250 2023-10-14T19:08:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 --2- 172.21.15.7:0/1412115109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x560cd9bccf60 0x560cd9c03d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 >> 172.21.15.7:0/1412115109 conn(0x560cd9ba5370 msgr2=0x560cd9be95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 shutdown_connections 2023-10-14T19:08:51.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 1 -- 172.21.15.7:0/1412115109 wait complete. 2023-10-14T19:08:51.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0aad58b80 20 client.6564 trim_cache size 0 max 16384 2023-10-14T19:08:51.900 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:51.900 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:08:51.901 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:08:51.901 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6408, 2023-10-14T19:08:51.901 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:08:51.901 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:08:51.901 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:08:51.902 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.9085509429999998, 2023-10-14T19:08:51.902 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 56, 2023-10-14T19:08:51.902 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2023-10-14T19:08:51.902 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 90, 2023-10-14T19:08:51.902 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.997487275999999 2023-10-14T19:08:51.903 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:51.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc07c067200 msgr2=0x7fc07c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc07c067200 0x7fc07c0696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0c72f0 tx=0x7fc084007eb0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 msgr2=0x7fc09c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 0x7fc09c0b5ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc09400b610 tx=0x7fc094018000 comp rx=0 tx=0).stop 2023-10-14T19:08:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 shutdown_connections 2023-10-14T19:08:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc07c067200 0x7fc07c0696b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09c159c80 0x7fc09c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09c0af790 0x7fc09c0b5ad0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 --2- 172.21.15.7:0/3254652127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09c1598b0 0x7fc09c0c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 >> 172.21.15.7:0/3254652127 conn(0x7fc09c070e30 msgr2=0x7fc09c0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.878+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 shutdown_connections 2023-10-14T19:08:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:51.879+0000 7fc0a1a5f700 1 -- 172.21.15.7:0/3254652127 wait complete. 2023-10-14T19:08:51.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:08:52.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.026+0000 7f6f0db2d700 1 Processor -- start 2023-10-14T19:08:52.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.026+0000 7f6f0db2d700 1 -- start start 2023-10-14T19:08:52.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f0db2d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:52.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f0db2d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 0x7f6f08156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:52.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f0db2d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0815ae40 con 0x7f6f080cb5a0 2023-10-14T19:08:52.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f0db2d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080ce0f0 con 0x7f6f0815a400 2023-10-14T19:08:52.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f0db2d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080cbde0 con 0x7f6f080cb970 2023-10-14T19:08:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f07fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 0x7f6f08156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f077fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6f080cb5a0 0x7f6f080cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36996/0 (socket says 172.21.15.7:36996) 2023-10-14T19:08:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f08159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:37918/0 (socket says 172.21.15.7:37918) 2023-10-14T19:08:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f07fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 0x7f6f08156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:59662/0 (socket says 172.21.15.7:59662) 2023-10-14T19:08:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.027+0000 7f6f077fe700 1 -- 172.21.15.7:0/2568263071 learned_addr learned my addr 172.21.15.7:0/2568263071 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f06ffd700 1 -- 172.21.15.7:0/2568263071 >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 msgr2=0x7f6f08156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f06ffd700 1 --2- 172.21.15.7:0/2568263071 >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 0x7f6f08156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f06ffd700 1 -- 172.21.15.7:0/2568263071 >> v1:172.21.15.148:6789/0 conn(0x7f6f080cb5a0 legacy=0x7f6f080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f06ffd700 1 -- 172.21.15.7:0/2568263071 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0815ab60 con 0x7f6f080cb970 2023-10-14T19:08:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f07fff700 1 --2- 172.21.15.7:0/2568263071 >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 0x7f6f08156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f067fc700 1 -- 172.21.15.7:0/2568263071 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771293912 0 0) 0x7f6f0815ae40 con 0x7f6f080cb5a0 2023-10-14T19:08:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f06ffd700 1 --2- 172.21.15.7:0/2568263071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f08159ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0098e0 tx=0x7f6efc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e3f177da76f960 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f067fc700 1 -- 172.21.15.7:0/2568263071 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00b640 con 0x7f6f080cb970 2023-10-14T19:08:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f067fc700 1 -- 172.21.15.7:0/2568263071 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc00b7a0 con 0x7f6f080cb970 2023-10-14T19:08:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.028+0000 7f6f067fc700 1 -- 172.21.15.7:0/2568263071 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00bb40 con 0x7f6f080cb970 2023-10-14T19:08:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 -- 172.21.15.7:0/2568263071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 msgr2=0x7f6f08159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/2568263071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f08159ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0098e0 tx=0x7f6efc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 -- 172.21.15.7:0/2568263071 shutdown_connections 2023-10-14T19:08:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/2568263071 >> v2:172.21.15.148:3300/0 conn(0x7f6f0815a400 0x7f6f08156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/2568263071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f08159ec0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 -- 172.21.15.7:0/2568263071 >> 172.21.15.7:0/2568263071 conn(0x7f6f08070e30 msgr2=0x7f6f080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 -- 172.21.15.7:0/2568263071 shutdown_connections 2023-10-14T19:08:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.029+0000 7f6f0db2d700 1 -- 172.21.15.7:0/2568263071 wait complete. 2023-10-14T19:08:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.030+0000 7f6f0db2d700 1 Processor -- start 2023-10-14T19:08:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.030+0000 7f6f0db2d700 1 -- start start 2023-10-14T19:08:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f0db2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f080cb5a0 0x7f6f08153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f0db2d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f0815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f0db2d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 0x7f6f08155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f0db2d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0816a400 con 0x7f6f0815a400 2023-10-14T19:08:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f0db2d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0816a6e0 con 0x7f6f080cb5a0 2023-10-14T19:08:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f0db2d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0816a9c0 con 0x7f6f080cb970 2023-10-14T19:08:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 0x7f6f08155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 0x7f6f08155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55892/0 (socket says 172.21.15.7:55892) 2023-10-14T19:08:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 -- 172.21.15.7:0/4102725986 learned_addr learned my addr 172.21.15.7:0/4102725986 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f077fe700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f080cb5a0 0x7f6f08153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f06ffd700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f0815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 -- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 msgr2=0x7f6f0815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f0815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 -- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f080cb5a0 msgr2=0x7f6f08153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f080cb5a0 0x7f6f08153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 -- 172.21.15.7:0/4102725986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00009a20 con 0x7f6f0815a400 2023-10-14T19:08:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f06ffd700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f0815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f077fe700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f080cb5a0 0x7f6f08153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6f07fff700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 0x7f6f08155310 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009fc0 tx=0x7f6f0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.031+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000cd30 con 0x7f6f0815a400 2023-10-14T19:08:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.032+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0000f040 con 0x7f6f0815a400 2023-10-14T19:08:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.032+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000146d0 con 0x7f6f0815a400 2023-10-14T19:08:52.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.032+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc009420 con 0x7f6f0815a400 2023-10-14T19:08:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.032+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f08153780 con 0x7f6f0815a400 2023-10-14T19:08:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.032+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0804c3c0 con 0x7f6f0815a400 2023-10-14T19:08:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.033+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6f00003020 con 0x7f6f0815a400 2023-10-14T19:08:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.033+0000 7f6eef7fe700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ef4067200 0x7f6ef40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.033+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f00085520 con 0x7f6f0815a400 2023-10-14T19:08:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.033+0000 7f6f077fe700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ef4067200 0x7f6ef40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.034+0000 7f6f077fe700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ef4067200 0x7f6ef40696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8001810 tx=0x7f6ef8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.038+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f00052330 con 0x7f6f0815a400 2023-10-14T19:08:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.278+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f080b1440 con 0x7f6f0815a400 2023-10-14T19:08:52.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.278+0000 7f6eef7fe700 1 -- 172.21.15.7:0/4102725986 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f00083e60 con 0x7f6f0815a400 2023-10-14T19:08:52.279 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:08:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ef4067200 msgr2=0x7f6ef40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ef4067200 0x7f6ef40696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8001810 tx=0x7f6ef8009040 comp rx=0 tx=0).stop 2023-10-14T19:08:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 msgr2=0x7f6f08155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 0x7f6f08155310 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009fc0 tx=0x7f6f0000b040 comp rx=0 tx=0).stop 2023-10-14T19:08:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 shutdown_connections 2023-10-14T19:08:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6ef4067200 0x7f6ef40696b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f080cb5a0 0x7f6f08153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f0815a400 0x7f6f08155310 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 --2- 172.21.15.7:0/4102725986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f080cb970 0x7f6f0815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 >> 172.21.15.7:0/4102725986 conn(0x7f6f08070e30 msgr2=0x7f6f080c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 shutdown_connections 2023-10-14T19:08:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:52.280+0000 7f6f0db2d700 1 -- 172.21.15.7:0/4102725986 wait complete. 2023-10-14T19:08:52.293 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:08:52.294 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:08:52.294 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:08:52.294 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:08:52.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:52.295 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:08:52.295 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:08:52.296 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:08:52.296 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:08:52.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.297 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:08:52.313 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:08:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:08:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:08:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:08:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.314 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:08:52.315 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:08:52.315 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:08:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:08:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:08:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42122sec preferred_lft 42122sec 2023-10-14T19:08:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:08:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.317 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:08:52.317 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:08:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:08:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:08:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.318 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:08:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:08:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.319 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:08:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:08:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:52.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.320 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:08:52.376 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:08:52.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.378 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:08:52.435 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:08:52.435 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:08:52.437 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:08:52.437 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:08:52.437 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:08:52.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:08:52.438 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:08:52.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:08:52.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:08:52.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:08:52.440 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:08:52.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.539 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:08:52.554 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:08:52.554 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:08:52.554 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:08:52.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:08:52.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:52.620 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:52.675 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:08:52.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:52.676 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:52.730 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:08:52.730 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:08:52.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:52.812 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:52.812 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:08:52.813 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:08:52.821 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:52.821 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:08:52.821 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:08:52.821 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:52.822 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:08:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:08:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:08:52.847 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:52.847 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:52.847 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:08:52.847 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:08:52.847 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:08:52.848 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:08:52.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:52.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:52.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:08:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 Processor -- start 2023-10-14T19:08:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 -- start start 2023-10-14T19:08:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f479c0a8be0 0x7f479c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f479c0aee90 0x7f479c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0ce1a0 con 0x7f479c06d280 2023-10-14T19:08:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0cd5d0 con 0x7f479c0aee90 2023-10-14T19:08:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.072+0000 7f47a1d91700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0cd870 con 0x7f479c0a8be0 2023-10-14T19:08:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f479c0aee90 0x7f479c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f479c06d280 0x7f479c0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53754/0 (socket says 172.21.15.7:53754) 2023-10-14T19:08:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479affd700 1 -- 172.21.15.7:0/2669268835 learned_addr learned my addr 172.21.15.7:0/2669268835 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479b7fe700 1 --2- 172.21.15.7:0/2669268835 >> v2:172.21.15.148:3300/0 conn(0x7f479c0a8be0 0x7f479c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479bfff700 1 -- 172.21.15.7:0/2669268835 >> v2:172.21.15.148:3300/0 conn(0x7f479c0a8be0 msgr2=0x7f479c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479bfff700 1 --2- 172.21.15.7:0/2669268835 >> v2:172.21.15.148:3300/0 conn(0x7f479c0a8be0 0x7f479c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479bfff700 1 -- 172.21.15.7:0/2669268835 >> v1:172.21.15.7:6789/0 conn(0x7f479c06d280 legacy=0x7f479c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479bfff700 1 -- 172.21.15.7:0/2669268835 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0cdb50 con 0x7f479c0aee90 2023-10-14T19:08:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479a7fc700 1 -- 172.21.15.7:0/2669268835 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374099339 0 0) 0x7f479c0ce1a0 con 0x7f479c06d280 2023-10-14T19:08:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479b7fe700 1 --2- 172.21.15.7:0/2669268835 >> v2:172.21.15.148:3300/0 conn(0x7f479c0a8be0 0x7f479c0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479bfff700 1 --2- 172.21.15.7:0/2669268835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c0aee90 0x7f479c0b08c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f479c06a9e0 tx=0x7f478c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382937cd5379cbd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479a7fc700 1 -- 172.21.15.7:0/2669268835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00e070 con 0x7f479c0aee90 2023-10-14T19:08:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479a7fc700 1 -- 172.21.15.7:0/2669268835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00bcc0 con 0x7f479c0aee90 2023-10-14T19:08:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.073+0000 7f479a7fc700 1 -- 172.21.15.7:0/2669268835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c012680 con 0x7f479c0aee90 2023-10-14T19:08:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 -- 172.21.15.7:0/2669268835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c0aee90 msgr2=0x7f479c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 --2- 172.21.15.7:0/2669268835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c0aee90 0x7f479c0b08c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f479c06a9e0 tx=0x7f478c009780 comp rx=0 tx=0).stop 2023-10-14T19:08:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 -- 172.21.15.7:0/2669268835 shutdown_connections 2023-10-14T19:08:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 --2- 172.21.15.7:0/2669268835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c0aee90 0x7f479c0b08c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 --2- 172.21.15.7:0/2669268835 >> v2:172.21.15.148:3300/0 conn(0x7f479c0a8be0 0x7f479c0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 -- 172.21.15.7:0/2669268835 >> 172.21.15.7:0/2669268835 conn(0x7f479c06ce80 msgr2=0x7f479c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 -- 172.21.15.7:0/2669268835 shutdown_connections 2023-10-14T19:08:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.074+0000 7f47a1d91700 1 -- 172.21.15.7:0/2669268835 wait complete. 2023-10-14T19:08:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.075+0000 7f47a1d91700 1 Processor -- start 2023-10-14T19:08:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.075+0000 7f47a1d91700 1 -- start start 2023-10-14T19:08:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 0x7f479c06f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f479c0a8be0 0x7f479c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c0aee90 0x7f479c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c151020 con 0x7f479c06d280 2023-10-14T19:08:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c06e2f0 con 0x7f479c0aee90 2023-10-14T19:08:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c06e5d0 con 0x7f479c0a8be0 2023-10-14T19:08:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 0x7f479c06f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 0x7f479c06f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55914/0 (socket says 172.21.15.7:55914) 2023-10-14T19:08:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 -- 172.21.15.7:0/586069203 learned_addr learned my addr 172.21.15.7:0/586069203 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 -- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f479c0a8be0 msgr2=0x7f479c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f479c0a8be0 0x7f479c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 -- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c0aee90 msgr2=0x7f479c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c0aee90 0x7f479c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 -- 172.21.15.7:0/586069203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009a20 con 0x7f479c06d280 2023-10-14T19:08:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f479b7fe700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 0x7f479c06f390 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f479400c830 tx=0x7f4794008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794005a00 con 0x7f479c06d280 2023-10-14T19:08:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794005b60 con 0x7f479c06d280 2023-10-14T19:08:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c06e8b0 con 0x7f479c06d280 2023-10-14T19:08:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.076+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794011600 con 0x7f479c06d280 2023-10-14T19:08:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.077+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c06ee70 con 0x7f479c06d280 2023-10-14T19:08:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.077+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c04c3c0 con 0x7f479c06d280 2023-10-14T19:08:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.078+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f47940119f0 con 0x7f479c06d280 2023-10-14T19:08:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.078+0000 7f47937fe700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f477c067200 0x7f477c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.078+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47940849e0 con 0x7f479c06d280 2023-10-14T19:08:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.078+0000 7f479affd700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f477c067200 0x7f477c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.079+0000 7f479affd700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f477c067200 0x7f477c0696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f479c06d6a0 tx=0x7f4784007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.083+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47940517f0 con 0x7f479c06d280 2023-10-14T19:08:53.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.323+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f479c0887d0 con 0x7f479c06d280 2023-10-14T19:08:53.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.323+0000 7f47937fe700 1 -- 172.21.15.7:0/586069203 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4794054e10 con 0x7f479c06d280 2023-10-14T19:08:53.324 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:08:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f477c067200 msgr2=0x7f477c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f477c067200 0x7f477c0696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f479c06d6a0 tx=0x7f4784007a40 comp rx=0 tx=0).stop 2023-10-14T19:08:53.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 msgr2=0x7f479c06f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:53.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 0x7f479c06f390 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f479400c830 tx=0x7f4794008040 comp rx=0 tx=0).stop 2023-10-14T19:08:53.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 shutdown_connections 2023-10-14T19:08:53.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f477c067200 0x7f477c0696b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c0aee90 0x7f479c0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f479c06d280 0x7f479c06f390 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 --2- 172.21.15.7:0/586069203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f479c0a8be0 0x7f479c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:53.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 >> 172.21.15.7:0/586069203 conn(0x7f479c06ce80 msgr2=0x7f479c159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:53.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 shutdown_connections 2023-10-14T19:08:53.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:53.325+0000 7f47a1d91700 1 -- 172.21.15.7:0/586069203 wait complete. 2023-10-14T19:08:53.338 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:08:53.338 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:08:53.339 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:08:53.339 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:08:53.339 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:53.340 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:08:53.340 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:08:53.340 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:08:53.341 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:08:53.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.342 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:08:53.360 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:08:53.361 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:08:53.361 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:08:53.361 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.361 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:08:53.362 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.362 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:53.362 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:53.362 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:08:53.362 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:53.363 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:53.363 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:08:53.363 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:08:53.363 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:53.363 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:08:53.364 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:53.364 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:08:53.364 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42131sec preferred_lft 42131sec 2023-10-14T19:08:53.364 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:08:53.364 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.365 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:08:53.365 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:08:53.365 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:08:53.365 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.365 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:08:53.366 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.366 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:53.366 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:08:53.366 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:08:53.366 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.367 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:08:53.367 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:08:53.367 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:08:53.367 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:08:53.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.368 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:08:53.427 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:08:53.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.429 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:08:53.488 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:08:53.488 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:08:53.489 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:08:53.489 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:08:53.489 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:08:53.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.490 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:08:53.491 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:08:53.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:08:53.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:08:53.492 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:08:53.492 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:08:53.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.596 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:08:53.612 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:08:53.612 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:08:53.612 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:08:53.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:08:53.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:53.678 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:53.733 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:08:53.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:08:53.735 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:53.788 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:08:53.788 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:08:53.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:53.869 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:53.869 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:08:53.870 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:08:53.877 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:53.878 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:08:53.878 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:08:53.879 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:53.879 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:53.900 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:08:53.900 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:08:53.901 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:08:53.901 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:08:53.901 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:08:53.901 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:08:53.901 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:08:53.902 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:08:53.903 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:08:53.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:53.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:53.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:08:54.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.103+0000 7f6eb38d0700 1 Processor -- start 2023-10-14T19:08:54.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.104+0000 7f6eb38d0700 1 -- start start 2023-10-14T19:08:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.104+0000 7f6eb38d0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6eac06dcf0 0x7f6eac159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.104+0000 7f6eb38d0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6eac159e40 0x7f6eac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:54.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.104+0000 7f6eb38d0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0ccfd0 con 0x7f6eac159530 2023-10-14T19:08:54.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb38d0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac15a410 con 0x7f6eac06dcf0 2023-10-14T19:08:54.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb38d0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac15a6f0 con 0x7f6eac159e40 2023-10-14T19:08:54.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb166c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6eac159530 0x7f6eac0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53756/0 (socket says 172.21.15.7:53756) 2023-10-14T19:08:54.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb166c700 1 -- 172.21.15.7:0/2529389167 learned_addr learned my addr 172.21.15.7:0/2529389167 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:54.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb0e6b700 1 --2- 172.21.15.7:0/2529389167 >> v2:172.21.15.7:3300/0 conn(0x7f6eac06dcf0 0x7f6eac159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:54.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb1e6d700 1 --2- 172.21.15.7:0/2529389167 >> v2:172.21.15.148:3300/0 conn(0x7f6eac159e40 0x7f6eac0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:54.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eabfff700 1 -- 172.21.15.7:0/2529389167 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683866143 0 0) 0x7f6eac0ccfd0 con 0x7f6eac159530 2023-10-14T19:08:54.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eabfff700 1 -- 172.21.15.7:0/2529389167 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e94003570 con 0x7f6eac159530 2023-10-14T19:08:54.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb0e6b700 1 -- 172.21.15.7:0/2529389167 >> v2:172.21.15.148:3300/0 conn(0x7f6eac159e40 msgr2=0x7f6eac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:54.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb0e6b700 1 --2- 172.21.15.7:0/2529389167 >> v2:172.21.15.148:3300/0 conn(0x7f6eac159e40 0x7f6eac0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:54.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb0e6b700 1 -- 172.21.15.7:0/2529389167 >> v1:172.21.15.7:6789/0 conn(0x7f6eac159530 legacy=0x7f6eac0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:54.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb0e6b700 1 -- 172.21.15.7:0/2529389167 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac15a9d0 con 0x7f6eac06dcf0 2023-10-14T19:08:54.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb1e6d700 1 --2- 172.21.15.7:0/2529389167 >> v2:172.21.15.148:3300/0 conn(0x7f6eac159e40 0x7f6eac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:54.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eb0e6b700 1 --2- 172.21.15.7:0/2529389167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac159900 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0caef0 tx=0x7f6ea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b3151f9196a966 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:54.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eabfff700 1 -- 172.21.15.7:0/2529389167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0011630 con 0x7f6eac06dcf0 2023-10-14T19:08:54.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eabfff700 1 -- 172.21.15.7:0/2529389167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea0011790 con 0x7f6eac06dcf0 2023-10-14T19:08:54.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.105+0000 7f6eabfff700 1 -- 172.21.15.7:0/2529389167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0011b30 con 0x7f6eac06dcf0 2023-10-14T19:08:54.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2529389167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 msgr2=0x7f6eac159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:54.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2529389167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac159900 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0caef0 tx=0x7f6ea00091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:54.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2529389167 shutdown_connections 2023-10-14T19:08:54.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2529389167 >> v2:172.21.15.148:3300/0 conn(0x7f6eac159e40 0x7f6eac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:54.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2529389167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac159900 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:54.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2529389167 >> 172.21.15.7:0/2529389167 conn(0x7f6eac0703a0 msgr2=0x7f6eac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:54.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2529389167 shutdown_connections 2023-10-14T19:08:54.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.106+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2529389167 wait complete. 2023-10-14T19:08:54.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.107+0000 7f6eb38d0700 1 Processor -- start 2023-10-14T19:08:54.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.107+0000 7f6eb38d0700 1 -- start start 2023-10-14T19:08:54.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb38d0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:54.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb38d0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6eac159530 0x7f6eac0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:54.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb38d0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6eac159e40 0x7f6eac0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:54.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb38d0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac169f70 con 0x7f6eac06dcf0 2023-10-14T19:08:54.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb38d0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b59d0 con 0x7f6eac159530 2023-10-14T19:08:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb38d0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b5cb0 con 0x7f6eac159e40 2023-10-14T19:08:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb166c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb166c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55940/0 (socket says 172.21.15.7:55940) 2023-10-14T19:08:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.108+0000 7f6eb166c700 1 -- 172.21.15.7:0/2048763347 learned_addr learned my addr 172.21.15.7:0/2048763347 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb0e6b700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6eac159530 0x7f6eac0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb1e6d700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6eac159e40 0x7f6eac0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb166c700 1 -- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6eac159e40 msgr2=0x7f6eac0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb166c700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6eac159e40 0x7f6eac0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb166c700 1 -- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6eac159530 msgr2=0x7f6eac0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:54.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb166c700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6eac159530 0x7f6eac0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb166c700 1 -- 172.21.15.7:0/2048763347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0009420 con 0x7f6eac06dcf0 2023-10-14T19:08:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb1e6d700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6eac159e40 0x7f6eac0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb166c700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac154240 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c7c0 tx=0x7f6ea4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4005b30 con 0x7f6eac06dcf0 2023-10-14T19:08:54.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4005c90 con 0x7f6eac06dcf0 2023-10-14T19:08:54.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0b5f90 con 0x7f6eac06dcf0 2023-10-14T19:08:54.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4007340 con 0x7f6eac06dcf0 2023-10-14T19:08:54.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.109+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac154780 con 0x7f6eac06dcf0 2023-10-14T19:08:54.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.110+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac04c3c0 con 0x7f6eac06dcf0 2023-10-14T19:08:54.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.110+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6ea401b400 con 0x7f6eac06dcf0 2023-10-14T19:08:54.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.111+0000 7f6ea97fa700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e980671d0 0x7f6e98069680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.111+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ea40844d0 con 0x7f6eac06dcf0 2023-10-14T19:08:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.111+0000 7f6eb0e6b700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e980671d0 0x7f6e98069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.112+0000 7f6eb0e6b700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e980671d0 0x7f6e98069680 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00093f0 tx=0x7f6ea0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.115+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ea4051470 con 0x7f6eac06dcf0 2023-10-14T19:08:54.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:54.355+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6eac0ce6a0 con 0x7f6eac06dcf0 2023-10-14T19:08:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.004+0000 7f6ea97fa700 1 -- 172.21.15.7:0/2048763347 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6ea4054a90 con 0x7f6eac06dcf0 2023-10-14T19:08:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e980671d0 msgr2=0x7f6e98069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e980671d0 0x7f6e98069680 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00093f0 tx=0x7f6ea0017000 comp rx=0 tx=0).stop 2023-10-14T19:08:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 msgr2=0x7f6eac154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac154240 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c7c0 tx=0x7f6ea4007e00 comp rx=0 tx=0).stop 2023-10-14T19:08:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 shutdown_connections 2023-10-14T19:08:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6e980671d0 0x7f6e98069680 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6eac159e40 0x7f6eac0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6eac06dcf0 0x7f6eac154240 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 --2- 172.21.15.7:0/2048763347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6eac159530 0x7f6eac0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 >> 172.21.15.7:0/2048763347 conn(0x7f6eac0703a0 msgr2=0x7f6eac0c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 shutdown_connections 2023-10-14T19:08:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.007+0000 7f6eb38d0700 1 -- 172.21.15.7:0/2048763347 wait complete. 2023-10-14T19:08:55.022 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:08:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.147+0000 7f534fbd7700 1 Processor -- start 2023-10-14T19:08:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 -- start start 2023-10-14T19:08:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5348138bc0 0x7f534806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53481393f0 0x7f53480cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534806dab0 0x7f53480cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480c3380 con 0x7f5348138bc0 2023-10-14T19:08:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534806e010 con 0x7f53481393f0 2023-10-14T19:08:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.148+0000 7f534fbd7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480c2a50 con 0x7f534806dab0 2023-10-14T19:08:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5348138bc0 0x7f534806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5348138bc0 0x7f534806d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55956/0 (socket says 172.21.15.7:55956) 2023-10-14T19:08:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 -- 172.21.15.7:0/2560980225 learned_addr learned my addr 172.21.15.7:0/2560980225 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534e174700 1 --2- 172.21.15.7:0/2560980225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534806dab0 0x7f53480cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d172700 1 --2- 172.21.15.7:0/2560980225 >> v2:172.21.15.148:3300/0 conn(0x7f53481393f0 0x7f53480cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 -- 172.21.15.7:0/2560980225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534806dab0 msgr2=0x7f53480cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 --2- 172.21.15.7:0/2560980225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534806dab0 0x7f53480cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 -- 172.21.15.7:0/2560980225 >> v2:172.21.15.148:3300/0 conn(0x7f53481393f0 msgr2=0x7f53480cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 --2- 172.21.15.7:0/2560980225 >> v2:172.21.15.148:3300/0 conn(0x7f53481393f0 0x7f53480cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 -- 172.21.15.7:0/2560980225 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c2d30 con 0x7f5348138bc0 2023-10-14T19:08:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534d973700 1 --2- 172.21.15.7:0/2560980225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5348138bc0 0x7f534806d570 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f53481597d0 tx=0x7f534000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951f919f42a71b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534c971700 1 -- 172.21.15.7:0/2560980225 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340010070 con 0x7f5348138bc0 2023-10-14T19:08:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534c971700 1 -- 172.21.15.7:0/2560980225 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000de90 con 0x7f5348138bc0 2023-10-14T19:08:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.149+0000 7f534c971700 1 -- 172.21.15.7:0/2560980225 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000b320 con 0x7f5348138bc0 2023-10-14T19:08:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 -- 172.21.15.7:0/2560980225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5348138bc0 msgr2=0x7f534806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 --2- 172.21.15.7:0/2560980225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5348138bc0 0x7f534806d570 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f53481597d0 tx=0x7f534000ba50 comp rx=0 tx=0).stop 2023-10-14T19:08:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 -- 172.21.15.7:0/2560980225 shutdown_connections 2023-10-14T19:08:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 --2- 172.21.15.7:0/2560980225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534806dab0 0x7f53480cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 --2- 172.21.15.7:0/2560980225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5348138bc0 0x7f534806d570 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 --2- 172.21.15.7:0/2560980225 >> v2:172.21.15.148:3300/0 conn(0x7f53481393f0 0x7f53480cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 -- 172.21.15.7:0/2560980225 >> 172.21.15.7:0/2560980225 conn(0x7f53480ccb60 msgr2=0x7f53480ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 -- 172.21.15.7:0/2560980225 shutdown_connections 2023-10-14T19:08:55.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.150+0000 7f534fbd7700 1 -- 172.21.15.7:0/2560980225 wait complete. 2023-10-14T19:08:55.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.151+0000 7f534fbd7700 1 Processor -- start 2023-10-14T19:08:55.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.151+0000 7f534fbd7700 1 -- start start 2023-10-14T19:08:55.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534fbd7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 0x7f534812cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534fbd7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5348138bc0 0x7f534812d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534fbd7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53481393f0 0x7f534812d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534fbd7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480cadd0 con 0x7f534806dab0 2023-10-14T19:08:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534fbd7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348158e90 con 0x7f5348138bc0 2023-10-14T19:08:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534fbd7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480ca1c0 con 0x7f53481393f0 2023-10-14T19:08:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 0x7f534812cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 0x7f534812cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55972/0 (socket says 172.21.15.7:55972) 2023-10-14T19:08:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 -- 172.21.15.7:0/3200138197 learned_addr learned my addr 172.21.15.7:0/3200138197 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d172700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5348138bc0 0x7f534812d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534e174700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53481393f0 0x7f534812d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 -- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53481393f0 msgr2=0x7f534812d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53481393f0 0x7f534812d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 -- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5348138bc0 msgr2=0x7f534812d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5348138bc0 0x7f534812d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 -- 172.21.15.7:0/3200138197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534000bcf0 con 0x7f534806dab0 2023-10-14T19:08:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f534d973700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 0x7f534812cd10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5348069bb0 tx=0x7f534001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.152+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340009a30 con 0x7f534806dab0 2023-10-14T19:08:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.153+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340009bb0 con 0x7f534806dab0 2023-10-14T19:08:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.153+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53480ca4a0 con 0x7f534806dab0 2023-10-14T19:08:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.153+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534001e440 con 0x7f534806dab0 2023-10-14T19:08:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.153+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53480caa60 con 0x7f534806dab0 2023-10-14T19:08:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.154+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534804c3c0 con 0x7f534806dab0 2023-10-14T19:08:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.154+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5340003040 con 0x7f534806dab0 2023-10-14T19:08:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.154+0000 7f5345ffb700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5334067200 0x7f53340696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.155+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5340086140 con 0x7f534806dab0 2023-10-14T19:08:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.155+0000 7f534d172700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5334067200 0x7f53340696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.155+0000 7f534d172700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5334067200 0x7f53340696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f53480cc030 tx=0x7f533c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.159+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5340052f50 con 0x7f534806dab0 2023-10-14T19:08:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.378+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f53480caf10 con 0x7f5334067200 2023-10-14T19:08:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.381+0000 7f5345ffb700 1 -- 172.21.15.7:0/3200138197 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f533c00bdd0 con 0x7f5334067200 2023-10-14T19:08:55.381 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:08:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:08:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:55.382 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:08:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5334067200 msgr2=0x7f53340696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5334067200 0x7f53340696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f53480cc030 tx=0x7f533c008040 comp rx=0 tx=0).stop 2023-10-14T19:08:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 msgr2=0x7f534812cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 0x7f534812cd10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5348069bb0 tx=0x7f534001a000 comp rx=0 tx=0).stop 2023-10-14T19:08:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 shutdown_connections 2023-10-14T19:08:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5334067200 0x7f53340696b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53481393f0 0x7f534812d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f534806dab0 0x7f534812cd10 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 --2- 172.21.15.7:0/3200138197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5348138bc0 0x7f534812d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 >> 172.21.15.7:0/3200138197 conn(0x7f53480ccb60 msgr2=0x7f534813b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 shutdown_connections 2023-10-14T19:08:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.382+0000 7f534fbd7700 1 -- 172.21.15.7:0/3200138197 wait complete. 2023-10-14T19:08:55.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:08:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.516+0000 7fe35936e700 1 Processor -- start 2023-10-14T19:08:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.516+0000 7fe35936e700 1 -- start start 2023-10-14T19:08:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe35936e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe3540cb560 0x7fe35406d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe35936e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe3541632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe35936e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35406e1f0 con 0x7fe3541595f0 2023-10-14T19:08:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe35936e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3540cc770 con 0x7fe3540cb560 2023-10-14T19:08:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe35936e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540cf580 con 0x7fe35406dd90 2023-10-14T19:08:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe3537fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe3541632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe3527fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe3540cb560 0x7fe35406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe352ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe3541595f0 0x7fe3540cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:37006/0 (socket says 172.21.15.7:37006) 2023-10-14T19:08:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.517+0000 7fe352ffd700 1 -- 172.21.15.7:0/1958162349 learned_addr learned my addr 172.21.15.7:0/1958162349 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe351ffb700 1 -- 172.21.15.7:0/1958162349 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980479564 0 0) 0x7fe34c001110 con 0x7fe3541595f0 2023-10-14T19:08:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe3537fe700 1 -- 172.21.15.7:0/1958162349 >> v2:172.21.15.148:3300/0 conn(0x7fe3540cb560 msgr2=0x7fe35406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe3537fe700 1 --2- 172.21.15.7:0/1958162349 >> v2:172.21.15.148:3300/0 conn(0x7fe3540cb560 0x7fe35406d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe3537fe700 1 -- 172.21.15.7:0/1958162349 >> v1:172.21.15.148:6789/0 conn(0x7fe3541595f0 legacy=0x7fe3540cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe3537fe700 1 -- 172.21.15.7:0/1958162349 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540b1400 con 0x7fe35406dd90 2023-10-14T19:08:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe3527fc700 1 --2- 172.21.15.7:0/1958162349 >> v2:172.21.15.148:3300/0 conn(0x7fe3540cb560 0x7fe35406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe3537fe700 1 --2- 172.21.15.7:0/1958162349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe3541632e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e60 tx=0x7fe344009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fcce3dce9d54d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe351ffb700 1 -- 172.21.15.7:0/1958162349 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34400e070 con 0x7fe35406dd90 2023-10-14T19:08:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe351ffb700 1 -- 172.21.15.7:0/1958162349 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34400bb60 con 0x7fe35406dd90 2023-10-14T19:08:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.518+0000 7fe351ffb700 1 -- 172.21.15.7:0/1958162349 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344012430 con 0x7fe35406dd90 2023-10-14T19:08:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 -- 172.21.15.7:0/1958162349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 msgr2=0x7fe3541632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 --2- 172.21.15.7:0/1958162349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe3541632e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e60 tx=0x7fe344009780 comp rx=0 tx=0).stop 2023-10-14T19:08:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 -- 172.21.15.7:0/1958162349 shutdown_connections 2023-10-14T19:08:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 --2- 172.21.15.7:0/1958162349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe3541632e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 --2- 172.21.15.7:0/1958162349 >> v2:172.21.15.148:3300/0 conn(0x7fe3540cb560 0x7fe35406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 -- 172.21.15.7:0/1958162349 >> 172.21.15.7:0/1958162349 conn(0x7fe354070e70 msgr2=0x7fe3540d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:55.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 -- 172.21.15.7:0/1958162349 shutdown_connections 2023-10-14T19:08:55.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.519+0000 7fe35936e700 1 -- 172.21.15.7:0/1958162349 wait complete. 2023-10-14T19:08:55.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.520+0000 7fe35936e700 1 Processor -- start 2023-10-14T19:08:55.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.520+0000 7fe35936e700 1 -- start start 2023-10-14T19:08:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe35936e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe354146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe35936e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3540cb560 0x7fe3540b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe35936e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 0x7fe3540b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe35936e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540cb400 con 0x7fe3541595f0 2023-10-14T19:08:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe35936e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35415d280 con 0x7fe3540cb560 2023-10-14T19:08:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe35936e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540cae40 con 0x7fe35406dd90 2023-10-14T19:08:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 0x7fe3540b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 0x7fe3540b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55980/0 (socket says 172.21.15.7:55980) 2023-10-14T19:08:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 -- 172.21.15.7:0/247212855 learned_addr learned my addr 172.21.15.7:0/247212855 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe352ffd700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe354146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3527fc700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3540cb560 0x7fe3540b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 -- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 msgr2=0x7fe354146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe354146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 -- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3540cb560 msgr2=0x7fe3540b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3540cb560 0x7fe3540b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 -- 172.21.15.7:0/247212855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c009420 con 0x7fe3541595f0 2023-10-14T19:08:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe352ffd700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe354146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3527fc700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3540cb560 0x7fe3540b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe3537fe700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 0x7fe3540b2b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe34400b6c0 tx=0x7fe344019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.521+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344027470 con 0x7fe3541595f0 2023-10-14T19:08:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.522+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440275d0 con 0x7fe3541595f0 2023-10-14T19:08:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.522+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe344009a20 con 0x7fe3541595f0 2023-10-14T19:08:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.522+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344027990 con 0x7fe3541595f0 2023-10-14T19:08:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.522+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35415cf10 con 0x7fe3541595f0 2023-10-14T19:08:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.523+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35415cd70 con 0x7fe3541595f0 2023-10-14T19:08:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.523+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe344024070 con 0x7fe3541595f0 2023-10-14T19:08:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.523+0000 7fe34affd700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe334067230 0x7fe3340696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.524+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe344087060 con 0x7fe3541595f0 2023-10-14T19:08:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.524+0000 7fe352ffd700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe334067230 0x7fe3340696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.524+0000 7fe352ffd700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe334067230 0x7fe3340696e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe34c006920 tx=0x7fe34c007b90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.528+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe35415cd70 con 0x7fe3541595f0 2023-10-14T19:08:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.721+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe35415cd70 con 0x7fe3541595f0 2023-10-14T19:08:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.722+0000 7fe34affd700 1 -- 172.21.15.7:0/247212855 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe35415cd70 con 0x7fe3541595f0 2023-10-14T19:08:55.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.723+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe334067230 msgr2=0x7fe3340696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.723+0000 7fe35936e700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe334067230 0x7fe3340696e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe34c006920 tx=0x7fe34c007b90 comp rx=0 tx=0).stop 2023-10-14T19:08:55.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.723+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 msgr2=0x7fe3540b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 0x7fe3540b2b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe34400b6c0 tx=0x7fe344019000 comp rx=0 tx=0).stop 2023-10-14T19:08:55.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 shutdown_connections 2023-10-14T19:08:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe334067230 0x7fe3340696e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541595f0 0x7fe3540b2b00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35406dd90 0x7fe354146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 --2- 172.21.15.7:0/247212855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3540cb560 0x7fe3540b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 >> 172.21.15.7:0/247212855 conn(0x7fe354070e70 msgr2=0x7fe3541584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:55.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 shutdown_connections 2023-10-14T19:08:55.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.724+0000 7fe35936e700 1 -- 172.21.15.7:0/247212855 wait complete. 2023-10-14T19:08:55.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-14T19:08:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 Processor -- start 2023-10-14T19:08:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 -- start start 2023-10-14T19:08:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8a8157360 0x7fc8a8067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8a815abe0 0x7fc8a80ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a815a750 con 0x7fc8a8157360 2023-10-14T19:08:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a8159e40 con 0x7fc8a815abe0 2023-10-14T19:08:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.858+0000 7fc8ae0ec700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80687a0 con 0x7fc8a806d280 2023-10-14T19:08:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8a8157360 0x7fc8a8067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8a8157360 0x7fc8a8067e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55984/0 (socket says 172.21.15.7:55984) 2023-10-14T19:08:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 -- 172.21.15.7:0/1965174378 learned_addr learned my addr 172.21.15.7:0/1965174378 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a6ffd700 1 --2- 172.21.15.7:0/1965174378 >> v2:172.21.15.148:3300/0 conn(0x7fc8a815abe0 0x7fc8a80ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 -- 172.21.15.7:0/1965174378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 msgr2=0x7fc8a80cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 --2- 172.21.15.7:0/1965174378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 -- 172.21.15.7:0/1965174378 >> v2:172.21.15.148:3300/0 conn(0x7fc8a815abe0 msgr2=0x7fc8a80ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 --2- 172.21.15.7:0/1965174378 >> v2:172.21.15.148:3300/0 conn(0x7fc8a815abe0 0x7fc8a80ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 -- 172.21.15.7:0/1965174378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a815a100 con 0x7fc8a8157360 2023-10-14T19:08:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a77fe700 1 --2- 172.21.15.7:0/1965174378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8157360 0x7fc8a8067e30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80c7120 tx=0x7fc898009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce3e40d5796370f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a67fc700 1 -- 172.21.15.7:0/1965174378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800b860 con 0x7fc8a8157360 2023-10-14T19:08:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a67fc700 1 -- 172.21.15.7:0/1965174378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800b9c0 con 0x7fc8a8157360 2023-10-14T19:08:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.859+0000 7fc8a67fc700 1 -- 172.21.15.7:0/1965174378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800bd60 con 0x7fc8a8157360 2023-10-14T19:08:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1965174378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8157360 msgr2=0x7fc8a8067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1965174378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8157360 0x7fc8a8067e30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80c7120 tx=0x7fc898009250 comp rx=0 tx=0).stop 2023-10-14T19:08:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1965174378 shutdown_connections 2023-10-14T19:08:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1965174378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1965174378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8157360 0x7fc8a8067e30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1965174378 >> v2:172.21.15.148:3300/0 conn(0x7fc8a815abe0 0x7fc8a80ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1965174378 >> 172.21.15.7:0/1965174378 conn(0x7fc8a80ccb50 msgr2=0x7fc8a80ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1965174378 shutdown_connections 2023-10-14T19:08:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.860+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1965174378 wait complete. 2023-10-14T19:08:55.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.861+0000 7fc8ae0ec700 1 Processor -- start 2023-10-14T19:08:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.861+0000 7fc8ae0ec700 1 -- start start 2023-10-14T19:08:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8ae0ec700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8ae0ec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8a8157360 0x7fc8a8154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8ae0ec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 0x7fc8a80aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8ae0ec700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80ac060 con 0x7fc8a815abe0 2023-10-14T19:08:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8ae0ec700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80c45d0 con 0x7fc8a8157360 2023-10-14T19:08:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8ae0ec700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80ad2c0 con 0x7fc8a806d280 2023-10-14T19:08:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 0x7fc8a80aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 0x7fc8a80aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55994/0 (socket says 172.21.15.7:55994) 2023-10-14T19:08:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 -- 172.21.15.7:0/1699299626 learned_addr learned my addr 172.21.15.7:0/1699299626 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a77fe700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 -- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 msgr2=0x7fc8a80acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a6ffd700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8a8157360 0x7fc8a8154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 -- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8a8157360 msgr2=0x7fc8a8154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8a8157360 0x7fc8a8154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 -- 172.21.15.7:0/1699299626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980094f0 con 0x7fc8a815abe0 2023-10-14T19:08:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.862+0000 7fc8a7fff700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 0x7fc8a80aa8b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000bc30 tx=0x7fc8a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.863+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00092e0 con 0x7fc8a815abe0 2023-10-14T19:08:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.863+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000c7a0 con 0x7fc8a815abe0 2023-10-14T19:08:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.863+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a80c3ca0 con 0x7fc8a815abe0 2023-10-14T19:08:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.863+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000cb80 con 0x7fc8a815abe0 2023-10-14T19:08:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.863+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a80c4260 con 0x7fc8a815abe0 2023-10-14T19:08:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.864+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a804c3c0 con 0x7fc8a815abe0 2023-10-14T19:08:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.864+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc8a0012070 con 0x7fc8a815abe0 2023-10-14T19:08:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.864+0000 7fc88f7fe700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc894067200 0x7fc8940696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.865+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8a0084700 con 0x7fc8a815abe0 2023-10-14T19:08:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.865+0000 7fc8a77fe700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc894067200 0x7fc8940696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.865+0000 7fc8a77fe700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc894067200 0x7fc8940696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80c7120 tx=0x7fc898017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:55.869+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8a0051540 con 0x7fc8a815abe0 2023-10-14T19:08:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.090+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc8a815a3e0 con 0x7fc894067200 2023-10-14T19:08:56.093 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:56.093+0000 7f53c0831700 -1 client.5471 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-14T19:08:29.992277+0000 mtime=2023-10-14T19:08:29.992277+0000 ctime=2023-10-14T19:08:29.998222+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000693312"] has_dir_layout 0x55968d3c1000) 2023-10-14T19:08:56.097 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:56.097+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:56.097 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:56.097+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:56.097 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:56.097+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:56.098 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:56.097+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:56.098 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:08:56.097+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:08:56.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.103+0000 7fc88f7fe700 1 -- 172.21.15.7:0/1699299626 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+469 (secure 0 0 0) 0x7fc8a815a3e0 con 0x7fc894067200 2023-10-14T19:08:56.104 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:08:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_addrs": [ 2023-10-14T19:08:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.7:6789", 2023-10-14T19:08:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6789", 2023-10-14T19:08:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6790" 2023-10-14T19:08:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:08:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": { 2023-10-14T19:08:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "data": [ 2023-10-14T19:08:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": " 340G", 2023-10-14T19:08:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_data", 2023-10-14T19:08:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: "used": " 0 " 2023-10-14T19:08:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:08:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": [ 2023-10-14T19:08:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:08:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": " 340G", 2023-10-14T19:08:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_metadata", 2023-10-14T19:08:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: "used": "64.0k" 2023-10-14T19:08:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:08:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:08:56.109 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:08:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc894067200 msgr2=0x7fc8940696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc894067200 0x7fc8940696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80c7120 tx=0x7fc898017000 comp rx=0 tx=0).stop 2023-10-14T19:08:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 msgr2=0x7fc8a80aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 0x7fc8a80aa8b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000bc30 tx=0x7fc8a0009840 comp rx=0 tx=0).stop 2023-10-14T19:08:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 shutdown_connections 2023-10-14T19:08:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc894067200 0x7fc8940696b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a815abe0 0x7fc8a80aa8b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8a806d280 0x7fc8a80acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 --2- 172.21.15.7:0/1699299626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8a8157360 0x7fc8a8154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.105+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 >> 172.21.15.7:0/1699299626 conn(0x7fc8a80ccb50 msgr2=0x7fc8a80c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:56.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.106+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 shutdown_connections 2023-10-14T19:08:56.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.106+0000 7fc8ae0ec700 1 -- 172.21.15.7:0/1699299626 wait complete. 2023-10-14T19:08:56.118 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:08:56.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:56.161 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:08:56.209 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:08:56.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:08:56.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:56.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:08:56.249 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:08:56.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:56.250 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:08:56.304 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:08:56.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:08:56.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:08:56.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:08:56.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:08:56.347 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:08:56.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:56.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.522+0000 7fc75bf6c700 1 Processor -- start 2023-10-14T19:08:56.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.522+0000 7fc75bf6c700 1 -- start start 2023-10-14T19:08:56.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75bf6c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7540cb970 0x7fc754159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75bf6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75bf6c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75415ae40 con 0x7fc7540cb5a0 2023-10-14T19:08:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75bf6c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540ce0f0 con 0x7fc7540cb970 2023-10-14T19:08:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75bf6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540d13f0 con 0x7fc75415a400 2023-10-14T19:08:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc759507700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7540cb970 0x7fc754159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75a509700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc759d08700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc7540cb5a0 0x7fc7540cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:37012/0 (socket says 172.21.15.7:37012) 2023-10-14T19:08:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc759d08700 1 -- 172.21.15.7:0/1632346946 learned_addr learned my addr 172.21.15.7:0/1632346946 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc758d06700 1 -- 172.21.15.7:0/1632346946 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566392548 0 0) 0x7fc75415ae40 con 0x7fc7540cb5a0 2023-10-14T19:08:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc758d06700 1 -- 172.21.15.7:0/1632346946 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc73c003570 con 0x7fc7540cb5a0 2023-10-14T19:08:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75a509700 1 -- 172.21.15.7:0/1632346946 >> v2:172.21.15.148:3300/0 conn(0x7fc7540cb970 msgr2=0x7fc754159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75a509700 1 --2- 172.21.15.7:0/1632346946 >> v2:172.21.15.148:3300/0 conn(0x7fc7540cb970 0x7fc754159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75a509700 1 -- 172.21.15.7:0/1632346946 >> v1:172.21.15.148:6789/0 conn(0x7fc7540cb5a0 legacy=0x7fc7540cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc75a509700 1 -- 172.21.15.7:0/1632346946 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75415ab60 con 0x7fc75415a400 2023-10-14T19:08:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.523+0000 7fc759507700 1 --2- 172.21.15.7:0/1632346946 >> v2:172.21.15.148:3300/0 conn(0x7fc7540cb970 0x7fc754159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75a509700 1 --2- 172.21.15.7:0/1632346946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754156e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e60 tx=0x7fc744009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626ab1738ba71315 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc758d06700 1 -- 172.21.15.7:0/1632346946 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400e070 con 0x7fc75415a400 2023-10-14T19:08:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc758d06700 1 -- 172.21.15.7:0/1632346946 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400bab0 con 0x7fc75415a400 2023-10-14T19:08:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc758d06700 1 -- 172.21.15.7:0/1632346946 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400be70 con 0x7fc75415a400 2023-10-14T19:08:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 -- 172.21.15.7:0/1632346946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 msgr2=0x7fc754156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/1632346946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754156e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e60 tx=0x7fc744009780 comp rx=0 tx=0).stop 2023-10-14T19:08:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 -- 172.21.15.7:0/1632346946 shutdown_connections 2023-10-14T19:08:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/1632346946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754156e90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/1632346946 >> v2:172.21.15.148:3300/0 conn(0x7fc7540cb970 0x7fc754159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 -- 172.21.15.7:0/1632346946 >> 172.21.15.7:0/1632346946 conn(0x7fc754070e30 msgr2=0x7fc7540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 -- 172.21.15.7:0/1632346946 shutdown_connections 2023-10-14T19:08:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.524+0000 7fc75bf6c700 1 -- 172.21.15.7:0/1632346946 wait complete. 2023-10-14T19:08:56.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.525+0000 7fc75bf6c700 1 Processor -- start 2023-10-14T19:08:56.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 -- start start 2023-10-14T19:08:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 0x7fc754151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7540cb970 0x7fc75415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540b4840 con 0x7fc7540cb5a0 2023-10-14T19:08:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541523d0 con 0x7fc7540cb970 2023-10-14T19:08:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75bf6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540b3c30 con 0x7fc75415a400 2023-10-14T19:08:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc759d08700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 0x7fc754151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc759d08700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 0x7fc754151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55996/0 (socket says 172.21.15.7:55996) 2023-10-14T19:08:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc759d08700 1 -- 172.21.15.7:0/3195313930 learned_addr learned my addr 172.21.15.7:0/3195313930 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc759507700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7540cb970 0x7fc75415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.526+0000 7fc75a509700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc759d08700 1 -- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 msgr2=0x7fc754154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc759d08700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc759d08700 1 -- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7540cb970 msgr2=0x7fc75415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc759d08700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7540cb970 0x7fc75415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc759d08700 1 -- 172.21.15.7:0/3195313930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748009420 con 0x7fc7540cb5a0 2023-10-14T19:08:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc759d08700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 0x7fc754151e90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c7c0 tx=0x7fc74c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005cd0 con 0x7fc7540cb5a0 2023-10-14T19:08:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc744009a20 con 0x7fc7540cb5a0 2023-10-14T19:08:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c005e30 con 0x7fc7540cb5a0 2023-10-14T19:08:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c007320 con 0x7fc7540cb5a0 2023-10-14T19:08:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.527+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7540b41f0 con 0x7fc7540cb5a0 2023-10-14T19:08:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.528+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75404c3c0 con 0x7fc7540cb5a0 2023-10-14T19:08:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.529+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc74c01b3b0 con 0x7fc7540cb5a0 2023-10-14T19:08:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.529+0000 7fc751ffb700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740067200 0x7fc7400696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.529+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc74c084100 con 0x7fc7540cb5a0 2023-10-14T19:08:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.530+0000 7fc759507700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740067200 0x7fc7400696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.530+0000 7fc759507700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740067200 0x7fc7400696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc75416c590 tx=0x7fc7480091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.534+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc74c050fe0 con 0x7fc7540cb5a0 2023-10-14T19:08:56.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.772+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc75415df20 con 0x7fc7540cb5a0 2023-10-14T19:08:56.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.772+0000 7fc751ffb700 1 -- 172.21.15.7:0/3195313930 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fc74c054600 con 0x7fc7540cb5a0 2023-10-14T19:08:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:56.774 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:45.357460+0000","modified":"2023-10-14T19:08:48.985870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6408":{"gid":6408,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/2588094250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2588094250},{"type":"v1","addr":"172.21.15.7:6835","nonce":2588094250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T19:08:56.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740067200 msgr2=0x7fc7400696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740067200 0x7fc7400696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc75416c590 tx=0x7fc7480091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 msgr2=0x7fc754151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 0x7fc754151e90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c7c0 tx=0x7fc74c007e00 comp rx=0 tx=0).stop 2023-10-14T19:08:56.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 shutdown_connections 2023-10-14T19:08:56.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc740067200 0x7fc7400696b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc75415a400 0x7fc754154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7540cb5a0 0x7fc754151e90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 --2- 172.21.15.7:0/3195313930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7540cb970 0x7fc75415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 >> 172.21.15.7:0/3195313930 conn(0x7fc754070e30 msgr2=0x7fc7540b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 shutdown_connections 2023-10-14T19:08:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.774+0000 7fc75bf6c700 1 -- 172.21.15.7:0/3195313930 wait complete. 2023-10-14T19:08:56.778 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2023-10-14T19:08:56.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.906+0000 7fa190fb7700 1 Processor -- start 2023-10-14T19:08:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.907+0000 7fa190fb7700 1 -- start start 2023-10-14T19:08:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.907+0000 7fa190fb7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.907+0000 7fa190fb7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa18c0cde50 0x7fa18c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.907+0000 7fa190fb7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c15ae40 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.907+0000 7fa190fb7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0d13f0 con 0x7fa18c0cde50 2023-10-14T19:08:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.907+0000 7fa190fb7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15ab60 con 0x7fa18c0cb5a0 2023-10-14T19:08:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa18c0cde50 0x7fa18c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:55260/0 (socket says 172.21.15.7:55260) 2023-10-14T19:08:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa189d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa18c0cd9e0 0x7fa18c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:51716/0 (socket says 172.21.15.7:51716) 2023-10-14T19:08:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18a59c700 1 -- 172.21.15.7:0/3544622115 learned_addr learned my addr 172.21.15.7:0/3544622115 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18ad9d700 1 -- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 msgr2=0x7fa18c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18ad9d700 1 --2- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18ad9d700 1 -- 172.21.15.7:0/3544622115 >> v1:172.21.15.148:6789/0 conn(0x7fa18c0cd9e0 legacy=0x7fa18c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18ad9d700 1 -- 172.21.15.7:0/3544622115 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0ccf00 con 0x7fa18c0cde50 2023-10-14T19:08:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18a59c700 1 --2- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.908+0000 7fa18ad9d700 1 --2- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0cde50 0x7fa18c156e90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098e0 tx=0x7fa17c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6d939dc837399f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa18959a700 1 -- 172.21.15.7:0/3544622115 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00b640 con 0x7fa18c0cde50 2023-10-14T19:08:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa18959a700 1 -- 172.21.15.7:0/3544622115 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00b7a0 con 0x7fa18c0cde50 2023-10-14T19:08:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa18959a700 1 -- 172.21.15.7:0/3544622115 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00bb40 con 0x7fa18c0cde50 2023-10-14T19:08:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 -- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0cde50 msgr2=0x7fa18c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 --2- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0cde50 0x7fa18c156e90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098e0 tx=0x7fa17c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 -- 172.21.15.7:0/3544622115 shutdown_connections 2023-10-14T19:08:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 --2- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0cde50 0x7fa18c156e90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 --2- 172.21.15.7:0/3544622115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 -- 172.21.15.7:0/3544622115 >> 172.21.15.7:0/3544622115 conn(0x7fa18c070e30 msgr2=0x7fa18c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:56.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 -- 172.21.15.7:0/3544622115 shutdown_connections 2023-10-14T19:08:56.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.909+0000 7fa190fb7700 1 -- 172.21.15.7:0/3544622115 wait complete. 2023-10-14T19:08:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.910+0000 7fa190fb7700 1 Processor -- start 2023-10-14T19:08:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.910+0000 7fa190fb7700 1 -- start start 2023-10-14T19:08:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa190fb7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa190fb7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 0x7fa18c0b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa190fb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0b61c0 0x7fa18c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa190fb7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c16e860 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa190fb7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0c7ea0 con 0x7fa18c0b61c0 2023-10-14T19:08:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa190fb7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0c8180 con 0x7fa18c0cb5a0 2023-10-14T19:08:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa189d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 0x7fa18c0b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa189d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 0x7fa18c0b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42890/0 (socket says 172.21.15.7:42890) 2023-10-14T19:08:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa189d9b700 1 -- 172.21.15.7:0/1472616748 learned_addr learned my addr 172.21.15.7:0/1472616748 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa18ad9d700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0b61c0 0x7fa18c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa18a59c700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa189d9b700 1 -- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 msgr2=0x7fa18c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa189d9b700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.911+0000 7fa189d9b700 1 -- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0b61c0 msgr2=0x7fa18c155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa189d9b700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0b61c0 0x7fa18c155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa189d9b700 1 -- 172.21.15.7:0/1472616748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184009ae0 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa189d9b700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 0x7fa18c0b5c80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c7c0 tx=0x7fa174007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174005a70 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa174005bd0 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c009420 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1740070d0 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.912+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c0c8740 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.913+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c0c7fe0 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.913+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa174007480 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.914+0000 7fa1827fc700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa16c067200 0x7fa16c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:56.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.914+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa174083e70 con 0x7fa18c0cd9e0 2023-10-14T19:08:56.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.914+0000 7fa18a59c700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa16c067200 0x7fa16c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:56.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.915+0000 7fa18a59c700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa16c067200 0x7fa16c0696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa1840072d0 tx=0x7fa18400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:56.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:56.918+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa18c0c7fe0 con 0x7fa18c0cd9e0 2023-10-14T19:08:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.113+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa18c0c7fe0 con 0x7fa18c0cd9e0 2023-10-14T19:08:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.114+0000 7fa1827fc700 1 -- 172.21.15.7:0/1472616748 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15305 (secure 0 0 0) 0x7fa18c0c7fe0 con 0x7fa18c0cd9e0 2023-10-14T19:08:57.115 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:57.115 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:46.969334+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:43.793528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:44.327457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa16c067200 msgr2=0x7fa16c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa16c067200 0x7fa16c0696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa1840072d0 tx=0x7fa18400b040 comp rx=0 tx=0).stop 2023-10-14T19:08:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 msgr2=0x7fa18c0b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 0x7fa18c0b5c80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c7c0 tx=0x7fa174007f70 comp rx=0 tx=0).stop 2023-10-14T19:08:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 shutdown_connections 2023-10-14T19:08:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa16c067200 0x7fa16c0696b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa18c0b61c0 0x7fa18c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa18c0cb5a0 0x7fa18c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 --2- 172.21.15.7:0/1472616748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa18c0cd9e0 0x7fa18c0b5c80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 >> 172.21.15.7:0/1472616748 conn(0x7fa18c070e30 msgr2=0x7fa18c0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 shutdown_connections 2023-10-14T19:08:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.116+0000 7fa190fb7700 1 -- 172.21.15.7:0/1472616748 wait complete. 2023-10-14T19:08:57.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:08:43.793528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:08:44.327457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:08:57.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:08:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.251+0000 7fa5b115e700 1 Processor -- start 2023-10-14T19:08:57.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.251+0000 7fa5b115e700 1 -- start start 2023-10-14T19:08:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5b115e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5ac1598c0 0x7fa5ac0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5b115e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5ac159c90 0x7fa5ac0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5b115e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0c9310 con 0x7fa5ac0cd460 2023-10-14T19:08:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5b115e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0ad990 con 0x7fa5ac1598c0 2023-10-14T19:08:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5b115e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0ce090 con 0x7fa5ac159c90 2023-10-14T19:08:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5aad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5ac1598c0 0x7fa5ac0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5ab59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa5ac0cd460 0x7fa5ac0cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40144/0 (socket says 172.21.15.7:40144) 2023-10-14T19:08:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5aad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5ac1598c0 0x7fa5ac0c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42892/0 (socket says 172.21.15.7:42892) 2023-10-14T19:08:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5ab59e700 1 -- 172.21.15.7:0/516473871 learned_addr learned my addr 172.21.15.7:0/516473871 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.252+0000 7fa5aa59c700 1 --2- 172.21.15.7:0/516473871 >> v2:172.21.15.148:3300/0 conn(0x7fa5ac159c90 0x7fa5ac0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5aad9d700 1 -- 172.21.15.7:0/516473871 >> v2:172.21.15.148:3300/0 conn(0x7fa5ac159c90 msgr2=0x7fa5ac0c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5aad9d700 1 --2- 172.21.15.7:0/516473871 >> v2:172.21.15.148:3300/0 conn(0x7fa5ac159c90 0x7fa5ac0c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5aad9d700 1 -- 172.21.15.7:0/516473871 >> v1:172.21.15.7:6789/0 conn(0x7fa5ac0cd460 legacy=0x7fa5ac0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5aad9d700 1 -- 172.21.15.7:0/516473871 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0c8cc0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5aad9d700 1 --2- 172.21.15.7:0/516473871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac0c3e70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac065160 tx=0x7fa59c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f972345f8bd3d41c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5a9d9b700 1 -- 172.21.15.7:0/516473871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00b6b0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5a9d9b700 1 -- 172.21.15.7:0/516473871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00b810 con 0x7fa5ac1598c0 2023-10-14T19:08:57.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5a9d9b700 1 -- 172.21.15.7:0/516473871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00bbb0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 -- 172.21.15.7:0/516473871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 msgr2=0x7fa5ac0c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 --2- 172.21.15.7:0/516473871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac0c3e70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac065160 tx=0x7fa59c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 -- 172.21.15.7:0/516473871 shutdown_connections 2023-10-14T19:08:57.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 --2- 172.21.15.7:0/516473871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac0c3e70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 --2- 172.21.15.7:0/516473871 >> v2:172.21.15.148:3300/0 conn(0x7fa5ac159c90 0x7fa5ac0c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 -- 172.21.15.7:0/516473871 >> 172.21.15.7:0/516473871 conn(0x7fa5ac088000 msgr2=0x7fa5ac0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 -- 172.21.15.7:0/516473871 shutdown_connections 2023-10-14T19:08:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.253+0000 7fa5b115e700 1 -- 172.21.15.7:0/516473871 wait complete. 2023-10-14T19:08:57.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.255+0000 7fa5b115e700 1 Processor -- start 2023-10-14T19:08:57.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.255+0000 7fa5b115e700 1 -- start start 2023-10-14T19:08:57.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.255+0000 7fa5b115e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0cd460 0x7fa5ac154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.255+0000 7fa5b115e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac16a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5b115e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5ac159c90 0x7fa5ac0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5b115e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b4100 con 0x7fa5ac1598c0 2023-10-14T19:08:57.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5b115e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b3b40 con 0x7fa5ac0cd460 2023-10-14T19:08:57.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5b115e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b3e20 con 0x7fa5ac159c90 2023-10-14T19:08:57.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac16a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac16a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42898/0 (socket says 172.21.15.7:42898) 2023-10-14T19:08:57.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 -- 172.21.15.7:0/2687867074 learned_addr learned my addr 172.21.15.7:0/2687867074 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:57.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aad9d700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0cd460 0x7fa5ac154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5ab59e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5ac159c90 0x7fa5ac0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 -- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5ac159c90 msgr2=0x7fa5ac0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5ac159c90 0x7fa5ac0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 -- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0cd460 msgr2=0x7fa5ac154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0cd460 0x7fa5ac154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 -- 172.21.15.7:0/2687867074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009420 con 0x7fa5ac1598c0 2023-10-14T19:08:57.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5ab59e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5ac159c90 0x7fa5ac0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:57.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5aa59c700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac16a870 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000d890 tx=0x7fa5a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00125f0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a0012750 con 0x7fa5ac1598c0 2023-10-14T19:08:57.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac0b1440 con 0x7fa5ac1598c0 2023-10-14T19:08:57.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0012ad0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.256+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac0ab800 con 0x7fa5ac1598c0 2023-10-14T19:08:57.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.257+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac0b17b0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.258+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa5a001e460 con 0x7fa5ac1598c0 2023-10-14T19:08:57.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.258+0000 7fa592ffd700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa598067200 0x7fa5980696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.258+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5a0084fa0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.258+0000 7fa5aad9d700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa598067200 0x7fa5980696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.259+0000 7fa5aad9d700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa598067200 0x7fa5980696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0091e0 tx=0x7fa59c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.262+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5a0051ec0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.453+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5ac0b12a0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.454+0000 7fa592ffd700 1 -- 172.21.15.7:0/2687867074 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ac0b12a0 con 0x7fa5ac1598c0 2023-10-14T19:08:57.455 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:08:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa598067200 msgr2=0x7fa5980696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa598067200 0x7fa5980696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0091e0 tx=0x7fa59c017000 comp rx=0 tx=0).stop 2023-10-14T19:08:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 msgr2=0x7fa5ac16a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac16a870 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000d890 tx=0x7fa5a0008040 comp rx=0 tx=0).stop 2023-10-14T19:08:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 shutdown_connections 2023-10-14T19:08:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa598067200 0x7fa5980696b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0cd460 0x7fa5ac154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5ac159c90 0x7fa5ac0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 --2- 172.21.15.7:0/2687867074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5ac1598c0 0x7fa5ac16a870 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 >> 172.21.15.7:0/2687867074 conn(0x7fa5ac088000 msgr2=0x7fa5ac1565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 shutdown_connections 2023-10-14T19:08:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.456+0000 7fa5b115e700 1 -- 172.21.15.7:0/2687867074 wait complete. 2023-10-14T19:08:57.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:08:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.590+0000 7f0f9547f700 1 Processor -- start 2023-10-14T19:08:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.590+0000 7f0f9547f700 1 -- start start 2023-10-14T19:08:57.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f9547f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f900ca100 0x7f0f900a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f9547f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f900a9e30 0x7f0f9006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f9547f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9006c6a0 con 0x7f0f900c9d30 2023-10-14T19:08:57.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f9547f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9006cc60 con 0x7f0f900a9e30 2023-10-14T19:08:57.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f9547f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9015dde0 con 0x7f0f900ca100 2023-10-14T19:08:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f900a9e30 0x7f0f9006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0f900c9d30 0x7f0f9015d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40156/0 (socket says 172.21.15.7:40156) 2023-10-14T19:08:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8effd700 1 -- 172.21.15.7:0/1762108150 learned_addr learned my addr 172.21.15.7:0/1762108150 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8e7fc700 1 --2- 172.21.15.7:0/1762108150 >> v2:172.21.15.148:3300/0 conn(0x7f0f900ca100 0x7f0f900a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8f7fe700 1 -- 172.21.15.7:0/1762108150 >> v2:172.21.15.148:3300/0 conn(0x7f0f900ca100 msgr2=0x7f0f900a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8f7fe700 1 --2- 172.21.15.7:0/1762108150 >> v2:172.21.15.148:3300/0 conn(0x7f0f900ca100 0x7f0f900a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8f7fe700 1 -- 172.21.15.7:0/1762108150 >> v1:172.21.15.7:6789/0 conn(0x7f0f900c9d30 legacy=0x7f0f9015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8f7fe700 1 -- 172.21.15.7:0/1762108150 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9015e0c0 con 0x7f0f900a9e30 2023-10-14T19:08:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.591+0000 7f0f8dffb700 1 -- 172.21.15.7:0/1762108150 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870862850 0 0) 0x7f0f9006c6a0 con 0x7f0f900c9d30 2023-10-14T19:08:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f8f7fe700 1 --2- 172.21.15.7:0/1762108150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900a9e30 0x7f0f9006d0f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0f90068240 tx=0x7f0f88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d8db383cde567b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f8dffb700 1 -- 172.21.15.7:0/1762108150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800e070 con 0x7f0f900a9e30 2023-10-14T19:08:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f8dffb700 1 -- 172.21.15.7:0/1762108150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8800bc30 con 0x7f0f900a9e30 2023-10-14T19:08:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f8dffb700 1 -- 172.21.15.7:0/1762108150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88012430 con 0x7f0f900a9e30 2023-10-14T19:08:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 -- 172.21.15.7:0/1762108150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900a9e30 msgr2=0x7f0f9006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 --2- 172.21.15.7:0/1762108150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900a9e30 0x7f0f9006d0f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0f90068240 tx=0x7f0f88009780 comp rx=0 tx=0).stop 2023-10-14T19:08:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 -- 172.21.15.7:0/1762108150 shutdown_connections 2023-10-14T19:08:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 --2- 172.21.15.7:0/1762108150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900a9e30 0x7f0f9006d0f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 --2- 172.21.15.7:0/1762108150 >> v2:172.21.15.148:3300/0 conn(0x7f0f900ca100 0x7f0f900a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 -- 172.21.15.7:0/1762108150 >> 172.21.15.7:0/1762108150 conn(0x7f0f900675a0 msgr2=0x7f0f900679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 -- 172.21.15.7:0/1762108150 shutdown_connections 2023-10-14T19:08:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.592+0000 7f0f9547f700 1 -- 172.21.15.7:0/1762108150 wait complete. 2023-10-14T19:08:57.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 Processor -- start 2023-10-14T19:08:57.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 -- start start 2023-10-14T19:08:57.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f900a9e30 0x7f0f900cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 0x7f0f900c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f900ca100 0x7f0f901586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c34a0 con 0x7f0f900c9d30 2023-10-14T19:08:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900cb510 con 0x7f0f900ca100 2023-10-14T19:08:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.594+0000 7f0f9547f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c36b0 con 0x7f0f900a9e30 2023-10-14T19:08:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 0x7f0f900c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 0x7f0f900c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42924/0 (socket says 172.21.15.7:42924) 2023-10-14T19:08:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 -- 172.21.15.7:0/4009761547 learned_addr learned my addr 172.21.15.7:0/4009761547 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8effd700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f900a9e30 0x7f0f900cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8f7fe700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f900ca100 0x7f0f901586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 -- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f900a9e30 msgr2=0x7f0f900cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f900a9e30 0x7f0f900cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 -- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f900ca100 msgr2=0x7f0f901586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f900ca100 0x7f0f901586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 -- 172.21.15.7:0/4009761547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88009a20 con 0x7f0f900c9d30 2023-10-14T19:08:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8f7fe700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f900ca100 0x7f0f901586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f8e7fc700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 0x7f0f900c2f60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000d860 tx=0x7f0f80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80009610 con 0x7f0f900c9d30 2023-10-14T19:08:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80009770 con 0x7f0f900c9d30 2023-10-14T19:08:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f900c3990 con 0x7f0f900c9d30 2023-10-14T19:08:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80009b30 con 0x7f0f900c9d30 2023-10-14T19:08:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.595+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f900c3f50 con 0x7f0f900c9d30 2023-10-14T19:08:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.596+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9004c3c0 con 0x7f0f900c9d30 2023-10-14T19:08:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.597+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0f8001e460 con 0x7f0f900c9d30 2023-10-14T19:08:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.597+0000 7f0f86ffd700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f70067200 0x7f0f700696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.597+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f80085070 con 0x7f0f900c9d30 2023-10-14T19:08:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.597+0000 7f0f8effd700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f70067200 0x7f0f700696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.598+0000 7f0f8effd700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f70067200 0x7f0f700696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f780011e0 tx=0x7f0f78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.601+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f80051f90 con 0x7f0f900c9d30 2023-10-14T19:08:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.793+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f900ca9e0 con 0x7f0f900c9d30 2023-10-14T19:08:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.793+0000 7f0f86ffd700 1 -- 172.21.15.7:0/4009761547 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f800555b0 con 0x7f0f900c9d30 2023-10-14T19:08:57.794 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:08:57.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f70067200 msgr2=0x7f0f700696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f70067200 0x7f0f700696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f780011e0 tx=0x7f0f78009040 comp rx=0 tx=0).stop 2023-10-14T19:08:57.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 msgr2=0x7f0f900c2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 0x7f0f900c2f60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000d860 tx=0x7f0f80008040 comp rx=0 tx=0).stop 2023-10-14T19:08:57.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 shutdown_connections 2023-10-14T19:08:57.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0f70067200 0x7f0f700696b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f900ca100 0x7f0f901586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0f900a9e30 0x7f0f900cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 --2- 172.21.15.7:0/4009761547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f900c9d30 0x7f0f900c2f60 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.795+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 >> 172.21.15.7:0/4009761547 conn(0x7f0f900675a0 msgr2=0x7f0f900b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:57.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.796+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 shutdown_connections 2023-10-14T19:08:57.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.796+0000 7f0f9547f700 1 -- 172.21.15.7:0/4009761547 wait complete. 2023-10-14T19:08:57.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:08:57.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.931+0000 7fb5fd66a700 1 Processor -- start 2023-10-14T19:08:57.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.931+0000 7fb5fd66a700 1 -- start start 2023-10-14T19:08:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.931+0000 7fb5fd66a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5f81576d0 0x7fb5f80ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.931+0000 7fb5fd66a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80cc060 con 0x7fb5f80aead0 2023-10-14T19:08:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.931+0000 7fb5fd66a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80cb450 con 0x7fb5f80b1be0 2023-10-14T19:08:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.931+0000 7fb5fd66a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80cb730 con 0x7fb5f81576d0 2023-10-14T19:08:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5f81576d0 0x7fb5f80ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f67fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb5f80aead0 0x7fb5f80b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40166/0 (socket says 172.21.15.7:40166) 2023-10-14T19:08:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f67fc700 1 -- 172.21.15.7:0/3514389746 learned_addr learned my addr 172.21.15.7:0/3514389746 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f6ffd700 1 -- 172.21.15.7:0/3514389746 >> v1:172.21.15.148:6789/0 conn(0x7fb5f80b1be0 legacy=0x7fb5f8161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f6ffd700 1 -- 172.21.15.7:0/3514389746 >> v1:172.21.15.7:6789/0 conn(0x7fb5f80aead0 legacy=0x7fb5f80b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f6ffd700 1 -- 172.21.15.7:0/3514389746 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80cba10 con 0x7fb5f81576d0 2023-10-14T19:08:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f6ffd700 1 --2- 172.21.15.7:0/3514389746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f81576d0 0x7fb5f80ae590 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009e60 tx=0x7fb5e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1980fe2a640438 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f5ffb700 1 -- 172.21.15.7:0/3514389746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800e070 con 0x7fb5f81576d0 2023-10-14T19:08:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f5ffb700 1 -- 172.21.15.7:0/3514389746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800bbf0 con 0x7fb5f81576d0 2023-10-14T19:08:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.932+0000 7fb5f5ffb700 1 -- 172.21.15.7:0/3514389746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8012430 con 0x7fb5f81576d0 2023-10-14T19:08:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 -- 172.21.15.7:0/3514389746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f81576d0 msgr2=0x7fb5f80ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/3514389746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f81576d0 0x7fb5f80ae590 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009e60 tx=0x7fb5e8009780 comp rx=0 tx=0).stop 2023-10-14T19:08:57.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 -- 172.21.15.7:0/3514389746 shutdown_connections 2023-10-14T19:08:57.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/3514389746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f81576d0 0x7fb5f80ae590 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 -- 172.21.15.7:0/3514389746 >> 172.21.15.7:0/3514389746 conn(0x7fb5f806d170 msgr2=0x7fb5f80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:57.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 -- 172.21.15.7:0/3514389746 shutdown_connections 2023-10-14T19:08:57.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.933+0000 7fb5fd66a700 1 -- 172.21.15.7:0/3514389746 wait complete. 2023-10-14T19:08:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.934+0000 7fb5fd66a700 1 Processor -- start 2023-10-14T19:08:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.934+0000 7fb5fd66a700 1 -- start start 2023-10-14T19:08:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5f80aead0 0x7fb5f81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 0x7fb5f81558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f81576d0 0x7fb5f8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815aa90 con 0x7fb5f80b1be0 2023-10-14T19:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80a5690 con 0x7fb5f81576d0 2023-10-14T19:08:57.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815a1f0 con 0x7fb5f80aead0 2023-10-14T19:08:57.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 0x7fb5f81558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 0x7fb5f81558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42950/0 (socket says 172.21.15.7:42950) 2023-10-14T19:08:57.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 -- 172.21.15.7:0/120288583 learned_addr learned my addr 172.21.15.7:0/120288583 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:57.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f77fe700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f81576d0 0x7fb5f8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f6ffd700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5f80aead0 0x7fb5f81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 -- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5f80aead0 msgr2=0x7fb5f81598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5f80aead0 0x7fb5f81598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 -- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f81576d0 msgr2=0x7fb5f8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f81576d0 0x7fb5f8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 -- 172.21.15.7:0/120288583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8009a20 con 0x7fb5f80b1be0 2023-10-14T19:08:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5f67fc700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 0x7fb5f81558c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c7f0 tx=0x7fb5e0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0005b30 con 0x7fb5f80b1be0 2023-10-14T19:08:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0005cb0 con 0x7fb5f80b1be0 2023-10-14T19:08:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0004a80 con 0x7fb5f80b1be0 2023-10-14T19:08:57.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.935+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f815a4d0 con 0x7fb5f80b1be0 2023-10-14T19:08:57.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.936+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f8159e30 con 0x7fb5f80b1be0 2023-10-14T19:08:57.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.937+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80a5820 con 0x7fb5f80b1be0 2023-10-14T19:08:57.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.937+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb5e00070d0 con 0x7fb5f80b1be0 2023-10-14T19:08:57.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.937+0000 7fb5eeffd700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5d8067200 0x7fb5d80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:57.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.937+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5e0083bb0 con 0x7fb5f80b1be0 2023-10-14T19:08:57.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.938+0000 7fb5f6ffd700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5d8067200 0x7fb5d80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:57.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.938+0000 7fb5f6ffd700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5d8067200 0x7fb5d80696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80097c0 tx=0x7fb5e8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:57.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:57.942+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5e004b5a0 con 0x7fb5f80b1be0 2023-10-14T19:08:58.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.020+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb5e0050ea0 con 0x7fb5f80b1be0 2023-10-14T19:08:58.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.139+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5f804c3c0 con 0x7fb5f80b1be0 2023-10-14T19:08:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.140+0000 7fb5eeffd700 1 -- 172.21.15.7:0/120288583 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5e0050ad0 con 0x7fb5f80b1be0 2023-10-14T19:08:58.141 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:08:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5d8067200 msgr2=0x7fb5d80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5d8067200 0x7fb5d80696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80097c0 tx=0x7fb5e8018000 comp rx=0 tx=0).stop 2023-10-14T19:08:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 msgr2=0x7fb5f81558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 0x7fb5f81558c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c7f0 tx=0x7fb5e0007f70 comp rx=0 tx=0).stop 2023-10-14T19:08:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 shutdown_connections 2023-10-14T19:08:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5d8067200 0x7fb5d80696b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f81576d0 0x7fb5f8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5f80aead0 0x7fb5f81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 --2- 172.21.15.7:0/120288583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5f80b1be0 0x7fb5f81558c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 >> 172.21.15.7:0/120288583 conn(0x7fb5f806d170 msgr2=0x7fb5f80ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:58.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 shutdown_connections 2023-10-14T19:08:58.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.142+0000 7fb5fd66a700 1 -- 172.21.15.7:0/120288583 wait complete. 2023-10-14T19:08:58.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:58.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.273+0000 7f409b878700 1 Processor -- start 2023-10-14T19:08:58.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.274+0000 7f409b878700 1 -- start start 2023-10-14T19:08:58.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.274+0000 7f409b878700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f40940cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.274+0000 7f409b878700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940aeee0 con 0x7f40940a90d0 2023-10-14T19:08:58.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.274+0000 7f409b878700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940cf490 con 0x7f409406e550 2023-10-14T19:08:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.274+0000 7f409b878700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940ae680 con 0x7f40940a8d00 2023-10-14T19:08:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.274+0000 7f4098e13700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f40940a90d0 0x7f409406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40178/0 (socket says 172.21.15.7:40178) 2023-10-14T19:08:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4098e13700 1 -- 172.21.15.7:0/2288230426 learned_addr learned my addr 172.21.15.7:0/2288230426 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4099614700 1 --2- 172.21.15.7:0/2288230426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f40940cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459535396 0 0) 0x7f40940aeee0 con 0x7f40940a90d0 2023-10-14T19:08:58.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c003570 con 0x7f40940a90d0 2023-10-14T19:08:58.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294390267 0 0) 0x7f40940cf490 con 0x7f409406e550 2023-10-14T19:08:58.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40940aeee0 con 0x7f409406e550 2023-10-14T19:08:58.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4099614700 1 -- 172.21.15.7:0/2288230426 >> v1:172.21.15.148:6789/0 conn(0x7f409406e550 legacy=0x7f40940af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4099614700 1 -- 172.21.15.7:0/2288230426 >> v1:172.21.15.7:6789/0 conn(0x7f40940a90d0 legacy=0x7f409406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4099614700 1 -- 172.21.15.7:0/2288230426 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940ce330 con 0x7f40940a8d00 2023-10-14T19:08:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4099614700 1 --2- 172.21.15.7:0/2288230426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f40940cddf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f408c009900 tx=0x7f408c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67edc41a3615b05d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c005c10 con 0x7f40940a8d00 2023-10-14T19:08:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.275+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c005d70 con 0x7f40940a8d00 2023-10-14T19:08:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f4093fff700 1 -- 172.21.15.7:0/2288230426 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c006260 con 0x7f40940a8d00 2023-10-14T19:08:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 -- 172.21.15.7:0/2288230426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 msgr2=0x7f40940cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 --2- 172.21.15.7:0/2288230426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f40940cddf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f408c009900 tx=0x7f408c009120 comp rx=0 tx=0).stop 2023-10-14T19:08:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 -- 172.21.15.7:0/2288230426 shutdown_connections 2023-10-14T19:08:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 --2- 172.21.15.7:0/2288230426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f40940cddf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 -- 172.21.15.7:0/2288230426 >> 172.21.15.7:0/2288230426 conn(0x7f409406ce80 msgr2=0x7f40940ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 -- 172.21.15.7:0/2288230426 shutdown_connections 2023-10-14T19:08:58.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.276+0000 7f409b878700 1 -- 172.21.15.7:0/2288230426 wait complete. 2023-10-14T19:08:58.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.277+0000 7f409b878700 1 Processor -- start 2023-10-14T19:08:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.277+0000 7f409b878700 1 -- start start 2023-10-14T19:08:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f409b878700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 0x7f40940b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f409b878700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f409416a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f409b878700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40940a90d0 0x7f4094159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f409b878700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409416aa20 con 0x7f409406e550 2023-10-14T19:08:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f409b878700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940b24b0 con 0x7f40940a90d0 2023-10-14T19:08:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f409b878700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4094159670 con 0x7f40940a8d00 2023-10-14T19:08:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 0x7f40940b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 0x7f40940b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42962/0 (socket says 172.21.15.7:42962) 2023-10-14T19:08:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 -- 172.21.15.7:0/3783976797 learned_addr learned my addr 172.21.15.7:0/3783976797 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099e15700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40940a90d0 0x7f4094159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4098e13700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f409416a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 -- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 msgr2=0x7f409416a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f409416a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 -- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40940a90d0 msgr2=0x7f4094159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40940a90d0 0x7f4094159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.278+0000 7f4099614700 1 -- 172.21.15.7:0/3783976797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0093c0 con 0x7f409406e550 2023-10-14T19:08:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.279+0000 7f4099614700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 0x7f40940b12c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f408c009390 tx=0x7f408c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.279+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c01d8f0 con 0x7f409406e550 2023-10-14T19:08:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.279+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c01da50 con 0x7f409406e550 2023-10-14T19:08:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.279+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40940b18a0 con 0x7f409406e550 2023-10-14T19:08:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.279+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c01de10 con 0x7f409406e550 2023-10-14T19:08:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.279+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940b1e60 con 0x7f409406e550 2023-10-14T19:08:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.280+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409404c3c0 con 0x7f409406e550 2023-10-14T19:08:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.280+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f408c01b690 con 0x7f409406e550 2023-10-14T19:08:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.281+0000 7f40917fa700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4080067290 0x7f4080069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.281+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f408c0867f0 con 0x7f409406e550 2023-10-14T19:08:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.281+0000 7f4098e13700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4080067290 0x7f4080069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.281+0000 7f4098e13700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4080067290 0x7f4080069740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4088007fd0 tx=0x7f4088009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.285+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f408c053650 con 0x7f409406e550 2023-10-14T19:08:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.519+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4094067b20 con 0x7f409406e550 2023-10-14T19:08:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.520+0000 7f40917fa700 1 -- 172.21.15.7:0/3783976797 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f408c02a020 con 0x7f409406e550 2023-10-14T19:08:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:58.521 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:45.357460+0000","modified":"2023-10-14T19:08:48.985870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6408":{"gid":6408,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/2588094250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2588094250},{"type":"v1","addr":"172.21.15.7:6835","nonce":2588094250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T19:08:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4080067290 msgr2=0x7f4080069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4080067290 0x7f4080069740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4088007fd0 tx=0x7f4088009040 comp rx=0 tx=0).stop 2023-10-14T19:08:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 msgr2=0x7f40940b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 0x7f40940b12c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f408c009390 tx=0x7f408c016000 comp rx=0 tx=0).stop 2023-10-14T19:08:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 shutdown_connections 2023-10-14T19:08:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4080067290 0x7f4080069740 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40940a90d0 0x7f4094159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f409406e550 0x7f40940b12c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 --2- 172.21.15.7:0/3783976797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40940a8d00 0x7f409416a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 >> 172.21.15.7:0/3783976797 conn(0x7f409406ce80 msgr2=0x7f409415eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:58.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 shutdown_connections 2023-10-14T19:08:58.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.522+0000 7f409b878700 1 -- 172.21.15.7:0/3783976797 wait complete. 2023-10-14T19:08:58.527 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2023-10-14T19:08:58.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:58.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.654+0000 7f9321e94700 1 Processor -- start 2023-10-14T19:08:58.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.654+0000 7f9321e94700 1 -- start start 2023-10-14T19:08:58.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321e94700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f931c0b2940 0x7f931c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321e94700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f931c0cd9d0 0x7f931c06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321e94700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931c0b0110 con 0x7f931c0b2d10 2023-10-14T19:08:58.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321e94700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c0b0920 con 0x7f931c0b2940 2023-10-14T19:08:58.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321e94700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c06cc70 con 0x7f931c0cd9d0 2023-10-14T19:08:58.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9320e92700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f931c0b2940 0x7f931c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321693700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f931c0b2d10 0x7f931c159250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40188/0 (socket says 172.21.15.7:40188) 2023-10-14T19:08:58.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9321693700 1 -- 172.21.15.7:0/2636161409 learned_addr learned my addr 172.21.15.7:0/2636161409 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:58.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f931bfff700 1 --2- 172.21.15.7:0/2636161409 >> v2:172.21.15.148:3300/0 conn(0x7f931c0cd9d0 0x7f931c06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9320e92700 1 -- 172.21.15.7:0/2636161409 >> v2:172.21.15.148:3300/0 conn(0x7f931c0cd9d0 msgr2=0x7f931c06e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9320e92700 1 --2- 172.21.15.7:0/2636161409 >> v2:172.21.15.148:3300/0 conn(0x7f931c0cd9d0 0x7f931c06e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9320e92700 1 -- 172.21.15.7:0/2636161409 >> v1:172.21.15.7:6789/0 conn(0x7f931c0b2d10 legacy=0x7f931c159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9320e92700 1 -- 172.21.15.7:0/2636161409 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0b0360 con 0x7f931c0b2940 2023-10-14T19:08:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f931bfff700 1 --2- 172.21.15.7:0/2636161409 >> v2:172.21.15.148:3300/0 conn(0x7f931c0cd9d0 0x7f931c06e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:08:58.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f931b7fe700 1 -- 172.21.15.7:0/2636161409 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478919024 0 0) 0x7f931c0b0110 con 0x7f931c0b2d10 2023-10-14T19:08:58.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.655+0000 7f9320e92700 1 --2- 172.21.15.7:0/2636161409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0b2940 0x7f931c0a98e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f931c0acd40 tx=0x7f9310009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9ef22199dcea1c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:58.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f931b7fe700 1 -- 172.21.15.7:0/2636161409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310005c10 con 0x7f931c0b2940 2023-10-14T19:08:58.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f931b7fe700 1 -- 172.21.15.7:0/2636161409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310005d70 con 0x7f931c0b2940 2023-10-14T19:08:58.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f931b7fe700 1 -- 172.21.15.7:0/2636161409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310006260 con 0x7f931c0b2940 2023-10-14T19:08:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 -- 172.21.15.7:0/2636161409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0b2940 msgr2=0x7f931c0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 --2- 172.21.15.7:0/2636161409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0b2940 0x7f931c0a98e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f931c0acd40 tx=0x7f9310009120 comp rx=0 tx=0).stop 2023-10-14T19:08:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 -- 172.21.15.7:0/2636161409 shutdown_connections 2023-10-14T19:08:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 --2- 172.21.15.7:0/2636161409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0b2940 0x7f931c0a98e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 --2- 172.21.15.7:0/2636161409 >> v2:172.21.15.148:3300/0 conn(0x7f931c0cd9d0 0x7f931c06e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 -- 172.21.15.7:0/2636161409 >> 172.21.15.7:0/2636161409 conn(0x7f931c0675a0 msgr2=0x7f931c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 -- 172.21.15.7:0/2636161409 shutdown_connections 2023-10-14T19:08:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.656+0000 7f9321e94700 1 -- 172.21.15.7:0/2636161409 wait complete. 2023-10-14T19:08:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.657+0000 7f9321e94700 1 Processor -- start 2023-10-14T19:08:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.657+0000 7f9321e94700 1 -- start start 2023-10-14T19:08:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321e94700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f931c0b2940 0x7f931c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321e94700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f931c0b2d10 0x7f931c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321e94700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 0x7f931c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321e94700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c152750 con 0x7f931c0cd9d0 2023-10-14T19:08:58.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321e94700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c159560 con 0x7f931c0b2d10 2023-10-14T19:08:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321e94700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c15ded0 con 0x7f931c0b2940 2023-10-14T19:08:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321693700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 0x7f931c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321693700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 0x7f931c0add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42986/0 (socket says 172.21.15.7:42986) 2023-10-14T19:08:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f9321693700 1 -- 172.21.15.7:0/1108789857 learned_addr learned my addr 172.21.15.7:0/1108789857 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.658+0000 7f931bfff700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f931c0b2d10 0x7f931c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321693700 1 -- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f931c0b2940 msgr2=0x7f931c151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321693700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f931c0b2940 0x7f931c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321693700 1 -- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f931c0b2d10 msgr2=0x7f931c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321693700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f931c0b2d10 0x7f931c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321693700 1 -- 172.21.15.7:0/1108789857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100093c0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f931bfff700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f931c0b2d10 0x7f931c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:58.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321693700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 0x7f931c0add40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f931400cc90 tx=0x7f9314001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:58.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400cea0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400ab70 con 0x7f931c0cd9d0 2023-10-14T19:08:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c0cca20 con 0x7f931c0cd9d0 2023-10-14T19:08:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93140070f0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.659+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c15e3d0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.660+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c15e5c0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.660+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f93140074a0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.661+0000 7f9318ff9700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f93000672c0 0x7f9300069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.661+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9314085020 con 0x7f931c0cd9d0 2023-10-14T19:08:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.661+0000 7f9320e92700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f93000672c0 0x7f9300069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.661+0000 7f9320e92700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f93000672c0 0x7f9300069770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9310009160 tx=0x7f9310016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.665+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9314051dc0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.859+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f931c0ccf20 con 0x7f931c0cd9d0 2023-10-14T19:08:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.860+0000 7f9318ff9700 1 -- 172.21.15.7:0/1108789857 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f93140553e0 con 0x7f931c0cd9d0 2023-10-14T19:08:58.861 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:58.861 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:46.969334+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:43.793528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:44.327457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f93000672c0 msgr2=0x7f9300069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f93000672c0 0x7f9300069770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9310009160 tx=0x7f9310016000 comp rx=0 tx=0).stop 2023-10-14T19:08:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 msgr2=0x7f931c0add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 0x7f931c0add40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f931400cc90 tx=0x7f9314001a80 comp rx=0 tx=0).stop 2023-10-14T19:08:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 shutdown_connections 2023-10-14T19:08:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f93000672c0 0x7f9300069770 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c0cd9d0 0x7f931c0add40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f931c0b2940 0x7f931c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 --2- 172.21.15.7:0/1108789857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f931c0b2d10 0x7f931c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 >> 172.21.15.7:0/1108789857 conn(0x7f931c0675a0 msgr2=0x7f931c0abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 shutdown_connections 2023-10-14T19:08:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.862+0000 7f9321e94700 1 -- 172.21.15.7:0/1108789857 wait complete. 2023-10-14T19:08:58.875 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:08:58.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:58.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.994+0000 7f35243e3700 1 Processor -- start 2023-10-14T19:08:58.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.994+0000 7f35243e3700 1 -- start start 2023-10-14T19:08:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f35243e3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f351c0cb5a0 0x7f351c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f35243e3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c0cd9e0 0x7f351c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f35243e3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c15ae40 con 0x7f351c0cde50 2023-10-14T19:08:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f35243e3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c0d13f0 con 0x7f351c0cb5a0 2023-10-14T19:08:58.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f35243e3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c15ab60 con 0x7f351c0cd9e0 2023-10-14T19:08:58.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f351c0cb5a0 0x7f351c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f351c0cb5a0 0x7f351c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42992/0 (socket says 172.21.15.7:42992) 2023-10-14T19:08:58.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 -- 172.21.15.7:0/900786205 learned_addr learned my addr 172.21.15.7:0/900786205 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:58.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352197e700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c0cd9e0 0x7f351c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:58.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 -- 172.21.15.7:0/900786205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c0cd9e0 msgr2=0x7f351c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:59.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c0cd9e0 0x7f351c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 -- 172.21.15.7:0/900786205 >> v1:172.21.15.148:6789/0 conn(0x7f351c0cde50 legacy=0x7f351c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:59.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352217f700 1 -- 172.21.15.7:0/900786205 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c0ccf00 con 0x7f351c0cb5a0 2023-10-14T19:08:59.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.995+0000 7f352197e700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c0cd9e0 0x7f351c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:59.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f352217f700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cb5a0 0x7f351c0cb970 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f35140099b0 tx=0x7f3514009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38aecd19d57c54f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f352117d700 1 -- 172.21.15.7:0/900786205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400b860 con 0x7f351c0cb5a0 2023-10-14T19:08:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f352117d700 1 -- 172.21.15.7:0/900786205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351400b9c0 con 0x7f351c0cb5a0 2023-10-14T19:08:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f352117d700 1 -- 172.21.15.7:0/900786205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400bd60 con 0x7f351c0cb5a0 2023-10-14T19:08:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 -- 172.21.15.7:0/900786205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cb5a0 msgr2=0x7f351c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cb5a0 0x7f351c0cb970 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f35140099b0 tx=0x7f3514009250 comp rx=0 tx=0).stop 2023-10-14T19:08:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 -- 172.21.15.7:0/900786205 shutdown_connections 2023-10-14T19:08:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cb5a0 0x7f351c0cb970 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 --2- 172.21.15.7:0/900786205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c0cd9e0 0x7f351c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 -- 172.21.15.7:0/900786205 >> 172.21.15.7:0/900786205 conn(0x7f351c070e30 msgr2=0x7f351c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 -- 172.21.15.7:0/900786205 shutdown_connections 2023-10-14T19:08:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.996+0000 7f35243e3700 1 -- 172.21.15.7:0/900786205 wait complete. 2023-10-14T19:08:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.997+0000 7f35243e3700 1 Processor -- start 2023-10-14T19:08:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 -- start start 2023-10-14T19:08:59.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c0cb5a0 0x7f351c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 0x7f351c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c15dac0 0x7f351c15df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c8930 con 0x7f351c0cd9e0 2023-10-14T19:08:59.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c8c10 con 0x7f351c0cb5a0 2023-10-14T19:08:59.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f35243e3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c8ef0 con 0x7f351c15dac0 2023-10-14T19:08:59.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f352197e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 0x7f351c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f352197e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 0x7f351c0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42994/0 (socket says 172.21.15.7:42994) 2023-10-14T19:08:59.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f352197e700 1 -- 172.21.15.7:0/314940529 learned_addr learned my addr 172.21.15.7:0/314940529 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:59.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f352217f700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c0cb5a0 0x7f351c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.998+0000 7f3522980700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c15dac0 0x7f351c15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f352197e700 1 -- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c15dac0 msgr2=0x7f351c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f352197e700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c15dac0 0x7f351c15df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f352197e700 1 -- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c0cb5a0 msgr2=0x7f351c155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f352197e700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c0cb5a0 0x7f351c155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f352197e700 1 -- 172.21.15.7:0/314940529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140094f0 con 0x7f351c0cd9e0 2023-10-14T19:08:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f352197e700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 0x7f351c0c99d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f351000c830 tx=0x7f3510008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011600 con 0x7f351c0cd9e0 2023-10-14T19:08:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510011760 con 0x7f351c0cd9e0 2023-10-14T19:08:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c0c91d0 con 0x7f351c0cd9e0 2023-10-14T19:08:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011b20 con 0x7f351c0cd9e0 2023-10-14T19:08:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:58.999+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c1562d0 con 0x7f351c0cd9e0 2023-10-14T19:08:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.000+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c0c96d0 con 0x7f351c0cd9e0 2023-10-14T19:08:59.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.000+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3510018360 con 0x7f351c0cd9e0 2023-10-14T19:08:59.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.001+0000 7f351a7fc700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3508067290 0x7f3508069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.001+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3510084b10 con 0x7f351c0cd9e0 2023-10-14T19:08:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.001+0000 7f352217f700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3508067290 0x7f3508069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.002+0000 7f352217f700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3508067290 0x7f3508069740 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f35140099b0 tx=0x7f3514017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.005+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3510051860 con 0x7f351c0cd9e0 2023-10-14T19:08:59.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.241+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f351c04c3c0 con 0x7f351c0cd9e0 2023-10-14T19:08:59.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.242+0000 7f351a7fc700 1 -- 172.21.15.7:0/314940529 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3510015090 con 0x7f351c0cd9e0 2023-10-14T19:08:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:59.243 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:45.357460+0000","modified":"2023-10-14T19:08:48.985870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6408":{"gid":6408,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/2588094250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2588094250},{"type":"v1","addr":"172.21.15.7:6835","nonce":2588094250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T19:08:59.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.243+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3508067290 msgr2=0x7f3508069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.243+0000 7f35243e3700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3508067290 0x7f3508069740 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f35140099b0 tx=0x7f3514017000 comp rx=0 tx=0).stop 2023-10-14T19:08:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.243+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 msgr2=0x7f351c0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.243+0000 7f35243e3700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 0x7f351c0c99d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f351000c830 tx=0x7f3510008040 comp rx=0 tx=0).stop 2023-10-14T19:08:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 shutdown_connections 2023-10-14T19:08:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3508067290 0x7f3508069740 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c0cb5a0 0x7f351c155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f351c15dac0 0x7f351c15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 --2- 172.21.15.7:0/314940529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f351c0cd9e0 0x7f351c0c99d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 >> 172.21.15.7:0/314940529 conn(0x7f351c070e30 msgr2=0x7f351c0b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 shutdown_connections 2023-10-14T19:08:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.244+0000 7f35243e3700 1 -- 172.21.15.7:0/314940529 wait complete. 2023-10-14T19:08:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2023-10-14T19:08:59.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:08:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.374+0000 7f41bd660700 1 Processor -- start 2023-10-14T19:08:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.374+0000 7f41bd660700 1 -- start start 2023-10-14T19:08:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41bd660700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 0x7f41b80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41bd660700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41bd660700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b80ce9d0 con 0x7f41b81598b0 2023-10-14T19:08:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41bd660700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80af960 con 0x7f41b8159c80 2023-10-14T19:08:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41bd660700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80afc30 con 0x7f41b80cfe70 2023-10-14T19:08:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41b77fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41b67fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 0x7f41b80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41b6ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f41b81598b0 0x7f41b80af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:51756/0 (socket says 172.21.15.7:51756) 2023-10-14T19:08:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41b77fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:55360/0 (socket says 172.21.15.7:55360) 2023-10-14T19:08:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41b67fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 0x7f41b80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:60940/0 (socket says 172.21.15.7:60940) 2023-10-14T19:08:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.375+0000 7f41b6ffd700 1 -- 172.21.15.7:0/3246553513 learned_addr learned my addr 172.21.15.7:0/3246553513 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:08:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b77fe700 1 -- 172.21.15.7:0/3246553513 >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 msgr2=0x7f41b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b77fe700 1 --2- 172.21.15.7:0/3246553513 >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 0x7f41b80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b77fe700 1 -- 172.21.15.7:0/3246553513 >> v1:172.21.15.148:6789/0 conn(0x7f41b81598b0 legacy=0x7f41b80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b5ffb700 1 -- 172.21.15.7:0/3246553513 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474849274 0 0) 0x7f41b80ce9d0 con 0x7f41b81598b0 2023-10-14T19:08:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b77fe700 1 -- 172.21.15.7:0/3246553513 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80aff10 con 0x7f41b80cfe70 2023-10-14T19:08:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b67fc700 1 --2- 172.21.15.7:0/3246553513 >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 0x7f41b80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:08:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b77fe700 1 --2- 172.21.15.7:0/3246553513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80cbc30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009e60 tx=0x7f41a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=544e7b1107aaa2fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b5ffb700 1 -- 172.21.15.7:0/3246553513 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800e070 con 0x7f41b80cfe70 2023-10-14T19:08:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b5ffb700 1 -- 172.21.15.7:0/3246553513 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a800bb60 con 0x7f41b80cfe70 2023-10-14T19:08:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.376+0000 7f41b5ffb700 1 -- 172.21.15.7:0/3246553513 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8012430 con 0x7f41b80cfe70 2023-10-14T19:08:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 -- 172.21.15.7:0/3246553513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 msgr2=0x7f41b80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 --2- 172.21.15.7:0/3246553513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80cbc30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009e60 tx=0x7f41a8009780 comp rx=0 tx=0).stop 2023-10-14T19:08:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 -- 172.21.15.7:0/3246553513 shutdown_connections 2023-10-14T19:08:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 --2- 172.21.15.7:0/3246553513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80cbc30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 --2- 172.21.15.7:0/3246553513 >> v2:172.21.15.148:3300/0 conn(0x7f41b8159c80 0x7f41b80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 -- 172.21.15.7:0/3246553513 >> 172.21.15.7:0/3246553513 conn(0x7f41b8070e30 msgr2=0x7f41b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:59.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 -- 172.21.15.7:0/3246553513 shutdown_connections 2023-10-14T19:08:59.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.377+0000 7f41bd660700 1 -- 172.21.15.7:0/3246553513 wait complete. 2023-10-14T19:08:59.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.378+0000 7f41bd660700 1 Processor -- start 2023-10-14T19:08:59.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.378+0000 7f41bd660700 1 -- start start 2023-10-14T19:08:59.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41bd660700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41bd660700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b81598b0 0x7f41b815b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41bd660700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 0x7f41b8149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41bd660700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b815ab20 con 0x7f41b8159c80 2023-10-14T19:08:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41bd660700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b815a1f0 con 0x7f41b81598b0 2023-10-14T19:08:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41bd660700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b815a4d0 con 0x7f41b80cfe70 2023-10-14T19:08:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 0x7f41b8149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 0x7f41b8149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43008/0 (socket says 172.21.15.7:43008) 2023-10-14T19:08:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 -- 172.21.15.7:0/2033594063 learned_addr learned my addr 172.21.15.7:0/2033594063 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b6ffd700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b67fc700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b81598b0 0x7f41b815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 -- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 msgr2=0x7f41b80ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 -- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b81598b0 msgr2=0x7f41b815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b81598b0 0x7f41b815b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b77fe700 1 -- 172.21.15.7:0/2033594063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0009420 con 0x7f41b8159c80 2023-10-14T19:08:59.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b6ffd700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.379+0000 7f41b67fc700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b81598b0 0x7f41b815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:08:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.380+0000 7f41b77fe700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 0x7f41b8149030 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f41a8013000 tx=0x7f41a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.380+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8027470 con 0x7f41b8159c80 2023-10-14T19:08:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.380+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a8027610 con 0x7f41b8159c80 2023-10-14T19:08:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.380+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a8009a20 con 0x7f41b8159c80 2023-10-14T19:08:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.380+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a80279d0 con 0x7f41b8159c80 2023-10-14T19:08:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.380+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b815bb50 con 0x7f41b8159c80 2023-10-14T19:08:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.381+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b815acd0 con 0x7f41b8159c80 2023-10-14T19:08:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.381+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f41a8024070 con 0x7f41b8159c80 2023-10-14T19:08:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.382+0000 7f41aeffd700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4198067290 0x7f4198069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.382+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41a80874c0 con 0x7f41b8159c80 2023-10-14T19:08:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.382+0000 7f41b6ffd700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4198067290 0x7f4198069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.383+0000 7f41b6ffd700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4198067290 0x7f4198069740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f41b00018d0 tx=0x7f41b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.386+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41b815acd0 con 0x7f41b8159c80 2023-10-14T19:08:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.626+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41b804c3c0 con 0x7f41b8159c80 2023-10-14T19:08:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.626+0000 7f41aeffd700 1 -- 172.21.15.7:0/2033594063 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f41a8054320 con 0x7f41b8159c80 2023-10-14T19:08:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:59.630 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:08:45.357460+0000","modified":"2023-10-14T19:08:48.985870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6408":{"gid":6408,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/2588094250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2588094250},{"type":"v1","addr":"172.21.15.7:6835","nonce":2588094250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T19:08:59.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4198067290 msgr2=0x7f4198069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4198067290 0x7f4198069740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f41b00018d0 tx=0x7f41b0009040 comp rx=0 tx=0).stop 2023-10-14T19:08:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 msgr2=0x7f41b8149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 0x7f41b8149030 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f41a8013000 tx=0x7f41a8019000 comp rx=0 tx=0).stop 2023-10-14T19:08:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 shutdown_connections 2023-10-14T19:08:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4198067290 0x7f4198069740 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b8159c80 0x7f41b8149030 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41b80cfe70 0x7f41b80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 --2- 172.21.15.7:0/2033594063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b81598b0 0x7f41b815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 >> 172.21.15.7:0/2033594063 conn(0x7f41b8070e30 msgr2=0x7f41b80cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:59.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 shutdown_connections 2023-10-14T19:08:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.629+0000 7f41bd660700 1 -- 172.21.15.7:0/2033594063 wait complete. 2023-10-14T19:08:59.634 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2023-10-14T19:08:59.642 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:08:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.760+0000 7f488de7d700 1 Processor -- start 2023-10-14T19:08:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.760+0000 7f488de7d700 1 -- start start 2023-10-14T19:08:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f488de7d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f48880af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f488de7d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4888159c80 0x7f48880cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f488de7d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48880af790 0x7f48880cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f488de7d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48880ce9d0 con 0x7f4888159c80 2023-10-14T19:08:59.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f488de7d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48880afc30 con 0x7f48880af790 2023-10-14T19:08:59.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f488de7d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48880aff10 con 0x7f48881598b0 2023-10-14T19:08:59.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f4886ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4888159c80 0x7f48880cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f4886ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4888159c80 0x7f48880cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43022/0 (socket says 172.21.15.7:43022) 2023-10-14T19:08:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.761+0000 7f4886ffd700 1 -- 172.21.15.7:0/2775826323 learned_addr learned my addr 172.21.15.7:0/2775826323 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f4886ffd700 1 -- 172.21.15.7:0/2775826323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 msgr2=0x7f48880af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f4886ffd700 1 --2- 172.21.15.7:0/2775826323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f48880af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f4886ffd700 1 -- 172.21.15.7:0/2775826323 >> v2:172.21.15.148:3300/0 conn(0x7f48880af790 msgr2=0x7f48880cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:08:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f4886ffd700 1 --2- 172.21.15.7:0/2775826323 >> v2:172.21.15.148:3300/0 conn(0x7f48880af790 0x7f48880cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f4886ffd700 1 -- 172.21.15.7:0/2775826323 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880ce380 con 0x7f4888159c80 2023-10-14T19:08:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f4886ffd700 1 --2- 172.21.15.7:0/2775826323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880cb6f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f488806ed80 tx=0x7f487c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d6c6f559e57871 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f48867fc700 1 -- 172.21.15.7:0/2775826323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00b860 con 0x7f4888159c80 2023-10-14T19:08:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f48867fc700 1 -- 172.21.15.7:0/2775826323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c00b9c0 con 0x7f4888159c80 2023-10-14T19:08:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f48867fc700 1 -- 172.21.15.7:0/2775826323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00bd60 con 0x7f4888159c80 2023-10-14T19:08:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 -- 172.21.15.7:0/2775826323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 msgr2=0x7f48880cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 --2- 172.21.15.7:0/2775826323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880cb6f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f488806ed80 tx=0x7f487c009250 comp rx=0 tx=0).stop 2023-10-14T19:08:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 -- 172.21.15.7:0/2775826323 shutdown_connections 2023-10-14T19:08:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 --2- 172.21.15.7:0/2775826323 >> v2:172.21.15.148:3300/0 conn(0x7f48880af790 0x7f48880cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 --2- 172.21.15.7:0/2775826323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f48880af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 --2- 172.21.15.7:0/2775826323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880cb6f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.762+0000 7f488de7d700 1 -- 172.21.15.7:0/2775826323 >> 172.21.15.7:0/2775826323 conn(0x7f4888070e30 msgr2=0x7f48880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.763+0000 7f488de7d700 1 -- 172.21.15.7:0/2775826323 shutdown_connections 2023-10-14T19:08:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.763+0000 7f488de7d700 1 -- 172.21.15.7:0/2775826323 wait complete. 2023-10-14T19:08:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 Processor -- start 2023-10-14T19:08:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 -- start start 2023-10-14T19:08:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48880af790 0x7f488814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f4888151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4888159150 con 0x7f4888159c80 2023-10-14T19:08:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488814fd40 con 0x7f48880af790 2023-10-14T19:08:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.764+0000 7f488de7d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488814b820 con 0x7f48881598b0 2023-10-14T19:08:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43032/0 (socket says 172.21.15.7:43032) 2023-10-14T19:08:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 -- 172.21.15.7:0/3370249812 learned_addr learned my addr 172.21.15.7:0/3370249812 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:08:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f48877fe700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48880af790 0x7f488814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4886ffd700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f4888151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 -- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 msgr2=0x7f4888151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f4888151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 -- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48880af790 msgr2=0x7f488814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48880af790 0x7f488814b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 -- 172.21.15.7:0/3370249812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0094f0 con 0x7f4888159c80 2023-10-14T19:08:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f4887fff700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880b5b50 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f488000bb30 tx=0x7f48800097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000c860 con 0x7f4888159c80 2023-10-14T19:08:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000c9c0 con 0x7f4888159c80 2023-10-14T19:08:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488814ffa0 con 0x7f4888159c80 2023-10-14T19:08:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000cd80 con 0x7f4888159c80 2023-10-14T19:08:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.765+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4888150560 con 0x7f4888159c80 2023-10-14T19:08:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.766+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488804c3c0 con 0x7f4888159c80 2023-10-14T19:08:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.767+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4880014620 con 0x7f4888159c80 2023-10-14T19:08:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.767+0000 7f486f7fe700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4874067290 0x7f4874069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:08:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.767+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4880084970 con 0x7f4888159c80 2023-10-14T19:08:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.767+0000 7f48877fe700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4874067290 0x7f4874069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:08:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.768+0000 7f48877fe700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4874067290 0x7f4874069740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4878009b70 tx=0x7f4878009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:08:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.771+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4880051890 con 0x7f4888159c80 2023-10-14T19:08:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.966+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48880ce660 con 0x7f4888159c80 2023-10-14T19:08:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.967+0000 7f486f7fe700 1 -- 172.21.15.7:0/3370249812 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f4880054eb0 con 0x7f4888159c80 2023-10-14T19:08:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:08:59.968 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:08:46.969334+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:08:43.793528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T19:08:44.327457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:08:59.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4874067290 msgr2=0x7f4874069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4874067290 0x7f4874069740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4878009b70 tx=0x7f4878009120 comp rx=0 tx=0).stop 2023-10-14T19:08:59.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 msgr2=0x7f48880b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:08:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880b5b50 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f488000bb30 tx=0x7f48800097e0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 shutdown_connections 2023-10-14T19:08:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4874067290 0x7f4874069740 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48880af790 0x7f488814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4888159c80 0x7f48880b5b50 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 --2- 172.21.15.7:0/3370249812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48881598b0 0x7f4888151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:08:59.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 >> 172.21.15.7:0/3370249812 conn(0x7f4888070e30 msgr2=0x7f488814e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:08:59.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 shutdown_connections 2023-10-14T19:08:59.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:08:59.970+0000 7f488de7d700 1 -- 172.21.15.7:0/3370249812 wait complete. 2023-10-14T19:08:59.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:09:00.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.106+0000 7f14b80f4700 1 Processor -- start 2023-10-14T19:09:00.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.106+0000 7f14b80f4700 1 -- start start 2023-10-14T19:09:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b80f4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f14b00cb5a0 0x7f14b00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b80f4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b015a5d0 0x7f14b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b80f4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b015ae40 con 0x7f14b00cd9e0 2023-10-14T19:09:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b80f4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b00d13f0 con 0x7f14b00cb5a0 2023-10-14T19:09:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b80f4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015ab60 con 0x7f14b015a5d0 2023-10-14T19:09:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b568f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14b00cd9e0 0x7f14b0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40198/0 (socket says 172.21.15.7:40198) 2023-10-14T19:09:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b568f700 1 -- 172.21.15.7:0/1769330428 learned_addr learned my addr 172.21.15.7:0/1769330428 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b6691700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b015a5d0 0x7f14b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1769330428 >> v2:172.21.15.148:3300/0 conn(0x7f14b00cb5a0 0x7f14b00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b4e8e700 1 -- 172.21.15.7:0/1769330428 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511474963 0 0) 0x7f14b015ae40 con 0x7f14b00cd9e0 2023-10-14T19:09:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b4e8e700 1 -- 172.21.15.7:0/1769330428 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498003570 con 0x7f14b00cd9e0 2023-10-14T19:09:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b5e90700 1 -- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b015a5d0 msgr2=0x7f14b0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b015a5d0 0x7f14b0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b5e90700 1 -- 172.21.15.7:0/1769330428 >> v1:172.21.15.7:6789/0 conn(0x7f14b00cd9e0 legacy=0x7f14b0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b4e8e700 1 -- 172.21.15.7:0/1769330428 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4087393373 0 0) 0x7f1498003570 con 0x7f14b00cd9e0 2023-10-14T19:09:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b5e90700 1 -- 172.21.15.7:0/1769330428 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00ccf00 con 0x7f14b00cb5a0 2023-10-14T19:09:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b6691700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b015a5d0 0x7f14b0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.107+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cb5a0 0x7f14b00cb970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009910 tx=0x7f14a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3dd420416c0182 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b4e8e700 1 -- 172.21.15.7:0/1769330428 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4001470 con 0x7f14b00cb5a0 2023-10-14T19:09:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b4e8e700 1 -- 172.21.15.7:0/1769330428 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a8011420 con 0x7f14b00cb5a0 2023-10-14T19:09:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b4e8e700 1 -- 172.21.15.7:0/1769330428 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80117c0 con 0x7f14b00cb5a0 2023-10-14T19:09:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 -- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cb5a0 msgr2=0x7f14b00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cb5a0 0x7f14b00cb970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009910 tx=0x7f14a80091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 -- 172.21.15.7:0/1769330428 shutdown_connections 2023-10-14T19:09:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cb5a0 0x7f14b00cb970 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1769330428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b015a5d0 0x7f14b0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 -- 172.21.15.7:0/1769330428 >> 172.21.15.7:0/1769330428 conn(0x7f14b0070e30 msgr2=0x7f14b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 -- 172.21.15.7:0/1769330428 shutdown_connections 2023-10-14T19:09:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.108+0000 7f14b80f4700 1 -- 172.21.15.7:0/1769330428 wait complete. 2023-10-14T19:09:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.109+0000 7f14b80f4700 1 Processor -- start 2023-10-14T19:09:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.109+0000 7f14b80f4700 1 -- start start 2023-10-14T19:09:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b80f4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b00cb5a0 0x7f14b01555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b80f4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cd9e0 0x7f14b00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b80f4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 0x7f14b0150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b80f4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00c8b90 con 0x7f14b015a5d0 2023-10-14T19:09:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b80f4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00c7d00 con 0x7f14b00cd9e0 2023-10-14T19:09:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b80f4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0150750 con 0x7f14b00cb5a0 2023-10-14T19:09:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 0x7f14b0150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 0x7f14b0150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43038/0 (socket says 172.21.15.7:43038) 2023-10-14T19:09:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 -- 172.21.15.7:0/1207664957 learned_addr learned my addr 172.21.15.7:0/1207664957 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b568f700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cd9e0 0x7f14b00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b00cb5a0 0x7f14b01555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 -- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b00cb5a0 msgr2=0x7f14b01555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b00cb5a0 0x7f14b01555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 -- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cd9e0 msgr2=0x7f14b00c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cd9e0 0x7f14b00c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b6691700 1 -- 172.21.15.7:0/1207664957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0009a20 con 0x7f14b015a5d0 2023-10-14T19:09:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.110+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b00cb5a0 0x7f14b01555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.111+0000 7f14b6691700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 0x7f14b0150210 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009f20 tx=0x7f14a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.111+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000cc80 con 0x7f14b015a5d0 2023-10-14T19:09:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.111+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000f040 con 0x7f14b015a5d0 2023-10-14T19:09:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.111+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a8009420 con 0x7f14b015a5d0 2023-10-14T19:09:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.111+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0014480 con 0x7f14b015a5d0 2023-10-14T19:09:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.111+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b00c81f0 con 0x7f14b015a5d0 2023-10-14T19:09:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.112+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b004c3c0 con 0x7f14b015a5d0 2023-10-14T19:09:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.112+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f14a0003020 con 0x7f14b015a5d0 2023-10-14T19:09:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.113+0000 7f14adffb700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f149c067290 0x7f149c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.113+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14a0085580 con 0x7f14b015a5d0 2023-10-14T19:09:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.113+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f149c067290 0x7f149c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.113+0000 7f14b5e90700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f149c067290 0x7f149c069740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f14a800a010 tx=0x7f14a8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.117+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a00522d0 con 0x7f14b015a5d0 2023-10-14T19:09:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.369+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14b00cd1e0 con 0x7f14b015a5d0 2023-10-14T19:09:00.370 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:09:00.370+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:09:00.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.376+0000 7f14adffb700 1 -- 172.21.15.7:0/1207664957 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14a00558f0 con 0x7f14b015a5d0 2023-10-14T19:09:00.378 INFO:tasks.ceph.mds.c.smithi007.stderr: -808> 2023-10-14T19:08:51.273+0000 7f5b44769700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:09:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f149c067290 msgr2=0x7f149c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f149c067290 0x7f149c069740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f14a800a010 tx=0x7f14a8016000 comp rx=0 tx=0).stop 2023-10-14T19:09:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 msgr2=0x7f14b0150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 0x7f14b0150210 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009f20 tx=0x7f14a000b040 comp rx=0 tx=0).stop 2023-10-14T19:09:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 shutdown_connections 2023-10-14T19:09:00.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f149c067290 0x7f149c069740 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b015a5d0 0x7f14b0150210 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14b00cb5a0 0x7f14b01555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 --2- 172.21.15.7:0/1207664957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b00cd9e0 0x7f14b00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 >> 172.21.15.7:0/1207664957 conn(0x7f14b0070e30 msgr2=0x7f14b00b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:00.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 shutdown_connections 2023-10-14T19:09:00.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.379+0000 7f14b80f4700 1 -- 172.21.15.7:0/1207664957 wait complete. 2023-10-14T19:09:00.382 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:09:00.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:09:00.399 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:09:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.515+0000 7f41f8867700 1 Processor -- start 2023-10-14T19:09:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.515+0000 7f41f8867700 1 -- start start 2023-10-14T19:09:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f8867700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41f40c8800 0x7f41f40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f8867700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f8867700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f40adbc0 con 0x7f41f40c8bd0 2023-10-14T19:09:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f8867700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f40c9d30 con 0x7f41f40c8800 2023-10-14T19:09:00.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f8867700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40acfb0 con 0x7f41f40b1150 2023-10-14T19:09:00.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41f40c8800 0x7f41f40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f41f40c8bd0 0x7f41f40b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40222/0 (socket says 172.21.15.7:40222) 2023-10-14T19:09:00.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f1d9b700 1 -- 172.21.15.7:0/3720036201 learned_addr learned my addr 172.21.15.7:0/3720036201 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:00.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f2d9d700 1 --2- 172.21.15.7:0/3720036201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f259c700 1 -- 172.21.15.7:0/3720036201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 msgr2=0x7f41f40ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f259c700 1 --2- 172.21.15.7:0/3720036201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f40ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f259c700 1 -- 172.21.15.7:0/3720036201 >> v1:172.21.15.7:6789/0 conn(0x7f41f40c8bd0 legacy=0x7f41f40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f259c700 1 -- 172.21.15.7:0/3720036201 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40ad290 con 0x7f41f40c8800 2023-10-14T19:09:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f159a700 1 -- 172.21.15.7:0/3720036201 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045471239 0 0) 0x7f41f40adbc0 con 0x7f41f40c8bd0 2023-10-14T19:09:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.516+0000 7f41f259c700 1 --2- 172.21.15.7:0/3720036201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f40c94e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098e0 tx=0x7f41ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8d19aa32eece86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f159a700 1 -- 172.21.15.7:0/3720036201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec009e80 con 0x7f41f40c8800 2023-10-14T19:09:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f159a700 1 -- 172.21.15.7:0/3720036201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec00b860 con 0x7f41f40c8800 2023-10-14T19:09:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f159a700 1 -- 172.21.15.7:0/3720036201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec00bbe0 con 0x7f41f40c8800 2023-10-14T19:09:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 -- 172.21.15.7:0/3720036201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 msgr2=0x7f41f40c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 --2- 172.21.15.7:0/3720036201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f40c94e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098e0 tx=0x7f41ec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 -- 172.21.15.7:0/3720036201 shutdown_connections 2023-10-14T19:09:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 --2- 172.21.15.7:0/3720036201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f40c94e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 --2- 172.21.15.7:0/3720036201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f40ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 -- 172.21.15.7:0/3720036201 >> 172.21.15.7:0/3720036201 conn(0x7f41f406d170 msgr2=0x7f41f40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:00.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 -- 172.21.15.7:0/3720036201 shutdown_connections 2023-10-14T19:09:00.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.517+0000 7f41f8867700 1 -- 172.21.15.7:0/3720036201 wait complete. 2023-10-14T19:09:00.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.518+0000 7f41f8867700 1 Processor -- start 2023-10-14T19:09:00.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.518+0000 7f41f8867700 1 -- start start 2023-10-14T19:09:00.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f8867700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f8867700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f4150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f8867700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f40c8bd0 0x7f41f40af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f8867700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4169bb0 con 0x7f41f40c8800 2023-10-14T19:09:00.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f8867700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40a5ea0 con 0x7f41f40c8bd0 2023-10-14T19:09:00.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f8867700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4158f80 con 0x7f41f40b1150 2023-10-14T19:09:00.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f4150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f4150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43072/0 (socket says 172.21.15.7:43072) 2023-10-14T19:09:00.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f1d9b700 1 -- 172.21.15.7:0/3755867539 learned_addr learned my addr 172.21.15.7:0/3755867539 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:00.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f2d9d700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f40c8bd0 0x7f41f40af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f259c700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f1d9b700 1 -- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 msgr2=0x7f41f4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f1d9b700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f4158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.519+0000 7f41f1d9b700 1 -- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f40c8bd0 msgr2=0x7f41f40af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41f1d9b700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f40c8bd0 0x7f41f40af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41f1d9b700 1 -- 172.21.15.7:0/3755867539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec009420 con 0x7f41f40c8800 2023-10-14T19:09:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41f259c700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41f1d9b700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f4150b10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f41dc001d60 tx=0x7f41dc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc005b30 con 0x7f41f40c8800 2023-10-14T19:09:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc005c90 con 0x7f41f40c8800 2023-10-14T19:09:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc007320 con 0x7f41f40c8800 2023-10-14T19:09:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f40a5570 con 0x7f41f40c8800 2023-10-14T19:09:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.520+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f40a5b30 con 0x7f41f40c8800 2023-10-14T19:09:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.521+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f40a6030 con 0x7f41f40c8800 2023-10-14T19:09:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.521+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f41dc0076d0 con 0x7f41f40c8800 2023-10-14T19:09:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.522+0000 7f41ea7fc700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41d4067290 0x7f41d4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.522+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f41dc086890 con 0x7f41f40c8800 2023-10-14T19:09:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.522+0000 7f41f259c700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41d4067290 0x7f41d4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.522+0000 7f41f259c700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41d4067290 0x7f41d4069740 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0091e0 tx=0x7f41ec017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.526+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41dc053620 con 0x7f41f40c8800 2023-10-14T19:09:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:00.763+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f41f404c3c0 con 0x7f41f40c8800 2023-10-14T19:09:01.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.378+0000 7f41ea7fc700 1 -- 172.21.15.7:0/3755867539 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41dc056c40 con 0x7f41f40c8800 2023-10-14T19:09:01.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41d4067290 msgr2=0x7f41d4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41d4067290 0x7f41d4069740 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0091e0 tx=0x7f41ec017000 comp rx=0 tx=0).stop 2023-10-14T19:09:01.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 msgr2=0x7f41f4150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f4150b10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f41dc001d60 tx=0x7f41dc007df0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 shutdown_connections 2023-10-14T19:09:01.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41d4067290 0x7f41d4069740 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f40c8bd0 0x7f41f40af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41f40b1150 0x7f41f4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 --2- 172.21.15.7:0/3755867539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f40c8800 0x7f41f4150b10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 >> 172.21.15.7:0/3755867539 conn(0x7f41f406d170 msgr2=0x7f41f40ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:01.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 shutdown_connections 2023-10-14T19:09:01.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.381+0000 7f41f8867700 1 -- 172.21.15.7:0/3755867539 wait complete. 2023-10-14T19:09:01.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:09:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.566+0000 7fdd6c98d700 1 Processor -- start 2023-10-14T19:09:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.566+0000 7fdd6c98d700 1 -- start start 2023-10-14T19:09:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd6c98d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 0x7fdd680b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd6c98d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680b0c80 con 0x7fdd68159800 2023-10-14T19:09:01.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd6c98d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680b0f60 con 0x7fdd680b1d40 2023-10-14T19:09:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd6c98d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680d10d0 con 0x7fdd680b24f0 2023-10-14T19:09:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd6759e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdd68159800 0x7fdd680b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40224/0 (socket says 172.21.15.7:40224) 2023-10-14T19:09:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd6759e700 1 -- 172.21.15.7:0/2302289453 learned_addr learned my addr 172.21.15.7:0/2302289453 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd66d9d700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 0x7fdd680b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350953629 0 0) 0x7fdd680b0c80 con 0x7fdd68159800 2023-10-14T19:09:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.567+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd54003570 con 0x7fdd68159800 2023-10-14T19:09:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702954933 0 0) 0x7fdd680b0f60 con 0x7fdd680b1d40 2023-10-14T19:09:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd680b0c80 con 0x7fdd680b1d40 2023-10-14T19:09:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274265497 0 0) 0x7fdd54003570 con 0x7fdd68159800 2023-10-14T19:09:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 msgr2=0x7fdd680b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 0x7fdd680b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 >> v1:172.21.15.148:6789/0 conn(0x7fdd680b1d40 legacy=0x7fdd681590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd680b1240 con 0x7fdd68159800 2023-10-14T19:09:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fdd60001470 con 0x7fdd68159800 2023-10-14T19:09:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 >> v1:172.21.15.7:6789/0 conn(0x7fdd68159800 legacy=0x7fdd680b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54003c20 0x7fdd54004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd54004810 0x7fdd54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 0x7fdd540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680d10d0 con 0x7fdd54004810 2023-10-14T19:09:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5400bb40 con 0x7fdd54003c20 2023-10-14T19:09:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5400bd00 con 0x7fdd680b24f0 2023-10-14T19:09:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd54004810 0x7fdd54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd66d9d700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54003c20 0x7fdd54004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6759e700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 0x7fdd540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 -- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 msgr2=0x7fdd540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd680b24f0 0x7fdd540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 -- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54003c20 msgr2=0x7fdd54004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54003c20 0x7fdd54004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 -- 172.21.15.7:0/2302289453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54003570 con 0x7fdd54004810 2023-10-14T19:09:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd6659c700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd54004810 0x7fdd54004c80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001a10 tx=0x7fdd50007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19617045b29ea1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000c5d0 con 0x7fdd54004810 2023-10-14T19:09:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000c730 con 0x7fdd54004810 2023-10-14T19:09:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.568+0000 7fdd65d9b700 1 -- 172.21.15.7:0/2302289453 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000cad0 con 0x7fdd54004810 2023-10-14T19:09:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6c98d700 1 -- 172.21.15.7:0/2302289453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd54004810 msgr2=0x7fdd54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/2302289453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd54004810 0x7fdd54004c80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001a10 tx=0x7fdd50007d30 comp rx=0 tx=0).stop 2023-10-14T19:09:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6759e700 1 -- 172.21.15.7:0/2302289453 reap_dead start 2023-10-14T19:09:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6c98d700 1 -- 172.21.15.7:0/2302289453 shutdown_connections 2023-10-14T19:09:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6c98d700 1 -- 172.21.15.7:0/2302289453 >> 172.21.15.7:0/2302289453 conn(0x7fdd680703a0 msgr2=0x7fdd680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6c98d700 1 -- 172.21.15.7:0/2302289453 shutdown_connections 2023-10-14T19:09:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.569+0000 7fdd6c98d700 1 -- 172.21.15.7:0/2302289453 wait complete. 2023-10-14T19:09:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.570+0000 7fdd6c98d700 1 Processor -- start 2023-10-14T19:09:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.570+0000 7fdd6c98d700 1 -- start start 2023-10-14T19:09:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6c98d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54004810 0x7fdd6814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6c98d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 0x7fdd68150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6c98d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd68151370 0x7fdd6815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6c98d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6814de40 con 0x7fdd68169900 2023-10-14T19:09:01.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6c98d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6814d550 con 0x7fdd54004810 2023-10-14T19:09:01.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6c98d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6814b3c0 con 0x7fdd68151370 2023-10-14T19:09:01.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 0x7fdd68150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 0x7fdd68150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43084/0 (socket says 172.21.15.7:43084) 2023-10-14T19:09:01.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 -- 172.21.15.7:0/782196409 learned_addr learned my addr 172.21.15.7:0/782196409 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:01.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6759e700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd68151370 0x7fdd6815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd66d9d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54004810 0x7fdd6814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 -- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd68151370 msgr2=0x7fdd6815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd68151370 0x7fdd6815a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 -- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54004810 msgr2=0x7fdd6814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54004810 0x7fdd6814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6659c700 1 -- 172.21.15.7:0/782196409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6814d7f0 con 0x7fdd68169900 2023-10-14T19:09:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd6759e700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd68151370 0x7fdd6815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.571+0000 7fdd66d9d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54004810 0x7fdd6814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:01.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.572+0000 7fdd6659c700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 0x7fdd68150e30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c3c0 tx=0x7fdd50015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.572+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000cab0 con 0x7fdd68169900 2023-10-14T19:09:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.572+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50001360 con 0x7fdd68169900 2023-10-14T19:09:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.572+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6814dad0 con 0x7fdd68169900 2023-10-14T19:09:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.572+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50006a70 con 0x7fdd68169900 2023-10-14T19:09:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.572+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd68151880 con 0x7fdd68169900 2023-10-14T19:09:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.573+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6804c3c0 con 0x7fdd68169900 2023-10-14T19:09:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.573+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdd50019070 con 0x7fdd68169900 2023-10-14T19:09:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.574+0000 7fdd5effd700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdd48067290 0x7fdd48069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.574+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdd50085f90 con 0x7fdd68169900 2023-10-14T19:09:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.574+0000 7fdd66d9d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdd48067290 0x7fdd48069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.574+0000 7fdd66d9d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdd48067290 0x7fdd48069740 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdd68152c10 tx=0x7fdd5800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.578+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd50052da0 con 0x7fdd68169900 2023-10-14T19:09:01.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:01.772+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd6814df80 con 0x7fdd68169900 2023-10-14T19:09:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.383+0000 7fdd5effd700 1 -- 172.21.15.7:0/782196409 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdd500170d0 con 0x7fdd68169900 2023-10-14T19:09:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdd48067290 msgr2=0x7fdd48069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdd48067290 0x7fdd48069740 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdd68152c10 tx=0x7fdd5800b040 comp rx=0 tx=0).stop 2023-10-14T19:09:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 msgr2=0x7fdd68150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 0x7fdd68150e30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c3c0 tx=0x7fdd50015000 comp rx=0 tx=0).stop 2023-10-14T19:09:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 shutdown_connections 2023-10-14T19:09:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdd48067290 0x7fdd48069740 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd54004810 0x7fdd6814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd68151370 0x7fdd6815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 --2- 172.21.15.7:0/782196409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd68169900 0x7fdd68150e30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 >> 172.21.15.7:0/782196409 conn(0x7fdd680703a0 msgr2=0x7fdd68159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 shutdown_connections 2023-10-14T19:09:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.387+0000 7fdd6c98d700 1 -- 172.21.15.7:0/782196409 wait complete. 2023-10-14T19:09:02.390 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:09:02.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:09:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.533+0000 7fdbf8c24700 1 Processor -- start 2023-10-14T19:09:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.533+0000 7fdbf8c24700 1 -- start start 2023-10-14T19:09:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf8c24700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbf40cb880 0x7fdbf40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf8c24700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbf40cd770 0x7fdbf41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf8c24700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf40cf330 con 0x7fdbf40b04f0 2023-10-14T19:09:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf8c24700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf40cdbd0 con 0x7fdbf40cd770 2023-10-14T19:09:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf8c24700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf40cead0 con 0x7fdbf40cb880 2023-10-14T19:09:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf2d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbf40cd770 0x7fdbf41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdbf40b04f0 0x7fdbf40cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40236/0 (socket says 172.21.15.7:40236) 2023-10-14T19:09:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.534+0000 7fdbf1d9b700 1 -- 172.21.15.7:0/531042628 learned_addr learned my addr 172.21.15.7:0/531042628 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:02.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf259c700 1 --2- 172.21.15.7:0/531042628 >> v2:172.21.15.148:3300/0 conn(0x7fdbf40cb880 0x7fdbf40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:02.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/531042628 >> v2:172.21.15.148:3300/0 conn(0x7fdbf40cb880 msgr2=0x7fdbf40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:02.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf2d9d700 1 --2- 172.21.15.7:0/531042628 >> v2:172.21.15.148:3300/0 conn(0x7fdbf40cb880 0x7fdbf40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/531042628 >> v1:172.21.15.7:6789/0 conn(0x7fdbf40b04f0 legacy=0x7fdbf40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:02.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf159a700 1 -- 172.21.15.7:0/531042628 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487704335 0 0) 0x7fdbf40cf330 con 0x7fdbf40b04f0 2023-10-14T19:09:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/531042628 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40cddd0 con 0x7fdbf40cd770 2023-10-14T19:09:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf2d9d700 1 --2- 172.21.15.7:0/531042628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf41591e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40ce1c0 tx=0x7fdbe4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dba2aeadbc80fab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf159a700 1 -- 172.21.15.7:0/531042628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400e070 con 0x7fdbf40cd770 2023-10-14T19:09:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf159a700 1 -- 172.21.15.7:0/531042628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe400bc30 con 0x7fdbf40cd770 2023-10-14T19:09:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf159a700 1 -- 172.21.15.7:0/531042628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4012430 con 0x7fdbf40cd770 2023-10-14T19:09:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf8c24700 1 -- 172.21.15.7:0/531042628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 msgr2=0x7fdbf41591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.535+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/531042628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf41591e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40ce1c0 tx=0x7fdbe4009780 comp rx=0 tx=0).stop 2023-10-14T19:09:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.536+0000 7fdbf8c24700 1 -- 172.21.15.7:0/531042628 shutdown_connections 2023-10-14T19:09:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.536+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/531042628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf41591e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.536+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/531042628 >> v2:172.21.15.148:3300/0 conn(0x7fdbf40cb880 0x7fdbf40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.536+0000 7fdbf8c24700 1 -- 172.21.15.7:0/531042628 >> 172.21.15.7:0/531042628 conn(0x7fdbf40703a0 msgr2=0x7fdbf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:02.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.536+0000 7fdbf8c24700 1 -- 172.21.15.7:0/531042628 shutdown_connections 2023-10-14T19:09:02.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.536+0000 7fdbf8c24700 1 -- 172.21.15.7:0/531042628 wait complete. 2023-10-14T19:09:02.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.537+0000 7fdbf8c24700 1 Processor -- start 2023-10-14T19:09:02.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.537+0000 7fdbf8c24700 1 -- start start 2023-10-14T19:09:02.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.537+0000 7fdbf8c24700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf40b04f0 0x7fdbf40b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:02.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.537+0000 7fdbf8c24700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbf40cb880 0x7fdbf416aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf8c24700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf40c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf8c24700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40b4130 con 0x7fdbf40cd770 2023-10-14T19:09:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf8c24700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40b61b0 con 0x7fdbf40b04f0 2023-10-14T19:09:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf8c24700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40b3520 con 0x7fdbf40cb880 2023-10-14T19:09:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf40c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf40c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43090/0 (socket says 172.21.15.7:43090) 2023-10-14T19:09:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/3211787811 learned_addr learned my addr 172.21.15.7:0/3211787811 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf259c700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf40b04f0 0x7fdbf40b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf1d9b700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbf40cb880 0x7fdbf416aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbf40cb880 msgr2=0x7fdbf416aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:02.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbf40cb880 0x7fdbf416aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf40b04f0 msgr2=0x7fdbf40b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:02.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf40b04f0 0x7fdbf40b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:02.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 -- 172.21.15.7:0/3211787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009a20 con 0x7fdbf40cd770 2023-10-14T19:09:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf259c700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf40b04f0 0x7fdbf40b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf2d9d700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf40c9390 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400b6c0 tx=0x7fdbe4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe401d630 con 0x7fdbf40cd770 2023-10-14T19:09:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe401d790 con 0x7fdbf40cd770 2023-10-14T19:09:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf40b3800 con 0x7fdbf40cd770 2023-10-14T19:09:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe401db50 con 0x7fdbf40cd770 2023-10-14T19:09:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.538+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf40b3dc0 con 0x7fdbf40cd770 2023-10-14T19:09:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.539+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf40b42e0 con 0x7fdbf40cd770 2023-10-14T19:09:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.540+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdbe4024070 con 0x7fdbf40cd770 2023-10-14T19:09:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.540+0000 7fdbea7fc700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbd4067290 0x7fdbd4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.540+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fdbe4087180 con 0x7fdbf40cd770 2023-10-14T19:09:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.540+0000 7fdbf259c700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbd4067290 0x7fdbd4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.541+0000 7fdbf259c700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbd4067290 0x7fdbd4069740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdbec006fd0 tx=0x7fdbec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.545+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbe4054140 con 0x7fdbf40cd770 2023-10-14T19:09:02.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:02.735+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbf404c3c0 con 0x7fdbf40cd770 2023-10-14T19:09:03.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.386+0000 7fdbea7fc700 1 -- 172.21.15.7:0/3211787811 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdbe4057760 con 0x7fdbf40cd770 2023-10-14T19:09:03.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbd4067290 msgr2=0x7fdbd4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbd4067290 0x7fdbd4069740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdbec006fd0 tx=0x7fdbec008040 comp rx=0 tx=0).stop 2023-10-14T19:09:03.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 msgr2=0x7fdbf40c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf40c9390 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400b6c0 tx=0x7fdbe4019000 comp rx=0 tx=0).stop 2023-10-14T19:09:03.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 shutdown_connections 2023-10-14T19:09:03.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbd4067290 0x7fdbd4069740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf40b04f0 0x7fdbf40b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbf40cd770 0x7fdbf40c9390 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 --2- 172.21.15.7:0/3211787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbf40cb880 0x7fdbf416aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 >> 172.21.15.7:0/3211787811 conn(0x7fdbf40703a0 msgr2=0x7fdbf4158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:03.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 shutdown_connections 2023-10-14T19:09:03.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.392+0000 7fdbf8c24700 1 -- 172.21.15.7:0/3211787811 wait complete. 2023-10-14T19:09:03.395 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:09:03.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:09:03.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.531+0000 7fd65f21a700 1 Processor -- start 2023-10-14T19:09:03.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.531+0000 7fd65f21a700 1 -- start start 2023-10-14T19:09:03.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd65f21a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 0x7fd658159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd65f21a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6580ccfd0 con 0x7fd658159530 2023-10-14T19:09:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd65f21a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65815a3d0 con 0x7fd65806e0e0 2023-10-14T19:09:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd65f21a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65815a6b0 con 0x7fd65806dc70 2023-10-14T19:09:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd65cfb6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd658159530 0x7fd6580ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40240/0 (socket says 172.21.15.7:40240) 2023-10-14T19:09:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd65cfb6700 1 -- 172.21.15.7:0/4132714431 learned_addr learned my addr 172.21.15.7:0/4132714431 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290065939 0 0) 0x7fd6580ccfd0 con 0x7fd658159530 2023-10-14T19:09:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd644003570 con 0x7fd658159530 2023-10-14T19:09:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.532+0000 7fd657fff700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 0x7fd658159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4146007679 0 0) 0x7fd644003570 con 0x7fd658159530 2023-10-14T19:09:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 msgr2=0x7fd658159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 0x7fd658159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 >> v1:172.21.15.148:6789/0 conn(0x7fd65806e0e0 legacy=0x7fd6580cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65815a990 con 0x7fd658159530 2023-10-14T19:09:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fd6500017f0 con 0x7fd658159530 2023-10-14T19:09:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 >> v1:172.21.15.7:6789/0 conn(0x7fd658159530 legacy=0x7fd6580ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 0x7fd644003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd644004060 0x7fd644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd644004d50 0x7fd6440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65815a6b0 con 0x7fd644004d50 2023-10-14T19:09:03.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64400bc20 con 0x7fd644004060 2023-10-14T19:09:03.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64400bde0 con 0x7fd65806dc70 2023-10-14T19:09:03.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd644004d50 0x7fd6440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65cfb6700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 0x7fd644003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd657fff700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd644004060 0x7fd644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 -- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 msgr2=0x7fd644003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65806dc70 0x7fd644003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 -- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd644004060 msgr2=0x7fd644004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd644004060 0x7fd644004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 -- 172.21.15.7:0/4132714431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644003570 con 0x7fd644004d50 2023-10-14T19:09:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.533+0000 7fd65d7b7700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd644004d50 0x7fd6440051c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd6400018b0 tx=0x7fd640007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28b9350e8bd7ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640012420 con 0x7fd644004d50 2023-10-14T19:09:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640012580 con 0x7fd644004d50 2023-10-14T19:09:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd6577fe700 1 -- 172.21.15.7:0/4132714431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640012920 con 0x7fd644004d50 2023-10-14T19:09:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65f21a700 1 -- 172.21.15.7:0/4132714431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd644004d50 msgr2=0x7fd6440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65f21a700 1 --2- 172.21.15.7:0/4132714431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd644004d50 0x7fd6440051c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd6400018b0 tx=0x7fd640007d30 comp rx=0 tx=0).stop 2023-10-14T19:09:03.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65d7b7700 1 -- 172.21.15.7:0/4132714431 reap_dead start 2023-10-14T19:09:03.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65f21a700 1 -- 172.21.15.7:0/4132714431 shutdown_connections 2023-10-14T19:09:03.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65f21a700 1 -- 172.21.15.7:0/4132714431 >> 172.21.15.7:0/4132714431 conn(0x7fd6580703a0 msgr2=0x7fd6580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65f21a700 1 -- 172.21.15.7:0/4132714431 shutdown_connections 2023-10-14T19:09:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.534+0000 7fd65f21a700 1 -- 172.21.15.7:0/4132714431 wait complete. 2023-10-14T19:09:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.535+0000 7fd65f21a700 1 Processor -- start 2023-10-14T19:09:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.535+0000 7fd65f21a700 1 -- start start 2023-10-14T19:09:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65f21a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 0x7fd6580c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65f21a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65816a2a0 0x7fd6580c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65f21a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6580b5a80 0x7fd6580b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65f21a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65816aa90 con 0x7fd6580b5a80 2023-10-14T19:09:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65f21a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580b6460 con 0x7fd658148300 2023-10-14T19:09:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65f21a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580c8260 con 0x7fd65816a2a0 2023-10-14T19:09:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65cfb6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 0x7fd6580c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd657fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65816a2a0 0x7fd6580c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65cfb6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 0x7fd6580c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:32834/0 (socket says 172.21.15.7:32834) 2023-10-14T19:09:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65cfb6700 1 -- 172.21.15.7:0/1477262964 learned_addr learned my addr 172.21.15.7:0/1477262964 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.536+0000 7fd65d7b7700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6580b5a80 0x7fd6580b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd657fff700 1 -- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 msgr2=0x7fd6580c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd657fff700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 0x7fd6580c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd657fff700 1 -- 172.21.15.7:0/1477262964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6580b5a80 msgr2=0x7fd6580b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd657fff700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6580b5a80 0x7fd6580b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd657fff700 1 -- 172.21.15.7:0/1477262964 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580c7930 con 0x7fd65816a2a0 2023-10-14T19:09:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd65d7b7700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6580b5a80 0x7fd6580b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd65cfb6700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 0x7fd6580c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd657fff700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65816a2a0 0x7fd6580c86f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6480119f0 tx=0x7fd6480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800f790 con 0x7fd65816a2a0 2023-10-14T19:09:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64800f8f0 con 0x7fd65816a2a0 2023-10-14T19:09:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800fc90 con 0x7fd65816a2a0 2023-10-14T19:09:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6580c7c10 con 0x7fd65816a2a0 2023-10-14T19:09:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.537+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65816a710 con 0x7fd65816a2a0 2023-10-14T19:09:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.538+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6580c83f0 con 0x7fd65816a2a0 2023-10-14T19:09:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.539+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fd648014650 con 0x7fd65816a2a0 2023-10-14T19:09:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.539+0000 7fd654ff9700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd638067290 0x7fd638069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.539+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd648018030 con 0x7fd65816a2a0 2023-10-14T19:09:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.539+0000 7fd65cfb6700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd638067290 0x7fd638069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.540+0000 7fd65cfb6700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd638067290 0x7fd638069740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd650001f90 tx=0x7fd650009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.544+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd648052480 con 0x7fd65816a2a0 2023-10-14T19:09:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.736+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd65804c3c0 con 0x7fd65816a2a0 2023-10-14T19:09:03.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.741+0000 7fd654ff9700 1 -- 172.21.15.7:0/1477262964 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd648055aa0 con 0x7fd65816a2a0 2023-10-14T19:09:03.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd638067290 msgr2=0x7fd638069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd638067290 0x7fd638069740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd650001f90 tx=0x7fd650009040 comp rx=0 tx=0).stop 2023-10-14T19:09:03.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65816a2a0 msgr2=0x7fd6580c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65816a2a0 0x7fd6580c86f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6480119f0 tx=0x7fd6480091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 shutdown_connections 2023-10-14T19:09:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd638067290 0x7fd638069740 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd658148300 0x7fd6580c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6580b5a80 0x7fd6580b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 --2- 172.21.15.7:0/1477262964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd65816a2a0 0x7fd6580c86f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 >> 172.21.15.7:0/1477262964 conn(0x7fd6580703a0 msgr2=0x7fd6580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 shutdown_connections 2023-10-14T19:09:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.743+0000 7fd65f21a700 1 -- 172.21.15.7:0/1477262964 wait complete. 2023-10-14T19:09:03.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-14T19:09:03.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.875+0000 7f810c094700 1 Processor -- start 2023-10-14T19:09:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.876+0000 7f810c094700 1 -- start start 2023-10-14T19:09:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.876+0000 7f810c094700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f81040cb5a0 0x7f81040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.876+0000 7f810c094700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f8104156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.876+0000 7f810c094700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810415ae40 con 0x7f81040cd9e0 2023-10-14T19:09:03.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.876+0000 7f810c094700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81040d13f0 con 0x7f81040cb5a0 2023-10-14T19:09:03.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.876+0000 7f810c094700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810415ab60 con 0x7f810415a5d0 2023-10-14T19:09:03.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f810962f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f81040cd9e0 0x7f8104159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40250/0 (socket says 172.21.15.7:40250) 2023-10-14T19:09:03.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f810962f700 1 -- 172.21.15.7:0/3603435432 learned_addr learned my addr 172.21.15.7:0/3603435432 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:03.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f810a631700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f8104156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8109e30700 1 --2- 172.21.15.7:0/3603435432 >> v2:172.21.15.148:3300/0 conn(0x7f81040cb5a0 0x7f81040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430856520 0 0) 0x7f810415ae40 con 0x7f81040cd9e0 2023-10-14T19:09:03.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ec003570 con 0x7f81040cd9e0 2023-10-14T19:09:03.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972189483 0 0) 0x7f80ec003570 con 0x7f81040cd9e0 2023-10-14T19:09:03.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 msgr2=0x7f8104156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f8104156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 >> v2:172.21.15.148:3300/0 conn(0x7f81040cb5a0 msgr2=0x7f81040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 --2- 172.21.15.7:0/3603435432 >> v2:172.21.15.148:3300/0 conn(0x7f81040cb5a0 0x7f81040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040ccf00 con 0x7f81040cd9e0 2023-10-14T19:09:03.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f80f8001470 con 0x7f81040cd9e0 2023-10-14T19:09:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8109e30700 1 --2- 172.21.15.7:0/3603435432 >> v2:172.21.15.148:3300/0 conn(0x7f81040cb5a0 0x7f81040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f810a631700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f8104156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 >> v1:172.21.15.7:6789/0 conn(0x7f81040cd9e0 legacy=0x7f8104159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80ec003a60 0x7f80ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80ec004810 0x7f80ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f80ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810415ab60 con 0x7f80ec004810 2023-10-14T19:09:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec00ba60 con 0x7f80ec003a60 2023-10-14T19:09:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec00bba0 con 0x7f810415a5d0 2023-10-14T19:09:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f810962f700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80ec004810 0x7f80ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f8109e30700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80ec003a60 0x7f80ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.877+0000 7f810a631700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f80ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810962f700 1 -- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 msgr2=0x7f80ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810962f700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f80ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810962f700 1 -- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80ec003a60 msgr2=0x7f80ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:03.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810962f700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80ec003a60 0x7f80ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810962f700 1 -- 172.21.15.7:0/3603435432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4009420 con 0x7f80ec004810 2023-10-14T19:09:03.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810a631700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f810415a5d0 0x7f80ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:03.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810962f700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80ec004810 0x7f80ec004c80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c3c0 tx=0x7f80f8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc559d5fc04b72b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:03.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800cc90 con 0x7f80ec004810 2023-10-14T19:09:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f800cdf0 con 0x7f80ec004810 2023-10-14T19:09:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f8108e2e700 1 -- 172.21.15.7:0/3603435432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8005b50 con 0x7f80ec004810 2023-10-14T19:09:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810c094700 1 -- 172.21.15.7:0/3603435432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80ec004810 msgr2=0x7f80ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810c094700 1 --2- 172.21.15.7:0/3603435432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80ec004810 0x7f80ec004c80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c3c0 tx=0x7f80f8001e50 comp rx=0 tx=0).stop 2023-10-14T19:09:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810a631700 1 -- 172.21.15.7:0/3603435432 reap_dead start 2023-10-14T19:09:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810c094700 1 -- 172.21.15.7:0/3603435432 shutdown_connections 2023-10-14T19:09:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.878+0000 7f810c094700 1 -- 172.21.15.7:0/3603435432 >> 172.21.15.7:0/3603435432 conn(0x7f8104070e30 msgr2=0x7f81040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.879+0000 7f810c094700 1 -- 172.21.15.7:0/3603435432 shutdown_connections 2023-10-14T19:09:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.879+0000 7f810c094700 1 -- 172.21.15.7:0/3603435432 wait complete. 2023-10-14T19:09:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 Processor -- start 2023-10-14T19:09:03.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 -- start start 2023-10-14T19:09:03.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81040c6b10 0x7f81040b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 0x7f8104152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81040b3590 0x7f8104153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040c8200 con 0x7f81040b6000 2023-10-14T19:09:03.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040b64c0 con 0x7f81040c6b10 2023-10-14T19:09:03.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810c094700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040c78d0 con 0x7f81040b3590 2023-10-14T19:09:03.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810962f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 0x7f8104152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810962f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 0x7f8104152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43128/0 (socket says 172.21.15.7:43128) 2023-10-14T19:09:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.880+0000 7f810962f700 1 -- 172.21.15.7:0/678865732 learned_addr learned my addr 172.21.15.7:0/678865732 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f8109e30700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81040c6b10 0x7f81040b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810a631700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81040b3590 0x7f8104153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810962f700 1 -- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81040b3590 msgr2=0x7f8104153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810962f700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81040b3590 0x7f8104153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810962f700 1 -- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81040c6b10 msgr2=0x7f81040b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:03.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810962f700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81040c6b10 0x7f81040b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:03.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810962f700 1 -- 172.21.15.7:0/678865732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040c7bb0 con 0x7f81040b6000 2023-10-14T19:09:03.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810a631700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81040b3590 0x7f8104153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:03.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810962f700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 0x7f8104152e50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f80ec004690 tx=0x7f80f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:03.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8022070 con 0x7f81040b6000 2023-10-14T19:09:03.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f800c9e0 con 0x7f81040b6000 2023-10-14T19:09:03.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81040c7e90 con 0x7f81040b6000 2023-10-14T19:09:03.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800cc90 con 0x7f81040b6000 2023-10-14T19:09:03.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.881+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81040c7120 con 0x7f81040b6000 2023-10-14T19:09:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.882+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81040c83b0 con 0x7f81040b6000 2023-10-14T19:09:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.883+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f80f801e430 con 0x7f81040b6000 2023-10-14T19:09:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.883+0000 7f8101ffb700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f80f0067290 0x7f80f0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.883+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f80f8085b40 con 0x7f81040b6000 2023-10-14T19:09:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.883+0000 7f8109e30700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f80f0067290 0x7f80f0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:03.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.884+0000 7f8109e30700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f80f0067290 0x7f80f0069740 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0094d0 tx=0x7f80fc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:03.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:03.887+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81040c83b0 con 0x7f81040b6000 2023-10-14T19:09:04.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.162+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f81040c83b0 con 0x7f81040b6000 2023-10-14T19:09:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.388+0000 7f8101ffb700 1 -- 172.21.15.7:0/678865732 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v281) v1 ==== 181+0+0 (secure 0 0 0) 0x7f81040c83b0 con 0x7f81040b6000 2023-10-14T19:09:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.390+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f80f0067290 msgr2=0x7f80f0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.390+0000 7f810c094700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f80f0067290 0x7f80f0069740 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0094d0 tx=0x7f80fc00b040 comp rx=0 tx=0).stop 2023-10-14T19:09:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.390+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 msgr2=0x7f8104152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.390+0000 7f810c094700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 0x7f8104152e50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f80ec004690 tx=0x7f80f8015000 comp rx=0 tx=0).stop 2023-10-14T19:09:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.390+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 shutdown_connections 2023-10-14T19:09:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.390+0000 7f810c094700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f80f0067290 0x7f80f0069740 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.391+0000 7f810c094700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81040c6b10 0x7f81040b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.391+0000 7f810c094700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81040b3590 0x7f8104153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.391+0000 7f810c094700 1 --2- 172.21.15.7:0/678865732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81040b6000 0x7f8104152e50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.391+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 >> 172.21.15.7:0/678865732 conn(0x7f8104070e30 msgr2=0x7f8104159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.391+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 shutdown_connections 2023-10-14T19:09:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.391+0000 7f810c094700 1 -- 172.21.15.7:0/678865732 wait complete. 2023-10-14T19:09:04.403 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command without subvolume group ... ok 2023-10-14T19:09:04.404 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command without subvolume group 2023-10-14T19:09:04.404 INFO:tasks.cephfs_test_runner:test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:09:04.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-14T19:09:04.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.525+0000 7f2cf22b2700 1 Processor -- start 2023-10-14T19:09:04.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.525+0000 7f2cf22b2700 1 -- start start 2023-10-14T19:09:04.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cf22b2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cec0b07d0 0x7f2cec0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:04.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cf22b2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec15a280 con 0x7f2cec0b0ba0 2023-10-14T19:09:04.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cf22b2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec06e180 con 0x7f2cec0cf200 2023-10-14T19:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cf22b2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec06d850 con 0x7f2cec0b07d0 2023-10-14T19:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cebfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cec0b07d0 0x7f2cec0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cf084f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2cec0b0ba0 0x7f2cec06ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40254/0 (socket says 172.21.15.7:40254) 2023-10-14T19:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cf084f700 1 -- 172.21.15.7:0/3635131808 learned_addr learned my addr 172.21.15.7:0/3635131808 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cebfff700 1 -- 172.21.15.7:0/3635131808 >> v1:172.21.15.148:6789/0 conn(0x7f2cec0cf200 legacy=0x7f2cec06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cebfff700 1 -- 172.21.15.7:0/3635131808 >> v1:172.21.15.7:6789/0 conn(0x7f2cec0b0ba0 legacy=0x7f2cec06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cebfff700 1 -- 172.21.15.7:0/3635131808 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec06db30 con 0x7f2cec0b07d0 2023-10-14T19:09:04.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2cebfff700 1 --2- 172.21.15.7:0/3635131808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0b07d0 0x7f2cec0ccac0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40098d0 tx=0x7f2cd4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3054d08f5f3e6cdb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:04.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2ceaffd700 1 -- 172.21.15.7:0/3635131808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009e70 con 0x7f2cec0b07d0 2023-10-14T19:09:04.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2ceaffd700 1 -- 172.21.15.7:0/3635131808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4005c10 con 0x7f2cec0b07d0 2023-10-14T19:09:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.526+0000 7f2ceaffd700 1 -- 172.21.15.7:0/3635131808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400b6e0 con 0x7f2cec0b07d0 2023-10-14T19:09:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 -- 172.21.15.7:0/3635131808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0b07d0 msgr2=0x7f2cec0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/3635131808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0b07d0 0x7f2cec0ccac0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40098d0 tx=0x7f2cd4009120 comp rx=0 tx=0).stop 2023-10-14T19:09:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 -- 172.21.15.7:0/3635131808 shutdown_connections 2023-10-14T19:09:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/3635131808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0b07d0 0x7f2cec0ccac0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 -- 172.21.15.7:0/3635131808 >> 172.21.15.7:0/3635131808 conn(0x7f2cec06ce80 msgr2=0x7f2cec0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 -- 172.21.15.7:0/3635131808 shutdown_connections 2023-10-14T19:09:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.527+0000 7f2cf22b2700 1 -- 172.21.15.7:0/3635131808 wait complete. 2023-10-14T19:09:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.528+0000 7f2cf22b2700 1 Processor -- start 2023-10-14T19:09:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.528+0000 7f2cf22b2700 1 -- start start 2023-10-14T19:09:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf22b2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2cec0b07d0 0x7f2cec0c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf22b2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cec0b0ba0 0x7f2cec1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf22b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 0x7f2cec16add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf22b2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c8460 con 0x7f2cec0cf200 2023-10-14T19:09:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf22b2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1544e0 con 0x7f2cec0b0ba0 2023-10-14T19:09:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf22b2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec154de0 con 0x7f2cec0b07d0 2023-10-14T19:09:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 0x7f2cec16add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 0x7f2cec16add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43142/0 (socket says 172.21.15.7:43142) 2023-10-14T19:09:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 -- 172.21.15.7:0/4258100103 learned_addr learned my addr 172.21.15.7:0/4258100103 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cebfff700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2cec0b07d0 0x7f2cec0c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2ceb7fe700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cec0b0ba0 0x7f2cec1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 -- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2cec0b07d0 msgr2=0x7f2cec0c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2cec0b07d0 0x7f2cec0c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 -- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cec0b0ba0 msgr2=0x7f2cec1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cec0b0ba0 0x7f2cec1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 -- 172.21.15.7:0/4258100103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40093c0 con 0x7f2cec0cf200 2023-10-14T19:09:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cebfff700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2cec0b07d0 0x7f2cec0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:04.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2ceb7fe700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cec0b0ba0 0x7f2cec1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:04.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.529+0000 7f2cf084f700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 0x7f2cec16add0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400cc40 tx=0x7f2ce4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:04.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.530+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400a960 con 0x7f2cec0cf200 2023-10-14T19:09:04.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.530+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce400aac0 con 0x7f2cec0cf200 2023-10-14T19:09:04.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.530+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec169d30 con 0x7f2cec0cf200 2023-10-14T19:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.530+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400ae80 con 0x7f2cec0cf200 2023-10-14T19:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.530+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0c5d80 con 0x7f2cec0cf200 2023-10-14T19:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.531+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec169ec0 con 0x7f2cec0cf200 2023-10-14T19:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.531+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2ce4007300 con 0x7f2cec0cf200 2023-10-14T19:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.531+0000 7f2ce3fff700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2ccc067290 0x7f2ccc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.531+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2ce4084c30 con 0x7f2cec0cf200 2023-10-14T19:09:04.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.532+0000 7f2cebfff700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2ccc067290 0x7f2ccc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:04.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.532+0000 7f2cebfff700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2ccc067290 0x7f2ccc069740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009fd0 tx=0x7f2cd4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:04.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.536+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ce4051d10 con 0x7f2cec0cf200 2023-10-14T19:09:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:04.810+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f2cec04c3c0 con 0x7f2cec0cf200 2023-10-14T19:09:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.391+0000 7f2ce3fff700 1 -- 172.21.15.7:0/4258100103 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v282) v1 ==== 159+0+0 (secure 0 0 0) 0x7f2ce4055330 con 0x7f2cec0cf200 2023-10-14T19:09:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2ccc067290 msgr2=0x7f2ccc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2ccc067290 0x7f2ccc069740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009fd0 tx=0x7f2cd4016000 comp rx=0 tx=0).stop 2023-10-14T19:09:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 msgr2=0x7f2cec16add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 0x7f2cec16add0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400cc40 tx=0x7f2ce4001a50 comp rx=0 tx=0).stop 2023-10-14T19:09:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 shutdown_connections 2023-10-14T19:09:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2ccc067290 0x7f2ccc069740 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec0cf200 0x7f2cec16add0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2cec0b07d0 0x7f2cec0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 --2- 172.21.15.7:0/4258100103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cec0b0ba0 0x7f2cec1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 >> 172.21.15.7:0/4258100103 conn(0x7f2cec06ce80 msgr2=0x7f2cec0c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 shutdown_connections 2023-10-14T19:09:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.393+0000 7f2cf22b2700 1 -- 172.21.15.7:0/4258100103 wait complete. 2023-10-14T19:09:05.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:09:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.532+0000 7f1c619b4700 1 Processor -- start 2023-10-14T19:09:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.532+0000 7f1c619b4700 1 -- start start 2023-10-14T19:09:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c619b4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1c5c0cc320 0x7f1c5c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c619b4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c06d7b0 con 0x7f1c5c06a110 2023-10-14T19:09:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c619b4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c06e330 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c619b4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c06a570 con 0x7f1c5c0cc320 2023-10-14T19:09:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c5b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1c5c06a110 0x7f1c5c06e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40266/0 (socket says 172.21.15.7:40266) 2023-10-14T19:09:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c5b7fe700 1 -- 172.21.15.7:0/80571175 learned_addr learned my addr 172.21.15.7:0/80571175 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c5affd700 1 --2- 172.21.15.7:0/80571175 >> v2:172.21.15.148:3300/0 conn(0x7f1c5c0cc320 0x7f1c5c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.533+0000 7f1c59ffb700 1 -- 172.21.15.7:0/80571175 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072105547 0 0) 0x7f1c5c06d7b0 con 0x7f1c5c06a110 2023-10-14T19:09:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c59ffb700 1 -- 172.21.15.7:0/80571175 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c48003570 con 0x7f1c5c06a110 2023-10-14T19:09:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c5affd700 1 -- 172.21.15.7:0/80571175 >> v1:172.21.15.148:6789/0 conn(0x7f1c5c0cc6f0 legacy=0x7f1c5c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c5affd700 1 -- 172.21.15.7:0/80571175 >> v1:172.21.15.7:6789/0 conn(0x7f1c5c06a110 legacy=0x7f1c5c06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c59ffb700 1 -- 172.21.15.7:0/80571175 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183920056 0 0) 0x7f1c48003570 con 0x7f1c5c06a110 2023-10-14T19:09:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c5affd700 1 -- 172.21.15.7:0/80571175 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c06da00 con 0x7f1c5c0cc320 2023-10-14T19:09:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c5affd700 1 --2- 172.21.15.7:0/80571175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c0cc320 0x7f1c5c13c2a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c540098e0 tx=0x7f1c540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4a710e8f5f588f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c59ffb700 1 -- 172.21.15.7:0/80571175 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0017f0 con 0x7f1c5c0cc320 2023-10-14T19:09:05.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c59ffb700 1 -- 172.21.15.7:0/80571175 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54011420 con 0x7f1c5c0cc320 2023-10-14T19:09:05.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.534+0000 7f1c59ffb700 1 -- 172.21.15.7:0/80571175 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540117a0 con 0x7f1c5c0cc320 2023-10-14T19:09:05.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 -- 172.21.15.7:0/80571175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c0cc320 msgr2=0x7f1c5c13c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 --2- 172.21.15.7:0/80571175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c0cc320 0x7f1c5c13c2a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c540098e0 tx=0x7f1c540091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 -- 172.21.15.7:0/80571175 shutdown_connections 2023-10-14T19:09:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 --2- 172.21.15.7:0/80571175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c0cc320 0x7f1c5c13c2a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 -- 172.21.15.7:0/80571175 >> 172.21.15.7:0/80571175 conn(0x7f1c5c067f00 msgr2=0x7f1c5c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 -- 172.21.15.7:0/80571175 shutdown_connections 2023-10-14T19:09:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.535+0000 7f1c619b4700 1 -- 172.21.15.7:0/80571175 wait complete. 2023-10-14T19:09:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.536+0000 7f1c619b4700 1 Processor -- start 2023-10-14T19:09:05.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.536+0000 7f1c619b4700 1 -- start start 2023-10-14T19:09:05.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c619b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c06a110 0x7f1c5c1388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c619b4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c5c0cc320 0x7f1c5c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c619b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 0x7f1c5c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c619b4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b0a00 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c619b4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c138e20 con 0x7f1c5c06a110 2023-10-14T19:09:05.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c619b4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c169b20 con 0x7f1c5c0cc320 2023-10-14T19:09:05.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 0x7f1c5c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 0x7f1c5c0c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43144/0 (socket says 172.21.15.7:43144) 2023-10-14T19:09:05.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 -- 172.21.15.7:0/2339585051 learned_addr learned my addr 172.21.15.7:0/2339585051 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:05.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5affd700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c06a110 0x7f1c5c1388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5a7fc700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c5c0cc320 0x7f1c5c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 -- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c5c0cc320 msgr2=0x7f1c5c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c5c0cc320 0x7f1c5c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 -- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c06a110 msgr2=0x7f1c5c1388e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c06a110 0x7f1c5c1388e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 -- 172.21.15.7:0/2339585051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009420 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c5b7fe700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 0x7f1c5c0c9af0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00cc20 tx=0x7f1c4c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.537+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c004dc0 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.538+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00a6a0 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.538+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00aa60 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.538+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c139030 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.538+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c1395f0 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.538+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c04c3c0 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.539+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1c4c007150 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.539+0000 7f1c52ffd700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c3c067290 0x7f1c3c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.539+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1c4c083ed0 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.540+0000 7f1c5affd700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c3c067290 0x7f1c3c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.540+0000 7f1c5affd700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c3c067290 0x7f1c3c069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009fd0 tx=0x7f1c54016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.544+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c4c050f30 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.736+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1c5c0cbc90 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.739+0000 7f1c52ffd700 1 -- 172.21.15.7:0/2339585051 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c4c0180c0 con 0x7f1c5c0cc6f0 2023-10-14T19:09:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c3c067290 msgr2=0x7f1c3c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c3c067290 0x7f1c3c069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009fd0 tx=0x7f1c54016000 comp rx=0 tx=0).stop 2023-10-14T19:09:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 msgr2=0x7f1c5c0c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 0x7f1c5c0c9af0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00cc20 tx=0x7f1c4c0015b0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 shutdown_connections 2023-10-14T19:09:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1c3c067290 0x7f1c3c069740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c5c06a110 0x7f1c5c1388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0cc6f0 0x7f1c5c0c9af0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 --2- 172.21.15.7:0/2339585051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c5c0cc320 0x7f1c5c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 >> 172.21.15.7:0/2339585051 conn(0x7f1c5c067f00 msgr2=0x7f1c5c0682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:05.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 shutdown_connections 2023-10-14T19:09:05.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.742+0000 7f1c619b4700 1 -- 172.21.15.7:0/2339585051 wait complete. 2023-10-14T19:09:05.754 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:09:05.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:09:05.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:09:05.838 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:09:05.839 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:09:05.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:05.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.959+0000 7f3e32ae1700 1 Processor -- start 2023-10-14T19:09:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.959+0000 7f3e32ae1700 1 -- start start 2023-10-14T19:09:05.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e32ae1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 0x7f3e2c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e32ae1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3e2c0a90d0 0x7f3e2c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e32ae1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c06e7f0 con 0x7f3e2c06e380 2023-10-14T19:09:05.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e32ae1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ae680 con 0x7f3e2c0a90d0 2023-10-14T19:09:05.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e32ae1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0aeee0 con 0x7f3e2c0a8d00 2023-10-14T19:09:05.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e3107e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3e2c06e380 0x7f3e2c0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40272/0 (socket says 172.21.15.7:40272) 2023-10-14T19:09:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.960+0000 7f3e3107e700 1 -- 172.21.15.7:0/1873956667 learned_addr learned my addr 172.21.15.7:0/1873956667 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/1873956667 >> v2:172.21.15.148:3300/0 conn(0x7f3e2c0a90d0 0x7f3e2c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 0x7f3e2c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935966536 0 0) 0x7f3e2c06e7f0 con 0x7f3e2c06e380 2023-10-14T19:09:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e18003570 con 0x7f3e2c06e380 2023-10-14T19:09:05.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739275226 0 0) 0x7f3e18003570 con 0x7f3e2c06e380 2023-10-14T19:09:05.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 msgr2=0x7f3e2c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:05.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 0x7f3e2c0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 >> v2:172.21.15.148:3300/0 conn(0x7f3e2c0a90d0 msgr2=0x7f3e2c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:05.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 --2- 172.21.15.7:0/1873956667 >> v2:172.21.15.148:3300/0 conn(0x7f3e2c0a90d0 0x7f3e2c06de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0cf490 con 0x7f3e2c06e380 2023-10-14T19:09:05.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f3e1c001470 con 0x7f3e2c06e380 2023-10-14T19:09:05.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 >> v1:172.21.15.7:6789/0 conn(0x7f3e2c06e380 legacy=0x7f3e2c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e18004810 0x7f3e18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 0x7f3e180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ae680 con 0x7f3e18003a60 2023-10-14T19:09:05.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0aeee0 con 0x7f3e18004810 2023-10-14T19:09:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1800ba60 con 0x7f3e2c0a8d00 2023-10-14T19:09:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e18004810 0x7f3e18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3107e700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 0x7f3e180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 -- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 msgr2=0x7f3e180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:05.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c0a8d00 0x7f3e180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 -- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e18004810 msgr2=0x7f3e18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:05.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e18004810 0x7f3e18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e3087d700 1 -- 172.21.15.7:0/1873956667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18003570 con 0x7f3e18003a60 2023-10-14T19:09:05.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.961+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e18004810 0x7f3e18004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e3087d700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e18003e70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400e300 tx=0x7f3e2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1dfc68acd628e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400eb50 con 0x7f3e18003a60 2023-10-14T19:09:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400f040 con 0x7f3e18003a60 2023-10-14T19:09:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e2b7fe700 1 -- 172.21.15.7:0/1873956667 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24014480 con 0x7f3e18003a60 2023-10-14T19:09:05.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e32ae1700 1 -- 172.21.15.7:0/1873956667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 msgr2=0x7f3e18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/1873956667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e18003e70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400e300 tx=0x7f3e2400b040 comp rx=0 tx=0).stop 2023-10-14T19:09:05.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e3107e700 1 -- 172.21.15.7:0/1873956667 reap_dead start 2023-10-14T19:09:05.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e32ae1700 1 -- 172.21.15.7:0/1873956667 shutdown_connections 2023-10-14T19:09:05.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e32ae1700 1 -- 172.21.15.7:0/1873956667 >> 172.21.15.7:0/1873956667 conn(0x7f3e2c06ce80 msgr2=0x7f3e2c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:05.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e32ae1700 1 -- 172.21.15.7:0/1873956667 shutdown_connections 2023-10-14T19:09:05.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.962+0000 7f3e32ae1700 1 -- 172.21.15.7:0/1873956667 wait complete. 2023-10-14T19:09:05.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.963+0000 7f3e32ae1700 1 Processor -- start 2023-10-14T19:09:05.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 -- start start 2023-10-14T19:09:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e2c099130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e2c099670 0x7f3e2c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c155670 0x7f3e2c1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c154d10 con 0x7f3e18003a60 2023-10-14T19:09:05.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c154090 con 0x7f3e2c099670 2023-10-14T19:09:05.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e32ae1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c154370 con 0x7f3e2c155670 2023-10-14T19:09:05.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e3087d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e2c099130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e3087d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e2c099130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43164/0 (socket says 172.21.15.7:43164) 2023-10-14T19:09:05.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.964+0000 7f3e3087d700 1 -- 172.21.15.7:0/3991803460 learned_addr learned my addr 172.21.15.7:0/3991803460 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:05.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3107e700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c155670 0x7f3e2c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e2c099670 0x7f3e2c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3087d700 1 -- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c155670 msgr2=0x7f3e2c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3087d700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c155670 0x7f3e2c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3087d700 1 -- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e2c099670 msgr2=0x7f3e2c155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:05.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3087d700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e2c099670 0x7f3e2c155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:05.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3087d700 1 -- 172.21.15.7:0/3991803460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c154650 con 0x7f3e18003a60 2023-10-14T19:09:05.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e2c099670 0x7f3e2c155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:05.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e3087d700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e2c099130 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009c80 tx=0x7f3e2401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:05.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2401d420 con 0x7f3e18003a60 2023-10-14T19:09:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2401d580 con 0x7f3e18003a60 2023-10-14T19:09:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c154930 con 0x7f3e18003a60 2023-10-14T19:09:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2401d940 con 0x7f3e18003a60 2023-10-14T19:09:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.965+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c158f20 con 0x7f3e18003a60 2023-10-14T19:09:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.966+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c155a70 con 0x7f3e18003a60 2023-10-14T19:09:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.967+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3e24003040 con 0x7f3e18003a60 2023-10-14T19:09:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.967+0000 7f3e28ff9700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e0c067290 0x7f3e0c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.967+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3e24086950 con 0x7f3e18003a60 2023-10-14T19:09:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.967+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e0c067290 0x7f3e0c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.968+0000 7f3e2bfff700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e0c067290 0x7f3e0c069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e14006d60 tx=0x7f3e14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:05.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:05.971+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e24053a50 con 0x7f3e18003a60 2023-10-14T19:09:06.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.210+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e2c04c3c0 con 0x7f3e18003a60 2023-10-14T19:09:06.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.211+0000 7f3e28ff9700 1 -- 172.21.15.7:0/3991803460 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f3e24018070 con 0x7f3e18003a60 2023-10-14T19:09:06.211 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:06.211 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2579571399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2579571399},{"type":"v1","addr":"172.21.15.148:6836","nonce":2579571399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6070,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2884714105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2884714105},{"type":"v1","addr":"172.21.15.148:6837","nonce":2884714105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/1480078717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1480078717},{"type":"v1","addr":"172.21.15.7:6834","nonce":1480078717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2713823961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":2713823961},{"type":"v1","addr":"172.21.15.7:6835","nonce":2713823961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-10-14T19:09:06.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e0c067290 msgr2=0x7f3e0c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e0c067290 0x7f3e0c069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e14006d60 tx=0x7f3e14008040 comp rx=0 tx=0).stop 2023-10-14T19:09:06.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 msgr2=0x7f3e2c099130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e2c099130 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009c80 tx=0x7f3e2401a000 comp rx=0 tx=0).stop 2023-10-14T19:09:06.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 shutdown_connections 2023-10-14T19:09:06.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3e0c067290 0x7f3e0c069740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e2c155670 0x7f3e2c1589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e18003a60 0x7f3e2c099130 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 --2- 172.21.15.7:0/3991803460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e2c099670 0x7f3e2c155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 >> 172.21.15.7:0/3991803460 conn(0x7f3e2c06ce80 msgr2=0x7f3e2c152720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:06.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 shutdown_connections 2023-10-14T19:09:06.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.213+0000 7f3e32ae1700 1 -- 172.21.15.7:0/3991803460 wait complete. 2023-10-14T19:09:06.216 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 59 2023-10-14T19:09:06.225 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:09:06.226 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:09:06.226 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:09:06.227 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:06.227 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:09:06.227 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:09:06.228 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:09:06.228 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:06.228 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:09:06.228 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:09:06.229 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:09:06.229 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:06.229 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:09:06.230 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:09:06.230 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:09:06.230 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:06.235 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:09:06.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:09:06.236 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:09:06.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:09:06.240 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:09:06.240 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:09:06.241 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:09:06.241 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:09:06.279 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:09:06.279 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:06.280 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:09:06.281 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:06.283 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:09:06.283 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:06.284 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:09:06.284 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:06.285 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:09:06.354 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:09:06.355 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:09:06.367 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:09:06.367 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:09:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.415+0000 7f91264e9700 1 Processor -- start 2023-10-14T19:09:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.415+0000 7f91264e9700 1 -- start start 2023-10-14T19:09:06.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f91264e9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9120155b70 0x7f91200b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f91264e9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9120157510 con 0x7f91201589b0 2023-10-14T19:09:06.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f91264e9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200ae2f0 con 0x7f91200add80 2023-10-14T19:09:06.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f91264e9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91200ae5d0 con 0x7f9120155b70 2023-10-14T19:09:06.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f9124a86700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f91201589b0 0x7f9120156650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40298/0 (socket says 172.21.15.7:40298) 2023-10-14T19:09:06.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f9124a86700 1 -- 172.21.15.7:0/2987668804 learned_addr learned my addr 172.21.15.7:0/2987668804 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:06.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911ffff700 1 --2- 172.21.15.7:0/2987668804 >> v2:172.21.15.148:3300/0 conn(0x7f9120155b70 0x7f91200b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905628676 0 0) 0x7f9120157510 con 0x7f91201589b0 2023-10-14T19:09:06.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9108003570 con 0x7f91201589b0 2023-10-14T19:09:06.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 553016926 0 0) 0x7f9108003570 con 0x7f91201589b0 2023-10-14T19:09:06.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 >> v2:172.21.15.148:3300/0 conn(0x7f9120155b70 msgr2=0x7f91200b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:06.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 --2- 172.21.15.7:0/2987668804 >> v2:172.21.15.148:3300/0 conn(0x7f9120155b70 0x7f91200b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 >> v1:172.21.15.148:6789/0 conn(0x7f91200add80 legacy=0x7f9120155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200ae8b0 con 0x7f91201589b0 2023-10-14T19:09:06.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f91180017f0 con 0x7f91201589b0 2023-10-14T19:09:06.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 >> v1:172.21.15.7:6789/0 conn(0x7f91201589b0 legacy=0x7f9120156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f9108003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9108004810 0x7f9108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91080051c0 0x7f910800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200ae5d0 con 0x7f91080051c0 2023-10-14T19:09:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910800c050 con 0x7f9108003a60 2023-10-14T19:09:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.416+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910800c210 con 0x7f9108004810 2023-10-14T19:09:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f9108003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f9124a86700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91080051c0 0x7f910800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911f7fe700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9108004810 0x7f9108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 -- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9108004810 msgr2=0x7f9108004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9108004810 0x7f9108004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 -- 172.21.15.7:0/2987668804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91080051c0 msgr2=0x7f910800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91080051c0 0x7f910800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 -- 172.21.15.7:0/2987668804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108003570 con 0x7f9108003a60 2023-10-14T19:09:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f9124a86700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91080051c0 0x7f910800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:06.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f9124a86700 1 -- 172.21.15.7:0/2987668804 reap_dead start 2023-10-14T19:09:06.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911ffff700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f9108003e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9110009c30 tx=0x7f91100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b7e57217930673 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:06.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000e710 con 0x7f9108003a60 2023-10-14T19:09:06.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000e870 con 0x7f9108003a60 2023-10-14T19:09:06.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.417+0000 7f911effd700 1 -- 172.21.15.7:0/2987668804 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000ec30 con 0x7f9108003a60 2023-10-14T19:09:06.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 -- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 msgr2=0x7f9108003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f9108003e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9110009c30 tx=0x7f91100091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 -- 172.21.15.7:0/2987668804 shutdown_connections 2023-10-14T19:09:06.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 --2- 172.21.15.7:0/2987668804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f9108003e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 -- 172.21.15.7:0/2987668804 >> 172.21.15.7:0/2987668804 conn(0x7f912006d170 msgr2=0x7f91200cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:06.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 -- 172.21.15.7:0/2987668804 shutdown_connections 2023-10-14T19:09:06.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.418+0000 7f91264e9700 1 -- 172.21.15.7:0/2987668804 wait complete. 2023-10-14T19:09:06.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.419+0000 7f91264e9700 1 Processor -- start 2023-10-14T19:09:06.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.419+0000 7f91264e9700 1 -- start start 2023-10-14T19:09:06.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f912014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 0x7f912014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f912014e7e0 0x7f91201692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912014f010 con 0x7f912014bda0 2023-10-14T19:09:06.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91201496c0 con 0x7f9108003a60 2023-10-14T19:09:06.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912014a1a0 con 0x7f912014e7e0 2023-10-14T19:09:06.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 0x7f912014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 0x7f912014e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43236/0 (socket says 172.21.15.7:43236) 2023-10-14T19:09:06.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 -- 172.21.15.7:0/4277043565 learned_addr learned my addr 172.21.15.7:0/4277043565 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:06.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911ffff700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f912014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f9124a86700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f912014e7e0 0x7f91201692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 -- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f912014e7e0 msgr2=0x7f91201692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f912014e7e0 0x7f91201692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 -- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 msgr2=0x7f912014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:06.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f912014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:06.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 -- 172.21.15.7:0/4277043565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912014ec30 con 0x7f912014bda0 2023-10-14T19:09:06.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911ffff700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f912014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:06.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f911f7fe700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 0x7f912014e2a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9114002b30 tx=0x7f9114007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:06.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400f9a0 con 0x7f912014bda0 2023-10-14T19:09:06.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911400fb20 con 0x7f912014bda0 2023-10-14T19:09:06.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912014dd10 con 0x7f912014bda0 2023-10-14T19:09:06.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.420+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400fee0 con 0x7f912014bda0 2023-10-14T19:09:06.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.421+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912014e000 con 0x7f912014bda0 2023-10-14T19:09:06.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.421+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912014a310 con 0x7f912014bda0 2023-10-14T19:09:06.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.422+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f9114013600 con 0x7f912014bda0 2023-10-14T19:09:06.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.422+0000 7f9107fff700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f910c067290 0x7f910c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:06.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.422+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9114084f60 con 0x7f912014bda0 2023-10-14T19:09:06.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.423+0000 7f911ffff700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f910c067290 0x7f910c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:06.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.423+0000 7f911ffff700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f910c067290 0x7f910c069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9110009720 tx=0x7f911001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:06.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.426+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9114052080 con 0x7f912014bda0 2023-10-14T19:09:06.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:06.637+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f912004c3c0 con 0x7f912014bda0 2023-10-14T19:09:07.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.401+0000 7f9107fff700 1 -- 172.21.15.7:0/4277043565 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f91140556a0 con 0x7f912014bda0 2023-10-14T19:09:07.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f910c067290 msgr2=0x7f910c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f910c067290 0x7f910c069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9110009720 tx=0x7f911001a000 comp rx=0 tx=0).stop 2023-10-14T19:09:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 msgr2=0x7f912014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 0x7f912014e2a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9114002b30 tx=0x7f9114007d10 comp rx=0 tx=0).stop 2023-10-14T19:09:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 shutdown_connections 2023-10-14T19:09:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f910c067290 0x7f910c069740 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9108003a60 0x7f912014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f912014e7e0 0x7f91201692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 --2- 172.21.15.7:0/4277043565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912014bda0 0x7f912014e2a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 >> 172.21.15.7:0/4277043565 conn(0x7f912006d170 msgr2=0x7f9120153020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:07.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 shutdown_connections 2023-10-14T19:09:07.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.404+0000 7f91264e9700 1 -- 172.21.15.7:0/4277043565 wait complete. 2023-10-14T19:09:07.407 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:09:07.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:09:07.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.543+0000 7f5e5282d700 1 Processor -- start 2023-10-14T19:09:07.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.543+0000 7f5e5282d700 1 -- start start 2023-10-14T19:09:07.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e5282d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e4c0b07d0 0x7f5e4c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e5282d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e4c0cf200 0x7f5e4c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e5282d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c15a280 con 0x7f5e4c0b0ba0 2023-10-14T19:09:07.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e5282d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c06e180 con 0x7f5e4c0cf200 2023-10-14T19:09:07.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e5282d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0cd540 con 0x7f5e4c0b07d0 2023-10-14T19:09:07.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e4b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e4c0cf200 0x7f5e4c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e50dca700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5e4c0b0ba0 0x7f5e4c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34738/0 (socket says 172.21.15.7:34738) 2023-10-14T19:09:07.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.544+0000 7f5e50dca700 1 -- 172.21.15.7:0/1850054813 learned_addr learned my addr 172.21.15.7:0/1850054813 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:07.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4bfff700 1 --2- 172.21.15.7:0/1850054813 >> v2:172.21.15.148:3300/0 conn(0x7f5e4c0b07d0 0x7f5e4c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4b7fe700 1 -- 172.21.15.7:0/1850054813 >> v2:172.21.15.148:3300/0 conn(0x7f5e4c0b07d0 msgr2=0x7f5e4c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4b7fe700 1 --2- 172.21.15.7:0/1850054813 >> v2:172.21.15.148:3300/0 conn(0x7f5e4c0b07d0 0x7f5e4c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4b7fe700 1 -- 172.21.15.7:0/1850054813 >> v1:172.21.15.7:6789/0 conn(0x7f5e4c0b0ba0 legacy=0x7f5e4c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4b7fe700 1 -- 172.21.15.7:0/1850054813 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c06d850 con 0x7f5e4c0cf200 2023-10-14T19:09:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4affd700 1 -- 172.21.15.7:0/1850054813 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955128679 0 0) 0x7f5e4c15a280 con 0x7f5e4c0b0ba0 2023-10-14T19:09:07.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4bfff700 1 --2- 172.21.15.7:0/1850054813 >> v2:172.21.15.148:3300/0 conn(0x7f5e4c0b07d0 0x7f5e4c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:07.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4b7fe700 1 --2- 172.21.15.7:0/1850054813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c0cd000 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c064720 tx=0x7f5e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353c23ca29b3704b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:07.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4affd700 1 -- 172.21.15.7:0/1850054813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400b740 con 0x7f5e4c0cf200 2023-10-14T19:09:07.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4affd700 1 -- 172.21.15.7:0/1850054813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400b8a0 con 0x7f5e4c0cf200 2023-10-14T19:09:07.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e4affd700 1 -- 172.21.15.7:0/1850054813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400bc40 con 0x7f5e4c0cf200 2023-10-14T19:09:07.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e5282d700 1 -- 172.21.15.7:0/1850054813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 msgr2=0x7f5e4c0cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e5282d700 1 --2- 172.21.15.7:0/1850054813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c0cd000 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c064720 tx=0x7f5e340091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e5282d700 1 -- 172.21.15.7:0/1850054813 shutdown_connections 2023-10-14T19:09:07.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e5282d700 1 --2- 172.21.15.7:0/1850054813 >> v2:172.21.15.148:3300/0 conn(0x7f5e4c0b07d0 0x7f5e4c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e5282d700 1 --2- 172.21.15.7:0/1850054813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c0cd000 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.545+0000 7f5e5282d700 1 -- 172.21.15.7:0/1850054813 >> 172.21.15.7:0/1850054813 conn(0x7f5e4c06ce80 msgr2=0x7f5e4c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:07.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.546+0000 7f5e5282d700 1 -- 172.21.15.7:0/1850054813 shutdown_connections 2023-10-14T19:09:07.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.546+0000 7f5e5282d700 1 -- 172.21.15.7:0/1850054813 wait complete. 2023-10-14T19:09:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 Processor -- start 2023-10-14T19:09:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 -- start start 2023-10-14T19:09:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e4c0b07d0 0x7f5e4c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e4c0b0ba0 0x7f5e4c09b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c09b900 con 0x7f5e4c0cf200 2023-10-14T19:09:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c15e5f0 con 0x7f5e4c0b07d0 2023-10-14T19:09:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.547+0000 7f5e5282d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c15da20 con 0x7f5e4c0b0ba0 2023-10-14T19:09:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c15ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45374/0 (socket says 172.21.15.7:45374) 2023-10-14T19:09:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 -- 172.21.15.7:0/2262860805 learned_addr learned my addr 172.21.15.7:0/2262860805 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e4b7fe700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e4c0b0ba0 0x7f5e4c09b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e4bfff700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e4c0b07d0 0x7f5e4c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 -- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e4c0b0ba0 msgr2=0x7f5e4c09b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e4c0b0ba0 0x7f5e4c09b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 -- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e4c0b07d0 msgr2=0x7f5e4c15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e4c0b07d0 0x7f5e4c15afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 -- 172.21.15.7:0/2262860805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009420 con 0x7f5e4c0cf200 2023-10-14T19:09:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e4bfff700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e4c0b07d0 0x7f5e4c15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e50dca700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c15ea80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400cc90 tx=0x7f5e44001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400cea0 con 0x7f5e4c0cf200 2023-10-14T19:09:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c15dd20 con 0x7f5e4c0cf200 2023-10-14T19:09:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400ab30 con 0x7f5e4c0cf200 2023-10-14T19:09:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440070f0 con 0x7f5e4c0cf200 2023-10-14T19:09:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.548+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c09b610 con 0x7f5e4c0cf200 2023-10-14T19:09:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.549+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c15e760 con 0x7f5e4c0cf200 2023-10-14T19:09:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.550+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5e440074a0 con 0x7f5e4c0cf200 2023-10-14T19:09:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.550+0000 7f5e43fff700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e2c067290 0x7f5e2c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.550+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e44084d70 con 0x7f5e4c0cf200 2023-10-14T19:09:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.550+0000 7f5e4bfff700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e2c067290 0x7f5e2c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.551+0000 7f5e4bfff700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e2c067290 0x7f5e2c069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c008b00 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.554+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e44089070 con 0x7f5e4c0cf200 2023-10-14T19:09:07.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.825+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5e4c04c3c0 con 0x7f5e4c0cf200 2023-10-14T19:09:07.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.826+0000 7f5e43fff700 1 -- 172.21.15.7:0/2262860805 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5e44051d90 con 0x7f5e4c0cf200 2023-10-14T19:09:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:07.826 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:09:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:09:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:09:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:09:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:09:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:09:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:09:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:09:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:09:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:09:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:09:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:09:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:09:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:09:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:09:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:09:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:09:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:09:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:09:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:09:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:09:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:09:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:09:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:09:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:09:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:09:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:09:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:09:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:09:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:09:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:09:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:09:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:09:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:09:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:09:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:09:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:09:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:09:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:09:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:09:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:09:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:09:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:09:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:09:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:09:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:09:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:09:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:09:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:09:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:09:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:09:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:09:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:09:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:09:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:09:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:09:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:09:07.864 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:09:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e2c067290 msgr2=0x7f5e2c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e2c067290 0x7f5e2c069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c008b00 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2023-10-14T19:09:07.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 msgr2=0x7f5e4c15ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c15ea80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400cc90 tx=0x7f5e44001a20 comp rx=0 tx=0).stop 2023-10-14T19:09:07.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 shutdown_connections 2023-10-14T19:09:07.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e2c067290 0x7f5e2c069740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e4c0b07d0 0x7f5e4c15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e4c0cf200 0x7f5e4c15ea80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 --2- 172.21.15.7:0/2262860805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e4c0b0ba0 0x7f5e4c09b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 >> 172.21.15.7:0/2262860805 conn(0x7f5e4c06ce80 msgr2=0x7f5e4c158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 shutdown_connections 2023-10-14T19:09:07.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.828+0000 7f5e5282d700 1 -- 172.21.15.7:0/2262860805 wait complete. 2023-10-14T19:09:07.868 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.987+0000 7f2a2548f700 1 Processor -- start 2023-10-14T19:09:07.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.987+0000 7f2a2548f700 1 -- start start 2023-10-14T19:09:07.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a2548f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a20140e50 0x7f2a200af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a2548f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a2015b920 0x7f2a200cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a2548f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200af9d0 con 0x7f2a200af560 2023-10-14T19:09:07.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a2548f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200cb4d0 con 0x7f2a2015b920 2023-10-14T19:09:07.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a2548f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20158000 con 0x7f2a20140e50 2023-10-14T19:09:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a2015b920 0x7f2a200cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a1e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2a200af560 0x7f2a2015b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34748/0 (socket says 172.21.15.7:34748) 2023-10-14T19:09:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.988+0000 7f2a1e7fc700 1 -- 172.21.15.7:0/2889211851 learned_addr learned my addr 172.21.15.7:0/2889211851 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1effd700 1 --2- 172.21.15.7:0/2889211851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a20140e50 0x7f2a200af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1f7fe700 1 -- 172.21.15.7:0/2889211851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a20140e50 msgr2=0x7f2a200af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1f7fe700 1 --2- 172.21.15.7:0/2889211851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a20140e50 0x7f2a200af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1f7fe700 1 -- 172.21.15.7:0/2889211851 >> v1:172.21.15.7:6789/0 conn(0x7f2a200af560 legacy=0x7f2a2015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1f7fe700 1 -- 172.21.15.7:0/2889211851 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200cbd10 con 0x7f2a2015b920 2023-10-14T19:09:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1dffb700 1 -- 172.21.15.7:0/2889211851 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033548490 0 0) 0x7f2a200af9d0 con 0x7f2a200af560 2023-10-14T19:09:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1f7fe700 1 --2- 172.21.15.7:0/2889211851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015b920 0x7f2a200cc1a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009e60 tx=0x7f2a10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0ad563bc54ecd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1dffb700 1 -- 172.21.15.7:0/2889211851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000e070 con 0x7f2a2015b920 2023-10-14T19:09:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1dffb700 1 -- 172.21.15.7:0/2889211851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000bc30 con 0x7f2a2015b920 2023-10-14T19:09:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.989+0000 7f2a1dffb700 1 -- 172.21.15.7:0/2889211851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10012430 con 0x7f2a2015b920 2023-10-14T19:09:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 -- 172.21.15.7:0/2889211851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015b920 msgr2=0x7f2a200cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2889211851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015b920 0x7f2a200cc1a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009e60 tx=0x7f2a10009780 comp rx=0 tx=0).stop 2023-10-14T19:09:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 -- 172.21.15.7:0/2889211851 shutdown_connections 2023-10-14T19:09:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2889211851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015b920 0x7f2a200cc1a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2889211851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a20140e50 0x7f2a200af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 -- 172.21.15.7:0/2889211851 >> 172.21.15.7:0/2889211851 conn(0x7f2a200cded0 msgr2=0x7f2a2006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 -- 172.21.15.7:0/2889211851 shutdown_connections 2023-10-14T19:09:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.990+0000 7f2a2548f700 1 -- 172.21.15.7:0/2889211851 wait complete. 2023-10-14T19:09:07.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.991+0000 7f2a2548f700 1 Processor -- start 2023-10-14T19:09:07.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.991+0000 7f2a2548f700 1 -- start start 2023-10-14T19:09:07.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a2548f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a200af560 0x7f2a200c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a2548f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 0x7f2a2013f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a2548f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a2015b920 0x7f2a20159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:07.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a2548f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200a6c90 con 0x7f2a20140e50 2023-10-14T19:09:07.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a2548f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200c6ba0 con 0x7f2a2015b920 2023-10-14T19:09:07.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a2548f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200c6e80 con 0x7f2a200af560 2023-10-14T19:09:07.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 0x7f2a2013f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:07.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 0x7f2a2013f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45396/0 (socket says 172.21.15.7:45396) 2023-10-14T19:09:07.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 -- 172.21.15.7:0/2262057688 learned_addr learned my addr 172.21.15.7:0/2262057688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1effd700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a200af560 0x7f2a200c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1f7fe700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a2015b920 0x7f2a20159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 -- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a200af560 msgr2=0x7f2a200c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a200af560 0x7f2a200c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 -- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a2015b920 msgr2=0x7f2a20159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a2015b920 0x7f2a20159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 -- 172.21.15.7:0/2262057688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10009a20 con 0x7f2a20140e50 2023-10-14T19:09:08.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1effd700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a200af560 0x7f2a200c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:08.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a1e7fc700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 0x7f2a2013f1f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c810 tx=0x7f2a08007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.992+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08005c00 con 0x7f2a20140e50 2023-10-14T19:09:08.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.993+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08005d60 con 0x7f2a20140e50 2023-10-14T19:09:08.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.993+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08007340 con 0x7f2a20140e50 2023-10-14T19:09:08.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.993+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a200c7160 con 0x7f2a20140e50 2023-10-14T19:09:08.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.993+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a200c7720 con 0x7f2a20140e50 2023-10-14T19:09:08.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.994+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a200c7940 con 0x7f2a20140e50 2023-10-14T19:09:08.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.994+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2a0801b400 con 0x7f2a20140e50 2023-10-14T19:09:08.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.994+0000 7f2a16ffd700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2a00067290 0x7f2a00069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.995+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2a08084300 con 0x7f2a20140e50 2023-10-14T19:09:08.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.995+0000 7f2a1effd700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2a00067290 0x7f2a00069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.995+0000 7f2a1effd700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2a00067290 0x7f2a00069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2a18006fd0 tx=0x7f2a18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:07.999+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a08051430 con 0x7f2a20140e50 2023-10-14T19:09:08.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.192+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a2004c3c0 con 0x7f2a20140e50 2023-10-14T19:09:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.192+0000 7f2a16ffd700 1 -- 172.21.15.7:0/2262057688 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f2a08054a50 con 0x7f2a20140e50 2023-10-14T19:09:08.193 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:08.193 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":98,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:07.399530+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:08.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2a00067290 msgr2=0x7f2a00069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2a00067290 0x7f2a00069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2a18006fd0 tx=0x7f2a18008040 comp rx=0 tx=0).stop 2023-10-14T19:09:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 msgr2=0x7f2a2013f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 0x7f2a2013f1f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c810 tx=0x7f2a08007dd0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 shutdown_connections 2023-10-14T19:09:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2a00067290 0x7f2a00069740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a2015b920 0x7f2a20159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a200af560 0x7f2a200c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 --2- 172.21.15.7:0/2262057688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a20140e50 0x7f2a2013f1f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.194+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 >> 172.21.15.7:0/2262057688 conn(0x7f2a200cded0 msgr2=0x7f2a200cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.195+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 shutdown_connections 2023-10-14T19:09:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.195+0000 7f2a2548f700 1 -- 172.21.15.7:0/2262057688 wait complete. 2023-10-14T19:09:08.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:09:08.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:09:08.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.329+0000 7fdde8ed3700 1 Processor -- start 2023-10-14T19:09:08.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.329+0000 7fdde8ed3700 1 -- start start 2023-10-14T19:09:08.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.329+0000 7fdde8ed3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde4159530 0x7fdde40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.329+0000 7fdde8ed3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdde406e0e0 0x7fdde40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde8ed3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde40ccfd0 con 0x7fdde406dc70 2023-10-14T19:09:08.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde8ed3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde40cf0e0 con 0x7fdde406e0e0 2023-10-14T19:09:08.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde8ed3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415a3d0 con 0x7fdde4159530 2023-10-14T19:09:08.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdde406dc70 0x7fdde4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34754/0 (socket says 172.21.15.7:34754) 2023-10-14T19:09:08.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde1d9b700 1 -- 172.21.15.7:0/1590460097 learned_addr learned my addr 172.21.15.7:0/1590460097 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:08.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde259c700 1 --2- 172.21.15.7:0/1590460097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde4159530 0x7fdde40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde2d9d700 1 --2- 172.21.15.7:0/1590460097 >> v2:172.21.15.148:3300/0 conn(0x7fdde406e0e0 0x7fdde40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde159a700 1 -- 172.21.15.7:0/1590460097 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350072533 0 0) 0x7fdde40ccfd0 con 0x7fdde406dc70 2023-10-14T19:09:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde159a700 1 -- 172.21.15.7:0/1590460097 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd0003570 con 0x7fdde406dc70 2023-10-14T19:09:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde259c700 1 -- 172.21.15.7:0/1590460097 >> v2:172.21.15.148:3300/0 conn(0x7fdde406e0e0 msgr2=0x7fdde40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde259c700 1 --2- 172.21.15.7:0/1590460097 >> v2:172.21.15.148:3300/0 conn(0x7fdde406e0e0 0x7fdde40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde259c700 1 -- 172.21.15.7:0/1590460097 >> v1:172.21.15.7:6789/0 conn(0x7fdde406dc70 legacy=0x7fdde4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.330+0000 7fdde259c700 1 -- 172.21.15.7:0/1590460097 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde415a6b0 con 0x7fdde4159530 2023-10-14T19:09:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde259c700 1 --2- 172.21.15.7:0/1590460097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde4159530 0x7fdde40ceba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e60 tx=0x7fdddc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1b81074efa418d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde159a700 1 -- 172.21.15.7:0/1590460097 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00e070 con 0x7fdde4159530 2023-10-14T19:09:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde159a700 1 -- 172.21.15.7:0/1590460097 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc00bab0 con 0x7fdde4159530 2023-10-14T19:09:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde159a700 1 -- 172.21.15.7:0/1590460097 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00be30 con 0x7fdde4159530 2023-10-14T19:09:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1590460097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde4159530 msgr2=0x7fdde40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1590460097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde4159530 0x7fdde40ceba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e60 tx=0x7fdddc009780 comp rx=0 tx=0).stop 2023-10-14T19:09:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1590460097 shutdown_connections 2023-10-14T19:09:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1590460097 >> v2:172.21.15.148:3300/0 conn(0x7fdde406e0e0 0x7fdde40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1590460097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde4159530 0x7fdde40ceba0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1590460097 >> 172.21.15.7:0/1590460097 conn(0x7fdde40703a0 msgr2=0x7fdde40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:08.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1590460097 shutdown_connections 2023-10-14T19:09:08.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.331+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1590460097 wait complete. 2023-10-14T19:09:08.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.332+0000 7fdde8ed3700 1 Processor -- start 2023-10-14T19:09:08.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.332+0000 7fdde8ed3700 1 -- start start 2023-10-14T19:09:08.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.333+0000 7fdde8ed3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde406dc70 0x7fdde40c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.333+0000 7fdde8ed3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde406e0e0 0x7fdde40ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.333+0000 7fdde8ed3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdde4159530 0x7fdde4143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.333+0000 7fdde8ed3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415d390 con 0x7fdde406e0e0 2023-10-14T19:09:08.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.333+0000 7fdde8ed3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40caa10 con 0x7fdde4159530 2023-10-14T19:09:08.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.333+0000 7fdde8ed3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415ca60 con 0x7fdde406dc70 2023-10-14T19:09:08.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde259c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde406dc70 0x7fdde40c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde259c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde406dc70 0x7fdde40c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:54268/0 (socket says 172.21.15.7:54268) 2023-10-14T19:09:08.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde259c700 1 -- 172.21.15.7:0/1070299126 learned_addr learned my addr 172.21.15.7:0/1070299126 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:08.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdde4159530 0x7fdde4143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde1d9b700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde406e0e0 0x7fdde40ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 -- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde406dc70 msgr2=0x7fdde40c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde406dc70 0x7fdde40c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 -- 172.21.15.7:0/1070299126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde406e0e0 msgr2=0x7fdde40ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde406e0e0 0x7fdde40ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 -- 172.21.15.7:0/1070299126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009a20 con 0x7fdde4159530 2023-10-14T19:09:08.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.334+0000 7fdde2d9d700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdde4159530 0x7fdde4143d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009fd0 tx=0x7fddd40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.335+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4013680 con 0x7fdde4159530 2023-10-14T19:09:08.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.335+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4013800 con 0x7fdde4159530 2023-10-14T19:09:08.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.335+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde415cd40 con 0x7fdde4159530 2023-10-14T19:09:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.335+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4013bc0 con 0x7fdde4159530 2023-10-14T19:09:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.335+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40ca6c0 con 0x7fdde4159530 2023-10-14T19:09:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.336+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde415d500 con 0x7fdde4159530 2023-10-14T19:09:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.336+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fddd400c3e0 con 0x7fdde4159530 2023-10-14T19:09:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.337+0000 7fddda7fc700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddc4067290 0x7fddc4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.337+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fddd4084580 con 0x7fdde4159530 2023-10-14T19:09:08.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.337+0000 7fdde259c700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddc4067290 0x7fddc4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.337+0000 7fdde259c700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddc4067290 0x7fddc4069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0097c0 tx=0x7fdddc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.342+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddd40551c0 con 0x7fdde4159530 2023-10-14T19:09:08.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.535+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdde404c3c0 con 0x7fdde4159530 2023-10-14T19:09:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.535+0000 7fddda7fc700 1 -- 172.21.15.7:0/1070299126 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddd4054d50 con 0x7fdde4159530 2023-10-14T19:09:08.536 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:09:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddc4067290 msgr2=0x7fddc4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddc4067290 0x7fddc4069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0097c0 tx=0x7fdddc019000 comp rx=0 tx=0).stop 2023-10-14T19:09:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdde4159530 msgr2=0x7fdde4143d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdde4159530 0x7fdde4143d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009fd0 tx=0x7fddd40091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 shutdown_connections 2023-10-14T19:09:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fddc4067290 0x7fddc4069740 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdde4159530 0x7fdde4143d80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdde406dc70 0x7fdde40c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 --2- 172.21.15.7:0/1070299126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde406e0e0 0x7fdde40ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.537+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 >> 172.21.15.7:0/1070299126 conn(0x7fdde40703a0 msgr2=0x7fdde40b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.538+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 shutdown_connections 2023-10-14T19:09:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.538+0000 7fdde8ed3700 1 -- 172.21.15.7:0/1070299126 wait complete. 2023-10-14T19:09:08.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:09:08.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.669+0000 7fe7062ee700 1 Processor -- start 2023-10-14T19:09:08.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.669+0000 7fe7062ee700 1 -- start start 2023-10-14T19:09:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe7062ee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 0x7fe700164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe7062ee700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70015afd0 con 0x7fe700153c30 2023-10-14T19:09:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe7062ee700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70015b2b0 con 0x7fe70015de50 2023-10-14T19:09:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe7062ee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70015b590 con 0x7fe7000cf110 2023-10-14T19:09:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe7052ec700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe700153c30 0x7fe70015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34762/0 (socket says 172.21.15.7:34762) 2023-10-14T19:09:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe7052ec700 1 -- 172.21.15.7:0/2631333442 learned_addr learned my addr 172.21.15.7:0/2631333442 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe705aed700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 0x7fe700164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813453561 0 0) 0x7fe70015afd0 con 0x7fe700153c30 2023-10-14T19:09:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.670+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e8003570 con 0x7fe700153c30 2023-10-14T19:09:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366059543 0 0) 0x7fe6e8003570 con 0x7fe700153c30 2023-10-14T19:09:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 msgr2=0x7fe700164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 0x7fe700164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 >> v1:172.21.15.148:6789/0 conn(0x7fe70015de50 legacy=0x7fe7000cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70015b870 con 0x7fe700153c30 2023-10-14T19:09:08.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fe6f80017f0 con 0x7fe700153c30 2023-10-14T19:09:08.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 >> v1:172.21.15.7:6789/0 conn(0x7fe700153c30 legacy=0x7fe70015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 0x7fe6e8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6e8004010 0x7fe6e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6e8004d50 0x7fe6e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70015b590 con 0x7fe6e8004d50 2023-10-14T19:09:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e800bbf0 con 0x7fe6e8004010 2023-10-14T19:09:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e800bdb0 con 0x7fe7000cf110 2023-10-14T19:09:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6e8004d50 0x7fe6e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe7052ec700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 0x7fe6e8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe704aeb700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6e8004010 0x7fe6e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 -- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 msgr2=0x7fe6e8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000cf110 0x7fe6e8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 -- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6e8004010 msgr2=0x7fe6e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6e8004010 0x7fe6e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 -- 172.21.15.7:0/2631333442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8003570 con 0x7fe6e8004d50 2023-10-14T19:09:08.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe704aeb700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6e8004010 0x7fe6e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:08.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.671+0000 7fe705aed700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6e8004d50 0x7fe6e80051c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0006f00 tx=0x7fe6f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3c5ef36e0b61af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000e710 con 0x7fe6e8004d50 2023-10-14T19:09:08.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000e870 con 0x7fe6e8004d50 2023-10-14T19:09:08.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe6fffff700 1 -- 172.21.15.7:0/2631333442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000ec30 con 0x7fe6e8004d50 2023-10-14T19:09:08.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe7062ee700 1 -- 172.21.15.7:0/2631333442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6e8004d50 msgr2=0x7fe6e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe7062ee700 1 --2- 172.21.15.7:0/2631333442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6e8004d50 0x7fe6e80051c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0006f00 tx=0x7fe6f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe705aed700 1 -- 172.21.15.7:0/2631333442 reap_dead start 2023-10-14T19:09:08.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe7062ee700 1 -- 172.21.15.7:0/2631333442 shutdown_connections 2023-10-14T19:09:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe7062ee700 1 -- 172.21.15.7:0/2631333442 >> 172.21.15.7:0/2631333442 conn(0x7fe7000703a0 msgr2=0x7fe7000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe7062ee700 1 -- 172.21.15.7:0/2631333442 shutdown_connections 2023-10-14T19:09:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.672+0000 7fe7062ee700 1 -- 172.21.15.7:0/2631333442 wait complete. 2023-10-14T19:09:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.673+0000 7fe7062ee700 1 Processor -- start 2023-10-14T19:09:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.673+0000 7fe7062ee700 1 -- start start 2023-10-14T19:09:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7062ee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 0x7fe7000c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7062ee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000b3510 0x7fe7000cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7062ee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7000cc620 0x7fe7000c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7062ee700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000ccaa0 con 0x7fe700153180 2023-10-14T19:09:08.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7062ee700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000b3980 con 0x7fe7000cc620 2023-10-14T19:09:08.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7062ee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000c8da0 con 0x7fe7000b3510 2023-10-14T19:09:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 0x7fe7000c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 0x7fe7000c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45414/0 (socket says 172.21.15.7:45414) 2023-10-14T19:09:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 -- 172.21.15.7:0/1316591833 learned_addr learned my addr 172.21.15.7:0/1316591833 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe704aeb700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000b3510 0x7fe7000cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe705aed700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7000cc620 0x7fe7000c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 -- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000b3510 msgr2=0x7fe7000cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000b3510 0x7fe7000cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 -- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7000cc620 msgr2=0x7fe7000c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.674+0000 7fe7052ec700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7000cc620 0x7fe7000c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe7052ec700 1 -- 172.21.15.7:0/1316591833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000c9080 con 0x7fe700153180 2023-10-14T19:09:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe7052ec700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 0x7fe7000c86a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800a640 tx=0x7fe700159c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80133f0 con 0x7fe700153180 2023-10-14T19:09:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8013550 con 0x7fe700153180 2023-10-14T19:09:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000c9360 con 0x7fe700153180 2023-10-14T19:09:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8013910 con 0x7fe700153180 2023-10-14T19:09:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.675+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000c9920 con 0x7fe700153180 2023-10-14T19:09:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.676+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70004c3c0 con 0x7fe700153180 2023-10-14T19:09:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.676+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe6f8013c80 con 0x7fe700153180 2023-10-14T19:09:08.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.677+0000 7fe6fd7fa700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6ec067290 0x7fe6ec069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:08.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.677+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe6f8085690 con 0x7fe700153180 2023-10-14T19:09:08.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.677+0000 7fe704aeb700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6ec067290 0x7fe6ec069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:08.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.677+0000 7fe704aeb700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6ec067290 0x7fe6ec069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4003a00 tx=0x7fe6f400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:08.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.681+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6f8052840 con 0x7fe700153180 2023-10-14T19:09:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.874+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe7000caef0 con 0x7fe700153180 2023-10-14T19:09:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.874+0000 7fe6fd7fa700 1 -- 172.21.15.7:0/1316591833 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe6f8055e60 con 0x7fe700153180 2023-10-14T19:09:08.876 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:08.876 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:09:08.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:08.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:09:08.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:09:08.877 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:09:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6ec067290 msgr2=0x7fe6ec069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6ec067290 0x7fe6ec069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4003a00 tx=0x7fe6f400c040 comp rx=0 tx=0).stop 2023-10-14T19:09:08.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 msgr2=0x7fe7000c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:08.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 0x7fe7000c86a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800a640 tx=0x7fe700159c60 comp rx=0 tx=0).stop 2023-10-14T19:09:08.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 shutdown_connections 2023-10-14T19:09:08.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6ec067290 0x7fe6ec069740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7000cc620 0x7fe7000c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe700153180 0x7fe7000c86a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 --2- 172.21.15.7:0/1316591833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7000b3510 0x7fe7000cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:08.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 >> 172.21.15.7:0/1316591833 conn(0x7fe7000703a0 msgr2=0x7fe70006d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:08.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 shutdown_connections 2023-10-14T19:09:08.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:08.876+0000 7fe7062ee700 1 -- 172.21.15.7:0/1316591833 wait complete. 2023-10-14T19:09:08.889 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:09:08.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:09:09.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.013+0000 7f466c12b700 1 Processor -- start 2023-10-14T19:09:09.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.014+0000 7f466c12b700 1 -- start start 2023-10-14T19:09:09.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.014+0000 7f466c12b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f466415de80 0x7f4664159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.014+0000 7f466c12b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 0x7f46640c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.014+0000 7f466c12b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466415d9f0 con 0x7f4664067e50 2023-10-14T19:09:09.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.014+0000 7f466c12b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466415d3c0 con 0x7f466415de80 2023-10-14T19:09:09.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.014+0000 7f466c12b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466415a8f0 con 0x7f466415a300 2023-10-14T19:09:09.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 0x7f46640c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 0x7f46640c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:54300/0 (socket says 172.21.15.7:54300) 2023-10-14T19:09:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 -- 172.21.15.7:0/3000435680 learned_addr learned my addr 172.21.15.7:0/3000435680 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f46696c6700 1 --2- 172.21.15.7:0/3000435680 >> v2:172.21.15.148:3300/0 conn(0x7f466415de80 0x7f4664159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 -- 172.21.15.7:0/3000435680 >> v2:172.21.15.148:3300/0 conn(0x7f466415de80 msgr2=0x7f4664159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 --2- 172.21.15.7:0/3000435680 >> v2:172.21.15.148:3300/0 conn(0x7f466415de80 0x7f4664159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 -- 172.21.15.7:0/3000435680 >> v1:172.21.15.148:6789/0 conn(0x7f4664067e50 legacy=0x7f4664068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f4668ec5700 1 -- 172.21.15.7:0/3000435680 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539963718 0 0) 0x7f466415d9f0 con 0x7f4664067e50 2023-10-14T19:09:09.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 -- 172.21.15.7:0/3000435680 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466415abd0 con 0x7f466415a300 2023-10-14T19:09:09.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.015+0000 7f466a6c8700 1 --2- 172.21.15.7:0/3000435680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 0x7f46640c8c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4654009f20 tx=0x7f4654009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3152c9b9a1c789 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:09.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f4668ec5700 1 -- 172.21.15.7:0/3000435680 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400e070 con 0x7f466415a300 2023-10-14T19:09:09.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f4668ec5700 1 -- 172.21.15.7:0/3000435680 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400b9d0 con 0x7f466415a300 2023-10-14T19:09:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f4668ec5700 1 -- 172.21.15.7:0/3000435680 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540092e0 con 0x7f466415a300 2023-10-14T19:09:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 -- 172.21.15.7:0/3000435680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 msgr2=0x7f46640c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 --2- 172.21.15.7:0/3000435680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 0x7f46640c8c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4654009f20 tx=0x7f4654009840 comp rx=0 tx=0).stop 2023-10-14T19:09:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 -- 172.21.15.7:0/3000435680 shutdown_connections 2023-10-14T19:09:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 --2- 172.21.15.7:0/3000435680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415a300 0x7f46640c8c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 --2- 172.21.15.7:0/3000435680 >> v2:172.21.15.148:3300/0 conn(0x7f466415de80 0x7f4664159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 -- 172.21.15.7:0/3000435680 >> 172.21.15.7:0/3000435680 conn(0x7f46640ce4a0 msgr2=0x7f46640ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:09.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 -- 172.21.15.7:0/3000435680 shutdown_connections 2023-10-14T19:09:09.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.016+0000 7f466c12b700 1 -- 172.21.15.7:0/3000435680 wait complete. 2023-10-14T19:09:09.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.017+0000 7f466c12b700 1 Processor -- start 2023-10-14T19:09:09.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.017+0000 7f466c12b700 1 -- start start 2023-10-14T19:09:09.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466c12b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 0x7f466414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466c12b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f466415a300 0x7f466415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466c12b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415de80 0x7f466415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466c12b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466414bf60 con 0x7f4664067e50 2023-10-14T19:09:09.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466c12b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640b1250 con 0x7f466415a300 2023-10-14T19:09:09.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466c12b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466415cd50 con 0x7f466415de80 2023-10-14T19:09:09.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f4669ec7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 0x7f466414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f4669ec7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 0x7f466414ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45424/0 (socket says 172.21.15.7:45424) 2023-10-14T19:09:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f4669ec7700 1 -- 172.21.15.7:0/955754029 learned_addr learned my addr 172.21.15.7:0/955754029 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f46696c6700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f466415a300 0x7f466415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.018+0000 7f466a6c8700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415de80 0x7f466415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4669ec7700 1 -- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415de80 msgr2=0x7f466415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4669ec7700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415de80 0x7f466415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4669ec7700 1 -- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f466415a300 msgr2=0x7f466415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4669ec7700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f466415a300 0x7f466415bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4669ec7700 1 -- 172.21.15.7:0/955754029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654009ae0 con 0x7f4664067e50 2023-10-14T19:09:09.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4669ec7700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 0x7f466414ba20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c530 tx=0x7f465c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:09.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011590 con 0x7f4664067e50 2023-10-14T19:09:09.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c0116f0 con 0x7f4664067e50 2023-10-14T19:09:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640c22f0 con 0x7f4664067e50 2023-10-14T19:09:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011ab0 con 0x7f4664067e50 2023-10-14T19:09:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.019+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466415ca70 con 0x7f4664067e50 2023-10-14T19:09:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.020+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466404c3c0 con 0x7f4664067e50 2023-10-14T19:09:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.020+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f465c001010 con 0x7f4664067e50 2023-10-14T19:09:09.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.021+0000 7f4661ffb700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4650067290 0x7f4650069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.021+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f465c083c00 con 0x7f4664067e50 2023-10-14T19:09:09.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.021+0000 7f46696c6700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4650067290 0x7f4650069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.022+0000 7f46696c6700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4650067290 0x7f4650069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4664157440 tx=0x7f4658008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.025+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f465c050db0 con 0x7f4664067e50 2023-10-14T19:09:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.219+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f46640c96c0 con 0x7f4664067e50 2023-10-14T19:09:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.408+0000 7f4661ffb700 1 -- 172.21.15.7:0/955754029 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7f465c017070 con 0x7f4664067e50 2023-10-14T19:09:09.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.411+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4650067290 msgr2=0x7f4650069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4650067290 0x7f4650069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4664157440 tx=0x7f4658008040 comp rx=0 tx=0).stop 2023-10-14T19:09:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 msgr2=0x7f466414ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 0x7f466414ba20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c530 tx=0x7f465c00c8f0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 shutdown_connections 2023-10-14T19:09:09.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4650067290 0x7f4650069740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f466415de80 0x7f466415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4664067e50 0x7f466414ba20 secure :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c530 tx=0x7f465c00c8f0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 --2- 172.21.15.7:0/955754029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f466415a300 0x7f466415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.412+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 >> 172.21.15.7:0/955754029 conn(0x7f46640ce4a0 msgr2=0x7f46640cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:09.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.415+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 shutdown_connections 2023-10-14T19:09:09.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.415+0000 7f466c12b700 1 -- 172.21.15.7:0/955754029 wait complete. 2023-10-14T19:09:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:09:09.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:09:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.555+0000 7f3c4e13e700 1 Processor -- start 2023-10-14T19:09:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.555+0000 7f3c4e13e700 1 -- start start 2023-10-14T19:09:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c4e13e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 0x7f3c480ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c4e13e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 0x7f3c480cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c4e13e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480cf510 con 0x7f3c480ccfa0 2023-10-14T19:09:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c4e13e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480cc1e0 con 0x7f3c48159860 2023-10-14T19:09:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c4e13e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480ce900 con 0x7f3c480cbd90 2023-10-14T19:09:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c46ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 0x7f3c480cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c477fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 0x7f3c480ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c47fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3c480ccfa0 0x7f3c480cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:59524/0 (socket says 172.21.15.7:59524) 2023-10-14T19:09:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c46ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 0x7f3c480cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:54318/0 (socket says 172.21.15.7:54318) 2023-10-14T19:09:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c47fff700 1 -- 172.21.15.7:0/2698630812 learned_addr learned my addr 172.21.15.7:0/2698630812 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.556+0000 7f3c477fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 0x7f3c480ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:39224/0 (socket says 172.21.15.7:39224) 2023-10-14T19:09:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c46ffd700 1 -- 172.21.15.7:0/2698630812 >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 msgr2=0x7f3c480ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c46ffd700 1 --2- 172.21.15.7:0/2698630812 >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 0x7f3c480ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c46ffd700 1 -- 172.21.15.7:0/2698630812 >> v1:172.21.15.148:6789/0 conn(0x7f3c480ccfa0 legacy=0x7f3c480cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c467fc700 1 -- 172.21.15.7:0/2698630812 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701442118 0 0) 0x7f3c480cf510 con 0x7f3c480ccfa0 2023-10-14T19:09:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c46ffd700 1 -- 172.21.15.7:0/2698630812 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480cebe0 con 0x7f3c480cbd90 2023-10-14T19:09:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c477fe700 1 --2- 172.21.15.7:0/2698630812 >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 0x7f3c480ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c46ffd700 1 --2- 172.21.15.7:0/2698630812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 0x7f3c480cf9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0098d0 tx=0x7f3c3c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70b79864883bd54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c467fc700 1 -- 172.21.15.7:0/2698630812 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c005c10 con 0x7f3c480cbd90 2023-10-14T19:09:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c467fc700 1 -- 172.21.15.7:0/2698630812 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c005d70 con 0x7f3c480cbd90 2023-10-14T19:09:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c467fc700 1 -- 172.21.15.7:0/2698630812 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c006280 con 0x7f3c480cbd90 2023-10-14T19:09:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2698630812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 msgr2=0x7f3c480cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2698630812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 0x7f3c480cf9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0098d0 tx=0x7f3c3c009120 comp rx=0 tx=0).stop 2023-10-14T19:09:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.557+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2698630812 shutdown_connections 2023-10-14T19:09:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.558+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2698630812 >> v2:172.21.15.148:3300/0 conn(0x7f3c48159860 0x7f3c480ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.558+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2698630812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480cbd90 0x7f3c480cf9a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.558+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2698630812 >> 172.21.15.7:0/2698630812 conn(0x7f3c480999b0 msgr2=0x7f3c48070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.558+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2698630812 shutdown_connections 2023-10-14T19:09:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.558+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2698630812 wait complete. 2023-10-14T19:09:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.559+0000 7f3c4e13e700 1 Processor -- start 2023-10-14T19:09:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.559+0000 7f3c4e13e700 1 -- start start 2023-10-14T19:09:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.559+0000 7f3c4e13e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c480cbd90 0x7f3c48159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.559+0000 7f3c4e13e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480ccfa0 0x7f3c4815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.559+0000 7f3c4e13e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 0x7f3c48169740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c4e13e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4815aa10 con 0x7f3c48159860 2023-10-14T19:09:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c4e13e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4815acf0 con 0x7f3c480cbd90 2023-10-14T19:09:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c4e13e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4815afd0 con 0x7f3c480ccfa0 2023-10-14T19:09:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 0x7f3c48169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 0x7f3c48169740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45436/0 (socket says 172.21.15.7:45436) 2023-10-14T19:09:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 -- 172.21.15.7:0/2403979693 learned_addr learned my addr 172.21.15.7:0/2403979693 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c46ffd700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480ccfa0 0x7f3c4815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c477fe700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c480cbd90 0x7f3c48159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 -- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480ccfa0 msgr2=0x7f3c4815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480ccfa0 0x7f3c4815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 -- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c480cbd90 msgr2=0x7f3c48159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c480cbd90 0x7f3c48159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 -- 172.21.15.7:0/2403979693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c380093c0 con 0x7f3c48159860 2023-10-14T19:09:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c477fe700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c480cbd90 0x7f3c48159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c47fff700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 0x7f3c48169740 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000cc90 tx=0x7f3c40001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000a8b0 con 0x7f3c48159860 2023-10-14T19:09:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000aa10 con 0x7f3c48159860 2023-10-14T19:09:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c0093c0 con 0x7f3c48159860 2023-10-14T19:09:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000add0 con 0x7f3c48159860 2023-10-14T19:09:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.560+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480c77a0 con 0x7f3c48159860 2023-10-14T19:09:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.561+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c480c79c0 con 0x7f3c48159860 2023-10-14T19:09:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.562+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3c40007300 con 0x7f3c48159860 2023-10-14T19:09:09.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.562+0000 7f3c2f7fe700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c34067290 0x7f3c34069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:09.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.562+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3c40084d30 con 0x7f3c48159860 2023-10-14T19:09:09.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.563+0000 7f3c477fe700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c34067290 0x7f3c34069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:09.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.563+0000 7f3c477fe700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c34067290 0x7f3c34069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c480c99d0 tx=0x7f3c38009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:09.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.567+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c40051c70 con 0x7f3c48159860 2023-10-14T19:09:09.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:09.762+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3c4804c3c0 con 0x7f3c48159860 2023-10-14T19:09:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.411+0000 7f3c2f7fe700 1 -- 172.21.15.7:0/2403979693 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3c40055290 con 0x7f3c48159860 2023-10-14T19:09:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.416+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c34067290 msgr2=0x7f3c34069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.416+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c34067290 0x7f3c34069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c480c99d0 tx=0x7f3c38009120 comp rx=0 tx=0).stop 2023-10-14T19:09:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.416+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 msgr2=0x7f3c48169740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.416+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 0x7f3c48169740 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000cc90 tx=0x7f3c40001a80 comp rx=0 tx=0).stop 2023-10-14T19:09:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.417+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 shutdown_connections 2023-10-14T19:09:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.417+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3c34067290 0x7f3c34069740 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.417+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c480cbd90 0x7f3c48159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.417+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c48159860 0x7f3c48169740 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.417+0000 7f3c4e13e700 1 --2- 172.21.15.7:0/2403979693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c480ccfa0 0x7f3c4815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.417+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 >> 172.21.15.7:0/2403979693 conn(0x7f3c480999b0 msgr2=0x7f3c480b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.418+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 shutdown_connections 2023-10-14T19:09:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.419+0000 7f3c4e13e700 1 -- 172.21.15.7:0/2403979693 wait complete. 2023-10-14T19:09:10.431 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:09:10.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:09:10.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.571+0000 7f06c93b0700 1 Processor -- start 2023-10-14T19:09:10.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.571+0000 7f06c93b0700 1 -- start start 2023-10-14T19:09:10.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c93b0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06c40cf180 0x7f06c40ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:10.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c93b0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c415e010 con 0x7f06c41594d0 2023-10-14T19:09:10.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c93b0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c415d420 con 0x7f06c40cb1a0 2023-10-14T19:09:10.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c93b0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c415d6e0 con 0x7f06c40cf180 2023-10-14T19:09:10.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c27fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06c40cf180 0x7f06c40ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:10.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f06c41594d0 0x7f06c40cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34766/0 (socket says 172.21.15.7:34766) 2023-10-14T19:09:10.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c27fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06c40cf180 0x7f06c40ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45446/0 (socket says 172.21.15.7:45446) 2023-10-14T19:09:10.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c2ffd700 1 -- 172.21.15.7:0/2031841470 learned_addr learned my addr 172.21.15.7:0/2031841470 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:10.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c27fc700 1 -- 172.21.15.7:0/2031841470 >> v1:172.21.15.148:6789/0 conn(0x7f06c40cb1a0 legacy=0x7f06c4159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c27fc700 1 -- 172.21.15.7:0/2031841470 >> v1:172.21.15.7:6789/0 conn(0x7f06c41594d0 legacy=0x7f06c40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.572+0000 7f06c27fc700 1 -- 172.21.15.7:0/2031841470 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c415d9c0 con 0x7f06c40cf180 2023-10-14T19:09:10.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c27fc700 1 --2- 172.21.15.7:0/2031841470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c40ccfc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0098e0 tx=0x7f06ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b69b66ee520b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:10.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c1ffb700 1 -- 172.21.15.7:0/2031841470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac009e80 con 0x7f06c40cf180 2023-10-14T19:09:10.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c1ffb700 1 -- 172.21.15.7:0/2031841470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac00b860 con 0x7f06c40cf180 2023-10-14T19:09:10.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c1ffb700 1 -- 172.21.15.7:0/2031841470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac00bbe0 con 0x7f06c40cf180 2023-10-14T19:09:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 -- 172.21.15.7:0/2031841470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 msgr2=0x7f06c40ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 --2- 172.21.15.7:0/2031841470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c40ccfc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0098e0 tx=0x7f06ac0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 -- 172.21.15.7:0/2031841470 shutdown_connections 2023-10-14T19:09:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 --2- 172.21.15.7:0/2031841470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c40ccfc0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 -- 172.21.15.7:0/2031841470 >> 172.21.15.7:0/2031841470 conn(0x7f06c40703a0 msgr2=0x7f06c4070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:10.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 -- 172.21.15.7:0/2031841470 shutdown_connections 2023-10-14T19:09:10.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.573+0000 7f06c93b0700 1 -- 172.21.15.7:0/2031841470 wait complete. 2023-10-14T19:09:10.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 Processor -- start 2023-10-14T19:09:10.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 -- start start 2023-10-14T19:09:10.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06c40cb1a0 0x7f06c40c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:10.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:10.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06c41594d0 0x7f06c416b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:10.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40ca360 con 0x7f06c40cf180 2023-10-14T19:09:10.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40c9bb0 con 0x7f06c40cb1a0 2023-10-14T19:09:10.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c93b0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c416a170 con 0x7f06c41594d0 2023-10-14T19:09:10.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c27fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:10.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c27fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c415bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45458/0 (socket says 172.21.15.7:45458) 2023-10-14T19:09:10.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.575+0000 7f06c27fc700 1 -- 172.21.15.7:0/3537628303 learned_addr learned my addr 172.21.15.7:0/3537628303 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:10.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c2ffd700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06c40cb1a0 0x7f06c40c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:10.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c37fe700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06c41594d0 0x7f06c416b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:10.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c27fc700 1 -- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06c41594d0 msgr2=0x7f06c416b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c27fc700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06c41594d0 0x7f06c416b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c27fc700 1 -- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06c40cb1a0 msgr2=0x7f06c40c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c27fc700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06c40cb1a0 0x7f06c40c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c27fc700 1 -- 172.21.15.7:0/3537628303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac009420 con 0x7f06c40cf180 2023-10-14T19:09:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c27fc700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c415bbc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f06ac013000 tx=0x7f06ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac00b9d0 con 0x7f06c40cf180 2023-10-14T19:09:10.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac00bb30 con 0x7f06c40cf180 2023-10-14T19:09:10.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c415c100 con 0x7f06c40cf180 2023-10-14T19:09:10.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac025650 con 0x7f06c40cf180 2023-10-14T19:09:10.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.576+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c40c7d10 con 0x7f06c40cf180 2023-10-14T19:09:10.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.577+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c404c3c0 con 0x7f06c40cf180 2023-10-14T19:09:10.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.578+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f06ac023070 con 0x7f06c40cf180 2023-10-14T19:09:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.578+0000 7f06baffd700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f06a4067290 0x7f06a4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.578+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f06ac086120 con 0x7f06c40cf180 2023-10-14T19:09:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.578+0000 7f06c2ffd700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f06a4067290 0x7f06a4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.579+0000 7f06c2ffd700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f06a4067290 0x7f06a4069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00f380 tx=0x7f06bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.582+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06ac053060 con 0x7f06c40cf180 2023-10-14T19:09:10.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:10.819+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f06c415dca0 con 0x7f06c40cf180 2023-10-14T19:09:11.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.433+0000 7f06baffd700 1 -- 172.21.15.7:0/3537628303 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7f06ac056680 con 0x7f06c40cf180 2023-10-14T19:09:11.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.442+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f06a4067290 msgr2=0x7f06a4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.442+0000 7f06c93b0700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f06a4067290 0x7f06a4069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00f380 tx=0x7f06bc009040 comp rx=0 tx=0).stop 2023-10-14T19:09:11.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.442+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 msgr2=0x7f06c415bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.442+0000 7f06c93b0700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c415bbc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f06ac013000 tx=0x7f06ac017000 comp rx=0 tx=0).stop 2023-10-14T19:09:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.444+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 shutdown_connections 2023-10-14T19:09:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.444+0000 7f06c93b0700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f06a4067290 0x7f06a4069740 secure :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00f380 tx=0x7f06bc009040 comp rx=0 tx=0).stop 2023-10-14T19:09:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.444+0000 7f06c93b0700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06c40cb1a0 0x7f06c40c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.445+0000 7f06c93b0700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06c41594d0 0x7f06c416b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.445+0000 7f06c93b0700 1 --2- 172.21.15.7:0/3537628303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c40cf180 0x7f06c415bbc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.445+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 >> 172.21.15.7:0/3537628303 conn(0x7f06c40703a0 msgr2=0x7f06c40d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.447+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 shutdown_connections 2023-10-14T19:09:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.447+0000 7f06c93b0700 1 -- 172.21.15.7:0/3537628303 wait complete. 2023-10-14T19:09:11.457 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 16 and data pool 17 2023-10-14T19:09:11.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.595+0000 7ff3167e3700 1 Processor -- start 2023-10-14T19:09:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.595+0000 7ff3167e3700 1 -- start start 2023-10-14T19:09:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff3167e3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff310159920 0x7ff3100ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff3167e3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100acc00 con 0x7ff310159550 2023-10-14T19:09:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff3167e3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100abff0 con 0x7ff31015dfd0 2023-10-14T19:09:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff3167e3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100ac2d0 con 0x7ff310159920 2023-10-14T19:09:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff3157e1700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff310159550 0x7ff3100ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34774/0 (socket says 172.21.15.7:34774) 2023-10-14T19:09:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff3157e1700 1 -- 172.21.15.7:0/1046268436 learned_addr learned my addr 172.21.15.7:0/1046268436 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff315fe2700 1 --2- 172.21.15.7:0/1046268436 >> v2:172.21.15.148:3300/0 conn(0x7ff310159920 0x7ff3100ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585092832 0 0) 0x7ff3100acc00 con 0x7ff310159550 2023-10-14T19:09:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2fc003570 con 0x7ff310159550 2023-10-14T19:09:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052866143 0 0) 0x7ff3100abff0 con 0x7ff31015dfd0 2023-10-14T19:09:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3100acc00 con 0x7ff31015dfd0 2023-10-14T19:09:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff315fe2700 1 -- 172.21.15.7:0/1046268436 >> v1:172.21.15.148:6789/0 conn(0x7ff31015dfd0 legacy=0x7ff3100aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416344790 0 0) 0x7ff2fc003570 con 0x7ff310159550 2023-10-14T19:09:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff315fe2700 1 -- 172.21.15.7:0/1046268436 >> v1:172.21.15.7:6789/0 conn(0x7ff310159550 legacy=0x7ff3100ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.596+0000 7ff315fe2700 1 -- 172.21.15.7:0/1046268436 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100ac5b0 con 0x7ff310159920 2023-10-14T19:09:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff315fe2700 1 --2- 172.21.15.7:0/1046268436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159920 0x7ff3100ad090 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff308009e60 tx=0x7ff308009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c6be6fdee672b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30800e070 con 0x7ff310159920 2023-10-14T19:09:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30800b7a0 con 0x7ff310159920 2023-10-14T19:09:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff307fff700 1 -- 172.21.15.7:0/1046268436 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c001470 con 0x7ff310159920 2023-10-14T19:09:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff3167e3700 1 -- 172.21.15.7:0/1046268436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159920 msgr2=0x7ff3100ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff3167e3700 1 --2- 172.21.15.7:0/1046268436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159920 0x7ff3100ad090 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff308009e60 tx=0x7ff308009780 comp rx=0 tx=0).stop 2023-10-14T19:09:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff3167e3700 1 -- 172.21.15.7:0/1046268436 shutdown_connections 2023-10-14T19:09:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.597+0000 7ff3167e3700 1 --2- 172.21.15.7:0/1046268436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159920 0x7ff3100ad090 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.598+0000 7ff3167e3700 1 -- 172.21.15.7:0/1046268436 >> 172.21.15.7:0/1046268436 conn(0x7ff31006ce80 msgr2=0x7ff3100ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.598+0000 7ff3167e3700 1 -- 172.21.15.7:0/1046268436 shutdown_connections 2023-10-14T19:09:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.598+0000 7ff3167e3700 1 -- 172.21.15.7:0/1046268436 wait complete. 2023-10-14T19:09:11.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.599+0000 7ff3167e3700 1 Processor -- start 2023-10-14T19:09:11.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.599+0000 7ff3167e3700 1 -- start start 2023-10-14T19:09:11.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159550 0x7ff31014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 0x7ff31014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff31015dfd0 0x7ff31014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100b35e0 con 0x7ff310159920 2023-10-14T19:09:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31014d460 con 0x7ff310159550 2023-10-14T19:09:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100b29d0 con 0x7ff31015dfd0 2023-10-14T19:09:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 0x7ff31014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3157e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159550 0x7ff31014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 0x7ff31014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45460/0 (socket says 172.21.15.7:45460) 2023-10-14T19:09:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 -- 172.21.15.7:0/3000112505 learned_addr learned my addr 172.21.15.7:0/3000112505 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff315fe2700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff31015dfd0 0x7ff31014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 -- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff31015dfd0 msgr2=0x7ff31014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff31015dfd0 0x7ff31014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 -- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159550 msgr2=0x7ff31014cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159550 0x7ff31014cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 -- 172.21.15.7:0/3000112505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308009a20 con 0x7ff310159920 2023-10-14T19:09:11.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff314fe0700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 0x7ff31014e010 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c580 tx=0x7ff300007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:11.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300010510 con 0x7ff310159920 2023-10-14T19:09:11.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300010670 con 0x7ff310159920 2023-10-14T19:09:11.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300010a30 con 0x7ff310159920 2023-10-14T19:09:11.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3100b2cb0 con 0x7ff310159920 2023-10-14T19:09:11.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.600+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3100b3270 con 0x7ff310159920 2023-10-14T19:09:11.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.601+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31004c3c0 con 0x7ff310159920 2023-10-14T19:09:11.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.602+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ff30001b400 con 0x7ff310159920 2023-10-14T19:09:11.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.602+0000 7ff3057fa700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f4067290 0x7ff2f4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.602+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff300084660 con 0x7ff310159920 2023-10-14T19:09:11.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.602+0000 7ff3157e1700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f4067290 0x7ff2f4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.603+0000 7ff3157e1700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f4067290 0x7ff2f4069740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0011e0 tx=0x7ff30c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:11.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.607+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3000513c0 con 0x7ff310159920 2023-10-14T19:09:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.804+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff310152f60 con 0x7ff310159920 2023-10-14T19:09:11.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.805+0000 7ff3057fa700 1 -- 172.21.15.7:0/3000112505 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15329 (secure 0 0 0) 0x7ff3000549e0 con 0x7ff310159920 2023-10-14T19:09:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:11.806 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:10.821358+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:09.250495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:09.792938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f4067290 msgr2=0x7ff2f4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f4067290 0x7ff2f4069740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0011e0 tx=0x7ff30c000bc0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 msgr2=0x7ff31014e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 0x7ff31014e010 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c580 tx=0x7ff300007e10 comp rx=0 tx=0).stop 2023-10-14T19:09:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 shutdown_connections 2023-10-14T19:09:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff2f4067290 0x7ff2f4069740 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff310159550 0x7ff31014cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff31015dfd0 0x7ff31014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 --2- 172.21.15.7:0/3000112505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff310159920 0x7ff31014e010 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 >> 172.21.15.7:0/3000112505 conn(0x7ff31006ce80 msgr2=0x7ff3100afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 shutdown_connections 2023-10-14T19:09:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.807+0000 7ff3167e3700 1 -- 172.21.15.7:0/3000112505 wait complete. 2023-10-14T19:09:11.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 Processor -- start 2023-10-14T19:09:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 -- start start 2023-10-14T19:09:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1100cb5a0 0x7fc1100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc110159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11015ae40 con 0x7fc1100cde50 2023-10-14T19:09:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100d13f0 con 0x7fc1100cb5a0 2023-10-14T19:09:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.940+0000 7fc115737700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11015ab60 con 0x7fc1100cd9e0 2023-10-14T19:09:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1100cb5a0 0x7fc1100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc1100cde50 0x7fc110156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34786/0 (socket says 172.21.15.7:34786) 2023-10-14T19:09:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10f7fe700 1 -- 172.21.15.7:0/2683958477 learned_addr learned my addr 172.21.15.7:0/2683958477 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10e7fc700 1 --2- 172.21.15.7:0/2683958477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc110159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10effd700 1 -- 172.21.15.7:0/2683958477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 msgr2=0x7fc110159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10effd700 1 --2- 172.21.15.7:0/2683958477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc110159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10effd700 1 -- 172.21.15.7:0/2683958477 >> v1:172.21.15.7:6789/0 conn(0x7fc1100cde50 legacy=0x7fc110156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10effd700 1 -- 172.21.15.7:0/2683958477 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100ccf00 con 0x7fc1100cb5a0 2023-10-14T19:09:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10dffb700 1 -- 172.21.15.7:0/2683958477 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391491021 0 0) 0x7fc11015ae40 con 0x7fc1100cde50 2023-10-14T19:09:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10effd700 1 --2- 172.21.15.7:0/2683958477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1100cb5a0 0x7fc1100cb970 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc100009e60 tx=0x7fc100009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fce030ebd53dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10dffb700 1 -- 172.21.15.7:0/2683958477 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000e070 con 0x7fc1100cb5a0 2023-10-14T19:09:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10dffb700 1 -- 172.21.15.7:0/2683958477 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10000bb60 con 0x7fc1100cb5a0 2023-10-14T19:09:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.941+0000 7fc10dffb700 1 -- 172.21.15.7:0/2683958477 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100012430 con 0x7fc1100cb5a0 2023-10-14T19:09:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 -- 172.21.15.7:0/2683958477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1100cb5a0 msgr2=0x7fc1100cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 --2- 172.21.15.7:0/2683958477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1100cb5a0 0x7fc1100cb970 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc100009e60 tx=0x7fc100009780 comp rx=0 tx=0).stop 2023-10-14T19:09:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 -- 172.21.15.7:0/2683958477 shutdown_connections 2023-10-14T19:09:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 --2- 172.21.15.7:0/2683958477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1100cb5a0 0x7fc1100cb970 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 --2- 172.21.15.7:0/2683958477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc110159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 -- 172.21.15.7:0/2683958477 >> 172.21.15.7:0/2683958477 conn(0x7fc110070e30 msgr2=0x7fc1100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 -- 172.21.15.7:0/2683958477 shutdown_connections 2023-10-14T19:09:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.942+0000 7fc115737700 1 -- 172.21.15.7:0/2683958477 wait complete. 2023-10-14T19:09:11.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.943+0000 7fc115737700 1 Processor -- start 2023-10-14T19:09:11.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.943+0000 7fc115737700 1 -- start start 2023-10-14T19:09:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc115737700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1100cb5a0 0x7fc1101523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc115737700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc1100b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc115737700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 0x7fc110154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc115737700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b4f60 con 0x7fc11015c560 2023-10-14T19:09:11.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc115737700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b3e20 con 0x7fc1100cb5a0 2023-10-14T19:09:11.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc115737700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b4100 con 0x7fc1100cd9e0 2023-10-14T19:09:11.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 0x7fc110154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 0x7fc110154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45472/0 (socket says 172.21.15.7:45472) 2023-10-14T19:09:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 -- 172.21.15.7:0/1574895430 learned_addr learned my addr 172.21.15.7:0/1574895430 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10e7fc700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc1100b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10effd700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1100cb5a0 0x7fc1101523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 -- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 msgr2=0x7fc1100b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc1100b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 -- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1100cb5a0 msgr2=0x7fc1101523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:11.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1100cb5a0 0x7fc1101523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:11.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 -- 172.21.15.7:0/1574895430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100009a20 con 0x7fc11015c560 2023-10-14T19:09:11.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10e7fc700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc1100b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:11.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.944+0000 7fc10f7fe700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 0x7fc110154cf0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c530 tx=0x7fc108007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:11.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.945+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108005b30 con 0x7fc11015c560 2023-10-14T19:09:11.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.945+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108005c90 con 0x7fc11015c560 2023-10-14T19:09:11.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.945+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100b43e0 con 0x7fc11015c560 2023-10-14T19:09:11.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.945+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108007320 con 0x7fc11015c560 2023-10-14T19:09:11.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.945+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc110152930 con 0x7fc11015c560 2023-10-14T19:09:11.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.945+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11004c3c0 con 0x7fc11015c560 2023-10-14T19:09:11.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.946+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc10801b3b0 con 0x7fc11015c560 2023-10-14T19:09:11.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.946+0000 7fc106ffd700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc0f0067290 0x7fc0f0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:11.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.947+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc108084000 con 0x7fc11015c560 2023-10-14T19:09:11.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.947+0000 7fc10effd700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc0f0067290 0x7fc0f0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:11.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.947+0000 7fc10effd700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc0f0067290 0x7fc0f0069740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc1000097c0 tx=0x7fc100019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:11.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:11.951+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc108050e20 con 0x7fc11015c560 2023-10-14T19:09:12.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.146+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1100b50a0 con 0x7fc11015c560 2023-10-14T19:09:12.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.147+0000 7fc106ffd700 1 -- 172.21.15.7:0/1574895430 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fc108017020 con 0x7fc11015c560 2023-10-14T19:09:12.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:12.148 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:10.821358+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:09.250495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:09.792938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:12.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc0f0067290 msgr2=0x7fc0f0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:12.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc0f0067290 0x7fc0f0069740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc1000097c0 tx=0x7fc100019000 comp rx=0 tx=0).stop 2023-10-14T19:09:12.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 msgr2=0x7fc110154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:12.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 0x7fc110154cf0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c530 tx=0x7fc108007f90 comp rx=0 tx=0).stop 2023-10-14T19:09:12.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 shutdown_connections 2023-10-14T19:09:12.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc0f0067290 0x7fc0f0069740 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1100cb5a0 0x7fc1101523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11015c560 0x7fc110154cf0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 --2- 172.21.15.7:0/1574895430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1100cd9e0 0x7fc1100b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 >> 172.21.15.7:0/1574895430 conn(0x7fc110070e30 msgr2=0x7fc1100d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:12.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 shutdown_connections 2023-10-14T19:09:12.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.149+0000 7fc115737700 1 -- 172.21.15.7:0/1574895430 wait complete. 2023-10-14T19:09:12.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:09:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.285+0000 7f9d1012b700 1 Processor -- start 2023-10-14T19:09:12.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.285+0000 7f9d1012b700 1 -- start start 2023-10-14T19:09:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.285+0000 7f9d1012b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d080cc320 0x7f9d0813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d1012b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0806d7b0 con 0x7f9d0806a110 2023-10-14T19:09:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d1012b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0806e330 con 0x7f9d080cc6f0 2023-10-14T19:09:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d1012b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0806a570 con 0x7f9d080cc320 2023-10-14T19:09:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0dec7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9d080cc320 0x7f9d0813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0e6c8700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9d0806a110 0x7f9d0806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34802/0 (socket says 172.21.15.7:34802) 2023-10-14T19:09:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0e6c8700 1 -- 172.21.15.7:0/1809051369 learned_addr learned my addr 172.21.15.7:0/1809051369 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0dec7700 1 -- 172.21.15.7:0/1809051369 >> v1:172.21.15.148:6789/0 conn(0x7f9d080cc6f0 legacy=0x7f9d08069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0dec7700 1 -- 172.21.15.7:0/1809051369 >> v1:172.21.15.7:6789/0 conn(0x7f9d0806a110 legacy=0x7f9d0806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0dec7700 1 -- 172.21.15.7:0/1809051369 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0806da00 con 0x7f9d080cc320 2023-10-14T19:09:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0cec5700 1 -- 172.21.15.7:0/1809051369 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014130910 0 0) 0x7f9d0806d7b0 con 0x7f9d0806a110 2023-10-14T19:09:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0dec7700 1 --2- 172.21.15.7:0/1809051369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc320 0x7f9d0813c2a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009e60 tx=0x7f9d00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691a92ad7abee2b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0cec5700 1 -- 172.21.15.7:0/1809051369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000e070 con 0x7f9d080cc320 2023-10-14T19:09:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0cec5700 1 -- 172.21.15.7:0/1809051369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0000bbf0 con 0x7f9d080cc320 2023-10-14T19:09:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.286+0000 7f9d0cec5700 1 -- 172.21.15.7:0/1809051369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00012430 con 0x7f9d080cc320 2023-10-14T19:09:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 -- 172.21.15.7:0/1809051369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc320 msgr2=0x7f9d0813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 --2- 172.21.15.7:0/1809051369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc320 0x7f9d0813c2a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009e60 tx=0x7f9d00009780 comp rx=0 tx=0).stop 2023-10-14T19:09:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 -- 172.21.15.7:0/1809051369 shutdown_connections 2023-10-14T19:09:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 --2- 172.21.15.7:0/1809051369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc320 0x7f9d0813c2a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 -- 172.21.15.7:0/1809051369 >> 172.21.15.7:0/1809051369 conn(0x7f9d08067f00 msgr2=0x7f9d08068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:12.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 -- 172.21.15.7:0/1809051369 shutdown_connections 2023-10-14T19:09:12.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.287+0000 7f9d1012b700 1 -- 172.21.15.7:0/1809051369 wait complete. 2023-10-14T19:09:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.288+0000 7f9d1012b700 1 Processor -- start 2023-10-14T19:09:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.288+0000 7f9d1012b700 1 -- start start 2023-10-14T19:09:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d1012b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d0806a110 0x7f9d08169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d1012b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d080cc320 0x7f9d080c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d1012b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 0x7f9d080ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d1012b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0813b7c0 con 0x7f9d080cc6f0 2023-10-14T19:09:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d1012b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080c73f0 con 0x7f9d0806a110 2023-10-14T19:09:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d1012b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080c70c0 con 0x7f9d080cc320 2023-10-14T19:09:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 0x7f9d080ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 0x7f9d080ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45484/0 (socket says 172.21.15.7:45484) 2023-10-14T19:09:12.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 -- 172.21.15.7:0/443522191 learned_addr learned my addr 172.21.15.7:0/443522191 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:12.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0dec7700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d0806a110 0x7f9d08169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:12.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 -- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d080cc320 msgr2=0x7f9d080c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:12.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0d6c6700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d080cc320 0x7f9d080c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:12.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d080cc320 0x7f9d080c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 -- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d0806a110 msgr2=0x7f9d08169720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:12.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d0806a110 0x7f9d08169720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:12.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 -- 172.21.15.7:0/443522191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00009a20 con 0x7f9d080cc6f0 2023-10-14T19:09:12.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0dec7700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d0806a110 0x7f9d08169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:12.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.289+0000 7f9d0e6c8700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 0x7f9d080ae570 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800c7e0 tx=0x7f9cf8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:12.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.290+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8005b30 con 0x7f9d080cc6f0 2023-10-14T19:09:12.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.290+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8005c90 con 0x7f9d080cc6f0 2023-10-14T19:09:12.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.290+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d080a9a10 con 0x7f9d080cc6f0 2023-10-14T19:09:12.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.290+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8007320 con 0x7f9d080cc6f0 2023-10-14T19:09:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.290+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d080a9fd0 con 0x7f9d080cc6f0 2023-10-14T19:09:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.291+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d080c7560 con 0x7f9d080cc6f0 2023-10-14T19:09:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.291+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f9cf801b3b0 con 0x7f9d080cc6f0 2023-10-14T19:09:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.292+0000 7f9d05ffb700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9cf4067290 0x7f9cf4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.292+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9cf8083fa0 con 0x7f9d080cc6f0 2023-10-14T19:09:12.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.292+0000 7f9d0dec7700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9cf4067290 0x7f9cf4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:12.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.292+0000 7f9d0dec7700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9cf4067290 0x7f9cf4069740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9d000099f0 tx=0x7f9d00018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:12.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.296+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cf8050e00 con 0x7f9d080cc6f0 2023-10-14T19:09:12.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:12.537+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9d0804c3c0 con 0x7f9d080cc6f0 2023-10-14T19:09:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.448+0000 7f9d05ffb700 1 -- 172.21.15.7:0/443522191 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v63) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9cf8017020 con 0x7f9d080cc6f0 2023-10-14T19:09:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9cf4067290 msgr2=0x7f9cf4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9cf4067290 0x7f9cf4069740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9d000099f0 tx=0x7f9d00018000 comp rx=0 tx=0).stop 2023-10-14T19:09:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 msgr2=0x7f9d080ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 0x7f9d080ae570 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800c7e0 tx=0x7f9cf8007d90 comp rx=0 tx=0).stop 2023-10-14T19:09:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 shutdown_connections 2023-10-14T19:09:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9cf4067290 0x7f9cf4069740 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d0806a110 0x7f9d08169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d080cc6f0 0x7f9d080ae570 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 --2- 172.21.15.7:0/443522191 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d080cc320 0x7f9d080c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 >> 172.21.15.7:0/443522191 conn(0x7f9d08067f00 msgr2=0x7f9d080b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 shutdown_connections 2023-10-14T19:09:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.451+0000 7f9d1012b700 1 -- 172.21.15.7:0/443522191 wait complete. 2023-10-14T19:09:13.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:09:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.593+0000 7f360eb51700 1 Processor -- start 2023-10-14T19:09:13.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.593+0000 7f360eb51700 1 -- start start 2023-10-14T19:09:13.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360eb51700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3608159530 0x7f36080ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360eb51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f360806dc70 0x7f3608159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360eb51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806e0e0 0x7f36080cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360eb51700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080ccfd0 con 0x7f3608159530 2023-10-14T19:09:13.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360eb51700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080cf0e0 con 0x7f360806dc70 2023-10-14T19:09:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360eb51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360815a3d0 con 0x7f360806e0e0 2023-10-14T19:09:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360c8ed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3608159530 0x7f36080ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360c8ed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3608159530 0x7f36080ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45500/0 (socket says 172.21.15.7:45500) 2023-10-14T19:09:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360c8ed700 1 -- 172.21.15.7:0/749739782 learned_addr learned my addr 172.21.15.7:0/749739782 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f360d0ee700 1 --2- 172.21.15.7:0/749739782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806e0e0 0x7f36080cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.594+0000 7f3607fff700 1 --2- 172.21.15.7:0/749739782 >> v2:172.21.15.148:3300/0 conn(0x7f360806dc70 0x7f3608159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360c8ed700 1 -- 172.21.15.7:0/749739782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806e0e0 msgr2=0x7f36080cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360c8ed700 1 --2- 172.21.15.7:0/749739782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806e0e0 0x7f36080cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360c8ed700 1 -- 172.21.15.7:0/749739782 >> v2:172.21.15.148:3300/0 conn(0x7f360806dc70 msgr2=0x7f3608159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360c8ed700 1 --2- 172.21.15.7:0/749739782 >> v2:172.21.15.148:3300/0 conn(0x7f360806dc70 0x7f3608159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360c8ed700 1 -- 172.21.15.7:0/749739782 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360815a6b0 con 0x7f3608159530 2023-10-14T19:09:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f3607fff700 1 --2- 172.21.15.7:0/749739782 >> v2:172.21.15.148:3300/0 conn(0x7f360806dc70 0x7f3608159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360c8ed700 1 --2- 172.21.15.7:0/749739782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f36080ceba0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f36080b66e0 tx=0x7f3600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395a2e73b9d787a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f36077fe700 1 -- 172.21.15.7:0/749739782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600009e70 con 0x7f3608159530 2023-10-14T19:09:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f36077fe700 1 -- 172.21.15.7:0/749739782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360000b860 con 0x7f3608159530 2023-10-14T19:09:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f36077fe700 1 -- 172.21.15.7:0/749739782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000bc00 con 0x7f3608159530 2023-10-14T19:09:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360eb51700 1 -- 172.21.15.7:0/749739782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 msgr2=0x7f36080ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.595+0000 7f360eb51700 1 --2- 172.21.15.7:0/749739782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f36080ceba0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f36080b66e0 tx=0x7f3600009250 comp rx=0 tx=0).stop 2023-10-14T19:09:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 -- 172.21.15.7:0/749739782 shutdown_connections 2023-10-14T19:09:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 --2- 172.21.15.7:0/749739782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806e0e0 0x7f36080cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 --2- 172.21.15.7:0/749739782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f36080ceba0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 --2- 172.21.15.7:0/749739782 >> v2:172.21.15.148:3300/0 conn(0x7f360806dc70 0x7f3608159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 -- 172.21.15.7:0/749739782 >> 172.21.15.7:0/749739782 conn(0x7f36080703a0 msgr2=0x7f36080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 -- 172.21.15.7:0/749739782 shutdown_connections 2023-10-14T19:09:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.596+0000 7f360eb51700 1 -- 172.21.15.7:0/749739782 wait complete. 2023-10-14T19:09:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.597+0000 7f360eb51700 1 Processor -- start 2023-10-14T19:09:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.597+0000 7f360eb51700 1 -- start start 2023-10-14T19:09:13.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806dc70 0x7f3608153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360806e0e0 0x7f36080c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f3608154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080b4670 con 0x7f3608159530 2023-10-14T19:09:13.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080ca950 con 0x7f360806e0e0 2023-10-14T19:09:13.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608154440 con 0x7f360806dc70 2023-10-14T19:09:13.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f3608154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f3608154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45516/0 (socket says 172.21.15.7:45516) 2023-10-14T19:09:13.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 -- 172.21.15.7:0/1372750711 learned_addr learned my addr 172.21.15.7:0/1372750711 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:13.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f3607fff700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360806e0e0 0x7f36080c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360c8ed700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806dc70 0x7f3608153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 -- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806dc70 msgr2=0x7f3608153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806dc70 0x7f3608153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 -- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360806e0e0 msgr2=0x7f36080c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360806e0e0 0x7f36080c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 -- 172.21.15.7:0/1372750711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000094f0 con 0x7f3608159530 2023-10-14T19:09:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360d0ee700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f3608154dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f35f000ea50 tx=0x7f35f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:13.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000ee90 con 0x7f3608159530 2023-10-14T19:09:13.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f000c7f0 con 0x7f3608159530 2023-10-14T19:09:13.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36081548d0 con 0x7f3608159530 2023-10-14T19:09:13.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000cbb0 con 0x7f3608159530 2023-10-14T19:09:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.598+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36080ca390 con 0x7f3608159530 2023-10-14T19:09:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.599+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36080b4440 con 0x7f3608159530 2023-10-14T19:09:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.600+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f35f0013470 con 0x7f3608159530 2023-10-14T19:09:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.600+0000 7f3604ff9700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f35e8067290 0x7f35e8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.600+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35f0084c00 con 0x7f3608159530 2023-10-14T19:09:13.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.600+0000 7f360c8ed700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f35e8067290 0x7f35e8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:13.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.601+0000 7f360c8ed700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f35e8067290 0x7f35e8069740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f36080b66e0 tx=0x7f3600017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:13.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.604+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36080b4440 con 0x7f3608159530 2023-10-14T19:09:13.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:13.843+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f36080b4440 con 0x7f3608159530 2023-10-14T19:09:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.455+0000 7f3604ff9700 1 -- 172.21.15.7:0/1372750711 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36080b4440 con 0x7f3608159530 2023-10-14T19:09:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.457+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f35e8067290 msgr2=0x7f35e8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.457+0000 7f360eb51700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f35e8067290 0x7f35e8069740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f36080b66e0 tx=0x7f3600017000 comp rx=0 tx=0).stop 2023-10-14T19:09:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.457+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 msgr2=0x7f3608154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.457+0000 7f360eb51700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f3608154dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f35f000ea50 tx=0x7f35f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 shutdown_connections 2023-10-14T19:09:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f35e8067290 0x7f35e8069740 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3608159530 0x7f3608154dd0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f360806dc70 0x7f3608153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 --2- 172.21.15.7:0/1372750711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360806e0e0 0x7f36080c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 >> 172.21.15.7:0/1372750711 conn(0x7f36080703a0 msgr2=0x7f360815ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:14.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 shutdown_connections 2023-10-14T19:09:14.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.458+0000 7f360eb51700 1 -- 172.21.15.7:0/1372750711 wait complete. 2023-10-14T19:09:14.472 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.594+0000 7f34714a1700 1 Processor -- start 2023-10-14T19:09:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.594+0000 7f34714a1700 1 -- start start 2023-10-14T19:09:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f34714a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f34714a1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c15a750 con 0x7f346c15d440 2023-10-14T19:09:14.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f34714a1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c15e3a0 con 0x7f346c15d810 2023-10-14T19:09:14.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f34714a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c159e40 con 0x7f346c06cdb0 2023-10-14T19:09:14.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f346affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f346c15d440 0x7f346c06c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34812/0 (socket says 172.21.15.7:34812) 2023-10-14T19:09:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f346affd700 1 -- 172.21.15.7:0/1192029797 learned_addr learned my addr 172.21.15.7:0/1192029797 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f346a7fc700 1 --2- 172.21.15.7:0/1192029797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964734379 0 0) 0x7f346c15a750 con 0x7f346c15d440 2023-10-14T19:09:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3458003570 con 0x7f346c15d440 2023-10-14T19:09:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494163120 0 0) 0x7f346c15e3a0 con 0x7f346c15d810 2023-10-14T19:09:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f346c15a750 con 0x7f346c15d810 2023-10-14T19:09:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026560510 0 0) 0x7f3458003570 con 0x7f346c15d440 2023-10-14T19:09:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f346a7fc700 1 -- 172.21.15.7:0/1192029797 >> v1:172.21.15.148:6789/0 conn(0x7f346c15d810 legacy=0x7f346c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f346a7fc700 1 -- 172.21.15.7:0/1192029797 >> v1:172.21.15.7:6789/0 conn(0x7f346c15d440 legacy=0x7f346c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.595+0000 7f346a7fc700 1 -- 172.21.15.7:0/1192029797 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0af300 con 0x7f346c06cdb0 2023-10-14T19:09:14.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f346a7fc700 1 --2- 172.21.15.7:0/1192029797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c0aec90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3454009910 tx=0x7f34540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=298f36694c3e2347 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:14.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0017f0 con 0x7f346c06cdb0 2023-10-14T19:09:14.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454011420 con 0x7f346c06cdb0 2023-10-14T19:09:14.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f3469ffb700 1 -- 172.21.15.7:0/1192029797 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540117a0 con 0x7f346c06cdb0 2023-10-14T19:09:14.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 -- 172.21.15.7:0/1192029797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 msgr2=0x7f346c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 --2- 172.21.15.7:0/1192029797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c0aec90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3454009910 tx=0x7f34540091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 -- 172.21.15.7:0/1192029797 shutdown_connections 2023-10-14T19:09:14.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 --2- 172.21.15.7:0/1192029797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c0aec90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 -- 172.21.15.7:0/1192029797 >> 172.21.15.7:0/1192029797 conn(0x7f346c06f190 msgr2=0x7f346c0ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:14.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 -- 172.21.15.7:0/1192029797 shutdown_connections 2023-10-14T19:09:14.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.596+0000 7f34714a1700 1 -- 172.21.15.7:0/1192029797 wait complete. 2023-10-14T19:09:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 Processor -- start 2023-10-14T19:09:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 -- start start 2023-10-14T19:09:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 0x7f346c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f346c15d810 0x7f346c16d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c155850 con 0x7f346c15d440 2023-10-14T19:09:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0afb10 con 0x7f346c15d810 2023-10-14T19:09:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.598+0000 7f34714a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c154fb0 con 0x7f346c06cdb0 2023-10-14T19:09:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 0x7f346c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 0x7f346c14bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45524/0 (socket says 172.21.15.7:45524) 2023-10-14T19:09:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 -- 172.21.15.7:0/680869162 learned_addr learned my addr 172.21.15.7:0/680869162 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346affd700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346b7fe700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f346c15d810 0x7f346c16d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 -- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 msgr2=0x7f346c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 -- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f346c15d810 msgr2=0x7f346c16d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f346c15d810 0x7f346c16d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 -- 172.21.15.7:0/680869162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009420 con 0x7f346c15d440 2023-10-14T19:09:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346b7fe700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f346c15d810 0x7f346c16d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f346a7fc700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 0x7f346c14bf50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3454009860 tx=0x7f3454016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345401cba0 con 0x7f346c15d440 2023-10-14T19:09:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345401cd20 con 0x7f346c15d440 2023-10-14T19:09:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c155290 con 0x7f346c15d440 2023-10-14T19:09:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345401a6a0 con 0x7f346c15d440 2023-10-14T19:09:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.599+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c154bc0 con 0x7f346c15d440 2023-10-14T19:09:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.600+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c04c3c0 con 0x7f346c15d440 2023-10-14T19:09:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.601+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f345401aad0 con 0x7f346c15d440 2023-10-14T19:09:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.601+0000 7f3462ffd700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f344c067290 0x7f344c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.601+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34540862c0 con 0x7f346c15d440 2023-10-14T19:09:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.601+0000 7f346affd700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f344c067290 0x7f344c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.602+0000 7f346affd700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f344c067290 0x7f344c069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f345c007fd0 tx=0x7f345c000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.605+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3454053120 con 0x7f346c15d440 2023-10-14T19:09:14.844 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.843+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f346c0afc50 con 0x7f346c15d440 2023-10-14T19:09:14.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.844+0000 7f3462ffd700 1 -- 172.21.15.7:0/680869162 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f3454056740 con 0x7f346c15d440 2023-10-14T19:09:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:14.846 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:10.821659+0000","modified":"2023-10-14T19:09:14.450944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"d","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2854367647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2854367647},{"type":"v1","addr":"172.21.15.148:6836","nonce":2854367647}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T19:09:14.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f344c067290 msgr2=0x7f344c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f344c067290 0x7f344c069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f345c007fd0 tx=0x7f345c000f40 comp rx=0 tx=0).stop 2023-10-14T19:09:14.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 msgr2=0x7f346c14bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 0x7f346c14bf50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3454009860 tx=0x7f3454016000 comp rx=0 tx=0).stop 2023-10-14T19:09:14.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 shutdown_connections 2023-10-14T19:09:14.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f344c067290 0x7f344c069740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f346c15d810 0x7f346c16d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f346c06cdb0 0x7f346c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 --2- 172.21.15.7:0/680869162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f346c15d440 0x7f346c14bf50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.845+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 >> 172.21.15.7:0/680869162 conn(0x7f346c06f190 msgr2=0x7f346c14dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:14.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.846+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 shutdown_connections 2023-10-14T19:09:14.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.846+0000 7f34714a1700 1 -- 172.21.15.7:0/680869162 wait complete. 2023-10-14T19:09:14.854 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 64 2023-10-14T19:09:14.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.978+0000 7f1a8f59e700 1 Processor -- start 2023-10-14T19:09:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.978+0000 7f1a8f59e700 1 -- start start 2023-10-14T19:09:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a9006ded0 0x7f1a900b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8f59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a900b3270 con 0x7f1a90159940 2023-10-14T19:09:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8f59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900b3550 con 0x7f1a9006ded0 2023-10-14T19:09:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900b3830 con 0x7f1a90159570 2023-10-14T19:09:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a9006ded0 0x7f1a900b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a9006ded0 0x7f1a900b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45536/0 (socket says 172.21.15.7:45536) 2023-10-14T19:09:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/2073387077 learned_addr learned my addr 172.21.15.7:0/2073387077 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8e59c700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/2073387077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 msgr2=0x7f1a900b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/2073387077 >> v1:172.21.15.148:6789/0 conn(0x7f1a90159940 legacy=0x7f1a9006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/2073387077 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900b3b10 con 0x7f1a9006ded0 2023-10-14T19:09:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.979+0000 7f1a8e59c700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8ed9d700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a9006ded0 0x7f1a900b4310 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1a880099b0 tx=0x7f1a88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d00c0ba04d8ac3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8d59a700 1 -- 172.21.15.7:0/2073387077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800b860 con 0x7f1a9006ded0 2023-10-14T19:09:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8d59a700 1 -- 172.21.15.7:0/2073387077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800b9c0 con 0x7f1a9006ded0 2023-10-14T19:09:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8d59a700 1 -- 172.21.15.7:0/2073387077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800bd60 con 0x7f1a9006ded0 2023-10-14T19:09:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 -- 172.21.15.7:0/2073387077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a9006ded0 msgr2=0x7f1a900b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a9006ded0 0x7f1a900b4310 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1a880099b0 tx=0x7f1a88009250 comp rx=0 tx=0).stop 2023-10-14T19:09:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 -- 172.21.15.7:0/2073387077 shutdown_connections 2023-10-14T19:09:14.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a9006ded0 0x7f1a900b4310 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/2073387077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 -- 172.21.15.7:0/2073387077 >> 172.21.15.7:0/2073387077 conn(0x7f1a900703a0 msgr2=0x7f1a900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:14.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 -- 172.21.15.7:0/2073387077 shutdown_connections 2023-10-14T19:09:14.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.980+0000 7f1a8f59e700 1 -- 172.21.15.7:0/2073387077 wait complete. 2023-10-14T19:09:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.981+0000 7f1a8f59e700 1 Processor -- start 2023-10-14T19:09:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 -- start start 2023-10-14T19:09:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a9006ded0 0x7f1a90159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 0x7f1a9015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900c4d60 con 0x7f1a90159940 2023-10-14T19:09:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900c4150 con 0x7f1a9006ded0 2023-10-14T19:09:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900c4430 con 0x7f1a90159570 2023-10-14T19:09:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 0x7f1a9015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 0x7f1a9015b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45542/0 (socket says 172.21.15.7:45542) 2023-10-14T19:09:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/3855914159 learned_addr learned my addr 172.21.15.7:0/3855914159 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8dd9b700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.982+0000 7f1a8e59c700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a9006ded0 0x7f1a90159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 msgr2=0x7f1a900cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8ed9d700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a9006ded0 msgr2=0x7f1a90159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:14.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8ed9d700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a9006ded0 0x7f1a90159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:14.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8ed9d700 1 -- 172.21.15.7:0/3855914159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880094f0 con 0x7f1a90159940 2023-10-14T19:09:14.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8ed9d700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 0x7f1a9015b9a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1a880090b0 tx=0x7f1a88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801a640 con 0x7f1a90159940 2023-10-14T19:09:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8801f070 con 0x7f1a90159940 2023-10-14T19:09:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a900c4710 con 0x7f1a90159940 2023-10-14T19:09:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801aa10 con 0x7f1a90159940 2023-10-14T19:09:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.983+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9015a2e0 con 0x7f1a90159940 2023-10-14T19:09:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.984+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a900c4ed0 con 0x7f1a90159940 2023-10-14T19:09:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.984+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1a8801b430 con 0x7f1a90159940 2023-10-14T19:09:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.985+0000 7f1a867fc700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1a70067290 0x7f1a70069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.985+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a88021070 con 0x7f1a90159940 2023-10-14T19:09:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.985+0000 7f1a8e59c700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1a70067290 0x7f1a70069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.986+0000 7f1a8e59c700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1a70067290 0x7f1a70069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1a800076a0 tx=0x7f1a800098f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:14.989+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a88053a00 con 0x7f1a90159940 2023-10-14T19:09:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.182+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a9004c3c0 con 0x7f1a90159940 2023-10-14T19:09:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.183+0000 7f1a867fc700 1 -- 172.21.15.7:0/3855914159 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f1a8802b020 con 0x7f1a90159940 2023-10-14T19:09:15.184 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:15.184 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:12.441767+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:09.250495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:09.792938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:15.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1a70067290 msgr2=0x7f1a70069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1a70067290 0x7f1a70069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1a800076a0 tx=0x7f1a800098f0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 msgr2=0x7f1a9015b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 0x7f1a9015b9a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1a880090b0 tx=0x7f1a88017000 comp rx=0 tx=0).stop 2023-10-14T19:09:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 shutdown_connections 2023-10-14T19:09:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1a70067290 0x7f1a70069740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a9006ded0 0x7f1a90159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a90159940 0x7f1a9015b9a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 --2- 172.21.15.7:0/3855914159 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a90159570 0x7f1a900cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 >> 172.21.15.7:0/3855914159 conn(0x7f1a900703a0 msgr2=0x7f1a90150990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 shutdown_connections 2023-10-14T19:09:15.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.185+0000 7f1a8f59e700 1 -- 172.21.15.7:0/3855914159 wait complete. 2023-10-14T19:09:15.198 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:09:15.199 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:09:15.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.318+0000 7f4495e9e700 1 Processor -- start 2023-10-14T19:09:15.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.318+0000 7f4495e9e700 1 -- start start 2023-10-14T19:09:15.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.318+0000 7f4495e9e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44900cb5a0 0x7f44900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.318+0000 7f4495e9e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449015ae40 con 0x7f44900cd9e0 2023-10-14T19:09:15.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.318+0000 7f4495e9e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449015ab60 con 0x7f44900cde50 2023-10-14T19:09:15.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.318+0000 7f4495e9e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900d13f0 con 0x7f44900cb5a0 2023-10-14T19:09:15.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f44900cd9e0 0x7f4490159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34824/0 (socket says 172.21.15.7:34824) 2023-10-14T19:09:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448effd700 1 -- 172.21.15.7:0/1733478886 learned_addr learned my addr 172.21.15.7:0/1733478886 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448f7fe700 1 --2- 172.21.15.7:0/1733478886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44900cb5a0 0x7f44900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786056444 0 0) 0x7f449015ae40 con 0x7f44900cd9e0 2023-10-14T19:09:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4478003570 con 0x7f44900cd9e0 2023-10-14T19:09:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527992411 0 0) 0x7f449015ab60 con 0x7f44900cde50 2023-10-14T19:09:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449015ae40 con 0x7f44900cde50 2023-10-14T19:09:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448f7fe700 1 -- 172.21.15.7:0/1733478886 >> v1:172.21.15.148:6789/0 conn(0x7f44900cde50 legacy=0x7f4490156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110292613 0 0) 0x7f4478003570 con 0x7f44900cd9e0 2023-10-14T19:09:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448f7fe700 1 -- 172.21.15.7:0/1733478886 >> v1:172.21.15.7:6789/0 conn(0x7f44900cd9e0 legacy=0x7f4490159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448f7fe700 1 -- 172.21.15.7:0/1733478886 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900ccf00 con 0x7f44900cb5a0 2023-10-14T19:09:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.319+0000 7f448f7fe700 1 --2- 172.21.15.7:0/1733478886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44900cb5a0 0x7f44900cb970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4480009910 tx=0x7f44800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a7fddf977d782 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484001470 con 0x7f44900cb5a0 2023-10-14T19:09:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480011420 con 0x7f44900cb5a0 2023-10-14T19:09:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f448e7fc700 1 -- 172.21.15.7:0/1733478886 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800117a0 con 0x7f44900cb5a0 2023-10-14T19:09:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 -- 172.21.15.7:0/1733478886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44900cb5a0 msgr2=0x7f44900cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1733478886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44900cb5a0 0x7f44900cb970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4480009910 tx=0x7f44800091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 -- 172.21.15.7:0/1733478886 shutdown_connections 2023-10-14T19:09:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1733478886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44900cb5a0 0x7f44900cb970 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 -- 172.21.15.7:0/1733478886 >> 172.21.15.7:0/1733478886 conn(0x7f4490070e30 msgr2=0x7f44900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 -- 172.21.15.7:0/1733478886 shutdown_connections 2023-10-14T19:09:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.320+0000 7f4495e9e700 1 -- 172.21.15.7:0/1733478886 wait complete. 2023-10-14T19:09:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.321+0000 7f4495e9e700 1 Processor -- start 2023-10-14T19:09:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.321+0000 7f4495e9e700 1 -- start start 2023-10-14T19:09:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f4495e9e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 0x7f449015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f4495e9e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44900cd9e0 0x7f4490158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f4495e9e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f449015dbf0 0x7f4490158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f4495e9e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900b3ff0 con 0x7f44900cb5a0 2023-10-14T19:09:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f4495e9e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900b42d0 con 0x7f44900cd9e0 2023-10-14T19:09:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f4495e9e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900b45b0 con 0x7f449015dbf0 2023-10-14T19:09:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 0x7f449015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 0x7f449015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45552/0 (socket says 172.21.15.7:45552) 2023-10-14T19:09:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 -- 172.21.15.7:0/1343288075 learned_addr learned my addr 172.21.15.7:0/1343288075 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 -- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f449015dbf0 msgr2=0x7f4490158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f449015dbf0 0x7f4490158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 -- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44900cd9e0 msgr2=0x7f4490158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44900cd9e0 0x7f4490158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.322+0000 7f448f7fe700 1 -- 172.21.15.7:0/1343288075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009420 con 0x7f44900cb5a0 2023-10-14T19:09:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.323+0000 7f448f7fe700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 0x7f449015d6b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f4480009f00 tx=0x7f4480016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.323+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448001cbd0 con 0x7f44900cb5a0 2023-10-14T19:09:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.323+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448001cd30 con 0x7f44900cb5a0 2023-10-14T19:09:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.323+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900b4890 con 0x7f44900cb5a0 2023-10-14T19:09:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.323+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448001cea0 con 0x7f44900cb5a0 2023-10-14T19:09:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.323+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44901597c0 con 0x7f44900cb5a0 2023-10-14T19:09:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.324+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44900b4d90 con 0x7f44900cb5a0 2023-10-14T19:09:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.324+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f448001a910 con 0x7f44900cb5a0 2023-10-14T19:09:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.324+0000 7f44777fe700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f447c067290 0x7f447c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.325+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4480086310 con 0x7f44900cb5a0 2023-10-14T19:09:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.325+0000 7f448effd700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f447c067290 0x7f447c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.325+0000 7f448effd700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f447c067290 0x7f447c069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4484000ff0 tx=0x7f44840012c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.329+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4480053170 con 0x7f44900cb5a0 2023-10-14T19:09:15.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.518+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44900b4440 con 0x7f447c067290 2023-10-14T19:09:15.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.527+0000 7f44777fe700 1 -- 172.21.15.7:0/1343288075 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289748 (secure 0 0 0) 0x7f44900b4440 con 0x7f447c067290 2023-10-14T19:09:15.532 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:15.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f447c067290 msgr2=0x7f447c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f447c067290 0x7f447c069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4484000ff0 tx=0x7f44840012c0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 msgr2=0x7f449015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 0x7f449015d6b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f4480009f00 tx=0x7f4480016000 comp rx=0 tx=0).stop 2023-10-14T19:09:15.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 shutdown_connections 2023-10-14T19:09:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f447c067290 0x7f447c069740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f449015dbf0 0x7f4490158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44900cb5a0 0x7f449015d6b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 --2- 172.21.15.7:0/1343288075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44900cd9e0 0x7f4490158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 >> 172.21.15.7:0/1343288075 conn(0x7f4490070e30 msgr2=0x7f4490159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 shutdown_connections 2023-10-14T19:09:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.530+0000 7f4495e9e700 1 -- 172.21.15.7:0/1343288075 wait complete. 2023-10-14T19:09:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:09:15.543 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-10-14T19:09:13.710734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418072,"kb_used_data":11096,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556648,"statfs":{"total":773094113280,"available":770618007552,"internally_reserved":0,"allocated":11362304,"data_stored":5541164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.302163"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464314+0000","last_change":"2023-10-14T19:09:11.451607+0000","last_active":"2023-10-14T19:09:11.464314+0000","last_peered":"2023-10-14T19:09:11.464314+0000","last_clean":"2023-10-14T19:09:11.464314+0000","last_became_active":"2023-10-14T19:09:11.450793+0000","last_became_peered":"2023-10-14T19:09:11.450793+0000","last_unstale":"2023-10-14T19:09:11.464314+0000","last_undegraded":"2023-10-14T19:09:11.464314+0000","last_fullsized":"2023-10-14T19:09:11.464314+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:32.243023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.448745+0000","last_change":"2023-10-14T19:09:11.443305+0000","last_active":"2023-10-14T19:09:11.448745+0000","last_peered":"2023-10-14T19:09:11.448745+0000","last_clean":"2023-10-14T19:09:11.448745+0000","last_became_active":"2023-10-14T19:09:11.443022+0000","last_became_peered":"2023-10-14T19:09:11.443022+0000","last_unstale":"2023-10-14T19:09:11.448745+0000","last_undegraded":"2023-10-14T19:09:11.448745+0000","last_fullsized":"2023-10-14T19:09:11.448745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:24:43.626051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458373+0000","last_change":"2023-10-14T19:09:11.452466+0000","last_active":"2023-10-14T19:09:11.458373+0000","last_peered":"2023-10-14T19:09:11.458373+0000","last_clean":"2023-10-14T19:09:11.458373+0000","last_became_active":"2023-10-14T19:09:11.452196+0000","last_became_peered":"2023-10-14T19:09:11.452196+0000","last_unstale":"2023-10-14T19:09:11.458373+0000","last_undegraded":"2023-10-14T19:09:11.458373+0000","last_fullsized":"2023-10-14T19:09:11.458373+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:33.211233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.462194+0000","last_change":"2023-10-14T19:09:11.455812+0000","last_active":"2023-10-14T19:09:11.462194+0000","last_peered":"2023-10-14T19:09:11.462194+0000","last_clean":"2023-10-14T19:09:11.462194+0000","last_became_active":"2023-10-14T19:09:11.452630+0000","last_became_peered":"2023-10-14T19:09:11.452630+0000","last_unstale":"2023-10-14T19:09:11.462194+0000","last_undegraded":"2023-10-14T19:09:11.462194+0000","last_fullsized":"2023-10-14T19:09:11.462194+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:47.781394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.452286+0000","last_change":"2023-10-14T19:09:11.445661+0000","last_active":"2023-10-14T19:09:11.452286+0000","last_peered":"2023-10-14T19:09:11.452286+0000","last_clean":"2023-10-14T19:09:11.452286+0000","last_became_active":"2023-10-14T19:09:11.445381+0000","last_became_peered":"2023-10-14T19:09:11.445381+0000","last_unstale":"2023-10-14T19:09:11.452286+0000","last_undegraded":"2023-10-14T19:09:11.452286+0000","last_fullsized":"2023-10-14T19:09:11.452286+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:28.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461019+0000","last_change":"2023-10-14T19:09:11.460165+0000","last_active":"2023-10-14T19:09:11.461019+0000","last_peered":"2023-10-14T19:09:11.461019+0000","last_clean":"2023-10-14T19:09:11.461019+0000","last_became_active":"2023-10-14T19:09:11.459833+0000","last_became_peered":"2023-10-14T19:09:11.459833+0000","last_unstale":"2023-10-14T19:09:11.461019+0000","last_undegraded":"2023-10-14T19:09:11.461019+0000","last_fullsized":"2023-10-14T19:09:11.461019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.714635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454519+0000","last_change":"2023-10-14T19:09:11.451152+0000","last_active":"2023-10-14T19:09:11.454519+0000","last_peered":"2023-10-14T19:09:11.454519+0000","last_clean":"2023-10-14T19:09:11.454519+0000","last_became_active":"2023-10-14T19:09:11.449087+0000","last_became_peered":"2023-10-14T19:09:11.449087+0000","last_unstale":"2023-10-14T19:09:11.454519+0000","last_undegraded":"2023-10-14T19:09:11.454519+0000","last_fullsized":"2023-10-14T19:09:11.454519+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:52.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456588+0000","last_change":"2023-10-14T19:09:11.451569+0000","last_active":"2023-10-14T19:09:11.456588+0000","last_peered":"2023-10-14T19:09:11.456588+0000","last_clean":"2023-10-14T19:09:11.456588+0000","last_became_active":"2023-10-14T19:09:11.451297+0000","last_became_peered":"2023-10-14T19:09:11.451297+0000","last_unstale":"2023-10-14T19:09:11.456588+0000","last_undegraded":"2023-10-14T19:09:11.456588+0000","last_fullsized":"2023-10-14T19:09:11.456588+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:37.797964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.466044+0000","last_change":"2023-10-14T19:09:11.464556+0000","last_active":"2023-10-14T19:09:11.466044+0000","last_peered":"2023-10-14T19:09:11.466044+0000","last_clean":"2023-10-14T19:09:11.466044+0000","last_became_active":"2023-10-14T19:09:11.463816+0000","last_became_peered":"2023-10-14T19:09:11.463816+0000","last_unstale":"2023-10-14T19:09:11.466044+0000","last_undegraded":"2023-10-14T19:09:11.466044+0000","last_fullsized":"2023-10-14T19:09:11.466044+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:09.438949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.467676+0000","last_change":"2023-10-14T19:09:11.467310+0000","last_active":"2023-10-14T19:09:11.467676+0000","last_peered":"2023-10-14T19:09:11.467676+0000","last_clean":"2023-10-14T19:09:11.467676+0000","last_became_active":"2023-10-14T19:09:11.466063+0000","last_became_peered":"2023-10-14T19:09:11.466063+0000","last_unstale":"2023-10-14T19:09:11.467676+0000","last_undegraded":"2023-10-14T19:09:11.467676+0000","last_fullsized":"2023-10-14T19:09:11.467676+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:43.266434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.450442+0000","last_change":"2023-10-14T19:09:11.446423+0000","last_active":"2023-10-14T19:09:11.450442+0000","last_peered":"2023-10-14T19:09:11.450442+0000","last_clean":"2023-10-14T19:09:11.450442+0000","last_became_active":"2023-10-14T19:09:11.446140+0000","last_became_peered":"2023-10-14T19:09:11.446140+0000","last_unstale":"2023-10-14T19:09:11.450442+0000","last_undegraded":"2023-10-14T19:09:11.450442+0000","last_fullsized":"2023-10-14T19:09:11.450442+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:42.198292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465539+0000","last_change":"2023-10-14T19:09:11.462572+0000","last_active":"2023-10-14T19:09:11.465539+0000","last_peered":"2023-10-14T19:09:11.465539+0000","last_clean":"2023-10-14T19:09:11.465539+0000","last_became_active":"2023-10-14T19:09:11.461175+0000","last_became_peered":"2023-10-14T19:09:11.461175+0000","last_unstale":"2023-10-14T19:09:11.465539+0000","last_undegraded":"2023-10-14T19:09:11.465539+0000","last_fullsized":"2023-10-14T19:09:11.465539+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:51:44.843645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461489+0000","last_change":"2023-10-14T19:09:11.457974+0000","last_active":"2023-10-14T19:09:11.461489+0000","last_peered":"2023-10-14T19:09:11.461489+0000","last_clean":"2023-10-14T19:09:11.461489+0000","last_became_active":"2023-10-14T19:09:11.457659+0000","last_became_peered":"2023-10-14T19:09:11.457659+0000","last_unstale":"2023-10-14T19:09:11.461489+0000","last_undegraded":"2023-10-14T19:09:11.461489+0000","last_fullsized":"2023-10-14T19:09:11.461489+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:22.897697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461332+0000","last_change":"2023-10-14T19:09:11.456924+0000","last_active":"2023-10-14T19:09:11.461332+0000","last_peered":"2023-10-14T19:09:11.461332+0000","last_clean":"2023-10-14T19:09:11.461332+0000","last_became_active":"2023-10-14T19:09:11.456697+0000","last_became_peered":"2023-10-14T19:09:11.456697+0000","last_unstale":"2023-10-14T19:09:11.461332+0000","last_undegraded":"2023-10-14T19:09:11.461332+0000","last_fullsized":"2023-10-14T19:09:11.461332+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:42.880064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459243+0000","last_change":"2023-10-14T19:09:11.457913+0000","last_active":"2023-10-14T19:09:11.459243+0000","last_peered":"2023-10-14T19:09:11.459243+0000","last_clean":"2023-10-14T19:09:11.459243+0000","last_became_active":"2023-10-14T19:09:11.457631+0000","last_became_peered":"2023-10-14T19:09:11.457631+0000","last_unstale":"2023-10-14T19:09:11.459243+0000","last_undegraded":"2023-10-14T19:09:11.459243+0000","last_fullsized":"2023-10-14T19:09:11.459243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:15.463931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458831+0000","last_change":"2023-10-14T19:09:11.452286+0000","last_active":"2023-10-14T19:09:11.458831+0000","last_peered":"2023-10-14T19:09:11.458831+0000","last_clean":"2023-10-14T19:09:11.458831+0000","last_became_active":"2023-10-14T19:09:11.451812+0000","last_became_peered":"2023-10-14T19:09:11.451812+0000","last_unstale":"2023-10-14T19:09:11.458831+0000","last_undegraded":"2023-10-14T19:09:11.458831+0000","last_fullsized":"2023-10-14T19:09:11.458831+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:11.624773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458534+0000","last_change":"2023-10-14T19:09:11.449798+0000","last_active":"2023-10-14T19:09:11.458534+0000","last_peered":"2023-10-14T19:09:11.458534+0000","last_clean":"2023-10-14T19:09:11.458534+0000","last_became_active":"2023-10-14T19:09:11.449363+0000","last_became_peered":"2023-10-14T19:09:11.449363+0000","last_unstale":"2023-10-14T19:09:11.458534+0000","last_undegraded":"2023-10-14T19:09:11.458534+0000","last_fullsized":"2023-10-14T19:09:11.458534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:26.717844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454907+0000","last_change":"2023-10-14T19:09:11.445501+0000","last_active":"2023-10-14T19:09:11.454907+0000","last_peered":"2023-10-14T19:09:11.454907+0000","last_clean":"2023-10-14T19:09:11.454907+0000","last_became_active":"2023-10-14T19:09:11.445154+0000","last_became_peered":"2023-10-14T19:09:11.445154+0000","last_unstale":"2023-10-14T19:09:11.454907+0000","last_undegraded":"2023-10-14T19:09:11.454907+0000","last_fullsized":"2023-10-14T19:09:11.454907+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:07:13.502477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464195+0000","last_change":"2023-10-14T19:09:11.458955+0000","last_active":"2023-10-14T19:09:11.464195+0000","last_peered":"2023-10-14T19:09:11.464195+0000","last_clean":"2023-10-14T19:09:11.464195+0000","last_became_active":"2023-10-14T19:09:11.458661+0000","last_became_peered":"2023-10-14T19:09:11.458661+0000","last_unstale":"2023-10-14T19:09:11.464195+0000","last_undegraded":"2023-10-14T19:09:11.464195+0000","last_fullsized":"2023-10-14T19:09:11.464195+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:56.327074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.460907+0000","last_change":"2023-10-14T19:09:11.452854+0000","last_active":"2023-10-14T19:09:11.460907+0000","last_peered":"2023-10-14T19:09:11.460907+0000","last_clean":"2023-10-14T19:09:11.460907+0000","last_became_active":"2023-10-14T19:09:11.451866+0000","last_became_peered":"2023-10-14T19:09:11.451866+0000","last_unstale":"2023-10-14T19:09:11.460907+0000","last_undegraded":"2023-10-14T19:09:11.460907+0000","last_fullsized":"2023-10-14T19:09:11.460907+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:00.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461038+0000","last_change":"2023-10-14T19:09:11.454878+0000","last_active":"2023-10-14T19:09:11.461038+0000","last_peered":"2023-10-14T19:09:11.461038+0000","last_clean":"2023-10-14T19:09:11.461038+0000","last_became_active":"2023-10-14T19:09:11.450542+0000","last_became_peered":"2023-10-14T19:09:11.450542+0000","last_unstale":"2023-10-14T19:09:11.461038+0000","last_undegraded":"2023-10-14T19:09:11.461038+0000","last_fullsized":"2023-10-14T19:09:11.461038+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:14.132211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459440+0000","last_change":"2023-10-14T19:09:11.447110+0000","last_active":"2023-10-14T19:09:11.459440+0000","last_peered":"2023-10-14T19:09:11.459440+0000","last_clean":"2023-10-14T19:09:11.459440+0000","last_became_active":"2023-10-14T19:09:11.446837+0000","last_became_peered":"2023-10-14T19:09:11.446837+0000","last_unstale":"2023-10-14T19:09:11.459440+0000","last_undegraded":"2023-10-14T19:09:11.459440+0000","last_fullsized":"2023-10-14T19:09:11.459440+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:53.505866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458329+0000","last_change":"2023-10-14T19:09:11.448899+0000","last_active":"2023-10-14T19:09:11.458329+0000","last_peered":"2023-10-14T19:09:11.458329+0000","last_clean":"2023-10-14T19:09:11.458329+0000","last_became_active":"2023-10-14T19:09:11.448650+0000","last_became_peered":"2023-10-14T19:09:11.448650+0000","last_unstale":"2023-10-14T19:09:11.458329+0000","last_undegraded":"2023-10-14T19:09:11.458329+0000","last_fullsized":"2023-10-14T19:09:11.458329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:10.848122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456352+0000","last_change":"2023-10-14T19:09:11.453383+0000","last_active":"2023-10-14T19:09:11.456352+0000","last_peered":"2023-10-14T19:09:11.456352+0000","last_clean":"2023-10-14T19:09:11.456352+0000","last_became_active":"2023-10-14T19:09:11.449375+0000","last_became_peered":"2023-10-14T19:09:11.449375+0000","last_unstale":"2023-10-14T19:09:11.456352+0000","last_undegraded":"2023-10-14T19:09:11.456352+0000","last_fullsized":"2023-10-14T19:09:11.456352+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:37.797964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458509+0000","last_change":"2023-10-14T19:09:11.449610+0000","last_active":"2023-10-14T19:09:11.458509+0000","last_peered":"2023-10-14T19:09:11.458509+0000","last_clean":"2023-10-14T19:09:11.458509+0000","last_became_active":"2023-10-14T19:09:11.449020+0000","last_became_peered":"2023-10-14T19:09:11.449020+0000","last_unstale":"2023-10-14T19:09:11.458509+0000","last_undegraded":"2023-10-14T19:09:11.458509+0000","last_fullsized":"2023-10-14T19:09:11.458509+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:08:25.122170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.467656+0000","last_change":"2023-10-14T19:09:11.467254+0000","last_active":"2023-10-14T19:09:11.467656+0000","last_peered":"2023-10-14T19:09:11.467656+0000","last_clean":"2023-10-14T19:09:11.467656+0000","last_became_active":"2023-10-14T19:09:11.465681+0000","last_became_peered":"2023-10-14T19:09:11.465681+0000","last_unstale":"2023-10-14T19:09:11.467656+0000","last_undegraded":"2023-10-14T19:09:11.467656+0000","last_fullsized":"2023-10-14T19:09:11.467656+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:47:34.852115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455342+0000","last_change":"2023-10-14T19:09:11.452915+0000","last_active":"2023-10-14T19:09:11.455342+0000","last_peered":"2023-10-14T19:09:11.455342+0000","last_clean":"2023-10-14T19:09:11.455342+0000","last_became_active":"2023-10-14T19:09:11.452096+0000","last_became_peered":"2023-10-14T19:09:11.452096+0000","last_unstale":"2023-10-14T19:09:11.455342+0000","last_undegraded":"2023-10-14T19:09:11.455342+0000","last_fullsized":"2023-10-14T19:09:11.455342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:33.523020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456293+0000","last_change":"2023-10-14T19:09:11.453540+0000","last_active":"2023-10-14T19:09:11.456293+0000","last_peered":"2023-10-14T19:09:11.456293+0000","last_clean":"2023-10-14T19:09:11.456293+0000","last_became_active":"2023-10-14T19:09:11.453280+0000","last_became_peered":"2023-10-14T19:09:11.453280+0000","last_unstale":"2023-10-14T19:09:11.456293+0000","last_undegraded":"2023-10-14T19:09:11.456293+0000","last_fullsized":"2023-10-14T19:09:11.456293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:06.237196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461065+0000","last_change":"2023-10-14T19:09:11.455078+0000","last_active":"2023-10-14T19:09:11.461065+0000","last_peered":"2023-10-14T19:09:11.461065+0000","last_clean":"2023-10-14T19:09:11.461065+0000","last_became_active":"2023-10-14T19:09:11.454565+0000","last_became_peered":"2023-10-14T19:09:11.454565+0000","last_unstale":"2023-10-14T19:09:11.461065+0000","last_undegraded":"2023-10-14T19:09:11.461065+0000","last_fullsized":"2023-10-14T19:09:11.461065+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:33.531211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464036+0000","last_change":"2023-10-14T19:09:11.460078+0000","last_active":"2023-10-14T19:09:11.464036+0000","last_peered":"2023-10-14T19:09:11.464036+0000","last_clean":"2023-10-14T19:09:11.464036+0000","last_became_active":"2023-10-14T19:09:11.459875+0000","last_became_peered":"2023-10-14T19:09:11.459875+0000","last_unstale":"2023-10-14T19:09:11.464036+0000","last_undegraded":"2023-10-14T19:09:11.464036+0000","last_fullsized":"2023-10-14T19:09:11.464036+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:58.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465512+0000","last_change":"2023-10-14T19:09:11.462166+0000","last_active":"2023-10-14T19:09:11.465512+0000","last_peered":"2023-10-14T19:09:11.465512+0000","last_clean":"2023-10-14T19:09:11.465512+0000","last_became_active":"2023-10-14T19:09:11.460292+0000","last_became_peered":"2023-10-14T19:09:11.460292+0000","last_unstale":"2023-10-14T19:09:11.465512+0000","last_undegraded":"2023-10-14T19:09:11.465512+0000","last_fullsized":"2023-10-14T19:09:11.465512+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:22.954696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.457261+0000","last_change":"2023-10-14T19:09:11.456346+0000","last_active":"2023-10-14T19:09:11.457261+0000","last_peered":"2023-10-14T19:09:11.457261+0000","last_clean":"2023-10-14T19:09:11.457261+0000","last_became_active":"2023-10-14T19:09:11.456035+0000","last_became_peered":"2023-10-14T19:09:11.456035+0000","last_unstale":"2023-10-14T19:09:11.457261+0000","last_undegraded":"2023-10-14T19:09:11.457261+0000","last_fullsized":"2023-10-14T19:09:11.457261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:12:20.501979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.447832+0000","last_change":"2023-10-14T19:09:11.443592+0000","last_active":"2023-10-14T19:09:11.447832+0000","last_peered":"2023-10-14T19:09:11.447832+0000","last_clean":"2023-10-14T19:09:11.447832+0000","last_became_active":"2023-10-14T19:09:11.443174+0000","last_became_peered":"2023-10-14T19:09:11.443174+0000","last_unstale":"2023-10-14T19:09:11.447832+0000","last_undegraded":"2023-10-14T19:09:11.447832+0000","last_fullsized":"2023-10-14T19:09:11.447832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:54.913793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"101'4","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.457717+0000","last_change":"2023-10-14T19:09:10.425791+0000","last_active":"2023-10-14T19:09:11.457717+0000","last_peered":"2023-10-14T19:09:11.457717+0000","last_clean":"2023-10-14T19:09:11.457717+0000","last_became_active":"2023-10-14T19:09:10.425485+0000","last_became_peered":"2023-10-14T19:09:10.425485+0000","last_unstale":"2023-10-14T19:09:11.457717+0000","last_undegraded":"2023-10-14T19:09:11.457717+0000","last_fullsized":"2023-10-14T19:09:11.457717+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:51.128711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456222+0000","last_change":"2023-10-14T19:09:11.449340+0000","last_active":"2023-10-14T19:09:11.456222+0000","last_peered":"2023-10-14T19:09:11.456222+0000","last_clean":"2023-10-14T19:09:11.456222+0000","last_became_active":"2023-10-14T19:09:11.448988+0000","last_became_peered":"2023-10-14T19:09:11.448988+0000","last_unstale":"2023-10-14T19:09:11.456222+0000","last_undegraded":"2023-10-14T19:09:11.456222+0000","last_fullsized":"2023-10-14T19:09:11.456222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:47:29.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455652+0000","last_change":"2023-10-14T19:09:10.431671+0000","last_active":"2023-10-14T19:09:11.455652+0000","last_peered":"2023-10-14T19:09:11.455652+0000","last_clean":"2023-10-14T19:09:11.455652+0000","last_became_active":"2023-10-14T19:09:10.431359+0000","last_became_peered":"2023-10-14T19:09:10.431359+0000","last_unstale":"2023-10-14T19:09:11.455652+0000","last_undegraded":"2023-10-14T19:09:11.455652+0000","last_fullsized":"2023-10-14T19:09:11.455652+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:11.359787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.450608+0000","last_change":"2023-10-14T19:09:11.449406+0000","last_active":"2023-10-14T19:09:11.450608+0000","last_peered":"2023-10-14T19:09:11.450608+0000","last_clean":"2023-10-14T19:09:11.450608+0000","last_became_active":"2023-10-14T19:09:11.449042+0000","last_became_peered":"2023-10-14T19:09:11.449042+0000","last_unstale":"2023-10-14T19:09:11.450608+0000","last_undegraded":"2023-10-14T19:09:11.450608+0000","last_fullsized":"2023-10-14T19:09:11.450608+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:21.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.451761+0000","last_change":"2023-10-14T19:09:10.434856+0000","last_active":"2023-10-14T19:09:11.451761+0000","last_peered":"2023-10-14T19:09:11.451761+0000","last_clean":"2023-10-14T19:09:11.451761+0000","last_became_active":"2023-10-14T19:09:10.434541+0000","last_became_peered":"2023-10-14T19:09:10.434541+0000","last_unstale":"2023-10-14T19:09:11.451761+0000","last_undegraded":"2023-10-14T19:09:11.451761+0000","last_fullsized":"2023-10-14T19:09:11.451761+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:06.558725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458408+0000","last_change":"2023-10-14T19:09:11.455477+0000","last_active":"2023-10-14T19:09:11.458408+0000","last_peered":"2023-10-14T19:09:11.458408+0000","last_clean":"2023-10-14T19:09:11.458408+0000","last_became_active":"2023-10-14T19:09:11.455192+0000","last_became_peered":"2023-10-14T19:09:11.455192+0000","last_unstale":"2023-10-14T19:09:11.458408+0000","last_undegraded":"2023-10-14T19:09:11.458408+0000","last_fullsized":"2023-10-14T19:09:11.458408+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:03.964638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.452456+0000","last_change":"2023-10-14T19:09:10.425723+0000","last_active":"2023-10-14T19:09:11.452456+0000","last_peered":"2023-10-14T19:09:11.452456+0000","last_clean":"2023-10-14T19:09:11.452456+0000","last_became_active":"2023-10-14T19:09:10.425323+0000","last_became_peered":"2023-10-14T19:09:10.425323+0000","last_unstale":"2023-10-14T19:09:11.452456+0000","last_undegraded":"2023-10-14T19:09:11.452456+0000","last_fullsized":"2023-10-14T19:09:11.452456+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:51.213685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465616+0000","last_change":"2023-10-14T19:09:11.463660+0000","last_active":"2023-10-14T19:09:11.465616+0000","last_peered":"2023-10-14T19:09:11.465616+0000","last_clean":"2023-10-14T19:09:11.465616+0000","last_became_active":"2023-10-14T19:09:11.461402+0000","last_became_peered":"2023-10-14T19:09:11.461402+0000","last_unstale":"2023-10-14T19:09:11.465616+0000","last_undegraded":"2023-10-14T19:09:11.465616+0000","last_fullsized":"2023-10-14T19:09:11.465616+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:26:28.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.453220+0000","last_change":"2023-10-14T19:09:10.425942+0000","last_active":"2023-10-14T19:09:11.453220+0000","last_peered":"2023-10-14T19:09:11.453220+0000","last_clean":"2023-10-14T19:09:11.453220+0000","last_became_active":"2023-10-14T19:09:10.425649+0000","last_became_peered":"2023-10-14T19:09:10.425649+0000","last_unstale":"2023-10-14T19:09:11.453220+0000","last_undegraded":"2023-10-14T19:09:11.453220+0000","last_fullsized":"2023-10-14T19:09:11.453220+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:55:19.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454351+0000","last_change":"2023-10-14T19:09:11.445456+0000","last_active":"2023-10-14T19:09:11.454351+0000","last_peered":"2023-10-14T19:09:11.454351+0000","last_clean":"2023-10-14T19:09:11.454351+0000","last_became_active":"2023-10-14T19:09:11.445190+0000","last_became_peered":"2023-10-14T19:09:11.445190+0000","last_unstale":"2023-10-14T19:09:11.454351+0000","last_undegraded":"2023-10-14T19:09:11.454351+0000","last_fullsized":"2023-10-14T19:09:11.454351+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:50.807505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459351+0000","last_change":"2023-10-14T19:09:10.426996+0000","last_active":"2023-10-14T19:09:11.459351+0000","last_peered":"2023-10-14T19:09:11.459351+0000","last_clean":"2023-10-14T19:09:11.459351+0000","last_became_active":"2023-10-14T19:09:10.426448+0000","last_became_peered":"2023-10-14T19:09:10.426448+0000","last_unstale":"2023-10-14T19:09:11.459351+0000","last_undegraded":"2023-10-14T19:09:11.459351+0000","last_fullsized":"2023-10-14T19:09:11.459351+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:23.135490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465457+0000","last_change":"2023-10-14T19:09:11.462184+0000","last_active":"2023-10-14T19:09:11.465457+0000","last_peered":"2023-10-14T19:09:11.465457+0000","last_clean":"2023-10-14T19:09:11.465457+0000","last_became_active":"2023-10-14T19:09:11.460638+0000","last_became_peered":"2023-10-14T19:09:11.460638+0000","last_unstale":"2023-10-14T19:09:11.465457+0000","last_undegraded":"2023-10-14T19:09:11.465457+0000","last_fullsized":"2023-10-14T19:09:11.465457+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:33.229837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.438204+0000","last_change":"2023-10-14T19:09:10.423638+0000","last_active":"2023-10-14T19:09:11.438204+0000","last_peered":"2023-10-14T19:09:11.438204+0000","last_clean":"2023-10-14T19:09:11.438204+0000","last_became_active":"2023-10-14T19:09:10.423397+0000","last_became_peered":"2023-10-14T19:09:10.423397+0000","last_unstale":"2023-10-14T19:09:11.438204+0000","last_undegraded":"2023-10-14T19:09:11.438204+0000","last_fullsized":"2023-10-14T19:09:11.438204+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:20.307588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454500+0000","last_change":"2023-10-14T19:09:11.449324+0000","last_active":"2023-10-14T19:09:11.454500+0000","last_peered":"2023-10-14T19:09:11.454500+0000","last_clean":"2023-10-14T19:09:11.454500+0000","last_became_active":"2023-10-14T19:09:11.448765+0000","last_became_peered":"2023-10-14T19:09:11.448765+0000","last_unstale":"2023-10-14T19:09:11.454500+0000","last_undegraded":"2023-10-14T19:09:11.454500+0000","last_fullsized":"2023-10-14T19:09:11.454500+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:33.523020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.446293+0000","last_change":"2023-10-14T19:09:10.431607+0000","last_active":"2023-10-14T19:09:11.446293+0000","last_peered":"2023-10-14T19:09:11.446293+0000","last_clean":"2023-10-14T19:09:11.446293+0000","last_became_active":"2023-10-14T19:09:10.431026+0000","last_became_peered":"2023-10-14T19:09:10.431026+0000","last_unstale":"2023-10-14T19:09:11.446293+0000","last_undegraded":"2023-10-14T19:09:11.446293+0000","last_fullsized":"2023-10-14T19:09:11.446293+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:02:53.665050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.463895+0000","last_change":"2023-10-14T19:09:11.455280+0000","last_active":"2023-10-14T19:09:11.463895+0000","last_peered":"2023-10-14T19:09:11.463895+0000","last_clean":"2023-10-14T19:09:11.463895+0000","last_became_active":"2023-10-14T19:09:11.454975+0000","last_became_peered":"2023-10-14T19:09:11.454975+0000","last_unstale":"2023-10-14T19:09:11.463895+0000","last_undegraded":"2023-10-14T19:09:11.463895+0000","last_fullsized":"2023-10-14T19:09:11.463895+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:54.913793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.433323+0000","last_change":"2023-10-14T19:09:10.434600+0000","last_active":"2023-10-14T19:09:11.433323+0000","last_peered":"2023-10-14T19:09:11.433323+0000","last_clean":"2023-10-14T19:09:11.433323+0000","last_became_active":"2023-10-14T19:09:10.434262+0000","last_became_peered":"2023-10-14T19:09:10.434262+0000","last_unstale":"2023-10-14T19:09:11.433323+0000","last_undegraded":"2023-10-14T19:09:11.433323+0000","last_fullsized":"2023-10-14T19:09:11.433323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:05:48.855182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464138+0000","last_change":"2023-10-14T19:09:11.458987+0000","last_active":"2023-10-14T19:09:11.464138+0000","last_peered":"2023-10-14T19:09:11.464138+0000","last_clean":"2023-10-14T19:09:11.464138+0000","last_became_active":"2023-10-14T19:09:11.458708+0000","last_became_peered":"2023-10-14T19:09:11.458708+0000","last_unstale":"2023-10-14T19:09:11.464138+0000","last_undegraded":"2023-10-14T19:09:11.464138+0000","last_fullsized":"2023-10-14T19:09:11.464138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:24.137329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437383+0000","last_change":"2023-10-14T19:09:10.427131+0000","last_active":"2023-10-14T19:09:11.437383+0000","last_peered":"2023-10-14T19:09:11.437383+0000","last_clean":"2023-10-14T19:09:11.437383+0000","last_became_active":"2023-10-14T19:09:10.426438+0000","last_became_peered":"2023-10-14T19:09:10.426438+0000","last_unstale":"2023-10-14T19:09:11.437383+0000","last_undegraded":"2023-10-14T19:09:11.437383+0000","last_fullsized":"2023-10-14T19:09:11.437383+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:11.359787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455530+0000","last_change":"2023-10-14T19:09:11.446487+0000","last_active":"2023-10-14T19:09:11.455530+0000","last_peered":"2023-10-14T19:09:11.455530+0000","last_clean":"2023-10-14T19:09:11.455530+0000","last_became_active":"2023-10-14T19:09:11.446262+0000","last_became_peered":"2023-10-14T19:09:11.446262+0000","last_unstale":"2023-10-14T19:09:11.455530+0000","last_undegraded":"2023-10-14T19:09:11.455530+0000","last_fullsized":"2023-10-14T19:09:11.455530+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:55.855622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"101'3","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461990+0000","last_change":"2023-10-14T19:09:10.433554+0000","last_active":"2023-10-14T19:09:11.461990+0000","last_peered":"2023-10-14T19:09:11.461990+0000","last_clean":"2023-10-14T19:09:11.461990+0000","last_became_active":"2023-10-14T19:09:10.433217+0000","last_became_peered":"2023-10-14T19:09:10.433217+0000","last_unstale":"2023-10-14T19:09:11.461990+0000","last_undegraded":"2023-10-14T19:09:11.461990+0000","last_fullsized":"2023-10-14T19:09:11.461990+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:36.796125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458399+0000","last_change":"2023-10-14T19:09:11.453605+0000","last_active":"2023-10-14T19:09:11.458399+0000","last_peered":"2023-10-14T19:09:11.458399+0000","last_clean":"2023-10-14T19:09:11.458399+0000","last_became_active":"2023-10-14T19:09:11.453268+0000","last_became_peered":"2023-10-14T19:09:11.453268+0000","last_unstale":"2023-10-14T19:09:11.458399+0000","last_undegraded":"2023-10-14T19:09:11.458399+0000","last_fullsized":"2023-10-14T19:09:11.458399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:38.637946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"101'6","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465713+0000","last_change":"2023-10-14T19:09:10.431054+0000","last_active":"2023-10-14T19:09:11.465713+0000","last_peered":"2023-10-14T19:09:11.465713+0000","last_clean":"2023-10-14T19:09:11.465713+0000","last_became_active":"2023-10-14T19:09:10.430787+0000","last_became_peered":"2023-10-14T19:09:10.430787+0000","last_unstale":"2023-10-14T19:09:11.465713+0000","last_undegraded":"2023-10-14T19:09:11.465713+0000","last_fullsized":"2023-10-14T19:09:11.465713+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:05.235356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459472+0000","last_change":"2023-10-14T19:09:11.454852+0000","last_active":"2023-10-14T19:09:11.459472+0000","last_peered":"2023-10-14T19:09:11.459472+0000","last_clean":"2023-10-14T19:09:11.459472+0000","last_became_active":"2023-10-14T19:09:11.454568+0000","last_became_peered":"2023-10-14T19:09:11.454568+0000","last_unstale":"2023-10-14T19:09:11.459472+0000","last_undegraded":"2023-10-14T19:09:11.459472+0000","last_fullsized":"2023-10-14T19:09:11.459472+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:42.880064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454524+0000","last_change":"2023-10-14T19:09:10.436670+0000","last_active":"2023-10-14T19:09:11.454524+0000","last_peered":"2023-10-14T19:09:11.454524+0000","last_clean":"2023-10-14T19:09:11.454524+0000","last_became_active":"2023-10-14T19:09:10.436389+0000","last_became_peered":"2023-10-14T19:09:10.436389+0000","last_unstale":"2023-10-14T19:09:11.454524+0000","last_undegraded":"2023-10-14T19:09:11.454524+0000","last_fullsized":"2023-10-14T19:09:11.454524+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:03:52.129046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456324+0000","last_change":"2023-10-14T19:09:11.454201+0000","last_active":"2023-10-14T19:09:11.456324+0000","last_peered":"2023-10-14T19:09:11.456324+0000","last_clean":"2023-10-14T19:09:11.456324+0000","last_became_active":"2023-10-14T19:09:11.453892+0000","last_became_peered":"2023-10-14T19:09:11.453892+0000","last_unstale":"2023-10-14T19:09:11.456324+0000","last_undegraded":"2023-10-14T19:09:11.456324+0000","last_fullsized":"2023-10-14T19:09:11.456324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:51.903737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437978+0000","last_change":"2023-10-14T19:09:10.433361+0000","last_active":"2023-10-14T19:09:11.437978+0000","last_peered":"2023-10-14T19:09:11.437978+0000","last_clean":"2023-10-14T19:09:11.437978+0000","last_became_active":"2023-10-14T19:09:10.433043+0000","last_became_peered":"2023-10-14T19:09:10.433043+0000","last_unstale":"2023-10-14T19:09:11.437978+0000","last_undegraded":"2023-10-14T19:09:11.437978+0000","last_fullsized":"2023-10-14T19:09:11.437978+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:07.803211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456868+0000","last_change":"2023-10-14T19:09:11.447878+0000","last_active":"2023-10-14T19:09:11.456868+0000","last_peered":"2023-10-14T19:09:11.456868+0000","last_clean":"2023-10-14T19:09:11.456868+0000","last_became_active":"2023-10-14T19:09:11.447623+0000","last_became_peered":"2023-10-14T19:09:11.447623+0000","last_unstale":"2023-10-14T19:09:11.456868+0000","last_undegraded":"2023-10-14T19:09:11.456868+0000","last_fullsized":"2023-10-14T19:09:11.456868+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:32.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"101'8","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461997+0000","last_change":"2023-10-14T19:09:10.429417+0000","last_active":"2023-10-14T19:09:11.461997+0000","last_peered":"2023-10-14T19:09:11.461997+0000","last_clean":"2023-10-14T19:09:11.461997+0000","last_became_active":"2023-10-14T19:09:10.429169+0000","last_became_peered":"2023-10-14T19:09:10.429169+0000","last_unstale":"2023-10-14T19:09:11.461997+0000","last_undegraded":"2023-10-14T19:09:11.461997+0000","last_fullsized":"2023-10-14T19:09:11.461997+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:51.169528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.457943+0000","last_change":"2023-10-14T19:09:11.455058+0000","last_active":"2023-10-14T19:09:11.457943+0000","last_peered":"2023-10-14T19:09:11.457943+0000","last_clean":"2023-10-14T19:09:11.457943+0000","last_became_active":"2023-10-14T19:09:11.454786+0000","last_became_peered":"2023-10-14T19:09:11.454786+0000","last_unstale":"2023-10-14T19:09:11.457943+0000","last_undegraded":"2023-10-14T19:09:11.457943+0000","last_fullsized":"2023-10-14T19:09:11.457943+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:37:10.219253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464408+0000","last_change":"2023-10-14T19:09:10.432333+0000","last_active":"2023-10-14T19:09:11.464408+0000","last_peered":"2023-10-14T19:09:11.464408+0000","last_clean":"2023-10-14T19:09:11.464408+0000","last_became_active":"2023-10-14T19:09:10.432066+0000","last_became_peered":"2023-10-14T19:09:10.432066+0000","last_unstale":"2023-10-14T19:09:11.464408+0000","last_undegraded":"2023-10-14T19:09:11.464408+0000","last_fullsized":"2023-10-14T19:09:11.464408+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:50.901897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.463232+0000","last_change":"2023-10-14T19:09:11.461226+0000","last_active":"2023-10-14T19:09:11.463232+0000","last_peered":"2023-10-14T19:09:11.463232+0000","last_clean":"2023-10-14T19:09:11.463232+0000","last_became_active":"2023-10-14T19:09:11.460908+0000","last_became_peered":"2023-10-14T19:09:11.460908+0000","last_unstale":"2023-10-14T19:09:11.463232+0000","last_undegraded":"2023-10-14T19:09:11.463232+0000","last_fullsized":"2023-10-14T19:09:11.463232+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:58.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.453863+0000","last_change":"2023-10-14T19:09:10.425357+0000","last_active":"2023-10-14T19:09:11.453863+0000","last_peered":"2023-10-14T19:09:11.453863+0000","last_clean":"2023-10-14T19:09:11.453863+0000","last_became_active":"2023-10-14T19:09:10.425051+0000","last_became_peered":"2023-10-14T19:09:10.425051+0000","last_unstale":"2023-10-14T19:09:11.453863+0000","last_undegraded":"2023-10-14T19:09:11.453863+0000","last_fullsized":"2023-10-14T19:09:11.453863+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.314925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.468979+0000","last_change":"2023-10-14T19:09:11.463082+0000","last_active":"2023-10-14T19:09:11.468979+0000","last_peered":"2023-10-14T19:09:11.468979+0000","last_clean":"2023-10-14T19:09:11.468979+0000","last_became_active":"2023-10-14T19:09:11.462779+0000","last_became_peered":"2023-10-14T19:09:11.462779+0000","last_unstale":"2023-10-14T19:09:11.468979+0000","last_undegraded":"2023-10-14T19:09:11.468979+0000","last_fullsized":"2023-10-14T19:09:11.468979+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:33:22.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455824+0000","last_change":"2023-10-14T19:09:10.423444+0000","last_active":"2023-10-14T19:09:11.455824+0000","last_peered":"2023-10-14T19:09:11.455824+0000","last_clean":"2023-10-14T19:09:11.455824+0000","last_became_active":"2023-10-14T19:09:10.423153+0000","last_became_peered":"2023-10-14T19:09:10.423153+0000","last_unstale":"2023-10-14T19:09:11.455824+0000","last_undegraded":"2023-10-14T19:09:11.455824+0000","last_fullsized":"2023-10-14T19:09:11.455824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:20.307588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458392+0000","last_change":"2023-10-14T19:09:11.455227+0000","last_active":"2023-10-14T19:09:11.458392+0000","last_peered":"2023-10-14T19:09:11.458392+0000","last_clean":"2023-10-14T19:09:11.458392+0000","last_became_active":"2023-10-14T19:09:11.454702+0000","last_became_peered":"2023-10-14T19:09:11.454702+0000","last_unstale":"2023-10-14T19:09:11.458392+0000","last_undegraded":"2023-10-14T19:09:11.458392+0000","last_fullsized":"2023-10-14T19:09:11.458392+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:51.903737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.442272+0000","last_change":"2023-10-14T19:09:10.432539+0000","last_active":"2023-10-14T19:09:11.442272+0000","last_peered":"2023-10-14T19:09:11.442272+0000","last_clean":"2023-10-14T19:09:11.442272+0000","last_became_active":"2023-10-14T19:09:10.432271+0000","last_became_peered":"2023-10-14T19:09:10.432271+0000","last_unstale":"2023-10-14T19:09:11.442272+0000","last_undegraded":"2023-10-14T19:09:11.442272+0000","last_fullsized":"2023-10-14T19:09:11.442272+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:53:24.788449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456430+0000","last_change":"2023-10-14T19:09:11.451154+0000","last_active":"2023-10-14T19:09:11.456430+0000","last_peered":"2023-10-14T19:09:11.456430+0000","last_clean":"2023-10-14T19:09:11.456430+0000","last_became_active":"2023-10-14T19:09:11.450901+0000","last_became_peered":"2023-10-14T19:09:11.450901+0000","last_unstale":"2023-10-14T19:09:11.456430+0000","last_undegraded":"2023-10-14T19:09:11.456430+0000","last_fullsized":"2023-10-14T19:09:11.456430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:06.237196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454605+0000","last_change":"2023-10-14T19:09:10.435587+0000","last_active":"2023-10-14T19:09:11.454605+0000","last_peered":"2023-10-14T19:09:11.454605+0000","last_clean":"2023-10-14T19:09:11.454605+0000","last_became_active":"2023-10-14T19:09:10.435292+0000","last_became_peered":"2023-10-14T19:09:10.435292+0000","last_unstale":"2023-10-14T19:09:11.454605+0000","last_undegraded":"2023-10-14T19:09:11.454605+0000","last_fullsized":"2023-10-14T19:09:11.454605+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:31:43.257650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.467202+0000","last_change":"2023-10-14T19:09:11.466894+0000","last_active":"2023-10-14T19:09:11.467202+0000","last_peered":"2023-10-14T19:09:11.467202+0000","last_clean":"2023-10-14T19:09:11.467202+0000","last_became_active":"2023-10-14T19:09:11.466598+0000","last_became_peered":"2023-10-14T19:09:11.466598+0000","last_unstale":"2023-10-14T19:09:11.467202+0000","last_undegraded":"2023-10-14T19:09:11.467202+0000","last_fullsized":"2023-10-14T19:09:11.467202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:44.056341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.433214+0000","last_change":"2023-10-14T19:09:10.426976+0000","last_active":"2023-10-14T19:09:11.433214+0000","last_peered":"2023-10-14T19:09:11.433214+0000","last_clean":"2023-10-14T19:09:11.433214+0000","last_became_active":"2023-10-14T19:09:10.425173+0000","last_became_peered":"2023-10-14T19:09:10.425173+0000","last_unstale":"2023-10-14T19:09:11.433214+0000","last_undegraded":"2023-10-14T19:09:11.433214+0000","last_fullsized":"2023-10-14T19:09:11.433214+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:47:49.206432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461515+0000","last_change":"2023-10-14T19:09:11.456382+0000","last_active":"2023-10-14T19:09:11.461515+0000","last_peered":"2023-10-14T19:09:11.461515+0000","last_clean":"2023-10-14T19:09:11.461515+0000","last_became_active":"2023-10-14T19:09:11.456067+0000","last_became_peered":"2023-10-14T19:09:11.456067+0000","last_unstale":"2023-10-14T19:09:11.461515+0000","last_undegraded":"2023-10-14T19:09:11.461515+0000","last_fullsized":"2023-10-14T19:09:11.461515+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:02:54.666890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.439754+0000","last_change":"2023-10-14T19:09:10.433526+0000","last_active":"2023-10-14T19:09:11.439754+0000","last_peered":"2023-10-14T19:09:11.439754+0000","last_clean":"2023-10-14T19:09:11.439754+0000","last_became_active":"2023-10-14T19:09:10.433206+0000","last_became_peered":"2023-10-14T19:09:10.433206+0000","last_unstale":"2023-10-14T19:09:11.439754+0000","last_undegraded":"2023-10-14T19:09:11.439754+0000","last_fullsized":"2023-10-14T19:09:11.439754+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:18.014552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456891+0000","last_change":"2023-10-14T19:09:11.452443+0000","last_active":"2023-10-14T19:09:11.456891+0000","last_peered":"2023-10-14T19:09:11.456891+0000","last_clean":"2023-10-14T19:09:11.456891+0000","last_became_active":"2023-10-14T19:09:11.452177+0000","last_became_peered":"2023-10-14T19:09:11.452177+0000","last_unstale":"2023-10-14T19:09:11.456891+0000","last_undegraded":"2023-10-14T19:09:11.456891+0000","last_fullsized":"2023-10-14T19:09:11.456891+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:33.211233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.446512+0000","last_change":"2023-10-14T19:09:10.431710+0000","last_active":"2023-10-14T19:09:11.446512+0000","last_peered":"2023-10-14T19:09:11.446512+0000","last_clean":"2023-10-14T19:09:11.446512+0000","last_became_active":"2023-10-14T19:09:10.431301+0000","last_became_peered":"2023-10-14T19:09:10.431301+0000","last_unstale":"2023-10-14T19:09:11.446512+0000","last_undegraded":"2023-10-14T19:09:11.446512+0000","last_fullsized":"2023-10-14T19:09:11.446512+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:33:21.302759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456524+0000","last_change":"2023-10-14T19:09:11.454181+0000","last_active":"2023-10-14T19:09:11.456524+0000","last_peered":"2023-10-14T19:09:11.456524+0000","last_clean":"2023-10-14T19:09:11.456524+0000","last_became_active":"2023-10-14T19:09:11.453902+0000","last_became_peered":"2023-10-14T19:09:11.453902+0000","last_unstale":"2023-10-14T19:09:11.456524+0000","last_undegraded":"2023-10-14T19:09:11.456524+0000","last_fullsized":"2023-10-14T19:09:11.456524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:13.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465219+0000","last_change":"2023-10-14T19:09:10.429548+0000","last_active":"2023-10-14T19:09:11.465219+0000","last_peered":"2023-10-14T19:09:11.465219+0000","last_clean":"2023-10-14T19:09:11.465219+0000","last_became_active":"2023-10-14T19:09:10.429285+0000","last_became_peered":"2023-10-14T19:09:10.429285+0000","last_unstale":"2023-10-14T19:09:11.465219+0000","last_undegraded":"2023-10-14T19:09:11.465219+0000","last_fullsized":"2023-10-14T19:09:11.465219+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:53.473802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.466063+0000","last_change":"2023-10-14T19:09:11.464802+0000","last_active":"2023-10-14T19:09:11.466063+0000","last_peered":"2023-10-14T19:09:11.466063+0000","last_clean":"2023-10-14T19:09:11.466063+0000","last_became_active":"2023-10-14T19:09:11.464497+0000","last_became_peered":"2023-10-14T19:09:11.464497+0000","last_unstale":"2023-10-14T19:09:11.466063+0000","last_undegraded":"2023-10-14T19:09:11.466063+0000","last_fullsized":"2023-10-14T19:09:11.466063+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:24.024280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.438154+0000","last_change":"2023-10-14T19:09:10.431638+0000","last_active":"2023-10-14T19:09:11.438154+0000","last_peered":"2023-10-14T19:09:11.438154+0000","last_clean":"2023-10-14T19:09:11.438154+0000","last_became_active":"2023-10-14T19:09:10.431358+0000","last_became_peered":"2023-10-14T19:09:10.431358+0000","last_unstale":"2023-10-14T19:09:11.438154+0000","last_undegraded":"2023-10-14T19:09:11.438154+0000","last_fullsized":"2023-10-14T19:09:11.438154+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:14.462092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465559+0000","last_change":"2023-10-14T19:09:11.462608+0000","last_active":"2023-10-14T19:09:11.465559+0000","last_peered":"2023-10-14T19:09:11.465559+0000","last_clean":"2023-10-14T19:09:11.465559+0000","last_became_active":"2023-10-14T19:09:11.461277+0000","last_became_peered":"2023-10-14T19:09:11.461277+0000","last_unstale":"2023-10-14T19:09:11.465559+0000","last_undegraded":"2023-10-14T19:09:11.465559+0000","last_fullsized":"2023-10-14T19:09:11.465559+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:27.942352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.443460+0000","last_change":"2023-10-14T19:09:10.432457+0000","last_active":"2023-10-14T19:09:11.443460+0000","last_peered":"2023-10-14T19:09:11.443460+0000","last_clean":"2023-10-14T19:09:11.443460+0000","last_became_active":"2023-10-14T19:09:10.432294+0000","last_became_peered":"2023-10-14T19:09:10.432294+0000","last_unstale":"2023-10-14T19:09:11.443460+0000","last_undegraded":"2023-10-14T19:09:11.443460+0000","last_fullsized":"2023-10-14T19:09:11.443460+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:55.325235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454905+0000","last_change":"2023-10-14T19:09:11.447230+0000","last_active":"2023-10-14T19:09:11.454905+0000","last_peered":"2023-10-14T19:09:11.454905+0000","last_clean":"2023-10-14T19:09:11.454905+0000","last_became_active":"2023-10-14T19:09:11.446957+0000","last_became_peered":"2023-10-14T19:09:11.446957+0000","last_unstale":"2023-10-14T19:09:11.454905+0000","last_undegraded":"2023-10-14T19:09:11.454905+0000","last_fullsized":"2023-10-14T19:09:11.454905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:54.475642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437592+0000","last_change":"2023-10-14T19:09:10.429918+0000","last_active":"2023-10-14T19:09:11.437592+0000","last_peered":"2023-10-14T19:09:11.437592+0000","last_clean":"2023-10-14T19:09:11.437592+0000","last_became_active":"2023-10-14T19:09:10.429627+0000","last_became_peered":"2023-10-14T19:09:10.429627+0000","last_unstale":"2023-10-14T19:09:11.437592+0000","last_undegraded":"2023-10-14T19:09:11.437592+0000","last_fullsized":"2023-10-14T19:09:11.437592+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:12.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.460954+0000","last_change":"2023-10-14T19:09:11.454091+0000","last_active":"2023-10-14T19:09:11.460954+0000","last_peered":"2023-10-14T19:09:11.460954+0000","last_clean":"2023-10-14T19:09:11.460954+0000","last_became_active":"2023-10-14T19:09:11.453796+0000","last_became_peered":"2023-10-14T19:09:11.453796+0000","last_unstale":"2023-10-14T19:09:11.460954+0000","last_undegraded":"2023-10-14T19:09:11.460954+0000","last_fullsized":"2023-10-14T19:09:11.460954+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:27.496935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.442389+0000","last_change":"2023-10-14T19:09:10.428603+0000","last_active":"2023-10-14T19:09:11.442389+0000","last_peered":"2023-10-14T19:09:11.442389+0000","last_clean":"2023-10-14T19:09:11.442389+0000","last_became_active":"2023-10-14T19:09:10.428340+0000","last_became_peered":"2023-10-14T19:09:10.428340+0000","last_unstale":"2023-10-14T19:09:11.442389+0000","last_undegraded":"2023-10-14T19:09:11.442389+0000","last_fullsized":"2023-10-14T19:09:11.442389+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:20:36.332081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454371+0000","last_change":"2023-10-14T19:09:11.446472+0000","last_active":"2023-10-14T19:09:11.454371+0000","last_peered":"2023-10-14T19:09:11.454371+0000","last_clean":"2023-10-14T19:09:11.454371+0000","last_became_active":"2023-10-14T19:09:11.446223+0000","last_became_peered":"2023-10-14T19:09:11.446223+0000","last_unstale":"2023-10-14T19:09:11.454371+0000","last_undegraded":"2023-10-14T19:09:11.454371+0000","last_fullsized":"2023-10-14T19:09:11.454371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:12.361626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437039+0000","last_change":"2023-10-14T19:09:10.425668+0000","last_active":"2023-10-14T19:09:11.437039+0000","last_peered":"2023-10-14T19:09:11.437039+0000","last_clean":"2023-10-14T19:09:11.437039+0000","last_became_active":"2023-10-14T19:09:10.425382+0000","last_became_peered":"2023-10-14T19:09:10.425382+0000","last_unstale":"2023-10-14T19:09:11.437039+0000","last_undegraded":"2023-10-14T19:09:11.437039+0000","last_fullsized":"2023-10-14T19:09:11.437039+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:14.462092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458471+0000","last_change":"2023-10-14T19:09:11.455489+0000","last_active":"2023-10-14T19:09:11.458471+0000","last_peered":"2023-10-14T19:09:11.458471+0000","last_clean":"2023-10-14T19:09:11.458471+0000","last_became_active":"2023-10-14T19:09:11.455232+0000","last_became_peered":"2023-10-14T19:09:11.455232+0000","last_unstale":"2023-10-14T19:09:11.458471+0000","last_undegraded":"2023-10-14T19:09:11.458471+0000","last_fullsized":"2023-10-14T19:09:11.458471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:55.855622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.433373+0000","last_change":"2023-10-14T19:09:10.434989+0000","last_active":"2023-10-14T19:09:11.433373+0000","last_peered":"2023-10-14T19:09:11.433373+0000","last_clean":"2023-10-14T19:09:11.433373+0000","last_became_active":"2023-10-14T19:09:10.434513+0000","last_became_peered":"2023-10-14T19:09:10.434513+0000","last_unstale":"2023-10-14T19:09:11.433373+0000","last_undegraded":"2023-10-14T19:09:11.433373+0000","last_fullsized":"2023-10-14T19:09:11.433373+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:46.932765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.462303+0000","last_change":"2023-10-14T19:09:11.452280+0000","last_active":"2023-10-14T19:09:11.462303+0000","last_peered":"2023-10-14T19:09:11.462303+0000","last_clean":"2023-10-14T19:09:11.462303+0000","last_became_active":"2023-10-14T19:09:11.450673+0000","last_became_peered":"2023-10-14T19:09:11.450673+0000","last_unstale":"2023-10-14T19:09:11.462303+0000","last_undegraded":"2023-10-14T19:09:11.462303+0000","last_fullsized":"2023-10-14T19:09:11.462303+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:55.563870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.446408+0000","last_change":"2023-10-14T19:09:10.431781+0000","last_active":"2023-10-14T19:09:11.446408+0000","last_peered":"2023-10-14T19:09:11.446408+0000","last_clean":"2023-10-14T19:09:11.446408+0000","last_became_active":"2023-10-14T19:09:10.431428+0000","last_became_peered":"2023-10-14T19:09:10.431428+0000","last_unstale":"2023-10-14T19:09:11.446408+0000","last_undegraded":"2023-10-14T19:09:11.446408+0000","last_fullsized":"2023-10-14T19:09:11.446408+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:32.209393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456371+0000","last_change":"2023-10-14T19:09:11.454274+0000","last_active":"2023-10-14T19:09:11.456371+0000","last_peered":"2023-10-14T19:09:11.456371+0000","last_clean":"2023-10-14T19:09:11.456371+0000","last_became_active":"2023-10-14T19:09:11.453165+0000","last_became_peered":"2023-10-14T19:09:11.453165+0000","last_unstale":"2023-10-14T19:09:11.456371+0000","last_undegraded":"2023-10-14T19:09:11.456371+0000","last_fullsized":"2023-10-14T19:09:11.456371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:55.334948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.441813+0000","last_change":"2023-10-14T19:09:10.429347+0000","last_active":"2023-10-14T19:09:11.441813+0000","last_peered":"2023-10-14T19:09:11.441813+0000","last_clean":"2023-10-14T19:09:11.441813+0000","last_became_active":"2023-10-14T19:09:10.429154+0000","last_became_peered":"2023-10-14T19:09:10.429154+0000","last_unstale":"2023-10-14T19:09:11.441813+0000","last_undegraded":"2023-10-14T19:09:11.441813+0000","last_fullsized":"2023-10-14T19:09:11.441813+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:12:19.500140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.445136+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:09:11.445136+0000","last_peered":"2023-10-14T19:09:11.445136+0000","last_clean":"2023-10-14T19:09:11.445136+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:09:11.445136+0000","last_undegraded":"2023-10-14T19:09:11.445136+0000","last_fullsized":"2023-10-14T19:09:11.445136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1132289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.67200000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":4.2080000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.67200000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":3.1480000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.61499999999999999},"min":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.505}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.75700000000000001},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":3.23},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.78000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.57199999999999995},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":2.4620000000000002},"last":0.313},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.70399999999999996},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.34799999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51900000000000002,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.375},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.86899999999999999,"15min":2.883},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.79300000000000004},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":5.383},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1261568,"data_stored":541403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.69199999999999995},"min":{"1min":0.38400000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":5.6820000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.752},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":5.7030000000000003},"last":0.65300000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.74399999999999999},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.70999999999999996,"5min":0.755,"15min":7.8680000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.52900000000000003,"15min":0.76300000000000001},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.80900000000000005,"15min":7.8250000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.77900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.83299999999999996},"min":{"1min":0.44,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":8.0090000000000003},"last":0.628}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.81299999999999994},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.311},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.495}]},{"osd":7,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.59699999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77000000000000002,"5min":0.77900000000000003,"15min":0.86599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":547745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.495,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54700000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.249},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":1.032,"15min":1.032},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":1.627}]},{"osd":6,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.499},{"interface":"front","average":{"1min":0.622,"5min":0.625,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.079,"15min":1.079},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":1.5880000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303224,"kb_used_data":1840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068616,"statfs":{"total":96636764160,"available":96326262784,"internally_reserved":0,"allocated":1884160,"data_stored":1139637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.497,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.62,"15min":0.62},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72999999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80000000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61299999999999999,"15min":0.64300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":541333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.439,"5min":0.58199999999999996,"15min":0.60699999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.439},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.34699999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.56499999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.76700000000000002},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.497,"5min":0.60999999999999999,"15min":11.269},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34200000000000003,"15min":0.73799999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48699999999999999,"5min":0.56499999999999995,"15min":11.318},"last":0.317},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56000000000000005,"5min":0.624,"15min":0.69999999999999996},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.375},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.67100000000000004},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.68600000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.82799999999999996,"5min":0.89000000000000001,"15min":1.9710000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":1.0289999999999999},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79900000000000004,"5min":0.93200000000000005,"15min":11.379},"last":0.40000000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":1.0309999999999999},"min":{"1min":0.47399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.93400000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.626,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":2.0009999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":1.0469999999999999},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.46999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":542939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32300000000000001,"15min":0.35299999999999998},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.42399999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51200000000000001,"5min":0.57199999999999995,"15min":0.70099999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.64500000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36199999999999999,"15min":0.38500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.0629999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.41399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":0.59999999999999998,"15min":0.81000000000000005},"last":0.375},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.45000000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":2.597},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.94999999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.214}]},{"osd":6,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.133},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.997}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302624,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069216,"statfs":{"total":96636764160,"available":96326877184,"internally_reserved":0,"allocated":1269760,"data_stored":547621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.67800000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":3.488,"15min":3.488},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64300000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.502,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63900000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66400000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.437}]},{"osd":6,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68500000000000005,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.72299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298536,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073304,"statfs":{"total":96636764160,"available":96331063296,"internally_reserved":0,"allocated":1277952,"data_stored":548197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.876,"15min":0.876},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.61699999999999999,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.88500000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.754},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:09:15.549 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:09:15.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.702+0000 7f747c92d700 1 Processor -- start 2023-10-14T19:09:15.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.702+0000 7f747c92d700 1 -- start start 2023-10-14T19:09:15.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747c92d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74780cf200 0x7f74780c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747c92d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f747806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747c92d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747815a280 con 0x7f74780b07d0 2023-10-14T19:09:15.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747c92d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747806e180 con 0x7f74780cf200 2023-10-14T19:09:15.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747c92d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747806d850 con 0x7f74780b0ba0 2023-10-14T19:09:15.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7475d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74780cf200 0x7f74780c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747659c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f74780b07d0 0x7f74780ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34834/0 (socket says 172.21.15.7:34834) 2023-10-14T19:09:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747659c700 1 -- 172.21.15.7:0/2475026801 learned_addr learned my addr 172.21.15.7:0/2475026801 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7476d9d700 1 --2- 172.21.15.7:0/2475026801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f747806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747559a700 1 -- 172.21.15.7:0/2475026801 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158577852 0 0) 0x7f747815a280 con 0x7f74780b07d0 2023-10-14T19:09:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f747559a700 1 -- 172.21.15.7:0/2475026801 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7464003570 con 0x7f74780b07d0 2023-10-14T19:09:15.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7475d9b700 1 -- 172.21.15.7:0/2475026801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 msgr2=0x7f747806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:15.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7475d9b700 1 --2- 172.21.15.7:0/2475026801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f747806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7475d9b700 1 -- 172.21.15.7:0/2475026801 >> v1:172.21.15.7:6789/0 conn(0x7f74780b07d0 legacy=0x7f74780ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7475d9b700 1 -- 172.21.15.7:0/2475026801 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747806db30 con 0x7f74780cf200 2023-10-14T19:09:15.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.703+0000 7f7475d9b700 1 --2- 172.21.15.7:0/2475026801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c42c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f74600098e0 tx=0x7f74600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b5eccb28c2ee46 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:15.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747559a700 1 -- 172.21.15.7:0/2475026801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011630 con 0x7f74780cf200 2023-10-14T19:09:15.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747559a700 1 -- 172.21.15.7:0/2475026801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460011790 con 0x7f74780cf200 2023-10-14T19:09:15.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747559a700 1 -- 172.21.15.7:0/2475026801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011b30 con 0x7f74780cf200 2023-10-14T19:09:15.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 -- 172.21.15.7:0/2475026801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 msgr2=0x7f74780c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 --2- 172.21.15.7:0/2475026801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c42c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f74600098e0 tx=0x7f74600091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 -- 172.21.15.7:0/2475026801 shutdown_connections 2023-10-14T19:09:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 --2- 172.21.15.7:0/2475026801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f747806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 --2- 172.21.15.7:0/2475026801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c42c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 -- 172.21.15.7:0/2475026801 >> 172.21.15.7:0/2475026801 conn(0x7f747806ce80 msgr2=0x7f74780ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 -- 172.21.15.7:0/2475026801 shutdown_connections 2023-10-14T19:09:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.704+0000 7f747c92d700 1 -- 172.21.15.7:0/2475026801 wait complete. 2023-10-14T19:09:15.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.705+0000 7f747c92d700 1 Processor -- start 2023-10-14T19:09:15.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.705+0000 7f747c92d700 1 -- start start 2023-10-14T19:09:15.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747c92d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74780b07d0 0x7f7478141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747c92d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f74780c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747c92d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747c92d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478141a90 con 0x7f74780cf200 2023-10-14T19:09:15.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747c92d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74781425f0 con 0x7f74780b07d0 2023-10-14T19:09:15.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747c92d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7478144d80 con 0x7f74780b0ba0 2023-10-14T19:09:15.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45568/0 (socket says 172.21.15.7:45568) 2023-10-14T19:09:15.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 -- 172.21.15.7:0/2933687751 learned_addr learned my addr 172.21.15.7:0/2933687751 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:15.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7475d9b700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f74780c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f747659c700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74780b07d0 0x7f7478141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 -- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 msgr2=0x7f74780c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f74780c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 -- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74780b07d0 msgr2=0x7f7478141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.706+0000 7f7476d9d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74780b07d0 0x7f7478141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f7476d9d700 1 -- 172.21.15.7:0/2933687751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460009420 con 0x7f74780cf200 2023-10-14T19:09:15.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f747659c700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74780b07d0 0x7f7478141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:15.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f7476d9d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c55c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f747000ea50 tx=0x7f74700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:15.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74700096b0 con 0x7f74780cf200 2023-10-14T19:09:15.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000c850 con 0x7f74780cf200 2023-10-14T19:09:15.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74780c7d30 con 0x7f74780cf200 2023-10-14T19:09:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000cc10 con 0x7f74780cf200 2023-10-14T19:09:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.707+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7478142280 con 0x7f74780cf200 2023-10-14T19:09:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.708+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7478142760 con 0x7f74780cf200 2023-10-14T19:09:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.708+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7470013470 con 0x7f74780cf200 2023-10-14T19:09:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.709+0000 7f746e7fc700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7458067290 0x7f7458069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.709+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7470084ca0 con 0x7f74780cf200 2023-10-14T19:09:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.709+0000 7f747659c700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7458067290 0x7f7458069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.709+0000 7f747659c700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7458067290 0x7f7458069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7468007fd0 tx=0x7f7468009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.713+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7470051b00 con 0x7f74780cf200 2023-10-14T19:09:15.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.905+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7478141e20 con 0x7f7458067290 2023-10-14T19:09:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.913+0000 7f746e7fc700 1 -- 172.21.15.7:0/2933687751 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289748 (secure 0 0 0) 0x7f7468003050 con 0x7f7458067290 2023-10-14T19:09:15.918 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7458067290 msgr2=0x7f7458069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7458067290 0x7f7458069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7468007fd0 tx=0x7f7468009040 comp rx=0 tx=0).stop 2023-10-14T19:09:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 msgr2=0x7f74780c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c55c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f747000ea50 tx=0x7f74700091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 shutdown_connections 2023-10-14T19:09:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7458067290 0x7f7458069740 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74780b07d0 0x7f7478141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74780cf200 0x7f74780c55c0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 --2- 172.21.15.7:0/2933687751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74780b0ba0 0x7f74780c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 >> 172.21.15.7:0/2933687751 conn(0x7f747806ce80 msgr2=0x7f74780ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 shutdown_connections 2023-10-14T19:09:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:15.917+0000 7f747c92d700 1 -- 172.21.15.7:0/2933687751 wait complete. 2023-10-14T19:09:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:09:15.929 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-10-14T19:09:15.711338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418072,"kb_used_data":11096,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556648,"statfs":{"total":773094113280,"available":770618007552,"internally_reserved":0,"allocated":11362304,"data_stored":5541164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001282"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464314+0000","last_change":"2023-10-14T19:09:11.451607+0000","last_active":"2023-10-14T19:09:11.464314+0000","last_peered":"2023-10-14T19:09:11.464314+0000","last_clean":"2023-10-14T19:09:11.464314+0000","last_became_active":"2023-10-14T19:09:11.450793+0000","last_became_peered":"2023-10-14T19:09:11.450793+0000","last_unstale":"2023-10-14T19:09:11.464314+0000","last_undegraded":"2023-10-14T19:09:11.464314+0000","last_fullsized":"2023-10-14T19:09:11.464314+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:32.243023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.448745+0000","last_change":"2023-10-14T19:09:11.443305+0000","last_active":"2023-10-14T19:09:11.448745+0000","last_peered":"2023-10-14T19:09:11.448745+0000","last_clean":"2023-10-14T19:09:11.448745+0000","last_became_active":"2023-10-14T19:09:11.443022+0000","last_became_peered":"2023-10-14T19:09:11.443022+0000","last_unstale":"2023-10-14T19:09:11.448745+0000","last_undegraded":"2023-10-14T19:09:11.448745+0000","last_fullsized":"2023-10-14T19:09:11.448745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:24:43.626051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458373+0000","last_change":"2023-10-14T19:09:11.452466+0000","last_active":"2023-10-14T19:09:11.458373+0000","last_peered":"2023-10-14T19:09:11.458373+0000","last_clean":"2023-10-14T19:09:11.458373+0000","last_became_active":"2023-10-14T19:09:11.452196+0000","last_became_peered":"2023-10-14T19:09:11.452196+0000","last_unstale":"2023-10-14T19:09:11.458373+0000","last_undegraded":"2023-10-14T19:09:11.458373+0000","last_fullsized":"2023-10-14T19:09:11.458373+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:33.211233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.462194+0000","last_change":"2023-10-14T19:09:11.455812+0000","last_active":"2023-10-14T19:09:11.462194+0000","last_peered":"2023-10-14T19:09:11.462194+0000","last_clean":"2023-10-14T19:09:11.462194+0000","last_became_active":"2023-10-14T19:09:11.452630+0000","last_became_peered":"2023-10-14T19:09:11.452630+0000","last_unstale":"2023-10-14T19:09:11.462194+0000","last_undegraded":"2023-10-14T19:09:11.462194+0000","last_fullsized":"2023-10-14T19:09:11.462194+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:57:47.781394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.452286+0000","last_change":"2023-10-14T19:09:11.445661+0000","last_active":"2023-10-14T19:09:11.452286+0000","last_peered":"2023-10-14T19:09:11.452286+0000","last_clean":"2023-10-14T19:09:11.452286+0000","last_became_active":"2023-10-14T19:09:11.445381+0000","last_became_peered":"2023-10-14T19:09:11.445381+0000","last_unstale":"2023-10-14T19:09:11.452286+0000","last_undegraded":"2023-10-14T19:09:11.452286+0000","last_fullsized":"2023-10-14T19:09:11.452286+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:28.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461019+0000","last_change":"2023-10-14T19:09:11.460165+0000","last_active":"2023-10-14T19:09:11.461019+0000","last_peered":"2023-10-14T19:09:11.461019+0000","last_clean":"2023-10-14T19:09:11.461019+0000","last_became_active":"2023-10-14T19:09:11.459833+0000","last_became_peered":"2023-10-14T19:09:11.459833+0000","last_unstale":"2023-10-14T19:09:11.461019+0000","last_undegraded":"2023-10-14T19:09:11.461019+0000","last_fullsized":"2023-10-14T19:09:11.461019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.714635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454519+0000","last_change":"2023-10-14T19:09:11.451152+0000","last_active":"2023-10-14T19:09:11.454519+0000","last_peered":"2023-10-14T19:09:11.454519+0000","last_clean":"2023-10-14T19:09:11.454519+0000","last_became_active":"2023-10-14T19:09:11.449087+0000","last_became_peered":"2023-10-14T19:09:11.449087+0000","last_unstale":"2023-10-14T19:09:11.454519+0000","last_undegraded":"2023-10-14T19:09:11.454519+0000","last_fullsized":"2023-10-14T19:09:11.454519+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:52.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456588+0000","last_change":"2023-10-14T19:09:11.451569+0000","last_active":"2023-10-14T19:09:11.456588+0000","last_peered":"2023-10-14T19:09:11.456588+0000","last_clean":"2023-10-14T19:09:11.456588+0000","last_became_active":"2023-10-14T19:09:11.451297+0000","last_became_peered":"2023-10-14T19:09:11.451297+0000","last_unstale":"2023-10-14T19:09:11.456588+0000","last_undegraded":"2023-10-14T19:09:11.456588+0000","last_fullsized":"2023-10-14T19:09:11.456588+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:37.797964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.466044+0000","last_change":"2023-10-14T19:09:11.464556+0000","last_active":"2023-10-14T19:09:11.466044+0000","last_peered":"2023-10-14T19:09:11.466044+0000","last_clean":"2023-10-14T19:09:11.466044+0000","last_became_active":"2023-10-14T19:09:11.463816+0000","last_became_peered":"2023-10-14T19:09:11.463816+0000","last_unstale":"2023-10-14T19:09:11.466044+0000","last_undegraded":"2023-10-14T19:09:11.466044+0000","last_fullsized":"2023-10-14T19:09:11.466044+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:09.438949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.467676+0000","last_change":"2023-10-14T19:09:11.467310+0000","last_active":"2023-10-14T19:09:11.467676+0000","last_peered":"2023-10-14T19:09:11.467676+0000","last_clean":"2023-10-14T19:09:11.467676+0000","last_became_active":"2023-10-14T19:09:11.466063+0000","last_became_peered":"2023-10-14T19:09:11.466063+0000","last_unstale":"2023-10-14T19:09:11.467676+0000","last_undegraded":"2023-10-14T19:09:11.467676+0000","last_fullsized":"2023-10-14T19:09:11.467676+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:43.266434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.450442+0000","last_change":"2023-10-14T19:09:11.446423+0000","last_active":"2023-10-14T19:09:11.450442+0000","last_peered":"2023-10-14T19:09:11.450442+0000","last_clean":"2023-10-14T19:09:11.450442+0000","last_became_active":"2023-10-14T19:09:11.446140+0000","last_became_peered":"2023-10-14T19:09:11.446140+0000","last_unstale":"2023-10-14T19:09:11.450442+0000","last_undegraded":"2023-10-14T19:09:11.450442+0000","last_fullsized":"2023-10-14T19:09:11.450442+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:42.198292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465539+0000","last_change":"2023-10-14T19:09:11.462572+0000","last_active":"2023-10-14T19:09:11.465539+0000","last_peered":"2023-10-14T19:09:11.465539+0000","last_clean":"2023-10-14T19:09:11.465539+0000","last_became_active":"2023-10-14T19:09:11.461175+0000","last_became_peered":"2023-10-14T19:09:11.461175+0000","last_unstale":"2023-10-14T19:09:11.465539+0000","last_undegraded":"2023-10-14T19:09:11.465539+0000","last_fullsized":"2023-10-14T19:09:11.465539+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:51:44.843645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461489+0000","last_change":"2023-10-14T19:09:11.457974+0000","last_active":"2023-10-14T19:09:11.461489+0000","last_peered":"2023-10-14T19:09:11.461489+0000","last_clean":"2023-10-14T19:09:11.461489+0000","last_became_active":"2023-10-14T19:09:11.457659+0000","last_became_peered":"2023-10-14T19:09:11.457659+0000","last_unstale":"2023-10-14T19:09:11.461489+0000","last_undegraded":"2023-10-14T19:09:11.461489+0000","last_fullsized":"2023-10-14T19:09:11.461489+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:22.897697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461332+0000","last_change":"2023-10-14T19:09:11.456924+0000","last_active":"2023-10-14T19:09:11.461332+0000","last_peered":"2023-10-14T19:09:11.461332+0000","last_clean":"2023-10-14T19:09:11.461332+0000","last_became_active":"2023-10-14T19:09:11.456697+0000","last_became_peered":"2023-10-14T19:09:11.456697+0000","last_unstale":"2023-10-14T19:09:11.461332+0000","last_undegraded":"2023-10-14T19:09:11.461332+0000","last_fullsized":"2023-10-14T19:09:11.461332+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:42.880064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459243+0000","last_change":"2023-10-14T19:09:11.457913+0000","last_active":"2023-10-14T19:09:11.459243+0000","last_peered":"2023-10-14T19:09:11.459243+0000","last_clean":"2023-10-14T19:09:11.459243+0000","last_became_active":"2023-10-14T19:09:11.457631+0000","last_became_peered":"2023-10-14T19:09:11.457631+0000","last_unstale":"2023-10-14T19:09:11.459243+0000","last_undegraded":"2023-10-14T19:09:11.459243+0000","last_fullsized":"2023-10-14T19:09:11.459243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:15.463931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458831+0000","last_change":"2023-10-14T19:09:11.452286+0000","last_active":"2023-10-14T19:09:11.458831+0000","last_peered":"2023-10-14T19:09:11.458831+0000","last_clean":"2023-10-14T19:09:11.458831+0000","last_became_active":"2023-10-14T19:09:11.451812+0000","last_became_peered":"2023-10-14T19:09:11.451812+0000","last_unstale":"2023-10-14T19:09:11.458831+0000","last_undegraded":"2023-10-14T19:09:11.458831+0000","last_fullsized":"2023-10-14T19:09:11.458831+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:11.624773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458534+0000","last_change":"2023-10-14T19:09:11.449798+0000","last_active":"2023-10-14T19:09:11.458534+0000","last_peered":"2023-10-14T19:09:11.458534+0000","last_clean":"2023-10-14T19:09:11.458534+0000","last_became_active":"2023-10-14T19:09:11.449363+0000","last_became_peered":"2023-10-14T19:09:11.449363+0000","last_unstale":"2023-10-14T19:09:11.458534+0000","last_undegraded":"2023-10-14T19:09:11.458534+0000","last_fullsized":"2023-10-14T19:09:11.458534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:26.717844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454907+0000","last_change":"2023-10-14T19:09:11.445501+0000","last_active":"2023-10-14T19:09:11.454907+0000","last_peered":"2023-10-14T19:09:11.454907+0000","last_clean":"2023-10-14T19:09:11.454907+0000","last_became_active":"2023-10-14T19:09:11.445154+0000","last_became_peered":"2023-10-14T19:09:11.445154+0000","last_unstale":"2023-10-14T19:09:11.454907+0000","last_undegraded":"2023-10-14T19:09:11.454907+0000","last_fullsized":"2023-10-14T19:09:11.454907+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:07:13.502477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464195+0000","last_change":"2023-10-14T19:09:11.458955+0000","last_active":"2023-10-14T19:09:11.464195+0000","last_peered":"2023-10-14T19:09:11.464195+0000","last_clean":"2023-10-14T19:09:11.464195+0000","last_became_active":"2023-10-14T19:09:11.458661+0000","last_became_peered":"2023-10-14T19:09:11.458661+0000","last_unstale":"2023-10-14T19:09:11.464195+0000","last_undegraded":"2023-10-14T19:09:11.464195+0000","last_fullsized":"2023-10-14T19:09:11.464195+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:56.327074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.460907+0000","last_change":"2023-10-14T19:09:11.452854+0000","last_active":"2023-10-14T19:09:11.460907+0000","last_peered":"2023-10-14T19:09:11.460907+0000","last_clean":"2023-10-14T19:09:11.460907+0000","last_became_active":"2023-10-14T19:09:11.451866+0000","last_became_peered":"2023-10-14T19:09:11.451866+0000","last_unstale":"2023-10-14T19:09:11.460907+0000","last_undegraded":"2023-10-14T19:09:11.460907+0000","last_fullsized":"2023-10-14T19:09:11.460907+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:00.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461038+0000","last_change":"2023-10-14T19:09:11.454878+0000","last_active":"2023-10-14T19:09:11.461038+0000","last_peered":"2023-10-14T19:09:11.461038+0000","last_clean":"2023-10-14T19:09:11.461038+0000","last_became_active":"2023-10-14T19:09:11.450542+0000","last_became_peered":"2023-10-14T19:09:11.450542+0000","last_unstale":"2023-10-14T19:09:11.461038+0000","last_undegraded":"2023-10-14T19:09:11.461038+0000","last_fullsized":"2023-10-14T19:09:11.461038+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:14.132211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459440+0000","last_change":"2023-10-14T19:09:11.447110+0000","last_active":"2023-10-14T19:09:11.459440+0000","last_peered":"2023-10-14T19:09:11.459440+0000","last_clean":"2023-10-14T19:09:11.459440+0000","last_became_active":"2023-10-14T19:09:11.446837+0000","last_became_peered":"2023-10-14T19:09:11.446837+0000","last_unstale":"2023-10-14T19:09:11.459440+0000","last_undegraded":"2023-10-14T19:09:11.459440+0000","last_fullsized":"2023-10-14T19:09:11.459440+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:53.505866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458329+0000","last_change":"2023-10-14T19:09:11.448899+0000","last_active":"2023-10-14T19:09:11.458329+0000","last_peered":"2023-10-14T19:09:11.458329+0000","last_clean":"2023-10-14T19:09:11.458329+0000","last_became_active":"2023-10-14T19:09:11.448650+0000","last_became_peered":"2023-10-14T19:09:11.448650+0000","last_unstale":"2023-10-14T19:09:11.458329+0000","last_undegraded":"2023-10-14T19:09:11.458329+0000","last_fullsized":"2023-10-14T19:09:11.458329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:10.848122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456352+0000","last_change":"2023-10-14T19:09:11.453383+0000","last_active":"2023-10-14T19:09:11.456352+0000","last_peered":"2023-10-14T19:09:11.456352+0000","last_clean":"2023-10-14T19:09:11.456352+0000","last_became_active":"2023-10-14T19:09:11.449375+0000","last_became_peered":"2023-10-14T19:09:11.449375+0000","last_unstale":"2023-10-14T19:09:11.456352+0000","last_undegraded":"2023-10-14T19:09:11.456352+0000","last_fullsized":"2023-10-14T19:09:11.456352+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:37.797964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458509+0000","last_change":"2023-10-14T19:09:11.449610+0000","last_active":"2023-10-14T19:09:11.458509+0000","last_peered":"2023-10-14T19:09:11.458509+0000","last_clean":"2023-10-14T19:09:11.458509+0000","last_became_active":"2023-10-14T19:09:11.449020+0000","last_became_peered":"2023-10-14T19:09:11.449020+0000","last_unstale":"2023-10-14T19:09:11.458509+0000","last_undegraded":"2023-10-14T19:09:11.458509+0000","last_fullsized":"2023-10-14T19:09:11.458509+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:08:25.122170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.467656+0000","last_change":"2023-10-14T19:09:11.467254+0000","last_active":"2023-10-14T19:09:11.467656+0000","last_peered":"2023-10-14T19:09:11.467656+0000","last_clean":"2023-10-14T19:09:11.467656+0000","last_became_active":"2023-10-14T19:09:11.465681+0000","last_became_peered":"2023-10-14T19:09:11.465681+0000","last_unstale":"2023-10-14T19:09:11.467656+0000","last_undegraded":"2023-10-14T19:09:11.467656+0000","last_fullsized":"2023-10-14T19:09:11.467656+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:47:34.852115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455342+0000","last_change":"2023-10-14T19:09:11.452915+0000","last_active":"2023-10-14T19:09:11.455342+0000","last_peered":"2023-10-14T19:09:11.455342+0000","last_clean":"2023-10-14T19:09:11.455342+0000","last_became_active":"2023-10-14T19:09:11.452096+0000","last_became_peered":"2023-10-14T19:09:11.452096+0000","last_unstale":"2023-10-14T19:09:11.455342+0000","last_undegraded":"2023-10-14T19:09:11.455342+0000","last_fullsized":"2023-10-14T19:09:11.455342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:33.523020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456293+0000","last_change":"2023-10-14T19:09:11.453540+0000","last_active":"2023-10-14T19:09:11.456293+0000","last_peered":"2023-10-14T19:09:11.456293+0000","last_clean":"2023-10-14T19:09:11.456293+0000","last_became_active":"2023-10-14T19:09:11.453280+0000","last_became_peered":"2023-10-14T19:09:11.453280+0000","last_unstale":"2023-10-14T19:09:11.456293+0000","last_undegraded":"2023-10-14T19:09:11.456293+0000","last_fullsized":"2023-10-14T19:09:11.456293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:06.237196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461065+0000","last_change":"2023-10-14T19:09:11.455078+0000","last_active":"2023-10-14T19:09:11.461065+0000","last_peered":"2023-10-14T19:09:11.461065+0000","last_clean":"2023-10-14T19:09:11.461065+0000","last_became_active":"2023-10-14T19:09:11.454565+0000","last_became_peered":"2023-10-14T19:09:11.454565+0000","last_unstale":"2023-10-14T19:09:11.461065+0000","last_undegraded":"2023-10-14T19:09:11.461065+0000","last_fullsized":"2023-10-14T19:09:11.461065+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:33.531211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464036+0000","last_change":"2023-10-14T19:09:11.460078+0000","last_active":"2023-10-14T19:09:11.464036+0000","last_peered":"2023-10-14T19:09:11.464036+0000","last_clean":"2023-10-14T19:09:11.464036+0000","last_became_active":"2023-10-14T19:09:11.459875+0000","last_became_peered":"2023-10-14T19:09:11.459875+0000","last_unstale":"2023-10-14T19:09:11.464036+0000","last_undegraded":"2023-10-14T19:09:11.464036+0000","last_fullsized":"2023-10-14T19:09:11.464036+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:58.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465512+0000","last_change":"2023-10-14T19:09:11.462166+0000","last_active":"2023-10-14T19:09:11.465512+0000","last_peered":"2023-10-14T19:09:11.465512+0000","last_clean":"2023-10-14T19:09:11.465512+0000","last_became_active":"2023-10-14T19:09:11.460292+0000","last_became_peered":"2023-10-14T19:09:11.460292+0000","last_unstale":"2023-10-14T19:09:11.465512+0000","last_undegraded":"2023-10-14T19:09:11.465512+0000","last_fullsized":"2023-10-14T19:09:11.465512+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:22.954696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.457261+0000","last_change":"2023-10-14T19:09:11.456346+0000","last_active":"2023-10-14T19:09:11.457261+0000","last_peered":"2023-10-14T19:09:11.457261+0000","last_clean":"2023-10-14T19:09:11.457261+0000","last_became_active":"2023-10-14T19:09:11.456035+0000","last_became_peered":"2023-10-14T19:09:11.456035+0000","last_unstale":"2023-10-14T19:09:11.457261+0000","last_undegraded":"2023-10-14T19:09:11.457261+0000","last_fullsized":"2023-10-14T19:09:11.457261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:12:20.501979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.447832+0000","last_change":"2023-10-14T19:09:11.443592+0000","last_active":"2023-10-14T19:09:11.447832+0000","last_peered":"2023-10-14T19:09:11.447832+0000","last_clean":"2023-10-14T19:09:11.447832+0000","last_became_active":"2023-10-14T19:09:11.443174+0000","last_became_peered":"2023-10-14T19:09:11.443174+0000","last_unstale":"2023-10-14T19:09:11.447832+0000","last_undegraded":"2023-10-14T19:09:11.447832+0000","last_fullsized":"2023-10-14T19:09:11.447832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:54.913793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"101'4","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.457717+0000","last_change":"2023-10-14T19:09:10.425791+0000","last_active":"2023-10-14T19:09:11.457717+0000","last_peered":"2023-10-14T19:09:11.457717+0000","last_clean":"2023-10-14T19:09:11.457717+0000","last_became_active":"2023-10-14T19:09:10.425485+0000","last_became_peered":"2023-10-14T19:09:10.425485+0000","last_unstale":"2023-10-14T19:09:11.457717+0000","last_undegraded":"2023-10-14T19:09:11.457717+0000","last_fullsized":"2023-10-14T19:09:11.457717+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:51.128711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456222+0000","last_change":"2023-10-14T19:09:11.449340+0000","last_active":"2023-10-14T19:09:11.456222+0000","last_peered":"2023-10-14T19:09:11.456222+0000","last_clean":"2023-10-14T19:09:11.456222+0000","last_became_active":"2023-10-14T19:09:11.448988+0000","last_became_peered":"2023-10-14T19:09:11.448988+0000","last_unstale":"2023-10-14T19:09:11.456222+0000","last_undegraded":"2023-10-14T19:09:11.456222+0000","last_fullsized":"2023-10-14T19:09:11.456222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:47:29.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455652+0000","last_change":"2023-10-14T19:09:10.431671+0000","last_active":"2023-10-14T19:09:11.455652+0000","last_peered":"2023-10-14T19:09:11.455652+0000","last_clean":"2023-10-14T19:09:11.455652+0000","last_became_active":"2023-10-14T19:09:10.431359+0000","last_became_peered":"2023-10-14T19:09:10.431359+0000","last_unstale":"2023-10-14T19:09:11.455652+0000","last_undegraded":"2023-10-14T19:09:11.455652+0000","last_fullsized":"2023-10-14T19:09:11.455652+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:11.359787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.450608+0000","last_change":"2023-10-14T19:09:11.449406+0000","last_active":"2023-10-14T19:09:11.450608+0000","last_peered":"2023-10-14T19:09:11.450608+0000","last_clean":"2023-10-14T19:09:11.450608+0000","last_became_active":"2023-10-14T19:09:11.449042+0000","last_became_peered":"2023-10-14T19:09:11.449042+0000","last_unstale":"2023-10-14T19:09:11.450608+0000","last_undegraded":"2023-10-14T19:09:11.450608+0000","last_fullsized":"2023-10-14T19:09:11.450608+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:21.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.451761+0000","last_change":"2023-10-14T19:09:10.434856+0000","last_active":"2023-10-14T19:09:11.451761+0000","last_peered":"2023-10-14T19:09:11.451761+0000","last_clean":"2023-10-14T19:09:11.451761+0000","last_became_active":"2023-10-14T19:09:10.434541+0000","last_became_peered":"2023-10-14T19:09:10.434541+0000","last_unstale":"2023-10-14T19:09:11.451761+0000","last_undegraded":"2023-10-14T19:09:11.451761+0000","last_fullsized":"2023-10-14T19:09:11.451761+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:06.558725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458408+0000","last_change":"2023-10-14T19:09:11.455477+0000","last_active":"2023-10-14T19:09:11.458408+0000","last_peered":"2023-10-14T19:09:11.458408+0000","last_clean":"2023-10-14T19:09:11.458408+0000","last_became_active":"2023-10-14T19:09:11.455192+0000","last_became_peered":"2023-10-14T19:09:11.455192+0000","last_unstale":"2023-10-14T19:09:11.458408+0000","last_undegraded":"2023-10-14T19:09:11.458408+0000","last_fullsized":"2023-10-14T19:09:11.458408+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:03.964638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.452456+0000","last_change":"2023-10-14T19:09:10.425723+0000","last_active":"2023-10-14T19:09:11.452456+0000","last_peered":"2023-10-14T19:09:11.452456+0000","last_clean":"2023-10-14T19:09:11.452456+0000","last_became_active":"2023-10-14T19:09:10.425323+0000","last_became_peered":"2023-10-14T19:09:10.425323+0000","last_unstale":"2023-10-14T19:09:11.452456+0000","last_undegraded":"2023-10-14T19:09:11.452456+0000","last_fullsized":"2023-10-14T19:09:11.452456+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:51.213685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465616+0000","last_change":"2023-10-14T19:09:11.463660+0000","last_active":"2023-10-14T19:09:11.465616+0000","last_peered":"2023-10-14T19:09:11.465616+0000","last_clean":"2023-10-14T19:09:11.465616+0000","last_became_active":"2023-10-14T19:09:11.461402+0000","last_became_peered":"2023-10-14T19:09:11.461402+0000","last_unstale":"2023-10-14T19:09:11.465616+0000","last_undegraded":"2023-10-14T19:09:11.465616+0000","last_fullsized":"2023-10-14T19:09:11.465616+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:26:28.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.453220+0000","last_change":"2023-10-14T19:09:10.425942+0000","last_active":"2023-10-14T19:09:11.453220+0000","last_peered":"2023-10-14T19:09:11.453220+0000","last_clean":"2023-10-14T19:09:11.453220+0000","last_became_active":"2023-10-14T19:09:10.425649+0000","last_became_peered":"2023-10-14T19:09:10.425649+0000","last_unstale":"2023-10-14T19:09:11.453220+0000","last_undegraded":"2023-10-14T19:09:11.453220+0000","last_fullsized":"2023-10-14T19:09:11.453220+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:55:19.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454351+0000","last_change":"2023-10-14T19:09:11.445456+0000","last_active":"2023-10-14T19:09:11.454351+0000","last_peered":"2023-10-14T19:09:11.454351+0000","last_clean":"2023-10-14T19:09:11.454351+0000","last_became_active":"2023-10-14T19:09:11.445190+0000","last_became_peered":"2023-10-14T19:09:11.445190+0000","last_unstale":"2023-10-14T19:09:11.454351+0000","last_undegraded":"2023-10-14T19:09:11.454351+0000","last_fullsized":"2023-10-14T19:09:11.454351+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:26:50.807505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459351+0000","last_change":"2023-10-14T19:09:10.426996+0000","last_active":"2023-10-14T19:09:11.459351+0000","last_peered":"2023-10-14T19:09:11.459351+0000","last_clean":"2023-10-14T19:09:11.459351+0000","last_became_active":"2023-10-14T19:09:10.426448+0000","last_became_peered":"2023-10-14T19:09:10.426448+0000","last_unstale":"2023-10-14T19:09:11.459351+0000","last_undegraded":"2023-10-14T19:09:11.459351+0000","last_fullsized":"2023-10-14T19:09:11.459351+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:23.135490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465457+0000","last_change":"2023-10-14T19:09:11.462184+0000","last_active":"2023-10-14T19:09:11.465457+0000","last_peered":"2023-10-14T19:09:11.465457+0000","last_clean":"2023-10-14T19:09:11.465457+0000","last_became_active":"2023-10-14T19:09:11.460638+0000","last_became_peered":"2023-10-14T19:09:11.460638+0000","last_unstale":"2023-10-14T19:09:11.465457+0000","last_undegraded":"2023-10-14T19:09:11.465457+0000","last_fullsized":"2023-10-14T19:09:11.465457+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:33.229837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.438204+0000","last_change":"2023-10-14T19:09:10.423638+0000","last_active":"2023-10-14T19:09:11.438204+0000","last_peered":"2023-10-14T19:09:11.438204+0000","last_clean":"2023-10-14T19:09:11.438204+0000","last_became_active":"2023-10-14T19:09:10.423397+0000","last_became_peered":"2023-10-14T19:09:10.423397+0000","last_unstale":"2023-10-14T19:09:11.438204+0000","last_undegraded":"2023-10-14T19:09:11.438204+0000","last_fullsized":"2023-10-14T19:09:11.438204+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:20.307588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454500+0000","last_change":"2023-10-14T19:09:11.449324+0000","last_active":"2023-10-14T19:09:11.454500+0000","last_peered":"2023-10-14T19:09:11.454500+0000","last_clean":"2023-10-14T19:09:11.454500+0000","last_became_active":"2023-10-14T19:09:11.448765+0000","last_became_peered":"2023-10-14T19:09:11.448765+0000","last_unstale":"2023-10-14T19:09:11.454500+0000","last_undegraded":"2023-10-14T19:09:11.454500+0000","last_fullsized":"2023-10-14T19:09:11.454500+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:33.523020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.446293+0000","last_change":"2023-10-14T19:09:10.431607+0000","last_active":"2023-10-14T19:09:11.446293+0000","last_peered":"2023-10-14T19:09:11.446293+0000","last_clean":"2023-10-14T19:09:11.446293+0000","last_became_active":"2023-10-14T19:09:10.431026+0000","last_became_peered":"2023-10-14T19:09:10.431026+0000","last_unstale":"2023-10-14T19:09:11.446293+0000","last_undegraded":"2023-10-14T19:09:11.446293+0000","last_fullsized":"2023-10-14T19:09:11.446293+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:02:53.665050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.463895+0000","last_change":"2023-10-14T19:09:11.455280+0000","last_active":"2023-10-14T19:09:11.463895+0000","last_peered":"2023-10-14T19:09:11.463895+0000","last_clean":"2023-10-14T19:09:11.463895+0000","last_became_active":"2023-10-14T19:09:11.454975+0000","last_became_peered":"2023-10-14T19:09:11.454975+0000","last_unstale":"2023-10-14T19:09:11.463895+0000","last_undegraded":"2023-10-14T19:09:11.463895+0000","last_fullsized":"2023-10-14T19:09:11.463895+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:54.913793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.433323+0000","last_change":"2023-10-14T19:09:10.434600+0000","last_active":"2023-10-14T19:09:11.433323+0000","last_peered":"2023-10-14T19:09:11.433323+0000","last_clean":"2023-10-14T19:09:11.433323+0000","last_became_active":"2023-10-14T19:09:10.434262+0000","last_became_peered":"2023-10-14T19:09:10.434262+0000","last_unstale":"2023-10-14T19:09:11.433323+0000","last_undegraded":"2023-10-14T19:09:11.433323+0000","last_fullsized":"2023-10-14T19:09:11.433323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:05:48.855182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464138+0000","last_change":"2023-10-14T19:09:11.458987+0000","last_active":"2023-10-14T19:09:11.464138+0000","last_peered":"2023-10-14T19:09:11.464138+0000","last_clean":"2023-10-14T19:09:11.464138+0000","last_became_active":"2023-10-14T19:09:11.458708+0000","last_became_peered":"2023-10-14T19:09:11.458708+0000","last_unstale":"2023-10-14T19:09:11.464138+0000","last_undegraded":"2023-10-14T19:09:11.464138+0000","last_fullsized":"2023-10-14T19:09:11.464138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:24.137329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437383+0000","last_change":"2023-10-14T19:09:10.427131+0000","last_active":"2023-10-14T19:09:11.437383+0000","last_peered":"2023-10-14T19:09:11.437383+0000","last_clean":"2023-10-14T19:09:11.437383+0000","last_became_active":"2023-10-14T19:09:10.426438+0000","last_became_peered":"2023-10-14T19:09:10.426438+0000","last_unstale":"2023-10-14T19:09:11.437383+0000","last_undegraded":"2023-10-14T19:09:11.437383+0000","last_fullsized":"2023-10-14T19:09:11.437383+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:11.359787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455530+0000","last_change":"2023-10-14T19:09:11.446487+0000","last_active":"2023-10-14T19:09:11.455530+0000","last_peered":"2023-10-14T19:09:11.455530+0000","last_clean":"2023-10-14T19:09:11.455530+0000","last_became_active":"2023-10-14T19:09:11.446262+0000","last_became_peered":"2023-10-14T19:09:11.446262+0000","last_unstale":"2023-10-14T19:09:11.455530+0000","last_undegraded":"2023-10-14T19:09:11.455530+0000","last_fullsized":"2023-10-14T19:09:11.455530+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:55.855622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"101'3","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461990+0000","last_change":"2023-10-14T19:09:10.433554+0000","last_active":"2023-10-14T19:09:11.461990+0000","last_peered":"2023-10-14T19:09:11.461990+0000","last_clean":"2023-10-14T19:09:11.461990+0000","last_became_active":"2023-10-14T19:09:10.433217+0000","last_became_peered":"2023-10-14T19:09:10.433217+0000","last_unstale":"2023-10-14T19:09:11.461990+0000","last_undegraded":"2023-10-14T19:09:11.461990+0000","last_fullsized":"2023-10-14T19:09:11.461990+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:36.796125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458399+0000","last_change":"2023-10-14T19:09:11.453605+0000","last_active":"2023-10-14T19:09:11.458399+0000","last_peered":"2023-10-14T19:09:11.458399+0000","last_clean":"2023-10-14T19:09:11.458399+0000","last_became_active":"2023-10-14T19:09:11.453268+0000","last_became_peered":"2023-10-14T19:09:11.453268+0000","last_unstale":"2023-10-14T19:09:11.458399+0000","last_undegraded":"2023-10-14T19:09:11.458399+0000","last_fullsized":"2023-10-14T19:09:11.458399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:38.637946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"101'6","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465713+0000","last_change":"2023-10-14T19:09:10.431054+0000","last_active":"2023-10-14T19:09:11.465713+0000","last_peered":"2023-10-14T19:09:11.465713+0000","last_clean":"2023-10-14T19:09:11.465713+0000","last_became_active":"2023-10-14T19:09:10.430787+0000","last_became_peered":"2023-10-14T19:09:10.430787+0000","last_unstale":"2023-10-14T19:09:11.465713+0000","last_undegraded":"2023-10-14T19:09:11.465713+0000","last_fullsized":"2023-10-14T19:09:11.465713+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:05.235356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.459472+0000","last_change":"2023-10-14T19:09:11.454852+0000","last_active":"2023-10-14T19:09:11.459472+0000","last_peered":"2023-10-14T19:09:11.459472+0000","last_clean":"2023-10-14T19:09:11.459472+0000","last_became_active":"2023-10-14T19:09:11.454568+0000","last_became_peered":"2023-10-14T19:09:11.454568+0000","last_unstale":"2023-10-14T19:09:11.459472+0000","last_undegraded":"2023-10-14T19:09:11.459472+0000","last_fullsized":"2023-10-14T19:09:11.459472+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:42.880064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454524+0000","last_change":"2023-10-14T19:09:10.436670+0000","last_active":"2023-10-14T19:09:11.454524+0000","last_peered":"2023-10-14T19:09:11.454524+0000","last_clean":"2023-10-14T19:09:11.454524+0000","last_became_active":"2023-10-14T19:09:10.436389+0000","last_became_peered":"2023-10-14T19:09:10.436389+0000","last_unstale":"2023-10-14T19:09:11.454524+0000","last_undegraded":"2023-10-14T19:09:11.454524+0000","last_fullsized":"2023-10-14T19:09:11.454524+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:03:52.129046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456324+0000","last_change":"2023-10-14T19:09:11.454201+0000","last_active":"2023-10-14T19:09:11.456324+0000","last_peered":"2023-10-14T19:09:11.456324+0000","last_clean":"2023-10-14T19:09:11.456324+0000","last_became_active":"2023-10-14T19:09:11.453892+0000","last_became_peered":"2023-10-14T19:09:11.453892+0000","last_unstale":"2023-10-14T19:09:11.456324+0000","last_undegraded":"2023-10-14T19:09:11.456324+0000","last_fullsized":"2023-10-14T19:09:11.456324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:51.903737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437978+0000","last_change":"2023-10-14T19:09:10.433361+0000","last_active":"2023-10-14T19:09:11.437978+0000","last_peered":"2023-10-14T19:09:11.437978+0000","last_clean":"2023-10-14T19:09:11.437978+0000","last_became_active":"2023-10-14T19:09:10.433043+0000","last_became_peered":"2023-10-14T19:09:10.433043+0000","last_unstale":"2023-10-14T19:09:11.437978+0000","last_undegraded":"2023-10-14T19:09:11.437978+0000","last_fullsized":"2023-10-14T19:09:11.437978+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:07.803211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456868+0000","last_change":"2023-10-14T19:09:11.447878+0000","last_active":"2023-10-14T19:09:11.456868+0000","last_peered":"2023-10-14T19:09:11.456868+0000","last_clean":"2023-10-14T19:09:11.456868+0000","last_became_active":"2023-10-14T19:09:11.447623+0000","last_became_peered":"2023-10-14T19:09:11.447623+0000","last_unstale":"2023-10-14T19:09:11.456868+0000","last_undegraded":"2023-10-14T19:09:11.456868+0000","last_fullsized":"2023-10-14T19:09:11.456868+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:32.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"101'8","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461997+0000","last_change":"2023-10-14T19:09:10.429417+0000","last_active":"2023-10-14T19:09:11.461997+0000","last_peered":"2023-10-14T19:09:11.461997+0000","last_clean":"2023-10-14T19:09:11.461997+0000","last_became_active":"2023-10-14T19:09:10.429169+0000","last_became_peered":"2023-10-14T19:09:10.429169+0000","last_unstale":"2023-10-14T19:09:11.461997+0000","last_undegraded":"2023-10-14T19:09:11.461997+0000","last_fullsized":"2023-10-14T19:09:11.461997+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:51.169528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.457943+0000","last_change":"2023-10-14T19:09:11.455058+0000","last_active":"2023-10-14T19:09:11.457943+0000","last_peered":"2023-10-14T19:09:11.457943+0000","last_clean":"2023-10-14T19:09:11.457943+0000","last_became_active":"2023-10-14T19:09:11.454786+0000","last_became_peered":"2023-10-14T19:09:11.454786+0000","last_unstale":"2023-10-14T19:09:11.457943+0000","last_undegraded":"2023-10-14T19:09:11.457943+0000","last_fullsized":"2023-10-14T19:09:11.457943+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:37:10.219253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.464408+0000","last_change":"2023-10-14T19:09:10.432333+0000","last_active":"2023-10-14T19:09:11.464408+0000","last_peered":"2023-10-14T19:09:11.464408+0000","last_clean":"2023-10-14T19:09:11.464408+0000","last_became_active":"2023-10-14T19:09:10.432066+0000","last_became_peered":"2023-10-14T19:09:10.432066+0000","last_unstale":"2023-10-14T19:09:11.464408+0000","last_undegraded":"2023-10-14T19:09:11.464408+0000","last_fullsized":"2023-10-14T19:09:11.464408+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:50.901897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.463232+0000","last_change":"2023-10-14T19:09:11.461226+0000","last_active":"2023-10-14T19:09:11.463232+0000","last_peered":"2023-10-14T19:09:11.463232+0000","last_clean":"2023-10-14T19:09:11.463232+0000","last_became_active":"2023-10-14T19:09:11.460908+0000","last_became_peered":"2023-10-14T19:09:11.460908+0000","last_unstale":"2023-10-14T19:09:11.463232+0000","last_undegraded":"2023-10-14T19:09:11.463232+0000","last_fullsized":"2023-10-14T19:09:11.463232+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:58.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.453863+0000","last_change":"2023-10-14T19:09:10.425357+0000","last_active":"2023-10-14T19:09:11.453863+0000","last_peered":"2023-10-14T19:09:11.453863+0000","last_clean":"2023-10-14T19:09:11.453863+0000","last_became_active":"2023-10-14T19:09:10.425051+0000","last_became_peered":"2023-10-14T19:09:10.425051+0000","last_unstale":"2023-10-14T19:09:11.453863+0000","last_undegraded":"2023-10-14T19:09:11.453863+0000","last_fullsized":"2023-10-14T19:09:11.453863+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.314925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.468979+0000","last_change":"2023-10-14T19:09:11.463082+0000","last_active":"2023-10-14T19:09:11.468979+0000","last_peered":"2023-10-14T19:09:11.468979+0000","last_clean":"2023-10-14T19:09:11.468979+0000","last_became_active":"2023-10-14T19:09:11.462779+0000","last_became_peered":"2023-10-14T19:09:11.462779+0000","last_unstale":"2023-10-14T19:09:11.468979+0000","last_undegraded":"2023-10-14T19:09:11.468979+0000","last_fullsized":"2023-10-14T19:09:11.468979+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:33:22.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.455824+0000","last_change":"2023-10-14T19:09:10.423444+0000","last_active":"2023-10-14T19:09:11.455824+0000","last_peered":"2023-10-14T19:09:11.455824+0000","last_clean":"2023-10-14T19:09:11.455824+0000","last_became_active":"2023-10-14T19:09:10.423153+0000","last_became_peered":"2023-10-14T19:09:10.423153+0000","last_unstale":"2023-10-14T19:09:11.455824+0000","last_undegraded":"2023-10-14T19:09:11.455824+0000","last_fullsized":"2023-10-14T19:09:11.455824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:20.307588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458392+0000","last_change":"2023-10-14T19:09:11.455227+0000","last_active":"2023-10-14T19:09:11.458392+0000","last_peered":"2023-10-14T19:09:11.458392+0000","last_clean":"2023-10-14T19:09:11.458392+0000","last_became_active":"2023-10-14T19:09:11.454702+0000","last_became_peered":"2023-10-14T19:09:11.454702+0000","last_unstale":"2023-10-14T19:09:11.458392+0000","last_undegraded":"2023-10-14T19:09:11.458392+0000","last_fullsized":"2023-10-14T19:09:11.458392+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:51.903737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.442272+0000","last_change":"2023-10-14T19:09:10.432539+0000","last_active":"2023-10-14T19:09:11.442272+0000","last_peered":"2023-10-14T19:09:11.442272+0000","last_clean":"2023-10-14T19:09:11.442272+0000","last_became_active":"2023-10-14T19:09:10.432271+0000","last_became_peered":"2023-10-14T19:09:10.432271+0000","last_unstale":"2023-10-14T19:09:11.442272+0000","last_undegraded":"2023-10-14T19:09:11.442272+0000","last_fullsized":"2023-10-14T19:09:11.442272+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:53:24.788449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456430+0000","last_change":"2023-10-14T19:09:11.451154+0000","last_active":"2023-10-14T19:09:11.456430+0000","last_peered":"2023-10-14T19:09:11.456430+0000","last_clean":"2023-10-14T19:09:11.456430+0000","last_became_active":"2023-10-14T19:09:11.450901+0000","last_became_peered":"2023-10-14T19:09:11.450901+0000","last_unstale":"2023-10-14T19:09:11.456430+0000","last_undegraded":"2023-10-14T19:09:11.456430+0000","last_fullsized":"2023-10-14T19:09:11.456430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:06.237196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454605+0000","last_change":"2023-10-14T19:09:10.435587+0000","last_active":"2023-10-14T19:09:11.454605+0000","last_peered":"2023-10-14T19:09:11.454605+0000","last_clean":"2023-10-14T19:09:11.454605+0000","last_became_active":"2023-10-14T19:09:10.435292+0000","last_became_peered":"2023-10-14T19:09:10.435292+0000","last_unstale":"2023-10-14T19:09:11.454605+0000","last_undegraded":"2023-10-14T19:09:11.454605+0000","last_fullsized":"2023-10-14T19:09:11.454605+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:31:43.257650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.467202+0000","last_change":"2023-10-14T19:09:11.466894+0000","last_active":"2023-10-14T19:09:11.467202+0000","last_peered":"2023-10-14T19:09:11.467202+0000","last_clean":"2023-10-14T19:09:11.467202+0000","last_became_active":"2023-10-14T19:09:11.466598+0000","last_became_peered":"2023-10-14T19:09:11.466598+0000","last_unstale":"2023-10-14T19:09:11.467202+0000","last_undegraded":"2023-10-14T19:09:11.467202+0000","last_fullsized":"2023-10-14T19:09:11.467202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:44.056341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.433214+0000","last_change":"2023-10-14T19:09:10.426976+0000","last_active":"2023-10-14T19:09:11.433214+0000","last_peered":"2023-10-14T19:09:11.433214+0000","last_clean":"2023-10-14T19:09:11.433214+0000","last_became_active":"2023-10-14T19:09:10.425173+0000","last_became_peered":"2023-10-14T19:09:10.425173+0000","last_unstale":"2023-10-14T19:09:11.433214+0000","last_undegraded":"2023-10-14T19:09:11.433214+0000","last_fullsized":"2023-10-14T19:09:11.433214+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:47:49.206432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.461515+0000","last_change":"2023-10-14T19:09:11.456382+0000","last_active":"2023-10-14T19:09:11.461515+0000","last_peered":"2023-10-14T19:09:11.461515+0000","last_clean":"2023-10-14T19:09:11.461515+0000","last_became_active":"2023-10-14T19:09:11.456067+0000","last_became_peered":"2023-10-14T19:09:11.456067+0000","last_unstale":"2023-10-14T19:09:11.461515+0000","last_undegraded":"2023-10-14T19:09:11.461515+0000","last_fullsized":"2023-10-14T19:09:11.461515+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:02:54.666890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.439754+0000","last_change":"2023-10-14T19:09:10.433526+0000","last_active":"2023-10-14T19:09:11.439754+0000","last_peered":"2023-10-14T19:09:11.439754+0000","last_clean":"2023-10-14T19:09:11.439754+0000","last_became_active":"2023-10-14T19:09:10.433206+0000","last_became_peered":"2023-10-14T19:09:10.433206+0000","last_unstale":"2023-10-14T19:09:11.439754+0000","last_undegraded":"2023-10-14T19:09:11.439754+0000","last_fullsized":"2023-10-14T19:09:11.439754+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:18.014552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456891+0000","last_change":"2023-10-14T19:09:11.452443+0000","last_active":"2023-10-14T19:09:11.456891+0000","last_peered":"2023-10-14T19:09:11.456891+0000","last_clean":"2023-10-14T19:09:11.456891+0000","last_became_active":"2023-10-14T19:09:11.452177+0000","last_became_peered":"2023-10-14T19:09:11.452177+0000","last_unstale":"2023-10-14T19:09:11.456891+0000","last_undegraded":"2023-10-14T19:09:11.456891+0000","last_fullsized":"2023-10-14T19:09:11.456891+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:33.211233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.446512+0000","last_change":"2023-10-14T19:09:10.431710+0000","last_active":"2023-10-14T19:09:11.446512+0000","last_peered":"2023-10-14T19:09:11.446512+0000","last_clean":"2023-10-14T19:09:11.446512+0000","last_became_active":"2023-10-14T19:09:10.431301+0000","last_became_peered":"2023-10-14T19:09:10.431301+0000","last_unstale":"2023-10-14T19:09:11.446512+0000","last_undegraded":"2023-10-14T19:09:11.446512+0000","last_fullsized":"2023-10-14T19:09:11.446512+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:33:21.302759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456524+0000","last_change":"2023-10-14T19:09:11.454181+0000","last_active":"2023-10-14T19:09:11.456524+0000","last_peered":"2023-10-14T19:09:11.456524+0000","last_clean":"2023-10-14T19:09:11.456524+0000","last_became_active":"2023-10-14T19:09:11.453902+0000","last_became_peered":"2023-10-14T19:09:11.453902+0000","last_unstale":"2023-10-14T19:09:11.456524+0000","last_undegraded":"2023-10-14T19:09:11.456524+0000","last_fullsized":"2023-10-14T19:09:11.456524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:13.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465219+0000","last_change":"2023-10-14T19:09:10.429548+0000","last_active":"2023-10-14T19:09:11.465219+0000","last_peered":"2023-10-14T19:09:11.465219+0000","last_clean":"2023-10-14T19:09:11.465219+0000","last_became_active":"2023-10-14T19:09:10.429285+0000","last_became_peered":"2023-10-14T19:09:10.429285+0000","last_unstale":"2023-10-14T19:09:11.465219+0000","last_undegraded":"2023-10-14T19:09:11.465219+0000","last_fullsized":"2023-10-14T19:09:11.465219+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:53.473802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.466063+0000","last_change":"2023-10-14T19:09:11.464802+0000","last_active":"2023-10-14T19:09:11.466063+0000","last_peered":"2023-10-14T19:09:11.466063+0000","last_clean":"2023-10-14T19:09:11.466063+0000","last_became_active":"2023-10-14T19:09:11.464497+0000","last_became_peered":"2023-10-14T19:09:11.464497+0000","last_unstale":"2023-10-14T19:09:11.466063+0000","last_undegraded":"2023-10-14T19:09:11.466063+0000","last_fullsized":"2023-10-14T19:09:11.466063+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:24.024280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.438154+0000","last_change":"2023-10-14T19:09:10.431638+0000","last_active":"2023-10-14T19:09:11.438154+0000","last_peered":"2023-10-14T19:09:11.438154+0000","last_clean":"2023-10-14T19:09:11.438154+0000","last_became_active":"2023-10-14T19:09:10.431358+0000","last_became_peered":"2023-10-14T19:09:10.431358+0000","last_unstale":"2023-10-14T19:09:11.438154+0000","last_undegraded":"2023-10-14T19:09:11.438154+0000","last_fullsized":"2023-10-14T19:09:11.438154+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:14.462092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.465559+0000","last_change":"2023-10-14T19:09:11.462608+0000","last_active":"2023-10-14T19:09:11.465559+0000","last_peered":"2023-10-14T19:09:11.465559+0000","last_clean":"2023-10-14T19:09:11.465559+0000","last_became_active":"2023-10-14T19:09:11.461277+0000","last_became_peered":"2023-10-14T19:09:11.461277+0000","last_unstale":"2023-10-14T19:09:11.465559+0000","last_undegraded":"2023-10-14T19:09:11.465559+0000","last_fullsized":"2023-10-14T19:09:11.465559+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:27.942352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.443460+0000","last_change":"2023-10-14T19:09:10.432457+0000","last_active":"2023-10-14T19:09:11.443460+0000","last_peered":"2023-10-14T19:09:11.443460+0000","last_clean":"2023-10-14T19:09:11.443460+0000","last_became_active":"2023-10-14T19:09:10.432294+0000","last_became_peered":"2023-10-14T19:09:10.432294+0000","last_unstale":"2023-10-14T19:09:11.443460+0000","last_undegraded":"2023-10-14T19:09:11.443460+0000","last_fullsized":"2023-10-14T19:09:11.443460+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:55.325235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454905+0000","last_change":"2023-10-14T19:09:11.447230+0000","last_active":"2023-10-14T19:09:11.454905+0000","last_peered":"2023-10-14T19:09:11.454905+0000","last_clean":"2023-10-14T19:09:11.454905+0000","last_became_active":"2023-10-14T19:09:11.446957+0000","last_became_peered":"2023-10-14T19:09:11.446957+0000","last_unstale":"2023-10-14T19:09:11.454905+0000","last_undegraded":"2023-10-14T19:09:11.454905+0000","last_fullsized":"2023-10-14T19:09:11.454905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:54.475642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437592+0000","last_change":"2023-10-14T19:09:10.429918+0000","last_active":"2023-10-14T19:09:11.437592+0000","last_peered":"2023-10-14T19:09:11.437592+0000","last_clean":"2023-10-14T19:09:11.437592+0000","last_became_active":"2023-10-14T19:09:10.429627+0000","last_became_peered":"2023-10-14T19:09:10.429627+0000","last_unstale":"2023-10-14T19:09:11.437592+0000","last_undegraded":"2023-10-14T19:09:11.437592+0000","last_fullsized":"2023-10-14T19:09:11.437592+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:12.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.460954+0000","last_change":"2023-10-14T19:09:11.454091+0000","last_active":"2023-10-14T19:09:11.460954+0000","last_peered":"2023-10-14T19:09:11.460954+0000","last_clean":"2023-10-14T19:09:11.460954+0000","last_became_active":"2023-10-14T19:09:11.453796+0000","last_became_peered":"2023-10-14T19:09:11.453796+0000","last_unstale":"2023-10-14T19:09:11.460954+0000","last_undegraded":"2023-10-14T19:09:11.460954+0000","last_fullsized":"2023-10-14T19:09:11.460954+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:27.496935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.442389+0000","last_change":"2023-10-14T19:09:10.428603+0000","last_active":"2023-10-14T19:09:11.442389+0000","last_peered":"2023-10-14T19:09:11.442389+0000","last_clean":"2023-10-14T19:09:11.442389+0000","last_became_active":"2023-10-14T19:09:10.428340+0000","last_became_peered":"2023-10-14T19:09:10.428340+0000","last_unstale":"2023-10-14T19:09:11.442389+0000","last_undegraded":"2023-10-14T19:09:11.442389+0000","last_fullsized":"2023-10-14T19:09:11.442389+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:20:36.332081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.454371+0000","last_change":"2023-10-14T19:09:11.446472+0000","last_active":"2023-10-14T19:09:11.454371+0000","last_peered":"2023-10-14T19:09:11.454371+0000","last_clean":"2023-10-14T19:09:11.454371+0000","last_became_active":"2023-10-14T19:09:11.446223+0000","last_became_peered":"2023-10-14T19:09:11.446223+0000","last_unstale":"2023-10-14T19:09:11.454371+0000","last_undegraded":"2023-10-14T19:09:11.454371+0000","last_fullsized":"2023-10-14T19:09:11.454371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:12.361626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.437039+0000","last_change":"2023-10-14T19:09:10.425668+0000","last_active":"2023-10-14T19:09:11.437039+0000","last_peered":"2023-10-14T19:09:11.437039+0000","last_clean":"2023-10-14T19:09:11.437039+0000","last_became_active":"2023-10-14T19:09:10.425382+0000","last_became_peered":"2023-10-14T19:09:10.425382+0000","last_unstale":"2023-10-14T19:09:11.437039+0000","last_undegraded":"2023-10-14T19:09:11.437039+0000","last_fullsized":"2023-10-14T19:09:11.437039+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:14.462092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.458471+0000","last_change":"2023-10-14T19:09:11.455489+0000","last_active":"2023-10-14T19:09:11.458471+0000","last_peered":"2023-10-14T19:09:11.458471+0000","last_clean":"2023-10-14T19:09:11.458471+0000","last_became_active":"2023-10-14T19:09:11.455232+0000","last_became_peered":"2023-10-14T19:09:11.455232+0000","last_unstale":"2023-10-14T19:09:11.458471+0000","last_undegraded":"2023-10-14T19:09:11.458471+0000","last_fullsized":"2023-10-14T19:09:11.458471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:55.855622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.433373+0000","last_change":"2023-10-14T19:09:10.434989+0000","last_active":"2023-10-14T19:09:11.433373+0000","last_peered":"2023-10-14T19:09:11.433373+0000","last_clean":"2023-10-14T19:09:11.433373+0000","last_became_active":"2023-10-14T19:09:10.434513+0000","last_became_peered":"2023-10-14T19:09:10.434513+0000","last_unstale":"2023-10-14T19:09:11.433373+0000","last_undegraded":"2023-10-14T19:09:11.433373+0000","last_fullsized":"2023-10-14T19:09:11.433373+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:46.932765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.462303+0000","last_change":"2023-10-14T19:09:11.452280+0000","last_active":"2023-10-14T19:09:11.462303+0000","last_peered":"2023-10-14T19:09:11.462303+0000","last_clean":"2023-10-14T19:09:11.462303+0000","last_became_active":"2023-10-14T19:09:11.450673+0000","last_became_peered":"2023-10-14T19:09:11.450673+0000","last_unstale":"2023-10-14T19:09:11.462303+0000","last_undegraded":"2023-10-14T19:09:11.462303+0000","last_fullsized":"2023-10-14T19:09:11.462303+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:55.563870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.446408+0000","last_change":"2023-10-14T19:09:10.431781+0000","last_active":"2023-10-14T19:09:11.446408+0000","last_peered":"2023-10-14T19:09:11.446408+0000","last_clean":"2023-10-14T19:09:11.446408+0000","last_became_active":"2023-10-14T19:09:10.431428+0000","last_became_peered":"2023-10-14T19:09:10.431428+0000","last_unstale":"2023-10-14T19:09:11.446408+0000","last_undegraded":"2023-10-14T19:09:11.446408+0000","last_fullsized":"2023-10-14T19:09:11.446408+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:32.209393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.456371+0000","last_change":"2023-10-14T19:09:11.454274+0000","last_active":"2023-10-14T19:09:11.456371+0000","last_peered":"2023-10-14T19:09:11.456371+0000","last_clean":"2023-10-14T19:09:11.456371+0000","last_became_active":"2023-10-14T19:09:11.453165+0000","last_became_peered":"2023-10-14T19:09:11.453165+0000","last_unstale":"2023-10-14T19:09:11.456371+0000","last_undegraded":"2023-10-14T19:09:11.456371+0000","last_fullsized":"2023-10-14T19:09:11.456371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:10.407159+0000","last_clean_scrub_stamp":"2023-10-14T19:09:10.407159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:55.334948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.441813+0000","last_change":"2023-10-14T19:09:10.429347+0000","last_active":"2023-10-14T19:09:11.441813+0000","last_peered":"2023-10-14T19:09:11.441813+0000","last_clean":"2023-10-14T19:09:11.441813+0000","last_became_active":"2023-10-14T19:09:10.429154+0000","last_became_peered":"2023-10-14T19:09:10.429154+0000","last_unstale":"2023-10-14T19:09:11.441813+0000","last_undegraded":"2023-10-14T19:09:11.441813+0000","last_fullsized":"2023-10-14T19:09:11.441813+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:09.405320+0000","last_clean_scrub_stamp":"2023-10-14T19:09:09.405320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:12:19.500140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T19:09:11.445136+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:09:11.445136+0000","last_peered":"2023-10-14T19:09:11.445136+0000","last_clean":"2023-10-14T19:09:11.445136+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:09:11.445136+0000","last_undegraded":"2023-10-14T19:09:11.445136+0000","last_fullsized":"2023-10-14T19:09:11.445136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1132289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.67200000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":4.2080000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.67200000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":3.1480000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.61499999999999999},"min":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.505}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.75700000000000001},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":3.23},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.78000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.57199999999999995},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":2.4620000000000002},"last":0.313},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.70399999999999996},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.34799999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51900000000000002,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.375},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.86899999999999999,"15min":2.883},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.79300000000000004},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":5.383},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1261568,"data_stored":541403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.69199999999999995},"min":{"1min":0.38400000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":5.6820000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.752},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":5.7030000000000003},"last":0.65300000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.74399999999999999},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.70999999999999996,"5min":0.755,"15min":7.8680000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.52900000000000003,"15min":0.76300000000000001},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.80900000000000005,"15min":7.8250000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.77900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.83299999999999996},"min":{"1min":0.44,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":8.0090000000000003},"last":0.628}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.81299999999999994},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.311},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.495}]},{"osd":7,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.59699999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77000000000000002,"5min":0.77900000000000003,"15min":0.86599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":547745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.495,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54700000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.249},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":1.032,"15min":1.032},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":1.627}]},{"osd":6,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.499},{"interface":"front","average":{"1min":0.622,"5min":0.625,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.079,"15min":1.079},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":1.5880000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303224,"kb_used_data":1840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068616,"statfs":{"total":96636764160,"available":96326262784,"internally_reserved":0,"allocated":1884160,"data_stored":1139637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.497,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.62,"15min":0.62},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72999999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80000000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61299999999999999,"15min":0.64300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":541333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.439,"5min":0.58199999999999996,"15min":0.60699999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.439},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.34699999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.56499999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.76700000000000002},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.497,"5min":0.60999999999999999,"15min":11.269},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34200000000000003,"15min":0.73799999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48699999999999999,"5min":0.56499999999999995,"15min":11.318},"last":0.317},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56000000000000005,"5min":0.624,"15min":0.69999999999999996},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.375},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.67100000000000004},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.68600000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.82799999999999996,"5min":0.89000000000000001,"15min":1.9710000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":1.0289999999999999},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79900000000000004,"5min":0.93200000000000005,"15min":11.379},"last":0.40000000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":1.0309999999999999},"min":{"1min":0.47399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.93400000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.626,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":2.0009999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":1.0469999999999999},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.46999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":542939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32300000000000001,"15min":0.35299999999999998},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.42399999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51200000000000001,"5min":0.57199999999999995,"15min":0.70099999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.64500000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36199999999999999,"15min":0.38500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.0629999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.41399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":0.59999999999999998,"15min":0.81000000000000005},"last":0.375},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.45000000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":2.597},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.94999999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.214}]},{"osd":6,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.133},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.997}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302624,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069216,"statfs":{"total":96636764160,"available":96326877184,"internally_reserved":0,"allocated":1269760,"data_stored":547621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.67800000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77800000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76000000000000001,"5min":3.488,"15min":3.488},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64300000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.502,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63900000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66400000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.437}]},{"osd":6,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68500000000000005,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.72299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298536,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073304,"statfs":{"total":96636764160,"available":96331063296,"internally_reserved":0,"allocated":1277952,"data_stored":548197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.876,"15min":0.876},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.61699999999999999,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":5.8639999999999999,"15min":5.8639999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.88500000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.754},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:09:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:09:15.936 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:09:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.095+0000 7f0696181700 1 Processor -- start 2023-10-14T19:09:16.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.095+0000 7f0696181700 1 -- start start 2023-10-14T19:09:16.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f0696181700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0690159860 0x7f06900ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f0696181700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f06900ccfa0 0x7f06900cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f0696181700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900cf510 con 0x7f06900cbd90 2023-10-14T19:09:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f0696181700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900d00b0 con 0x7f0690159860 2023-10-14T19:09:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f0696181700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900cc210 con 0x7f06900ccfa0 2023-10-14T19:09:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f068f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0690159860 0x7f06900ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f068f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0690159860 0x7f06900ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45582/0 (socket says 172.21.15.7:45582) 2023-10-14T19:09:16.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.096+0000 7f068f7fe700 1 -- 172.21.15.7:0/633797678 learned_addr learned my addr 172.21.15.7:0/633797678 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:16.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068ffff700 1 --2- 172.21.15.7:0/633797678 >> v2:172.21.15.148:3300/0 conn(0x7f06900ccfa0 0x7f06900cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068f7fe700 1 -- 172.21.15.7:0/633797678 >> v2:172.21.15.148:3300/0 conn(0x7f06900ccfa0 msgr2=0x7f06900cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:16.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068f7fe700 1 --2- 172.21.15.7:0/633797678 >> v2:172.21.15.148:3300/0 conn(0x7f06900ccfa0 0x7f06900cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068f7fe700 1 -- 172.21.15.7:0/633797678 >> v1:172.21.15.148:6789/0 conn(0x7f06900cbd90 legacy=0x7f06900cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068f7fe700 1 -- 172.21.15.7:0/633797678 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900ce900 con 0x7f0690159860 2023-10-14T19:09:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068f7fe700 1 --2- 172.21.15.7:0/633797678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0690159860 0x7f06900ce220 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0690088690 tx=0x7f0680009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9573262e9fd539c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:16.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068e7fc700 1 -- 172.21.15.7:0/633797678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680005c10 con 0x7f0690159860 2023-10-14T19:09:16.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068e7fc700 1 -- 172.21.15.7:0/633797678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680005d70 con 0x7f0690159860 2023-10-14T19:09:16.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f068e7fc700 1 -- 172.21.15.7:0/633797678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000b880 con 0x7f0690159860 2023-10-14T19:09:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.097+0000 7f0696181700 1 -- 172.21.15.7:0/633797678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0690159860 msgr2=0x7f06900ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 --2- 172.21.15.7:0/633797678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0690159860 0x7f06900ce220 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0690088690 tx=0x7f0680009220 comp rx=0 tx=0).stop 2023-10-14T19:09:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 -- 172.21.15.7:0/633797678 shutdown_connections 2023-10-14T19:09:16.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 --2- 172.21.15.7:0/633797678 >> v2:172.21.15.148:3300/0 conn(0x7f06900ccfa0 0x7f06900cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 --2- 172.21.15.7:0/633797678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0690159860 0x7f06900ce220 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 -- 172.21.15.7:0/633797678 >> 172.21.15.7:0/633797678 conn(0x7f06900999b0 msgr2=0x7f0690070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:16.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 -- 172.21.15.7:0/633797678 shutdown_connections 2023-10-14T19:09:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.098+0000 7f0696181700 1 -- 172.21.15.7:0/633797678 wait complete. 2023-10-14T19:09:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.099+0000 7f0696181700 1 Processor -- start 2023-10-14T19:09:16.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.099+0000 7f0696181700 1 -- start start 2023-10-14T19:09:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 0x7f06900c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06900ccfa0 0x7f06900c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0690159860 0x7f069014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06900c8600 con 0x7f06900cbd90 2023-10-14T19:09:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014dfa0 con 0x7f0690159860 2023-10-14T19:09:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06900c8860 con 0x7f06900ccfa0 2023-10-14T19:09:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 0x7f06900c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 0x7f06900c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45588/0 (socket says 172.21.15.7:45588) 2023-10-14T19:09:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 -- 172.21.15.7:0/1961999718 learned_addr learned my addr 172.21.15.7:0/1961999718 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068ffff700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0690159860 0x7f069014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068effd700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06900ccfa0 0x7f06900c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 -- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06900ccfa0 msgr2=0x7f06900c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06900ccfa0 0x7f06900c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 -- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0690159860 msgr2=0x7f069014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0690159860 0x7f069014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 -- 172.21.15.7:0/1961999718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009480 con 0x7f06900cbd90 2023-10-14T19:09:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068ffff700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0690159860 0x7f069014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068effd700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06900ccfa0 0x7f06900c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f068f7fe700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 0x7f06900c70b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f068000b3c0 tx=0x7f0680016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011910 con 0x7f06900cbd90 2023-10-14T19:09:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680020070 con 0x7f06900cbd90 2023-10-14T19:09:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011ca0 con 0x7f06900cbd90 2023-10-14T19:09:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06900c8b40 con 0x7f06900cbd90 2023-10-14T19:09:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.100+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900c5480 con 0x7f06900cbd90 2023-10-14T19:09:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.101+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06900ce200 con 0x7f06900cbd90 2023-10-14T19:09:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.102+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0680022030 con 0x7f06900cbd90 2023-10-14T19:09:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.102+0000 7f06777fe700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f067c067290 0x7f067c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.102+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06800866a0 con 0x7f06900cbd90 2023-10-14T19:09:16.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.102+0000 7f068effd700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f067c067290 0x7f067c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.103+0000 7f068effd700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f067c067290 0x7f067c069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f06900c3e10 tx=0x7f0684009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:16.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.106+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0680053500 con 0x7f06900cbd90 2023-10-14T19:09:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.378+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f069004c410 con 0x7f06900cbd90 2023-10-14T19:09:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.382+0000 7f06777fe700 1 -- 172.21.15.7:0/1961999718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0680056b20 con 0x7f06900cbd90 2023-10-14T19:09:16.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f067c067290 msgr2=0x7f067c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f067c067290 0x7f067c069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f06900c3e10 tx=0x7f0684009040 comp rx=0 tx=0).stop 2023-10-14T19:09:16.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 msgr2=0x7f06900c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 0x7f06900c70b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f068000b3c0 tx=0x7f0680016000 comp rx=0 tx=0).stop 2023-10-14T19:09:16.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 shutdown_connections 2023-10-14T19:09:16.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f067c067290 0x7f067c069740 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0690159860 0x7f069014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06900cbd90 0x7f06900c70b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 --2- 172.21.15.7:0/1961999718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06900ccfa0 0x7f06900c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 >> 172.21.15.7:0/1961999718 conn(0x7f06900999b0 msgr2=0x7f069015bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:16.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 shutdown_connections 2023-10-14T19:09:16.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.384+0000 7f0696181700 1 -- 172.21.15.7:0/1961999718 wait complete. 2023-10-14T19:09:16.389 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:09:16.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:16.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.517+0000 7fa36b5b3700 1 Processor -- start 2023-10-14T19:09:16.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.517+0000 7fa36b5b3700 1 -- start start 2023-10-14T19:09:16.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.518+0000 7fa36b5b3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa36415a7d0 0x7fa364158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.518+0000 7fa36b5b3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa364158c80 con 0x7fa364150c90 2023-10-14T19:09:16.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.518+0000 7fa36b5b3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa364158f60 con 0x7fa3641508c0 2023-10-14T19:09:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.518+0000 7fa36b5b3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36415afc0 con 0x7fa36415a7d0 2023-10-14T19:09:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.518+0000 7fa369b50700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa364150c90 0x7fa364154700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34846/0 (socket says 172.21.15.7:34846) 2023-10-14T19:09:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.518+0000 7fa369b50700 1 -- 172.21.15.7:0/1518029866 learned_addr learned my addr 172.21.15.7:0/1518029866 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa368b4e700 1 --2- 172.21.15.7:0/1518029866 >> v2:172.21.15.148:3300/0 conn(0x7fa36415a7d0 0x7fa364158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786429865 0 0) 0x7fa364158c80 con 0x7fa364150c90 2023-10-14T19:09:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa34c003570 con 0x7fa364150c90 2023-10-14T19:09:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 117909105 0 0) 0x7fa34c003570 con 0x7fa364150c90 2023-10-14T19:09:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 >> v2:172.21.15.148:3300/0 conn(0x7fa36415a7d0 msgr2=0x7fa364158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 --2- 172.21.15.7:0/1518029866 >> v2:172.21.15.148:3300/0 conn(0x7fa36415a7d0 0x7fa364158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 >> v1:172.21.15.148:6789/0 conn(0x7fa3641508c0 legacy=0x7fa36415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa364159240 con 0x7fa364150c90 2023-10-14T19:09:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa35c001470 con 0x7fa364150c90 2023-10-14T19:09:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 >> v1:172.21.15.7:6789/0 conn(0x7fa364150c90 legacy=0x7fa364154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa34c003a60 0x7fa34c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa34c004810 0x7fa34c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c0051c0 0x7fa34c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c00c0a0 con 0x7fa34c003a60 2023-10-14T19:09:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c00c210 con 0x7fa34c0051c0 2023-10-14T19:09:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c00c3d0 con 0x7fa34c004810 2023-10-14T19:09:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa36934f700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa34c003a60 0x7fa34c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa369b50700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c0051c0 0x7fa34c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa368b4e700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa34c004810 0x7fa34c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa36934f700 1 -- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa34c004810 msgr2=0x7fa34c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa36934f700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa34c004810 0x7fa34c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa36934f700 1 -- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c0051c0 msgr2=0x7fa34c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa36934f700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c0051c0 0x7fa34c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa36934f700 1 -- 172.21.15.7:0/1518029866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c003570 con 0x7fa34c003a60 2023-10-14T19:09:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.519+0000 7fa369b50700 1 -- 172.21.15.7:0/1518029866 reap_dead start 2023-10-14T19:09:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36934f700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa34c003a60 0x7fa34c003e70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa354001fc0 tx=0x7fa354001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c721faf673420b81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354001950 con 0x7fa34c003a60 2023-10-14T19:09:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35400c8b0 con 0x7fa34c003a60 2023-10-14T19:09:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa363fff700 1 -- 172.21.15.7:0/1518029866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400cc50 con 0x7fa34c003a60 2023-10-14T19:09:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 -- 172.21.15.7:0/1518029866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa34c003a60 msgr2=0x7fa34c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa34c003a60 0x7fa34c003e70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa354001fc0 tx=0x7fa354001640 comp rx=0 tx=0).stop 2023-10-14T19:09:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 -- 172.21.15.7:0/1518029866 shutdown_connections 2023-10-14T19:09:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/1518029866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa34c003a60 0x7fa34c003e70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 -- 172.21.15.7:0/1518029866 >> 172.21.15.7:0/1518029866 conn(0x7fa3640cded0 msgr2=0x7fa36406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 -- 172.21.15.7:0/1518029866 shutdown_connections 2023-10-14T19:09:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.520+0000 7fa36b5b3700 1 -- 172.21.15.7:0/1518029866 wait complete. 2023-10-14T19:09:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.521+0000 7fa36b5b3700 1 Processor -- start 2023-10-14T19:09:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.521+0000 7fa36b5b3700 1 -- start start 2023-10-14T19:09:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa36b5b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c003a60 0x7fa3640b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa36b5b3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa364155560 0x7fa3640ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa36b5b3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 0x7fa3640ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa36b5b3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3641565e0 con 0x7fa3640b1d60 2023-10-14T19:09:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa36b5b3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3641559d0 con 0x7fa34c003a60 2023-10-14T19:09:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa36b5b3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa364155cb0 con 0x7fa364155560 2023-10-14T19:09:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa369b50700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 0x7fa3640ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa369b50700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 0x7fa3640ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45610/0 (socket says 172.21.15.7:45610) 2023-10-14T19:09:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.522+0000 7fa369b50700 1 -- 172.21.15.7:0/3627002327 learned_addr learned my addr 172.21.15.7:0/3627002327 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa36934f700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c003a60 0x7fa3640b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa368b4e700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa364155560 0x7fa3640ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa369b50700 1 -- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa364155560 msgr2=0x7fa3640ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa369b50700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa364155560 0x7fa3640ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa369b50700 1 -- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c003a60 msgr2=0x7fa3640b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa369b50700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c003a60 0x7fa3640b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa369b50700 1 -- 172.21.15.7:0/3627002327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa364155f90 con 0x7fa3640b1d60 2023-10-14T19:09:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa369b50700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 0x7fa3640ca910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa3640cd3e0 tx=0x7fa35c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c018030 con 0x7fa3640b1d60 2023-10-14T19:09:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c007740 con 0x7fa3640b1d60 2023-10-14T19:09:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa364156270 con 0x7fa3640b1d60 2023-10-14T19:09:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00fab0 con 0x7fa3640b1d60 2023-10-14T19:09:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.523+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa364138ca0 con 0x7fa3640b1d60 2023-10-14T19:09:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.524+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3640b2580 con 0x7fa3640b1d60 2023-10-14T19:09:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.524+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fa35c01b070 con 0x7fa3640b1d60 2023-10-14T19:09:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.525+0000 7fa3617fa700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa350067290 0x7fa350069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.525+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa35c019070 con 0x7fa3640b1d60 2023-10-14T19:09:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.525+0000 7fa36934f700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa350067290 0x7fa350069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.526+0000 7fa36934f700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa350067290 0x7fa350069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa364156d30 tx=0x7fa354015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.529+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa35c051560 con 0x7fa3640b1d60 2023-10-14T19:09:16.744 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-10-14T19:09:16.744+0000 7f88693c3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:09:16.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.765+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa36404c3c0 con 0x7fa3640b1d60 2023-10-14T19:09:16.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.765+0000 7fa3617fa700 1 -- 172.21.15.7:0/3627002327 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fa35c054b80 con 0x7fa3640b1d60 2023-10-14T19:09:16.766 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:16.766 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:10.821659+0000","modified":"2023-10-14T19:09:14.450944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"d","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2854367647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2854367647},{"type":"v1","addr":"172.21.15.148:6836","nonce":2854367647}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T19:09:16.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa350067290 msgr2=0x7fa350069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa350067290 0x7fa350069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa364156d30 tx=0x7fa354015000 comp rx=0 tx=0).stop 2023-10-14T19:09:16.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 msgr2=0x7fa3640ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:16.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 0x7fa3640ca910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa3640cd3e0 tx=0x7fa35c001e50 comp rx=0 tx=0).stop 2023-10-14T19:09:16.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 shutdown_connections 2023-10-14T19:09:16.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa350067290 0x7fa350069740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa34c003a60 0x7fa3640b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3640b1d60 0x7fa3640ca910 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 --2- 172.21.15.7:0/3627002327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa364155560 0x7fa3640ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:16.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 >> 172.21.15.7:0/3627002327 conn(0x7fa3640cded0 msgr2=0x7fa3640af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 shutdown_connections 2023-10-14T19:09:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:16.767+0000 7fa36b5b3700 1 -- 172.21.15.7:0/3627002327 wait complete. 2023-10-14T19:09:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 64 2023-10-14T19:09:17.183 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:09:10.821659+0000', 'modified': '2023-10-14T19:09:14.450944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6768}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6768': {'gid': 6768, 'name': 'd', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6836/2854367647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 2854367647}, {'type': 'v1', 'addr': '172.21.15.148:6836', 'nonce': 2854367647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:09:17.183 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:09:17.184 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T19:09:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.307+0000 7f60d3d03700 1 Processor -- start 2023-10-14T19:09:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.307+0000 7f60d3d03700 1 -- start start 2023-10-14T19:09:17.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d3d03700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc0cb5a0 0x7f60cc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d3d03700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60cc15a5d0 0x7f60cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d3d03700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc15ae40 con 0x7f60cc0cd9e0 2023-10-14T19:09:17.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d3d03700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0d13f0 con 0x7f60cc0cb5a0 2023-10-14T19:09:17.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d3d03700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc15ab60 con 0x7f60cc15a5d0 2023-10-14T19:09:17.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d129e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f60cc0cd9e0 0x7f60cc159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38310/0 (socket says 172.21.15.7:38310) 2023-10-14T19:09:17.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d1a9f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc0cb5a0 0x7f60cc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d129e700 1 -- 172.21.15.7:0/3214473480 learned_addr learned my addr 172.21.15.7:0/3214473480 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:17.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.308+0000 7f60d22a0700 1 --2- 172.21.15.7:0/3214473480 >> v2:172.21.15.148:3300/0 conn(0x7f60cc15a5d0 0x7f60cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d1a9f700 1 -- 172.21.15.7:0/3214473480 >> v2:172.21.15.148:3300/0 conn(0x7f60cc15a5d0 msgr2=0x7f60cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/3214473480 >> v2:172.21.15.148:3300/0 conn(0x7f60cc15a5d0 0x7f60cc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d1a9f700 1 -- 172.21.15.7:0/3214473480 >> v1:172.21.15.7:6789/0 conn(0x7f60cc0cd9e0 legacy=0x7f60cc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d1a9f700 1 -- 172.21.15.7:0/3214473480 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0ccf00 con 0x7f60cc0cb5a0 2023-10-14T19:09:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/3214473480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc0cb970 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098e0 tx=0x7f60c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479a9600cd72edb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d0a9d700 1 -- 172.21.15.7:0/3214473480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4011630 con 0x7f60cc0cb5a0 2023-10-14T19:09:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d0a9d700 1 -- 172.21.15.7:0/3214473480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4011790 con 0x7f60cc0cb5a0 2023-10-14T19:09:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.309+0000 7f60d0a9d700 1 -- 172.21.15.7:0/3214473480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4011b30 con 0x7f60cc0cb5a0 2023-10-14T19:09:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 -- 172.21.15.7:0/3214473480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cb5a0 msgr2=0x7f60cc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 --2- 172.21.15.7:0/3214473480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc0cb970 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098e0 tx=0x7f60c40091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 -- 172.21.15.7:0/3214473480 shutdown_connections 2023-10-14T19:09:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 --2- 172.21.15.7:0/3214473480 >> v2:172.21.15.148:3300/0 conn(0x7f60cc15a5d0 0x7f60cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 --2- 172.21.15.7:0/3214473480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc0cb970 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 -- 172.21.15.7:0/3214473480 >> 172.21.15.7:0/3214473480 conn(0x7f60cc070e30 msgr2=0x7f60cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 -- 172.21.15.7:0/3214473480 shutdown_connections 2023-10-14T19:09:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.310+0000 7f60d3d03700 1 -- 172.21.15.7:0/3214473480 wait complete. 2023-10-14T19:09:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 Processor -- start 2023-10-14T19:09:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 -- start start 2023-10-14T19:09:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc16aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc0cd9e0 0x7f60cc155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 0x7f60cc15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc15dd50 con 0x7f60cc15a5d0 2023-10-14T19:09:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc16ac90 con 0x7f60cc0cb5a0 2023-10-14T19:09:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.311+0000 7f60d3d03700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc16a110 con 0x7f60cc0cd9e0 2023-10-14T19:09:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 0x7f60cc15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 0x7f60cc15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58868/0 (socket says 172.21.15.7:58868) 2023-10-14T19:09:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 -- 172.21.15.7:0/592649081 learned_addr learned my addr 172.21.15.7:0/592649081 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc16aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d129e700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc0cd9e0 0x7f60cc155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 -- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc0cd9e0 msgr2=0x7f60cc155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc0cd9e0 0x7f60cc155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 -- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc0cb5a0 msgr2=0x7f60cc16aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc16aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 -- 172.21.15.7:0/592649081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c4009420 con 0x7f60cc15a5d0 2023-10-14T19:09:17.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d129e700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc0cd9e0 0x7f60cc155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:17.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d22a0700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 0x7f60cc15d090 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009df0 tx=0x7f60bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60c9ffb700 1 -- 172.21.15.7:0/592649081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00cb50 con 0x7f60cc15a5d0 2023-10-14T19:09:17.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60c9ffb700 1 -- 172.21.15.7:0/592649081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00f040 con 0x7f60cc15a5d0 2023-10-14T19:09:17.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60c9ffb700 1 -- 172.21.15.7:0/592649081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc014480 con 0x7f60cc15a5d0 2023-10-14T19:09:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc16a3f0 con 0x7f60cc15a5d0 2023-10-14T19:09:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.312+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc16a9b0 con 0x7f60cc15a5d0 2023-10-14T19:09:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.314+0000 7f60c9ffb700 1 -- 172.21.15.7:0/592649081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f60bc014830 con 0x7f60cc15a5d0 2023-10-14T19:09:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.314+0000 7f60c9ffb700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60b8067290 0x7f60b8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.314+0000 7f60c9ffb700 1 -- 172.21.15.7:0/592649081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60bc085710 con 0x7f60cc15a5d0 2023-10-14T19:09:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.315+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60b8067290 0x7f60b8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.315+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60b8067290 0x7f60b8069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f60c40091e0 tx=0x7f60c4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.316+0000 7f60dcffcb80 1 Processor -- start 2023-10-14T19:09:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.316+0000 7f60dcffcb80 1 -- start start 2023-10-14T19:09:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e56e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e7fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e52cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3dada70 con 0x5611a3ea0d00 2023-10-14T19:09:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3dab270 con 0x5611a3e7ff60 2023-10-14T19:09:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a3da7060 con 0x5611a3e56a50 2023-10-14T19:09:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e7fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e7fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58878/0 (socket says 172.21.15.7:58878) 2023-10-14T19:09:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 -- 172.21.15.7:0/878893203 learned_addr learned my addr 172.21.15.7:0/878893203 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e56e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d22a0700 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e52cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 -- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 msgr2=0x5611a3e56e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e56e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 -- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 msgr2=0x5611a3e52cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e52cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.317+0000 7f60d129e700 1 -- 172.21.15.7:0/878893203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611a3c41270 con 0x5611a3ea0d00 2023-10-14T19:09:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60d129e700 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e7fa20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f60c0001780 tx=0x7f60c0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee318dc6361dcd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60b2ffd700 1 -- 172.21.15.7:0/878893203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0005ad0 con 0x5611a3ea0d00 2023-10-14T19:09:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60b2ffd700 1 -- 172.21.15.7:0/878893203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0005c30 con 0x5611a3ea0d00 2023-10-14T19:09:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60b2ffd700 1 -- 172.21.15.7:0/878893203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00070d0 con 0x5611a3ea0d00 2023-10-14T19:09:17.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 -- 172.21.15.7:0/878893203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 msgr2=0x5611a3e7fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e7fa20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f60c0001780 tx=0x7f60c0009040 comp rx=0 tx=0).stop 2023-10-14T19:09:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 -- 172.21.15.7:0/878893203 shutdown_connections 2023-10-14T19:09:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e52cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e56e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/878893203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e7fa20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 -- 172.21.15.7:0/878893203 >> 172.21.15.7:0/878893203 conn(0x5611a3e58370 msgr2=0x5611a3e58740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.318+0000 7f60dcffcb80 1 -- 172.21.15.7:0/878893203 shutdown_connections 2023-10-14T19:09:17.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.319+0000 7f60dcffcb80 1 -- 172.21.15.7:0/878893203 wait complete. 2023-10-14T19:09:17.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.319+0000 7f60dcffcb80 1 -- start start 2023-10-14T19:09:17.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.319+0000 7f60dcffcb80 1 Processor -- start 2023-10-14T19:09:17.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e7ff60 0x5611a3ea0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e96e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3d52890 con 0x5611a3ea0d00 2023-10-14T19:09:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3d6dea0 con 0x5611a3e56a50 2023-10-14T19:09:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a3c29e30 con 0x5611a3e7ff60 2023-10-14T19:09:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60dcffcb80 10 client.0 _ll_register_callbacks cb 0x5611a3e1a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:09:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60d22a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e96e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60d22a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e96e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58888/0 (socket says 172.21.15.7:58888) 2023-10-14T19:09:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60d22a0700 1 -- 172.21.15.7:0/1204789393 learned_addr learned my addr 172.21.15.7:0/1204789393 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60d129e700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e7ff60 0x5611a3ea0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.320+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60d22a0700 1 -- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e7ff60 msgr2=0x5611a3ea0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60d22a0700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e7ff60 0x5611a3ea0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60d22a0700 1 -- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 msgr2=0x5611a3e9ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60d22a0700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60d22a0700 1 -- 172.21.15.7:0/1204789393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c000f040 con 0x5611a3ea0d00 2023-10-14T19:09:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60d22a0700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e96e70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009dc0 tx=0x7f60bc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7058418aa30e8d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:09:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60a7fff700 1 -- 172.21.15.7:0/1204789393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0593b0 con 0x5611a3ea0d00 2023-10-14T19:09:17.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60a7fff700 1 -- 172.21.15.7:0/1204789393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60bc05d100 con 0x5611a3ea0d00 2023-10-14T19:09:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611a3e4bb70 con 0x5611a3ea0d00 2023-10-14T19:09:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60a7fff700 1 -- 172.21.15.7:0/1204789393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60bc0565d0 con 0x5611a3ea0d00 2023-10-14T19:09:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 10 client.6906 fetch_fsmap learned FSMap version 64 2023-10-14T19:09:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5611a3be3fe0 con 0x5611a3ea0d00 2023-10-14T19:09:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60a7fff700 1 -- 172.21.15.7:0/1204789393 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc07de90 con 0x5611a3ea0d00 2023-10-14T19:09:17.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60a7fff700 1 -- 172.21.15.7:0/1204789393 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60bc055650 con 0x5611a3ea0d00 2023-10-14T19:09:17.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 10 client.6906 fetch_fsmap finished waiting for FSMap version 64 2023-10-14T19:09:17.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 10 client.6906 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T19:09:17.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 20 client.6906 populate_metadata read hostname 'smithi007' 2023-10-14T19:09:17.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3eb08f0 0x5611a3eb0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 4 client.6906 mds_command: new command op to 6768 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:09:17.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.321+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 --> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611a3e28aa0 con 0x5611a3eb08f0 2023-10-14T19:09:17.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.322+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3eb08f0 0x5611a3eb0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.322+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3eb08f0 0x5611a3eb0cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e399adc16f2fd9 server_cookie=154fea398df578a2 in_seq=0 out_seq=0 2023-10-14T19:09:17.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.322+0000 7f60a7fff700 10 client.6906 ms_handle_connect on v2:172.21.15.148:6834/2854367647 2023-10-14T19:09:17.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60a7fff700 1 -- 172.21.15.7:0/1204789393 <== mds.0 v2:172.21.15.148:6834/2854367647 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5611a3e28aa0 con 0x5611a3eb08f0 2023-10-14T19:09:17.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60a7fff700 10 client.6906 handle_command_reply: tid=0 2023-10-14T19:09:17.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 client.6906 shutdown 2023-10-14T19:09:17.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 msgr2=0x5611a3e96e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e96e70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009dc0 tx=0x7f60bc009cd0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 shutdown_connections 2023-10-14T19:09:17.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3eb08f0 0x5611a3eb0cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60a7fff700 0 client.6906 ms_handle_reset on v2:172.21.15.148:6834/2854367647 2023-10-14T19:09:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e96e70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/1204789393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e7ff60 0x5611a3ea0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 >> 172.21.15.7:0/1204789393 conn(0x5611a3e58370 msgr2=0x5611a3e57350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 shutdown_connections 2023-10-14T19:09:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 1 -- 172.21.15.7:0/1204789393 wait complete. 2023-10-14T19:09:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.323+0000 7f60dcffcb80 20 client.6906 trim_cache size 0 max 16384 2023-10-14T19:09:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.340+0000 7f60dcffcb80 1 Processor -- start 2023-10-14T19:09:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.340+0000 7f60dcffcb80 1 -- start start 2023-10-14T19:09:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e9c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e9d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e9f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e515a0 con 0x5611a3ea0d00 2023-10-14T19:09:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e9e1e0 con 0x5611a3e7ff60 2023-10-14T19:09:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e53580 con 0x5611a3e56a50 2023-10-14T19:09:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e9f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e9f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58900/0 (socket says 172.21.15.7:58900) 2023-10-14T19:09:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 -- 172.21.15.7:0/4168891922 learned_addr learned my addr 172.21.15.7:0/4168891922 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d129e700 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 -- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 msgr2=0x5611a3e9c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e9c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 -- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 msgr2=0x5611a3e9d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e9d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 -- 172.21.15.7:0/4168891922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611a3e548b0 con 0x5611a3ea0d00 2023-10-14T19:09:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60d22a0700 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e9f870 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00c730 tx=0x7f60bc016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baac9aa24908a725 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60b37fe700 1 -- 172.21.15.7:0/4168891922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc05b4d0 con 0x5611a3ea0d00 2023-10-14T19:09:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60b37fe700 1 -- 172.21.15.7:0/4168891922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc07de90 con 0x5611a3ea0d00 2023-10-14T19:09:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.341+0000 7f60b37fe700 1 -- 172.21.15.7:0/4168891922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc05d100 con 0x5611a3ea0d00 2023-10-14T19:09:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 -- 172.21.15.7:0/4168891922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 msgr2=0x5611a3e9f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e9f870 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00c730 tx=0x7f60bc016070 comp rx=0 tx=0).stop 2023-10-14T19:09:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 -- 172.21.15.7:0/4168891922 shutdown_connections 2023-10-14T19:09:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3ea0d00 0x5611a3e9f870 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3e56a50 0x5611a3e9c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/4168891922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e7ff60 0x5611a3e9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 -- 172.21.15.7:0/4168891922 >> 172.21.15.7:0/4168891922 conn(0x5611a3e58370 msgr2=0x5611a3e4f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 -- 172.21.15.7:0/4168891922 shutdown_connections 2023-10-14T19:09:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 -- 172.21.15.7:0/4168891922 wait complete. 2023-10-14T19:09:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.342+0000 7f60dcffcb80 1 -- start start 2023-10-14T19:09:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 Processor -- start 2023-10-14T19:09:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 0x5611a3e53ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3ea0d00 0x5611a3f02c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e840f0 con 0x5611a3e7ff60 2023-10-14T19:09:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e9d850 con 0x5611a3e56a50 2023-10-14T19:09:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e93560 con 0x5611a3ea0d00 2023-10-14T19:09:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.343+0000 7f60dcffcb80 10 client.0 _ll_register_callbacks cb 0x5611a3e1a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:09:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 0x5611a3e53ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 0x5611a3e53ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58904/0 (socket says 172.21.15.7:58904) 2023-10-14T19:09:17.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 -- 172.21.15.7:0/196946910 learned_addr learned my addr 172.21.15.7:0/196946910 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:17.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d22a0700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3ea0d00 0x5611a3f02c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 -- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3ea0d00 msgr2=0x5611a3f02c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3ea0d00 0x5611a3f02c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 -- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 msgr2=0x5611a3e9d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 -- 172.21.15.7:0/196946910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a3be3fe0 con 0x5611a3e7ff60 2023-10-14T19:09:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60d129e700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 0x5611a3e53ca0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f60c0013000 tx=0x7f60c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd8e61cfe76bf05 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:09:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60a7fff700 1 -- 172.21.15.7:0/196946910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00076d0 con 0x5611a3e7ff60 2023-10-14T19:09:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60a7fff700 1 -- 172.21.15.7:0/196946910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60c0014480 con 0x5611a3e7ff60 2023-10-14T19:09:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60c0005c30 con 0x5611a3e7ff60 2023-10-14T19:09:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60a7fff700 1 -- 172.21.15.7:0/196946910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60c0014850 con 0x5611a3e7ff60 2023-10-14T19:09:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60dcffcb80 10 client.6912 fetch_fsmap learned FSMap version 64 2023-10-14T19:09:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5611a3d75780 con 0x5611a3e7ff60 2023-10-14T19:09:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60a7fff700 1 -- 172.21.15.7:0/196946910 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0005c30 con 0x5611a3e7ff60 2023-10-14T19:09:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.344+0000 7f60a7fff700 1 -- 172.21.15.7:0/196946910 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60c00149b0 con 0x5611a3e7ff60 2023-10-14T19:09:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 10 client.6912 fetch_fsmap finished waiting for FSMap version 64 2023-10-14T19:09:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 10 client.6912 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T19:09:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 20 client.6912 populate_metadata read hostname 'smithi007' 2023-10-14T19:09:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3e93e60 0x5611a3e94230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 4 client.6912 mds_command: new command op to 6768 tid=0[{"prefix": "status"}] 2023-10-14T19:09:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 --> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611a3d49e00 con 0x5611a3e93e60 2023-10-14T19:09:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3e93e60 0x5611a3e94230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60a7fff700 10 client.6912 ms_handle_connect on v2:172.21.15.148:6834/2854367647 2023-10-14T19:09:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60d1a9f700 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3e93e60 0x5611a3e94230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243e716aee16f0c2 server_cookie=81ad07d9870ae1ee in_seq=0 out_seq=0 2023-10-14T19:09:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60a7fff700 1 -- 172.21.15.7:0/196946910 <== mds.0 v2:172.21.15.148:6834/2854367647 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5611a3d49e00 con 0x5611a3e93e60 2023-10-14T19:09:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60a7fff700 10 client.6912 handle_command_reply: tid=0 2023-10-14T19:09:17.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 client.6912 shutdown 2023-10-14T19:09:17.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 msgr2=0x5611a3e53ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 0x5611a3e53ca0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f60c0013000 tx=0x7f60c0019000 comp rx=0 tx=0).stop 2023-10-14T19:09:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 shutdown_connections 2023-10-14T19:09:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:6834/2854367647,v1:172.21.15.148:6836/2854367647] conn(0x5611a3e93e60 0x5611a3e94230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5611a3e56a50 0x5611a3e9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60a7fff700 0 client.6912 ms_handle_reset on v2:172.21.15.148:6834/2854367647 2023-10-14T19:09:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5611a3ea0d00 0x5611a3f02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 --2- 172.21.15.7:0/196946910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a3e7ff60 0x5611a3e53ca0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.345+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 >> 172.21.15.7:0/196946910 conn(0x5611a3e58370 msgr2=0x5611a3e4f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 shutdown_connections 2023-10-14T19:09:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60dcffcb80 1 -- 172.21.15.7:0/196946910 wait complete. 2023-10-14T19:09:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60dcffcb80 20 client.6912 trim_cache size 0 max 16384 2023-10-14T19:09:17.375 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:09:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:09:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:09:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6768, 2023-10-14T19:09:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:09:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:09:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:09:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.9151868380000003, 2023-10-14T19:09:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 64, 2023-10-14T19:09:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 102, 2023-10-14T19:09:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 102, 2023-10-14T19:09:17.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.97739211 2023-10-14T19:09:17.378 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:09:17.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60b8067290 msgr2=0x7f60b8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60b8067290 0x7f60b8069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f60c40091e0 tx=0x7f60c4017000 comp rx=0 tx=0).stop 2023-10-14T19:09:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 msgr2=0x7f60cc15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 0x7f60cc15d090 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009df0 tx=0x7f60bc00b040 comp rx=0 tx=0).stop 2023-10-14T19:09:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 shutdown_connections 2023-10-14T19:09:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60b8067290 0x7f60b8069740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc0cb5a0 0x7f60cc16aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc15a5d0 0x7f60cc15d090 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 --2- 172.21.15.7:0/592649081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc0cd9e0 0x7f60cc155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 >> 172.21.15.7:0/592649081 conn(0x7f60cc070e30 msgr2=0x7f60cc0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 shutdown_connections 2023-10-14T19:09:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.346+0000 7f60d3d03700 1 -- 172.21.15.7:0/592649081 wait complete. 2023-10-14T19:09:17.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:09:17.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.502+0000 7f00cb7d0700 1 Processor -- start 2023-10-14T19:09:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.502+0000 7f00cb7d0700 1 -- start start 2023-10-14T19:09:17.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00cb7d0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 0x7f00c4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00cb7d0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c415ae40 con 0x7f00c415a400 2023-10-14T19:09:17.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00cb7d0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c415ab60 con 0x7f00c40cb5a0 2023-10-14T19:09:17.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00cb7d0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40ce0f0 con 0x7f00c40cb970 2023-10-14T19:09:17.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00c9d6d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00c415a400 0x7f00c4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38322/0 (socket says 172.21.15.7:38322) 2023-10-14T19:09:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00c9d6d700 1 -- 172.21.15.7:0/1658156548 learned_addr learned my addr 172.21.15.7:0/1658156548 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00c8d6b700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 0x7f00c4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170285718 0 0) 0x7f00c415ae40 con 0x7f00c415a400 2023-10-14T19:09:17.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b0003570 con 0x7f00c415a400 2023-10-14T19:09:17.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061890478 0 0) 0x7f00c415ab60 con 0x7f00c40cb5a0 2023-10-14T19:09:17.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c415ae40 con 0x7f00c40cb5a0 2023-10-14T19:09:17.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335150967 0 0) 0x7f00b0003570 con 0x7f00c415a400 2023-10-14T19:09:17.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 msgr2=0x7f00c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 0x7f00c4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 >> v1:172.21.15.148:6789/0 conn(0x7f00c40cb5a0 legacy=0x7f00c40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40ccf00 con 0x7f00c415a400 2023-10-14T19:09:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f00bc0017f0 con 0x7f00c415a400 2023-10-14T19:09:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 >> v1:172.21.15.7:6789/0 conn(0x7f00c415a400 legacy=0x7f00c4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00b0003c20 0x7f00b0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0004810 0x7f00b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 0x7f00b0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40ce0f0 con 0x7f00b0003c20 2023-10-14T19:09:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b000bc20 con 0x7f00b0004810 2023-10-14T19:09:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.503+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b000bde0 con 0x7f00c40cb970 2023-10-14T19:09:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00b0003c20 0x7f00b0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c8d6b700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0004810 0x7f00b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c9d6d700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 0x7f00b0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 -- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 msgr2=0x7f00b0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40cb970 0x7f00b0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 -- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0004810 msgr2=0x7f00b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0004810 0x7f00b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 -- 172.21.15.7:0/1658156548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0003570 con 0x7f00b0003c20 2023-10-14T19:09:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00c956c700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00b0003c20 0x7f00b0004010 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f00c0001a10 tx=0x7f00c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d898b51440d14417 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000c5d0 con 0x7f00b0003c20 2023-10-14T19:09:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c000c730 con 0x7f00b0003c20 2023-10-14T19:09:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.504+0000 7f00bbfff700 1 -- 172.21.15.7:0/1658156548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000cad0 con 0x7f00b0003c20 2023-10-14T19:09:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00cb7d0700 1 -- 172.21.15.7:0/1658156548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00b0003c20 msgr2=0x7f00b0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/1658156548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00b0003c20 0x7f00b0004010 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f00c0001a10 tx=0x7f00c0007d30 comp rx=0 tx=0).stop 2023-10-14T19:09:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00c9d6d700 1 -- 172.21.15.7:0/1658156548 reap_dead start 2023-10-14T19:09:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00cb7d0700 1 -- 172.21.15.7:0/1658156548 shutdown_connections 2023-10-14T19:09:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00cb7d0700 1 -- 172.21.15.7:0/1658156548 >> 172.21.15.7:0/1658156548 conn(0x7f00c4070e30 msgr2=0x7f00c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00cb7d0700 1 -- 172.21.15.7:0/1658156548 shutdown_connections 2023-10-14T19:09:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.505+0000 7f00cb7d0700 1 -- 172.21.15.7:0/1658156548 wait complete. 2023-10-14T19:09:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.506+0000 7f00cb7d0700 1 Processor -- start 2023-10-14T19:09:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.506+0000 7f00cb7d0700 1 -- start start 2023-10-14T19:09:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00cb7d0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0003c20 0x7f00c415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00cb7d0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40c8260 0x7f00c40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00cb7d0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 0x7f00c40b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00cb7d0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40cbde0 con 0x7f00c40b4560 2023-10-14T19:09:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00cb7d0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415c9a0 con 0x7f00b0003c20 2023-10-14T19:09:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00cb7d0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415b3c0 con 0x7f00c40c8260 2023-10-14T19:09:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 0x7f00c40b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 0x7f00c40b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58912/0 (socket says 172.21.15.7:58912) 2023-10-14T19:09:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 -- 172.21.15.7:0/360159103 learned_addr learned my addr 172.21.15.7:0/360159103 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c8d6b700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40c8260 0x7f00c40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c956c700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0003c20 0x7f00c415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 -- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40c8260 msgr2=0x7f00c40c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40c8260 0x7f00c40c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 -- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0003c20 msgr2=0x7f00c415c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0003c20 0x7f00c415c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 -- 172.21.15.7:0/360159103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c415b6a0 con 0x7f00c40b4560 2023-10-14T19:09:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00c9d6d700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 0x7f00c40b4a00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001350 tx=0x7f00bc0020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.507+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00ac90 con 0x7f00c40b4560 2023-10-14T19:09:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.508+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc00ae10 con 0x7f00c40b4560 2023-10-14T19:09:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.508+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc013640 con 0x7f00c40b4560 2023-10-14T19:09:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.508+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c415b980 con 0x7f00c40b4560 2023-10-14T19:09:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.508+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c415bf40 con 0x7f00c40b4560 2023-10-14T19:09:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.509+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c415c160 con 0x7f00c40b4560 2023-10-14T19:09:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.509+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f00bc0139b0 con 0x7f00c40b4560 2023-10-14T19:09:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.509+0000 7f00b97fa700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00a80672c0 0x7f00a8069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.509+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00bc085240 con 0x7f00c40b4560 2023-10-14T19:09:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.510+0000 7f00c956c700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00a80672c0 0x7f00a8069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.510+0000 7f00c956c700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00a80672c0 0x7f00a8069770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f00c0008fd0 tx=0x7f00c0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.514+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00bc0520a0 con 0x7f00c40b4560 2023-10-14T19:09:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.752+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f00c404c3c0 con 0x7f00c40b4560 2023-10-14T19:09:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.752+0000 7f00b97fa700 1 -- 172.21.15.7:0/360159103 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7f00bc0556c0 con 0x7f00c40b4560 2023-10-14T19:09:17.754 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:09:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00a80672c0 msgr2=0x7f00a8069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00a80672c0 0x7f00a8069770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f00c0008fd0 tx=0x7f00c0015000 comp rx=0 tx=0).stop 2023-10-14T19:09:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 msgr2=0x7f00c40b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 0x7f00c40b4a00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001350 tx=0x7f00bc0020a0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 shutdown_connections 2023-10-14T19:09:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f00a80672c0 0x7f00a8069770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b0003c20 0x7f00c415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00c40b4560 0x7f00c40b4a00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 --2- 172.21.15.7:0/360159103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00c40c8260 0x7f00c40c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 >> 172.21.15.7:0/360159103 conn(0x7f00c4070e30 msgr2=0x7f00c40b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 shutdown_connections 2023-10-14T19:09:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:17.754+0000 7f00cb7d0700 1 -- 172.21.15.7:0/360159103 wait complete. 2023-10-14T19:09:17.767 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:09:17.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:09:17.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:09:17.768 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:09:17.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:17.769 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:09:17.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:09:17.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:09:17.770 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:09:17.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:17.771 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:09:17.786 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:09:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:09:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:09:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:09:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.788 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:09:17.788 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:09:17.789 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:09:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:09:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:09:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42096sec preferred_lft 42096sec 2023-10-14T19:09:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:09:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.791 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:09:17.791 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:09:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:09:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:09:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.793 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:09:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:09:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.793 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:09:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:09:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:17.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:17.796 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:09:17.850 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:09:17.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:17.853 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:09:17.909 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:09:17.909 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:09:17.909 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:09:17.910 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:09:17.910 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:09:17.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:17.911 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:09:17.912 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:09:17.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:09:17.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:09:17.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:09:17.913 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:09:18.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.013 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:09:18.028 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:09:18.029 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:09:18.029 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:09:18.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:09:18.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:18.095 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:18.150 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:09:18.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:18.151 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:18.204 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:09:18.205 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:09:18.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:18.285 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:18.286 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:09:18.286 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:09:18.293 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:18.294 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:09:18.294 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:09:18.294 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:18.294 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:18.319 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:09:18.319 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:09:18.319 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:09:18.320 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:09:18.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:18.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:09:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.546+0000 7fe8528a0700 1 Processor -- start 2023-10-14T19:09:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.546+0000 7fe8528a0700 1 -- start start 2023-10-14T19:09:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe8528a0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe84c0cb5a0 0x7fe84c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe8528a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe8528a0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c15ae40 con 0x7fe84c0cde50 2023-10-14T19:09:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe8528a0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c0d13f0 con 0x7fe84c0cb5a0 2023-10-14T19:09:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe8528a0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15ab60 con 0x7fe84c0cd9e0 2023-10-14T19:09:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe84b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe84bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe84c0cb5a0 0x7fe84c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe84b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:36130/0 (socket says 172.21.15.7:36130) 2023-10-14T19:09:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.547+0000 7fe84b7fe700 1 -- 172.21.15.7:0/2172630751 learned_addr learned my addr 172.21.15.7:0/2172630751 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84bfff700 1 -- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 msgr2=0x7fe84c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84bfff700 1 --2- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84bfff700 1 -- 172.21.15.7:0/2172630751 >> v1:172.21.15.148:6789/0 conn(0x7fe84c0cde50 legacy=0x7fe84c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84bfff700 1 -- 172.21.15.7:0/2172630751 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0ccf00 con 0x7fe84c0cb5a0 2023-10-14T19:09:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84b7fe700 1 --2- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84bfff700 1 --2- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c0cb970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0098e0 tx=0x7fe83c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e5bdf9969fbe851 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84affd700 1 -- 172.21.15.7:0/2172630751 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00b640 con 0x7fe84c0cb5a0 2023-10-14T19:09:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84affd700 1 -- 172.21.15.7:0/2172630751 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00b7a0 con 0x7fe84c0cb5a0 2023-10-14T19:09:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.548+0000 7fe84affd700 1 -- 172.21.15.7:0/2172630751 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00bb40 con 0x7fe84c0cb5a0 2023-10-14T19:09:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 -- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 msgr2=0x7fe84c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 --2- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c0cb970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0098e0 tx=0x7fe83c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 -- 172.21.15.7:0/2172630751 shutdown_connections 2023-10-14T19:09:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 --2- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c0cb970 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 --2- 172.21.15.7:0/2172630751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 -- 172.21.15.7:0/2172630751 >> 172.21.15.7:0/2172630751 conn(0x7fe84c070e30 msgr2=0x7fe84c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 -- 172.21.15.7:0/2172630751 shutdown_connections 2023-10-14T19:09:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.549+0000 7fe8528a0700 1 -- 172.21.15.7:0/2172630751 wait complete. 2023-10-14T19:09:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.550+0000 7fe8528a0700 1 Processor -- start 2023-10-14T19:09:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.550+0000 7fe8528a0700 1 -- start start 2023-10-14T19:09:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe8528a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe8528a0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe8528a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 0x7fe84c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe8528a0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15df00 con 0x7fe84c0c9050 2023-10-14T19:09:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe8528a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0ca620 con 0x7fe84c0cb5a0 2023-10-14T19:09:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe8528a0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0ca190 con 0x7fe84c0cd9e0 2023-10-14T19:09:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 0x7fe84c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 0x7fe84c15ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58920/0 (socket says 172.21.15.7:58920) 2023-10-14T19:09:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 -- 172.21.15.7:0/614421226 learned_addr learned my addr 172.21.15.7:0/614421226 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe84bfff700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe84b7fe700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 -- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 msgr2=0x7fe84c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 -- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 msgr2=0x7fe84c15d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c15d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 -- 172.21.15.7:0/614421226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400094f0 con 0x7fe84c0c9050 2023-10-14T19:09:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.551+0000 7fe850e3d700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 0x7fe84c15ba80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe84400c870 tx=0x7fe844001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.552+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844012630 con 0x7fe84c0c9050 2023-10-14T19:09:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.552+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440127b0 con 0x7fe84c0c9050 2023-10-14T19:09:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.552+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c009420 con 0x7fe84c0c9050 2023-10-14T19:09:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.552+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844012b70 con 0x7fe84c0c9050 2023-10-14T19:09:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.552+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c0c8b00 con 0x7fe84c0c9050 2023-10-14T19:09:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.552+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c04c3c0 con 0x7fe84c0c9050 2023-10-14T19:09:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.553+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe844003030 con 0x7fe84c0c9050 2023-10-14T19:09:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.553+0000 7fe833fff700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe838067290 0x7fe838069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.553+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe844084b90 con 0x7fe84c0c9050 2023-10-14T19:09:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.554+0000 7fe84bfff700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe838067290 0x7fe838069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.554+0000 7fe84bfff700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe838067290 0x7fe838069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0093f0 tx=0x7fe83c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.558+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8440518f0 con 0x7fe84c0c9050 2023-10-14T19:09:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.795+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe84c0cd1e0 con 0x7fe84c0c9050 2023-10-14T19:09:18.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.796+0000 7fe833fff700 1 -- 172.21.15.7:0/614421226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe844054f10 con 0x7fe84c0c9050 2023-10-14T19:09:18.797 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:09:18.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe838067290 msgr2=0x7fe838069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:18.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe838067290 0x7fe838069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0093f0 tx=0x7fe83c017000 comp rx=0 tx=0).stop 2023-10-14T19:09:18.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 msgr2=0x7fe84c15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:18.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 0x7fe84c15ba80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe84400c870 tx=0x7fe844001670 comp rx=0 tx=0).stop 2023-10-14T19:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 shutdown_connections 2023-10-14T19:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe838067290 0x7fe838069740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe84c0cb5a0 0x7fe84c15d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c0c9050 0x7fe84c15ba80 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 --2- 172.21.15.7:0/614421226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe84c0cd9e0 0x7fe84c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:18.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 >> 172.21.15.7:0/614421226 conn(0x7fe84c070e30 msgr2=0x7fe84c0b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:18.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 shutdown_connections 2023-10-14T19:09:18.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:18.798+0000 7fe8528a0700 1 -- 172.21.15.7:0/614421226 wait complete. 2023-10-14T19:09:18.811 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:09:18.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:09:18.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:09:18.812 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:09:18.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:18.813 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:09:18.813 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:09:18.813 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:09:18.814 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:09:18.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.815 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:09:18.833 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:09:18.833 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:09:18.834 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:09:18.834 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.834 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:09:18.834 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.834 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:09:18.835 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:09:18.836 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:18.836 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:18.836 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:09:18.836 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:18.836 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:09:18.837 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42105sec preferred_lft 42105sec 2023-10-14T19:09:18.837 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:09:18.837 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.837 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:09:18.838 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:18.838 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:09:18.838 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.838 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:09:18.838 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.839 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:18.839 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:09:18.839 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:09:18.839 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.839 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:18.840 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:09:18.840 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:09:18.840 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:18.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.841 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:09:18.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:18.871 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:18.901 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:09:18.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.903 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:09:18.992 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:09:18.993 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:09:18.993 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:09:18.993 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:09:18.994 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:09:18.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:18.996 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:09:18.996 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:09:18.997 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:09:18.998 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:09:18.998 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:09:18.999 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:09:19.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:19.101 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:09:19.117 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:09:19.118 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:09:19.118 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:09:19.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:19.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:09:19.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:19.184 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:19.241 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:09:19.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:19.243 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:19.297 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:09:19.297 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:09:19.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:19.377 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:19.377 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:09:19.377 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:09:19.386 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:19.386 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:09:19.386 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:09:19.387 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:19.387 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:19.407 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:19.407 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:09:19.408 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:09:19.408 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:19.408 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:19.408 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:09:19.408 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:09:19.409 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:09:19.410 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:09:19.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:19.410 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:19.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:09:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.601+0000 7ff46149f700 1 Processor -- start 2023-10-14T19:09:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.601+0000 7ff46149f700 1 -- start start 2023-10-14T19:09:19.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff46149f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c142f70 0x7ff45c0cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:19.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff46149f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff45c0d0a80 0x7ff45c0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:19.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff46149f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c0b5610 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff46149f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0b6500 con 0x7ff45c0d0a80 2023-10-14T19:09:19.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff46149f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0b58f0 con 0x7ff45c142f70 2023-10-14T19:09:19.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff45c0d0a80 0x7ff45c0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:19.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff45c0d0a80 0x7ff45c0b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58928/0 (socket says 172.21.15.7:58928) 2023-10-14T19:09:19.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 -- 172.21.15.7:0/811534165 learned_addr learned my addr 172.21.15.7:0/811534165 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:19.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45affd700 1 --2- 172.21.15.7:0/811534165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c142f70 0x7ff45c0cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:19.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 -- 172.21.15.7:0/811534165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c142f70 msgr2=0x7ff45c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:19.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 --2- 172.21.15.7:0/811534165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c142f70 0x7ff45c0cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:19.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 -- 172.21.15.7:0/811534165 >> v1:172.21.15.148:6789/0 conn(0x7ff45c0cc9f0 legacy=0x7ff45c0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:19.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.602+0000 7ff45b7fe700 1 -- 172.21.15.7:0/811534165 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0b5bd0 con 0x7ff45c0d0a80 2023-10-14T19:09:19.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff45b7fe700 1 --2- 172.21.15.7:0/811534165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0d0a80 0x7ff45c0b09a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009f20 tx=0x7ff44c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aafae629d06753d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:19.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff459ffb700 1 -- 172.21.15.7:0/811534165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00e070 con 0x7ff45c0d0a80 2023-10-14T19:09:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff459ffb700 1 -- 172.21.15.7:0/811534165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00b9d0 con 0x7ff45c0d0a80 2023-10-14T19:09:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff459ffb700 1 -- 172.21.15.7:0/811534165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0092e0 con 0x7ff45c0d0a80 2023-10-14T19:09:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 -- 172.21.15.7:0/811534165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0d0a80 msgr2=0x7ff45c0b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 --2- 172.21.15.7:0/811534165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0d0a80 0x7ff45c0b09a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009f20 tx=0x7ff44c009840 comp rx=0 tx=0).stop 2023-10-14T19:09:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 -- 172.21.15.7:0/811534165 shutdown_connections 2023-10-14T19:09:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 --2- 172.21.15.7:0/811534165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0d0a80 0x7ff45c0b09a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 --2- 172.21.15.7:0/811534165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c142f70 0x7ff45c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 -- 172.21.15.7:0/811534165 >> 172.21.15.7:0/811534165 conn(0x7ff45c0703a0 msgr2=0x7ff45c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 -- 172.21.15.7:0/811534165 shutdown_connections 2023-10-14T19:09:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.603+0000 7ff46149f700 1 -- 172.21.15.7:0/811534165 wait complete. 2023-10-14T19:09:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 Processor -- start 2023-10-14T19:09:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 -- start start 2023-10-14T19:09:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 0x7ff45c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c0d0a80 0x7ff45c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45c142f70 0x7ff45c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c15bd10 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c159130 con 0x7ff45c142f70 2023-10-14T19:09:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff46149f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c15ac70 con 0x7ff45c0d0a80 2023-10-14T19:09:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff45affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 0x7ff45c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff45affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 0x7ff45c158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58932/0 (socket says 172.21.15.7:58932) 2023-10-14T19:09:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.605+0000 7ff45affd700 1 -- 172.21.15.7:0/1356563747 learned_addr learned my addr 172.21.15.7:0/1356563747 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45b7fe700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45c142f70 0x7ff45c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45a7fc700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c0d0a80 0x7ff45c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45affd700 1 -- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c0d0a80 msgr2=0x7ff45c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45affd700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c0d0a80 0x7ff45c0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45affd700 1 -- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45c142f70 msgr2=0x7ff45c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45affd700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45c142f70 0x7ff45c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45affd700 1 -- 172.21.15.7:0/1356563747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c009ae0 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff45affd700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 0x7ff45c158bf0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff45400e930 tx=0x7ff4540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454013680 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540137e0 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c15af50 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454013b80 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.606+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c15b510 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.607+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c0b5410 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.607+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ff45400c3e0 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.608+0000 7ff452ffd700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff43c067290 0x7ff43c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:19.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.608+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff454084b20 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.608+0000 7ff45a7fc700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff43c067290 0x7ff43c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:19.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.609+0000 7ff45a7fc700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff43c067290 0x7ff43c069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff45c141420 tx=0x7ff444007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:19.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.612+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff454051980 con 0x7ff45c0cc9f0 2023-10-14T19:09:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:19.850+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff45c140100 con 0x7ff45c0cc9f0 2023-10-14T19:09:20.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.470+0000 7ff452ffd700 1 -- 172.21.15.7:0/1356563747 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff454054fa0 con 0x7ff45c0cc9f0 2023-10-14T19:09:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff43c067290 msgr2=0x7ff43c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff43c067290 0x7ff43c069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff45c141420 tx=0x7ff444007ec0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 msgr2=0x7ff45c158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 0x7ff45c158bf0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff45400e930 tx=0x7ff4540091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 shutdown_connections 2023-10-14T19:09:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff43c067290 0x7ff43c069740 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45c142f70 0x7ff45c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff45c0cc9f0 0x7ff45c158bf0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 --2- 172.21.15.7:0/1356563747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff45c0d0a80 0x7ff45c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 >> 172.21.15.7:0/1356563747 conn(0x7ff45c0703a0 msgr2=0x7ff45c13f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 shutdown_connections 2023-10-14T19:09:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.472+0000 7ff46149f700 1 -- 172.21.15.7:0/1356563747 wait complete. 2023-10-14T19:09:20.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:09:20.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.615+0000 7f2d7b975700 1 Processor -- start 2023-10-14T19:09:20.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.615+0000 7f2d7b975700 1 -- start start 2023-10-14T19:09:20.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d7b975700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d740cb5a0 0x7f2d740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d7b975700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d740cd9e0 0x7f2d74159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d7b975700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7415ae40 con 0x7f2d740cde50 2023-10-14T19:09:20.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d7b975700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740d13f0 con 0x7f2d740cd9e0 2023-10-14T19:09:20.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d7b975700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415ab60 con 0x7f2d740cb5a0 2023-10-14T19:09:20.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d78f10700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d740cd9e0 0x7f2d74159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d79f12700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2d740cde50 0x7f2d74156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38324/0 (socket says 172.21.15.7:38324) 2023-10-14T19:09:20.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d78f10700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d740cd9e0 0x7f2d74159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58946/0 (socket says 172.21.15.7:58946) 2023-10-14T19:09:20.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.616+0000 7f2d79f12700 1 -- 172.21.15.7:0/322965247 learned_addr learned my addr 172.21.15.7:0/322965247 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:20.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d79711700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d740cb5a0 0x7f2d740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d78f10700 1 -- 172.21.15.7:0/322965247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d740cb5a0 msgr2=0x7f2d740cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:20.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d78f10700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d740cb5a0 0x7f2d740cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d78f10700 1 -- 172.21.15.7:0/322965247 >> v1:172.21.15.7:6789/0 conn(0x7f2d740cde50 legacy=0x7f2d74156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d73fff700 1 -- 172.21.15.7:0/322965247 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898745857 0 0) 0x7f2d7415ae40 con 0x7f2d740cde50 2023-10-14T19:09:20.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d78f10700 1 -- 172.21.15.7:0/322965247 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740ccf00 con 0x7f2d740cd9e0 2023-10-14T19:09:20.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d79711700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d740cb5a0 0x7f2d740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:20.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d78f10700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cd9e0 0x7f2d74159ec0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098e0 tx=0x7f2d680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b25b16742e96c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:20.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d73fff700 1 -- 172.21.15.7:0/322965247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68009e80 con 0x7f2d740cd9e0 2023-10-14T19:09:20.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d73fff700 1 -- 172.21.15.7:0/322965247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6800b860 con 0x7f2d740cd9e0 2023-10-14T19:09:20.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.617+0000 7f2d73fff700 1 -- 172.21.15.7:0/322965247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800bbe0 con 0x7f2d740cd9e0 2023-10-14T19:09:20.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 -- 172.21.15.7:0/322965247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cd9e0 msgr2=0x7f2d74159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cd9e0 0x7f2d74159ec0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098e0 tx=0x7f2d680091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 -- 172.21.15.7:0/322965247 shutdown_connections 2023-10-14T19:09:20.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d740cb5a0 0x7f2d740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 --2- 172.21.15.7:0/322965247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cd9e0 0x7f2d74159ec0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 -- 172.21.15.7:0/322965247 >> 172.21.15.7:0/322965247 conn(0x7f2d74070e30 msgr2=0x7f2d740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:20.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 -- 172.21.15.7:0/322965247 shutdown_connections 2023-10-14T19:09:20.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.618+0000 7f2d7b975700 1 -- 172.21.15.7:0/322965247 wait complete. 2023-10-14T19:09:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.619+0000 7f2d7b975700 1 Processor -- start 2023-10-14T19:09:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.619+0000 7f2d7b975700 1 -- start start 2023-10-14T19:09:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d7b975700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 0x7f2d7415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d7b975700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d740cd9e0 0x7f2d741549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d7b975700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74169230 0x7f2d740c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d7b975700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740c7c90 con 0x7f2d740cb5a0 2023-10-14T19:09:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d7b975700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741696c0 con 0x7f2d740cd9e0 2023-10-14T19:09:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d7b975700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741699a0 con 0x7f2d74169230 2023-10-14T19:09:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 0x7f2d7415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 0x7f2d7415c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58952/0 (socket says 172.21.15.7:58952) 2023-10-14T19:09:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 -- 172.21.15.7:0/2064118910 learned_addr learned my addr 172.21.15.7:0/2064118910 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79f12700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74169230 0x7f2d740c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d78f10700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d740cd9e0 0x7f2d741549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 -- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74169230 msgr2=0x7f2d740c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74169230 0x7f2d740c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 -- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d740cd9e0 msgr2=0x7f2d741549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d740cd9e0 0x7f2d741549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 -- 172.21.15.7:0/2064118910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009420 con 0x7f2d740cb5a0 2023-10-14T19:09:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.620+0000 7f2d79711700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 0x7f2d7415c010 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400d1d0 tx=0x7f2d64009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:20.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.621+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400de70 con 0x7f2d740cb5a0 2023-10-14T19:09:20.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.621+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6400f040 con 0x7f2d740cb5a0 2023-10-14T19:09:20.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.621+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74169c80 con 0x7f2d740cb5a0 2023-10-14T19:09:20.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.621+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64015670 con 0x7f2d740cb5a0 2023-10-14T19:09:20.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.621+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7415c550 con 0x7f2d740cb5a0 2023-10-14T19:09:20.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.621+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d740c7f00 con 0x7f2d740cb5a0 2023-10-14T19:09:20.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.622+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2d64015a60 con 0x7f2d740cb5a0 2023-10-14T19:09:20.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.622+0000 7f2d717fa700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d60067290 0x7f2d60069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.622+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d64085070 con 0x7f2d740cb5a0 2023-10-14T19:09:20.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.623+0000 7f2d78f10700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d60067290 0x7f2d60069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.623+0000 7f2d78f10700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d60067290 0x7f2d60069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2d740c7260 tx=0x7f2d68017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:20.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.627+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d6404e5a0 con 0x7f2d740cb5a0 2023-10-14T19:09:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.846+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d7404c3c0 con 0x7f2d60067290 2023-10-14T19:09:20.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.848+0000 7f2d717fa700 1 -- 172.21.15.7:0/2064118910 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2d7404c3c0 con 0x7f2d60067290 2023-10-14T19:09:20.849 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:09:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:09:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:20.849 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:09:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d60067290 msgr2=0x7f2d60069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d60067290 0x7f2d60069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2d740c7260 tx=0x7f2d68017000 comp rx=0 tx=0).stop 2023-10-14T19:09:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 msgr2=0x7f2d7415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 0x7f2d7415c010 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400d1d0 tx=0x7f2d64009a90 comp rx=0 tx=0).stop 2023-10-14T19:09:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 shutdown_connections 2023-10-14T19:09:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d60067290 0x7f2d60069740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74169230 0x7f2d740c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d740cb5a0 0x7f2d7415c010 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 --2- 172.21.15.7:0/2064118910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d740cd9e0 0x7f2d741549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 >> 172.21.15.7:0/2064118910 conn(0x7f2d74070e30 msgr2=0x7f2d740b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 shutdown_connections 2023-10-14T19:09:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.850+0000 7f2d7b975700 1 -- 172.21.15.7:0/2064118910 wait complete. 2023-10-14T19:09:20.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:09:20.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.984+0000 7fdbd1940700 1 Processor -- start 2023-10-14T19:09:20.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.984+0000 7fdbd1940700 1 -- start start 2023-10-14T19:09:20.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbd1940700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbd1940700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbcc06e0e0 0x7fdbcc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbd1940700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0ccfd0 con 0x7fdbcc159530 2023-10-14T19:09:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbd1940700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc15a3d0 con 0x7fdbcc06e0e0 2023-10-14T19:09:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbd1940700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15a6b0 con 0x7fdbcc06dc70 2023-10-14T19:09:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbca7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbcb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbcc06e0e0 0x7fdbcc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbcaffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdbcc159530 0x7fdbcc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:42340/0 (socket says 172.21.15.7:42340) 2023-10-14T19:09:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbca7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:36158/0 (socket says 172.21.15.7:36158) 2023-10-14T19:09:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbcaffd700 1 -- 172.21.15.7:0/4251781965 learned_addr learned my addr 172.21.15.7:0/4251781965 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbca7fc700 1 -- 172.21.15.7:0/4251781965 >> v2:172.21.15.148:3300/0 conn(0x7fdbcc06e0e0 msgr2=0x7fdbcc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbca7fc700 1 --2- 172.21.15.7:0/4251781965 >> v2:172.21.15.148:3300/0 conn(0x7fdbcc06e0e0 0x7fdbcc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbca7fc700 1 -- 172.21.15.7:0/4251781965 >> v1:172.21.15.148:6789/0 conn(0x7fdbcc159530 legacy=0x7fdbcc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbca7fc700 1 -- 172.21.15.7:0/4251781965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc15a990 con 0x7fdbcc06dc70 2023-10-14T19:09:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.985+0000 7fdbcb7fe700 1 --2- 172.21.15.7:0/4251781965 >> v2:172.21.15.148:3300/0 conn(0x7fdbcc06e0e0 0x7fdbcc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbca7fc700 1 --2- 172.21.15.7:0/4251781965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc159900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40098e0 tx=0x7fdbb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749c59e6b734f1a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbc9ffb700 1 -- 172.21.15.7:0/4251781965 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400b640 con 0x7fdbcc06dc70 2023-10-14T19:09:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbc9ffb700 1 -- 172.21.15.7:0/4251781965 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400b7a0 con 0x7fdbcc06dc70 2023-10-14T19:09:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbc9ffb700 1 -- 172.21.15.7:0/4251781965 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400bb40 con 0x7fdbcc06dc70 2023-10-14T19:09:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 -- 172.21.15.7:0/4251781965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 msgr2=0x7fdbcc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 --2- 172.21.15.7:0/4251781965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc159900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40098e0 tx=0x7fdbb40091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 -- 172.21.15.7:0/4251781965 shutdown_connections 2023-10-14T19:09:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 --2- 172.21.15.7:0/4251781965 >> v2:172.21.15.148:3300/0 conn(0x7fdbcc06e0e0 0x7fdbcc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 --2- 172.21.15.7:0/4251781965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc159900 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 -- 172.21.15.7:0/4251781965 >> 172.21.15.7:0/4251781965 conn(0x7fdbcc0703a0 msgr2=0x7fdbcc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 -- 172.21.15.7:0/4251781965 shutdown_connections 2023-10-14T19:09:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.986+0000 7fdbd1940700 1 -- 172.21.15.7:0/4251781965 wait complete. 2023-10-14T19:09:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 Processor -- start 2023-10-14T19:09:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 -- start start 2023-10-14T19:09:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbcc06e0e0 0x7fdbcc14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 0x7fdbcc0d0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc16d5f0 con 0x7fdbcc159530 2023-10-14T19:09:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15f0f0 con 0x7fdbcc06e0e0 2023-10-14T19:09:20.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbd1940700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc16d840 con 0x7fdbcc06dc70 2023-10-14T19:09:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbcb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 0x7fdbcc0d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbcb7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 0x7fdbcc0d0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58954/0 (socket says 172.21.15.7:58954) 2023-10-14T19:09:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.988+0000 7fdbcb7fe700 1 -- 172.21.15.7:0/1169165700 learned_addr learned my addr 172.21.15.7:0/1169165700 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcaffd700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbca7fc700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbcc06e0e0 0x7fdbcc14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcb7fe700 1 -- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 msgr2=0x7fdbcc0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcb7fe700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc0b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcb7fe700 1 -- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbcc06e0e0 msgr2=0x7fdbcc14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcb7fe700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbcc06e0e0 0x7fdbcc14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcb7fe700 1 -- 172.21.15.7:0/1169165700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc009420 con 0x7fdbcc159530 2023-10-14T19:09:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcaffd700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbcb7fe700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 0x7fdbcc0d0850 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00ec50 tx=0x7fdbbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00c9d0 con 0x7fdbcc159530 2023-10-14T19:09:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc00cb30 con 0x7fdbcc159530 2023-10-14T19:09:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb4009420 con 0x7fdbcc159530 2023-10-14T19:09:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc013470 con 0x7fdbcc159530 2023-10-14T19:09:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.989+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc16de00 con 0x7fdbcc159530 2023-10-14T19:09:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.990+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc04c3c0 con 0x7fdbcc159530 2023-10-14T19:09:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.991+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdbbc0138a0 con 0x7fdbcc159530 2023-10-14T19:09:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.991+0000 7fdbc2ffd700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbac067290 0x7fdbac069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.991+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbbc084e70 con 0x7fdbcc159530 2023-10-14T19:09:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.991+0000 7fdbcaffd700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbac067290 0x7fdbac069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.992+0000 7fdbcaffd700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbac067290 0x7fdbac069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400e160 tx=0x7fdbc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:20.995+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbbc051cd0 con 0x7fdbcc159530 2023-10-14T19:09:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.189+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdbcc16dff0 con 0x7fdbcc159530 2023-10-14T19:09:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.189+0000 7fdbc2ffd700 1 -- 172.21.15.7:0/1169165700 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdbbc0552f0 con 0x7fdbcc159530 2023-10-14T19:09:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbac067290 msgr2=0x7fdbac069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbac067290 0x7fdbac069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400e160 tx=0x7fdbc4009040 comp rx=0 tx=0).stop 2023-10-14T19:09:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 msgr2=0x7fdbcc0d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 0x7fdbcc0d0850 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00ec50 tx=0x7fdbbc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 shutdown_connections 2023-10-14T19:09:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbac067290 0x7fdbac069740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbcc159530 0x7fdbcc0d0850 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbcc06dc70 0x7fdbcc0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 --2- 172.21.15.7:0/1169165700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbcc06e0e0 0x7fdbcc14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 >> 172.21.15.7:0/1169165700 conn(0x7fdbcc0703a0 msgr2=0x7fdbcc0c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 shutdown_connections 2023-10-14T19:09:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.191+0000 7fdbd1940700 1 -- 172.21.15.7:0/1169165700 wait complete. 2023-10-14T19:09:21.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-14T19:09:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.324+0000 7f53342b0700 1 Processor -- start 2023-10-14T19:09:21.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.324+0000 7f53342b0700 1 -- start start 2023-10-14T19:09:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f53342b0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f532c159860 0x7f532c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f53342b0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f532c0ccfa0 0x7f532c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f53342b0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c0cf510 con 0x7f532c0cbd90 2023-10-14T19:09:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f53342b0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0d00b0 con 0x7f532c0ccfa0 2023-10-14T19:09:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f53342b0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0cc210 con 0x7f532c159860 2023-10-14T19:09:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f533284d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f532c0ccfa0 0x7f532c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.325+0000 7f533184b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f532c0cbd90 0x7f532c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38340/0 (socket says 172.21.15.7:38340) 2023-10-14T19:09:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533184b700 1 -- 172.21.15.7:0/600041452 learned_addr learned my addr 172.21.15.7:0/600041452 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533204c700 1 --2- 172.21.15.7:0/600041452 >> v2:172.21.15.148:3300/0 conn(0x7f532c159860 0x7f532c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533284d700 1 -- 172.21.15.7:0/600041452 >> v2:172.21.15.148:3300/0 conn(0x7f532c159860 msgr2=0x7f532c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533284d700 1 --2- 172.21.15.7:0/600041452 >> v2:172.21.15.148:3300/0 conn(0x7f532c159860 0x7f532c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533284d700 1 -- 172.21.15.7:0/600041452 >> v1:172.21.15.7:6789/0 conn(0x7f532c0cbd90 legacy=0x7f532c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533104a700 1 -- 172.21.15.7:0/600041452 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101159334 0 0) 0x7f532c0cf510 con 0x7f532c0cbd90 2023-10-14T19:09:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533284d700 1 -- 172.21.15.7:0/600041452 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c0ce900 con 0x7f532c0ccfa0 2023-10-14T19:09:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533284d700 1 --2- 172.21.15.7:0/600041452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0ccfa0 0x7f532c0cd400 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f532c088e40 tx=0x7f5324009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df4f0cd00082af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533104a700 1 -- 172.21.15.7:0/600041452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400e070 con 0x7f532c0ccfa0 2023-10-14T19:09:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533104a700 1 -- 172.21.15.7:0/600041452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400bb60 con 0x7f532c0ccfa0 2023-10-14T19:09:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.326+0000 7f533104a700 1 -- 172.21.15.7:0/600041452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324012430 con 0x7f532c0ccfa0 2023-10-14T19:09:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 -- 172.21.15.7:0/600041452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0ccfa0 msgr2=0x7f532c0cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 --2- 172.21.15.7:0/600041452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0ccfa0 0x7f532c0cd400 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f532c088e40 tx=0x7f5324009780 comp rx=0 tx=0).stop 2023-10-14T19:09:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 -- 172.21.15.7:0/600041452 shutdown_connections 2023-10-14T19:09:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 --2- 172.21.15.7:0/600041452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0ccfa0 0x7f532c0cd400 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 --2- 172.21.15.7:0/600041452 >> v2:172.21.15.148:3300/0 conn(0x7f532c159860 0x7f532c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 -- 172.21.15.7:0/600041452 >> 172.21.15.7:0/600041452 conn(0x7f532c0999b0 msgr2=0x7f532c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 -- 172.21.15.7:0/600041452 shutdown_connections 2023-10-14T19:09:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.327+0000 7f53342b0700 1 -- 172.21.15.7:0/600041452 wait complete. 2023-10-14T19:09:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.328+0000 7f53342b0700 1 Processor -- start 2023-10-14T19:09:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.328+0000 7f53342b0700 1 -- start start 2023-10-14T19:09:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53342b0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 0x7f532c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53342b0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f532c0ccfa0 0x7f532c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53342b0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532c159860 0x7f532c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53342b0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0c7e00 con 0x7f532c0cbd90 2023-10-14T19:09:21.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53342b0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15a6d0 con 0x7f532c159860 2023-10-14T19:09:21.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53342b0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15ca30 con 0x7f532c0ccfa0 2023-10-14T19:09:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 0x7f532c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 0x7f532c0ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58974/0 (socket says 172.21.15.7:58974) 2023-10-14T19:09:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 -- 172.21.15.7:0/2389681899 learned_addr learned my addr 172.21.15.7:0/2389681899 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533184b700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f532c0ccfa0 0x7f532c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533284d700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532c159860 0x7f532c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 -- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f532c0ccfa0 msgr2=0x7f532c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f532c0ccfa0 0x7f532c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 -- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532c159860 msgr2=0x7f532c158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532c159860 0x7f532c158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 -- 172.21.15.7:0/2389681899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009a20 con 0x7f532c0cbd90 2023-10-14T19:09:21.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f533204c700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 0x7f532c0ca5d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f532800ea00 tx=0x7f5328009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532800c850 con 0x7f532c0cbd90 2023-10-14T19:09:21.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.329+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532800c9b0 con 0x7f532c0cbd90 2023-10-14T19:09:21.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.330+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c15cd10 con 0x7f532c0cbd90 2023-10-14T19:09:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.330+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532800cd30 con 0x7f532c0cbd90 2023-10-14T19:09:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.330+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c158fa0 con 0x7f532c0cbd90 2023-10-14T19:09:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.330+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c1591c0 con 0x7f532c0cbd90 2023-10-14T19:09:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.331+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5328013680 con 0x7f532c0cbd90 2023-10-14T19:09:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.331+0000 7f53227fc700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5310067290 0x7f5310069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.332+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53280850b0 con 0x7f532c0cbd90 2023-10-14T19:09:21.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.332+0000 7f533184b700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5310067290 0x7f5310069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.332+0000 7f533184b700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5310067290 0x7f5310069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f532c0cae70 tx=0x7f531c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.336+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f532c1591c0 con 0x7f532c0cbd90 2023-10-14T19:09:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.556+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f532c1591c0 con 0x7f5310067290 2023-10-14T19:09:21.562 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:09:21.561+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:09:21.562 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:09:21.561+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:09:21.563 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:09:21.561+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:09:21.563 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:09:21.561+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:09:21.563 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:09:21.561+0000 7f53c0831700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T19:09:21.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.567+0000 7f53227fc700 1 -- 172.21.15.7:0/2389681899 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+471 (secure 0 0 0) 0x7f532c1591c0 con 0x7f5310067290 2023-10-14T19:09:21.573 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:09:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_addrs": [ 2023-10-14T19:09:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.7:6789", 2023-10-14T19:09:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6789", 2023-10-14T19:09:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: "172.21.15.148:6790" 2023-10-14T19:09:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:09:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": { 2023-10-14T19:09:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: "data": [ 2023-10-14T19:09:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": 365977698304, 2023-10-14T19:09:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_data", 2023-10-14T19:09:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: "used": 0 2023-10-14T19:09:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-10-14T19:09:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": [ 2023-10-14T19:09:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: "avail": 365977698304, 2023-10-14T19:09:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs_metadata", 2023-10-14T19:09:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: "used": 65536 2023-10-14T19:09:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:09:21.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:21.581 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:09:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.569+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5310067290 msgr2=0x7f5310069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5310067290 0x7f5310069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f532c0cae70 tx=0x7f531c009040 comp rx=0 tx=0).stop 2023-10-14T19:09:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 msgr2=0x7f532c0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 0x7f532c0ca5d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f532800ea00 tx=0x7f5328009120 comp rx=0 tx=0).stop 2023-10-14T19:09:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 shutdown_connections 2023-10-14T19:09:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5310067290 0x7f5310069740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532c159860 0x7f532c158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f532c0cbd90 0x7f532c0ca5d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 --2- 172.21.15.7:0/2389681899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f532c0ccfa0 0x7f532c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 >> 172.21.15.7:0/2389681899 conn(0x7f532c0999b0 msgr2=0x7f532c0b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 shutdown_connections 2023-10-14T19:09:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.570+0000 7f53342b0700 1 -- 172.21.15.7:0/2389681899 wait complete. 2023-10-14T19:09:21.589 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:09:21.590 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:09:21.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:09:21.683 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:09:21.684 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:09:21.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:09:21.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:21.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:09:21.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:21.732 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:09:21.748 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:09:21.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:09:21.748 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:21.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:09:21.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:21.796 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:09:21.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.933+0000 7fdf6ba08700 1 Processor -- start 2023-10-14T19:09:21.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.933+0000 7fdf6ba08700 1 -- start start 2023-10-14T19:09:21.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf6ba08700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf640cf200 0x7fdf640c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf6ba08700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640b0ba0 0x7fdf6406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf6ba08700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6415a280 con 0x7fdf640b07d0 2023-10-14T19:09:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf6ba08700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6406e180 con 0x7fdf640cf200 2023-10-14T19:09:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf6ba08700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6406d850 con 0x7fdf640b0ba0 2023-10-14T19:09:21.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf68fa3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf640cf200 0x7fdf640c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf68fa3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf640cf200 0x7fdf640c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58976/0 (socket says 172.21.15.7:58976) 2023-10-14T19:09:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.934+0000 7fdf68fa3700 1 -- 172.21.15.7:0/151484703 learned_addr learned my addr 172.21.15.7:0/151484703 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf68fa3700 1 -- 172.21.15.7:0/151484703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640b0ba0 msgr2=0x7fdf6406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf69fa5700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640b0ba0 0x7fdf6406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf68fa3700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640b0ba0 0x7fdf6406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf68fa3700 1 -- 172.21.15.7:0/151484703 >> v1:172.21.15.148:6789/0 conn(0x7fdf640b07d0 legacy=0x7fdf640ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf68fa3700 1 -- 172.21.15.7:0/151484703 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6406db30 con 0x7fdf640cf200 2023-10-14T19:09:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf69fa5700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640b0ba0 0x7fdf6406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf68fa3700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640cf200 0x7fdf640c42c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdf540099b0 tx=0x7fdf54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1cd9ae83befc45 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf5bfff700 1 -- 172.21.15.7:0/151484703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5400b820 con 0x7fdf640cf200 2023-10-14T19:09:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf5bfff700 1 -- 172.21.15.7:0/151484703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5400b980 con 0x7fdf640cf200 2023-10-14T19:09:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf5bfff700 1 -- 172.21.15.7:0/151484703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5400bd20 con 0x7fdf640cf200 2023-10-14T19:09:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 -- 172.21.15.7:0/151484703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640cf200 msgr2=0x7fdf640c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640cf200 0x7fdf640c42c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdf540099b0 tx=0x7fdf54009250 comp rx=0 tx=0).stop 2023-10-14T19:09:21.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 -- 172.21.15.7:0/151484703 shutdown_connections 2023-10-14T19:09:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640b0ba0 0x7fdf6406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/151484703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640cf200 0x7fdf640c42c0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 -- 172.21.15.7:0/151484703 >> 172.21.15.7:0/151484703 conn(0x7fdf6406ce80 msgr2=0x7fdf640ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.935+0000 7fdf6ba08700 1 -- 172.21.15.7:0/151484703 shutdown_connections 2023-10-14T19:09:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.936+0000 7fdf6ba08700 1 -- 172.21.15.7:0/151484703 wait complete. 2023-10-14T19:09:21.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 Processor -- start 2023-10-14T19:09:21.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 -- start start 2023-10-14T19:09:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf640b07d0 0x7fdf6416ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 0x7fdf64158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640cf200 0x7fdf6416b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6413fe90 con 0x7fdf640b0ba0 2023-10-14T19:09:21.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64156da0 con 0x7fdf640b07d0 2023-10-14T19:09:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.937+0000 7fdf6ba08700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64156190 con 0x7fdf640cf200 2023-10-14T19:09:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 0x7fdf64158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 0x7fdf64158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58978/0 (socket says 172.21.15.7:58978) 2023-10-14T19:09:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 -- 172.21.15.7:0/2136885241 learned_addr learned my addr 172.21.15.7:0/2136885241 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf69fa5700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640cf200 0x7fdf6416b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf697a4700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf640b07d0 0x7fdf6416ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 -- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640cf200 msgr2=0x7fdf6416b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640cf200 0x7fdf6416b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 -- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf640b07d0 msgr2=0x7fdf6416ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf640b07d0 0x7fdf6416ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 -- 172.21.15.7:0/2136885241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf540094f0 con 0x7fdf640b0ba0 2023-10-14T19:09:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf68fa3700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 0x7fdf64158590 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fdf540030c0 tx=0x7fdf54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5401c460 con 0x7fdf640b0ba0 2023-10-14T19:09:21.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5401c5c0 con 0x7fdf640b0ba0 2023-10-14T19:09:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf64156470 con 0x7fdf640b0ba0 2023-10-14T19:09:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5401c960 con 0x7fdf640b0ba0 2023-10-14T19:09:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.938+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf64156a30 con 0x7fdf640b0ba0 2023-10-14T19:09:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.939+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf64156f30 con 0x7fdf640b0ba0 2023-10-14T19:09:21.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.940+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdf5401cd10 con 0x7fdf640b0ba0 2023-10-14T19:09:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.940+0000 7fdf597fa700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf48067290 0x7fdf48069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.940+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf54087000 con 0x7fdf640b0ba0 2023-10-14T19:09:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.940+0000 7fdf697a4700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf48067290 0x7fdf48069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.941+0000 7fdf697a4700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf48067290 0x7fdf48069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdf60006fd0 tx=0x7fdf60009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:21.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:21.944+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf54053e60 con 0x7fdf640b0ba0 2023-10-14T19:09:22.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.181+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf64156ee0 con 0x7fdf640b0ba0 2023-10-14T19:09:22.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.182+0000 7fdf597fa700 1 -- 172.21.15.7:0/2136885241 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fdf54057480 con 0x7fdf640b0ba0 2023-10-14T19:09:22.183 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:22.184 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:10.821659+0000","modified":"2023-10-14T19:09:14.450944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"d","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2854367647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2854367647},{"type":"v1","addr":"172.21.15.148:6836","nonce":2854367647}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T19:09:22.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf48067290 msgr2=0x7fdf48069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf48067290 0x7fdf48069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdf60006fd0 tx=0x7fdf60009060 comp rx=0 tx=0).stop 2023-10-14T19:09:22.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 msgr2=0x7fdf64158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 0x7fdf64158590 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fdf540030c0 tx=0x7fdf54016000 comp rx=0 tx=0).stop 2023-10-14T19:09:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 shutdown_connections 2023-10-14T19:09:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdf48067290 0x7fdf48069740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf640b07d0 0x7fdf6416ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf640cf200 0x7fdf6416b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 --2- 172.21.15.7:0/2136885241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf640b0ba0 0x7fdf64158590 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 >> 172.21.15.7:0/2136885241 conn(0x7fdf6406ce80 msgr2=0x7fdf640c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:22.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 shutdown_connections 2023-10-14T19:09:22.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.184+0000 7fdf6ba08700 1 -- 172.21.15.7:0/2136885241 wait complete. 2023-10-14T19:09:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 65 2023-10-14T19:09:22.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.315+0000 7f107b57b700 1 Processor -- start 2023-10-14T19:09:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.315+0000 7f107b57b700 1 -- start start 2023-10-14T19:09:22.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f107b57b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10740b0ba0 0x7f10740c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f107b57b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107415a280 con 0x7f10740cf200 2023-10-14T19:09:22.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f107b57b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107406e180 con 0x7f10740b07d0 2023-10-14T19:09:22.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f107b57b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107406d850 con 0x7f10740b0ba0 2023-10-14T19:09:22.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f1079b18700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10740b0ba0 0x7f10740c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f1078b16700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f10740cf200 0x7f107406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38354/0 (socket says 172.21.15.7:38354) 2023-10-14T19:09:22.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.316+0000 7f1078b16700 1 -- 172.21.15.7:0/2391488773 learned_addr learned my addr 172.21.15.7:0/2391488773 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:22.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1079b18700 1 -- 172.21.15.7:0/2391488773 >> v1:172.21.15.148:6789/0 conn(0x7f10740b07d0 legacy=0x7f10740ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:22.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1079b18700 1 -- 172.21.15.7:0/2391488773 >> v1:172.21.15.7:6789/0 conn(0x7f10740cf200 legacy=0x7f107406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1079b18700 1 -- 172.21.15.7:0/2391488773 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107406db30 con 0x7f10740b0ba0 2023-10-14T19:09:22.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1073fff700 1 -- 172.21.15.7:0/2391488773 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054206505 0 0) 0x7f107415a280 con 0x7f10740cf200 2023-10-14T19:09:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1079b18700 1 --2- 172.21.15.7:0/2391488773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740b0ba0 0x7f10740c42c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1064009e60 tx=0x7f1064009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5adc5c690731a23 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1073fff700 1 -- 172.21.15.7:0/2391488773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106400e070 con 0x7f10740b0ba0 2023-10-14T19:09:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1073fff700 1 -- 172.21.15.7:0/2391488773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106400bbf0 con 0x7f10740b0ba0 2023-10-14T19:09:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f1073fff700 1 -- 172.21.15.7:0/2391488773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064012430 con 0x7f10740b0ba0 2023-10-14T19:09:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f107b57b700 1 -- 172.21.15.7:0/2391488773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740b0ba0 msgr2=0x7f10740c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.317+0000 7f107b57b700 1 --2- 172.21.15.7:0/2391488773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740b0ba0 0x7f10740c42c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1064009e60 tx=0x7f1064009780 comp rx=0 tx=0).stop 2023-10-14T19:09:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.318+0000 7f107b57b700 1 -- 172.21.15.7:0/2391488773 shutdown_connections 2023-10-14T19:09:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.318+0000 7f107b57b700 1 --2- 172.21.15.7:0/2391488773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740b0ba0 0x7f10740c42c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.318+0000 7f107b57b700 1 -- 172.21.15.7:0/2391488773 >> 172.21.15.7:0/2391488773 conn(0x7f107406ce80 msgr2=0x7f10740ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.318+0000 7f107b57b700 1 -- 172.21.15.7:0/2391488773 shutdown_connections 2023-10-14T19:09:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.318+0000 7f107b57b700 1 -- 172.21.15.7:0/2391488773 wait complete. 2023-10-14T19:09:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.319+0000 7f107b57b700 1 Processor -- start 2023-10-14T19:09:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.319+0000 7f107b57b700 1 -- start start 2023-10-14T19:09:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10740b07d0 0x7f107413e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10740b0ba0 0x7f10741527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 0x7f1074152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074155b80 con 0x7f10740cf200 2023-10-14T19:09:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074153230 con 0x7f10740b07d0 2023-10-14T19:09:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1074151f90 con 0x7f10740b0ba0 2023-10-14T19:09:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 0x7f1074152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 0x7f1074152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59006/0 (socket says 172.21.15.7:59006) 2023-10-14T19:09:22.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 -- 172.21.15.7:0/724258268 learned_addr learned my addr 172.21.15.7:0/724258268 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:22.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079317700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10740b07d0 0x7f107413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1078b16700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10740b0ba0 0x7f10741527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 -- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10740b0ba0 msgr2=0x7f10741527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10740b0ba0 0x7f10741527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 -- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10740b07d0 msgr2=0x7f107413e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10740b07d0 0x7f107413e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 -- 172.21.15.7:0/724258268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009a20 con 0x7f10740cf200 2023-10-14T19:09:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f1079b18700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 0x7f1074152cf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f107406af10 tx=0x7f1064018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106401e640 con 0x7f10740cf200 2023-10-14T19:09:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106401e7a0 con 0x7f10740cf200 2023-10-14T19:09:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10741552e0 con 0x7f10740cf200 2023-10-14T19:09:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106401eb60 con 0x7f10740cf200 2023-10-14T19:09:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.320+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1074155920 con 0x7f10740cf200 2023-10-14T19:09:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.321+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10740b1bb0 con 0x7f10740cf200 2023-10-14T19:09:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.322+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1064024070 con 0x7f10740cf200 2023-10-14T19:09:22.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.322+0000 7f10717fa700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1060067290 0x7f1060069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.322+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1064087440 con 0x7f10740cf200 2023-10-14T19:09:22.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.322+0000 7f1079317700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1060067290 0x7f1060069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.331 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.323+0000 7f1079317700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1060067290 0x7f1060069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f106c006fd0 tx=0x7f106c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:22.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.326+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10740b1bb0 con 0x7f10740cf200 2023-10-14T19:09:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.520+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10740b1bb0 con 0x7f10740cf200 2023-10-14T19:09:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.521+0000 7f10717fa700 1 -- 172.21.15.7:0/724258268 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f10740b1bb0 con 0x7f10740cf200 2023-10-14T19:09:22.522 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:22.522 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:12.441767+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:09.250495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:09.792938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1060067290 msgr2=0x7f1060069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1060067290 0x7f1060069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f106c006fd0 tx=0x7f106c009060 comp rx=0 tx=0).stop 2023-10-14T19:09:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 msgr2=0x7f1074152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 0x7f1074152cf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f107406af10 tx=0x7f1064018000 comp rx=0 tx=0).stop 2023-10-14T19:09:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 shutdown_connections 2023-10-14T19:09:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1060067290 0x7f1060069740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10740b07d0 0x7f107413e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740cf200 0x7f1074152cf0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 --2- 172.21.15.7:0/724258268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10740b0ba0 0x7f10741527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 >> 172.21.15.7:0/724258268 conn(0x7f107406ce80 msgr2=0x7f1074068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 shutdown_connections 2023-10-14T19:09:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.523+0000 7f107b57b700 1 -- 172.21.15.7:0/724258268 wait complete. 2023-10-14T19:09:22.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:09:09.250495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:09:09.792938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:09:22.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:09:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.658+0000 7fb7b7089700 1 Processor -- start 2023-10-14T19:09:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b7089700 1 -- start start 2023-10-14T19:09:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b7089700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7b0159530 0x7fb7b00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b7089700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7b006e0e0 0x7fb7b00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b7089700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00ccfd0 con 0x7fb7b006dc70 2023-10-14T19:09:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b7089700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b00cf0e0 con 0x7fb7b0159530 2023-10-14T19:09:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b7089700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b015a3d0 con 0x7fb7b006e0e0 2023-10-14T19:09:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7b4e25700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7b0159530 0x7fb7b00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7affff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb7b006dc70 0x7fb7b0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38364/0 (socket says 172.21.15.7:38364) 2023-10-14T19:09:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.659+0000 7fb7affff700 1 -- 172.21.15.7:0/2307529115 learned_addr learned my addr 172.21.15.7:0/2307529115 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7b5626700 1 --2- 172.21.15.7:0/2307529115 >> v2:172.21.15.148:3300/0 conn(0x7fb7b006e0e0 0x7fb7b00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7b4e25700 1 -- 172.21.15.7:0/2307529115 >> v2:172.21.15.148:3300/0 conn(0x7fb7b006e0e0 msgr2=0x7fb7b00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7b4e25700 1 --2- 172.21.15.7:0/2307529115 >> v2:172.21.15.148:3300/0 conn(0x7fb7b006e0e0 0x7fb7b00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7b4e25700 1 -- 172.21.15.7:0/2307529115 >> v1:172.21.15.7:6789/0 conn(0x7fb7b006dc70 legacy=0x7fb7b0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7af7fe700 1 -- 172.21.15.7:0/2307529115 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502970014 0 0) 0x7fb7b00ccfd0 con 0x7fb7b006dc70 2023-10-14T19:09:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7b4e25700 1 -- 172.21.15.7:0/2307529115 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b015a6b0 con 0x7fb7b0159530 2023-10-14T19:09:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7b4e25700 1 --2- 172.21.15.7:0/2307529115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b0159530 0x7fb7b00ceba0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00caef0 tx=0x7fb7a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260878af543519e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7af7fe700 1 -- 172.21.15.7:0/2307529115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4011630 con 0x7fb7b0159530 2023-10-14T19:09:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7af7fe700 1 -- 172.21.15.7:0/2307529115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4011790 con 0x7fb7b0159530 2023-10-14T19:09:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.660+0000 7fb7af7fe700 1 -- 172.21.15.7:0/2307529115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4011b30 con 0x7fb7b0159530 2023-10-14T19:09:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 -- 172.21.15.7:0/2307529115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b0159530 msgr2=0x7fb7b00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 --2- 172.21.15.7:0/2307529115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b0159530 0x7fb7b00ceba0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00caef0 tx=0x7fb7a40091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 -- 172.21.15.7:0/2307529115 shutdown_connections 2023-10-14T19:09:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 --2- 172.21.15.7:0/2307529115 >> v2:172.21.15.148:3300/0 conn(0x7fb7b006e0e0 0x7fb7b00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 --2- 172.21.15.7:0/2307529115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b0159530 0x7fb7b00ceba0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 -- 172.21.15.7:0/2307529115 >> 172.21.15.7:0/2307529115 conn(0x7fb7b00703a0 msgr2=0x7fb7b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:22.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 -- 172.21.15.7:0/2307529115 shutdown_connections 2023-10-14T19:09:22.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.661+0000 7fb7b7089700 1 -- 172.21.15.7:0/2307529115 wait complete. 2023-10-14T19:09:22.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.662+0000 7fb7b7089700 1 Processor -- start 2023-10-14T19:09:22.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.662+0000 7fb7b7089700 1 -- start start 2023-10-14T19:09:22.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 0x7fb7b015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7b006e0e0 0x7fb7b014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7b0159530 0x7fb7b00b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015dd30 con 0x7fb7b006dc70 2023-10-14T19:09:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015e010 con 0x7fb7b006e0e0 2023-10-14T19:09:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015e2f0 con 0x7fb7b0159530 2023-10-14T19:09:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 0x7fb7b015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 0x7fb7b015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59026/0 (socket says 172.21.15.7:59026) 2023-10-14T19:09:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 -- 172.21.15.7:0/251957977 learned_addr learned my addr 172.21.15.7:0/251957977 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7affff700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7b006e0e0 0x7fb7b014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b5626700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7b0159530 0x7fb7b00b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 -- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7b0159530 msgr2=0x7fb7b00b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7b0159530 0x7fb7b00b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 -- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7b006e0e0 msgr2=0x7fb7b014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7b006e0e0 0x7fb7b014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 -- 172.21.15.7:0/251957977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4009420 con 0x7fb7b006dc70 2023-10-14T19:09:22.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7affff700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7b006e0e0 0x7fb7b014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:22.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b4e25700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 0x7fb7b015d3c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40093f0 tx=0x7fb7a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:22.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4011b10 con 0x7fb7b006dc70 2023-10-14T19:09:22.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4025400 con 0x7fb7b006dc70 2023-10-14T19:09:22.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b015e5d0 con 0x7fb7b006dc70 2023-10-14T19:09:22.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.663+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40257a0 con 0x7fb7b006dc70 2023-10-14T19:09:22.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.664+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b015d900 con 0x7fb7b006dc70 2023-10-14T19:09:22.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.664+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b015eaf0 con 0x7fb7b006dc70 2023-10-14T19:09:22.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.665+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb7a4025b90 con 0x7fb7b006dc70 2023-10-14T19:09:22.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.665+0000 7fb7acff9700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb794067290 0x7fb794069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:22.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.665+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7a4086370 con 0x7fb7b006dc70 2023-10-14T19:09:22.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.665+0000 7fb7affff700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb794067290 0x7fb794069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:22.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.666+0000 7fb7affff700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb794067290 0x7fb794069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00b5890 tx=0x7fb79c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:22.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.670+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7b015eaf0 con 0x7fb7b006dc70 2023-10-14T19:09:22.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.835+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb7a40535a0 con 0x7fb7b006dc70 2023-10-14T19:09:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.864+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7b004c3c0 con 0x7fb7b006dc70 2023-10-14T19:09:22.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.864+0000 7fb7acff9700 1 -- 172.21.15.7:0/251957977 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7a4055230 con 0x7fb7b006dc70 2023-10-14T19:09:22.865 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:09:22.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb794067290 msgr2=0x7fb794069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb794067290 0x7fb794069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00b5890 tx=0x7fb79c009040 comp rx=0 tx=0).stop 2023-10-14T19:09:22.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 msgr2=0x7fb7b015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:22.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 0x7fb7b015d3c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40093f0 tx=0x7fb7a4017000 comp rx=0 tx=0).stop 2023-10-14T19:09:22.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 shutdown_connections 2023-10-14T19:09:22.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb794067290 0x7fb794069740 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7b0159530 0x7fb7b00b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7b006dc70 0x7fb7b015d3c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 --2- 172.21.15.7:0/251957977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7b006e0e0 0x7fb7b014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:22.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 >> 172.21.15.7:0/251957977 conn(0x7fb7b00703a0 msgr2=0x7fb7b0154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:22.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 shutdown_connections 2023-10-14T19:09:22.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:22.866+0000 7fb7b7089700 1 -- 172.21.15.7:0/251957977 wait complete. 2023-10-14T19:09:22.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:09:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.000+0000 7f413db62700 1 Processor -- start 2023-10-14T19:09:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.000+0000 7f413db62700 1 -- start start 2023-10-14T19:09:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f413db62700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4138159530 0x7f41380ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f413db62700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f413806dc70 0x7f4138159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f413db62700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380ccfd0 con 0x7f413806e0e0 2023-10-14T19:09:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f413db62700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41380cf0e0 con 0x7f4138159530 2023-10-14T19:09:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f413db62700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413815a3d0 con 0x7f413806dc70 2023-10-14T19:09:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f41377fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4138159530 0x7f41380ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f4136ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f413806dc70 0x7f4138159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f4137fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f413806e0e0 0x7f41380cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:42364/0 (socket says 172.21.15.7:42364) 2023-10-14T19:09:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f4137fff700 1 -- 172.21.15.7:0/1991117281 learned_addr learned my addr 172.21.15.7:0/1991117281 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f41377fe700 1 -- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f413806dc70 msgr2=0x7f4138159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f41377fe700 1 --2- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f413806dc70 0x7f4138159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f41377fe700 1 -- 172.21.15.7:0/1991117281 >> v1:172.21.15.148:6789/0 conn(0x7f413806e0e0 legacy=0x7f41380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f41377fe700 1 -- 172.21.15.7:0/1991117281 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413815a6b0 con 0x7f4138159530 2023-10-14T19:09:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f41367fc700 1 -- 172.21.15.7:0/1991117281 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623418117 0 0) 0x7f41380ccfd0 con 0x7f413806e0e0 2023-10-14T19:09:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.001+0000 7f4136ffd700 1 --2- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f413806dc70 0x7f4138159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f41377fe700 1 --2- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4138159530 0x7f41380ceba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41280098e0 tx=0x7f41280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ad9993e5c62b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f41367fc700 1 -- 172.21.15.7:0/1991117281 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800b640 con 0x7f4138159530 2023-10-14T19:09:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f41367fc700 1 -- 172.21.15.7:0/1991117281 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412800b7a0 con 0x7f4138159530 2023-10-14T19:09:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f41367fc700 1 -- 172.21.15.7:0/1991117281 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800bb40 con 0x7f4138159530 2023-10-14T19:09:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 -- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4138159530 msgr2=0x7f41380ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 --2- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4138159530 0x7f41380ceba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41280098e0 tx=0x7f41280091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 -- 172.21.15.7:0/1991117281 shutdown_connections 2023-10-14T19:09:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 --2- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4138159530 0x7f41380ceba0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 --2- 172.21.15.7:0/1991117281 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f413806dc70 0x7f4138159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 -- 172.21.15.7:0/1991117281 >> 172.21.15.7:0/1991117281 conn(0x7f41380703a0 msgr2=0x7f41380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 -- 172.21.15.7:0/1991117281 shutdown_connections 2023-10-14T19:09:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.002+0000 7f413db62700 1 -- 172.21.15.7:0/1991117281 wait complete. 2023-10-14T19:09:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 Processor -- start 2023-10-14T19:09:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 -- start start 2023-10-14T19:09:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f413806dc70 0x7f413814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 0x7f413816cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4138159530 0x7f41380cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413814e950 con 0x7f413806e0e0 2023-10-14T19:09:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413816de10 con 0x7f413806dc70 2023-10-14T19:09:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f413db62700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41380b35b0 con 0x7f4138159530 2023-10-14T19:09:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f4136ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 0x7f413816cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f4136ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 0x7f413816cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59030/0 (socket says 172.21.15.7:59030) 2023-10-14T19:09:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.004+0000 7f4136ffd700 1 -- 172.21.15.7:0/701035238 learned_addr learned my addr 172.21.15.7:0/701035238 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4137fff700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4138159530 0x7f41380cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f41377fe700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f413806dc70 0x7f413814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4136ffd700 1 -- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4138159530 msgr2=0x7f41380cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4136ffd700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4138159530 0x7f41380cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4136ffd700 1 -- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f413806dc70 msgr2=0x7f413814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4136ffd700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f413806dc70 0x7f413814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4136ffd700 1 -- 172.21.15.7:0/701035238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c009420 con 0x7f413806e0e0 2023-10-14T19:09:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f4136ffd700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 0x7f413816cee0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f412c00ec80 tx=0x7f412c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00c850 con 0x7f413806e0e0 2023-10-14T19:09:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c00c9b0 con 0x7f413806e0e0 2023-10-14T19:09:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4128009420 con 0x7f413806e0e0 2023-10-14T19:09:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00cd30 con 0x7f413806e0e0 2023-10-14T19:09:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.005+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413816db30 con 0x7f413806e0e0 2023-10-14T19:09:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.006+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413804c3c0 con 0x7f413806e0e0 2023-10-14T19:09:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.007+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f412c013680 con 0x7f413806e0e0 2023-10-14T19:09:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.007+0000 7f411f7fe700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41240673f0 0x7f41240698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.007+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f412c084f00 con 0x7f413806e0e0 2023-10-14T19:09:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.007+0000 7f41377fe700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41240673f0 0x7f41240698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.008+0000 7f41377fe700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41240673f0 0x7f41240698a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f41280093f0 tx=0x7f4128017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.011+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f412c0556a0 con 0x7f413806e0e0 2023-10-14T19:09:23.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.204+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f413815a990 con 0x7f413806e0e0 2023-10-14T19:09:23.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.204+0000 7f411f7fe700 1 -- 172.21.15.7:0/701035238 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7f412c055230 con 0x7f413806e0e0 2023-10-14T19:09:23.206 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:09:23.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.206+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41240673f0 msgr2=0x7f41240698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41240673f0 0x7f41240698a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f41280093f0 tx=0x7f4128017000 comp rx=0 tx=0).stop 2023-10-14T19:09:23.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 msgr2=0x7f413816cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 0x7f413816cee0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f412c00ec80 tx=0x7f412c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 shutdown_connections 2023-10-14T19:09:23.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f41240673f0 0x7f41240698a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f413806dc70 0x7f413814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4138159530 0x7f41380cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 --2- 172.21.15.7:0/701035238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f413806e0e0 0x7f413816cee0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 >> 172.21.15.7:0/701035238 conn(0x7f41380703a0 msgr2=0x7f41380cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:23.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 shutdown_connections 2023-10-14T19:09:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.207+0000 7f413db62700 1 -- 172.21.15.7:0/701035238 wait complete. 2023-10-14T19:09:23.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:09:23.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.341+0000 7f698a534700 1 Processor -- start 2023-10-14T19:09:23.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.341+0000 7f698a534700 1 -- start start 2023-10-14T19:09:23.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f698a534700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f69840cf110 0x7f698415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f698a534700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698415ac50 con 0x7f6984153a00 2023-10-14T19:09:23.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f698a534700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698415d010 con 0x7f6984153dd0 2023-10-14T19:09:23.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f698a534700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698415af60 con 0x7f69840cf110 2023-10-14T19:09:23.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f6989d33700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f69840cf110 0x7f698415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f6989532700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6984153a00 0x7f698415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38378/0 (socket says 172.21.15.7:38378) 2023-10-14T19:09:23.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.342+0000 7f6989532700 1 -- 172.21.15.7:0/3067138439 learned_addr learned my addr 172.21.15.7:0/3067138439 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:23.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6989d33700 1 -- 172.21.15.7:0/3067138439 >> v1:172.21.15.148:6789/0 conn(0x7f6984153dd0 legacy=0x7f69840cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6989d33700 1 -- 172.21.15.7:0/3067138439 >> v1:172.21.15.7:6789/0 conn(0x7f6984153a00 legacy=0x7f698415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6989d33700 1 -- 172.21.15.7:0/3067138439 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698415b240 con 0x7f69840cf110 2023-10-14T19:09:23.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6983fff700 1 -- 172.21.15.7:0/3067138439 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606890568 0 0) 0x7f698415ac50 con 0x7f6984153a00 2023-10-14T19:09:23.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6989d33700 1 --2- 172.21.15.7:0/3067138439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69840cf110 0x7f698415de50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f697c009e60 tx=0x7f697c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c53548cf45b4886 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6983fff700 1 -- 172.21.15.7:0/3067138439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00e070 con 0x7f69840cf110 2023-10-14T19:09:23.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6983fff700 1 -- 172.21.15.7:0/3067138439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00bc30 con 0x7f69840cf110 2023-10-14T19:09:23.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f6983fff700 1 -- 172.21.15.7:0/3067138439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c012430 con 0x7f69840cf110 2023-10-14T19:09:23.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f698a534700 1 -- 172.21.15.7:0/3067138439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69840cf110 msgr2=0x7f698415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f698a534700 1 --2- 172.21.15.7:0/3067138439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69840cf110 0x7f698415de50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f697c009e60 tx=0x7f697c009780 comp rx=0 tx=0).stop 2023-10-14T19:09:23.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f698a534700 1 -- 172.21.15.7:0/3067138439 shutdown_connections 2023-10-14T19:09:23.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f698a534700 1 --2- 172.21.15.7:0/3067138439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69840cf110 0x7f698415de50 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.343+0000 7f698a534700 1 -- 172.21.15.7:0/3067138439 >> 172.21.15.7:0/3067138439 conn(0x7f69840703a0 msgr2=0x7f69840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:23.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.344+0000 7f698a534700 1 -- 172.21.15.7:0/3067138439 shutdown_connections 2023-10-14T19:09:23.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.344+0000 7f698a534700 1 -- 172.21.15.7:0/3067138439 wait complete. 2023-10-14T19:09:23.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.345+0000 7f698a534700 1 Processor -- start 2023-10-14T19:09:23.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.345+0000 7f698a534700 1 -- start start 2023-10-14T19:09:23.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.345+0000 7f698a534700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69840cf110 0x7f6984152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.345+0000 7f698a534700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 0x7f6984156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f698a534700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6984153dd0 0x7f6984158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f698a534700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984169d50 con 0x7f6984153a00 2023-10-14T19:09:23.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f698a534700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984169140 con 0x7f69840cf110 2023-10-14T19:09:23.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f698a534700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6984169420 con 0x7f6984153dd0 2023-10-14T19:09:23.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 0x7f6984156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 0x7f6984156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59048/0 (socket says 172.21.15.7:59048) 2023-10-14T19:09:23.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 -- 172.21.15.7:0/3997139336 learned_addr learned my addr 172.21.15.7:0/3997139336 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:23.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6989532700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69840cf110 0x7f6984152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6989d33700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6984153dd0 0x7f6984158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 -- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6984153dd0 msgr2=0x7f6984158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6984153dd0 0x7f6984158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 -- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69840cf110 msgr2=0x7f6984152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69840cf110 0x7f6984152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 -- 172.21.15.7:0/3997139336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009a20 con 0x7f6984153a00 2023-10-14T19:09:23.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f6988d31700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 0x7f6984156a20 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f697800c4e0 tx=0x7f697800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978011590 con 0x7f6984153a00 2023-10-14T19:09:23.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978011710 con 0x7f6984153a00 2023-10-14T19:09:23.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6984169700 con 0x7f6984153a00 2023-10-14T19:09:23.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978011ad0 con 0x7f6984153a00 2023-10-14T19:09:23.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.346+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6984156f60 con 0x7f6984153a00 2023-10-14T19:09:23.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.347+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698404c3c0 con 0x7f6984153a00 2023-10-14T19:09:23.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.348+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f697801b3b0 con 0x7f6984153a00 2023-10-14T19:09:23.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.348+0000 7f69817fa700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6970067320 0x7f69700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.348+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6978084030 con 0x7f6984153a00 2023-10-14T19:09:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.348+0000 7f6989532700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6970067320 0x7f69700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.349+0000 7f6989532700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6970067320 0x7f69700697d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6974007fd0 tx=0x7f6974007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.352+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6978050cc0 con 0x7f6984153a00 2023-10-14T19:09:23.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.545+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f698416a0e0 con 0x7f6984153a00 2023-10-14T19:09:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.546+0000 7f69817fa700 1 -- 172.21.15.7:0/3997139336 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6978017070 con 0x7f6984153a00 2023-10-14T19:09:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:09:23.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6970067320 msgr2=0x7f69700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6970067320 0x7f69700697d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6974007fd0 tx=0x7f6974007d30 comp rx=0 tx=0).stop 2023-10-14T19:09:23.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 msgr2=0x7f6984156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 0x7f6984156a20 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f697800c4e0 tx=0x7f697800c7f0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 shutdown_connections 2023-10-14T19:09:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6970067320 0x7f69700697d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69840cf110 0x7f6984152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6984153dd0 0x7f6984158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 --2- 172.21.15.7:0/3997139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6984153a00 0x7f6984156a20 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 >> 172.21.15.7:0/3997139336 conn(0x7f69840703a0 msgr2=0x7f69840ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 shutdown_connections 2023-10-14T19:09:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.548+0000 7f698a534700 1 -- 172.21.15.7:0/3997139336 wait complete. 2023-10-14T19:09:23.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:23.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.679+0000 7f97e9d8b700 1 Processor -- start 2023-10-14T19:09:23.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.679+0000 7f97e9d8b700 1 -- start start 2023-10-14T19:09:23.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e9d8b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b07d0 0x7f97e40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e9d8b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f97e40cf200 0x7f97e40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e9d8b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97e40b0ba0 0x7f97e406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e9d8b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e415a280 con 0x7f97e40b0ba0 2023-10-14T19:09:23.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e9d8b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e406e180 con 0x7f97e40cf200 2023-10-14T19:09:23.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e9d8b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40cd540 con 0x7f97e40b07d0 2023-10-14T19:09:23.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97e40b0ba0 0x7f97e406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97e40b0ba0 0x7f97e406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59056/0 (socket says 172.21.15.7:59056) 2023-10-14T19:09:23.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e3fff700 1 -- 172.21.15.7:0/1650313457 learned_addr learned my addr 172.21.15.7:0/1650313457 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:23.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e37fe700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b07d0 0x7f97e40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.680+0000 7f97e2ffd700 1 --2- 172.21.15.7:0/1650313457 >> v2:172.21.15.148:3300/0 conn(0x7f97e40cf200 0x7f97e40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e3fff700 1 -- 172.21.15.7:0/1650313457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b07d0 msgr2=0x7f97e40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:23.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e3fff700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b07d0 0x7f97e40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e3fff700 1 -- 172.21.15.7:0/1650313457 >> v2:172.21.15.148:3300/0 conn(0x7f97e40cf200 msgr2=0x7f97e40cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:23.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e3fff700 1 --2- 172.21.15.7:0/1650313457 >> v2:172.21.15.148:3300/0 conn(0x7f97e40cf200 0x7f97e40cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e3fff700 1 -- 172.21.15.7:0/1650313457 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e406d850 con 0x7f97e40b0ba0 2023-10-14T19:09:23.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e2ffd700 1 --2- 172.21.15.7:0/1650313457 >> v2:172.21.15.148:3300/0 conn(0x7f97e40cf200 0x7f97e40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:23.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e37fe700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b07d0 0x7f97e40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:23.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e3fff700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40b0ba0 0x7f97e406e610 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f97e4064ed0 tx=0x7f97dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5613be9efc77b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e27fc700 1 -- 172.21.15.7:0/1650313457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00e070 con 0x7f97e40b0ba0 2023-10-14T19:09:23.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e27fc700 1 -- 172.21.15.7:0/1650313457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc00bae0 con 0x7f97e40b0ba0 2023-10-14T19:09:23.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e27fc700 1 -- 172.21.15.7:0/1650313457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0092e0 con 0x7f97e40b0ba0 2023-10-14T19:09:23.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 -- 172.21.15.7:0/1650313457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40b0ba0 msgr2=0x7f97e406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40b0ba0 0x7f97e406e610 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f97e4064ed0 tx=0x7f97dc009840 comp rx=0 tx=0).stop 2023-10-14T19:09:23.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 -- 172.21.15.7:0/1650313457 shutdown_connections 2023-10-14T19:09:23.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40b0ba0 0x7f97e406e610 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/1650313457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b07d0 0x7f97e40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/1650313457 >> v2:172.21.15.148:3300/0 conn(0x7f97e40cf200 0x7f97e40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 -- 172.21.15.7:0/1650313457 >> 172.21.15.7:0/1650313457 conn(0x7f97e406ce80 msgr2=0x7f97e40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:23.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.681+0000 7f97e9d8b700 1 -- 172.21.15.7:0/1650313457 shutdown_connections 2023-10-14T19:09:23.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.682+0000 7f97e9d8b700 1 -- 172.21.15.7:0/1650313457 wait complete. 2023-10-14T19:09:23.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 Processor -- start 2023-10-14T19:09:23.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 -- start start 2023-10-14T19:09:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97e40b07d0 0x7f97e4158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b0ba0 0x7f97e40af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 0x7f97e40af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e416a410 con 0x7f97e40cf200 2023-10-14T19:09:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4169ae0 con 0x7f97e40b07d0 2023-10-14T19:09:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.683+0000 7f97e9d8b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4169dc0 con 0x7f97e40b0ba0 2023-10-14T19:09:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 0x7f97e40af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 0x7f97e40af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59072/0 (socket says 172.21.15.7:59072) 2023-10-14T19:09:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 -- 172.21.15.7:0/140025132 learned_addr learned my addr 172.21.15.7:0/140025132 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e2ffd700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b0ba0 0x7f97e40af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e37fe700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97e40b07d0 0x7f97e4158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 -- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b0ba0 msgr2=0x7f97e40af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b0ba0 0x7f97e40af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 -- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97e40b07d0 msgr2=0x7f97e4158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97e40b07d0 0x7f97e4158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 -- 172.21.15.7:0/140025132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009ae0 con 0x7f97e40cf200 2023-10-14T19:09:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e3fff700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 0x7f97e40af930 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f97e406af10 tx=0x7f97dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc008e80 con 0x7f97e40cf200 2023-10-14T19:09:23.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc01d420 con 0x7f97e40cf200 2023-10-14T19:09:23.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e416a0a0 con 0x7f97e40cf200 2023-10-14T19:09:23.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc01d7c0 con 0x7f97e40cf200 2023-10-14T19:09:23.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.684+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e4159350 con 0x7f97e40cf200 2023-10-14T19:09:23.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.685+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e416a5c0 con 0x7f97e40cf200 2023-10-14T19:09:23.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.686+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f97dc003040 con 0x7f97e40cf200 2023-10-14T19:09:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.686+0000 7f97cb7fe700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f97d00673a0 0x7f97d0069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.686+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97dc086b50 con 0x7f97e40cf200 2023-10-14T19:09:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.686+0000 7f97e37fe700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f97d00673a0 0x7f97d0069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.687+0000 7f97e37fe700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f97d00673a0 0x7f97d0069850 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f97d4006fd0 tx=0x7f97d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.690+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97e416a5c0 con 0x7f97e40cf200 2023-10-14T19:09:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.930+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97e404c3c0 con 0x7f97e40cf200 2023-10-14T19:09:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.930+0000 7f97cb7fe700 1 -- 172.21.15.7:0/140025132 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f97dc053690 con 0x7f97e40cf200 2023-10-14T19:09:23.931 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:23.932 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:10.821659+0000","modified":"2023-10-14T19:09:14.450944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"d","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2854367647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2854367647},{"type":"v1","addr":"172.21.15.148:6836","nonce":2854367647}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T19:09:23.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f97d00673a0 msgr2=0x7f97d0069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f97d00673a0 0x7f97d0069850 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f97d4006fd0 tx=0x7f97d4008040 comp rx=0 tx=0).stop 2023-10-14T19:09:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 msgr2=0x7f97e40af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 0x7f97e40af930 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f97e406af10 tx=0x7f97dc018000 comp rx=0 tx=0).stop 2023-10-14T19:09:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 shutdown_connections 2023-10-14T19:09:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f97d00673a0 0x7f97d0069850 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97e40b07d0 0x7f97e4158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97e40cf200 0x7f97e40af930 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 --2- 172.21.15.7:0/140025132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97e40b0ba0 0x7f97e40af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 >> 172.21.15.7:0/140025132 conn(0x7f97e406ce80 msgr2=0x7f97e40ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 shutdown_connections 2023-10-14T19:09:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:23.932+0000 7f97e9d8b700 1 -- 172.21.15.7:0/140025132 wait complete. 2023-10-14T19:09:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 65 2023-10-14T19:09:23.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.063+0000 7fde3ca92700 1 Processor -- start 2023-10-14T19:09:24.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.064+0000 7fde3ca92700 1 -- start start 2023-10-14T19:09:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.064+0000 7fde3ca92700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde380cb5a0 0x7fde380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.064+0000 7fde3ca92700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde38159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3ca92700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3815ae40 con 0x7fde380cde50 2023-10-14T19:09:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3ca92700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde380d13f0 con 0x7fde380cb5a0 2023-10-14T19:09:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3ca92700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3815ab60 con 0x7fde380cd9e0 2023-10-14T19:09:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde36d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fde380cde50 0x7fde38156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38386/0 (socket says 172.21.15.7:38386) 2023-10-14T19:09:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde36d9d700 1 -- 172.21.15.7:0/1344965538 learned_addr learned my addr 172.21.15.7:0/1344965538 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3659c700 1 --2- 172.21.15.7:0/1344965538 >> v2:172.21.15.148:3300/0 conn(0x7fde380cb5a0 0x7fde380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde35d9b700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde38159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148456599 0 0) 0x7fde3815ae40 con 0x7fde380cde50 2023-10-14T19:09:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde24003570 con 0x7fde380cde50 2023-10-14T19:09:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167062877 0 0) 0x7fde24003570 con 0x7fde380cde50 2023-10-14T19:09:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 msgr2=0x7fde38159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde38159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 >> v2:172.21.15.148:3300/0 conn(0x7fde380cb5a0 msgr2=0x7fde380cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 --2- 172.21.15.7:0/1344965538 >> v2:172.21.15.148:3300/0 conn(0x7fde380cb5a0 0x7fde380cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380ccf00 con 0x7fde380cde50 2023-10-14T19:09:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fde30001470 con 0x7fde380cde50 2023-10-14T19:09:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 >> v1:172.21.15.7:6789/0 conn(0x7fde380cde50 legacy=0x7fde38156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde24003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde24003fe0 0x7fde24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde24004d50 0x7fde240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3815ab60 con 0x7fde24003fe0 2023-10-14T19:09:24.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2400ba60 con 0x7fde24004d50 2023-10-14T19:09:24.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2400bbd0 con 0x7fde380cd9e0 2023-10-14T19:09:24.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde3659c700 1 --2- 172.21.15.7:0/1344965538 >> v2:172.21.15.148:3300/0 conn(0x7fde380cb5a0 0x7fde380cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:24.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.065+0000 7fde35d9b700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde24003fe0 0x7fde24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde36d9d700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde24004d50 0x7fde240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3659c700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde24003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde35d9b700 1 -- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 msgr2=0x7fde24003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde35d9b700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde24003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde35d9b700 1 -- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde24004d50 msgr2=0x7fde240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde35d9b700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde24004d50 0x7fde240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde35d9b700 1 -- 172.21.15.7:0/1344965538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24003570 con 0x7fde24003fe0 2023-10-14T19:09:24.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3659c700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde380cd9e0 0x7fde24003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:24.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde36d9d700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde24004d50 0x7fde240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:24.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde35d9b700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde24003fe0 0x7fde24004810 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fde20009c00 tx=0x7fde200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e09bd4d8ad1cc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000e6b0 con 0x7fde24003fe0 2023-10-14T19:09:24.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000e810 con 0x7fde24003fe0 2023-10-14T19:09:24.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3559a700 1 -- 172.21.15.7:0/1344965538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000ebd0 con 0x7fde24003fe0 2023-10-14T19:09:24.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3ca92700 1 -- 172.21.15.7:0/1344965538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde24003fe0 msgr2=0x7fde24004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde3ca92700 1 --2- 172.21.15.7:0/1344965538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde24003fe0 0x7fde24004810 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fde20009c00 tx=0x7fde200091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.066+0000 7fde36d9d700 1 -- 172.21.15.7:0/1344965538 reap_dead start 2023-10-14T19:09:24.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.067+0000 7fde3ca92700 1 -- 172.21.15.7:0/1344965538 shutdown_connections 2023-10-14T19:09:24.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.067+0000 7fde3ca92700 1 -- 172.21.15.7:0/1344965538 >> 172.21.15.7:0/1344965538 conn(0x7fde38070e30 msgr2=0x7fde380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:24.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.067+0000 7fde3ca92700 1 -- 172.21.15.7:0/1344965538 shutdown_connections 2023-10-14T19:09:24.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.067+0000 7fde3ca92700 1 -- 172.21.15.7:0/1344965538 wait complete. 2023-10-14T19:09:24.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 Processor -- start 2023-10-14T19:09:24.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 -- start start 2023-10-14T19:09:24.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde24003fe0 0x7fde380b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 0x7fde3816c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde3816ce90 0x7fde380b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde380b39f0 con 0x7fde380ce900 2023-10-14T19:09:24.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.068+0000 7fde3ca92700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde380b4350 con 0x7fde3816ce90 2023-10-14T19:09:24.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde3ca92700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde380b3630 con 0x7fde24003fe0 2023-10-14T19:09:24.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 0x7fde3816c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 0x7fde3816c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59092/0 (socket says 172.21.15.7:59092) 2023-10-14T19:09:24.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 -- 172.21.15.7:0/4076557968 learned_addr learned my addr 172.21.15.7:0/4076557968 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde3659c700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde24003fe0 0x7fde380b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde36d9d700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde3816ce90 0x7fde380b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 -- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde24003fe0 msgr2=0x7fde380b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde24003fe0 0x7fde380b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 -- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde3816ce90 msgr2=0x7fde380b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde3816ce90 0x7fde380b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 -- 172.21.15.7:0/4076557968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3816d310 con 0x7fde380ce900 2023-10-14T19:09:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde35d9b700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 0x7fde3816c950 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fde200091e0 tx=0x7fde2001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20022070 con 0x7fde380ce900 2023-10-14T19:09:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000e980 con 0x7fde380ce900 2023-10-14T19:09:24.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3816d5f0 con 0x7fde380ce900 2023-10-14T19:09:24.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000e6b0 con 0x7fde380ce900 2023-10-14T19:09:24.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.069+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3815e220 con 0x7fde380ce900 2023-10-14T19:09:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.070+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3804c3c0 con 0x7fde380ce900 2023-10-14T19:09:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.071+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fde2001c450 con 0x7fde380ce900 2023-10-14T19:09:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.071+0000 7fde2e7fc700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde18067350 0x7fde18069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.071+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde20086610 con 0x7fde380ce900 2023-10-14T19:09:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.071+0000 7fde3659c700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde18067350 0x7fde18069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.072+0000 7fde3659c700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde18067350 0x7fde18069800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde28007a70 tx=0x7fde2800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.075+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde200532a0 con 0x7fde380ce900 2023-10-14T19:09:24.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.270+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde3816d7e0 con 0x7fde380ce900 2023-10-14T19:09:24.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.271+0000 7fde2e7fc700 1 -- 172.21.15.7:0/4076557968 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fde200568c0 con 0x7fde380ce900 2023-10-14T19:09:24.272 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:24.272 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:12.441767+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:09.250495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:09.792938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde18067350 msgr2=0x7fde18069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde18067350 0x7fde18069800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde28007a70 tx=0x7fde2800b040 comp rx=0 tx=0).stop 2023-10-14T19:09:24.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 msgr2=0x7fde3816c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 0x7fde3816c950 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fde200091e0 tx=0x7fde2001a000 comp rx=0 tx=0).stop 2023-10-14T19:09:24.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 shutdown_connections 2023-10-14T19:09:24.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fde18067350 0x7fde18069800 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde3816ce90 0x7fde380b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde24003fe0 0x7fde380b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 --2- 172.21.15.7:0/4076557968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380ce900 0x7fde3816c950 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 >> 172.21.15.7:0/4076557968 conn(0x7fde38070e30 msgr2=0x7fde380b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:24.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 shutdown_connections 2023-10-14T19:09:24.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.273+0000 7fde3ca92700 1 -- 172.21.15.7:0/4076557968 wait complete. 2023-10-14T19:09:24.286 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:09:24.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:24.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.404+0000 7f491f2f2700 1 Processor -- start 2023-10-14T19:09:24.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.404+0000 7f491f2f2700 1 -- start start 2023-10-14T19:09:24.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491f2f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f49180cb5a0 0x7f49180cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491f2f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f4918159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491f2f2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49180cde50 0x7f491815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491f2f2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49180d13f0 con 0x7f49180cde50 2023-10-14T19:09:24.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491f2f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491815a940 con 0x7f49180cb5a0 2023-10-14T19:09:24.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491f2f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491815ae40 con 0x7f49180cd9e0 2023-10-14T19:09:24.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491d88f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49180cde50 0x7f491815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491d88f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49180cde50 0x7f491815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59096/0 (socket says 172.21.15.7:59096) 2023-10-14T19:09:24.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491d88f700 1 -- 172.21.15.7:0/4048671480 learned_addr learned my addr 172.21.15.7:0/4048671480 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:24.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491d08e700 1 --2- 172.21.15.7:0/4048671480 >> v2:172.21.15.148:3300/0 conn(0x7f49180cb5a0 0x7f49180cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.405+0000 7f491c88d700 1 --2- 172.21.15.7:0/4048671480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f4918159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d88f700 1 -- 172.21.15.7:0/4048671480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 msgr2=0x7f4918159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d88f700 1 --2- 172.21.15.7:0/4048671480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f4918159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d88f700 1 -- 172.21.15.7:0/4048671480 >> v2:172.21.15.148:3300/0 conn(0x7f49180cb5a0 msgr2=0x7f49180cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d88f700 1 --2- 172.21.15.7:0/4048671480 >> v2:172.21.15.148:3300/0 conn(0x7f49180cb5a0 0x7f49180cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d88f700 1 -- 172.21.15.7:0/4048671480 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491815ab60 con 0x7f49180cde50 2023-10-14T19:09:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d08e700 1 --2- 172.21.15.7:0/4048671480 >> v2:172.21.15.148:3300/0 conn(0x7f49180cb5a0 0x7f49180cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491d88f700 1 --2- 172.21.15.7:0/4048671480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cde50 0x7f491815a400 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4918065120 tx=0x7f4908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbd017ec468cab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f4917fff700 1 -- 172.21.15.7:0/4048671480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490800e070 con 0x7f49180cde50 2023-10-14T19:09:24.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f4917fff700 1 -- 172.21.15.7:0/4048671480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490800ba40 con 0x7f49180cde50 2023-10-14T19:09:24.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f4917fff700 1 -- 172.21.15.7:0/4048671480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49080092e0 con 0x7f49180cde50 2023-10-14T19:09:24.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 -- 172.21.15.7:0/4048671480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cde50 msgr2=0x7f491815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 --2- 172.21.15.7:0/4048671480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cde50 0x7f491815a400 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4918065120 tx=0x7f4908009840 comp rx=0 tx=0).stop 2023-10-14T19:09:24.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 -- 172.21.15.7:0/4048671480 shutdown_connections 2023-10-14T19:09:24.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 --2- 172.21.15.7:0/4048671480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cde50 0x7f491815a400 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 --2- 172.21.15.7:0/4048671480 >> v2:172.21.15.148:3300/0 conn(0x7f49180cb5a0 0x7f49180cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 --2- 172.21.15.7:0/4048671480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f4918159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.406+0000 7f491f2f2700 1 -- 172.21.15.7:0/4048671480 >> 172.21.15.7:0/4048671480 conn(0x7f4918070e30 msgr2=0x7f49180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:24.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.407+0000 7f491f2f2700 1 -- 172.21.15.7:0/4048671480 shutdown_connections 2023-10-14T19:09:24.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.407+0000 7f491f2f2700 1 -- 172.21.15.7:0/4048671480 wait complete. 2023-10-14T19:09:24.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 Processor -- start 2023-10-14T19:09:24.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 -- start start 2023-10-14T19:09:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 0x7f491815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f49181596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4918159c00 0x7f491816c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491815d360 con 0x7f49180cb5a0 2023-10-14T19:09:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491815c750 con 0x7f4918159c00 2023-10-14T19:09:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.408+0000 7f491f2f2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491815ca30 con 0x7f49180cd9e0 2023-10-14T19:09:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 0x7f491815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 0x7f491815d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59112/0 (socket says 172.21.15.7:59112) 2023-10-14T19:09:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 -- 172.21.15.7:0/3904135528 learned_addr learned my addr 172.21.15.7:0/3904135528 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d88f700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4918159c00 0x7f491816c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491c88d700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f49181596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 -- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 msgr2=0x7f49181596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f49181596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 -- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4918159c00 msgr2=0x7f491816c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4918159c00 0x7f491816c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 -- 172.21.15.7:0/3904135528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009ae0 con 0x7f49180cb5a0 2023-10-14T19:09:24.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d88f700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4918159c00 0x7f491816c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:24.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491c88d700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f49181596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:24.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491d08e700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 0x7f491815d7f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f491000e8d0 tx=0x7f4910008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000ee70 con 0x7f49180cb5a0 2023-10-14T19:09:24.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491000c5e0 con 0x7f49180cb5a0 2023-10-14T19:09:24.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491815cd10 con 0x7f49180cb5a0 2023-10-14T19:09:24.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000c980 con 0x7f49180cb5a0 2023-10-14T19:09:24.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.409+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491815dd30 con 0x7f49180cb5a0 2023-10-14T19:09:24.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.410+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49181582b0 con 0x7f49180cb5a0 2023-10-14T19:09:24.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.411+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4910013410 con 0x7f49180cb5a0 2023-10-14T19:09:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.411+0000 7f49157fa700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4904067320 0x7f49040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.411+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4910084c30 con 0x7f49180cb5a0 2023-10-14T19:09:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.411+0000 7f491c88d700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4904067320 0x7f49040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.412+0000 7f491c88d700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4904067320 0x7f49040697d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f49180c5850 tx=0x7f490c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.415+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49100517b0 con 0x7f49180cb5a0 2023-10-14T19:09:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.654+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f491804c3c0 con 0x7f49180cb5a0 2023-10-14T19:09:24.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.654+0000 7f49157fa700 1 -- 172.21.15.7:0/3904135528 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f4910054dd0 con 0x7f49180cb5a0 2023-10-14T19:09:24.656 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:24.656 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:10.821659+0000","modified":"2023-10-14T19:09:14.450944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"d","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2854367647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2854367647},{"type":"v1","addr":"172.21.15.148:6836","nonce":2854367647}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T19:09:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4904067320 msgr2=0x7f49040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4904067320 0x7f49040697d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f49180c5850 tx=0x7f490c008040 comp rx=0 tx=0).stop 2023-10-14T19:09:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 msgr2=0x7f491815d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 0x7f491815d7f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f491000e8d0 tx=0x7f4910008040 comp rx=0 tx=0).stop 2023-10-14T19:09:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 shutdown_connections 2023-10-14T19:09:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4904067320 0x7f49040697d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4918159c00 0x7f491816c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49180cb5a0 0x7f491815d7f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 --2- 172.21.15.7:0/3904135528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49180cd9e0 0x7f49181596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 >> 172.21.15.7:0/3904135528 conn(0x7f4918070e30 msgr2=0x7f49180d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 shutdown_connections 2023-10-14T19:09:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.657+0000 7f491f2f2700 1 -- 172.21.15.7:0/3904135528 wait complete. 2023-10-14T19:09:24.660 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 65 2023-10-14T19:09:24.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:24.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.789+0000 7f807dd65700 1 Processor -- start 2023-10-14T19:09:24.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.789+0000 7f807dd65700 1 -- start start 2023-10-14T19:09:24.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f807dd65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f80780cb5a0 0x7f80780cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f807dd65700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f80780cd9e0 0x7f8078159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f807dd65700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807815ae40 con 0x7f807815a400 2023-10-14T19:09:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f807dd65700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80780d13f0 con 0x7f80780cb5a0 2023-10-14T19:09:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f807dd65700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807815ab60 con 0x7f80780cd9e0 2023-10-14T19:09:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80777fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f80780cb5a0 0x7f80780cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f8077fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f807815a400 0x7f8078156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38394/0 (socket says 172.21.15.7:38394) 2023-10-14T19:09:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f8077fff700 1 -- 172.21.15.7:0/2434481778 learned_addr learned my addr 172.21.15.7:0/2434481778 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f8076ffd700 1 --2- 172.21.15.7:0/2434481778 >> v2:172.21.15.148:3300/0 conn(0x7f80780cd9e0 0x7f8078159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80777fe700 1 -- 172.21.15.7:0/2434481778 >> v2:172.21.15.148:3300/0 conn(0x7f80780cd9e0 msgr2=0x7f8078159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80777fe700 1 --2- 172.21.15.7:0/2434481778 >> v2:172.21.15.148:3300/0 conn(0x7f80780cd9e0 0x7f8078159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80777fe700 1 -- 172.21.15.7:0/2434481778 >> v1:172.21.15.7:6789/0 conn(0x7f807815a400 legacy=0x7f8078156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80777fe700 1 -- 172.21.15.7:0/2434481778 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780ccf00 con 0x7f80780cb5a0 2023-10-14T19:09:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80767fc700 1 -- 172.21.15.7:0/2434481778 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230031560 0 0) 0x7f807815ae40 con 0x7f807815a400 2023-10-14T19:09:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f8076ffd700 1 --2- 172.21.15.7:0/2434481778 >> v2:172.21.15.148:3300/0 conn(0x7f80780cd9e0 0x7f8078159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80777fe700 1 --2- 172.21.15.7:0/2434481778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780cb970 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098e0 tx=0x7f806c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ca23f9b4d7b894 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80767fc700 1 -- 172.21.15.7:0/2434481778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c009e80 con 0x7f80780cb5a0 2023-10-14T19:09:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80767fc700 1 -- 172.21.15.7:0/2434481778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c00b820 con 0x7f80780cb5a0 2023-10-14T19:09:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.790+0000 7f80767fc700 1 -- 172.21.15.7:0/2434481778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00bba0 con 0x7f80780cb5a0 2023-10-14T19:09:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 -- 172.21.15.7:0/2434481778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 msgr2=0x7f80780cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 --2- 172.21.15.7:0/2434481778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780cb970 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098e0 tx=0x7f806c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 -- 172.21.15.7:0/2434481778 shutdown_connections 2023-10-14T19:09:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 --2- 172.21.15.7:0/2434481778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780cb970 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 --2- 172.21.15.7:0/2434481778 >> v2:172.21.15.148:3300/0 conn(0x7f80780cd9e0 0x7f8078159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 -- 172.21.15.7:0/2434481778 >> 172.21.15.7:0/2434481778 conn(0x7f8078070e30 msgr2=0x7f80780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:24.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 -- 172.21.15.7:0/2434481778 shutdown_connections 2023-10-14T19:09:24.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.791+0000 7f807dd65700 1 -- 172.21.15.7:0/2434481778 wait complete. 2023-10-14T19:09:24.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.792+0000 7f807dd65700 1 Processor -- start 2023-10-14T19:09:24.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.792+0000 7f807dd65700 1 -- start start 2023-10-14T19:09:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f807dd65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f807dd65700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80780cd9e0 0x7f807815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f807dd65700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f807815a400 0x7f807815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f807dd65700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807815b3a0 con 0x7f80780cb5a0 2023-10-14T19:09:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f807dd65700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078155260 con 0x7f807815a400 2023-10-14T19:09:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f807dd65700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078155540 con 0x7f80780cd9e0 2023-10-14T19:09:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59128/0 (socket says 172.21.15.7:59128) 2023-10-14T19:09:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 -- 172.21.15.7:0/475036413 learned_addr learned my addr 172.21.15.7:0/475036413 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f8077fff700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f807815a400 0x7f807815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f8076ffd700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80780cd9e0 0x7f807815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 -- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80780cd9e0 msgr2=0x7f807815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80780cd9e0 0x7f807815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 -- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f807815a400 msgr2=0x7f807815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f807815a400 0x7f807815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f80777fe700 1 -- 172.21.15.7:0/475036413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009420 con 0x7f80780cb5a0 2023-10-14T19:09:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f8076ffd700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80780cd9e0 0x7f807815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.793+0000 7f8077fff700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f807815a400 0x7f807815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.794+0000 7f80777fe700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780b34b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f807806ea60 tx=0x7f806c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.794+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011420 con 0x7f80780cb5a0 2023-10-14T19:09:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.794+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c0115a0 con 0x7f80780cb5a0 2023-10-14T19:09:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.794+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8078155820 con 0x7f80780cb5a0 2023-10-14T19:09:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.794+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011960 con 0x7f80780cb5a0 2023-10-14T19:09:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.794+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80780b4e80 con 0x7f80780cb5a0 2023-10-14T19:09:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.795+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807804c3c0 con 0x7f80780cb5a0 2023-10-14T19:09:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.795+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f806c011cd0 con 0x7f80780cb5a0 2023-10-14T19:09:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.796+0000 7f805f7fe700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8064067320 0x7f80640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.796+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f806c086810 con 0x7f80780cb5a0 2023-10-14T19:09:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.796+0000 7f8076ffd700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8064067320 0x7f80640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.796+0000 7f8076ffd700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8064067320 0x7f80640697d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f807815e440 tx=0x7f8068006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:24.800+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f806c0534a0 con 0x7f80780cb5a0 2023-10-14T19:09:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.037+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80780cd1e0 con 0x7f80780cb5a0 2023-10-14T19:09:25.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.037+0000 7f805f7fe700 1 -- 172.21.15.7:0/475036413 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f806c056ac0 con 0x7f80780cb5a0 2023-10-14T19:09:25.038 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:25.039 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:10.821659+0000","modified":"2023-10-14T19:09:14.450944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"d","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2854367647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2854367647},{"type":"v1","addr":"172.21.15.148:6836","nonce":2854367647}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T19:09:25.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8064067320 msgr2=0x7f80640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8064067320 0x7f80640697d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f807815e440 tx=0x7f8068006f90 comp rx=0 tx=0).stop 2023-10-14T19:09:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 msgr2=0x7f80780b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780b34b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f807806ea60 tx=0x7f806c017000 comp rx=0 tx=0).stop 2023-10-14T19:09:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 shutdown_connections 2023-10-14T19:09:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8064067320 0x7f80640697d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f807815a400 0x7f807815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80780cb5a0 0x7f80780b34b0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 --2- 172.21.15.7:0/475036413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80780cd9e0 0x7f807815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 >> 172.21.15.7:0/475036413 conn(0x7f8078070e30 msgr2=0x7f80780b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 shutdown_connections 2023-10-14T19:09:25.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.039+0000 7f807dd65700 1 -- 172.21.15.7:0/475036413 wait complete. 2023-10-14T19:09:25.043 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 65 2023-10-14T19:09:25.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:25.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.171+0000 7fbe41922700 1 Processor -- start 2023-10-14T19:09:25.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.171+0000 7fbe41922700 1 -- start start 2023-10-14T19:09:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe41922700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c0cb1a0 0x7fbe3c164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe41922700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c15e010 con 0x7fbe3c0cf180 2023-10-14T19:09:25.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe41922700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c15d420 con 0x7fbe3c1594d0 2023-10-14T19:09:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe41922700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c15d6e0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe3a7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbe3c0cf180 0x7fbe3c0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38396/0 (socket says 172.21.15.7:38396) 2023-10-14T19:09:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe3a7fc700 1 -- 172.21.15.7:0/1062891825 learned_addr learned my addr 172.21.15.7:0/1062891825 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe3b7fe700 1 --2- 172.21.15.7:0/1062891825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c0cb1a0 0x7fbe3c164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255070166 0 0) 0x7fbe3c15e010 con 0x7fbe3c0cf180 2023-10-14T19:09:25.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.172+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe28003570 con 0x7fbe3c0cf180 2023-10-14T19:09:25.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062348452 0 0) 0x7fbe3c15d420 con 0x7fbe3c1594d0 2023-10-14T19:09:25.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe3c15e010 con 0x7fbe3c1594d0 2023-10-14T19:09:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835048404 0 0) 0x7fbe28003570 con 0x7fbe3c0cf180 2023-10-14T19:09:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe3b7fe700 1 -- 172.21.15.7:0/1062891825 >> v1:172.21.15.148:6789/0 conn(0x7fbe3c1594d0 legacy=0x7fbe3c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe3b7fe700 1 -- 172.21.15.7:0/1062891825 >> v1:172.21.15.7:6789/0 conn(0x7fbe3c0cf180 legacy=0x7fbe3c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe3b7fe700 1 -- 172.21.15.7:0/1062891825 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c15d9c0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe3b7fe700 1 --2- 172.21.15.7:0/1062891825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c0cb1a0 0x7fbe3c164640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009e90 tx=0x7fbe2c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16df15564467c79e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c00e070 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00b870 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.173+0000 7fbe39ffb700 1 -- 172.21.15.7:0/1062891825 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24001470 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 -- 172.21.15.7:0/1062891825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c0cb1a0 msgr2=0x7fbe3c164640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 --2- 172.21.15.7:0/1062891825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c0cb1a0 0x7fbe3c164640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009e90 tx=0x7fbe2c009780 comp rx=0 tx=0).stop 2023-10-14T19:09:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 -- 172.21.15.7:0/1062891825 shutdown_connections 2023-10-14T19:09:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 --2- 172.21.15.7:0/1062891825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c0cb1a0 0x7fbe3c164640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 -- 172.21.15.7:0/1062891825 >> 172.21.15.7:0/1062891825 conn(0x7fbe3c0703a0 msgr2=0x7fbe3c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 -- 172.21.15.7:0/1062891825 shutdown_connections 2023-10-14T19:09:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.174+0000 7fbe41922700 1 -- 172.21.15.7:0/1062891825 wait complete. 2023-10-14T19:09:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.175+0000 7fbe41922700 1 Processor -- start 2023-10-14T19:09:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.175+0000 7fbe41922700 1 -- start start 2023-10-14T19:09:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 0x7fbe3c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe3c0cf180 0x7fbe3c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c1594d0 0x7fbe3c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c151ae0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c169e00 con 0x7fbe3c0cf180 2023-10-14T19:09:25.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1511b0 con 0x7fbe3c1594d0 2023-10-14T19:09:25.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 0x7fbe3c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 0x7fbe3c159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59130/0 (socket says 172.21.15.7:59130) 2023-10-14T19:09:25.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 -- 172.21.15.7:0/700112147 learned_addr learned my addr 172.21.15.7:0/700112147 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:25.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3b7fe700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c1594d0 0x7fbe3c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3a7fc700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe3c0cf180 0x7fbe3c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 -- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c1594d0 msgr2=0x7fbe3c0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c1594d0 0x7fbe3c0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 -- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe3c0cf180 msgr2=0x7fbe3c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe3c0cf180 0x7fbe3c0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 -- 172.21.15.7:0/700112147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c009a20 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe3affd700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 0x7fbe3c159bb0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c580 tx=0x7fbe34007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34010510 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe34010670 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c151490 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34010a30 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.176+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c0b53c0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.177+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c04c3c0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.178+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbe3401b400 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.178+0000 7fbe32ffd700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe1c067320 0x7fbe1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.178+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe340849e0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.179+0000 7fbe3a7fc700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe1c067320 0x7fbe1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.179+0000 7fbe3a7fc700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe1c067320 0x7fbe1c0697d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0b63f0 tx=0x7fbe24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.183+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe34051670 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.382+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe3c15dca0 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.382+0000 7fbe32ffd700 1 -- 172.21.15.7:0/700112147 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fbe34054c90 con 0x7fbe3c0cb1a0 2023-10-14T19:09:25.384 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:25.384 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:12.441767+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:09.250495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:09.792938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe1c067320 msgr2=0x7fbe1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe1c067320 0x7fbe1c0697d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0b63f0 tx=0x7fbe24009040 comp rx=0 tx=0).stop 2023-10-14T19:09:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 msgr2=0x7fbe3c159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 0x7fbe3c159bb0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c580 tx=0x7fbe34007e10 comp rx=0 tx=0).stop 2023-10-14T19:09:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 shutdown_connections 2023-10-14T19:09:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe1c067320 0x7fbe1c0697d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe3c1594d0 0x7fbe3c0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe3c0cb1a0 0x7fbe3c159bb0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 --2- 172.21.15.7:0/700112147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe3c0cf180 0x7fbe3c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 >> 172.21.15.7:0/700112147 conn(0x7fbe3c0703a0 msgr2=0x7fbe3c1498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 shutdown_connections 2023-10-14T19:09:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.385+0000 7fbe41922700 1 -- 172.21.15.7:0/700112147 wait complete. 2023-10-14T19:09:25.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:09:25.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.517+0000 7f4947478700 1 Processor -- start 2023-10-14T19:09:25.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.518+0000 7f4947478700 1 -- start start 2023-10-14T19:09:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.518+0000 7f4947478700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49400cd260 0x7f49400c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.518+0000 7f4947478700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f49400b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4947478700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49400c3690 con 0x7f49400cce90 2023-10-14T19:09:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4947478700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400c3970 con 0x7f49400cd260 2023-10-14T19:09:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4947478700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49400c3c50 con 0x7f49400c4c70 2023-10-14T19:09:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4945214700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49400cce90 0x7f49400cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38400/0 (socket says 172.21.15.7:38400) 2023-10-14T19:09:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4945214700 1 -- 172.21.15.7:0/4159622758 learned_addr learned my addr 172.21.15.7:0/4159622758 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4944a13700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49400cd260 0x7f49400c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f493ffff700 1 -- 172.21.15.7:0/4159622758 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911817365 0 0) 0x7f49400c3690 con 0x7f49400cce90 2023-10-14T19:09:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4945a15700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f49400b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f493ffff700 1 -- 172.21.15.7:0/4159622758 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4928003570 con 0x7f49400cce90 2023-10-14T19:09:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4944a13700 1 -- 172.21.15.7:0/4159622758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 msgr2=0x7f49400b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4944a13700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f49400b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4944a13700 1 -- 172.21.15.7:0/4159622758 >> v1:172.21.15.7:6789/0 conn(0x7f49400cce90 legacy=0x7f49400cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4944a13700 1 -- 172.21.15.7:0/4159622758 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400c3f30 con 0x7f49400cd260 2023-10-14T19:09:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4945a15700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f49400b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f4944a13700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cd260 0x7f49400c4730 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6422847e9e83c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f493ffff700 1 -- 172.21.15.7:0/4159622758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400b640 con 0x7f49400cd260 2023-10-14T19:09:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f493ffff700 1 -- 172.21.15.7:0/4159622758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b7a0 con 0x7f49400cd260 2023-10-14T19:09:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.519+0000 7f493ffff700 1 -- 172.21.15.7:0/4159622758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bb20 con 0x7f49400cd260 2023-10-14T19:09:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 -- 172.21.15.7:0/4159622758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cd260 msgr2=0x7f49400c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cd260 0x7f49400c4730 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 -- 172.21.15.7:0/4159622758 shutdown_connections 2023-10-14T19:09:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f49400b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 --2- 172.21.15.7:0/4159622758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cd260 0x7f49400c4730 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 -- 172.21.15.7:0/4159622758 >> 172.21.15.7:0/4159622758 conn(0x7f494006ce80 msgr2=0x7f49400ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 -- 172.21.15.7:0/4159622758 shutdown_connections 2023-10-14T19:09:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.520+0000 7f4947478700 1 -- 172.21.15.7:0/4159622758 wait complete. 2023-10-14T19:09:25.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.521+0000 7f4947478700 1 Processor -- start 2023-10-14T19:09:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.521+0000 7f4947478700 1 -- start start 2023-10-14T19:09:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4947478700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f494015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4947478700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 0x7f49401591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4947478700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49400cd260 0x7f4940068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4947478700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494015d230 con 0x7f49400cce90 2023-10-14T19:09:25.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4947478700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494015b780 con 0x7f49400cd260 2023-10-14T19:09:25.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4947478700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494015c250 con 0x7f49400c4c70 2023-10-14T19:09:25.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 0x7f49401591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 0x7f49401591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59140/0 (socket says 172.21.15.7:59140) 2023-10-14T19:09:25.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 -- 172.21.15.7:0/383750113 learned_addr learned my addr 172.21.15.7:0/383750113 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:25.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4945214700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f494015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 -- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 msgr2=0x7f494015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f494015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 -- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49400cd260 msgr2=0x7f4940068bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4945a15700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49400cd260 0x7f4940068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49400cd260 0x7f4940068bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.522+0000 7f4944a13700 1 -- 172.21.15.7:0/383750113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009420 con 0x7f49400cce90 2023-10-14T19:09:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.523+0000 7f4944a13700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 0x7f49401591d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f494006af10 tx=0x7f4934017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.523+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400b910 con 0x7f49400cce90 2023-10-14T19:09:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.523+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400bab0 con 0x7f49400cce90 2023-10-14T19:09:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.523+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934025670 con 0x7f49400cce90 2023-10-14T19:09:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.523+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940098300 con 0x7f49400cce90 2023-10-14T19:09:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.523+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494015bc90 con 0x7f49400cce90 2023-10-14T19:09:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.524+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494004c3c0 con 0x7f49400cce90 2023-10-14T19:09:25.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.524+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4934023070 con 0x7f49400cce90 2023-10-14T19:09:25.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.525+0000 7f493d7fa700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f492c067320 0x7f492c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.525+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49340860b0 con 0x7f49400cce90 2023-10-14T19:09:25.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.525+0000 7f4945214700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f492c067320 0x7f492c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.525+0000 7f4945214700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f492c067320 0x7f492c0697d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4938001460 tx=0x7f4938009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.529+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4934052df0 con 0x7f49400cce90 2023-10-14T19:09:25.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.766+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4940069cc0 con 0x7f49400cce90 2023-10-14T19:09:25.767 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:09:25.766+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:09:25.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.769+0000 7f493d7fa700 1 -- 172.21.15.7:0/383750113 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4934056410 con 0x7f49400cce90 2023-10-14T19:09:25.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f492c067320 msgr2=0x7f492c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f492c067320 0x7f492c0697d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4938001460 tx=0x7f4938009040 comp rx=0 tx=0).stop 2023-10-14T19:09:25.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 msgr2=0x7f49401591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 0x7f49401591d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f494006af10 tx=0x7f4934017000 comp rx=0 tx=0).stop 2023-10-14T19:09:25.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 shutdown_connections 2023-10-14T19:09:25.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f492c067320 0x7f492c0697d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49400cd260 0x7f4940068bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49400c4c70 0x7f494015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 --2- 172.21.15.7:0/383750113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49400cce90 0x7f49401591d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 >> 172.21.15.7:0/383750113 conn(0x7f494006ce80 msgr2=0x7f49400c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:25.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 shutdown_connections 2023-10-14T19:09:25.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.772+0000 7f4947478700 1 -- 172.21.15.7:0/383750113 wait complete. 2023-10-14T19:09:25.776 INFO:tasks.ceph.mds.d.smithi148.stderr: -808> 2023-10-14T19:09:16.744+0000 7f88693c3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:09:25.777 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:09:25.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:09:25.795 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:09:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.907+0000 7f261dca2700 1 Processor -- start 2023-10-14T19:09:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.907+0000 7f261dca2700 1 -- start start 2023-10-14T19:09:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f261dca2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2618159530 0x7f26180ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f261dca2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 0x7f2618159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f261dca2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26180ccfd0 con 0x7f261806e0e0 2023-10-14T19:09:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f261dca2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26180cf0e0 con 0x7f2618159530 2023-10-14T19:09:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f261dca2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261815a3d0 con 0x7f261806dc70 2023-10-14T19:09:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f2617fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f261806e0e0 0x7f26180cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38414/0 (socket says 172.21.15.7:38414) 2023-10-14T19:09:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f2617fff700 1 -- 172.21.15.7:0/1237308685 learned_addr learned my addr 172.21.15.7:0/1237308685 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:25.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821797015 0 0) 0x7f26180ccfd0 con 0x7f261806e0e0 2023-10-14T19:09:25.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2600003570 con 0x7f261806e0e0 2023-10-14T19:09:25.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f2616ffd700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 0x7f2618159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26177fe700 1 --2- 172.21.15.7:0/1237308685 >> v2:172.21.15.148:3300/0 conn(0x7f2618159530 0x7f26180ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2291067412 0 0) 0x7f2600003570 con 0x7f261806e0e0 2023-10-14T19:09:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 msgr2=0x7f2618159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 0x7f2618159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 >> v2:172.21.15.148:3300/0 conn(0x7f2618159530 msgr2=0x7f26180ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 --2- 172.21.15.7:0/1237308685 >> v2:172.21.15.148:3300/0 conn(0x7f2618159530 0x7f26180ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261815a6b0 con 0x7f261806e0e0 2023-10-14T19:09:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f26100017f0 con 0x7f261806e0e0 2023-10-14T19:09:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 >> v1:172.21.15.7:6789/0 conn(0x7f261806e0e0 legacy=0x7f26180cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 0x7f2600003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.908+0000 7f26167fc700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2600003fe0 0x7f2600004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2600004d50 0x7f26000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180cf0e0 con 0x7f2600004d50 2023-10-14T19:09:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261815a3d0 con 0x7f2600003fe0 2023-10-14T19:09:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260000ba90 con 0x7f261806dc70 2023-10-14T19:09:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2600004d50 0x7f26000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2616ffd700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2600003fe0 0x7f2600004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26177fe700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 0x7f2600003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 -- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 msgr2=0x7f2600003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f261806dc70 0x7f2600003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 -- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2600003fe0 msgr2=0x7f2600004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2600003fe0 0x7f2600004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 -- 172.21.15.7:0/1237308685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600003570 con 0x7f2600004d50 2023-10-14T19:09:25.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f2617fff700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2600004d50 0x7f26000051c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f261000a940 tx=0x7f2610002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b93e8ddc8eb5886 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610012440 con 0x7f2600004d50 2023-10-14T19:09:25.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100125a0 con 0x7f2600004d50 2023-10-14T19:09:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.909+0000 7f26167fc700 1 -- 172.21.15.7:0/1237308685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610012960 con 0x7f2600004d50 2023-10-14T19:09:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f261dca2700 1 -- 172.21.15.7:0/1237308685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2600004d50 msgr2=0x7f26000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f261dca2700 1 --2- 172.21.15.7:0/1237308685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2600004d50 0x7f26000051c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f261000a940 tx=0x7f2610002210 comp rx=0 tx=0).stop 2023-10-14T19:09:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f2617fff700 1 -- 172.21.15.7:0/1237308685 reap_dead start 2023-10-14T19:09:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f261dca2700 1 -- 172.21.15.7:0/1237308685 shutdown_connections 2023-10-14T19:09:25.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f261dca2700 1 -- 172.21.15.7:0/1237308685 >> 172.21.15.7:0/1237308685 conn(0x7f26180703a0 msgr2=0x7f26180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:25.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f261dca2700 1 -- 172.21.15.7:0/1237308685 shutdown_connections 2023-10-14T19:09:25.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.910+0000 7f261dca2700 1 -- 172.21.15.7:0/1237308685 wait complete. 2023-10-14T19:09:25.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.911+0000 7f261dca2700 1 Processor -- start 2023-10-14T19:09:25.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.911+0000 7f261dca2700 1 -- start start 2023-10-14T19:09:25.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f261dca2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26180b4f30 0x7f26180b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f261dca2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26180c8ed0 0x7f26180ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f261dca2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 0x7f2618169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f261dca2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c8a40 con 0x7f2618169b40 2023-10-14T19:09:25.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f261dca2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c9d00 con 0x7f26180b4f30 2023-10-14T19:09:25.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f261dca2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c8140 con 0x7f26180c8ed0 2023-10-14T19:09:25.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 0x7f2618169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 0x7f2618169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59158/0 (socket says 172.21.15.7:59158) 2023-10-14T19:09:25.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 -- 172.21.15.7:0/2255944335 learned_addr learned my addr 172.21.15.7:0/2255944335 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:25.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2616ffd700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26180c8ed0 0x7f26180ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f26177fe700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26180b4f30 0x7f26180b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 -- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26180c8ed0 msgr2=0x7f26180ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26180c8ed0 0x7f26180ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 -- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26180b4f30 msgr2=0x7f26180b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:25.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26180b4f30 0x7f26180b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:25.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2617fff700 1 -- 172.21.15.7:0/2255944335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26180b5840 con 0x7f2618169b40 2023-10-14T19:09:25.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f2616ffd700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26180c8ed0 0x7f26180ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:25.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.912+0000 7f26177fe700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26180b4f30 0x7f26180b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:25.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.913+0000 7f2617fff700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 0x7f2618169fc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2610012ad0 tx=0x7f2610015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.913+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100017b0 con 0x7f2618169b40 2023-10-14T19:09:25.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.913+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100072e0 con 0x7f2618169b40 2023-10-14T19:09:25.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.913+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26180b4870 con 0x7f2618169b40 2023-10-14T19:09:25.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.913+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100076a0 con 0x7f2618169b40 2023-10-14T19:09:25.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.913+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26180c86d0 con 0x7f2618169b40 2023-10-14T19:09:25.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.914+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26180c8bf0 con 0x7f2618169b40 2023-10-14T19:09:25.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.914+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2610019030 con 0x7f2618169b40 2023-10-14T19:09:25.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.914+0000 7f25ff7fe700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2604067320 0x7f26040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:25.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.915+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2610086c30 con 0x7f2618169b40 2023-10-14T19:09:25.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.915+0000 7f26177fe700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2604067320 0x7f26040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:25.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.915+0000 7f26177fe700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2604067320 0x7f26040697d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2608006f00 tx=0x7f2608008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:25.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:25.919+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26180c8bf0 con 0x7f2618169b40 2023-10-14T19:09:26.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.156+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f261804c3c0 con 0x7f2618169b40 2023-10-14T19:09:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.771+0000 7f25ff7fe700 1 -- 172.21.15.7:0/2255944335 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2610053870 con 0x7f2618169b40 2023-10-14T19:09:26.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2604067320 msgr2=0x7f26040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:26.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2604067320 0x7f26040697d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2608006f00 tx=0x7f2608008040 comp rx=0 tx=0).stop 2023-10-14T19:09:26.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 msgr2=0x7f2618169fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 0x7f2618169fc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2610012ad0 tx=0x7f2610015000 comp rx=0 tx=0).stop 2023-10-14T19:09:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 shutdown_connections 2023-10-14T19:09:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2604067320 0x7f26040697d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26180b4f30 0x7f26180b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2618169b40 0x7f2618169fc0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 --2- 172.21.15.7:0/2255944335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26180c8ed0 0x7f26180ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 >> 172.21.15.7:0/2255944335 conn(0x7f26180703a0 msgr2=0x7f261815acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:26.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 shutdown_connections 2023-10-14T19:09:26.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.774+0000 7f261dca2700 1 -- 172.21.15.7:0/2255944335 wait complete. 2023-10-14T19:09:26.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:09:26.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.919+0000 7f377ad82700 1 Processor -- start 2023-10-14T19:09:26.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.919+0000 7f377ad82700 1 -- start start 2023-10-14T19:09:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377ad82700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3774159530 0x7f37740ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377ad82700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f377406dcf0 0x7f3774159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377ad82700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740ccfd0 con 0x7f3774159e40 2023-10-14T19:09:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377ad82700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377415a410 con 0x7f377406dcf0 2023-10-14T19:09:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377ad82700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377415a6f0 con 0x7f3774159530 2023-10-14T19:09:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3773fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f377406dcf0 0x7f3774159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377931f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3774159e40 0x7f37740cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45274/0 (socket says 172.21.15.7:45274) 2023-10-14T19:09:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f377931f700 1 -- 172.21.15.7:0/3283196175 learned_addr learned my addr 172.21.15.7:0/3283196175 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3778b1e700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3774159530 0x7f37740ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3773fff700 1 -- 172.21.15.7:0/3283196175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3774159530 msgr2=0x7f37740ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3773fff700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3774159530 0x7f37740ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3773fff700 1 -- 172.21.15.7:0/3283196175 >> v1:172.21.15.7:6789/0 conn(0x7f3774159e40 legacy=0x7f37740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:26.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f37737fe700 1 -- 172.21.15.7:0/3283196175 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031475896 0 0) 0x7f37740ccfd0 con 0x7f3774159e40 2023-10-14T19:09:26.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3773fff700 1 -- 172.21.15.7:0/3283196175 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377415a9d0 con 0x7f377406dcf0 2023-10-14T19:09:26.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3778b1e700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3774159530 0x7f37740ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:26.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f3773fff700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377406dcf0 0x7f3774159900 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f37600098e0 tx=0x7f37600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ffeb132f465007 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:26.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.920+0000 7f37737fe700 1 -- 172.21.15.7:0/3283196175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760009e80 con 0x7f377406dcf0 2023-10-14T19:09:26.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f37737fe700 1 -- 172.21.15.7:0/3283196175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000b860 con 0x7f377406dcf0 2023-10-14T19:09:26.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f37737fe700 1 -- 172.21.15.7:0/3283196175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000bbe0 con 0x7f377406dcf0 2023-10-14T19:09:26.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 -- 172.21.15.7:0/3283196175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377406dcf0 msgr2=0x7f3774159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:26.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377406dcf0 0x7f3774159900 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f37600098e0 tx=0x7f37600091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 -- 172.21.15.7:0/3283196175 shutdown_connections 2023-10-14T19:09:26.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3774159530 0x7f37740ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 --2- 172.21.15.7:0/3283196175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377406dcf0 0x7f3774159900 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 -- 172.21.15.7:0/3283196175 >> 172.21.15.7:0/3283196175 conn(0x7f37740703a0 msgr2=0x7f37740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:26.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 -- 172.21.15.7:0/3283196175 shutdown_connections 2023-10-14T19:09:26.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.921+0000 7f377ad82700 1 -- 172.21.15.7:0/3283196175 wait complete. 2023-10-14T19:09:26.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.922+0000 7f377ad82700 1 Processor -- start 2023-10-14T19:09:26.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.922+0000 7f377ad82700 1 -- start start 2023-10-14T19:09:26.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377ad82700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f377406dcf0 0x7f37740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:26.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377ad82700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3774159530 0x7f377416ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:26.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377ad82700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 0x7f37740af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:26.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377ad82700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740b4830 con 0x7f3774159e40 2023-10-14T19:09:26.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377ad82700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740b39c0 con 0x7f3774159530 2023-10-14T19:09:26.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377ad82700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377416b380 con 0x7f377406dcf0 2023-10-14T19:09:26.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377931f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 0x7f37740af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:26.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377931f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 0x7f37740af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52400/0 (socket says 172.21.15.7:52400) 2023-10-14T19:09:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f377931f700 1 -- 172.21.15.7:0/2901547720 learned_addr learned my addr 172.21.15.7:0/2901547720 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f3778b1e700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f377406dcf0 0x7f37740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.923+0000 7f3773fff700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3774159530 0x7f377416ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377931f700 1 -- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f377406dcf0 msgr2=0x7f37740b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377931f700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f377406dcf0 0x7f37740b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377931f700 1 -- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3774159530 msgr2=0x7f377416ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377931f700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3774159530 0x7f377416ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377931f700 1 -- 172.21.15.7:0/2901547720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760009420 con 0x7f3774159e40 2023-10-14T19:09:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f3773fff700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3774159530 0x7f377416ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377931f700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 0x7f37740af8d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f376c00cbf0 tx=0x7f376c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c00a910 con 0x7f3774159e40 2023-10-14T19:09:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c00aa70 con 0x7f3774159e40 2023-10-14T19:09:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37740b3c20 con 0x7f3774159e40 2023-10-14T19:09:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c00ae30 con 0x7f3774159e40 2023-10-14T19:09:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.924+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37740b41e0 con 0x7f3774159e40 2023-10-14T19:09:26.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.925+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740cb120 con 0x7f3774159e40 2023-10-14T19:09:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.925+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f376c007300 con 0x7f3774159e40 2023-10-14T19:09:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.926+0000 7f3770ff9700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3758067320 0x7f37580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.926+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f376c085050 con 0x7f3774159e40 2023-10-14T19:09:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.926+0000 7f3778b1e700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3758067320 0x7f37580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:26.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.927+0000 7f3778b1e700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3758067320 0x7f37580697d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f37740b5610 tx=0x7f3768008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:26.930+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f376c051d10 con 0x7f3774159e40 2023-10-14T19:09:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.123+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f377415acb0 con 0x7f3774159e40 2023-10-14T19:09:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.856+0000 7f3770ff9700 1 -- 172.21.15.7:0/2901547720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 181+0+0 (secure 0 0 0) 0x7f376c055330 con 0x7f3774159e40 2023-10-14T19:09:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3758067320 msgr2=0x7f37580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3758067320 0x7f37580697d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f37740b5610 tx=0x7f3768008040 comp rx=0 tx=0).stop 2023-10-14T19:09:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 msgr2=0x7f37740af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 0x7f37740af8d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f376c00cbf0 tx=0x7f376c0019b0 comp rx=0 tx=0).stop 2023-10-14T19:09:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 shutdown_connections 2023-10-14T19:09:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3758067320 0x7f37580697d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3774159e40 0x7f37740af8d0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:27.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f377406dcf0 0x7f37740b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:27.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 --2- 172.21.15.7:0/2901547720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3774159530 0x7f377416ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:27.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 >> 172.21.15.7:0/2901547720 conn(0x7f37740703a0 msgr2=0x7f3774158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:27.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 shutdown_connections 2023-10-14T19:09:27.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:27.859+0000 7f377ad82700 1 -- 172.21.15.7:0/2901547720 wait complete. 2023-10-14T19:09:27.863 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:09:27.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:09:28.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.005+0000 7f0c81228700 1 Processor -- start 2023-10-14T19:09:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.005+0000 7f0c81228700 1 -- start start 2023-10-14T19:09:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c81228700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0c7c06c6a0 0x7f0c7c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c81228700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c0af670 con 0x7f0c7c0aa740 2023-10-14T19:09:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c81228700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c0aa2b0 con 0x7f0c7c159940 2023-10-14T19:09:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c81228700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c06d080 con 0x7f0c7c06c6a0 2023-10-14T19:09:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c7a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0c7c06c6a0 0x7f0c7c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:28.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c7b59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0c7c0aa740 0x7f0c7c0aab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45276/0 (socket says 172.21.15.7:45276) 2023-10-14T19:09:28.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.006+0000 7f0c7b59e700 1 -- 172.21.15.7:0/133587549 learned_addr learned my addr 172.21.15.7:0/133587549 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:28.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c7a59c700 1 -- 172.21.15.7:0/133587549 >> v1:172.21.15.148:6789/0 conn(0x7f0c7c159940 legacy=0x7f0c7c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:28.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c7a59c700 1 -- 172.21.15.7:0/133587549 >> v1:172.21.15.7:6789/0 conn(0x7f0c7c0aa740 legacy=0x7f0c7c0aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c7a59c700 1 -- 172.21.15.7:0/133587549 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0b12a0 con 0x7f0c7c06c6a0 2023-10-14T19:09:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c79d9b700 1 -- 172.21.15.7:0/133587549 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980230529 0 0) 0x7f0c74001110 con 0x7f0c7c0aa740 2023-10-14T19:09:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c7a59c700 1 --2- 172.21.15.7:0/133587549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c06c6a0 0x7f0c7c06cb40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0c640098e0 tx=0x7f0c640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94193f4dbae9329 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c79d9b700 1 -- 172.21.15.7:0/133587549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64009e80 con 0x7f0c7c06c6a0 2023-10-14T19:09:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c79d9b700 1 -- 172.21.15.7:0/133587549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400b820 con 0x7f0c7c06c6a0 2023-10-14T19:09:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c79d9b700 1 -- 172.21.15.7:0/133587549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400bba0 con 0x7f0c7c06c6a0 2023-10-14T19:09:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 -- 172.21.15.7:0/133587549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c06c6a0 msgr2=0x7f0c7c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 --2- 172.21.15.7:0/133587549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c06c6a0 0x7f0c7c06cb40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0c640098e0 tx=0x7f0c640091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 -- 172.21.15.7:0/133587549 shutdown_connections 2023-10-14T19:09:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 --2- 172.21.15.7:0/133587549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c06c6a0 0x7f0c7c06cb40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 -- 172.21.15.7:0/133587549 >> 172.21.15.7:0/133587549 conn(0x7f0c7c0cd3e0 msgr2=0x7f0c7c0cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 -- 172.21.15.7:0/133587549 shutdown_connections 2023-10-14T19:09:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.007+0000 7f0c81228700 1 -- 172.21.15.7:0/133587549 wait complete. 2023-10-14T19:09:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 Processor -- start 2023-10-14T19:09:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 -- start start 2023-10-14T19:09:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c7c06c6a0 0x7f0c7c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 0x7f0c7c1486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c7c159940 0x7f0c7c0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c147600 con 0x7f0c7c0aa740 2023-10-14T19:09:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c1478e0 con 0x7f0c7c159940 2023-10-14T19:09:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.009+0000 7f0c81228700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c147bc0 con 0x7f0c7c06c6a0 2023-10-14T19:09:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 0x7f0c7c1486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 0x7f0c7c1486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52414/0 (socket says 172.21.15.7:52414) 2023-10-14T19:09:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 -- 172.21.15.7:0/3729263900 learned_addr learned my addr 172.21.15.7:0/3729263900 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7b59e700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c7c159940 0x7f0c7c0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7ad9d700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c7c06c6a0 0x7f0c7c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 -- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c7c06c6a0 msgr2=0x7f0c7c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c7c06c6a0 0x7f0c7c0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 -- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c7c159940 msgr2=0x7f0c7c0aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c7c159940 0x7f0c7c0aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 -- 172.21.15.7:0/3729263900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64009420 con 0x7f0c7c0aa740 2023-10-14T19:09:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7b59e700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c7c159940 0x7f0c7c0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c7a59c700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 0x7f0c7c1486a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0c640097b0 tx=0x7f0c64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400bae0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c64020070 con 0x7f0c7c0aa740 2023-10-14T19:09:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c147ea0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6401b6a0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.010+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c0ccb30 con 0x7f0c7c0aa740 2023-10-14T19:09:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.011+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c1483c0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.012+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0c64022030 con 0x7f0c7c0aa740 2023-10-14T19:09:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.012+0000 7f0c72ffd700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c5c067320 0x7f0c5c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.012+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f0c640869a0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.012+0000 7f0c7ad9d700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c5c067320 0x7f0c5c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.013+0000 7f0c7ad9d700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c5c067320 0x7f0c5c0697d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009fd0 tx=0x7f0c6c009600 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.016+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c7c1483c0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.207+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c7c1483c0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.862+0000 7f0c72ffd700 1 -- 172.21.15.7:0/3729263900 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c7c1483c0 con 0x7f0c7c0aa740 2023-10-14T19:09:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c5c067320 msgr2=0x7f0c5c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c5c067320 0x7f0c5c0697d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009fd0 tx=0x7f0c6c009600 comp rx=0 tx=0).stop 2023-10-14T19:09:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 msgr2=0x7f0c7c1486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 0x7f0c7c1486a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0c640097b0 tx=0x7f0c64016000 comp rx=0 tx=0).stop 2023-10-14T19:09:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 shutdown_connections 2023-10-14T19:09:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c5c067320 0x7f0c5c0697d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c7c159940 0x7f0c7c0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c7c06c6a0 0x7f0c7c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 --2- 172.21.15.7:0/3729263900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c7c0aa740 0x7f0c7c1486a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:28.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.870+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 >> 172.21.15.7:0/3729263900 conn(0x7f0c7c0cd3e0 msgr2=0x7f0c7c158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:28.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.871+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 shutdown_connections 2023-10-14T19:09:28.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:28.871+0000 7f0c81228700 1 -- 172.21.15.7:0/3729263900 wait complete. 2023-10-14T19:09:28.874 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:09:28.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:09:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.012+0000 7f495ad63700 1 Processor -- start 2023-10-14T19:09:29.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.012+0000 7f495ad63700 1 -- start start 2023-10-14T19:09:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f495ad63700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49540cc320 0x7f495413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f495ad63700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49540cc6f0 0x7f495413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f495ad63700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495406d7b0 con 0x7f4954069a00 2023-10-14T19:09:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f495ad63700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495406a590 con 0x7f49540cc320 2023-10-14T19:09:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f495ad63700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495406f7d0 con 0x7f49540cc6f0 2023-10-14T19:09:29.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49540cc320 0x7f495413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49540cc320 0x7f495413c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52426/0 (socket says 172.21.15.7:52426) 2023-10-14T19:09:29.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 -- 172.21.15.7:0/4106699368 learned_addr learned my addr 172.21.15.7:0/4106699368 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:29.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 -- 172.21.15.7:0/4106699368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49540cc6f0 msgr2=0x7f495413c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:29.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4953fff700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49540cc6f0 0x7f495413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49540cc6f0 0x7f495413c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 -- 172.21.15.7:0/4106699368 >> v1:172.21.15.148:6789/0 conn(0x7f4954069a00 legacy=0x7f4954069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 -- 172.21.15.7:0/4106699368 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495406e330 con 0x7f49540cc320 2023-10-14T19:09:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4953fff700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49540cc6f0 0x7f495413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f4958aff700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f495413c2a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f494c009f20 tx=0x7f494c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68317fc572ef37c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f49537fe700 1 -- 172.21.15.7:0/4106699368 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00e070 con 0x7f49540cc320 2023-10-14T19:09:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f49537fe700 1 -- 172.21.15.7:0/4106699368 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c00ba40 con 0x7f49540cc320 2023-10-14T19:09:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.013+0000 7f49537fe700 1 -- 172.21.15.7:0/4106699368 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c0092e0 con 0x7f49540cc320 2023-10-14T19:09:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 -- 172.21.15.7:0/4106699368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 msgr2=0x7f495413c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f495413c2a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f494c009f20 tx=0x7f494c009840 comp rx=0 tx=0).stop 2023-10-14T19:09:29.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 -- 172.21.15.7:0/4106699368 shutdown_connections 2023-10-14T19:09:29.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f495413c2a0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 --2- 172.21.15.7:0/4106699368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49540cc6f0 0x7f495413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 -- 172.21.15.7:0/4106699368 >> 172.21.15.7:0/4106699368 conn(0x7f4954067f00 msgr2=0x7f4954068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:29.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 -- 172.21.15.7:0/4106699368 shutdown_connections 2023-10-14T19:09:29.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.014+0000 7f495ad63700 1 -- 172.21.15.7:0/4106699368 wait complete. 2023-10-14T19:09:29.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.015+0000 7f495ad63700 1 Processor -- start 2023-10-14T19:09:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.015+0000 7f495ad63700 1 -- start start 2023-10-14T19:09:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f495ad63700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4954069a00 0x7f495416c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f495ad63700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f49540ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f495ad63700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49540cc6f0 0x7f49540ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f495ad63700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49540c7150 con 0x7f49540cc320 2023-10-14T19:09:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f495ad63700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49540c6580 con 0x7f49540cc6f0 2023-10-14T19:09:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f495ad63700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495416ccd0 con 0x7f4954069a00 2023-10-14T19:09:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f49540ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f49540ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52430/0 (socket says 172.21.15.7:52430) 2023-10-14T19:09:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 -- 172.21.15.7:0/3819201853 learned_addr learned my addr 172.21.15.7:0/3819201853 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4958aff700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4954069a00 0x7f495416c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 -- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4954069a00 msgr2=0x7f495416c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4959300700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49540cc6f0 0x7f49540ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4954069a00 0x7f495416c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 -- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49540cc6f0 msgr2=0x7f49540ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49540cc6f0 0x7f49540ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.016+0000 7f4953fff700 1 -- 172.21.15.7:0/3819201853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c009ae0 con 0x7f49540cc320 2023-10-14T19:09:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.017+0000 7f4953fff700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f49540ae7a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f494400c850 tx=0x7f4944008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.017+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944011600 con 0x7f49540cc320 2023-10-14T19:09:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.017+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4944011760 con 0x7f49540cc320 2023-10-14T19:09:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.017+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49540c6820 con 0x7f49540cc320 2023-10-14T19:09:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.017+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944011b00 con 0x7f49540cc320 2023-10-14T19:09:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.017+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49540c6de0 con 0x7f49540cc320 2023-10-14T19:09:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.018+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495404c3c0 con 0x7f49540cc320 2023-10-14T19:09:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.018+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f49440073b0 con 0x7f49540cc320 2023-10-14T19:09:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.019+0000 7f4950ff9700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4934067320 0x7f49340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.019+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4944084a00 con 0x7f49540cc320 2023-10-14T19:09:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.019+0000 7f4958aff700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4934067320 0x7f49340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.019+0000 7f4958aff700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4934067320 0x7f49340697d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f49540c8410 tx=0x7f494c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.023+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4944051880 con 0x7f49540cc320 2023-10-14T19:09:29.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.223+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f49540c7290 con 0x7f49540cc320 2023-10-14T19:09:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.226+0000 7f4950ff9700 1 -- 172.21.15.7:0/3819201853 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4944054ea0 con 0x7f49540cc320 2023-10-14T19:09:29.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4934067320 msgr2=0x7f49340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4934067320 0x7f49340697d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f49540c8410 tx=0x7f494c017000 comp rx=0 tx=0).stop 2023-10-14T19:09:29.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 msgr2=0x7f49540ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f49540ae7a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f494400c850 tx=0x7f4944008040 comp rx=0 tx=0).stop 2023-10-14T19:09:29.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 shutdown_connections 2023-10-14T19:09:29.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4934067320 0x7f49340697d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49540cc6f0 0x7f49540ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4954069a00 0x7f495416c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 --2- 172.21.15.7:0/3819201853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49540cc320 0x7f49540ae7a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 >> 172.21.15.7:0/3819201853 conn(0x7f4954067f00 msgr2=0x7f4954153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:29.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 shutdown_connections 2023-10-14T19:09:29.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.228+0000 7f495ad63700 1 -- 172.21.15.7:0/3819201853 wait complete. 2023-10-14T19:09:29.241 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-14T19:09:29.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.360+0000 7fd1aeb68700 1 Processor -- start 2023-10-14T19:09:29.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.360+0000 7fd1aeb68700 1 -- start start 2023-10-14T19:09:29.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1aeb68700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a8159850 0x7fd1a80adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1aeb68700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1a8159c20 0x7fd1a80ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1aeb68700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1a80b0930 0x7fd1a80b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1aeb68700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a80ccdc0 con 0x7fd1a8159c20 2023-10-14T19:09:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1aeb68700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a80b12f0 con 0x7fd1a80b0930 2023-10-14T19:09:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1aeb68700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80adb20 con 0x7fd1a8159850 2023-10-14T19:09:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1a8159c20 0x7fd1a80ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1a8159c20 0x7fd1a80ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52434/0 (socket says 172.21.15.7:52434) 2023-10-14T19:09:29.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 -- 172.21.15.7:0/331396151 learned_addr learned my addr 172.21.15.7:0/331396151 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:29.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1ad105700 1 --2- 172.21.15.7:0/331396151 >> v2:172.21.15.148:3300/0 conn(0x7fd1a80b0930 0x7fd1a80b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1ac904700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a8159850 0x7fd1a80adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 -- 172.21.15.7:0/331396151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a8159850 msgr2=0x7fd1a80adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:29.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a8159850 0x7fd1a80adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 -- 172.21.15.7:0/331396151 >> v2:172.21.15.148:3300/0 conn(0x7fd1a80b0930 msgr2=0x7fd1a80b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:29.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 --2- 172.21.15.7:0/331396151 >> v2:172.21.15.148:3300/0 conn(0x7fd1a80b0930 0x7fd1a80b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 -- 172.21.15.7:0/331396151 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80acf10 con 0x7fd1a8159c20 2023-10-14T19:09:29.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1ad105700 1 --2- 172.21.15.7:0/331396151 >> v2:172.21.15.148:3300/0 conn(0x7fd1a80b0930 0x7fd1a80b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:29.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1ac904700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a8159850 0x7fd1a80adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:29.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.361+0000 7fd1a7fff700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159c20 0x7fd1a80ae4f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80cd360 tx=0x7fd194009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993fe5237ebbcf80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:29.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1a77fe700 1 -- 172.21.15.7:0/331396151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400b820 con 0x7fd1a8159c20 2023-10-14T19:09:29.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1a77fe700 1 -- 172.21.15.7:0/331396151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400b980 con 0x7fd1a8159c20 2023-10-14T19:09:29.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1a77fe700 1 -- 172.21.15.7:0/331396151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400bd20 con 0x7fd1a8159c20 2023-10-14T19:09:29.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 -- 172.21.15.7:0/331396151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159c20 msgr2=0x7fd1a80ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159c20 0x7fd1a80ae4f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80cd360 tx=0x7fd194009250 comp rx=0 tx=0).stop 2023-10-14T19:09:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 -- 172.21.15.7:0/331396151 shutdown_connections 2023-10-14T19:09:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/331396151 >> v2:172.21.15.148:3300/0 conn(0x7fd1a80b0930 0x7fd1a80b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a8159850 0x7fd1a80adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/331396151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159c20 0x7fd1a80ae4f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 -- 172.21.15.7:0/331396151 >> 172.21.15.7:0/331396151 conn(0x7fd1a806d170 msgr2=0x7fd1a80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 -- 172.21.15.7:0/331396151 shutdown_connections 2023-10-14T19:09:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.362+0000 7fd1aeb68700 1 -- 172.21.15.7:0/331396151 wait complete. 2023-10-14T19:09:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.363+0000 7fd1aeb68700 1 Processor -- start 2023-10-14T19:09:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.363+0000 7fd1aeb68700 1 -- start start 2023-10-14T19:09:29.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1aeb68700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a80b0930 0x7fd1a81508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1aeb68700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 0x7fd1a8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1aeb68700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1a8159c20 0x7fd1a815f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1aeb68700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a814ccb0 con 0x7fd1a8159850 2023-10-14T19:09:29.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1aeb68700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a814f200 con 0x7fd1a8159c20 2023-10-14T19:09:29.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1aeb68700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a814f4e0 con 0x7fd1a80b0930 2023-10-14T19:09:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 0x7fd1a8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 0x7fd1a8159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52446/0 (socket says 172.21.15.7:52446) 2023-10-14T19:09:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1a7fff700 1 -- 172.21.15.7:0/415451966 learned_addr learned my addr 172.21.15.7:0/415451966 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1ac904700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a80b0930 0x7fd1a81508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1ad105700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1a8159c20 0x7fd1a815f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.364+0000 7fd1a7fff700 1 -- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a80b0930 msgr2=0x7fd1a81508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a7fff700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a80b0930 0x7fd1a81508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a7fff700 1 -- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1a8159c20 msgr2=0x7fd1a815f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a7fff700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1a8159c20 0x7fd1a815f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a7fff700 1 -- 172.21.15.7:0/415451966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940094f0 con 0x7fd1a8159850 2023-10-14T19:09:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1ad105700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1a8159c20 0x7fd1a815f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a7fff700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 0x7fd1a8159000 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd1940099b0 tx=0x7fd194017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194024440 con 0x7fd1a8159850 2023-10-14T19:09:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940245c0 con 0x7fd1a8159850 2023-10-14T19:09:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194024980 con 0x7fd1a8159850 2023-10-14T19:09:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a814f7c0 con 0x7fd1a8159850 2023-10-14T19:09:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.365+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a8150e30 con 0x7fd1a8159850 2023-10-14T19:09:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.366+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a814f620 con 0x7fd1a8159850 2023-10-14T19:09:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.366+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd19401a420 con 0x7fd1a8159850 2023-10-14T19:09:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.367+0000 7fd1a4ff9700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd18c067320 0x7fd18c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.367+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd1940867c0 con 0x7fd1a8159850 2023-10-14T19:09:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.367+0000 7fd1ac904700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd18c067320 0x7fd18c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.367+0000 7fd1ac904700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd18c067320 0x7fd18c0697d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00ac00 tx=0x7fd19c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.371+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1a814f620 con 0x7fd1a8159850 2023-10-14T19:09:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.643+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7fd1a814fce0 con 0x7fd1a8159850 2023-10-14T19:09:29.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.863+0000 7fd1a4ff9700 1 -- 172.21.15.7:0/415451966 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v306) v1 ==== 156+0+0 (secure 0 0 0) 0x7fd1a814fce0 con 0x7fd1a8159850 2023-10-14T19:09:29.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.864+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd18c067320 msgr2=0x7fd18c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.864+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd18c067320 0x7fd18c0697d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00ac00 tx=0x7fd19c006f90 comp rx=0 tx=0).stop 2023-10-14T19:09:29.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 msgr2=0x7fd1a8159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:29.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 0x7fd1a8159000 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd1940099b0 tx=0x7fd194017000 comp rx=0 tx=0).stop 2023-10-14T19:09:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 shutdown_connections 2023-10-14T19:09:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd18c067320 0x7fd18c0697d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1a8159c20 0x7fd1a815f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1a80b0930 0x7fd1a81508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 --2- 172.21.15.7:0/415451966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1a8159850 0x7fd1a8159000 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 >> 172.21.15.7:0/415451966 conn(0x7fd1a806d170 msgr2=0x7fd1a8069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 shutdown_connections 2023-10-14T19:09:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.865+0000 7fd1aeb68700 1 -- 172.21.15.7:0/415451966 wait complete. 2023-10-14T19:09:29.878 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command without subvolume group ... ok 2023-10-14T19:09:29.878 INFO:tasks.cephfs_test_runner:Starting test: test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) That the existing and the newly created volumes can be listed and 2023-10-14T19:09:29.879 INFO:tasks.cephfs_test_runner:test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:09:29.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-14T19:09:29.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.998+0000 7f2abe093700 1 Processor -- start 2023-10-14T19:09:30.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.998+0000 7f2abe093700 1 -- start start 2023-10-14T19:09:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.999+0000 7f2abe093700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 0x7f2ab8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.999+0000 7f2abe093700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab815ae40 con 0x7f2ab80cb970 2023-10-14T19:09:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.999+0000 7f2abe093700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab815ab60 con 0x7f2ab80cb5a0 2023-10-14T19:09:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.999+0000 7f2abe093700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80ce0f0 con 0x7f2ab815a5d0 2023-10-14T19:09:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.999+0000 7f2ab6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2ab80cb970 0x7f2ab8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45282/0 (socket says 172.21.15.7:45282) 2023-10-14T19:09:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:29.999+0000 7f2ab6ffd700 1 -- 172.21.15.7:0/3912115623 learned_addr learned my addr 172.21.15.7:0/3912115623 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:30.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab7fff700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 0x7f2ab8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503184503 0 0) 0x7f2ab815ae40 con 0x7f2ab80cb970 2023-10-14T19:09:30.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa0003570 con 0x7f2ab80cb970 2023-10-14T19:09:30.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1852806625 0 0) 0x7f2aa0003570 con 0x7f2ab80cb970 2023-10-14T19:09:30.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 msgr2=0x7f2ab8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:30.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 0x7f2ab8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 >> v1:172.21.15.148:6789/0 conn(0x7f2ab80cb5a0 legacy=0x7f2ab80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80ccf00 con 0x7f2ab80cb970 2023-10-14T19:09:30.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2aac001470 con 0x7f2ab80cb970 2023-10-14T19:09:30.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 >> v1:172.21.15.7:6789/0 conn(0x7f2ab80cb970 legacy=0x7f2ab8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2aa0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2aa0004810 0x7f2aa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 0x7f2aa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80ce0f0 con 0x7f2aa0003a90 2023-10-14T19:09:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa000bb10 con 0x7f2aa0004810 2023-10-14T19:09:30.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa000bcd0 con 0x7f2ab815a5d0 2023-10-14T19:09:30.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2aa0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab6ffd700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2aa0004810 0x7f2aa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab7fff700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 0x7f2aa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 msgr2=0x7f2aa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab815a5d0 0x7f2aa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2aa0004810 msgr2=0x7f2aa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2aa0004810 0x7f2aa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3912115623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0003570 con 0x7f2aa0003a90 2023-10-14T19:09:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.000+0000 7f2ab6ffd700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2aa0004810 0x7f2aa0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2aa0003e60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80019a0 tx=0x7f2aa8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfc5737f795ac34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800c5d0 con 0x7f2aa0003a90 2023-10-14T19:09:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa800c730 con 0x7f2aa0003a90 2023-10-14T19:09:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2ab67fc700 1 -- 172.21.15.7:0/3912115623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800cad0 con 0x7f2aa0003a90 2023-10-14T19:09:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2abe093700 1 -- 172.21.15.7:0/3912115623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 msgr2=0x7f2aa0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2abe093700 1 --2- 172.21.15.7:0/3912115623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2aa0003e60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80019a0 tx=0x7f2aa8007d10 comp rx=0 tx=0).stop 2023-10-14T19:09:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2ab7fff700 1 -- 172.21.15.7:0/3912115623 reap_dead start 2023-10-14T19:09:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2abe093700 1 -- 172.21.15.7:0/3912115623 shutdown_connections 2023-10-14T19:09:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2abe093700 1 -- 172.21.15.7:0/3912115623 >> 172.21.15.7:0/3912115623 conn(0x7f2ab8070e30 msgr2=0x7f2ab80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2abe093700 1 -- 172.21.15.7:0/3912115623 shutdown_connections 2023-10-14T19:09:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.001+0000 7f2abe093700 1 -- 172.21.15.7:0/3912115623 wait complete. 2023-10-14T19:09:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 Processor -- start 2023-10-14T19:09:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 -- start start 2023-10-14T19:09:30.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2ab81501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab80af410 0x7f2ab8153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab81522c0 0x7f2ab8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8153490 con 0x7f2aa0003a90 2023-10-14T19:09:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8152880 con 0x7f2ab80af410 2023-10-14T19:09:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2abe093700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8152b60 con 0x7f2ab81522c0 2023-10-14T19:09:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2ab81501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2ab81501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52464/0 (socket says 172.21.15.7:52464) 2023-10-14T19:09:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.003+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3155683411 learned_addr learned my addr 172.21.15.7:0/3155683411 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab7fff700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab81522c0 0x7f2ab8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab6ffd700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab80af410 0x7f2ab8153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab81522c0 msgr2=0x7f2ab8157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab81522c0 0x7f2ab8157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab80af410 msgr2=0x7f2ab8153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab80af410 0x7f2ab8153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab77fe700 1 -- 172.21.15.7:0/3155683411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8152e40 con 0x7f2aa0003a90 2023-10-14T19:09:30.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2ab77fe700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2ab81501a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0004770 tx=0x7f2aa8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:30.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800c5d0 con 0x7f2aa0003a90 2023-10-14T19:09:30.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa800ce40 con 0x7f2aa0003a90 2023-10-14T19:09:30.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab8153120 con 0x7f2aa0003a90 2023-10-14T19:09:30.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8007af0 con 0x7f2aa0003a90 2023-10-14T19:09:30.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.004+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab81506e0 con 0x7f2aa0003a90 2023-10-14T19:09:30.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.005+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab8153770 con 0x7f2aa0003a90 2023-10-14T19:09:30.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.005+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2aa8019030 con 0x7f2aa0003a90 2023-10-14T19:09:30.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.006+0000 7f2a9f7fe700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:30.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.006+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2aa8085dd0 con 0x7f2aa0003a90 2023-10-14T19:09:30.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.006+0000 7f2ab6ffd700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:30.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.007+0000 7f2ab6ffd700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0015a0 tx=0x7f2aac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:30.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.010+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2aa8052e20 con 0x7f2aa0003a90 2023-10-14T19:09:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.284+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7f2ab804c3c0 con 0x7f2aa0003a90 2023-10-14T19:09:30.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.864+0000 7f2a9f7fe700 1 -- 172.21.15.7:0/3155683411 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v307) v1 ==== 134+0+0 (secure 0 0 0) 0x7f2aa80220c0 con 0x7f2aa0003a90 2023-10-14T19:09:30.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 msgr2=0x7f2aa40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0015a0 tx=0x7f2aac009040 comp rx=0 tx=0).stop 2023-10-14T19:09:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 msgr2=0x7f2ab81501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2ab81501a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0004770 tx=0x7f2aa8015000 comp rx=0 tx=0).stop 2023-10-14T19:09:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 shutdown_connections 2023-10-14T19:09:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab81522c0 0x7f2ab8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa0003a90 0x7f2ab81501a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 --2- 172.21.15.7:0/3155683411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab80af410 0x7f2ab8153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 >> 172.21.15.7:0/3155683411 conn(0x7f2ab8070e30 msgr2=0x7f2ab8154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 shutdown_connections 2023-10-14T19:09:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:30.866+0000 7f2abe093700 1 -- 172.21.15.7:0/3155683411 wait complete. 2023-10-14T19:09:30.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:09:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.004+0000 7f5a048a9700 1 Processor -- start 2023-10-14T19:09:31.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.004+0000 7f5a048a9700 1 -- start start 2023-10-14T19:09:31.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f5a048a9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a00159530 0x7f5a000ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f5a048a9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a0006e0e0 0x7f5a000cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f5a048a9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000ccfd0 con 0x7f5a0006dc70 2023-10-14T19:09:31.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f5a048a9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a000cf0e0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f5a048a9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0015a3d0 con 0x7f5a00159530 2023-10-14T19:09:31.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a0006e0e0 0x7f5a000cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a0006e0e0 0x7f5a000cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52470/0 (socket says 172.21.15.7:52470) 2023-10-14T19:09:31.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 -- 172.21.15.7:0/2820342269 learned_addr learned my addr 172.21.15.7:0/2820342269 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fe59c700 1 --2- 172.21.15.7:0/2820342269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a00159530 0x7f5a000ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 -- 172.21.15.7:0/2820342269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a00159530 msgr2=0x7f5a000ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 --2- 172.21.15.7:0/2820342269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a00159530 0x7f5a000ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 -- 172.21.15.7:0/2820342269 >> v1:172.21.15.148:6789/0 conn(0x7f5a0006dc70 legacy=0x7f5a00159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 -- 172.21.15.7:0/2820342269 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0015a6b0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fed9d700 1 --2- 172.21.15.7:0/2820342269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000cb6f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009f20 tx=0x7f59f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c80cd1f2633cf17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.005+0000 7f59fd59a700 1 -- 172.21.15.7:0/2820342269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800e070 con 0x7f5a0006e0e0 2023-10-14T19:09:31.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f59fd59a700 1 -- 172.21.15.7:0/2820342269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800b9d0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f59fd59a700 1 -- 172.21.15.7:0/2820342269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f80092e0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 -- 172.21.15.7:0/2820342269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 msgr2=0x7f5a000cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 --2- 172.21.15.7:0/2820342269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000cb6f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009f20 tx=0x7f59f8009840 comp rx=0 tx=0).stop 2023-10-14T19:09:31.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 -- 172.21.15.7:0/2820342269 shutdown_connections 2023-10-14T19:09:31.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 --2- 172.21.15.7:0/2820342269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000cb6f0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 --2- 172.21.15.7:0/2820342269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a00159530 0x7f5a000ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 -- 172.21.15.7:0/2820342269 >> 172.21.15.7:0/2820342269 conn(0x7f5a000703a0 msgr2=0x7f5a000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:31.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 -- 172.21.15.7:0/2820342269 shutdown_connections 2023-10-14T19:09:31.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.006+0000 7f5a048a9700 1 -- 172.21.15.7:0/2820342269 wait complete. 2023-10-14T19:09:31.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.007+0000 7f5a048a9700 1 Processor -- start 2023-10-14T19:09:31.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.007+0000 7f5a048a9700 1 -- start start 2023-10-14T19:09:31.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f5a048a9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0006dc70 0x7f5a000c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f5a048a9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f5a048a9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a00159530 0x7f5a00155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f5a048a9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000c8e20 con 0x7f5a0006e0e0 2023-10-14T19:09:31.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f5a048a9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000c8210 con 0x7f5a00159530 2023-10-14T19:09:31.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f5a048a9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000c84f0 con 0x7f5a0006dc70 2023-10-14T19:09:31.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52480/0 (socket says 172.21.15.7:52480) 2023-10-14T19:09:31.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 -- 172.21.15.7:0/766233824 learned_addr learned my addr 172.21.15.7:0/766233824 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:31.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fe59c700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0006dc70 0x7f5a000c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fed9d700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a00159530 0x7f5a00155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 -- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0006dc70 msgr2=0x7f5a000c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0006dc70 0x7f5a000c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 -- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a00159530 msgr2=0x7f5a00155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a00159530 0x7f5a00155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.008+0000 7f59fdd9b700 1 -- 172.21.15.7:0/766233824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009ae0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.009+0000 7f59fdd9b700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000c7c10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c590 tx=0x7f59f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.009+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011590 con 0x7f5a0006e0e0 2023-10-14T19:09:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.009+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4011710 con 0x7f5a0006e0e0 2023-10-14T19:09:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.009+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a000c87d0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.009+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011ad0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.009+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a00158240 con 0x7f5a0006e0e0 2023-10-14T19:09:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.010+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0004c3c0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.010+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f59f401b3b0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.010+0000 7f59ee7fc700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59e0067320 0x7f59e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.011+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59f4083de0 con 0x7f5a0006e0e0 2023-10-14T19:09:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.011+0000 7f59fe59c700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59e0067320 0x7f59e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.011+0000 7f59fe59c700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59e0067320 0x7f59e00697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009d10 tx=0x7f59f00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.015+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59f4050d30 con 0x7f5a0006e0e0 2023-10-14T19:09:31.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.207+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5a0015a990 con 0x7f5a0006e0e0 2023-10-14T19:09:31.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.210+0000 7f59ee7fc700 1 -- 172.21.15.7:0/766233824 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59f4017070 con 0x7f5a0006e0e0 2023-10-14T19:09:31.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59e0067320 msgr2=0x7f59e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59e0067320 0x7f59e00697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009d10 tx=0x7f59f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 msgr2=0x7f5a000c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000c7c10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c590 tx=0x7f59f400c8a0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 shutdown_connections 2023-10-14T19:09:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f59e0067320 0x7f59e00697d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a00159530 0x7f5a00155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a0006dc70 0x7f5a000c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 --2- 172.21.15.7:0/766233824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a0006e0e0 0x7f5a000c7c10 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 >> 172.21.15.7:0/766233824 conn(0x7f5a000703a0 msgr2=0x7f5a000d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:31.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 shutdown_connections 2023-10-14T19:09:31.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.212+0000 7f5a048a9700 1 -- 172.21.15.7:0/766233824 wait complete. 2023-10-14T19:09:31.225 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:09:31.226 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:09:31.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:09:31.310 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:09:31.311 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:09:31.311 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.429+0000 7fd586a0c700 1 Processor -- start 2023-10-14T19:09:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.429+0000 7fd586a0c700 1 -- start start 2023-10-14T19:09:31.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd586a0c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5800b1b20 0x7fd58015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd586a0c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5801579d0 0x7fd580161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd586a0c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd580158210 con 0x7fd580157600 2023-10-14T19:09:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd586a0c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5800cb850 con 0x7fd5800b1b20 2023-10-14T19:09:31.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd586a0c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800cb290 con 0x7fd5801579d0 2023-10-14T19:09:31.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd57f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5800b1b20 0x7fd58015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd57ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd580157600 0x7fd5800b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45284/0 (socket says 172.21.15.7:45284) 2023-10-14T19:09:31.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd57ffff700 1 -- 172.21.15.7:0/1985810811 learned_addr learned my addr 172.21.15.7:0/1985810811 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:31.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd584fa9700 1 --2- 172.21.15.7:0/1985810811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5801579d0 0x7fd580161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd57f7fe700 1 -- 172.21.15.7:0/1985810811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5801579d0 msgr2=0x7fd580161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:31.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd57f7fe700 1 --2- 172.21.15.7:0/1985810811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5801579d0 0x7fd580161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.430+0000 7fd57f7fe700 1 -- 172.21.15.7:0/1985810811 >> v1:172.21.15.7:6789/0 conn(0x7fd580157600 legacy=0x7fd5800b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd57f7fe700 1 -- 172.21.15.7:0/1985810811 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800cb570 con 0x7fd5800b1b20 2023-10-14T19:09:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd57effd700 1 -- 172.21.15.7:0/1985810811 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251125284 0 0) 0x7fd580158210 con 0x7fd580157600 2023-10-14T19:09:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd57f7fe700 1 --2- 172.21.15.7:0/1985810811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5800b1b20 0x7fd58015f2b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd5700098e0 tx=0x7fd5700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a1e5cff768463b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd57effd700 1 -- 172.21.15.7:0/1985810811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570009e80 con 0x7fd5800b1b20 2023-10-14T19:09:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd57effd700 1 -- 172.21.15.7:0/1985810811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000b860 con 0x7fd5800b1b20 2023-10-14T19:09:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd57effd700 1 -- 172.21.15.7:0/1985810811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000bbe0 con 0x7fd5800b1b20 2023-10-14T19:09:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 -- 172.21.15.7:0/1985810811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5800b1b20 msgr2=0x7fd58015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 --2- 172.21.15.7:0/1985810811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5800b1b20 0x7fd58015f2b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd5700098e0 tx=0x7fd5700091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 -- 172.21.15.7:0/1985810811 shutdown_connections 2023-10-14T19:09:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 --2- 172.21.15.7:0/1985810811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5801579d0 0x7fd580161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 --2- 172.21.15.7:0/1985810811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5800b1b20 0x7fd58015f2b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 -- 172.21.15.7:0/1985810811 >> 172.21.15.7:0/1985810811 conn(0x7fd58006d170 msgr2=0x7fd5800cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:31.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 -- 172.21.15.7:0/1985810811 shutdown_connections 2023-10-14T19:09:31.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.431+0000 7fd586a0c700 1 -- 172.21.15.7:0/1985810811 wait complete. 2023-10-14T19:09:31.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 Processor -- start 2023-10-14T19:09:31.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 -- start start 2023-10-14T19:09:31.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5800b1b20 0x7fd580155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd580157600 0x7fd58015ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 0x7fd58015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58016a640 con 0x7fd5801579d0 2023-10-14T19:09:31.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580169a30 con 0x7fd580157600 2023-10-14T19:09:31.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.433+0000 7fd586a0c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580169d10 con 0x7fd5800b1b20 2023-10-14T19:09:31.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 0x7fd58015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 0x7fd58015efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52490/0 (socket says 172.21.15.7:52490) 2023-10-14T19:09:31.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 -- 172.21.15.7:0/328188320 learned_addr learned my addr 172.21.15.7:0/328188320 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:31.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd57ffff700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5800b1b20 0x7fd580155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd57f7fe700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd580157600 0x7fd58015ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 -- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5800b1b20 msgr2=0x7fd580155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5800b1b20 0x7fd580155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 -- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd580157600 msgr2=0x7fd58015ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd580157600 0x7fd58015ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 -- 172.21.15.7:0/328188320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009420 con 0x7fd5801579d0 2023-10-14T19:09:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd57ffff700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5800b1b20 0x7fd580155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd584fa9700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 0x7fd58015efb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd578007f30 tx=0x7fd5780098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800ecf0 con 0x7fd5801579d0 2023-10-14T19:09:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800ee50 con 0x7fd5801579d0 2023-10-14T19:09:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd580169ff0 con 0x7fd5801579d0 2023-10-14T19:09:31.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578014670 con 0x7fd5801579d0 2023-10-14T19:09:31.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.434+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5801696e0 con 0x7fd5801579d0 2023-10-14T19:09:31.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.435+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5800af200 con 0x7fd5801579d0 2023-10-14T19:09:31.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.436+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd5780149e0 con 0x7fd5801579d0 2023-10-14T19:09:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.436+0000 7fd577fff700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd560067320 0x7fd5600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.436+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd578085140 con 0x7fd5801579d0 2023-10-14T19:09:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.436+0000 7fd57ffff700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd560067320 0x7fd5600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.437+0000 7fd57ffff700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd560067320 0x7fd5600697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd5800adc70 tx=0x7fd568009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.440+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5800af200 con 0x7fd5801579d0 2023-10-14T19:09:31.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.675+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5800af200 con 0x7fd5801579d0 2023-10-14T19:09:31.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.676+0000 7fd577fff700 1 -- 172.21.15.7:0/328188320 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fd5800af200 con 0x7fd5801579d0 2023-10-14T19:09:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:31.678 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3507652384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3507652384},{"type":"v1","addr":"172.21.15.148:6837","nonce":3507652384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/1433671061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1433671061},{"type":"v1","addr":"172.21.15.148:6836","nonce":1433671061}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/753037231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":753037231},{"type":"v1","addr":"172.21.15.7:6834","nonce":753037231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/320138281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":320138281},{"type":"v1","addr":"172.21.15.7:6835","nonce":320138281}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-10-14T19:09:31.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd560067320 msgr2=0x7fd5600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd560067320 0x7fd5600697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd5800adc70 tx=0x7fd568009040 comp rx=0 tx=0).stop 2023-10-14T19:09:31.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 msgr2=0x7fd58015efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 0x7fd58015efb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd578007f30 tx=0x7fd5780098e0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 shutdown_connections 2023-10-14T19:09:31.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd560067320 0x7fd5600697d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5801579d0 0x7fd58015efb0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5800b1b20 0x7fd580155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 --2- 172.21.15.7:0/328188320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd580157600 0x7fd58015ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 >> 172.21.15.7:0/328188320 conn(0x7fd58006d170 msgr2=0x7fd5800c1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 shutdown_connections 2023-10-14T19:09:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.678+0000 7fd586a0c700 1 -- 172.21.15.7:0/328188320 wait complete. 2023-10-14T19:09:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 67 2023-10-14T19:09:31.692 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:09:31.692 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:09:31.692 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:09:31.693 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:31.693 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:09:31.693 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:09:31.694 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:09:31.694 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:31.694 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:09:31.695 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:09:31.695 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:09:31.695 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:31.695 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:09:31.696 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:09:31.696 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:09:31.696 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:09:31.701 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:09:31.702 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:09:31.703 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:09:31.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:09:31.705 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:09:31.706 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:09:31.707 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:09:31.707 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:09:31.745 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:09:31.746 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:31.747 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:09:31.748 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:31.748 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:09:31.749 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:31.750 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:09:31.750 DEBUG:teuthology.parallel:result is None 2023-10-14T19:09:31.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:09:31.821 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:09:31.822 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:09:31.831 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:09:31.831 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:09:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.878+0000 7fc56d310700 1 Processor -- start 2023-10-14T19:09:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.878+0000 7fc56d310700 1 -- start start 2023-10-14T19:09:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc56d310700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5680cb5a0 0x7fc5680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc56d310700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5680cde50 0x7fc568156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc56d310700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56815ae40 con 0x7fc5680cd9e0 2023-10-14T19:09:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc56d310700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680d13f0 con 0x7fc5680cde50 2023-10-14T19:09:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc56d310700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56815ab60 con 0x7fc5680cb5a0 2023-10-14T19:09:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5667fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc5680cd9e0 0x7fc568159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45300/0 (socket says 172.21.15.7:45300) 2023-10-14T19:09:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5667fc700 1 -- 172.21.15.7:0/2759874378 learned_addr learned my addr 172.21.15.7:0/2759874378 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5677fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5680cde50 0x7fc568156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc566ffd700 1 --2- 172.21.15.7:0/2759874378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5680cb5a0 0x7fc5680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc565ffb700 1 -- 172.21.15.7:0/2759874378 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471153488 0 0) 0x7fc56815ae40 con 0x7fc5680cd9e0 2023-10-14T19:09:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc565ffb700 1 -- 172.21.15.7:0/2759874378 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc550003570 con 0x7fc5680cd9e0 2023-10-14T19:09:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5677fe700 1 -- 172.21.15.7:0/2759874378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5680cb5a0 msgr2=0x7fc5680cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5677fe700 1 --2- 172.21.15.7:0/2759874378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5680cb5a0 0x7fc5680cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5677fe700 1 -- 172.21.15.7:0/2759874378 >> v1:172.21.15.7:6789/0 conn(0x7fc5680cd9e0 legacy=0x7fc568159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5677fe700 1 -- 172.21.15.7:0/2759874378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680ccf00 con 0x7fc5680cde50 2023-10-14T19:09:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.879+0000 7fc5677fe700 1 --2- 172.21.15.7:0/2759874378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cde50 0x7fc568156e90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc560009e60 tx=0x7fc560009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1a2ae621872b58 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc565ffb700 1 -- 172.21.15.7:0/2759874378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000e070 con 0x7fc5680cde50 2023-10-14T19:09:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc565ffb700 1 -- 172.21.15.7:0/2759874378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000bab0 con 0x7fc5680cde50 2023-10-14T19:09:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc565ffb700 1 -- 172.21.15.7:0/2759874378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000be70 con 0x7fc5680cde50 2023-10-14T19:09:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2759874378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cde50 msgr2=0x7fc568156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2759874378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cde50 0x7fc568156e90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc560009e60 tx=0x7fc560009780 comp rx=0 tx=0).stop 2023-10-14T19:09:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2759874378 shutdown_connections 2023-10-14T19:09:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2759874378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cde50 0x7fc568156e90 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2759874378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5680cb5a0 0x7fc5680cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2759874378 >> 172.21.15.7:0/2759874378 conn(0x7fc568070e30 msgr2=0x7fc5680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2759874378 shutdown_connections 2023-10-14T19:09:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2759874378 wait complete. 2023-10-14T19:09:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.881+0000 7fc56d310700 1 Processor -- start 2023-10-14T19:09:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 -- start start 2023-10-14T19:09:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 0x7fc568156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5680cd9e0 0x7fc5681595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc568158390 0x7fc56816cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681572f0 con 0x7fc5680cb5a0 2023-10-14T19:09:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681575d0 con 0x7fc5680cd9e0 2023-10-14T19:09:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc56d310700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681578b0 con 0x7fc568158390 2023-10-14T19:09:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc566ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 0x7fc568156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc566ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 0x7fc568156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52548/0 (socket says 172.21.15.7:52548) 2023-10-14T19:09:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.882+0000 7fc566ffd700 1 -- 172.21.15.7:0/2667858017 learned_addr learned my addr 172.21.15.7:0/2667858017 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc5667fc700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5680cd9e0 0x7fc5681595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc5677fe700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc568158390 0x7fc56816cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc566ffd700 1 -- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc568158390 msgr2=0x7fc56816cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc566ffd700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc568158390 0x7fc56816cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc566ffd700 1 -- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5680cd9e0 msgr2=0x7fc5681595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:31.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc566ffd700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5680cd9e0 0x7fc5681595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:31.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc566ffd700 1 -- 172.21.15.7:0/2667858017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009a20 con 0x7fc5680cb5a0 2023-10-14T19:09:31.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc5667fc700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5680cd9e0 0x7fc5681595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:31.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc566ffd700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 0x7fc568156c60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc55800ec80 tx=0x7fc5580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800c9d0 con 0x7fc5680cb5a0 2023-10-14T19:09:31.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55800cb30 con 0x7fc5680cb5a0 2023-10-14T19:09:31.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568157b90 con 0x7fc5680cb5a0 2023-10-14T19:09:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558013470 con 0x7fc5680cb5a0 2023-10-14T19:09:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.883+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680af490 con 0x7fc5680cb5a0 2023-10-14T19:09:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.884+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56804c3c0 con 0x7fc5680cb5a0 2023-10-14T19:09:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.884+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc558013820 con 0x7fc5680cb5a0 2023-10-14T19:09:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.885+0000 7fc54effd700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc554067320 0x7fc5540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.885+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc558084d00 con 0x7fc5680cb5a0 2023-10-14T19:09:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.885+0000 7fc5667fc700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc554067320 0x7fc5540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.885+0000 7fc5667fc700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc554067320 0x7fc5540697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc568159de0 tx=0x7fc55c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:31.889+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc558051c90 con 0x7fc5680cb5a0 2023-10-14T19:09:32.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.100+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc5681581e0 con 0x7fc5680cb5a0 2023-10-14T19:09:32.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.878+0000 7fc54effd700 1 -- 172.21.15.7:0/2667858017 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc5580552b0 con 0x7fc5680cb5a0 2023-10-14T19:09:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc554067320 msgr2=0x7fc5540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc554067320 0x7fc5540697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc568159de0 tx=0x7fc55c009040 comp rx=0 tx=0).stop 2023-10-14T19:09:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 msgr2=0x7fc568156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 0x7fc568156c60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc55800ec80 tx=0x7fc5580091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 shutdown_connections 2023-10-14T19:09:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc554067320 0x7fc5540697d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc568158390 0x7fc56816cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cb5a0 0x7fc568156c60 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:32.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 --2- 172.21.15.7:0/2667858017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5680cd9e0 0x7fc5681595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:32.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 >> 172.21.15.7:0/2667858017 conn(0x7fc568070e30 msgr2=0x7fc5680d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:32.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 shutdown_connections 2023-10-14T19:09:32.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:32.880+0000 7fc56d310700 1 -- 172.21.15.7:0/2667858017 wait complete. 2023-10-14T19:09:32.885 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:09:32.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:09:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.018+0000 7f0059642700 1 Processor -- start 2023-10-14T19:09:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.018+0000 7f0059642700 1 -- start start 2023-10-14T19:09:33.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f0059642700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f0059642700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00540cb1a0 0x7f00540cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f0059642700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005415e010 con 0x7f00541598a0 2023-10-14T19:09:33.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f0059642700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005415d420 con 0x7f00540cb1a0 2023-10-14T19:09:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f0059642700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005415d6e0 con 0x7f00541594d0 2023-10-14T19:09:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f004bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00540cb1a0 0x7f00540cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f00537fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00541598a0 0x7f00540ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45306/0 (socket says 172.21.15.7:45306) 2023-10-14T19:09:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f00537fe700 1 -- 172.21.15.7:0/1355832580 learned_addr learned my addr 172.21.15.7:0/1355832580 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.019+0000 7f0052ffd700 1 --2- 172.21.15.7:0/1355832580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f004bfff700 1 -- 172.21.15.7:0/1355832580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 msgr2=0x7f00540cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f004bfff700 1 --2- 172.21.15.7:0/1355832580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f004bfff700 1 -- 172.21.15.7:0/1355832580 >> v1:172.21.15.7:6789/0 conn(0x7f00541598a0 legacy=0x7f00540ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f004bfff700 1 -- 172.21.15.7:0/1355832580 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005415d9c0 con 0x7f00540cb1a0 2023-10-14T19:09:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f00527fc700 1 -- 172.21.15.7:0/1355832580 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60367713 0 0) 0x7f005415e010 con 0x7f00541598a0 2023-10-14T19:09:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f004bfff700 1 --2- 172.21.15.7:0/1355832580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00540cb1a0 0x7f00540cefb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f003c0098e0 tx=0x7f003c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90e6eb680d6c2fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f00527fc700 1 -- 172.21.15.7:0/1355832580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c009e80 con 0x7f00540cb1a0 2023-10-14T19:09:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f00527fc700 1 -- 172.21.15.7:0/1355832580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c00b860 con 0x7f00540cb1a0 2023-10-14T19:09:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f00527fc700 1 -- 172.21.15.7:0/1355832580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c00bbe0 con 0x7f00540cb1a0 2023-10-14T19:09:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f0059642700 1 -- 172.21.15.7:0/1355832580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00540cb1a0 msgr2=0x7f00540cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f0059642700 1 --2- 172.21.15.7:0/1355832580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00540cb1a0 0x7f00540cefb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f003c0098e0 tx=0x7f003c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f0059642700 1 -- 172.21.15.7:0/1355832580 shutdown_connections 2023-10-14T19:09:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f0059642700 1 --2- 172.21.15.7:0/1355832580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f0059642700 1 --2- 172.21.15.7:0/1355832580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00540cb1a0 0x7f00540cefb0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.020+0000 7f0059642700 1 -- 172.21.15.7:0/1355832580 >> 172.21.15.7:0/1355832580 conn(0x7f00540703a0 msgr2=0x7f0054070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.021+0000 7f0059642700 1 -- 172.21.15.7:0/1355832580 shutdown_connections 2023-10-14T19:09:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.021+0000 7f0059642700 1 -- 172.21.15.7:0/1355832580 wait complete. 2023-10-14T19:09:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 Processor -- start 2023-10-14T19:09:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 -- start start 2023-10-14T19:09:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00540cb1a0 0x7f00541582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 0x7f005416d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c7600 con 0x7f00541598a0 2023-10-14T19:09:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c7bc0 con 0x7f00540cb1a0 2023-10-14T19:09:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.022+0000 7f0059642700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005416dec0 con 0x7f00541594d0 2023-10-14T19:09:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 0x7f005416d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 0x7f005416d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52578/0 (socket says 172.21.15.7:52578) 2023-10-14T19:09:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 -- 172.21.15.7:0/4170869628 learned_addr learned my addr 172.21.15.7:0/4170869628 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f004bfff700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f0052ffd700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00540cb1a0 0x7f00541582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 -- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 msgr2=0x7f00540c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 -- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00540cb1a0 msgr2=0x7f00541582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00540cb1a0 0x7f00541582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 -- 172.21.15.7:0/4170869628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c009420 con 0x7f00541598a0 2023-10-14T19:09:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f00537fe700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 0x7f005416d400 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f004c00cc40 tx=0x7f004c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00a810 con 0x7f00541598a0 2023-10-14T19:09:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00a990 con 0x7f00541598a0 2023-10-14T19:09:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005416e1a0 con 0x7f00541598a0 2023-10-14T19:09:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00ad50 con 0x7f00541598a0 2023-10-14T19:09:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.023+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00541587f0 con 0x7f00541598a0 2023-10-14T19:09:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.024+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00540c7d50 con 0x7f00541598a0 2023-10-14T19:09:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.025+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f004c007300 con 0x7f00541598a0 2023-10-14T19:09:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.025+0000 7f004affd700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0034067320 0x7f00340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.025+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f004c084b30 con 0x7f00541598a0 2023-10-14T19:09:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.025+0000 7f0052ffd700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0034067320 0x7f00340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.026+0000 7f0052ffd700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0034067320 0x7f00340697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0044006fd0 tx=0x7f0044008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.029+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f004c051b90 con 0x7f00541598a0 2023-10-14T19:09:33.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.301+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f005404c3c0 con 0x7f00541598a0 2023-10-14T19:09:33.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.302+0000 7f004affd700 1 -- 172.21.15.7:0/4170869628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f004c0551b0 con 0x7f00541598a0 2023-10-14T19:09:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:33.303 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:09:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:09:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:09:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:09:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:09:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:09:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:09:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:09:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:09:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:09:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:09:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:09:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:09:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:09:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:09:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:09:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:09:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:09:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:09:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:09:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:09:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:09:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:09:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:09:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:09:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:09:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:09:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:09:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:09:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:09:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:09:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:09:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:09:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:09:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:09:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:09:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:09:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:09:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:09:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:09:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:09:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:09:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:09:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:09:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:09:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:09:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:09:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:09:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:09:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:09:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:09:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:09:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:09:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:09:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:09:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:09:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:09:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:09:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:09:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:09:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:09:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:09:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:09:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:09:33.346 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:09:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0034067320 msgr2=0x7f00340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0034067320 0x7f00340697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0044006fd0 tx=0x7f0044008040 comp rx=0 tx=0).stop 2023-10-14T19:09:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 msgr2=0x7f005416d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 0x7f005416d400 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f004c00cc40 tx=0x7f004c001970 comp rx=0 tx=0).stop 2023-10-14T19:09:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 shutdown_connections 2023-10-14T19:09:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0034067320 0x7f00340697d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00540cb1a0 0x7f00541582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541598a0 0x7f005416d400 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 --2- 172.21.15.7:0/4170869628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00541594d0 0x7f00540c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 >> 172.21.15.7:0/4170869628 conn(0x7f00540703a0 msgr2=0x7f00540d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 shutdown_connections 2023-10-14T19:09:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.304+0000 7f0059642700 1 -- 172.21.15.7:0/4170869628 wait complete. 2023-10-14T19:09:33.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.470+0000 7f9f95a65700 1 Processor -- start 2023-10-14T19:09:33.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.470+0000 7f9f95a65700 1 -- start start 2023-10-14T19:09:33.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95a65700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f90153c30 0x7f9f9015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95a65700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9f9015de50 0x7f9f900cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95a65700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9015afd0 con 0x7f9f900cef40 2023-10-14T19:09:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95a65700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9015b2b0 con 0x7f9f9015de50 2023-10-14T19:09:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95a65700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9015b590 con 0x7f9f90153c30 2023-10-14T19:09:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9f9015de50 0x7f9f900cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95264700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9f900cef40 0x7f9f9006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45322/0 (socket says 172.21.15.7:45322) 2023-10-14T19:09:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f95264700 1 -- 172.21.15.7:0/2737704215 learned_addr learned my addr 172.21.15.7:0/2737704215 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f94a63700 1 --2- 172.21.15.7:0/2737704215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f90153c30 0x7f9f9015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8f7fe700 1 -- 172.21.15.7:0/2737704215 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658938631 0 0) 0x7f9f9015afd0 con 0x7f9f900cef40 2023-10-14T19:09:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8f7fe700 1 -- 172.21.15.7:0/2737704215 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f78003570 con 0x7f9f900cef40 2023-10-14T19:09:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8ffff700 1 -- 172.21.15.7:0/2737704215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f90153c30 msgr2=0x7f9f9015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8ffff700 1 --2- 172.21.15.7:0/2737704215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f90153c30 0x7f9f9015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8ffff700 1 -- 172.21.15.7:0/2737704215 >> v1:172.21.15.7:6789/0 conn(0x7f9f900cef40 legacy=0x7f9f9006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.471+0000 7f9f8ffff700 1 -- 172.21.15.7:0/2737704215 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9015b870 con 0x7f9f9015de50 2023-10-14T19:09:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f8ffff700 1 --2- 172.21.15.7:0/2737704215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f9015de50 0x7f9f900cea00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9f840098e0 tx=0x7f9f840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc4d7810b2dad73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f8f7fe700 1 -- 172.21.15.7:0/2737704215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011630 con 0x7f9f9015de50 2023-10-14T19:09:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f8f7fe700 1 -- 172.21.15.7:0/2737704215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84011790 con 0x7f9f9015de50 2023-10-14T19:09:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f8f7fe700 1 -- 172.21.15.7:0/2737704215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011b30 con 0x7f9f9015de50 2023-10-14T19:09:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 -- 172.21.15.7:0/2737704215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f9015de50 msgr2=0x7f9f900cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2737704215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f9015de50 0x7f9f900cea00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9f840098e0 tx=0x7f9f840091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 -- 172.21.15.7:0/2737704215 shutdown_connections 2023-10-14T19:09:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2737704215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f90153c30 0x7f9f9015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2737704215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f9015de50 0x7f9f900cea00 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 -- 172.21.15.7:0/2737704215 >> 172.21.15.7:0/2737704215 conn(0x7f9f900703a0 msgr2=0x7f9f900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 -- 172.21.15.7:0/2737704215 shutdown_connections 2023-10-14T19:09:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.472+0000 7f9f95a65700 1 -- 172.21.15.7:0/2737704215 wait complete. 2023-10-14T19:09:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.473+0000 7f9f95a65700 1 Processor -- start 2023-10-14T19:09:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 -- start start 2023-10-14T19:09:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 0x7f9f90152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f90153c30 0x7f9f900b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f9015de50 0x7f9f900cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901694e0 con 0x7f9f900cef40 2023-10-14T19:09:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900b62a0 con 0x7f9f90153c30 2023-10-14T19:09:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.474+0000 7f9f95a65700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9016a470 con 0x7f9f9015de50 2023-10-14T19:09:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 0x7f9f90152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 0x7f9f90152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52600/0 (socket says 172.21.15.7:52600) 2023-10-14T19:09:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 -- 172.21.15.7:0/2444087593 learned_addr learned my addr 172.21.15.7:0/2444087593 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f8ffff700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f90153c30 0x7f9f900b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f95264700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f9015de50 0x7f9f900cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 -- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f9015de50 msgr2=0x7f9f900cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f9015de50 0x7f9f900cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 -- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f90153c30 msgr2=0x7f9f900b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f90153c30 0x7f9f900b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 -- 172.21.15.7:0/2444087593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009420 con 0x7f9f900cef40 2023-10-14T19:09:33.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f95264700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f9015de50 0x7f9f900cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:33.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f94a63700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 0x7f9f90152ff0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009ef0 tx=0x7f9f8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800cc20 con 0x7f9f900cef40 2023-10-14T19:09:33.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800f040 con 0x7f9f900cef40 2023-10-14T19:09:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f90153530 con 0x7f9f900cef40 2023-10-14T19:09:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88014480 con 0x7f9f900cef40 2023-10-14T19:09:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.475+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f90169990 con 0x7f9f900cef40 2023-10-14T19:09:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.476+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9016a2c0 con 0x7f9f900cef40 2023-10-14T19:09:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.477+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9f880147f0 con 0x7f9f900cef40 2023-10-14T19:09:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.477+0000 7f9f8cff9700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f7c067320 0x7f9f7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.477+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9f88085320 con 0x7f9f900cef40 2023-10-14T19:09:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.477+0000 7f9f8ffff700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f7c067320 0x7f9f7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.478+0000 7f9f8ffff700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f7c067320 0x7f9f7c0697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9f840091e0 tx=0x7f9f84017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.481+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f880522f0 con 0x7f9f900cef40 2023-10-14T19:09:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.675+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f9004c3c0 con 0x7f9f900cef40 2023-10-14T19:09:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.676+0000 7f9f8cff9700 1 -- 172.21.15.7:0/2444087593 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f9f88055910 con 0x7f9f900cef40 2023-10-14T19:09:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:33.677 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":110,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:32.876791+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f7c067320 msgr2=0x7f9f7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f7c067320 0x7f9f7c0697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9f840091e0 tx=0x7f9f84017000 comp rx=0 tx=0).stop 2023-10-14T19:09:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 msgr2=0x7f9f90152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 0x7f9f90152ff0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009ef0 tx=0x7f9f8800b040 comp rx=0 tx=0).stop 2023-10-14T19:09:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 shutdown_connections 2023-10-14T19:09:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9f7c067320 0x7f9f7c0697d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f9015de50 0x7f9f900cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f900cef40 0x7f9f90152ff0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 --2- 172.21.15.7:0/2444087593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f90153c30 0x7f9f900b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 >> 172.21.15.7:0/2444087593 conn(0x7f9f900703a0 msgr2=0x7f9f900c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 shutdown_connections 2023-10-14T19:09:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.678+0000 7f9f95a65700 1 -- 172.21.15.7:0/2444087593 wait complete. 2023-10-14T19:09:33.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:09:33.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:09:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.814+0000 7f1f5b7c5700 1 Processor -- start 2023-10-14T19:09:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.814+0000 7f1f5b7c5700 1 -- start start 2023-10-14T19:09:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f5b7c5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5413c9b0 0x7f1f54069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f5b7c5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f540cc6f0 0x7f1f54069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f5b7c5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5406d7b0 con 0x7f1f540cc320 2023-10-14T19:09:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f5b7c5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5406f7d0 con 0x7f1f540cc6f0 2023-10-14T19:09:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f5b7c5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5406e330 con 0x7f1f5413c9b0 2023-10-14T19:09:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f540cc6f0 0x7f1f54069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f540cc6f0 0x7f1f54069f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52608/0 (socket says 172.21.15.7:52608) 2023-10-14T19:09:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 -- 172.21.15.7:0/799867034 learned_addr learned my addr 172.21.15.7:0/799867034 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59561700 1 --1- 172.21.15.7:0/799867034 >> v1:172.21.15.148:6789/0 conn(0x7f1f540cc320 0x7f1f5413c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36766/0 (socket says 172.21.15.7:36766) 2023-10-14T19:09:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f58d60700 1 --2- 172.21.15.7:0/799867034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5413c9b0 0x7f1f54069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 -- 172.21.15.7:0/799867034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5413c9b0 msgr2=0x7f1f54069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 --2- 172.21.15.7:0/799867034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5413c9b0 0x7f1f54069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 -- 172.21.15.7:0/799867034 >> v1:172.21.15.148:6789/0 conn(0x7f1f540cc320 legacy=0x7f1f5413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f53fff700 1 -- 172.21.15.7:0/799867034 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871807909 0 0) 0x7f1f5406d7b0 con 0x7f1f540cc320 2023-10-14T19:09:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 -- 172.21.15.7:0/799867034 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5406da00 con 0x7f1f540cc6f0 2023-10-14T19:09:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f59d62700 1 --2- 172.21.15.7:0/799867034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f540cc6f0 0x7f1f54069f40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009f20 tx=0x7f1f44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3f9958d3ddb017 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f53fff700 1 -- 172.21.15.7:0/799867034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400e070 con 0x7f1f540cc6f0 2023-10-14T19:09:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f53fff700 1 -- 172.21.15.7:0/799867034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4400b9d0 con 0x7f1f540cc6f0 2023-10-14T19:09:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.815+0000 7f1f53fff700 1 -- 172.21.15.7:0/799867034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440092e0 con 0x7f1f540cc6f0 2023-10-14T19:09:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/799867034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f540cc6f0 msgr2=0x7f1f54069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/799867034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f540cc6f0 0x7f1f54069f40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009f20 tx=0x7f1f44009840 comp rx=0 tx=0).stop 2023-10-14T19:09:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/799867034 shutdown_connections 2023-10-14T19:09:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/799867034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f540cc6f0 0x7f1f54069f40 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/799867034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5413c9b0 0x7f1f54069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/799867034 >> 172.21.15.7:0/799867034 conn(0x7f1f54067f00 msgr2=0x7f1f54068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/799867034 shutdown_connections 2023-10-14T19:09:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.816+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/799867034 wait complete. 2023-10-14T19:09:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.817+0000 7f1f5b7c5700 1 Processor -- start 2023-10-14T19:09:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.817+0000 7f1f5b7c5700 1 -- start start 2023-10-14T19:09:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f5b7c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f540cc320 0x7f1f5416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f5b7c5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f540cc6f0 0x7f1f5413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f5b7c5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 0x7f1f540adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f5b7c5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5416aa60 con 0x7f1f5413c9b0 2023-10-14T19:09:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f5b7c5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540b0660 con 0x7f1f540cc320 2023-10-14T19:09:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f5b7c5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540c64d0 con 0x7f1f540cc6f0 2023-10-14T19:09:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f59d62700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 0x7f1f540adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f59d62700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 0x7f1f540adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52622/0 (socket says 172.21.15.7:52622) 2023-10-14T19:09:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f59d62700 1 -- 172.21.15.7:0/4156908067 learned_addr learned my addr 172.21.15.7:0/4156908067 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f58d60700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f540cc6f0 0x7f1f5413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f59561700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f540cc320 0x7f1f5416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.818+0000 7f1f59d62700 1 -- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f540cc6f0 msgr2=0x7f1f5413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f59d62700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f540cc6f0 0x7f1f5413ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f59d62700 1 -- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f540cc320 msgr2=0x7f1f5416a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f59d62700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f540cc320 0x7f1f5416a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f59d62700 1 -- 172.21.15.7:0/4156908067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009ae0 con 0x7f1f5413c9b0 2023-10-14T19:09:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f58d60700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f540cc6f0 0x7f1f5413ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f59d62700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 0x7f1f540adb30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1f540cf610 tx=0x7f1f44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44008c70 con 0x7f1f5413c9b0 2023-10-14T19:09:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44008dd0 con 0x7f1f5413c9b0 2023-10-14T19:09:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440266b0 con 0x7f1f5413c9b0 2023-10-14T19:09:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f540afd30 con 0x7f1f5413c9b0 2023-10-14T19:09:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.819+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f540b02f0 con 0x7f1f5413c9b0 2023-10-14T19:09:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.820+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5404c3c0 con 0x7f1f5413c9b0 2023-10-14T19:09:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.820+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1f44003040 con 0x7f1f5413c9b0 2023-10-14T19:09:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.820+0000 7f1f517fa700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1f40067320 0x7f1f400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.821+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1f44086930 con 0x7f1f5413c9b0 2023-10-14T19:09:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.821+0000 7f1f59561700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1f40067320 0x7f1f400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.821+0000 7f1f59561700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1f40067320 0x7f1f400697d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1f540c88e0 tx=0x7f1f4c007bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:33.825+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f44053800 con 0x7f1f5413c9b0 2023-10-14T19:09:34.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.019+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f5406dce0 con 0x7f1f5413c9b0 2023-10-14T19:09:34.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.019+0000 7f1f517fa700 1 -- 172.21.15.7:0/4156908067 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f44056e20 con 0x7f1f5413c9b0 2023-10-14T19:09:34.021 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:09:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1f40067320 msgr2=0x7f1f400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1f40067320 0x7f1f400697d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1f540c88e0 tx=0x7f1f4c007bf0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 msgr2=0x7f1f540adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 0x7f1f540adb30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1f540cf610 tx=0x7f1f44018000 comp rx=0 tx=0).stop 2023-10-14T19:09:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 shutdown_connections 2023-10-14T19:09:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1f40067320 0x7f1f400697d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f540cc320 0x7f1f5416a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5413c9b0 0x7f1f540adb30 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 --2- 172.21.15.7:0/4156908067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f540cc6f0 0x7f1f5413ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 >> 172.21.15.7:0/4156908067 conn(0x7f1f54067f00 msgr2=0x7f1f540b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:34.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 shutdown_connections 2023-10-14T19:09:34.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.022+0000 7f1f5b7c5700 1 -- 172.21.15.7:0/4156908067 wait complete. 2023-10-14T19:09:34.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:09:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 Processor -- start 2023-10-14T19:09:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 -- start start 2023-10-14T19:09:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f79c80b07d0 0x7f79c80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79c80cf200 0x7f79c80cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c815a280 con 0x7f79c80b0ba0 2023-10-14T19:09:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c806e180 con 0x7f79c80cf200 2023-10-14T19:09:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.154+0000 7f79cd284700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c80cd540 con 0x7f79c80b07d0 2023-10-14T19:09:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79c80cf200 0x7f79c80cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79c80cf200 0x7f79c80cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52630/0 (socket says 172.21.15.7:52630) 2023-10-14T19:09:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 -- 172.21.15.7:0/1265554712 learned_addr learned my addr 172.21.15.7:0/1265554712 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 -- 172.21.15.7:0/1265554712 >> v2:172.21.15.148:3300/0 conn(0x7f79c80b07d0 msgr2=0x7f79c80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 --2- 172.21.15.7:0/1265554712 >> v2:172.21.15.148:3300/0 conn(0x7f79c80b07d0 0x7f79c80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 -- 172.21.15.7:0/1265554712 >> v1:172.21.15.148:6789/0 conn(0x7f79c80b0ba0 legacy=0x7f79c806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 -- 172.21.15.7:0/1265554712 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c806d850 con 0x7f79c80cf200 2023-10-14T19:09:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c67fc700 1 --2- 172.21.15.7:0/1265554712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80cf200 0x7f79c80cd000 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f79c8064720 tx=0x7f79b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bdd6a959bc332e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c5ffb700 1 -- 172.21.15.7:0/1265554712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000b8b0 con 0x7f79c80cf200 2023-10-14T19:09:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c5ffb700 1 -- 172.21.15.7:0/1265554712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000ba10 con 0x7f79c80cf200 2023-10-14T19:09:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.155+0000 7f79c5ffb700 1 -- 172.21.15.7:0/1265554712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000bdb0 con 0x7f79c80cf200 2023-10-14T19:09:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 -- 172.21.15.7:0/1265554712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80cf200 msgr2=0x7f79c80cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 --2- 172.21.15.7:0/1265554712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80cf200 0x7f79c80cd000 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f79c8064720 tx=0x7f79b0009250 comp rx=0 tx=0).stop 2023-10-14T19:09:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 -- 172.21.15.7:0/1265554712 shutdown_connections 2023-10-14T19:09:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 --2- 172.21.15.7:0/1265554712 >> v2:172.21.15.148:3300/0 conn(0x7f79c80b07d0 0x7f79c80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 --2- 172.21.15.7:0/1265554712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80cf200 0x7f79c80cd000 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 -- 172.21.15.7:0/1265554712 >> 172.21.15.7:0/1265554712 conn(0x7f79c806ce80 msgr2=0x7f79c80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 -- 172.21.15.7:0/1265554712 shutdown_connections 2023-10-14T19:09:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.156+0000 7f79cd284700 1 -- 172.21.15.7:0/1265554712 wait complete. 2023-10-14T19:09:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.157+0000 7f79cd284700 1 Processor -- start 2023-10-14T19:09:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.157+0000 7f79cd284700 1 -- start start 2023-10-14T19:09:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79c80b07d0 0x7f79c80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 0x7f79c8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c80cf200 0x7f79c8156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c816aa60 con 0x7f79c80b0ba0 2023-10-14T19:09:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80c6920 con 0x7f79c80cf200 2023-10-14T19:09:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80c6c00 con 0x7f79c80b07d0 2023-10-14T19:09:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 0x7f79c8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 0x7f79c8156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52632/0 (socket says 172.21.15.7:52632) 2023-10-14T19:09:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 -- 172.21.15.7:0/296730437 learned_addr learned my addr 172.21.15.7:0/296730437 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c77fe700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c80cf200 0x7f79c8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c6ffd700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79c80b07d0 0x7f79c80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 -- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79c80b07d0 msgr2=0x7f79c80c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79c80b07d0 0x7f79c80c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 -- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c80cf200 msgr2=0x7f79c8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c80cf200 0x7f79c8156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 -- 172.21.15.7:0/296730437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00094f0 con 0x7f79c80b0ba0 2023-10-14T19:09:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79c67fc700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 0x7f79c8156d10 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f79b00090b0 tx=0x7f79b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0011e60 con 0x7f79c80b0ba0 2023-10-14T19:09:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b001b680 con 0x7f79c80b0ba0 2023-10-14T19:09:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b001ba20 con 0x7f79c80b0ba0 2023-10-14T19:09:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c80c6ee0 con 0x7f79c80b0ba0 2023-10-14T19:09:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.158+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c8156a40 con 0x7f79c80b0ba0 2023-10-14T19:09:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.159+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c80c7120 con 0x7f79c80b0ba0 2023-10-14T19:09:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.160+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f79b001c450 con 0x7f79c80b0ba0 2023-10-14T19:09:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.160+0000 7f79beffd700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f79a8067320 0x7f79a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.160+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f79b0086630 con 0x7f79c80b0ba0 2023-10-14T19:09:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.160+0000 7f79c6ffd700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f79a8067320 0x7f79a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.161+0000 7f79c6ffd700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f79a8067320 0x7f79a80697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79c0007f30 tx=0x7f79c0007420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:34.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.164+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79c80c7120 con 0x7f79c80b0ba0 2023-10-14T19:09:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.358+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f79c80c7120 con 0x7f79c80b0ba0 2023-10-14T19:09:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.358+0000 7f79beffd700 1 -- 172.21.15.7:0/296730437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) v1 ==== 84+0+65 (secure 0 0 0) 0x7f79c80c7120 con 0x7f79c80b0ba0 2023-10-14T19:09:34.359 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:34.360 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:09:34.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:34.360 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:09:34.360 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:09:34.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:34.361 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:09:34.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f79a8067320 msgr2=0x7f79a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f79a8067320 0x7f79a80697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79c0007f30 tx=0x7f79c0007420 comp rx=0 tx=0).stop 2023-10-14T19:09:34.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 msgr2=0x7f79c8156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 0x7f79c8156d10 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f79b00090b0 tx=0x7f79b0016000 comp rx=0 tx=0).stop 2023-10-14T19:09:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 shutdown_connections 2023-10-14T19:09:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f79a8067320 0x7f79a80697d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c80cf200 0x7f79c8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79c80b07d0 0x7f79c80c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 --2- 172.21.15.7:0/296730437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79c80b0ba0 0x7f79c8156d10 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 >> 172.21.15.7:0/296730437 conn(0x7f79c806ce80 msgr2=0x7f79c806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 shutdown_connections 2023-10-14T19:09:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.360+0000 7f79cd284700 1 -- 172.21.15.7:0/296730437 wait complete. 2023-10-14T19:09:34.373 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:09:34.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:09:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.497+0000 7faed4b1e700 1 Processor -- start 2023-10-14T19:09:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.497+0000 7faed4b1e700 1 -- start start 2023-10-14T19:09:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.498+0000 7faed4b1e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed015de80 0x7faed0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.498+0000 7faed4b1e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed015d9f0 con 0x7faed015a300 2023-10-14T19:09:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.498+0000 7faed4b1e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed015d3c0 con 0x7faed0067e50 2023-10-14T19:09:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.498+0000 7faed4b1e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed015e2f0 con 0x7faed015de80 2023-10-14T19:09:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faeced9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faed015a300 0x7faed00c8c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45336/0 (socket says 172.21.15.7:45336) 2023-10-14T19:09:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faeced9d700 1 -- 172.21.15.7:0/2177960829 learned_addr learned my addr 172.21.15.7:0/2177960829 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecdd9b700 1 --2- 172.21.15.7:0/2177960829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed015de80 0x7faed0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973180575 0 0) 0x7faed015d9f0 con 0x7faed015a300 2023-10-14T19:09:34.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc003570 con 0x7faed015a300 2023-10-14T19:09:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112190111 0 0) 0x7faed015d3c0 con 0x7faed0067e50 2023-10-14T19:09:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed015d9f0 con 0x7faed0067e50 2023-10-14T19:09:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecdd9b700 1 -- 172.21.15.7:0/2177960829 >> v1:172.21.15.148:6789/0 conn(0x7faed0067e50 legacy=0x7faed0068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecdd9b700 1 -- 172.21.15.7:0/2177960829 >> v1:172.21.15.7:6789/0 conn(0x7faed015a300 legacy=0x7faed00c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecdd9b700 1 -- 172.21.15.7:0/2177960829 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed015a8f0 con 0x7faed015de80 2023-10-14T19:09:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecdd9b700 1 --2- 172.21.15.7:0/2177960829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed015de80 0x7faed0159dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009910 tx=0x7faeb80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd721c08a757851e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011630 con 0x7faed015de80 2023-10-14T19:09:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb8011790 con 0x7faed015de80 2023-10-14T19:09:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.499+0000 7faecd59a700 1 -- 172.21.15.7:0/2177960829 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011b30 con 0x7faed015de80 2023-10-14T19:09:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 -- 172.21.15.7:0/2177960829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed015de80 msgr2=0x7faed0159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 --2- 172.21.15.7:0/2177960829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed015de80 0x7faed0159dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009910 tx=0x7faeb80091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 -- 172.21.15.7:0/2177960829 shutdown_connections 2023-10-14T19:09:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 --2- 172.21.15.7:0/2177960829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed015de80 0x7faed0159dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 -- 172.21.15.7:0/2177960829 >> 172.21.15.7:0/2177960829 conn(0x7faed00ce4a0 msgr2=0x7faed00ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 -- 172.21.15.7:0/2177960829 shutdown_connections 2023-10-14T19:09:34.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.500+0000 7faed4b1e700 1 -- 172.21.15.7:0/2177960829 wait complete. 2023-10-14T19:09:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.501+0000 7faed4b1e700 1 Processor -- start 2023-10-14T19:09:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.501+0000 7faed4b1e700 1 -- start start 2023-10-14T19:09:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faed4b1e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed0067e50 0x7faed0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faed4b1e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 0x7faed00c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faed4b1e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faed015de80 0x7faed0153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faed4b1e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c8550 con 0x7faed015a300 2023-10-14T19:09:34.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faed4b1e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0169f40 con 0x7faed015de80 2023-10-14T19:09:34.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faed4b1e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed0159be0 con 0x7faed0067e50 2023-10-14T19:09:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 0x7faed00c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 0x7faed00c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52644/0 (socket says 172.21.15.7:52644) 2023-10-14T19:09:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 -- 172.21.15.7:0/791677258 learned_addr learned my addr 172.21.15.7:0/791677258 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faece59c700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed0067e50 0x7faed0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faeced9d700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faed015de80 0x7faed0153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 -- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed0067e50 msgr2=0x7faed0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed0067e50 0x7faed0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 -- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faed015de80 msgr2=0x7faed0153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faed015de80 0x7faed0153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 -- 172.21.15.7:0/791677258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8009420 con 0x7faed015a300 2023-10-14T19:09:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faeced9d700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faed015de80 0x7faed0153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.502+0000 7faecdd9b700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 0x7faed00c54b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7faed0067b90 tx=0x7faeb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.503+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011900 con 0x7faed015a300 2023-10-14T19:09:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.503+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb8011aa0 con 0x7faed015a300 2023-10-14T19:09:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.503+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8025670 con 0x7faed015a300 2023-10-14T19:09:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.503+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed016a210 con 0x7faed015a300 2023-10-14T19:09:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.503+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed016a7d0 con 0x7faed015a300 2023-10-14T19:09:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.503+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed004c3c0 con 0x7faed015a300 2023-10-14T19:09:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.504+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faeb8023070 con 0x7faed015a300 2023-10-14T19:09:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.504+0000 7faec67fc700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faeb0067320 0x7faeb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.504+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faeb8085e70 con 0x7faed015a300 2023-10-14T19:09:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.505+0000 7faece59c700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faeb0067320 0x7faeb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.505+0000 7faece59c700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faeb0067320 0x7faeb00697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faec80037e0 tx=0x7faec8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.509+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faeb8052f00 con 0x7faed015a300 2023-10-14T19:09:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.704+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faed015abd0 con 0x7faed015a300 2023-10-14T19:09:34.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.888+0000 7faec67fc700 1 -- 172.21.15.7:0/791677258 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) v1 ==== 138+0+0 (secure 0 0 0) 0x7faeb802a020 con 0x7faed015a300 2023-10-14T19:09:34.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.892+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faeb0067320 msgr2=0x7faeb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.892+0000 7faed4b1e700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faeb0067320 0x7faeb00697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faec80037e0 tx=0x7faec8009040 comp rx=0 tx=0).stop 2023-10-14T19:09:34.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.892+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 msgr2=0x7faed00c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:34.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.892+0000 7faed4b1e700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 0x7faed00c54b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7faed0067b90 tx=0x7faeb8017000 comp rx=0 tx=0).stop 2023-10-14T19:09:34.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 shutdown_connections 2023-10-14T19:09:34.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faeb0067320 0x7faeb00697d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faed015de80 0x7faed0153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faed0067e50 0x7faed0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 --2- 172.21.15.7:0/791677258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faed015a300 0x7faed00c54b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 >> 172.21.15.7:0/791677258 conn(0x7faed00ce4a0 msgr2=0x7faed00cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 shutdown_connections 2023-10-14T19:09:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:34.893+0000 7faed4b1e700 1 -- 172.21.15.7:0/791677258 wait complete. 2023-10-14T19:09:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:09:34.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:09:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.032+0000 7f2b6c31e700 1 Processor -- start 2023-10-14T19:09:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.032+0000 7f2b6c31e700 1 -- start start 2023-10-14T19:09:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6c31e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 0x7f2b640ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6c31e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 0x7f2b640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6c31e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640ccfd0 con 0x7f2b6406dc70 2023-10-14T19:09:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6c31e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640cf0e0 con 0x7f2b6406e0e0 2023-10-14T19:09:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6c31e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6415a3d0 con 0x7f2b64159530 2023-10-14T19:09:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6a0ba700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 0x7f2b640ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6a8bb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 0x7f2b640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6a8bb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 0x7f2b640cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:49428/0 (socket says 172.21.15.7:49428) 2023-10-14T19:09:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6a0ba700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 0x7f2b640ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:36332/0 (socket says 172.21.15.7:36332) 2023-10-14T19:09:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.033+0000 7f2b6a8bb700 1 -- 172.21.15.7:0/3659657692 learned_addr learned my addr 172.21.15.7:0/3659657692 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/3659657692 >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 msgr2=0x7f2b640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b6a0ba700 1 --2- 172.21.15.7:0/3659657692 >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 0x7f2b640cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/3659657692 >> v1:172.21.15.148:6789/0 conn(0x7f2b6406dc70 legacy=0x7f2b64159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/3659657692 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6415a6b0 con 0x7f2b64159530 2023-10-14T19:09:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b6a8bb700 1 --2- 172.21.15.7:0/3659657692 >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 0x7f2b640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b6a0ba700 1 --2- 172.21.15.7:0/3659657692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 0x7f2b640ceba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009e60 tx=0x7f2b54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3874a96d046c7db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b690b8700 1 -- 172.21.15.7:0/3659657692 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400e070 con 0x7f2b64159530 2023-10-14T19:09:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b690b8700 1 -- 172.21.15.7:0/3659657692 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5400bb60 con 0x7f2b64159530 2023-10-14T19:09:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.034+0000 7f2b690b8700 1 -- 172.21.15.7:0/3659657692 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54012430 con 0x7f2b64159530 2023-10-14T19:09:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 -- 172.21.15.7:0/3659657692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 msgr2=0x7f2b640ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/3659657692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 0x7f2b640ceba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009e60 tx=0x7f2b54009780 comp rx=0 tx=0).stop 2023-10-14T19:09:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 -- 172.21.15.7:0/3659657692 shutdown_connections 2023-10-14T19:09:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/3659657692 >> v2:172.21.15.148:3300/0 conn(0x7f2b6406e0e0 0x7f2b640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/3659657692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b64159530 0x7f2b640ceba0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 -- 172.21.15.7:0/3659657692 >> 172.21.15.7:0/3659657692 conn(0x7f2b640703a0 msgr2=0x7f2b640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 -- 172.21.15.7:0/3659657692 shutdown_connections 2023-10-14T19:09:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.035+0000 7f2b6c31e700 1 -- 172.21.15.7:0/3659657692 wait complete. 2023-10-14T19:09:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.036+0000 7f2b6c31e700 1 Processor -- start 2023-10-14T19:09:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.036+0000 7f2b6c31e700 1 -- start start 2023-10-14T19:09:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6c31e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 0x7f2b640c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6c31e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b6406e0e0 0x7f2b6416aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6c31e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b64159530 0x7f2b64149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6c31e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6416aff0 con 0x7f2b6406dc70 2023-10-14T19:09:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6c31e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640c8a80 con 0x7f2b64159530 2023-10-14T19:09:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6c31e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641496d0 con 0x7f2b6406e0e0 2023-10-14T19:09:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 0x7f2b640c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 0x7f2b640c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52646/0 (socket says 172.21.15.7:52646) 2023-10-14T19:09:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/473253233 learned_addr learned my addr 172.21.15.7:0/473253233 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b698b9700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b6406e0e0 0x7f2b6416aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a8bb700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b64159530 0x7f2b64149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b6406e0e0 msgr2=0x7f2b6416aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b6406e0e0 0x7f2b6416aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b64159530 msgr2=0x7f2b64149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b64159530 0x7f2b64149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 -- 172.21.15.7:0/473253233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0094f0 con 0x7f2b6406dc70 2023-10-14T19:09:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b6a0ba700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 0x7f2b640c7790 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2b540097c0 tx=0x7f2b54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.037+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54012c40 con 0x7f2b6406dc70 2023-10-14T19:09:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.038+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54012dc0 con 0x7f2b6406dc70 2023-10-14T19:09:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.038+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b54009a20 con 0x7f2b6406dc70 2023-10-14T19:09:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.038+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540276c0 con 0x7f2b6406dc70 2023-10-14T19:09:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.038+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b640c8150 con 0x7f2b6406dc70 2023-10-14T19:09:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.039+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6404c3c0 con 0x7f2b6406dc70 2023-10-14T19:09:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.039+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2b54024070 con 0x7f2b6406dc70 2023-10-14T19:09:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.040+0000 7f2b627fc700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b50067320 0x7f2b500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.040+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2b54086fa0 con 0x7f2b6406dc70 2023-10-14T19:09:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.040+0000 7f2b698b9700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b50067320 0x7f2b500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.040+0000 7f2b698b9700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b50067320 0x7f2b500697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2b640b6690 tx=0x7f2b58000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.044+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b54053dd0 con 0x7f2b6406dc70 2023-10-14T19:09:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.237+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2b6415a990 con 0x7f2b6406dc70 2023-10-14T19:09:35.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.894+0000 7f2b627fc700 1 -- 172.21.15.7:0/473253233 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2b540573f0 con 0x7f2b6406dc70 2023-10-14T19:09:35.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b50067320 msgr2=0x7f2b500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:35.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b50067320 0x7f2b500697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2b640b6690 tx=0x7f2b58000bc0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 msgr2=0x7f2b640c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:35.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 0x7f2b640c7790 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2b540097c0 tx=0x7f2b54019000 comp rx=0 tx=0).stop 2023-10-14T19:09:35.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 shutdown_connections 2023-10-14T19:09:35.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b50067320 0x7f2b500697d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b64159530 0x7f2b64149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b6406dc70 0x7f2b640c7790 secure :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2b540097c0 tx=0x7f2b54019000 comp rx=0 tx=0).stop 2023-10-14T19:09:35.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 --2- 172.21.15.7:0/473253233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b6406e0e0 0x7f2b6416aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:35.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.908+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 >> 172.21.15.7:0/473253233 conn(0x7f2b640703a0 msgr2=0x7f2b640b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:35.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.910+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 shutdown_connections 2023-10-14T19:09:35.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:35.910+0000 7f2b6c31e700 1 -- 172.21.15.7:0/473253233 wait complete. 2023-10-14T19:09:35.914 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:09:35.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:09:36.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.056+0000 7f6a22025700 1 Processor -- start 2023-10-14T19:09:36.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.056+0000 7f6a22025700 1 -- start start 2023-10-14T19:09:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a22025700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a1c159530 0x7f6a1c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a22025700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a1c06e0e0 0x7f6a1c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a22025700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0ccfd0 con 0x7f6a1c06dc70 2023-10-14T19:09:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a22025700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0cf0e0 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a22025700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c15a3d0 con 0x7f6a1c159530 2023-10-14T19:09:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a1c06e0e0 0x7f6a1c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a1c06e0e0 0x7f6a1c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52658/0 (socket says 172.21.15.7:52658) 2023-10-14T19:09:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 -- 172.21.15.7:0/4156252469 learned_addr learned my addr 172.21.15.7:0/4156252469 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1b7fe700 1 --2- 172.21.15.7:0/4156252469 >> v2:172.21.15.148:3300/0 conn(0x7f6a1c159530 0x7f6a1c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 -- 172.21.15.7:0/4156252469 >> v2:172.21.15.148:3300/0 conn(0x7f6a1c159530 msgr2=0x7f6a1c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 --2- 172.21.15.7:0/4156252469 >> v2:172.21.15.148:3300/0 conn(0x7f6a1c159530 0x7f6a1c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 -- 172.21.15.7:0/4156252469 >> v1:172.21.15.148:6789/0 conn(0x7f6a1c06dc70 legacy=0x7f6a1c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:36.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 -- 172.21.15.7:0/4156252469 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c15a6b0 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.057+0000 7f6a1bfff700 1 --2- 172.21.15.7:0/4156252469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c0cb6f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c06d630 tx=0x7f6a0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22960adcc72124d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:36.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a1a7fc700 1 -- 172.21.15.7:0/4156252469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00b820 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a1a7fc700 1 -- 172.21.15.7:0/4156252469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c00b980 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a1a7fc700 1 -- 172.21.15.7:0/4156252469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00bd20 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 -- 172.21.15.7:0/4156252469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 msgr2=0x7f6a1c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:36.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 --2- 172.21.15.7:0/4156252469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c0cb6f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c06d630 tx=0x7f6a0c009250 comp rx=0 tx=0).stop 2023-10-14T19:09:36.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 -- 172.21.15.7:0/4156252469 shutdown_connections 2023-10-14T19:09:36.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 --2- 172.21.15.7:0/4156252469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c0cb6f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 --2- 172.21.15.7:0/4156252469 >> v2:172.21.15.148:3300/0 conn(0x7f6a1c159530 0x7f6a1c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 -- 172.21.15.7:0/4156252469 >> 172.21.15.7:0/4156252469 conn(0x7f6a1c0703a0 msgr2=0x7f6a1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:36.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 -- 172.21.15.7:0/4156252469 shutdown_connections 2023-10-14T19:09:36.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.058+0000 7f6a22025700 1 -- 172.21.15.7:0/4156252469 wait complete. 2023-10-14T19:09:36.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.059+0000 7f6a22025700 1 Processor -- start 2023-10-14T19:09:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.059+0000 7f6a22025700 1 -- start start 2023-10-14T19:09:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a22025700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c06dc70 0x7f6a1c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a22025700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a22025700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a1c159530 0x7f6a1c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a22025700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c155c40 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a22025700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c158ea0 con 0x7f6a1c06dc70 2023-10-14T19:09:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a22025700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b5df0 con 0x7f6a1c159530 2023-10-14T19:09:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52674/0 (socket says 172.21.15.7:52674) 2023-10-14T19:09:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 -- 172.21.15.7:0/1970970751 learned_addr learned my addr 172.21.15.7:0/1970970751 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:36.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1b7fe700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c06dc70 0x7f6a1c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:36.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1bfff700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a1c159530 0x7f6a1c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:36.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 -- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a1c159530 msgr2=0x7f6a1c0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:36.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a1c159530 0x7f6a1c0b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 -- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c06dc70 msgr2=0x7f6a1c0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c06dc70 0x7f6a1c0c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.060+0000 7f6a1affd700 1 -- 172.21.15.7:0/1970970751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0094f0 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.061+0000 7f6a1affd700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c158960 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c5d0 tx=0x7f6a04007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.061+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011590 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.061+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a04011710 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.061+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c0b5420 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.061+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011ad0 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.061+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c0ca680 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.062+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c04c3c0 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.062+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a0401c460 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.063+0000 7f6a137fe700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69fc067350 0x7f69fc069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:36.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.063+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6a04084940 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.063+0000 7f6a1b7fe700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69fc067350 0x7f69fc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:36.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.063+0000 7f6a1b7fe700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69fc067350 0x7f69fc069800 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0c7b60 tx=0x7f6a1400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:36.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.067+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a04051630 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.303+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6a1c0d14e0 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.895+0000 7f6a137fe700 1 -- 172.21.15.7:0/1970970751 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v69) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6a04054c50 con 0x7f6a1c06e0e0 2023-10-14T19:09:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69fc067350 msgr2=0x7f69fc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69fc067350 0x7f69fc069800 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0c7b60 tx=0x7f6a1400b040 comp rx=0 tx=0).stop 2023-10-14T19:09:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 msgr2=0x7f6a1c158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c158960 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c5d0 tx=0x7f6a04007f60 comp rx=0 tx=0).stop 2023-10-14T19:09:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 shutdown_connections 2023-10-14T19:09:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69fc067350 0x7f69fc069800 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.901+0000 7f6a22025700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c06dc70 0x7f6a1c0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.902+0000 7f6a22025700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a1c159530 0x7f6a1c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.902+0000 7f6a22025700 1 --2- 172.21.15.7:0/1970970751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a1c06e0e0 0x7f6a1c158960 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:36.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.902+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 >> 172.21.15.7:0/1970970751 conn(0x7f6a1c0703a0 msgr2=0x7f6a1c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.902+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 shutdown_connections 2023-10-14T19:09:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:36.902+0000 7f6a22025700 1 -- 172.21.15.7:0/1970970751 wait complete. 2023-10-14T19:09:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 18 and data pool 19 2023-10-14T19:09:36.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.040+0000 7f8daeb67700 1 Processor -- start 2023-10-14T19:09:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.040+0000 7f8daeb67700 1 -- start start 2023-10-14T19:09:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8daeb67700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8daeb67700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8daeb67700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da815ae40 con 0x7f8da80cde50 2023-10-14T19:09:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8daeb67700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da80d13f0 con 0x7f8da80cd9e0 2023-10-14T19:09:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8daeb67700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da815ab60 con 0x7f8da80cb5a0 2023-10-14T19:09:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8dad104700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8da80cde50 0x7f8da8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33794/0 (socket says 172.21.15.7:33794) 2023-10-14T19:09:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8dad104700 1 -- 172.21.15.7:0/3741939865 learned_addr learned my addr 172.21.15.7:0/3741939865 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8dac903700 1 --2- 172.21.15.7:0/3741939865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da77fe700 1 -- 172.21.15.7:0/3741939865 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113848272 0 0) 0x7f8da815ae40 con 0x7f8da80cde50 2023-10-14T19:09:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da77fe700 1 -- 172.21.15.7:0/3741939865 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d94003570 con 0x7f8da80cde50 2023-10-14T19:09:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da7fff700 1 -- 172.21.15.7:0/3741939865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 msgr2=0x7f8da80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da7fff700 1 --2- 172.21.15.7:0/3741939865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da7fff700 1 -- 172.21.15.7:0/3741939865 >> v1:172.21.15.7:6789/0 conn(0x7f8da80cde50 legacy=0x7f8da8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da7fff700 1 -- 172.21.15.7:0/3741939865 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da80ccf00 con 0x7f8da80cd9e0 2023-10-14T19:09:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.041+0000 7f8da7fff700 1 --2- 172.21.15.7:0/3741939865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da8159ec0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009e60 tx=0x7f8d98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8198ebae36d07ac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8da77fe700 1 -- 172.21.15.7:0/3741939865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800e070 con 0x7f8da80cd9e0 2023-10-14T19:09:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8da77fe700 1 -- 172.21.15.7:0/3741939865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800bb60 con 0x7f8da80cd9e0 2023-10-14T19:09:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8da77fe700 1 -- 172.21.15.7:0/3741939865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98012430 con 0x7f8da80cd9e0 2023-10-14T19:09:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 -- 172.21.15.7:0/3741939865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 msgr2=0x7f8da8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 --2- 172.21.15.7:0/3741939865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da8159ec0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009e60 tx=0x7f8d98009780 comp rx=0 tx=0).stop 2023-10-14T19:09:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 -- 172.21.15.7:0/3741939865 shutdown_connections 2023-10-14T19:09:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 --2- 172.21.15.7:0/3741939865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 --2- 172.21.15.7:0/3741939865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 -- 172.21.15.7:0/3741939865 >> 172.21.15.7:0/3741939865 conn(0x7f8da8070e30 msgr2=0x7f8da80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 -- 172.21.15.7:0/3741939865 shutdown_connections 2023-10-14T19:09:37.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.042+0000 7f8daeb67700 1 -- 172.21.15.7:0/3741939865 wait complete. 2023-10-14T19:09:37.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.043+0000 7f8daeb67700 1 Processor -- start 2023-10-14T19:09:37.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.043+0000 7f8daeb67700 1 -- start start 2023-10-14T19:09:37.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8daeb67700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da8147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8daeb67700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da816c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8daeb67700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da816a2e0 0x7f8da816cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8daeb67700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da80b3e60 con 0x7f8da80cd9e0 2023-10-14T19:09:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8daeb67700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da8159c00 con 0x7f8da816a2e0 2023-10-14T19:09:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8daeb67700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da8159920 con 0x7f8da80cb5a0 2023-10-14T19:09:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8da7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da816c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8da7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da816c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45546/0 (socket says 172.21.15.7:45546) 2023-10-14T19:09:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8da7fff700 1 -- 172.21.15.7:0/1609087236 learned_addr learned my addr 172.21.15.7:0/1609087236 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8dac903700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da8147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.044+0000 7f8dad104700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da816a2e0 0x7f8da816cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da7fff700 1 -- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 msgr2=0x7f8da8147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da7fff700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da8147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da7fff700 1 -- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da816a2e0 msgr2=0x7f8da816cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da7fff700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da816a2e0 0x7f8da816cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da7fff700 1 -- 172.21.15.7:0/1609087236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98009a20 con 0x7f8da80cd9e0 2023-10-14T19:09:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8dac903700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da8147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da7fff700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da816c7d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8d980097c0 tx=0x7f8d98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98012da0 con 0x7f8da80cd9e0 2023-10-14T19:09:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98027470 con 0x7f8da80cd9e0 2023-10-14T19:09:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da80b3810 con 0x7f8da80cd9e0 2023-10-14T19:09:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98027830 con 0x7f8da80cd9e0 2023-10-14T19:09:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.045+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da8147650 con 0x7f8da80cd9e0 2023-10-14T19:09:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.046+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da804c3c0 con 0x7f8da80cd9e0 2023-10-14T19:09:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.046+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8d98024070 con 0x7f8da80cd9e0 2023-10-14T19:09:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.047+0000 7f8da4ff9700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d88067320 0x7f8d880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.047+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d98087380 con 0x7f8da80cd9e0 2023-10-14T19:09:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.047+0000 7f8dac903700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d88067320 0x7f8d880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.048+0000 7f8dac903700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d88067320 0x7f8d880697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d90006fd0 tx=0x7f8d90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.051+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d98054010 con 0x7f8da80cd9e0 2023-10-14T19:09:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.247+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8da80b3fa0 con 0x7f8da80cd9e0 2023-10-14T19:09:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.248+0000 7f8da4ff9700 1 -- 172.21.15.7:0/1609087236 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f8d98057630 con 0x7f8da80cd9e0 2023-10-14T19:09:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:37.249 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":113,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:36.305179+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:34.735685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:35.268214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:37.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d88067320 msgr2=0x7f8d880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d88067320 0x7f8d880697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d90006fd0 tx=0x7f8d90008040 comp rx=0 tx=0).stop 2023-10-14T19:09:37.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 msgr2=0x7f8da816c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da816c7d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8d980097c0 tx=0x7f8d98019000 comp rx=0 tx=0).stop 2023-10-14T19:09:37.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 shutdown_connections 2023-10-14T19:09:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d88067320 0x7f8d880697d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da816a2e0 0x7f8da816cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8da80cb5a0 0x7f8da8147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 --2- 172.21.15.7:0/1609087236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da80cd9e0 0x7f8da816c7d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 >> 172.21.15.7:0/1609087236 conn(0x7f8da8070e30 msgr2=0x7f8da80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:37.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 shutdown_connections 2023-10-14T19:09:37.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.250+0000 7f8daeb67700 1 -- 172.21.15.7:0/1609087236 wait complete. 2023-10-14T19:09:37.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 Processor -- start 2023-10-14T19:09:37.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 -- start start 2023-10-14T19:09:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1cd0159c20 0x7f1cd00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cd00b0e70 0x7f1cd00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd00adb20 con 0x7f1cd0159850 2023-10-14T19:09:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00ccdc0 con 0x7f1cd0159c20 2023-10-14T19:09:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.382+0000 7f1cd6ffe700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00b12b0 con 0x7f1cd00b0e70 2023-10-14T19:09:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1cd0159c20 0x7f1cd00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1cd0159c20 0x7f1cd00b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45550/0 (socket says 172.21.15.7:45550) 2023-10-14T19:09:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 -- 172.21.15.7:0/4053782361 learned_addr learned my addr 172.21.15.7:0/4053782361 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1cd559b700 1 --2- 172.21.15.7:0/4053782361 >> v2:172.21.15.148:3300/0 conn(0x7f1cd00b0e70 0x7f1cd00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 -- 172.21.15.7:0/4053782361 >> v2:172.21.15.148:3300/0 conn(0x7f1cd00b0e70 msgr2=0x7f1cd00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 --2- 172.21.15.7:0/4053782361 >> v2:172.21.15.148:3300/0 conn(0x7f1cd00b0e70 0x7f1cd00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 -- 172.21.15.7:0/4053782361 >> v1:172.21.15.148:6789/0 conn(0x7f1cd0159850 legacy=0x7f1cd00adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 -- 172.21.15.7:0/4053782361 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00acf10 con 0x7f1cd0159c20 2023-10-14T19:09:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccffff700 1 --2- 172.21.15.7:0/4053782361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159c20 0x7f1cd00b0930 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00aeda0 tx=0x7f1cc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4192da6f1db40d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccf7fe700 1 -- 172.21.15.7:0/4053782361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000e070 con 0x7f1cd0159c20 2023-10-14T19:09:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccf7fe700 1 -- 172.21.15.7:0/4053782361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc000ba10 con 0x7f1cd0159c20 2023-10-14T19:09:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.383+0000 7f1ccf7fe700 1 -- 172.21.15.7:0/4053782361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00092e0 con 0x7f1cd0159c20 2023-10-14T19:09:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/4053782361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159c20 msgr2=0x7f1cd00b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/4053782361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159c20 0x7f1cd00b0930 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00aeda0 tx=0x7f1cc0009840 comp rx=0 tx=0).stop 2023-10-14T19:09:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/4053782361 shutdown_connections 2023-10-14T19:09:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/4053782361 >> v2:172.21.15.148:3300/0 conn(0x7f1cd00b0e70 0x7f1cd00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/4053782361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159c20 0x7f1cd00b0930 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/4053782361 >> 172.21.15.7:0/4053782361 conn(0x7f1cd006d170 msgr2=0x7f1cd00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/4053782361 shutdown_connections 2023-10-14T19:09:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.384+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/4053782361 wait complete. 2023-10-14T19:09:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.385+0000 7f1cd6ffe700 1 Processor -- start 2023-10-14T19:09:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.385+0000 7f1cd6ffe700 1 -- start start 2023-10-14T19:09:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd6ffe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd00b0e70 0x7f1cd00c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd6ffe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 0x7f1cd00abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd6ffe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cd0159c20 0x7f1cd0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd6ffe700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd016ad50 con 0x7f1cd0159850 2023-10-14T19:09:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd6ffe700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00a9cf0 con 0x7f1cd0159c20 2023-10-14T19:09:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd6ffe700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00c2070 con 0x7f1cd00b0e70 2023-10-14T19:09:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 0x7f1cd00abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 0x7f1cd00abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45554/0 (socket says 172.21.15.7:45554) 2023-10-14T19:09:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 -- 172.21.15.7:0/3560243716 learned_addr learned my addr 172.21.15.7:0/3560243716 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd559b700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cd0159c20 0x7f1cd0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1cd4d9a700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd00b0e70 0x7f1cd00c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 -- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd00b0e70 msgr2=0x7f1cd00c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd00b0e70 0x7f1cd00c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 -- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cd0159c20 msgr2=0x7f1cd0156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cd0159c20 0x7f1cd0156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 -- 172.21.15.7:0/3560243716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009ae0 con 0x7f1cd0159850 2023-10-14T19:09:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.386+0000 7f1ccffff700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 0x7f1cd00abe60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009fd0 tx=0x7f1cc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.387+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00094e0 con 0x7f1cd0159850 2023-10-14T19:09:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.387+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0012850 con 0x7f1cd0159850 2023-10-14T19:09:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.387+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd00c2350 con 0x7f1cd0159850 2023-10-14T19:09:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.387+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0012c30 con 0x7f1cd0159850 2023-10-14T19:09:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.387+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd00a9980 con 0x7f1cd0159850 2023-10-14T19:09:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.388+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd00a9e60 con 0x7f1cd0159850 2023-10-14T19:09:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.388+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1cc001e640 con 0x7f1cd0159850 2023-10-14T19:09:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.388+0000 7f1cccff9700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1cb0067320 0x7f1cb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.388+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cc00865e0 con 0x7f1cd0159850 2023-10-14T19:09:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.389+0000 7f1cd4d9a700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1cb0067320 0x7f1cb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.389+0000 7f1cd4d9a700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1cb0067320 0x7f1cb00697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8003a30 tx=0x7f1cb8007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.393+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cc0053260 con 0x7f1cd0159850 2023-10-14T19:09:37.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.587+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cd004c3f0 con 0x7f1cd0159850 2023-10-14T19:09:37.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.588+0000 7f1cccff9700 1 -- 172.21.15.7:0/3560243716 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f1cc0056880 con 0x7f1cd0159850 2023-10-14T19:09:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:37.589 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":113,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:36.305179+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:34.735685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:35.268214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1cb0067320 msgr2=0x7f1cb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1cb0067320 0x7f1cb00697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8003a30 tx=0x7f1cb8007ea0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 msgr2=0x7f1cd00abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 0x7f1cd00abe60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009fd0 tx=0x7f1cc0017000 comp rx=0 tx=0).stop 2023-10-14T19:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 shutdown_connections 2023-10-14T19:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1cb0067320 0x7f1cb00697d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cd0159c20 0x7f1cd0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd00b0e70 0x7f1cd00c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 --2- 172.21.15.7:0/3560243716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0159850 0x7f1cd00abe60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 >> 172.21.15.7:0/3560243716 conn(0x7f1cd006d170 msgr2=0x7f1cd00cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 shutdown_connections 2023-10-14T19:09:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.590+0000 7f1cd6ffe700 1 -- 172.21.15.7:0/3560243716 wait complete. 2023-10-14T19:09:37.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:09:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.725+0000 7fc66759e700 1 Processor -- start 2023-10-14T19:09:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.725+0000 7fc66759e700 1 -- start start 2023-10-14T19:09:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc668153a00 0x7fc668153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66759e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66815ac50 con 0x7fc66815de50 2023-10-14T19:09:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66759e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66815d010 con 0x7fc6680cea00 2023-10-14T19:09:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66815af60 con 0x7fc668153a00 2023-10-14T19:09:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc665d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc66815de50 0x7fc66815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33810/0 (socket says 172.21.15.7:33810) 2023-10-14T19:09:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc665d9b700 1 -- 172.21.15.7:0/1147593292 learned_addr learned my addr 172.21.15.7:0/1147593292 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66659c700 1 --2- 172.21.15.7:0/1147593292 >> v2:172.21.15.148:3300/0 conn(0x7fc668153a00 0x7fc668153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66559a700 1 -- 172.21.15.7:0/1147593292 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723239449 0 0) 0x7fc66815ac50 con 0x7fc66815de50 2023-10-14T19:09:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66559a700 1 -- 172.21.15.7:0/1147593292 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc654003570 con 0x7fc66815de50 2023-10-14T19:09:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66659c700 1 -- 172.21.15.7:0/1147593292 >> v1:172.21.15.148:6789/0 conn(0x7fc6680cea00 legacy=0x7fc6680cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.726+0000 7fc66659c700 1 -- 172.21.15.7:0/1147593292 >> v1:172.21.15.7:6789/0 conn(0x7fc66815de50 legacy=0x7fc66815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66659c700 1 -- 172.21.15.7:0/1147593292 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66815b240 con 0x7fc668153a00 2023-10-14T19:09:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66659c700 1 --2- 172.21.15.7:0/1147593292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc668153a00 0x7fc668153dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6600098e0 tx=0x7fc6600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918da8000fecf0d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66559a700 1 -- 172.21.15.7:0/1147593292 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000b640 con 0x7fc668153a00 2023-10-14T19:09:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66559a700 1 -- 172.21.15.7:0/1147593292 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66000b7a0 con 0x7fc668153a00 2023-10-14T19:09:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66559a700 1 -- 172.21.15.7:0/1147593292 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000bb40 con 0x7fc668153a00 2023-10-14T19:09:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66759e700 1 -- 172.21.15.7:0/1147593292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc668153a00 msgr2=0x7fc668153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66759e700 1 --2- 172.21.15.7:0/1147593292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc668153a00 0x7fc668153dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6600098e0 tx=0x7fc6600091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66759e700 1 -- 172.21.15.7:0/1147593292 shutdown_connections 2023-10-14T19:09:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66759e700 1 --2- 172.21.15.7:0/1147593292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc668153a00 0x7fc668153dd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.727+0000 7fc66759e700 1 -- 172.21.15.7:0/1147593292 >> 172.21.15.7:0/1147593292 conn(0x7fc6680703a0 msgr2=0x7fc6680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.728+0000 7fc66759e700 1 -- 172.21.15.7:0/1147593292 shutdown_connections 2023-10-14T19:09:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.728+0000 7fc66759e700 1 -- 172.21.15.7:0/1147593292 wait complete. 2023-10-14T19:09:37.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 Processor -- start 2023-10-14T19:09:37.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 -- start start 2023-10-14T19:09:37.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6680cea00 0x7fc6681408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 0x7fc6680b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66815de50 0x7fc6681586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668140e10 con 0x7fc668153a00 2023-10-14T19:09:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680c7b30 con 0x7fc6680cea00 2023-10-14T19:09:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc66759e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680c7e10 con 0x7fc66815de50 2023-10-14T19:09:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc665d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 0x7fc6680b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.729+0000 7fc665d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 0x7fc6680b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45570/0 (socket says 172.21.15.7:45570) 2023-10-14T19:09:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 -- 172.21.15.7:0/3472238218 learned_addr learned my addr 172.21.15.7:0/3472238218 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc66659c700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6680cea00 0x7fc6681408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc666d9d700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66815de50 0x7fc6681586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 -- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66815de50 msgr2=0x7fc6681586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66815de50 0x7fc6681586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 -- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6680cea00 msgr2=0x7fc6681408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6680cea00 0x7fc6681408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 -- 172.21.15.7:0/3472238218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009420 con 0x7fc668153a00 2023-10-14T19:09:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc666d9d700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66815de50 0x7fc6681586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc665d9b700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 0x7fc6680b5ab0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c7c0 tx=0x7fc650007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650005b30 con 0x7fc668153a00 2023-10-14T19:09:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650005c90 con 0x7fc668153a00 2023-10-14T19:09:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650007340 con 0x7fc668153a00 2023-10-14T19:09:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680c80f0 con 0x7fc668153a00 2023-10-14T19:09:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.730+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6680c86b0 con 0x7fc668153a00 2023-10-14T19:09:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.731+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc668159780 con 0x7fc668153a00 2023-10-14T19:09:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.732+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc65001b400 con 0x7fc668153a00 2023-10-14T19:09:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.732+0000 7fc65e7fc700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc648067320 0x7fc6480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.732+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc650084610 con 0x7fc668153a00 2023-10-14T19:09:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.732+0000 7fc66659c700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc648067320 0x7fc6480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:37.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.733+0000 7fc66659c700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc648067320 0x7fc6480697d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc6600093f0 tx=0x7fc660017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:37.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.736+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc650051420 con 0x7fc668153a00 2023-10-14T19:09:37.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:37.977+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc6680c88d0 con 0x7fc668153a00 2023-10-14T19:09:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.916+0000 7fc65e7fc700 1 -- 172.21.15.7:0/3472238218 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc650054a40 con 0x7fc668153a00 2023-10-14T19:09:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc648067320 msgr2=0x7fc6480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc648067320 0x7fc6480697d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc6600093f0 tx=0x7fc660017000 comp rx=0 tx=0).stop 2023-10-14T19:09:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 msgr2=0x7fc6680b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 0x7fc6680b5ab0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c7c0 tx=0x7fc650007e00 comp rx=0 tx=0).stop 2023-10-14T19:09:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 shutdown_connections 2023-10-14T19:09:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc648067320 0x7fc6480697d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6680cea00 0x7fc6681408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc66815de50 0x7fc6681586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 --2- 172.21.15.7:0/3472238218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc668153a00 0x7fc6680b5ab0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.919+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 >> 172.21.15.7:0/3472238218 conn(0x7fc6680703a0 msgr2=0x7fc668152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.920+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 shutdown_connections 2023-10-14T19:09:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:38.920+0000 7fc66759e700 1 -- 172.21.15.7:0/3472238218 wait complete. 2023-10-14T19:09:38.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:09:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.063+0000 7fc3f154d700 1 Processor -- start 2023-10-14T19:09:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.063+0000 7fc3f154d700 1 -- start start 2023-10-14T19:09:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3f154d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3ec0cd6b0 0x7fc3ec0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3f154d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0cf510 con 0x7fc3ec0ce220 2023-10-14T19:09:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3f154d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0ce6a0 con 0x7fc3ec159860 2023-10-14T19:09:39.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3f154d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0d00b0 con 0x7fc3ec0cd6b0 2023-10-14T19:09:39.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3eb7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3ec0cd6b0 0x7fc3ec0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:39.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3ea7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3ec0ce220 0x7fc3ec0ccfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33824/0 (socket says 172.21.15.7:33824) 2023-10-14T19:09:39.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.064+0000 7fc3ea7fc700 1 -- 172.21.15.7:0/1661120668 learned_addr learned my addr 172.21.15.7:0/1661120668 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:39.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3eb7fe700 1 -- 172.21.15.7:0/1661120668 >> v1:172.21.15.148:6789/0 conn(0x7fc3ec159860 legacy=0x7fc3ec0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3eb7fe700 1 -- 172.21.15.7:0/1661120668 >> v1:172.21.15.7:6789/0 conn(0x7fc3ec0ce220 legacy=0x7fc3ec0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3eb7fe700 1 -- 172.21.15.7:0/1661120668 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0ce900 con 0x7fc3ec0cd6b0 2023-10-14T19:09:39.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3e9ffb700 1 -- 172.21.15.7:0/1661120668 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431365169 0 0) 0x7fc3ec0cf510 con 0x7fc3ec0ce220 2023-10-14T19:09:39.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3eb7fe700 1 --2- 172.21.15.7:0/1661120668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0cd6b0 0x7fc3ec0cbd90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009e60 tx=0x7fc3dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa56e298d3427ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:39.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3e9ffb700 1 -- 172.21.15.7:0/1661120668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00e070 con 0x7fc3ec0cd6b0 2023-10-14T19:09:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3e9ffb700 1 -- 172.21.15.7:0/1661120668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00bc30 con 0x7fc3ec0cd6b0 2023-10-14T19:09:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.065+0000 7fc3e9ffb700 1 -- 172.21.15.7:0/1661120668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc012430 con 0x7fc3ec0cd6b0 2023-10-14T19:09:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 -- 172.21.15.7:0/1661120668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0cd6b0 msgr2=0x7fc3ec0cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 --2- 172.21.15.7:0/1661120668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0cd6b0 0x7fc3ec0cbd90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009e60 tx=0x7fc3dc009780 comp rx=0 tx=0).stop 2023-10-14T19:09:39.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 -- 172.21.15.7:0/1661120668 shutdown_connections 2023-10-14T19:09:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 --2- 172.21.15.7:0/1661120668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0cd6b0 0x7fc3ec0cbd90 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 -- 172.21.15.7:0/1661120668 >> 172.21.15.7:0/1661120668 conn(0x7fc3ec0999b0 msgr2=0x7fc3ec070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 -- 172.21.15.7:0/1661120668 shutdown_connections 2023-10-14T19:09:39.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.066+0000 7fc3f154d700 1 -- 172.21.15.7:0/1661120668 wait complete. 2023-10-14T19:09:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.067+0000 7fc3f154d700 1 Processor -- start 2023-10-14T19:09:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.067+0000 7fc3f154d700 1 -- start start 2023-10-14T19:09:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3ec0cd6b0 0x7fc3ec0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 0x7fc3ec158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec159860 0x7fc3ec15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0c7ac0 con 0x7fc3ec0ce220 2023-10-14T19:09:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0c5b50 con 0x7fc3ec159860 2023-10-14T19:09:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1591c0 con 0x7fc3ec0cd6b0 2023-10-14T19:09:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 0x7fc3ec158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 0x7fc3ec158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45578/0 (socket says 172.21.15.7:45578) 2023-10-14T19:09:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 -- 172.21.15.7:0/4231604314 learned_addr learned my addr 172.21.15.7:0/4231604314 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 -- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3ec0cd6b0 msgr2=0x7fc3ec0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3ec0cd6b0 0x7fc3ec0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 -- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec159860 msgr2=0x7fc3ec15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec159860 0x7fc3ec15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 -- 172.21.15.7:0/4231604314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc009a20 con 0x7fc3ec0ce220 2023-10-14T19:09:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3ea7fc700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 0x7fc3ec158c80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400c7c0 tx=0x7fc3d4007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40072e0 con 0x7fc3ec0ce220 2023-10-14T19:09:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d4007440 con 0x7fc3ec0ce220 2023-10-14T19:09:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.068+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec15b760 con 0x7fc3ec0ce220 2023-10-14T19:09:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.069+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40057f0 con 0x7fc3ec0ce220 2023-10-14T19:09:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.069+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec0c9910 con 0x7fc3ec0ce220 2023-10-14T19:09:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.069+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec04c3c0 con 0x7fc3ec0ce220 2023-10-14T19:09:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.070+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc3d4005c00 con 0x7fc3ec0ce220 2023-10-14T19:09:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.070+0000 7fc3e2ffd700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3cc067320 0x7fc3cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.071+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3d4084220 con 0x7fc3ec0ce220 2023-10-14T19:09:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.071+0000 7fc3eaffd700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3cc067320 0x7fc3cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.071+0000 7fc3eaffd700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3cc067320 0x7fc3cc0697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4001640 tx=0x7fc3e4007b90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:39.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.075+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3d4050eb0 con 0x7fc3ec0ce220 2023-10-14T19:09:39.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.311+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc3ec06caa0 con 0x7fc3ec0ce220 2023-10-14T19:09:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.921+0000 7fc3e2ffd700 1 -- 172.21.15.7:0/4231604314 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v73) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc3d4001e60 con 0x7fc3ec0ce220 2023-10-14T19:09:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3cc067320 msgr2=0x7fc3cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3cc067320 0x7fc3cc0697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4001640 tx=0x7fc3e4007b90 comp rx=0 tx=0).stop 2023-10-14T19:09:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 msgr2=0x7fc3ec158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 0x7fc3ec158c80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400c7c0 tx=0x7fc3d4007c80 comp rx=0 tx=0).stop 2023-10-14T19:09:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 shutdown_connections 2023-10-14T19:09:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3cc067320 0x7fc3cc0697d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec159860 0x7fc3ec15c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3ec0cd6b0 0x7fc3ec0c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 --2- 172.21.15.7:0/4231604314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3ec0ce220 0x7fc3ec158c80 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 >> 172.21.15.7:0/4231604314 conn(0x7fc3ec0999b0 msgr2=0x7fc3ec0b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 shutdown_connections 2023-10-14T19:09:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:39.923+0000 7fc3f154d700 1 -- 172.21.15.7:0/4231604314 wait complete. 2023-10-14T19:09:39.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:40.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.063+0000 7f366bb1c700 1 Processor -- start 2023-10-14T19:09:40.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.063+0000 7f366bb1c700 1 -- start start 2023-10-14T19:09:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366bb1c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36640cb970 0x7f3664159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366bb1c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f366415a400 0x7f3664156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366bb1c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366415ae40 con 0x7f36640cb5a0 2023-10-14T19:09:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366bb1c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640ce0f0 con 0x7f366415a400 2023-10-14T19:09:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366bb1c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640d13f0 con 0x7f36640cb970 2023-10-14T19:09:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f366415a400 0x7f3664156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f366415a400 0x7f3664156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45584/0 (socket says 172.21.15.7:45584) 2023-10-14T19:09:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 -- 172.21.15.7:0/3088366 learned_addr learned my addr 172.21.15.7:0/3088366 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f36690b7700 1 --2- 172.21.15.7:0/3088366 >> v2:172.21.15.148:3300/0 conn(0x7f36640cb970 0x7f3664159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 -- 172.21.15.7:0/3088366 >> v2:172.21.15.148:3300/0 conn(0x7f36640cb970 msgr2=0x7f3664159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 --2- 172.21.15.7:0/3088366 >> v2:172.21.15.148:3300/0 conn(0x7f36640cb970 0x7f3664159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 -- 172.21.15.7:0/3088366 >> v1:172.21.15.148:6789/0 conn(0x7f36640cb5a0 legacy=0x7f36640cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 -- 172.21.15.7:0/3088366 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366415ab60 con 0x7f366415a400 2023-10-14T19:09:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f36690b7700 1 --2- 172.21.15.7:0/3088366 >> v2:172.21.15.148:3300/0 conn(0x7f36640cb970 0x7f3664159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f366a0b9700 1 --2- 172.21.15.7:0/3088366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f366415a400 0x7f3664156e90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f36640d1780 tx=0x7f3654009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d05a550a766655 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f36688b6700 1 -- 172.21.15.7:0/3088366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365400e070 con 0x7f366415a400 2023-10-14T19:09:40.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f36688b6700 1 -- 172.21.15.7:0/3088366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365400ba10 con 0x7f366415a400 2023-10-14T19:09:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.064+0000 7f36688b6700 1 -- 172.21.15.7:0/3088366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540092e0 con 0x7f366415a400 2023-10-14T19:09:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 -- 172.21.15.7:0/3088366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f366415a400 msgr2=0x7f3664156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 --2- 172.21.15.7:0/3088366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f366415a400 0x7f3664156e90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f36640d1780 tx=0x7f3654009840 comp rx=0 tx=0).stop 2023-10-14T19:09:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 -- 172.21.15.7:0/3088366 shutdown_connections 2023-10-14T19:09:40.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 --2- 172.21.15.7:0/3088366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f366415a400 0x7f3664156e90 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 --2- 172.21.15.7:0/3088366 >> v2:172.21.15.148:3300/0 conn(0x7f36640cb970 0x7f3664159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 -- 172.21.15.7:0/3088366 >> 172.21.15.7:0/3088366 conn(0x7f3664070e30 msgr2=0x7f36640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:40.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 -- 172.21.15.7:0/3088366 shutdown_connections 2023-10-14T19:09:40.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.065+0000 7f366bb1c700 1 -- 172.21.15.7:0/3088366 wait complete. 2023-10-14T19:09:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.066+0000 7f366bb1c700 1 Processor -- start 2023-10-14T19:09:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.066+0000 7f366bb1c700 1 -- start start 2023-10-14T19:09:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366bb1c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36640cb5a0 0x7f3664168b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366bb1c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 0x7f36640b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366bb1c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f366415a400 0x7f36640c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366bb1c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664151720 con 0x7f36640cb970 2023-10-14T19:09:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366bb1c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664151290 con 0x7f36640cb5a0 2023-10-14T19:09:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366bb1c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36640b60f0 con 0x7f366415a400 2023-10-14T19:09:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 0x7f36640b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 0x7f36640b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45592/0 (socket says 172.21.15.7:45592) 2023-10-14T19:09:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 -- 172.21.15.7:0/2642334675 learned_addr learned my addr 172.21.15.7:0/2642334675 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f366a0b9700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f366415a400 0x7f36640c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36698b8700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36640cb5a0 0x7f3664168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 -- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f366415a400 msgr2=0x7f36640c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f366415a400 0x7f36640c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 -- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36640cb5a0 msgr2=0x7f3664168b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36640cb5a0 0x7f3664168b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 -- 172.21.15.7:0/2642334675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3654009ae0 con 0x7f36640cb970 2023-10-14T19:09:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.067+0000 7f36690b7700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 0x7f36640b4170 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f365800c860 tx=0x7f3658008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.068+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658011600 con 0x7f36640cb970 2023-10-14T19:09:40.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.068+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658011760 con 0x7f36640cb970 2023-10-14T19:09:40.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.068+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3664169060 con 0x7f36640cb970 2023-10-14T19:09:40.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.068+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658011b00 con 0x7f36640cb970 2023-10-14T19:09:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.068+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3664150680 con 0x7f36640cb970 2023-10-14T19:09:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.069+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3664151400 con 0x7f36640cb970 2023-10-14T19:09:40.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.069+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f365800a3e0 con 0x7f36640cb970 2023-10-14T19:09:40.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.070+0000 7f3661ffb700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3650067320 0x7f36500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.070+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3658084df0 con 0x7f36640cb970 2023-10-14T19:09:40.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.070+0000 7f36698b8700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3650067320 0x7f36500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.071+0000 7f36698b8700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3650067320 0x7f36500697d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f365c003870 tx=0x7f365c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.074+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3658051970 con 0x7f36640cb970 2023-10-14T19:09:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.311+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f366404c3c0 con 0x7f36640cb970 2023-10-14T19:09:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.312+0000 7f3661ffb700 1 -- 172.21.15.7:0/2642334675 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f3658015090 con 0x7f36640cb970 2023-10-14T19:09:40.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:40.314 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6589,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3885032212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3885032212},{"type":"v1","addr":"172.21.15.148:6837","nonce":3885032212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7113,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3111043599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3111043599},{"type":"v1","addr":"172.21.15.7:6834","nonce":3111043599}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:36.305484+0000","modified":"2023-10-14T19:09:39.916613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/698585291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":698585291},{"type":"v1","addr":"172.21.15.7:6835","nonce":698585291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T19:09:40.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3650067320 msgr2=0x7f36500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3650067320 0x7f36500697d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f365c003870 tx=0x7f365c009040 comp rx=0 tx=0).stop 2023-10-14T19:09:40.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 msgr2=0x7f36640b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 0x7f36640b4170 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f365800c860 tx=0x7f3658008040 comp rx=0 tx=0).stop 2023-10-14T19:09:40.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 shutdown_connections 2023-10-14T19:09:40.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3650067320 0x7f36500697d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36640cb5a0 0x7f3664168b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f366415a400 0x7f36640c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 --2- 172.21.15.7:0/2642334675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36640cb970 0x7f36640b4170 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 >> 172.21.15.7:0/2642334675 conn(0x7f3664070e30 msgr2=0x7f3664155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 shutdown_connections 2023-10-14T19:09:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.314+0000 7f366bb1c700 1 -- 172.21.15.7:0/2642334675 wait complete. 2023-10-14T19:09:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2023-10-14T19:09:40.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:09:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.446+0000 7fa89db92700 1 Processor -- start 2023-10-14T19:09:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.446+0000 7fa89db92700 1 -- start start 2023-10-14T19:09:40.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa89db92700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 0x7fa8980ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa89db92700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 0x7fa8980cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa89db92700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89815a280 con 0x7fa8980b0ba0 2023-10-14T19:09:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa89db92700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89806e180 con 0x7fa8980cf200 2023-10-14T19:09:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa89db92700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980cd540 con 0x7fa8980b07d0 2023-10-14T19:09:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 0x7fa8980ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa896ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 0x7fa8980cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 0x7fa8980ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:58982/0 (socket says 172.21.15.7:58982) 2023-10-14T19:09:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 -- 172.21.15.7:0/1960912180 learned_addr learned my addr 172.21.15.7:0/1960912180 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa896ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 0x7fa8980cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:53120/0 (socket says 172.21.15.7:53120) 2023-10-14T19:09:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 -- 172.21.15.7:0/1960912180 >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 msgr2=0x7fa8980cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 --2- 172.21.15.7:0/1960912180 >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 0x7fa8980cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 -- 172.21.15.7:0/1960912180 >> v1:172.21.15.148:6789/0 conn(0x7fa8980b0ba0 legacy=0x7fa89806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa8977fe700 1 -- 172.21.15.7:0/1960912180 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89806d850 con 0x7fa8980b07d0 2023-10-14T19:09:40.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.447+0000 7fa896ffd700 1 --2- 172.21.15.7:0/1960912180 >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 0x7fa8980cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:40.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa8977fe700 1 --2- 172.21.15.7:0/1960912180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 0x7fa8980ccac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa888009990 tx=0x7fa888009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a3dc1e9b01942a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa8967fc700 1 -- 172.21.15.7:0/1960912180 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888009e80 con 0x7fa8980b07d0 2023-10-14T19:09:40.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa8967fc700 1 -- 172.21.15.7:0/1960912180 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888005c10 con 0x7fa8980b07d0 2023-10-14T19:09:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa8967fc700 1 -- 172.21.15.7:0/1960912180 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88800b6e0 con 0x7fa8980b07d0 2023-10-14T19:09:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa89db92700 1 -- 172.21.15.7:0/1960912180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 msgr2=0x7fa8980ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa89db92700 1 --2- 172.21.15.7:0/1960912180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 0x7fa8980ccac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa888009990 tx=0x7fa888009220 comp rx=0 tx=0).stop 2023-10-14T19:09:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa89db92700 1 -- 172.21.15.7:0/1960912180 shutdown_connections 2023-10-14T19:09:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa89db92700 1 --2- 172.21.15.7:0/1960912180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b07d0 0x7fa8980ccac0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa89db92700 1 --2- 172.21.15.7:0/1960912180 >> v2:172.21.15.148:3300/0 conn(0x7fa8980cf200 0x7fa8980cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.448+0000 7fa89db92700 1 -- 172.21.15.7:0/1960912180 >> 172.21.15.7:0/1960912180 conn(0x7fa89806ce80 msgr2=0x7fa8980ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:40.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.449+0000 7fa89db92700 1 -- 172.21.15.7:0/1960912180 shutdown_connections 2023-10-14T19:09:40.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.449+0000 7fa89db92700 1 -- 172.21.15.7:0/1960912180 wait complete. 2023-10-14T19:09:40.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.450+0000 7fa89db92700 1 Processor -- start 2023-10-14T19:09:40.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.450+0000 7fa89db92700 1 -- start start 2023-10-14T19:09:40.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.450+0000 7fa89db92700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 0x7fa898157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b0ba0 0x7fa89815e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8980cf200 0x7fa898154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89815f840 con 0x7fa8980b07d0 2023-10-14T19:09:40.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89815ec30 con 0x7fa8980cf200 2023-10-14T19:09:40.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89815ef10 con 0x7fa8980b0ba0 2023-10-14T19:09:40.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 0x7fa898157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 0x7fa898157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45608/0 (socket says 172.21.15.7:45608) 2023-10-14T19:09:40.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 -- 172.21.15.7:0/544186202 learned_addr learned my addr 172.21.15.7:0/544186202 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:40.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa897fff700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8980cf200 0x7fa898154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa896ffd700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b0ba0 0x7fa89815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 -- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b0ba0 msgr2=0x7fa89815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b0ba0 0x7fa89815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 -- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8980cf200 msgr2=0x7fa898154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8980cf200 0x7fa898154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 -- 172.21.15.7:0/544186202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009420 con 0x7fa8980b07d0 2023-10-14T19:09:40.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa8977fe700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 0x7fa898157450 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa888007fd0 tx=0x7fa888016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888011950 con 0x7fa8980b07d0 2023-10-14T19:09:40.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888020070 con 0x7fa8980b07d0 2023-10-14T19:09:40.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa888009480 con 0x7fa8980b07d0 2023-10-14T19:09:40.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888011d20 con 0x7fa8980b07d0 2023-10-14T19:09:40.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.451+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89815f4d0 con 0x7fa8980b07d0 2023-10-14T19:09:40.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.452+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8980c94e0 con 0x7fa8980b07d0 2023-10-14T19:09:40.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.453+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa888022030 con 0x7fa8980b07d0 2023-10-14T19:09:40.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.453+0000 7fa87f7fe700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa884067320 0x7fa8840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.453+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa888086650 con 0x7fa8980b07d0 2023-10-14T19:09:40.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.453+0000 7fa896ffd700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa884067320 0x7fa8840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.454+0000 7fa896ffd700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa884067320 0x7fa8840697d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa8980c8ab0 tx=0x7fa88c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.457+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8880533b0 con 0x7fa8980b07d0 2023-10-14T19:09:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.651+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa89804c3c0 con 0x7fa8980b07d0 2023-10-14T19:09:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.651+0000 7fa87f7fe700 1 -- 172.21.15.7:0/544186202 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fa8880569d0 con 0x7fa8980b07d0 2023-10-14T19:09:40.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:40.653 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":114,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:09:37.833209+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:34.735685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:35.268214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:09:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa884067320 msgr2=0x7fa8840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa884067320 0x7fa8840697d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa8980c8ab0 tx=0x7fa88c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 msgr2=0x7fa898157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 0x7fa898157450 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa888007fd0 tx=0x7fa888016000 comp rx=0 tx=0).stop 2023-10-14T19:09:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 shutdown_connections 2023-10-14T19:09:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa884067320 0x7fa8840697d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8980cf200 0x7fa898154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b07d0 0x7fa898157450 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 --2- 172.21.15.7:0/544186202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8980b0ba0 0x7fa89815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 >> 172.21.15.7:0/544186202 conn(0x7fa89806ce80 msgr2=0x7fa8980c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 shutdown_connections 2023-10-14T19:09:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.653+0000 7fa89db92700 1 -- 172.21.15.7:0/544186202 wait complete. 2023-10-14T19:09:40.667 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:09:40.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:09:40.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.785+0000 7ff99fcce700 1 Processor -- start 2023-10-14T19:09:40.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.786+0000 7ff99fcce700 1 -- start start 2023-10-14T19:09:40.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99fcce700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff998155b70 0x7ff9980b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99fcce700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9981589b0 0x7ff9980b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99fcce700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff998157510 con 0x7ff9980add80 2023-10-14T19:09:40.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99fcce700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980ae2f0 con 0x7ff9981589b0 2023-10-14T19:09:40.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99fcce700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980ae5d0 con 0x7ff998155b70 2023-10-14T19:09:40.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99e26b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9981589b0 0x7ff9980b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99d269700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff9980add80 0x7ff998155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33840/0 (socket says 172.21.15.7:33840) 2023-10-14T19:09:40.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99da6a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff998155b70 0x7ff9980b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99d269700 1 -- 172.21.15.7:0/2629445753 learned_addr learned my addr 172.21.15.7:0/2629445753 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99e26b700 1 -- 172.21.15.7:0/2629445753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff998155b70 msgr2=0x7ff9980b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99e26b700 1 --2- 172.21.15.7:0/2629445753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff998155b70 0x7ff9980b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99e26b700 1 -- 172.21.15.7:0/2629445753 >> v1:172.21.15.7:6789/0 conn(0x7ff9980add80 legacy=0x7ff998155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99e26b700 1 -- 172.21.15.7:0/2629445753 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980ae8b0 con 0x7ff9981589b0 2023-10-14T19:09:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99ca68700 1 -- 172.21.15.7:0/2629445753 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373899311 0 0) 0x7ff998157510 con 0x7ff9980add80 2023-10-14T19:09:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99e26b700 1 --2- 172.21.15.7:0/2629445753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9981589b0 0x7ff9980b0740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff988009e60 tx=0x7ff988009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f66ef77207748c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99ca68700 1 -- 172.21.15.7:0/2629445753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800e070 con 0x7ff9981589b0 2023-10-14T19:09:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99ca68700 1 -- 172.21.15.7:0/2629445753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98800bb60 con 0x7ff9981589b0 2023-10-14T19:09:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.787+0000 7ff99ca68700 1 -- 172.21.15.7:0/2629445753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988012430 con 0x7ff9981589b0 2023-10-14T19:09:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 -- 172.21.15.7:0/2629445753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9981589b0 msgr2=0x7ff9980b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 --2- 172.21.15.7:0/2629445753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9981589b0 0x7ff9980b0740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff988009e60 tx=0x7ff988009780 comp rx=0 tx=0).stop 2023-10-14T19:09:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 -- 172.21.15.7:0/2629445753 shutdown_connections 2023-10-14T19:09:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 --2- 172.21.15.7:0/2629445753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9981589b0 0x7ff9980b0740 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 --2- 172.21.15.7:0/2629445753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff998155b70 0x7ff9980b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 -- 172.21.15.7:0/2629445753 >> 172.21.15.7:0/2629445753 conn(0x7ff99806d170 msgr2=0x7ff9980cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 -- 172.21.15.7:0/2629445753 shutdown_connections 2023-10-14T19:09:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.788+0000 7ff99fcce700 1 -- 172.21.15.7:0/2629445753 wait complete. 2023-10-14T19:09:40.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.789+0000 7ff99fcce700 1 Processor -- start 2023-10-14T19:09:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.789+0000 7ff99fcce700 1 -- start start 2023-10-14T19:09:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99fcce700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9980add80 0x7ff99814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99fcce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 0x7ff998147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99fcce700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9981589b0 0x7ff99814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99fcce700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff998167840 con 0x7ff998155b70 2023-10-14T19:09:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99fcce700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99814b270 con 0x7ff9980add80 2023-10-14T19:09:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99fcce700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99814bbe0 con 0x7ff9981589b0 2023-10-14T19:09:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 0x7ff998147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 0x7ff998147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45614/0 (socket says 172.21.15.7:45614) 2023-10-14T19:09:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 -- 172.21.15.7:0/1630933318 learned_addr learned my addr 172.21.15.7:0/1630933318 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 -- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9981589b0 msgr2=0x7ff99814ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99e26b700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9981589b0 0x7ff99814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9981589b0 0x7ff99814ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99da6a700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9980add80 0x7ff99814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 -- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9980add80 msgr2=0x7ff99814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9980add80 0x7ff99814b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 -- 172.21.15.7:0/1630933318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009a20 con 0x7ff998155b70 2023-10-14T19:09:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.790+0000 7ff99d269700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 0x7ff998147500 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c810 tx=0x7ff98c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.791+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c005b30 con 0x7ff998155b70 2023-10-14T19:09:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.791+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c005c90 con 0x7ff998155b70 2023-10-14T19:09:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.791+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c007300 con 0x7ff998155b70 2023-10-14T19:09:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.791+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99806e940 con 0x7ff998155b70 2023-10-14T19:09:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.791+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99806ef00 con 0x7ff998155b70 2023-10-14T19:09:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.792+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99804c3c0 con 0x7ff998155b70 2023-10-14T19:09:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.792+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff98c01b400 con 0x7ff998155b70 2023-10-14T19:09:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.793+0000 7ff995ffb700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff984067320 0x7ff9840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.793+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff98c084710 con 0x7ff998155b70 2023-10-14T19:09:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.793+0000 7ff99da6a700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff984067320 0x7ff9840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.793+0000 7ff99da6a700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff984067320 0x7ff9840697d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff9900093f0 tx=0x7ff990008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:40.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.797+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff98c0514a0 con 0x7ff998155b70 2023-10-14T19:09:40.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.989+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff99806be60 con 0x7ff984067320 2023-10-14T19:09:40.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:40.997+0000 7ff995ffb700 1 -- 172.21.15.7:0/1630933318 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289803 (secure 0 0 0) 0x7ff99806be60 con 0x7ff984067320 2023-10-14T19:09:41.002 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff984067320 msgr2=0x7ff9840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff984067320 0x7ff9840697d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff9900093f0 tx=0x7ff990008040 comp rx=0 tx=0).stop 2023-10-14T19:09:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 msgr2=0x7ff998147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 0x7ff998147500 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c810 tx=0x7ff98c007df0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 shutdown_connections 2023-10-14T19:09:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff984067320 0x7ff9840697d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9980add80 0x7ff99814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9981589b0 0x7ff99814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 --2- 172.21.15.7:0/1630933318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff998155b70 0x7ff998147500 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 >> 172.21.15.7:0/1630933318 conn(0x7ff99806d170 msgr2=0x7ff9981566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 shutdown_connections 2023-10-14T19:09:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.001+0000 7ff99fcce700 1 -- 172.21.15.7:0/1630933318 wait complete. 2023-10-14T19:09:41.007 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:09:41.014 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2023-10-14T19:09:39.716663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419220,"kb_used_data":12244,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752555500,"statfs":{"total":773094113280,"available":770616832000,"internally_reserved":0,"allocated":12537856,"data_stored":6056057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827751"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851711+0000","last_change":"2023-10-14T19:09:36.851711+0000","last_active":"2023-10-14T19:09:36.851711+0000","last_peered":"2023-10-14T19:09:36.851711+0000","last_clean":"2023-10-14T19:09:36.851711+0000","last_became_active":"2023-10-14T19:09:36.851419+0000","last_became_peered":"2023-10-14T19:09:36.851419+0000","last_unstale":"2023-10-14T19:09:36.851711+0000","last_undegraded":"2023-10-14T19:09:36.851711+0000","last_fullsized":"2023-10-14T19:09:36.851711+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:10:10.757019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.855013+0000","last_change":"2023-10-14T19:09:36.855013+0000","last_active":"2023-10-14T19:09:36.855013+0000","last_peered":"2023-10-14T19:09:36.855013+0000","last_clean":"2023-10-14T19:09:36.855013+0000","last_became_active":"2023-10-14T19:09:36.854718+0000","last_became_peered":"2023-10-14T19:09:36.854718+0000","last_unstale":"2023-10-14T19:09:36.855013+0000","last_undegraded":"2023-10-14T19:09:36.855013+0000","last_fullsized":"2023-10-14T19:09:36.855013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:00.333528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851536+0000","last_change":"2023-10-14T19:09:36.851536+0000","last_active":"2023-10-14T19:09:36.851536+0000","last_peered":"2023-10-14T19:09:36.851536+0000","last_clean":"2023-10-14T19:09:36.851536+0000","last_became_active":"2023-10-14T19:09:36.851276+0000","last_became_peered":"2023-10-14T19:09:36.851276+0000","last_unstale":"2023-10-14T19:09:36.851536+0000","last_undegraded":"2023-10-14T19:09:36.851536+0000","last_fullsized":"2023-10-14T19:09:36.851536+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:34.920362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847199+0000","last_change":"2023-10-14T19:09:36.847199+0000","last_active":"2023-10-14T19:09:36.847199+0000","last_peered":"2023-10-14T19:09:36.847199+0000","last_clean":"2023-10-14T19:09:36.847199+0000","last_became_active":"2023-10-14T19:09:36.846948+0000","last_became_peered":"2023-10-14T19:09:36.846948+0000","last_unstale":"2023-10-14T19:09:36.847199+0000","last_undegraded":"2023-10-14T19:09:36.847199+0000","last_fullsized":"2023-10-14T19:09:36.847199+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:01.790674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849633+0000","last_change":"2023-10-14T19:09:36.849633+0000","last_active":"2023-10-14T19:09:36.849633+0000","last_peered":"2023-10-14T19:09:36.849633+0000","last_clean":"2023-10-14T19:09:36.849633+0000","last_became_active":"2023-10-14T19:09:36.849327+0000","last_became_peered":"2023-10-14T19:09:36.849327+0000","last_unstale":"2023-10-14T19:09:36.849633+0000","last_undegraded":"2023-10-14T19:09:36.849633+0000","last_fullsized":"2023-10-14T19:09:36.849633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:25.092554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.843899+0000","last_change":"2023-10-14T19:09:36.843899+0000","last_active":"2023-10-14T19:09:36.843899+0000","last_peered":"2023-10-14T19:09:36.843899+0000","last_clean":"2023-10-14T19:09:36.843899+0000","last_became_active":"2023-10-14T19:09:36.843624+0000","last_became_peered":"2023-10-14T19:09:36.843624+0000","last_unstale":"2023-10-14T19:09:36.843899+0000","last_undegraded":"2023-10-14T19:09:36.843899+0000","last_fullsized":"2023-10-14T19:09:36.843899+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:20.334984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852585+0000","last_change":"2023-10-14T19:09:36.852585+0000","last_active":"2023-10-14T19:09:36.852585+0000","last_peered":"2023-10-14T19:09:36.852585+0000","last_clean":"2023-10-14T19:09:36.852585+0000","last_became_active":"2023-10-14T19:09:36.852298+0000","last_became_peered":"2023-10-14T19:09:36.852298+0000","last_unstale":"2023-10-14T19:09:36.852585+0000","last_undegraded":"2023-10-14T19:09:36.852585+0000","last_fullsized":"2023-10-14T19:09:36.852585+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:46.135677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853082+0000","last_change":"2023-10-14T19:09:36.853082+0000","last_active":"2023-10-14T19:09:36.853082+0000","last_peered":"2023-10-14T19:09:36.853082+0000","last_clean":"2023-10-14T19:09:36.853082+0000","last_became_active":"2023-10-14T19:09:36.852756+0000","last_became_peered":"2023-10-14T19:09:36.852756+0000","last_unstale":"2023-10-14T19:09:36.853082+0000","last_undegraded":"2023-10-14T19:09:36.853082+0000","last_fullsized":"2023-10-14T19:09:36.853082+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:00.333528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850164+0000","last_change":"2023-10-14T19:09:36.850164+0000","last_active":"2023-10-14T19:09:36.850164+0000","last_peered":"2023-10-14T19:09:36.850164+0000","last_clean":"2023-10-14T19:09:36.850164+0000","last_became_active":"2023-10-14T19:09:36.849759+0000","last_became_peered":"2023-10-14T19:09:36.849759+0000","last_unstale":"2023-10-14T19:09:36.850164+0000","last_undegraded":"2023-10-14T19:09:36.850164+0000","last_fullsized":"2023-10-14T19:09:36.850164+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:48.436109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854981+0000","last_change":"2023-10-14T19:09:36.854981+0000","last_active":"2023-10-14T19:09:36.854981+0000","last_peered":"2023-10-14T19:09:36.854981+0000","last_clean":"2023-10-14T19:09:36.854981+0000","last_became_active":"2023-10-14T19:09:36.854616+0000","last_became_peered":"2023-10-14T19:09:36.854616+0000","last_unstale":"2023-10-14T19:09:36.854981+0000","last_undegraded":"2023-10-14T19:09:36.854981+0000","last_fullsized":"2023-10-14T19:09:36.854981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:57.724436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852925+0000","last_change":"2023-10-14T19:09:36.852925+0000","last_active":"2023-10-14T19:09:36.852925+0000","last_peered":"2023-10-14T19:09:36.852925+0000","last_clean":"2023-10-14T19:09:36.852925+0000","last_became_active":"2023-10-14T19:09:36.852300+0000","last_became_peered":"2023-10-14T19:09:36.852300+0000","last_unstale":"2023-10-14T19:09:36.852925+0000","last_undegraded":"2023-10-14T19:09:36.852925+0000","last_fullsized":"2023-10-14T19:09:36.852925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:14.996662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850226+0000","last_change":"2023-10-14T19:09:36.850226+0000","last_active":"2023-10-14T19:09:36.850226+0000","last_peered":"2023-10-14T19:09:36.850226+0000","last_clean":"2023-10-14T19:09:36.850226+0000","last_became_active":"2023-10-14T19:09:36.849969+0000","last_became_peered":"2023-10-14T19:09:36.849969+0000","last_unstale":"2023-10-14T19:09:36.850226+0000","last_undegraded":"2023-10-14T19:09:36.850226+0000","last_fullsized":"2023-10-14T19:09:36.850226+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:21.045283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853558+0000","last_change":"2023-10-14T19:09:36.853558+0000","last_active":"2023-10-14T19:09:36.853558+0000","last_peered":"2023-10-14T19:09:36.853558+0000","last_clean":"2023-10-14T19:09:36.853558+0000","last_became_active":"2023-10-14T19:09:36.852624+0000","last_became_peered":"2023-10-14T19:09:36.852624+0000","last_unstale":"2023-10-14T19:09:36.853558+0000","last_undegraded":"2023-10-14T19:09:36.853558+0000","last_fullsized":"2023-10-14T19:09:36.853558+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:29.446051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.857849+0000","last_change":"2023-10-14T19:09:36.857849+0000","last_active":"2023-10-14T19:09:36.857849+0000","last_peered":"2023-10-14T19:09:36.857849+0000","last_clean":"2023-10-14T19:09:36.857849+0000","last_became_active":"2023-10-14T19:09:36.857556+0000","last_became_peered":"2023-10-14T19:09:36.857556+0000","last_unstale":"2023-10-14T19:09:36.857849+0000","last_undegraded":"2023-10-14T19:09:36.857849+0000","last_fullsized":"2023-10-14T19:09:36.857849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:46.255941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853308+0000","last_change":"2023-10-14T19:09:36.853308+0000","last_active":"2023-10-14T19:09:36.853308+0000","last_peered":"2023-10-14T19:09:36.853308+0000","last_clean":"2023-10-14T19:09:36.853308+0000","last_became_active":"2023-10-14T19:09:36.853048+0000","last_became_peered":"2023-10-14T19:09:36.853048+0000","last_unstale":"2023-10-14T19:09:36.853308+0000","last_undegraded":"2023-10-14T19:09:36.853308+0000","last_fullsized":"2023-10-14T19:09:36.853308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:26.688556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849174+0000","last_change":"2023-10-14T19:09:36.849174+0000","last_active":"2023-10-14T19:09:36.849174+0000","last_peered":"2023-10-14T19:09:36.849174+0000","last_clean":"2023-10-14T19:09:36.849174+0000","last_became_active":"2023-10-14T19:09:36.847943+0000","last_became_peered":"2023-10-14T19:09:36.847943+0000","last_unstale":"2023-10-14T19:09:36.849174+0000","last_undegraded":"2023-10-14T19:09:36.849174+0000","last_fullsized":"2023-10-14T19:09:36.849174+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:27.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845611+0000","last_change":"2023-10-14T19:09:36.845611+0000","last_active":"2023-10-14T19:09:36.845611+0000","last_peered":"2023-10-14T19:09:36.845611+0000","last_clean":"2023-10-14T19:09:36.845611+0000","last_became_active":"2023-10-14T19:09:36.844365+0000","last_became_peered":"2023-10-14T19:09:36.844365+0000","last_unstale":"2023-10-14T19:09:36.845611+0000","last_undegraded":"2023-10-14T19:09:36.845611+0000","last_fullsized":"2023-10-14T19:09:36.845611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:34.444315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853670+0000","last_change":"2023-10-14T19:09:36.853670+0000","last_active":"2023-10-14T19:09:36.853670+0000","last_peered":"2023-10-14T19:09:36.853670+0000","last_clean":"2023-10-14T19:09:36.853670+0000","last_became_active":"2023-10-14T19:09:36.853342+0000","last_became_peered":"2023-10-14T19:09:36.853342+0000","last_unstale":"2023-10-14T19:09:36.853670+0000","last_undegraded":"2023-10-14T19:09:36.853670+0000","last_fullsized":"2023-10-14T19:09:36.853670+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:59.972880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850403+0000","last_change":"2023-10-14T19:09:36.850403+0000","last_active":"2023-10-14T19:09:36.850403+0000","last_peered":"2023-10-14T19:09:36.850403+0000","last_clean":"2023-10-14T19:09:36.850403+0000","last_became_active":"2023-10-14T19:09:36.849846+0000","last_became_peered":"2023-10-14T19:09:36.849846+0000","last_unstale":"2023-10-14T19:09:36.850403+0000","last_undegraded":"2023-10-14T19:09:36.850403+0000","last_fullsized":"2023-10-14T19:09:36.850403+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:06:23.495975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.855880+0000","last_change":"2023-10-14T19:09:36.855880+0000","last_active":"2023-10-14T19:09:36.855880+0000","last_peered":"2023-10-14T19:09:36.855880+0000","last_clean":"2023-10-14T19:09:36.855880+0000","last_became_active":"2023-10-14T19:09:36.855580+0000","last_became_peered":"2023-10-14T19:09:36.855580+0000","last_unstale":"2023-10-14T19:09:36.855880+0000","last_undegraded":"2023-10-14T19:09:36.855880+0000","last_fullsized":"2023-10-14T19:09:36.855880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:21.808725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850765+0000","last_change":"2023-10-14T19:09:36.850765+0000","last_active":"2023-10-14T19:09:36.850765+0000","last_peered":"2023-10-14T19:09:36.850765+0000","last_clean":"2023-10-14T19:09:36.850765+0000","last_became_active":"2023-10-14T19:09:36.850499+0000","last_became_peered":"2023-10-14T19:09:36.850499+0000","last_unstale":"2023-10-14T19:09:36.850765+0000","last_undegraded":"2023-10-14T19:09:36.850765+0000","last_fullsized":"2023-10-14T19:09:36.850765+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:25.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851667+0000","last_change":"2023-10-14T19:09:36.851667+0000","last_active":"2023-10-14T19:09:36.851667+0000","last_peered":"2023-10-14T19:09:36.851667+0000","last_clean":"2023-10-14T19:09:36.851667+0000","last_became_active":"2023-10-14T19:09:36.851368+0000","last_became_peered":"2023-10-14T19:09:36.851368+0000","last_unstale":"2023-10-14T19:09:36.851667+0000","last_undegraded":"2023-10-14T19:09:36.851667+0000","last_fullsized":"2023-10-14T19:09:36.851667+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:20:40.022873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851093+0000","last_change":"2023-10-14T19:09:36.851093+0000","last_active":"2023-10-14T19:09:36.851093+0000","last_peered":"2023-10-14T19:09:36.851093+0000","last_clean":"2023-10-14T19:09:36.851093+0000","last_became_active":"2023-10-14T19:09:36.850793+0000","last_became_peered":"2023-10-14T19:09:36.850793+0000","last_unstale":"2023-10-14T19:09:36.851093+0000","last_undegraded":"2023-10-14T19:09:36.851093+0000","last_fullsized":"2023-10-14T19:09:36.851093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:26:53.675656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.841409+0000","last_change":"2023-10-14T19:09:36.841409+0000","last_active":"2023-10-14T19:09:36.841409+0000","last_peered":"2023-10-14T19:09:36.841409+0000","last_clean":"2023-10-14T19:09:36.841409+0000","last_became_active":"2023-10-14T19:09:36.841104+0000","last_became_peered":"2023-10-14T19:09:36.841104+0000","last_unstale":"2023-10-14T19:09:36.841409+0000","last_undegraded":"2023-10-14T19:09:36.841409+0000","last_fullsized":"2023-10-14T19:09:36.841409+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:48.913159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852313+0000","last_change":"2023-10-14T19:09:36.852313+0000","last_active":"2023-10-14T19:09:36.852313+0000","last_peered":"2023-10-14T19:09:36.852313+0000","last_clean":"2023-10-14T19:09:36.852313+0000","last_became_active":"2023-10-14T19:09:36.851838+0000","last_became_peered":"2023-10-14T19:09:36.851838+0000","last_unstale":"2023-10-14T19:09:36.852313+0000","last_undegraded":"2023-10-14T19:09:36.852313+0000","last_fullsized":"2023-10-14T19:09:36.852313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:49.505693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848219+0000","last_change":"2023-10-14T19:09:36.848219+0000","last_active":"2023-10-14T19:09:36.848219+0000","last_peered":"2023-10-14T19:09:36.848219+0000","last_clean":"2023-10-14T19:09:36.848219+0000","last_became_active":"2023-10-14T19:09:36.847829+0000","last_became_peered":"2023-10-14T19:09:36.847829+0000","last_unstale":"2023-10-14T19:09:36.848219+0000","last_undegraded":"2023-10-14T19:09:36.848219+0000","last_fullsized":"2023-10-14T19:09:36.848219+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:25.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851654+0000","last_change":"2023-10-14T19:09:36.851654+0000","last_active":"2023-10-14T19:09:36.851654+0000","last_peered":"2023-10-14T19:09:36.851654+0000","last_clean":"2023-10-14T19:09:36.851654+0000","last_became_active":"2023-10-14T19:09:36.851374+0000","last_became_peered":"2023-10-14T19:09:36.851374+0000","last_unstale":"2023-10-14T19:09:36.851654+0000","last_undegraded":"2023-10-14T19:09:36.851654+0000","last_fullsized":"2023-10-14T19:09:36.851654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:58.692645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845186+0000","last_change":"2023-10-14T19:09:36.845186+0000","last_active":"2023-10-14T19:09:36.845186+0000","last_peered":"2023-10-14T19:09:36.845186+0000","last_clean":"2023-10-14T19:09:36.845186+0000","last_became_active":"2023-10-14T19:09:36.844819+0000","last_became_peered":"2023-10-14T19:09:36.844819+0000","last_unstale":"2023-10-14T19:09:36.845186+0000","last_undegraded":"2023-10-14T19:09:36.845186+0000","last_fullsized":"2023-10-14T19:09:36.845186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:34.920362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853291+0000","last_change":"2023-10-14T19:09:36.853291+0000","last_active":"2023-10-14T19:09:36.853291+0000","last_peered":"2023-10-14T19:09:36.853291+0000","last_clean":"2023-10-14T19:09:36.853291+0000","last_became_active":"2023-10-14T19:09:36.852988+0000","last_became_peered":"2023-10-14T19:09:36.852988+0000","last_unstale":"2023-10-14T19:09:36.853291+0000","last_undegraded":"2023-10-14T19:09:36.853291+0000","last_fullsized":"2023-10-14T19:09:36.853291+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:48.379109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850322+0000","last_change":"2023-10-14T19:09:36.850322+0000","last_active":"2023-10-14T19:09:36.850322+0000","last_peered":"2023-10-14T19:09:36.850322+0000","last_clean":"2023-10-14T19:09:36.850322+0000","last_became_active":"2023-10-14T19:09:36.850022+0000","last_became_peered":"2023-10-14T19:09:36.850022+0000","last_unstale":"2023-10-14T19:09:36.850322+0000","last_undegraded":"2023-10-14T19:09:36.850322+0000","last_fullsized":"2023-10-14T19:09:36.850322+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:03:20.148302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848967+0000","last_change":"2023-10-14T19:09:36.848967+0000","last_active":"2023-10-14T19:09:36.848967+0000","last_peered":"2023-10-14T19:09:36.848967+0000","last_clean":"2023-10-14T19:09:36.848967+0000","last_became_active":"2023-10-14T19:09:36.848109+0000","last_became_peered":"2023-10-14T19:09:36.848109+0000","last_unstale":"2023-10-14T19:09:36.848967+0000","last_undegraded":"2023-10-14T19:09:36.848967+0000","last_fullsized":"2023-10-14T19:09:36.848967+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:07.540919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.843232+0000","last_change":"2023-10-14T19:09:36.843232+0000","last_active":"2023-10-14T19:09:36.843232+0000","last_peered":"2023-10-14T19:09:36.843232+0000","last_clean":"2023-10-14T19:09:36.843232+0000","last_became_active":"2023-10-14T19:09:36.842981+0000","last_became_peered":"2023-10-14T19:09:36.842981+0000","last_unstale":"2023-10-14T19:09:36.843232+0000","last_undegraded":"2023-10-14T19:09:36.843232+0000","last_fullsized":"2023-10-14T19:09:36.843232+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:31.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848534+0000","last_change":"2023-10-14T19:09:36.848534+0000","last_active":"2023-10-14T19:09:36.848534+0000","last_peered":"2023-10-14T19:09:36.848534+0000","last_clean":"2023-10-14T19:09:36.848534+0000","last_became_active":"2023-10-14T19:09:36.848222+0000","last_became_peered":"2023-10-14T19:09:36.848222+0000","last_unstale":"2023-10-14T19:09:36.848534+0000","last_undegraded":"2023-10-14T19:09:36.848534+0000","last_fullsized":"2023-10-14T19:09:36.848534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:41:00.941110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"113'4","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.905914+0000","last_change":"2023-10-14T19:09:35.917961+0000","last_active":"2023-10-14T19:09:36.905914+0000","last_peered":"2023-10-14T19:09:36.905914+0000","last_clean":"2023-10-14T19:09:36.905914+0000","last_became_active":"2023-10-14T19:09:35.917586+0000","last_became_peered":"2023-10-14T19:09:35.917586+0000","last_unstale":"2023-10-14T19:09:36.905914+0000","last_undegraded":"2023-10-14T19:09:36.905914+0000","last_fullsized":"2023-10-14T19:09:36.905914+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:52.536917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849461+0000","last_change":"2023-10-14T19:09:36.849461+0000","last_active":"2023-10-14T19:09:36.849461+0000","last_peered":"2023-10-14T19:09:36.849461+0000","last_clean":"2023-10-14T19:09:36.849461+0000","last_became_active":"2023-10-14T19:09:36.849189+0000","last_became_peered":"2023-10-14T19:09:36.849189+0000","last_unstale":"2023-10-14T19:09:36.849461+0000","last_undegraded":"2023-10-14T19:09:36.849461+0000","last_fullsized":"2023-10-14T19:09:36.849461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:08.747847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.837427+0000","last_change":"2023-10-14T19:09:35.908525+0000","last_active":"2023-10-14T19:09:36.837427+0000","last_peered":"2023-10-14T19:09:36.837427+0000","last_clean":"2023-10-14T19:09:36.837427+0000","last_became_active":"2023-10-14T19:09:35.908273+0000","last_became_peered":"2023-10-14T19:09:35.908273+0000","last_unstale":"2023-10-14T19:09:36.837427+0000","last_undegraded":"2023-10-14T19:09:36.837427+0000","last_fullsized":"2023-10-14T19:09:36.837427+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:28.015884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854475+0000","last_change":"2023-10-14T19:09:36.854475+0000","last_active":"2023-10-14T19:09:36.854475+0000","last_peered":"2023-10-14T19:09:36.854475+0000","last_clean":"2023-10-14T19:09:36.854475+0000","last_became_active":"2023-10-14T19:09:36.853835+0000","last_became_peered":"2023-10-14T19:09:36.853835+0000","last_unstale":"2023-10-14T19:09:36.854475+0000","last_undegraded":"2023-10-14T19:09:36.854475+0000","last_fullsized":"2023-10-14T19:09:36.854475+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:21.808725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904161+0000","last_change":"2023-10-14T19:09:35.908011+0000","last_active":"2023-10-14T19:09:36.904161+0000","last_peered":"2023-10-14T19:09:36.904161+0000","last_clean":"2023-10-14T19:09:36.904161+0000","last_became_active":"2023-10-14T19:09:35.907671+0000","last_became_peered":"2023-10-14T19:09:35.907671+0000","last_unstale":"2023-10-14T19:09:36.904161+0000","last_undegraded":"2023-10-14T19:09:36.904161+0000","last_fullsized":"2023-10-14T19:09:36.904161+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:32.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852559+0000","last_change":"2023-10-14T19:09:36.852559+0000","last_active":"2023-10-14T19:09:36.852559+0000","last_peered":"2023-10-14T19:09:36.852559+0000","last_clean":"2023-10-14T19:09:36.852559+0000","last_became_active":"2023-10-14T19:09:36.852257+0000","last_became_peered":"2023-10-14T19:09:36.852257+0000","last_unstale":"2023-10-14T19:09:36.852559+0000","last_undegraded":"2023-10-14T19:09:36.852559+0000","last_fullsized":"2023-10-14T19:09:36.852559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:49.538483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.903070+0000","last_change":"2023-10-14T19:09:35.911261+0000","last_active":"2023-10-14T19:09:36.903070+0000","last_peered":"2023-10-14T19:09:36.903070+0000","last_clean":"2023-10-14T19:09:36.903070+0000","last_became_active":"2023-10-14T19:09:35.910966+0000","last_became_peered":"2023-10-14T19:09:35.910966+0000","last_unstale":"2023-10-14T19:09:36.903070+0000","last_undegraded":"2023-10-14T19:09:36.903070+0000","last_fullsized":"2023-10-14T19:09:36.903070+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:32.575520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853046+0000","last_change":"2023-10-14T19:09:36.853046+0000","last_active":"2023-10-14T19:09:36.853046+0000","last_peered":"2023-10-14T19:09:36.853046+0000","last_clean":"2023-10-14T19:09:36.853046+0000","last_became_active":"2023-10-14T19:09:36.852755+0000","last_became_peered":"2023-10-14T19:09:36.852755+0000","last_unstale":"2023-10-14T19:09:36.853046+0000","last_undegraded":"2023-10-14T19:09:36.853046+0000","last_fullsized":"2023-10-14T19:09:36.853046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:55.811537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.843417+0000","last_change":"2023-10-14T19:09:35.912691+0000","last_active":"2023-10-14T19:09:36.843417+0000","last_peered":"2023-10-14T19:09:36.843417+0000","last_clean":"2023-10-14T19:09:36.843417+0000","last_became_active":"2023-10-14T19:09:35.912056+0000","last_became_peered":"2023-10-14T19:09:35.912056+0000","last_unstale":"2023-10-14T19:09:36.843417+0000","last_undegraded":"2023-10-14T19:09:36.843417+0000","last_fullsized":"2023-10-14T19:09:36.843417+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:11.705200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.844676+0000","last_change":"2023-10-14T19:09:36.844676+0000","last_active":"2023-10-14T19:09:36.844676+0000","last_peered":"2023-10-14T19:09:36.844676+0000","last_clean":"2023-10-14T19:09:36.844676+0000","last_became_active":"2023-10-14T19:09:36.844419+0000","last_became_peered":"2023-10-14T19:09:36.844419+0000","last_unstale":"2023-10-14T19:09:36.844676+0000","last_undegraded":"2023-10-14T19:09:36.844676+0000","last_fullsized":"2023-10-14T19:09:36.844676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:46.255941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.839979+0000","last_change":"2023-10-14T19:09:35.916103+0000","last_active":"2023-10-14T19:09:36.839979+0000","last_peered":"2023-10-14T19:09:36.839979+0000","last_clean":"2023-10-14T19:09:36.839979+0000","last_became_active":"2023-10-14T19:09:35.915751+0000","last_became_peered":"2023-10-14T19:09:35.915751+0000","last_unstale":"2023-10-14T19:09:36.839979+0000","last_undegraded":"2023-10-14T19:09:36.839979+0000","last_fullsized":"2023-10-14T19:09:36.839979+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:21:08.306476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851793+0000","last_change":"2023-10-14T19:09:36.851793+0000","last_active":"2023-10-14T19:09:36.851793+0000","last_peered":"2023-10-14T19:09:36.851793+0000","last_clean":"2023-10-14T19:09:36.851793+0000","last_became_active":"2023-10-14T19:09:36.849906+0000","last_became_peered":"2023-10-14T19:09:36.849906+0000","last_unstale":"2023-10-14T19:09:36.851793+0000","last_undegraded":"2023-10-14T19:09:36.851793+0000","last_fullsized":"2023-10-14T19:09:36.851793+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:57.724436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911278+0000","last_change":"2023-10-14T19:09:35.908806+0000","last_active":"2023-10-14T19:09:35.911278+0000","last_peered":"2023-10-14T19:09:35.911278+0000","last_clean":"2023-10-14T19:09:35.911278+0000","last_became_active":"2023-10-14T19:09:35.908557+0000","last_became_peered":"2023-10-14T19:09:35.908557+0000","last_unstale":"2023-10-14T19:09:35.911278+0000","last_undegraded":"2023-10-14T19:09:35.911278+0000","last_fullsized":"2023-10-14T19:09:35.911278+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:20.038996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.857143+0000","last_change":"2023-10-14T19:09:36.857143+0000","last_active":"2023-10-14T19:09:36.857143+0000","last_peered":"2023-10-14T19:09:36.857143+0000","last_clean":"2023-10-14T19:09:36.857143+0000","last_became_active":"2023-10-14T19:09:36.856905+0000","last_became_peered":"2023-10-14T19:09:36.856905+0000","last_unstale":"2023-10-14T19:09:36.857143+0000","last_undegraded":"2023-10-14T19:09:36.857143+0000","last_fullsized":"2023-10-14T19:09:36.857143+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:43.644351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.914471+0000","last_change":"2023-10-14T19:09:35.910314+0000","last_active":"2023-10-14T19:09:35.914471+0000","last_peered":"2023-10-14T19:09:35.914471+0000","last_clean":"2023-10-14T19:09:35.914471+0000","last_became_active":"2023-10-14T19:09:35.910049+0000","last_became_peered":"2023-10-14T19:09:35.910049+0000","last_unstale":"2023-10-14T19:09:35.914471+0000","last_undegraded":"2023-10-14T19:09:35.914471+0000","last_fullsized":"2023-10-14T19:09:35.914471+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:24:12.975846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.842844+0000","last_change":"2023-10-14T19:09:36.842844+0000","last_active":"2023-10-14T19:09:36.842844+0000","last_peered":"2023-10-14T19:09:36.842844+0000","last_clean":"2023-10-14T19:09:36.842844+0000","last_became_active":"2023-10-14T19:09:36.842569+0000","last_became_peered":"2023-10-14T19:09:36.842569+0000","last_unstale":"2023-10-14T19:09:36.842844+0000","last_undegraded":"2023-10-14T19:09:36.842844+0000","last_fullsized":"2023-10-14T19:09:36.842844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:33:47.786011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.923361+0000","last_change":"2023-10-14T19:09:35.915609+0000","last_active":"2023-10-14T19:09:35.923361+0000","last_peered":"2023-10-14T19:09:35.923361+0000","last_clean":"2023-10-14T19:09:35.923361+0000","last_became_active":"2023-10-14T19:09:35.915356+0000","last_became_peered":"2023-10-14T19:09:35.915356+0000","last_unstale":"2023-10-14T19:09:35.923361+0000","last_undegraded":"2023-10-14T19:09:35.923361+0000","last_fullsized":"2023-10-14T19:09:35.923361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:36.099899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845299+0000","last_change":"2023-10-14T19:09:36.845299+0000","last_active":"2023-10-14T19:09:36.845299+0000","last_peered":"2023-10-14T19:09:36.845299+0000","last_clean":"2023-10-14T19:09:36.845299+0000","last_became_active":"2023-10-14T19:09:36.845009+0000","last_became_peered":"2023-10-14T19:09:36.845009+0000","last_unstale":"2023-10-14T19:09:36.845299+0000","last_undegraded":"2023-10-14T19:09:36.845299+0000","last_fullsized":"2023-10-14T19:09:36.845299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:53.423764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911613+0000","last_change":"2023-10-14T19:09:35.908276+0000","last_active":"2023-10-14T19:09:35.911613+0000","last_peered":"2023-10-14T19:09:35.911613+0000","last_clean":"2023-10-14T19:09:35.911613+0000","last_became_active":"2023-10-14T19:09:35.907995+0000","last_became_peered":"2023-10-14T19:09:35.907995+0000","last_unstale":"2023-10-14T19:09:35.911613+0000","last_undegraded":"2023-10-14T19:09:35.911613+0000","last_fullsized":"2023-10-14T19:09:35.911613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:45.129391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847933+0000","last_change":"2023-10-14T19:09:36.847933+0000","last_active":"2023-10-14T19:09:36.847933+0000","last_peered":"2023-10-14T19:09:36.847933+0000","last_clean":"2023-10-14T19:09:36.847933+0000","last_became_active":"2023-10-14T19:09:36.847622+0000","last_became_peered":"2023-10-14T19:09:36.847622+0000","last_unstale":"2023-10-14T19:09:36.847933+0000","last_undegraded":"2023-10-14T19:09:36.847933+0000","last_fullsized":"2023-10-14T19:09:36.847933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:27.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"113'3","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.902099+0000","last_change":"2023-10-14T19:09:35.909027+0000","last_active":"2023-10-14T19:09:36.902099+0000","last_peered":"2023-10-14T19:09:36.902099+0000","last_clean":"2023-10-14T19:09:36.902099+0000","last_became_active":"2023-10-14T19:09:35.908786+0000","last_became_peered":"2023-10-14T19:09:35.908786+0000","last_unstale":"2023-10-14T19:09:36.902099+0000","last_undegraded":"2023-10-14T19:09:36.902099+0000","last_fullsized":"2023-10-14T19:09:36.902099+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:08.090524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853694+0000","last_change":"2023-10-14T19:09:36.853694+0000","last_active":"2023-10-14T19:09:36.853694+0000","last_peered":"2023-10-14T19:09:36.853694+0000","last_clean":"2023-10-14T19:09:36.853694+0000","last_became_active":"2023-10-14T19:09:36.853409+0000","last_became_peered":"2023-10-14T19:09:36.853409+0000","last_unstale":"2023-10-14T19:09:36.853694+0000","last_undegraded":"2023-10-14T19:09:36.853694+0000","last_fullsized":"2023-10-14T19:09:36.853694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:12.546010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"113'6","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.906671+0000","last_change":"2023-10-14T19:09:35.907155+0000","last_active":"2023-10-14T19:09:36.906671+0000","last_peered":"2023-10-14T19:09:36.906671+0000","last_clean":"2023-10-14T19:09:36.906671+0000","last_became_active":"2023-10-14T19:09:35.906664+0000","last_became_peered":"2023-10-14T19:09:35.906664+0000","last_unstale":"2023-10-14T19:09:36.906671+0000","last_undegraded":"2023-10-14T19:09:36.906671+0000","last_fullsized":"2023-10-14T19:09:36.906671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:32.575520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.842945+0000","last_change":"2023-10-14T19:09:36.842945+0000","last_active":"2023-10-14T19:09:36.842945+0000","last_peered":"2023-10-14T19:09:36.842945+0000","last_clean":"2023-10-14T19:09:36.842945+0000","last_became_active":"2023-10-14T19:09:36.842674+0000","last_became_peered":"2023-10-14T19:09:36.842674+0000","last_unstale":"2023-10-14T19:09:36.842945+0000","last_undegraded":"2023-10-14T19:09:36.842945+0000","last_fullsized":"2023-10-14T19:09:36.842945+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:21.808486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.919145+0000","last_change":"2023-10-14T19:09:35.918754+0000","last_active":"2023-10-14T19:09:35.919145+0000","last_peered":"2023-10-14T19:09:35.919145+0000","last_clean":"2023-10-14T19:09:35.919145+0000","last_became_active":"2023-10-14T19:09:35.918370+0000","last_became_peered":"2023-10-14T19:09:35.918370+0000","last_unstale":"2023-10-14T19:09:35.919145+0000","last_undegraded":"2023-10-14T19:09:35.919145+0000","last_fullsized":"2023-10-14T19:09:35.919145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:25.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854448+0000","last_change":"2023-10-14T19:09:36.854448+0000","last_active":"2023-10-14T19:09:36.854448+0000","last_peered":"2023-10-14T19:09:36.854448+0000","last_clean":"2023-10-14T19:09:36.854448+0000","last_became_active":"2023-10-14T19:09:36.854202+0000","last_became_peered":"2023-10-14T19:09:36.854202+0000","last_unstale":"2023-10-14T19:09:36.854448+0000","last_undegraded":"2023-10-14T19:09:36.854448+0000","last_fullsized":"2023-10-14T19:09:36.854448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:34.920362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.916157+0000","last_change":"2023-10-14T19:09:35.913414+0000","last_active":"2023-10-14T19:09:35.916157+0000","last_peered":"2023-10-14T19:09:35.916157+0000","last_clean":"2023-10-14T19:09:35.916157+0000","last_became_active":"2023-10-14T19:09:35.912646+0000","last_became_peered":"2023-10-14T19:09:35.912646+0000","last_unstale":"2023-10-14T19:09:35.916157+0000","last_undegraded":"2023-10-14T19:09:35.916157+0000","last_fullsized":"2023-10-14T19:09:35.916157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:28.015884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848313+0000","last_change":"2023-10-14T19:09:36.848313+0000","last_active":"2023-10-14T19:09:36.848313+0000","last_peered":"2023-10-14T19:09:36.848313+0000","last_clean":"2023-10-14T19:09:36.848313+0000","last_became_active":"2023-10-14T19:09:36.848021+0000","last_became_peered":"2023-10-14T19:09:36.848021+0000","last_unstale":"2023-10-14T19:09:36.848313+0000","last_undegraded":"2023-10-14T19:09:36.848313+0000","last_fullsized":"2023-10-14T19:09:36.848313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:53.423764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"113'8","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.905293+0000","last_change":"2023-10-14T19:09:35.907299+0000","last_active":"2023-10-14T19:09:36.905293+0000","last_peered":"2023-10-14T19:09:36.905293+0000","last_clean":"2023-10-14T19:09:36.905293+0000","last_became_active":"2023-10-14T19:09:35.907020+0000","last_became_peered":"2023-10-14T19:09:35.907020+0000","last_unstale":"2023-10-14T19:09:36.905293+0000","last_undegraded":"2023-10-14T19:09:36.905293+0000","last_fullsized":"2023-10-14T19:09:36.905293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:11.705200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848366+0000","last_change":"2023-10-14T19:09:36.848366+0000","last_active":"2023-10-14T19:09:36.848366+0000","last_peered":"2023-10-14T19:09:36.848366+0000","last_clean":"2023-10-14T19:09:36.848366+0000","last_became_active":"2023-10-14T19:09:36.848084+0000","last_became_peered":"2023-10-14T19:09:36.848084+0000","last_unstale":"2023-10-14T19:09:36.848366+0000","last_undegraded":"2023-10-14T19:09:36.848366+0000","last_fullsized":"2023-10-14T19:09:36.848366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:49.505693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.839080+0000","last_change":"2023-10-14T19:09:35.911905+0000","last_active":"2023-10-14T19:09:36.839080+0000","last_peered":"2023-10-14T19:09:36.839080+0000","last_clean":"2023-10-14T19:09:36.839080+0000","last_became_active":"2023-10-14T19:09:35.911631+0000","last_became_peered":"2023-10-14T19:09:35.911631+0000","last_unstale":"2023-10-14T19:09:36.839080+0000","last_undegraded":"2023-10-14T19:09:36.839080+0000","last_fullsized":"2023-10-14T19:09:36.839080+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:24:12.975846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845338+0000","last_change":"2023-10-14T19:09:36.845338+0000","last_active":"2023-10-14T19:09:36.845338+0000","last_peered":"2023-10-14T19:09:36.845338+0000","last_clean":"2023-10-14T19:09:36.845338+0000","last_became_active":"2023-10-14T19:09:36.845040+0000","last_became_peered":"2023-10-14T19:09:36.845040+0000","last_unstale":"2023-10-14T19:09:36.845338+0000","last_undegraded":"2023-10-14T19:09:36.845338+0000","last_fullsized":"2023-10-14T19:09:36.845338+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:21.045283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.903718+0000","last_change":"2023-10-14T19:09:35.905664+0000","last_active":"2023-10-14T19:09:36.903718+0000","last_peered":"2023-10-14T19:09:36.903718+0000","last_clean":"2023-10-14T19:09:36.903718+0000","last_became_active":"2023-10-14T19:09:35.905404+0000","last_became_peered":"2023-10-14T19:09:35.905404+0000","last_unstale":"2023-10-14T19:09:36.903718+0000","last_undegraded":"2023-10-14T19:09:36.903718+0000","last_fullsized":"2023-10-14T19:09:36.903718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:10.785218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848603+0000","last_change":"2023-10-14T19:09:36.848603+0000","last_active":"2023-10-14T19:09:36.848603+0000","last_peered":"2023-10-14T19:09:36.848603+0000","last_clean":"2023-10-14T19:09:36.848603+0000","last_became_active":"2023-10-14T19:09:36.848355+0000","last_became_peered":"2023-10-14T19:09:36.848355+0000","last_unstale":"2023-10-14T19:09:36.848603+0000","last_undegraded":"2023-10-14T19:09:36.848603+0000","last_fullsized":"2023-10-14T19:09:36.848603+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:56:43.405938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.838861+0000","last_change":"2023-10-14T19:09:35.905860+0000","last_active":"2023-10-14T19:09:36.838861+0000","last_peered":"2023-10-14T19:09:36.838861+0000","last_clean":"2023-10-14T19:09:36.838861+0000","last_became_active":"2023-10-14T19:09:35.905588+0000","last_became_peered":"2023-10-14T19:09:35.905588+0000","last_unstale":"2023-10-14T19:09:36.838861+0000","last_undegraded":"2023-10-14T19:09:36.838861+0000","last_fullsized":"2023-10-14T19:09:36.838861+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:52.417478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.856915+0000","last_change":"2023-10-14T19:09:36.856915+0000","last_active":"2023-10-14T19:09:36.856915+0000","last_peered":"2023-10-14T19:09:36.856915+0000","last_clean":"2023-10-14T19:09:36.856915+0000","last_became_active":"2023-10-14T19:09:36.856647+0000","last_became_peered":"2023-10-14T19:09:36.856647+0000","last_unstale":"2023-10-14T19:09:36.856915+0000","last_undegraded":"2023-10-14T19:09:36.856915+0000","last_fullsized":"2023-10-14T19:09:36.856915+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:33.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911349+0000","last_change":"2023-10-14T19:09:35.909972+0000","last_active":"2023-10-14T19:09:35.911349+0000","last_peered":"2023-10-14T19:09:35.911349+0000","last_clean":"2023-10-14T19:09:35.911349+0000","last_became_active":"2023-10-14T19:09:35.909656+0000","last_became_peered":"2023-10-14T19:09:35.909656+0000","last_unstale":"2023-10-14T19:09:35.911349+0000","last_undegraded":"2023-10-14T19:09:35.911349+0000","last_fullsized":"2023-10-14T19:09:35.911349+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:43:08.531467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852766+0000","last_change":"2023-10-14T19:09:36.852766+0000","last_active":"2023-10-14T19:09:36.852766+0000","last_peered":"2023-10-14T19:09:36.852766+0000","last_clean":"2023-10-14T19:09:36.852766+0000","last_became_active":"2023-10-14T19:09:36.852507+0000","last_became_peered":"2023-10-14T19:09:36.852507+0000","last_unstale":"2023-10-14T19:09:36.852766+0000","last_undegraded":"2023-10-14T19:09:36.852766+0000","last_fullsized":"2023-10-14T19:09:36.852766+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:51.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904285+0000","last_change":"2023-10-14T19:09:35.914426+0000","last_active":"2023-10-14T19:09:36.904285+0000","last_peered":"2023-10-14T19:09:36.904285+0000","last_clean":"2023-10-14T19:09:36.904285+0000","last_became_active":"2023-10-14T19:09:35.914166+0000","last_became_peered":"2023-10-14T19:09:35.914166+0000","last_unstale":"2023-10-14T19:09:36.904285+0000","last_undegraded":"2023-10-14T19:09:36.904285+0000","last_fullsized":"2023-10-14T19:09:36.904285+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:18.178899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851090+0000","last_change":"2023-10-14T19:09:36.851090+0000","last_active":"2023-10-14T19:09:36.851090+0000","last_peered":"2023-10-14T19:09:36.851090+0000","last_clean":"2023-10-14T19:09:36.851090+0000","last_became_active":"2023-10-14T19:09:36.850804+0000","last_became_peered":"2023-10-14T19:09:36.850804+0000","last_unstale":"2023-10-14T19:09:36.851090+0000","last_undegraded":"2023-10-14T19:09:36.851090+0000","last_fullsized":"2023-10-14T19:09:36.851090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:03:01.841777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.913710+0000","last_change":"2023-10-14T19:09:35.910422+0000","last_active":"2023-10-14T19:09:35.913710+0000","last_peered":"2023-10-14T19:09:35.913710+0000","last_clean":"2023-10-14T19:09:35.913710+0000","last_became_active":"2023-10-14T19:09:35.909580+0000","last_became_peered":"2023-10-14T19:09:35.909580+0000","last_unstale":"2023-10-14T19:09:35.913710+0000","last_undegraded":"2023-10-14T19:09:35.913710+0000","last_fullsized":"2023-10-14T19:09:35.913710+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:19.328698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854968+0000","last_change":"2023-10-14T19:09:36.854968+0000","last_active":"2023-10-14T19:09:36.854968+0000","last_peered":"2023-10-14T19:09:36.854968+0000","last_clean":"2023-10-14T19:09:36.854968+0000","last_became_active":"2023-10-14T19:09:36.854665+0000","last_became_peered":"2023-10-14T19:09:36.854665+0000","last_unstale":"2023-10-14T19:09:36.854968+0000","last_undegraded":"2023-10-14T19:09:36.854968+0000","last_fullsized":"2023-10-14T19:09:36.854968+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:53.891007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.914155+0000","last_change":"2023-10-14T19:09:35.910590+0000","last_active":"2023-10-14T19:09:35.914155+0000","last_peered":"2023-10-14T19:09:35.914155+0000","last_clean":"2023-10-14T19:09:35.914155+0000","last_became_active":"2023-10-14T19:09:35.910235+0000","last_became_peered":"2023-10-14T19:09:35.910235+0000","last_unstale":"2023-10-14T19:09:35.914155+0000","last_undegraded":"2023-10-14T19:09:35.914155+0000","last_fullsized":"2023-10-14T19:09:35.914155+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:30.958755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849100+0000","last_change":"2023-10-14T19:09:36.849100+0000","last_active":"2023-10-14T19:09:36.849100+0000","last_peered":"2023-10-14T19:09:36.849100+0000","last_clean":"2023-10-14T19:09:36.849100+0000","last_became_active":"2023-10-14T19:09:36.848835+0000","last_became_peered":"2023-10-14T19:09:36.848835+0000","last_unstale":"2023-10-14T19:09:36.849100+0000","last_undegraded":"2023-10-14T19:09:36.849100+0000","last_fullsized":"2023-10-14T19:09:36.849100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:29.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.908768+0000","last_change":"2023-10-14T19:09:35.905324+0000","last_active":"2023-10-14T19:09:35.908768+0000","last_peered":"2023-10-14T19:09:35.908768+0000","last_clean":"2023-10-14T19:09:35.908768+0000","last_became_active":"2023-10-14T19:09:35.905034+0000","last_became_peered":"2023-10-14T19:09:35.905034+0000","last_unstale":"2023-10-14T19:09:35.908768+0000","last_undegraded":"2023-10-14T19:09:35.908768+0000","last_fullsized":"2023-10-14T19:09:35.908768+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:51:26.555154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845356+0000","last_change":"2023-10-14T19:09:36.845356+0000","last_active":"2023-10-14T19:09:36.845356+0000","last_peered":"2023-10-14T19:09:36.845356+0000","last_clean":"2023-10-14T19:09:36.845356+0000","last_became_active":"2023-10-14T19:09:36.845086+0000","last_became_peered":"2023-10-14T19:09:36.845086+0000","last_unstale":"2023-10-14T19:09:36.845356+0000","last_undegraded":"2023-10-14T19:09:36.845356+0000","last_fullsized":"2023-10-14T19:09:36.845356+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:06.062939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904172+0000","last_change":"2023-10-14T19:09:35.912898+0000","last_active":"2023-10-14T19:09:36.904172+0000","last_peered":"2023-10-14T19:09:36.904172+0000","last_clean":"2023-10-14T19:09:36.904172+0000","last_became_active":"2023-10-14T19:09:35.912623+0000","last_became_peered":"2023-10-14T19:09:35.912623+0000","last_unstale":"2023-10-14T19:09:36.904172+0000","last_undegraded":"2023-10-14T19:09:36.904172+0000","last_fullsized":"2023-10-14T19:09:36.904172+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:35.323248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851091+0000","last_change":"2023-10-14T19:09:36.851091+0000","last_active":"2023-10-14T19:09:36.851091+0000","last_peered":"2023-10-14T19:09:36.851091+0000","last_clean":"2023-10-14T19:09:36.851091+0000","last_became_active":"2023-10-14T19:09:36.850742+0000","last_became_peered":"2023-10-14T19:09:36.850742+0000","last_unstale":"2023-10-14T19:09:36.851091+0000","last_undegraded":"2023-10-14T19:09:36.851091+0000","last_fullsized":"2023-10-14T19:09:36.851091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:59:48.060503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.917599+0000","last_change":"2023-10-14T19:09:35.912196+0000","last_active":"2023-10-14T19:09:35.917599+0000","last_peered":"2023-10-14T19:09:35.917599+0000","last_clean":"2023-10-14T19:09:35.917599+0000","last_became_active":"2023-10-14T19:09:35.911923+0000","last_became_peered":"2023-10-14T19:09:35.911923+0000","last_unstale":"2023-10-14T19:09:35.917599+0000","last_undegraded":"2023-10-14T19:09:35.917599+0000","last_fullsized":"2023-10-14T19:09:35.917599+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:45.129391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.856445+0000","last_change":"2023-10-14T19:09:36.856445+0000","last_active":"2023-10-14T19:09:36.856445+0000","last_peered":"2023-10-14T19:09:36.856445+0000","last_clean":"2023-10-14T19:09:36.856445+0000","last_became_active":"2023-10-14T19:09:36.856166+0000","last_became_peered":"2023-10-14T19:09:36.856166+0000","last_unstale":"2023-10-14T19:09:36.856445+0000","last_undegraded":"2023-10-14T19:09:36.856445+0000","last_fullsized":"2023-10-14T19:09:36.856445+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:06.062939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.914511+0000","last_change":"2023-10-14T19:09:35.908137+0000","last_active":"2023-10-14T19:09:35.914511+0000","last_peered":"2023-10-14T19:09:35.914511+0000","last_clean":"2023-10-14T19:09:35.914511+0000","last_became_active":"2023-10-14T19:09:35.907810+0000","last_became_peered":"2023-10-14T19:09:35.907810+0000","last_unstale":"2023-10-14T19:09:35.914511+0000","last_undegraded":"2023-10-14T19:09:35.914511+0000","last_fullsized":"2023-10-14T19:09:35.914511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:08.090524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.846897+0000","last_change":"2023-10-14T19:09:36.846897+0000","last_active":"2023-10-14T19:09:36.846897+0000","last_peered":"2023-10-14T19:09:36.846897+0000","last_clean":"2023-10-14T19:09:36.846897+0000","last_became_active":"2023-10-14T19:09:36.846485+0000","last_became_peered":"2023-10-14T19:09:36.846485+0000","last_unstale":"2023-10-14T19:09:36.846897+0000","last_undegraded":"2023-10-14T19:09:36.846897+0000","last_fullsized":"2023-10-14T19:09:36.846897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:21:09.312763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.915796+0000","last_change":"2023-10-14T19:09:35.915266+0000","last_active":"2023-10-14T19:09:35.915796+0000","last_peered":"2023-10-14T19:09:35.915796+0000","last_clean":"2023-10-14T19:09:35.915796+0000","last_became_active":"2023-10-14T19:09:35.914993+0000","last_became_peered":"2023-10-14T19:09:35.914993+0000","last_unstale":"2023-10-14T19:09:35.915796+0000","last_undegraded":"2023-10-14T19:09:35.915796+0000","last_fullsized":"2023-10-14T19:09:35.915796+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:44.853234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852603+0000","last_change":"2023-10-14T19:09:36.852603+0000","last_active":"2023-10-14T19:09:36.852603+0000","last_peered":"2023-10-14T19:09:36.852603+0000","last_clean":"2023-10-14T19:09:36.852603+0000","last_became_active":"2023-10-14T19:09:36.852093+0000","last_became_peered":"2023-10-14T19:09:36.852093+0000","last_unstale":"2023-10-14T19:09:36.852603+0000","last_undegraded":"2023-10-14T19:09:36.852603+0000","last_fullsized":"2023-10-14T19:09:36.852603+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:59.972880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.915618+0000","last_change":"2023-10-14T19:09:35.913219+0000","last_active":"2023-10-14T19:09:35.915618+0000","last_peered":"2023-10-14T19:09:35.915618+0000","last_clean":"2023-10-14T19:09:35.915618+0000","last_became_active":"2023-10-14T19:09:35.912957+0000","last_became_peered":"2023-10-14T19:09:35.912957+0000","last_unstale":"2023-10-14T19:09:35.915618+0000","last_undegraded":"2023-10-14T19:09:35.915618+0000","last_fullsized":"2023-10-14T19:09:35.915618+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:43:08.531467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847970+0000","last_change":"2023-10-14T19:09:36.847970+0000","last_active":"2023-10-14T19:09:36.847970+0000","last_peered":"2023-10-14T19:09:36.847970+0000","last_clean":"2023-10-14T19:09:36.847970+0000","last_became_active":"2023-10-14T19:09:36.847726+0000","last_became_peered":"2023-10-14T19:09:36.847726+0000","last_unstale":"2023-10-14T19:09:36.847970+0000","last_undegraded":"2023-10-14T19:09:36.847970+0000","last_fullsized":"2023-10-14T19:09:36.847970+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:26:53.675656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.917625+0000","last_change":"2023-10-14T19:09:35.912253+0000","last_active":"2023-10-14T19:09:35.917625+0000","last_peered":"2023-10-14T19:09:35.917625+0000","last_clean":"2023-10-14T19:09:35.917625+0000","last_became_active":"2023-10-14T19:09:35.911977+0000","last_became_peered":"2023-10-14T19:09:35.911977+0000","last_unstale":"2023-10-14T19:09:35.917625+0000","last_undegraded":"2023-10-14T19:09:35.917625+0000","last_fullsized":"2023-10-14T19:09:35.917625+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:19.328698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851358+0000","last_change":"2023-10-14T19:09:36.851358+0000","last_active":"2023-10-14T19:09:36.851358+0000","last_peered":"2023-10-14T19:09:36.851358+0000","last_clean":"2023-10-14T19:09:36.851358+0000","last_became_active":"2023-10-14T19:09:36.850929+0000","last_became_peered":"2023-10-14T19:09:36.850929+0000","last_unstale":"2023-10-14T19:09:36.851358+0000","last_undegraded":"2023-10-14T19:09:36.851358+0000","last_fullsized":"2023-10-14T19:09:36.851358+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:27.389278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.910657+0000","last_change":"2023-10-14T19:09:35.908112+0000","last_active":"2023-10-14T19:09:35.910657+0000","last_peered":"2023-10-14T19:09:35.910657+0000","last_clean":"2023-10-14T19:09:35.910657+0000","last_became_active":"2023-10-14T19:09:35.907438+0000","last_became_peered":"2023-10-14T19:09:35.907438+0000","last_unstale":"2023-10-14T19:09:35.910657+0000","last_undegraded":"2023-10-14T19:09:35.910657+0000","last_fullsized":"2023-10-14T19:09:35.910657+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:28.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.855703+0000","last_change":"2023-10-14T19:09:36.855703+0000","last_active":"2023-10-14T19:09:36.855703+0000","last_peered":"2023-10-14T19:09:36.855703+0000","last_clean":"2023-10-14T19:09:36.855703+0000","last_became_active":"2023-10-14T19:09:36.855456+0000","last_became_peered":"2023-10-14T19:09:36.855456+0000","last_unstale":"2023-10-14T19:09:36.855703+0000","last_undegraded":"2023-10-14T19:09:36.855703+0000","last_fullsized":"2023-10-14T19:09:36.855703+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:34.444315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911893+0000","last_change":"2023-10-14T19:09:35.910669+0000","last_active":"2023-10-14T19:09:35.911893+0000","last_peered":"2023-10-14T19:09:35.911893+0000","last_clean":"2023-10-14T19:09:35.911893+0000","last_became_active":"2023-10-14T19:09:35.909624+0000","last_became_peered":"2023-10-14T19:09:35.909624+0000","last_unstale":"2023-10-14T19:09:35.911893+0000","last_undegraded":"2023-10-14T19:09:35.911893+0000","last_fullsized":"2023-10-14T19:09:35.911893+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:00.538132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847907+0000","last_change":"2023-10-14T19:09:36.847907+0000","last_active":"2023-10-14T19:09:36.847907+0000","last_peered":"2023-10-14T19:09:36.847907+0000","last_clean":"2023-10-14T19:09:36.847907+0000","last_became_active":"2023-10-14T19:09:36.847604+0000","last_became_peered":"2023-10-14T19:09:36.847604+0000","last_unstale":"2023-10-14T19:09:36.847907+0000","last_undegraded":"2023-10-14T19:09:36.847907+0000","last_fullsized":"2023-10-14T19:09:36.847907+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:49:35.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904386+0000","last_change":"2023-10-14T19:09:35.917829+0000","last_active":"2023-10-14T19:09:36.904386+0000","last_peered":"2023-10-14T19:09:36.904386+0000","last_clean":"2023-10-14T19:09:36.904386+0000","last_became_active":"2023-10-14T19:09:35.917519+0000","last_became_peered":"2023-10-14T19:09:35.917519+0000","last_unstale":"2023-10-14T19:09:36.904386+0000","last_undegraded":"2023-10-14T19:09:36.904386+0000","last_fullsized":"2023-10-14T19:09:36.904386+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:28.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.907674+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:09:35.907674+0000","last_peered":"2023-10-14T19:09:35.907674+0000","last_clean":"2023-10-14T19:09:35.907674+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:09:35.907674+0000","last_undegraded":"2023-10-14T19:09:35.907674+0000","last_fullsized":"2023-10-14T19:09:35.907674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303368,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068472,"statfs":{"total":96636764160,"available":96326115328,"internally_reserved":0,"allocated":2031616,"data_stored":1202218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.67200000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":4.2080000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.67200000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":3.1480000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.61499999999999999},"min":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.75700000000000001},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":3.23},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.78000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.57199999999999995},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":2.4620000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.70399999999999996},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51900000000000002,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.86899999999999999,"15min":2.883},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.5},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.79300000000000004},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":5.383},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302776,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069064,"statfs":{"total":96636764160,"available":96326721536,"internally_reserved":0,"allocated":1425408,"data_stored":611240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.69199999999999995},"min":{"1min":0.38400000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":5.6820000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.752},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":5.7030000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.74399999999999999},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.70999999999999996,"5min":0.755,"15min":7.8680000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.52900000000000003,"15min":0.76300000000000001},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.80900000000000005,"15min":7.8250000000000002},"last":0.41399999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.77900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.83299999999999996},"min":{"1min":0.44,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":8.0090000000000003},"last":0.434}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.81299999999999994},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.38600000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.311},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.504}]},{"osd":7,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.59699999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77000000000000002,"5min":0.77900000000000003,"15min":0.86599999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.216,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.249},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52300000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38300000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.36799999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.31},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.34899999999999998},"min":{"1min":0.28799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.54000000000000004},"min":{"1min":0.42299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":1.032,"15min":1.032},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.87,"5min":1.079,"15min":1.079},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.48099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1200072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33500000000000002,"15min":0.34399999999999997},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.41599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60899999999999999},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51400000000000001,"5min":0.62,"15min":0.62},"last":0.311},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.45200000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.621}]},{"osd":7,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82299999999999995,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":610292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.439,"5min":0.58199999999999996,"15min":0.60699999999999998},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.439},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.313}]},{"osd":1,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.56499999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.76700000000000002},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.497,"5min":0.60999999999999999,"15min":11.269},"last":0.25900000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34200000000000003,"15min":0.73799999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48699999999999999,"5min":0.56499999999999995,"15min":11.318},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56000000000000005,"5min":0.624,"15min":0.69999999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.433},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.67100000000000004},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.68600000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.82799999999999996,"5min":0.89000000000000001,"15min":1.9710000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":1.0289999999999999},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79900000000000004,"5min":0.93200000000000005,"15min":11.379},"last":0.41899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":1.0309999999999999},"min":{"1min":0.47399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.93400000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.497}]},{"osd":7,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.626,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":2.0009999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":1.0469999999999999},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":602941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32300000000000001,"15min":0.35299999999999998},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.42399999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51200000000000001,"5min":0.57199999999999995,"15min":0.70099999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.64500000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36199999999999999,"15min":0.38500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.371}]},{"osd":2,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.41399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":0.59999999999999998,"15min":0.81000000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.45000000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.433}]},{"osd":4,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":609774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":2.1360000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":5.7910000000000004}]},{"osd":1,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.85699999999999998,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88600000000000001,"5min":3.488,"15min":3.488},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":1.254,"15min":1.254},"last":1.589}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":5.8360000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":0.874,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.1950000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.54500000000000004},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.222}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.57099999999999995,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64400000000000002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.374},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.63600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.878},"last":0.79000000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55200000000000005,"15min":0.60799999999999998},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.34399999999999997},"max":{"1min":0.61199999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":1.1299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298676,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073164,"statfs":{"total":96636764160,"available":96330919936,"internally_reserved":0,"allocated":1421312,"data_stored":609816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.52400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71299999999999997,"5min":0.752,"15min":0.83899999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68000000000000005,"5min":0.71699999999999997,"15min":0.83199999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.876},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":5.8639999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89600000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.85299999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76100000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:09:41.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:09:41.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.172+0000 7f77aee36700 1 Processor -- start 2023-10-14T19:09:41.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.172+0000 7f77aee36700 1 -- start start 2023-10-14T19:09:41.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.172+0000 7f77aee36700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77a80a8be0 0x7f77a80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77aee36700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80aee90 0x7f77a80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77aee36700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a80ce1a0 con 0x7f77a806d280 2023-10-14T19:09:41.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77aee36700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a80cd5d0 con 0x7f77a80a8be0 2023-10-14T19:09:41.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77aee36700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80cd870 con 0x7f77a80aee90 2023-10-14T19:09:41.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77a80a8be0 0x7f77a80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77a80a8be0 0x7f77a80a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:53160/0 (socket says 172.21.15.7:53160) 2023-10-14T19:09:41.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 -- 172.21.15.7:0/1823893691 learned_addr learned my addr 172.21.15.7:0/1823893691 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:41.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77ad3d3700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80aee90 0x7f77a80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 -- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80aee90 msgr2=0x7f77a80b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:41.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80aee90 0x7f77a80b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 -- 172.21.15.7:0/1823893691 >> v1:172.21.15.148:6789/0 conn(0x7f77a806d280 legacy=0x7f77a80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77acbd2700 1 -- 172.21.15.7:0/1823893691 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80cdb50 con 0x7f77a80a8be0 2023-10-14T19:09:41.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.173+0000 7f77ad3d3700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80aee90 0x7f77a80b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:41.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77acbd2700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80a8be0 0x7f77a80a8fb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009f70 tx=0x7f77a0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc17f7cb22d39f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77a77fe700 1 -- 172.21.15.7:0/1823893691 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a000e070 con 0x7f77a80a8be0 2023-10-14T19:09:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77a77fe700 1 -- 172.21.15.7:0/1823893691 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a000bab0 con 0x7f77a80a8be0 2023-10-14T19:09:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77a77fe700 1 -- 172.21.15.7:0/1823893691 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00092e0 con 0x7f77a80a8be0 2023-10-14T19:09:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 -- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80a8be0 msgr2=0x7f77a80a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80a8be0 0x7f77a80a8fb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009f70 tx=0x7f77a0009840 comp rx=0 tx=0).stop 2023-10-14T19:09:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 -- 172.21.15.7:0/1823893691 shutdown_connections 2023-10-14T19:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80aee90 0x7f77a80b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 --2- 172.21.15.7:0/1823893691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80a8be0 0x7f77a80a8fb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 -- 172.21.15.7:0/1823893691 >> 172.21.15.7:0/1823893691 conn(0x7f77a806ce80 msgr2=0x7f77a80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 -- 172.21.15.7:0/1823893691 shutdown_connections 2023-10-14T19:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.174+0000 7f77aee36700 1 -- 172.21.15.7:0/1823893691 wait complete. 2023-10-14T19:09:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.175+0000 7f77aee36700 1 Processor -- start 2023-10-14T19:09:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 -- start start 2023-10-14T19:09:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 0x7f77a8167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80a8be0 0x7f77a8098f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80aee90 0x7f77a80994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80ab8c0 con 0x7f77a806d280 2023-10-14T19:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80ab590 con 0x7f77a80aee90 2023-10-14T19:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.176+0000 7f77aee36700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8168300 con 0x7f77a80a8be0 2023-10-14T19:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 0x7f77a8167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 0x7f77a8167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45628/0 (socket says 172.21.15.7:45628) 2023-10-14T19:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 -- 172.21.15.7:0/1350366255 learned_addr learned my addr 172.21.15.7:0/1350366255 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77a7fff700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80a8be0 0x7f77a8098f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77ad3d3700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80aee90 0x7f77a80994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 -- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80a8be0 msgr2=0x7f77a8098f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80a8be0 0x7f77a8098f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 -- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80aee90 msgr2=0x7f77a80994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80aee90 0x7f77a80994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 -- 172.21.15.7:0/1350366255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009420 con 0x7f77a806d280 2023-10-14T19:09:41.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77acbd2700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 0x7f77a8167930 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f77a000b6c0 tx=0x7f77a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0008b70 con 0x7f77a806d280 2023-10-14T19:09:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0008cd0 con 0x7f77a806d280 2023-10-14T19:09:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a001d670 con 0x7f77a806d280 2023-10-14T19:09:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a0009ae0 con 0x7f77a806d280 2023-10-14T19:09:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.177+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a81688c0 con 0x7f77a806d280 2023-10-14T19:09:41.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.178+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a804c3c0 con 0x7f77a806d280 2023-10-14T19:09:41.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.179+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f77a0003040 con 0x7f77a806d280 2023-10-14T19:09:41.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.179+0000 7f77a4ff9700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7788067320 0x7f77880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.179+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77a00868e0 con 0x7f77a806d280 2023-10-14T19:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.179+0000 7f77a7fff700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7788067320 0x7f77880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.180+0000 7f77a7fff700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7788067320 0x7f77880697d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f77a8098690 tx=0x7f7798009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.183+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77a0053460 con 0x7f77a806d280 2023-10-14T19:09:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.374+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77a80aba00 con 0x7f7788067320 2023-10-14T19:09:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.382+0000 7f77a4ff9700 1 -- 172.21.15.7:0/1350366255 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289803 (secure 0 0 0) 0x7f7798013420 con 0x7f7788067320 2023-10-14T19:09:41.387 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7788067320 msgr2=0x7f77880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7788067320 0x7f77880697d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f77a8098690 tx=0x7f7798009040 comp rx=0 tx=0).stop 2023-10-14T19:09:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 msgr2=0x7f77a8167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 0x7f77a8167930 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f77a000b6c0 tx=0x7f77a0018000 comp rx=0 tx=0).stop 2023-10-14T19:09:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 shutdown_connections 2023-10-14T19:09:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7788067320 0x7f77880697d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77a80aee90 0x7f77a80994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77a806d280 0x7f77a8167930 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 --2- 172.21.15.7:0/1350366255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77a80a8be0 0x7f77a8098f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.385+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 >> 172.21.15.7:0/1350366255 conn(0x7f77a806ce80 msgr2=0x7f77a80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.386+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 shutdown_connections 2023-10-14T19:09:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.386+0000 7f77aee36700 1 -- 172.21.15.7:0/1350366255 wait complete. 2023-10-14T19:09:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:09:41.398 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2023-10-14T19:09:39.716663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419220,"kb_used_data":12244,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752555500,"statfs":{"total":773094113280,"available":770616832000,"internally_reserved":0,"allocated":12537856,"data_stored":6056057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827751"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851711+0000","last_change":"2023-10-14T19:09:36.851711+0000","last_active":"2023-10-14T19:09:36.851711+0000","last_peered":"2023-10-14T19:09:36.851711+0000","last_clean":"2023-10-14T19:09:36.851711+0000","last_became_active":"2023-10-14T19:09:36.851419+0000","last_became_peered":"2023-10-14T19:09:36.851419+0000","last_unstale":"2023-10-14T19:09:36.851711+0000","last_undegraded":"2023-10-14T19:09:36.851711+0000","last_fullsized":"2023-10-14T19:09:36.851711+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:10:10.757019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.855013+0000","last_change":"2023-10-14T19:09:36.855013+0000","last_active":"2023-10-14T19:09:36.855013+0000","last_peered":"2023-10-14T19:09:36.855013+0000","last_clean":"2023-10-14T19:09:36.855013+0000","last_became_active":"2023-10-14T19:09:36.854718+0000","last_became_peered":"2023-10-14T19:09:36.854718+0000","last_unstale":"2023-10-14T19:09:36.855013+0000","last_undegraded":"2023-10-14T19:09:36.855013+0000","last_fullsized":"2023-10-14T19:09:36.855013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:00.333528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851536+0000","last_change":"2023-10-14T19:09:36.851536+0000","last_active":"2023-10-14T19:09:36.851536+0000","last_peered":"2023-10-14T19:09:36.851536+0000","last_clean":"2023-10-14T19:09:36.851536+0000","last_became_active":"2023-10-14T19:09:36.851276+0000","last_became_peered":"2023-10-14T19:09:36.851276+0000","last_unstale":"2023-10-14T19:09:36.851536+0000","last_undegraded":"2023-10-14T19:09:36.851536+0000","last_fullsized":"2023-10-14T19:09:36.851536+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:34.920362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847199+0000","last_change":"2023-10-14T19:09:36.847199+0000","last_active":"2023-10-14T19:09:36.847199+0000","last_peered":"2023-10-14T19:09:36.847199+0000","last_clean":"2023-10-14T19:09:36.847199+0000","last_became_active":"2023-10-14T19:09:36.846948+0000","last_became_peered":"2023-10-14T19:09:36.846948+0000","last_unstale":"2023-10-14T19:09:36.847199+0000","last_undegraded":"2023-10-14T19:09:36.847199+0000","last_fullsized":"2023-10-14T19:09:36.847199+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:01.790674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849633+0000","last_change":"2023-10-14T19:09:36.849633+0000","last_active":"2023-10-14T19:09:36.849633+0000","last_peered":"2023-10-14T19:09:36.849633+0000","last_clean":"2023-10-14T19:09:36.849633+0000","last_became_active":"2023-10-14T19:09:36.849327+0000","last_became_peered":"2023-10-14T19:09:36.849327+0000","last_unstale":"2023-10-14T19:09:36.849633+0000","last_undegraded":"2023-10-14T19:09:36.849633+0000","last_fullsized":"2023-10-14T19:09:36.849633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:25.092554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.843899+0000","last_change":"2023-10-14T19:09:36.843899+0000","last_active":"2023-10-14T19:09:36.843899+0000","last_peered":"2023-10-14T19:09:36.843899+0000","last_clean":"2023-10-14T19:09:36.843899+0000","last_became_active":"2023-10-14T19:09:36.843624+0000","last_became_peered":"2023-10-14T19:09:36.843624+0000","last_unstale":"2023-10-14T19:09:36.843899+0000","last_undegraded":"2023-10-14T19:09:36.843899+0000","last_fullsized":"2023-10-14T19:09:36.843899+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:20.334984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852585+0000","last_change":"2023-10-14T19:09:36.852585+0000","last_active":"2023-10-14T19:09:36.852585+0000","last_peered":"2023-10-14T19:09:36.852585+0000","last_clean":"2023-10-14T19:09:36.852585+0000","last_became_active":"2023-10-14T19:09:36.852298+0000","last_became_peered":"2023-10-14T19:09:36.852298+0000","last_unstale":"2023-10-14T19:09:36.852585+0000","last_undegraded":"2023-10-14T19:09:36.852585+0000","last_fullsized":"2023-10-14T19:09:36.852585+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:46.135677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853082+0000","last_change":"2023-10-14T19:09:36.853082+0000","last_active":"2023-10-14T19:09:36.853082+0000","last_peered":"2023-10-14T19:09:36.853082+0000","last_clean":"2023-10-14T19:09:36.853082+0000","last_became_active":"2023-10-14T19:09:36.852756+0000","last_became_peered":"2023-10-14T19:09:36.852756+0000","last_unstale":"2023-10-14T19:09:36.853082+0000","last_undegraded":"2023-10-14T19:09:36.853082+0000","last_fullsized":"2023-10-14T19:09:36.853082+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:00.333528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850164+0000","last_change":"2023-10-14T19:09:36.850164+0000","last_active":"2023-10-14T19:09:36.850164+0000","last_peered":"2023-10-14T19:09:36.850164+0000","last_clean":"2023-10-14T19:09:36.850164+0000","last_became_active":"2023-10-14T19:09:36.849759+0000","last_became_peered":"2023-10-14T19:09:36.849759+0000","last_unstale":"2023-10-14T19:09:36.850164+0000","last_undegraded":"2023-10-14T19:09:36.850164+0000","last_fullsized":"2023-10-14T19:09:36.850164+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:48.436109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854981+0000","last_change":"2023-10-14T19:09:36.854981+0000","last_active":"2023-10-14T19:09:36.854981+0000","last_peered":"2023-10-14T19:09:36.854981+0000","last_clean":"2023-10-14T19:09:36.854981+0000","last_became_active":"2023-10-14T19:09:36.854616+0000","last_became_peered":"2023-10-14T19:09:36.854616+0000","last_unstale":"2023-10-14T19:09:36.854981+0000","last_undegraded":"2023-10-14T19:09:36.854981+0000","last_fullsized":"2023-10-14T19:09:36.854981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:57.724436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852925+0000","last_change":"2023-10-14T19:09:36.852925+0000","last_active":"2023-10-14T19:09:36.852925+0000","last_peered":"2023-10-14T19:09:36.852925+0000","last_clean":"2023-10-14T19:09:36.852925+0000","last_became_active":"2023-10-14T19:09:36.852300+0000","last_became_peered":"2023-10-14T19:09:36.852300+0000","last_unstale":"2023-10-14T19:09:36.852925+0000","last_undegraded":"2023-10-14T19:09:36.852925+0000","last_fullsized":"2023-10-14T19:09:36.852925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:14.996662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850226+0000","last_change":"2023-10-14T19:09:36.850226+0000","last_active":"2023-10-14T19:09:36.850226+0000","last_peered":"2023-10-14T19:09:36.850226+0000","last_clean":"2023-10-14T19:09:36.850226+0000","last_became_active":"2023-10-14T19:09:36.849969+0000","last_became_peered":"2023-10-14T19:09:36.849969+0000","last_unstale":"2023-10-14T19:09:36.850226+0000","last_undegraded":"2023-10-14T19:09:36.850226+0000","last_fullsized":"2023-10-14T19:09:36.850226+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:21.045283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853558+0000","last_change":"2023-10-14T19:09:36.853558+0000","last_active":"2023-10-14T19:09:36.853558+0000","last_peered":"2023-10-14T19:09:36.853558+0000","last_clean":"2023-10-14T19:09:36.853558+0000","last_became_active":"2023-10-14T19:09:36.852624+0000","last_became_peered":"2023-10-14T19:09:36.852624+0000","last_unstale":"2023-10-14T19:09:36.853558+0000","last_undegraded":"2023-10-14T19:09:36.853558+0000","last_fullsized":"2023-10-14T19:09:36.853558+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:29.446051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.857849+0000","last_change":"2023-10-14T19:09:36.857849+0000","last_active":"2023-10-14T19:09:36.857849+0000","last_peered":"2023-10-14T19:09:36.857849+0000","last_clean":"2023-10-14T19:09:36.857849+0000","last_became_active":"2023-10-14T19:09:36.857556+0000","last_became_peered":"2023-10-14T19:09:36.857556+0000","last_unstale":"2023-10-14T19:09:36.857849+0000","last_undegraded":"2023-10-14T19:09:36.857849+0000","last_fullsized":"2023-10-14T19:09:36.857849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:46.255941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853308+0000","last_change":"2023-10-14T19:09:36.853308+0000","last_active":"2023-10-14T19:09:36.853308+0000","last_peered":"2023-10-14T19:09:36.853308+0000","last_clean":"2023-10-14T19:09:36.853308+0000","last_became_active":"2023-10-14T19:09:36.853048+0000","last_became_peered":"2023-10-14T19:09:36.853048+0000","last_unstale":"2023-10-14T19:09:36.853308+0000","last_undegraded":"2023-10-14T19:09:36.853308+0000","last_fullsized":"2023-10-14T19:09:36.853308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:26.688556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849174+0000","last_change":"2023-10-14T19:09:36.849174+0000","last_active":"2023-10-14T19:09:36.849174+0000","last_peered":"2023-10-14T19:09:36.849174+0000","last_clean":"2023-10-14T19:09:36.849174+0000","last_became_active":"2023-10-14T19:09:36.847943+0000","last_became_peered":"2023-10-14T19:09:36.847943+0000","last_unstale":"2023-10-14T19:09:36.849174+0000","last_undegraded":"2023-10-14T19:09:36.849174+0000","last_fullsized":"2023-10-14T19:09:36.849174+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:27.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845611+0000","last_change":"2023-10-14T19:09:36.845611+0000","last_active":"2023-10-14T19:09:36.845611+0000","last_peered":"2023-10-14T19:09:36.845611+0000","last_clean":"2023-10-14T19:09:36.845611+0000","last_became_active":"2023-10-14T19:09:36.844365+0000","last_became_peered":"2023-10-14T19:09:36.844365+0000","last_unstale":"2023-10-14T19:09:36.845611+0000","last_undegraded":"2023-10-14T19:09:36.845611+0000","last_fullsized":"2023-10-14T19:09:36.845611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:34.444315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853670+0000","last_change":"2023-10-14T19:09:36.853670+0000","last_active":"2023-10-14T19:09:36.853670+0000","last_peered":"2023-10-14T19:09:36.853670+0000","last_clean":"2023-10-14T19:09:36.853670+0000","last_became_active":"2023-10-14T19:09:36.853342+0000","last_became_peered":"2023-10-14T19:09:36.853342+0000","last_unstale":"2023-10-14T19:09:36.853670+0000","last_undegraded":"2023-10-14T19:09:36.853670+0000","last_fullsized":"2023-10-14T19:09:36.853670+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:59.972880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850403+0000","last_change":"2023-10-14T19:09:36.850403+0000","last_active":"2023-10-14T19:09:36.850403+0000","last_peered":"2023-10-14T19:09:36.850403+0000","last_clean":"2023-10-14T19:09:36.850403+0000","last_became_active":"2023-10-14T19:09:36.849846+0000","last_became_peered":"2023-10-14T19:09:36.849846+0000","last_unstale":"2023-10-14T19:09:36.850403+0000","last_undegraded":"2023-10-14T19:09:36.850403+0000","last_fullsized":"2023-10-14T19:09:36.850403+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:06:23.495975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.855880+0000","last_change":"2023-10-14T19:09:36.855880+0000","last_active":"2023-10-14T19:09:36.855880+0000","last_peered":"2023-10-14T19:09:36.855880+0000","last_clean":"2023-10-14T19:09:36.855880+0000","last_became_active":"2023-10-14T19:09:36.855580+0000","last_became_peered":"2023-10-14T19:09:36.855580+0000","last_unstale":"2023-10-14T19:09:36.855880+0000","last_undegraded":"2023-10-14T19:09:36.855880+0000","last_fullsized":"2023-10-14T19:09:36.855880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:21.808725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850765+0000","last_change":"2023-10-14T19:09:36.850765+0000","last_active":"2023-10-14T19:09:36.850765+0000","last_peered":"2023-10-14T19:09:36.850765+0000","last_clean":"2023-10-14T19:09:36.850765+0000","last_became_active":"2023-10-14T19:09:36.850499+0000","last_became_peered":"2023-10-14T19:09:36.850499+0000","last_unstale":"2023-10-14T19:09:36.850765+0000","last_undegraded":"2023-10-14T19:09:36.850765+0000","last_fullsized":"2023-10-14T19:09:36.850765+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:25.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851667+0000","last_change":"2023-10-14T19:09:36.851667+0000","last_active":"2023-10-14T19:09:36.851667+0000","last_peered":"2023-10-14T19:09:36.851667+0000","last_clean":"2023-10-14T19:09:36.851667+0000","last_became_active":"2023-10-14T19:09:36.851368+0000","last_became_peered":"2023-10-14T19:09:36.851368+0000","last_unstale":"2023-10-14T19:09:36.851667+0000","last_undegraded":"2023-10-14T19:09:36.851667+0000","last_fullsized":"2023-10-14T19:09:36.851667+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:20:40.022873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851093+0000","last_change":"2023-10-14T19:09:36.851093+0000","last_active":"2023-10-14T19:09:36.851093+0000","last_peered":"2023-10-14T19:09:36.851093+0000","last_clean":"2023-10-14T19:09:36.851093+0000","last_became_active":"2023-10-14T19:09:36.850793+0000","last_became_peered":"2023-10-14T19:09:36.850793+0000","last_unstale":"2023-10-14T19:09:36.851093+0000","last_undegraded":"2023-10-14T19:09:36.851093+0000","last_fullsized":"2023-10-14T19:09:36.851093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:26:53.675656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.841409+0000","last_change":"2023-10-14T19:09:36.841409+0000","last_active":"2023-10-14T19:09:36.841409+0000","last_peered":"2023-10-14T19:09:36.841409+0000","last_clean":"2023-10-14T19:09:36.841409+0000","last_became_active":"2023-10-14T19:09:36.841104+0000","last_became_peered":"2023-10-14T19:09:36.841104+0000","last_unstale":"2023-10-14T19:09:36.841409+0000","last_undegraded":"2023-10-14T19:09:36.841409+0000","last_fullsized":"2023-10-14T19:09:36.841409+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:48.913159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852313+0000","last_change":"2023-10-14T19:09:36.852313+0000","last_active":"2023-10-14T19:09:36.852313+0000","last_peered":"2023-10-14T19:09:36.852313+0000","last_clean":"2023-10-14T19:09:36.852313+0000","last_became_active":"2023-10-14T19:09:36.851838+0000","last_became_peered":"2023-10-14T19:09:36.851838+0000","last_unstale":"2023-10-14T19:09:36.852313+0000","last_undegraded":"2023-10-14T19:09:36.852313+0000","last_fullsized":"2023-10-14T19:09:36.852313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:49.505693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848219+0000","last_change":"2023-10-14T19:09:36.848219+0000","last_active":"2023-10-14T19:09:36.848219+0000","last_peered":"2023-10-14T19:09:36.848219+0000","last_clean":"2023-10-14T19:09:36.848219+0000","last_became_active":"2023-10-14T19:09:36.847829+0000","last_became_peered":"2023-10-14T19:09:36.847829+0000","last_unstale":"2023-10-14T19:09:36.848219+0000","last_undegraded":"2023-10-14T19:09:36.848219+0000","last_fullsized":"2023-10-14T19:09:36.848219+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:25.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851654+0000","last_change":"2023-10-14T19:09:36.851654+0000","last_active":"2023-10-14T19:09:36.851654+0000","last_peered":"2023-10-14T19:09:36.851654+0000","last_clean":"2023-10-14T19:09:36.851654+0000","last_became_active":"2023-10-14T19:09:36.851374+0000","last_became_peered":"2023-10-14T19:09:36.851374+0000","last_unstale":"2023-10-14T19:09:36.851654+0000","last_undegraded":"2023-10-14T19:09:36.851654+0000","last_fullsized":"2023-10-14T19:09:36.851654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:58.692645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845186+0000","last_change":"2023-10-14T19:09:36.845186+0000","last_active":"2023-10-14T19:09:36.845186+0000","last_peered":"2023-10-14T19:09:36.845186+0000","last_clean":"2023-10-14T19:09:36.845186+0000","last_became_active":"2023-10-14T19:09:36.844819+0000","last_became_peered":"2023-10-14T19:09:36.844819+0000","last_unstale":"2023-10-14T19:09:36.845186+0000","last_undegraded":"2023-10-14T19:09:36.845186+0000","last_fullsized":"2023-10-14T19:09:36.845186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:34.920362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853291+0000","last_change":"2023-10-14T19:09:36.853291+0000","last_active":"2023-10-14T19:09:36.853291+0000","last_peered":"2023-10-14T19:09:36.853291+0000","last_clean":"2023-10-14T19:09:36.853291+0000","last_became_active":"2023-10-14T19:09:36.852988+0000","last_became_peered":"2023-10-14T19:09:36.852988+0000","last_unstale":"2023-10-14T19:09:36.853291+0000","last_undegraded":"2023-10-14T19:09:36.853291+0000","last_fullsized":"2023-10-14T19:09:36.853291+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:48.379109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.850322+0000","last_change":"2023-10-14T19:09:36.850322+0000","last_active":"2023-10-14T19:09:36.850322+0000","last_peered":"2023-10-14T19:09:36.850322+0000","last_clean":"2023-10-14T19:09:36.850322+0000","last_became_active":"2023-10-14T19:09:36.850022+0000","last_became_peered":"2023-10-14T19:09:36.850022+0000","last_unstale":"2023-10-14T19:09:36.850322+0000","last_undegraded":"2023-10-14T19:09:36.850322+0000","last_fullsized":"2023-10-14T19:09:36.850322+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:03:20.148302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848967+0000","last_change":"2023-10-14T19:09:36.848967+0000","last_active":"2023-10-14T19:09:36.848967+0000","last_peered":"2023-10-14T19:09:36.848967+0000","last_clean":"2023-10-14T19:09:36.848967+0000","last_became_active":"2023-10-14T19:09:36.848109+0000","last_became_peered":"2023-10-14T19:09:36.848109+0000","last_unstale":"2023-10-14T19:09:36.848967+0000","last_undegraded":"2023-10-14T19:09:36.848967+0000","last_fullsized":"2023-10-14T19:09:36.848967+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:07.540919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.843232+0000","last_change":"2023-10-14T19:09:36.843232+0000","last_active":"2023-10-14T19:09:36.843232+0000","last_peered":"2023-10-14T19:09:36.843232+0000","last_clean":"2023-10-14T19:09:36.843232+0000","last_became_active":"2023-10-14T19:09:36.842981+0000","last_became_peered":"2023-10-14T19:09:36.842981+0000","last_unstale":"2023-10-14T19:09:36.843232+0000","last_undegraded":"2023-10-14T19:09:36.843232+0000","last_fullsized":"2023-10-14T19:09:36.843232+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:31.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848534+0000","last_change":"2023-10-14T19:09:36.848534+0000","last_active":"2023-10-14T19:09:36.848534+0000","last_peered":"2023-10-14T19:09:36.848534+0000","last_clean":"2023-10-14T19:09:36.848534+0000","last_became_active":"2023-10-14T19:09:36.848222+0000","last_became_peered":"2023-10-14T19:09:36.848222+0000","last_unstale":"2023-10-14T19:09:36.848534+0000","last_undegraded":"2023-10-14T19:09:36.848534+0000","last_fullsized":"2023-10-14T19:09:36.848534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:41:00.941110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"113'4","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.905914+0000","last_change":"2023-10-14T19:09:35.917961+0000","last_active":"2023-10-14T19:09:36.905914+0000","last_peered":"2023-10-14T19:09:36.905914+0000","last_clean":"2023-10-14T19:09:36.905914+0000","last_became_active":"2023-10-14T19:09:35.917586+0000","last_became_peered":"2023-10-14T19:09:35.917586+0000","last_unstale":"2023-10-14T19:09:36.905914+0000","last_undegraded":"2023-10-14T19:09:36.905914+0000","last_fullsized":"2023-10-14T19:09:36.905914+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:52.536917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849461+0000","last_change":"2023-10-14T19:09:36.849461+0000","last_active":"2023-10-14T19:09:36.849461+0000","last_peered":"2023-10-14T19:09:36.849461+0000","last_clean":"2023-10-14T19:09:36.849461+0000","last_became_active":"2023-10-14T19:09:36.849189+0000","last_became_peered":"2023-10-14T19:09:36.849189+0000","last_unstale":"2023-10-14T19:09:36.849461+0000","last_undegraded":"2023-10-14T19:09:36.849461+0000","last_fullsized":"2023-10-14T19:09:36.849461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:08.747847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.837427+0000","last_change":"2023-10-14T19:09:35.908525+0000","last_active":"2023-10-14T19:09:36.837427+0000","last_peered":"2023-10-14T19:09:36.837427+0000","last_clean":"2023-10-14T19:09:36.837427+0000","last_became_active":"2023-10-14T19:09:35.908273+0000","last_became_peered":"2023-10-14T19:09:35.908273+0000","last_unstale":"2023-10-14T19:09:36.837427+0000","last_undegraded":"2023-10-14T19:09:36.837427+0000","last_fullsized":"2023-10-14T19:09:36.837427+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:28.015884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854475+0000","last_change":"2023-10-14T19:09:36.854475+0000","last_active":"2023-10-14T19:09:36.854475+0000","last_peered":"2023-10-14T19:09:36.854475+0000","last_clean":"2023-10-14T19:09:36.854475+0000","last_became_active":"2023-10-14T19:09:36.853835+0000","last_became_peered":"2023-10-14T19:09:36.853835+0000","last_unstale":"2023-10-14T19:09:36.854475+0000","last_undegraded":"2023-10-14T19:09:36.854475+0000","last_fullsized":"2023-10-14T19:09:36.854475+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:21.808725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904161+0000","last_change":"2023-10-14T19:09:35.908011+0000","last_active":"2023-10-14T19:09:36.904161+0000","last_peered":"2023-10-14T19:09:36.904161+0000","last_clean":"2023-10-14T19:09:36.904161+0000","last_became_active":"2023-10-14T19:09:35.907671+0000","last_became_peered":"2023-10-14T19:09:35.907671+0000","last_unstale":"2023-10-14T19:09:36.904161+0000","last_undegraded":"2023-10-14T19:09:36.904161+0000","last_fullsized":"2023-10-14T19:09:36.904161+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:32.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852559+0000","last_change":"2023-10-14T19:09:36.852559+0000","last_active":"2023-10-14T19:09:36.852559+0000","last_peered":"2023-10-14T19:09:36.852559+0000","last_clean":"2023-10-14T19:09:36.852559+0000","last_became_active":"2023-10-14T19:09:36.852257+0000","last_became_peered":"2023-10-14T19:09:36.852257+0000","last_unstale":"2023-10-14T19:09:36.852559+0000","last_undegraded":"2023-10-14T19:09:36.852559+0000","last_fullsized":"2023-10-14T19:09:36.852559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:49.538483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.903070+0000","last_change":"2023-10-14T19:09:35.911261+0000","last_active":"2023-10-14T19:09:36.903070+0000","last_peered":"2023-10-14T19:09:36.903070+0000","last_clean":"2023-10-14T19:09:36.903070+0000","last_became_active":"2023-10-14T19:09:35.910966+0000","last_became_peered":"2023-10-14T19:09:35.910966+0000","last_unstale":"2023-10-14T19:09:36.903070+0000","last_undegraded":"2023-10-14T19:09:36.903070+0000","last_fullsized":"2023-10-14T19:09:36.903070+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:32.575520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853046+0000","last_change":"2023-10-14T19:09:36.853046+0000","last_active":"2023-10-14T19:09:36.853046+0000","last_peered":"2023-10-14T19:09:36.853046+0000","last_clean":"2023-10-14T19:09:36.853046+0000","last_became_active":"2023-10-14T19:09:36.852755+0000","last_became_peered":"2023-10-14T19:09:36.852755+0000","last_unstale":"2023-10-14T19:09:36.853046+0000","last_undegraded":"2023-10-14T19:09:36.853046+0000","last_fullsized":"2023-10-14T19:09:36.853046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:55.811537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.843417+0000","last_change":"2023-10-14T19:09:35.912691+0000","last_active":"2023-10-14T19:09:36.843417+0000","last_peered":"2023-10-14T19:09:36.843417+0000","last_clean":"2023-10-14T19:09:36.843417+0000","last_became_active":"2023-10-14T19:09:35.912056+0000","last_became_peered":"2023-10-14T19:09:35.912056+0000","last_unstale":"2023-10-14T19:09:36.843417+0000","last_undegraded":"2023-10-14T19:09:36.843417+0000","last_fullsized":"2023-10-14T19:09:36.843417+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:11.705200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.844676+0000","last_change":"2023-10-14T19:09:36.844676+0000","last_active":"2023-10-14T19:09:36.844676+0000","last_peered":"2023-10-14T19:09:36.844676+0000","last_clean":"2023-10-14T19:09:36.844676+0000","last_became_active":"2023-10-14T19:09:36.844419+0000","last_became_peered":"2023-10-14T19:09:36.844419+0000","last_unstale":"2023-10-14T19:09:36.844676+0000","last_undegraded":"2023-10-14T19:09:36.844676+0000","last_fullsized":"2023-10-14T19:09:36.844676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:46.255941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.839979+0000","last_change":"2023-10-14T19:09:35.916103+0000","last_active":"2023-10-14T19:09:36.839979+0000","last_peered":"2023-10-14T19:09:36.839979+0000","last_clean":"2023-10-14T19:09:36.839979+0000","last_became_active":"2023-10-14T19:09:35.915751+0000","last_became_peered":"2023-10-14T19:09:35.915751+0000","last_unstale":"2023-10-14T19:09:36.839979+0000","last_undegraded":"2023-10-14T19:09:36.839979+0000","last_fullsized":"2023-10-14T19:09:36.839979+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:21:08.306476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851793+0000","last_change":"2023-10-14T19:09:36.851793+0000","last_active":"2023-10-14T19:09:36.851793+0000","last_peered":"2023-10-14T19:09:36.851793+0000","last_clean":"2023-10-14T19:09:36.851793+0000","last_became_active":"2023-10-14T19:09:36.849906+0000","last_became_peered":"2023-10-14T19:09:36.849906+0000","last_unstale":"2023-10-14T19:09:36.851793+0000","last_undegraded":"2023-10-14T19:09:36.851793+0000","last_fullsized":"2023-10-14T19:09:36.851793+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:57.724436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911278+0000","last_change":"2023-10-14T19:09:35.908806+0000","last_active":"2023-10-14T19:09:35.911278+0000","last_peered":"2023-10-14T19:09:35.911278+0000","last_clean":"2023-10-14T19:09:35.911278+0000","last_became_active":"2023-10-14T19:09:35.908557+0000","last_became_peered":"2023-10-14T19:09:35.908557+0000","last_unstale":"2023-10-14T19:09:35.911278+0000","last_undegraded":"2023-10-14T19:09:35.911278+0000","last_fullsized":"2023-10-14T19:09:35.911278+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:20.038996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.857143+0000","last_change":"2023-10-14T19:09:36.857143+0000","last_active":"2023-10-14T19:09:36.857143+0000","last_peered":"2023-10-14T19:09:36.857143+0000","last_clean":"2023-10-14T19:09:36.857143+0000","last_became_active":"2023-10-14T19:09:36.856905+0000","last_became_peered":"2023-10-14T19:09:36.856905+0000","last_unstale":"2023-10-14T19:09:36.857143+0000","last_undegraded":"2023-10-14T19:09:36.857143+0000","last_fullsized":"2023-10-14T19:09:36.857143+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:43.644351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.914471+0000","last_change":"2023-10-14T19:09:35.910314+0000","last_active":"2023-10-14T19:09:35.914471+0000","last_peered":"2023-10-14T19:09:35.914471+0000","last_clean":"2023-10-14T19:09:35.914471+0000","last_became_active":"2023-10-14T19:09:35.910049+0000","last_became_peered":"2023-10-14T19:09:35.910049+0000","last_unstale":"2023-10-14T19:09:35.914471+0000","last_undegraded":"2023-10-14T19:09:35.914471+0000","last_fullsized":"2023-10-14T19:09:35.914471+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:24:12.975846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.842844+0000","last_change":"2023-10-14T19:09:36.842844+0000","last_active":"2023-10-14T19:09:36.842844+0000","last_peered":"2023-10-14T19:09:36.842844+0000","last_clean":"2023-10-14T19:09:36.842844+0000","last_became_active":"2023-10-14T19:09:36.842569+0000","last_became_peered":"2023-10-14T19:09:36.842569+0000","last_unstale":"2023-10-14T19:09:36.842844+0000","last_undegraded":"2023-10-14T19:09:36.842844+0000","last_fullsized":"2023-10-14T19:09:36.842844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:33:47.786011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.923361+0000","last_change":"2023-10-14T19:09:35.915609+0000","last_active":"2023-10-14T19:09:35.923361+0000","last_peered":"2023-10-14T19:09:35.923361+0000","last_clean":"2023-10-14T19:09:35.923361+0000","last_became_active":"2023-10-14T19:09:35.915356+0000","last_became_peered":"2023-10-14T19:09:35.915356+0000","last_unstale":"2023-10-14T19:09:35.923361+0000","last_undegraded":"2023-10-14T19:09:35.923361+0000","last_fullsized":"2023-10-14T19:09:35.923361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:36.099899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845299+0000","last_change":"2023-10-14T19:09:36.845299+0000","last_active":"2023-10-14T19:09:36.845299+0000","last_peered":"2023-10-14T19:09:36.845299+0000","last_clean":"2023-10-14T19:09:36.845299+0000","last_became_active":"2023-10-14T19:09:36.845009+0000","last_became_peered":"2023-10-14T19:09:36.845009+0000","last_unstale":"2023-10-14T19:09:36.845299+0000","last_undegraded":"2023-10-14T19:09:36.845299+0000","last_fullsized":"2023-10-14T19:09:36.845299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:53.423764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911613+0000","last_change":"2023-10-14T19:09:35.908276+0000","last_active":"2023-10-14T19:09:35.911613+0000","last_peered":"2023-10-14T19:09:35.911613+0000","last_clean":"2023-10-14T19:09:35.911613+0000","last_became_active":"2023-10-14T19:09:35.907995+0000","last_became_peered":"2023-10-14T19:09:35.907995+0000","last_unstale":"2023-10-14T19:09:35.911613+0000","last_undegraded":"2023-10-14T19:09:35.911613+0000","last_fullsized":"2023-10-14T19:09:35.911613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:45.129391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847933+0000","last_change":"2023-10-14T19:09:36.847933+0000","last_active":"2023-10-14T19:09:36.847933+0000","last_peered":"2023-10-14T19:09:36.847933+0000","last_clean":"2023-10-14T19:09:36.847933+0000","last_became_active":"2023-10-14T19:09:36.847622+0000","last_became_peered":"2023-10-14T19:09:36.847622+0000","last_unstale":"2023-10-14T19:09:36.847933+0000","last_undegraded":"2023-10-14T19:09:36.847933+0000","last_fullsized":"2023-10-14T19:09:36.847933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:27.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"113'3","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.902099+0000","last_change":"2023-10-14T19:09:35.909027+0000","last_active":"2023-10-14T19:09:36.902099+0000","last_peered":"2023-10-14T19:09:36.902099+0000","last_clean":"2023-10-14T19:09:36.902099+0000","last_became_active":"2023-10-14T19:09:35.908786+0000","last_became_peered":"2023-10-14T19:09:35.908786+0000","last_unstale":"2023-10-14T19:09:36.902099+0000","last_undegraded":"2023-10-14T19:09:36.902099+0000","last_fullsized":"2023-10-14T19:09:36.902099+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:08.090524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.853694+0000","last_change":"2023-10-14T19:09:36.853694+0000","last_active":"2023-10-14T19:09:36.853694+0000","last_peered":"2023-10-14T19:09:36.853694+0000","last_clean":"2023-10-14T19:09:36.853694+0000","last_became_active":"2023-10-14T19:09:36.853409+0000","last_became_peered":"2023-10-14T19:09:36.853409+0000","last_unstale":"2023-10-14T19:09:36.853694+0000","last_undegraded":"2023-10-14T19:09:36.853694+0000","last_fullsized":"2023-10-14T19:09:36.853694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:12.546010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"113'6","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.906671+0000","last_change":"2023-10-14T19:09:35.907155+0000","last_active":"2023-10-14T19:09:36.906671+0000","last_peered":"2023-10-14T19:09:36.906671+0000","last_clean":"2023-10-14T19:09:36.906671+0000","last_became_active":"2023-10-14T19:09:35.906664+0000","last_became_peered":"2023-10-14T19:09:35.906664+0000","last_unstale":"2023-10-14T19:09:36.906671+0000","last_undegraded":"2023-10-14T19:09:36.906671+0000","last_fullsized":"2023-10-14T19:09:36.906671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:32.575520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.842945+0000","last_change":"2023-10-14T19:09:36.842945+0000","last_active":"2023-10-14T19:09:36.842945+0000","last_peered":"2023-10-14T19:09:36.842945+0000","last_clean":"2023-10-14T19:09:36.842945+0000","last_became_active":"2023-10-14T19:09:36.842674+0000","last_became_peered":"2023-10-14T19:09:36.842674+0000","last_unstale":"2023-10-14T19:09:36.842945+0000","last_undegraded":"2023-10-14T19:09:36.842945+0000","last_fullsized":"2023-10-14T19:09:36.842945+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:21.808486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.919145+0000","last_change":"2023-10-14T19:09:35.918754+0000","last_active":"2023-10-14T19:09:35.919145+0000","last_peered":"2023-10-14T19:09:35.919145+0000","last_clean":"2023-10-14T19:09:35.919145+0000","last_became_active":"2023-10-14T19:09:35.918370+0000","last_became_peered":"2023-10-14T19:09:35.918370+0000","last_unstale":"2023-10-14T19:09:35.919145+0000","last_undegraded":"2023-10-14T19:09:35.919145+0000","last_fullsized":"2023-10-14T19:09:35.919145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:25.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854448+0000","last_change":"2023-10-14T19:09:36.854448+0000","last_active":"2023-10-14T19:09:36.854448+0000","last_peered":"2023-10-14T19:09:36.854448+0000","last_clean":"2023-10-14T19:09:36.854448+0000","last_became_active":"2023-10-14T19:09:36.854202+0000","last_became_peered":"2023-10-14T19:09:36.854202+0000","last_unstale":"2023-10-14T19:09:36.854448+0000","last_undegraded":"2023-10-14T19:09:36.854448+0000","last_fullsized":"2023-10-14T19:09:36.854448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:39:34.920362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.916157+0000","last_change":"2023-10-14T19:09:35.913414+0000","last_active":"2023-10-14T19:09:35.916157+0000","last_peered":"2023-10-14T19:09:35.916157+0000","last_clean":"2023-10-14T19:09:35.916157+0000","last_became_active":"2023-10-14T19:09:35.912646+0000","last_became_peered":"2023-10-14T19:09:35.912646+0000","last_unstale":"2023-10-14T19:09:35.916157+0000","last_undegraded":"2023-10-14T19:09:35.916157+0000","last_fullsized":"2023-10-14T19:09:35.916157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:28.015884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848313+0000","last_change":"2023-10-14T19:09:36.848313+0000","last_active":"2023-10-14T19:09:36.848313+0000","last_peered":"2023-10-14T19:09:36.848313+0000","last_clean":"2023-10-14T19:09:36.848313+0000","last_became_active":"2023-10-14T19:09:36.848021+0000","last_became_peered":"2023-10-14T19:09:36.848021+0000","last_unstale":"2023-10-14T19:09:36.848313+0000","last_undegraded":"2023-10-14T19:09:36.848313+0000","last_fullsized":"2023-10-14T19:09:36.848313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:53.423764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"113'8","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.905293+0000","last_change":"2023-10-14T19:09:35.907299+0000","last_active":"2023-10-14T19:09:36.905293+0000","last_peered":"2023-10-14T19:09:36.905293+0000","last_clean":"2023-10-14T19:09:36.905293+0000","last_became_active":"2023-10-14T19:09:35.907020+0000","last_became_peered":"2023-10-14T19:09:35.907020+0000","last_unstale":"2023-10-14T19:09:36.905293+0000","last_undegraded":"2023-10-14T19:09:36.905293+0000","last_fullsized":"2023-10-14T19:09:36.905293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:11.705200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848366+0000","last_change":"2023-10-14T19:09:36.848366+0000","last_active":"2023-10-14T19:09:36.848366+0000","last_peered":"2023-10-14T19:09:36.848366+0000","last_clean":"2023-10-14T19:09:36.848366+0000","last_became_active":"2023-10-14T19:09:36.848084+0000","last_became_peered":"2023-10-14T19:09:36.848084+0000","last_unstale":"2023-10-14T19:09:36.848366+0000","last_undegraded":"2023-10-14T19:09:36.848366+0000","last_fullsized":"2023-10-14T19:09:36.848366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:49.505693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.839080+0000","last_change":"2023-10-14T19:09:35.911905+0000","last_active":"2023-10-14T19:09:36.839080+0000","last_peered":"2023-10-14T19:09:36.839080+0000","last_clean":"2023-10-14T19:09:36.839080+0000","last_became_active":"2023-10-14T19:09:35.911631+0000","last_became_peered":"2023-10-14T19:09:35.911631+0000","last_unstale":"2023-10-14T19:09:36.839080+0000","last_undegraded":"2023-10-14T19:09:36.839080+0000","last_fullsized":"2023-10-14T19:09:36.839080+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:24:12.975846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845338+0000","last_change":"2023-10-14T19:09:36.845338+0000","last_active":"2023-10-14T19:09:36.845338+0000","last_peered":"2023-10-14T19:09:36.845338+0000","last_clean":"2023-10-14T19:09:36.845338+0000","last_became_active":"2023-10-14T19:09:36.845040+0000","last_became_peered":"2023-10-14T19:09:36.845040+0000","last_unstale":"2023-10-14T19:09:36.845338+0000","last_undegraded":"2023-10-14T19:09:36.845338+0000","last_fullsized":"2023-10-14T19:09:36.845338+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:21.045283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.903718+0000","last_change":"2023-10-14T19:09:35.905664+0000","last_active":"2023-10-14T19:09:36.903718+0000","last_peered":"2023-10-14T19:09:36.903718+0000","last_clean":"2023-10-14T19:09:36.903718+0000","last_became_active":"2023-10-14T19:09:35.905404+0000","last_became_peered":"2023-10-14T19:09:35.905404+0000","last_unstale":"2023-10-14T19:09:36.903718+0000","last_undegraded":"2023-10-14T19:09:36.903718+0000","last_fullsized":"2023-10-14T19:09:36.903718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:10.785218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.848603+0000","last_change":"2023-10-14T19:09:36.848603+0000","last_active":"2023-10-14T19:09:36.848603+0000","last_peered":"2023-10-14T19:09:36.848603+0000","last_clean":"2023-10-14T19:09:36.848603+0000","last_became_active":"2023-10-14T19:09:36.848355+0000","last_became_peered":"2023-10-14T19:09:36.848355+0000","last_unstale":"2023-10-14T19:09:36.848603+0000","last_undegraded":"2023-10-14T19:09:36.848603+0000","last_fullsized":"2023-10-14T19:09:36.848603+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:56:43.405938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.838861+0000","last_change":"2023-10-14T19:09:35.905860+0000","last_active":"2023-10-14T19:09:36.838861+0000","last_peered":"2023-10-14T19:09:36.838861+0000","last_clean":"2023-10-14T19:09:36.838861+0000","last_became_active":"2023-10-14T19:09:35.905588+0000","last_became_peered":"2023-10-14T19:09:35.905588+0000","last_unstale":"2023-10-14T19:09:36.838861+0000","last_undegraded":"2023-10-14T19:09:36.838861+0000","last_fullsized":"2023-10-14T19:09:36.838861+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:52.417478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.856915+0000","last_change":"2023-10-14T19:09:36.856915+0000","last_active":"2023-10-14T19:09:36.856915+0000","last_peered":"2023-10-14T19:09:36.856915+0000","last_clean":"2023-10-14T19:09:36.856915+0000","last_became_active":"2023-10-14T19:09:36.856647+0000","last_became_peered":"2023-10-14T19:09:36.856647+0000","last_unstale":"2023-10-14T19:09:36.856915+0000","last_undegraded":"2023-10-14T19:09:36.856915+0000","last_fullsized":"2023-10-14T19:09:36.856915+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:33.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911349+0000","last_change":"2023-10-14T19:09:35.909972+0000","last_active":"2023-10-14T19:09:35.911349+0000","last_peered":"2023-10-14T19:09:35.911349+0000","last_clean":"2023-10-14T19:09:35.911349+0000","last_became_active":"2023-10-14T19:09:35.909656+0000","last_became_peered":"2023-10-14T19:09:35.909656+0000","last_unstale":"2023-10-14T19:09:35.911349+0000","last_undegraded":"2023-10-14T19:09:35.911349+0000","last_fullsized":"2023-10-14T19:09:35.911349+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:43:08.531467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852766+0000","last_change":"2023-10-14T19:09:36.852766+0000","last_active":"2023-10-14T19:09:36.852766+0000","last_peered":"2023-10-14T19:09:36.852766+0000","last_clean":"2023-10-14T19:09:36.852766+0000","last_became_active":"2023-10-14T19:09:36.852507+0000","last_became_peered":"2023-10-14T19:09:36.852507+0000","last_unstale":"2023-10-14T19:09:36.852766+0000","last_undegraded":"2023-10-14T19:09:36.852766+0000","last_fullsized":"2023-10-14T19:09:36.852766+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:51.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904285+0000","last_change":"2023-10-14T19:09:35.914426+0000","last_active":"2023-10-14T19:09:36.904285+0000","last_peered":"2023-10-14T19:09:36.904285+0000","last_clean":"2023-10-14T19:09:36.904285+0000","last_became_active":"2023-10-14T19:09:35.914166+0000","last_became_peered":"2023-10-14T19:09:35.914166+0000","last_unstale":"2023-10-14T19:09:36.904285+0000","last_undegraded":"2023-10-14T19:09:36.904285+0000","last_fullsized":"2023-10-14T19:09:36.904285+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:18.178899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851090+0000","last_change":"2023-10-14T19:09:36.851090+0000","last_active":"2023-10-14T19:09:36.851090+0000","last_peered":"2023-10-14T19:09:36.851090+0000","last_clean":"2023-10-14T19:09:36.851090+0000","last_became_active":"2023-10-14T19:09:36.850804+0000","last_became_peered":"2023-10-14T19:09:36.850804+0000","last_unstale":"2023-10-14T19:09:36.851090+0000","last_undegraded":"2023-10-14T19:09:36.851090+0000","last_fullsized":"2023-10-14T19:09:36.851090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:03:01.841777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.913710+0000","last_change":"2023-10-14T19:09:35.910422+0000","last_active":"2023-10-14T19:09:35.913710+0000","last_peered":"2023-10-14T19:09:35.913710+0000","last_clean":"2023-10-14T19:09:35.913710+0000","last_became_active":"2023-10-14T19:09:35.909580+0000","last_became_peered":"2023-10-14T19:09:35.909580+0000","last_unstale":"2023-10-14T19:09:35.913710+0000","last_undegraded":"2023-10-14T19:09:35.913710+0000","last_fullsized":"2023-10-14T19:09:35.913710+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:19.328698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.854968+0000","last_change":"2023-10-14T19:09:36.854968+0000","last_active":"2023-10-14T19:09:36.854968+0000","last_peered":"2023-10-14T19:09:36.854968+0000","last_clean":"2023-10-14T19:09:36.854968+0000","last_became_active":"2023-10-14T19:09:36.854665+0000","last_became_peered":"2023-10-14T19:09:36.854665+0000","last_unstale":"2023-10-14T19:09:36.854968+0000","last_undegraded":"2023-10-14T19:09:36.854968+0000","last_fullsized":"2023-10-14T19:09:36.854968+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:53.891007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.914155+0000","last_change":"2023-10-14T19:09:35.910590+0000","last_active":"2023-10-14T19:09:35.914155+0000","last_peered":"2023-10-14T19:09:35.914155+0000","last_clean":"2023-10-14T19:09:35.914155+0000","last_became_active":"2023-10-14T19:09:35.910235+0000","last_became_peered":"2023-10-14T19:09:35.910235+0000","last_unstale":"2023-10-14T19:09:35.914155+0000","last_undegraded":"2023-10-14T19:09:35.914155+0000","last_fullsized":"2023-10-14T19:09:35.914155+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:30.958755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.849100+0000","last_change":"2023-10-14T19:09:36.849100+0000","last_active":"2023-10-14T19:09:36.849100+0000","last_peered":"2023-10-14T19:09:36.849100+0000","last_clean":"2023-10-14T19:09:36.849100+0000","last_became_active":"2023-10-14T19:09:36.848835+0000","last_became_peered":"2023-10-14T19:09:36.848835+0000","last_unstale":"2023-10-14T19:09:36.849100+0000","last_undegraded":"2023-10-14T19:09:36.849100+0000","last_fullsized":"2023-10-14T19:09:36.849100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:29.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.908768+0000","last_change":"2023-10-14T19:09:35.905324+0000","last_active":"2023-10-14T19:09:35.908768+0000","last_peered":"2023-10-14T19:09:35.908768+0000","last_clean":"2023-10-14T19:09:35.908768+0000","last_became_active":"2023-10-14T19:09:35.905034+0000","last_became_peered":"2023-10-14T19:09:35.905034+0000","last_unstale":"2023-10-14T19:09:35.908768+0000","last_undegraded":"2023-10-14T19:09:35.908768+0000","last_fullsized":"2023-10-14T19:09:35.908768+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:51:26.555154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.845356+0000","last_change":"2023-10-14T19:09:36.845356+0000","last_active":"2023-10-14T19:09:36.845356+0000","last_peered":"2023-10-14T19:09:36.845356+0000","last_clean":"2023-10-14T19:09:36.845356+0000","last_became_active":"2023-10-14T19:09:36.845086+0000","last_became_peered":"2023-10-14T19:09:36.845086+0000","last_unstale":"2023-10-14T19:09:36.845356+0000","last_undegraded":"2023-10-14T19:09:36.845356+0000","last_fullsized":"2023-10-14T19:09:36.845356+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:06.062939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904172+0000","last_change":"2023-10-14T19:09:35.912898+0000","last_active":"2023-10-14T19:09:36.904172+0000","last_peered":"2023-10-14T19:09:36.904172+0000","last_clean":"2023-10-14T19:09:36.904172+0000","last_became_active":"2023-10-14T19:09:35.912623+0000","last_became_peered":"2023-10-14T19:09:35.912623+0000","last_unstale":"2023-10-14T19:09:36.904172+0000","last_undegraded":"2023-10-14T19:09:36.904172+0000","last_fullsized":"2023-10-14T19:09:36.904172+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:35.323248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851091+0000","last_change":"2023-10-14T19:09:36.851091+0000","last_active":"2023-10-14T19:09:36.851091+0000","last_peered":"2023-10-14T19:09:36.851091+0000","last_clean":"2023-10-14T19:09:36.851091+0000","last_became_active":"2023-10-14T19:09:36.850742+0000","last_became_peered":"2023-10-14T19:09:36.850742+0000","last_unstale":"2023-10-14T19:09:36.851091+0000","last_undegraded":"2023-10-14T19:09:36.851091+0000","last_fullsized":"2023-10-14T19:09:36.851091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:59:48.060503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.917599+0000","last_change":"2023-10-14T19:09:35.912196+0000","last_active":"2023-10-14T19:09:35.917599+0000","last_peered":"2023-10-14T19:09:35.917599+0000","last_clean":"2023-10-14T19:09:35.917599+0000","last_became_active":"2023-10-14T19:09:35.911923+0000","last_became_peered":"2023-10-14T19:09:35.911923+0000","last_unstale":"2023-10-14T19:09:35.917599+0000","last_undegraded":"2023-10-14T19:09:35.917599+0000","last_fullsized":"2023-10-14T19:09:35.917599+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:45.129391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.856445+0000","last_change":"2023-10-14T19:09:36.856445+0000","last_active":"2023-10-14T19:09:36.856445+0000","last_peered":"2023-10-14T19:09:36.856445+0000","last_clean":"2023-10-14T19:09:36.856445+0000","last_became_active":"2023-10-14T19:09:36.856166+0000","last_became_peered":"2023-10-14T19:09:36.856166+0000","last_unstale":"2023-10-14T19:09:36.856445+0000","last_undegraded":"2023-10-14T19:09:36.856445+0000","last_fullsized":"2023-10-14T19:09:36.856445+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:06.062939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.914511+0000","last_change":"2023-10-14T19:09:35.908137+0000","last_active":"2023-10-14T19:09:35.914511+0000","last_peered":"2023-10-14T19:09:35.914511+0000","last_clean":"2023-10-14T19:09:35.914511+0000","last_became_active":"2023-10-14T19:09:35.907810+0000","last_became_peered":"2023-10-14T19:09:35.907810+0000","last_unstale":"2023-10-14T19:09:35.914511+0000","last_undegraded":"2023-10-14T19:09:35.914511+0000","last_fullsized":"2023-10-14T19:09:35.914511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:08.090524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.846897+0000","last_change":"2023-10-14T19:09:36.846897+0000","last_active":"2023-10-14T19:09:36.846897+0000","last_peered":"2023-10-14T19:09:36.846897+0000","last_clean":"2023-10-14T19:09:36.846897+0000","last_became_active":"2023-10-14T19:09:36.846485+0000","last_became_peered":"2023-10-14T19:09:36.846485+0000","last_unstale":"2023-10-14T19:09:36.846897+0000","last_undegraded":"2023-10-14T19:09:36.846897+0000","last_fullsized":"2023-10-14T19:09:36.846897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:21:09.312763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.915796+0000","last_change":"2023-10-14T19:09:35.915266+0000","last_active":"2023-10-14T19:09:35.915796+0000","last_peered":"2023-10-14T19:09:35.915796+0000","last_clean":"2023-10-14T19:09:35.915796+0000","last_became_active":"2023-10-14T19:09:35.914993+0000","last_became_peered":"2023-10-14T19:09:35.914993+0000","last_unstale":"2023-10-14T19:09:35.915796+0000","last_undegraded":"2023-10-14T19:09:35.915796+0000","last_fullsized":"2023-10-14T19:09:35.915796+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:44.853234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.852603+0000","last_change":"2023-10-14T19:09:36.852603+0000","last_active":"2023-10-14T19:09:36.852603+0000","last_peered":"2023-10-14T19:09:36.852603+0000","last_clean":"2023-10-14T19:09:36.852603+0000","last_became_active":"2023-10-14T19:09:36.852093+0000","last_became_peered":"2023-10-14T19:09:36.852093+0000","last_unstale":"2023-10-14T19:09:36.852603+0000","last_undegraded":"2023-10-14T19:09:36.852603+0000","last_fullsized":"2023-10-14T19:09:36.852603+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:59.972880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.915618+0000","last_change":"2023-10-14T19:09:35.913219+0000","last_active":"2023-10-14T19:09:35.915618+0000","last_peered":"2023-10-14T19:09:35.915618+0000","last_clean":"2023-10-14T19:09:35.915618+0000","last_became_active":"2023-10-14T19:09:35.912957+0000","last_became_peered":"2023-10-14T19:09:35.912957+0000","last_unstale":"2023-10-14T19:09:35.915618+0000","last_undegraded":"2023-10-14T19:09:35.915618+0000","last_fullsized":"2023-10-14T19:09:35.915618+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:43:08.531467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847970+0000","last_change":"2023-10-14T19:09:36.847970+0000","last_active":"2023-10-14T19:09:36.847970+0000","last_peered":"2023-10-14T19:09:36.847970+0000","last_clean":"2023-10-14T19:09:36.847970+0000","last_became_active":"2023-10-14T19:09:36.847726+0000","last_became_peered":"2023-10-14T19:09:36.847726+0000","last_unstale":"2023-10-14T19:09:36.847970+0000","last_undegraded":"2023-10-14T19:09:36.847970+0000","last_fullsized":"2023-10-14T19:09:36.847970+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:26:53.675656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.917625+0000","last_change":"2023-10-14T19:09:35.912253+0000","last_active":"2023-10-14T19:09:35.917625+0000","last_peered":"2023-10-14T19:09:35.917625+0000","last_clean":"2023-10-14T19:09:35.917625+0000","last_became_active":"2023-10-14T19:09:35.911977+0000","last_became_peered":"2023-10-14T19:09:35.911977+0000","last_unstale":"2023-10-14T19:09:35.917625+0000","last_undegraded":"2023-10-14T19:09:35.917625+0000","last_fullsized":"2023-10-14T19:09:35.917625+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:19.328698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.851358+0000","last_change":"2023-10-14T19:09:36.851358+0000","last_active":"2023-10-14T19:09:36.851358+0000","last_peered":"2023-10-14T19:09:36.851358+0000","last_clean":"2023-10-14T19:09:36.851358+0000","last_became_active":"2023-10-14T19:09:36.850929+0000","last_became_peered":"2023-10-14T19:09:36.850929+0000","last_unstale":"2023-10-14T19:09:36.851358+0000","last_undegraded":"2023-10-14T19:09:36.851358+0000","last_fullsized":"2023-10-14T19:09:36.851358+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:27.389278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.910657+0000","last_change":"2023-10-14T19:09:35.908112+0000","last_active":"2023-10-14T19:09:35.910657+0000","last_peered":"2023-10-14T19:09:35.910657+0000","last_clean":"2023-10-14T19:09:35.910657+0000","last_became_active":"2023-10-14T19:09:35.907438+0000","last_became_peered":"2023-10-14T19:09:35.907438+0000","last_unstale":"2023-10-14T19:09:35.910657+0000","last_undegraded":"2023-10-14T19:09:35.910657+0000","last_fullsized":"2023-10-14T19:09:35.910657+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:28.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.855703+0000","last_change":"2023-10-14T19:09:36.855703+0000","last_active":"2023-10-14T19:09:36.855703+0000","last_peered":"2023-10-14T19:09:36.855703+0000","last_clean":"2023-10-14T19:09:36.855703+0000","last_became_active":"2023-10-14T19:09:36.855456+0000","last_became_peered":"2023-10-14T19:09:36.855456+0000","last_unstale":"2023-10-14T19:09:36.855703+0000","last_undegraded":"2023-10-14T19:09:36.855703+0000","last_fullsized":"2023-10-14T19:09:36.855703+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:34.444315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.911893+0000","last_change":"2023-10-14T19:09:35.910669+0000","last_active":"2023-10-14T19:09:35.911893+0000","last_peered":"2023-10-14T19:09:35.911893+0000","last_clean":"2023-10-14T19:09:35.911893+0000","last_became_active":"2023-10-14T19:09:35.909624+0000","last_became_peered":"2023-10-14T19:09:35.909624+0000","last_unstale":"2023-10-14T19:09:35.911893+0000","last_undegraded":"2023-10-14T19:09:35.911893+0000","last_fullsized":"2023-10-14T19:09:35.911893+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:00.538132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.847907+0000","last_change":"2023-10-14T19:09:36.847907+0000","last_active":"2023-10-14T19:09:36.847907+0000","last_peered":"2023-10-14T19:09:36.847907+0000","last_clean":"2023-10-14T19:09:36.847907+0000","last_became_active":"2023-10-14T19:09:36.847604+0000","last_became_peered":"2023-10-14T19:09:36.847604+0000","last_unstale":"2023-10-14T19:09:36.847907+0000","last_undegraded":"2023-10-14T19:09:36.847907+0000","last_fullsized":"2023-10-14T19:09:36.847907+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:35.888572+0000","last_clean_scrub_stamp":"2023-10-14T19:09:35.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:49:35.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-14T19:09:36.904386+0000","last_change":"2023-10-14T19:09:35.917829+0000","last_active":"2023-10-14T19:09:36.904386+0000","last_peered":"2023-10-14T19:09:36.904386+0000","last_clean":"2023-10-14T19:09:36.904386+0000","last_became_active":"2023-10-14T19:09:35.917519+0000","last_became_peered":"2023-10-14T19:09:35.917519+0000","last_unstale":"2023-10-14T19:09:36.904386+0000","last_undegraded":"2023-10-14T19:09:36.904386+0000","last_fullsized":"2023-10-14T19:09:36.904386+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:09:34.882285+0000","last_clean_scrub_stamp":"2023-10-14T19:09:34.882285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:28.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-14T19:09:35.907674+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:09:35.907674+0000","last_peered":"2023-10-14T19:09:35.907674+0000","last_clean":"2023-10-14T19:09:35.907674+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:09:35.907674+0000","last_undegraded":"2023-10-14T19:09:35.907674+0000","last_fullsized":"2023-10-14T19:09:35.907674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303368,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068472,"statfs":{"total":96636764160,"available":96326115328,"internally_reserved":0,"allocated":2031616,"data_stored":1202218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.67200000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":4.2080000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.67200000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":3.1480000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.61499999999999999},"min":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.75700000000000001},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":3.23},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.78000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.57199999999999995},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":2.4620000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.70399999999999996},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51900000000000002,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.86899999999999999,"15min":2.883},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.5},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.79300000000000004},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":5.383},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302776,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069064,"statfs":{"total":96636764160,"available":96326721536,"internally_reserved":0,"allocated":1425408,"data_stored":611240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.69199999999999995},"min":{"1min":0.38400000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":5.6820000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.752},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":5.7030000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.74399999999999999},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.70999999999999996,"5min":0.755,"15min":7.8680000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.52900000000000003,"15min":0.76300000000000001},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.80900000000000005,"15min":7.8250000000000002},"last":0.41399999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.77900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.83299999999999996},"min":{"1min":0.44,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":8.0090000000000003},"last":0.434}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.81299999999999994},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.38600000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.311},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.504}]},{"osd":7,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.59699999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77000000000000002,"5min":0.77900000000000003,"15min":0.86599999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":609704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.216,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.249},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52300000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38300000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.36799999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.31},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.34899999999999998},"min":{"1min":0.28799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.54000000000000004},"min":{"1min":0.42299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":1.032,"15min":1.032},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.87,"5min":1.079,"15min":1.079},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.48099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1200072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33500000000000002,"15min":0.34399999999999997},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.41599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60899999999999999},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51400000000000001,"5min":0.62,"15min":0.62},"last":0.311},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.45200000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.621}]},{"osd":7,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82299999999999995,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":610292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.439,"5min":0.58199999999999996,"15min":0.60699999999999998},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.439},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.313}]},{"osd":1,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36699999999999999,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.56499999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.76700000000000002},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.497,"5min":0.60999999999999999,"15min":11.269},"last":0.25900000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34200000000000003,"15min":0.73799999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48699999999999999,"5min":0.56499999999999995,"15min":11.318},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56000000000000005,"5min":0.624,"15min":0.69999999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.433},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.67100000000000004},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.68600000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.82799999999999996,"5min":0.89000000000000001,"15min":1.9710000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":1.0289999999999999},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79900000000000004,"5min":0.93200000000000005,"15min":11.379},"last":0.41899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":1.0309999999999999},"min":{"1min":0.47399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.93400000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.497}]},{"osd":7,"last update":"Sat Oct 14 19:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.626,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":2.0009999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":1.0469999999999999},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":602941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32300000000000001,"15min":0.35299999999999998},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.42399999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51200000000000001,"5min":0.57199999999999995,"15min":0.70099999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.64500000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36199999999999999,"15min":0.38500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.371}]},{"osd":2,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.41399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":0.59999999999999998,"15min":0.81000000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.45000000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.433}]},{"osd":4,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":609774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":2.1360000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":5.7910000000000004}]},{"osd":1,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.85699999999999998,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88600000000000001,"5min":3.488,"15min":3.488},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":1.254,"15min":1.254},"last":1.589}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":5.8360000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":0.874,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.1950000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.54500000000000004},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.222}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.57099999999999995,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64400000000000002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.374},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.63600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.878},"last":0.79000000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55200000000000005,"15min":0.60799999999999998},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.34399999999999997},"max":{"1min":0.61199999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":1.1299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298676,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073164,"statfs":{"total":96636764160,"available":96330919936,"internally_reserved":0,"allocated":1421312,"data_stored":609816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.52400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71299999999999997,"5min":0.752,"15min":0.83899999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68000000000000005,"5min":0.71699999999999997,"15min":0.83199999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.876},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":5.8639999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89600000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.85299999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76100000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:09:41.404 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:09:41.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:09:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.566+0000 7faa5767b700 1 Processor -- start 2023-10-14T19:09:41.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.567+0000 7faa5767b700 1 -- start start 2023-10-14T19:09:41.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.567+0000 7faa5767b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa500ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.567+0000 7faa5767b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa500ccba0 0x7faa500cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.567+0000 7faa5767b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500c32a0 con 0x7faa50157930 2023-10-14T19:09:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.567+0000 7faa5767b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500c9730 con 0x7faa500ccba0 2023-10-14T19:09:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.567+0000 7faa5767b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500cd560 con 0x7faa500ca2c0 2023-10-14T19:09:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa55417700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faa50157930 0x7faa500ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33844/0 (socket says 172.21.15.7:33844) 2023-10-14T19:09:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa55417700 1 -- 172.21.15.7:0/1397686342 learned_addr learned my addr 172.21.15.7:0/1397686342 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:41.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa55c18700 1 --2- 172.21.15.7:0/1397686342 >> v2:172.21.15.148:3300/0 conn(0x7faa500ccba0 0x7faa500cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa54c16700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa500ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386092636 0 0) 0x7faa500c32a0 con 0x7faa50157930 2023-10-14T19:09:41.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa38003570 con 0x7faa50157930 2023-10-14T19:09:41.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894536256 0 0) 0x7faa38003570 con 0x7faa50157930 2023-10-14T19:09:41.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 msgr2=0x7faa500ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:41.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa500ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 >> v2:172.21.15.148:3300/0 conn(0x7faa500ccba0 msgr2=0x7faa500cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:41.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 --2- 172.21.15.7:0/1397686342 >> v2:172.21.15.148:3300/0 conn(0x7faa500ccba0 0x7faa500cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500c4100 con 0x7faa50157930 2023-10-14T19:09:41.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7faa48001470 con 0x7faa50157930 2023-10-14T19:09:41.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 >> v1:172.21.15.7:6789/0 conn(0x7faa50157930 legacy=0x7faa500ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa38003b10 0x7faa38003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa38004810 0x7faa38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500c9730 con 0x7faa38003b10 2023-10-14T19:09:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500cd560 con 0x7faa38004810 2023-10-14T19:09:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800bb40 con 0x7faa500ca2c0 2023-10-14T19:09:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa55417700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa38003b10 0x7faa38003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa54c16700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa38004810 0x7faa38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.568+0000 7faa55c18700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55417700 1 -- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 msgr2=0x7faa380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:41.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55417700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55417700 1 -- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa38004810 msgr2=0x7faa38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:41.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55417700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa38004810 0x7faa38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55417700 1 -- 172.21.15.7:0/1397686342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38003570 con 0x7faa38003b10 2023-10-14T19:09:41.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55c18700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500ca2c0 0x7faa380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:41.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55417700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa38003b10 0x7faa38003f20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c2d0 tx=0x7faa48001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31594f3077576b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800cba0 con 0x7faa38003b10 2023-10-14T19:09:41.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800cd20 con 0x7faa38003b10 2023-10-14T19:09:41.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa4ffff700 1 -- 172.21.15.7:0/1397686342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48005b70 con 0x7faa38003b10 2023-10-14T19:09:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa5767b700 1 -- 172.21.15.7:0/1397686342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa38003b10 msgr2=0x7faa38003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa5767b700 1 --2- 172.21.15.7:0/1397686342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa38003b10 0x7faa38003f20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c2d0 tx=0x7faa48001d80 comp rx=0 tx=0).stop 2023-10-14T19:09:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.569+0000 7faa55c18700 1 -- 172.21.15.7:0/1397686342 reap_dead start 2023-10-14T19:09:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.570+0000 7faa5767b700 1 -- 172.21.15.7:0/1397686342 shutdown_connections 2023-10-14T19:09:41.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.570+0000 7faa5767b700 1 -- 172.21.15.7:0/1397686342 >> 172.21.15.7:0/1397686342 conn(0x7faa50088000 msgr2=0x7faa500883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.570+0000 7faa5767b700 1 -- 172.21.15.7:0/1397686342 shutdown_connections 2023-10-14T19:09:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.570+0000 7faa5767b700 1 -- 172.21.15.7:0/1397686342 wait complete. 2023-10-14T19:09:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.571+0000 7faa5767b700 1 Processor -- start 2023-10-14T19:09:41.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.571+0000 7faa5767b700 1 -- start start 2023-10-14T19:09:41.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa38003b10 0x7faa500b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500ad000 0x7faa500b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 0x7faa500b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5006d7b0 con 0x7faa500ad470 2023-10-14T19:09:41.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5006dd70 con 0x7faa500ad000 2023-10-14T19:09:41.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500abc70 con 0x7faa38003b10 2023-10-14T19:09:41.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 0x7faa500b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 0x7faa500b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45648/0 (socket says 172.21.15.7:45648) 2023-10-14T19:09:41.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 -- 172.21.15.7:0/1090259060 learned_addr learned my addr 172.21.15.7:0/1090259060 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:41.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55417700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa38003b10 0x7faa500b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa54c16700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500ad000 0x7faa500b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 -- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa38003b10 msgr2=0x7faa500b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa38003b10 0x7faa500b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 -- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500ad000 msgr2=0x7faa500b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500ad000 0x7faa500b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 -- 172.21.15.7:0/1090259060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500b3fd0 con 0x7faa500ad470 2023-10-14T19:09:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa55c18700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 0x7faa500b1ec0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faa50063620 tx=0x7faa4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4000e050 con 0x7faa500ad470 2023-10-14T19:09:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4000f040 con 0x7faa500ad470 2023-10-14T19:09:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa500abf10 con 0x7faa500ad470 2023-10-14T19:09:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40010ec0 con 0x7faa500ad470 2023-10-14T19:09:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.572+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5006da00 con 0x7faa500ad470 2023-10-14T19:09:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.574+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa500c9360 con 0x7faa500ad470 2023-10-14T19:09:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.574+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faa40003020 con 0x7faa500ad470 2023-10-14T19:09:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.574+0000 7faa4d7fa700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faa3c0672f0 0x7faa3c0697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.574+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa40085430 con 0x7faa500ad470 2023-10-14T19:09:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.575+0000 7faa55417700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faa3c0672f0 0x7faa3c0697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.575+0000 7faa55417700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faa3c0672f0 0x7faa3c0697a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faa48007c00 tx=0x7faa48015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.579+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa40051fb0 con 0x7faa500ad470 2023-10-14T19:09:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.851+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faa5004c3c0 con 0x7faa500ad470 2023-10-14T19:09:41.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.854+0000 7faa4d7fa700 1 -- 172.21.15.7:0/1090259060 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7faa400555d0 con 0x7faa500ad470 2023-10-14T19:09:41.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.856+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faa3c0672f0 msgr2=0x7faa3c0697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.856+0000 7faa5767b700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faa3c0672f0 0x7faa3c0697a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faa48007c00 tx=0x7faa48015000 comp rx=0 tx=0).stop 2023-10-14T19:09:41.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.856+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 msgr2=0x7faa500b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.856+0000 7faa5767b700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 0x7faa500b1ec0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faa50063620 tx=0x7faa4000b040 comp rx=0 tx=0).stop 2023-10-14T19:09:41.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 shutdown_connections 2023-10-14T19:09:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7faa3c0672f0 0x7faa3c0697a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa500ad470 0x7faa500b1ec0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa38003b10 0x7faa500b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 --2- 172.21.15.7:0/1090259060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500ad000 0x7faa500b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 >> 172.21.15.7:0/1090259060 conn(0x7faa50088000 msgr2=0x7faa500883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:41.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 shutdown_connections 2023-10-14T19:09:41.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.857+0000 7faa5767b700 1 -- 172.21.15.7:0/1090259060 wait complete. 2023-10-14T19:09:41.860 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:09:41.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:09:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.988+0000 7f390aa50700 1 Processor -- start 2023-10-14T19:09:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f390aa50700 1 -- start start 2023-10-14T19:09:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f390aa50700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39040a8be0 0x7f39040a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f390aa50700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39040ce1a0 con 0x7f390406d280 2023-10-14T19:09:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f390aa50700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39040cd5d0 con 0x7f39040aee90 2023-10-14T19:09:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f390aa50700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040cd870 con 0x7f39040a8be0 2023-10-14T19:09:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f3903fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39040a8be0 0x7f39040a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.989+0000 7f39037fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f390406d280 0x7f39040ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33850/0 (socket says 172.21.15.7:33850) 2023-10-14T19:09:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f39037fe700 1 -- 172.21.15.7:0/3060278990 learned_addr learned my addr 172.21.15.7:0/3060278990 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3903fff700 1 -- 172.21.15.7:0/3060278990 >> v1:172.21.15.148:6789/0 conn(0x7f39040aee90 legacy=0x7f39040b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3903fff700 1 -- 172.21.15.7:0/3060278990 >> v1:172.21.15.7:6789/0 conn(0x7f390406d280 legacy=0x7f39040ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3903fff700 1 -- 172.21.15.7:0/3060278990 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040cdb50 con 0x7f39040a8be0 2023-10-14T19:09:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3903fff700 1 --2- 172.21.15.7:0/3060278990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040a8be0 0x7f39040a8fb0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098d0 tx=0x7f38f4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790a9b7c6aa36be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3902ffd700 1 -- 172.21.15.7:0/3060278990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4009e70 con 0x7f39040a8be0 2023-10-14T19:09:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3902ffd700 1 -- 172.21.15.7:0/3060278990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4005c10 con 0x7f39040a8be0 2023-10-14T19:09:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.990+0000 7f3902ffd700 1 -- 172.21.15.7:0/3060278990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400b6a0 con 0x7f39040a8be0 2023-10-14T19:09:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 -- 172.21.15.7:0/3060278990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040a8be0 msgr2=0x7f39040a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 --2- 172.21.15.7:0/3060278990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040a8be0 0x7f39040a8fb0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098d0 tx=0x7f38f4009120 comp rx=0 tx=0).stop 2023-10-14T19:09:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 -- 172.21.15.7:0/3060278990 shutdown_connections 2023-10-14T19:09:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 --2- 172.21.15.7:0/3060278990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39040a8be0 0x7f39040a8fb0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 -- 172.21.15.7:0/3060278990 >> 172.21.15.7:0/3060278990 conn(0x7f390406ce80 msgr2=0x7f39040ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 -- 172.21.15.7:0/3060278990 shutdown_connections 2023-10-14T19:09:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.991+0000 7f390aa50700 1 -- 172.21.15.7:0/3060278990 wait complete. 2023-10-14T19:09:41.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.992+0000 7f390aa50700 1 Processor -- start 2023-10-14T19:09:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.992+0000 7f390aa50700 1 -- start start 2023-10-14T19:09:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f390aa50700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 0x7f39040980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f390aa50700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39040a8be0 0x7f39040cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f390aa50700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39040aee90 0x7f39040cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f390aa50700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904099450 con 0x7f390406d280 2023-10-14T19:09:42.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f390aa50700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39041679e0 con 0x7f39040a8be0 2023-10-14T19:09:42.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f390aa50700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3904167c70 con 0x7f39040aee90 2023-10-14T19:09:42.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 0x7f39040980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 0x7f39040980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45672/0 (socket says 172.21.15.7:45672) 2023-10-14T19:09:42.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 -- 172.21.15.7:0/2622710778 learned_addr learned my addr 172.21.15.7:0/2622710778 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3908fed700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39040aee90 0x7f39040cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f39037fe700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39040a8be0 0x7f39040cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 -- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39040aee90 msgr2=0x7f39040cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39040aee90 0x7f39040cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 -- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39040a8be0 msgr2=0x7f39040cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39040a8be0 0x7f39040cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 -- 172.21.15.7:0/2622710778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40093c0 con 0x7f390406d280 2023-10-14T19:09:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f3903fff700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 0x7f39040980f0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f38f4003080 tx=0x7f38f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4006670 con 0x7f390406d280 2023-10-14T19:09:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40067d0 con 0x7f390406d280 2023-10-14T19:09:42.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.993+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40266c0 con 0x7f390406d280 2023-10-14T19:09:42.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.994+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3904098bb0 con 0x7f390406d280 2023-10-14T19:09:42.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.994+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3904099170 con 0x7f390406d280 2023-10-14T19:09:42.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.994+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3904167f50 con 0x7f390406d280 2023-10-14T19:09:42.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.995+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f38f4023070 con 0x7f390406d280 2023-10-14T19:09:42.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.995+0000 7f38fbfff700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e4067320 0x7f38e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.995+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38f4087070 con 0x7f390406d280 2023-10-14T19:09:42.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.996+0000 7f39037fe700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e4067320 0x7f38e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:41.996+0000 7f39037fe700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e4067320 0x7f38e40697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f39040ad950 tx=0x7f38ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.000+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38f4053e10 con 0x7f390406d280 2023-10-14T19:09:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.237+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f390404c3c0 con 0x7f390406d280 2023-10-14T19:09:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.237+0000 7f38fbfff700 1 -- 172.21.15.7:0/2622710778 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f38f402b020 con 0x7f390406d280 2023-10-14T19:09:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:09:42.239 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6589,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3885032212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3885032212},{"type":"v1","addr":"172.21.15.148:6837","nonce":3885032212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7113,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3111043599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3111043599},{"type":"v1","addr":"172.21.15.7:6834","nonce":3111043599}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:36.305484+0000","modified":"2023-10-14T19:09:39.916613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/698585291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":698585291},{"type":"v1","addr":"172.21.15.7:6835","nonce":698585291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T19:09:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e4067320 msgr2=0x7f38e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e4067320 0x7f38e40697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f39040ad950 tx=0x7f38ec009040 comp rx=0 tx=0).stop 2023-10-14T19:09:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 msgr2=0x7f39040980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 0x7f39040980f0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f38f4003080 tx=0x7f38f4015000 comp rx=0 tx=0).stop 2023-10-14T19:09:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 shutdown_connections 2023-10-14T19:09:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e4067320 0x7f38e40697d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f39040aee90 0x7f39040cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f390406d280 0x7f39040980f0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 --2- 172.21.15.7:0/2622710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39040a8be0 0x7f39040cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 >> 172.21.15.7:0/2622710778 conn(0x7f390406ce80 msgr2=0x7f39040ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 shutdown_connections 2023-10-14T19:09:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.239+0000 7f390aa50700 1 -- 172.21.15.7:0/2622710778 wait complete. 2023-10-14T19:09:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2023-10-14T19:09:42.655 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:09:36.305484+0000', 'modified': '2023-10-14T19:09:39.916613+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7116}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7116': {'gid': 7116, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/698585291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6833', 'nonce': 698585291}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 698585291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:09:42.655 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:09:42.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T19:09:42.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.780+0000 7f8ef4c0a700 1 Processor -- start 2023-10-14T19:09:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.780+0000 7f8ef4c0a700 1 -- start start 2023-10-14T19:09:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8ef4c0a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ef01598b0 0x7f8ef00af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8ef4c0a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ef00af790 0x7f8ef0163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8ef4c0a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef00ce9d0 con 0x7f8ef0159c80 2023-10-14T19:09:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8ef4c0a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef00afc30 con 0x7f8ef01598b0 2023-10-14T19:09:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8ef4c0a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef00aff10 con 0x7f8ef00af790 2023-10-14T19:09:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ef01598b0 0x7f8ef00af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ef01598b0 0x7f8ef00af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45686/0 (socket says 172.21.15.7:45686) 2023-10-14T19:09:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 -- 172.21.15.7:0/895105912 learned_addr learned my addr 172.21.15.7:0/895105912 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/895105912 >> v2:172.21.15.148:3300/0 conn(0x7f8ef00af790 0x7f8ef0163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 -- 172.21.15.7:0/895105912 >> v2:172.21.15.148:3300/0 conn(0x7f8ef00af790 msgr2=0x7f8ef0163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 --2- 172.21.15.7:0/895105912 >> v2:172.21.15.148:3300/0 conn(0x7f8ef00af790 0x7f8ef0163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 -- 172.21.15.7:0/895105912 >> v1:172.21.15.148:6789/0 conn(0x7f8ef0159c80 legacy=0x7f8ef00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 -- 172.21.15.7:0/895105912 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00ce380 con 0x7f8ef01598b0 2023-10-14T19:09:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eee59c700 1 --2- 172.21.15.7:0/895105912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef01598b0 0x7f8ef00af250 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00898c0 tx=0x7f8ee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f3aa2df4871e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eed59a700 1 -- 172.21.15.7:0/895105912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800b820 con 0x7f8ef01598b0 2023-10-14T19:09:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.781+0000 7f8eed59a700 1 -- 172.21.15.7:0/895105912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee800b980 con 0x7f8ef01598b0 2023-10-14T19:09:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8eed59a700 1 -- 172.21.15.7:0/895105912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800bd20 con 0x7f8ef01598b0 2023-10-14T19:09:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/895105912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef01598b0 msgr2=0x7f8ef00af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/895105912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef01598b0 0x7f8ef00af250 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00898c0 tx=0x7f8ee8009250 comp rx=0 tx=0).stop 2023-10-14T19:09:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/895105912 shutdown_connections 2023-10-14T19:09:42.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/895105912 >> v2:172.21.15.148:3300/0 conn(0x7f8ef00af790 0x7f8ef0163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/895105912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef01598b0 0x7f8ef00af250 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/895105912 >> 172.21.15.7:0/895105912 conn(0x7f8ef0070e30 msgr2=0x7f8ef00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/895105912 shutdown_connections 2023-10-14T19:09:42.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.782+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/895105912 wait complete. 2023-10-14T19:09:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.783+0000 7f8ef4c0a700 1 Processor -- start 2023-10-14T19:09:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.783+0000 7f8ef4c0a700 1 -- start start 2023-10-14T19:09:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8ef4c0a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef00af790 0x7f8ef00b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8ef4c0a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef01598b0 0x7f8ef015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8ef4c0a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 0x7f8ef015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8ef4c0a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00b59f0 con 0x7f8ef0159c80 2023-10-14T19:09:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8ef4c0a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef016a5f0 con 0x7f8ef01598b0 2023-10-14T19:09:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8ef4c0a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef016aa80 con 0x7f8ef00af790 2023-10-14T19:09:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 0x7f8ef015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 0x7f8ef015c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45700/0 (socket says 172.21.15.7:45700) 2023-10-14T19:09:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1758982167 learned_addr learned my addr 172.21.15.7:0/1758982167 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef00af790 0x7f8ef00b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef01598b0 0x7f8ef015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef00af790 msgr2=0x7f8ef00b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef00af790 0x7f8ef00b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef01598b0 msgr2=0x7f8ef015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef01598b0 0x7f8ef015c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1758982167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80094f0 con 0x7f8ef0159c80 2023-10-14T19:09:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef01598b0 0x7f8ef015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.784+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef00af790 0x7f8ef00b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.785+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 0x7f8ef015c6e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0007f30 tx=0x7f8ee00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.785+0000 7f8ee67fc700 1 -- 172.21.15.7:0/1758982167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000ec90 con 0x7f8ef0159c80 2023-10-14T19:09:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.785+0000 7f8ee67fc700 1 -- 172.21.15.7:0/1758982167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000edf0 con 0x7f8ef0159c80 2023-10-14T19:09:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.785+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef00b5720 con 0x7f8ef0159c80 2023-10-14T19:09:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.785+0000 7f8ee67fc700 1 -- 172.21.15.7:0/1758982167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0014670 con 0x7f8ef0159c80 2023-10-14T19:09:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.785+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef0169fa0 con 0x7f8ef0159c80 2023-10-14T19:09:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.786+0000 7f8ee67fc700 1 -- 172.21.15.7:0/1758982167 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8ee0014a20 con 0x7f8ef0159c80 2023-10-14T19:09:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.786+0000 7f8ee67fc700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ed0067320 0x7f8ed00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.787+0000 7f8ee67fc700 1 -- 172.21.15.7:0/1758982167 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ee00853a0 con 0x7f8ef0159c80 2023-10-14T19:09:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.787+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ed0067320 0x7f8ed00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.787+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ed0067320 0x7f8ed00697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00898c0 tx=0x7f8ee8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.788+0000 7f8efdf03b80 1 Processor -- start 2023-10-14T19:09:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.788+0000 7f8efdf03b80 1 -- start start 2023-10-14T19:09:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be4439fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443e9d00 0x55be443c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be4439bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be442f6a70 con 0x55be4439fa50 2023-10-14T19:09:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be442f4270 con 0x55be443c8f60 2023-10-14T19:09:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be442f0060 con 0x55be443e9d00 2023-10-14T19:09:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be4439fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be4439fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45702/0 (socket says 172.21.15.7:45702) 2023-10-14T19:09:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8eee59c700 1 -- 172.21.15.7:0/3246774569 learned_addr learned my addr 172.21.15.7:0/3246774569 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be4439bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.789+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443e9d00 0x55be443c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eee59c700 1 -- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443e9d00 msgr2=0x55be443c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eee59c700 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443e9d00 0x55be443c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eee59c700 1 -- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 msgr2=0x55be4439bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eee59c700 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be4439bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eee59c700 1 -- 172.21.15.7:0/3246774569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4418a270 con 0x55be4439fa50 2023-10-14T19:09:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443e9d00 0x55be443c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8eee59c700 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be4439fe20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800b950 tx=0x7f8ee801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd957320e7371f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8ecf7fe700 1 -- 172.21.15.7:0/3246774569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800bca0 con 0x55be4439fa50 2023-10-14T19:09:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8ecf7fe700 1 -- 172.21.15.7:0/3246774569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8011ac0 con 0x55be4439fa50 2023-10-14T19:09:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.790+0000 7f8ecf7fe700 1 -- 172.21.15.7:0/3246774569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8011e40 con 0x55be4439fa50 2023-10-14T19:09:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3246774569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 msgr2=0x55be4439fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be4439fe20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800b950 tx=0x7f8ee801e040 comp rx=0 tx=0).stop 2023-10-14T19:09:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3246774569 shutdown_connections 2023-10-14T19:09:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be4439bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be4439fe20 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3246774569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443e9d00 0x55be443c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3246774569 >> 172.21.15.7:0/3246774569 conn(0x55be443a1370 msgr2=0x55be443a1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3246774569 shutdown_connections 2023-10-14T19:09:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3246774569 wait complete. 2023-10-14T19:09:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 -- start start 2023-10-14T19:09:42.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.791+0000 7f8efdf03b80 1 Processor -- start 2023-10-14T19:09:42.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be443e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be4439ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4429b890 con 0x55be4439fa50 2023-10-14T19:09:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be442b6ea0 con 0x55be443e9d00 2023-10-14T19:09:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be44172e30 con 0x55be443c8f60 2023-10-14T19:09:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8efdf03b80 10 client.0 _ll_register_callbacks cb 0x55be44363110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:09:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.792+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443e4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45712/0 (socket says 172.21.15.7:45712) 2023-10-14T19:09:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 -- 172.21.15.7:0/922586842 learned_addr learned my addr 172.21.15.7:0/922586842 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be443e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 -- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 msgr2=0x55be443e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be443e1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 -- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 msgr2=0x55be4439ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be4439ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be4439ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 -- 172.21.15.7:0/922586842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee8022070 con 0x55be4439fa50 2023-10-14T19:09:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eee59c700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443e4130 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8006e20 tx=0x7f8ee802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9e59f743d16f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eccff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:09:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eccff9700 1 -- 172.21.15.7:0/922586842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee801c870 con 0x55be4439fa50 2023-10-14T19:09:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eccff9700 1 -- 172.21.15.7:0/922586842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ee803baf0 con 0x55be4439fa50 2023-10-14T19:09:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be44394b70 con 0x55be4439fa50 2023-10-14T19:09:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eccff9700 1 -- 172.21.15.7:0/922586842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ee801c9d0 con 0x55be4439fa50 2023-10-14T19:09:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8efdf03b80 10 client.7260 fetch_fsmap learned FSMap version 73 2023-10-14T19:09:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55be4412cfe0 con 0x55be4439fa50 2023-10-14T19:09:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.793+0000 7f8eccff9700 1 -- 172.21.15.7:0/922586842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be44394b70 con 0x55be4439fa50 2023-10-14T19:09:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8eccff9700 1 -- 172.21.15.7:0/922586842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8ee802f020 con 0x55be4439fa50 2023-10-14T19:09:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8efdf03b80 10 client.7260 fetch_fsmap finished waiting for FSMap version 73 2023-10-14T19:09:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8efdf03b80 10 client.7260 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:09:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8efdf03b80 20 client.7260 populate_metadata read hostname 'smithi007' 2023-10-14T19:09:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443ddc20 0x55be443ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8efdf03b80 4 client.7260 mds_command: new command op to 7116 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:09:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 --> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be44371aa0 con 0x55be443ddc20 2023-10-14T19:09:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443ddc20 0x55be443ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8eccff9700 10 client.7260 ms_handle_connect on v2:172.21.15.7:6833/698585291 2023-10-14T19:09:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.794+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443ddc20 0x55be443ddff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b755258d90fb352 server_cookie=c0da02dd4e7f4130 in_seq=0 out_seq=0 2023-10-14T19:09:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8eccff9700 1 -- 172.21.15.7:0/922586842 <== mds.0 v2:172.21.15.7:6833/698585291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55be44371aa0 con 0x55be443ddc20 2023-10-14T19:09:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8eccff9700 10 client.7260 handle_command_reply: tid=0 2023-10-14T19:09:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 client.7260 shutdown 2023-10-14T19:09:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 msgr2=0x55be443e4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443e4130 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8006e20 tx=0x7f8ee802a000 comp rx=0 tx=0).stop 2023-10-14T19:09:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 shutdown_connections 2023-10-14T19:09:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443ddc20 0x55be443ddff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be4439ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8eccff9700 0 client.7260 ms_handle_reset on v2:172.21.15.7:6833/698585291 2023-10-14T19:09:42.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443e4130 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/922586842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be443e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 >> 172.21.15.7:0/922586842 conn(0x55be443a1370 msgr2=0x55be443e5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 shutdown_connections 2023-10-14T19:09:42.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 1 -- 172.21.15.7:0/922586842 wait complete. 2023-10-14T19:09:42.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.795+0000 7f8efdf03b80 20 client.7260 trim_cache size 0 max 16384 2023-10-14T19:09:42.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.812+0000 7f8efdf03b80 1 Processor -- start 2023-10-14T19:09:42.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.812+0000 7f8efdf03b80 1 -- start start 2023-10-14T19:09:42.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443de230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be4439fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be443f8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4439a5a0 con 0x55be4439fa50 2023-10-14T19:09:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4439a8a0 con 0x55be443e9d00 2023-10-14T19:09:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be44398830 con 0x55be443c8f60 2023-10-14T19:09:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443de230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443de230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45726/0 (socket says 172.21.15.7:45726) 2023-10-14T19:09:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 -- 172.21.15.7:0/3105808953 learned_addr learned my addr 172.21.15.7:0/3105808953 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 -- 172.21.15.7:0/3105808953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 msgr2=0x55be4439fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be4439fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 -- 172.21.15.7:0/3105808953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 msgr2=0x55be443f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be443f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.813+0000 7f8eee59c700 1 -- 172.21.15.7:0/3105808953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be442be780 con 0x55be4439fa50 2023-10-14T19:09:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8eee59c700 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443de230 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8011a90 tx=0x7f8ee8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4271b02164fbcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8ecffff700 1 -- 172.21.15.7:0/3105808953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8011ce0 con 0x55be4439fa50 2023-10-14T19:09:42.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8ecffff700 1 -- 172.21.15.7:0/3105808953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee801c870 con 0x55be4439fa50 2023-10-14T19:09:42.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8ecffff700 1 -- 172.21.15.7:0/3105808953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee801a440 con 0x55be4439fa50 2023-10-14T19:09:42.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3105808953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 msgr2=0x55be443de230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443de230 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8011a90 tx=0x7f8ee8035000 comp rx=0 tx=0).stop 2023-10-14T19:09:42.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3105808953 shutdown_connections 2023-10-14T19:09:42.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443e9d00 0x55be443f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4439fa50 0x55be443de230 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/3105808953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be443c8f60 0x55be4439fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3105808953 >> 172.21.15.7:0/3105808953 conn(0x55be443a1370 msgr2=0x55be4439bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3105808953 shutdown_connections 2023-10-14T19:09:42.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.814+0000 7f8efdf03b80 1 -- 172.21.15.7:0/3105808953 wait complete. 2023-10-14T19:09:42.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.815+0000 7f8efdf03b80 1 -- start start 2023-10-14T19:09:42.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.815+0000 7f8efdf03b80 1 Processor -- start 2023-10-14T19:09:42.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be4439fa50 0x55be4444b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be443e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 0x55be443e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4444ca10 con 0x55be443e9d00 2023-10-14T19:09:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be443dcf20 con 0x55be443c8f60 2023-10-14T19:09:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be443cb950 con 0x55be4439fa50 2023-10-14T19:09:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8efdf03b80 10 client.0 _ll_register_callbacks cb 0x55be44363110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:09:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 0x55be443e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 0x55be443e0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45730/0 (socket says 172.21.15.7:45730) 2023-10-14T19:09:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1056818247 learned_addr learned my addr 172.21.15.7:0/1056818247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be4439fa50 0x55be4444b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be443e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be4439fa50 msgr2=0x55be4444b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be4439fa50 0x55be4444b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 msgr2=0x55be443e0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be443e0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 -- 172.21.15.7:0/1056818247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4412cfe0 con 0x55be443e9d00 2023-10-14T19:09:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eedd9b700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be443e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.816+0000 7f8eeed9d700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 0x55be443e0f40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00094d0 tx=0x7f8ee0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e5dde37cffe741 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:09:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 1 -- 172.21.15.7:0/1056818247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee006c0f0 con 0x55be443e9d00 2023-10-14T19:09:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 1 -- 172.21.15.7:0/1056818247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ee0058f40 con 0x55be443e9d00 2023-10-14T19:09:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ee8011ac0 con 0x55be443e9d00 2023-10-14T19:09:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 1 -- 172.21.15.7:0/1056818247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ee005cc90 con 0x55be443e9d00 2023-10-14T19:09:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 10 client.7266 fetch_fsmap learned FSMap version 73 2023-10-14T19:09:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55be442a5470 con 0x55be443e9d00 2023-10-14T19:09:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 1 -- 172.21.15.7:0/1056818247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee0060080 con 0x55be443e9d00 2023-10-14T19:09:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 1 -- 172.21.15.7:0/1056818247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8ee00551e0 con 0x55be443e9d00 2023-10-14T19:09:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 10 client.7266 fetch_fsmap finished waiting for FSMap version 73 2023-10-14T19:09:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 10 client.7266 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:09:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 20 client.7266 populate_metadata read hostname 'smithi007' 2023-10-14T19:09:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443c5440 0x55be443c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 4 client.7266 mds_command: new command op to 7116 tid=0[{"prefix": "status"}] 2023-10-14T19:09:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 --> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be44292e00 con 0x55be443c5440 2023-10-14T19:09:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443c5440 0x55be443c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eee59c700 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443c5440 0x55be443c5810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1f81a0b670f3429 server_cookie=540287d6143f22a1 in_seq=0 out_seq=0 2023-10-14T19:09:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.817+0000 7f8eccff9700 10 client.7266 ms_handle_connect on v2:172.21.15.7:6833/698585291 2023-10-14T19:09:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8eccff9700 1 -- 172.21.15.7:0/1056818247 <== mds.0 v2:172.21.15.7:6833/698585291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55be44292e00 con 0x55be443c5440 2023-10-14T19:09:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8eccff9700 10 client.7266 handle_command_reply: tid=0 2023-10-14T19:09:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 client.7266 shutdown 2023-10-14T19:09:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 msgr2=0x55be443e0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 0x55be443e0f40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00094d0 tx=0x7f8ee0020040 comp rx=0 tx=0).stop 2023-10-14T19:09:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 shutdown_connections 2023-10-14T19:09:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:6833/698585291,v1:172.21.15.7:6835/698585291] conn(0x55be443c5440 0x55be443c5810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be443e9d00 0x55be443e0f40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8eccff9700 0 client.7266 ms_handle_reset on v2:172.21.15.7:6833/698585291 2023-10-14T19:09:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55be4439fa50 0x55be4444b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 --2- 172.21.15.7:0/1056818247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be443c8f60 0x55be443e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 >> 172.21.15.7:0/1056818247 conn(0x55be443a1370 msgr2=0x55be4439fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 shutdown_connections 2023-10-14T19:09:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 1 -- 172.21.15.7:0/1056818247 wait complete. 2023-10-14T19:09:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.818+0000 7f8efdf03b80 20 client.7266 trim_cache size 0 max 16384 2023-10-14T19:09:42.844 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:09:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:09:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:09:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7116, 2023-10-14T19:09:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:09:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:09:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:09:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.9244669190000003, 2023-10-14T19:09:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 73, 2023-10-14T19:09:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 114, 2023-10-14T19:09:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 114, 2023-10-14T19:09:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.995108326 2023-10-14T19:09:42.846 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:09:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ed0067320 msgr2=0x7f8ed00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ed0067320 0x7f8ed00697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00898c0 tx=0x7f8ee8016000 comp rx=0 tx=0).stop 2023-10-14T19:09:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 msgr2=0x7f8ef015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 0x7f8ef015c6e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0007f30 tx=0x7f8ee00098e0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 shutdown_connections 2023-10-14T19:09:42.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8ed0067320 0x7f8ed00697d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef0159c80 0x7f8ef015c6e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef00af790 0x7f8ef00b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 --2- 172.21.15.7:0/1758982167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef01598b0 0x7f8ef015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 >> 172.21.15.7:0/1758982167 conn(0x7f8ef0070e30 msgr2=0x7f8ef00b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 shutdown_connections 2023-10-14T19:09:42.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.819+0000 7f8ef4c0a700 1 -- 172.21.15.7:0/1758982167 wait complete. 2023-10-14T19:09:42.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:09:42.851 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-14T19:09:42.838+0000 7fa73b89c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:09:42.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.970+0000 7f2acac17700 1 Processor -- start 2023-10-14T19:09:42.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.970+0000 7f2acac17700 1 -- start start 2023-10-14T19:09:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2acac17700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ac41598b0 0x7f2ac40af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2acac17700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac40ce9d0 con 0x7f2ac4159c80 2023-10-14T19:09:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2acac17700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac40afc30 con 0x7f2ac40af790 2023-10-14T19:09:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2acac17700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40aff10 con 0x7f2ac41598b0 2023-10-14T19:09:42.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2ac4159c80 0x7f2ac40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33862/0 (socket says 172.21.15.7:33862) 2023-10-14T19:09:42.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac3fff700 1 -- 172.21.15.7:0/1338061676 learned_addr learned my addr 172.21.15.7:0/1338061676 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:42.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/1338061676 >> v2:172.21.15.148:3300/0 conn(0x7f2ac41598b0 0x7f2ac40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017444075 0 0) 0x7f2ac40ce9d0 con 0x7f2ac4159c80 2023-10-14T19:09:42.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab0003570 con 0x7f2ac4159c80 2023-10-14T19:09:42.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943820606 0 0) 0x7f2ab0003570 con 0x7f2ac4159c80 2023-10-14T19:09:42.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 >> v2:172.21.15.148:3300/0 conn(0x7f2ac41598b0 msgr2=0x7f2ac40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 --2- 172.21.15.7:0/1338061676 >> v2:172.21.15.148:3300/0 conn(0x7f2ac41598b0 0x7f2ac40af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 >> v1:172.21.15.148:6789/0 conn(0x7f2ac40af790 legacy=0x7f2ac4163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40ce380 con 0x7f2ac4159c80 2023-10-14T19:09:42.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2aac001470 con 0x7f2ac4159c80 2023-10-14T19:09:42.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 >> v1:172.21.15.7:6789/0 conn(0x7f2ac4159c80 legacy=0x7f2ac40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ab0003a60 0x7f2ab0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0004810 0x7f2ab0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab00051c0 0x7f2ab000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.971+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40aff10 con 0x7f2ab0003a60 2023-10-14T19:09:42.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab000c0d0 con 0x7f2ab0004810 2023-10-14T19:09:42.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab000c290 con 0x7f2ab00051c0 2023-10-14T19:09:42.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ab0003a60 0x7f2ab0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac3fff700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0004810 0x7f2ab0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac91b4700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab00051c0 0x7f2ab000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 -- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab00051c0 msgr2=0x7f2ab000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ab00051c0 0x7f2ab000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 -- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0004810 msgr2=0x7f2ab0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:42.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0004810 0x7f2ab0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 -- 172.21.15.7:0/1338061676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0003570 con 0x7f2ab0003a60 2023-10-14T19:09:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac91b4700 1 -- 172.21.15.7:0/1338061676 reap_dead start 2023-10-14T19:09:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ab0003a60 0x7f2ab0003e70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00e210 tx=0x7f2abc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69382ed22a6de28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00eac0 con 0x7f2ab0003a60 2023-10-14T19:09:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00f040 con 0x7f2ab0003a60 2023-10-14T19:09:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.972+0000 7f2ac37fe700 1 -- 172.21.15.7:0/1338061676 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ee70 con 0x7f2ab0003a60 2023-10-14T19:09:42.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 -- 172.21.15.7:0/1338061676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ab0003a60 msgr2=0x7f2ab0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ab0003a60 0x7f2ab0003e70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00e210 tx=0x7f2abc00b040 comp rx=0 tx=0).stop 2023-10-14T19:09:42.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 -- 172.21.15.7:0/1338061676 shutdown_connections 2023-10-14T19:09:42.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 --2- 172.21.15.7:0/1338061676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ab0003a60 0x7f2ab0003e70 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 -- 172.21.15.7:0/1338061676 >> 172.21.15.7:0/1338061676 conn(0x7f2ac4070e30 msgr2=0x7f2ac40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 -- 172.21.15.7:0/1338061676 shutdown_connections 2023-10-14T19:09:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.973+0000 7f2acac17700 1 -- 172.21.15.7:0/1338061676 wait complete. 2023-10-14T19:09:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.974+0000 7f2acac17700 1 Processor -- start 2023-10-14T19:09:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.974+0000 7f2acac17700 1 -- start start 2023-10-14T19:09:42.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2acac17700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0003a60 0x7f2ac4157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2acac17700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ac4169f80 0x7f2ac40c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2acac17700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 0x7f2ac4155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2acac17700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4157f90 con 0x7f2ac4153690 2023-10-14T19:09:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2acac17700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40c7960 con 0x7f2ab0003a60 2023-10-14T19:09:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2acac17700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40c7c40 con 0x7f2ac4169f80 2023-10-14T19:09:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 0x7f2ac4155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 0x7f2ac4155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45754/0 (socket says 172.21.15.7:45754) 2023-10-14T19:09:42.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 -- 172.21.15.7:0/874352424 learned_addr learned my addr 172.21.15.7:0/874352424 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:42.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac3fff700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ac4169f80 0x7f2ac40c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0003a60 0x7f2ac4157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 -- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ac4169f80 msgr2=0x7f2ac40c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ac4169f80 0x7f2ac40c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 -- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0003a60 msgr2=0x7f2ac4157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:42.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0003a60 0x7f2ac4157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:42.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 -- 172.21.15.7:0/874352424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40c7f20 con 0x7f2ac4153690 2023-10-14T19:09:42.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0003a60 0x7f2ac4157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:42.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac3fff700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ac4169f80 0x7f2ac40c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:42.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.975+0000 7f2ac91b4700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 0x7f2ac4155bc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4089a80 tx=0x7f2ab4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.976+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4006a30 con 0x7f2ac4153690 2023-10-14T19:09:42.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.976+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4006bb0 con 0x7f2ac4153690 2023-10-14T19:09:42.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.976+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac4156100 con 0x7f2ac4153690 2023-10-14T19:09:42.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.976+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4007030 con 0x7f2ac4153690 2023-10-14T19:09:42.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.976+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac40c8440 con 0x7f2ac4153690 2023-10-14T19:09:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.976+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac40c77c0 con 0x7f2ac4153690 2023-10-14T19:09:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.977+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2ab40073a0 con 0x7f2ac4153690 2023-10-14T19:09:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.977+0000 7f2ac0ff9700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.978+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ab4084430 con 0x7f2ac4153690 2023-10-14T19:09:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.978+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:42.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.978+0000 7f2ac89b3700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00afd0 tx=0x7f2abc01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:42.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:42.982+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac40c77c0 con 0x7f2ac4153690 2023-10-14T19:09:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.220+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ac40c77c0 con 0x7f2ac4153690 2023-10-14T19:09:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.221+0000 7f2ac0ff9700 1 -- 172.21.15.7:0/874352424 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ac40c77c0 con 0x7f2ac4153690 2023-10-14T19:09:43.222 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:09:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 msgr2=0x7f2aa40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00afd0 tx=0x7f2abc01a000 comp rx=0 tx=0).stop 2023-10-14T19:09:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 msgr2=0x7f2ac4155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 0x7f2ac4155bc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4089a80 tx=0x7f2ab4007d30 comp rx=0 tx=0).stop 2023-10-14T19:09:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 shutdown_connections 2023-10-14T19:09:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2aa4067320 0x7f2aa40697d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ab0003a60 0x7f2ac4157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ac4153690 0x7f2ac4155bc0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 --2- 172.21.15.7:0/874352424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ac4169f80 0x7f2ac40c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 >> 172.21.15.7:0/874352424 conn(0x7f2ac4070e30 msgr2=0x7f2ac40b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 shutdown_connections 2023-10-14T19:09:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:43.223+0000 7f2acac17700 1 -- 172.21.15.7:0/874352424 wait complete. 2023-10-14T19:09:43.236 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:09:43.237 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:09:43.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:09:43.237 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:09:43.238 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:43.238 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:09:43.238 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:09:43.239 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:09:43.239 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:09:43.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.240 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:09:43.256 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:09:43.256 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:09:43.257 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:09:43.257 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.257 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:09:43.257 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.257 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:43.258 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:43.258 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:09:43.258 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:43.258 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:43.258 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:09:43.259 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:09:43.259 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:43.259 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:09:43.259 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:09:43.260 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42071sec preferred_lft 42071sec 2023-10-14T19:09:43.260 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:09:43.260 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.260 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:43.260 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:43.261 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:09:43.261 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:09:43.261 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:43.261 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:09:43.261 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.261 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:09:43.262 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.262 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:43.262 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:09:43.262 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:09:43.262 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.263 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:43.263 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:09:43.263 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:09:43.263 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:43.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.264 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:09:43.320 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:09:43.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.322 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:09:43.378 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:09:43.378 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:09:43.378 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:09:43.379 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:09:43.379 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:09:43.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.380 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:09:43.380 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:09:43.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:09:43.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:09:43.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:09:43.381 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:09:43.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.480 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:09:43.495 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:09:43.496 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:09:43.496 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:09:43.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:09:43.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:43.561 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:43.617 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:09:43.617 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:43.618 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:43.672 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:09:43.673 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:09:43.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:43.754 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:43.755 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:09:43.755 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:09:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:09:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:09:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:43.764 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:43.784 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:09:43.785 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:09:43.785 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:09:43.785 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:43.785 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:43.785 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:09:43.786 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:09:43.786 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:09:43.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:09:43.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:43.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:09:43.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:09:44.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.015+0000 7ff42ed9d700 1 Processor -- start 2023-10-14T19:09:44.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.015+0000 7ff42ed9d700 1 -- start start 2023-10-14T19:09:44.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff428153c30 0x7ff42815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42ed9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 0x7ff4280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42ed9d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42815afd0 con 0x7ff4280cef40 2023-10-14T19:09:44.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42ed9d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42815b2b0 con 0x7ff428153c30 2023-10-14T19:09:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42ed9d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42815b590 con 0x7ff42815de50 2023-10-14T19:09:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42e59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff4280cef40 0x7ff42806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33864/0 (socket says 172.21.15.7:33864) 2023-10-14T19:09:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42e59c700 1 -- 172.21.15.7:0/839088631 learned_addr learned my addr 172.21.15.7:0/839088631 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.016+0000 7ff42d59a700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 0x7ff4280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42dd9b700 1 --2- 172.21.15.7:0/839088631 >> v2:172.21.15.148:3300/0 conn(0x7ff428153c30 0x7ff42815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960546774 0 0) 0x7ff42815afd0 con 0x7ff4280cef40 2023-10-14T19:09:44.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff410003570 con 0x7ff4280cef40 2023-10-14T19:09:44.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790032048 0 0) 0x7ff410003570 con 0x7ff4280cef40 2023-10-14T19:09:44.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 msgr2=0x7ff4280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:44.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 0x7ff4280cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 >> v2:172.21.15.148:3300/0 conn(0x7ff428153c30 msgr2=0x7ff42815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:44.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 --2- 172.21.15.7:0/839088631 >> v2:172.21.15.148:3300/0 conn(0x7ff428153c30 0x7ff42815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42815b870 con 0x7ff4280cef40 2023-10-14T19:09:44.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff4180017f0 con 0x7ff4280cef40 2023-10-14T19:09:44.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 >> v1:172.21.15.7:6789/0 conn(0x7ff4280cef40 legacy=0x7ff42806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:44.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff410003a60 0x7ff410003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 0x7ff4100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42815b2b0 con 0x7ff410004810 2023-10-14T19:09:44.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42815b590 con 0x7ff410003a60 2023-10-14T19:09:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41000ba60 con 0x7ff42815de50 2023-10-14T19:09:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42dd9b700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff410003a60 0x7ff410003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42e59c700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 0x7ff4100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 -- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 msgr2=0x7ff4100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff42815de50 0x7ff4100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 -- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff410003a60 msgr2=0x7ff410003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff410003a60 0x7ff410003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 -- 172.21.15.7:0/839088631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410003570 con 0x7ff410004810 2023-10-14T19:09:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.017+0000 7ff42d59a700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff410004c80 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009c30 tx=0x7ff41c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357edf6262fcb425 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00e710 con 0x7ff410004810 2023-10-14T19:09:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c00e870 con 0x7ff410004810 2023-10-14T19:09:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42cd99700 1 -- 172.21.15.7:0/839088631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00ec30 con 0x7ff410004810 2023-10-14T19:09:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42ed9d700 1 -- 172.21.15.7:0/839088631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 msgr2=0x7ff410004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/839088631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff410004c80 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009c30 tx=0x7ff41c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42e59c700 1 -- 172.21.15.7:0/839088631 reap_dead start 2023-10-14T19:09:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42ed9d700 1 -- 172.21.15.7:0/839088631 shutdown_connections 2023-10-14T19:09:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42ed9d700 1 -- 172.21.15.7:0/839088631 >> 172.21.15.7:0/839088631 conn(0x7ff4280703a0 msgr2=0x7ff4280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42ed9d700 1 -- 172.21.15.7:0/839088631 shutdown_connections 2023-10-14T19:09:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.018+0000 7ff42ed9d700 1 -- 172.21.15.7:0/839088631 wait complete. 2023-10-14T19:09:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.019+0000 7ff42ed9d700 1 Processor -- start 2023-10-14T19:09:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.019+0000 7ff42ed9d700 1 -- start start 2023-10-14T19:09:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff428151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4280b4170 0x7ff4280cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42ed9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4280cb8c0 0x7ff4280b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42ed9d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280cbd10 con 0x7ff410004810 2023-10-14T19:09:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42ed9d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280c8c60 con 0x7ff4280b4170 2023-10-14T19:09:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42ed9d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280cc4b0 con 0x7ff4280cb8c0 2023-10-14T19:09:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff428151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff428151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45778/0 (socket says 172.21.15.7:45778) 2023-10-14T19:09:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42dd9b700 1 -- 172.21.15.7:0/2335833195 learned_addr learned my addr 172.21.15.7:0/2335833195 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42e59c700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4280cb8c0 0x7ff4280b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42d59a700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4280b4170 0x7ff4280cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42dd9b700 1 -- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4280cb8c0 msgr2=0x7ff4280b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:44.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.020+0000 7ff42dd9b700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4280cb8c0 0x7ff4280b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42dd9b700 1 -- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4280b4170 msgr2=0x7ff4280cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:44.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42dd9b700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4280b4170 0x7ff4280cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42dd9b700 1 -- 172.21.15.7:0/2335833195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280c8930 con 0x7ff410004810 2023-10-14T19:09:44.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42d59a700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4280b4170 0x7ff4280cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:44.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42dd9b700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff428151e30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff4200119c0 tx=0x7ff420008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:44.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000f6d0 con 0x7ff410004810 2023-10-14T19:09:44.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42000f830 con 0x7ff410004810 2023-10-14T19:09:44.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4280cd1a0 con 0x7ff410004810 2023-10-14T19:09:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000fbf0 con 0x7ff410004810 2023-10-14T19:09:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.021+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4280cc1d0 con 0x7ff410004810 2023-10-14T19:09:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.022+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4280c8f40 con 0x7ff410004810 2023-10-14T19:09:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.023+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff420015460 con 0x7ff410004810 2023-10-14T19:09:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.023+0000 7ff425ffb700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff414067320 0x7ff4140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.023+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff420085440 con 0x7ff410004810 2023-10-14T19:09:44.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.023+0000 7ff42d59a700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff414067320 0x7ff4140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:44.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.024+0000 7ff42d59a700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff414067320 0x7ff4140697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0091e0 tx=0x7ff41c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:44.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.027+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff420055c10 con 0x7ff410004810 2023-10-14T19:09:44.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.267+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff42804c3c0 con 0x7ff410004810 2023-10-14T19:09:44.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.267+0000 7ff425ffb700 1 -- 172.21.15.7:0/2335833195 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4200557a0 con 0x7ff410004810 2023-10-14T19:09:44.269 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:09:44.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff414067320 msgr2=0x7ff4140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff414067320 0x7ff4140697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0091e0 tx=0x7ff41c01a000 comp rx=0 tx=0).stop 2023-10-14T19:09:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 msgr2=0x7ff428151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff428151e30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff4200119c0 tx=0x7ff420008040 comp rx=0 tx=0).stop 2023-10-14T19:09:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 shutdown_connections 2023-10-14T19:09:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff414067320 0x7ff4140697d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4280cb8c0 0x7ff4280b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff410004810 0x7ff428151e30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 --2- 172.21.15.7:0/2335833195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4280b4170 0x7ff4280cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 >> 172.21.15.7:0/2335833195 conn(0x7ff4280703a0 msgr2=0x7ff42815a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:44.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 shutdown_connections 2023-10-14T19:09:44.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:44.270+0000 7ff42ed9d700 1 -- 172.21.15.7:0/2335833195 wait complete. 2023-10-14T19:09:44.282 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:09:44.283 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:09:44.283 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:09:44.284 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:09:44.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:44.284 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:09:44.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:09:44.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:09:44.285 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:09:44.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.286 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:09:44.305 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:09:44.305 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:09:44.305 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:09:44.306 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.306 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:09:44.306 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.306 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:44.307 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:44.307 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:09:44.307 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:44.307 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:44.309 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:09:44.310 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:09:44.310 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:44.310 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:09:44.310 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:44.311 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:09:44.311 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42080sec preferred_lft 42080sec 2023-10-14T19:09:44.311 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:09:44.311 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.311 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:09:44.311 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:09:44.312 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:09:44.312 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.312 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:09:44.312 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.312 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:44.313 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:09:44.313 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:09:44.313 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.313 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:09:44.313 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:09:44.314 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:09:44.314 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:09:44.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.315 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:09:44.373 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:09:44.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.375 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:09:44.432 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:09:44.433 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:09:44.433 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:09:44.433 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:09:44.433 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:09:44.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.434 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:09:44.435 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:09:44.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:09:44.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:09:44.436 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:09:44.436 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:09:44.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.538 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:09:44.554 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:09:44.554 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:09:44.555 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:09:44.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.555 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:09:44.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:44.620 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:44.674 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:09:44.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:09:44.675 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:44.729 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:09:44.730 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:09:44.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:44.809 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:44.809 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:09:44.809 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:09:44.817 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:44.817 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:09:44.817 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:09:44.818 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:44.818 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:44.840 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:09:44.840 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:09:44.840 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:09:44.841 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:09:44.841 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:09:44.841 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:09:44.841 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:09:44.841 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:09:44.843 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:09:44.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:09:44.843 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:09:44.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:09:45.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.039+0000 7f0a69b95700 1 Processor -- start 2023-10-14T19:09:45.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.039+0000 7f0a69b95700 1 -- start start 2023-10-14T19:09:45.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a69b95700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a6415de80 0x7f0a64159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:45.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a69b95700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 0x7f0a640c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:45.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a69b95700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6415d9f0 con 0x7f0a64067e50 2023-10-14T19:09:45.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a69b95700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6415d3c0 con 0x7f0a6415de80 2023-10-14T19:09:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a69b95700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6415a8f0 con 0x7f0a6415a300 2023-10-14T19:09:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 0x7f0a640c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a62ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a6415de80 0x7f0a64159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.040+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 0x7f0a640c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:59160/0 (socket says 172.21.15.7:59160) 2023-10-14T19:09:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a63fff700 1 -- 172.21.15.7:0/3821994463 learned_addr learned my addr 172.21.15.7:0/3821994463 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a62ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a6415de80 0x7f0a64159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:53312/0 (socket says 172.21.15.7:53312) 2023-10-14T19:09:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a63fff700 1 -- 172.21.15.7:0/3821994463 >> v2:172.21.15.148:3300/0 conn(0x7f0a6415de80 msgr2=0x7f0a64159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a63fff700 1 --2- 172.21.15.7:0/3821994463 >> v2:172.21.15.148:3300/0 conn(0x7f0a6415de80 0x7f0a64159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a63fff700 1 -- 172.21.15.7:0/3821994463 >> v1:172.21.15.148:6789/0 conn(0x7f0a64067e50 legacy=0x7f0a64068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a63fff700 1 -- 172.21.15.7:0/3821994463 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6415abd0 con 0x7f0a6415a300 2023-10-14T19:09:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a63fff700 1 --2- 172.21.15.7:0/3821994463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 0x7f0a640c8c70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009f20 tx=0x7f0a5c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff754c78de4b282 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a627fc700 1 -- 172.21.15.7:0/3821994463 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00e070 con 0x7f0a6415a300 2023-10-14T19:09:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a627fc700 1 -- 172.21.15.7:0/3821994463 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c00b9d0 con 0x7f0a6415a300 2023-10-14T19:09:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.041+0000 7f0a627fc700 1 -- 172.21.15.7:0/3821994463 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0092e0 con 0x7f0a6415a300 2023-10-14T19:09:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 -- 172.21.15.7:0/3821994463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 msgr2=0x7f0a640c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3821994463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 0x7f0a640c8c70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009f20 tx=0x7f0a5c009840 comp rx=0 tx=0).stop 2023-10-14T19:09:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 -- 172.21.15.7:0/3821994463 shutdown_connections 2023-10-14T19:09:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3821994463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415a300 0x7f0a640c8c70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3821994463 >> v2:172.21.15.148:3300/0 conn(0x7f0a6415de80 0x7f0a64159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 -- 172.21.15.7:0/3821994463 >> 172.21.15.7:0/3821994463 conn(0x7f0a640ce4a0 msgr2=0x7f0a640ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 -- 172.21.15.7:0/3821994463 shutdown_connections 2023-10-14T19:09:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.042+0000 7f0a69b95700 1 -- 172.21.15.7:0/3821994463 wait complete. 2023-10-14T19:09:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.043+0000 7f0a69b95700 1 Processor -- start 2023-10-14T19:09:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.043+0000 7f0a69b95700 1 -- start start 2023-10-14T19:09:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a69b95700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a64067e50 0x7f0a6414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a69b95700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 0x7f0a640b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a69b95700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415de80 0x7f0a6414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a69b95700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640b24b0 con 0x7f0a6415a300 2023-10-14T19:09:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a69b95700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640c3a30 con 0x7f0a64067e50 2023-10-14T19:09:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a69b95700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640c3100 con 0x7f0a6415de80 2023-10-14T19:09:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 0x7f0a640b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 0x7f0a640b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45794/0 (socket says 172.21.15.7:45794) 2023-10-14T19:09:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 -- 172.21.15.7:0/3431475777 learned_addr learned my addr 172.21.15.7:0/3431475777 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a63fff700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415de80 0x7f0a6414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a637fe700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a64067e50 0x7f0a6414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 -- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415de80 msgr2=0x7f0a6414ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415de80 0x7f0a6414ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 -- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a64067e50 msgr2=0x7f0a6414d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a64067e50 0x7f0a6414d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a62ffd700 1 -- 172.21.15.7:0/3431475777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c009ae0 con 0x7f0a6415a300 2023-10-14T19:09:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.044+0000 7f0a63fff700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415de80 0x7f0a6414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:09:45.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.045+0000 7f0a62ffd700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 0x7f0a640b1c00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800ec80 tx=0x7f0a580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.045+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800c850 con 0x7f0a6415a300 2023-10-14T19:09:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.045+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800c9b0 con 0x7f0a6415a300 2023-10-14T19:09:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.045+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640c33e0 con 0x7f0a6415a300 2023-10-14T19:09:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.045+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800cd50 con 0x7f0a6415a300 2023-10-14T19:09:45.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.045+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6414dd50 con 0x7f0a6415a300 2023-10-14T19:09:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.046+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a640c3ba0 con 0x7f0a6415a300 2023-10-14T19:09:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.046+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a58013680 con 0x7f0a6415a300 2023-10-14T19:09:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.047+0000 7f0a4b7fe700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a50067320 0x7f0a500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.047+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a58084f50 con 0x7f0a6415a300 2023-10-14T19:09:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.047+0000 7f0a637fe700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a50067320 0x7f0a500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.047+0000 7f0a637fe700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a50067320 0x7f0a500697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0a540039e0 tx=0x7f0a54007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.051+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a58051be0 con 0x7f0a6415a300 2023-10-14T19:09:45.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.290+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a6404c3c0 con 0x7f0a6415a300 2023-10-14T19:09:45.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.936+0000 7f0a4b7fe700 1 -- 172.21.15.7:0/3431475777 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0a58055200 con 0x7f0a6415a300 2023-10-14T19:09:45.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a50067320 msgr2=0x7f0a500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:45.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a50067320 0x7f0a500697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0a540039e0 tx=0x7f0a54007ec0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 msgr2=0x7f0a640b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:45.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 0x7f0a640b1c00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800ec80 tx=0x7f0a580091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 shutdown_connections 2023-10-14T19:09:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a50067320 0x7f0a500697d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a64067e50 0x7f0a6414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a6415de80 0x7f0a6414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 --2- 172.21.15.7:0/3431475777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6415a300 0x7f0a640b1c00 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 >> 172.21.15.7:0/3431475777 conn(0x7f0a640ce4a0 msgr2=0x7f0a6414e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 shutdown_connections 2023-10-14T19:09:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:45.939+0000 7f0a69b95700 1 -- 172.21.15.7:0/3431475777 wait complete. 2023-10-14T19:09:45.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:09:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.083+0000 7fa9adb66700 1 Processor -- start 2023-10-14T19:09:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.083+0000 7fa9adb66700 1 -- start start 2023-10-14T19:09:46.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9adb66700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa9a80cf110 0x7fa9a8164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9adb66700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a815afd0 con 0x7fa9a815de50 2023-10-14T19:09:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9adb66700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a815b2b0 con 0x7fa9a8153c30 2023-10-14T19:09:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9adb66700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a815b590 con 0x7fa9a80cf110 2023-10-14T19:09:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9ad365700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa9a80cf110 0x7fa9a8164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9a7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa9a815de50 0x7fa9a80cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33876/0 (socket says 172.21.15.7:33876) 2023-10-14T19:09:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9a7fff700 1 -- 172.21.15.7:0/3204676141 learned_addr learned my addr 172.21.15.7:0/3204676141 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9ad365700 1 -- 172.21.15.7:0/3204676141 >> v1:172.21.15.148:6789/0 conn(0x7fa9a8153c30 legacy=0x7fa9a815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9ad365700 1 -- 172.21.15.7:0/3204676141 >> v1:172.21.15.7:6789/0 conn(0x7fa9a815de50 legacy=0x7fa9a80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9ad365700 1 -- 172.21.15.7:0/3204676141 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a815b870 con 0x7fa9a80cf110 2023-10-14T19:09:46.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.084+0000 7fa9a77fe700 1 -- 172.21.15.7:0/3204676141 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51844488 0 0) 0x7fa9a815afd0 con 0x7fa9a815de50 2023-10-14T19:09:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9ad365700 1 --2- 172.21.15.7:0/3204676141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a80cf110 0x7fa9a8164600 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009e60 tx=0x7fa9a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fcb1436bc44155 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9a77fe700 1 -- 172.21.15.7:0/3204676141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000e070 con 0x7fa9a80cf110 2023-10-14T19:09:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9a77fe700 1 -- 172.21.15.7:0/3204676141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a000bc30 con 0x7fa9a80cf110 2023-10-14T19:09:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9a77fe700 1 -- 172.21.15.7:0/3204676141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0012430 con 0x7fa9a80cf110 2023-10-14T19:09:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 -- 172.21.15.7:0/3204676141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a80cf110 msgr2=0x7fa9a8164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3204676141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a80cf110 0x7fa9a8164600 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009e60 tx=0x7fa9a0009780 comp rx=0 tx=0).stop 2023-10-14T19:09:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 -- 172.21.15.7:0/3204676141 shutdown_connections 2023-10-14T19:09:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3204676141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a80cf110 0x7fa9a8164600 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 -- 172.21.15.7:0/3204676141 >> 172.21.15.7:0/3204676141 conn(0x7fa9a80703a0 msgr2=0x7fa9a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 -- 172.21.15.7:0/3204676141 shutdown_connections 2023-10-14T19:09:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.085+0000 7fa9adb66700 1 -- 172.21.15.7:0/3204676141 wait complete. 2023-10-14T19:09:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.086+0000 7fa9adb66700 1 Processor -- start 2023-10-14T19:09:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 -- start start 2023-10-14T19:09:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a80cf110 0x7fa9a81693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 0x7fa9a8158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9a815de50 0x7fa9a80b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80b4480 con 0x7fa9a8153c30 2023-10-14T19:09:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80b3870 con 0x7fa9a80cf110 2023-10-14T19:09:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9adb66700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80b3b50 con 0x7fa9a815de50 2023-10-14T19:09:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 0x7fa9a8158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.087+0000 7fa9a7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 0x7fa9a8158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45814/0 (socket says 172.21.15.7:45814) 2023-10-14T19:09:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 -- 172.21.15.7:0/3831593510 learned_addr learned my addr 172.21.15.7:0/3831593510 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9acb64700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a80cf110 0x7fa9a81693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9ad365700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9a815de50 0x7fa9a80b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 -- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9a815de50 msgr2=0x7fa9a80b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9a815de50 0x7fa9a80b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 -- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a80cf110 msgr2=0x7fa9a81693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a80cf110 0x7fa9a81693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 -- 172.21.15.7:0/3831593510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009a20 con 0x7fa9a8153c30 2023-10-14T19:09:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a7fff700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 0x7fa9a8158df0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00c5b0 tx=0x7fa99c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c005b30 con 0x7fa9a8153c30 2023-10-14T19:09:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c005c90 con 0x7fa9a8153c30 2023-10-14T19:09:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a80b3e30 con 0x7fa9a8153c30 2023-10-14T19:09:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c007300 con 0x7fa9a8153c30 2023-10-14T19:09:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.088+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a80c7310 con 0x7fa9a8153c30 2023-10-14T19:09:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.089+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a80b45f0 con 0x7fa9a8153c30 2023-10-14T19:09:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.090+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa99c01b3b0 con 0x7fa9a8153c30 2023-10-14T19:09:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.090+0000 7fa9a4ff9700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa994067350 0x7fa994069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.090+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa99c084060 con 0x7fa9a8153c30 2023-10-14T19:09:46.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.090+0000 7fa9acb64700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa994067350 0x7fa994069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.091+0000 7fa9acb64700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa994067350 0x7fa994069800 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8070fb0 tx=0x7fa998009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.095+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa99c050cf0 con 0x7fa9a8153c30 2023-10-14T19:09:46.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.314+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9a804c3c0 con 0x7fa994067350 2023-10-14T19:09:46.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.317+0000 7fa9a4ff9700 1 -- 172.21.15.7:0/3831593510 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa9a804c3c0 con 0x7fa994067350 2023-10-14T19:09:46.317 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:09:46.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:46.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:09:46.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:46.318 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:09:46.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa994067350 msgr2=0x7fa994069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa994067350 0x7fa994069800 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8070fb0 tx=0x7fa998009040 comp rx=0 tx=0).stop 2023-10-14T19:09:46.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 msgr2=0x7fa9a8158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 0x7fa9a8158df0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00c5b0 tx=0x7fa99c001070 comp rx=0 tx=0).stop 2023-10-14T19:09:46.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 shutdown_connections 2023-10-14T19:09:46.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa994067350 0x7fa994069800 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a80cf110 0x7fa9a81693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9a815de50 0x7fa9a80b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 --2- 172.21.15.7:0/3831593510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9a8153c30 0x7fa9a8158df0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 >> 172.21.15.7:0/3831593510 conn(0x7fa9a80703a0 msgr2=0x7fa9a80cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:46.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 shutdown_connections 2023-10-14T19:09:46.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.318+0000 7fa9adb66700 1 -- 172.21.15.7:0/3831593510 wait complete. 2023-10-14T19:09:46.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:09:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.452+0000 7feba9d35700 1 Processor -- start 2023-10-14T19:09:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.453+0000 7feba9d35700 1 -- start start 2023-10-14T19:09:46.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.453+0000 7feba9d35700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feba4159860 0x7feba40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.453+0000 7feba9d35700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba40cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.453+0000 7feba9d35700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40cf510 con 0x7feba40ccfa0 2023-10-14T19:09:46.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.453+0000 7feba9d35700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40cc1e0 con 0x7feba4159860 2023-10-14T19:09:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.453+0000 7feba9d35700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40ce900 con 0x7feba40cbd90 2023-10-14T19:09:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba40cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba37fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feba4159860 0x7feba40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba40cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:59184/0 (socket says 172.21.15.7:59184) 2023-10-14T19:09:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 -- 172.21.15.7:0/19990481 learned_addr learned my addr 172.21.15.7:0/19990481 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 -- 172.21.15.7:0/19990481 >> v2:172.21.15.148:3300/0 conn(0x7feba4159860 msgr2=0x7feba40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 --2- 172.21.15.7:0/19990481 >> v2:172.21.15.148:3300/0 conn(0x7feba4159860 0x7feba40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 -- 172.21.15.7:0/19990481 >> v1:172.21.15.148:6789/0 conn(0x7feba40ccfa0 legacy=0x7feba40cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 -- 172.21.15.7:0/19990481 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40cebe0 con 0x7feba40cbd90 2023-10-14T19:09:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba2ffd700 1 --2- 172.21.15.7:0/19990481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba40cf9a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb98009990 tx=0x7feb98009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eae7eb351469df69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba27fc700 1 -- 172.21.15.7:0/19990481 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98009e80 con 0x7feba40cbd90 2023-10-14T19:09:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.454+0000 7feba27fc700 1 -- 172.21.15.7:0/19990481 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98005c10 con 0x7feba40cbd90 2023-10-14T19:09:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba27fc700 1 -- 172.21.15.7:0/19990481 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800b650 con 0x7feba40cbd90 2023-10-14T19:09:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 -- 172.21.15.7:0/19990481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 msgr2=0x7feba40cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 --2- 172.21.15.7:0/19990481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba40cf9a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb98009990 tx=0x7feb98009220 comp rx=0 tx=0).stop 2023-10-14T19:09:46.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 -- 172.21.15.7:0/19990481 shutdown_connections 2023-10-14T19:09:46.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 --2- 172.21.15.7:0/19990481 >> v2:172.21.15.148:3300/0 conn(0x7feba4159860 0x7feba40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 --2- 172.21.15.7:0/19990481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba40cf9a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 -- 172.21.15.7:0/19990481 >> 172.21.15.7:0/19990481 conn(0x7feba40999b0 msgr2=0x7feba4070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:46.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 -- 172.21.15.7:0/19990481 shutdown_connections 2023-10-14T19:09:46.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.455+0000 7feba9d35700 1 -- 172.21.15.7:0/19990481 wait complete. 2023-10-14T19:09:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.456+0000 7feba9d35700 1 Processor -- start 2023-10-14T19:09:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.456+0000 7feba9d35700 1 -- start start 2023-10-14T19:09:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba9d35700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba409d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba9d35700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feba40ccfa0 0x7feba40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba9d35700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 0x7feba416d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba9d35700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40b3140 con 0x7feba4159860 2023-10-14T19:09:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba9d35700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40c9150 con 0x7feba40ccfa0 2023-10-14T19:09:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba9d35700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40c9430 con 0x7feba40cbd90 2023-10-14T19:09:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 0x7feba416d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 0x7feba416d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45830/0 (socket says 172.21.15.7:45830) 2023-10-14T19:09:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 -- 172.21.15.7:0/1163947579 learned_addr learned my addr 172.21.15.7:0/1163947579 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba37fe700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba409d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba2ffd700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feba40ccfa0 0x7feba40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 -- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 msgr2=0x7feba409d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba409d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 -- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feba40ccfa0 msgr2=0x7feba40c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.457+0000 7feba3fff700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feba40ccfa0 0x7feba40c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feba3fff700 1 -- 172.21.15.7:0/1163947579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009480 con 0x7feba4159860 2023-10-14T19:09:46.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feba2ffd700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feba40ccfa0 0x7feba40c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feba3fff700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 0x7feba416d6a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00c8e0 tx=0x7feb9c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00ce80 con 0x7feba4159860 2023-10-14T19:09:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00a7e0 con 0x7feba4159860 2023-10-14T19:09:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba40c9710 con 0x7feba4159860 2023-10-14T19:09:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00aba0 con 0x7feba4159860 2023-10-14T19:09:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.458+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba40c9d50 con 0x7feba4159860 2023-10-14T19:09:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.459+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba404c3c0 con 0x7feba4159860 2023-10-14T19:09:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.459+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feb9c003030 con 0x7feba4159860 2023-10-14T19:09:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.460+0000 7feb8b7fe700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feb90067350 0x7feb90069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.460+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb9c084c20 con 0x7feba4159860 2023-10-14T19:09:46.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.460+0000 7feba37fe700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feb90067350 0x7feb90069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.460+0000 7feba37fe700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feb90067350 0x7feb90069800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb94009c90 tx=0x7feb94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.464+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb9c0518b0 con 0x7feba4159860 2023-10-14T19:09:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.659+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feba40cf760 con 0x7feba4159860 2023-10-14T19:09:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.660+0000 7feb8b7fe700 1 -- 172.21.15.7:0/1163947579 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb9c054ed0 con 0x7feba4159860 2023-10-14T19:09:46.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feb90067350 msgr2=0x7feb90069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feb90067350 0x7feb90069800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb94009c90 tx=0x7feb94008040 comp rx=0 tx=0).stop 2023-10-14T19:09:46.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 msgr2=0x7feba416d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 0x7feba416d6a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00c8e0 tx=0x7feb9c001710 comp rx=0 tx=0).stop 2023-10-14T19:09:46.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 shutdown_connections 2023-10-14T19:09:46.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feb90067350 0x7feb90069800 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba4159860 0x7feba416d6a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feba40cbd90 0x7feba409d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 --2- 172.21.15.7:0/1163947579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feba40ccfa0 0x7feba40c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 >> 172.21.15.7:0/1163947579 conn(0x7feba40999b0 msgr2=0x7feba40b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 shutdown_connections 2023-10-14T19:09:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.662+0000 7feba9d35700 1 -- 172.21.15.7:0/1163947579 wait complete. 2023-10-14T19:09:46.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:09:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.795+0000 7f5c8a052700 1 Processor -- start 2023-10-14T19:09:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.795+0000 7f5c8a052700 1 -- start start 2023-10-14T19:09:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c8a052700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c841599a0 0x7f5c8406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c8a052700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c8406b230 0x7f5c840c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c8a052700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c840c7f50 con 0x7f5c841595d0 2023-10-14T19:09:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c8a052700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8406bd00 con 0x7f5c8406b230 2023-10-14T19:09:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c8a052700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8406b740 con 0x7f5c841599a0 2023-10-14T19:09:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c8406b230 0x7f5c840c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c8406b230 0x7f5c840c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46648/0 (socket says 172.21.15.7:46648) 2023-10-14T19:09:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 -- 172.21.15.7:0/3966054432 learned_addr learned my addr 172.21.15.7:0/3966054432 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c82ffd700 1 --2- 172.21.15.7:0/3966054432 >> v2:172.21.15.148:3300/0 conn(0x7f5c841599a0 0x7f5c8406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 -- 172.21.15.7:0/3966054432 >> v2:172.21.15.148:3300/0 conn(0x7f5c841599a0 msgr2=0x7f5c8406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 --2- 172.21.15.7:0/3966054432 >> v2:172.21.15.148:3300/0 conn(0x7f5c841599a0 0x7f5c8406acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 -- 172.21.15.7:0/3966054432 >> v1:172.21.15.148:6789/0 conn(0x7f5c841595d0 legacy=0x7f5c840675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c83fff700 1 -- 172.21.15.7:0/3966054432 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8406ba20 con 0x7f5c8406b230 2023-10-14T19:09:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.796+0000 7f5c82ffd700 1 --2- 172.21.15.7:0/3966054432 >> v2:172.21.15.148:3300/0 conn(0x7f5c841599a0 0x7f5c8406acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c83fff700 1 --2- 172.21.15.7:0/3966054432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c8406b230 0x7f5c840c83e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f5c840ce450 tx=0x7f5c7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4720eb4567e9e226 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c827fc700 1 -- 172.21.15.7:0/3966054432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c00e070 con 0x7f5c8406b230 2023-10-14T19:09:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c827fc700 1 -- 172.21.15.7:0/3966054432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c00ba10 con 0x7f5c8406b230 2023-10-14T19:09:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c827fc700 1 -- 172.21.15.7:0/3966054432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0092e0 con 0x7f5c8406b230 2023-10-14T19:09:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 -- 172.21.15.7:0/3966054432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c8406b230 msgr2=0x7f5c840c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 --2- 172.21.15.7:0/3966054432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c8406b230 0x7f5c840c83e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f5c840ce450 tx=0x7f5c7c009840 comp rx=0 tx=0).stop 2023-10-14T19:09:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 -- 172.21.15.7:0/3966054432 shutdown_connections 2023-10-14T19:09:46.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 --2- 172.21.15.7:0/3966054432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c8406b230 0x7f5c840c83e0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 --2- 172.21.15.7:0/3966054432 >> v2:172.21.15.148:3300/0 conn(0x7f5c841599a0 0x7f5c8406acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 -- 172.21.15.7:0/3966054432 >> 172.21.15.7:0/3966054432 conn(0x7f5c840cd400 msgr2=0x7f5c840cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 -- 172.21.15.7:0/3966054432 shutdown_connections 2023-10-14T19:09:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.797+0000 7f5c8a052700 1 -- 172.21.15.7:0/3966054432 wait complete. 2023-10-14T19:09:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 Processor -- start 2023-10-14T19:09:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 -- start start 2023-10-14T19:09:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c8406b230 0x7f5c84169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c841595d0 0x7f5c840c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 0x7f5c841548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8416a030 con 0x7f5c841599a0 2023-10-14T19:09:46.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8416a310 con 0x7f5c8406b230 2023-10-14T19:09:46.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.799+0000 7f5c8a052700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8416a5f0 con 0x7f5c841595d0 2023-10-14T19:09:46.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 0x7f5c841548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 0x7f5c841548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46660/0 (socket says 172.21.15.7:46660) 2023-10-14T19:09:46.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 -- 172.21.15.7:0/1814010246 learned_addr learned my addr 172.21.15.7:0/1814010246 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:46.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c82ffd700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c841595d0 0x7f5c840c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c837fe700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c8406b230 0x7f5c84169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 -- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c841595d0 msgr2=0x7f5c840c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c841595d0 0x7f5c840c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 -- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c8406b230 msgr2=0x7f5c84169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:46.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c8406b230 0x7f5c84169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:46.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 -- 172.21.15.7:0/1814010246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009ae0 con 0x7f5c841599a0 2023-10-14T19:09:46.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c83fff700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 0x7f5c841548f0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c003000 tx=0x7f5c7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0032f0 con 0x7f5c841599a0 2023-10-14T19:09:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c0092e0 con 0x7f5c841599a0 2023-10-14T19:09:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c01d420 con 0x7f5c841599a0 2023-10-14T19:09:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8416a8d0 con 0x7f5c841599a0 2023-10-14T19:09:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.800+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c84154e30 con 0x7f5c841599a0 2023-10-14T19:09:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.801+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8404c3c0 con 0x7f5c841599a0 2023-10-14T19:09:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.802+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5c7c01d810 con 0x7f5c841599a0 2023-10-14T19:09:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.803+0000 7f5c6b7fe700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c70067320 0x7f5c700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.803+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c7c086830 con 0x7f5c841599a0 2023-10-14T19:09:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.803+0000 7f5c837fe700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c70067320 0x7f5c700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.803+0000 7f5c837fe700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c70067320 0x7f5c700697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5c840c2b90 tx=0x7f5c74007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:46.806+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c7c0533f0 con 0x7f5c841599a0 2023-10-14T19:09:47.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.029+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c8416a480 con 0x7f5c70067320 2023-10-14T19:09:47.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.032+0000 7f5c6b7fe700 1 -- 172.21.15.7:0/1814010246 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5c8416a480 con 0x7f5c70067320 2023-10-14T19:09:47.032 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:09:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:09:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:47.033 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:09:47.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c70067320 msgr2=0x7f5c700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:47.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c70067320 0x7f5c700697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5c840c2b90 tx=0x7f5c74007ea0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 msgr2=0x7f5c841548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 0x7f5c841548f0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c003000 tx=0x7f5c7c017000 comp rx=0 tx=0).stop 2023-10-14T19:09:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 shutdown_connections 2023-10-14T19:09:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5c70067320 0x7f5c700697d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c8406b230 0x7f5c84169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c841599a0 0x7f5c841548f0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 --2- 172.21.15.7:0/1814010246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5c841595d0 0x7f5c840c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 >> 172.21.15.7:0/1814010246 conn(0x7f5c840cd400 msgr2=0x7f5c84068220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:47.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 shutdown_connections 2023-10-14T19:09:47.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.033+0000 7f5c8a052700 1 -- 172.21.15.7:0/1814010246 wait complete. 2023-10-14T19:09:47.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000638085 2023-10-14T19:09:47.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.167+0000 7fea536e7700 1 Processor -- start 2023-10-14T19:09:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.167+0000 7fea536e7700 1 -- start start 2023-10-14T19:09:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea536e7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea4c0cc320 0x7fea4c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea536e7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc6f0 0x7fea4c13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea536e7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea4c069a00 0x7fea4c069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea536e7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4c06d7b0 con 0x7fea4c0cc320 2023-10-14T19:09:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea536e7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4c06e330 con 0x7fea4c069a00 2023-10-14T19:09:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea536e7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c06da00 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea4c0cc320 0x7fea4c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea4c0cc320 0x7fea4c13c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46670/0 (socket says 172.21.15.7:46670) 2023-10-14T19:09:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 -- 172.21.15.7:0/3423211788 learned_addr learned my addr 172.21.15.7:0/3423211788 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea50c82700 1 --2- 172.21.15.7:0/3423211788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc6f0 0x7fea4c13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51c84700 1 --2- 172.21.15.7:0/3423211788 >> v2:172.21.15.148:3300/0 conn(0x7fea4c069a00 0x7fea4c069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 -- 172.21.15.7:0/3423211788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc6f0 msgr2=0x7fea4c13c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 --2- 172.21.15.7:0/3423211788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc6f0 0x7fea4c13c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 -- 172.21.15.7:0/3423211788 >> v2:172.21.15.148:3300/0 conn(0x7fea4c069a00 msgr2=0x7fea4c069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 --2- 172.21.15.7:0/3423211788 >> v2:172.21.15.148:3300/0 conn(0x7fea4c069a00 0x7fea4c069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 -- 172.21.15.7:0/3423211788 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c06dce0 con 0x7fea4c0cc320 2023-10-14T19:09:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea51483700 1 --2- 172.21.15.7:0/3423211788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc320 0x7fea4c13c2a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fea4c06e2a0 tx=0x7fea48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a599a0bafbaade1c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.168+0000 7fea43fff700 1 -- 172.21.15.7:0/3423211788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800b860 con 0x7fea4c0cc320 2023-10-14T19:09:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea43fff700 1 -- 172.21.15.7:0/3423211788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4800b9c0 con 0x7fea4c0cc320 2023-10-14T19:09:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea43fff700 1 -- 172.21.15.7:0/3423211788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800bd60 con 0x7fea4c0cc320 2023-10-14T19:09:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 -- 172.21.15.7:0/3423211788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc320 msgr2=0x7fea4c13c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 --2- 172.21.15.7:0/3423211788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc320 0x7fea4c13c2a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fea4c06e2a0 tx=0x7fea48009250 comp rx=0 tx=0).stop 2023-10-14T19:09:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 -- 172.21.15.7:0/3423211788 shutdown_connections 2023-10-14T19:09:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 --2- 172.21.15.7:0/3423211788 >> v2:172.21.15.148:3300/0 conn(0x7fea4c069a00 0x7fea4c069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 --2- 172.21.15.7:0/3423211788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc320 0x7fea4c13c2a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 --2- 172.21.15.7:0/3423211788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc6f0 0x7fea4c13c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 -- 172.21.15.7:0/3423211788 >> 172.21.15.7:0/3423211788 conn(0x7fea4c067f00 msgr2=0x7fea4c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 -- 172.21.15.7:0/3423211788 shutdown_connections 2023-10-14T19:09:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.169+0000 7fea536e7700 1 -- 172.21.15.7:0/3423211788 wait complete. 2023-10-14T19:09:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.170+0000 7fea536e7700 1 Processor -- start 2023-10-14T19:09:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.170+0000 7fea536e7700 1 -- start start 2023-10-14T19:09:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea536e7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea4c069a00 0x7fea4c138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea536e7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc320 0x7fea4c0aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea536e7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 0x7fea4c0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea536e7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c169c60 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea536e7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1399a0 con 0x7fea4c069a00 2023-10-14T19:09:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea536e7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c139c80 con 0x7fea4c0cc320 2023-10-14T19:09:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea51c84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 0x7fea4c0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea51c84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 0x7fea4c0ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46678/0 (socket says 172.21.15.7:46678) 2023-10-14T19:09:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea51c84700 1 -- 172.21.15.7:0/1030671568 learned_addr learned my addr 172.21.15.7:0/1030671568 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea50c82700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc320 0x7fea4c0aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.171+0000 7fea51483700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea4c069a00 0x7fea4c138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51c84700 1 -- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc320 msgr2=0x7fea4c0aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51c84700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc320 0x7fea4c0aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51c84700 1 -- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea4c069a00 msgr2=0x7fea4c138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51c84700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea4c069a00 0x7fea4c138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51c84700 1 -- 172.21.15.7:0/1030671568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480094f0 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51483700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea4c069a00 0x7fea4c138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea51c84700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 0x7fea4c0ac000 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fea44009fd0 tx=0x7fea44009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400eca0 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400ee00 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c0ac540 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44014670 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.172+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c0aca80 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.173+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4c04c3c0 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.173+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fea440149e0 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.174+0000 7fea417fa700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea30067320 0x7fea300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.174+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea440853d0 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.174+0000 7fea51483700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea30067320 0x7fea300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.174+0000 7fea51483700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea30067320 0x7fea300697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fea4c06e2a0 tx=0x7fea48017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.178+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea44052060 con 0x7fea4c0cc6f0 2023-10-14T19:09:47.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:47.402+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000638085", "target": ["mon-mgr", ""]}) v1 -- 0x7fea4c139e30 con 0x7fea30067320 2023-10-14T19:09:48.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:48.937 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:49.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.969+0000 7fea417fa700 1 -- 172.21.15.7:0/1030671568 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fea4c139e30 con 0x7fea30067320 2023-10-14T19:09:49.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea30067320 msgr2=0x7fea300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:49.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea30067320 0x7fea300697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fea4c06e2a0 tx=0x7fea48017000 comp rx=0 tx=0).stop 2023-10-14T19:09:49.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 msgr2=0x7fea4c0ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:49.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 0x7fea4c0ac000 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fea44009fd0 tx=0x7fea44009900 comp rx=0 tx=0).stop 2023-10-14T19:09:49.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 shutdown_connections 2023-10-14T19:09:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea30067320 0x7fea300697d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea4c069a00 0x7fea4c138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea4c0cc6f0 0x7fea4c0ac000 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 --2- 172.21.15.7:0/1030671568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea4c0cc320 0x7fea4c0aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 >> 172.21.15.7:0/1030671568 conn(0x7fea4c067f00 msgr2=0x7fea4c068510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 shutdown_connections 2023-10-14T19:09:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:49.974+0000 7fea536e7700 1 -- 172.21.15.7:0/1030671568 wait complete. 2023-10-14T19:09:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:Volume created successfully (no MDS daemons created) 2023-10-14T19:09:49.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000638086 2023-10-14T19:09:50.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.116+0000 7f6694e51700 1 Processor -- start 2023-10-14T19:09:50.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.116+0000 7f6694e51700 1 -- start start 2023-10-14T19:09:50.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.117+0000 7f6694e51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f669013fb60 0x7f6690159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:50.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.117+0000 7f6694e51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f66900c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:50.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.117+0000 7f6694e51700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66900c8cd0 con 0x7f669013ff30 2023-10-14T19:09:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.117+0000 7f6694e51700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669006b480 con 0x7f669013fb60 2023-10-14T19:09:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.117+0000 7f6694e51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669015aa20 con 0x7f66900cd8e0 2023-10-14T19:09:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f669013fb60 0x7f6690159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f66900c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f66900c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:41002/0 (socket says 172.21.15.7:41002) 2023-10-14T19:09:50.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f669013fb60 0x7f6690159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:39278/0 (socket says 172.21.15.7:39278) 2023-10-14T19:09:50.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 -- 172.21.15.7:0/172414908 learned_addr learned my addr 172.21.15.7:0/172414908 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:50.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 -- 172.21.15.7:0/172414908 >> v2:172.21.15.148:3300/0 conn(0x7f669013fb60 msgr2=0x7f6690159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:50.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 --2- 172.21.15.7:0/172414908 >> v2:172.21.15.148:3300/0 conn(0x7f669013fb60 0x7f6690159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:50.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 -- 172.21.15.7:0/172414908 >> v1:172.21.15.148:6789/0 conn(0x7f669013ff30 legacy=0x7f66900cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 -- 172.21.15.7:0/172414908 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669015ad00 con 0x7f66900cd8e0 2023-10-14T19:09:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668ffff700 1 --2- 172.21.15.7:0/172414908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f66900c9160 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6688009f20 tx=0x7f6688009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e83a44d4f21d9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668e7fc700 1 -- 172.21.15.7:0/172414908 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800e070 con 0x7f66900cd8e0 2023-10-14T19:09:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668e7fc700 1 -- 172.21.15.7:0/172414908 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668800b9d0 con 0x7f66900cd8e0 2023-10-14T19:09:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.118+0000 7f668e7fc700 1 -- 172.21.15.7:0/172414908 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880092e0 con 0x7f66900cd8e0 2023-10-14T19:09:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 -- 172.21.15.7:0/172414908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 msgr2=0x7f66900c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 --2- 172.21.15.7:0/172414908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f66900c9160 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6688009f20 tx=0x7f6688009840 comp rx=0 tx=0).stop 2023-10-14T19:09:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 -- 172.21.15.7:0/172414908 shutdown_connections 2023-10-14T19:09:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 --2- 172.21.15.7:0/172414908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f66900c9160 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 --2- 172.21.15.7:0/172414908 >> v2:172.21.15.148:3300/0 conn(0x7f669013fb60 0x7f6690159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 -- 172.21.15.7:0/172414908 >> 172.21.15.7:0/172414908 conn(0x7f66900675a0 msgr2=0x7f66900679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:50.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 -- 172.21.15.7:0/172414908 shutdown_connections 2023-10-14T19:09:50.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.119+0000 7f6694e51700 1 -- 172.21.15.7:0/172414908 wait complete. 2023-10-14T19:09:50.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.120+0000 7f6694e51700 1 Processor -- start 2023-10-14T19:09:50.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.120+0000 7f6694e51700 1 -- start start 2023-10-14T19:09:50.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f6694e51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f6690155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:50.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f6694e51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669013fb60 0x7f6690156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f6694e51700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 0x7f6690156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f6694e51700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900c3d80 con 0x7f669013ff30 2023-10-14T19:09:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f6694e51700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900c3170 con 0x7f669013fb60 2023-10-14T19:09:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f6694e51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900c3450 con 0x7f66900cd8e0 2023-10-14T19:09:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f668ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 0x7f6690156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f668ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 0x7f6690156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46680/0 (socket says 172.21.15.7:46680) 2023-10-14T19:09:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f668ffff700 1 -- 172.21.15.7:0/2813459375 learned_addr learned my addr 172.21.15.7:0/2813459375 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f668f7fe700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f6690155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f668effd700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669013fb60 0x7f6690156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.121+0000 7f668ffff700 1 -- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 msgr2=0x7f6690155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f668ffff700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f6690155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f668ffff700 1 -- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669013fb60 msgr2=0x7f6690156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f668ffff700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669013fb60 0x7f6690156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f668ffff700 1 -- 172.21.15.7:0/2813459375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688009ae0 con 0x7f669013ff30 2023-10-14T19:09:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f668effd700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669013fb60 0x7f6690156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:09:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f668ffff700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 0x7f6690156e80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6688012000 tx=0x7f6688018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688008c30 con 0x7f669013ff30 2023-10-14T19:09:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688008dd0 con 0x7f669013ff30 2023-10-14T19:09:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880266b0 con 0x7f669013ff30 2023-10-14T19:09:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66900c3730 con 0x7f669013ff30 2023-10-14T19:09:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.122+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6690155e70 con 0x7f669013ff30 2023-10-14T19:09:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.123+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669004c3c0 con 0x7f669013ff30 2023-10-14T19:09:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.123+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6688003040 con 0x7f669013ff30 2023-10-14T19:09:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.124+0000 7f66777fe700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f667c067320 0x7f667c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.124+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6688087140 con 0x7f669013ff30 2023-10-14T19:09:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.124+0000 7f668f7fe700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f667c067320 0x7f667c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.124+0000 7f668f7fe700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f667c067320 0x7f667c0697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6680009d40 tx=0x7f6680008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.128+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6688053940 con 0x7f669013ff30 2023-10-14T19:09:50.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:50.347+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000638086", "target": ["mon-mgr", ""]}) v1 -- 0x7f669006d310 con 0x7f667c067320 2023-10-14T19:09:52.839 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-14T19:09:52.838+0000 7f94a3f57700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:09:52.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.959+0000 7f66777fe700 1 -- 172.21.15.7:0/2813459375 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f669006d310 con 0x7f667c067320 2023-10-14T19:09:52.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f667c067320 msgr2=0x7f667c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:52.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f667c067320 0x7f667c0697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6680009d40 tx=0x7f6680008040 comp rx=0 tx=0).stop 2023-10-14T19:09:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 msgr2=0x7f6690156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 0x7f6690156e80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6688012000 tx=0x7f6688018000 comp rx=0 tx=0).stop 2023-10-14T19:09:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 shutdown_connections 2023-10-14T19:09:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f667c067320 0x7f667c0697d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669013ff30 0x7f6690156e80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:52.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66900cd8e0 0x7f6690155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:52.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 --2- 172.21.15.7:0/2813459375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669013fb60 0x7f6690156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:52.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 >> 172.21.15.7:0/2813459375 conn(0x7f66900675a0 msgr2=0x7f669006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:52.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.963+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 shutdown_connections 2023-10-14T19:09:52.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:52.964+0000 7f6694e51700 1 -- 172.21.15.7:0/2813459375 wait complete. 2023-10-14T19:09:52.967 INFO:teuthology.orchestra.run.smithi007.stderr:Volume created successfully (no MDS daemons created) 2023-10-14T19:09:52.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:09:53.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.111+0000 7f7a966d3700 1 Processor -- start 2023-10-14T19:09:53.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.111+0000 7f7a966d3700 1 -- start start 2023-10-14T19:09:53.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.112+0000 7f7a966d3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7a900cb5a0 0x7f7a900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.112+0000 7f7a966d3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9015ae40 con 0x7f7a9015a5d0 2023-10-14T19:09:53.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.112+0000 7f7a966d3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9015ab60 con 0x7f7a900cd9e0 2023-10-14T19:09:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.112+0000 7f7a966d3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900d13f0 con 0x7f7a900cb5a0 2023-10-14T19:09:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.112+0000 7f7a94c70700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7a9015a5d0 0x7f7a90156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41022/0 (socket says 172.21.15.7:41022) 2023-10-14T19:09:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.112+0000 7f7a94c70700 1 -- 172.21.15.7:0/2478782546 learned_addr learned my addr 172.21.15.7:0/2478782546 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:09:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8ffff700 1 --2- 172.21.15.7:0/2478782546 >> v2:172.21.15.148:3300/0 conn(0x7f7a900cb5a0 0x7f7a900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474700027 0 0) 0x7f7a9015ae40 con 0x7f7a9015a5d0 2023-10-14T19:09:53.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a78003570 con 0x7f7a9015a5d0 2023-10-14T19:09:53.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720883882 0 0) 0x7f7a78003570 con 0x7f7a9015a5d0 2023-10-14T19:09:53.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 >> v2:172.21.15.148:3300/0 conn(0x7f7a900cb5a0 msgr2=0x7f7a900cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:53.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 --2- 172.21.15.7:0/2478782546 >> v2:172.21.15.148:3300/0 conn(0x7f7a900cb5a0 0x7f7a900cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 >> v1:172.21.15.148:6789/0 conn(0x7f7a900cd9e0 legacy=0x7f7a90159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900ccf00 con 0x7f7a9015a5d0 2023-10-14T19:09:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f7a880017f0 con 0x7f7a9015a5d0 2023-10-14T19:09:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 >> v1:172.21.15.7:6789/0 conn(0x7f7a9015a5d0 legacy=0x7f7a90156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a78003a60 0x7f7a78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a78004810 0x7f7a78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a780051c0 0x7f7a7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7800c0a0 con 0x7f7a78004810 2023-10-14T19:09:53.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7800c210 con 0x7f7a780051c0 2023-10-14T19:09:53.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7800c3d0 con 0x7f7a78003a60 2023-10-14T19:09:53.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8f7fe700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a78004810 0x7f7a78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8ffff700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a78003a60 0x7f7a78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a94c70700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a780051c0 0x7f7a7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8f7fe700 1 -- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a78003a60 msgr2=0x7f7a78003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:53.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8f7fe700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a78003a60 0x7f7a78003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8f7fe700 1 -- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a780051c0 msgr2=0x7f7a7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:53.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8f7fe700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a780051c0 0x7f7a7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.113+0000 7f7a8f7fe700 1 -- 172.21.15.7:0/2478782546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78003570 con 0x7f7a78004810 2023-10-14T19:09:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a94c70700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a780051c0 0x7f7a7800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a94c70700 1 -- 172.21.15.7:0/2478782546 reap_dead start 2023-10-14T19:09:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a8f7fe700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a78004810 0x7f7a78004c80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f7a840018b0 tx=0x7f7a84007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86922b9ab292ffbd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84012420 con 0x7f7a78004810 2023-10-14T19:09:53.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a840125a0 con 0x7f7a78004810 2023-10-14T19:09:53.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a8effd700 1 -- 172.21.15.7:0/2478782546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84012960 con 0x7f7a78004810 2023-10-14T19:09:53.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 -- 172.21.15.7:0/2478782546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a78004810 msgr2=0x7f7a78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a78004810 0x7f7a78004c80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f7a840018b0 tx=0x7f7a84007d30 comp rx=0 tx=0).stop 2023-10-14T19:09:53.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 -- 172.21.15.7:0/2478782546 shutdown_connections 2023-10-14T19:09:53.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 --2- 172.21.15.7:0/2478782546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a78004810 0x7f7a78004c80 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 -- 172.21.15.7:0/2478782546 >> 172.21.15.7:0/2478782546 conn(0x7f7a90070e30 msgr2=0x7f7a900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:53.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 -- 172.21.15.7:0/2478782546 shutdown_connections 2023-10-14T19:09:53.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.114+0000 7f7a966d3700 1 -- 172.21.15.7:0/2478782546 wait complete. 2023-10-14T19:09:53.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.115+0000 7f7a966d3700 1 Processor -- start 2023-10-14T19:09:53.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 -- start start 2023-10-14T19:09:53.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a78004810 0x7f7a90153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a900c8180 0x7f7a900b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 0x7f7a900b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900ca0f0 con 0x7f7a900c85f0 2023-10-14T19:09:53.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90153bd0 con 0x7f7a78004810 2023-10-14T19:09:53.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a966d3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900c94e0 con 0x7f7a900c8180 2023-10-14T19:09:53.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a94c70700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 0x7f7a900b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a94c70700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 0x7f7a900b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46712/0 (socket says 172.21.15.7:46712) 2023-10-14T19:09:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.116+0000 7f7a94c70700 1 -- 172.21.15.7:0/1740630269 learned_addr learned my addr 172.21.15.7:0/1740630269 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a8ffff700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a78004810 0x7f7a90153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a8f7fe700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a900c8180 0x7f7a900b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a94c70700 1 -- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a900c8180 msgr2=0x7f7a900b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a94c70700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a900c8180 0x7f7a900b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a94c70700 1 -- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a78004810 msgr2=0x7f7a90153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a94c70700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a78004810 0x7f7a90153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a94c70700 1 -- 172.21.15.7:0/1740630269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900c97c0 con 0x7f7a900c85f0 2023-10-14T19:09:53.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a94c70700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 0x7f7a900b5270 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7a880012e0 tx=0x7f7a88001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:53.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800eab0 con 0x7f7a900c85f0 2023-10-14T19:09:53.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800ec10 con 0x7f7a900c85f0 2023-10-14T19:09:53.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a900c9aa0 con 0x7f7a900c85f0 2023-10-14T19:09:53.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88013420 con 0x7f7a900c85f0 2023-10-14T19:09:53.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.117+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9015e1a0 con 0x7f7a900c85f0 2023-10-14T19:09:53.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.118+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9004c3c0 con 0x7f7a900c85f0 2023-10-14T19:09:53.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.119+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7a880137d0 con 0x7f7a900c85f0 2023-10-14T19:09:53.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.119+0000 7f7a77fff700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a7c067320 0x7f7a7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.119+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f7a880856e0 con 0x7f7a900c85f0 2023-10-14T19:09:53.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.119+0000 7f7a8ffff700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a7c067320 0x7f7a7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.120+0000 7f7a8ffff700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a7c067320 0x7f7a7c0697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a80006f00 tx=0x7f7a800091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:53.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.124+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a88051c70 con 0x7f7a900c85f0 2023-10-14T19:09:53.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.344+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a900cd1e0 con 0x7f7a7c067320 2023-10-14T19:09:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.346+0000 7f7a77fff700 1 -- 172.21.15.7:0/1740630269 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+151 (secure 0 0 0) 0x7f7a900cd1e0 con 0x7f7a7c067320 2023-10-14T19:09:53.347 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:09:53.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:53.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:09:53.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:53.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:53.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volume_0000000000638085" 2023-10-14T19:09:53.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:09:53.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:09:53.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volume_0000000000638086" 2023-10-14T19:09:53.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:09:53.349 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:09:53.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a7c067320 msgr2=0x7f7a7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a7c067320 0x7f7a7c0697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a80006f00 tx=0x7f7a800091a0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 msgr2=0x7f7a900b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 0x7f7a900b5270 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7a880012e0 tx=0x7f7a88001250 comp rx=0 tx=0).stop 2023-10-14T19:09:53.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 shutdown_connections 2023-10-14T19:09:53.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7a7c067320 0x7f7a7c0697d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a78004810 0x7f7a90153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a900c85f0 0x7f7a900b5270 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.347+0000 7f7a966d3700 1 --2- 172.21.15.7:0/1740630269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a900c8180 0x7f7a900b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.348+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 >> 172.21.15.7:0/1740630269 conn(0x7f7a90070e30 msgr2=0x7f7a900b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:53.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.348+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 shutdown_connections 2023-10-14T19:09:53.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.348+0000 7f7a966d3700 1 -- 172.21.15.7:0/1740630269 wait complete. 2023-10-14T19:09:53.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000638085 --yes-i-really-mean-it 2023-10-14T19:09:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.482+0000 7f6b4bfad700 1 Processor -- start 2023-10-14T19:09:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4bfad700 1 -- start start 2023-10-14T19:09:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4bfad700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b44159860 0x7f6b440ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4bfad700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b440ccfa0 0x7f6b440cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4bfad700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b440cf510 con 0x7f6b440cbd90 2023-10-14T19:09:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4bfad700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b440d00b0 con 0x7f6b440ccfa0 2023-10-14T19:09:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4bfad700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b440cc1e0 con 0x7f6b44159860 2023-10-14T19:09:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.483+0000 7f6b4a54a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b440ccfa0 0x7f6b440cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b440ccfa0 0x7f6b440cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46720/0 (socket says 172.21.15.7:46720) 2023-10-14T19:09:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 -- 172.21.15.7:0/1948531949 learned_addr learned my addr 172.21.15.7:0/1948531949 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b49d49700 1 --2- 172.21.15.7:0/1948531949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b44159860 0x7f6b440ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 -- 172.21.15.7:0/1948531949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b44159860 msgr2=0x7f6b440ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 --2- 172.21.15.7:0/1948531949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b44159860 0x7f6b440ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 -- 172.21.15.7:0/1948531949 >> v1:172.21.15.148:6789/0 conn(0x7f6b440cbd90 legacy=0x7f6b440cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 -- 172.21.15.7:0/1948531949 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b440cd960 con 0x7f6b440ccfa0 2023-10-14T19:09:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b4a54a700 1 --2- 172.21.15.7:0/1948531949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b440ccfa0 0x7f6b440cd420 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6b340099b0 tx=0x7f6b34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5240409aabaccc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b48d47700 1 -- 172.21.15.7:0/1948531949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400b860 con 0x7f6b440ccfa0 2023-10-14T19:09:53.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b48d47700 1 -- 172.21.15.7:0/1948531949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400b9c0 con 0x7f6b440ccfa0 2023-10-14T19:09:53.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.484+0000 7f6b48d47700 1 -- 172.21.15.7:0/1948531949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400bd60 con 0x7f6b440ccfa0 2023-10-14T19:09:53.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 -- 172.21.15.7:0/1948531949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b440ccfa0 msgr2=0x7f6b440cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/1948531949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b440ccfa0 0x7f6b440cd420 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6b340099b0 tx=0x7f6b34009250 comp rx=0 tx=0).stop 2023-10-14T19:09:53.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 -- 172.21.15.7:0/1948531949 shutdown_connections 2023-10-14T19:09:53.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/1948531949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b440ccfa0 0x7f6b440cd420 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/1948531949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b44159860 0x7f6b440ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 -- 172.21.15.7:0/1948531949 >> 172.21.15.7:0/1948531949 conn(0x7f6b440999b0 msgr2=0x7f6b44070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:53.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 -- 172.21.15.7:0/1948531949 shutdown_connections 2023-10-14T19:09:53.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.485+0000 7f6b4bfad700 1 -- 172.21.15.7:0/1948531949 wait complete. 2023-10-14T19:09:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.486+0000 7f6b4bfad700 1 Processor -- start 2023-10-14T19:09:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.486+0000 7f6b4bfad700 1 -- start start 2023-10-14T19:09:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b440cbd90 0x7f6b4409a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b440ccfa0 0x7f6b440ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 0x7f6b440c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4409d400 con 0x7f6b44159860 2023-10-14T19:09:53.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4409c830 con 0x7f6b440cbd90 2023-10-14T19:09:53.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b440cac90 con 0x7f6b440ccfa0 2023-10-14T19:09:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 0x7f6b440c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 0x7f6b440c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46724/0 (socket says 172.21.15.7:46724) 2023-10-14T19:09:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 -- 172.21.15.7:0/3907996143 learned_addr learned my addr 172.21.15.7:0/3907996143 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b49d49700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b440cbd90 0x7f6b4409a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b49548700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b440ccfa0 0x7f6b440ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 -- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b440ccfa0 msgr2=0x7f6b440ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b440ccfa0 0x7f6b440ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 -- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b440cbd90 msgr2=0x7f6b4409a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b440cbd90 0x7f6b4409a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 -- 172.21.15.7:0/3907996143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b340094f0 con 0x7f6b44159860 2023-10-14T19:09:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b49d49700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b440cbd90 0x7f6b4409a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4a54a700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 0x7f6b440c7d60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6b4406c7c0 tx=0x7f6b34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3401a630 con 0x7f6b44159860 2023-10-14T19:09:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3401a790 con 0x7f6b44159860 2023-10-14T19:09:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3401ab50 con 0x7f6b44159860 2023-10-14T19:09:53.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.487+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4409cad0 con 0x7f6b44159860 2023-10-14T19:09:53.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.488+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4409d090 con 0x7f6b44159860 2023-10-14T19:09:53.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.489+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4409d570 con 0x7f6b44159860 2023-10-14T19:09:53.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.489+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6b340253f0 con 0x7f6b44159860 2023-10-14T19:09:53.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.489+0000 7f6b41ffb700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b30067320 0x7f6b300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:53.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.490+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f6b34087010 con 0x7f6b44159860 2023-10-14T19:09:53.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.490+0000 7f6b49d49700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b30067320 0x7f6b300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:53.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.490+0000 7f6b49d49700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b30067320 0x7f6b300697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c007580 tx=0x7f6b3c009790 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:53.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.494+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b34053560 con 0x7f6b44159860 2023-10-14T19:09:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:53.717+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000638085", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b4404c3c0 con 0x7f6b30067320 2023-10-14T19:09:53.722 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:09:53.722+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:09:53.726 INFO:tasks.ceph.mds.c.smithi007.stderr: -35> 2023-10-14T19:09:52.838+0000 7f94a3f57700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:09:53.746 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:09:56.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.745+0000 7f6b41ffb700 1 -- 172.21.15.7:0/3907996143 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f6b4404c3c0 con 0x7f6b30067320 2023-10-14T19:09:56.747 INFO:teuthology.orchestra.run.smithi007.stdout:metadata pool: cephfs.volume_0000000000638085.meta data pool: ['cephfs.volume_0000000000638085.data'] removed 2023-10-14T19:09:56.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b30067320 msgr2=0x7f6b300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:56.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b30067320 0x7f6b300697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c007580 tx=0x7f6b3c009790 comp rx=0 tx=0).stop 2023-10-14T19:09:56.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 msgr2=0x7f6b440c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:56.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 0x7f6b440c7d60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6b4406c7c0 tx=0x7f6b34017000 comp rx=0 tx=0).stop 2023-10-14T19:09:56.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 shutdown_connections 2023-10-14T19:09:56.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b30067320 0x7f6b300697d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b440cbd90 0x7f6b4409a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b44159860 0x7f6b440c7d60 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.748+0000 7f6b4bfad700 1 --2- 172.21.15.7:0/3907996143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b440ccfa0 0x7f6b440ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.749+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 >> 172.21.15.7:0/3907996143 conn(0x7f6b440999b0 msgr2=0x7f6b440cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.749+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 shutdown_connections 2023-10-14T19:09:56.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.749+0000 7f6b4bfad700 1 -- 172.21.15.7:0/3907996143 wait complete. 2023-10-14T19:09:56.764 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000638086 --yes-i-really-mean-it 2023-10-14T19:09:56.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.894+0000 7f83c08e4700 1 Processor -- start 2023-10-14T19:09:56.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.894+0000 7f83c08e4700 1 -- start start 2023-10-14T19:09:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83c08e4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc153a00 0x7f83bc153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83c08e4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f83bc15de50 0x7f83bc15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83c08e4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83bc0cea00 0x7f83bc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83c08e4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc15af60 con 0x7f83bc0cea00 2023-10-14T19:09:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83c08e4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc15b240 con 0x7f83bc15de50 2023-10-14T19:09:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83c08e4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc15b520 con 0x7f83bc153a00 2023-10-14T19:09:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83bc0cea00 0x7f83bc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83bc0cea00 0x7f83bc0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42982/0 (socket says 172.21.15.7:42982) 2023-10-14T19:09:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 -- 172.21.15.7:0/2371604579 learned_addr learned my addr 172.21.15.7:0/2371604579 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bad9d700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc153a00 0x7f83bc153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83ba59c700 1 --2- 172.21.15.7:0/2371604579 >> v2:172.21.15.148:3300/0 conn(0x7f83bc15de50 0x7f83bc15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 -- 172.21.15.7:0/2371604579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc153a00 msgr2=0x7f83bc153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc153a00 0x7f83bc153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 -- 172.21.15.7:0/2371604579 >> v2:172.21.15.148:3300/0 conn(0x7f83bc15de50 msgr2=0x7f83bc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:09:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 --2- 172.21.15.7:0/2371604579 >> v2:172.21.15.148:3300/0 conn(0x7f83bc15de50 0x7f83bc15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 -- 172.21.15.7:0/2371604579 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc15b800 con 0x7f83bc0cea00 2023-10-14T19:09:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bad9d700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc153a00 0x7f83bc153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:09:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.895+0000 7f83bb59e700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0cee40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f83bc06e800 tx=0x7f83ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a0b7f8329bced2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83b9d9b700 1 -- 172.21.15.7:0/2371604579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00e070 con 0x7f83bc0cea00 2023-10-14T19:09:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83b9d9b700 1 -- 172.21.15.7:0/2371604579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00ba20 con 0x7f83bc0cea00 2023-10-14T19:09:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83b9d9b700 1 -- 172.21.15.7:0/2371604579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0092e0 con 0x7f83bc0cea00 2023-10-14T19:09:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 -- 172.21.15.7:0/2371604579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 msgr2=0x7f83bc0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0cee40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f83bc06e800 tx=0x7f83ac009840 comp rx=0 tx=0).stop 2023-10-14T19:09:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 -- 172.21.15.7:0/2371604579 shutdown_connections 2023-10-14T19:09:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0cee40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 --2- 172.21.15.7:0/2371604579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc153a00 0x7f83bc153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 --2- 172.21.15.7:0/2371604579 >> v2:172.21.15.148:3300/0 conn(0x7f83bc15de50 0x7f83bc15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 -- 172.21.15.7:0/2371604579 >> 172.21.15.7:0/2371604579 conn(0x7f83bc0703a0 msgr2=0x7f83bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:09:56.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 -- 172.21.15.7:0/2371604579 shutdown_connections 2023-10-14T19:09:56.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.896+0000 7f83c08e4700 1 -- 172.21.15.7:0/2371604579 wait complete. 2023-10-14T19:09:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.897+0000 7f83c08e4700 1 Processor -- start 2023-10-14T19:09:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.897+0000 7f83c08e4700 1 -- start start 2023-10-14T19:09:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83c08e4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83c08e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83bc153a00 0x7f83bc0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83c08e4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc15de50 0x7f83bc150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83c08e4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1506a0 con 0x7f83bc0cea00 2023-10-14T19:09:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83c08e4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0cd500 con 0x7f83bc153a00 2023-10-14T19:09:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83c08e4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0c7e10 con 0x7f83bc15de50 2023-10-14T19:09:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83bad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83bad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42984/0 (socket says 172.21.15.7:42984) 2023-10-14T19:09:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83bad9d700 1 -- 172.21.15.7:0/1504164773 learned_addr learned my addr 172.21.15.7:0/1504164773 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:09:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83ba59c700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83bc153a00 0x7f83bc0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.898+0000 7f83bb59e700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc15de50 0x7f83bc150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83bad9d700 1 -- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc15de50 msgr2=0x7f83bc150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:56.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83bad9d700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc15de50 0x7f83bc150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83bad9d700 1 -- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83bc153a00 msgr2=0x7f83bc0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:09:56.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83bad9d700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83bc153a00 0x7f83bc0c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:09:56.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83bad9d700 1 -- 172.21.15.7:0/1504164773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009ae0 con 0x7f83bc0cea00 2023-10-14T19:09:56.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83bad9d700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0c9cb0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e8d0 tx=0x7f83b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:56.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4013410 con 0x7f83bc0cea00 2023-10-14T19:09:56.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4013570 con 0x7f83bc0cea00 2023-10-14T19:09:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4013910 con 0x7f83bc0cea00 2023-10-14T19:09:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0c86f0 con 0x7f83bc0cea00 2023-10-14T19:09:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.899+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc0cceb0 con 0x7f83bc0cea00 2023-10-14T19:09:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.900+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc0cd7e0 con 0x7f83bc0cea00 2023-10-14T19:09:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.900+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f83b4013cc0 con 0x7f83bc0cea00 2023-10-14T19:09:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.901+0000 7f83b2ffd700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f839c067320 0x7f839c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:09:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.901+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f83b4084ef0 con 0x7f83bc0cea00 2023-10-14T19:09:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.901+0000 7f83ba59c700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f839c067320 0x7f839c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:09:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.901+0000 7f83ba59c700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f839c067320 0x7f839c0697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f83bc16cac0 tx=0x7f83a40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:09:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:56.905+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83b4051690 con 0x7f83bc0cea00 2023-10-14T19:09:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:09:57.125+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000638086", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f83bc04c450 con 0x7f839c067320 2023-10-14T19:09:57.131 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:09:57.130+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:09:57.160 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:10:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.148+0000 7f83b2ffd700 1 -- 172.21.15.7:0/1504164773 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f83a4009e20 con 0x7f839c067320 2023-10-14T19:10:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:metadata pool: cephfs.volume_0000000000638086.meta data pool: ['cephfs.volume_0000000000638086.data'] removed 2023-10-14T19:10:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f839c067320 msgr2=0x7f839c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f839c067320 0x7f839c0697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f83bc16cac0 tx=0x7f83a40091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 msgr2=0x7f83bc0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0c9cb0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e8d0 tx=0x7f83b4008040 comp rx=0 tx=0).stop 2023-10-14T19:10:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 shutdown_connections 2023-10-14T19:10:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f839c067320 0x7f839c0697d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83bc15de50 0x7f83bc150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc0cea00 0x7f83bc0c9cb0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 --2- 172.21.15.7:0/1504164773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83bc153a00 0x7f83bc0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 >> 172.21.15.7:0/1504164773 conn(0x7f83bc0703a0 msgr2=0x7f83bc0b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 shutdown_connections 2023-10-14T19:10:00.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.151+0000 7f83c08e4700 1 -- 172.21.15.7:0/1504164773 wait complete. 2023-10-14T19:10:00.167 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:10:00.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:00.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:00.263 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:10:00.264 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:10:00.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:10:00.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:00.306 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:10:00.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:00.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:10:00.362 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:10:00.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:10:00.363 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:00.405 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:10:00.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:00.406 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:10:00.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:00.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.586+0000 7fc06bc86700 1 Processor -- start 2023-10-14T19:10:00.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.586+0000 7fc06bc86700 1 -- start start 2023-10-14T19:10:00.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06bc86700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc0640cb5a0 0x7fc0640cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06bc86700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc06415a5d0 0x7fc064156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06bc86700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06415ae40 con 0x7fc0640cd9e0 2023-10-14T19:10:00.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06bc86700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640d13f0 con 0x7fc06415a5d0 2023-10-14T19:10:00.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06bc86700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06415ab60 con 0x7fc0640cb5a0 2023-10-14T19:10:00.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06a223700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc06415a5d0 0x7fc064156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc069221700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc0640cd9e0 0x7fc064159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42416/0 (socket says 172.21.15.7:42416) 2023-10-14T19:10:00.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc069221700 1 -- 172.21.15.7:0/4256081589 learned_addr learned my addr 172.21.15.7:0/4256081589 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:00.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc069a22700 1 --2- 172.21.15.7:0/4256081589 >> v2:172.21.15.148:3300/0 conn(0x7fc0640cb5a0 0x7fc0640cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06a223700 1 -- 172.21.15.7:0/4256081589 >> v2:172.21.15.148:3300/0 conn(0x7fc0640cb5a0 msgr2=0x7fc0640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:00.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06a223700 1 --2- 172.21.15.7:0/4256081589 >> v2:172.21.15.148:3300/0 conn(0x7fc0640cb5a0 0x7fc0640cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06a223700 1 -- 172.21.15.7:0/4256081589 >> v1:172.21.15.7:6789/0 conn(0x7fc0640cd9e0 legacy=0x7fc064159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06a223700 1 -- 172.21.15.7:0/4256081589 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640ccf00 con 0x7fc06415a5d0 2023-10-14T19:10:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc068a20700 1 -- 172.21.15.7:0/4256081589 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678277319 0 0) 0x7fc06415ae40 con 0x7fc0640cd9e0 2023-10-14T19:10:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc069a22700 1 --2- 172.21.15.7:0/4256081589 >> v2:172.21.15.148:3300/0 conn(0x7fc0640cb5a0 0x7fc0640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.587+0000 7fc06a223700 1 --2- 172.21.15.7:0/4256081589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc06415a5d0 0x7fc064156e90 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e60 tx=0x7fc05c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f981bcf60336532d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc068a20700 1 -- 172.21.15.7:0/4256081589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00e070 con 0x7fc06415a5d0 2023-10-14T19:10:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc068a20700 1 -- 172.21.15.7:0/4256081589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00bbf0 con 0x7fc06415a5d0 2023-10-14T19:10:00.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc068a20700 1 -- 172.21.15.7:0/4256081589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c012430 con 0x7fc06415a5d0 2023-10-14T19:10:00.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 -- 172.21.15.7:0/4256081589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc06415a5d0 msgr2=0x7fc064156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 --2- 172.21.15.7:0/4256081589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc06415a5d0 0x7fc064156e90 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e60 tx=0x7fc05c009780 comp rx=0 tx=0).stop 2023-10-14T19:10:00.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 -- 172.21.15.7:0/4256081589 shutdown_connections 2023-10-14T19:10:00.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 --2- 172.21.15.7:0/4256081589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc06415a5d0 0x7fc064156e90 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 --2- 172.21.15.7:0/4256081589 >> v2:172.21.15.148:3300/0 conn(0x7fc0640cb5a0 0x7fc0640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 -- 172.21.15.7:0/4256081589 >> 172.21.15.7:0/4256081589 conn(0x7fc064070e30 msgr2=0x7fc0640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:00.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 -- 172.21.15.7:0/4256081589 shutdown_connections 2023-10-14T19:10:00.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.588+0000 7fc06bc86700 1 -- 172.21.15.7:0/4256081589 wait complete. 2023-10-14T19:10:00.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.589+0000 7fc06bc86700 1 Processor -- start 2023-10-14T19:10:00.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.589+0000 7fc06bc86700 1 -- start start 2023-10-14T19:10:00.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06bc86700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 0x7fc0641521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06bc86700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0640cd9e0 0x7fc06415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06bc86700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc06415a5d0 0x7fc0640c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06bc86700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc064152700 con 0x7fc0640cb5a0 2023-10-14T19:10:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06bc86700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640b38c0 con 0x7fc0640cd9e0 2023-10-14T19:10:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06bc86700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640ca2d0 con 0x7fc06415a5d0 2023-10-14T19:10:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc069a22700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 0x7fc0641521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc069a22700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 0x7fc0641521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43006/0 (socket says 172.21.15.7:43006) 2023-10-14T19:10:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc069a22700 1 -- 172.21.15.7:0/643926000 learned_addr learned my addr 172.21.15.7:0/643926000 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc069221700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0640cd9e0 0x7fc06415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc069a22700 1 -- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc06415a5d0 msgr2=0x7fc0640c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.590+0000 7fc06a223700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc06415a5d0 0x7fc0640c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc069a22700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc06415a5d0 0x7fc0640c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc069a22700 1 -- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0640cd9e0 msgr2=0x7fc06415bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc069a22700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0640cd9e0 0x7fc06415bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc069a22700 1 -- 172.21.15.7:0/643926000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009a20 con 0x7fc0640cb5a0 2023-10-14T19:10:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc069221700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0640cd9e0 0x7fc06415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc069a22700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 0x7fc0641521c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c830 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060011600 con 0x7fc0640cb5a0 2023-10-14T19:10:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060011760 con 0x7fc0640cb5a0 2023-10-14T19:10:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640c92e0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060011b20 con 0x7fc0640cb5a0 2023-10-14T19:10:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.591+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0640c98a0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.592+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0640afee0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.592+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc06000a3e0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.593+0000 7fc059ffb700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc048067320 0x7fc0480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.593+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fc0600852c0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.593+0000 7fc069221700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc048067320 0x7fc0480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.594+0000 7fc069221700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc048067320 0x7fc0480697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc06415bd90 tx=0x7fc054009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.597+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc060051d90 con 0x7fc0640cb5a0 2023-10-14T19:10:00.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.833+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc06404c3c0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.834+0000 7fc059ffb700 1 -- 172.21.15.7:0/643926000 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fc0600553b0 con 0x7fc0640cb5a0 2023-10-14T19:10:00.835 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:00.836 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2658859369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2658859369},{"type":"v1","addr":"172.21.15.148:6837","nonce":2658859369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/713445110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":713445110},{"type":"v1","addr":"172.21.15.7:6834","nonce":713445110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:36.305484+0000","modified":"2023-10-14T19:09:39.916613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/698585291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":698585291},{"type":"v1","addr":"172.21.15.7:6835","nonce":698585291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T19:10:00.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc048067320 msgr2=0x7fc0480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc048067320 0x7fc0480697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc06415bd90 tx=0x7fc054009040 comp rx=0 tx=0).stop 2023-10-14T19:10:00.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 msgr2=0x7fc0641521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 0x7fc0641521c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c830 tx=0x7fc060008040 comp rx=0 tx=0).stop 2023-10-14T19:10:00.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 shutdown_connections 2023-10-14T19:10:00.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc048067320 0x7fc0480697d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc06415a5d0 0x7fc0640c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0640cb5a0 0x7fc0641521c0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 --2- 172.21.15.7:0/643926000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0640cd9e0 0x7fc06415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 >> 172.21.15.7:0/643926000 conn(0x7fc064070e30 msgr2=0x7fc0640cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:00.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 shutdown_connections 2023-10-14T19:10:00.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.836+0000 7fc06bc86700 1 -- 172.21.15.7:0/643926000 wait complete. 2023-10-14T19:10:00.840 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 83 2023-10-14T19:10:00.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.971+0000 7f49c4a59700 1 Processor -- start 2023-10-14T19:10:00.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.971+0000 7f49c4a59700 1 -- start start 2023-10-14T19:10:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49c4a59700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f49c00aec90 0x7f49c015df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49c4a59700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c015a750 con 0x7f49c006cdb0 2023-10-14T19:10:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49c4a59700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c0159e40 con 0x7f49c015d440 2023-10-14T19:10:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49c4a59700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c00af110 con 0x7f49c00aec90 2023-10-14T19:10:00.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bdd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49c006cdb0 0x7f49c015d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42432/0 (socket says 172.21.15.7:42432) 2023-10-14T19:10:00.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bdd9b700 1 -- 172.21.15.7:0/4046115880 learned_addr learned my addr 172.21.15.7:0/4046115880 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:00.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bed9d700 1 --2- 172.21.15.7:0/4046115880 >> v2:172.21.15.148:3300/0 conn(0x7f49c00aec90 0x7f49c015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477513397 0 0) 0x7f49c015a750 con 0x7f49c006cdb0 2023-10-14T19:10:00.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ac003570 con 0x7f49c006cdb0 2023-10-14T19:10:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878774529 0 0) 0x7f49c0159e40 con 0x7f49c015d440 2023-10-14T19:10:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c015a750 con 0x7f49c015d440 2023-10-14T19:10:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122130722 0 0) 0x7f49ac003570 con 0x7f49c006cdb0 2023-10-14T19:10:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 >> v2:172.21.15.148:3300/0 conn(0x7f49c00aec90 msgr2=0x7f49c015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 --2- 172.21.15.7:0/4046115880 >> v2:172.21.15.148:3300/0 conn(0x7f49c00aec90 0x7f49c015df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 >> v1:172.21.15.148:6789/0 conn(0x7f49c015d440 legacy=0x7f49c006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00af300 con 0x7f49c006cdb0 2023-10-14T19:10:00.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f49a8001470 con 0x7f49c006cdb0 2023-10-14T19:10:00.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 >> v1:172.21.15.7:6789/0 conn(0x7f49c006cdb0 legacy=0x7f49c015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49ac003bf0 0x7f49ac003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac004810 0x7f49ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac0051c0 0x7f49ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00c130 con 0x7f49ac0051c0 2023-10-14T19:10:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00c2a0 con 0x7f49ac004810 2023-10-14T19:10:00.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.972+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00c460 con 0x7f49ac003bf0 2023-10-14T19:10:00.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac0051c0 0x7f49ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bdd9b700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac004810 0x7f49ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49be59c700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49ac003bf0 0x7f49ac003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 -- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49ac003bf0 msgr2=0x7f49ac003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49ac003bf0 0x7f49ac003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 -- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac004810 msgr2=0x7f49ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac004810 0x7f49ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 -- 172.21.15.7:0/4046115880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac003570 con 0x7f49ac0051c0 2023-10-14T19:10:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 -- 172.21.15.7:0/4046115880 reap_dead start 2023-10-14T19:10:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bed9d700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac0051c0 0x7f49ac00ba60 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f49b0006f00 tx=0x7f49b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a27fed306fef83 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000e710 con 0x7f49ac0051c0 2023-10-14T19:10:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000e890 con 0x7f49ac0051c0 2023-10-14T19:10:00.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.973+0000 7f49bd59a700 1 -- 172.21.15.7:0/4046115880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000ec50 con 0x7f49ac0051c0 2023-10-14T19:10:00.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 -- 172.21.15.7:0/4046115880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac0051c0 msgr2=0x7f49ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac0051c0 0x7f49ac00ba60 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f49b0006f00 tx=0x7f49b00091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 -- 172.21.15.7:0/4046115880 shutdown_connections 2023-10-14T19:10:00.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 --2- 172.21.15.7:0/4046115880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac0051c0 0x7f49ac00ba60 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 -- 172.21.15.7:0/4046115880 >> 172.21.15.7:0/4046115880 conn(0x7f49c006f190 msgr2=0x7f49c00ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:00.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 -- 172.21.15.7:0/4046115880 shutdown_connections 2023-10-14T19:10:00.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.974+0000 7f49c4a59700 1 -- 172.21.15.7:0/4046115880 wait complete. 2023-10-14T19:10:00.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.975+0000 7f49c4a59700 1 Processor -- start 2023-10-14T19:10:00.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.975+0000 7f49c4a59700 1 -- start start 2023-10-14T19:10:00.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49c4a59700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac0051c0 0x7f49c0145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49c4a59700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 0x7f49c0149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49c4a59700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49c00b0f10 0x7f49c00b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49c4a59700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00b0a80 con 0x7f49c0149810 2023-10-14T19:10:00.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49c4a59700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00afe70 con 0x7f49ac0051c0 2023-10-14T19:10:00.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49c4a59700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00b0150 con 0x7f49c00b0f10 2023-10-14T19:10:00.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 0x7f49c0149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 0x7f49c0149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43024/0 (socket says 172.21.15.7:43024) 2023-10-14T19:10:00.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 -- 172.21.15.7:0/2316225466 learned_addr learned my addr 172.21.15.7:0/2316225466 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:00.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49be59c700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac0051c0 0x7f49c0145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bed9d700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49c00b0f10 0x7f49c00b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 -- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49c00b0f10 msgr2=0x7f49c00b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49c00b0f10 0x7f49c00b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 -- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac0051c0 msgr2=0x7f49c0145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:00.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac0051c0 0x7f49c0145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:00.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 -- 172.21.15.7:0/2316225466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00b0430 con 0x7f49c0149810 2023-10-14T19:10:00.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bed9d700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49c00b0f10 0x7f49c00b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:00.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49be59c700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac0051c0 0x7f49c0145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:00.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49bdd9b700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 0x7f49c0149c80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f49a80073c0 tx=0x7f49a8001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:00.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8007830 con 0x7f49c0149810 2023-10-14T19:10:00.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.976+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a8001040 con 0x7f49c0149810 2023-10-14T19:10:00.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.977+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c00b0710 con 0x7f49c0149810 2023-10-14T19:10:00.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.977+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a800fb00 con 0x7f49c0149810 2023-10-14T19:10:00.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.977+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c0147d50 con 0x7f49c0149810 2023-10-14T19:10:00.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.977+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c004c3c0 con 0x7f49c0149810 2023-10-14T19:10:00.994 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.978+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f49a801d460 con 0x7f49c0149810 2023-10-14T19:10:00.995 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.978+0000 7f49b67fc700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f49a0067320 0x7f49a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:00.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.978+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f49a8084ca0 con 0x7f49c0149810 2023-10-14T19:10:00.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.979+0000 7f49be59c700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f49a0067320 0x7f49a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:00.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.979+0000 7f49be59c700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f49a0067320 0x7f49a00697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f49b8000f80 tx=0x7f49b80017a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:00.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:00.983+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49a8051990 con 0x7f49c0149810 2023-10-14T19:10:01.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.179+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c015a100 con 0x7f49c0149810 2023-10-14T19:10:01.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.180+0000 7f49b67fc700 1 -- 172.21.15.7:0/2316225466 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+15575 (secure 0 0 0) 0x7f49a8054fb0 con 0x7f49c0149810 2023-10-14T19:10:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:01.182 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":127,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:00.139493+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:34.735685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:35.268214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6837/3885032212":"2023-10-15T19:09:57.131329+0000","172.21.15.148:6835/3885032212":"2023-10-15T19:09:57.131329+0000","172.21.15.7:6834/3111043599":"2023-10-15T19:09:53.722947+0000","172.21.15.7:6832/3111043599":"2023-10-15T19:09:53.722947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:01.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f49a0067320 msgr2=0x7f49a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f49a0067320 0x7f49a00697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f49b8000f80 tx=0x7f49b80017a0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 msgr2=0x7f49c0149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 0x7f49c0149c80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f49a80073c0 tx=0x7f49a8001e10 comp rx=0 tx=0).stop 2023-10-14T19:10:01.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 shutdown_connections 2023-10-14T19:10:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f49a0067320 0x7f49a00697d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49ac0051c0 0x7f49c0145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49c00b0f10 0x7f49c00b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 --2- 172.21.15.7:0/2316225466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0149810 0x7f49c0149c80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.182+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 >> 172.21.15.7:0/2316225466 conn(0x7f49c006f190 msgr2=0x7f49c00ac4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.183+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 shutdown_connections 2023-10-14T19:10:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.183+0000 7f49c4a59700 1 -- 172.21.15.7:0/2316225466 wait complete. 2023-10-14T19:10:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:09:34.735685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:09:35.268214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:10:01.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:10:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.328+0000 7fa2889ee700 1 Processor -- start 2023-10-14T19:10:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.328+0000 7fa2889ee700 1 -- start start 2023-10-14T19:10:01.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa2889ee700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa284155f30 0x7fa284156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa2889ee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2841599d0 0x7fa284159e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa2889ee700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2841575a0 con 0x7fa284155b60 2023-10-14T19:10:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa2889ee700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28415a3b0 con 0x7fa284155f30 2023-10-14T19:10:01.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa2889ee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b0e40 con 0x7fa2841599d0 2023-10-14T19:10:01.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa284155f30 0x7fa284156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa284155f30 0x7fa284156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43034/0 (socket says 172.21.15.7:43034) 2023-10-14T19:10:01.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 -- 172.21.15.7:0/2288208339 learned_addr learned my addr 172.21.15.7:0/2288208339 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:01.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa282d9d700 1 --2- 172.21.15.7:0/2288208339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2841599d0 0x7fa284159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 -- 172.21.15.7:0/2288208339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2841599d0 msgr2=0x7fa284159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:01.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 --2- 172.21.15.7:0/2288208339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2841599d0 0x7fa284159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 -- 172.21.15.7:0/2288208339 >> v1:172.21.15.148:6789/0 conn(0x7fa284155b60 legacy=0x7fa2840b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:01.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 -- 172.21.15.7:0/2288208339 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa284156990 con 0x7fa284155f30 2023-10-14T19:10:01.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa281d9b700 1 --2- 172.21.15.7:0/2288208339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa284155f30 0x7fa284156380 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa27800bc50 tx=0x7fa27800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112945cc14a5e439 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:01.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa28159a700 1 -- 172.21.15.7:0/2288208339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800be60 con 0x7fa284155f30 2023-10-14T19:10:01.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa28159a700 1 -- 172.21.15.7:0/2288208339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800de00 con 0x7fa284155f30 2023-10-14T19:10:01.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.329+0000 7fa28159a700 1 -- 172.21.15.7:0/2288208339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780196b0 con 0x7fa284155f30 2023-10-14T19:10:01.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 -- 172.21.15.7:0/2288208339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa284155f30 msgr2=0x7fa284156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 --2- 172.21.15.7:0/2288208339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa284155f30 0x7fa284156380 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa27800bc50 tx=0x7fa27800b4f0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 -- 172.21.15.7:0/2288208339 shutdown_connections 2023-10-14T19:10:01.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 --2- 172.21.15.7:0/2288208339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2841599d0 0x7fa284159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 --2- 172.21.15.7:0/2288208339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa284155f30 0x7fa284156380 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 -- 172.21.15.7:0/2288208339 >> 172.21.15.7:0/2288208339 conn(0x7fa28406d170 msgr2=0x7fa2840cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:01.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 -- 172.21.15.7:0/2288208339 shutdown_connections 2023-10-14T19:10:01.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.330+0000 7fa2889ee700 1 -- 172.21.15.7:0/2288208339 wait complete. 2023-10-14T19:10:01.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.331+0000 7fa2889ee700 1 Processor -- start 2023-10-14T19:10:01.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.331+0000 7fa2889ee700 1 -- start start 2023-10-14T19:10:01.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa2889ee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa284155b60 0x7fa284143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa2889ee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa284155f30 0x7fa2840c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa2889ee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 0x7fa284165990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa2889ee700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840c8d80 con 0x7fa2841599d0 2023-10-14T19:10:01.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa2889ee700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840c9340 con 0x7fa284155f30 2023-10-14T19:10:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa2889ee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841443e0 con 0x7fa284155b60 2023-10-14T19:10:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 0x7fa284165990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 0x7fa284165990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43046/0 (socket says 172.21.15.7:43046) 2023-10-14T19:10:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 -- 172.21.15.7:0/1992431629 learned_addr learned my addr 172.21.15.7:0/1992431629 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:01.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa28259c700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa284155b60 0x7fa284143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa281d9b700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa284155f30 0x7fa2840c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 -- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa284155b60 msgr2=0x7fa284143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa284155b60 0x7fa284143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 -- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa284155f30 msgr2=0x7fa2840c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa284155f30 0x7fa2840c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 -- 172.21.15.7:0/1992431629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27800b790 con 0x7fa2841599d0 2023-10-14T19:10:01.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa281d9b700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa284155f30 0x7fa2840c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:01.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa28259c700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa284155b60 0x7fa284143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:01.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.332+0000 7fa282d9d700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 0x7fa284165990 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa27c007f20 tx=0x7fa27c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:01.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.333+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00eca0 con 0x7fa2841599d0 2023-10-14T19:10:01.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.333+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c00ee20 con 0x7fa2841599d0 2023-10-14T19:10:01.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.333+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2841664a0 con 0x7fa2841599d0 2023-10-14T19:10:01.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.333+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c014670 con 0x7fa2841599d0 2023-10-14T19:10:01.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.333+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2840c8fd0 con 0x7fa2841599d0 2023-10-14T19:10:01.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.333+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2840c94b0 con 0x7fa2841599d0 2023-10-14T19:10:01.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.334+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa27c0149e0 con 0x7fa2841599d0 2023-10-14T19:10:01.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.334+0000 7fa2727fc700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa264067320 0x7fa2640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.334+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fa27c085450 con 0x7fa2841599d0 2023-10-14T19:10:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.335+0000 7fa28259c700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa264067320 0x7fa2640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.335+0000 7fa28259c700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa264067320 0x7fa2640697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa274001840 tx=0x7fa274009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:01.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.339+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa27c052030 con 0x7fa2841599d0 2023-10-14T19:10:01.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.530+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa28404c3c0 con 0x7fa2841599d0 2023-10-14T19:10:01.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.531+0000 7fa2727fc700 1 -- 172.21.15.7:0/1992431629 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v127) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa27c055650 con 0x7fa2841599d0 2023-10-14T19:10:01.533 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:10:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa264067320 msgr2=0x7fa2640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa264067320 0x7fa2640697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa274001840 tx=0x7fa274009040 comp rx=0 tx=0).stop 2023-10-14T19:10:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 msgr2=0x7fa284165990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 0x7fa284165990 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa27c007f20 tx=0x7fa27c009860 comp rx=0 tx=0).stop 2023-10-14T19:10:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 shutdown_connections 2023-10-14T19:10:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa264067320 0x7fa2640697d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2841599d0 0x7fa284165990 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa284155b60 0x7fa284143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 --2- 172.21.15.7:0/1992431629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa284155f30 0x7fa2840c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 >> 172.21.15.7:0/1992431629 conn(0x7fa28406d170 msgr2=0x7fa284157930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 shutdown_connections 2023-10-14T19:10:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.533+0000 7fa2889ee700 1 -- 172.21.15.7:0/1992431629 wait complete. 2023-10-14T19:10:01.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:10:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.671+0000 7f02fe09b700 1 Processor -- start 2023-10-14T19:10:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02fe09b700 1 -- start start 2023-10-14T19:10:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02fe09b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02f8159860 0x7f02f80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02fe09b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f02f80ccfa0 0x7f02f80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02fe09b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80cf510 con 0x7f02f80cbd90 2023-10-14T19:10:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02fe09b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80d00b0 con 0x7f02f8159860 2023-10-14T19:10:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02fe09b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80cc210 con 0x7f02f80ccfa0 2023-10-14T19:10:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02f77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02f8159860 0x7f02f80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.672+0000 7f02f77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02f8159860 0x7f02f80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43058/0 (socket says 172.21.15.7:43058) 2023-10-14T19:10:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f77fe700 1 -- 172.21.15.7:0/4094597564 learned_addr learned my addr 172.21.15.7:0/4094597564 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f7fff700 1 --2- 172.21.15.7:0/4094597564 >> v2:172.21.15.148:3300/0 conn(0x7f02f80ccfa0 0x7f02f80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f77fe700 1 -- 172.21.15.7:0/4094597564 >> v2:172.21.15.148:3300/0 conn(0x7f02f80ccfa0 msgr2=0x7f02f80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f77fe700 1 --2- 172.21.15.7:0/4094597564 >> v2:172.21.15.148:3300/0 conn(0x7f02f80ccfa0 0x7f02f80cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f77fe700 1 -- 172.21.15.7:0/4094597564 >> v1:172.21.15.148:6789/0 conn(0x7f02f80cbd90 legacy=0x7f02f80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f77fe700 1 -- 172.21.15.7:0/4094597564 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80ce900 con 0x7f02f8159860 2023-10-14T19:10:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f77fe700 1 --2- 172.21.15.7:0/4094597564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8159860 0x7f02f80ce220 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f02f8088690 tx=0x7f02e8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad65fe1550a75a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f67fc700 1 -- 172.21.15.7:0/4094597564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8005c10 con 0x7f02f8159860 2023-10-14T19:10:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f67fc700 1 -- 172.21.15.7:0/4094597564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8005d70 con 0x7f02f8159860 2023-10-14T19:10:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.673+0000 7f02f67fc700 1 -- 172.21.15.7:0/4094597564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8006260 con 0x7f02f8159860 2023-10-14T19:10:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 -- 172.21.15.7:0/4094597564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8159860 msgr2=0x7f02f80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 --2- 172.21.15.7:0/4094597564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8159860 0x7f02f80ce220 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f02f8088690 tx=0x7f02e8009220 comp rx=0 tx=0).stop 2023-10-14T19:10:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 -- 172.21.15.7:0/4094597564 shutdown_connections 2023-10-14T19:10:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 --2- 172.21.15.7:0/4094597564 >> v2:172.21.15.148:3300/0 conn(0x7f02f80ccfa0 0x7f02f80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 --2- 172.21.15.7:0/4094597564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8159860 0x7f02f80ce220 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 -- 172.21.15.7:0/4094597564 >> 172.21.15.7:0/4094597564 conn(0x7f02f80999b0 msgr2=0x7f02f8070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 -- 172.21.15.7:0/4094597564 shutdown_connections 2023-10-14T19:10:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.674+0000 7f02fe09b700 1 -- 172.21.15.7:0/4094597564 wait complete. 2023-10-14T19:10:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.675+0000 7f02fe09b700 1 Processor -- start 2023-10-14T19:10:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.675+0000 7f02fe09b700 1 -- start start 2023-10-14T19:10:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 0x7f02f80c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02f80ccfa0 0x7f02f80c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02f8159860 0x7f02f814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80c8600 con 0x7f02f80cbd90 2023-10-14T19:10:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f814dfa0 con 0x7f02f80ccfa0 2023-10-14T19:10:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80c8860 con 0x7f02f8159860 2023-10-14T19:10:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 0x7f02f80c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 0x7f02f80c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43074/0 (socket says 172.21.15.7:43074) 2023-10-14T19:10:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 -- 172.21.15.7:0/678563880 learned_addr learned my addr 172.21.15.7:0/678563880 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f6ffd700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02f80ccfa0 0x7f02f80c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 -- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02f8159860 msgr2=0x7f02f814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f7fff700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02f8159860 0x7f02f814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02f8159860 0x7f02f814da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 -- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02f80ccfa0 msgr2=0x7f02f80c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02f80ccfa0 0x7f02f80c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 -- 172.21.15.7:0/678563880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009480 con 0x7f02f80cbd90 2023-10-14T19:10:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f6ffd700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02f80ccfa0 0x7f02f80c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02f77fe700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 0x7f02f80c70b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f02e800b0e0 tx=0x7f02e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800b9d0 con 0x7f02f80cbd90 2023-10-14T19:10:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8020070 con 0x7f02f80cbd90 2023-10-14T19:10:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800bd60 con 0x7f02f80cbd90 2023-10-14T19:10:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f80c8b40 con 0x7f02f80cbd90 2023-10-14T19:10:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.676+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f80c5480 con 0x7f02f80cbd90 2023-10-14T19:10:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.677+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f80ce200 con 0x7f02f80cbd90 2023-10-14T19:10:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.678+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f02e8022030 con 0x7f02f80cbd90 2023-10-14T19:10:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.678+0000 7f02df7fe700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f02e4067320 0x7f02e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.678+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f02e8086750 con 0x7f02f80cbd90 2023-10-14T19:10:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.678+0000 7f02f6ffd700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f02e4067320 0x7f02e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.679+0000 7f02f6ffd700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f02e4067320 0x7f02e40697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02f80c3e10 tx=0x7f02ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.683+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02e8053440 con 0x7f02f80cbd90 2023-10-14T19:10:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.875+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02f804c3c0 con 0x7f02f80cbd90 2023-10-14T19:10:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.875+0000 7f02df7fe700 1 -- 172.21.15.7:0/678563880 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02e8056a60 con 0x7f02f80cbd90 2023-10-14T19:10:01.876 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:10:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f02e4067320 msgr2=0x7f02e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f02e4067320 0x7f02e40697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02f80c3e10 tx=0x7f02ec009040 comp rx=0 tx=0).stop 2023-10-14T19:10:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 msgr2=0x7f02f80c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 0x7f02f80c70b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f02e800b0e0 tx=0x7f02e8016000 comp rx=0 tx=0).stop 2023-10-14T19:10:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 shutdown_connections 2023-10-14T19:10:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f02e4067320 0x7f02e40697d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02f8159860 0x7f02f814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f80cbd90 0x7f02f80c70b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 --2- 172.21.15.7:0/678563880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02f80ccfa0 0x7f02f80c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 >> 172.21.15.7:0/678563880 conn(0x7f02f80999b0 msgr2=0x7f02f815bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 shutdown_connections 2023-10-14T19:10:01.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:01.877+0000 7f02fe09b700 1 -- 172.21.15.7:0/678563880 wait complete. 2023-10-14T19:10:01.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:10:02.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.015+0000 7fe75deea700 1 Processor -- start 2023-10-14T19:10:02.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.015+0000 7fe75deea700 1 -- start start 2023-10-14T19:10:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe75deea700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe7580cbbc0 0x7fe7580c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe75deea700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7580c98e0 0x7fe7580c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe75deea700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe758068350 con 0x7fe758159970 2023-10-14T19:10:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe75deea700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580c9d30 con 0x7fe7580cbbc0 2023-10-14T19:10:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe75deea700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe758068db0 con 0x7fe7580c98e0 2023-10-14T19:10:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe756ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe7580cbbc0 0x7fe7580c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe756ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe7580cbbc0 0x7fe7580c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43078/0 (socket says 172.21.15.7:43078) 2023-10-14T19:10:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe756ffd700 1 -- 172.21.15.7:0/982773083 learned_addr learned my addr 172.21.15.7:0/982773083 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.016+0000 7fe757fff700 1 --2- 172.21.15.7:0/982773083 >> v2:172.21.15.148:3300/0 conn(0x7fe7580c98e0 0x7fe7580c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe756ffd700 1 -- 172.21.15.7:0/982773083 >> v2:172.21.15.148:3300/0 conn(0x7fe7580c98e0 msgr2=0x7fe7580c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe756ffd700 1 --2- 172.21.15.7:0/982773083 >> v2:172.21.15.148:3300/0 conn(0x7fe7580c98e0 0x7fe7580c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe756ffd700 1 -- 172.21.15.7:0/982773083 >> v1:172.21.15.148:6789/0 conn(0x7fe758159970 legacy=0x7fe7580686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe756ffd700 1 -- 172.21.15.7:0/982773083 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758067740 con 0x7fe7580cbbc0 2023-10-14T19:10:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe756ffd700 1 --2- 172.21.15.7:0/982773083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580c93a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe7580ce0b0 tx=0x7fe74c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16c9a5dfc661011 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe7567fc700 1 -- 172.21.15.7:0/982773083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00b860 con 0x7fe7580cbbc0 2023-10-14T19:10:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe7567fc700 1 -- 172.21.15.7:0/982773083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00b9c0 con 0x7fe7580cbbc0 2023-10-14T19:10:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.017+0000 7fe7567fc700 1 -- 172.21.15.7:0/982773083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00bd60 con 0x7fe7580cbbc0 2023-10-14T19:10:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 -- 172.21.15.7:0/982773083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 msgr2=0x7fe7580c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 --2- 172.21.15.7:0/982773083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580c93a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe7580ce0b0 tx=0x7fe74c009250 comp rx=0 tx=0).stop 2023-10-14T19:10:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 -- 172.21.15.7:0/982773083 shutdown_connections 2023-10-14T19:10:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 --2- 172.21.15.7:0/982773083 >> v2:172.21.15.148:3300/0 conn(0x7fe7580c98e0 0x7fe7580c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 --2- 172.21.15.7:0/982773083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580c93a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 -- 172.21.15.7:0/982773083 >> 172.21.15.7:0/982773083 conn(0x7fe75806e250 msgr2=0x7fe7580cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 -- 172.21.15.7:0/982773083 shutdown_connections 2023-10-14T19:10:02.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.018+0000 7fe75deea700 1 -- 172.21.15.7:0/982773083 wait complete. 2023-10-14T19:10:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.019+0000 7fe75deea700 1 Processor -- start 2023-10-14T19:10:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.019+0000 7fe75deea700 1 -- start start 2023-10-14T19:10:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7580c98e0 0x7fe7580b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe758159970 0x7fe75815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75816a520 con 0x7fe7580cbbc0 2023-10-14T19:10:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe758169f10 con 0x7fe7580c98e0 2023-10-14T19:10:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580b3350 con 0x7fe758159970 2023-10-14T19:10:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43094/0 (socket says 172.21.15.7:43094) 2023-10-14T19:10:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 -- 172.21.15.7:0/3106005724 learned_addr learned my addr 172.21.15.7:0/3106005724 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe7577fe700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7580c98e0 0x7fe7580b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe757fff700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe758159970 0x7fe75815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 -- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe758159970 msgr2=0x7fe75815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe758159970 0x7fe75815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 -- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7580c98e0 msgr2=0x7fe7580b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7580c98e0 0x7fe7580b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 -- 172.21.15.7:0/3106005724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0094f0 con 0x7fe7580cbbc0 2023-10-14T19:10:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe7577fe700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7580c98e0 0x7fe7580b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe756ffd700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580b2a30 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe75806e6b0 tx=0x7fe74c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c011e60 con 0x7fe7580cbbc0 2023-10-14T19:10:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c01a630 con 0x7fe7580cbbc0 2023-10-14T19:10:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c01a9f0 con 0x7fe7580cbbc0 2023-10-14T19:10:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.020+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7580b3070 con 0x7fe7580cbbc0 2023-10-14T19:10:02.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.021+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe758153530 con 0x7fe7580cbbc0 2023-10-14T19:10:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.021+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe758169d70 con 0x7fe7580cbbc0 2023-10-14T19:10:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.022+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe74c02d440 con 0x7fe7580cbbc0 2023-10-14T19:10:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.022+0000 7fe73f7fe700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe744067320 0x7fe7440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.022+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fe74c0868d0 con 0x7fe7580cbbc0 2023-10-14T19:10:02.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.023+0000 7fe7577fe700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe744067320 0x7fe7440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.023+0000 7fe7577fe700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe744067320 0x7fe7440697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7480017a0 tx=0x7fe748009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.027+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe758169d70 con 0x7fe7580cbbc0 2023-10-14T19:10:02.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.220+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe758169d70 con 0x7fe7580cbbc0 2023-10-14T19:10:02.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.220+0000 7fe73f7fe700 1 -- 172.21.15.7:0/3106005724 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe758169d70 con 0x7fe7580cbbc0 2023-10-14T19:10:02.221 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:10:02.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe744067320 msgr2=0x7fe7440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe744067320 0x7fe7440697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7480017a0 tx=0x7fe748009040 comp rx=0 tx=0).stop 2023-10-14T19:10:02.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 msgr2=0x7fe7580b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580b2a30 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe75806e6b0 tx=0x7fe74c017000 comp rx=0 tx=0).stop 2023-10-14T19:10:02.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 shutdown_connections 2023-10-14T19:10:02.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe744067320 0x7fe7440697d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7580c98e0 0x7fe7580b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe758159970 0x7fe75815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 --2- 172.21.15.7:0/3106005724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7580cbbc0 0x7fe7580b2a30 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 >> 172.21.15.7:0/3106005724 conn(0x7fe75806e250 msgr2=0x7fe758158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:02.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 shutdown_connections 2023-10-14T19:10:02.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.222+0000 7fe75deea700 1 -- 172.21.15.7:0/3106005724 wait complete. 2023-10-14T19:10:02.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.354+0000 7f00af77d700 1 Processor -- start 2023-10-14T19:10:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.354+0000 7f00af77d700 1 -- start start 2023-10-14T19:10:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00af77d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00a80cb5a0 0x7f00a80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00af77d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00af77d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a815ae40 con 0x7f00a80cd9e0 2023-10-14T19:10:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00af77d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a80d13f0 con 0x7f00a80cb5a0 2023-10-14T19:10:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00af77d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a815ab60 con 0x7f00a815a5d0 2023-10-14T19:10:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00ad519700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00a80cb5a0 0x7f00a80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00acd18700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00a80cd9e0 0x7f00a8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42446/0 (socket says 172.21.15.7:42446) 2023-10-14T19:10:02.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.355+0000 7f00acd18700 1 -- 172.21.15.7:0/19344404 learned_addr learned my addr 172.21.15.7:0/19344404 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:02.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00add1a700 1 --2- 172.21.15.7:0/19344404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00ad519700 1 -- 172.21.15.7:0/19344404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 msgr2=0x7f00a8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:02.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00ad519700 1 --2- 172.21.15.7:0/19344404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00ad519700 1 -- 172.21.15.7:0/19344404 >> v1:172.21.15.7:6789/0 conn(0x7f00a80cd9e0 legacy=0x7f00a8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00ad519700 1 -- 172.21.15.7:0/19344404 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80ccf00 con 0x7f00a80cb5a0 2023-10-14T19:10:02.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00ad519700 1 --2- 172.21.15.7:0/19344404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a80cb970 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009910 tx=0x7f00a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287154332ed91c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f009ffff700 1 -- 172.21.15.7:0/19344404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400b820 con 0x7f00a80cb5a0 2023-10-14T19:10:02.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f009ffff700 1 -- 172.21.15.7:0/19344404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a400b980 con 0x7f00a80cb5a0 2023-10-14T19:10:02.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f009ffff700 1 -- 172.21.15.7:0/19344404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400bd20 con 0x7f00a80cb5a0 2023-10-14T19:10:02.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00af77d700 1 -- 172.21.15.7:0/19344404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 msgr2=0x7f00a80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.356+0000 7f00af77d700 1 --2- 172.21.15.7:0/19344404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a80cb970 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009910 tx=0x7f00a40091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.357+0000 7f00af77d700 1 -- 172.21.15.7:0/19344404 shutdown_connections 2023-10-14T19:10:02.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.357+0000 7f00af77d700 1 --2- 172.21.15.7:0/19344404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a80cb970 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.357+0000 7f00af77d700 1 --2- 172.21.15.7:0/19344404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.357+0000 7f00af77d700 1 -- 172.21.15.7:0/19344404 >> 172.21.15.7:0/19344404 conn(0x7f00a8070e30 msgr2=0x7f00a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:02.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.357+0000 7f00af77d700 1 -- 172.21.15.7:0/19344404 shutdown_connections 2023-10-14T19:10:02.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.357+0000 7f00af77d700 1 -- 172.21.15.7:0/19344404 wait complete. 2023-10-14T19:10:02.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.358+0000 7f00af77d700 1 Processor -- start 2023-10-14T19:10:02.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.358+0000 7f00af77d700 1 -- start start 2023-10-14T19:10:02.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a8159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00a80cd9e0 0x7f00a80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8169660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8159280 con 0x7f00a80cb5a0 2023-10-14T19:10:02.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8159c50 con 0x7f00a80cd9e0 2023-10-14T19:10:02.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a816a190 con 0x7f00a815a5d0 2023-10-14T19:10:02.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a8159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a8159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43104/0 (socket says 172.21.15.7:43104) 2023-10-14T19:10:02.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 -- 172.21.15.7:0/3949360468 learned_addr learned my addr 172.21.15.7:0/3949360468 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:02.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00acd18700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00a80cd9e0 0x7f00a80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00add1a700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8169660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 -- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 msgr2=0x7f00a8169660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8169660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 -- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00a80cd9e0 msgr2=0x7f00a80c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00a80cd9e0 0x7f00a80c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 -- 172.21.15.7:0/3949360468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a4009420 con 0x7f00a80cb5a0 2023-10-14T19:10:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00acd18700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00a80cd9e0 0x7f00a80c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00add1a700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8169660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00ad519700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a8159710 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f00a806ea60 tx=0x7f00a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011e90 con 0x7f00a80cb5a0 2023-10-14T19:10:02.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4024440 con 0x7f00a80cb5a0 2023-10-14T19:10:02.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a816a470 con 0x7f00a80cb5a0 2023-10-14T19:10:02.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.359+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4024800 con 0x7f00a80cb5a0 2023-10-14T19:10:02.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.360+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a80b55d0 con 0x7f00a80cb5a0 2023-10-14T19:10:02.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.360+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a804c3c0 con 0x7f00a80cb5a0 2023-10-14T19:10:02.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.361+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00a401a420 con 0x7f00a80cb5a0 2023-10-14T19:10:02.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.361+0000 7f009d7fa700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f008c067320 0x7f008c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.361+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f00a4086cf0 con 0x7f00a80cb5a0 2023-10-14T19:10:02.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.362+0000 7f00acd18700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f008c067320 0x7f008c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.362+0000 7f00acd18700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f008c067320 0x7f008c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f00980058d0 tx=0x7f0098009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.366+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00a4053890 con 0x7f00a80cb5a0 2023-10-14T19:10:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.602+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00a80cd1e0 con 0x7f00a80cb5a0 2023-10-14T19:10:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.603+0000 7f009d7fa700 1 -- 172.21.15.7:0/3949360468 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f00a4056eb0 con 0x7f00a80cb5a0 2023-10-14T19:10:02.604 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:02.604 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2658859369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2658859369},{"type":"v1","addr":"172.21.15.148:6837","nonce":2658859369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/713445110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":713445110},{"type":"v1","addr":"172.21.15.7:6834","nonce":713445110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:36.305484+0000","modified":"2023-10-14T19:09:39.916613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/698585291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":698585291},{"type":"v1","addr":"172.21.15.7:6835","nonce":698585291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T19:10:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f008c067320 msgr2=0x7f008c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f008c067320 0x7f008c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f00980058d0 tx=0x7f0098009040 comp rx=0 tx=0).stop 2023-10-14T19:10:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 msgr2=0x7f00a8159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a8159710 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f00a806ea60 tx=0x7f00a4017000 comp rx=0 tx=0).stop 2023-10-14T19:10:02.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 shutdown_connections 2023-10-14T19:10:02.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f008c067320 0x7f008c0697d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00a815a5d0 0x7f00a8169660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a80cb5a0 0x7f00a8159710 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 --2- 172.21.15.7:0/3949360468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00a80cd9e0 0x7f00a80c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 >> 172.21.15.7:0/3949360468 conn(0x7f00a8070e30 msgr2=0x7f00a80c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 shutdown_connections 2023-10-14T19:10:02.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.605+0000 7f00af77d700 1 -- 172.21.15.7:0/3949360468 wait complete. 2023-10-14T19:10:02.609 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 83 2023-10-14T19:10:02.618 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:02.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.737+0000 7ff448265700 1 Processor -- start 2023-10-14T19:10:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.737+0000 7ff448265700 1 -- start start 2023-10-14T19:10:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff448265700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff44015db00 0x7ff4400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff448265700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff440161440 0x7ff4400afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff448265700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff44015fe40 0x7ff4400aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff448265700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff440160fb0 con 0x7ff44015db00 2023-10-14T19:10:02.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff448265700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4401603a0 con 0x7ff44015fe40 2023-10-14T19:10:02.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff448265700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff440160680 con 0x7ff440161440 2023-10-14T19:10:02.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff446001700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff44015db00 0x7ff4400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff445800700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff440161440 0x7ff4400afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff446001700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff44015db00 0x7ff4400b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43116/0 (socket says 172.21.15.7:43116) 2023-10-14T19:10:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff446001700 1 -- 172.21.15.7:0/3681060156 learned_addr learned my addr 172.21.15.7:0/3681060156 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.738+0000 7ff446802700 1 --2- 172.21.15.7:0/3681060156 >> v2:172.21.15.148:3300/0 conn(0x7ff44015fe40 0x7ff4400aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff446001700 1 -- 172.21.15.7:0/3681060156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff440161440 msgr2=0x7ff4400afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff446001700 1 --2- 172.21.15.7:0/3681060156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff440161440 0x7ff4400afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff446001700 1 -- 172.21.15.7:0/3681060156 >> v2:172.21.15.148:3300/0 conn(0x7ff44015fe40 msgr2=0x7ff4400aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff446001700 1 --2- 172.21.15.7:0/3681060156 >> v2:172.21.15.148:3300/0 conn(0x7ff44015fe40 0x7ff4400aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff446001700 1 -- 172.21.15.7:0/3681060156 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440160960 con 0x7ff44015db00 2023-10-14T19:10:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff446001700 1 --2- 172.21.15.7:0/3681060156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4400b1b40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff44006c090 tx=0x7ff438009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6763f03b06d3545a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff444fff700 1 -- 172.21.15.7:0/3681060156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800e070 con 0x7ff44015db00 2023-10-14T19:10:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff444fff700 1 -- 172.21.15.7:0/3681060156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800b970 con 0x7ff44015db00 2023-10-14T19:10:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.739+0000 7ff444fff700 1 -- 172.21.15.7:0/3681060156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380092e0 con 0x7ff44015db00 2023-10-14T19:10:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 -- 172.21.15.7:0/3681060156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 msgr2=0x7ff4400b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 --2- 172.21.15.7:0/3681060156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4400b1b40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff44006c090 tx=0x7ff438009840 comp rx=0 tx=0).stop 2023-10-14T19:10:02.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 -- 172.21.15.7:0/3681060156 shutdown_connections 2023-10-14T19:10:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 --2- 172.21.15.7:0/3681060156 >> v2:172.21.15.148:3300/0 conn(0x7ff44015fe40 0x7ff4400aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 --2- 172.21.15.7:0/3681060156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4400b1b40 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 --2- 172.21.15.7:0/3681060156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff440161440 0x7ff4400afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 -- 172.21.15.7:0/3681060156 >> 172.21.15.7:0/3681060156 conn(0x7ff44006d170 msgr2=0x7ff4400cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:02.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 -- 172.21.15.7:0/3681060156 shutdown_connections 2023-10-14T19:10:02.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.740+0000 7ff448265700 1 -- 172.21.15.7:0/3681060156 wait complete. 2023-10-14T19:10:02.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.741+0000 7ff448265700 1 Processor -- start 2023-10-14T19:10:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.741+0000 7ff448265700 1 -- start start 2023-10-14T19:10:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4401450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44015fe40 0x7ff4400acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff440161440 0x7ff4400aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400ae600 con 0x7ff44015db00 2023-10-14T19:10:02.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400ae170 con 0x7ff440161440 2023-10-14T19:10:02.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400ad560 con 0x7ff44015fe40 2023-10-14T19:10:02.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4401450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4401450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43122/0 (socket says 172.21.15.7:43122) 2023-10-14T19:10:02.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 -- 172.21.15.7:0/3139249495 learned_addr learned my addr 172.21.15.7:0/3139249495 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:02.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff445800700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44015fe40 0x7ff4400acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446802700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff440161440 0x7ff4400aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 -- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44015fe40 msgr2=0x7ff4400acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44015fe40 0x7ff4400acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 -- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff440161440 msgr2=0x7ff4400aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff440161440 0x7ff4400aa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 -- 172.21.15.7:0/3139249495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009ae0 con 0x7ff44015db00 2023-10-14T19:10:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446802700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff440161440 0x7ff4400aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:02.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff446001700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4401450e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff44006d610 tx=0x7ff438018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380088a0 con 0x7ff44015db00 2023-10-14T19:10:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438008a00 con 0x7ff44015db00 2023-10-14T19:10:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4400ad840 con 0x7ff44015db00 2023-10-14T19:10:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.742+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438008dc0 con 0x7ff44015db00 2023-10-14T19:10:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.743+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4400ade00 con 0x7ff44015db00 2023-10-14T19:10:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.744+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4400ae450 con 0x7ff44015db00 2023-10-14T19:10:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.744+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff438003040 con 0x7ff44015db00 2023-10-14T19:10:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.744+0000 7ff43dffb700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff42c067320 0x7ff42c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.744+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7ff438086ab0 con 0x7ff44015db00 2023-10-14T19:10:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.745+0000 7ff445800700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff42c067320 0x7ff42c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.745+0000 7ff445800700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff42c067320 0x7ff42c0697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff4401715a0 tx=0x7ff4340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.749+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff438053580 con 0x7ff44015db00 2023-10-14T19:10:02.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.948+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff44004c3c0 con 0x7ff44015db00 2023-10-14T19:10:02.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.948+0000 7ff43dffb700 1 -- 172.21.15.7:0/3139249495 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+15575 (secure 0 0 0) 0x7ff438056ba0 con 0x7ff44015db00 2023-10-14T19:10:02.949 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:02.950 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":127,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:00.139493+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:34.735685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:35.268214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6837/3885032212":"2023-10-15T19:09:57.131329+0000","172.21.15.148:6835/3885032212":"2023-10-15T19:09:57.131329+0000","172.21.15.7:6834/3111043599":"2023-10-15T19:09:53.722947+0000","172.21.15.7:6832/3111043599":"2023-10-15T19:09:53.722947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff42c067320 msgr2=0x7ff42c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff42c067320 0x7ff42c0697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff4401715a0 tx=0x7ff4340091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 msgr2=0x7ff4401450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4401450e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff44006d610 tx=0x7ff438018000 comp rx=0 tx=0).stop 2023-10-14T19:10:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 shutdown_connections 2023-10-14T19:10:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff42c067320 0x7ff42c0697d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff440161440 0x7ff4400aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44015db00 0x7ff4401450e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 --2- 172.21.15.7:0/3139249495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44015fe40 0x7ff4400acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 >> 172.21.15.7:0/3139249495 conn(0x7ff44006d170 msgr2=0x7ff44006b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 shutdown_connections 2023-10-14T19:10:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:02.951+0000 7ff448265700 1 -- 172.21.15.7:0/3139249495 wait complete. 2023-10-14T19:10:02.964 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:10:02.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:03.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.083+0000 7f1dfef6d700 1 Processor -- start 2023-10-14T19:10:03.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.083+0000 7f1dfef6d700 1 -- start start 2023-10-14T19:10:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfef6d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1df80cb970 0x7f1df8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfef6d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1df815a400 0x7f1df8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfef6d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df815ae40 con 0x7f1df80cb5a0 2023-10-14T19:10:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfef6d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df80ce0f0 con 0x7f1df815a400 2023-10-14T19:10:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfef6d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df80d13f0 con 0x7f1df80cb970 2023-10-14T19:10:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfd50a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1df815a400 0x7f1df8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfd50a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1df815a400 0x7f1df8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43130/0 (socket says 172.21.15.7:43130) 2023-10-14T19:10:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.084+0000 7f1dfd50a700 1 -- 172.21.15.7:0/4157912879 learned_addr learned my addr 172.21.15.7:0/4157912879 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:03.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1df7fff700 1 --2- 172.21.15.7:0/4157912879 >> v2:172.21.15.148:3300/0 conn(0x7f1df80cb970 0x7f1df8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfd50a700 1 -- 172.21.15.7:0/4157912879 >> v2:172.21.15.148:3300/0 conn(0x7f1df80cb970 msgr2=0x7f1df8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:03.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfd50a700 1 --2- 172.21.15.7:0/4157912879 >> v2:172.21.15.148:3300/0 conn(0x7f1df80cb970 0x7f1df8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfd50a700 1 -- 172.21.15.7:0/4157912879 >> v1:172.21.15.148:6789/0 conn(0x7f1df80cb5a0 legacy=0x7f1df80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:03.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfd50a700 1 -- 172.21.15.7:0/4157912879 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df815ab60 con 0x7f1df815a400 2023-10-14T19:10:03.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1df7fff700 1 --2- 172.21.15.7:0/4157912879 >> v2:172.21.15.148:3300/0 conn(0x7f1df80cb970 0x7f1df8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:03.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfd50a700 1 --2- 172.21.15.7:0/4157912879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df8156e90 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1df80d1780 tx=0x7f1de0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc0e52dbb0a2e03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1df77fe700 1 -- 172.21.15.7:0/4157912879 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000b820 con 0x7f1df815a400 2023-10-14T19:10:03.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1df77fe700 1 -- 172.21.15.7:0/4157912879 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000b980 con 0x7f1df815a400 2023-10-14T19:10:03.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1df77fe700 1 -- 172.21.15.7:0/4157912879 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000bd20 con 0x7f1df815a400 2023-10-14T19:10:03.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfef6d700 1 -- 172.21.15.7:0/4157912879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 msgr2=0x7f1df8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/4157912879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df8156e90 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1df80d1780 tx=0x7f1de0009250 comp rx=0 tx=0).stop 2023-10-14T19:10:03.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfef6d700 1 -- 172.21.15.7:0/4157912879 shutdown_connections 2023-10-14T19:10:03.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/4157912879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df8156e90 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/4157912879 >> v2:172.21.15.148:3300/0 conn(0x7f1df80cb970 0x7f1df8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.085+0000 7f1dfef6d700 1 -- 172.21.15.7:0/4157912879 >> 172.21.15.7:0/4157912879 conn(0x7f1df8070e30 msgr2=0x7f1df80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:03.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.086+0000 7f1dfef6d700 1 -- 172.21.15.7:0/4157912879 shutdown_connections 2023-10-14T19:10:03.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.086+0000 7f1dfef6d700 1 -- 172.21.15.7:0/4157912879 wait complete. 2023-10-14T19:10:03.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 Processor -- start 2023-10-14T19:10:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 -- start start 2023-10-14T19:10:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df80cb5a0 0x7f1df81521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1df80cb970 0x7f1df80c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df815c830 con 0x7f1df815a400 2023-10-14T19:10:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df815c540 con 0x7f1df80cb5a0 2023-10-14T19:10:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.087+0000 7f1dfef6d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df80c9170 con 0x7f1df80cb970 2023-10-14T19:10:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df80cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43138/0 (socket says 172.21.15.7:43138) 2023-10-14T19:10:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 -- 172.21.15.7:0/658066206 learned_addr learned my addr 172.21.15.7:0/658066206 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfcd09700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df80cb5a0 0x7f1df81521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1df7fff700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1df80cb970 0x7f1df80c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 -- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1df80cb970 msgr2=0x7f1df80c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1df80cb970 0x7f1df80c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 -- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df80cb5a0 msgr2=0x7f1df81521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df80cb5a0 0x7f1df81521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 -- 172.21.15.7:0/658066206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00094f0 con 0x7f1df815a400 2023-10-14T19:10:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfd50a700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df80cf230 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009290 tx=0x7f1de0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de001b680 con 0x7f1df815a400 2023-10-14T19:10:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de001b7e0 con 0x7f1df815a400 2023-10-14T19:10:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df80c9450 con 0x7f1df815a400 2023-10-14T19:10:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de001bba0 con 0x7f1df815a400 2023-10-14T19:10:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.088+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df8152710 con 0x7f1df815a400 2023-10-14T19:10:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.089+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df804c3c0 con 0x7f1df815a400 2023-10-14T19:10:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.090+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1de001c450 con 0x7f1df815a400 2023-10-14T19:10:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.090+0000 7f1df4ff9700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1dd8067320 0x7f1dd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.090+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f1de0086a90 con 0x7f1df815a400 2023-10-14T19:10:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.090+0000 7f1dfcd09700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1dd8067320 0x7f1dd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.091+0000 7f1dfcd09700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1dd8067320 0x7f1dd80697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1df816ca20 tx=0x7f1df0007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.094+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1de0053670 con 0x7f1df815a400 2023-10-14T19:10:03.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.331+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1df815c970 con 0x7f1df815a400 2023-10-14T19:10:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.332+0000 7f1df4ff9700 1 -- 172.21.15.7:0/658066206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f1de002a070 con 0x7f1df815a400 2023-10-14T19:10:03.333 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:03.333 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2658859369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2658859369},{"type":"v1","addr":"172.21.15.148:6837","nonce":2658859369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/713445110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":713445110},{"type":"v1","addr":"172.21.15.7:6834","nonce":713445110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:36.305484+0000","modified":"2023-10-14T19:09:39.916613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/698585291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":698585291},{"type":"v1","addr":"172.21.15.7:6835","nonce":698585291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T19:10:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1dd8067320 msgr2=0x7f1dd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1dd8067320 0x7f1dd80697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1df816ca20 tx=0x7f1df0007ea0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 msgr2=0x7f1df80cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df80cf230 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009290 tx=0x7f1de0016000 comp rx=0 tx=0).stop 2023-10-14T19:10:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 shutdown_connections 2023-10-14T19:10:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1dd8067320 0x7f1dd80697d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df80cb5a0 0x7f1df81521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1df815a400 0x7f1df80cf230 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 --2- 172.21.15.7:0/658066206 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1df80cb970 0x7f1df80c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 >> 172.21.15.7:0/658066206 conn(0x7f1df8070e30 msgr2=0x7f1df80c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 shutdown_connections 2023-10-14T19:10:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.334+0000 7f1dfef6d700 1 -- 172.21.15.7:0/658066206 wait complete. 2023-10-14T19:10:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 83 2023-10-14T19:10:03.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.466+0000 7f5fad9b4700 1 Processor -- start 2023-10-14T19:10:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.466+0000 7f5fad9b4700 1 -- start start 2023-10-14T19:10:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fad9b4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5fa80cf200 0x7f5fa80c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fad9b4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5fa80b0ba0 0x7f5fa806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fad9b4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa815a280 con 0x7f5fa80b07d0 2023-10-14T19:10:03.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fad9b4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa806e180 con 0x7f5fa80cf200 2023-10-14T19:10:03.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fad9b4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa806d850 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5fa80cf200 0x7f5fa80c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5fa80cf200 0x7f5fa80c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43146/0 (socket says 172.21.15.7:43146) 2023-10-14T19:10:03.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 -- 172.21.15.7:0/225598727 learned_addr learned my addr 172.21.15.7:0/225598727 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:03.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa77fe700 1 --2- 172.21.15.7:0/225598727 >> v2:172.21.15.148:3300/0 conn(0x7f5fa80b0ba0 0x7f5fa806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 -- 172.21.15.7:0/225598727 >> v2:172.21.15.148:3300/0 conn(0x7f5fa80b0ba0 msgr2=0x7f5fa806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:03.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 --2- 172.21.15.7:0/225598727 >> v2:172.21.15.148:3300/0 conn(0x7f5fa80b0ba0 0x7f5fa806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 -- 172.21.15.7:0/225598727 >> v1:172.21.15.148:6789/0 conn(0x7f5fa80b07d0 legacy=0x7f5fa80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 -- 172.21.15.7:0/225598727 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa806db30 con 0x7f5fa80cf200 2023-10-14T19:10:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa67fc700 1 --2- 172.21.15.7:0/225598727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80cf200 0x7f5fa80c42c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80637a0 tx=0x7f5f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc0d9dcdf3c6636 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.467+0000 7f5fa5ffb700 1 -- 172.21.15.7:0/225598727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000b820 con 0x7f5fa80cf200 2023-10-14T19:10:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fa5ffb700 1 -- 172.21.15.7:0/225598727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000b980 con 0x7f5fa80cf200 2023-10-14T19:10:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fa5ffb700 1 -- 172.21.15.7:0/225598727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000bd20 con 0x7f5fa80cf200 2023-10-14T19:10:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 -- 172.21.15.7:0/225598727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80cf200 msgr2=0x7f5fa80c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/225598727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80cf200 0x7f5fa80c42c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80637a0 tx=0x7f5f90009250 comp rx=0 tx=0).stop 2023-10-14T19:10:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 -- 172.21.15.7:0/225598727 shutdown_connections 2023-10-14T19:10:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/225598727 >> v2:172.21.15.148:3300/0 conn(0x7f5fa80b0ba0 0x7f5fa806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/225598727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80cf200 0x7f5fa80c42c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 -- 172.21.15.7:0/225598727 >> 172.21.15.7:0/225598727 conn(0x7f5fa806ce80 msgr2=0x7f5fa80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:03.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 -- 172.21.15.7:0/225598727 shutdown_connections 2023-10-14T19:10:03.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.468+0000 7f5fad9b4700 1 -- 172.21.15.7:0/225598727 wait complete. 2023-10-14T19:10:03.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.469+0000 7f5fad9b4700 1 Processor -- start 2023-10-14T19:10:03.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.469+0000 7f5fad9b4700 1 -- start start 2023-10-14T19:10:03.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fad9b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa80b07d0 0x7f5fa80afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fad9b4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 0x7f5fa81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fad9b4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fa80cf200 0x7f5fa80aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fad9b4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80aff40 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fad9b4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80ae730 con 0x7f5fa80b07d0 2023-10-14T19:10:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fad9b4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80af570 con 0x7f5fa80cf200 2023-10-14T19:10:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fa67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 0x7f5fa81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fa67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 0x7f5fa81572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43148/0 (socket says 172.21.15.7:43148) 2023-10-14T19:10:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fa67fc700 1 -- 172.21.15.7:0/623658675 learned_addr learned my addr 172.21.15.7:0/623658675 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fa6ffd700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa80b07d0 0x7f5fa80afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.470+0000 7f5fa77fe700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fa80cf200 0x7f5fa80aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa67fc700 1 -- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fa80cf200 msgr2=0x7f5fa80aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa67fc700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fa80cf200 0x7f5fa80aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa67fc700 1 -- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa80b07d0 msgr2=0x7f5fa80afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa67fc700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa80b07d0 0x7f5fa80afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa67fc700 1 -- 172.21.15.7:0/623658675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900094f0 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa6ffd700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa80b07d0 0x7f5fa80afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:03.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fa67fc700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 0x7f5fa81572c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009290 tx=0x7f5f90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90011e60 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9001c670 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8157800 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9001ca30 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.471+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa80aec40 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.472+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa804c3c0 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.472+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5f9001a450 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.473+0000 7f5f9effd700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f88067320 0x7f5f880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.473+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f5f90087390 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.473+0000 7f5fa6ffd700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f88067320 0x7f5f880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.473+0000 7f5fa6ffd700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f88067320 0x7f5f880697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00013c0 tx=0x7f5fa0009680 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.477+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f90053f70 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.714+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fa804c3c0 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.715+0000 7f5f9effd700 1 -- 172.21.15.7:0/623658675 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f5f90057590 con 0x7f5fa80b0ba0 2023-10-14T19:10:03.716 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:03.716 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2658859369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2658859369},{"type":"v1","addr":"172.21.15.148:6837","nonce":2658859369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/713445110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":713445110},{"type":"v1","addr":"172.21.15.7:6834","nonce":713445110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:09:36.305484+0000","modified":"2023-10-14T19:09:39.916613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/698585291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":698585291},{"type":"v1","addr":"172.21.15.7:6835","nonce":698585291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T19:10:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f88067320 msgr2=0x7f5f880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f88067320 0x7f5f880697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00013c0 tx=0x7f5fa0009680 comp rx=0 tx=0).stop 2023-10-14T19:10:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 msgr2=0x7f5fa81572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 0x7f5fa81572c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009290 tx=0x7f5f90016000 comp rx=0 tx=0).stop 2023-10-14T19:10:03.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 shutdown_connections 2023-10-14T19:10:03.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5f88067320 0x7f5f880697d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa80b07d0 0x7f5fa80afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fa80cf200 0x7f5fa80aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 --2- 172.21.15.7:0/623658675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa80b0ba0 0x7f5fa81572c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 >> 172.21.15.7:0/623658675 conn(0x7f5fa806ce80 msgr2=0x7f5fa81590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:03.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.716+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 shutdown_connections 2023-10-14T19:10:03.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.717+0000 7f5fad9b4700 1 -- 172.21.15.7:0/623658675 wait complete. 2023-10-14T19:10:03.720 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 83 2023-10-14T19:10:03.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:03.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.848+0000 7f999fda1700 1 Processor -- start 2023-10-14T19:10:03.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.848+0000 7f999fda1700 1 -- start start 2023-10-14T19:10:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999fda1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f99980cb5a0 0x7f99980cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999fda1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99980cd9e0 0x7f9998159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999fda1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f999815a400 0x7f9998156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999fda1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99980d13f0 con 0x7f99980cd9e0 2023-10-14T19:10:03.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999fda1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999815ae40 con 0x7f99980cb5a0 2023-10-14T19:10:03.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999fda1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999815ab60 con 0x7f999815a400 2023-10-14T19:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99980cd9e0 0x7f9998159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99980cd9e0 0x7f9998159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43158/0 (socket says 172.21.15.7:43158) 2023-10-14T19:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 -- 172.21.15.7:0/3026959308 learned_addr learned my addr 172.21.15.7:0/3026959308 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 -- 172.21.15.7:0/3026959308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f999815a400 msgr2=0x7f9998156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999e33e700 1 --2- 172.21.15.7:0/3026959308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f999815a400 0x7f9998156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999db3d700 1 --2- 172.21.15.7:0/3026959308 >> v2:172.21.15.148:3300/0 conn(0x7f99980cb5a0 0x7f99980cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 --2- 172.21.15.7:0/3026959308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f999815a400 0x7f9998156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 -- 172.21.15.7:0/3026959308 >> v2:172.21.15.148:3300/0 conn(0x7f99980cb5a0 msgr2=0x7f99980cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:03.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 --2- 172.21.15.7:0/3026959308 >> v2:172.21.15.148:3300/0 conn(0x7f99980cb5a0 0x7f99980cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 -- 172.21.15.7:0/3026959308 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980ccf00 con 0x7f99980cd9e0 2023-10-14T19:10:03.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.849+0000 7f999d33c700 1 --2- 172.21.15.7:0/3026959308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cd9e0 0x7f9998159ec0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f99880099b0 tx=0x7f9988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3083a32f63154e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999cb3b700 1 -- 172.21.15.7:0/3026959308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998800b820 con 0x7f99980cd9e0 2023-10-14T19:10:03.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999cb3b700 1 -- 172.21.15.7:0/3026959308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998800b980 con 0x7f99980cd9e0 2023-10-14T19:10:03.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999cb3b700 1 -- 172.21.15.7:0/3026959308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998800bd20 con 0x7f99980cd9e0 2023-10-14T19:10:03.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 -- 172.21.15.7:0/3026959308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cd9e0 msgr2=0x7f9998159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 --2- 172.21.15.7:0/3026959308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cd9e0 0x7f9998159ec0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f99880099b0 tx=0x7f9988009250 comp rx=0 tx=0).stop 2023-10-14T19:10:03.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 -- 172.21.15.7:0/3026959308 shutdown_connections 2023-10-14T19:10:03.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 --2- 172.21.15.7:0/3026959308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f999815a400 0x7f9998156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 --2- 172.21.15.7:0/3026959308 >> v2:172.21.15.148:3300/0 conn(0x7f99980cb5a0 0x7f99980cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 --2- 172.21.15.7:0/3026959308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cd9e0 0x7f9998159ec0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 -- 172.21.15.7:0/3026959308 >> 172.21.15.7:0/3026959308 conn(0x7f9998070e30 msgr2=0x7f99980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:03.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 -- 172.21.15.7:0/3026959308 shutdown_connections 2023-10-14T19:10:03.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.850+0000 7f999fda1700 1 -- 172.21.15.7:0/3026959308 wait complete. 2023-10-14T19:10:03.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.851+0000 7f999fda1700 1 Processor -- start 2023-10-14T19:10:03.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.851+0000 7f999fda1700 1 -- start start 2023-10-14T19:10:03.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999fda1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 0x7f9998151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999fda1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99980cd9e0 0x7f9998159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999fda1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f999815a400 0x7f99981551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999fda1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9998152330 con 0x7f99980cb5a0 2023-10-14T19:10:03.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999fda1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980b4fd0 con 0x7f999815a400 2023-10-14T19:10:03.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999fda1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99980b46a0 con 0x7f99980cd9e0 2023-10-14T19:10:03.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 0x7f9998151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 0x7f9998151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43174/0 (socket says 172.21.15.7:43174) 2023-10-14T19:10:03.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 -- 172.21.15.7:0/1366962670 learned_addr learned my addr 172.21.15.7:0/1366962670 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:03.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 -- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99980cd9e0 msgr2=0x7f9998159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99980cd9e0 0x7f9998159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 -- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f999815a400 msgr2=0x7f99981551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:03.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f999815a400 0x7f99981551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:03.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.852+0000 7f999db3d700 1 -- 172.21.15.7:0/1366962670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880094f0 con 0x7f99980cb5a0 2023-10-14T19:10:03.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.853+0000 7f999db3d700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 0x7f9998151df0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f999400c7d0 tx=0x7f9994008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.853+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011600 con 0x7f99980cb5a0 2023-10-14T19:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.853+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994011760 con 0x7f99980cb5a0 2023-10-14T19:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.853+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011b20 con 0x7f99980cb5a0 2023-10-14T19:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.853+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99980b4980 con 0x7f99980cb5a0 2023-10-14T19:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.853+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99980c77c0 con 0x7f99980cb5a0 2023-10-14T19:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.854+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999804c3c0 con 0x7f99980cb5a0 2023-10-14T19:10:03.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.854+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f99940193f0 con 0x7f99980cb5a0 2023-10-14T19:10:03.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.855+0000 7f998dffb700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f997c067320 0x7f997c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:03.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.855+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f9994085240 con 0x7f99980cb5a0 2023-10-14T19:10:03.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.855+0000 7f999d33c700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f997c067320 0x7f997c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:03.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.855+0000 7f999d33c700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f997c067320 0x7f997c0697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f99880099b0 tx=0x7f9988017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:03.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:03.859+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9994051d10 con 0x7f99980cb5a0 2023-10-14T19:10:04.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.053+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99980cd1e0 con 0x7f99980cb5a0 2023-10-14T19:10:04.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.054+0000 7f998dffb700 1 -- 172.21.15.7:0/1366962670 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+15575 (secure 0 0 0) 0x7f9994055330 con 0x7f99980cb5a0 2023-10-14T19:10:04.055 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:04.055 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":127,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:00.139493+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:09:34.735685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T19:09:35.268214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6837/3885032212":"2023-10-15T19:09:57.131329+0000","172.21.15.148:6835/3885032212":"2023-10-15T19:09:57.131329+0000","172.21.15.7:6834/3111043599":"2023-10-15T19:09:53.722947+0000","172.21.15.7:6832/3111043599":"2023-10-15T19:09:53.722947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f997c067320 msgr2=0x7f997c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f997c067320 0x7f997c0697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f99880099b0 tx=0x7f9988017000 comp rx=0 tx=0).stop 2023-10-14T19:10:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 msgr2=0x7f9998151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 0x7f9998151df0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f999400c7d0 tx=0x7f9994008040 comp rx=0 tx=0).stop 2023-10-14T19:10:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 shutdown_connections 2023-10-14T19:10:04.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f997c067320 0x7f997c0697d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f999815a400 0x7f99981551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99980cb5a0 0x7f9998151df0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 --2- 172.21.15.7:0/1366962670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99980cd9e0 0x7f9998159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 >> 172.21.15.7:0/1366962670 conn(0x7f9998070e30 msgr2=0x7f99980cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:04.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 shutdown_connections 2023-10-14T19:10:04.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.056+0000 7f999fda1700 1 -- 172.21.15.7:0/1366962670 wait complete. 2023-10-14T19:10:04.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:10:04.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.190+0000 7f2064cae700 1 Processor -- start 2023-10-14T19:10:04.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.190+0000 7f2064cae700 1 -- start start 2023-10-14T19:10:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f2064cae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006e0a0 0x7f20600c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f2064cae700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2060150380 0x7f206006a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f2064cae700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206006a490 con 0x7f206006f3a0 2023-10-14T19:10:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f2064cae700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600c7490 con 0x7f2060150380 2023-10-14T19:10:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f2064cae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20600c7770 con 0x7f206006e0a0 2023-10-14T19:10:04.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2060150380 0x7f206006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f206006f3a0 0x7f206014fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42460/0 (socket says 172.21.15.7:42460) 2023-10-14T19:10:04.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205effd700 1 -- 172.21.15.7:0/3209426105 learned_addr learned my addr 172.21.15.7:0/3209426105 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:04.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205ffff700 1 -- 172.21.15.7:0/3209426105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006e0a0 msgr2=0x7f20600c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:04.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205f7fe700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006e0a0 0x7f20600c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205e7fc700 1 -- 172.21.15.7:0/3209426105 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43972671 0 0) 0x7f206006a490 con 0x7f206006f3a0 2023-10-14T19:10:04.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.191+0000 7f205ffff700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006e0a0 0x7f20600c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205ffff700 1 -- 172.21.15.7:0/3209426105 >> v1:172.21.15.7:6789/0 conn(0x7f206006f3a0 legacy=0x7f206014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205ffff700 1 -- 172.21.15.7:0/3209426105 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600c7a50 con 0x7f2060150380 2023-10-14T19:10:04.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205f7fe700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006e0a0 0x7f20600c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:04.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205ffff700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206006a920 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2058009e60 tx=0x7f2058009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa67e9f80ec75cad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:04.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205e7fc700 1 -- 172.21.15.7:0/3209426105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205800e070 con 0x7f2060150380 2023-10-14T19:10:04.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205e7fc700 1 -- 172.21.15.7:0/3209426105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205800bc30 con 0x7f2060150380 2023-10-14T19:10:04.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f205e7fc700 1 -- 172.21.15.7:0/3209426105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058012430 con 0x7f2060150380 2023-10-14T19:10:04.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 -- 172.21.15.7:0/3209426105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 msgr2=0x7f206006a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206006a920 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2058009e60 tx=0x7f2058009780 comp rx=0 tx=0).stop 2023-10-14T19:10:04.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 -- 172.21.15.7:0/3209426105 shutdown_connections 2023-10-14T19:10:04.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206006a920 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 --2- 172.21.15.7:0/3209426105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006e0a0 0x7f20600c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 -- 172.21.15.7:0/3209426105 >> 172.21.15.7:0/3209426105 conn(0x7f206006d170 msgr2=0x7f20600cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 -- 172.21.15.7:0/3209426105 shutdown_connections 2023-10-14T19:10:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.192+0000 7f2064cae700 1 -- 172.21.15.7:0/3209426105 wait complete. 2023-10-14T19:10:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 Processor -- start 2023-10-14T19:10:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 -- start start 2023-10-14T19:10:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f206006e0a0 0x7f206016c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006f3a0 0x7f206016a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206014a9e0 con 0x7f2060150380 2023-10-14T19:10:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060169b40 con 0x7f206006e0a0 2023-10-14T19:10:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f2064cae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2060169e20 con 0x7f206006f3a0 2023-10-14T19:10:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.194+0000 7f205ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43188/0 (socket says 172.21.15.7:43188) 2023-10-14T19:10:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 -- 172.21.15.7:0/3856012429 learned_addr learned my addr 172.21.15.7:0/3856012429 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205effd700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006f3a0 0x7f206016a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205f7fe700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f206006e0a0 0x7f206016c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 -- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006f3a0 msgr2=0x7f206016a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006f3a0 0x7f206016a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 -- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f206006e0a0 msgr2=0x7f206016c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f206006e0a0 0x7f206016c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 -- 172.21.15.7:0/3856012429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009a20 con 0x7f2060150380 2023-10-14T19:10:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f205ffff700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206014a4a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f2060071320 tx=0x7f2058019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205801d630 con 0x7f2060150380 2023-10-14T19:10:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205801d7b0 con 0x7f2060150380 2023-10-14T19:10:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205801db70 con 0x7f2060150380 2023-10-14T19:10:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206016a100 con 0x7f2060150380 2023-10-14T19:10:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.195+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206014b5c0 con 0x7f2060150380 2023-10-14T19:10:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.196+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206004c3c0 con 0x7f2060150380 2023-10-14T19:10:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.197+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2058024070 con 0x7f2060150380 2023-10-14T19:10:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.197+0000 7f20477fe700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f204c067320 0x7f204c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.197+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f2058087700 con 0x7f2060150380 2023-10-14T19:10:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.197+0000 7f205f7fe700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f204c067320 0x7f204c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.198+0000 7f205f7fe700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f204c067320 0x7f204c0697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f20600b0360 tx=0x7f2050006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.201+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20580542e0 con 0x7f2060150380 2023-10-14T19:10:04.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.438+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f20600c7d30 con 0x7f2060150380 2023-10-14T19:10:04.440 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:10:04.439+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:10:04.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.443+0000 7f20477fe700 1 -- 172.21.15.7:0/3856012429 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2058057900 con 0x7f2060150380 2023-10-14T19:10:04.446 INFO:tasks.ceph.mds.a.smithi007.stderr: -1356> 2023-10-14T19:09:42.838+0000 7fa73b89c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:10:04.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f204c067320 msgr2=0x7f204c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f204c067320 0x7f204c0697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f20600b0360 tx=0x7f2050006f90 comp rx=0 tx=0).stop 2023-10-14T19:10:04.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 msgr2=0x7f206014a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206014a4a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f2060071320 tx=0x7f2058019000 comp rx=0 tx=0).stop 2023-10-14T19:10:04.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 shutdown_connections 2023-10-14T19:10:04.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f204c067320 0x7f204c0697d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f206006e0a0 0x7f206016c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2060150380 0x7f206014a4a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 --2- 172.21.15.7:0/3856012429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f206006f3a0 0x7f206016a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 >> 172.21.15.7:0/3856012429 conn(0x7f206006d170 msgr2=0x7f20600c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:04.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 shutdown_connections 2023-10-14T19:10:04.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.446+0000 7f2064cae700 1 -- 172.21.15.7:0/3856012429 wait complete. 2023-10-14T19:10:04.450 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:10:04.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:10:04.467 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:10:04.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.582+0000 7f18a6e68700 1 Processor -- start 2023-10-14T19:10:04.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.582+0000 7f18a6e68700 1 -- start start 2023-10-14T19:10:04.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a6e68700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18a0153dd0 0x7f18a015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a6e68700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a015ac50 con 0x7f18a0153a00 2023-10-14T19:10:04.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a6e68700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a015d010 con 0x7f18a00cea00 2023-10-14T19:10:04.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a6e68700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a015af60 con 0x7f18a0153dd0 2023-10-14T19:10:04.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a5e66700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f18a0153a00 0x7f18a015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42472/0 (socket says 172.21.15.7:42472) 2023-10-14T19:10:04.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a5e66700 1 -- 172.21.15.7:0/4122068850 learned_addr learned my addr 172.21.15.7:0/4122068850 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:04.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a5665700 1 --2- 172.21.15.7:0/4122068850 >> v2:172.21.15.148:3300/0 conn(0x7f18a0153dd0 0x7f18a015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729000177 0 0) 0x7f18a015ac50 con 0x7f18a0153a00 2023-10-14T19:10:04.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.583+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1888003570 con 0x7f18a0153a00 2023-10-14T19:10:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848140706 0 0) 0x7f1888003570 con 0x7f18a0153a00 2023-10-14T19:10:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 >> v2:172.21.15.148:3300/0 conn(0x7f18a0153dd0 msgr2=0x7f18a015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 --2- 172.21.15.7:0/4122068850 >> v2:172.21.15.148:3300/0 conn(0x7f18a0153dd0 0x7f18a015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 >> v1:172.21.15.148:6789/0 conn(0x7f18a00cea00 legacy=0x7f18a00ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a015b240 con 0x7f18a0153a00 2023-10-14T19:10:04.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f1898001470 con 0x7f18a0153a00 2023-10-14T19:10:04.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 >> v1:172.21.15.7:6789/0 conn(0x7f18a0153a00 legacy=0x7f18a015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1888003a60 0x7f1888003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f1888004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18880051c0 0x7f188800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a015af60 con 0x7f1888004810 2023-10-14T19:10:04.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188800c0e0 con 0x7f18880051c0 2023-10-14T19:10:04.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188800c2a0 con 0x7f1888003a60 2023-10-14T19:10:04.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f1888004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a6667700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18880051c0 0x7f188800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5e66700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1888003a60 0x7f1888003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 -- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1888003a60 msgr2=0x7f1888003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:04.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1888003a60 0x7f1888003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 -- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18880051c0 msgr2=0x7f188800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18880051c0 0x7f188800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 -- 172.21.15.7:0/4122068850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888003570 con 0x7f1888004810 2023-10-14T19:10:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a6667700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18880051c0 0x7f188800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:04.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5e66700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1888003a60 0x7f1888003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a6667700 1 -- 172.21.15.7:0/4122068850 reap_dead start 2023-10-14T19:10:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.584+0000 7f18a5665700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f1888004c80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f18a015e390 tx=0x7f18940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b4d5e5b9baefd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400e710 con 0x7f1888004810 2023-10-14T19:10:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189400e870 con 0x7f1888004810 2023-10-14T19:10:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a4e64700 1 -- 172.21.15.7:0/4122068850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400ec30 con 0x7f1888004810 2023-10-14T19:10:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 -- 172.21.15.7:0/4122068850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 msgr2=0x7f1888004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f1888004c80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f18a015e390 tx=0x7f18940091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 -- 172.21.15.7:0/4122068850 shutdown_connections 2023-10-14T19:10:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 --2- 172.21.15.7:0/4122068850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f1888004c80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 -- 172.21.15.7:0/4122068850 >> 172.21.15.7:0/4122068850 conn(0x7f18a00703a0 msgr2=0x7f18a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:04.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 -- 172.21.15.7:0/4122068850 shutdown_connections 2023-10-14T19:10:04.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.585+0000 7f18a6e68700 1 -- 172.21.15.7:0/4122068850 wait complete. 2023-10-14T19:10:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.586+0000 7f18a6e68700 1 Processor -- start 2023-10-14T19:10:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.586+0000 7f18a6e68700 1 -- start start 2023-10-14T19:10:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6e68700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f18a00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6e68700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18a0169b00 0x7f18a0144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6e68700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18a0159c90 0x7f18a015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6e68700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a015a640 con 0x7f1888004810 2023-10-14T19:10:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6e68700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a016a3c0 con 0x7f18a0159c90 2023-10-14T19:10:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6e68700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a016a6a0 con 0x7f18a0169b00 2023-10-14T19:10:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f18a00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f18a00c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43220/0 (socket says 172.21.15.7:43220) 2023-10-14T19:10:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 -- 172.21.15.7:0/1160601955 learned_addr learned my addr 172.21.15.7:0/1160601955 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 -- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18a0169b00 msgr2=0x7f18a0144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a6667700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18a0159c90 0x7f18a015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18a0169b00 0x7f18a0144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 -- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18a0159c90 msgr2=0x7f18a015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18a0159c90 0x7f18a015a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.587+0000 7f18a5e66700 1 -- 172.21.15.7:0/1160601955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a016a980 con 0x7f1888004810 2023-10-14T19:10:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.588+0000 7f18a5e66700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f18a00c9df0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f189800eb90 tx=0x7f1898001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:04.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.588+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800c780 con 0x7f1888004810 2023-10-14T19:10:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.588+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800c8e0 con 0x7f1888004810 2023-10-14T19:10:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.588+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800cc80 con 0x7f1888004810 2023-10-14T19:10:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.588+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00cbc60 con 0x7f1888004810 2023-10-14T19:10:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.588+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a0145340 con 0x7f1888004810 2023-10-14T19:10:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.589+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a0145530 con 0x7f1888004810 2023-10-14T19:10:04.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.589+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f189801d460 con 0x7f1888004810 2023-10-14T19:10:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.590+0000 7f189dffb700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f188c067320 0x7f188c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.590+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1898085060 con 0x7f1888004810 2023-10-14T19:10:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.590+0000 7f18a5665700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f188c067320 0x7f188c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.591+0000 7f18a5665700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f188c067320 0x7f188c0697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f18a00b6550 tx=0x7f189401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:04.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.594+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18a0145530 con 0x7f1888004810 2023-10-14T19:10:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:04.836+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f18a00cc180 con 0x7f1888004810 2023-10-14T19:10:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.443+0000 7f189dffb700 1 -- 172.21.15.7:0/1160601955 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f18a00cc180 con 0x7f1888004810 2023-10-14T19:10:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.446+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f188c067320 msgr2=0x7f188c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.446+0000 7f18a6e68700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f188c067320 0x7f188c0697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f18a00b6550 tx=0x7f189401a000 comp rx=0 tx=0).stop 2023-10-14T19:10:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.446+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 msgr2=0x7f18a00c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.446+0000 7f18a6e68700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f18a00c9df0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f189800eb90 tx=0x7f1898001470 comp rx=0 tx=0).stop 2023-10-14T19:10:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 shutdown_connections 2023-10-14T19:10:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f188c067320 0x7f188c0697d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18a0159c90 0x7f18a015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1888004810 0x7f18a00c9df0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 --2- 172.21.15.7:0/1160601955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18a0169b00 0x7f18a0144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 >> 172.21.15.7:0/1160601955 conn(0x7f18a00703a0 msgr2=0x7f18a00c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 shutdown_connections 2023-10-14T19:10:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.447+0000 7f18a6e68700 1 -- 172.21.15.7:0/1160601955 wait complete. 2023-10-14T19:10:05.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:10:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f4994429700 1 Processor -- start 2023-10-14T19:10:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f4994429700 1 -- start start 2023-10-14T19:10:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f4994429700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f498c06dcf0 0x7f498c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:05.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f4994429700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c0ccfd0 con 0x7f498c159530 2023-10-14T19:10:05.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f4994429700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c15a410 con 0x7f498c159e40 2023-10-14T19:10:05.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f4994429700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c15a6f0 con 0x7f498c06dcf0 2023-10-14T19:10:05.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49919c4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f498c06dcf0 0x7f498c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:05.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49921c5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f498c159530 0x7f498c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42488/0 (socket says 172.21.15.7:42488) 2023-10-14T19:10:05.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49921c5700 1 -- 172.21.15.7:0/1805165721 learned_addr learned my addr 172.21.15.7:0/1805165721 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:05.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49919c4700 1 -- 172.21.15.7:0/1805165721 >> v1:172.21.15.148:6789/0 conn(0x7f498c159e40 legacy=0x7f498c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49919c4700 1 -- 172.21.15.7:0/1805165721 >> v1:172.21.15.7:6789/0 conn(0x7f498c159530 legacy=0x7f498c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49919c4700 1 -- 172.21.15.7:0/1805165721 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c15a9d0 con 0x7f498c06dcf0 2023-10-14T19:10:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49911c3700 1 -- 172.21.15.7:0/1805165721 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518805143 0 0) 0x7f498c0ccfd0 con 0x7f498c159530 2023-10-14T19:10:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.635+0000 7f49919c4700 1 --2- 172.21.15.7:0/1805165721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c159900 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f497c0098e0 tx=0x7f497c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f760f9e6a1ed0003 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f49911c3700 1 -- 172.21.15.7:0/1805165721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c009e80 con 0x7f498c06dcf0 2023-10-14T19:10:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f49911c3700 1 -- 172.21.15.7:0/1805165721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c00b860 con 0x7f498c06dcf0 2023-10-14T19:10:05.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f49911c3700 1 -- 172.21.15.7:0/1805165721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00bbe0 con 0x7f498c06dcf0 2023-10-14T19:10:05.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 -- 172.21.15.7:0/1805165721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 msgr2=0x7f498c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 --2- 172.21.15.7:0/1805165721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c159900 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f497c0098e0 tx=0x7f497c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 -- 172.21.15.7:0/1805165721 shutdown_connections 2023-10-14T19:10:05.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 --2- 172.21.15.7:0/1805165721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c159900 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 -- 172.21.15.7:0/1805165721 >> 172.21.15.7:0/1805165721 conn(0x7f498c0703a0 msgr2=0x7f498c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:05.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 -- 172.21.15.7:0/1805165721 shutdown_connections 2023-10-14T19:10:05.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.636+0000 7f4994429700 1 -- 172.21.15.7:0/1805165721 wait complete. 2023-10-14T19:10:05.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.637+0000 7f4994429700 1 Processor -- start 2023-10-14T19:10:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.637+0000 7f4994429700 1 -- start start 2023-10-14T19:10:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f4994429700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f4994429700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c159530 0x7f498c16a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f4994429700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f498c159e40 0x7f498c15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f4994429700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c16b100 con 0x7f498c06dcf0 2023-10-14T19:10:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f4994429700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c15b370 con 0x7f498c159530 2023-10-14T19:10:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f4994429700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c16ab40 con 0x7f498c159e40 2023-10-14T19:10:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f49921c5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f49921c5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c1533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43226/0 (socket says 172.21.15.7:43226) 2023-10-14T19:10:05.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.638+0000 7f49921c5700 1 -- 172.21.15.7:0/2071931939 learned_addr learned my addr 172.21.15.7:0/2071931939 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:05.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49921c5700 1 -- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f498c159e40 msgr2=0x7f498c15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49921c5700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f498c159e40 0x7f498c15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49921c5700 1 -- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c159530 msgr2=0x7f498c16a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49921c5700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c159530 0x7f498c16a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49921c5700 1 -- 172.21.15.7:0/2071931939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c009420 con 0x7f498c06dcf0 2023-10-14T19:10:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49921c5700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c1533d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f4988001d90 tx=0x7f4988007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800ac70 con 0x7f498c06dcf0 2023-10-14T19:10:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800add0 con 0x7f498c06dcf0 2023-10-14T19:10:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988013b10 con 0x7f498c06dcf0 2023-10-14T19:10:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c16ae20 con 0x7f498c06dcf0 2023-10-14T19:10:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.639+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c153910 con 0x7f498c06dcf0 2023-10-14T19:10:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.640+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c04c3c0 con 0x7f498c06dcf0 2023-10-14T19:10:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.640+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f49880058a0 con 0x7f498c06dcf0 2023-10-14T19:10:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.641+0000 7f49827fc700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4970067320 0x7f49700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.641+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f498808cc20 con 0x7f498c06dcf0 2023-10-14T19:10:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.641+0000 7f49919c4700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4970067320 0x7f49700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.642+0000 7f49919c4700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4970067320 0x7f49700697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f498c1555a0 tx=0x7f497c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.646+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49880596a0 con 0x7f498c06dcf0 2023-10-14T19:10:05.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:05.837+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f498c0cf090 con 0x7f498c06dcf0 2023-10-14T19:10:06.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.449+0000 7f49827fc700 1 -- 172.21.15.7:0/2071931939 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7f49880230d0 con 0x7f498c06dcf0 2023-10-14T19:10:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4970067320 msgr2=0x7f49700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:06.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4970067320 0x7f49700697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f498c1555a0 tx=0x7f497c017000 comp rx=0 tx=0).stop 2023-10-14T19:10:06.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 msgr2=0x7f498c1533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:06.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c1533d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f4988001d90 tx=0x7f4988007d90 comp rx=0 tx=0).stop 2023-10-14T19:10:06.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 shutdown_connections 2023-10-14T19:10:06.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4970067320 0x7f49700697d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f498c159e40 0x7f498c15cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498c06dcf0 0x7f498c1533d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 --2- 172.21.15.7:0/2071931939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c159530 0x7f498c16a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 >> 172.21.15.7:0/2071931939 conn(0x7f498c0703a0 msgr2=0x7f498c1541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:06.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 shutdown_connections 2023-10-14T19:10:06.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.453+0000 7f4994429700 1 -- 172.21.15.7:0/2071931939 wait complete. 2023-10-14T19:10:06.456 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:10:06.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:10:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.598+0000 7f8d83471700 1 Processor -- start 2023-10-14T19:10:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.598+0000 7f8d83471700 1 -- start start 2023-10-14T19:10:06.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d83471700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d7c06e2a0 0x7f8d7c0a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d83471700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 0x7f8d7c0ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d83471700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0cced0 con 0x7f8d7c088400 2023-10-14T19:10:06.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d83471700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd140 con 0x7f8d7c06e2a0 2023-10-14T19:10:06.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d83471700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd420 con 0x7f8d7c0cee40 2023-10-14T19:10:06.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d80a0c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8d7c088400 0x7f8d7c0a8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42496/0 (socket says 172.21.15.7:42496) 2023-10-14T19:10:06.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.599+0000 7f8d80a0c700 1 -- 172.21.15.7:0/741008401 learned_addr learned my addr 172.21.15.7:0/741008401 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:06.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d81a0e700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 0x7f8d7c0ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d8120d700 1 --2- 172.21.15.7:0/741008401 >> v2:172.21.15.148:3300/0 conn(0x7f8d7c06e2a0 0x7f8d7c0a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781521262 0 0) 0x7f8d7c0cced0 con 0x7f8d7c088400 2023-10-14T19:10:06.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d64003570 con 0x7f8d7c088400 2023-10-14T19:10:06.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1409546141 0 0) 0x7f8d64003570 con 0x7f8d7c088400 2023-10-14T19:10:06.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 msgr2=0x7f8d7c0ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:06.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 0x7f8d7c0ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 >> v2:172.21.15.148:3300/0 conn(0x7f8d7c06e2a0 msgr2=0x7f8d7c0a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:06.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 --2- 172.21.15.7:0/741008401 >> v2:172.21.15.148:3300/0 conn(0x7f8d7c06e2a0 0x7f8d7c0a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0cd700 con 0x7f8d7c088400 2023-10-14T19:10:06.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8d70001470 con 0x7f8d7c088400 2023-10-14T19:10:06.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 >> v1:172.21.15.7:6789/0 conn(0x7f8d7c088400 legacy=0x7f8d7c0a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d64003a60 0x7f8d64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d64004810 0x7f8d64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 0x7f8d640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd140 con 0x7f8d64004810 2023-10-14T19:10:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd420 con 0x7f8d64003a60 2023-10-14T19:10:06.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6400ba60 con 0x7f8d7c0cee40 2023-10-14T19:10:06.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d64004810 0x7f8d64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d8120d700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d64003a60 0x7f8d64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d81a0e700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 0x7f8d640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d80a0c700 1 -- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 msgr2=0x7f8d640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d7c0cee40 0x7f8d640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d80a0c700 1 -- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d64003a60 msgr2=0x7f8d64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d64003a60 0x7f8d64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.600+0000 7f8d80a0c700 1 -- 172.21.15.7:0/741008401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64003570 con 0x7f8d64004810 2023-10-14T19:10:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d64004810 0x7f8d64004c80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c3f0 tx=0x7f8d70001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3594a3e28cd5013b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:06.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7000cc80 con 0x7f8d64004810 2023-10-14T19:10:06.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7000cde0 con 0x7f8d64004810 2023-10-14T19:10:06.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d7bfff700 1 -- 172.21.15.7:0/741008401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70005b70 con 0x7f8d64004810 2023-10-14T19:10:06.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d83471700 1 -- 172.21.15.7:0/741008401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d64004810 msgr2=0x7f8d64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:06.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d83471700 1 --2- 172.21.15.7:0/741008401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d64004810 0x7f8d64004c80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c3f0 tx=0x7f8d70001e90 comp rx=0 tx=0).stop 2023-10-14T19:10:06.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d81a0e700 1 -- 172.21.15.7:0/741008401 reap_dead start 2023-10-14T19:10:06.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d83471700 1 -- 172.21.15.7:0/741008401 shutdown_connections 2023-10-14T19:10:06.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d83471700 1 -- 172.21.15.7:0/741008401 >> 172.21.15.7:0/741008401 conn(0x7f8d7c088000 msgr2=0x7f8d7c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:06.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d83471700 1 -- 172.21.15.7:0/741008401 shutdown_connections 2023-10-14T19:10:06.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.601+0000 7f8d83471700 1 -- 172.21.15.7:0/741008401 wait complete. 2023-10-14T19:10:06.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.602+0000 7f8d83471700 1 Processor -- start 2023-10-14T19:10:06.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.602+0000 7f8d83471700 1 -- start start 2023-10-14T19:10:06.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d83471700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d64004810 0x7f8d7c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d83471700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 0x7f8d7c148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d83471700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d7c0af850 0x7f8d7c0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d83471700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0b0230 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d83471700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0b2390 con 0x7f8d7c0af850 2023-10-14T19:10:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d83471700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c15adf0 con 0x7f8d64004810 2023-10-14T19:10:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d80a0c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 0x7f8d7c148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d80a0c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 0x7f8d7c148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43246/0 (socket says 172.21.15.7:43246) 2023-10-14T19:10:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.603+0000 7f8d80a0c700 1 -- 172.21.15.7:0/2786562177 learned_addr learned my addr 172.21.15.7:0/2786562177 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d81a0e700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d7c0af850 0x7f8d7c0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d8120d700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d64004810 0x7f8d7c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d80a0c700 1 -- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d64004810 msgr2=0x7f8d7c15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d64004810 0x7f8d7c15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d80a0c700 1 -- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d7c0af850 msgr2=0x7f8d7c0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d7c0af850 0x7f8d7c0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d80a0c700 1 -- 172.21.15.7:0/2786562177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0b2630 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d81a0e700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d7c0af850 0x7f8d7c0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:06.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d80a0c700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 0x7f8d7c148850 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8d70007d10 tx=0x7f8d70015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700072e0 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70007440 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700077e0 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c0b2910 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.604+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c15aa50 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.605+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c04c3c0 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.605+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8d70019030 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.606+0000 7f8d797fa700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d68067320 0x7f8d680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.606+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5525+0+0 (secure 0 0 0) 0x7f8d70086200 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.606+0000 7f8d8120d700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d68067320 0x7f8d680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.606+0000 7f8d8120d700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d68067320 0x7f8d680697d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c006ea0 tx=0x7f8d6c009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.610+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d70052f40 con 0x7f8d7c15d1e0 2023-10-14T19:10:06.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:06.804+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8d7c0b2c80 con 0x7f8d7c15d1e0 2023-10-14T19:10:07.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.454+0000 7f8d797fa700 1 -- 172.21.15.7:0/2786562177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8d70056560 con 0x7f8d7c15d1e0 2023-10-14T19:10:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d68067320 msgr2=0x7f8d680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d68067320 0x7f8d680697d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c006ea0 tx=0x7f8d6c009120 comp rx=0 tx=0).stop 2023-10-14T19:10:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 msgr2=0x7f8d7c148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 0x7f8d7c148850 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8d70007d10 tx=0x7f8d70015000 comp rx=0 tx=0).stop 2023-10-14T19:10:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 shutdown_connections 2023-10-14T19:10:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8d68067320 0x7f8d680697d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d7c0af850 0x7f8d7c0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d64004810 0x7f8d7c15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 --2- 172.21.15.7:0/2786562177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d7c15d1e0 0x7f8d7c148850 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.456+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 >> 172.21.15.7:0/2786562177 conn(0x7f8d7c088000 msgr2=0x7f8d7c154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.457+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 shutdown_connections 2023-10-14T19:10:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.457+0000 7f8d83471700 1 -- 172.21.15.7:0/2786562177 wait complete. 2023-10-14T19:10:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:10:07.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:10:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.609+0000 7ff788cc3700 1 Processor -- start 2023-10-14T19:10:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.609+0000 7ff788cc3700 1 -- start start 2023-10-14T19:10:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff788cc3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7841597e0 0x7ff784159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff788cc3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406e950 0x7ff78406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff788cc3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78406f300 con 0x7ff78406c6a0 2023-10-14T19:10:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff788cc3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7840c71a0 con 0x7ff7841597e0 2023-10-14T19:10:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff788cc3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840c7a40 con 0x7ff78406e950 2023-10-14T19:10:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff78259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7841597e0 0x7ff784159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff782d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff78406c6a0 0x7ff78406cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58490/0 (socket says 172.21.15.7:58490) 2023-10-14T19:10:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.610+0000 7ff782d9d700 1 -- 172.21.15.7:0/2669469854 learned_addr learned my addr 172.21.15.7:0/2669469854 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff781d9b700 1 --2- 172.21.15.7:0/2669469854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406e950 0x7ff78406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78259c700 1 -- 172.21.15.7:0/2669469854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406e950 msgr2=0x7ff78406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78259c700 1 --2- 172.21.15.7:0/2669469854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406e950 0x7ff78406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78259c700 1 -- 172.21.15.7:0/2669469854 >> v1:172.21.15.7:6789/0 conn(0x7ff78406c6a0 legacy=0x7ff78406cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78259c700 1 -- 172.21.15.7:0/2669469854 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78406d3d0 con 0x7ff7841597e0 2023-10-14T19:10:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78159a700 1 -- 172.21.15.7:0/2669469854 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671283122 0 0) 0x7ff78406f300 con 0x7ff78406c6a0 2023-10-14T19:10:07.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78259c700 1 --2- 172.21.15.7:0/2669469854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7841597e0 0x7ff784159bb0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff7740098d0 tx=0x7ff774009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e780372987d1be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78159a700 1 -- 172.21.15.7:0/2669469854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774009e70 con 0x7ff7841597e0 2023-10-14T19:10:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78159a700 1 -- 172.21.15.7:0/2669469854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774005c10 con 0x7ff7841597e0 2023-10-14T19:10:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.611+0000 7ff78159a700 1 -- 172.21.15.7:0/2669469854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400b650 con 0x7ff7841597e0 2023-10-14T19:10:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 -- 172.21.15.7:0/2669469854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7841597e0 msgr2=0x7ff784159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 --2- 172.21.15.7:0/2669469854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7841597e0 0x7ff784159bb0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff7740098d0 tx=0x7ff774009120 comp rx=0 tx=0).stop 2023-10-14T19:10:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 -- 172.21.15.7:0/2669469854 shutdown_connections 2023-10-14T19:10:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 --2- 172.21.15.7:0/2669469854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7841597e0 0x7ff784159bb0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 --2- 172.21.15.7:0/2669469854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406e950 0x7ff78406edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 -- 172.21.15.7:0/2669469854 >> 172.21.15.7:0/2669469854 conn(0x7ff7840ccb60 msgr2=0x7ff7840ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 -- 172.21.15.7:0/2669469854 shutdown_connections 2023-10-14T19:10:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.612+0000 7ff788cc3700 1 -- 172.21.15.7:0/2669469854 wait complete. 2023-10-14T19:10:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.613+0000 7ff788cc3700 1 Processor -- start 2023-10-14T19:10:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.613+0000 7ff788cc3700 1 -- start start 2023-10-14T19:10:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406c6a0 0x7ff7840af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 0x7ff7840b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7841597e0 0x7ff78414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840ac8d0 con 0x7ff78406e950 2023-10-14T19:10:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840b2780 con 0x7ff7841597e0 2023-10-14T19:10:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840affc0 con 0x7ff78406c6a0 2023-10-14T19:10:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 0x7ff7840b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 0x7ff7840b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44286/0 (socket says 172.21.15.7:44286) 2023-10-14T19:10:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 -- 172.21.15.7:0/3838666698 learned_addr learned my addr 172.21.15.7:0/3838666698 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:07.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff78259c700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406c6a0 0x7ff7840af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff782d9d700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7841597e0 0x7ff78414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 -- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406c6a0 msgr2=0x7ff7840af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406c6a0 0x7ff7840af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 -- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7841597e0 msgr2=0x7ff78414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7841597e0 0x7ff78414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 -- 172.21.15.7:0/3838666698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740093c0 con 0x7ff78406e950 2023-10-14T19:10:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff78259c700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406c6a0 0x7ff7840af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff782d9d700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7841597e0 0x7ff78414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff781d9b700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 0x7ff7840b2240 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff77800d890 tx=0x7ff778008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800b600 con 0x7ff78406e950 2023-10-14T19:10:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800b760 con 0x7ff78406e950 2023-10-14T19:10:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7840b02a0 con 0x7ff78406e950 2023-10-14T19:10:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800bae0 con 0x7ff78406e950 2023-10-14T19:10:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.614+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7840b0860 con 0x7ff78406e950 2023-10-14T19:10:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.615+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7840aca80 con 0x7ff78406e950 2023-10-14T19:10:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.616+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff77801e460 con 0x7ff78406e950 2023-10-14T19:10:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.616+0000 7ff7727fc700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff764067320 0x7ff7640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.616+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5111+0+0 (secure 0 0 0) 0x7ff778085040 con 0x7ff78406e950 2023-10-14T19:10:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.616+0000 7ff78259c700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff764067320 0x7ff7640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.617+0000 7ff78259c700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff764067320 0x7ff7640697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff774009160 tx=0x7ff774016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.621+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7840aca80 con 0x7ff78406e950 2023-10-14T19:10:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.814+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff7840aca80 con 0x7ff78406e950 2023-10-14T19:10:07.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.817+0000 7ff7727fc700 1 -- 172.21.15.7:0/3838666698 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7840aca80 con 0x7ff78406e950 2023-10-14T19:10:07.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff764067320 msgr2=0x7ff7640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff764067320 0x7ff7640697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff774009160 tx=0x7ff774016000 comp rx=0 tx=0).stop 2023-10-14T19:10:07.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 msgr2=0x7ff7840b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 0x7ff7840b2240 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff77800d890 tx=0x7ff778008040 comp rx=0 tx=0).stop 2023-10-14T19:10:07.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 shutdown_connections 2023-10-14T19:10:07.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff764067320 0x7ff7640697d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7841597e0 0x7ff78414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78406c6a0 0x7ff7840af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 --2- 172.21.15.7:0/3838666698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78406e950 0x7ff7840b2240 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 >> 172.21.15.7:0/3838666698 conn(0x7ff7840ccb60 msgr2=0x7ff78406f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 shutdown_connections 2023-10-14T19:10:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.819+0000 7ff788cc3700 1 -- 172.21.15.7:0/3838666698 wait complete. 2023-10-14T19:10:07.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-14T19:10:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.951+0000 7f232f59e700 1 Processor -- start 2023-10-14T19:10:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.951+0000 7f232f59e700 1 -- start start 2023-10-14T19:10:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2330153c30 0x7f233015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f233015de50 0x7f23300cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232f59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233015afd0 con 0x7f23300cef40 2023-10-14T19:10:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232f59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233015b2b0 con 0x7f2330153c30 2023-10-14T19:10:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233015b590 con 0x7f233015de50 2023-10-14T19:10:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2330153c30 0x7f233015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2330153c30 0x7f233015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44298/0 (socket says 172.21.15.7:44298) 2023-10-14T19:10:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232e59c700 1 -- 172.21.15.7:0/3680140915 learned_addr learned my addr 172.21.15.7:0/3680140915 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.952+0000 7f232dd9b700 1 --2- 172.21.15.7:0/3680140915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f233015de50 0x7f23300cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232e59c700 1 -- 172.21.15.7:0/3680140915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f233015de50 msgr2=0x7f23300cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232e59c700 1 --2- 172.21.15.7:0/3680140915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f233015de50 0x7f23300cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232e59c700 1 -- 172.21.15.7:0/3680140915 >> v1:172.21.15.148:6789/0 conn(0x7f23300cef40 legacy=0x7f233006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232e59c700 1 -- 172.21.15.7:0/3680140915 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233015b870 con 0x7f2330153c30 2023-10-14T19:10:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232e59c700 1 --2- 172.21.15.7:0/3680140915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f233015a5e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f23280099b0 tx=0x7f2328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2d16abeda3f5d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232d59a700 1 -- 172.21.15.7:0/3680140915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800b860 con 0x7f2330153c30 2023-10-14T19:10:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232d59a700 1 -- 172.21.15.7:0/3680140915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232800b9c0 con 0x7f2330153c30 2023-10-14T19:10:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232d59a700 1 -- 172.21.15.7:0/3680140915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800bd60 con 0x7f2330153c30 2023-10-14T19:10:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232f59e700 1 -- 172.21.15.7:0/3680140915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 msgr2=0x7f233015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.953+0000 7f232f59e700 1 --2- 172.21.15.7:0/3680140915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f233015a5e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f23280099b0 tx=0x7f2328009250 comp rx=0 tx=0).stop 2023-10-14T19:10:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.954+0000 7f232f59e700 1 -- 172.21.15.7:0/3680140915 shutdown_connections 2023-10-14T19:10:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.954+0000 7f232f59e700 1 --2- 172.21.15.7:0/3680140915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f233015a5e0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.954+0000 7f232f59e700 1 --2- 172.21.15.7:0/3680140915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f233015de50 0x7f23300cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.954+0000 7f232f59e700 1 -- 172.21.15.7:0/3680140915 >> 172.21.15.7:0/3680140915 conn(0x7f23300703a0 msgr2=0x7f23300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.954+0000 7f232f59e700 1 -- 172.21.15.7:0/3680140915 shutdown_connections 2023-10-14T19:10:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.954+0000 7f232f59e700 1 -- 172.21.15.7:0/3680140915 wait complete. 2023-10-14T19:10:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.955+0000 7f232f59e700 1 Processor -- start 2023-10-14T19:10:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.955+0000 7f232f59e700 1 -- start start 2023-10-14T19:10:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.955+0000 7f232f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23300cef40 0x7f233015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.955+0000 7f232f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f23300b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f233015de50 0x7f2330140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232f59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300b4660 con 0x7f2330153c30 2023-10-14T19:10:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300b5460 con 0x7f233015de50 2023-10-14T19:10:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300b5fc0 con 0x7f23300cef40 2023-10-14T19:10:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f23300b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f23300b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44300/0 (socket says 172.21.15.7:44300) 2023-10-14T19:10:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 -- 172.21.15.7:0/1004205356 learned_addr learned my addr 172.21.15.7:0/1004205356 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232e59c700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23300cef40 0x7f233015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232ed9d700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f233015de50 0x7f2330140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 -- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23300cef40 msgr2=0x7f233015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23300cef40 0x7f233015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 -- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f233015de50 msgr2=0x7f2330140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f233015de50 0x7f2330140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 -- 172.21.15.7:0/1004205356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280094f0 con 0x7f2330153c30 2023-10-14T19:10:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232dd9b700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f23300b3310 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f231800d890 tx=0x7f2318008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180125f0 con 0x7f2330153c30 2023-10-14T19:10:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318012750 con 0x7f2330153c30 2023-10-14T19:10:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23300b4850 con 0x7f2330153c30 2023-10-14T19:10:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318012af0 con 0x7f2330153c30 2023-10-14T19:10:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.956+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23300b50f0 con 0x7f2330153c30 2023-10-14T19:10:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.957+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23300b55f0 con 0x7f2330153c30 2023-10-14T19:10:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.958+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f231801e460 con 0x7f2330153c30 2023-10-14T19:10:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.958+0000 7f23267fc700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2310067320 0x7f23100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.958+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f2318084f50 con 0x7f2330153c30 2023-10-14T19:10:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.958+0000 7f232e59c700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2310067320 0x7f23100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.959+0000 7f232e59c700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2310067320 0x7f23100697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23280099b0 tx=0x7f2328017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:07.962+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2318051e30 con 0x7f2330153c30 2023-10-14T19:10:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.235+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7f233004c3c0 con 0x7f2330153c30 2023-10-14T19:10:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.458+0000 7f23267fc700 1 -- 172.21.15.7:0/1004205356 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v343) v1 ==== 131+0+0 (secure 0 0 0) 0x7f2318055450 con 0x7f2330153c30 2023-10-14T19:10:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2310067320 msgr2=0x7f23100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2310067320 0x7f23100697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23280099b0 tx=0x7f2328017000 comp rx=0 tx=0).stop 2023-10-14T19:10:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 msgr2=0x7f23300b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f23300b3310 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f231800d890 tx=0x7f2318008040 comp rx=0 tx=0).stop 2023-10-14T19:10:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 shutdown_connections 2023-10-14T19:10:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2310067320 0x7f23100697d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f233015de50 0x7f2330140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23300cef40 0x7f233015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 --2- 172.21.15.7:0/1004205356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2330153c30 0x7f23300b3310 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 >> 172.21.15.7:0/1004205356 conn(0x7f23300703a0 msgr2=0x7f23300c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 shutdown_connections 2023-10-14T19:10:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.461+0000 7f232f59e700 1 -- 172.21.15.7:0/1004205356 wait complete. 2023-10-14T19:10:08.473 INFO:tasks.cephfs_test_runner:That the existing and the newly created volumes can be listed and ... ok 2023-10-14T19:10:08.474 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) That volume, its file system and pools, can be renamed. 2023-10-14T19:10:08.474 INFO:tasks.cephfs_test_runner:test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:10:08.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-14T19:10:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.594+0000 7f1bf46fc700 1 Processor -- start 2023-10-14T19:10:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 -- start start 2023-10-14T19:10:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a8be0 0x7f1bec0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1bec06d280 0x7f1bec0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1bec0ae780 0x7f1bec0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec0af140 con 0x7f1bec06d280 2023-10-14T19:10:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec0ce1a0 con 0x7f1bec0ae780 2023-10-14T19:10:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.595+0000 7f1bf46fc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0cd5d0 con 0x7f1bec0a8be0 2023-10-14T19:10:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1bec06d280 0x7f1bec0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1bec06d280 0x7f1bec0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44310/0 (socket says 172.21.15.7:44310) 2023-10-14T19:10:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 -- 172.21.15.7:0/2572289638 learned_addr learned my addr 172.21.15.7:0/2572289638 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf2498700 1 --2- 172.21.15.7:0/2572289638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a8be0 0x7f1bec0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf2c99700 1 --2- 172.21.15.7:0/2572289638 >> v2:172.21.15.148:3300/0 conn(0x7f1bec0ae780 0x7f1bec0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 -- 172.21.15.7:0/2572289638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a8be0 msgr2=0x7f1bec0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 --2- 172.21.15.7:0/2572289638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a8be0 0x7f1bec0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 -- 172.21.15.7:0/2572289638 >> v2:172.21.15.148:3300/0 conn(0x7f1bec0ae780 msgr2=0x7f1bec0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 --2- 172.21.15.7:0/2572289638 >> v2:172.21.15.148:3300/0 conn(0x7f1bec0ae780 0x7f1bec0aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 -- 172.21.15.7:0/2572289638 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0cd870 con 0x7f1bec06d280 2023-10-14T19:10:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1c97700 1 --2- 172.21.15.7:0/2572289638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec06d280 0x7f1bec0b08c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1bec065140 tx=0x7f1be0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce95c20a59a9862 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1496700 1 -- 172.21.15.7:0/2572289638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0005c10 con 0x7f1bec06d280 2023-10-14T19:10:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1496700 1 -- 172.21.15.7:0/2572289638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0005d70 con 0x7f1bec06d280 2023-10-14T19:10:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.596+0000 7f1bf1496700 1 -- 172.21.15.7:0/2572289638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0006260 con 0x7f1bec06d280 2023-10-14T19:10:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 -- 172.21.15.7:0/2572289638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec06d280 msgr2=0x7f1bec0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/2572289638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec06d280 0x7f1bec0b08c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1bec065140 tx=0x7f1be0009220 comp rx=0 tx=0).stop 2023-10-14T19:10:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 -- 172.21.15.7:0/2572289638 shutdown_connections 2023-10-14T19:10:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/2572289638 >> v2:172.21.15.148:3300/0 conn(0x7f1bec0ae780 0x7f1bec0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/2572289638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a8be0 0x7f1bec0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/2572289638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec06d280 0x7f1bec0b08c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 -- 172.21.15.7:0/2572289638 >> 172.21.15.7:0/2572289638 conn(0x7f1bec06ce80 msgr2=0x7f1bec0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 -- 172.21.15.7:0/2572289638 shutdown_connections 2023-10-14T19:10:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.597+0000 7f1bf46fc700 1 -- 172.21.15.7:0/2572289638 wait complete. 2023-10-14T19:10:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.598+0000 7f1bf46fc700 1 Processor -- start 2023-10-14T19:10:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.598+0000 7f1bf46fc700 1 -- start start 2023-10-14T19:10:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf46fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec06d280 0x7f1bec0a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf46fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec0a8be0 0x7f1bec0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf46fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 0x7f1bec09b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf46fc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0c4920 con 0x7f1bec0ae780 2023-10-14T19:10:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf46fc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0c3a30 con 0x7f1bec0a8be0 2023-10-14T19:10:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf46fc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0aab40 con 0x7f1bec06d280 2023-10-14T19:10:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 0x7f1bec09b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 0x7f1bec09b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44312/0 (socket says 172.21.15.7:44312) 2023-10-14T19:10:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 -- 172.21.15.7:0/3083469816 learned_addr learned my addr 172.21.15.7:0/3083469816 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf1c97700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec0a8be0 0x7f1bec0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2498700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec06d280 0x7f1bec0a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 -- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec06d280 msgr2=0x7f1bec0a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec06d280 0x7f1bec0a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 -- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec0a8be0 msgr2=0x7f1bec0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec0a8be0 0x7f1bec0ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 -- 172.21.15.7:0/3083469816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0009480 con 0x7f1bec0ae780 2023-10-14T19:10:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf1c97700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec0a8be0 0x7f1bec0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.599+0000 7f1bf2c99700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 0x7f1bec09b670 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009e90 tx=0x7f1bdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.600+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00cbc0 con 0x7f1bec0ae780 2023-10-14T19:10:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.600+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00f040 con 0x7f1bec0ae780 2023-10-14T19:10:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.600+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec159630 con 0x7f1bec0ae780 2023-10-14T19:10:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.600+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc014480 con 0x7f1bec0ae780 2023-10-14T19:10:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.600+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec0aadd0 con 0x7f1bec0ae780 2023-10-14T19:10:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.601+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec04c3c0 con 0x7f1bec0ae780 2023-10-14T19:10:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.601+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1bdc014830 con 0x7f1bec0ae780 2023-10-14T19:10:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.601+0000 7f1bea7fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1bd8067320 0x7f1bd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.601+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f1bdc0854c0 con 0x7f1bec0ae780 2023-10-14T19:10:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.602+0000 7f1bf2498700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1bd8067320 0x7f1bd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.602+0000 7f1bf2498700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1bd8067320 0x7f1bd80697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009ca0 tx=0x7f1be4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.606+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bdc055da0 con 0x7f1bec0ae780 2023-10-14T19:10:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:08.877+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f1bec0ab0f0 con 0x7f1bec0ae780 2023-10-14T19:10:09.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.460+0000 7f1bea7fc700 1 -- 172.21.15.7:0/3083469816 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v344) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1bdc055930 con 0x7f1bec0ae780 2023-10-14T19:10:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1bd8067320 msgr2=0x7f1bd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1bd8067320 0x7f1bd80697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009ca0 tx=0x7f1be4008040 comp rx=0 tx=0).stop 2023-10-14T19:10:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 msgr2=0x7f1bec09b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 0x7f1bec09b670 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009e90 tx=0x7f1bdc00b040 comp rx=0 tx=0).stop 2023-10-14T19:10:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 shutdown_connections 2023-10-14T19:10:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1bd8067320 0x7f1bd80697d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bec0ae780 0x7f1bec09b670 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec06d280 0x7f1bec0a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 --2- 172.21.15.7:0/3083469816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec0a8be0 0x7f1bec0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 >> 172.21.15.7:0/3083469816 conn(0x7f1bec06ce80 msgr2=0x7f1bec0b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:09.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 shutdown_connections 2023-10-14T19:10:09.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.463+0000 7f1bf46fc700 1 -- 172.21.15.7:0/3083469816 wait complete. 2023-10-14T19:10:09.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:10:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.602+0000 7f43cde94700 1 Processor -- start 2023-10-14T19:10:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.602+0000 7f43cde94700 1 -- start start 2023-10-14T19:10:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43cde94700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f43c81598c0 0x7f43c80c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43cde94700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43c80c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43cde94700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c80c9310 con 0x7f43c80cd460 2023-10-14T19:10:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43cde94700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80ad990 con 0x7f43c81598c0 2023-10-14T19:10:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43cde94700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80ce090 con 0x7f43c8159c90 2023-10-14T19:10:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43c7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43c80cd460 0x7f43c80cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58500/0 (socket says 172.21.15.7:58500) 2023-10-14T19:10:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43c7fff700 1 -- 172.21.15.7:0/47327320 learned_addr learned my addr 172.21.15.7:0/47327320 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43c6ffd700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43c80c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.603+0000 7f43c77fe700 1 --2- 172.21.15.7:0/47327320 >> v2:172.21.15.148:3300/0 conn(0x7f43c81598c0 0x7f43c80c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703771847 0 0) 0x7f43c80c9310 con 0x7f43c80cd460 2023-10-14T19:10:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b4003570 con 0x7f43c80cd460 2023-10-14T19:10:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1439992310 0 0) 0x7f43b4003570 con 0x7f43c80cd460 2023-10-14T19:10:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 msgr2=0x7f43c80c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43c80c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 >> v2:172.21.15.148:3300/0 conn(0x7f43c81598c0 msgr2=0x7f43c80c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 --2- 172.21.15.7:0/47327320 >> v2:172.21.15.148:3300/0 conn(0x7f43c81598c0 0x7f43c80c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80c8cc0 con 0x7f43c80cd460 2023-10-14T19:10:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f43b8001470 con 0x7f43c80cd460 2023-10-14T19:10:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 >> v1:172.21.15.7:6789/0 conn(0x7f43c80cd460 legacy=0x7f43c80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b4004810 0x7f43b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80ad990 con 0x7f43b4003a60 2023-10-14T19:10:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80ce090 con 0x7f43b4004810 2023-10-14T19:10:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b400ba60 con 0x7f43c8159c90 2023-10-14T19:10:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c6ffd700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b4004810 0x7f43b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c7fff700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 -- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 msgr2=0x7f43b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 -- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b4004810 msgr2=0x7f43b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b4004810 0x7f43b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 -- 172.21.15.7:0/47327320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4003570 con 0x7f43b4003a60 2023-10-14T19:10:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c7fff700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8159c90 0x7f43b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.604+0000 7f43c77fe700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43b4003e70 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f43c000e240 tx=0x7f43c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fce7f7bbd2c31f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000eaf0 con 0x7f43b4003a60 2023-10-14T19:10:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000f040 con 0x7f43b4003a60 2023-10-14T19:10:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43c67fc700 1 -- 172.21.15.7:0/47327320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000eea0 con 0x7f43b4003a60 2023-10-14T19:10:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43cde94700 1 -- 172.21.15.7:0/47327320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 msgr2=0x7f43b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43cde94700 1 --2- 172.21.15.7:0/47327320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43b4003e70 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f43c000e240 tx=0x7f43c000b040 comp rx=0 tx=0).stop 2023-10-14T19:10:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43c7fff700 1 -- 172.21.15.7:0/47327320 reap_dead start 2023-10-14T19:10:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43cde94700 1 -- 172.21.15.7:0/47327320 shutdown_connections 2023-10-14T19:10:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43cde94700 1 -- 172.21.15.7:0/47327320 >> 172.21.15.7:0/47327320 conn(0x7f43c8088000 msgr2=0x7f43c80883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43cde94700 1 -- 172.21.15.7:0/47327320 shutdown_connections 2023-10-14T19:10:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.605+0000 7f43cde94700 1 -- 172.21.15.7:0/47327320 wait complete. 2023-10-14T19:10:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.606+0000 7f43cde94700 1 Processor -- start 2023-10-14T19:10:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.606+0000 7f43cde94700 1 -- start start 2023-10-14T19:10:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43cde94700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43c8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43cde94700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c80b26e0 0x7f43c8150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43cde94700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8069310 0x7f43c80697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43cde94700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8069cf0 con 0x7f43b4003a60 2023-10-14T19:10:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43cde94700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80b2250 con 0x7f43c80b26e0 2023-10-14T19:10:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43cde94700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80b1640 con 0x7f43c8069310 2023-10-14T19:10:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43c77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43c8158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43c77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43c8158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44338/0 (socket says 172.21.15.7:44338) 2023-10-14T19:10:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43c77fe700 1 -- 172.21.15.7:0/641567044 learned_addr learned my addr 172.21.15.7:0/641567044 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43c7fff700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8069310 0x7f43c80697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.607+0000 7f43c6ffd700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c80b26e0 0x7f43c8150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c77fe700 1 -- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8069310 msgr2=0x7f43c80697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c77fe700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8069310 0x7f43c80697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c77fe700 1 -- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c80b26e0 msgr2=0x7f43c8150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c77fe700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c80b26e0 0x7f43c8150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c77fe700 1 -- 172.21.15.7:0/641567044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80b1920 con 0x7f43b4003a60 2023-10-14T19:10:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c7fff700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8069310 0x7f43c80697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43c77fe700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43c8158970 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f43b40046d0 tx=0x7f43c001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0029480 con 0x7f43b4003a60 2023-10-14T19:10:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0022070 con 0x7f43b4003a60 2023-10-14T19:10:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0029850 con 0x7f43b4003a60 2023-10-14T19:10:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c80b1c00 con 0x7f43b4003a60 2023-10-14T19:10:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.608+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c81509b0 con 0x7f43b4003a60 2023-10-14T19:10:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.609+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c804c3c0 con 0x7f43b4003a60 2023-10-14T19:10:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.609+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f43c001d430 con 0x7f43b4003a60 2023-10-14T19:10:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.610+0000 7f43bf7fe700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43a8067320 0x7f43a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.610+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f43c0024070 con 0x7f43b4003a60 2023-10-14T19:10:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.610+0000 7f43c6ffd700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43a8067320 0x7f43a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.611+0000 7f43c6ffd700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43a8067320 0x7f43a80697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43c80b0170 tx=0x7f43b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.614+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43c00b85a0 con 0x7f43b4003a60 2023-10-14T19:10:09.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.807+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f43c80cb160 con 0x7f43b4003a60 2023-10-14T19:10:09.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.811+0000 7f43bf7fe700 1 -- 172.21.15.7:0/641567044 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43c0054190 con 0x7f43b4003a60 2023-10-14T19:10:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43a8067320 msgr2=0x7f43a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43a8067320 0x7f43a80697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43c80b0170 tx=0x7f43b0008040 comp rx=0 tx=0).stop 2023-10-14T19:10:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 msgr2=0x7f43c8158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43c8158970 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f43b40046d0 tx=0x7f43c001a000 comp rx=0 tx=0).stop 2023-10-14T19:10:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 shutdown_connections 2023-10-14T19:10:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43a8067320 0x7f43a80697d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43c8069310 0x7f43c80697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b4003a60 0x7f43c8158970 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 --2- 172.21.15.7:0/641567044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c80b26e0 0x7f43c8150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 >> 172.21.15.7:0/641567044 conn(0x7f43c8088000 msgr2=0x7f43c80c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 shutdown_connections 2023-10-14T19:10:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:09.813+0000 7f43cde94700 1 -- 172.21.15.7:0/641567044 wait complete. 2023-10-14T19:10:09.825 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:10:09.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:09.862 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:09.903 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:10:09.904 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:10:09.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.023+0000 7fa33cca9700 1 Processor -- start 2023-10-14T19:10:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.023+0000 7fa33cca9700 1 -- start start 2023-10-14T19:10:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa33cca9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa338142c00 0x7fa33806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa33cca9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa3380c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa33cca9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380ca480 con 0x7fa338142fd0 2023-10-14T19:10:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa33cca9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33815e240 con 0x7fa338142c00 2023-10-14T19:10:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa33cca9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33806b350 con 0x7fa33806bd20 2023-10-14T19:10:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa3377fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa338142c00 0x7fa33806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa337fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa338142fd0 0x7fa33806c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58510/0 (socket says 172.21.15.7:58510) 2023-10-14T19:10:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa337fff700 1 -- 172.21.15.7:0/2248333829 learned_addr learned my addr 172.21.15.7:0/2248333829 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa336ffd700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa3380c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa3377fe700 1 -- 172.21.15.7:0/2248333829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 msgr2=0x7fa3380c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa3377fe700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa3380c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa3377fe700 1 -- 172.21.15.7:0/2248333829 >> v1:172.21.15.7:6789/0 conn(0x7fa338142fd0 legacy=0x7fa33806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa3377fe700 1 -- 172.21.15.7:0/2248333829 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33815df60 con 0x7fa338142c00 2023-10-14T19:10:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa3367fc700 1 -- 172.21.15.7:0/2248333829 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922339149 0 0) 0x7fa3380ca480 con 0x7fa338142fd0 2023-10-14T19:10:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.024+0000 7fa336ffd700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa3380c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa3377fe700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa33806b7e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa3280098e0 tx=0x7fa3280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8974a450ebcf4af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa3367fc700 1 -- 172.21.15.7:0/2248333829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328009e80 con 0x7fa338142c00 2023-10-14T19:10:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa3367fc700 1 -- 172.21.15.7:0/2248333829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800b860 con 0x7fa338142c00 2023-10-14T19:10:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa3367fc700 1 -- 172.21.15.7:0/2248333829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32800bbe0 con 0x7fa338142c00 2023-10-14T19:10:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 -- 172.21.15.7:0/2248333829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 msgr2=0x7fa33806b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa33806b7e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa3280098e0 tx=0x7fa3280091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 -- 172.21.15.7:0/2248333829 shutdown_connections 2023-10-14T19:10:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa33806b7e0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 --2- 172.21.15.7:0/2248333829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa3380c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 -- 172.21.15.7:0/2248333829 >> 172.21.15.7:0/2248333829 conn(0x7fa3380675a0 msgr2=0x7fa3380679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 -- 172.21.15.7:0/2248333829 shutdown_connections 2023-10-14T19:10:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.025+0000 7fa33cca9700 1 -- 172.21.15.7:0/2248333829 wait complete. 2023-10-14T19:10:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 Processor -- start 2023-10-14T19:10:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 -- start start 2023-10-14T19:10:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa338158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa3380c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa338142fd0 0x7fa3380b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c6790 con 0x7fa338142c00 2023-10-14T19:10:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c5e60 con 0x7fa338142fd0 2023-10-14T19:10:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa33cca9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c6140 con 0x7fa33806bd20 2023-10-14T19:10:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa3380c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa3380c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44358/0 (socket says 172.21.15.7:44358) 2023-10-14T19:10:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.027+0000 7fa336ffd700 1 -- 172.21.15.7:0/4287927361 learned_addr learned my addr 172.21.15.7:0/4287927361 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa3377fe700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa338158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa337fff700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa338142fd0 0x7fa3380b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa336ffd700 1 -- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 msgr2=0x7fa338158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa336ffd700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa338158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa336ffd700 1 -- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa338142fd0 msgr2=0x7fa3380b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa336ffd700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa338142fd0 0x7fa3380b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa336ffd700 1 -- 172.21.15.7:0/4287927361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009420 con 0x7fa338142c00 2023-10-14T19:10:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa3377fe700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa338158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa337fff700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa338142fd0 0x7fa3380b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa336ffd700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa3380c6c20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c830 tx=0x7fa32c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c011600 con 0x7fa338142c00 2023-10-14T19:10:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c011760 con 0x7fa338142c00 2023-10-14T19:10:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380c6420 con 0x7fa338142c00 2023-10-14T19:10:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c011b20 con 0x7fa338142c00 2023-10-14T19:10:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.028+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3380c7160 con 0x7fa338142c00 2023-10-14T19:10:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.029+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3380c5fa0 con 0x7fa338142c00 2023-10-14T19:10:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.030+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa32c00a3e0 con 0x7fa338142c00 2023-10-14T19:10:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.030+0000 7fa31f7fe700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa324067320 0x7fa3240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.030+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fa32c084ff0 con 0x7fa338142c00 2023-10-14T19:10:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.030+0000 7fa3377fe700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa324067320 0x7fa3240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.031+0000 7fa3377fe700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa324067320 0x7fa3240697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa328003080 tx=0x7fa328017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.034+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3380c5fa0 con 0x7fa338142c00 2023-10-14T19:10:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.272+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3380c5fa0 con 0x7fa338142c00 2023-10-14T19:10:10.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.273+0000 7fa31f7fe700 1 -- 172.21.15.7:0/4287927361 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fa32c01fde0 con 0x7fa338142c00 2023-10-14T19:10:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:10.273 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/438880610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":438880610},{"type":"v1","addr":"172.21.15.148:6836","nonce":438880610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":6754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2658859369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2658859369},{"type":"v1","addr":"172.21.15.148:6837","nonce":2658859369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/713445110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":713445110},{"type":"v1","addr":"172.21.15.7:6834","nonce":713445110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7434,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1931924765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1931924765},{"type":"v1","addr":"172.21.15.7:6835","nonce":1931924765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[]} 2023-10-14T19:10:10.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.274+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa324067320 msgr2=0x7fa3240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.274+0000 7fa33cca9700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa324067320 0x7fa3240697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa328003080 tx=0x7fa328017000 comp rx=0 tx=0).stop 2023-10-14T19:10:10.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.274+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 msgr2=0x7fa3380c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.274+0000 7fa33cca9700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa3380c6c20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c830 tx=0x7fa32c008040 comp rx=0 tx=0).stop 2023-10-14T19:10:10.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 shutdown_connections 2023-10-14T19:10:10.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa324067320 0x7fa3240697d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa338142fd0 0x7fa3380b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa33806bd20 0x7fa338158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 --2- 172.21.15.7:0/4287927361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa338142c00 0x7fa3380c6c20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 >> 172.21.15.7:0/4287927361 conn(0x7fa3380675a0 msgr2=0x7fa338141c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:10.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 shutdown_connections 2023-10-14T19:10:10.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.275+0000 7fa33cca9700 1 -- 172.21.15.7:0/4287927361 wait complete. 2023-10-14T19:10:10.277 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 85 2023-10-14T19:10:10.287 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:10:10.287 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:10:10.288 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:10:10.288 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:10.288 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:10:10.289 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:10:10.289 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:10:10.289 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:10.289 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:10:10.290 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:10:10.290 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:10:10.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:10.291 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:10:10.291 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:10:10.291 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:10:10.291 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:10.296 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:10:10.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:10:10.297 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:10:10.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:10:10.301 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:10:10.301 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:10:10.302 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:10:10.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:10:10.340 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:10:10.340 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:10.341 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:10:10.341 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:10.344 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:10:10.344 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:10.345 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:10:10.345 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:10.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:10:10.415 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:10:10.416 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:10:10.427 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:10:10.427 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:10:10.428 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-10-14T19:10:10.427+0000 7fd6097c1700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T19:10:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.473+0000 7f3ef6ae3700 1 Processor -- start 2023-10-14T19:10:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.473+0000 7f3ef6ae3700 1 -- start start 2023-10-14T19:10:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef6ae3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ef00cb970 0x7f3ef0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef6ae3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef6ae3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef015ae40 con 0x7f3ef00cb5a0 2023-10-14T19:10:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef6ae3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00ce0f0 con 0x7f3ef00cb970 2023-10-14T19:10:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef6ae3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00d13f0 con 0x7f3ef015a400 2023-10-14T19:10:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ef00cb970 0x7f3ef0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef487f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3ef00cb5a0 0x7f3ef00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58540/0 (socket says 172.21.15.7:58540) 2023-10-14T19:10:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ef00cb970 0x7f3ef0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44396/0 (socket says 172.21.15.7:44396) 2023-10-14T19:10:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef487f700 1 -- 172.21.15.7:0/914331021 learned_addr learned my addr 172.21.15.7:0/914331021 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3ef5080700 1 --2- 172.21.15.7:0/914331021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 -- 172.21.15.7:0/914331021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 msgr2=0x7f3ef0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 --2- 172.21.15.7:0/914331021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 -- 172.21.15.7:0/914331021 >> v1:172.21.15.7:6789/0 conn(0x7f3ef00cb5a0 legacy=0x7f3ef00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 -- 172.21.15.7:0/914331021 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef015ab60 con 0x7f3ef00cb970 2023-10-14T19:10:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eef7fe700 1 -- 172.21.15.7:0/914331021 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914737573 0 0) 0x7f3ef015ae40 con 0x7f3ef00cb5a0 2023-10-14T19:10:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eeffff700 1 --2- 172.21.15.7:0/914331021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0159ec0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0098e0 tx=0x7f3edc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332b8f4894ea3c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:10.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eef7fe700 1 -- 172.21.15.7:0/914331021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00b640 con 0x7f3ef00cb970 2023-10-14T19:10:10.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eef7fe700 1 -- 172.21.15.7:0/914331021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00b7a0 con 0x7f3ef00cb970 2023-10-14T19:10:10.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.474+0000 7f3eef7fe700 1 -- 172.21.15.7:0/914331021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00bb40 con 0x7f3ef00cb970 2023-10-14T19:10:10.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/914331021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 msgr2=0x7f3ef0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/914331021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0159ec0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0098e0 tx=0x7f3edc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/914331021 shutdown_connections 2023-10-14T19:10:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/914331021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/914331021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0159ec0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/914331021 >> 172.21.15.7:0/914331021 conn(0x7f3ef0070e30 msgr2=0x7f3ef00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/914331021 shutdown_connections 2023-10-14T19:10:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.475+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/914331021 wait complete. 2023-10-14T19:10:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.476+0000 7f3ef6ae3700 1 Processor -- start 2023-10-14T19:10:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.476+0000 7f3ef6ae3700 1 -- start start 2023-10-14T19:10:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef6ae3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ef00cb5a0 0x7f3ef015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef6ae3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef6ae3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef6ae3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef015dec0 con 0x7f3ef00cb970 2023-10-14T19:10:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef6ae3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef015d4f0 con 0x7f3ef00cb5a0 2023-10-14T19:10:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef6ae3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0158430 con 0x7f3ef015a400 2023-10-14T19:10:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44406/0 (socket says 172.21.15.7:44406) 2023-10-14T19:10:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 -- 172.21.15.7:0/390813593 learned_addr learned my addr 172.21.15.7:0/390813593 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef5080700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3ef487f700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ef00cb5a0 0x7f3ef015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 -- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 msgr2=0x7f3ef01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 -- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ef00cb5a0 msgr2=0x7f3ef015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ef00cb5a0 0x7f3ef015d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.477+0000 7f3eeffff700 1 -- 172.21.15.7:0/390813593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009420 con 0x7f3ef00cb970 2023-10-14T19:10:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.478+0000 7f3eeffff700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0157be0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3ef006ea60 tx=0x7f3edc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.478+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00bb20 con 0x7f3ef00cb970 2023-10-14T19:10:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.478+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc011420 con 0x7f3ef00cb970 2023-10-14T19:10:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.478+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef015cbc0 con 0x7f3ef00cb970 2023-10-14T19:10:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.478+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0117a0 con 0x7f3ef00cb970 2023-10-14T19:10:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.478+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef015d180 con 0x7f3ef00cb970 2023-10-14T19:10:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.479+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef015d660 con 0x7f3ef00cb970 2023-10-14T19:10:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.479+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3edc011b10 con 0x7f3ef00cb970 2023-10-14T19:10:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.480+0000 7f3eecff9700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ed4067320 0x7f3ed40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.480+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f3edc086120 con 0x7f3ef00cb970 2023-10-14T19:10:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.480+0000 7f3ef487f700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ed4067320 0x7f3ed40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.480+0000 7f3ef487f700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ed4067320 0x7f3ed40697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40011e0 tx=0x7f3ee4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:10.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.484+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3edc053000 con 0x7f3ef00cb970 2023-10-14T19:10:10.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:10.690+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3ef004c3c0 con 0x7f3ef00cb970 2023-10-14T19:10:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.473+0000 7f3eecff9700 1 -- 172.21.15.7:0/390813593 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3edc056620 con 0x7f3ef00cb970 2023-10-14T19:10:11.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ed4067320 msgr2=0x7f3ed40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ed4067320 0x7f3ed40697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40011e0 tx=0x7f3ee4009040 comp rx=0 tx=0).stop 2023-10-14T19:10:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 msgr2=0x7f3ef0157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0157be0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3ef006ea60 tx=0x7f3edc017000 comp rx=0 tx=0).stop 2023-10-14T19:10:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 shutdown_connections 2023-10-14T19:10:11.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ed4067320 0x7f3ed40697d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ef00cb5a0 0x7f3ef015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ef015a400 0x7f3ef01555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 --2- 172.21.15.7:0/390813593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef00cb970 0x7f3ef0157be0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 >> 172.21.15.7:0/390813593 conn(0x7f3ef0070e30 msgr2=0x7f3ef00b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 shutdown_connections 2023-10-14T19:10:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.476+0000 7f3ef6ae3700 1 -- 172.21.15.7:0/390813593 wait complete. 2023-10-14T19:10:11.478 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:10:11.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:10:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.617+0000 7f3785f6f700 1 Processor -- start 2023-10-14T19:10:11.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.617+0000 7f3785f6f700 1 -- start start 2023-10-14T19:10:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f3785f6f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37800aee90 0x7f37800a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f3785f6f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f378006d280 0x7f37800b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f3785f6f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800ce1a0 con 0x7f37800a8be0 2023-10-14T19:10:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f3785f6f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800cd5d0 con 0x7f378006d280 2023-10-14T19:10:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f3785f6f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800cd870 con 0x7f37800aee90 2023-10-14T19:10:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f377f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37800a8be0 0x7f37800ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58550/0 (socket says 172.21.15.7:58550) 2023-10-14T19:10:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f377f7fe700 1 -- 172.21.15.7:0/1083264718 learned_addr learned my addr 172.21.15.7:0/1083264718 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.618+0000 7f377ffff700 1 --2- 172.21.15.7:0/1083264718 >> v2:172.21.15.7:3300/0 conn(0x7f378006d280 0x7f37800b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377e7fc700 1 -- 172.21.15.7:0/1083264718 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615823596 0 0) 0x7f37800ce1a0 con 0x7f37800a8be0 2023-10-14T19:10:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377e7fc700 1 -- 172.21.15.7:0/1083264718 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3768003570 con 0x7f37800a8be0 2023-10-14T19:10:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377effd700 1 --2- 172.21.15.7:0/1083264718 >> v2:172.21.15.148:3300/0 conn(0x7f37800aee90 0x7f37800a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377ffff700 1 -- 172.21.15.7:0/1083264718 >> v2:172.21.15.148:3300/0 conn(0x7f37800aee90 msgr2=0x7f37800a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377ffff700 1 --2- 172.21.15.7:0/1083264718 >> v2:172.21.15.148:3300/0 conn(0x7f37800aee90 0x7f37800a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377ffff700 1 -- 172.21.15.7:0/1083264718 >> v1:172.21.15.7:6789/0 conn(0x7f37800a8be0 legacy=0x7f37800ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377ffff700 1 -- 172.21.15.7:0/1083264718 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800cdb50 con 0x7f378006d280 2023-10-14T19:10:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377effd700 1 --2- 172.21.15.7:0/1083264718 >> v2:172.21.15.148:3300/0 conn(0x7f37800aee90 0x7f37800a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377ffff700 1 --2- 172.21.15.7:0/1083264718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f378006d280 0x7f37800b08c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f37800b0f60 tx=0x7f3778009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f562c8607ffb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377e7fc700 1 -- 172.21.15.7:0/1083264718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800e070 con 0x7f378006d280 2023-10-14T19:10:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377e7fc700 1 -- 172.21.15.7:0/1083264718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800bbf0 con 0x7f378006d280 2023-10-14T19:10:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f377e7fc700 1 -- 172.21.15.7:0/1083264718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778012430 con 0x7f378006d280 2023-10-14T19:10:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.619+0000 7f3785f6f700 1 -- 172.21.15.7:0/1083264718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f378006d280 msgr2=0x7f37800b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 --2- 172.21.15.7:0/1083264718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f378006d280 0x7f37800b08c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f37800b0f60 tx=0x7f3778009780 comp rx=0 tx=0).stop 2023-10-14T19:10:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 -- 172.21.15.7:0/1083264718 shutdown_connections 2023-10-14T19:10:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 --2- 172.21.15.7:0/1083264718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f378006d280 0x7f37800b08c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 --2- 172.21.15.7:0/1083264718 >> v2:172.21.15.148:3300/0 conn(0x7f37800aee90 0x7f37800a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 -- 172.21.15.7:0/1083264718 >> 172.21.15.7:0/1083264718 conn(0x7f378006ce80 msgr2=0x7f37800ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 -- 172.21.15.7:0/1083264718 shutdown_connections 2023-10-14T19:10:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.620+0000 7f3785f6f700 1 -- 172.21.15.7:0/1083264718 wait complete. 2023-10-14T19:10:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.621+0000 7f3785f6f700 1 Processor -- start 2023-10-14T19:10:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.621+0000 7f3785f6f700 1 -- start start 2023-10-14T19:10:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378006d280 0x7f3780099e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37800a8be0 0x7f378006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 0x7f37800abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378009a370 con 0x7f37800aee90 2023-10-14T19:10:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378006e870 con 0x7f37800a8be0 2023-10-14T19:10:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378006e260 con 0x7f378006d280 2023-10-14T19:10:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 0x7f37800abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 0x7f37800abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44430/0 (socket says 172.21.15.7:44430) 2023-10-14T19:10:11.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 -- 172.21.15.7:0/3197335158 learned_addr learned my addr 172.21.15.7:0/3197335158 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:11.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377f7fe700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378006d280 0x7f3780099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:11.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377effd700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37800a8be0 0x7f378006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:11.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 -- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378006d280 msgr2=0x7f3780099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378006d280 0x7f3780099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 -- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37800a8be0 msgr2=0x7f378006ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37800a8be0 0x7f378006ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 -- 172.21.15.7:0/3197335158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009a20 con 0x7f37800aee90 2023-10-14T19:10:11.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377f7fe700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378006d280 0x7f3780099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:11.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377effd700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37800a8be0 0x7f378006ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:11.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f377ffff700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 0x7f37800abf90 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3778009fd0 tx=0x7f3778019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778012e80 con 0x7f37800aee90 2023-10-14T19:10:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377801e630 con 0x7f37800aee90 2023-10-14T19:10:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378009bce0 con 0x7f37800aee90 2023-10-14T19:10:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377801e9f0 con 0x7f37800aee90 2023-10-14T19:10:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.622+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378009bfc0 con 0x7f37800aee90 2023-10-14T19:10:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.623+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378004c3c0 con 0x7f37800aee90 2023-10-14T19:10:11.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.624+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3778024070 con 0x7f37800aee90 2023-10-14T19:10:11.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.624+0000 7f37677fe700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f376c067320 0x7f376c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:11.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.624+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f37780871b0 con 0x7f37800aee90 2023-10-14T19:10:11.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.625+0000 7f377f7fe700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f376c067320 0x7f376c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:11.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.625+0000 7f377f7fe700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f376c067320 0x7f376c0697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3770001360 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:11.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.628+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3778054240 con 0x7f37800aee90 2023-10-14T19:10:11.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.900+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f378006e9b0 con 0x7f37800aee90 2023-10-14T19:10:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.900+0000 7f37677fe700 1 -- 172.21.15.7:0/3197335158 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3778057860 con 0x7f37800aee90 2023-10-14T19:10:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:11.900 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:10:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:10:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:10:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:10:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:10:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:10:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:10:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:10:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:10:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:10:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:10:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:10:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:10:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:10:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.911 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:10:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:10:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:10:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:10:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:10:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:10:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:10:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:10:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:10:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:10:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:10:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:10:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:10:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:10:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:10:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:10:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:10:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:10:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:10:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:10:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:10:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:10:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:10:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:10:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:10:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:10:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:10:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:10:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:10:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:10:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:10:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:10:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:10:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:10:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:10:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:10:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:10:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:10:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:10:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:10:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:10:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:10:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:10:11.940 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:10:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f376c067320 msgr2=0x7f376c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f376c067320 0x7f376c0697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3770001360 tx=0x7f3770009040 comp rx=0 tx=0).stop 2023-10-14T19:10:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 msgr2=0x7f37800abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 0x7f37800abf90 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3778009fd0 tx=0x7f3778019000 comp rx=0 tx=0).stop 2023-10-14T19:10:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 shutdown_connections 2023-10-14T19:10:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f376c067320 0x7f376c0697d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37800aee90 0x7f37800abf90 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378006d280 0x7f3780099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 --2- 172.21.15.7:0/3197335158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37800a8be0 0x7f378006ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 >> 172.21.15.7:0/3197335158 conn(0x7f378006ce80 msgr2=0x7f37801595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 shutdown_connections 2023-10-14T19:10:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:11.902+0000 7f3785f6f700 1 -- 172.21.15.7:0/3197335158 wait complete. 2023-10-14T19:10:11.944 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.063+0000 7f4690bfd700 1 Processor -- start 2023-10-14T19:10:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.063+0000 7f4690bfd700 1 -- start start 2023-10-14T19:10:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.064+0000 7f4690bfd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f468c0aee90 0x7f468c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.064+0000 7f4690bfd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0ce1a0 con 0x7f468c0a8be0 2023-10-14T19:10:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.064+0000 7f4690bfd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0cd5d0 con 0x7f468c06d280 2023-10-14T19:10:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.064+0000 7f4690bfd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c0cd870 con 0x7f468c0aee90 2023-10-14T19:10:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.064+0000 7f468a59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f468c0a8be0 0x7f468c0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58562/0 (socket says 172.21.15.7:58562) 2023-10-14T19:10:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.064+0000 7f468a59c700 1 -- 172.21.15.7:0/2697336519 learned_addr learned my addr 172.21.15.7:0/2697336519 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310699298 0 0) 0x7f468c0ce1a0 con 0x7f468c0a8be0 2023-10-14T19:10:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4678003570 con 0x7f468c0a8be0 2023-10-14T19:10:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f4689d9b700 1 --2- 172.21.15.7:0/2697336519 >> v2:172.21.15.148:3300/0 conn(0x7f468c0aee90 0x7f468c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569567605 0 0) 0x7f4678003570 con 0x7f468c0a8be0 2023-10-14T19:10:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 >> v2:172.21.15.148:3300/0 conn(0x7f468c0aee90 msgr2=0x7f468c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 --2- 172.21.15.7:0/2697336519 >> v2:172.21.15.148:3300/0 conn(0x7f468c0aee90 0x7f468c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 >> v1:172.21.15.148:6789/0 conn(0x7f468c06d280 legacy=0x7f468c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0cdb50 con 0x7f468c0a8be0 2023-10-14T19:10:12.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f4684001970 con 0x7f468c0a8be0 2023-10-14T19:10:12.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 >> v1:172.21.15.7:6789/0 conn(0x7f468c0a8be0 legacy=0x7f468c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4678003a60 0x7f4678003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4678004810 0x7f4678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46780052e0 0x7f467800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0cd870 con 0x7f46780052e0 2023-10-14T19:10:12.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467800c190 con 0x7f4678003a60 2023-10-14T19:10:12.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467800c350 con 0x7f4678004810 2023-10-14T19:10:12.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468ad9d700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46780052e0 0x7f467800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468a59c700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4678003a60 0x7f4678003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f4689d9b700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4678004810 0x7f4678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468ad9d700 1 -- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4678004810 msgr2=0x7f4678004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:12.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468ad9d700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4678004810 0x7f4678004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468ad9d700 1 -- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4678003a60 msgr2=0x7f4678003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:12.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.065+0000 7f468ad9d700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4678003a60 0x7f4678003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f468ad9d700 1 -- 172.21.15.7:0/2697336519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678003570 con 0x7f46780052e0 2023-10-14T19:10:12.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f468ad9d700 1 -- 172.21.15.7:0/2697336519 reap_dead start 2023-10-14T19:10:12.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f468ad9d700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46780052e0 0x7f467800ba60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f467c001880 tx=0x7f467c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2165a12628d7ac8a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c012420 con 0x7f46780052e0 2023-10-14T19:10:12.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c0125a0 con 0x7f46780052e0 2023-10-14T19:10:12.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f468959a700 1 -- 172.21.15.7:0/2697336519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c012960 con 0x7f46780052e0 2023-10-14T19:10:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 -- 172.21.15.7:0/2697336519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46780052e0 msgr2=0x7f467800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46780052e0 0x7f467800ba60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f467c001880 tx=0x7f467c007d30 comp rx=0 tx=0).stop 2023-10-14T19:10:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 -- 172.21.15.7:0/2697336519 shutdown_connections 2023-10-14T19:10:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 --2- 172.21.15.7:0/2697336519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46780052e0 0x7f467800ba60 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 -- 172.21.15.7:0/2697336519 >> 172.21.15.7:0/2697336519 conn(0x7f468c06ce80 msgr2=0x7f468c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:12.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 -- 172.21.15.7:0/2697336519 shutdown_connections 2023-10-14T19:10:12.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.066+0000 7f4690bfd700 1 -- 172.21.15.7:0/2697336519 wait complete. 2023-10-14T19:10:12.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.067+0000 7f4690bfd700 1 Processor -- start 2023-10-14T19:10:12.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 -- start start 2023-10-14T19:10:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46780052e0 0x7f468c167630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c167b70 0x7f468c068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 0x7f468c0aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1685d0 con 0x7f468c068c60 2023-10-14T19:10:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c069100 con 0x7f468c167b70 2023-10-14T19:10:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f4690bfd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c168010 con 0x7f46780052e0 2023-10-14T19:10:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f468ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 0x7f468c0aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f468ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 0x7f468c0aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44460/0 (socket says 172.21.15.7:44460) 2023-10-14T19:10:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.068+0000 7f468ad9d700 1 -- 172.21.15.7:0/372254556 learned_addr learned my addr 172.21.15.7:0/372254556 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f4689d9b700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c167b70 0x7f468c068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468a59c700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46780052e0 0x7f468c167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468ad9d700 1 -- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46780052e0 msgr2=0x7f468c167630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468ad9d700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46780052e0 0x7f468c167630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468ad9d700 1 -- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c167b70 msgr2=0x7f468c068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468ad9d700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c167b70 0x7f468c068720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468ad9d700 1 -- 172.21.15.7:0/372254556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c1682f0 con 0x7f468c068c60 2023-10-14T19:10:12.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f468ad9d700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 0x7f468c0aa0a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f468c15b5f0 tx=0x7f467c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c012420 con 0x7f468c068c60 2023-10-14T19:10:12.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c001200 con 0x7f468c068c60 2023-10-14T19:10:12.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c16add0 con 0x7f468c068c60 2023-10-14T19:10:12.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011df0 con 0x7f468c068c60 2023-10-14T19:10:12.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.069+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c0aa5e0 con 0x7f468c068c60 2023-10-14T19:10:12.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.070+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c16ac30 con 0x7f468c068c60 2023-10-14T19:10:12.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.070+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f467c01e640 con 0x7f468c068c60 2023-10-14T19:10:12.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.071+0000 7f46827fc700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f466c067320 0x7f466c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.071+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f467c085e70 con 0x7f468c068c60 2023-10-14T19:10:12.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.071+0000 7f468a59c700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f466c067320 0x7f466c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.071+0000 7f468a59c700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f466c067320 0x7f466c0697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4684001190 tx=0x7f4684009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.075+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f468c16ac30 con 0x7f468c068c60 2023-10-14T19:10:12.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.268+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f468c16b2f0 con 0x7f468c068c60 2023-10-14T19:10:12.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.269+0000 7f46827fc700 1 -- 172.21.15.7:0/372254556 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f468c16b2f0 con 0x7f468c068c60 2023-10-14T19:10:12.270 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:12.270 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":135,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:11.470527+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:12.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f466c067320 msgr2=0x7f466c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f466c067320 0x7f466c0697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4684001190 tx=0x7f4684009040 comp rx=0 tx=0).stop 2023-10-14T19:10:12.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 msgr2=0x7f468c0aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 0x7f468c0aa0a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f468c15b5f0 tx=0x7f467c015000 comp rx=0 tx=0).stop 2023-10-14T19:10:12.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 shutdown_connections 2023-10-14T19:10:12.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f466c067320 0x7f466c0697d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f468c068c60 0x7f468c0aa0a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46780052e0 0x7f468c167630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 --2- 172.21.15.7:0/372254556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c167b70 0x7f468c068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.271+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 >> 172.21.15.7:0/372254556 conn(0x7f468c06ce80 msgr2=0x7f468c0b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.272+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 shutdown_connections 2023-10-14T19:10:12.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.272+0000 7f4690bfd700 1 -- 172.21.15.7:0/372254556 wait complete. 2023-10-14T19:10:12.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:10:12.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:10:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.407+0000 7f22ae995700 1 Processor -- start 2023-10-14T19:10:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.407+0000 7f22ae995700 1 -- start start 2023-10-14T19:10:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.407+0000 7f22ae995700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22a806dc70 0x7f22a8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22ae995700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a80ccfd0 con 0x7f22a8159530 2023-10-14T19:10:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22ae995700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a815a3d0 con 0x7f22a806e0e0 2023-10-14T19:10:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22ae995700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a815a6b0 con 0x7f22a806dc70 2023-10-14T19:10:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f22a8159530 0x7f22a80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58564/0 (socket says 172.21.15.7:58564) 2023-10-14T19:10:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a7fff700 1 -- 172.21.15.7:0/1968220517 learned_addr learned my addr 172.21.15.7:0/1968220517 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a77fe700 1 --2- 172.21.15.7:0/1968220517 >> v2:172.21.15.148:3300/0 conn(0x7f22a806dc70 0x7f22a8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a6ffd700 1 -- 172.21.15.7:0/1968220517 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538511839 0 0) 0x7f22a80ccfd0 con 0x7f22a8159530 2023-10-14T19:10:12.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a6ffd700 1 -- 172.21.15.7:0/1968220517 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2290003570 con 0x7f22a8159530 2023-10-14T19:10:12.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a77fe700 1 -- 172.21.15.7:0/1968220517 >> v1:172.21.15.148:6789/0 conn(0x7f22a806e0e0 legacy=0x7f22a80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a6ffd700 1 -- 172.21.15.7:0/1968220517 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142184442 0 0) 0x7f22a815a3d0 con 0x7f22a806e0e0 2023-10-14T19:10:12.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a77fe700 1 -- 172.21.15.7:0/1968220517 >> v1:172.21.15.7:6789/0 conn(0x7f22a8159530 legacy=0x7f22a80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a77fe700 1 -- 172.21.15.7:0/1968220517 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a815a990 con 0x7f22a806dc70 2023-10-14T19:10:12.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.408+0000 7f22a77fe700 1 --2- 172.21.15.7:0/1968220517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806dc70 0x7f22a8159900 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f229c0098e0 tx=0x7f229c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950d8a03838c13f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22a6ffd700 1 -- 172.21.15.7:0/1968220517 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00b640 con 0x7f22a806dc70 2023-10-14T19:10:12.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22a6ffd700 1 -- 172.21.15.7:0/1968220517 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c00b7a0 con 0x7f22a806dc70 2023-10-14T19:10:12.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22a6ffd700 1 -- 172.21.15.7:0/1968220517 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00bb40 con 0x7f22a806dc70 2023-10-14T19:10:12.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 -- 172.21.15.7:0/1968220517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806dc70 msgr2=0x7f22a8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 --2- 172.21.15.7:0/1968220517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806dc70 0x7f22a8159900 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f229c0098e0 tx=0x7f229c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 -- 172.21.15.7:0/1968220517 shutdown_connections 2023-10-14T19:10:12.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 --2- 172.21.15.7:0/1968220517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806dc70 0x7f22a8159900 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 -- 172.21.15.7:0/1968220517 >> 172.21.15.7:0/1968220517 conn(0x7f22a80703a0 msgr2=0x7f22a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:12.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 -- 172.21.15.7:0/1968220517 shutdown_connections 2023-10-14T19:10:12.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.409+0000 7f22ae995700 1 -- 172.21.15.7:0/1968220517 wait complete. 2023-10-14T19:10:12.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.410+0000 7f22ae995700 1 Processor -- start 2023-10-14T19:10:12.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 -- start start 2023-10-14T19:10:12.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22a806dc70 0x7f22a81530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806e0e0 0x7f22a816a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 0x7f22a80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80b4f40 con 0x7f22a8159530 2023-10-14T19:10:12.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80b3480 con 0x7f22a806e0e0 2023-10-14T19:10:12.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22ae995700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80b3760 con 0x7f22a806dc70 2023-10-14T19:10:12.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22acf32700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 0x7f22a80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22acf32700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 0x7f22a80b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44462/0 (socket says 172.21.15.7:44462) 2023-10-14T19:10:12.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.411+0000 7f22acf32700 1 -- 172.21.15.7:0/735742192 learned_addr learned my addr 172.21.15.7:0/735742192 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:12.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22a77fe700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806e0e0 0x7f22a816a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22a7fff700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22a806dc70 0x7f22a81530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22acf32700 1 -- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22a806dc70 msgr2=0x7f22a81530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22acf32700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22a806dc70 0x7f22a81530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22acf32700 1 -- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806e0e0 msgr2=0x7f22a816a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22acf32700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806e0e0 0x7f22a816a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22acf32700 1 -- 172.21.15.7:0/735742192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009420 con 0x7f22a8159530 2023-10-14T19:10:12.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22acf32700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 0x7f22a80b3bf0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c8c0 tx=0x7f22a0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000ce60 con 0x7f22a8159530 2023-10-14T19:10:12.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000a7a0 con 0x7f22a8159530 2023-10-14T19:10:12.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a80b5190 con 0x7f22a8159530 2023-10-14T19:10:12.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000ab60 con 0x7f22a8159530 2023-10-14T19:10:12.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.412+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a80b5b00 con 0x7f22a8159530 2023-10-14T19:10:12.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.413+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a804c3c0 con 0x7f22a8159530 2023-10-14T19:10:12.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.413+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f22a0012420 con 0x7f22a8159530 2023-10-14T19:10:12.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.414+0000 7f228ffff700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2294067320 0x7f22940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.414+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f22a0084c20 con 0x7f22a8159530 2023-10-14T19:10:12.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.414+0000 7f22a7fff700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2294067320 0x7f22940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.414+0000 7f22a7fff700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2294067320 0x7f22940697d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f22980058d0 tx=0x7f2298009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.418+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a0051c00 con 0x7f22a8159530 2023-10-14T19:10:12.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.610+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22a80b38a0 con 0x7f22a8159530 2023-10-14T19:10:12.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.610+0000 7f228ffff700 1 -- 172.21.15.7:0/735742192 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22a0055220 con 0x7f22a8159530 2023-10-14T19:10:12.611 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:10:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2294067320 msgr2=0x7f22940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2294067320 0x7f22940697d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f22980058d0 tx=0x7f2298009040 comp rx=0 tx=0).stop 2023-10-14T19:10:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 msgr2=0x7f22a80b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 0x7f22a80b3bf0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c8c0 tx=0x7f22a0001670 comp rx=0 tx=0).stop 2023-10-14T19:10:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 shutdown_connections 2023-10-14T19:10:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2294067320 0x7f22940697d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8159530 0x7f22a80b3bf0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22a806dc70 0x7f22a81530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 --2- 172.21.15.7:0/735742192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22a806e0e0 0x7f22a816a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 >> 172.21.15.7:0/735742192 conn(0x7f22a80703a0 msgr2=0x7f22a815eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 shutdown_connections 2023-10-14T19:10:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.612+0000 7f22ae995700 1 -- 172.21.15.7:0/735742192 wait complete. 2023-10-14T19:10:12.624 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:10:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.744+0000 7fa89ddea700 1 Processor -- start 2023-10-14T19:10:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.744+0000 7fa89ddea700 1 -- start start 2023-10-14T19:10:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa89ddea700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159850 0x7fa8980adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa89ddea700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa898159c20 0x7fa8980ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa89ddea700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8980adb20 con 0x7fa8980b0930 2023-10-14T19:10:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa89ddea700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8980ccdc0 con 0x7fa898159c20 2023-10-14T19:10:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa89ddea700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980acf10 con 0x7fa898159850 2023-10-14T19:10:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa896ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa898159c20 0x7fa8980ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa897fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa8980b0930 0x7fa8980c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58570/0 (socket says 172.21.15.7:58570) 2023-10-14T19:10:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa897fff700 1 -- 172.21.15.7:0/2629501097 learned_addr learned my addr 172.21.15.7:0/2629501097 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa8977fe700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159850 0x7fa8980adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa896ffd700 1 -- 172.21.15.7:0/2629501097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159850 msgr2=0x7fa8980adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa896ffd700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159850 0x7fa8980adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa8967fc700 1 -- 172.21.15.7:0/2629501097 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823725333 0 0) 0x7fa8980adb20 con 0x7fa8980b0930 2023-10-14T19:10:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa896ffd700 1 -- 172.21.15.7:0/2629501097 >> v1:172.21.15.7:6789/0 conn(0x7fa8980b0930 legacy=0x7fa8980c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa896ffd700 1 -- 172.21.15.7:0/2629501097 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8980ad1f0 con 0x7fa898159c20 2023-10-14T19:10:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa8977fe700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159850 0x7fa8980adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.745+0000 7fa896ffd700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa898159c20 0x7fa8980ae4f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc79210436ec4b71 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa8967fc700 1 -- 172.21.15.7:0/2629501097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880009e80 con 0x7fa898159c20 2023-10-14T19:10:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa8967fc700 1 -- 172.21.15.7:0/2629501097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000b860 con 0x7fa898159c20 2023-10-14T19:10:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa8967fc700 1 -- 172.21.15.7:0/2629501097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bbe0 con 0x7fa898159c20 2023-10-14T19:10:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 -- 172.21.15.7:0/2629501097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa898159c20 msgr2=0x7fa8980ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa898159c20 0x7fa8980ae4f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 -- 172.21.15.7:0/2629501097 shutdown_connections 2023-10-14T19:10:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159850 0x7fa8980adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 --2- 172.21.15.7:0/2629501097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa898159c20 0x7fa8980ae4f0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 -- 172.21.15.7:0/2629501097 >> 172.21.15.7:0/2629501097 conn(0x7fa89806d170 msgr2=0x7fa8980cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 -- 172.21.15.7:0/2629501097 shutdown_connections 2023-10-14T19:10:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.746+0000 7fa89ddea700 1 -- 172.21.15.7:0/2629501097 wait complete. 2023-10-14T19:10:12.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.747+0000 7fa89ddea700 1 Processor -- start 2023-10-14T19:10:12.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.747+0000 7fa89ddea700 1 -- start start 2023-10-14T19:10:12.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa89ddea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 0x7fa898169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa89ddea700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa898159850 0x7fa8980c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa89ddea700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159c20 0x7fa898154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa89ddea700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980c34e0 con 0x7fa8980b0930 2023-10-14T19:10:12.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa89ddea700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980c2a10 con 0x7fa898159850 2023-10-14T19:10:12.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa89ddea700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980c2c40 con 0x7fa898159c20 2023-10-14T19:10:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 0x7fa898169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 0x7fa898169880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44468/0 (socket says 172.21.15.7:44468) 2023-10-14T19:10:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa8977fe700 1 -- 172.21.15.7:0/594420228 learned_addr learned my addr 172.21.15.7:0/594420228 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa897fff700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159c20 0x7fa898154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.748+0000 7fa896ffd700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa898159850 0x7fa8980c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa8977fe700 1 -- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159c20 msgr2=0x7fa898154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa8977fe700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159c20 0x7fa898154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa8977fe700 1 -- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa898159850 msgr2=0x7fa8980c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa8977fe700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa898159850 0x7fa8980c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa8977fe700 1 -- 172.21.15.7:0/594420228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880009420 con 0x7fa8980b0930 2023-10-14T19:10:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa897fff700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159c20 0x7fa898154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa896ffd700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa898159850 0x7fa8980c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa8977fe700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 0x7fa898169880 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c830 tx=0x7fa888008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888011600 con 0x7fa8980b0930 2023-10-14T19:10:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888011760 con 0x7fa8980b0930 2023-10-14T19:10:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8980c2f20 con 0x7fa8980b0930 2023-10-14T19:10:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888011b20 con 0x7fa8980b0930 2023-10-14T19:10:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.749+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8980c3a80 con 0x7fa8980b0930 2023-10-14T19:10:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.750+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8980c3ca0 con 0x7fa8980b0930 2023-10-14T19:10:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.750+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa88800a3e0 con 0x7fa8980b0930 2023-10-14T19:10:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.751+0000 7fa88f7fe700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa878067320 0x7fa8780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.751+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa888084fc0 con 0x7fa8980b0930 2023-10-14T19:10:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.751+0000 7fa896ffd700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa878067320 0x7fa8780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.751+0000 7fa896ffd700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa878067320 0x7fa8780697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa880003080 tx=0x7fa880017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.755+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa888051e90 con 0x7fa8980b0930 2023-10-14T19:10:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.950+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa89804c3c0 con 0x7fa8980b0930 2023-10-14T19:10:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.950+0000 7fa88f7fe700 1 -- 172.21.15.7:0/594420228 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa888015090 con 0x7fa8980b0930 2023-10-14T19:10:12.950 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:12.951 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:10:12.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:12.951 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:10:12.951 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:10:12.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:12.952 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:10:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa878067320 msgr2=0x7fa8780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa878067320 0x7fa8780697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa880003080 tx=0x7fa880017000 comp rx=0 tx=0).stop 2023-10-14T19:10:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 msgr2=0x7fa898169880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 0x7fa898169880 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c830 tx=0x7fa888008040 comp rx=0 tx=0).stop 2023-10-14T19:10:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 shutdown_connections 2023-10-14T19:10:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa878067320 0x7fa8780697d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa898159c20 0x7fa898154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8980b0930 0x7fa898169880 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 --2- 172.21.15.7:0/594420228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa898159850 0x7fa8980c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 >> 172.21.15.7:0/594420228 conn(0x7fa89806d170 msgr2=0x7fa8980adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 shutdown_connections 2023-10-14T19:10:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:12.952+0000 7fa89ddea700 1 -- 172.21.15.7:0/594420228 wait complete. 2023-10-14T19:10:12.964 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:10:12.964 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:10:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.088+0000 7f3252b31700 1 Processor -- start 2023-10-14T19:10:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.088+0000 7f3252b31700 1 -- start start 2023-10-14T19:10:13.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f3252b31700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f324c06dcf0 0x7f324c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f3252b31700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c0ccfd0 con 0x7f324c159e40 2023-10-14T19:10:13.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f3252b31700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c15a410 con 0x7f324c159530 2023-10-14T19:10:13.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f3252b31700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c15a6f0 con 0x7f324c06dcf0 2023-10-14T19:10:13.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32510ce700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f324c159e40 0x7f324c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58582/0 (socket says 172.21.15.7:58582) 2023-10-14T19:10:13.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32510ce700 1 -- 172.21.15.7:0/1874598177 learned_addr learned my addr 172.21.15.7:0/1874598177 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:13.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f3243fff700 1 --2- 172.21.15.7:0/1874598177 >> v2:172.21.15.148:3300/0 conn(0x7f324c06dcf0 0x7f324c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980242482 0 0) 0x7f324c0ccfd0 con 0x7f324c159e40 2023-10-14T19:10:13.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003570 con 0x7f324c159e40 2023-10-14T19:10:13.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503812338 0 0) 0x7f324c15a410 con 0x7f324c159530 2023-10-14T19:10:13.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c0ccfd0 con 0x7f324c159530 2023-10-14T19:10:13.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393746409 0 0) 0x7f3234003570 con 0x7f324c159e40 2023-10-14T19:10:13.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 >> v2:172.21.15.148:3300/0 conn(0x7f324c06dcf0 msgr2=0x7f324c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:13.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 --2- 172.21.15.7:0/1874598177 >> v2:172.21.15.148:3300/0 conn(0x7f324c06dcf0 0x7f324c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 >> v1:172.21.15.148:6789/0 conn(0x7f324c159530 legacy=0x7f324c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c15a9d0 con 0x7f324c159e40 2023-10-14T19:10:13.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f3244001470 con 0x7f324c159e40 2023-10-14T19:10:13.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 >> v1:172.21.15.7:6789/0 conn(0x7f324c159e40 legacy=0x7f324c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3234003c40 0x7f3234004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3234004810 0x7f3234004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234005210 0x7f323400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15a6f0 con 0x7f3234004810 2023-10-14T19:10:13.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323400c1b0 con 0x7f3234003c40 2023-10-14T19:10:13.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323400c370 con 0x7f3234005210 2023-10-14T19:10:13.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.089+0000 7f3243fff700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3234004810 0x7f3234004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32508cd700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3234003c40 0x7f3234004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32510ce700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234005210 0x7f323400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f3243fff700 1 -- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234005210 msgr2=0x7f323400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:13.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f3243fff700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234005210 0x7f323400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f3243fff700 1 -- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3234003c40 msgr2=0x7f3234004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:13.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f3243fff700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3234003c40 0x7f3234004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f3243fff700 1 -- 172.21.15.7:0/1874598177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234003570 con 0x7f3234004810 2023-10-14T19:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32508cd700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3234003c40 0x7f3234004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32510ce700 1 -- 172.21.15.7:0/1874598177 reap_dead start 2023-10-14T19:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f3243fff700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3234004810 0x7f3234004c80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f323c006f00 tx=0x7f323c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4c8be903bb08d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c00e710 con 0x7f3234004810 2023-10-14T19:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c00e870 con 0x7f3234004810 2023-10-14T19:10:13.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.090+0000 7f32437fe700 1 -- 172.21.15.7:0/1874598177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c00ec30 con 0x7f3234004810 2023-10-14T19:10:13.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 -- 172.21.15.7:0/1874598177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3234004810 msgr2=0x7f3234004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3234004810 0x7f3234004c80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f323c006f00 tx=0x7f323c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 -- 172.21.15.7:0/1874598177 shutdown_connections 2023-10-14T19:10:13.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 --2- 172.21.15.7:0/1874598177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3234004810 0x7f3234004c80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 -- 172.21.15.7:0/1874598177 >> 172.21.15.7:0/1874598177 conn(0x7f324c0703a0 msgr2=0x7f324c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:13.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 -- 172.21.15.7:0/1874598177 shutdown_connections 2023-10-14T19:10:13.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.091+0000 7f3252b31700 1 -- 172.21.15.7:0/1874598177 wait complete. 2023-10-14T19:10:13.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.092+0000 7f3252b31700 1 Processor -- start 2023-10-14T19:10:13.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.092+0000 7f3252b31700 1 -- start start 2023-10-14T19:10:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3252b31700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234004810 0x7f324c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3252b31700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f324c0ca050 0x7f324c0b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3252b31700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 0x7f324c0b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3252b31700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0c8fb0 con 0x7f324c0b3480 2023-10-14T19:10:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3252b31700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0c9290 con 0x7f324c0ca050 2023-10-14T19:10:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3252b31700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0c9570 con 0x7f3234004810 2023-10-14T19:10:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 0x7f324c0b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 0x7f324c0b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44492/0 (socket says 172.21.15.7:44492) 2023-10-14T19:10:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 -- 172.21.15.7:0/2687556380 learned_addr learned my addr 172.21.15.7:0/2687556380 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32508cd700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234004810 0x7f324c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3243fff700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f324c0ca050 0x7f324c0b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 -- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234004810 msgr2=0x7f324c1583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234004810 0x7f324c1583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 -- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f324c0ca050 msgr2=0x7f324c0b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f324c0ca050 0x7f324c0b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 -- 172.21.15.7:0/2687556380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0c9850 con 0x7f324c0b3480 2023-10-14T19:10:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f32510ce700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 0x7f324c0b38e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f324c0cc2b0 tx=0x7f3244001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.093+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244005e10 con 0x7f324c0b3480 2023-10-14T19:10:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.094+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324400c7b0 con 0x7f324c0b3480 2023-10-14T19:10:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.094+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c0c9b30 con 0x7f324c0b3480 2023-10-14T19:10:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.094+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400cb70 con 0x7f324c0b3480 2023-10-14T19:10:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.094+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c0b2d80 con 0x7f324c0b3480 2023-10-14T19:10:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.095+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c0b2fa0 con 0x7f324c0b3480 2023-10-14T19:10:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.095+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f324401d460 con 0x7f324c0b3480 2023-10-14T19:10:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.095+0000 7f3240ff9700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3238067320 0x7f32380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.095+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3244084560 con 0x7f324c0b3480 2023-10-14T19:10:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.096+0000 7f32508cd700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3238067320 0x7f32380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.096+0000 7f32508cd700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3238067320 0x7f32380697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3248000f80 tx=0x7f3248009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.100+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3244051600 con 0x7f324c0b3480 2023-10-14T19:10:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.294+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f324c0c9d20 con 0x7f324c0b3480 2023-10-14T19:10:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.482+0000 7f3240ff9700 1 -- 172.21.15.7:0/2687556380 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v136) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3244054c20 con 0x7f324c0b3480 2023-10-14T19:10:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.486+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3238067320 msgr2=0x7f32380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.486+0000 7f3252b31700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3238067320 0x7f32380697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3248000f80 tx=0x7f3248009040 comp rx=0 tx=0).stop 2023-10-14T19:10:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.486+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 msgr2=0x7f324c0b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.486+0000 7f3252b31700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 0x7f324c0b38e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f324c0cc2b0 tx=0x7f3244001070 comp rx=0 tx=0).stop 2023-10-14T19:10:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.487+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 shutdown_connections 2023-10-14T19:10:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.487+0000 7f3252b31700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3238067320 0x7f32380697d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.487+0000 7f3252b31700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f324c0b3480 0x7f324c0b38e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.487+0000 7f3252b31700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3234004810 0x7f324c1583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.487+0000 7f3252b31700 1 --2- 172.21.15.7:0/2687556380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f324c0ca050 0x7f324c0b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.487+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 >> 172.21.15.7:0/2687556380 conn(0x7f324c0703a0 msgr2=0x7f324c0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.488+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 shutdown_connections 2023-10-14T19:10:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.488+0000 7f3252b31700 1 -- 172.21.15.7:0/2687556380 wait complete. 2023-10-14T19:10:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:10:13.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:10:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.627+0000 7f69ee262700 1 Processor -- start 2023-10-14T19:10:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.627+0000 7f69ee262700 1 -- start start 2023-10-14T19:10:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69ee262700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 0x7f69e80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69ee262700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80ccfd0 con 0x7f69e806dc70 2023-10-14T19:10:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69ee262700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e815a3d0 con 0x7f69e8159530 2023-10-14T19:10:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69ee262700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e815a6b0 con 0x7f69e806e0e0 2023-10-14T19:10:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69e6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f69e806dc70 0x7f69e8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58594/0 (socket says 172.21.15.7:58594) 2023-10-14T19:10:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69e6ffd700 1 -- 172.21.15.7:0/1161643053 learned_addr learned my addr 172.21.15.7:0/1161643053 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 0x7f69e80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398360074 0 0) 0x7f69e80ccfd0 con 0x7f69e806dc70 2023-10-14T19:10:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d0003570 con 0x7f69e806dc70 2023-10-14T19:10:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.628+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070176311 0 0) 0x7f69e815a3d0 con 0x7f69e8159530 2023-10-14T19:10:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e80ccfd0 con 0x7f69e8159530 2023-10-14T19:10:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2928356033 0 0) 0x7f69d0003570 con 0x7f69e806dc70 2023-10-14T19:10:13.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 msgr2=0x7f69e80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:13.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 0x7f69e80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 >> v1:172.21.15.148:6789/0 conn(0x7f69e8159530 legacy=0x7f69e80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e815a990 con 0x7f69e806dc70 2023-10-14T19:10:13.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f69dc001470 con 0x7f69e806dc70 2023-10-14T19:10:13.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 >> v1:172.21.15.7:6789/0 conn(0x7f69e806dc70 legacy=0x7f69e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 0x7f69d0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d0004180 0x7f69d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69d0004d50 0x7f69d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e815a6b0 con 0x7f69d0004d50 2023-10-14T19:10:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d000bba0 con 0x7f69d0004180 2023-10-14T19:10:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d000bd60 con 0x7f69e806e0e0 2023-10-14T19:10:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69d0004d50 0x7f69d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e6ffd700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d0004180 0x7f69d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e77fe700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 0x7f69d0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 -- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 msgr2=0x7f69d0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e806e0e0 0x7f69d0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 -- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d0004180 msgr2=0x7f69d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d0004180 0x7f69d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 -- 172.21.15.7:0/1161643053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0003570 con 0x7f69d0004d50 2023-10-14T19:10:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69d0004d50 0x7f69d00051c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f69e80cf2d0 tx=0x7f69e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db7d0df0705d3c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000ea60 con 0x7f69d0004d50 2023-10-14T19:10:13.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000f040 con 0x7f69d0004d50 2023-10-14T19:10:13.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.629+0000 7f69e67fc700 1 -- 172.21.15.7:0/1161643053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000ee10 con 0x7f69d0004d50 2023-10-14T19:10:13.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69ee262700 1 -- 172.21.15.7:0/1161643053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69d0004d50 msgr2=0x7f69d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69ee262700 1 --2- 172.21.15.7:0/1161643053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69d0004d50 0x7f69d00051c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f69e80cf2d0 tx=0x7f69e000b040 comp rx=0 tx=0).stop 2023-10-14T19:10:13.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69e7fff700 1 -- 172.21.15.7:0/1161643053 reap_dead start 2023-10-14T19:10:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69ee262700 1 -- 172.21.15.7:0/1161643053 shutdown_connections 2023-10-14T19:10:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69ee262700 1 -- 172.21.15.7:0/1161643053 >> 172.21.15.7:0/1161643053 conn(0x7f69e80703a0 msgr2=0x7f69e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69ee262700 1 -- 172.21.15.7:0/1161643053 shutdown_connections 2023-10-14T19:10:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.630+0000 7f69ee262700 1 -- 172.21.15.7:0/1161643053 wait complete. 2023-10-14T19:10:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.631+0000 7f69ee262700 1 Processor -- start 2023-10-14T19:10:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.631+0000 7f69ee262700 1 -- start start 2023-10-14T19:10:13.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69ee262700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69e814d300 0x7f69e80c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69ee262700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e814e4c0 0x7f69e80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69ee262700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 0x7f69e80cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69ee262700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e816ba00 con 0x7f69e80cd6c0 2023-10-14T19:10:13.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69ee262700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ce0a0 con 0x7f69e814d300 2023-10-14T19:10:13.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69ee262700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e816adf0 con 0x7f69e814e4c0 2023-10-14T19:10:13.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 0x7f69e80cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 0x7f69e80cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44500/0 (socket says 172.21.15.7:44500) 2023-10-14T19:10:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 -- 172.21.15.7:0/1604399533 learned_addr learned my addr 172.21.15.7:0/1604399533 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e6ffd700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e814e4c0 0x7f69e80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e77fe700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69e814d300 0x7f69e80c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 -- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e814e4c0 msgr2=0x7f69e80c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e814e4c0 0x7f69e80c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 -- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69e814d300 msgr2=0x7f69e80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:13.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69e814d300 0x7f69e80c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:13.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e7fff700 1 -- 172.21.15.7:0/1604399533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e816b0d0 con 0x7f69e80cd6c0 2023-10-14T19:10:13.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.632+0000 7f69e6ffd700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e814e4c0 0x7f69e80c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:13.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.633+0000 7f69e7fff700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 0x7f69e80cdb60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f69e000afd0 tx=0x7f69e001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:13.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.633+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e001d630 con 0x7f69e80cd6c0 2023-10-14T19:10:13.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.633+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e001d7b0 con 0x7f69e80cd6c0 2023-10-14T19:10:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.633+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e816b3b0 con 0x7f69e80cd6c0 2023-10-14T19:10:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.633+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e001db70 con 0x7f69e80cd6c0 2023-10-14T19:10:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.633+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e814d6d0 con 0x7f69e80cd6c0 2023-10-14T19:10:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.634+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e816b850 con 0x7f69e80cd6c0 2023-10-14T19:10:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.634+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f69e0003040 con 0x7f69e80cd6c0 2023-10-14T19:10:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.635+0000 7f69cf7fe700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69d4067320 0x7f69d40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:13.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.635+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f69e0086cd0 con 0x7f69e80cd6c0 2023-10-14T19:10:13.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.635+0000 7f69e77fe700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69d4067320 0x7f69d40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:13.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.636+0000 7f69e77fe700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69d4067320 0x7f69d40697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f69d8007e40 tx=0x7f69d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:13.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.639+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69e0053ab0 con 0x7f69e80cd6c0 2023-10-14T19:10:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:13.831+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f69e816bbb0 con 0x7f69e80cd6c0 2023-10-14T19:10:14.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.488+0000 7f69cf7fe700 1 -- 172.21.15.7:0/1604399533 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v137) v1 ==== 170+0+0 (secure 0 0 0) 0x7f69e816bbb0 con 0x7f69e80cd6c0 2023-10-14T19:10:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69d4067320 msgr2=0x7f69d40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69d4067320 0x7f69d40697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f69d8007e40 tx=0x7f69d8009040 comp rx=0 tx=0).stop 2023-10-14T19:10:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 msgr2=0x7f69e80cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 0x7f69e80cdb60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f69e000afd0 tx=0x7f69e001a000 comp rx=0 tx=0).stop 2023-10-14T19:10:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 shutdown_connections 2023-10-14T19:10:14.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f69d4067320 0x7f69d40697d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69e814d300 0x7f69e80c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69e80cd6c0 0x7f69e80cdb60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 --2- 172.21.15.7:0/1604399533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69e814e4c0 0x7f69e80c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.493+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 >> 172.21.15.7:0/1604399533 conn(0x7f69e80703a0 msgr2=0x7f69e80b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.495+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 shutdown_connections 2023-10-14T19:10:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.495+0000 7f69ee262700 1 -- 172.21.15.7:0/1604399533 wait complete. 2023-10-14T19:10:14.499 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:10:14.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:10:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.645+0000 7f741b59e700 1 Processor -- start 2023-10-14T19:10:14.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.645+0000 7f741b59e700 1 -- start start 2023-10-14T19:10:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c0c7f90 0x7f741c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741b59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0ca480 con 0x7f741c142fd0 2023-10-14T19:10:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c15e240 con 0x7f741c142c00 2023-10-14T19:10:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c06b350 con 0x7f741c0c7f90 2023-10-14T19:10:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f7419d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f741c142fd0 0x7f741c0c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58602/0 (socket says 172.21.15.7:58602) 2023-10-14T19:10:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f7419d9b700 1 -- 172.21.15.7:0/167883462 learned_addr learned my addr 172.21.15.7:0/167883462 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741ad9d700 1 --2- 172.21.15.7:0/167883462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c0c7f90 0x7f741c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741959a700 1 -- 172.21.15.7:0/167883462 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346717957 0 0) 0x7f741c0ca480 con 0x7f741c142fd0 2023-10-14T19:10:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.646+0000 7f741959a700 1 -- 172.21.15.7:0/167883462 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7408003570 con 0x7f741c142fd0 2023-10-14T19:10:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741959a700 1 -- 172.21.15.7:0/167883462 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309353176 0 0) 0x7f741c15e240 con 0x7f741c142c00 2023-10-14T19:10:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741ad9d700 1 -- 172.21.15.7:0/167883462 >> v1:172.21.15.148:6789/0 conn(0x7f741c142c00 legacy=0x7f741c06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741ad9d700 1 -- 172.21.15.7:0/167883462 >> v1:172.21.15.7:6789/0 conn(0x7f741c142fd0 legacy=0x7f741c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741ad9d700 1 -- 172.21.15.7:0/167883462 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c15df60 con 0x7f741c0c7f90 2023-10-14T19:10:14.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741ad9d700 1 --2- 172.21.15.7:0/167883462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c0c7f90 0x7f741c06c6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f740c009e90 tx=0x7f740c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a86593a6a7f1745 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:14.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741959a700 1 -- 172.21.15.7:0/167883462 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c00e070 con 0x7f741c0c7f90 2023-10-14T19:10:14.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741959a700 1 -- 172.21.15.7:0/167883462 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c00bc30 con 0x7f741c0c7f90 2023-10-14T19:10:14.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.647+0000 7f741959a700 1 -- 172.21.15.7:0/167883462 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c012430 con 0x7f741c0c7f90 2023-10-14T19:10:14.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 -- 172.21.15.7:0/167883462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c0c7f90 msgr2=0x7f741c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 --2- 172.21.15.7:0/167883462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c0c7f90 0x7f741c06c6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f740c009e90 tx=0x7f740c009780 comp rx=0 tx=0).stop 2023-10-14T19:10:14.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 -- 172.21.15.7:0/167883462 shutdown_connections 2023-10-14T19:10:14.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 --2- 172.21.15.7:0/167883462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c0c7f90 0x7f741c06c6a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 -- 172.21.15.7:0/167883462 >> 172.21.15.7:0/167883462 conn(0x7f741c0675a0 msgr2=0x7f741c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:14.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 -- 172.21.15.7:0/167883462 shutdown_connections 2023-10-14T19:10:14.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.648+0000 7f741b59e700 1 -- 172.21.15.7:0/167883462 wait complete. 2023-10-14T19:10:14.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 Processor -- start 2023-10-14T19:10:14.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 -- start start 2023-10-14T19:10:14.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 0x7f741c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:14.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c142c00 0x7f741c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:14.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f741c142fd0 0x7f741c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:14.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c7e00 con 0x7f741c0c7f90 2023-10-14T19:10:14.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.649+0000 7f741b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c4dc0 con 0x7f741c142fd0 2023-10-14T19:10:14.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c4490 con 0x7f741c142c00 2023-10-14T19:10:14.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 0x7f741c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:14.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 0x7f741c15b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44510/0 (socket says 172.21.15.7:44510) 2023-10-14T19:10:14.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 -- 172.21.15.7:0/3998820038 learned_addr learned my addr 172.21.15.7:0/3998820038 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:14.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f7419d9b700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c142c00 0x7f741c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:14.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741ad9d700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f741c142fd0 0x7f741c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:14.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 -- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c142c00 msgr2=0x7f741c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c142c00 0x7f741c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 -- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f741c142fd0 msgr2=0x7f741c15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:14.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f741c142fd0 0x7f741c15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:14.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 -- 172.21.15.7:0/3998820038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c009a20 con 0x7f741c0c7f90 2023-10-14T19:10:14.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741a59c700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 0x7f741c15b1a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f741400c7e0 tx=0x7f7414007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:14.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140105c0 con 0x7f741c0c7f90 2023-10-14T19:10:14.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414010740 con 0x7f741c0c7f90 2023-10-14T19:10:14.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0c4770 con 0x7f741c0c7f90 2023-10-14T19:10:14.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414010b00 con 0x7f741c0c7f90 2023-10-14T19:10:14.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.650+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c15b6e0 con 0x7f741c0c7f90 2023-10-14T19:10:14.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.651+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c04c3c0 con 0x7f741c0c7f90 2023-10-14T19:10:14.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.652+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f741401b3b0 con 0x7f741c0c7f90 2023-10-14T19:10:14.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.652+0000 7f74127fc700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f73fc067320 0x7f73fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:14.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.652+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f74140841d0 con 0x7f741c0c7f90 2023-10-14T19:10:14.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.653+0000 7f7419d9b700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f73fc067320 0x7f73fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:14.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.653+0000 7f7419d9b700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f73fc067320 0x7f73fc0697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f741c06a580 tx=0x7f7404009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:14.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.657+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7414050ec0 con 0x7f741c0c7f90 2023-10-14T19:10:14.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:14.894+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f741c06ad00 con 0x7f741c0c7f90 2023-10-14T19:10:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.491+0000 7f74127fc700 1 -- 172.21.15.7:0/3998820038 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7f74140544e0 con 0x7f741c0c7f90 2023-10-14T19:10:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.501+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f73fc067320 msgr2=0x7f73fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.501+0000 7f741b59e700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f73fc067320 0x7f73fc0697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f741c06a580 tx=0x7f7404009040 comp rx=0 tx=0).stop 2023-10-14T19:10:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.501+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 msgr2=0x7f741c15b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.501+0000 7f741b59e700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 0x7f741c15b1a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f741400c7e0 tx=0x7f7414007df0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.511+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 shutdown_connections 2023-10-14T19:10:15.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.511+0000 7f741b59e700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f73fc067320 0x7f73fc0697d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.511+0000 7f741b59e700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f741c142fd0 0x7f741c15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.511+0000 7f741b59e700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c0c7f90 0x7f741c15b1a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.511+0000 7f741b59e700 1 --2- 172.21.15.7:0/3998820038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f741c142c00 0x7f741c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.511+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 >> 172.21.15.7:0/3998820038 conn(0x7f741c0675a0 msgr2=0x7f741c0c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:15.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.515+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 shutdown_connections 2023-10-14T19:10:15.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.516+0000 7f741b59e700 1 -- 172.21.15.7:0/3998820038 wait complete. 2023-10-14T19:10:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 24 and data pool 25 2023-10-14T19:10:15.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.660+0000 7fed6689b700 1 Processor -- start 2023-10-14T19:10:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.660+0000 7fed6689b700 1 -- start start 2023-10-14T19:10:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed6689b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed60153c30 0x7fed6015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed6689b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed600cf110 0x7fed6015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed6689b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6015afd0 con 0x7fed6015de50 2023-10-14T19:10:15.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed6689b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6015b2b0 con 0x7fed60153c30 2023-10-14T19:10:15.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed6689b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6015b590 con 0x7fed600cf110 2023-10-14T19:10:15.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65899700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed60153c30 0x7fed6015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:15.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65098700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fed6015de50 0x7fed600cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58606/0 (socket says 172.21.15.7:58606) 2023-10-14T19:10:15.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65098700 1 -- 172.21.15.7:0/658189946 learned_addr learned my addr 172.21.15.7:0/658189946 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:15.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed6609a700 1 --2- 172.21.15.7:0/658189946 >> v2:172.21.15.148:3300/0 conn(0x7fed600cf110 0x7fed6015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:15.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65899700 1 -- 172.21.15.7:0/658189946 >> v2:172.21.15.148:3300/0 conn(0x7fed600cf110 msgr2=0x7fed6015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:15.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65899700 1 --2- 172.21.15.7:0/658189946 >> v2:172.21.15.148:3300/0 conn(0x7fed600cf110 0x7fed6015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65899700 1 -- 172.21.15.7:0/658189946 >> v1:172.21.15.7:6789/0 conn(0x7fed6015de50 legacy=0x7fed600cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed65899700 1 -- 172.21.15.7:0/658189946 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6015b870 con 0x7fed60153c30 2023-10-14T19:10:15.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.661+0000 7fed64897700 1 -- 172.21.15.7:0/658189946 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743748424 0 0) 0x7fed6015afd0 con 0x7fed6015de50 2023-10-14T19:10:15.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed65899700 1 --2- 172.21.15.7:0/658189946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60153c30 0x7fed6015a5e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fed600cdab0 tx=0x7fed50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36377c6210eac9d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:15.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed64897700 1 -- 172.21.15.7:0/658189946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000e070 con 0x7fed60153c30 2023-10-14T19:10:15.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed64897700 1 -- 172.21.15.7:0/658189946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5000bc30 con 0x7fed60153c30 2023-10-14T19:10:15.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed64897700 1 -- 172.21.15.7:0/658189946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50012430 con 0x7fed60153c30 2023-10-14T19:10:15.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 -- 172.21.15.7:0/658189946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60153c30 msgr2=0x7fed6015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 --2- 172.21.15.7:0/658189946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60153c30 0x7fed6015a5e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fed600cdab0 tx=0x7fed50009780 comp rx=0 tx=0).stop 2023-10-14T19:10:15.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 -- 172.21.15.7:0/658189946 shutdown_connections 2023-10-14T19:10:15.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 --2- 172.21.15.7:0/658189946 >> v2:172.21.15.148:3300/0 conn(0x7fed600cf110 0x7fed6015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 --2- 172.21.15.7:0/658189946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60153c30 0x7fed6015a5e0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 -- 172.21.15.7:0/658189946 >> 172.21.15.7:0/658189946 conn(0x7fed600703a0 msgr2=0x7fed600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:15.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 -- 172.21.15.7:0/658189946 shutdown_connections 2023-10-14T19:10:15.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.662+0000 7fed6689b700 1 -- 172.21.15.7:0/658189946 wait complete. 2023-10-14T19:10:15.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.663+0000 7fed6689b700 1 Processor -- start 2023-10-14T19:10:15.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.663+0000 7fed6689b700 1 -- start start 2023-10-14T19:10:15.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6689b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed600cf110 0x7fed600b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:15.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6689b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed60153c30 0x7fed601697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:15.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6689b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 0x7fed60152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:15.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6689b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c9370 con 0x7fed6015de50 2023-10-14T19:10:15.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6689b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600ccd80 con 0x7fed600cf110 2023-10-14T19:10:15.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6689b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b6090 con 0x7fed60153c30 2023-10-14T19:10:15.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6609a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 0x7fed60152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:15.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6609a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 0x7fed60152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44530/0 (socket says 172.21.15.7:44530) 2023-10-14T19:10:15.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed6609a700 1 -- 172.21.15.7:0/3066563065 learned_addr learned my addr 172.21.15.7:0/3066563065 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:15.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed65098700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed60153c30 0x7fed601697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.664+0000 7fed65899700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed600cf110 0x7fed600b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6609a700 1 -- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed60153c30 msgr2=0x7fed601697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6609a700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed60153c30 0x7fed601697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6609a700 1 -- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed600cf110 msgr2=0x7fed600b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6609a700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed600cf110 0x7fed600b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6609a700 1 -- 172.21.15.7:0/3066563065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009a20 con 0x7fed6015de50 2023-10-14T19:10:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed65899700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed600cf110 0x7fed600b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed65098700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed60153c30 0x7fed601697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:15.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6609a700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 0x7fed60152f50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fed5800d890 tx=0x7fed58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:15.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580125f0 con 0x7fed6015de50 2023-10-14T19:10:15.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed58012770 con 0x7fed6015de50 2023-10-14T19:10:15.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600c8a40 con 0x7fed6015de50 2023-10-14T19:10:15.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58012b30 con 0x7fed6015de50 2023-10-14T19:10:15.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.665+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600c9000 con 0x7fed6015de50 2023-10-14T19:10:15.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.666+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed600c9520 con 0x7fed6015de50 2023-10-14T19:10:15.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.666+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fed5801e460 con 0x7fed6015de50 2023-10-14T19:10:15.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.667+0000 7fed5dffb700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed4c067320 0x7fed4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:15.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.667+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed58085340 con 0x7fed6015de50 2023-10-14T19:10:15.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.667+0000 7fed65899700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed4c067320 0x7fed4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:15.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.668+0000 7fed65899700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed4c067320 0x7fed4c0697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fed600cdab0 tx=0x7fed50019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:15.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.671+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed600c9520 con 0x7fed6015de50 2023-10-14T19:10:15.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.865+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed6004c3c0 con 0x7fed6015de50 2023-10-14T19:10:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.866+0000 7fed5dffb700 1 -- 172.21.15.7:0/3066563065 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fed58051fd0 con 0x7fed6015de50 2023-10-14T19:10:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:15.867 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":138,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:14.896296+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:13.861987+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:15.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed4c067320 msgr2=0x7fed4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed4c067320 0x7fed4c0697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fed600cdab0 tx=0x7fed50019000 comp rx=0 tx=0).stop 2023-10-14T19:10:15.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 msgr2=0x7fed60152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 0x7fed60152f50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fed5800d890 tx=0x7fed58008040 comp rx=0 tx=0).stop 2023-10-14T19:10:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 shutdown_connections 2023-10-14T19:10:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed4c067320 0x7fed4c0697d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed600cf110 0x7fed600b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6015de50 0x7fed60152f50 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 --2- 172.21.15.7:0/3066563065 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed60153c30 0x7fed601697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 >> 172.21.15.7:0/3066563065 conn(0x7fed600703a0 msgr2=0x7fed600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 shutdown_connections 2023-10-14T19:10:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:15.868+0000 7fed6689b700 1 -- 172.21.15.7:0/3066563065 wait complete. 2023-10-14T19:10:15.881 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:16.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.000+0000 7f11bbbf8700 1 Processor -- start 2023-10-14T19:10:16.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.000+0000 7f11bbbf8700 1 -- start start 2023-10-14T19:10:16.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11bbbf8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11b40cf200 0x7f11b40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11bbbf8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40b0ba0 0x7f11b406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11bbbf8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b415a280 con 0x7f11b40b07d0 2023-10-14T19:10:16.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11bbbf8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b406e180 con 0x7f11b40cf200 2023-10-14T19:10:16.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11bbbf8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b406d850 con 0x7f11b40b0ba0 2023-10-14T19:10:16.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11b40cf200 0x7f11b40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11b40cf200 0x7f11b40c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44532/0 (socket says 172.21.15.7:44532) 2023-10-14T19:10:16.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 -- 172.21.15.7:0/3098820280 learned_addr learned my addr 172.21.15.7:0/3098820280 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:16.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11ba195700 1 --2- 172.21.15.7:0/3098820280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40b0ba0 0x7f11b406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 -- 172.21.15.7:0/3098820280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40b0ba0 msgr2=0x7f11b406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:16.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 --2- 172.21.15.7:0/3098820280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40b0ba0 0x7f11b406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 -- 172.21.15.7:0/3098820280 >> v1:172.21.15.148:6789/0 conn(0x7f11b40b07d0 legacy=0x7f11b40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:16.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 -- 172.21.15.7:0/3098820280 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b406db30 con 0x7f11b40cf200 2023-10-14T19:10:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b9193700 1 --2- 172.21.15.7:0/3098820280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40cf200 0x7f11b40c42c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f11a40099b0 tx=0x7f11a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154a6f953e9e1935 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b8992700 1 -- 172.21.15.7:0/3098820280 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400b820 con 0x7f11b40cf200 2023-10-14T19:10:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b8992700 1 -- 172.21.15.7:0/3098820280 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400b980 con 0x7f11b40cf200 2023-10-14T19:10:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.001+0000 7f11b8992700 1 -- 172.21.15.7:0/3098820280 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400bd20 con 0x7f11b40cf200 2023-10-14T19:10:16.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3098820280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40cf200 msgr2=0x7f11b40c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3098820280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40cf200 0x7f11b40c42c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f11a40099b0 tx=0x7f11a4009250 comp rx=0 tx=0).stop 2023-10-14T19:10:16.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3098820280 shutdown_connections 2023-10-14T19:10:16.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3098820280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40b0ba0 0x7f11b406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3098820280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40cf200 0x7f11b40c42c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3098820280 >> 172.21.15.7:0/3098820280 conn(0x7f11b406ce80 msgr2=0x7f11b40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:16.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3098820280 shutdown_connections 2023-10-14T19:10:16.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.002+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3098820280 wait complete. 2023-10-14T19:10:16.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.003+0000 7f11bbbf8700 1 Processor -- start 2023-10-14T19:10:16.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.003+0000 7f11bbbf8700 1 -- start start 2023-10-14T19:10:16.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11bbbf8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b40b07d0 0x7f11b4151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11bbbf8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 0x7f11b416de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11bbbf8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40cf200 0x7f11b41585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11bbbf8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b416e350 con 0x7f11b40b0ba0 2023-10-14T19:10:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11bbbf8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40c78c0 con 0x7f11b40b07d0 2023-10-14T19:10:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11bbbf8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40c7b20 con 0x7f11b40cf200 2023-10-14T19:10:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 0x7f11b416de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 0x7f11b416de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44536/0 (socket says 172.21.15.7:44536) 2023-10-14T19:10:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 -- 172.21.15.7:0/3827340998 learned_addr learned my addr 172.21.15.7:0/3827340998 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11ba195700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40cf200 0x7f11b41585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9994700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b40b07d0 0x7f11b4151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 -- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40cf200 msgr2=0x7f11b41585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40cf200 0x7f11b41585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 -- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b40b07d0 msgr2=0x7f11b4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b40b07d0 0x7f11b4151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.004+0000 7f11b9193700 1 -- 172.21.15.7:0/3827340998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40094f0 con 0x7f11b40b0ba0 2023-10-14T19:10:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.005+0000 7f11b9193700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 0x7f11b416de10 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009290 tx=0x7f11a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.005+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4011d90 con 0x7f11b40b0ba0 2023-10-14T19:10:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.005+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4020070 con 0x7f11b40b0ba0 2023-10-14T19:10:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.005+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b40c7e00 con 0x7f11b40b0ba0 2023-10-14T19:10:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.005+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a401b6a0 con 0x7f11b40b0ba0 2023-10-14T19:10:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.005+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40c83c0 con 0x7f11b40b0ba0 2023-10-14T19:10:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.006+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b404c3c0 con 0x7f11b40b0ba0 2023-10-14T19:10:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.006+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f11a4022030 con 0x7f11b40b0ba0 2023-10-14T19:10:16.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.007+0000 7f11a9ffb700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1198067320 0x7f11980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.007+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11a4086a70 con 0x7f11b40b0ba0 2023-10-14T19:10:16.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.007+0000 7f11b9994700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1198067320 0x7f11980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.007+0000 7f11b9994700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1198067320 0x7f11980697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009930 tx=0x7f11b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:16.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.011+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11a4053810 con 0x7f11b40b0ba0 2023-10-14T19:10:16.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.204+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11b404c3c0 con 0x7f11b40b0ba0 2023-10-14T19:10:16.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.205+0000 7f11a9ffb700 1 -- 172.21.15.7:0/3827340998 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f11a4056e30 con 0x7f11b40b0ba0 2023-10-14T19:10:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:16.206 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":138,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:14.896296+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:13.861987+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:16.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1198067320 msgr2=0x7f11980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1198067320 0x7f11980697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009930 tx=0x7f11b0008040 comp rx=0 tx=0).stop 2023-10-14T19:10:16.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 msgr2=0x7f11b416de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 0x7f11b416de10 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009290 tx=0x7f11a4016000 comp rx=0 tx=0).stop 2023-10-14T19:10:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 shutdown_connections 2023-10-14T19:10:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1198067320 0x7f11980697d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b40b07d0 0x7f11b4151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b40cf200 0x7f11b41585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 --2- 172.21.15.7:0/3827340998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b40b0ba0 0x7f11b416de10 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 >> 172.21.15.7:0/3827340998 conn(0x7f11b406ce80 msgr2=0x7f11b40c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 shutdown_connections 2023-10-14T19:10:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.207+0000 7f11bbbf8700 1 -- 172.21.15.7:0/3827340998 wait complete. 2023-10-14T19:10:16.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:10:16.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.341+0000 7fc5265b2700 1 Processor -- start 2023-10-14T19:10:16.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.341+0000 7fc5265b2700 1 -- start start 2023-10-14T19:10:16.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc5265b2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc520159860 0x7fc5200ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc5265b2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5200ccfa0 0x7fc5200cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc5265b2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5200cf510 con 0x7fc5200cbd90 2023-10-14T19:10:16.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc5265b2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200d00b0 con 0x7fc5200ccfa0 2023-10-14T19:10:16.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc5265b2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200cc210 con 0x7fc520159860 2023-10-14T19:10:16.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc524b4f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5200ccfa0 0x7fc5200cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc524b4f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5200ccfa0 0x7fc5200cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44544/0 (socket says 172.21.15.7:44544) 2023-10-14T19:10:16.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc524b4f700 1 -- 172.21.15.7:0/616269184 learned_addr learned my addr 172.21.15.7:0/616269184 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:16.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.342+0000 7fc51ffff700 1 --2- 172.21.15.7:0/616269184 >> v2:172.21.15.148:3300/0 conn(0x7fc520159860 0x7fc5200ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc524b4f700 1 -- 172.21.15.7:0/616269184 >> v2:172.21.15.148:3300/0 conn(0x7fc520159860 msgr2=0x7fc5200ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:16.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc524b4f700 1 --2- 172.21.15.7:0/616269184 >> v2:172.21.15.148:3300/0 conn(0x7fc520159860 0x7fc5200ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc524b4f700 1 -- 172.21.15.7:0/616269184 >> v1:172.21.15.148:6789/0 conn(0x7fc5200cbd90 legacy=0x7fc5200cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc524b4f700 1 -- 172.21.15.7:0/616269184 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200ce900 con 0x7fc5200ccfa0 2023-10-14T19:10:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc524b4f700 1 --2- 172.21.15.7:0/616269184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5200ccfa0 0x7fc5200cd400 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc520088e40 tx=0x7fc518009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cfc3335ef48f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc51effd700 1 -- 172.21.15.7:0/616269184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800e070 con 0x7fc5200ccfa0 2023-10-14T19:10:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc51effd700 1 -- 172.21.15.7:0/616269184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800ba20 con 0x7fc5200ccfa0 2023-10-14T19:10:16.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc51effd700 1 -- 172.21.15.7:0/616269184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180092e0 con 0x7fc5200ccfa0 2023-10-14T19:10:16.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc5265b2700 1 -- 172.21.15.7:0/616269184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5200ccfa0 msgr2=0x7fc5200cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.343+0000 7fc5265b2700 1 --2- 172.21.15.7:0/616269184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5200ccfa0 0x7fc5200cd400 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc520088e40 tx=0x7fc518009840 comp rx=0 tx=0).stop 2023-10-14T19:10:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.344+0000 7fc5265b2700 1 -- 172.21.15.7:0/616269184 shutdown_connections 2023-10-14T19:10:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.344+0000 7fc5265b2700 1 --2- 172.21.15.7:0/616269184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5200ccfa0 0x7fc5200cd400 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.344+0000 7fc5265b2700 1 --2- 172.21.15.7:0/616269184 >> v2:172.21.15.148:3300/0 conn(0x7fc520159860 0x7fc5200ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.344+0000 7fc5265b2700 1 -- 172.21.15.7:0/616269184 >> 172.21.15.7:0/616269184 conn(0x7fc5200999b0 msgr2=0x7fc520070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.344+0000 7fc5265b2700 1 -- 172.21.15.7:0/616269184 shutdown_connections 2023-10-14T19:10:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.344+0000 7fc5265b2700 1 -- 172.21.15.7:0/616269184 wait complete. 2023-10-14T19:10:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 Processor -- start 2023-10-14T19:10:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 -- start start 2023-10-14T19:10:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5200cbd90 0x7fc52016a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5200ccfa0 0x7fc5200c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 0x7fc5200c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200caa60 con 0x7fc520159860 2023-10-14T19:10:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.345+0000 7fc5265b2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52016aac0 con 0x7fc5200cbd90 2023-10-14T19:10:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc5265b2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c9e50 con 0x7fc5200ccfa0 2023-10-14T19:10:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 0x7fc5200c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 0x7fc5200c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44548/0 (socket says 172.21.15.7:44548) 2023-10-14T19:10:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 -- 172.21.15.7:0/2246166885 learned_addr learned my addr 172.21.15.7:0/2246166885 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc51ffff700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5200cbd90 0x7fc52016a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc51f7fe700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5200ccfa0 0x7fc5200c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 -- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5200ccfa0 msgr2=0x7fc5200c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5200ccfa0 0x7fc5200c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 -- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5200cbd90 msgr2=0x7fc52016a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5200cbd90 0x7fc52016a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 -- 172.21.15.7:0/2246166885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518009ae0 con 0x7fc520159860 2023-10-14T19:10:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc51ffff700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5200cbd90 0x7fc52016a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc524b4f700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 0x7fc5200c7c40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc518009880 tx=0x7fc518018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518008c60 con 0x7fc520159860 2023-10-14T19:10:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518008de0 con 0x7fc520159860 2023-10-14T19:10:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5200ca130 con 0x7fc520159860 2023-10-14T19:10:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180266b0 con 0x7fc520159860 2023-10-14T19:10:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.346+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200ca6f0 con 0x7fc520159860 2023-10-14T19:10:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.347+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52004c3c0 con 0x7fc520159860 2023-10-14T19:10:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.348+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc518003040 con 0x7fc520159860 2023-10-14T19:10:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.348+0000 7fc517fff700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.348+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc518086720 con 0x7fc520159860 2023-10-14T19:10:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.348+0000 7fc51ffff700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.349+0000 7fc51ffff700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc52015f540 tx=0x7fc510008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.352+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc518053320 con 0x7fc520159860 2023-10-14T19:10:16.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:16.600+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc5200cebe0 con 0x7fc520159860 2023-10-14T19:10:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.517+0000 7fc517fff700 1 -- 172.21.15.7:0/2246166885 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v90) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc518056940 con 0x7fc520159860 2023-10-14T19:10:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 msgr2=0x7fc5000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc52015f540 tx=0x7fc510008040 comp rx=0 tx=0).stop 2023-10-14T19:10:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 msgr2=0x7fc5200c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 0x7fc5200c7c40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc518009880 tx=0x7fc518018000 comp rx=0 tx=0).stop 2023-10-14T19:10:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 shutdown_connections 2023-10-14T19:10:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5200cbd90 0x7fc52016a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc520159860 0x7fc5200c7c40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 --2- 172.21.15.7:0/2246166885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5200ccfa0 0x7fc5200c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 >> 172.21.15.7:0/2246166885 conn(0x7fc5200999b0 msgr2=0x7fc5200b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 shutdown_connections 2023-10-14T19:10:17.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.520+0000 7fc5265b2700 1 -- 172.21.15.7:0/2246166885 wait complete. 2023-10-14T19:10:17.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:10:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.666+0000 7f37dc212700 1 Processor -- start 2023-10-14T19:10:17.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.667+0000 7f37dc212700 1 -- start start 2023-10-14T19:10:17.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.667+0000 7f37dc212700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37d406e0e0 0x7f37d40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.667+0000 7f37dc212700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d40ccfd0 con 0x7f37d4159530 2023-10-14T19:10:17.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.667+0000 7f37dc212700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d415a3d0 con 0x7f37d406dc70 2023-10-14T19:10:17.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.667+0000 7f37dc212700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d415a6b0 con 0x7f37d406e0e0 2023-10-14T19:10:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d9fae700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37d4159530 0x7f37d40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49492/0 (socket says 172.21.15.7:49492) 2023-10-14T19:10:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d9fae700 1 -- 172.21.15.7:0/3212322886 learned_addr learned my addr 172.21.15.7:0/3212322886 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593602335 0 0) 0x7f37d40ccfd0 con 0x7f37d4159530 2023-10-14T19:10:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37bc003570 con 0x7f37d4159530 2023-10-14T19:10:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37da7af700 1 --2- 172.21.15.7:0/3212322886 >> v2:172.21.15.148:3300/0 conn(0x7f37d406e0e0 0x7f37d40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996357503 0 0) 0x7f37bc003570 con 0x7f37d4159530 2023-10-14T19:10:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 >> v2:172.21.15.148:3300/0 conn(0x7f37d406e0e0 msgr2=0x7f37d40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 --2- 172.21.15.7:0/3212322886 >> v2:172.21.15.148:3300/0 conn(0x7f37d406e0e0 0x7f37d40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 >> v1:172.21.15.148:6789/0 conn(0x7f37d406dc70 legacy=0x7f37d4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d415a990 con 0x7f37d4159530 2023-10-14T19:10:17.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f37cc001470 con 0x7f37d4159530 2023-10-14T19:10:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 >> v1:172.21.15.7:6789/0 conn(0x7f37d4159530 legacy=0x7f37d40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37bc003a60 0x7f37bc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37bc005210 0x7f37bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d415a6b0 con 0x7f37bc004810 2023-10-14T19:10:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc00c100 con 0x7f37bc003a60 2023-10-14T19:10:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc00c2c0 con 0x7f37bc005210 2023-10-14T19:10:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d97ad700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37d9fae700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37bc003a60 0x7f37bc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.668+0000 7f37da7af700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37bc005210 0x7f37bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d97ad700 1 -- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37bc005210 msgr2=0x7f37bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d97ad700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37bc005210 0x7f37bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d97ad700 1 -- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37bc003a60 msgr2=0x7f37bc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d97ad700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37bc003a60 0x7f37bc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d97ad700 1 -- 172.21.15.7:0/3212322886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc003570 con 0x7f37bc004810 2023-10-14T19:10:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37da7af700 1 -- 172.21.15.7:0/3212322886 reap_dead start 2023-10-14T19:10:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d97ad700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37bc004c80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f37c80018d0 tx=0x7f37c8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd33b680c771bef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8012400 con 0x7f37bc004810 2023-10-14T19:10:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8012580 con 0x7f37bc004810 2023-10-14T19:10:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37d8fac700 1 -- 172.21.15.7:0/3212322886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8012940 con 0x7f37bc004810 2023-10-14T19:10:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37dc212700 1 -- 172.21.15.7:0/3212322886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 msgr2=0x7f37bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.669+0000 7f37dc212700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37bc004c80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f37c80018d0 tx=0x7f37c8007d30 comp rx=0 tx=0).stop 2023-10-14T19:10:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.670+0000 7f37dc212700 1 -- 172.21.15.7:0/3212322886 shutdown_connections 2023-10-14T19:10:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.670+0000 7f37dc212700 1 --2- 172.21.15.7:0/3212322886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37bc004c80 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.670+0000 7f37dc212700 1 -- 172.21.15.7:0/3212322886 >> 172.21.15.7:0/3212322886 conn(0x7f37d40703a0 msgr2=0x7f37d40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.670+0000 7f37dc212700 1 -- 172.21.15.7:0/3212322886 shutdown_connections 2023-10-14T19:10:17.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.670+0000 7f37dc212700 1 -- 172.21.15.7:0/3212322886 wait complete. 2023-10-14T19:10:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 Processor -- start 2023-10-14T19:10:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 -- start start 2023-10-14T19:10:17.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37d40d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37d40b42f0 0x7f37d40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37d40c7cd0 0x7f37d414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40c8dc0 con 0x7f37bc004810 2023-10-14T19:10:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40c8150 con 0x7f37d40b42f0 2023-10-14T19:10:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.671+0000 7f37dc212700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40c8430 con 0x7f37d40c7cd0 2023-10-14T19:10:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37d40d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37d40d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58836/0 (socket says 172.21.15.7:58836) 2023-10-14T19:10:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 -- 172.21.15.7:0/2107265016 learned_addr learned my addr 172.21.15.7:0/2107265016 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d97ad700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37d40b42f0 0x7f37d40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37da7af700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37d40c7cd0 0x7f37d414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 -- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37d40c7cd0 msgr2=0x7f37d414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37d40c7cd0 0x7f37d414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 -- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37d40b42f0 msgr2=0x7f37d40c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37d40b42f0 0x7f37d40c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 -- 172.21.15.7:0/2107265016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40c8710 con 0x7f37bc004810 2023-10-14T19:10:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37da7af700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37d40c7cd0 0x7f37d414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d97ad700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37d40b42f0 0x7f37d40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d9fae700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37d40d00a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0073c0 tx=0x7f37cc001e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc018030 con 0x7f37bc004810 2023-10-14T19:10:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc001430 con 0x7f37bc004810 2023-10-14T19:10:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d40c89f0 con 0x7f37bc004810 2023-10-14T19:10:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00fb20 con 0x7f37bc004810 2023-10-14T19:10:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.672+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d414e3a0 con 0x7f37bc004810 2023-10-14T19:10:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.673+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d40d0820 con 0x7f37bc004810 2023-10-14T19:10:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.674+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f37cc01b070 con 0x7f37bc004810 2023-10-14T19:10:17.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.674+0000 7f37d1ffb700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37c0067320 0x7f37c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:17.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.674+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37cc019070 con 0x7f37bc004810 2023-10-14T19:10:17.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.674+0000 7f37d97ad700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37c0067320 0x7f37c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:17.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.675+0000 7f37d97ad700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37c0067320 0x7f37c00697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f37c8001340 tx=0x7f37c8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:17.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.678+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37cc051820 con 0x7f37bc004810 2023-10-14T19:10:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:17.920+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f37d404c3c0 con 0x7f37bc004810 2023-10-14T19:10:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.521+0000 7f37d1ffb700 1 -- 172.21.15.7:0/2107265016 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v91) v1 ==== 122+0+0 (secure 0 0 0) 0x7f37cc054e40 con 0x7f37bc004810 2023-10-14T19:10:18.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37c0067320 msgr2=0x7f37c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37c0067320 0x7f37c00697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f37c8001340 tx=0x7f37c8015000 comp rx=0 tx=0).stop 2023-10-14T19:10:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 msgr2=0x7f37d40d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37d40d00a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0073c0 tx=0x7f37cc001e30 comp rx=0 tx=0).stop 2023-10-14T19:10:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 shutdown_connections 2023-10-14T19:10:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37c0067320 0x7f37c00697d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37d40c7cd0 0x7f37d414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc004810 0x7f37d40d00a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 --2- 172.21.15.7:0/2107265016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37d40b42f0 0x7f37d40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 >> 172.21.15.7:0/2107265016 conn(0x7f37d40703a0 msgr2=0x7f37d40d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 shutdown_connections 2023-10-14T19:10:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.524+0000 7f37dc212700 1 -- 172.21.15.7:0/2107265016 wait complete. 2023-10-14T19:10:18.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:18.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 Processor -- start 2023-10-14T19:10:18.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 -- start start 2023-10-14T19:10:18.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0d240cf200 0x7f0d240c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:18.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d240b0ba0 0x7f0d2406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2415a280 con 0x7f0d240b07d0 2023-10-14T19:10:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2406e180 con 0x7f0d240cf200 2023-10-14T19:10:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.660+0000 7f0d2abf0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2406d850 con 0x7f0d240b0ba0 2023-10-14T19:10:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0d240cf200 0x7f0d240c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0d240cf200 0x7f0d240c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58844/0 (socket says 172.21.15.7:58844) 2023-10-14T19:10:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 -- 172.21.15.7:0/2766428639 learned_addr learned my addr 172.21.15.7:0/2766428639 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 -- 172.21.15.7:0/2766428639 >> v2:172.21.15.148:3300/0 conn(0x7f0d240b0ba0 msgr2=0x7f0d2406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 --2- 172.21.15.7:0/2766428639 >> v2:172.21.15.148:3300/0 conn(0x7f0d240b0ba0 0x7f0d2406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 -- 172.21.15.7:0/2766428639 >> v1:172.21.15.148:6789/0 conn(0x7f0d240b07d0 legacy=0x7f0d240ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:18.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 -- 172.21.15.7:0/2766428639 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2406db30 con 0x7f0d240cf200 2023-10-14T19:10:18.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d23fff700 1 --2- 172.21.15.7:0/2766428639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240cf200 0x7f0d240c42c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0d240637a0 tx=0x7f0d14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b0644a484fd768 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:18.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d237fe700 1 -- 172.21.15.7:0/2766428639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400b860 con 0x7f0d240cf200 2023-10-14T19:10:18.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d237fe700 1 -- 172.21.15.7:0/2766428639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400b9c0 con 0x7f0d240cf200 2023-10-14T19:10:18.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.661+0000 7f0d237fe700 1 -- 172.21.15.7:0/2766428639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400bd60 con 0x7f0d240cf200 2023-10-14T19:10:18.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 -- 172.21.15.7:0/2766428639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240cf200 msgr2=0x7f0d240c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/2766428639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240cf200 0x7f0d240c42c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0d240637a0 tx=0x7f0d14009250 comp rx=0 tx=0).stop 2023-10-14T19:10:18.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 -- 172.21.15.7:0/2766428639 shutdown_connections 2023-10-14T19:10:18.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/2766428639 >> v2:172.21.15.148:3300/0 conn(0x7f0d240b0ba0 0x7f0d2406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/2766428639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240cf200 0x7f0d240c42c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 -- 172.21.15.7:0/2766428639 >> 172.21.15.7:0/2766428639 conn(0x7f0d2406ce80 msgr2=0x7f0d240ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:18.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 -- 172.21.15.7:0/2766428639 shutdown_connections 2023-10-14T19:10:18.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.662+0000 7f0d2abf0700 1 -- 172.21.15.7:0/2766428639 wait complete. 2023-10-14T19:10:18.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.663+0000 7f0d2abf0700 1 Processor -- start 2023-10-14T19:10:18.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.663+0000 7f0d2abf0700 1 -- start start 2023-10-14T19:10:18.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2abf0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 0x7f0d2409a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:18.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2abf0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d240b0ba0 0x7f0d24156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:18.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2abf0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d240cf200 0x7f0d24098730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:18.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2abf0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2409ae20 con 0x7f0d240b07d0 2023-10-14T19:10:18.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2abf0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24157140 con 0x7f0d240cf200 2023-10-14T19:10:18.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2abf0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24099030 con 0x7f0d240b0ba0 2023-10-14T19:10:18.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 0x7f0d2409a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:18.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 0x7f0d2409a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58854/0 (socket says 172.21.15.7:58854) 2023-10-14T19:10:18.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 -- 172.21.15.7:0/1650484034 learned_addr learned my addr 172.21.15.7:0/1650484034 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:18.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2918d700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d240cf200 0x7f0d24098730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:18.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d23fff700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d240b0ba0 0x7f0d24156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:18.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 -- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d240b0ba0 msgr2=0x7f0d24156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d240b0ba0 0x7f0d24156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 -- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d240cf200 msgr2=0x7f0d24098730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d240cf200 0x7f0d24098730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 -- 172.21.15.7:0/1650484034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140094f0 con 0x7f0d240b07d0 2023-10-14T19:10:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2918d700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d240cf200 0x7f0d24098730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d23fff700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d240b0ba0 0x7f0d24156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.664+0000 7f0d2898c700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 0x7f0d2409a850 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00cd30 tx=0x7f0d1c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.665+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00ab70 con 0x7f0d240b07d0 2023-10-14T19:10:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.665+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00acd0 con 0x7f0d240b07d0 2023-10-14T19:10:18.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.665+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d240c6a20 con 0x7f0d240b07d0 2023-10-14T19:10:18.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.665+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c012670 con 0x7f0d240b07d0 2023-10-14T19:10:18.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.665+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d24099310 con 0x7f0d240b07d0 2023-10-14T19:10:18.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.665+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d240c6e40 con 0x7f0d240b07d0 2023-10-14T19:10:18.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.666+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0d1c012a60 con 0x7f0d240b07d0 2023-10-14T19:10:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.666+0000 7f0d20ff9700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.666+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d1c0853d0 con 0x7f0d240b07d0 2023-10-14T19:10:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.667+0000 7f0d23fff700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.667+0000 7f0d23fff700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d240637a0 tx=0x7f0d14017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.671+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d240c6e40 con 0x7f0d240b07d0 2023-10-14T19:10:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.906+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d240c6e40 con 0x7f0d240b07d0 2023-10-14T19:10:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.907+0000 7f0d20ff9700 1 -- 172.21.15.7:0/1650484034 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f0d240c6e40 con 0x7f0d240b07d0 2023-10-14T19:10:18.908 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:18.908 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:18.517038+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 msgr2=0x7f0d040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d240637a0 tx=0x7f0d14017000 comp rx=0 tx=0).stop 2023-10-14T19:10:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 msgr2=0x7f0d2409a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 0x7f0d2409a850 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00cd30 tx=0x7f0d1c001b40 comp rx=0 tx=0).stop 2023-10-14T19:10:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 shutdown_connections 2023-10-14T19:10:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d240cf200 0x7f0d24098730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d240b07d0 0x7f0d2409a850 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 --2- 172.21.15.7:0/1650484034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d240b0ba0 0x7f0d24156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 >> 172.21.15.7:0/1650484034 conn(0x7f0d2406ce80 msgr2=0x7f0d240cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 shutdown_connections 2023-10-14T19:10:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:18.909+0000 7f0d2abf0700 1 -- 172.21.15.7:0/1650484034 wait complete. 2023-10-14T19:10:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 91 2023-10-14T19:10:18.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:19.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:10:19.017 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:10:19.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.042+0000 7f15e0418700 1 Processor -- start 2023-10-14T19:10:19.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.042+0000 7f15e0418700 1 -- start start 2023-10-14T19:10:19.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15e0418700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d81508c0 0x7f15d8158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15e0418700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15d8150c90 0x7f15d80af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15e0418700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d8155710 con 0x7f15d815a0c0 2023-10-14T19:10:19.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15e0418700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d815afc0 con 0x7f15d8150c90 2023-10-14T19:10:19.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15e0418700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80af820 con 0x7f15d81508c0 2023-10-14T19:10:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15d8150c90 0x7f15d80af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15d8150c90 0x7f15d80af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58856/0 (socket says 172.21.15.7:58856) 2023-10-14T19:10:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 -- 172.21.15.7:0/887306399 learned_addr learned my addr 172.21.15.7:0/887306399 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15de1b4700 1 --2- 172.21.15.7:0/887306399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d81508c0 0x7f15d8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 -- 172.21.15.7:0/887306399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d81508c0 msgr2=0x7f15d8158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 --2- 172.21.15.7:0/887306399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d81508c0 0x7f15d8158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 -- 172.21.15.7:0/887306399 >> v1:172.21.15.148:6789/0 conn(0x7f15d815a0c0 legacy=0x7f15d8156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.043+0000 7f15dd9b3700 1 -- 172.21.15.7:0/887306399 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d8158c80 con 0x7f15d8150c90 2023-10-14T19:10:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15dd9b3700 1 --2- 172.21.15.7:0/887306399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d8150c90 0x7f15d80af2e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f15d40099b0 tx=0x7f15d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efac6e0584286612 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15dd1b2700 1 -- 172.21.15.7:0/887306399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400b860 con 0x7f15d8150c90 2023-10-14T19:10:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15dd1b2700 1 -- 172.21.15.7:0/887306399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400b9c0 con 0x7f15d8150c90 2023-10-14T19:10:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15dd1b2700 1 -- 172.21.15.7:0/887306399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400bd60 con 0x7f15d8150c90 2023-10-14T19:10:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 -- 172.21.15.7:0/887306399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d8150c90 msgr2=0x7f15d80af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 --2- 172.21.15.7:0/887306399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d8150c90 0x7f15d80af2e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f15d40099b0 tx=0x7f15d4009250 comp rx=0 tx=0).stop 2023-10-14T19:10:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 -- 172.21.15.7:0/887306399 shutdown_connections 2023-10-14T19:10:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 --2- 172.21.15.7:0/887306399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d81508c0 0x7f15d8158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 --2- 172.21.15.7:0/887306399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d8150c90 0x7f15d80af2e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 -- 172.21.15.7:0/887306399 >> 172.21.15.7:0/887306399 conn(0x7f15d80cded0 msgr2=0x7f15d806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 -- 172.21.15.7:0/887306399 shutdown_connections 2023-10-14T19:10:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.044+0000 7f15e0418700 1 -- 172.21.15.7:0/887306399 wait complete. 2023-10-14T19:10:19.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 Processor -- start 2023-10-14T19:10:19.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 -- start start 2023-10-14T19:10:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15d81508c0 0x7f15d80c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d8150c90 0x7f15d80c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 0x7f15d80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8152260 con 0x7f15d815a0c0 2023-10-14T19:10:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8151650 con 0x7f15d81508c0 2023-10-14T19:10:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15e0418700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8151930 con 0x7f15d8150c90 2023-10-14T19:10:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15de9b5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 0x7f15d80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15de9b5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 0x7f15d80caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58866/0 (socket says 172.21.15.7:58866) 2023-10-14T19:10:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15de9b5700 1 -- 172.21.15.7:0/4227273848 learned_addr learned my addr 172.21.15.7:0/4227273848 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15de1b4700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15d81508c0 0x7f15d80c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.046+0000 7f15dd9b3700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d8150c90 0x7f15d80c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15de9b5700 1 -- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d8150c90 msgr2=0x7f15d80c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15de9b5700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d8150c90 0x7f15d80c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15de9b5700 1 -- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15d81508c0 msgr2=0x7f15d80c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15de9b5700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15d81508c0 0x7f15d80c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15de9b5700 1 -- 172.21.15.7:0/4227273848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40094f0 con 0x7f15d815a0c0 2023-10-14T19:10:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15de9b5700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 0x7f15d80caa90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c8e0 tx=0x7f15d0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0012630 con 0x7f15d815a0c0 2023-10-14T19:10:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d0012790 con 0x7f15d815a0c0 2023-10-14T19:10:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0012b50 con 0x7f15d815a0c0 2023-10-14T19:10:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d8151c10 con 0x7f15d815a0c0 2023-10-14T19:10:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.047+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d80cafd0 con 0x7f15d815a0c0 2023-10-14T19:10:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.048+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d81523d0 con 0x7f15d815a0c0 2023-10-14T19:10:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.049+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f15d001a3a0 con 0x7f15d815a0c0 2023-10-14T19:10:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.049+0000 7f15ce7fc700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f15bc067320 0x7f15bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.049+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15d0084de0 con 0x7f15d815a0c0 2023-10-14T19:10:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.049+0000 7f15de1b4700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f15bc067320 0x7f15bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.050+0000 7f15de1b4700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f15bc067320 0x7f15bc0697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006fd0 tx=0x7f15c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.054+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15d0055500 con 0x7f15d815a0c0 2023-10-14T19:10:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.245+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15d804c3c0 con 0x7f15d815a0c0 2023-10-14T19:10:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.247+0000 7f15ce7fc700 1 -- 172.21.15.7:0/4227273848 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f15d0055090 con 0x7f15d815a0c0 2023-10-14T19:10:19.248 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:19.248 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":139,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:16.488614+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:13.861987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f15bc067320 msgr2=0x7f15bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f15bc067320 0x7f15bc0697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006fd0 tx=0x7f15c8008040 comp rx=0 tx=0).stop 2023-10-14T19:10:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 msgr2=0x7f15d80caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 0x7f15d80caa90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c8e0 tx=0x7f15d0001710 comp rx=0 tx=0).stop 2023-10-14T19:10:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 shutdown_connections 2023-10-14T19:10:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f15bc067320 0x7f15bc0697d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15d81508c0 0x7f15d80c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d815a0c0 0x7f15d80caa90 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 --2- 172.21.15.7:0/4227273848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15d8150c90 0x7f15d80c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 >> 172.21.15.7:0/4227273848 conn(0x7f15d80cded0 msgr2=0x7f15d8068590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 shutdown_connections 2023-10-14T19:10:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.249+0000 7f15e0418700 1 -- 172.21.15.7:0/4227273848 wait complete. 2023-10-14T19:10:19.262 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:10:19.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.381+0000 7ff96ffff700 1 Processor -- start 2023-10-14T19:10:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.381+0000 7ff96ffff700 1 -- start start 2023-10-14T19:10:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff970159550 0x7ff9700ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 0x7ff9700ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96ffff700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700acc00 con 0x7ff97015dfd0 2023-10-14T19:10:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700abff0 con 0x7ff970159550 2023-10-14T19:10:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700ac2d0 con 0x7ff970159920 2023-10-14T19:10:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff97015dfd0 0x7ff9700aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49502/0 (socket says 172.21.15.7:49502) 2023-10-14T19:10:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1343377688 learned_addr learned my addr 172.21.15.7:0/1343377688 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96f7fe700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 0x7ff9700ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96effd700 1 --2- 172.21.15.7:0/1343377688 >> v2:172.21.15.148:3300/0 conn(0x7ff970159550 0x7ff9700ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303369423 0 0) 0x7ff9700acc00 con 0x7ff97015dfd0 2023-10-14T19:10:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.382+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff95c003570 con 0x7ff97015dfd0 2023-10-14T19:10:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3525710606 0 0) 0x7ff95c003570 con 0x7ff97015dfd0 2023-10-14T19:10:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 msgr2=0x7ff9700ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 0x7ff9700ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 >> v2:172.21.15.148:3300/0 conn(0x7ff970159550 msgr2=0x7ff9700ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 --2- 172.21.15.7:0/1343377688 >> v2:172.21.15.148:3300/0 conn(0x7ff970159550 0x7ff9700ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700ac5b0 con 0x7ff97015dfd0 2023-10-14T19:10:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff958001470 con 0x7ff97015dfd0 2023-10-14T19:10:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 >> v1:172.21.15.7:6789/0 conn(0x7ff97015dfd0 legacy=0x7ff9700aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 0x7ff95c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95c003fe0 0x7ff95c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700abff0 con 0x7ff95c003fe0 2023-10-14T19:10:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700ac2d0 con 0x7ff95c004d50 2023-10-14T19:10:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00ba90 con 0x7ff970159920 2023-10-14T19:10:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95c003fe0 0x7ff95c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96effd700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 0x7ff95c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96f7fe700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 msgr2=0x7ff95c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970159920 0x7ff95c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c004d50 msgr2=0x7ff95c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1343377688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c003570 con 0x7ff95c003fe0 2023-10-14T19:10:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96f7fe700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95c003fe0 0x7ff95c004810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c3c0 tx=0x7ff958001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4214183f62631b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800cc30 con 0x7ff95c003fe0 2023-10-14T19:10:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800cdd0 con 0x7ff95c003fe0 2023-10-14T19:10:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.383+0000 7ff96dffb700 1 -- 172.21.15.7:0/1343377688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958005b70 con 0x7ff95c003fe0 2023-10-14T19:10:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96ffff700 1 -- 172.21.15.7:0/1343377688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95c003fe0 msgr2=0x7ff95c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1343377688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95c003fe0 0x7ff95c004810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c3c0 tx=0x7ff958001e90 comp rx=0 tx=0).stop 2023-10-14T19:10:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96f7fe700 1 -- 172.21.15.7:0/1343377688 reap_dead start 2023-10-14T19:10:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96ffff700 1 -- 172.21.15.7:0/1343377688 shutdown_connections 2023-10-14T19:10:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96ffff700 1 -- 172.21.15.7:0/1343377688 >> 172.21.15.7:0/1343377688 conn(0x7ff97006ce80 msgr2=0x7ff9700ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96ffff700 1 -- 172.21.15.7:0/1343377688 shutdown_connections 2023-10-14T19:10:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.384+0000 7ff96ffff700 1 -- 172.21.15.7:0/1343377688 wait complete. 2023-10-14T19:10:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.385+0000 7ff96ffff700 1 Processor -- start 2023-10-14T19:10:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.385+0000 7ff96ffff700 1 -- start start 2023-10-14T19:10:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c003fe0 0x7ff9700cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 0x7ff9700b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970167b40 0x7ff9700b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96ffff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b1cd0 con 0x7ff9700cdbc0 2023-10-14T19:10:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b4090 con 0x7ff95c003fe0 2023-10-14T19:10:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700c7e50 con 0x7ff970167b40 2023-10-14T19:10:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 0x7ff9700b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 0x7ff9700b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58872/0 (socket says 172.21.15.7:58872) 2023-10-14T19:10:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1034274448 learned_addr learned my addr 172.21.15.7:0/1034274448 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96f7fe700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970167b40 0x7ff9700b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96effd700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c003fe0 0x7ff9700cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970167b40 msgr2=0x7ff9700b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970167b40 0x7ff9700b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c003fe0 msgr2=0x7ff9700cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c003fe0 0x7ff9700cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96e7fc700 1 -- 172.21.15.7:0/1034274448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700c8130 con 0x7ff9700cdbc0 2023-10-14T19:10:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.386+0000 7ff96effd700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c003fe0 0x7ff9700cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.387+0000 7ff96e7fc700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 0x7ff9700b1250 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ff958011000 tx=0x7ff958015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.387+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800cc30 con 0x7ff9700cdbc0 2023-10-14T19:10:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.387+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580072e0 con 0x7ff9700cdbc0 2023-10-14T19:10:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.387+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580076a0 con 0x7ff9700cdbc0 2023-10-14T19:10:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.387+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700c8410 con 0x7ff9700cdbc0 2023-10-14T19:10:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.387+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700b35a0 con 0x7ff9700cdbc0 2023-10-14T19:10:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.388+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9700c8780 con 0x7ff9700cdbc0 2023-10-14T19:10:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.388+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff958019070 con 0x7ff9700cdbc0 2023-10-14T19:10:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.389+0000 7ff966ffd700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff950067320 0x7ff9500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.389+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff958085b60 con 0x7ff9700cdbc0 2023-10-14T19:10:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.389+0000 7ff96effd700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff950067320 0x7ff9500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.389+0000 7ff96effd700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff950067320 0x7ff9500697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff9680093f0 tx=0x7ff968008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.393+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9580527f0 con 0x7ff9700cdbc0 2023-10-14T19:10:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.580+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9700c7cb0 con 0x7ff950067320 2023-10-14T19:10:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.588+0000 7ff966ffd700 1 -- 172.21.15.7:0/1034274448 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274912 (secure 0 0 0) 0x7ff9700c7cb0 con 0x7ff950067320 2023-10-14T19:10:19.593 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:19.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff950067320 msgr2=0x7ff9500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff950067320 0x7ff9500697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff9680093f0 tx=0x7ff968008040 comp rx=0 tx=0).stop 2023-10-14T19:10:19.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 msgr2=0x7ff9700b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 0x7ff9700b1250 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ff958011000 tx=0x7ff958015000 comp rx=0 tx=0).stop 2023-10-14T19:10:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 shutdown_connections 2023-10-14T19:10:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff950067320 0x7ff9500697d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff95c003fe0 0x7ff9700cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff970167b40 0x7ff9700b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 --2- 172.21.15.7:0/1034274448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9700cdbc0 0x7ff9700b1250 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 >> 172.21.15.7:0/1034274448 conn(0x7ff97006ce80 msgr2=0x7ff970152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 shutdown_connections 2023-10-14T19:10:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.591+0000 7ff96ffff700 1 -- 172.21.15.7:0/1034274448 wait complete. 2023-10-14T19:10:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:19.604 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-10-14T19:10:17.725726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2425576,"kb_used_data":14504,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752549144,"statfs":{"total":773094113280,"available":770610323456,"internally_reserved":0,"allocated":14852096,"data_stored":7252168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.243236"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:14.481631+0000","last_change":"2023-10-14T19:10:14.481631+0000","last_active":"2023-10-14T19:10:14.481631+0000","last_peered":"2023-10-14T19:10:14.481631+0000","last_clean":"2023-10-14T19:10:14.481631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:14.481631+0000","last_undegraded":"2023-10-14T19:10:14.481631+0000","last_fullsized":"2023-10-14T19:10:14.481631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:13.476200+0000","last_change":"2023-10-14T19:10:13.476200+0000","last_active":"2023-10-14T19:10:13.476200+0000","last_peered":"2023-10-14T19:10:13.476200+0000","last_clean":"2023-10-14T19:10:13.476200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:13.476200+0000","last_undegraded":"2023-10-14T19:10:13.476200+0000","last_fullsized":"2023-10-14T19:10:13.476200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":254,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-14T19:10:10.475303+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:10.475303+0000","last_peered":"2023-10-14T19:10:10.475303+0000","last_clean":"2023-10-14T19:10:10.475303+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:10.475303+0000","last_undegraded":"2023-10-14T19:10:10.475303+0000","last_fullsized":"2023-10-14T19:10:10.475303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1349297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.67200000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":4.2080000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.67200000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.496}]},{"osd":1,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":3.1480000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.61499999999999999},"min":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.75700000000000001},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":3.23},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.78000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.57199999999999995},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":2.4620000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.70399999999999996},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.371}]},{"osd":5,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51900000000000002,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.86899999999999999,"15min":2.883},"last":0.38800000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.79300000000000004},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":5.383},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":758929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.629},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":758929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.216,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52300000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.36799999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.34899999999999998},"min":{"1min":0.28799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.54000000000000004},"min":{"1min":0.42299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":1.032,"15min":1.032},"last":0.74099999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.87,"5min":1.079,"15min":1.079},"last":0.79400000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1349297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33500000000000002,"15min":0.34399999999999997},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.309},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.41599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60899999999999999},"last":0.438}]},{"osd":3,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51400000000000001,"5min":0.62,"15min":0.62},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.45200000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82299999999999995,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":758929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.246},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.38300000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.48499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":758929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32300000000000001,"15min":0.35299999999999998},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.42399999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51200000000000001,"5min":0.57199999999999995,"15min":0.70099999999999996},"last":0.436}]},{"osd":1,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.64500000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36199999999999999,"15min":0.38500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.41399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":0.59999999999999998,"15min":0.81000000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.45000000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.624}]},{"osd":4,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.85299999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78500000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.80400000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.61399999999999999,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":758929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.73699999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.85699999999999998,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88600000000000001,"5min":3.488,"15min":3.488},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":1.254,"15min":1.254},"last":0.625}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":0.874,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.54500000000000004},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.57099999999999995,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64400000000000002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.442},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.63600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.878},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55200000000000005,"15min":0.60799999999999998},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.34399999999999997},"max":{"1min":0.61199999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":758929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.52400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71299999999999997,"5min":0.752,"15min":0.83899999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.499},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68000000000000005,"5min":0.71699999999999997,"15min":0.83199999999999996},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.876},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":5.8639999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89600000000000002},"last":0.625}]},{"osd":7,"last update":"Sat Oct 14 19:09:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.85299999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76100000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:19.612 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.763+0000 7f9ed8335700 1 Processor -- start 2023-10-14T19:10:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.763+0000 7f9ed8335700 1 -- start start 2023-10-14T19:10:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.764+0000 7f9ed8335700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ed00cf200 0x7f9ed00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.764+0000 7f9ed8335700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ed00b0ba0 0x7f9ed006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.764+0000 7f9ed8335700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed015a280 con 0x7f9ed00b07d0 2023-10-14T19:10:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.764+0000 7f9ed8335700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed006e180 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.764+0000 7f9ed8335700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed006d850 con 0x7f9ed00cf200 2023-10-14T19:10:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed60d1700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9ed00b07d0 0x7f9ed00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49512/0 (socket says 172.21.15.7:49512) 2023-10-14T19:10:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed60d1700 1 -- 172.21.15.7:0/1262039931 learned_addr learned my addr 172.21.15.7:0/1262039931 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed68d2700 1 --2- 172.21.15.7:0/1262039931 >> v2:172.21.15.7:3300/0 conn(0x7f9ed00b0ba0 0x7f9ed006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed58d0700 1 --2- 172.21.15.7:0/1262039931 >> v2:172.21.15.148:3300/0 conn(0x7f9ed00cf200 0x7f9ed00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed50cf700 1 -- 172.21.15.7:0/1262039931 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023748073 0 0) 0x7f9ed015a280 con 0x7f9ed00b07d0 2023-10-14T19:10:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed50cf700 1 -- 172.21.15.7:0/1262039931 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ebc003570 con 0x7f9ed00b07d0 2023-10-14T19:10:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed68d2700 1 -- 172.21.15.7:0/1262039931 >> v2:172.21.15.148:3300/0 conn(0x7f9ed00cf200 msgr2=0x7f9ed00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed68d2700 1 --2- 172.21.15.7:0/1262039931 >> v2:172.21.15.148:3300/0 conn(0x7f9ed00cf200 0x7f9ed00c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed68d2700 1 -- 172.21.15.7:0/1262039931 >> v1:172.21.15.7:6789/0 conn(0x7f9ed00b07d0 legacy=0x7f9ed00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed68d2700 1 -- 172.21.15.7:0/1262039931 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed006db30 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed68d2700 1 --2- 172.21.15.7:0/1262039931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed006e610 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00cab40 tx=0x7f9ec8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1df49860d52736 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed50cf700 1 -- 172.21.15.7:0/1262039931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800e070 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed50cf700 1 -- 172.21.15.7:0/1262039931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec800bb60 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.765+0000 7f9ed50cf700 1 -- 172.21.15.7:0/1262039931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8012430 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 -- 172.21.15.7:0/1262039931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 msgr2=0x7f9ed006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 --2- 172.21.15.7:0/1262039931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed006e610 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00cab40 tx=0x7f9ec8009780 comp rx=0 tx=0).stop 2023-10-14T19:10:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 -- 172.21.15.7:0/1262039931 shutdown_connections 2023-10-14T19:10:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 --2- 172.21.15.7:0/1262039931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed006e610 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 --2- 172.21.15.7:0/1262039931 >> v2:172.21.15.148:3300/0 conn(0x7f9ed00cf200 0x7f9ed00c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 -- 172.21.15.7:0/1262039931 >> 172.21.15.7:0/1262039931 conn(0x7f9ed006ce80 msgr2=0x7f9ed00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 -- 172.21.15.7:0/1262039931 shutdown_connections 2023-10-14T19:10:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.766+0000 7f9ed8335700 1 -- 172.21.15.7:0/1262039931 wait complete. 2023-10-14T19:10:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.767+0000 7f9ed8335700 1 Processor -- start 2023-10-14T19:10:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.767+0000 7f9ed8335700 1 -- start start 2023-10-14T19:10:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed8335700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ed00b07d0 0x7f9ed009b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed8335700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed0158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed8335700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ed00cf200 0x7f9ed016cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed8335700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed009acd0 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed8335700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed009a0c0 con 0x7f9ed00b07d0 2023-10-14T19:10:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed8335700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed009a3a0 con 0x7f9ed00cf200 2023-10-14T19:10:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed0158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed0158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58896/0 (socket says 172.21.15.7:58896) 2023-10-14T19:10:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 -- 172.21.15.7:0/2903768699 learned_addr learned my addr 172.21.15.7:0/2903768699 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed60d1700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ed00b07d0 0x7f9ed009b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed68d2700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ed00cf200 0x7f9ed016cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 -- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ed00cf200 msgr2=0x7f9ed016cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ed00cf200 0x7f9ed016cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 -- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ed00b07d0 msgr2=0x7f9ed009b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ed00b07d0 0x7f9ed009b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 -- 172.21.15.7:0/2903768699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8009a20 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.768+0000 7f9ed58d0700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed0158d00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000d890 tx=0x7f9ec0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.769+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000b600 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.769+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000b760 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.769+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed009a680 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.769+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000bae0 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.769+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed016dae0 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.769+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed009ae80 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.770+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9ec001e460 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.770+0000 7f9ec67fc700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9eb4067320 0x7f9eb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.771+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ec0085350 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.771+0000 7f9ed60d1700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9eb4067320 0x7f9eb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.771+0000 7f9ed60d1700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9eb4067320 0x7f9eb40697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001360 tx=0x7f9ecc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.775+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ed009ae80 con 0x7f9ed00b0ba0 2023-10-14T19:10:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.962+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ed004c3c0 con 0x7f9eb4067320 2023-10-14T19:10:19.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.971+0000 7f9ec67fc700 1 -- 172.21.15.7:0/2903768699 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290241 (secure 0 0 0) 0x7f9ed004c3c0 con 0x7f9eb4067320 2023-10-14T19:10:19.975 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9eb4067320 msgr2=0x7f9eb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9eb4067320 0x7f9eb40697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001360 tx=0x7f9ecc009040 comp rx=0 tx=0).stop 2023-10-14T19:10:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 msgr2=0x7f9ed0158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed0158d00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000d890 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2023-10-14T19:10:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 shutdown_connections 2023-10-14T19:10:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9eb4067320 0x7f9eb40697d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ed00b07d0 0x7f9ed009b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ed00cf200 0x7f9ed016cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 --2- 172.21.15.7:0/2903768699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ed00b0ba0 0x7f9ed0158d00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 >> 172.21.15.7:0/2903768699 conn(0x7f9ed006ce80 msgr2=0x7f9ed0067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 shutdown_connections 2023-10-14T19:10:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:19.974+0000 7f9ed8335700 1 -- 172.21.15.7:0/2903768699 wait complete. 2023-10-14T19:10:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:19.987 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2023-10-14T19:10:19.726208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425976,"kb_used_data":14904,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548744,"statfs":{"total":773094113280,"available":770609913856,"internally_reserved":0,"allocated":15261696,"data_stored":7432580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001583"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.518121+0000","last_change":"2023-10-14T19:10:15.515514+0000","last_active":"2023-10-14T19:10:15.518121+0000","last_peered":"2023-10-14T19:10:15.518121+0000","last_clean":"2023-10-14T19:10:15.518121+0000","last_became_active":"2023-10-14T19:10:15.515176+0000","last_became_peered":"2023-10-14T19:10:15.515176+0000","last_unstale":"2023-10-14T19:10:15.518121+0000","last_undegraded":"2023-10-14T19:10:15.518121+0000","last_fullsized":"2023-10-14T19:10:15.518121+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:45.156747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511715+0000","last_change":"2023-10-14T19:10:15.506663+0000","last_active":"2023-10-14T19:10:15.511715+0000","last_peered":"2023-10-14T19:10:15.511715+0000","last_clean":"2023-10-14T19:10:15.511715+0000","last_became_active":"2023-10-14T19:10:15.506393+0000","last_became_peered":"2023-10-14T19:10:15.506393+0000","last_unstale":"2023-10-14T19:10:15.511715+0000","last_undegraded":"2023-10-14T19:10:15.511715+0000","last_fullsized":"2023-10-14T19:10:15.511715+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:15.736120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.504861+0000","last_change":"2023-10-14T19:10:15.503880+0000","last_active":"2023-10-14T19:10:15.504861+0000","last_peered":"2023-10-14T19:10:15.504861+0000","last_clean":"2023-10-14T19:10:15.504861+0000","last_became_active":"2023-10-14T19:10:15.503571+0000","last_became_peered":"2023-10-14T19:10:15.503571+0000","last_unstale":"2023-10-14T19:10:15.504861+0000","last_undegraded":"2023-10-14T19:10:15.504861+0000","last_fullsized":"2023-10-14T19:10:15.504861+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:53:35.566865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512303+0000","last_change":"2023-10-14T19:10:15.510427+0000","last_active":"2023-10-14T19:10:15.512303+0000","last_peered":"2023-10-14T19:10:15.512303+0000","last_clean":"2023-10-14T19:10:15.512303+0000","last_became_active":"2023-10-14T19:10:15.510072+0000","last_became_peered":"2023-10-14T19:10:15.510072+0000","last_unstale":"2023-10-14T19:10:15.512303+0000","last_undegraded":"2023-10-14T19:10:15.512303+0000","last_fullsized":"2023-10-14T19:10:15.512303+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:10.814546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516937+0000","last_change":"2023-10-14T19:10:15.514061+0000","last_active":"2023-10-14T19:10:15.516937+0000","last_peered":"2023-10-14T19:10:15.516937+0000","last_clean":"2023-10-14T19:10:15.516937+0000","last_became_active":"2023-10-14T19:10:15.513795+0000","last_became_peered":"2023-10-14T19:10:15.513795+0000","last_unstale":"2023-10-14T19:10:15.516937+0000","last_undegraded":"2023-10-14T19:10:15.516937+0000","last_fullsized":"2023-10-14T19:10:15.516937+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:16.310173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.508577+0000","last_change":"2023-10-14T19:10:15.506508+0000","last_active":"2023-10-14T19:10:15.508577+0000","last_peered":"2023-10-14T19:10:15.508577+0000","last_clean":"2023-10-14T19:10:15.508577+0000","last_became_active":"2023-10-14T19:10:15.506203+0000","last_became_peered":"2023-10-14T19:10:15.506203+0000","last_unstale":"2023-10-14T19:10:15.508577+0000","last_undegraded":"2023-10-14T19:10:15.508577+0000","last_fullsized":"2023-10-14T19:10:15.508577+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:56.121877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512175+0000","last_change":"2023-10-14T19:10:15.509115+0000","last_active":"2023-10-14T19:10:15.512175+0000","last_peered":"2023-10-14T19:10:15.512175+0000","last_clean":"2023-10-14T19:10:15.512175+0000","last_became_active":"2023-10-14T19:10:15.508795+0000","last_became_peered":"2023-10-14T19:10:15.508795+0000","last_unstale":"2023-10-14T19:10:15.512175+0000","last_undegraded":"2023-10-14T19:10:15.512175+0000","last_fullsized":"2023-10-14T19:10:15.512175+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:43.413407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.495692+0000","last_change":"2023-10-14T19:10:15.495692+0000","last_active":"2023-10-14T19:10:15.495692+0000","last_peered":"2023-10-14T19:10:15.495692+0000","last_clean":"2023-10-14T19:10:15.495692+0000","last_became_active":"2023-10-14T19:10:15.495305+0000","last_became_peered":"2023-10-14T19:10:15.495305+0000","last_unstale":"2023-10-14T19:10:15.495692+0000","last_undegraded":"2023-10-14T19:10:15.495692+0000","last_fullsized":"2023-10-14T19:10:15.495692+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:15.090447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511332+0000","last_change":"2023-10-14T19:10:15.508090+0000","last_active":"2023-10-14T19:10:15.511332+0000","last_peered":"2023-10-14T19:10:15.511332+0000","last_clean":"2023-10-14T19:10:15.511332+0000","last_became_active":"2023-10-14T19:10:15.507805+0000","last_became_peered":"2023-10-14T19:10:15.507805+0000","last_unstale":"2023-10-14T19:10:15.511332+0000","last_undegraded":"2023-10-14T19:10:15.511332+0000","last_fullsized":"2023-10-14T19:10:15.511332+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:02:43.231385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516611+0000","last_change":"2023-10-14T19:10:15.516611+0000","last_active":"2023-10-14T19:10:15.516611+0000","last_peered":"2023-10-14T19:10:15.516611+0000","last_clean":"2023-10-14T19:10:15.516611+0000","last_became_active":"2023-10-14T19:10:15.514578+0000","last_became_peered":"2023-10-14T19:10:15.514578+0000","last_unstale":"2023-10-14T19:10:15.516611+0000","last_undegraded":"2023-10-14T19:10:15.516611+0000","last_fullsized":"2023-10-14T19:10:15.516611+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:12.235027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511694+0000","last_change":"2023-10-14T19:10:15.505653+0000","last_active":"2023-10-14T19:10:15.511694+0000","last_peered":"2023-10-14T19:10:15.511694+0000","last_clean":"2023-10-14T19:10:15.511694+0000","last_became_active":"2023-10-14T19:10:15.505399+0000","last_became_peered":"2023-10-14T19:10:15.505399+0000","last_unstale":"2023-10-14T19:10:15.511694+0000","last_undegraded":"2023-10-14T19:10:15.511694+0000","last_fullsized":"2023-10-14T19:10:15.511694+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:03.367872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511647+0000","last_change":"2023-10-14T19:10:15.508037+0000","last_active":"2023-10-14T19:10:15.511647+0000","last_peered":"2023-10-14T19:10:15.511647+0000","last_clean":"2023-10-14T19:10:15.511647+0000","last_became_active":"2023-10-14T19:10:15.507764+0000","last_became_peered":"2023-10-14T19:10:15.507764+0000","last_unstale":"2023-10-14T19:10:15.511647+0000","last_undegraded":"2023-10-14T19:10:15.511647+0000","last_fullsized":"2023-10-14T19:10:15.511647+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:45:26.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511996+0000","last_change":"2023-10-14T19:10:15.507822+0000","last_active":"2023-10-14T19:10:15.511996+0000","last_peered":"2023-10-14T19:10:15.511996+0000","last_clean":"2023-10-14T19:10:15.511996+0000","last_became_active":"2023-10-14T19:10:15.507517+0000","last_became_peered":"2023-10-14T19:10:15.507517+0000","last_unstale":"2023-10-14T19:10:15.511996+0000","last_undegraded":"2023-10-14T19:10:15.511996+0000","last_fullsized":"2023-10-14T19:10:15.511996+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:20.059828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516150+0000","last_change":"2023-10-14T19:10:15.515079+0000","last_active":"2023-10-14T19:10:15.516150+0000","last_peered":"2023-10-14T19:10:15.516150+0000","last_clean":"2023-10-14T19:10:15.516150+0000","last_became_active":"2023-10-14T19:10:15.514823+0000","last_became_peered":"2023-10-14T19:10:15.514823+0000","last_unstale":"2023-10-14T19:10:15.516150+0000","last_undegraded":"2023-10-14T19:10:15.516150+0000","last_fullsized":"2023-10-14T19:10:15.516150+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:05.738762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511885+0000","last_change":"2023-10-14T19:10:15.508816+0000","last_active":"2023-10-14T19:10:15.511885+0000","last_peered":"2023-10-14T19:10:15.511885+0000","last_clean":"2023-10-14T19:10:15.511885+0000","last_became_active":"2023-10-14T19:10:15.508246+0000","last_became_peered":"2023-10-14T19:10:15.508246+0000","last_unstale":"2023-10-14T19:10:15.511885+0000","last_undegraded":"2023-10-14T19:10:15.511885+0000","last_fullsized":"2023-10-14T19:10:15.511885+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:22.093724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.507467+0000","last_change":"2023-10-14T19:10:15.507467+0000","last_active":"2023-10-14T19:10:15.507467+0000","last_peered":"2023-10-14T19:10:15.507467+0000","last_clean":"2023-10-14T19:10:15.507467+0000","last_became_active":"2023-10-14T19:10:15.507162+0000","last_became_peered":"2023-10-14T19:10:15.507162+0000","last_unstale":"2023-10-14T19:10:15.507467+0000","last_undegraded":"2023-10-14T19:10:15.507467+0000","last_fullsized":"2023-10-14T19:10:15.507467+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:46.746453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.515929+0000","last_change":"2023-10-14T19:10:15.508382+0000","last_active":"2023-10-14T19:10:15.515929+0000","last_peered":"2023-10-14T19:10:15.515929+0000","last_clean":"2023-10-14T19:10:15.515929+0000","last_became_active":"2023-10-14T19:10:15.508135+0000","last_became_peered":"2023-10-14T19:10:15.508135+0000","last_unstale":"2023-10-14T19:10:15.515929+0000","last_undegraded":"2023-10-14T19:10:15.515929+0000","last_fullsized":"2023-10-14T19:10:15.515929+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:14.899404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.507288+0000","last_change":"2023-10-14T19:10:15.503510+0000","last_active":"2023-10-14T19:10:15.507288+0000","last_peered":"2023-10-14T19:10:15.507288+0000","last_clean":"2023-10-14T19:10:15.507288+0000","last_became_active":"2023-10-14T19:10:15.503252+0000","last_became_peered":"2023-10-14T19:10:15.503252+0000","last_unstale":"2023-10-14T19:10:15.507288+0000","last_undegraded":"2023-10-14T19:10:15.507288+0000","last_fullsized":"2023-10-14T19:10:15.507288+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:03.976688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512572+0000","last_change":"2023-10-14T19:10:15.512572+0000","last_active":"2023-10-14T19:10:15.512572+0000","last_peered":"2023-10-14T19:10:15.512572+0000","last_clean":"2023-10-14T19:10:15.512572+0000","last_became_active":"2023-10-14T19:10:15.509587+0000","last_became_peered":"2023-10-14T19:10:15.509587+0000","last_unstale":"2023-10-14T19:10:15.512572+0000","last_undegraded":"2023-10-14T19:10:15.512572+0000","last_fullsized":"2023-10-14T19:10:15.512572+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:10.992484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516390+0000","last_change":"2023-10-14T19:10:15.513828+0000","last_active":"2023-10-14T19:10:15.516390+0000","last_peered":"2023-10-14T19:10:15.516390+0000","last_clean":"2023-10-14T19:10:15.516390+0000","last_became_active":"2023-10-14T19:10:15.513534+0000","last_became_peered":"2023-10-14T19:10:15.513534+0000","last_unstale":"2023-10-14T19:10:15.516390+0000","last_undegraded":"2023-10-14T19:10:15.516390+0000","last_fullsized":"2023-10-14T19:10:15.516390+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:59.408387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.515436+0000","last_change":"2023-10-14T19:10:15.505677+0000","last_active":"2023-10-14T19:10:15.515436+0000","last_peered":"2023-10-14T19:10:15.515436+0000","last_clean":"2023-10-14T19:10:15.515436+0000","last_became_active":"2023-10-14T19:10:15.505389+0000","last_became_peered":"2023-10-14T19:10:15.505389+0000","last_unstale":"2023-10-14T19:10:15.515436+0000","last_undegraded":"2023-10-14T19:10:15.515436+0000","last_fullsized":"2023-10-14T19:10:15.515436+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:43:46.383819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.513989+0000","last_change":"2023-10-14T19:10:15.513989+0000","last_active":"2023-10-14T19:10:15.513989+0000","last_peered":"2023-10-14T19:10:15.513989+0000","last_clean":"2023-10-14T19:10:15.513989+0000","last_became_active":"2023-10-14T19:10:15.513491+0000","last_became_peered":"2023-10-14T19:10:15.513491+0000","last_unstale":"2023-10-14T19:10:15.513989+0000","last_undegraded":"2023-10-14T19:10:15.513989+0000","last_fullsized":"2023-10-14T19:10:15.513989+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:53:35.381151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.520437+0000","last_change":"2023-10-14T19:10:15.516775+0000","last_active":"2023-10-14T19:10:15.520437+0000","last_peered":"2023-10-14T19:10:15.520437+0000","last_clean":"2023-10-14T19:10:15.520437+0000","last_became_active":"2023-10-14T19:10:15.513082+0000","last_became_peered":"2023-10-14T19:10:15.513082+0000","last_unstale":"2023-10-14T19:10:15.520437+0000","last_undegraded":"2023-10-14T19:10:15.520437+0000","last_fullsized":"2023-10-14T19:10:15.520437+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:51.413269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.502320+0000","last_change":"2023-10-14T19:10:15.502320+0000","last_active":"2023-10-14T19:10:15.502320+0000","last_peered":"2023-10-14T19:10:15.502320+0000","last_clean":"2023-10-14T19:10:15.502320+0000","last_became_active":"2023-10-14T19:10:15.501960+0000","last_became_peered":"2023-10-14T19:10:15.501960+0000","last_unstale":"2023-10-14T19:10:15.502320+0000","last_undegraded":"2023-10-14T19:10:15.502320+0000","last_fullsized":"2023-10-14T19:10:15.502320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:05.673279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.520840+0000","last_change":"2023-10-14T19:10:15.518077+0000","last_active":"2023-10-14T19:10:15.520840+0000","last_peered":"2023-10-14T19:10:15.520840+0000","last_clean":"2023-10-14T19:10:15.520840+0000","last_became_active":"2023-10-14T19:10:15.517813+0000","last_became_peered":"2023-10-14T19:10:15.517813+0000","last_unstale":"2023-10-14T19:10:15.520840+0000","last_undegraded":"2023-10-14T19:10:15.520840+0000","last_fullsized":"2023-10-14T19:10:15.520840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:54.960958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512252+0000","last_change":"2023-10-14T19:10:15.509394+0000","last_active":"2023-10-14T19:10:15.512252+0000","last_peered":"2023-10-14T19:10:15.512252+0000","last_clean":"2023-10-14T19:10:15.512252+0000","last_became_active":"2023-10-14T19:10:15.508946+0000","last_became_peered":"2023-10-14T19:10:15.508946+0000","last_unstale":"2023-10-14T19:10:15.512252+0000","last_undegraded":"2023-10-14T19:10:15.512252+0000","last_fullsized":"2023-10-14T19:10:15.512252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:47.414253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.508604+0000","last_change":"2023-10-14T19:10:15.506380+0000","last_active":"2023-10-14T19:10:15.508604+0000","last_peered":"2023-10-14T19:10:15.508604+0000","last_clean":"2023-10-14T19:10:15.508604+0000","last_became_active":"2023-10-14T19:10:15.506067+0000","last_became_peered":"2023-10-14T19:10:15.506067+0000","last_unstale":"2023-10-14T19:10:15.508604+0000","last_undegraded":"2023-10-14T19:10:15.508604+0000","last_fullsized":"2023-10-14T19:10:15.508604+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:18.116659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.515530+0000","last_change":"2023-10-14T19:10:15.511935+0000","last_active":"2023-10-14T19:10:15.515530+0000","last_peered":"2023-10-14T19:10:15.515530+0000","last_clean":"2023-10-14T19:10:15.515530+0000","last_became_active":"2023-10-14T19:10:15.511595+0000","last_became_peered":"2023-10-14T19:10:15.511595+0000","last_unstale":"2023-10-14T19:10:15.515530+0000","last_undegraded":"2023-10-14T19:10:15.515530+0000","last_fullsized":"2023-10-14T19:10:15.515530+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:07:20.422901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512013+0000","last_change":"2023-10-14T19:10:15.507976+0000","last_active":"2023-10-14T19:10:15.512013+0000","last_peered":"2023-10-14T19:10:15.512013+0000","last_clean":"2023-10-14T19:10:15.512013+0000","last_became_active":"2023-10-14T19:10:15.507708+0000","last_became_peered":"2023-10-14T19:10:15.507708+0000","last_unstale":"2023-10-14T19:10:15.512013+0000","last_undegraded":"2023-10-14T19:10:15.512013+0000","last_fullsized":"2023-10-14T19:10:15.512013+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:33.363921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.502725+0000","last_change":"2023-10-14T19:10:15.499676+0000","last_active":"2023-10-14T19:10:15.502725+0000","last_peered":"2023-10-14T19:10:15.502725+0000","last_clean":"2023-10-14T19:10:15.502725+0000","last_became_active":"2023-10-14T19:10:15.499171+0000","last_became_peered":"2023-10-14T19:10:15.499171+0000","last_unstale":"2023-10-14T19:10:15.502725+0000","last_undegraded":"2023-10-14T19:10:15.502725+0000","last_fullsized":"2023-10-14T19:10:15.502725+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:20.059828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516642+0000","last_change":"2023-10-14T19:10:15.508648+0000","last_active":"2023-10-14T19:10:15.516642+0000","last_peered":"2023-10-14T19:10:15.516642+0000","last_clean":"2023-10-14T19:10:15.516642+0000","last_became_active":"2023-10-14T19:10:15.507770+0000","last_became_peered":"2023-10-14T19:10:15.507770+0000","last_unstale":"2023-10-14T19:10:15.516642+0000","last_undegraded":"2023-10-14T19:10:15.516642+0000","last_fullsized":"2023-10-14T19:10:15.516642+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:00.417203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.515166+0000","last_change":"2023-10-14T19:10:15.505438+0000","last_active":"2023-10-14T19:10:15.515166+0000","last_peered":"2023-10-14T19:10:15.515166+0000","last_clean":"2023-10-14T19:10:15.515166+0000","last_became_active":"2023-10-14T19:10:15.505061+0000","last_became_peered":"2023-10-14T19:10:15.505061+0000","last_unstale":"2023-10-14T19:10:15.515166+0000","last_undegraded":"2023-10-14T19:10:15.515166+0000","last_fullsized":"2023-10-14T19:10:15.515166+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:04.484273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.509028+0000","last_change":"2023-10-14T19:10:15.509028+0000","last_active":"2023-10-14T19:10:15.509028+0000","last_peered":"2023-10-14T19:10:15.509028+0000","last_clean":"2023-10-14T19:10:15.509028+0000","last_became_active":"2023-10-14T19:10:15.506700+0000","last_became_peered":"2023-10-14T19:10:15.506700+0000","last_unstale":"2023-10-14T19:10:15.509028+0000","last_undegraded":"2023-10-14T19:10:15.509028+0000","last_fullsized":"2023-10-14T19:10:15.509028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:07.787662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.515858+0000","last_change":"2023-10-14T19:10:14.508062+0000","last_active":"2023-10-14T19:10:15.515858+0000","last_peered":"2023-10-14T19:10:15.515858+0000","last_clean":"2023-10-14T19:10:15.515858+0000","last_became_active":"2023-10-14T19:10:14.507591+0000","last_became_peered":"2023-10-14T19:10:14.507591+0000","last_unstale":"2023-10-14T19:10:15.515858+0000","last_undegraded":"2023-10-14T19:10:15.515858+0000","last_fullsized":"2023-10-14T19:10:15.515858+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:32.096615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.522895+0000","last_change":"2023-10-14T19:10:15.522895+0000","last_active":"2023-10-14T19:10:15.522895+0000","last_peered":"2023-10-14T19:10:15.522895+0000","last_clean":"2023-10-14T19:10:15.522895+0000","last_became_active":"2023-10-14T19:10:15.522617+0000","last_became_peered":"2023-10-14T19:10:15.522617+0000","last_unstale":"2023-10-14T19:10:15.522895+0000","last_undegraded":"2023-10-14T19:10:15.522895+0000","last_fullsized":"2023-10-14T19:10:15.522895+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:04.859794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.518291+0000","last_change":"2023-10-14T19:10:14.504137+0000","last_active":"2023-10-14T19:10:15.518291+0000","last_peered":"2023-10-14T19:10:15.518291+0000","last_clean":"2023-10-14T19:10:15.518291+0000","last_became_active":"2023-10-14T19:10:14.503820+0000","last_became_peered":"2023-10-14T19:10:14.503820+0000","last_unstale":"2023-10-14T19:10:15.518291+0000","last_undegraded":"2023-10-14T19:10:15.518291+0000","last_fullsized":"2023-10-14T19:10:15.518291+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:42.008072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516345+0000","last_change":"2023-10-14T19:10:15.515749+0000","last_active":"2023-10-14T19:10:15.516345+0000","last_peered":"2023-10-14T19:10:15.516345+0000","last_clean":"2023-10-14T19:10:15.516345+0000","last_became_active":"2023-10-14T19:10:15.515542+0000","last_became_peered":"2023-10-14T19:10:15.515542+0000","last_unstale":"2023-10-14T19:10:15.516345+0000","last_undegraded":"2023-10-14T19:10:15.516345+0000","last_fullsized":"2023-10-14T19:10:15.516345+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:15.315574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.518974+0000","last_change":"2023-10-14T19:10:14.509083+0000","last_active":"2023-10-14T19:10:15.518974+0000","last_peered":"2023-10-14T19:10:15.518974+0000","last_clean":"2023-10-14T19:10:15.518974+0000","last_became_active":"2023-10-14T19:10:14.508448+0000","last_became_peered":"2023-10-14T19:10:14.508448+0000","last_unstale":"2023-10-14T19:10:15.518974+0000","last_undegraded":"2023-10-14T19:10:15.518974+0000","last_fullsized":"2023-10-14T19:10:15.518974+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:04.733331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.500802+0000","last_change":"2023-10-14T19:10:15.499365+0000","last_active":"2023-10-14T19:10:15.500802+0000","last_peered":"2023-10-14T19:10:15.500802+0000","last_clean":"2023-10-14T19:10:15.500802+0000","last_became_active":"2023-10-14T19:10:15.499083+0000","last_became_peered":"2023-10-14T19:10:15.499083+0000","last_unstale":"2023-10-14T19:10:15.500802+0000","last_undegraded":"2023-10-14T19:10:15.500802+0000","last_fullsized":"2023-10-14T19:10:15.500802+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:15.736120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511428+0000","last_change":"2023-10-14T19:10:14.501271+0000","last_active":"2023-10-14T19:10:15.511428+0000","last_peered":"2023-10-14T19:10:15.511428+0000","last_clean":"2023-10-14T19:10:15.511428+0000","last_became_active":"2023-10-14T19:10:14.500945+0000","last_became_peered":"2023-10-14T19:10:14.500945+0000","last_unstale":"2023-10-14T19:10:15.511428+0000","last_undegraded":"2023-10-14T19:10:15.511428+0000","last_fullsized":"2023-10-14T19:10:15.511428+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:43:45.378388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.513760+0000","last_change":"2023-10-14T19:10:15.513760+0000","last_active":"2023-10-14T19:10:15.513760+0000","last_peered":"2023-10-14T19:10:15.513760+0000","last_clean":"2023-10-14T19:10:15.513760+0000","last_became_active":"2023-10-14T19:10:15.513138+0000","last_became_peered":"2023-10-14T19:10:15.513138+0000","last_unstale":"2023-10-14T19:10:15.513760+0000","last_undegraded":"2023-10-14T19:10:15.513760+0000","last_fullsized":"2023-10-14T19:10:15.513760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:05:59.628940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.519406+0000","last_change":"2023-10-14T19:10:14.507442+0000","last_active":"2023-10-14T19:10:15.519406+0000","last_peered":"2023-10-14T19:10:15.519406+0000","last_clean":"2023-10-14T19:10:15.519406+0000","last_became_active":"2023-10-14T19:10:14.506879+0000","last_became_peered":"2023-10-14T19:10:14.506879+0000","last_unstale":"2023-10-14T19:10:15.519406+0000","last_undegraded":"2023-10-14T19:10:15.519406+0000","last_fullsized":"2023-10-14T19:10:15.519406+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:15.460894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.508382+0000","last_change":"2023-10-14T19:10:15.508382+0000","last_active":"2023-10-14T19:10:15.508382+0000","last_peered":"2023-10-14T19:10:15.508382+0000","last_clean":"2023-10-14T19:10:15.508382+0000","last_became_active":"2023-10-14T19:10:15.508084+0000","last_became_peered":"2023-10-14T19:10:15.508084+0000","last_unstale":"2023-10-14T19:10:15.508382+0000","last_undegraded":"2023-10-14T19:10:15.508382+0000","last_fullsized":"2023-10-14T19:10:15.508382+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:03.273724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"138'1","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.491790+0000","last_change":"2023-10-14T19:10:14.501029+0000","last_active":"2023-10-14T19:10:15.491790+0000","last_peered":"2023-10-14T19:10:15.491790+0000","last_clean":"2023-10-14T19:10:15.491790+0000","last_became_active":"2023-10-14T19:10:14.500356+0000","last_became_peered":"2023-10-14T19:10:14.500356+0000","last_unstale":"2023-10-14T19:10:15.491790+0000","last_undegraded":"2023-10-14T19:10:15.491790+0000","last_fullsized":"2023-10-14T19:10:15.491790+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:51.073665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.504710+0000","last_change":"2023-10-14T19:10:15.500873+0000","last_active":"2023-10-14T19:10:15.504710+0000","last_peered":"2023-10-14T19:10:15.504710+0000","last_clean":"2023-10-14T19:10:15.504710+0000","last_became_active":"2023-10-14T19:10:15.500650+0000","last_became_peered":"2023-10-14T19:10:15.500650+0000","last_unstale":"2023-10-14T19:10:15.504710+0000","last_undegraded":"2023-10-14T19:10:15.504710+0000","last_fullsized":"2023-10-14T19:10:15.504710+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:09.486838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.494631+0000","last_change":"2023-10-14T19:10:14.502983+0000","last_active":"2023-10-14T19:10:15.494631+0000","last_peered":"2023-10-14T19:10:15.494631+0000","last_clean":"2023-10-14T19:10:15.494631+0000","last_became_active":"2023-10-14T19:10:14.502753+0000","last_became_peered":"2023-10-14T19:10:14.502753+0000","last_unstale":"2023-10-14T19:10:15.494631+0000","last_undegraded":"2023-10-14T19:10:15.494631+0000","last_fullsized":"2023-10-14T19:10:15.494631+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:56.651842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511249+0000","last_change":"2023-10-14T19:10:15.505927+0000","last_active":"2023-10-14T19:10:15.511249+0000","last_peered":"2023-10-14T19:10:15.511249+0000","last_clean":"2023-10-14T19:10:15.511249+0000","last_became_active":"2023-10-14T19:10:15.505049+0000","last_became_peered":"2023-10-14T19:10:15.505049+0000","last_unstale":"2023-10-14T19:10:15.511249+0000","last_undegraded":"2023-10-14T19:10:15.511249+0000","last_fullsized":"2023-10-14T19:10:15.511249+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:03.987656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.492274+0000","last_change":"2023-10-14T19:10:14.504848+0000","last_active":"2023-10-14T19:10:15.492274+0000","last_peered":"2023-10-14T19:10:15.492274+0000","last_clean":"2023-10-14T19:10:15.492274+0000","last_became_active":"2023-10-14T19:10:14.504573+0000","last_became_peered":"2023-10-14T19:10:14.504573+0000","last_unstale":"2023-10-14T19:10:15.492274+0000","last_undegraded":"2023-10-14T19:10:15.492274+0000","last_fullsized":"2023-10-14T19:10:15.492274+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:30:32.358490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.510503+0000","last_change":"2023-10-14T19:10:15.510503+0000","last_active":"2023-10-14T19:10:15.510503+0000","last_peered":"2023-10-14T19:10:15.510503+0000","last_clean":"2023-10-14T19:10:15.510503+0000","last_became_active":"2023-10-14T19:10:15.510255+0000","last_became_peered":"2023-10-14T19:10:15.510255+0000","last_unstale":"2023-10-14T19:10:15.510503+0000","last_undegraded":"2023-10-14T19:10:15.510503+0000","last_fullsized":"2023-10-14T19:10:15.510503+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:49.427908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.497640+0000","last_change":"2023-10-14T19:10:14.509737+0000","last_active":"2023-10-14T19:10:15.497640+0000","last_peered":"2023-10-14T19:10:15.497640+0000","last_clean":"2023-10-14T19:10:15.497640+0000","last_became_active":"2023-10-14T19:10:14.509481+0000","last_became_peered":"2023-10-14T19:10:14.509481+0000","last_unstale":"2023-10-14T19:10:15.497640+0000","last_undegraded":"2023-10-14T19:10:15.497640+0000","last_fullsized":"2023-10-14T19:10:15.497640+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:18.446684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.503480+0000","last_change":"2023-10-14T19:10:15.499385+0000","last_active":"2023-10-14T19:10:15.503480+0000","last_peered":"2023-10-14T19:10:15.503480+0000","last_clean":"2023-10-14T19:10:15.503480+0000","last_became_active":"2023-10-14T19:10:15.498507+0000","last_became_peered":"2023-10-14T19:10:15.498507+0000","last_unstale":"2023-10-14T19:10:15.503480+0000","last_undegraded":"2023-10-14T19:10:15.503480+0000","last_fullsized":"2023-10-14T19:10:15.503480+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:52.625839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.523207+0000","last_change":"2023-10-14T19:10:14.505752+0000","last_active":"2023-10-14T19:10:15.523207+0000","last_peered":"2023-10-14T19:10:15.523207+0000","last_clean":"2023-10-14T19:10:15.523207+0000","last_became_active":"2023-10-14T19:10:14.505470+0000","last_became_peered":"2023-10-14T19:10:14.505470+0000","last_unstale":"2023-10-14T19:10:15.523207+0000","last_undegraded":"2023-10-14T19:10:15.523207+0000","last_fullsized":"2023-10-14T19:10:15.523207+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:04.664856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.520354+0000","last_change":"2023-10-14T19:10:15.520354+0000","last_active":"2023-10-14T19:10:15.520354+0000","last_peered":"2023-10-14T19:10:15.520354+0000","last_clean":"2023-10-14T19:10:15.520354+0000","last_became_active":"2023-10-14T19:10:15.520053+0000","last_became_peered":"2023-10-14T19:10:15.520053+0000","last_unstale":"2023-10-14T19:10:15.520354+0000","last_undegraded":"2023-10-14T19:10:15.520354+0000","last_fullsized":"2023-10-14T19:10:15.520354+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:56.918652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"138'6","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.524282+0000","last_change":"2023-10-14T19:10:14.507426+0000","last_active":"2023-10-14T19:10:15.524282+0000","last_peered":"2023-10-14T19:10:15.524282+0000","last_clean":"2023-10-14T19:10:15.524282+0000","last_became_active":"2023-10-14T19:10:14.507151+0000","last_became_peered":"2023-10-14T19:10:14.507151+0000","last_unstale":"2023-10-14T19:10:15.524282+0000","last_undegraded":"2023-10-14T19:10:15.524282+0000","last_fullsized":"2023-10-14T19:10:15.524282+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:09.809115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.520140+0000","last_change":"2023-10-14T19:10:15.517539+0000","last_active":"2023-10-14T19:10:15.520140+0000","last_peered":"2023-10-14T19:10:15.520140+0000","last_clean":"2023-10-14T19:10:15.520140+0000","last_became_active":"2023-10-14T19:10:15.517195+0000","last_became_peered":"2023-10-14T19:10:15.517195+0000","last_unstale":"2023-10-14T19:10:15.520140+0000","last_undegraded":"2023-10-14T19:10:15.520140+0000","last_fullsized":"2023-10-14T19:10:15.520140+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:46.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.523094+0000","last_change":"2023-10-14T19:10:14.505800+0000","last_active":"2023-10-14T19:10:15.523094+0000","last_peered":"2023-10-14T19:10:15.523094+0000","last_clean":"2023-10-14T19:10:15.523094+0000","last_became_active":"2023-10-14T19:10:14.505493+0000","last_became_peered":"2023-10-14T19:10:14.505493+0000","last_unstale":"2023-10-14T19:10:15.523094+0000","last_undegraded":"2023-10-14T19:10:15.523094+0000","last_fullsized":"2023-10-14T19:10:15.523094+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:23:37.864867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512647+0000","last_change":"2023-10-14T19:10:15.510864+0000","last_active":"2023-10-14T19:10:15.512647+0000","last_peered":"2023-10-14T19:10:15.512647+0000","last_clean":"2023-10-14T19:10:15.512647+0000","last_became_active":"2023-10-14T19:10:15.510675+0000","last_became_peered":"2023-10-14T19:10:15.510675+0000","last_unstale":"2023-10-14T19:10:15.512647+0000","last_undegraded":"2023-10-14T19:10:15.512647+0000","last_fullsized":"2023-10-14T19:10:15.512647+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:27:37.472157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T19:10:14.512524+0000","last_change":"2023-10-14T19:10:14.511317+0000","last_active":"2023-10-14T19:10:14.512524+0000","last_peered":"2023-10-14T19:10:14.512524+0000","last_clean":"2023-10-14T19:10:14.512524+0000","last_became_active":"2023-10-14T19:10:14.511025+0000","last_became_peered":"2023-10-14T19:10:14.511025+0000","last_unstale":"2023-10-14T19:10:14.512524+0000","last_undegraded":"2023-10-14T19:10:14.512524+0000","last_fullsized":"2023-10-14T19:10:14.512524+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:34:15.975283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511357+0000","last_change":"2023-10-14T19:10:15.509959+0000","last_active":"2023-10-14T19:10:15.511357+0000","last_peered":"2023-10-14T19:10:15.511357+0000","last_clean":"2023-10-14T19:10:15.511357+0000","last_became_active":"2023-10-14T19:10:15.509688+0000","last_became_peered":"2023-10-14T19:10:15.509688+0000","last_unstale":"2023-10-14T19:10:15.511357+0000","last_undegraded":"2023-10-14T19:10:15.511357+0000","last_fullsized":"2023-10-14T19:10:15.511357+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:21:10.814546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T19:10:14.509508+0000","last_change":"2023-10-14T19:10:14.507220+0000","last_active":"2023-10-14T19:10:14.509508+0000","last_peered":"2023-10-14T19:10:14.509508+0000","last_clean":"2023-10-14T19:10:14.509508+0000","last_became_active":"2023-10-14T19:10:14.506899+0000","last_became_peered":"2023-10-14T19:10:14.506899+0000","last_unstale":"2023-10-14T19:10:14.509508+0000","last_undegraded":"2023-10-14T19:10:14.509508+0000","last_fullsized":"2023-10-14T19:10:14.509508+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:56.651842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.508953+0000","last_change":"2023-10-14T19:10:15.508953+0000","last_active":"2023-10-14T19:10:15.508953+0000","last_peered":"2023-10-14T19:10:15.508953+0000","last_clean":"2023-10-14T19:10:15.508953+0000","last_became_active":"2023-10-14T19:10:15.508676+0000","last_became_peered":"2023-10-14T19:10:15.508676+0000","last_unstale":"2023-10-14T19:10:15.508953+0000","last_undegraded":"2023-10-14T19:10:15.508953+0000","last_fullsized":"2023-10-14T19:10:15.508953+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.359545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"138'8","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.523595+0000","last_change":"2023-10-14T19:10:14.505595+0000","last_active":"2023-10-14T19:10:15.523595+0000","last_peered":"2023-10-14T19:10:15.523595+0000","last_clean":"2023-10-14T19:10:15.523595+0000","last_became_active":"2023-10-14T19:10:14.505296+0000","last_became_peered":"2023-10-14T19:10:14.505296+0000","last_unstale":"2023-10-14T19:10:15.523595+0000","last_undegraded":"2023-10-14T19:10:15.523595+0000","last_fullsized":"2023-10-14T19:10:15.523595+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:18.707075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512192+0000","last_change":"2023-10-14T19:10:15.512192+0000","last_active":"2023-10-14T19:10:15.512192+0000","last_peered":"2023-10-14T19:10:15.512192+0000","last_clean":"2023-10-14T19:10:15.512192+0000","last_became_active":"2023-10-14T19:10:15.508274+0000","last_became_peered":"2023-10-14T19:10:15.508274+0000","last_unstale":"2023-10-14T19:10:15.512192+0000","last_undegraded":"2023-10-14T19:10:15.512192+0000","last_fullsized":"2023-10-14T19:10:15.512192+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:08.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.520843+0000","last_change":"2023-10-14T19:10:14.510739+0000","last_active":"2023-10-14T19:10:15.520843+0000","last_peered":"2023-10-14T19:10:15.520843+0000","last_clean":"2023-10-14T19:10:15.520843+0000","last_became_active":"2023-10-14T19:10:14.510477+0000","last_became_peered":"2023-10-14T19:10:14.510477+0000","last_unstale":"2023-10-14T19:10:15.520843+0000","last_undegraded":"2023-10-14T19:10:15.520843+0000","last_fullsized":"2023-10-14T19:10:15.520843+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:52.667502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.523311+0000","last_change":"2023-10-14T19:10:15.518043+0000","last_active":"2023-10-14T19:10:15.523311+0000","last_peered":"2023-10-14T19:10:15.523311+0000","last_clean":"2023-10-14T19:10:15.523311+0000","last_became_active":"2023-10-14T19:10:15.517758+0000","last_became_peered":"2023-10-14T19:10:15.517758+0000","last_unstale":"2023-10-14T19:10:15.523311+0000","last_undegraded":"2023-10-14T19:10:15.523311+0000","last_fullsized":"2023-10-14T19:10:15.523311+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:09.486838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"138'2","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.522276+0000","last_change":"2023-10-14T19:10:14.509391+0000","last_active":"2023-10-14T19:10:15.522276+0000","last_peered":"2023-10-14T19:10:15.522276+0000","last_clean":"2023-10-14T19:10:15.522276+0000","last_became_active":"2023-10-14T19:10:14.509105+0000","last_became_peered":"2023-10-14T19:10:14.509105+0000","last_unstale":"2023-10-14T19:10:15.522276+0000","last_undegraded":"2023-10-14T19:10:15.522276+0000","last_fullsized":"2023-10-14T19:10:15.522276+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:18.707075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.502820+0000","last_change":"2023-10-14T19:10:15.500246+0000","last_active":"2023-10-14T19:10:15.502820+0000","last_peered":"2023-10-14T19:10:15.502820+0000","last_clean":"2023-10-14T19:10:15.502820+0000","last_became_active":"2023-10-14T19:10:15.499986+0000","last_became_peered":"2023-10-14T19:10:15.499986+0000","last_unstale":"2023-10-14T19:10:15.502820+0000","last_undegraded":"2023-10-14T19:10:15.502820+0000","last_fullsized":"2023-10-14T19:10:15.502820+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:54.960958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.522903+0000","last_change":"2023-10-14T19:10:14.506126+0000","last_active":"2023-10-14T19:10:15.522903+0000","last_peered":"2023-10-14T19:10:15.522903+0000","last_clean":"2023-10-14T19:10:15.522903+0000","last_became_active":"2023-10-14T19:10:14.505865+0000","last_became_peered":"2023-10-14T19:10:14.505865+0000","last_unstale":"2023-10-14T19:10:15.522903+0000","last_undegraded":"2023-10-14T19:10:15.522903+0000","last_fullsized":"2023-10-14T19:10:15.522903+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:58:50.330096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.512296+0000","last_change":"2023-10-14T19:10:15.510394+0000","last_active":"2023-10-14T19:10:15.512296+0000","last_peered":"2023-10-14T19:10:15.512296+0000","last_clean":"2023-10-14T19:10:15.512296+0000","last_became_active":"2023-10-14T19:10:15.510002+0000","last_became_peered":"2023-10-14T19:10:15.510002+0000","last_unstale":"2023-10-14T19:10:15.512296+0000","last_undegraded":"2023-10-14T19:10:15.512296+0000","last_fullsized":"2023-10-14T19:10:15.512296+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:02:43.231385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.492690+0000","last_change":"2023-10-14T19:10:14.500293+0000","last_active":"2023-10-14T19:10:15.492690+0000","last_peered":"2023-10-14T19:10:15.492690+0000","last_clean":"2023-10-14T19:10:15.492690+0000","last_became_active":"2023-10-14T19:10:14.499775+0000","last_became_peered":"2023-10-14T19:10:14.499775+0000","last_unstale":"2023-10-14T19:10:15.492690+0000","last_undegraded":"2023-10-14T19:10:15.492690+0000","last_fullsized":"2023-10-14T19:10:15.492690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:21.088293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.522105+0000","last_change":"2023-10-14T19:10:15.522105+0000","last_active":"2023-10-14T19:10:15.522105+0000","last_peered":"2023-10-14T19:10:15.522105+0000","last_clean":"2023-10-14T19:10:15.522105+0000","last_became_active":"2023-10-14T19:10:15.521499+0000","last_became_peered":"2023-10-14T19:10:15.521499+0000","last_unstale":"2023-10-14T19:10:15.522105+0000","last_undegraded":"2023-10-14T19:10:15.522105+0000","last_fullsized":"2023-10-14T19:10:15.522105+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:07:34.516117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.517828+0000","last_change":"2023-10-14T19:10:14.510403+0000","last_active":"2023-10-14T19:10:15.517828+0000","last_peered":"2023-10-14T19:10:15.517828+0000","last_clean":"2023-10-14T19:10:15.517828+0000","last_became_active":"2023-10-14T19:10:14.509079+0000","last_became_peered":"2023-10-14T19:10:14.509079+0000","last_unstale":"2023-10-14T19:10:15.517828+0000","last_undegraded":"2023-10-14T19:10:15.517828+0000","last_fullsized":"2023-10-14T19:10:15.517828+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:08.481407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.503653+0000","last_change":"2023-10-14T19:10:15.499786+0000","last_active":"2023-10-14T19:10:15.503653+0000","last_peered":"2023-10-14T19:10:15.503653+0000","last_clean":"2023-10-14T19:10:15.503653+0000","last_became_active":"2023-10-14T19:10:15.499483+0000","last_became_peered":"2023-10-14T19:10:15.499483+0000","last_unstale":"2023-10-14T19:10:15.503653+0000","last_undegraded":"2023-10-14T19:10:15.503653+0000","last_fullsized":"2023-10-14T19:10:15.503653+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:16.178241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.496559+0000","last_change":"2023-10-14T19:10:14.498525+0000","last_active":"2023-10-14T19:10:15.496559+0000","last_peered":"2023-10-14T19:10:15.496559+0000","last_clean":"2023-10-14T19:10:15.496559+0000","last_became_active":"2023-10-14T19:10:14.498259+0000","last_became_peered":"2023-10-14T19:10:14.498259+0000","last_unstale":"2023-10-14T19:10:15.496559+0000","last_undegraded":"2023-10-14T19:10:15.496559+0000","last_fullsized":"2023-10-14T19:10:15.496559+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:06.747349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511768+0000","last_change":"2023-10-14T19:10:15.508324+0000","last_active":"2023-10-14T19:10:15.511768+0000","last_peered":"2023-10-14T19:10:15.511768+0000","last_clean":"2023-10-14T19:10:15.511768+0000","last_became_active":"2023-10-14T19:10:15.508074+0000","last_became_peered":"2023-10-14T19:10:15.508074+0000","last_unstale":"2023-10-14T19:10:15.511768+0000","last_undegraded":"2023-10-14T19:10:15.511768+0000","last_fullsized":"2023-10-14T19:10:15.511768+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:23.636663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.494964+0000","last_change":"2023-10-14T19:10:14.511356+0000","last_active":"2023-10-14T19:10:15.494964+0000","last_peered":"2023-10-14T19:10:15.494964+0000","last_clean":"2023-10-14T19:10:15.494964+0000","last_became_active":"2023-10-14T19:10:14.511109+0000","last_became_peered":"2023-10-14T19:10:14.511109+0000","last_unstale":"2023-10-14T19:10:15.494964+0000","last_undegraded":"2023-10-14T19:10:15.494964+0000","last_fullsized":"2023-10-14T19:10:15.494964+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:27:36.466726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516249+0000","last_change":"2023-10-14T19:10:15.513834+0000","last_active":"2023-10-14T19:10:15.516249+0000","last_peered":"2023-10-14T19:10:15.516249+0000","last_clean":"2023-10-14T19:10:15.516249+0000","last_became_active":"2023-10-14T19:10:15.513492+0000","last_became_peered":"2023-10-14T19:10:15.513492+0000","last_unstale":"2023-10-14T19:10:15.516249+0000","last_undegraded":"2023-10-14T19:10:15.516249+0000","last_fullsized":"2023-10-14T19:10:15.516249+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:19.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.497340+0000","last_change":"2023-10-14T19:10:14.507124+0000","last_active":"2023-10-14T19:10:15.497340+0000","last_peered":"2023-10-14T19:10:15.497340+0000","last_clean":"2023-10-14T19:10:15.497340+0000","last_became_active":"2023-10-14T19:10:14.506833+0000","last_became_peered":"2023-10-14T19:10:14.506833+0000","last_unstale":"2023-10-14T19:10:15.497340+0000","last_undegraded":"2023-10-14T19:10:15.497340+0000","last_fullsized":"2023-10-14T19:10:15.497340+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:53.002063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516286+0000","last_change":"2023-10-14T19:10:15.513768+0000","last_active":"2023-10-14T19:10:15.516286+0000","last_peered":"2023-10-14T19:10:15.516286+0000","last_clean":"2023-10-14T19:10:15.516286+0000","last_became_active":"2023-10-14T19:10:15.513380+0000","last_became_peered":"2023-10-14T19:10:15.513380+0000","last_unstale":"2023-10-14T19:10:15.516286+0000","last_undegraded":"2023-10-14T19:10:15.516286+0000","last_fullsized":"2023-10-14T19:10:15.516286+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:27.292020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.521836+0000","last_change":"2023-10-14T19:10:14.507739+0000","last_active":"2023-10-14T19:10:15.521836+0000","last_peered":"2023-10-14T19:10:15.521836+0000","last_clean":"2023-10-14T19:10:15.521836+0000","last_became_active":"2023-10-14T19:10:14.507534+0000","last_became_peered":"2023-10-14T19:10:14.507534+0000","last_unstale":"2023-10-14T19:10:15.521836+0000","last_undegraded":"2023-10-14T19:10:15.521836+0000","last_fullsized":"2023-10-14T19:10:15.521836+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:51.073665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516020+0000","last_change":"2023-10-14T19:10:15.516020+0000","last_active":"2023-10-14T19:10:15.516020+0000","last_peered":"2023-10-14T19:10:15.516020+0000","last_clean":"2023-10-14T19:10:15.516020+0000","last_became_active":"2023-10-14T19:10:15.509436+0000","last_became_peered":"2023-10-14T19:10:15.509436+0000","last_unstale":"2023-10-14T19:10:15.516020+0000","last_undegraded":"2023-10-14T19:10:15.516020+0000","last_fullsized":"2023-10-14T19:10:15.516020+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:59.800535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T19:10:14.512454+0000","last_change":"2023-10-14T19:10:14.508442+0000","last_active":"2023-10-14T19:10:14.512454+0000","last_peered":"2023-10-14T19:10:14.512454+0000","last_clean":"2023-10-14T19:10:14.512454+0000","last_became_active":"2023-10-14T19:10:14.508138+0000","last_became_peered":"2023-10-14T19:10:14.508138+0000","last_unstale":"2023-10-14T19:10:14.512454+0000","last_undegraded":"2023-10-14T19:10:14.512454+0000","last_fullsized":"2023-10-14T19:10:14.512454+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:11.218715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.509089+0000","last_change":"2023-10-14T19:10:15.509089+0000","last_active":"2023-10-14T19:10:15.509089+0000","last_peered":"2023-10-14T19:10:15.509089+0000","last_clean":"2023-10-14T19:10:15.509089+0000","last_became_active":"2023-10-14T19:10:15.506906+0000","last_became_peered":"2023-10-14T19:10:15.506906+0000","last_unstale":"2023-10-14T19:10:15.509089+0000","last_undegraded":"2023-10-14T19:10:15.509089+0000","last_fullsized":"2023-10-14T19:10:15.509089+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:44:49.209296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T19:10:14.512535+0000","last_change":"2023-10-14T19:10:14.507997+0000","last_active":"2023-10-14T19:10:14.512535+0000","last_peered":"2023-10-14T19:10:14.512535+0000","last_clean":"2023-10-14T19:10:14.512535+0000","last_became_active":"2023-10-14T19:10:14.507731+0000","last_became_peered":"2023-10-14T19:10:14.507731+0000","last_unstale":"2023-10-14T19:10:14.512535+0000","last_undegraded":"2023-10-14T19:10:14.512535+0000","last_fullsized":"2023-10-14T19:10:14.512535+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:44.151316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.503309+0000","last_change":"2023-10-14T19:10:15.503309+0000","last_active":"2023-10-14T19:10:15.503309+0000","last_peered":"2023-10-14T19:10:15.503309+0000","last_clean":"2023-10-14T19:10:15.503309+0000","last_became_active":"2023-10-14T19:10:15.503043+0000","last_became_peered":"2023-10-14T19:10:15.503043+0000","last_unstale":"2023-10-14T19:10:15.503309+0000","last_undegraded":"2023-10-14T19:10:15.503309+0000","last_fullsized":"2023-10-14T19:10:15.503309+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:32.507152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T19:10:14.512157+0000","last_change":"2023-10-14T19:10:14.511840+0000","last_active":"2023-10-14T19:10:14.512157+0000","last_peered":"2023-10-14T19:10:14.512157+0000","last_clean":"2023-10-14T19:10:14.512157+0000","last_became_active":"2023-10-14T19:10:14.509311+0000","last_became_peered":"2023-10-14T19:10:14.509311+0000","last_unstale":"2023-10-14T19:10:14.512157+0000","last_undegraded":"2023-10-14T19:10:14.512157+0000","last_fullsized":"2023-10-14T19:10:14.512157+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:58:50.330096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.510746+0000","last_change":"2023-10-14T19:10:15.505041+0000","last_active":"2023-10-14T19:10:15.510746+0000","last_peered":"2023-10-14T19:10:15.510746+0000","last_clean":"2023-10-14T19:10:15.510746+0000","last_became_active":"2023-10-14T19:10:15.504516+0000","last_became_peered":"2023-10-14T19:10:15.504516+0000","last_unstale":"2023-10-14T19:10:15.510746+0000","last_undegraded":"2023-10-14T19:10:15.510746+0000","last_fullsized":"2023-10-14T19:10:15.510746+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:45.912490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.498094+0000","last_change":"2023-10-14T19:10:14.506023+0000","last_active":"2023-10-14T19:10:15.498094+0000","last_peered":"2023-10-14T19:10:15.498094+0000","last_clean":"2023-10-14T19:10:15.498094+0000","last_became_active":"2023-10-14T19:10:14.505756+0000","last_became_peered":"2023-10-14T19:10:14.505756+0000","last_unstale":"2023-10-14T19:10:15.498094+0000","last_undegraded":"2023-10-14T19:10:15.498094+0000","last_fullsized":"2023-10-14T19:10:15.498094+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:48.625862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511001+0000","last_change":"2023-10-14T19:10:15.504920+0000","last_active":"2023-10-14T19:10:15.511001+0000","last_peered":"2023-10-14T19:10:15.511001+0000","last_clean":"2023-10-14T19:10:15.511001+0000","last_became_active":"2023-10-14T19:10:15.504613+0000","last_became_peered":"2023-10-14T19:10:15.504613+0000","last_unstale":"2023-10-14T19:10:15.511001+0000","last_undegraded":"2023-10-14T19:10:15.511001+0000","last_fullsized":"2023-10-14T19:10:15.511001+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:34:16.980714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.497913+0000","last_change":"2023-10-14T19:10:14.504279+0000","last_active":"2023-10-14T19:10:15.497913+0000","last_peered":"2023-10-14T19:10:15.497913+0000","last_clean":"2023-10-14T19:10:15.497913+0000","last_became_active":"2023-10-14T19:10:14.504005+0000","last_became_peered":"2023-10-14T19:10:14.504005+0000","last_unstale":"2023-10-14T19:10:15.497913+0000","last_undegraded":"2023-10-14T19:10:15.497913+0000","last_fullsized":"2023-10-14T19:10:15.497913+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:08.767612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.511750+0000","last_change":"2023-10-14T19:10:15.507044+0000","last_active":"2023-10-14T19:10:15.511750+0000","last_peered":"2023-10-14T19:10:15.511750+0000","last_clean":"2023-10-14T19:10:15.511750+0000","last_became_active":"2023-10-14T19:10:15.506789+0000","last_became_peered":"2023-10-14T19:10:15.506789+0000","last_unstale":"2023-10-14T19:10:15.511750+0000","last_undegraded":"2023-10-14T19:10:15.511750+0000","last_fullsized":"2023-10-14T19:10:15.511750+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:36.186853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.496541+0000","last_change":"2023-10-14T19:10:14.504426+0000","last_active":"2023-10-14T19:10:15.496541+0000","last_peered":"2023-10-14T19:10:15.496541+0000","last_clean":"2023-10-14T19:10:15.496541+0000","last_became_active":"2023-10-14T19:10:14.504146+0000","last_became_peered":"2023-10-14T19:10:14.504146+0000","last_unstale":"2023-10-14T19:10:15.496541+0000","last_undegraded":"2023-10-14T19:10:15.496541+0000","last_fullsized":"2023-10-14T19:10:15.496541+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:15.304742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.516267+0000","last_change":"2023-10-14T19:10:15.513878+0000","last_active":"2023-10-14T19:10:15.516267+0000","last_peered":"2023-10-14T19:10:15.516267+0000","last_clean":"2023-10-14T19:10:15.516267+0000","last_became_active":"2023-10-14T19:10:15.513387+0000","last_became_peered":"2023-10-14T19:10:15.513387+0000","last_unstale":"2023-10-14T19:10:15.516267+0000","last_undegraded":"2023-10-14T19:10:15.516267+0000","last_fullsized":"2023-10-14T19:10:15.516267+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:05.236329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.493993+0000","last_change":"2023-10-14T19:10:14.507766+0000","last_active":"2023-10-14T19:10:15.493993+0000","last_peered":"2023-10-14T19:10:15.493993+0000","last_clean":"2023-10-14T19:10:15.493993+0000","last_became_active":"2023-10-14T19:10:14.507482+0000","last_became_peered":"2023-10-14T19:10:14.507482+0000","last_unstale":"2023-10-14T19:10:15.493993+0000","last_undegraded":"2023-10-14T19:10:15.493993+0000","last_fullsized":"2023-10-14T19:10:15.493993+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:36:46.408822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.509981+0000","last_change":"2023-10-14T19:10:15.509981+0000","last_active":"2023-10-14T19:10:15.509981+0000","last_peered":"2023-10-14T19:10:15.509981+0000","last_clean":"2023-10-14T19:10:15.509981+0000","last_became_active":"2023-10-14T19:10:15.509396+0000","last_became_peered":"2023-10-14T19:10:15.509396+0000","last_unstale":"2023-10-14T19:10:15.509981+0000","last_undegraded":"2023-10-14T19:10:15.509981+0000","last_fullsized":"2023-10-14T19:10:15.509981+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:14.481631+0000","last_clean_scrub_stamp":"2023-10-14T19:10:14.481631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:21:03.553097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.496675+0000","last_change":"2023-10-14T19:10:14.501427+0000","last_active":"2023-10-14T19:10:15.496675+0000","last_peered":"2023-10-14T19:10:15.496675+0000","last_clean":"2023-10-14T19:10:15.496675+0000","last_became_active":"2023-10-14T19:10:14.501158+0000","last_became_peered":"2023-10-14T19:10:14.501158+0000","last_unstale":"2023-10-14T19:10:15.496675+0000","last_undegraded":"2023-10-14T19:10:15.496675+0000","last_fullsized":"2023-10-14T19:10:15.496675+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:13.476200+0000","last_clean_scrub_stamp":"2023-10-14T19:10:13.476200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:10.594338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":258,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-14T19:10:15.494833+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:15.494833+0000","last_peered":"2023-10-14T19:10:15.494833+0000","last_clean":"2023-10-14T19:10:15.494833+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:15.494833+0000","last_undegraded":"2023-10-14T19:10:15.494833+0000","last_fullsized":"2023-10-14T19:10:15.494833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2347008,"data_stored":1368232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.51300000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.755}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.84299999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":784048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.505}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1769472,"data_stored":785584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.626},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.50700000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303672,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068168,"statfs":{"total":96636764160,"available":96325804032,"internally_reserved":0,"allocated":2342912,"data_stored":1368150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33500000000000002,"15min":0.34399999999999997},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.41599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60899999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51400000000000001,"5min":0.62,"15min":0.62},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.379}]},{"osd":4,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.45200000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.40500000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.502},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.41399999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.434}]},{"osd":7,"last update":"Sat Oct 14 19:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82299999999999995,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":778426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.376}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.499}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.623},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":777954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.318},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.28299999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54800000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.53800000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1773568,"data_stored":786138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":0.498}]},{"osd":1,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.85699999999999998,"5min":5.7830000000000004,"15min":5.7830000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88600000000000001,"5min":3.488,"15min":3.488},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":1.254,"15min":1.254},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":0.874,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.54500000000000004},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.35799999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.57099999999999995,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64400000000000002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.63600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.878},"last":0.40899999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55200000000000005,"15min":0.60799999999999998},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.34399999999999997},"max":{"1min":0.61199999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":784048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.317},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.502},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:19.993 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:10:19.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:10:20.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.153+0000 7f0357b3e700 1 Processor -- start 2023-10-14T19:10:20.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.154+0000 7f0357b3e700 1 -- start start 2023-10-14T19:10:20.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.154+0000 7f0357b3e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f03500c8800 0x7f03500c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.154+0000 7f0357b3e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500b1150 0x7f03500ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.154+0000 7f0357b3e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03500adbc0 con 0x7f03500c8bd0 2023-10-14T19:10:20.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.154+0000 7f0357b3e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500c9d30 con 0x7f03500c8800 2023-10-14T19:10:20.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.154+0000 7f0357b3e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03500acfb0 con 0x7f03500b1150 2023-10-14T19:10:20.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03558da700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f03500c8800 0x7f03500c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03550d9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f03500c8bd0 0x7f03500b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49520/0 (socket says 172.21.15.7:49520) 2023-10-14T19:10:20.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03550d9700 1 -- 172.21.15.7:0/1035264751 learned_addr learned my addr 172.21.15.7:0/1035264751 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:20.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03560db700 1 --2- 172.21.15.7:0/1035264751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500b1150 0x7f03500ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03558da700 1 -- 172.21.15.7:0/1035264751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500b1150 msgr2=0x7f03500ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:20.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03558da700 1 --2- 172.21.15.7:0/1035264751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500b1150 0x7f03500ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03558da700 1 -- 172.21.15.7:0/1035264751 >> v1:172.21.15.7:6789/0 conn(0x7f03500c8bd0 legacy=0x7f03500b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03548d8700 1 -- 172.21.15.7:0/1035264751 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534140606 0 0) 0x7f03500adbc0 con 0x7f03500c8bd0 2023-10-14T19:10:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03558da700 1 -- 172.21.15.7:0/1035264751 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500ad290 con 0x7f03500c8800 2023-10-14T19:10:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03558da700 1 --2- 172.21.15.7:0/1035264751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03500c94e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f03480098e0 tx=0x7f03480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ce48bd88ddcb7f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03548d8700 1 -- 172.21.15.7:0/1035264751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348009e80 con 0x7f03500c8800 2023-10-14T19:10:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03548d8700 1 -- 172.21.15.7:0/1035264751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800b860 con 0x7f03500c8800 2023-10-14T19:10:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.155+0000 7f03548d8700 1 -- 172.21.15.7:0/1035264751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034800bbe0 con 0x7f03500c8800 2023-10-14T19:10:20.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 -- 172.21.15.7:0/1035264751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 msgr2=0x7f03500c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 --2- 172.21.15.7:0/1035264751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03500c94e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f03480098e0 tx=0x7f03480091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 -- 172.21.15.7:0/1035264751 shutdown_connections 2023-10-14T19:10:20.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 --2- 172.21.15.7:0/1035264751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03500c94e0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 --2- 172.21.15.7:0/1035264751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500b1150 0x7f03500ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 -- 172.21.15.7:0/1035264751 >> 172.21.15.7:0/1035264751 conn(0x7f035006d170 msgr2=0x7f03500cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 -- 172.21.15.7:0/1035264751 shutdown_connections 2023-10-14T19:10:20.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.156+0000 7f0357b3e700 1 -- 172.21.15.7:0/1035264751 wait complete. 2023-10-14T19:10:20.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.157+0000 7f0357b3e700 1 Processor -- start 2023-10-14T19:10:20.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.157+0000 7f0357b3e700 1 -- start start 2023-10-14T19:10:20.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03500b1150 0x7f03501694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03501526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500c8bd0 0x7f0350159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035014f840 con 0x7f03500c8800 2023-10-14T19:10:20.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0350152470 con 0x7f03500b1150 2023-10-14T19:10:20.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035016a410 con 0x7f03500c8bd0 2023-10-14T19:10:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03501526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03501526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58918/0 (socket says 172.21.15.7:58918) 2023-10-14T19:10:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 -- 172.21.15.7:0/339391188 learned_addr learned my addr 172.21.15.7:0/339391188 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03558da700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03500b1150 0x7f03501694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03560db700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500c8bd0 0x7f0350159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 -- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500c8bd0 msgr2=0x7f0350159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500c8bd0 0x7f0350159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 -- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03500b1150 msgr2=0x7f03501694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03500b1150 0x7f03501694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 -- 172.21.15.7:0/339391188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348009420 con 0x7f03500c8800 2023-10-14T19:10:20.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03560db700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500c8bd0 0x7f0350159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:20.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f03550d9700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03501526f0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f034400c7e0 tx=0x7f0344007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:20.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344005b30 con 0x7f03500c8800 2023-10-14T19:10:20.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0344005c90 con 0x7f03500c8800 2023-10-14T19:10:20.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035016cca0 con 0x7f03500c8800 2023-10-14T19:10:20.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.158+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344007300 con 0x7f03500c8800 2023-10-14T19:10:20.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.159+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0350169ed0 con 0x7f03500c8800 2023-10-14T19:10:20.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.160+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035004c3c0 con 0x7f03500c8800 2023-10-14T19:10:20.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.160+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f034401b400 con 0x7f03500c8800 2023-10-14T19:10:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.160+0000 7f034dffb700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f033c067350 0x7f033c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.160+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0344084660 con 0x7f03500c8800 2023-10-14T19:10:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.161+0000 7f03558da700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f033c067350 0x7f033c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.161+0000 7f03558da700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f033c067350 0x7f033c069800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f03480091e0 tx=0x7f0348017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.164+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0344051470 con 0x7f03500c8800 2023-10-14T19:10:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.441+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f035016a1f0 con 0x7f03500c8800 2023-10-14T19:10:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.445+0000 7f034dffb700 1 -- 172.21.15.7:0/339391188 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0344054a90 con 0x7f03500c8800 2023-10-14T19:10:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f033c067350 msgr2=0x7f033c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f033c067350 0x7f033c069800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f03480091e0 tx=0x7f0348017000 comp rx=0 tx=0).stop 2023-10-14T19:10:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 msgr2=0x7f03501526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03501526f0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f034400c7e0 tx=0x7f0344007df0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 shutdown_connections 2023-10-14T19:10:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f033c067350 0x7f033c069800 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03500b1150 0x7f03501694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03500c8bd0 0x7f0350159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 --2- 172.21.15.7:0/339391188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03500c8800 0x7f03501526f0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 >> 172.21.15.7:0/339391188 conn(0x7f035006d170 msgr2=0x7f03500af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 shutdown_connections 2023-10-14T19:10:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.447+0000 7f0357b3e700 1 -- 172.21.15.7:0/339391188 wait complete. 2023-10-14T19:10:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:10:20.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:20.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.579+0000 7f4e1676b700 1 Processor -- start 2023-10-14T19:10:20.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.579+0000 7f4e1676b700 1 -- start start 2023-10-14T19:10:20.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e1676b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e1676b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e1676b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1015ae40 con 0x7f4e1015a400 2023-10-14T19:10:20.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e1676b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100d13f0 con 0x7f4e100cd9e0 2023-10-14T19:10:20.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e1676b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1015ab60 con 0x7f4e100cb5a0 2023-10-14T19:10:20.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e0f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e0f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58922/0 (socket says 172.21.15.7:58922) 2023-10-14T19:10:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.580+0000 7f4e0f7fe700 1 -- 172.21.15.7:0/2121452144 learned_addr learned my addr 172.21.15.7:0/2121452144 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0ffff700 1 --2- 172.21.15.7:0/2121452144 >> v2:172.21.15.148:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0f7fe700 1 -- 172.21.15.7:0/2121452144 >> v2:172.21.15.148:3300/0 conn(0x7f4e100cb5a0 msgr2=0x7f4e100cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:20.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0f7fe700 1 --2- 172.21.15.7:0/2121452144 >> v2:172.21.15.148:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0f7fe700 1 -- 172.21.15.7:0/2121452144 >> v1:172.21.15.148:6789/0 conn(0x7f4e1015a400 legacy=0x7f4e10156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:20.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0f7fe700 1 -- 172.21.15.7:0/2121452144 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100ccf00 con 0x7f4e100cd9e0 2023-10-14T19:10:20.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0f7fe700 1 --2- 172.21.15.7:0/2121452144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cd9e0 0x7f4e10159ec0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4e040099b0 tx=0x7f4e04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8baf5f8f1ec3f3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:20.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0effd700 1 -- 172.21.15.7:0/2121452144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400b7e0 con 0x7f4e100cd9e0 2023-10-14T19:10:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0effd700 1 -- 172.21.15.7:0/2121452144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400b940 con 0x7f4e100cd9e0 2023-10-14T19:10:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e0effd700 1 -- 172.21.15.7:0/2121452144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400bce0 con 0x7f4e100cd9e0 2023-10-14T19:10:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.581+0000 7f4e1676b700 1 -- 172.21.15.7:0/2121452144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cd9e0 msgr2=0x7f4e10159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 --2- 172.21.15.7:0/2121452144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cd9e0 0x7f4e10159ec0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4e040099b0 tx=0x7f4e04009250 comp rx=0 tx=0).stop 2023-10-14T19:10:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 -- 172.21.15.7:0/2121452144 shutdown_connections 2023-10-14T19:10:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 --2- 172.21.15.7:0/2121452144 >> v2:172.21.15.148:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 --2- 172.21.15.7:0/2121452144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 -- 172.21.15.7:0/2121452144 >> 172.21.15.7:0/2121452144 conn(0x7f4e10070e30 msgr2=0x7f4e100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 -- 172.21.15.7:0/2121452144 shutdown_connections 2023-10-14T19:10:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.582+0000 7f4e1676b700 1 -- 172.21.15.7:0/2121452144 wait complete. 2023-10-14T19:10:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.583+0000 7f4e1676b700 1 Processor -- start 2023-10-14T19:10:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.583+0000 7f4e1676b700 1 -- start start 2023-10-14T19:10:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e100cd9e0 0x7f4e100b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1015a400 0x7f4e100b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101593f0 con 0x7f4e100cb5a0 2023-10-14T19:10:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101587e0 con 0x7f4e1015a400 2023-10-14T19:10:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10158ac0 con 0x7f4e100cd9e0 2023-10-14T19:10:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58930/0 (socket says 172.21.15.7:58930) 2023-10-14T19:10:20.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 -- 172.21.15.7:0/1023931984 learned_addr learned my addr 172.21.15.7:0/1023931984 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:20.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0f7fe700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e100cd9e0 0x7f4e100b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e14d08700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1015a400 0x7f4e100b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 -- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e100cd9e0 msgr2=0x7f4e100b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e100cd9e0 0x7f4e100b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 -- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1015a400 msgr2=0x7f4e100b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1015a400 0x7f4e100b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 -- 172.21.15.7:0/1023931984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040094f0 con 0x7f4e100cb5a0 2023-10-14T19:10:20.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e14d08700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1015a400 0x7f4e100b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e0ffff700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153bc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c880 tx=0x7f4e00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00011600 con 0x7f4e100cb5a0 2023-10-14T19:10:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e000117a0 con 0x7f4e100cb5a0 2023-10-14T19:10:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00011b60 con 0x7f4e100cb5a0 2023-10-14T19:10:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e10158da0 con 0x7f4e100cb5a0 2023-10-14T19:10:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.584+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e10154100 con 0x7f4e100cb5a0 2023-10-14T19:10:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.585+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10154320 con 0x7f4e100cb5a0 2023-10-14T19:10:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.586+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4e00018360 con 0x7f4e100cb5a0 2023-10-14T19:10:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.586+0000 7f4df7fff700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4dfc067320 0x7f4dfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.586+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e00084bc0 con 0x7f4e100cb5a0 2023-10-14T19:10:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.586+0000 7f4e0f7fe700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4dfc067320 0x7f4dfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.587+0000 7f4e0f7fe700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4dfc067320 0x7f4dfc0697d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4e040099b0 tx=0x7f4e04016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.590+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e00051740 con 0x7f4e100cb5a0 2023-10-14T19:10:20.816 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-14T19:10:20.814+0000 7fa1d6544700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:10:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.828+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e1004c3c0 con 0x7f4e100cb5a0 2023-10-14T19:10:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.828+0000 7f4df7fff700 1 -- 172.21.15.7:0/1023931984 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f4e00015090 con 0x7f4e100cb5a0 2023-10-14T19:10:20.829 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:20.829 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:18.517038+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4dfc067320 msgr2=0x7f4dfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4dfc067320 0x7f4dfc0697d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4e040099b0 tx=0x7f4e04016000 comp rx=0 tx=0).stop 2023-10-14T19:10:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 msgr2=0x7f4e10153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153bc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c880 tx=0x7f4e00008040 comp rx=0 tx=0).stop 2023-10-14T19:10:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 shutdown_connections 2023-10-14T19:10:20.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4dfc067320 0x7f4dfc0697d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1015a400 0x7f4e100b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153bc0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 --2- 172.21.15.7:0/1023931984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e100cd9e0 0x7f4e100b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:20.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 >> 172.21.15.7:0/1023931984 conn(0x7f4e10070e30 msgr2=0x7f4e100cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:20.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 shutdown_connections 2023-10-14T19:10:20.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:20.830+0000 7f4e1676b700 1 -- 172.21.15.7:0/1023931984 wait complete. 2023-10-14T19:10:20.834 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 91 2023-10-14T19:10:21.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:10:14.896608+0000', 'modified': '2023-10-14T19:10:18.517038+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7506}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7506': {'gid': 7506, 'name': 'a', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/3846428512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6833', 'nonce': 3846428512}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 3846428512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:10:21.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:10:21.247 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T19:10:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.368+0000 7fc09df77700 1 Processor -- start 2023-10-14T19:10:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.368+0000 7fc09df77700 1 -- start start 2023-10-14T19:10:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc09df77700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb970 0x7fc098159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc09df77700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc09815a400 0x7fc098156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc09df77700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09815ae40 con 0x7fc0980cb5a0 2023-10-14T19:10:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc09df77700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0980ce0f0 con 0x7fc09815a400 2023-10-14T19:10:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc09df77700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980cbde0 con 0x7fc0980cb970 2023-10-14T19:10:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc097fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc09815a400 0x7fc098156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc097fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc09815a400 0x7fc098156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58934/0 (socket says 172.21.15.7:58934) 2023-10-14T19:10:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc097fff700 1 -- 172.21.15.7:0/1469024700 learned_addr learned my addr 172.21.15.7:0/1469024700 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.369+0000 7fc096ffd700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb970 0x7fc098159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc097fff700 1 -- 172.21.15.7:0/1469024700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb970 msgr2=0x7fc098159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc097fff700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb970 0x7fc098159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc097fff700 1 -- 172.21.15.7:0/1469024700 >> v1:172.21.15.148:6789/0 conn(0x7fc0980cb5a0 legacy=0x7fc0980cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc097fff700 1 -- 172.21.15.7:0/1469024700 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09815ab60 con 0x7fc09815a400 2023-10-14T19:10:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc096ffd700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb970 0x7fc098159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc097fff700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098156e90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fc090009f50 tx=0x7fc090009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afbe1cab15c9033 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc0967fc700 1 -- 172.21.15.7:0/1469024700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000e070 con 0x7fc09815a400 2023-10-14T19:10:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc0967fc700 1 -- 172.21.15.7:0/1469024700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000ba70 con 0x7fc09815a400 2023-10-14T19:10:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc0967fc700 1 -- 172.21.15.7:0/1469024700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900092e0 con 0x7fc09815a400 2023-10-14T19:10:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc09df77700 1 -- 172.21.15.7:0/1469024700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 msgr2=0x7fc098156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.370+0000 7fc09df77700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098156e90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fc090009f50 tx=0x7fc090009840 comp rx=0 tx=0).stop 2023-10-14T19:10:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.371+0000 7fc09df77700 1 -- 172.21.15.7:0/1469024700 shutdown_connections 2023-10-14T19:10:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.371+0000 7fc09df77700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098156e90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.371+0000 7fc09df77700 1 --2- 172.21.15.7:0/1469024700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb970 0x7fc098159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.371+0000 7fc09df77700 1 -- 172.21.15.7:0/1469024700 >> 172.21.15.7:0/1469024700 conn(0x7fc098070e30 msgr2=0x7fc0980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.371+0000 7fc09df77700 1 -- 172.21.15.7:0/1469024700 shutdown_connections 2023-10-14T19:10:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.371+0000 7fc09df77700 1 -- 172.21.15.7:0/1469024700 wait complete. 2023-10-14T19:10:21.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.372+0000 7fc09df77700 1 Processor -- start 2023-10-14T19:10:21.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.372+0000 7fc09df77700 1 -- start start 2023-10-14T19:10:21.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb5a0 0x7fc0980ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980cb970 0x7fc098159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098159180 con 0x7fc09815a400 2023-10-14T19:10:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098159b50 con 0x7fc0980cb970 2023-10-14T19:10:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0981582d0 con 0x7fc0980cb5a0 2023-10-14T19:10:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58938/0 (socket says 172.21.15.7:58938) 2023-10-14T19:10:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 -- 172.21.15.7:0/381151547 learned_addr learned my addr 172.21.15.7:0/381151547 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc0977fe700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb5a0 0x7fc0980ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc096ffd700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980cb970 0x7fc098159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 -- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb5a0 msgr2=0x7fc0980ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb5a0 0x7fc0980ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 -- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980cb970 msgr2=0x7fc098159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980cb970 0x7fc098159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 -- 172.21.15.7:0/381151547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009ae0 con 0x7fc09815a400 2023-10-14T19:10:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc097fff700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098157d90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fc09806ea60 tx=0x7fc090018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc07f7fe700 1 -- 172.21.15.7:0/381151547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900032f0 con 0x7fc09815a400 2023-10-14T19:10:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc07f7fe700 1 -- 172.21.15.7:0/381151547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090008d90 con 0x7fc09815a400 2023-10-14T19:10:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc098158570 con 0x7fc09815a400 2023-10-14T19:10:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.373+0000 7fc07f7fe700 1 -- 172.21.15.7:0/381151547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900266b0 con 0x7fc09815a400 2023-10-14T19:10:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.374+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc098158b30 con 0x7fc09815a400 2023-10-14T19:10:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.375+0000 7fc07f7fe700 1 -- 172.21.15.7:0/381151547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc090003040 con 0x7fc09815a400 2023-10-14T19:10:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.375+0000 7fc07f7fe700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc084067320 0x7fc0840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.375+0000 7fc07f7fe700 1 -- 172.21.15.7:0/381151547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc090086da0 con 0x7fc09815a400 2023-10-14T19:10:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.375+0000 7fc0977fe700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc084067320 0x7fc0840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.376+0000 7fc0977fe700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc084067320 0x7fc0840697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc0980ca940 tx=0x7fc088009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.377+0000 7fc0a7270b80 1 Processor -- start 2023-10-14T19:10:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.377+0000 7fc0a7270b80 1 -- start start 2023-10-14T19:10:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a8564ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85675a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85675f60 0x562a85648cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a855a3a70 con 0x562a8564ca50 2023-10-14T19:10:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a855a1270 con 0x562a85696d00 2023-10-14T19:10:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a8559d060 con 0x562a85675f60 2023-10-14T19:10:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a8564ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a8564ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58948/0 (socket says 172.21.15.7:58948) 2023-10-14T19:10:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 -- 172.21.15.7:0/3687082348 learned_addr learned my addr 172.21.15.7:0/3687082348 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc097fff700 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85675f60 0x562a85648cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc096ffd700 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85675a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 -- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85675f60 msgr2=0x562a85648cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85675f60 0x562a85648cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 -- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 msgr2=0x562a85675a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85675a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.378+0000 7fc0977fe700 1 -- 172.21.15.7:0/3687082348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a85437270 con 0x562a8564ca50 2023-10-14T19:10:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc096ffd700 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85675a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0977fe700 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a8564ce20 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc08800f990 tx=0x7fc088015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5063719c238875 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc07cff9700 1 -- 172.21.15.7:0/3687082348 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880015d0 con 0x562a8564ca50 2023-10-14T19:10:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc07cff9700 1 -- 172.21.15.7:0/3687082348 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088014660 con 0x562a8564ca50 2023-10-14T19:10:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc07cff9700 1 -- 172.21.15.7:0/3687082348 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880149e0 con 0x562a8564ca50 2023-10-14T19:10:21.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3687082348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 msgr2=0x562a8564ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a8564ce20 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc08800f990 tx=0x7fc088015000 comp rx=0 tx=0).stop 2023-10-14T19:10:21.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3687082348 shutdown_connections 2023-10-14T19:10:21.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85675f60 0x562a85648cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a8564ce20 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.379+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3687082348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85675a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.380+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3687082348 >> 172.21.15.7:0/3687082348 conn(0x562a8564e370 msgr2=0x562a8564e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.380+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3687082348 shutdown_connections 2023-10-14T19:10:21.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.380+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3687082348 wait complete. 2023-10-14T19:10:21.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.380+0000 7fc0a7270b80 1 -- start start 2023-10-14T19:10:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.380+0000 7fc0a7270b80 1 Processor -- start 2023-10-14T19:10:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856911f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a8568ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 0x562a85647c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a85548890 con 0x562a85696d00 2023-10-14T19:10:21.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a85563ea0 con 0x562a85675f60 2023-10-14T19:10:21.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a8541fe30 con 0x562a8564ca50 2023-10-14T19:10:21.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0a7270b80 10 client.0 _ll_register_callbacks cb 0x562a85610110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:10:21.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 0x562a85647c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 0x562a85647c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58950/0 (socket says 172.21.15.7:58950) 2023-10-14T19:10:21.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 -- 172.21.15.7:0/3071920543 learned_addr learned my addr 172.21.15.7:0/3071920543 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc0977fe700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856911f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc096ffd700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a8568ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 -- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 msgr2=0x562a856911f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856911f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 -- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 msgr2=0x562a8568ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a8568ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc097fff700 1 -- 172.21.15.7:0/3071920543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09815ae40 con 0x562a85696d00 2023-10-14T19:10:21.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.381+0000 7fc096ffd700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a8568ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:21.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc097fff700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 0x562a85647c20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc090009880 tx=0x7fc0900094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02ad9e359e5ab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:10:21.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc075ffb700 1 -- 172.21.15.7:0/3071920543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000e040 con 0x562a85696d00 2023-10-14T19:10:21.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc075ffb700 1 -- 172.21.15.7:0/3071920543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc090056b40 con 0x562a85696d00 2023-10-14T19:10:21.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a85641b70 con 0x562a85696d00 2023-10-14T19:10:21.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc075ffb700 1 -- 172.21.15.7:0/3071920543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09005e0b0 con 0x562a85696d00 2023-10-14T19:10:21.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 10 client.7656 fetch_fsmap learned FSMap version 91 2023-10-14T19:10:21.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x562a853d9fe0 con 0x562a85696d00 2023-10-14T19:10:21.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc075ffb700 1 -- 172.21.15.7:0/3071920543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a85641b70 con 0x562a85696d00 2023-10-14T19:10:21.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc075ffb700 1 -- 172.21.15.7:0/3071920543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 91) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc09006dbc0 con 0x562a85696d00 2023-10-14T19:10:21.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 10 client.7656 fetch_fsmap finished waiting for FSMap version 91 2023-10-14T19:10:21.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 10 client.7656 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:10:21.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 20 client.7656 populate_metadata read hostname 'smithi007' 2023-10-14T19:10:21.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a8568bf20 0x562a8568b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 4 client.7656 mds_command: new command op to 7506 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:10:21.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 --> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a8561eaa0 con 0x562a8568bf20 2023-10-14T19:10:21.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.382+0000 7fc0977fe700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a8568bf20 0x562a8568b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0977fe700 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a8568bf20 0x562a8568b1a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d4322410ff02d93 server_cookie=4ad6ce708dbc9162 in_seq=0 out_seq=0 2023-10-14T19:10:21.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc075ffb700 10 client.7656 ms_handle_connect on v2:172.21.15.7:6833/3846428512 2023-10-14T19:10:21.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc075ffb700 1 -- 172.21.15.7:0/3071920543 <== mds.0 v2:172.21.15.7:6833/3846428512 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562a8561eaa0 con 0x562a8568bf20 2023-10-14T19:10:21.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc075ffb700 10 client.7656 handle_command_reply: tid=0 2023-10-14T19:10:21.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 client.7656 shutdown 2023-10-14T19:10:21.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 msgr2=0x562a85647c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 0x562a85647c20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc090009880 tx=0x7fc0900094e0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 shutdown_connections 2023-10-14T19:10:21.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a8568bf20 0x562a8568b1a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85696d00 0x562a85647c20 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856911f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc075ffb700 0 client.7656 ms_handle_reset on v2:172.21.15.7:6833/3846428512 2023-10-14T19:10:21.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/3071920543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a8568ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.383+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 >> 172.21.15.7:0/3071920543 conn(0x562a8564e370 msgr2=0x562a85649860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.384+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 shutdown_connections 2023-10-14T19:10:21.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.384+0000 7fc0a7270b80 1 -- 172.21.15.7:0/3071920543 wait complete. 2023-10-14T19:10:21.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.384+0000 7fc0a7270b80 20 client.7656 trim_cache size 0 max 16384 2023-10-14T19:10:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 Processor -- start 2023-10-14T19:10:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 -- start start 2023-10-14T19:10:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a856a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a85645520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85696d00 0x562a85648b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a8562c510 con 0x562a8564ca50 2023-10-14T19:10:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a856905c0 con 0x562a85675f60 2023-10-14T19:10:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a8568a9b0 con 0x562a85696d00 2023-10-14T19:10:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a856a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0977fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a856a61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58966/0 (socket says 172.21.15.7:58966) 2023-10-14T19:10:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.401+0000 7fc0977fe700 1 -- 172.21.15.7:0/728851404 learned_addr learned my addr 172.21.15.7:0/728851404 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0977fe700 1 -- 172.21.15.7:0/728851404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85696d00 msgr2=0x562a85648b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0977fe700 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85696d00 0x562a85648b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0977fe700 1 -- 172.21.15.7:0/728851404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 msgr2=0x562a85645520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0977fe700 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a85645520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0977fe700 1 -- 172.21.15.7:0/728851404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a8564a8b0 con 0x562a8564ca50 2023-10-14T19:10:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0977fe700 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a856a61f0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fc08800f930 tx=0x7fc088016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae38e5d17a41e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc07d7fa700 1 -- 172.21.15.7:0/728851404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088031070 con 0x562a8564ca50 2023-10-14T19:10:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc07d7fa700 1 -- 172.21.15.7:0/728851404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880147d0 con 0x562a8564ca50 2023-10-14T19:10:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc07d7fa700 1 -- 172.21.15.7:0/728851404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088014960 con 0x562a8564ca50 2023-10-14T19:10:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0a7270b80 1 -- 172.21.15.7:0/728851404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 msgr2=0x562a856a61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a856a61f0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fc08800f930 tx=0x7fc088016000 comp rx=0 tx=0).stop 2023-10-14T19:10:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0a7270b80 1 -- 172.21.15.7:0/728851404 shutdown_connections 2023-10-14T19:10:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.402+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a85696d00 0x562a85648b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a8564ca50 0x562a856a61f0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/728851404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85675f60 0x562a85645520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 -- 172.21.15.7:0/728851404 >> 172.21.15.7:0/728851404 conn(0x562a8564e370 msgr2=0x562a8564fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 -- 172.21.15.7:0/728851404 shutdown_connections 2023-10-14T19:10:21.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 -- 172.21.15.7:0/728851404 wait complete. 2023-10-14T19:10:21.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 -- start start 2023-10-14T19:10:21.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.403+0000 7fc0a7270b80 1 Processor -- start 2023-10-14T19:10:21.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 0x562a85649620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85649b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a856487b0 con 0x562a85675f60 2023-10-14T19:10:21.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a856ad210 con 0x562a85696d00 2023-10-14T19:10:21.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a856a72c0 con 0x562a8564ca50 2023-10-14T19:10:21.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0a7270b80 10 client.0 _ll_register_callbacks cb 0x562a85610110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:10:21.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 0x562a85649620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 0x562a85649620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58970/0 (socket says 172.21.15.7:58970) 2023-10-14T19:10:21.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 -- 172.21.15.7:0/2472343018 learned_addr learned my addr 172.21.15.7:0/2472343018 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc097fff700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85649b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc0977fe700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 -- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 msgr2=0x562a856f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 -- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 msgr2=0x562a85649b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85649b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 -- 172.21.15.7:0/2472343018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a85437270 con 0x562a85675f60 2023-10-14T19:10:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:10:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.404+0000 7fc096ffd700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 0x562a85649620 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x562a8564c510 tx=0x7fc08c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227d1ee47efa823a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc075ffb700 1 -- 172.21.15.7:0/2472343018 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c013ec0 con 0x562a85675f60 2023-10-14T19:10:21.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc075ffb700 1 -- 172.21.15.7:0/2472343018 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc08c01a030 con 0x562a85675f60 2023-10-14T19:10:21.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc088014660 con 0x562a85675f60 2023-10-14T19:10:21.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc075ffb700 1 -- 172.21.15.7:0/2472343018 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08c016610 con 0x562a85675f60 2023-10-14T19:10:21.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 10 client.7662 fetch_fsmap learned FSMap version 91 2023-10-14T19:10:21.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x562a8556b780 con 0x562a85675f60 2023-10-14T19:10:21.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc075ffb700 1 -- 172.21.15.7:0/2472343018 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088014660 con 0x562a85675f60 2023-10-14T19:10:21.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc075ffb700 1 -- 172.21.15.7:0/2472343018 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 91) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc08c016770 con 0x562a85675f60 2023-10-14T19:10:21.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 10 client.7662 fetch_fsmap finished waiting for FSMap version 91 2023-10-14T19:10:21.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 10 client.7662 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:10:21.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 20 client.7662 populate_metadata read hostname 'smithi007' 2023-10-14T19:10:21.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a856a8140 0x562a856a8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 4 client.7662 mds_command: new command op to 7506 tid=0[{"prefix": "status"}] 2023-10-14T19:10:21.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 --> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562a8553fe00 con 0x562a856a8140 2023-10-14T19:10:21.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.405+0000 7fc0977fe700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a856a8140 0x562a856a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc075ffb700 10 client.7662 ms_handle_connect on v2:172.21.15.7:6833/3846428512 2023-10-14T19:10:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0977fe700 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a856a8140 0x562a856a8510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3bf55227de29cc0 server_cookie=bf2fec09c9a62a31 in_seq=0 out_seq=0 2023-10-14T19:10:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc075ffb700 1 -- 172.21.15.7:0/2472343018 <== mds.0 v2:172.21.15.7:6833/3846428512 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x562a8553fe00 con 0x562a856a8140 2023-10-14T19:10:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc075ffb700 10 client.7662 handle_command_reply: tid=0 2023-10-14T19:10:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 client.7662 shutdown 2023-10-14T19:10:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 msgr2=0x562a85649620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 0x562a85649620 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x562a8564c510 tx=0x7fc08c008040 comp rx=0 tx=0).stop 2023-10-14T19:10:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 shutdown_connections 2023-10-14T19:10:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:6833/3846428512,v1:172.21.15.7:6835/3846428512] conn(0x562a856a8140 0x562a856a8510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a85696d00 0x562a85649b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x562a8564ca50 0x562a856f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc075ffb700 0 client.7662 ms_handle_reset on v2:172.21.15.7:6833/3846428512 2023-10-14T19:10:21.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 --2- 172.21.15.7:0/2472343018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a85675f60 0x562a85649620 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 >> 172.21.15.7:0/2472343018 conn(0x562a8564e370 msgr2=0x562a85648b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 shutdown_connections 2023-10-14T19:10:21.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 1 -- 172.21.15.7:0/2472343018 wait complete. 2023-10-14T19:10:21.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc0a7270b80 20 client.7662 trim_cache size 0 max 16384 2023-10-14T19:10:21.433 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:10:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:10:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:10:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7506, 2023-10-14T19:10:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:10:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:10:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:10:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.9182296729999999, 2023-10-14T19:10:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 91, 2023-10-14T19:10:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 139, 2023-10-14T19:10:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 139, 2023-10-14T19:10:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.989238804999999 2023-10-14T19:10:21.435 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:10:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.406+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc084067320 msgr2=0x7fc0840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc084067320 0x7fc0840697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc0980ca940 tx=0x7fc088009040 comp rx=0 tx=0).stop 2023-10-14T19:10:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 msgr2=0x7fc098157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098157d90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fc09806ea60 tx=0x7fc090018000 comp rx=0 tx=0).stop 2023-10-14T19:10:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 shutdown_connections 2023-10-14T19:10:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc084067320 0x7fc0840697d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc09815a400 0x7fc098157d90 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0980cb5a0 0x7fc0980ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 --2- 172.21.15.7:0/381151547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980cb970 0x7fc098159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 >> 172.21.15.7:0/381151547 conn(0x7fc098070e30 msgr2=0x7fc0980b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 shutdown_connections 2023-10-14T19:10:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.407+0000 7fc09df77700 1 -- 172.21.15.7:0/381151547 wait complete. 2023-10-14T19:10:21.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:10:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.559+0000 7fe610570700 1 Processor -- start 2023-10-14T19:10:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.559+0000 7fe610570700 1 -- start start 2023-10-14T19:10:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe610570700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe60815a5d0 0x7fe608156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe610570700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60815ae40 con 0x7fe6080cb970 2023-10-14T19:10:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe610570700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60815ab60 con 0x7fe6080cb5a0 2023-10-14T19:10:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe610570700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080ce0f0 con 0x7fe60815a5d0 2023-10-14T19:10:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60eb0d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe60815a5d0 0x7fe608156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60db0b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe6080cb970 0x7fe608159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49532/0 (socket says 172.21.15.7:49532) 2023-10-14T19:10:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60db0b700 1 -- 172.21.15.7:0/3113418529 learned_addr learned my addr 172.21.15.7:0/3113418529 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60eb0d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe60815a5d0 0x7fe608156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58972/0 (socket says 172.21.15.7:58972) 2023-10-14T19:10:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60eb0d700 1 -- 172.21.15.7:0/3113418529 >> v1:172.21.15.148:6789/0 conn(0x7fe6080cb5a0 legacy=0x7fe6080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60eb0d700 1 -- 172.21.15.7:0/3113418529 >> v1:172.21.15.7:6789/0 conn(0x7fe6080cb970 legacy=0x7fe608159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.560+0000 7fe60eb0d700 1 -- 172.21.15.7:0/3113418529 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080ccf00 con 0x7fe60815a5d0 2023-10-14T19:10:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe60eb0d700 1 --2- 172.21.15.7:0/3113418529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60815a5d0 0x7fe608156e90 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098e0 tx=0x7fe5f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72a3d8d6fbb833 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe60d30a700 1 -- 172.21.15.7:0/3113418529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8009e80 con 0x7fe60815a5d0 2023-10-14T19:10:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe60d30a700 1 -- 172.21.15.7:0/3113418529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800b820 con 0x7fe60815a5d0 2023-10-14T19:10:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe60d30a700 1 -- 172.21.15.7:0/3113418529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800bba0 con 0x7fe60815a5d0 2023-10-14T19:10:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 -- 172.21.15.7:0/3113418529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60815a5d0 msgr2=0x7fe608156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 --2- 172.21.15.7:0/3113418529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60815a5d0 0x7fe608156e90 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098e0 tx=0x7fe5f80091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 -- 172.21.15.7:0/3113418529 shutdown_connections 2023-10-14T19:10:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 --2- 172.21.15.7:0/3113418529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60815a5d0 0x7fe608156e90 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 -- 172.21.15.7:0/3113418529 >> 172.21.15.7:0/3113418529 conn(0x7fe608070e30 msgr2=0x7fe6080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 -- 172.21.15.7:0/3113418529 shutdown_connections 2023-10-14T19:10:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.561+0000 7fe610570700 1 -- 172.21.15.7:0/3113418529 wait complete. 2023-10-14T19:10:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.562+0000 7fe610570700 1 Processor -- start 2023-10-14T19:10:21.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.562+0000 7fe610570700 1 -- start start 2023-10-14T19:10:21.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe610570700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 0x7fe6081531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe610570700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6080cb970 0x7fe6080b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe610570700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe60815a5d0 0x7fe60815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe610570700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080b62d0 con 0x7fe6080cb5a0 2023-10-14T19:10:21.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe610570700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080b56c0 con 0x7fe60815a5d0 2023-10-14T19:10:21.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe610570700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080b59a0 con 0x7fe6080cb970 2023-10-14T19:10:21.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe60e30c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 0x7fe6081531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe60e30c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 0x7fe6081531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58984/0 (socket says 172.21.15.7:58984) 2023-10-14T19:10:21.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.563+0000 7fe60e30c700 1 -- 172.21.15.7:0/1313575162 learned_addr learned my addr 172.21.15.7:0/1313575162 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:21.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60db0b700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6080cb970 0x7fe6080b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60eb0d700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe60815a5d0 0x7fe60815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60e30c700 1 -- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6080cb970 msgr2=0x7fe6080b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60e30c700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6080cb970 0x7fe6080b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60e30c700 1 -- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe60815a5d0 msgr2=0x7fe60815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60e30c700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe60815a5d0 0x7fe60815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60e30c700 1 -- 172.21.15.7:0/1313575162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009420 con 0x7fe6080cb5a0 2023-10-14T19:10:21.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60db0b700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6080cb970 0x7fe6080b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:21.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60eb0d700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe60815a5d0 0x7fe60815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:21.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe60e30c700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 0x7fe6081531e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe60000c950 tx=0x7fe600002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000a7e0 con 0x7fe6080cb5a0 2023-10-14T19:10:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000a940 con 0x7fe6080cb5a0 2023-10-14T19:10:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6080b5c80 con 0x7fe6080cb5a0 2023-10-14T19:10:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000ad00 con 0x7fe6080cb5a0 2023-10-14T19:10:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.564+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6080caa00 con 0x7fe6080cb5a0 2023-10-14T19:10:21.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.565+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60804c3c0 con 0x7fe6080cb5a0 2023-10-14T19:10:21.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.565+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe600012630 con 0x7fe6080cb5a0 2023-10-14T19:10:21.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.566+0000 7fe6067fc700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5f4067320 0x7fe5f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:21.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.566+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6000851e0 con 0x7fe6080cb5a0 2023-10-14T19:10:21.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.566+0000 7fe60db0b700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5f4067320 0x7fe5f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:21.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.566+0000 7fe60db0b700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5f4067320 0x7fe5f40697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe6080af420 tx=0x7fe5fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:21.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.570+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe600051f20 con 0x7fe6080cb5a0 2023-10-14T19:10:21.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.810+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6080d12e0 con 0x7fe6080cb5a0 2023-10-14T19:10:21.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.810+0000 7fe6067fc700 1 -- 172.21.15.7:0/1313575162 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe600016060 con 0x7fe6080cb5a0 2023-10-14T19:10:21.811 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:10:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5f4067320 msgr2=0x7fe5f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5f4067320 0x7fe5f40697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe6080af420 tx=0x7fe5fc009040 comp rx=0 tx=0).stop 2023-10-14T19:10:21.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 msgr2=0x7fe6081531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:21.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 0x7fe6081531e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe60000c950 tx=0x7fe600002760 comp rx=0 tx=0).stop 2023-10-14T19:10:21.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 shutdown_connections 2023-10-14T19:10:21.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5f4067320 0x7fe5f40697d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe60815a5d0 0x7fe60815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080cb5a0 0x7fe6081531e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 --2- 172.21.15.7:0/1313575162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6080cb970 0x7fe6080b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 >> 172.21.15.7:0/1313575162 conn(0x7fe608070e30 msgr2=0x7fe6080c6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 shutdown_connections 2023-10-14T19:10:21.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:21.812+0000 7fe610570700 1 -- 172.21.15.7:0/1313575162 wait complete. 2023-10-14T19:10:21.825 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:10:21.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:10:21.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:10:21.826 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:10:21.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:21.827 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:10:21.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:10:21.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:10:21.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:10:21.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:21.828 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:10:21.846 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:10:21.847 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:10:21.847 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:10:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:10:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.849 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:10:21.850 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:10:21.851 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:10:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:10:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:10:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42032sec preferred_lft 42032sec 2023-10-14T19:10:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:10:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.853 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:10:21.854 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:10:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:10:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:10:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.856 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:10:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:10:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.857 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:10:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:10:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:21.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:21.859 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:10:21.911 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:10:21.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:21.913 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:10:21.969 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:10:21.970 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:10:21.970 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:10:21.970 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:10:21.970 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:10:21.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:21.972 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:10:21.972 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:10:21.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:10:21.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:10:21.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:10:21.973 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:10:22.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:22.073 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:10:22.088 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:10:22.089 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:10:22.089 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:10:22.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:22.090 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:10:22.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:22.154 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:22.209 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:10:22.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:22.210 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:22.264 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:10:22.264 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:10:22.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:22.345 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:22.345 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:10:22.345 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:10:22.353 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:22.353 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:10:22.354 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:10:22.354 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:22.354 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:22.376 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:22.376 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:10:22.376 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:10:22.376 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:22.377 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:22.377 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:10:22.377 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:10:22.377 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:10:22.378 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:10:22.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:22.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:22.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:10:22.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.604+0000 7f1594006700 1 Processor -- start 2023-10-14T19:10:22.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.604+0000 7f1594006700 1 -- start start 2023-10-14T19:10:22.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1594006700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f158c0cb5a0 0x7f158c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1594006700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f158c0cd9e0 0x7f158c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1594006700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c15ae40 con 0x7f158c15a400 2023-10-14T19:10:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1594006700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c0d13f0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1594006700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c15ab60 con 0x7f158c0cd9e0 2023-10-14T19:10:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1591da2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f158c0cb5a0 0x7f158c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1591da2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f158c0cb5a0 0x7f158c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58992/0 (socket says 172.21.15.7:58992) 2023-10-14T19:10:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.605+0000 7f1591da2700 1 -- 172.21.15.7:0/3993737844 learned_addr learned my addr 172.21.15.7:0/3993737844 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f15915a1700 1 --2- 172.21.15.7:0/3993737844 >> v2:172.21.15.148:3300/0 conn(0x7f158c0cd9e0 0x7f158c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1591da2700 1 -- 172.21.15.7:0/3993737844 >> v2:172.21.15.148:3300/0 conn(0x7f158c0cd9e0 msgr2=0x7f158c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1591da2700 1 --2- 172.21.15.7:0/3993737844 >> v2:172.21.15.148:3300/0 conn(0x7f158c0cd9e0 0x7f158c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1591da2700 1 -- 172.21.15.7:0/3993737844 >> v1:172.21.15.148:6789/0 conn(0x7f158c15a400 legacy=0x7f158c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1591da2700 1 -- 172.21.15.7:0/3993737844 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0ccf00 con 0x7f158c0cb5a0 2023-10-14T19:10:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1591da2700 1 --2- 172.21.15.7:0/3993737844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c0cb970 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f157c0099b0 tx=0x7f157c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549cd32735639d4f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1590da0700 1 -- 172.21.15.7:0/3993737844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00b7e0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1590da0700 1 -- 172.21.15.7:0/3993737844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00b940 con 0x7f158c0cb5a0 2023-10-14T19:10:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1590da0700 1 -- 172.21.15.7:0/3993737844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00bce0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1594006700 1 -- 172.21.15.7:0/3993737844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 msgr2=0x7f158c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1594006700 1 --2- 172.21.15.7:0/3993737844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c0cb970 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f157c0099b0 tx=0x7f157c009250 comp rx=0 tx=0).stop 2023-10-14T19:10:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1594006700 1 -- 172.21.15.7:0/3993737844 shutdown_connections 2023-10-14T19:10:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1594006700 1 --2- 172.21.15.7:0/3993737844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c0cb970 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1594006700 1 --2- 172.21.15.7:0/3993737844 >> v2:172.21.15.148:3300/0 conn(0x7f158c0cd9e0 0x7f158c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.606+0000 7f1594006700 1 -- 172.21.15.7:0/3993737844 >> 172.21.15.7:0/3993737844 conn(0x7f158c070e30 msgr2=0x7f158c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.607+0000 7f1594006700 1 -- 172.21.15.7:0/3993737844 shutdown_connections 2023-10-14T19:10:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.607+0000 7f1594006700 1 -- 172.21.15.7:0/3993737844 wait complete. 2023-10-14T19:10:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 Processor -- start 2023-10-14T19:10:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 -- start start 2023-10-14T19:10:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c16e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f158c0cd9e0 0x7f158c158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c15a400 0x7f158c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c16e620 con 0x7f158c0cb5a0 2023-10-14T19:10:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c152d50 con 0x7f158c15a400 2023-10-14T19:10:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.608+0000 7f1594006700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c16d690 con 0x7f158c0cd9e0 2023-10-14T19:10:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c16e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:22.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c16e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59008/0 (socket says 172.21.15.7:59008) 2023-10-14T19:10:22.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 -- 172.21.15.7:0/190868548 learned_addr learned my addr 172.21.15.7:0/190868548 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:22.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f15915a1700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f158c0cd9e0 0x7f158c158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f15925a3700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c15a400 0x7f158c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 -- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f158c0cd9e0 msgr2=0x7f158c158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f158c0cd9e0 0x7f158c158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 -- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c15a400 msgr2=0x7f158c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c15a400 0x7f158c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 -- 172.21.15.7:0/190868548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0094f0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f15915a1700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f158c0cd9e0 0x7f158c158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:22.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1591da2700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c16e0e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f158c06ea60 tx=0x7f157c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:22.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c011e60 con 0x7f158c0cb5a0 2023-10-14T19:10:22.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c020070 con 0x7f158c0cb5a0 2023-10-14T19:10:22.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c01b6a0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.609+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c16dc50 con 0x7f158c0cb5a0 2023-10-14T19:10:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.610+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c157a00 con 0x7f158c0cb5a0 2023-10-14T19:10:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.611+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c04c3c0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.611+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f157c022030 con 0x7f158c0cb5a0 2023-10-14T19:10:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.611+0000 7f1589ffb700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1578067320 0x7f15780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.612+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f157c086b90 con 0x7f158c0cb5a0 2023-10-14T19:10:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.612+0000 7f15915a1700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1578067320 0x7f15780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.612+0000 7f15915a1700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1578067320 0x7f15780697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f158c0c6380 tx=0x7f1580008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.616+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f157c0539e0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.853+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f158c04c3c0 con 0x7f158c0cb5a0 2023-10-14T19:10:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.854+0000 7f1589ffb700 1 -- 172.21.15.7:0/190868548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7f157c057000 con 0x7f158c0cb5a0 2023-10-14T19:10:22.858 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:10:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1578067320 msgr2=0x7f15780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1578067320 0x7f15780697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f158c0c6380 tx=0x7f1580008040 comp rx=0 tx=0).stop 2023-10-14T19:10:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 msgr2=0x7f158c16e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c16e0e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f158c06ea60 tx=0x7f157c016000 comp rx=0 tx=0).stop 2023-10-14T19:10:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 shutdown_connections 2023-10-14T19:10:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1578067320 0x7f15780697d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c15a400 0x7f158c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158c0cb5a0 0x7f158c16e0e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 --2- 172.21.15.7:0/190868548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f158c0cd9e0 0x7f158c158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 >> 172.21.15.7:0/190868548 conn(0x7f158c070e30 msgr2=0x7f158c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 shutdown_connections 2023-10-14T19:10:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:22.856+0000 7f1594006700 1 -- 172.21.15.7:0/190868548 wait complete. 2023-10-14T19:10:22.869 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:10:22.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:10:22.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:10:22.870 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:10:22.870 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:22.871 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:10:22.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:10:22.871 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:10:22.871 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:10:22.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:22.872 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:10:22.891 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:10:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:10:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:10:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:10:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.892 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:10:22.893 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:10:22.894 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:22.894 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:22.894 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:10:22.894 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:22.895 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:10:22.895 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42041sec preferred_lft 42041sec 2023-10-14T19:10:22.895 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:10:22.895 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.895 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:10:22.896 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:22.896 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:10:22.896 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.896 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:10:22.897 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.897 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:22.897 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:10:22.898 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:10:22.898 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.898 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:22.898 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:10:22.898 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:10:22.899 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:22.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:22.899 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:10:22.958 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:10:22.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:22.961 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:10:23.018 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:10:23.018 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:10:23.019 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:10:23.019 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:10:23.019 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:10:23.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:23.020 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:10:23.020 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:10:23.021 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:10:23.021 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:10:23.022 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:10:23.022 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:10:23.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:23.124 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:10:23.139 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:10:23.139 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:10:23.139 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:10:23.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:23.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:10:23.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:23.205 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:23.259 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:10:23.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:23.260 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:23.313 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:10:23.313 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:10:23.314 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:23.424 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:23.424 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:10:23.424 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:10:23.425 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:23.425 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:23.425 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:10:23.425 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:10:23.425 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:10:23.426 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:10:23.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:23.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:23.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:10:23.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.628+0000 7fea66e42700 1 Processor -- start 2023-10-14T19:10:23.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.628+0000 7fea66e42700 1 -- start start 2023-10-14T19:10:23.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea66e42700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea60159940 0x7fea600b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:23.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea66e42700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea6006cdb0 0x7fea600aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:23.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea66e42700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600af670 con 0x7fea600b0e00 2023-10-14T19:10:23.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea66e42700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600aa2b0 con 0x7fea60159940 2023-10-14T19:10:23.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea66e42700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b12a0 con 0x7fea6006cdb0 2023-10-14T19:10:23.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea5ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fea600b0e00 0x7fea6006c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49540/0 (socket says 172.21.15.7:49540) 2023-10-14T19:10:23.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea5ffff700 1 -- 172.21.15.7:0/2879952144 learned_addr learned my addr 172.21.15.7:0/2879952144 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:23.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea653df700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea6006cdb0 0x7fea600aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:23.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea64bde700 1 --2- 172.21.15.7:0/2879952144 >> v2:172.21.15.148:3300/0 conn(0x7fea60159940 0x7fea600b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:23.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea5f7fe700 1 -- 172.21.15.7:0/2879952144 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589357124 0 0) 0x7fea4c001110 con 0x7fea600b0e00 2023-10-14T19:10:23.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea5f7fe700 1 -- 172.21.15.7:0/2879952144 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea50003570 con 0x7fea600b0e00 2023-10-14T19:10:23.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea64bde700 1 -- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea6006cdb0 msgr2=0x7fea600aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:23.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea64bde700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea6006cdb0 0x7fea600aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:23.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea64bde700 1 -- 172.21.15.7:0/2879952144 >> v1:172.21.15.7:6789/0 conn(0x7fea600b0e00 legacy=0x7fea6006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:23.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea64bde700 1 -- 172.21.15.7:0/2879952144 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60159d10 con 0x7fea60159940 2023-10-14T19:10:23.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.629+0000 7fea653df700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea6006cdb0 0x7fea600aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:23.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea64bde700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea60159940 0x7fea600b08c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fea540098d0 tx=0x7fea54009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d102d0f7dbc2b692 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:23.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea5f7fe700 1 -- 172.21.15.7:0/2879952144 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54005c10 con 0x7fea60159940 2023-10-14T19:10:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea5f7fe700 1 -- 172.21.15.7:0/2879952144 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54005d70 con 0x7fea60159940 2023-10-14T19:10:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea5f7fe700 1 -- 172.21.15.7:0/2879952144 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54006280 con 0x7fea60159940 2023-10-14T19:10:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 -- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea60159940 msgr2=0x7fea600b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea60159940 0x7fea600b08c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fea540098d0 tx=0x7fea54009120 comp rx=0 tx=0).stop 2023-10-14T19:10:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 -- 172.21.15.7:0/2879952144 shutdown_connections 2023-10-14T19:10:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea60159940 0x7fea600b08c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 --2- 172.21.15.7:0/2879952144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea6006cdb0 0x7fea600aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 -- 172.21.15.7:0/2879952144 >> 172.21.15.7:0/2879952144 conn(0x7fea600cd3e0 msgr2=0x7fea600cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 -- 172.21.15.7:0/2879952144 shutdown_connections 2023-10-14T19:10:23.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.630+0000 7fea66e42700 1 -- 172.21.15.7:0/2879952144 wait complete. 2023-10-14T19:10:23.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 Processor -- start 2023-10-14T19:10:23.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 -- start start 2023-10-14T19:10:23.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6006cdb0 0x7fea600cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:23.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 0x7fea60156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:23.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea60159940 0x7fea600c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:23.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600cccf0 con 0x7fea600b0e00 2023-10-14T19:10:23.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600ad9d0 con 0x7fea6006cdb0 2023-10-14T19:10:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.632+0000 7fea66e42700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600adcb0 con 0x7fea60159940 2023-10-14T19:10:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 0x7fea60156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 0x7fea60156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59012/0 (socket says 172.21.15.7:59012) 2023-10-14T19:10:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 -- 172.21.15.7:0/406803493 learned_addr learned my addr 172.21.15.7:0/406803493 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea64bde700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6006cdb0 0x7fea600cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea653df700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea60159940 0x7fea600c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 -- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea60159940 msgr2=0x7fea600c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea60159940 0x7fea600c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 -- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6006cdb0 msgr2=0x7fea600cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6006cdb0 0x7fea600cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 -- 172.21.15.7:0/406803493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58009a20 con 0x7fea600b0e00 2023-10-14T19:10:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5ffff700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 0x7fea60156ea0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c7c0 tx=0x7fea4c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c005b30 con 0x7fea600b0e00 2023-10-14T19:10:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c005cb0 con 0x7fea600b0e00 2023-10-14T19:10:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c007320 con 0x7fea600b0e00 2023-10-14T19:10:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea540093c0 con 0x7fea600b0e00 2023-10-14T19:10:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.633+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600ae6e0 con 0x7fea600b0e00 2023-10-14T19:10:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.634+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600ade20 con 0x7fea600b0e00 2023-10-14T19:10:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.635+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fea4c01b3b0 con 0x7fea600b0e00 2023-10-14T19:10:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.635+0000 7fea5cff9700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea44067320 0x7fea440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.635+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea4c083f00 con 0x7fea600b0e00 2023-10-14T19:10:23.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.636+0000 7fea64bde700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea44067320 0x7fea440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:23.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.636+0000 7fea64bde700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea44067320 0x7fea440697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fea54009340 tx=0x7fea54016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:23.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.640+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea4c050c50 con 0x7fea600b0e00 2023-10-14T19:10:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:23.879+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea600af670 con 0x7fea600b0e00 2023-10-14T19:10:24.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.537+0000 7fea5cff9700 1 -- 172.21.15.7:0/406803493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v92) v1 ==== 136+0+0 (secure 0 0 0) 0x7fea600af670 con 0x7fea600b0e00 2023-10-14T19:10:24.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea44067320 msgr2=0x7fea440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea44067320 0x7fea440697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fea54009340 tx=0x7fea54016000 comp rx=0 tx=0).stop 2023-10-14T19:10:24.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 msgr2=0x7fea60156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 0x7fea60156ea0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c7c0 tx=0x7fea4c007c70 comp rx=0 tx=0).stop 2023-10-14T19:10:24.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 shutdown_connections 2023-10-14T19:10:24.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fea44067320 0x7fea440697d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6006cdb0 0x7fea600cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea60159940 0x7fea600c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 --2- 172.21.15.7:0/406803493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea600b0e00 0x7fea60156ea0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 >> 172.21.15.7:0/406803493 conn(0x7fea600cd3e0 msgr2=0x7fea6015d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:24.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 shutdown_connections 2023-10-14T19:10:24.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.539+0000 7fea66e42700 1 -- 172.21.15.7:0/406803493 wait complete. 2023-10-14T19:10:24.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:10:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.683+0000 7f4f1d759700 1 Processor -- start 2023-10-14T19:10:24.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.684+0000 7f4f1d759700 1 -- start start 2023-10-14T19:10:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.684+0000 7f4f1d759700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f18153c30 0x7f4f1815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.684+0000 7f4f1d759700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f180cf110 0x7f4f1815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.684+0000 7f4f1d759700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1815afd0 con 0x7f4f1815de50 2023-10-14T19:10:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.684+0000 7f4f1d759700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1815b2b0 con 0x7f4f18153c30 2023-10-14T19:10:24.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.684+0000 7f4f1d759700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815b590 con 0x7f4f180cf110 2023-10-14T19:10:24.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f18153c30 0x7f4f1815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:24.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f18153c30 0x7f4f1815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59022/0 (socket says 172.21.15.7:59022) 2023-10-14T19:10:24.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 -- 172.21.15.7:0/2600039012 learned_addr learned my addr 172.21.15.7:0/2600039012 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:24.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f177fe700 1 --1- 172.21.15.7:0/2600039012 >> v1:172.21.15.7:6789/0 conn(0x7f4f1815de50 0x7f4f180cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49556/0 (socket says 172.21.15.7:49556) 2023-10-14T19:10:24.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f1cf58700 1 --2- 172.21.15.7:0/2600039012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f180cf110 0x7f4f1815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:24.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 -- 172.21.15.7:0/2600039012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f180cf110 msgr2=0x7f4f1815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:24.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 --2- 172.21.15.7:0/2600039012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f180cf110 0x7f4f1815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 -- 172.21.15.7:0/2600039012 >> v1:172.21.15.7:6789/0 conn(0x7f4f1815de50 legacy=0x7f4f180cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 -- 172.21.15.7:0/2600039012 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815b870 con 0x7f4f18153c30 2023-10-14T19:10:24.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f16ffd700 1 -- 172.21.15.7:0/2600039012 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207456786 0 0) 0x7f4f1815afd0 con 0x7f4f1815de50 2023-10-14T19:10:24.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f17fff700 1 --2- 172.21.15.7:0/2600039012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f18153c30 0x7f4f1815a5e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4f080099b0 tx=0x7f4f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6cebec743696ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:24.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f16ffd700 1 -- 172.21.15.7:0/2600039012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800b860 con 0x7f4f18153c30 2023-10-14T19:10:24.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f16ffd700 1 -- 172.21.15.7:0/2600039012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800b9c0 con 0x7f4f18153c30 2023-10-14T19:10:24.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.685+0000 7f4f16ffd700 1 -- 172.21.15.7:0/2600039012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800bd60 con 0x7f4f18153c30 2023-10-14T19:10:24.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 -- 172.21.15.7:0/2600039012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f18153c30 msgr2=0x7f4f1815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2600039012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f18153c30 0x7f4f1815a5e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4f080099b0 tx=0x7f4f08009250 comp rx=0 tx=0).stop 2023-10-14T19:10:24.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 -- 172.21.15.7:0/2600039012 shutdown_connections 2023-10-14T19:10:24.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2600039012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f18153c30 0x7f4f1815a5e0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2600039012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f180cf110 0x7f4f1815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 -- 172.21.15.7:0/2600039012 >> 172.21.15.7:0/2600039012 conn(0x7f4f180703a0 msgr2=0x7f4f180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:24.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 -- 172.21.15.7:0/2600039012 shutdown_connections 2023-10-14T19:10:24.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.686+0000 7f4f1d759700 1 -- 172.21.15.7:0/2600039012 wait complete. 2023-10-14T19:10:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.687+0000 7f4f1d759700 1 Processor -- start 2023-10-14T19:10:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.687+0000 7f4f1d759700 1 -- start start 2023-10-14T19:10:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1d759700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 0x7f4f180b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1d759700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f18153c30 0x7f4f180b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1d759700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f1815de50 0x7f4f180b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1d759700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b49b0 con 0x7f4f180cf110 2023-10-14T19:10:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1d759700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b3da0 con 0x7f4f1815de50 2023-10-14T19:10:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1d759700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b4080 con 0x7f4f18153c30 2023-10-14T19:10:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 0x7f4f180b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 0x7f4f180b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59028/0 (socket says 172.21.15.7:59028) 2023-10-14T19:10:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 -- 172.21.15.7:0/2394658803 learned_addr learned my addr 172.21.15.7:0/2394658803 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f177fe700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f18153c30 0x7f4f180b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f1cf58700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f1815de50 0x7f4f180b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 -- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f18153c30 msgr2=0x7f4f180b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f18153c30 0x7f4f180b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 -- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f1815de50 msgr2=0x7f4f180b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f1815de50 0x7f4f180b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 -- 172.21.15.7:0/2394658803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080094f0 con 0x7f4f180cf110 2023-10-14T19:10:24.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f17fff700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 0x7f4f180b37a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4f180cf5c0 tx=0x7f4f08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:24.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011d70 con 0x7f4f180cf110 2023-10-14T19:10:24.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.688+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08024440 con 0x7f4f180cf110 2023-10-14T19:10:24.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.689+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180b4360 con 0x7f4f180cf110 2023-10-14T19:10:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.689+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08024800 con 0x7f4f180cf110 2023-10-14T19:10:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.689+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180b34f0 con 0x7f4f180cf110 2023-10-14T19:10:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.690+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1804c3c0 con 0x7f4f180cf110 2023-10-14T19:10:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.690+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4f0801a420 con 0x7f4f180cf110 2023-10-14T19:10:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.690+0000 7f4f0ffff700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ef8067320 0x7f4ef80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:24.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.691+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f08086a10 con 0x7f4f180cf110 2023-10-14T19:10:24.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.691+0000 7f4f177fe700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ef8067320 0x7f4ef80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:24.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.691+0000 7f4f177fe700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ef8067320 0x7f4ef80697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c9ee0 tx=0x7f4f00007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:24.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.695+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f080536a0 con 0x7f4f180cf110 2023-10-14T19:10:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.916+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f1815bb50 con 0x7f4ef8067320 2023-10-14T19:10:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.918+0000 7f4f0ffff700 1 -- 172.21.15.7:0/2394658803 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4f1815bb50 con 0x7f4ef8067320 2023-10-14T19:10:24.919 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:10:24.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:24.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:10:24.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:24.920 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:10:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ef8067320 msgr2=0x7f4ef80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ef8067320 0x7f4ef80697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c9ee0 tx=0x7f4f00007ef0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 msgr2=0x7f4f180b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 0x7f4f180b37a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4f180cf5c0 tx=0x7f4f08017000 comp rx=0 tx=0).stop 2023-10-14T19:10:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 shutdown_connections 2023-10-14T19:10:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ef8067320 0x7f4ef80697d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f1815de50 0x7f4f180b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f180cf110 0x7f4f180b37a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 --2- 172.21.15.7:0/2394658803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f18153c30 0x7f4f180b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 >> 172.21.15.7:0/2394658803 conn(0x7f4f180703a0 msgr2=0x7f4f180c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 shutdown_connections 2023-10-14T19:10:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:24.920+0000 7f4f1d759700 1 -- 172.21.15.7:0/2394658803 wait complete. 2023-10-14T19:10:24.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:10:25.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.054+0000 7f4c007a6700 1 Processor -- start 2023-10-14T19:10:25.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.054+0000 7f4c007a6700 1 -- start start 2023-10-14T19:10:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4c007a6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc320 0x7f4bf813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4c007a6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bf806a110 0x7f4bf813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4c007a6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf806d7b0 con 0x7f4bf80cc6f0 2023-10-14T19:10:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4c007a6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf806a590 con 0x7f4bf806a110 2023-10-14T19:10:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4c007a6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf806f7d0 con 0x7f4bf80cc320 2023-10-14T19:10:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bf806a110 0x7f4bf813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bf806a110 0x7f4bf813c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59032/0 (socket says 172.21.15.7:59032) 2023-10-14T19:10:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 -- 172.21.15.7:0/1467631398 learned_addr learned my addr 172.21.15.7:0/1467631398 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfe542700 1 --2- 172.21.15.7:0/1467631398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc320 0x7f4bf813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 -- 172.21.15.7:0/1467631398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc320 msgr2=0x7f4bf813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 --2- 172.21.15.7:0/1467631398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc320 0x7f4bf813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 -- 172.21.15.7:0/1467631398 >> v1:172.21.15.148:6789/0 conn(0x7f4bf80cc6f0 legacy=0x7f4bf8069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 -- 172.21.15.7:0/1467631398 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf806e330 con 0x7f4bf806a110 2023-10-14T19:10:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.055+0000 7f4bfed43700 1 --2- 172.21.15.7:0/1467631398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf806a110 0x7f4bf813c7e0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009f20 tx=0x7f4bf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3297d33a512e410 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4bfd540700 1 -- 172.21.15.7:0/1467631398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000e070 con 0x7f4bf806a110 2023-10-14T19:10:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4bfd540700 1 -- 172.21.15.7:0/1467631398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000ba80 con 0x7f4bf806a110 2023-10-14T19:10:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4bfd540700 1 -- 172.21.15.7:0/1467631398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00092e0 con 0x7f4bf806a110 2023-10-14T19:10:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 -- 172.21.15.7:0/1467631398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf806a110 msgr2=0x7f4bf813c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1467631398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf806a110 0x7f4bf813c7e0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009f20 tx=0x7f4bf0009840 comp rx=0 tx=0).stop 2023-10-14T19:10:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 -- 172.21.15.7:0/1467631398 shutdown_connections 2023-10-14T19:10:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1467631398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf806a110 0x7f4bf813c7e0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1467631398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc320 0x7f4bf813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 -- 172.21.15.7:0/1467631398 >> 172.21.15.7:0/1467631398 conn(0x7f4bf8067f00 msgr2=0x7f4bf8068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 -- 172.21.15.7:0/1467631398 shutdown_connections 2023-10-14T19:10:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.056+0000 7f4c007a6700 1 -- 172.21.15.7:0/1467631398 wait complete. 2023-10-14T19:10:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.057+0000 7f4c007a6700 1 Processor -- start 2023-10-14T19:10:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.057+0000 7f4c007a6700 1 -- start start 2023-10-14T19:10:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4c007a6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf806a110 0x7f4bf80b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4c007a6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 0x7f4bf816cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4c007a6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc6f0 0x7f4bf816d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4c007a6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80aeed0 con 0x7f4bf80cc320 2023-10-14T19:10:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4c007a6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80c7f00 con 0x7f4bf806a110 2023-10-14T19:10:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4c007a6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ae530 con 0x7f4bf80cc6f0 2023-10-14T19:10:25.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4bfdd41700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 0x7f4bf816cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4bfdd41700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 0x7f4bf816cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59044/0 (socket says 172.21.15.7:59044) 2023-10-14T19:10:25.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4bfdd41700 1 -- 172.21.15.7:0/1751713393 learned_addr learned my addr 172.21.15.7:0/1751713393 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:25.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4bfed43700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc6f0 0x7f4bf816d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.058+0000 7f4bfe542700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf806a110 0x7f4bf80b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfdd41700 1 -- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc6f0 msgr2=0x7f4bf816d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfdd41700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc6f0 0x7f4bf816d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfdd41700 1 -- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf806a110 msgr2=0x7f4bf80b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfdd41700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf806a110 0x7f4bf80b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfdd41700 1 -- 172.21.15.7:0/1751713393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0009ae0 con 0x7f4bf80cc320 2023-10-14T19:10:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfe542700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf806a110 0x7f4bf80b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bfdd41700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 0x7f4bf816cf50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c4e0 tx=0x7f4be800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8011590 con 0x7f4bf80cc320 2023-10-14T19:10:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8011710 con 0x7f4bf80cc320 2023-10-14T19:10:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80ae810 con 0x7f4bf80cc320 2023-10-14T19:10:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8011ad0 con 0x7f4bf80cc320 2023-10-14T19:10:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.059+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf816dbe0 con 0x7f4bf80cc320 2023-10-14T19:10:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.060+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf816de00 con 0x7f4bf80cc320 2023-10-14T19:10:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.061+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4be801b3b0 con 0x7f4bf80cc320 2023-10-14T19:10:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.061+0000 7f4bee7fc700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4bdc067320 0x7f4bdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.061+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4be8084080 con 0x7f4bf80cc320 2023-10-14T19:10:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.061+0000 7f4bfe542700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4bdc067320 0x7f4bdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.061+0000 7f4bfe542700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4bdc067320 0x7f4bdc0697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4006fd0 tx=0x7f4bf4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.065+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bf816de00 con 0x7f4bf80cc320 2023-10-14T19:10:25.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.261+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4bf80af010 con 0x7f4bf80cc320 2023-10-14T19:10:25.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.262+0000 7f4bee7fc700 1 -- 172.21.15.7:0/1751713393 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4bf80af010 con 0x7f4bf80cc320 2023-10-14T19:10:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4bdc067320 msgr2=0x7f4bdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4bdc067320 0x7f4bdc0697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4006fd0 tx=0x7f4bf4008040 comp rx=0 tx=0).stop 2023-10-14T19:10:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 msgr2=0x7f4bf816cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 0x7f4bf816cf50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c4e0 tx=0x7f4be800c7f0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 shutdown_connections 2023-10-14T19:10:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4bdc067320 0x7f4bdc0697d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf806a110 0x7f4bf80b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4bf80cc6f0 0x7f4bf816d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 --2- 172.21.15.7:0/1751713393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf80cc320 0x7f4bf816cf50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 >> 172.21.15.7:0/1751713393 conn(0x7f4bf8067f00 msgr2=0x7f4bf813c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 shutdown_connections 2023-10-14T19:10:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.264+0000 7f4c007a6700 1 -- 172.21.15.7:0/1751713393 wait complete. 2023-10-14T19:10:25.277 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:10:25.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:10:25.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:25.313 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:10:25.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:25.314 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:10:25.369 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:10:25.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:10:25.369 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:25.411 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:10:25.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:25.412 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:10:25.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:10:25.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:25.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T19:10:25.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:10:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T19:10:25.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:10:25.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:25.484 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T19:10:25.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:10:25.523 INFO:teuthology.orchestra.run.smithi148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T19:10:25.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000623116 --yes-i-really-mean-it 2023-10-14T19:10:25.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.646+0000 7fd7ffcac700 1 Processor -- start 2023-10-14T19:10:25.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.647+0000 7fd7ffcac700 1 -- start start 2023-10-14T19:10:25.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.647+0000 7fd7ffcac700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd7f80a8aa0 0x7fd7f80a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.647+0000 7fd7ffcac700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f8088400 0x7fd7f80b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.647+0000 7fd7ffcac700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80ce1c0 con 0x7fd7f80ae6f0 2023-10-14T19:10:25.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.647+0000 7fd7ffcac700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80cd5b0 con 0x7fd7f80a8aa0 2023-10-14T19:10:25.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.647+0000 7fd7ffcac700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80cd890 con 0x7fd7f8088400 2023-10-14T19:10:25.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fe249700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd7f80ae6f0 0x7fd7f80cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49568/0 (socket says 172.21.15.7:49568) 2023-10-14T19:10:25.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fe249700 1 -- 172.21.15.7:0/561496818 learned_addr learned my addr 172.21.15.7:0/561496818 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:25.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fda48700 1 --2- 172.21.15.7:0/561496818 >> v2:172.21.15.148:3300/0 conn(0x7fd7f80a8aa0 0x7fd7f80a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fd247700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f8088400 0x7fd7f80b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fca46700 1 -- 172.21.15.7:0/561496818 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227448336 0 0) 0x7fd7f80ce1c0 con 0x7fd7f80ae6f0 2023-10-14T19:10:25.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fca46700 1 -- 172.21.15.7:0/561496818 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003570 con 0x7fd7f80ae6f0 2023-10-14T19:10:25.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fda48700 1 -- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f8088400 msgr2=0x7fd7f80b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:25.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fda48700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f8088400 0x7fd7f80b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fda48700 1 -- 172.21.15.7:0/561496818 >> v1:172.21.15.7:6789/0 conn(0x7fd7f80ae6f0 legacy=0x7fd7f80cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fda48700 1 -- 172.21.15.7:0/561496818 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80cdb70 con 0x7fd7f80a8aa0 2023-10-14T19:10:25.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fd247700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f8088400 0x7fd7f80b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:25.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fda48700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80a8aa0 0x7fd7f80a8e70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009eb0 tx=0x7fd7f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87baa466be164fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:25.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fca46700 1 -- 172.21.15.7:0/561496818 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000e070 con 0x7fd7f80a8aa0 2023-10-14T19:10:25.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fca46700 1 -- 172.21.15.7:0/561496818 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000bb80 con 0x7fd7f80a8aa0 2023-10-14T19:10:25.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.648+0000 7fd7fca46700 1 -- 172.21.15.7:0/561496818 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0012430 con 0x7fd7f80a8aa0 2023-10-14T19:10:25.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 -- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80a8aa0 msgr2=0x7fd7f80a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80a8aa0 0x7fd7f80a8e70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009eb0 tx=0x7fd7f0009780 comp rx=0 tx=0).stop 2023-10-14T19:10:25.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 -- 172.21.15.7:0/561496818 shutdown_connections 2023-10-14T19:10:25.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80a8aa0 0x7fd7f80a8e70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/561496818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f8088400 0x7fd7f80b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 -- 172.21.15.7:0/561496818 >> 172.21.15.7:0/561496818 conn(0x7fd7f8088000 msgr2=0x7fd7f80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:25.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 -- 172.21.15.7:0/561496818 shutdown_connections 2023-10-14T19:10:25.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.649+0000 7fd7ffcac700 1 -- 172.21.15.7:0/561496818 wait complete. 2023-10-14T19:10:25.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.650+0000 7fd7ffcac700 1 Processor -- start 2023-10-14T19:10:25.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.650+0000 7fd7ffcac700 1 -- start start 2023-10-14T19:10:25.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7ffcac700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f80a8aa0 0x7fd7f806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7ffcac700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80ae6f0 0x7fd7f80c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7ffcac700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 0x7fd7f8098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7ffcac700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c76d0 con 0x7fd7f8158fc0 2023-10-14T19:10:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7ffcac700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c94f0 con 0x7fd7f80ae6f0 2023-10-14T19:10:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7ffcac700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c97d0 con 0x7fd7f80a8aa0 2023-10-14T19:10:25.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 0x7fd7f8098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 0x7fd7f8098c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59050/0 (socket says 172.21.15.7:59050) 2023-10-14T19:10:25.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 -- 172.21.15.7:0/177902387 learned_addr learned my addr 172.21.15.7:0/177902387 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:25.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fda48700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f80a8aa0 0x7fd7f806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fd247700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80ae6f0 0x7fd7f80c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 -- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f80a8aa0 msgr2=0x7fd7f806edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f80a8aa0 0x7fd7f806edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 -- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80ae6f0 msgr2=0x7fd7f80c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:25.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80ae6f0 0x7fd7f80c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:25.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 -- 172.21.15.7:0/177902387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec009420 con 0x7fd7f8158fc0 2023-10-14T19:10:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fda48700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f80a8aa0 0x7fd7f806edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fd247700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80ae6f0 0x7fd7f80c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.651+0000 7fd7fe249700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 0x7fd7f8098c70 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80010e0 tx=0x7fd7e8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.652+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005c00 con 0x7fd7f8158fc0 2023-10-14T19:10:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.652+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8005d60 con 0x7fd7f8158fc0 2023-10-14T19:10:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.652+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f0009a20 con 0x7fd7f8158fc0 2023-10-14T19:10:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.652+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80072e0 con 0x7fd7f8158fc0 2023-10-14T19:10:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.652+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f80c7c00 con 0x7fd7f8158fc0 2023-10-14T19:10:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.653+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f80c7e20 con 0x7fd7f8158fc0 2023-10-14T19:10:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.653+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd7e8012400 con 0x7fd7f8158fc0 2023-10-14T19:10:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.654+0000 7fd7f5ffb700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd7e4067320 0x7fd7e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.654+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7e80840e0 con 0x7fd7f8158fc0 2023-10-14T19:10:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.654+0000 7fd7fda48700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd7e4067320 0x7fd7e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.654+0000 7fd7fda48700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd7e4067320 0x7fd7e40697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00097c0 tx=0x7fd7f0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.658+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e804b5a0 con 0x7fd7f8158fc0 2023-10-14T19:10:25.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:25.878+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000623116", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f804c3c0 con 0x7fd7e4067320 2023-10-14T19:10:28.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.556+0000 7fd7f5ffb700 1 -- 172.21.15.7:0/177902387 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fd7f804c3c0 con 0x7fd7e4067320 2023-10-14T19:10:28.557 INFO:teuthology.orchestra.run.smithi007.stdout:FS volume 'cephfs' renamed to 'volume_0000000000623116' 2023-10-14T19:10:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd7e4067320 msgr2=0x7fd7e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd7e4067320 0x7fd7e40697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00097c0 tx=0x7fd7f0019000 comp rx=0 tx=0).stop 2023-10-14T19:10:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 msgr2=0x7fd7f8098c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 0x7fd7f8098c70 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80010e0 tx=0x7fd7e8007dd0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 shutdown_connections 2023-10-14T19:10:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd7e4067320 0x7fd7e40697d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f8158fc0 0x7fd7f8098c70 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7f80a8aa0 0x7fd7f806edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 --2- 172.21.15.7:0/177902387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f80ae6f0 0x7fd7f80c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 >> 172.21.15.7:0/177902387 conn(0x7fd7f8088000 msgr2=0x7fd7f80b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:28.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 shutdown_connections 2023-10-14T19:10:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.559+0000 7fd7ffcac700 1 -- 172.21.15.7:0/177902387 wait complete. 2023-10-14T19:10:28.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:10:28.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.702+0000 7fd590d9b700 1 Processor -- start 2023-10-14T19:10:28.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.702+0000 7fd590d9b700 1 -- start start 2023-10-14T19:10:28.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd590d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd58c153c30 0x7fd58c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:28.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd590d9b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c15afd0 con 0x7fd58c0cf110 2023-10-14T19:10:28.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd590d9b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c15b2b0 con 0x7fd58c15de50 2023-10-14T19:10:28.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd590d9b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c15b590 con 0x7fd58c153c30 2023-10-14T19:10:28.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd58c153c30 0x7fd58c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:28.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd58c0cf110 0x7fd58c15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44248/0 (socket says 172.21.15.7:44248) 2023-10-14T19:10:28.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd58c153c30 0x7fd58c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44976/0 (socket says 172.21.15.7:44976) 2023-10-14T19:10:28.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58bfff700 1 -- 172.21.15.7:0/1734258098 learned_addr learned my addr 172.21.15.7:0/1734258098 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:28.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58b7fe700 1 -- 172.21.15.7:0/1734258098 >> v1:172.21.15.148:6789/0 conn(0x7fd58c15de50 legacy=0x7fd58c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:28.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58b7fe700 1 -- 172.21.15.7:0/1734258098 >> v1:172.21.15.7:6789/0 conn(0x7fd58c0cf110 legacy=0x7fd58c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58b7fe700 1 -- 172.21.15.7:0/1734258098 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c15b870 con 0x7fd58c153c30 2023-10-14T19:10:28.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.703+0000 7fd58a7fc700 1 -- 172.21.15.7:0/1734258098 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141602768 0 0) 0x7fd58c15afd0 con 0x7fd58c0cf110 2023-10-14T19:10:28.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd58b7fe700 1 --2- 172.21.15.7:0/1734258098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c15a5e0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2da93e38d158e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:28.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd58a7fc700 1 -- 172.21.15.7:0/1734258098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c009e80 con 0x7fd58c153c30 2023-10-14T19:10:28.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd58a7fc700 1 -- 172.21.15.7:0/1734258098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00b820 con 0x7fd58c153c30 2023-10-14T19:10:28.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd58a7fc700 1 -- 172.21.15.7:0/1734258098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00bba0 con 0x7fd58c153c30 2023-10-14T19:10:28.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 -- 172.21.15.7:0/1734258098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 msgr2=0x7fd58c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 --2- 172.21.15.7:0/1734258098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c15a5e0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 -- 172.21.15.7:0/1734258098 shutdown_connections 2023-10-14T19:10:28.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 --2- 172.21.15.7:0/1734258098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c15a5e0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 -- 172.21.15.7:0/1734258098 >> 172.21.15.7:0/1734258098 conn(0x7fd58c0703a0 msgr2=0x7fd58c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:28.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 -- 172.21.15.7:0/1734258098 shutdown_connections 2023-10-14T19:10:28.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.704+0000 7fd590d9b700 1 -- 172.21.15.7:0/1734258098 wait complete. 2023-10-14T19:10:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 Processor -- start 2023-10-14T19:10:28.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 -- start start 2023-10-14T19:10:28.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd58c0cf110 0x7fd58c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:28.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:28.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd58c15de50 0x7fd58c169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0b3b20 con 0x7fd58c153c30 2023-10-14T19:10:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0b3e00 con 0x7fd58c15de50 2023-10-14T19:10:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd590d9b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0b40e0 con 0x7fd58c0cf110 2023-10-14T19:10:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd58affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd58affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c0b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44984/0 (socket says 172.21.15.7:44984) 2023-10-14T19:10:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.706+0000 7fd58affd700 1 -- 172.21.15.7:0/3525780627 learned_addr learned my addr 172.21.15.7:0/3525780627 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58bfff700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd58c15de50 0x7fd58c169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58b7fe700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd58c0cf110 0x7fd58c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58affd700 1 -- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd58c0cf110 msgr2=0x7fd58c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58affd700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd58c0cf110 0x7fd58c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58affd700 1 -- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd58c15de50 msgr2=0x7fd58c169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58affd700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd58c15de50 0x7fd58c169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58affd700 1 -- 172.21.15.7:0/3525780627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009420 con 0x7fd58c153c30 2023-10-14T19:10:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd58affd700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c0b4bc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b5e0 tx=0x7fd580009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000f510 con 0x7fd58c153c30 2023-10-14T19:10:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000f670 con 0x7fd58c153c30 2023-10-14T19:10:28.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c0b43c0 con 0x7fd58c153c30 2023-10-14T19:10:28.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000fa30 con 0x7fd58c153c30 2023-10-14T19:10:28.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.707+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c0b3810 con 0x7fd58c153c30 2023-10-14T19:10:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.708+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c0b48e0 con 0x7fd58c153c30 2023-10-14T19:10:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.709+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd58001a400 con 0x7fd58c153c30 2023-10-14T19:10:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.709+0000 7fd5737fe700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd578067320 0x7fd5780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.709+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd5800846b0 con 0x7fd58c153c30 2023-10-14T19:10:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.709+0000 7fd58b7fe700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd578067320 0x7fd5780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.710+0000 7fd58b7fe700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd578067320 0x7fd5780697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0030c0 tx=0x7fd57c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:28.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.713+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd58c0b48e0 con 0x7fd58c153c30 2023-10-14T19:10:28.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.934+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd58c0b3f70 con 0x7fd578067320 2023-10-14T19:10:28.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.936+0000 7fd5737fe700 1 -- 172.21.15.7:0/3525780627 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7fd58c0b3f70 con 0x7fd578067320 2023-10-14T19:10:28.937 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:10:28.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:28.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volume_0000000000623116" 2023-10-14T19:10:28.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:28.938 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:10:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd578067320 msgr2=0x7fd5780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd578067320 0x7fd5780697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0030c0 tx=0x7fd57c016000 comp rx=0 tx=0).stop 2023-10-14T19:10:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 msgr2=0x7fd58c0b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c0b4bc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b5e0 tx=0x7fd580009120 comp rx=0 tx=0).stop 2023-10-14T19:10:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 shutdown_connections 2023-10-14T19:10:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd578067320 0x7fd5780697d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd58c15de50 0x7fd58c169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd58c0cf110 0x7fd58c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 --2- 172.21.15.7:0/3525780627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd58c153c30 0x7fd58c0b4bc0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 >> 172.21.15.7:0/3525780627 conn(0x7fd58c0703a0 msgr2=0x7fd58c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 shutdown_connections 2023-10-14T19:10:28.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:28.938+0000 7fd590d9b700 1 -- 172.21.15.7:0/3525780627 wait complete. 2023-10-14T19:10:28.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:29.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.069+0000 7f6aa6049700 1 Processor -- start 2023-10-14T19:10:29.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.069+0000 7f6aa6049700 1 -- start start 2023-10-14T19:10:29.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6aa6049700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cd260 0x7f6aa00c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6aa6049700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6aa00c4c70 0x7f6aa00b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6aa6049700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa00c3690 con 0x7f6aa00cce90 2023-10-14T19:10:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6aa6049700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa00c3970 con 0x7f6aa00c4c70 2023-10-14T19:10:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6aa6049700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa00c3c50 con 0x7f6aa00cd260 2023-10-14T19:10:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6aa00c4c70 0x7f6aa00b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6aa00cce90 0x7f6aa00cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44262/0 (socket says 172.21.15.7:44262) 2023-10-14T19:10:29.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9f7fe700 1 -- 172.21.15.7:0/3593218341 learned_addr learned my addr 172.21.15.7:0/3593218341 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:29.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9effd700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cd260 0x7f6aa00c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9ffff700 1 -- 172.21.15.7:0/3593218341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cd260 msgr2=0x7f6aa00c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:29.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9ffff700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cd260 0x7f6aa00c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9ffff700 1 -- 172.21.15.7:0/3593218341 >> v1:172.21.15.7:6789/0 conn(0x7f6aa00cce90 legacy=0x7f6aa00cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9ffff700 1 -- 172.21.15.7:0/3593218341 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa00c3f30 con 0x7f6aa00c4c70 2023-10-14T19:10:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9effd700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cd260 0x7f6aa00c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.070+0000 7f6a9ffff700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00c4c70 0x7f6aa00b12d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009e60 tx=0x7f6a98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4442153d8bf9e8e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6a9e7fc700 1 -- 172.21.15.7:0/3593218341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800e070 con 0x7f6aa00c4c70 2023-10-14T19:10:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6a9e7fc700 1 -- 172.21.15.7:0/3593218341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9800bc30 con 0x7f6aa00c4c70 2023-10-14T19:10:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6a9e7fc700 1 -- 172.21.15.7:0/3593218341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98012430 con 0x7f6aa00c4c70 2023-10-14T19:10:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 -- 172.21.15.7:0/3593218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00c4c70 msgr2=0x7f6aa00b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00c4c70 0x7f6aa00b12d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009e60 tx=0x7f6a98009780 comp rx=0 tx=0).stop 2023-10-14T19:10:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 -- 172.21.15.7:0/3593218341 shutdown_connections 2023-10-14T19:10:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00c4c70 0x7f6aa00b12d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 --2- 172.21.15.7:0/3593218341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cd260 0x7f6aa00c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 -- 172.21.15.7:0/3593218341 >> 172.21.15.7:0/3593218341 conn(0x7f6aa006ce80 msgr2=0x7f6aa00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 -- 172.21.15.7:0/3593218341 shutdown_connections 2023-10-14T19:10:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.071+0000 7f6aa6049700 1 -- 172.21.15.7:0/3593218341 wait complete. 2023-10-14T19:10:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.072+0000 7f6aa6049700 1 Processor -- start 2023-10-14T19:10:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 -- start start 2023-10-14T19:10:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6aa00c4c70 0x7f6aa01697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cce90 0x7f6aa00c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 0x7f6aa014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa00c6870 con 0x7f6aa00cd260 2023-10-14T19:10:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa006d8e0 con 0x7f6aa00c4c70 2023-10-14T19:10:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6aa6049700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa00c85b0 con 0x7f6aa00cce90 2023-10-14T19:10:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6a9ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 0x7f6aa014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6a9ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 0x7f6aa014def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44994/0 (socket says 172.21.15.7:44994) 2023-10-14T19:10:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.073+0000 7f6a9ffff700 1 -- 172.21.15.7:0/2102752672 learned_addr learned my addr 172.21.15.7:0/2102752672 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9effd700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cce90 0x7f6aa00c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9f7fe700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6aa00c4c70 0x7f6aa01697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9ffff700 1 -- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cce90 msgr2=0x7f6aa00c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9ffff700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cce90 0x7f6aa00c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9ffff700 1 -- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6aa00c4c70 msgr2=0x7f6aa01697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9ffff700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6aa00c4c70 0x7f6aa01697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9ffff700 1 -- 172.21.15.7:0/2102752672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98009a20 con 0x7f6aa00cd260 2023-10-14T19:10:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a9ffff700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 0x7f6aa014def0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f6a98013000 tx=0x7f6a98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98012e90 con 0x7f6aa00cd260 2023-10-14T19:10:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9801e630 con 0x7f6aa00cd260 2023-10-14T19:10:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa0169e50 con 0x7f6aa00cd260 2023-10-14T19:10:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9801ea10 con 0x7f6aa00cd260 2023-10-14T19:10:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.074+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa016a410 con 0x7f6aa00cd260 2023-10-14T19:10:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.075+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa004c3c0 con 0x7f6aa00cd260 2023-10-14T19:10:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.076+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a98024070 con 0x7f6aa00cd260 2023-10-14T19:10:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.076+0000 7f6a877fe700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a8c067320 0x7f6a8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.076+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6a98087530 con 0x7f6aa00cd260 2023-10-14T19:10:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.076+0000 7f6a9f7fe700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a8c067320 0x7f6a8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.077+0000 7f6a9f7fe700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a8c067320 0x7f6a8c0697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.080+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a98054170 con 0x7f6aa00cd260 2023-10-14T19:10:29.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.317+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6aa00690f0 con 0x7f6aa00cd260 2023-10-14T19:10:29.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.318+0000 7f6a877fe700 1 -- 172.21.15.7:0/2102752672 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f6a98057790 con 0x7f6aa00cd260 2023-10-14T19:10:29.319 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:29.320 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:26.537765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000623116","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:29.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a8c067320 msgr2=0x7f6a8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a8c067320 0x7f6a8c0697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).stop 2023-10-14T19:10:29.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 msgr2=0x7f6aa014def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 0x7f6aa014def0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f6a98013000 tx=0x7f6a98019000 comp rx=0 tx=0).stop 2023-10-14T19:10:29.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 shutdown_connections 2023-10-14T19:10:29.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6a8c067320 0x7f6a8c0697d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6aa00c4c70 0x7f6aa01697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6aa00cd260 0x7f6aa014def0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 --2- 172.21.15.7:0/2102752672 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6aa00cce90 0x7f6aa00c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 >> 172.21.15.7:0/2102752672 conn(0x7f6aa006ce80 msgr2=0x7f6aa00c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:29.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 shutdown_connections 2023-10-14T19:10:29.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.320+0000 7f6aa6049700 1 -- 172.21.15.7:0/2102752672 wait complete. 2023-10-14T19:10:29.324 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2023-10-14T19:10:29.333 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.452+0000 7fe2ff74e700 1 Processor -- start 2023-10-14T19:10:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.453+0000 7fe2ff74e700 1 -- start start 2023-10-14T19:10:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.453+0000 7fe2ff74e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2f80cb5a0 0x7fe2f80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.453+0000 7fe2ff74e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f815a5d0 0x7fe2f8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.453+0000 7fe2ff74e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f815ae40 con 0x7fe2f80cd9e0 2023-10-14T19:10:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.453+0000 7fe2ff74e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80d13f0 con 0x7fe2f80cb5a0 2023-10-14T19:10:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.453+0000 7fe2ff74e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815ab60 con 0x7fe2f815a5d0 2023-10-14T19:10:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fd4ea700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2f80cb5a0 0x7fe2f80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fcce9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe2f80cd9e0 0x7fe2f8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44266/0 (socket says 172.21.15.7:44266) 2023-10-14T19:10:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fcce9700 1 -- 172.21.15.7:0/2708598917 learned_addr learned my addr 172.21.15.7:0/2708598917 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fdceb700 1 --2- 172.21.15.7:0/2708598917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f815a5d0 0x7fe2f8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fd4ea700 1 -- 172.21.15.7:0/2708598917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f815a5d0 msgr2=0x7fe2f8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fd4ea700 1 --2- 172.21.15.7:0/2708598917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f815a5d0 0x7fe2f8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fd4ea700 1 -- 172.21.15.7:0/2708598917 >> v1:172.21.15.7:6789/0 conn(0x7fe2f80cd9e0 legacy=0x7fe2f8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fd4ea700 1 -- 172.21.15.7:0/2708598917 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80ccf00 con 0x7fe2f80cb5a0 2023-10-14T19:10:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2fd4ea700 1 --2- 172.21.15.7:0/2708598917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f80cb5a0 0x7fe2f80cb970 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009910 tx=0x7fe2f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4dfebdcbe89650 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2f7fff700 1 -- 172.21.15.7:0/2708598917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000b820 con 0x7fe2f80cb5a0 2023-10-14T19:10:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2f7fff700 1 -- 172.21.15.7:0/2708598917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f000b980 con 0x7fe2f80cb5a0 2023-10-14T19:10:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.454+0000 7fe2f7fff700 1 -- 172.21.15.7:0/2708598917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000bd20 con 0x7fe2f80cb5a0 2023-10-14T19:10:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 -- 172.21.15.7:0/2708598917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f80cb5a0 msgr2=0x7fe2f80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/2708598917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f80cb5a0 0x7fe2f80cb970 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009910 tx=0x7fe2f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 -- 172.21.15.7:0/2708598917 shutdown_connections 2023-10-14T19:10:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/2708598917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f80cb5a0 0x7fe2f80cb970 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/2708598917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f815a5d0 0x7fe2f8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 -- 172.21.15.7:0/2708598917 >> 172.21.15.7:0/2708598917 conn(0x7fe2f8070e30 msgr2=0x7fe2f80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 -- 172.21.15.7:0/2708598917 shutdown_connections 2023-10-14T19:10:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.455+0000 7fe2ff74e700 1 -- 172.21.15.7:0/2708598917 wait complete. 2023-10-14T19:10:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.456+0000 7fe2ff74e700 1 Processor -- start 2023-10-14T19:10:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.456+0000 7fe2ff74e700 1 -- start start 2023-10-14T19:10:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2ff74e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2f80cb5a0 0x7fe2f8159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2ff74e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f80cd9e0 0x7fe2f80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2ff74e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 0x7fe2f8169660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2ff74e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8159280 con 0x7fe2f815a5d0 2023-10-14T19:10:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2ff74e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8159c50 con 0x7fe2f80cb5a0 2023-10-14T19:10:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2ff74e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f816a190 con 0x7fe2f80cd9e0 2023-10-14T19:10:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 0x7fe2f8169660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 0x7fe2f8169660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45012/0 (socket says 172.21.15.7:45012) 2023-10-14T19:10:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 -- 172.21.15.7:0/1762761610 learned_addr learned my addr 172.21.15.7:0/1762761610 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 -- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f80cd9e0 msgr2=0x7fe2f80c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f80cd9e0 0x7fe2f80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 -- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2f80cb5a0 msgr2=0x7fe2f8159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2f80cb5a0 0x7fe2f8159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 -- 172.21.15.7:0/1762761610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009420 con 0x7fe2f815a5d0 2023-10-14T19:10:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.457+0000 7fe2fdceb700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 0x7fe2f8169660 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8007f20 tx=0x7fe2e8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.458+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800eca0 con 0x7fe2f815a5d0 2023-10-14T19:10:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.458+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e800ee20 con 0x7fe2f815a5d0 2023-10-14T19:10:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.458+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f816a470 con 0x7fe2f815a5d0 2023-10-14T19:10:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.458+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8014670 con 0x7fe2f815a5d0 2023-10-14T19:10:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.458+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f80b55d0 con 0x7fe2f815a5d0 2023-10-14T19:10:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.458+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f804c3c0 con 0x7fe2f815a5d0 2023-10-14T19:10:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.459+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe2e80149e0 con 0x7fe2f815a5d0 2023-10-14T19:10:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.459+0000 7fe2f57fa700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe2e4067320 0x7fe2e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.459+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe2e80853f0 con 0x7fe2f815a5d0 2023-10-14T19:10:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.460+0000 7fe2fd4ea700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe2e4067320 0x7fe2e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.460+0000 7fe2fd4ea700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe2e4067320 0x7fe2e40697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00093a0 tx=0x7fe2f0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.463+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2e8052030 con 0x7fe2f815a5d0 2023-10-14T19:10:29.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.660+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2f81593c0 con 0x7fe2f815a5d0 2023-10-14T19:10:29.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.661+0000 7fe2f57fa700 1 -- 172.21.15.7:0/1762761610 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fe2e8055650 con 0x7fe2f815a5d0 2023-10-14T19:10:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:29.662 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":142,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:28.545406+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000623116.meta","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000623116"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000623116.data","create_time":"2023-10-14T19:10:13.861987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000623116"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:29.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe2e4067320 msgr2=0x7fe2e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe2e4067320 0x7fe2e40697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00093a0 tx=0x7fe2f0017000 comp rx=0 tx=0).stop 2023-10-14T19:10:29.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 msgr2=0x7fe2f8169660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 0x7fe2f8169660 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8007f20 tx=0x7fe2e8009860 comp rx=0 tx=0).stop 2023-10-14T19:10:29.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 shutdown_connections 2023-10-14T19:10:29.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe2e4067320 0x7fe2e40697d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2f80cb5a0 0x7fe2f8159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2f815a5d0 0x7fe2f8169660 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 --2- 172.21.15.7:0/1762761610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2f80cd9e0 0x7fe2f80c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 >> 172.21.15.7:0/1762761610 conn(0x7fe2f8070e30 msgr2=0x7fe2f80c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 shutdown_connections 2023-10-14T19:10:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.663+0000 7fe2ff74e700 1 -- 172.21.15.7:0/1762761610 wait complete. 2023-10-14T19:10:29.676 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:10:29.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:29.716 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:29.756 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:10:29.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:29.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.875+0000 7f07b2ff6700 1 Processor -- start 2023-10-14T19:10:29.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.875+0000 7f07b2ff6700 1 -- start start 2023-10-14T19:10:29.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b2ff6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07ac1598b0 0x7f07ac0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b2ff6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac159c80 0x7f07ac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b2ff6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac0ce9d0 con 0x7f07ac0af790 2023-10-14T19:10:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b2ff6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac0afc30 con 0x7f07ac1598b0 2023-10-14T19:10:29.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b2ff6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0aff10 con 0x7f07ac159c80 2023-10-14T19:10:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b0d92700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07ac1598b0 0x7f07ac0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b0d92700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07ac1598b0 0x7f07ac0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45014/0 (socket says 172.21.15.7:45014) 2023-10-14T19:10:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.876+0000 7f07b0d92700 1 -- 172.21.15.7:0/1058161574 learned_addr learned my addr 172.21.15.7:0/1058161574 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07abfff700 1 --2- 172.21.15.7:0/1058161574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac159c80 0x7f07ac0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b0d92700 1 -- 172.21.15.7:0/1058161574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac159c80 msgr2=0x7f07ac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b0d92700 1 --2- 172.21.15.7:0/1058161574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac159c80 0x7f07ac0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b0d92700 1 -- 172.21.15.7:0/1058161574 >> v1:172.21.15.148:6789/0 conn(0x7f07ac0af790 legacy=0x7f07ac0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b0d92700 1 -- 172.21.15.7:0/1058161574 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac0ce380 con 0x7f07ac1598b0 2023-10-14T19:10:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b0d92700 1 --2- 172.21.15.7:0/1058161574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac1598b0 0x7f07ac0af250 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009f20 tx=0x7f07a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1e1ccb9f73d629 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07ab7fe700 1 -- 172.21.15.7:0/1058161574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e070 con 0x7f07ac1598b0 2023-10-14T19:10:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07ab7fe700 1 -- 172.21.15.7:0/1058161574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400ba80 con 0x7f07ac1598b0 2023-10-14T19:10:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07ab7fe700 1 -- 172.21.15.7:0/1058161574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40092e0 con 0x7f07ac1598b0 2023-10-14T19:10:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b2ff6700 1 -- 172.21.15.7:0/1058161574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac1598b0 msgr2=0x7f07ac0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.877+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/1058161574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac1598b0 0x7f07ac0af250 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009f20 tx=0x7f07a4009840 comp rx=0 tx=0).stop 2023-10-14T19:10:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.878+0000 7f07b2ff6700 1 -- 172.21.15.7:0/1058161574 shutdown_connections 2023-10-14T19:10:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.878+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/1058161574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac1598b0 0x7f07ac0af250 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.878+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/1058161574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac159c80 0x7f07ac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.878+0000 7f07b2ff6700 1 -- 172.21.15.7:0/1058161574 >> 172.21.15.7:0/1058161574 conn(0x7f07ac070e30 msgr2=0x7f07ac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.878+0000 7f07b2ff6700 1 -- 172.21.15.7:0/1058161574 shutdown_connections 2023-10-14T19:10:29.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.878+0000 7f07b2ff6700 1 -- 172.21.15.7:0/1058161574 wait complete. 2023-10-14T19:10:29.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.879+0000 7f07b2ff6700 1 Processor -- start 2023-10-14T19:10:29.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.879+0000 7f07b2ff6700 1 -- start start 2023-10-14T19:10:29.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 0x7f07ac0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac1598b0 0x7f07ac154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07ac159c80 0x7f07ac1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0b34b0 con 0x7f07ac0af790 2023-10-14T19:10:29.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0b4310 con 0x7f07ac159c80 2023-10-14T19:10:29.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0b5250 con 0x7f07ac1598b0 2023-10-14T19:10:29.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 0x7f07ac0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 0x7f07ac0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45024/0 (socket says 172.21.15.7:45024) 2023-10-14T19:10:29.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 -- 172.21.15.7:0/403770514 learned_addr learned my addr 172.21.15.7:0/403770514 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:29.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07abfff700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac1598b0 0x7f07ac154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b1593700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07ac159c80 0x7f07ac1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 -- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac1598b0 msgr2=0x7f07ac154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac1598b0 0x7f07ac154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 -- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07ac159c80 msgr2=0x7f07ac1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07ac159c80 0x7f07ac1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 -- 172.21.15.7:0/403770514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009ae0 con 0x7f07ac0af790 2023-10-14T19:10:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b1593700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07ac159c80 0x7f07ac1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b0d92700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 0x7f07ac0b5bf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b6c0 tx=0x7f07a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4008a80 con 0x7f07ac0af790 2023-10-14T19:10:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4008c20 con 0x7f07ac0af790 2023-10-14T19:10:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac0b3700 con 0x7f07ac0af790 2023-10-14T19:10:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4026460 con 0x7f07ac0af790 2023-10-14T19:10:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.880+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac0b3a90 con 0x7f07ac0af790 2023-10-14T19:10:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.881+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac04c3c0 con 0x7f07ac0af790 2023-10-14T19:10:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.882+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f07a4003040 con 0x7f07ac0af790 2023-10-14T19:10:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.882+0000 7f07a8ff9700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0798067320 0x7f07980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.882+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f07a4086c10 con 0x7f07ac0af790 2023-10-14T19:10:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.883+0000 7f07abfff700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0798067320 0x7f07980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.883+0000 7f07abfff700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0798067320 0x7f07980697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0b2920 tx=0x7f07a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:29.887+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07a4053740 con 0x7f07ac0af790 2023-10-14T19:10:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.125+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07ac0ce660 con 0x7f07ac0af790 2023-10-14T19:10:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.125+0000 7f07a8ff9700 1 -- 172.21.15.7:0/403770514 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f07a4021090 con 0x7f07ac0af790 2023-10-14T19:10:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:30.127 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:26.537765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000623116","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0798067320 msgr2=0x7f07980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0798067320 0x7f07980697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0b2920 tx=0x7f07a0008040 comp rx=0 tx=0).stop 2023-10-14T19:10:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 msgr2=0x7f07ac0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 0x7f07ac0b5bf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b6c0 tx=0x7f07a4018000 comp rx=0 tx=0).stop 2023-10-14T19:10:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 shutdown_connections 2023-10-14T19:10:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0798067320 0x7f07980697d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07ac159c80 0x7f07ac1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07ac0af790 0x7f07ac0b5bf0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 --2- 172.21.15.7:0/403770514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07ac1598b0 0x7f07ac154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 >> 172.21.15.7:0/403770514 conn(0x7f07ac070e30 msgr2=0x7f07ac06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 shutdown_connections 2023-10-14T19:10:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.127+0000 7f07b2ff6700 1 -- 172.21.15.7:0/403770514 wait complete. 2023-10-14T19:10:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2023-10-14T19:10:30.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.260+0000 7f7885179700 1 Processor -- start 2023-10-14T19:10:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.260+0000 7f7885179700 1 -- start start 2023-10-14T19:10:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f7885179700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 0x7f788015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f7885179700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f78800cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f7885179700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788015afd0 con 0x7f78800cef40 2023-10-14T19:10:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f7885179700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788015b2b0 con 0x7f7880153c30 2023-10-14T19:10:30.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f7885179700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788015b590 con 0x7f788015de50 2023-10-14T19:10:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f787f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f78800cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f787ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 0x7f788015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f787f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f78800cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:36218/0 (socket says 172.21.15.7:36218) 2023-10-14T19:10:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f787ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 0x7f788015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:36526/0 (socket says 172.21.15.7:36526) 2023-10-14T19:10:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.261+0000 7f787f7fe700 1 -- 172.21.15.7:0/37000050 learned_addr learned my addr 172.21.15.7:0/37000050 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787f7fe700 1 -- 172.21.15.7:0/37000050 >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 msgr2=0x7f788015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787f7fe700 1 --2- 172.21.15.7:0/37000050 >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 0x7f788015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787f7fe700 1 -- 172.21.15.7:0/37000050 >> v1:172.21.15.148:6789/0 conn(0x7f78800cef40 legacy=0x7f788006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787f7fe700 1 -- 172.21.15.7:0/37000050 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788015b870 con 0x7f788015de50 2023-10-14T19:10:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787ffff700 1 --2- 172.21.15.7:0/37000050 >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 0x7f788015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787f7fe700 1 --2- 172.21.15.7:0/37000050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f78800cea00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f78700099b0 tx=0x7f7870009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d212514218ef76e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787effd700 1 -- 172.21.15.7:0/37000050 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870009ea0 con 0x7f788015de50 2023-10-14T19:10:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787effd700 1 -- 172.21.15.7:0/37000050 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000b860 con 0x7f788015de50 2023-10-14T19:10:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f787effd700 1 -- 172.21.15.7:0/37000050 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000bc00 con 0x7f788015de50 2023-10-14T19:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f7885179700 1 -- 172.21.15.7:0/37000050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 msgr2=0x7f78800cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f7885179700 1 --2- 172.21.15.7:0/37000050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f78800cea00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f78700099b0 tx=0x7f7870009250 comp rx=0 tx=0).stop 2023-10-14T19:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f7885179700 1 -- 172.21.15.7:0/37000050 shutdown_connections 2023-10-14T19:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f7885179700 1 --2- 172.21.15.7:0/37000050 >> v2:172.21.15.148:3300/0 conn(0x7f7880153c30 0x7f788015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f7885179700 1 --2- 172.21.15.7:0/37000050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f78800cea00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.262+0000 7f7885179700 1 -- 172.21.15.7:0/37000050 >> 172.21.15.7:0/37000050 conn(0x7f78800703a0 msgr2=0x7f78800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.263+0000 7f7885179700 1 -- 172.21.15.7:0/37000050 shutdown_connections 2023-10-14T19:10:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.263+0000 7f7885179700 1 -- 172.21.15.7:0/37000050 wait complete. 2023-10-14T19:10:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 Processor -- start 2023-10-14T19:10:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 -- start start 2023-10-14T19:10:30.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 0x7f7880159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880153c30 0x7f78800b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f7880150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b4c20 con 0x7f78800cef40 2023-10-14T19:10:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.264+0000 7f7885179700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788016dbf0 con 0x7f7880153c30 2023-10-14T19:10:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7885179700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b3840 con 0x7f788015de50 2023-10-14T19:10:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 0x7f7880159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 0x7f7880159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45028/0 (socket says 172.21.15.7:45028) 2023-10-14T19:10:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 -- 172.21.15.7:0/408605355 learned_addr learned my addr 172.21.15.7:0/408605355 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7884978700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f7880150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787f7fe700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880153c30 0x7f78800b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 -- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 msgr2=0x7f7880150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f7880150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 -- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880153c30 msgr2=0x7f78800b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880153c30 0x7f78800b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 -- 172.21.15.7:0/408605355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009420 con 0x7f78800cef40 2023-10-14T19:10:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f787ffff700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 0x7f7880159950 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f786800ec80 tx=0x7f78680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800c920 con 0x7f78800cef40 2023-10-14T19:10:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800ca80 con 0x7f78800cef40 2023-10-14T19:10:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800ce00 con 0x7f78800cef40 2023-10-14T19:10:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78700094f0 con 0x7f78800cef40 2023-10-14T19:10:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.265+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788016d880 con 0x7f78800cef40 2023-10-14T19:10:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.266+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788015db60 con 0x7f78800cef40 2023-10-14T19:10:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.267+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7868013680 con 0x7f78800cef40 2023-10-14T19:10:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.267+0000 7f7877fff700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7860067320 0x7f78600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.267+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f78680850a0 con 0x7f78800cef40 2023-10-14T19:10:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.267+0000 7f787f7fe700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7860067320 0x7f78600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.268+0000 7f787f7fe700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7860067320 0x7f78600697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78700099b0 tx=0x7f7870017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.271+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7868051ce0 con 0x7f78800cef40 2023-10-14T19:10:30.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.468+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f788016ded0 con 0x7f78800cef40 2023-10-14T19:10:30.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.469+0000 7f7877fff700 1 -- 172.21.15.7:0/408605355 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f7868055300 con 0x7f78800cef40 2023-10-14T19:10:30.470 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:30.470 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":142,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:28.545406+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000623116.meta","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000623116"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000623116.data","create_time":"2023-10-14T19:10:13.861987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000623116"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:30.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7860067320 msgr2=0x7f78600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7860067320 0x7f78600697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78700099b0 tx=0x7f7870017000 comp rx=0 tx=0).stop 2023-10-14T19:10:30.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 msgr2=0x7f7880159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 0x7f7880159950 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f786800ec80 tx=0x7f78680091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 shutdown_connections 2023-10-14T19:10:30.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7860067320 0x7f78600697d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f788015de50 0x7f7880150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78800cef40 0x7f7880159950 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 --2- 172.21.15.7:0/408605355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880153c30 0x7f78800b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 >> 172.21.15.7:0/408605355 conn(0x7f78800703a0 msgr2=0x7f78801531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:30.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 shutdown_connections 2023-10-14T19:10:30.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.471+0000 7f7885179700 1 -- 172.21.15.7:0/408605355 wait complete. 2023-10-14T19:10:30.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs.volume_0000000000623116.meta', 'create_time': '2023-10-14T19:10:13.324802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000623116'}}}, {'pool': 25, 'pool_name': 'cephfs.volume_0000000000623116.data', 'create_time': '2023-10-14T19:10:13.861987+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000623116'}}}] 2023-10-14T19:10:30.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:10:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.608+0000 7ff84916a700 1 Processor -- start 2023-10-14T19:10:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.608+0000 7ff84916a700 1 -- start start 2023-10-14T19:10:30.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff84916a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff844140f40 0x7ff8440c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff84916a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440cd170 con 0x7ff844140b70 2023-10-14T19:10:30.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff84916a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440c9a20 con 0x7ff84406d370 2023-10-14T19:10:30.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff84916a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440cd400 con 0x7ff844140f40 2023-10-14T19:10:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff843fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff844140b70 0x7ff8440c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44274/0 (socket says 172.21.15.7:44274) 2023-10-14T19:10:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff843fff700 1 -- 172.21.15.7:0/3132075031 learned_addr learned my addr 172.21.15.7:0/3132075031 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24607382 0 0) 0x7ff8440cd170 con 0x7ff844140b70 2023-10-14T19:10:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff848969700 1 --2- 172.21.15.7:0/3132075031 >> v2:172.21.15.148:3300/0 conn(0x7ff844140f40 0x7ff8440c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.609+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c003570 con 0x7ff844140b70 2023-10-14T19:10:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136644763 0 0) 0x7ff82c003570 con 0x7ff844140b70 2023-10-14T19:10:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 >> v2:172.21.15.148:3300/0 conn(0x7ff844140f40 msgr2=0x7ff8440c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 --2- 172.21.15.7:0/3132075031 >> v2:172.21.15.148:3300/0 conn(0x7ff844140f40 0x7ff8440c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 >> v1:172.21.15.148:6789/0 conn(0x7ff84406d370 legacy=0x7ff84415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440cd6e0 con 0x7ff844140b70 2023-10-14T19:10:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff834001470 con 0x7ff844140b70 2023-10-14T19:10:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 >> v1:172.21.15.7:6789/0 conn(0x7ff844140b70 legacy=0x7ff8440c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c003a60 0x7ff82c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff82c004810 0x7ff82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0051c0 0x7ff82c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440cd400 con 0x7ff82c003a60 2023-10-14T19:10:30.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c00c160 con 0x7ff82c0051c0 2023-10-14T19:10:30.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c00c320 con 0x7ff82c004810 2023-10-14T19:10:30.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c003a60 0x7ff82c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff848969700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0051c0 0x7ff82c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff8437fe700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff82c004810 0x7ff82c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 -- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff82c004810 msgr2=0x7ff82c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff82c004810 0x7ff82c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 -- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0051c0 msgr2=0x7ff82c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0051c0 0x7ff82c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 -- 172.21.15.7:0/3132075031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c003570 con 0x7ff82c003a60 2023-10-14T19:10:30.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff848969700 1 -- 172.21.15.7:0/3132075031 reap_dead start 2023-10-14T19:10:30.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.610+0000 7ff843fff700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c003a60 0x7ff82c003e70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c3c0 tx=0x7ff834001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cd2338b0772e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400cc50 con 0x7ff82c003a60 2023-10-14T19:10:30.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400cdb0 con 0x7ff82c003a60 2023-10-14T19:10:30.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff842ffd700 1 -- 172.21.15.7:0/3132075031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834005b50 con 0x7ff82c003a60 2023-10-14T19:10:30.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 -- 172.21.15.7:0/3132075031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c003a60 msgr2=0x7ff82c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c003a60 0x7ff82c003e70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c3c0 tx=0x7ff834001e50 comp rx=0 tx=0).stop 2023-10-14T19:10:30.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 -- 172.21.15.7:0/3132075031 shutdown_connections 2023-10-14T19:10:30.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 --2- 172.21.15.7:0/3132075031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff82c003a60 0x7ff82c003e70 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 -- 172.21.15.7:0/3132075031 >> 172.21.15.7:0/3132075031 conn(0x7ff8440675a0 msgr2=0x7ff8440679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:30.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 -- 172.21.15.7:0/3132075031 shutdown_connections 2023-10-14T19:10:30.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.611+0000 7ff84916a700 1 -- 172.21.15.7:0/3132075031 wait complete. 2023-10-14T19:10:30.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.612+0000 7ff84916a700 1 Processor -- start 2023-10-14T19:10:30.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.612+0000 7ff84916a700 1 -- start start 2023-10-14T19:10:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff84916a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c003a60 0x7ff8440af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff84916a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 0x7ff84412c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff84916a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff84415a740 0x7ff8441599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff84916a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844158710 con 0x7ff84413cf40 2023-10-14T19:10:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff84916a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440afab0 con 0x7ff82c003a60 2023-10-14T19:10:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff84916a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844159510 con 0x7ff84415a740 2023-10-14T19:10:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 0x7ff84412c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 0x7ff84412c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45042/0 (socket says 172.21.15.7:45042) 2023-10-14T19:10:30.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff8437fe700 1 -- 172.21.15.7:0/3968739906 learned_addr learned my addr 172.21.15.7:0/3968739906 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:30.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff848969700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff84415a740 0x7ff8441599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.613+0000 7ff843fff700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c003a60 0x7ff8440af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff8437fe700 1 -- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff84415a740 msgr2=0x7ff8441599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff8437fe700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff84415a740 0x7ff8441599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff8437fe700 1 -- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c003a60 msgr2=0x7ff8440af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff8437fe700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c003a60 0x7ff8440af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff8437fe700 1 -- 172.21.15.7:0/3968739906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844158900 con 0x7ff84413cf40 2023-10-14T19:10:30.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff8437fe700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 0x7ff84412c760 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff838002980 tx=0x7ff838007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838013600 con 0x7ff84413cf40 2023-10-14T19:10:30.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838013760 con 0x7ff84413cf40 2023-10-14T19:10:30.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff844158be0 con 0x7ff84413cf40 2023-10-14T19:10:30.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838013b00 con 0x7ff84413cf40 2023-10-14T19:10:30.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.614+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8441591a0 con 0x7ff84413cf40 2023-10-14T19:10:30.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.615+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff844159680 con 0x7ff84413cf40 2023-10-14T19:10:30.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.615+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff83801c400 con 0x7ff84413cf40 2023-10-14T19:10:30.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.616+0000 7ff82bfff700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff830067320 0x7ff8300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.616+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7ff838084f40 con 0x7ff84413cf40 2023-10-14T19:10:30.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.616+0000 7ff843fff700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff830067320 0x7ff8300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.617+0000 7ff843fff700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff830067320 0x7ff8300697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff834001ed0 tx=0x7ff834015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.620+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff838051c30 con 0x7ff84413cf40 2023-10-14T19:10:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.813+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff84404c3c0 con 0x7ff84413cf40 2023-10-14T19:10:30.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.813+0000 7ff82bfff700 1 -- 172.21.15.7:0/3968739906 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff838055250 con 0x7ff84413cf40 2023-10-14T19:10:30.814 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:10:30.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff830067320 msgr2=0x7ff8300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff830067320 0x7ff8300697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff834001ed0 tx=0x7ff834015000 comp rx=0 tx=0).stop 2023-10-14T19:10:30.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 msgr2=0x7ff84412c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 0x7ff84412c760 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff838002980 tx=0x7ff838007d30 comp rx=0 tx=0).stop 2023-10-14T19:10:30.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 shutdown_connections 2023-10-14T19:10:30.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff830067320 0x7ff8300697d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c003a60 0x7ff8440af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff84415a740 0x7ff8441599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 --2- 172.21.15.7:0/3968739906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff84413cf40 0x7ff84412c760 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.815+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 >> 172.21.15.7:0/3968739906 conn(0x7ff8440675a0 msgr2=0x7ff84413daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:30.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.816+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 shutdown_connections 2023-10-14T19:10:30.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.816+0000 7ff84916a700 1 -- 172.21.15.7:0/3968739906 wait complete. 2023-10-14T19:10:30.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000623116.meta pg_num 2023-10-14T19:10:30.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.950+0000 7f2d62044700 1 Processor -- start 2023-10-14T19:10:30.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.950+0000 7f2d62044700 1 -- start start 2023-10-14T19:10:30.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d62044700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d5c159530 0x7f2d5c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d62044700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d62044700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c0ccfd0 con 0x7f2d5c06dc70 2023-10-14T19:10:30.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d62044700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c0cf0e0 con 0x7f2d5c159530 2023-10-14T19:10:30.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d62044700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c15a3d0 con 0x7f2d5c06e0e0 2023-10-14T19:10:30.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d5c159530 0x7f2d5c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2d5c06dc70 0x7f2d5c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44288/0 (socket says 172.21.15.7:44288) 2023-10-14T19:10:30.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5affd700 1 -- 172.21.15.7:0/137230176 learned_addr learned my addr 172.21.15.7:0/137230176 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:30.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5bfff700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5b7fe700 1 -- 172.21.15.7:0/137230176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 msgr2=0x7f2d5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:30.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5b7fe700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.951+0000 7f2d5b7fe700 1 -- 172.21.15.7:0/137230176 >> v1:172.21.15.7:6789/0 conn(0x7f2d5c06dc70 legacy=0x7f2d5c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d5b7fe700 1 -- 172.21.15.7:0/137230176 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c15a6b0 con 0x7f2d5c159530 2023-10-14T19:10:30.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d5bfff700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:30.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d5b7fe700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c0ceba0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0098e0 tx=0x7f2d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e35ab5ad24642c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d5a7fc700 1 -- 172.21.15.7:0/137230176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c009e80 con 0x7f2d5c159530 2023-10-14T19:10:30.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d5a7fc700 1 -- 172.21.15.7:0/137230176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c00b860 con 0x7f2d5c159530 2023-10-14T19:10:30.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d5a7fc700 1 -- 172.21.15.7:0/137230176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00bbe0 con 0x7f2d5c159530 2023-10-14T19:10:30.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 -- 172.21.15.7:0/137230176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 msgr2=0x7f2d5c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c0ceba0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0098e0 tx=0x7f2d4c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 -- 172.21.15.7:0/137230176 shutdown_connections 2023-10-14T19:10:30.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c0ceba0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 --2- 172.21.15.7:0/137230176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 -- 172.21.15.7:0/137230176 >> 172.21.15.7:0/137230176 conn(0x7f2d5c0703a0 msgr2=0x7f2d5c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:30.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 -- 172.21.15.7:0/137230176 shutdown_connections 2023-10-14T19:10:30.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.952+0000 7f2d62044700 1 -- 172.21.15.7:0/137230176 wait complete. 2023-10-14T19:10:30.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 Processor -- start 2023-10-14T19:10:30.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 -- start start 2023-10-14T19:10:30.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c06dc70 0x7f2d5c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c151ae0 con 0x7f2d5c159530 2023-10-14T19:10:30.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c150ed0 con 0x7f2d5c06dc70 2023-10-14T19:10:30.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.954+0000 7f2d62044700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1511b0 con 0x7f2d5c06e0e0 2023-10-14T19:10:30.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c169fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45062/0 (socket says 172.21.15.7:45062) 2023-10-14T19:10:30.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 -- 172.21.15.7:0/1183077126 learned_addr learned my addr 172.21.15.7:0/1183077126 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:30.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5b7fe700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c06dc70 0x7f2d5c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5affd700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 -- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 msgr2=0x7f2d5c150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 -- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c06dc70 msgr2=0x7f2d5c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:30.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c06dc70 0x7f2d5c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 -- 172.21.15.7:0/1183077126 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c009420 con 0x7f2d5c159530 2023-10-14T19:10:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5b7fe700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c06dc70 0x7f2d5c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d5bfff700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c169fa0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400d150 tx=0x7f2d54009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400ddf0 con 0x7f2d5c159530 2023-10-14T19:10:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5400f040 con 0x7f2d5c159530 2023-10-14T19:10:30.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c151490 con 0x7f2d5c159530 2023-10-14T19:10:30.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54015690 con 0x7f2d5c159530 2023-10-14T19:10:30.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.955+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c150bc0 con 0x7f2d5c159530 2023-10-14T19:10:30.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.956+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c151c50 con 0x7f2d5c159530 2023-10-14T19:10:30.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.957+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d5401e3b0 con 0x7f2d5c159530 2023-10-14T19:10:30.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.957+0000 7f2d437fe700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d48067320 0x7f2d480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:30.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.957+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2d540853d0 con 0x7f2d5c159530 2023-10-14T19:10:30.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.957+0000 7f2d5b7fe700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d48067320 0x7f2d480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:30.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.958+0000 7f2d5b7fe700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d48067320 0x7f2d480697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0091e0 tx=0x7f2d4c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:30.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:30.961+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d54051f00 con 0x7f2d5c159530 2023-10-14T19:10:31.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.151+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000623116.meta", "var": "pg_num"} v 0) v1 -- 0x7f2d5c04c3c0 con 0x7f2d5c159530 2023-10-14T19:10:31.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.151+0000 7f2d437fe700 1 -- 172.21.15.7:0/1183077126 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000623116.meta", "var": "pg_num"}]=0 v142) v1 ==== 124+0+11 (secure 0 0 0) 0x7f2d54055520 con 0x7f2d5c159530 2023-10-14T19:10:31.153 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:10:31.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d48067320 msgr2=0x7f2d480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d48067320 0x7f2d480697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0091e0 tx=0x7f2d4c017000 comp rx=0 tx=0).stop 2023-10-14T19:10:31.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 msgr2=0x7f2d5c169fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c169fa0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400d150 tx=0x7f2d54009a50 comp rx=0 tx=0).stop 2023-10-14T19:10:31.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 shutdown_connections 2023-10-14T19:10:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d48067320 0x7f2d480697d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c06dc70 0x7f2d5c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5c159530 0x7f2d5c169fa0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 --2- 172.21.15.7:0/1183077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d5c06e0e0 0x7f2d5c150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 >> 172.21.15.7:0/1183077126 conn(0x7f2d5c0703a0 msgr2=0x7f2d5c0d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 shutdown_connections 2023-10-14T19:10:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.154+0000 7f2d62044700 1 -- 172.21.15.7:0/1183077126 wait complete. 2023-10-14T19:10:31.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000623116.data pg_num 2023-10-14T19:10:31.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.288+0000 7f29ff384700 1 Processor -- start 2023-10-14T19:10:31.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.288+0000 7f29ff384700 1 -- start start 2023-10-14T19:10:31.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29ff384700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f8153a00 0x7f29f8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29ff384700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29f815de50 0x7f29f815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29ff384700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f815af60 con 0x7f29f80cea00 2023-10-14T19:10:31.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29ff384700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f815d010 con 0x7f29f815de50 2023-10-14T19:10:31.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29ff384700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f815b240 con 0x7f29f8153a00 2023-10-14T19:10:31.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29f815de50 0x7f29f815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29f815de50 0x7f29f815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45068/0 (socket says 172.21.15.7:45068) 2023-10-14T19:10:31.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 -- 172.21.15.7:0/1157544411 learned_addr learned my addr 172.21.15.7:0/1157544411 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:31.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fe382700 1 --2- 172.21.15.7:0/1157544411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f8153a00 0x7f29f8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 -- 172.21.15.7:0/1157544411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f8153a00 msgr2=0x7f29f8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:31.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 --2- 172.21.15.7:0/1157544411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f8153a00 0x7f29f8153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 -- 172.21.15.7:0/1157544411 >> v1:172.21.15.148:6789/0 conn(0x7f29f80cea00 legacy=0x7f29f80cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:31.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.289+0000 7f29fdb81700 1 -- 172.21.15.7:0/1157544411 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f815b520 con 0x7f29f815de50 2023-10-14T19:10:31.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29fdb81700 1 --2- 172.21.15.7:0/1157544411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f815de50 0x7f29f815a540 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0099b0 tx=0x7f29ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a5a2ee26423e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:31.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29fd380700 1 -- 172.21.15.7:0/1157544411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00b820 con 0x7f29f815de50 2023-10-14T19:10:31.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29fd380700 1 -- 172.21.15.7:0/1157544411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec00b980 con 0x7f29f815de50 2023-10-14T19:10:31.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29fd380700 1 -- 172.21.15.7:0/1157544411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00bd20 con 0x7f29f815de50 2023-10-14T19:10:31.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 -- 172.21.15.7:0/1157544411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f815de50 msgr2=0x7f29f815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 --2- 172.21.15.7:0/1157544411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f815de50 0x7f29f815a540 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0099b0 tx=0x7f29ec009250 comp rx=0 tx=0).stop 2023-10-14T19:10:31.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 -- 172.21.15.7:0/1157544411 shutdown_connections 2023-10-14T19:10:31.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 --2- 172.21.15.7:0/1157544411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f8153a00 0x7f29f8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 --2- 172.21.15.7:0/1157544411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f815de50 0x7f29f815a540 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 -- 172.21.15.7:0/1157544411 >> 172.21.15.7:0/1157544411 conn(0x7f29f80703a0 msgr2=0x7f29f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:31.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 -- 172.21.15.7:0/1157544411 shutdown_connections 2023-10-14T19:10:31.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.290+0000 7f29ff384700 1 -- 172.21.15.7:0/1157544411 wait complete. 2023-10-14T19:10:31.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.291+0000 7f29ff384700 1 Processor -- start 2023-10-14T19:10:31.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 -- start start 2023-10-14T19:10:31.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80cea00 0x7f29f80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 0x7f29f80cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f815de50 0x7f29f8158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f81582a0 con 0x7f29f8153a00 2023-10-14T19:10:31.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8156570 con 0x7f29f80cea00 2023-10-14T19:10:31.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29ff384700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8156850 con 0x7f29f815de50 2023-10-14T19:10:31.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29fdb81700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 0x7f29f80cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29fdb81700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 0x7f29f80cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45072/0 (socket says 172.21.15.7:45072) 2023-10-14T19:10:31.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29fdb81700 1 -- 172.21.15.7:0/1874988688 learned_addr learned my addr 172.21.15.7:0/1874988688 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:31.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.292+0000 7f29fe382700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80cea00 0x7f29f80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29feb83700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f815de50 0x7f29f8158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29fdb81700 1 -- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f815de50 msgr2=0x7f29f8158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29fdb81700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f815de50 0x7f29f8158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29fdb81700 1 -- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80cea00 msgr2=0x7f29f80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29fdb81700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80cea00 0x7f29f80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29fdb81700 1 -- 172.21.15.7:0/1874988688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0094f0 con 0x7f29f8153a00 2023-10-14T19:10:31.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29feb83700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f815de50 0x7f29f8158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:31.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29fdb81700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 0x7f29f80cb110 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009290 tx=0x7f29ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:31.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec01b470 con 0x7f29f8153a00 2023-10-14T19:10:31.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec01b5d0 con 0x7f29f8153a00 2023-10-14T19:10:31.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80c7bc0 con 0x7f29f8153a00 2023-10-14T19:10:31.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec01b990 con 0x7f29f8153a00 2023-10-14T19:10:31.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.293+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f8156b30 con 0x7f29f8153a00 2023-10-14T19:10:31.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.294+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f815d1a0 con 0x7f29f8153a00 2023-10-14T19:10:31.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.295+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f29ec02f480 con 0x7f29f8153a00 2023-10-14T19:10:31.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.295+0000 7f29f67fc700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e4067320 0x7f29e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.295+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f29ec086d90 con 0x7f29f8153a00 2023-10-14T19:10:31.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.295+0000 7f29fe382700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e4067320 0x7f29e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.296+0000 7f29fe382700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e4067320 0x7f29e40697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f29f000acb0 tx=0x7f29f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:31.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.299+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29ec053a90 con 0x7f29f8153a00 2023-10-14T19:10:31.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.491+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000623116.data", "var": "pg_num"} v 0) v1 -- 0x7f29f804c3c0 con 0x7f29f8153a00 2023-10-14T19:10:31.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.491+0000 7f29f67fc700 1 -- 172.21.15.7:0/1874988688 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000623116.data", "var": "pg_num"}]=0 v142) v1 ==== 124+0+11 (secure 0 0 0) 0x7f29ec057030 con 0x7f29f8153a00 2023-10-14T19:10:31.493 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:10:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e4067320 msgr2=0x7f29e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e4067320 0x7f29e40697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f29f000acb0 tx=0x7f29f0008040 comp rx=0 tx=0).stop 2023-10-14T19:10:31.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 msgr2=0x7f29f80cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 0x7f29f80cb110 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009290 tx=0x7f29ec016000 comp rx=0 tx=0).stop 2023-10-14T19:10:31.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 shutdown_connections 2023-10-14T19:10:31.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e4067320 0x7f29e40697d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80cea00 0x7f29f80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29f815de50 0x7f29f8158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 --2- 172.21.15.7:0/1874988688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f8153a00 0x7f29f80cb110 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 >> 172.21.15.7:0/1874988688 conn(0x7f29f80703a0 msgr2=0x7f29f80d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 shutdown_connections 2023-10-14T19:10:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.493+0000 7f29ff384700 1 -- 172.21.15.7:0/1874988688 wait complete. 2023-10-14T19:10:31.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.628+0000 7f2f57cee700 1 Processor -- start 2023-10-14T19:10:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.628+0000 7f2f57cee700 1 -- start start 2023-10-14T19:10:31.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f57cee700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f500b07d0 0x7f2f500ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f57cee700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2f500cf200 0x7f2f500cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f57cee700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5015a280 con 0x7f2f500b0ba0 2023-10-14T19:10:31.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f57cee700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5006e180 con 0x7f2f500b07d0 2023-10-14T19:10:31.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f57cee700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f500cd540 con 0x7f2f500cf200 2023-10-14T19:10:31.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f55a8a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f500b07d0 0x7f2f500ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f55a8a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f500b07d0 0x7f2f500ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45074/0 (socket says 172.21.15.7:45074) 2023-10-14T19:10:31.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f55a8a700 1 -- 172.21.15.7:0/2780159392 learned_addr learned my addr 172.21.15.7:0/2780159392 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:31.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.629+0000 7f2f55289700 1 --2- 172.21.15.7:0/2780159392 >> v2:172.21.15.148:3300/0 conn(0x7f2f500cf200 0x7f2f500cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f55a8a700 1 -- 172.21.15.7:0/2780159392 >> v2:172.21.15.148:3300/0 conn(0x7f2f500cf200 msgr2=0x7f2f500cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f55a8a700 1 --2- 172.21.15.7:0/2780159392 >> v2:172.21.15.148:3300/0 conn(0x7f2f500cf200 0x7f2f500cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f55a8a700 1 -- 172.21.15.7:0/2780159392 >> v1:172.21.15.148:6789/0 conn(0x7f2f500b0ba0 legacy=0x7f2f5006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f55a8a700 1 -- 172.21.15.7:0/2780159392 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5006d850 con 0x7f2f500b07d0 2023-10-14T19:10:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f55a8a700 1 --2- 172.21.15.7:0/2780159392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f500ccac0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2f500cab40 tx=0x7f2f48009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99d6588b2774030 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f54a88700 1 -- 172.21.15.7:0/2780159392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48005c10 con 0x7f2f500b07d0 2023-10-14T19:10:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f54a88700 1 -- 172.21.15.7:0/2780159392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48005d70 con 0x7f2f500b07d0 2023-10-14T19:10:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f54a88700 1 -- 172.21.15.7:0/2780159392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800b910 con 0x7f2f500b07d0 2023-10-14T19:10:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 -- 172.21.15.7:0/2780159392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 msgr2=0x7f2f500ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 --2- 172.21.15.7:0/2780159392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f500ccac0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2f500cab40 tx=0x7f2f48009220 comp rx=0 tx=0).stop 2023-10-14T19:10:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 -- 172.21.15.7:0/2780159392 shutdown_connections 2023-10-14T19:10:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 --2- 172.21.15.7:0/2780159392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f500ccac0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 --2- 172.21.15.7:0/2780159392 >> v2:172.21.15.148:3300/0 conn(0x7f2f500cf200 0x7f2f500cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 -- 172.21.15.7:0/2780159392 >> 172.21.15.7:0/2780159392 conn(0x7f2f5006ce80 msgr2=0x7f2f500ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 -- 172.21.15.7:0/2780159392 shutdown_connections 2023-10-14T19:10:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.630+0000 7f2f57cee700 1 -- 172.21.15.7:0/2780159392 wait complete. 2023-10-14T19:10:31.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.631+0000 7f2f57cee700 1 Processor -- start 2023-10-14T19:10:31.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 -- start start 2023-10-14T19:10:31.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f5009aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f500b0ba0 0x7f2f5016a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500cf200 0x7f2f500c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c7af0 con 0x7f2f500b07d0 2023-10-14T19:10:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c6ee0 con 0x7f2f500cf200 2023-10-14T19:10:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f57cee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c71c0 con 0x7f2f500b0ba0 2023-10-14T19:10:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f55a8a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f5009aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f55a8a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f5009aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45090/0 (socket says 172.21.15.7:45090) 2023-10-14T19:10:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f55a8a700 1 -- 172.21.15.7:0/3413756960 learned_addr learned my addr 172.21.15.7:0/3413756960 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f5628b700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500cf200 0x7f2f500c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.632+0000 7f2f55289700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f500b0ba0 0x7f2f5016a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f55a8a700 1 -- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f500b0ba0 msgr2=0x7f2f5016a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f55a8a700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f500b0ba0 0x7f2f5016a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f55a8a700 1 -- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500cf200 msgr2=0x7f2f500c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f55a8a700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500cf200 0x7f2f500c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f55a8a700 1 -- 172.21.15.7:0/3413756960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009480 con 0x7f2f500b07d0 2023-10-14T19:10:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f55a8a700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f5009aea0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800b3c0 tx=0x7f2f48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:31.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800bda0 con 0x7f2f500b07d0 2023-10-14T19:10:31.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48020070 con 0x7f2f500b07d0 2023-10-14T19:10:31.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f500c74a0 con 0x7f2f500b07d0 2023-10-14T19:10:31.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800b910 con 0x7f2f500b07d0 2023-10-14T19:10:31.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.633+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5009b3e0 con 0x7f2f500b07d0 2023-10-14T19:10:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.634+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5004c3c0 con 0x7f2f500b07d0 2023-10-14T19:10:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.635+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f48022030 con 0x7f2f500b07d0 2023-10-14T19:10:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.635+0000 7f2f4dffb700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f3c067320 0x7f2f3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.635+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2f48086850 con 0x7f2f500b07d0 2023-10-14T19:10:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.635+0000 7f2f55289700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f3c067320 0x7f2f3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:31.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.636+0000 7f2f55289700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f3c067320 0x7f2f3c0697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f5009baf0 tx=0x7f2f44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:31.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.639+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f480535a0 con 0x7f2f500b07d0 2023-10-14T19:10:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.878+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f5006db30 con 0x7f2f500b07d0 2023-10-14T19:10:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.879+0000 7f2f4dffb700 1 -- 172.21.15.7:0/3413756960 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f2f48056bc0 con 0x7f2f500b07d0 2023-10-14T19:10:31.880 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:31.880 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:26.537765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000623116","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f3c067320 msgr2=0x7f2f3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f3c067320 0x7f2f3c0697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f5009baf0 tx=0x7f2f44008040 comp rx=0 tx=0).stop 2023-10-14T19:10:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 msgr2=0x7f2f5009aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f5009aea0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800b3c0 tx=0x7f2f48016000 comp rx=0 tx=0).stop 2023-10-14T19:10:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 shutdown_connections 2023-10-14T19:10:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f3c067320 0x7f2f3c0697d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500cf200 0x7f2f500c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f500b07d0 0x7f2f5009aea0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 --2- 172.21.15.7:0/3413756960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f500b0ba0 0x7f2f5016a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 >> 172.21.15.7:0/3413756960 conn(0x7f2f5006ce80 msgr2=0x7f2f50068930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 shutdown_connections 2023-10-14T19:10:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:31.881+0000 7f2f57cee700 1 -- 172.21.15.7:0/3413756960 wait complete. 2023-10-14T19:10:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2023-10-14T19:10:31.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:32.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.013+0000 7fbdab395700 1 Processor -- start 2023-10-14T19:10:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.013+0000 7fbdab395700 1 -- start start 2023-10-14T19:10:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbdab395700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbda40cb970 0x7fbda4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbdab395700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbda415a400 0x7fbda4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbdab395700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda415ae40 con 0x7fbda40cb5a0 2023-10-14T19:10:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbdab395700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40ce0f0 con 0x7fbda415a400 2023-10-14T19:10:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbdab395700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40d13f0 con 0x7fbda40cb970 2023-10-14T19:10:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbda415a400 0x7fbda4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9131700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbda40cb5a0 0x7fbda40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44302/0 (socket says 172.21.15.7:44302) 2023-10-14T19:10:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbda415a400 0x7fbda4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45104/0 (socket says 172.21.15.7:45104) 2023-10-14T19:10:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9131700 1 -- 172.21.15.7:0/3764018469 learned_addr learned my addr 172.21.15.7:0/3764018469 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda8930700 1 --2- 172.21.15.7:0/3764018469 >> v2:172.21.15.148:3300/0 conn(0x7fbda40cb970 0x7fbda4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 -- 172.21.15.7:0/3764018469 >> v2:172.21.15.148:3300/0 conn(0x7fbda40cb970 msgr2=0x7fbda4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 --2- 172.21.15.7:0/3764018469 >> v2:172.21.15.148:3300/0 conn(0x7fbda40cb970 0x7fbda4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 -- 172.21.15.7:0/3764018469 >> v1:172.21.15.7:6789/0 conn(0x7fbda40cb5a0 legacy=0x7fbda40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbd9bfff700 1 -- 172.21.15.7:0/3764018469 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674341027 0 0) 0x7fbda415ae40 con 0x7fbda40cb5a0 2023-10-14T19:10:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 -- 172.21.15.7:0/3764018469 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda415ab60 con 0x7fbda415a400 2023-10-14T19:10:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.014+0000 7fbda9932700 1 --2- 172.21.15.7:0/3764018469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda415a400 0x7fbda4156e90 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fbda40d1780 tx=0x7fbd9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e414fd95abd889ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbd9bfff700 1 -- 172.21.15.7:0/3764018469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00e070 con 0x7fbda415a400 2023-10-14T19:10:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbd9bfff700 1 -- 172.21.15.7:0/3764018469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00bb60 con 0x7fbda415a400 2023-10-14T19:10:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbd9bfff700 1 -- 172.21.15.7:0/3764018469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c012430 con 0x7fbda415a400 2023-10-14T19:10:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 -- 172.21.15.7:0/3764018469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda415a400 msgr2=0x7fbda4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 --2- 172.21.15.7:0/3764018469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda415a400 0x7fbda4156e90 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fbda40d1780 tx=0x7fbd9c009780 comp rx=0 tx=0).stop 2023-10-14T19:10:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 -- 172.21.15.7:0/3764018469 shutdown_connections 2023-10-14T19:10:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 --2- 172.21.15.7:0/3764018469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda415a400 0x7fbda4156e90 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 --2- 172.21.15.7:0/3764018469 >> v2:172.21.15.148:3300/0 conn(0x7fbda40cb970 0x7fbda4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 -- 172.21.15.7:0/3764018469 >> 172.21.15.7:0/3764018469 conn(0x7fbda4070e30 msgr2=0x7fbda40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 -- 172.21.15.7:0/3764018469 shutdown_connections 2023-10-14T19:10:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.015+0000 7fbdab395700 1 -- 172.21.15.7:0/3764018469 wait complete. 2023-10-14T19:10:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.016+0000 7fbdab395700 1 Processor -- start 2023-10-14T19:10:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.016+0000 7fbdab395700 1 -- start start 2023-10-14T19:10:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbdab395700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 0x7fbda41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbdab395700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbda40cb970 0x7fbda40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbdab395700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbda415a400 0x7fbda40cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbdab395700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40c91d0 con 0x7fbda40cb5a0 2023-10-14T19:10:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbdab395700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40b4c50 con 0x7fbda40cb970 2023-10-14T19:10:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbdab395700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40b4970 con 0x7fbda415a400 2023-10-14T19:10:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbda9131700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 0x7fbda41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbda9131700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 0x7fbda41512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45116/0 (socket says 172.21.15.7:45116) 2023-10-14T19:10:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbda9131700 1 -- 172.21.15.7:0/3088781953 learned_addr learned my addr 172.21.15.7:0/3088781953 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbda8930700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbda40cb970 0x7fbda40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbda9932700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbda415a400 0x7fbda40cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.017+0000 7fbda9131700 1 -- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbda415a400 msgr2=0x7fbda40cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbda9131700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbda415a400 0x7fbda40cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbda9131700 1 -- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbda40cb970 msgr2=0x7fbda40cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbda9131700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbda40cb970 0x7fbda40cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbda9131700 1 -- 172.21.15.7:0/3088781953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c009a20 con 0x7fbda40cb5a0 2023-10-14T19:10:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbda9932700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbda415a400 0x7fbda40cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbda9131700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 0x7fbda41512b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c7e0 tx=0x7fbda0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0005b30 con 0x7fbda40cb5a0 2023-10-14T19:10:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0005c90 con 0x7fbda40cb5a0 2023-10-14T19:10:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda40c8b80 con 0x7fbda40cb5a0 2023-10-14T19:10:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0007300 con 0x7fbda40cb5a0 2023-10-14T19:10:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.018+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda41517f0 con 0x7fbda40cb5a0 2023-10-14T19:10:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.019+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda404c3c0 con 0x7fbda40cb5a0 2023-10-14T19:10:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.019+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbda00076b0 con 0x7fbda40cb5a0 2023-10-14T19:10:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.020+0000 7fbd997fa700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd88067320 0x7fbd880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.020+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fbda0084230 con 0x7fbda40cb5a0 2023-10-14T19:10:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.020+0000 7fbda8930700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd88067320 0x7fbd880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.021+0000 7fbda8930700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd88067320 0x7fbd880697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbda40d1160 tx=0x7fbd940091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.024+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbda0050e70 con 0x7fbda40cb5a0 2023-10-14T19:10:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.219+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbda40ccf00 con 0x7fbda40cb5a0 2023-10-14T19:10:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.220+0000 7fbd997fa700 1 -- 172.21.15.7:0/3088781953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fbda0054490 con 0x7fbda40cb5a0 2023-10-14T19:10:32.221 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:32.221 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":142,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:28.545406+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000623116.meta","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000623116"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000623116.data","create_time":"2023-10-14T19:10:13.861987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000623116"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd88067320 msgr2=0x7fbd880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd88067320 0x7fbd880697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbda40d1160 tx=0x7fbd940091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 msgr2=0x7fbda41512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 0x7fbda41512b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c7e0 tx=0x7fbda0007df0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 shutdown_connections 2023-10-14T19:10:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd88067320 0x7fbd880697d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbda415a400 0x7fbda40cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda40cb5a0 0x7fbda41512b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 --2- 172.21.15.7:0/3088781953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbda40cb970 0x7fbda40cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 >> 172.21.15.7:0/3088781953 conn(0x7fbda4070e30 msgr2=0x7fbda41547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 shutdown_connections 2023-10-14T19:10:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.222+0000 7fbdab395700 1 -- 172.21.15.7:0/3088781953 wait complete. 2023-10-14T19:10:32.235 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000623116 and related pools 2023-10-14T19:10:32.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.354+0000 7f5cebd86700 1 Processor -- start 2023-10-14T19:10:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.354+0000 7f5cebd86700 1 -- start start 2023-10-14T19:10:32.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5cebd86700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ce40cb970 0x7f5ce4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5cebd86700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce415ae40 con 0x7f5ce40cb5a0 2023-10-14T19:10:32.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5cebd86700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce415ab60 con 0x7f5ce415a400 2023-10-14T19:10:32.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5cebd86700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40ce0f0 con 0x7f5ce40cb970 2023-10-14T19:10:32.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5ce9b22700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5ce40cb5a0 0x7f5ce40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44318/0 (socket says 172.21.15.7:44318) 2023-10-14T19:10:32.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5ce9b22700 1 -- 172.21.15.7:0/207689363 learned_addr learned my addr 172.21.15.7:0/207689363 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:32.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.355+0000 7f5ce9321700 1 --2- 172.21.15.7:0/207689363 >> v2:172.21.15.148:3300/0 conn(0x7f5ce40cb970 0x7f5ce4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce8b20700 1 -- 172.21.15.7:0/207689363 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785194835 0 0) 0x7f5ce415ae40 con 0x7f5ce40cb5a0 2023-10-14T19:10:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce8b20700 1 -- 172.21.15.7:0/207689363 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ccc003570 con 0x7f5ce40cb5a0 2023-10-14T19:10:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce8b20700 1 -- 172.21.15.7:0/207689363 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137286477 0 0) 0x7f5ccc003570 con 0x7f5ce40cb5a0 2023-10-14T19:10:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce9321700 1 -- 172.21.15.7:0/207689363 >> v1:172.21.15.148:6789/0 conn(0x7f5ce415a400 legacy=0x7f5ce4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce9321700 1 -- 172.21.15.7:0/207689363 >> v1:172.21.15.7:6789/0 conn(0x7f5ce40cb5a0 legacy=0x7f5ce40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce9321700 1 -- 172.21.15.7:0/207689363 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40ccf00 con 0x7f5ce40cb970 2023-10-14T19:10:32.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce9321700 1 --2- 172.21.15.7:0/207689363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb970 0x7f5ce4159ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80098e0 tx=0x7f5cd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c909d6fc2603e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce8b20700 1 -- 172.21.15.7:0/207689363 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40017f0 con 0x7f5ce40cb970 2023-10-14T19:10:32.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce8b20700 1 -- 172.21.15.7:0/207689363 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8011420 con 0x7f5ce40cb970 2023-10-14T19:10:32.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.356+0000 7f5ce8b20700 1 -- 172.21.15.7:0/207689363 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80117a0 con 0x7f5ce40cb970 2023-10-14T19:10:32.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 -- 172.21.15.7:0/207689363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb970 msgr2=0x7f5ce4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 --2- 172.21.15.7:0/207689363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb970 0x7f5ce4159ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80098e0 tx=0x7f5cd80091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 -- 172.21.15.7:0/207689363 shutdown_connections 2023-10-14T19:10:32.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 --2- 172.21.15.7:0/207689363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb970 0x7f5ce4159ec0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 -- 172.21.15.7:0/207689363 >> 172.21.15.7:0/207689363 conn(0x7f5ce4070e30 msgr2=0x7f5ce40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:32.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 -- 172.21.15.7:0/207689363 shutdown_connections 2023-10-14T19:10:32.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.357+0000 7f5cebd86700 1 -- 172.21.15.7:0/207689363 wait complete. 2023-10-14T19:10:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.358+0000 7f5cebd86700 1 Processor -- start 2023-10-14T19:10:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.358+0000 7f5cebd86700 1 -- start start 2023-10-14T19:10:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb5a0 0x7f5ce4159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 0x7f5ce415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce415a400 0x7f5ce4153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40caa30 con 0x7f5ce40cb970 2023-10-14T19:10:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce415a190 con 0x7f5ce40cb5a0 2023-10-14T19:10:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40b6060 con 0x7f5ce415a400 2023-10-14T19:10:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 0x7f5ce415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 0x7f5ce415ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45122/0 (socket says 172.21.15.7:45122) 2023-10-14T19:10:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 -- 172.21.15.7:0/1148658020 learned_addr learned my addr 172.21.15.7:0/1148658020 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9b22700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb5a0 0x7f5ce4159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cea323700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce415a400 0x7f5ce4153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 -- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce415a400 msgr2=0x7f5ce4153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce415a400 0x7f5ce4153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 -- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb5a0 msgr2=0x7f5ce4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb5a0 0x7f5ce4159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 -- 172.21.15.7:0/1148658020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009420 con 0x7f5ce40cb970 2023-10-14T19:10:32.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce9321700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 0x7f5ce415ca20 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5ce406ea60 tx=0x7f5cd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8010c20 con 0x7f5ce40cb970 2023-10-14T19:10:32.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8010d80 con 0x7f5ce40cb970 2023-10-14T19:10:32.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce40b6340 con 0x7f5ce40cb970 2023-10-14T19:10:32.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.359+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd801d660 con 0x7f5ce40cb970 2023-10-14T19:10:32.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.360+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce40c7a00 con 0x7f5ce40cb970 2023-10-14T19:10:32.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.360+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce404c3c0 con 0x7f5ce40cb970 2023-10-14T19:10:32.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.361+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5cd801da50 con 0x7f5ce40cb970 2023-10-14T19:10:32.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.361+0000 7f5ce1ffb700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5cd0067320 0x7f5cd00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.361+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f5cd8086a80 con 0x7f5ce40cb970 2023-10-14T19:10:32.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.362+0000 7f5ce9b22700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5cd0067320 0x7f5cd00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.362+0000 7f5ce9b22700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5cd0067320 0x7f5cd00697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4005fd0 tx=0x7f5cd4000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.366+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cd8053680 con 0x7f5ce40cb970 2023-10-14T19:10:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.610+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ce40cab70 con 0x7f5ce40cb970 2023-10-14T19:10:32.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.610+0000 7f5ce1ffb700 1 -- 172.21.15.7:0/1148658020 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f5cd8056ca0 con 0x7f5ce40cb970 2023-10-14T19:10:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:32.612 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:26.537765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000623116","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:32.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.612+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5cd0067320 msgr2=0x7f5cd00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.612+0000 7f5cebd86700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5cd0067320 0x7f5cd00697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4005fd0 tx=0x7f5cd4000f40 comp rx=0 tx=0).stop 2023-10-14T19:10:32.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.612+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 msgr2=0x7f5ce415ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.612+0000 7f5cebd86700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 0x7f5ce415ca20 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5ce406ea60 tx=0x7f5cd8017000 comp rx=0 tx=0).stop 2023-10-14T19:10:32.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 shutdown_connections 2023-10-14T19:10:32.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5cd0067320 0x7f5cd00697d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce40cb5a0 0x7f5ce4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce415a400 0x7f5ce4153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 --2- 172.21.15.7:0/1148658020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ce40cb970 0x7f5ce415ca20 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 >> 172.21.15.7:0/1148658020 conn(0x7f5ce4070e30 msgr2=0x7f5ce40b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 shutdown_connections 2023-10-14T19:10:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.613+0000 7f5cebd86700 1 -- 172.21.15.7:0/1148658020 wait complete. 2023-10-14T19:10:32.617 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2023-10-14T19:10:32.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:32.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.744+0000 7ff5cdbaa700 1 Processor -- start 2023-10-14T19:10:32.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.744+0000 7ff5cdbaa700 1 -- start start 2023-10-14T19:10:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5cdbaa700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5cdbaa700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5c8159c80 0x7ff5c80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5cdbaa700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c80ce9d0 con 0x7ff5c80af790 2023-10-14T19:10:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5cdbaa700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c80afc30 con 0x7ff5c8159c80 2023-10-14T19:10:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5cdbaa700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80aff10 con 0x7ff5c81598b0 2023-10-14T19:10:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5c6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5c8159c80 0x7ff5c80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5c6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5c8159c80 0x7ff5c80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45128/0 (socket says 172.21.15.7:45128) 2023-10-14T19:10:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.745+0000 7ff5c6ffd700 1 -- 172.21.15.7:0/2046544673 learned_addr learned my addr 172.21.15.7:0/2046544673 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c77fe700 1 --2- 172.21.15.7:0/2046544673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c6ffd700 1 -- 172.21.15.7:0/2046544673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 msgr2=0x7ff5c80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:32.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c6ffd700 1 --2- 172.21.15.7:0/2046544673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c6ffd700 1 -- 172.21.15.7:0/2046544673 >> v1:172.21.15.148:6789/0 conn(0x7ff5c80af790 legacy=0x7ff5c80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c6ffd700 1 -- 172.21.15.7:0/2046544673 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80ce380 con 0x7ff5c8159c80 2023-10-14T19:10:32.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c6ffd700 1 --2- 172.21.15.7:0/2046544673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c8159c80 0x7ff5c80cb6f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0099b0 tx=0x7ff5bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49a510f4c19757d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c67fc700 1 -- 172.21.15.7:0/2046544673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc009ea0 con 0x7ff5c8159c80 2023-10-14T19:10:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c67fc700 1 -- 172.21.15.7:0/2046544673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00b860 con 0x7ff5c8159c80 2023-10-14T19:10:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.746+0000 7ff5c67fc700 1 -- 172.21.15.7:0/2046544673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00bc00 con 0x7ff5c8159c80 2023-10-14T19:10:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/2046544673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c8159c80 msgr2=0x7ff5c80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/2046544673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c8159c80 0x7ff5c80cb6f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0099b0 tx=0x7ff5bc009250 comp rx=0 tx=0).stop 2023-10-14T19:10:32.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/2046544673 shutdown_connections 2023-10-14T19:10:32.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/2046544673 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/2046544673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c8159c80 0x7ff5c80cb6f0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/2046544673 >> 172.21.15.7:0/2046544673 conn(0x7ff5c8070e30 msgr2=0x7ff5c80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:32.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/2046544673 shutdown_connections 2023-10-14T19:10:32.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.747+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/2046544673 wait complete. 2023-10-14T19:10:32.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.748+0000 7ff5cdbaa700 1 Processor -- start 2023-10-14T19:10:32.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.748+0000 7ff5cdbaa700 1 -- start start 2023-10-14T19:10:32.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 0x7ff5c814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5c8159c80 0x7ff5c814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80b3820 con 0x7ff5c80af790 2023-10-14T19:10:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c814b940 con 0x7ff5c8159c80 2023-10-14T19:10:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80c81a0 con 0x7ff5c81598b0 2023-10-14T19:10:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 0x7ff5c814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 0x7ff5c814b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45140/0 (socket says 172.21.15.7:45140) 2023-10-14T19:10:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 -- 172.21.15.7:0/1636120449 learned_addr learned my addr 172.21.15.7:0/1636120449 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c6ffd700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c7fff700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5c8159c80 0x7ff5c814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 -- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 msgr2=0x7ff5c80c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 -- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5c8159c80 msgr2=0x7ff5c814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5c8159c80 0x7ff5c814cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 -- 172.21.15.7:0/1636120449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0094f0 con 0x7ff5c80af790 2023-10-14T19:10:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5c77fe700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 0x7ff5c814b400 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800ec80 tx=0x7ff5b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800c9d0 con 0x7ff5c80af790 2023-10-14T19:10:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800cb30 con 0x7ff5c80af790 2023-10-14T19:10:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c80c8480 con 0x7ff5c80af790 2023-10-14T19:10:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8013470 con 0x7ff5c80af790 2023-10-14T19:10:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.749+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c80b34b0 con 0x7ff5c80af790 2023-10-14T19:10:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.750+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c804c3c0 con 0x7ff5c80af790 2023-10-14T19:10:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.751+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff5b8013820 con 0x7ff5c80af790 2023-10-14T19:10:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.751+0000 7ff5af7fe700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5b4067320 0x7ff5b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.751+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7ff5b8085050 con 0x7ff5c80af790 2023-10-14T19:10:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.751+0000 7ff5c6ffd700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5b4067320 0x7ff5b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.752+0000 7ff5c6ffd700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5b4067320 0x7ff5b40697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0099b0 tx=0x7ff5bc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:32.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.755+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5b8051c90 con 0x7ff5c80af790 2023-10-14T19:10:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.996+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5c80ce660 con 0x7ff5c80af790 2023-10-14T19:10:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.996+0000 7ff5af7fe700 1 -- 172.21.15.7:0/1636120449 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4618 (secure 0 0 0) 0x7ff5b80552b0 con 0x7ff5c80af790 2023-10-14T19:10:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:32.998 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:14.896608+0000","modified":"2023-10-14T19:10:26.537765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7506":{"gid":7506,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3846428512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3846428512},{"type":"v1","addr":"172.21.15.7:6835","nonce":3846428512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000623116","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-14T19:10:32.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5b4067320 msgr2=0x7ff5b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5b4067320 0x7ff5b40697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0099b0 tx=0x7ff5bc017000 comp rx=0 tx=0).stop 2023-10-14T19:10:33.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 msgr2=0x7ff5c814b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 0x7ff5c814b400 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800ec80 tx=0x7ff5b80091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 shutdown_connections 2023-10-14T19:10:33.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5b4067320 0x7ff5b40697d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5c8159c80 0x7ff5c814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5c80af790 0x7ff5c814b400 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 --2- 172.21.15.7:0/1636120449 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5c81598b0 0x7ff5c80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 >> 172.21.15.7:0/1636120449 conn(0x7ff5c8070e30 msgr2=0x7ff5c814e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:33.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 shutdown_connections 2023-10-14T19:10:33.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:32.999+0000 7ff5cdbaa700 1 -- 172.21.15.7:0/1636120449 wait complete. 2023-10-14T19:10:33.002 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2023-10-14T19:10:33.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.130+0000 7f2d36b86700 1 Processor -- start 2023-10-14T19:10:33.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.130+0000 7f2d36b86700 1 -- start start 2023-10-14T19:10:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d36b86700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d30159550 0x7f2d300ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d36b86700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d36b86700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d300acc00 con 0x7f2d3015dfd0 2023-10-14T19:10:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d36b86700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300abff0 con 0x7f2d30159550 2023-10-14T19:10:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d36b86700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300ac2d0 con 0x7f2d30159920 2023-10-14T19:10:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d35b84700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d30159550 0x7f2d300ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d36385700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d35b84700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d30159550 0x7f2d300ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:36648/0 (socket says 172.21.15.7:36648) 2023-10-14T19:10:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.131+0000 7f2d35b84700 1 -- 172.21.15.7:0/3006089761 learned_addr learned my addr 172.21.15.7:0/3006089761 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:33.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d35b84700 1 -- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 msgr2=0x7f2d300ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:33.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d35b84700 1 --2- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d35b84700 1 -- 172.21.15.7:0/3006089761 >> v1:172.21.15.148:6789/0 conn(0x7f2d3015dfd0 legacy=0x7f2d300aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d35b84700 1 -- 172.21.15.7:0/3006089761 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300ac5b0 con 0x7f2d30159550 2023-10-14T19:10:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d34b82700 1 -- 172.21.15.7:0/3006089761 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991916035 0 0) 0x7f2d300acc00 con 0x7f2d3015dfd0 2023-10-14T19:10:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d36385700 1 --2- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d35b84700 1 --2- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300ceac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2d280099b0 tx=0x7f2d28009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fbbd1eee8b9b6f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d34b82700 1 -- 172.21.15.7:0/3006089761 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28009ea0 con 0x7f2d30159550 2023-10-14T19:10:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d34b82700 1 -- 172.21.15.7:0/3006089761 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2800b860 con 0x7f2d30159550 2023-10-14T19:10:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.132+0000 7f2d34b82700 1 -- 172.21.15.7:0/3006089761 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800bc00 con 0x7f2d30159550 2023-10-14T19:10:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 -- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 msgr2=0x7f2d300ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 --2- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300ceac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2d280099b0 tx=0x7f2d28009250 comp rx=0 tx=0).stop 2023-10-14T19:10:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 -- 172.21.15.7:0/3006089761 shutdown_connections 2023-10-14T19:10:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 --2- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 --2- 172.21.15.7:0/3006089761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300ceac0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 -- 172.21.15.7:0/3006089761 >> 172.21.15.7:0/3006089761 conn(0x7f2d3006ce80 msgr2=0x7f2d300ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 -- 172.21.15.7:0/3006089761 shutdown_connections 2023-10-14T19:10:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.133+0000 7f2d36b86700 1 -- 172.21.15.7:0/3006089761 wait complete. 2023-10-14T19:10:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.134+0000 7f2d36b86700 1 Processor -- start 2023-10-14T19:10:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.134+0000 7f2d36b86700 1 -- start start 2023-10-14T19:10:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36b86700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36b86700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36b86700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 0x7f2d3016c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36b86700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b2c00 con 0x7f2d3015dfd0 2023-10-14T19:10:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36b86700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b1ff0 con 0x7f2d30159550 2023-10-14T19:10:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36b86700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b22d0 con 0x7f2d30159920 2023-10-14T19:10:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 0x7f2d3016c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 0x7f2d3016c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45148/0 (socket says 172.21.15.7:45148) 2023-10-14T19:10:33.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 -- 172.21.15.7:0/827155170 learned_addr learned my addr 172.21.15.7:0/827155170 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:33.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d35b84700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d35383700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 -- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 msgr2=0x7f2d300c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 -- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 msgr2=0x7f2d300b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 -- 172.21.15.7:0/827155170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20009a20 con 0x7f2d3015dfd0 2023-10-14T19:10:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d35b84700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.135+0000 7f2d36385700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 0x7f2d3016c2e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009fc0 tx=0x7f2d2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.136+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000cd30 con 0x7f2d3015dfd0 2023-10-14T19:10:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.136+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000f040 con 0x7f2d3015dfd0 2023-10-14T19:10:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.136+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200146d0 con 0x7f2d3015dfd0 2023-10-14T19:10:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.136+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d280094f0 con 0x7f2d3015dfd0 2023-10-14T19:10:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.136+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d300b2890 con 0x7f2d3015dfd0 2023-10-14T19:10:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.137+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3004c3c0 con 0x7f2d3015dfd0 2023-10-14T19:10:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.137+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d20003020 con 0x7f2d3015dfd0 2023-10-14T19:10:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.138+0000 7f2d2dffb700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d1c067320 0x7f2d1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.138+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2d20085850 con 0x7f2d3015dfd0 2023-10-14T19:10:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.138+0000 7f2d35b84700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d1c067320 0x7f2d1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.138+0000 7f2d35b84700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d1c067320 0x7f2d1c0697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2d280099b0 tx=0x7f2d28017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.142+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d20052380 con 0x7f2d3015dfd0 2023-10-14T19:10:33.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.339+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d300b2d40 con 0x7f2d3015dfd0 2023-10-14T19:10:33.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.340+0000 7f2d2dffb700 1 -- 172.21.15.7:0/827155170 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f2d300b2d40 con 0x7f2d3015dfd0 2023-10-14T19:10:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:33.341 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":142,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:28.545406+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000623116.meta","create_time":"2023-10-14T19:10:13.324802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000623116"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000623116.data","create_time":"2023-10-14T19:10:13.861987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000623116"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:33.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d1c067320 msgr2=0x7f2d1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d1c067320 0x7f2d1c0697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2d280099b0 tx=0x7f2d28017000 comp rx=0 tx=0).stop 2023-10-14T19:10:33.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 msgr2=0x7f2d3016c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 0x7f2d3016c2e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009fc0 tx=0x7f2d2000b040 comp rx=0 tx=0).stop 2023-10-14T19:10:33.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 shutdown_connections 2023-10-14T19:10:33.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d1c067320 0x7f2d1c0697d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d30159550 0x7f2d300b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015dfd0 0x7f2d3016c2e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 --2- 172.21.15.7:0/827155170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d30159920 0x7f2d300c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 >> 172.21.15.7:0/827155170 conn(0x7f2d3006ce80 msgr2=0x7f2d300ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:33.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 shutdown_connections 2023-10-14T19:10:33.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.342+0000 7f2d36b86700 1 -- 172.21.15.7:0/827155170 wait complete. 2023-10-14T19:10:33.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000623116 2023-10-14T19:10:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 Processor -- start 2023-10-14T19:10:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 -- start start 2023-10-14T19:10:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc47c0a8d00 0x7fc47c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc47c06e380 0x7fc47c0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0ae680 con 0x7fc47c0a8d00 2023-10-14T19:10:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c06e7f0 con 0x7fc47c06e380 2023-10-14T19:10:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.475+0000 7fc48133e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0aeee0 con 0x7fc47c0a90d0 2023-10-14T19:10:33.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc47c0a8d00 0x7fc47c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc47c0a8d00 0x7fc47c0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45154/0 (socket says 172.21.15.7:45154) 2023-10-14T19:10:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 -- 172.21.15.7:0/143418865 learned_addr learned my addr 172.21.15.7:0/143418865 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 -- 172.21.15.7:0/143418865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 msgr2=0x7fc47c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47a7fc700 1 --2- 172.21.15.7:0/143418865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47b7fe700 1 --2- 172.21.15.7:0/143418865 >> v2:172.21.15.148:3300/0 conn(0x7fc47c06e380 0x7fc47c0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 --2- 172.21.15.7:0/143418865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c06de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 -- 172.21.15.7:0/143418865 >> v2:172.21.15.148:3300/0 conn(0x7fc47c06e380 msgr2=0x7fc47c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 --2- 172.21.15.7:0/143418865 >> v2:172.21.15.148:3300/0 conn(0x7fc47c06e380 0x7fc47c0cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 -- 172.21.15.7:0/143418865 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0cf490 con 0x7fc47c0a8d00 2023-10-14T19:10:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc47affd700 1 --2- 172.21.15.7:0/143418865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c0a8d00 0x7fc47c0cddf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc47c15d780 tx=0x7fc474009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622ec886d2247755 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc479ffb700 1 -- 172.21.15.7:0/143418865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474005c10 con 0x7fc47c0a8d00 2023-10-14T19:10:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc479ffb700 1 -- 172.21.15.7:0/143418865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474005d70 con 0x7fc47c0a8d00 2023-10-14T19:10:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.476+0000 7fc479ffb700 1 -- 172.21.15.7:0/143418865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47400b880 con 0x7fc47c0a8d00 2023-10-14T19:10:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 -- 172.21.15.7:0/143418865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c0a8d00 msgr2=0x7fc47c0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 --2- 172.21.15.7:0/143418865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c0a8d00 0x7fc47c0cddf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc47c15d780 tx=0x7fc474009220 comp rx=0 tx=0).stop 2023-10-14T19:10:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 -- 172.21.15.7:0/143418865 shutdown_connections 2023-10-14T19:10:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 --2- 172.21.15.7:0/143418865 >> v2:172.21.15.148:3300/0 conn(0x7fc47c06e380 0x7fc47c0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 --2- 172.21.15.7:0/143418865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c0a8d00 0x7fc47c0cddf0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 --2- 172.21.15.7:0/143418865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c06de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 -- 172.21.15.7:0/143418865 >> 172.21.15.7:0/143418865 conn(0x7fc47c06ce80 msgr2=0x7fc47c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:33.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 -- 172.21.15.7:0/143418865 shutdown_connections 2023-10-14T19:10:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.477+0000 7fc48133e700 1 -- 172.21.15.7:0/143418865 wait complete. 2023-10-14T19:10:33.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.478+0000 7fc48133e700 1 Processor -- start 2023-10-14T19:10:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.478+0000 7fc48133e700 1 -- start start 2023-10-14T19:10:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc48133e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 0x7fc47c158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc48133e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc47c0a8d00 0x7fc47c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc48133e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc48133e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1595e0 con 0x7fc47c06e380 2023-10-14T19:10:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc48133e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1589d0 con 0x7fc47c0a8d00 2023-10-14T19:10:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc48133e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c158cb0 con 0x7fc47c0a90d0 2023-10-14T19:10:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 0x7fc47c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 0x7fc47c158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45168/0 (socket says 172.21.15.7:45168) 2023-10-14T19:10:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 -- 172.21.15.7:0/399346768 learned_addr learned my addr 172.21.15.7:0/399346768 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47a7fc700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc47c0a8d00 0x7fc47c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47b7fe700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 -- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 msgr2=0x7fc47c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 -- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc47c0a8d00 msgr2=0x7fc47c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc47c0a8d00 0x7fc47c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 -- 172.21.15.7:0/399346768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc474009480 con 0x7fc47c06e380 2023-10-14T19:10:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47b7fe700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.479+0000 7fc47affd700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 0x7fc47c158120 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc47400b3c0 tx=0x7fc474016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.480+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474011870 con 0x7fc47c06e380 2023-10-14T19:10:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.480+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474020070 con 0x7fc47c06e380 2023-10-14T19:10:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.480+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c158f90 con 0x7fc47c06e380 2023-10-14T19:10:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.480+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474011c00 con 0x7fc47c06e380 2023-10-14T19:10:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.480+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c158660 con 0x7fc47c06e380 2023-10-14T19:10:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.481+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c159970 con 0x7fc47c06e380 2023-10-14T19:10:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.481+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc474022030 con 0x7fc47c06e380 2023-10-14T19:10:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.481+0000 7fc472ffd700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc45c067320 0x7fc45c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.481+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fc4740866b0 con 0x7fc47c06e380 2023-10-14T19:10:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.482+0000 7fc47a7fc700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc45c067320 0x7fc45c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.482+0000 7fc47a7fc700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc45c067320 0x7fc45c0697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc47c068480 tx=0x7fc464008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.486+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc474053400 con 0x7fc47c06e380 2023-10-14T19:10:33.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.725+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000623116"} v 0) v1 -- 0x7fc47c04c3c0 con 0x7fc47c06e380 2023-10-14T19:10:33.726 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:10:33.725+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:10:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.729+0000 7fc472ffd700 1 -- 172.21.15.7:0/399346768 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000623116"}]=0 volume_0000000000623116 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 195+0+0 (secure 0 0 0) 0x7fc474056a20 con 0x7fc47c06e380 2023-10-14T19:10:33.731 INFO:tasks.ceph.mds.a.smithi007.stderr: -755> 2023-10-14T19:10:20.814+0000 7fa1d6544700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:10:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc45c067320 msgr2=0x7fc45c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc45c067320 0x7fc45c0697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc47c068480 tx=0x7fc464008040 comp rx=0 tx=0).stop 2023-10-14T19:10:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 msgr2=0x7fc47c158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 0x7fc47c158120 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc47400b3c0 tx=0x7fc474016000 comp rx=0 tx=0).stop 2023-10-14T19:10:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 shutdown_connections 2023-10-14T19:10:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc45c067320 0x7fc45c0697d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc47c0a90d0 0x7fc47c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc47c06e380 0x7fc47c158120 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 --2- 172.21.15.7:0/399346768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc47c0a8d00 0x7fc47c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 >> 172.21.15.7:0/399346768 conn(0x7fc47c06ce80 msgr2=0x7fc47c0af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 shutdown_connections 2023-10-14T19:10:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.732+0000 7fc48133e700 1 -- 172.21.15.7:0/399346768 wait complete. 2023-10-14T19:10:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:volume_0000000000623116 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:10:33.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000623116 --yes-i-really-mean-it 2023-10-14T19:10:33.752 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:10:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.868+0000 7f9a38d58700 1 Processor -- start 2023-10-14T19:10:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.868+0000 7f9a38d58700 1 -- start start 2023-10-14T19:10:33.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.869+0000 7f9a38d58700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 0x7f9a34159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.869+0000 7f9a38d58700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a340ccfd0 con 0x7f9a3406e0e0 2023-10-14T19:10:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.869+0000 7f9a38d58700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3415a3d0 con 0x7f9a34159530 2023-10-14T19:10:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.869+0000 7f9a38d58700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3415a6b0 con 0x7f9a3406dc70 2023-10-14T19:10:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.869+0000 7f9a32d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9a3406e0e0 0x7f9a340cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44326/0 (socket says 172.21.15.7:44326) 2023-10-14T19:10:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.869+0000 7f9a32d9d700 1 -- 172.21.15.7:0/2083446307 learned_addr learned my addr 172.21.15.7:0/2083446307 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a31d9b700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 0x7f9a34159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996690665 0 0) 0x7f9a340ccfd0 con 0x7f9a3406e0e0 2023-10-14T19:10:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a20003570 con 0x7f9a3406e0e0 2023-10-14T19:10:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255192443 0 0) 0x7f9a20003570 con 0x7f9a3406e0e0 2023-10-14T19:10:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 msgr2=0x7f9a34159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 0x7f9a34159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 >> v1:172.21.15.148:6789/0 conn(0x7f9a34159530 legacy=0x7f9a340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3415a990 con 0x7f9a3406e0e0 2023-10-14T19:10:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f9a24001470 con 0x7f9a3406e0e0 2023-10-14T19:10:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 >> v1:172.21.15.7:6789/0 conn(0x7f9a3406e0e0 legacy=0x7f9a340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a20003a90 0x7f9a20003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20004810 0x7f9a20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 0x7f9a200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3415a6b0 con 0x7f9a20003a90 2023-10-14T19:10:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2000bb10 con 0x7f9a20004810 2023-10-14T19:10:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2000bcd0 con 0x7f9a3406dc70 2023-10-14T19:10:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3259c700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a20003a90 0x7f9a20003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a31d9b700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20004810 0x7f9a20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a32d9d700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 0x7f9a200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3259c700 1 -- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 msgr2=0x7f9a200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3259c700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3406dc70 0x7f9a200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3259c700 1 -- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20004810 msgr2=0x7f9a20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3259c700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20004810 0x7f9a20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.870+0000 7f9a3259c700 1 -- 172.21.15.7:0/2083446307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20003570 con 0x7f9a20003a90 2023-10-14T19:10:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a3259c700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a20003a90 0x7f9a20003e60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c002060 tx=0x7f9a2c0016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f1537477791f72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0019f0 con 0x7f9a20003a90 2023-10-14T19:10:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00c8b0 con 0x7f9a20003a90 2023-10-14T19:10:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a3159a700 1 -- 172.21.15.7:0/2083446307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00cc30 con 0x7f9a20003a90 2023-10-14T19:10:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a38d58700 1 -- 172.21.15.7:0/2083446307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a20003a90 msgr2=0x7f9a20003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a38d58700 1 --2- 172.21.15.7:0/2083446307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a20003a90 0x7f9a20003e60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c002060 tx=0x7f9a2c0016e0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a32d9d700 1 -- 172.21.15.7:0/2083446307 reap_dead start 2023-10-14T19:10:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a38d58700 1 -- 172.21.15.7:0/2083446307 shutdown_connections 2023-10-14T19:10:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a38d58700 1 -- 172.21.15.7:0/2083446307 >> 172.21.15.7:0/2083446307 conn(0x7f9a340703a0 msgr2=0x7f9a340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a38d58700 1 -- 172.21.15.7:0/2083446307 shutdown_connections 2023-10-14T19:10:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.871+0000 7f9a38d58700 1 -- 172.21.15.7:0/2083446307 wait complete. 2023-10-14T19:10:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.872+0000 7f9a38d58700 1 Processor -- start 2023-10-14T19:10:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 -- start start 2023-10-14T19:10:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20003a90 0x7f9a34168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 0x7f9a340d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a340c9ab0 0x7f9a340c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340d0e10 con 0x7f9a340d0460 2023-10-14T19:10:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3415dcf0 con 0x7f9a20003a90 2023-10-14T19:10:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a38d58700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340ca7e0 con 0x7f9a340c9ab0 2023-10-14T19:10:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a31d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 0x7f9a340d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a31d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 0x7f9a340d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45196/0 (socket says 172.21.15.7:45196) 2023-10-14T19:10:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.873+0000 7f9a31d9b700 1 -- 172.21.15.7:0/3838734098 learned_addr learned my addr 172.21.15.7:0/3838734098 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a3259c700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20003a90 0x7f9a34168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a32d9d700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a340c9ab0 0x7f9a340c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a31d9b700 1 -- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a340c9ab0 msgr2=0x7f9a340c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a31d9b700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a340c9ab0 0x7f9a340c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a31d9b700 1 -- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20003a90 msgr2=0x7f9a34168920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a31d9b700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20003a90 0x7f9a34168920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a31d9b700 1 -- 172.21.15.7:0/3838734098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3415d3c0 con 0x7f9a340d0460 2023-10-14T19:10:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a31d9b700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 0x7f9a340d08d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c011d40 tx=0x7f9a1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00fa10 con 0x7f9a340d0460 2023-10-14T19:10:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00fb70 con 0x7f9a340d0460 2023-10-14T19:10:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3415d6a0 con 0x7f9a340d0460 2023-10-14T19:10:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c014440 con 0x7f9a340d0460 2023-10-14T19:10:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.874+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a340ca490 con 0x7f9a340d0460 2023-10-14T19:10:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.875+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3415dea0 con 0x7f9a340d0460 2023-10-14T19:10:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.876+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9a1c014870 con 0x7f9a340d0460 2023-10-14T19:10:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.876+0000 7f9a2a7fc700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a14067320 0x7f9a140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.876+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f9a1c018030 con 0x7f9a340d0460 2023-10-14T19:10:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.876+0000 7f9a3259c700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a14067320 0x7f9a140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.877+0000 7f9a3259c700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a14067320 0x7f9a140697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c001370 tx=0x7f9a2c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:33.880+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a3415dea0 con 0x7f9a340d0460 2023-10-14T19:10:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.116+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000623116", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a3415de60 con 0x7f9a340d0460 2023-10-14T19:10:34.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.736+0000 7f9a2a7fc700 1 -- 172.21.15.7:0/3838734098 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000623116", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 121+0+0 (secure 0 0 0) 0x7f9a1c083e60 con 0x7f9a340d0460 2023-10-14T19:10:34.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a14067320 msgr2=0x7f9a140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a14067320 0x7f9a140697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c001370 tx=0x7f9a2c015000 comp rx=0 tx=0).stop 2023-10-14T19:10:34.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 msgr2=0x7f9a340d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 0x7f9a340d08d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c011d40 tx=0x7f9a1c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 shutdown_connections 2023-10-14T19:10:34.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9a14067320 0x7f9a140697d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a20003a90 0x7f9a34168920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a340c9ab0 0x7f9a340c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 --2- 172.21.15.7:0/3838734098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340d0460 0x7f9a340d08d0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 >> 172.21.15.7:0/3838734098 conn(0x7f9a340703a0 msgr2=0x7f9a340cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:34.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 shutdown_connections 2023-10-14T19:10:34.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.738+0000 7f9a38d58700 1 -- 172.21.15.7:0/3838734098 wait complete. 2023-10-14T19:10:34.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000623116.meta cephfs.volume_0000000000623116.meta --yes-i-really-really-mean-it 2023-10-14T19:10:34.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.918+0000 7f96717ae700 1 Processor -- start 2023-10-14T19:10:34.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f96717ae700 1 -- start start 2023-10-14T19:10:34.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f96717ae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 0x7f966c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f96717ae700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c06e560 con 0x7f966c0cec90 2023-10-14T19:10:34.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f96717ae700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c06e260 con 0x7f966c0b05a0 2023-10-14T19:10:34.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f96717ae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c3240 con 0x7f966c0c41e0 2023-10-14T19:10:34.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f966b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f966c0cec90 0x7f966c0c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44328/0 (socket says 172.21.15.7:44328) 2023-10-14T19:10:34.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.919+0000 7f966b7fe700 1 -- 172.21.15.7:0/1910779095 learned_addr learned my addr 172.21.15.7:0/1910779095 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:34.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f9670fad700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 0x7f966c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21625345 0 0) 0x7f966c06e560 con 0x7f966c0cec90 2023-10-14T19:10:34.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9658003570 con 0x7f966c0cec90 2023-10-14T19:10:34.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518632049 0 0) 0x7f966c06e260 con 0x7f966c0b05a0 2023-10-14T19:10:34.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f966c06e560 con 0x7f966c0b05a0 2023-10-14T19:10:34.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715643880 0 0) 0x7f9658003570 con 0x7f966c0cec90 2023-10-14T19:10:34.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 msgr2=0x7f966c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:34.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 0x7f966c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 >> v1:172.21.15.148:6789/0 conn(0x7f966c0b05a0 legacy=0x7f966c0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0c3520 con 0x7f966c0cec90 2023-10-14T19:10:34.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f965c001470 con 0x7f966c0cec90 2023-10-14T19:10:34.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 >> v1:172.21.15.7:6789/0 conn(0x7f966c0cec90 legacy=0x7f966c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f9658004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 0x7f9658004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658004d50 0x7f96580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c3240 con 0x7f9658003c20 2023-10-14T19:10:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965800bbf0 con 0x7f9658004d50 2023-10-14T19:10:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965800bd60 con 0x7f966c0c41e0 2023-10-14T19:10:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966bfff700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f9658004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f966b7fe700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 0x7f9658004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.920+0000 7f9670fad700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658004d50 0x7f96580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966bfff700 1 -- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 msgr2=0x7f9658004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:34.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966bfff700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c41e0 0x7f9658004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966bfff700 1 -- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658004d50 msgr2=0x7f96580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:34.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966bfff700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9658004d50 0x7f96580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966bfff700 1 -- 172.21.15.7:0/1910779095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658003570 con 0x7f9658003c20 2023-10-14T19:10:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966bfff700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f9658004010 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9654007fd0 tx=0x7f9654007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541d2913bc7478a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96540013f0 con 0x7f9658003c20 2023-10-14T19:10:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965400c5d0 con 0x7f9658003c20 2023-10-14T19:10:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f966affd700 1 -- 172.21.15.7:0/1910779095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965400c990 con 0x7f9658003c20 2023-10-14T19:10:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f96717ae700 1 -- 172.21.15.7:0/1910779095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 msgr2=0x7f9658004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f96717ae700 1 --2- 172.21.15.7:0/1910779095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f9658004010 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9654007fd0 tx=0x7f9654007d80 comp rx=0 tx=0).stop 2023-10-14T19:10:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.921+0000 7f9670fad700 1 -- 172.21.15.7:0/1910779095 reap_dead start 2023-10-14T19:10:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.922+0000 7f96717ae700 1 -- 172.21.15.7:0/1910779095 shutdown_connections 2023-10-14T19:10:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.922+0000 7f96717ae700 1 -- 172.21.15.7:0/1910779095 >> 172.21.15.7:0/1910779095 conn(0x7f966c088000 msgr2=0x7f966c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.922+0000 7f96717ae700 1 -- 172.21.15.7:0/1910779095 shutdown_connections 2023-10-14T19:10:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.922+0000 7f96717ae700 1 -- 172.21.15.7:0/1910779095 wait complete. 2023-10-14T19:10:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.923+0000 7f96717ae700 1 Processor -- start 2023-10-14T19:10:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.923+0000 7f96717ae700 1 -- start start 2023-10-14T19:10:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f966c14b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c5420 0x7f966c0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f966c0c9720 0x7f966c0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c70b0 con 0x7f9658003c20 2023-10-14T19:10:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0ca0e0 con 0x7f966c0c9720 2023-10-14T19:10:34.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c14b760 con 0x7f966c0c5420 2023-10-14T19:10:34.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f966c14b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f966c14b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45218/0 (socket says 172.21.15.7:45218) 2023-10-14T19:10:34.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 -- 172.21.15.7:0/879073426 learned_addr learned my addr 172.21.15.7:0/879073426 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:34.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f9670fad700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f966c0c9720 0x7f966c0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966b7fe700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c5420 0x7f966c0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 -- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c5420 msgr2=0x7f966c0c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c5420 0x7f966c0c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 -- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f966c0c9720 msgr2=0x7f966c0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f966c0c9720 0x7f966c0c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 -- 172.21.15.7:0/879073426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0c58b0 con 0x7f9658003c20 2023-10-14T19:10:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f9670fad700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f966c0c9720 0x7f966c0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966b7fe700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c5420 0x7f966c0c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f966bfff700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f966c14b220 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9654012f20 tx=0x7f9654015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654001390 con 0x7f9658003c20 2023-10-14T19:10:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965400c740 con 0x7f9658003c20 2023-10-14T19:10:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c0c5b90 con 0x7f9658003c20 2023-10-14T19:10:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654006870 con 0x7f9658003c20 2023-10-14T19:10:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.924+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c0c6150 con 0x7f9658003c20 2023-10-14T19:10:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.926+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c0c64c0 con 0x7f9658003c20 2023-10-14T19:10:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.926+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9654006c40 con 0x7f9658003c20 2023-10-14T19:10:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.926+0000 7f9663fff700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f964c067320 0x7f964c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.926+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f96540868c0 con 0x7f9658003c20 2023-10-14T19:10:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.927+0000 7f966b7fe700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f964c067320 0x7f964c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.927+0000 7f966b7fe700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f964c067320 0x7f964c0697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f965c0015a0 tx=0x7f965c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:34.931+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96540534b0 con 0x7f9658003c20 2023-10-14T19:10:35.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.123+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000623116.meta", "pool2": "cephfs.volume_0000000000623116.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f966c0b41d0 con 0x7f9658003c20 2023-10-14T19:10:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.856+0000 7f9663fff700 1 -- 172.21.15.7:0/879073426 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000623116.meta", "pool2": "cephfs.volume_0000000000623116.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000623116.meta' removed v144) v1 ==== 241+0+0 (secure 0 0 0) 0x7f9654017100 con 0x7f9658003c20 2023-10-14T19:10:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.859+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f964c067320 msgr2=0x7f964c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.859+0000 7f96717ae700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f964c067320 0x7f964c0697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f965c0015a0 tx=0x7f965c009040 comp rx=0 tx=0).stop 2023-10-14T19:10:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.859+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 msgr2=0x7f966c14b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.859+0000 7f96717ae700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f966c14b220 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9654012f20 tx=0x7f9654015000 comp rx=0 tx=0).stop 2023-10-14T19:10:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 shutdown_connections 2023-10-14T19:10:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f964c067320 0x7f964c0697d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f966c0c9720 0x7f966c0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9658003c20 0x7f966c14b220 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 --2- 172.21.15.7:0/879073426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f966c0c5420 0x7f966c0c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 >> 172.21.15.7:0/879073426 conn(0x7f966c088000 msgr2=0x7f966c159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 shutdown_connections 2023-10-14T19:10:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:35.860+0000 7f96717ae700 1 -- 172.21.15.7:0/879073426 wait complete. 2023-10-14T19:10:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs.volume_0000000000623116.meta' removed 2023-10-14T19:10:35.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000623116.data cephfs.volume_0000000000623116.data --yes-i-really-really-mean-it 2023-10-14T19:10:36.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.002+0000 7f720743d700 1 Processor -- start 2023-10-14T19:10:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.003+0000 7f720743d700 1 -- start start 2023-10-14T19:10:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.003+0000 7f720743d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72000cf800 0x7f72001509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.003+0000 7f720743d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72000ce360 con 0x7f72000cd200 2023-10-14T19:10:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.003+0000 7f720743d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72000cb970 con 0x7f72000cd5d0 2023-10-14T19:10:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.003+0000 7f720743d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72000cda40 con 0x7f72000cf800 2023-10-14T19:10:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72051d9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72000cd200 0x7f72000caeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44344/0 (socket says 172.21.15.7:44344) 2023-10-14T19:10:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72051d9700 1 -- 172.21.15.7:0/1992733394 learned_addr learned my addr 172.21.15.7:0/1992733394 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72059da700 1 --2- 172.21.15.7:0/1992733394 >> v2:172.21.15.7:3300/0 conn(0x7f72000cf800 0x7f72001509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f71fffff700 1 -- 172.21.15.7:0/1992733394 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474181028 0 0) 0x7f72000ce360 con 0x7f72000cd200 2023-10-14T19:10:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f71fffff700 1 -- 172.21.15.7:0/1992733394 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e8003570 con 0x7f72000cd200 2023-10-14T19:10:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72059da700 1 -- 172.21.15.7:0/1992733394 >> v1:172.21.15.148:6789/0 conn(0x7f72000cd5d0 legacy=0x7f72001502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72059da700 1 -- 172.21.15.7:0/1992733394 >> v1:172.21.15.7:6789/0 conn(0x7f72000cd200 legacy=0x7f72000caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72059da700 1 -- 172.21.15.7:0/1992733394 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000cbc50 con 0x7f72000cf800 2023-10-14T19:10:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f72059da700 1 --2- 172.21.15.7:0/1992733394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cf800 0x7f72001509d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f71f00098e0 tx=0x7f71f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3984bc068c966bad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f71fffff700 1 -- 172.21.15.7:0/1992733394 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000b640 con 0x7f72000cf800 2023-10-14T19:10:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f71fffff700 1 -- 172.21.15.7:0/1992733394 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000b7a0 con 0x7f72000cf800 2023-10-14T19:10:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.004+0000 7f71fffff700 1 -- 172.21.15.7:0/1992733394 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000bb40 con 0x7f72000cf800 2023-10-14T19:10:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 -- 172.21.15.7:0/1992733394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cf800 msgr2=0x7f72001509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 --2- 172.21.15.7:0/1992733394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cf800 0x7f72001509d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f71f00098e0 tx=0x7f71f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 -- 172.21.15.7:0/1992733394 shutdown_connections 2023-10-14T19:10:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 --2- 172.21.15.7:0/1992733394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cf800 0x7f72001509d0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 -- 172.21.15.7:0/1992733394 >> 172.21.15.7:0/1992733394 conn(0x7f72000999c0 msgr2=0x7f7200070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 -- 172.21.15.7:0/1992733394 shutdown_connections 2023-10-14T19:10:36.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.005+0000 7f720743d700 1 -- 172.21.15.7:0/1992733394 wait complete. 2023-10-14T19:10:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.006+0000 7f720743d700 1 Processor -- start 2023-10-14T19:10:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.006+0000 7f720743d700 1 -- start start 2023-10-14T19:10:36.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f720743d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 0x7f720014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:36.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f720743d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72000cd5d0 0x7f7200155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:36.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f720743d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72000cf800 0x7f720016cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:36.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f720743d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7200152660 con 0x7f72000cd200 2023-10-14T19:10:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f720743d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7200155d70 con 0x7f72000cd5d0 2023-10-14T19:10:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f720743d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200156050 con 0x7f72000cf800 2023-10-14T19:10:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 0x7f720014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 0x7f720014de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45248/0 (socket says 172.21.15.7:45248) 2023-10-14T19:10:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 -- 172.21.15.7:0/3674261738 learned_addr learned my addr 172.21.15.7:0/3674261738 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 -- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72000cf800 msgr2=0x7f720016cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:36.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72000cf800 0x7f720016cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 -- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72000cd5d0 msgr2=0x7f7200155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:36.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72000cd5d0 0x7f7200155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.007+0000 7f72051d9700 1 -- 172.21.15.7:0/3674261738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009420 con 0x7f72000cd200 2023-10-14T19:10:36.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.008+0000 7f72051d9700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 0x7f720014de10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f71f800cb10 tx=0x7f71f80027e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:36.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.008+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8005d80 con 0x7f72000cd200 2023-10-14T19:10:36.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.008+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f80070f0 con 0x7f72000cd200 2023-10-14T19:10:36.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.008+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7200152010 con 0x7f72000cd200 2023-10-14T19:10:36.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.008+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8007470 con 0x7f72000cd200 2023-10-14T19:10:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.008+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720014e350 con 0x7f72000cd200 2023-10-14T19:10:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.009+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720004c3c0 con 0x7f72000cd200 2023-10-14T19:10:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.009+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f71f80078a0 con 0x7f72000cd200 2023-10-14T19:10:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.009+0000 7f71fd7fa700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ec067320 0x7f71ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.010+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5394+0+0 (secure 0 0 0) 0x7f71f8084a20 con 0x7f72000cd200 2023-10-14T19:10:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.010+0000 7f72049d8700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ec067320 0x7f71ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.010+0000 7f72049d8700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ec067320 0x7f71ec0697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f720015e470 tx=0x7f71f4007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.014+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71f8051860 con 0x7f72000cd200 2023-10-14T19:10:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.209+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000623116.data", "pool2": "cephfs.volume_0000000000623116.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72000cbf30 con 0x7f72000cd200 2023-10-14T19:10:36.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.860+0000 7f71fd7fa700 1 -- 172.21.15.7:0/3674261738 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000623116.data", "pool2": "cephfs.volume_0000000000623116.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000623116.data' removed v145) v1 ==== 241+0+0 (secure 0 0 0) 0x7f71f8054e80 con 0x7f72000cd200 2023-10-14T19:10:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.864+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ec067320 msgr2=0x7f71ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.864+0000 7f720743d700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ec067320 0x7f71ec0697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f720015e470 tx=0x7f71f4007b40 comp rx=0 tx=0).stop 2023-10-14T19:10:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.864+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 msgr2=0x7f720014de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.864+0000 7f720743d700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 0x7f720014de10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f71f800cb10 tx=0x7f71f80027e0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 shutdown_connections 2023-10-14T19:10:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f71ec067320 0x7f71ec0697d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f72000cf800 0x7f720016cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72000cd200 0x7f720014de10 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 --2- 172.21.15.7:0/3674261738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72000cd5d0 0x7f7200155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 >> 172.21.15.7:0/3674261738 conn(0x7f72000999c0 msgr2=0x7f720006da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 shutdown_connections 2023-10-14T19:10:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:36.865+0000 7f720743d700 1 -- 172.21.15.7:0/3674261738 wait complete. 2023-10-14T19:10:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs.volume_0000000000623116.data' removed 2023-10-14T19:10:36.881 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:10:37.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.009+0000 7f9cb4a84700 1 Processor -- start 2023-10-14T19:10:37.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.009+0000 7f9cb4a84700 1 -- start start 2023-10-14T19:10:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cb4a84700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9cb00684e0 0x7f9cb00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cb4a84700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb0068320 con 0x7f9cb00cc910 2023-10-14T19:10:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cb4a84700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb015ae00 con 0x7f9cb00cd780 2023-10-14T19:10:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cb4a84700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb015a560 con 0x7f9cb00684e0 2023-10-14T19:10:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cadd9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9cb00684e0 0x7f9cb00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cae59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9cb00cc910 0x7f9cb0159d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35676/0 (socket says 172.21.15.7:35676) 2023-10-14T19:10:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cae59c700 1 -- 172.21.15.7:0/2382864759 learned_addr learned my addr 172.21.15.7:0/2382864759 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cadd9b700 1 -- 172.21.15.7:0/2382864759 >> v1:172.21.15.148:6789/0 conn(0x7f9cb00cd780 legacy=0x7f9cb015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cadd9b700 1 -- 172.21.15.7:0/2382864759 >> v1:172.21.15.7:6789/0 conn(0x7f9cb00cc910 legacy=0x7f9cb0159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cadd9b700 1 -- 172.21.15.7:0/2382864759 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb015a840 con 0x7f9cb00684e0 2023-10-14T19:10:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.010+0000 7f9cad59a700 1 -- 172.21.15.7:0/2382864759 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887012373 0 0) 0x7f9ca8001490 con 0x7f9cb00cc910 2023-10-14T19:10:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cadd9b700 1 --2- 172.21.15.7:0/2382864759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00684e0 0x7f9cb00cd240 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9c980098e0 tx=0x7f9c980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54042c786bf7e11c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cad59a700 1 -- 172.21.15.7:0/2382864759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98009e80 con 0x7f9cb00684e0 2023-10-14T19:10:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cad59a700 1 -- 172.21.15.7:0/2382864759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9800b820 con 0x7f9cb00684e0 2023-10-14T19:10:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cad59a700 1 -- 172.21.15.7:0/2382864759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800bba0 con 0x7f9cb00684e0 2023-10-14T19:10:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 -- 172.21.15.7:0/2382864759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00684e0 msgr2=0x7f9cb00cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/2382864759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00684e0 0x7f9cb00cd240 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9c980098e0 tx=0x7f9c980091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 -- 172.21.15.7:0/2382864759 shutdown_connections 2023-10-14T19:10:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/2382864759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00684e0 0x7f9cb00cd240 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 -- 172.21.15.7:0/2382864759 >> 172.21.15.7:0/2382864759 conn(0x7f9cb006d7b0 msgr2=0x7f9cb006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 -- 172.21.15.7:0/2382864759 shutdown_connections 2023-10-14T19:10:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.011+0000 7f9cb4a84700 1 -- 172.21.15.7:0/2382864759 wait complete. 2023-10-14T19:10:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.012+0000 7f9cb4a84700 1 Processor -- start 2023-10-14T19:10:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 -- start start 2023-10-14T19:10:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb00684e0 0x7f9cb00c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00cc910 0x7f9cb01569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 0x7f9cb00aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00ad4a0 con 0x7f9cb00cd780 2023-10-14T19:10:37.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00ae840 con 0x7f9cb00cc910 2023-10-14T19:10:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cb4a84700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00aeb20 con 0x7f9cb00684e0 2023-10-14T19:10:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9caed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 0x7f9cb00aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9caed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 0x7f9cb00aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45654/0 (socket says 172.21.15.7:45654) 2023-10-14T19:10:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9caed9d700 1 -- 172.21.15.7:0/3612385211 learned_addr learned my addr 172.21.15.7:0/3612385211 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cadd9b700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00cc910 0x7f9cb01569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.013+0000 7f9cae59c700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb00684e0 0x7f9cb00c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9caed9d700 1 -- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb00684e0 msgr2=0x7f9cb00c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9caed9d700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb00684e0 0x7f9cb00c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9caed9d700 1 -- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00cc910 msgr2=0x7f9cb01569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9caed9d700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00cc910 0x7f9cb01569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9caed9d700 1 -- 172.21.15.7:0/3612385211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98009420 con 0x7f9cb00cd780 2023-10-14T19:10:37.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9cadd9b700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00cc910 0x7f9cb01569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:37.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9caed9d700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 0x7f9cb00aefb0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c5e0 tx=0x7f9ca0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:37.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011590 con 0x7f9cb00cd780 2023-10-14T19:10:37.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0011710 con 0x7f9cb00cd780 2023-10-14T19:10:37.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb00ad6f0 con 0x7f9cb00cd780 2023-10-14T19:10:37.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011ad0 con 0x7f9cb00cd780 2023-10-14T19:10:37.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.014+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb0156f20 con 0x7f9cb00cd780 2023-10-14T19:10:37.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.015+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb004c3c0 con 0x7f9cb00cd780 2023-10-14T19:10:37.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.015+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9ca001c460 con 0x7f9cb00cd780 2023-10-14T19:10:37.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.016+0000 7f9ca67fc700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c90067320 0x7f9c900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.016+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ca0084600 con 0x7f9cb00cd780 2023-10-14T19:10:37.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.016+0000 7f9cae59c700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c90067320 0x7f9c900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.017+0000 7f9cae59c700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c90067320 0x7f9c900697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9cb006d330 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:37.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.020+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ca0051590 con 0x7f9cb00cd780 2023-10-14T19:10:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.213+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9cb00aec60 con 0x7f9cb00cd780 2023-10-14T19:10:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.217+0000 7f9ca67fc700 1 -- 172.21.15.7:0/3612385211 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ca0054bb0 con 0x7f9cb00cd780 2023-10-14T19:10:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c90067320 msgr2=0x7f9c900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c90067320 0x7f9c900697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9cb006d330 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2023-10-14T19:10:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 msgr2=0x7f9cb00aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 0x7f9cb00aefb0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c5e0 tx=0x7f9ca0007f60 comp rx=0 tx=0).stop 2023-10-14T19:10:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 shutdown_connections 2023-10-14T19:10:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c90067320 0x7f9c900697d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb00cd780 0x7f9cb00aefb0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb00684e0 0x7f9cb00c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 --2- 172.21.15.7:0/3612385211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00cc910 0x7f9cb01569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 >> 172.21.15.7:0/3612385211 conn(0x7f9cb006d7b0 msgr2=0x7f9cb015b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 shutdown_connections 2023-10-14T19:10:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.219+0000 7f9cb4a84700 1 -- 172.21.15.7:0/3612385211 wait complete. 2023-10-14T19:10:37.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-14T19:10:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.350+0000 7f334cc69700 1 Processor -- start 2023-10-14T19:10:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.350+0000 7f334cc69700 1 -- start start 2023-10-14T19:10:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.351+0000 7f334cc69700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3348159c80 0x7f33480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.351+0000 7f334cc69700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480ce9d0 con 0x7f33481598b0 2023-10-14T19:10:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.351+0000 7f334cc69700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480af960 con 0x7f33480cfe70 2023-10-14T19:10:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.351+0000 7f334cc69700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33480afc30 con 0x7f3348159c80 2023-10-14T19:10:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334659c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f33481598b0 0x7f33480af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35680/0 (socket says 172.21.15.7:35680) 2023-10-14T19:10:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334659c700 1 -- 172.21.15.7:0/3912522978 learned_addr learned my addr 172.21.15.7:0/3912522978 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538198060 0 0) 0x7f33480ce9d0 con 0x7f33481598b0 2023-10-14T19:10:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3334003570 con 0x7f33481598b0 2023-10-14T19:10:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f3345d9b700 1 --2- 172.21.15.7:0/3912522978 >> v2:172.21.15.148:3300/0 conn(0x7f3348159c80 0x7f33480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044651433 0 0) 0x7f3334003570 con 0x7f33481598b0 2023-10-14T19:10:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 >> v2:172.21.15.148:3300/0 conn(0x7f3348159c80 msgr2=0x7f33480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 --2- 172.21.15.7:0/3912522978 >> v2:172.21.15.148:3300/0 conn(0x7f3348159c80 0x7f33480cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 >> v1:172.21.15.148:6789/0 conn(0x7f33480cfe70 legacy=0x7f3348163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480aff10 con 0x7f33481598b0 2023-10-14T19:10:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f33400017f0 con 0x7f33481598b0 2023-10-14T19:10:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 >> v1:172.21.15.7:6789/0 conn(0x7f33481598b0 legacy=0x7f33480af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334003a60 0x7f3334003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3334004810 0x7f3334004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33340052e0 0x7f333400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480afc30 con 0x7f3334004810 2023-10-14T19:10:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333400c190 con 0x7f33340052e0 2023-10-14T19:10:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333400c350 con 0x7f3334003a60 2023-10-14T19:10:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f3345d9b700 1 --2- 172.21.15.7:0/3912522978 >> v2:172.21.15.148:3300/0 conn(0x7f3348159c80 0x7f33480cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f3345d9b700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3334004810 0x7f3334004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f334659c700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334003a60 0x7f3334003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.352+0000 7f3346d9d700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33340052e0 0x7f333400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3345d9b700 1 -- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334003a60 msgr2=0x7f3334003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3345d9b700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334003a60 0x7f3334003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3345d9b700 1 -- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33340052e0 msgr2=0x7f333400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3345d9b700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33340052e0 0x7f333400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3345d9b700 1 -- 172.21.15.7:0/3912522978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334003570 con 0x7f3334004810 2023-10-14T19:10:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3346d9d700 1 -- 172.21.15.7:0/3912522978 reap_dead start 2023-10-14T19:10:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f3345d9b700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3334004810 0x7f3334004c80 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ba0 tx=0x7f3330008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e572780fe69211f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000c070 con 0x7f3334004810 2023-10-14T19:10:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333000e5e0 con 0x7f3334004810 2023-10-14T19:10:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334559a700 1 -- 172.21.15.7:0/3912522978 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000e770 con 0x7f3334004810 2023-10-14T19:10:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334cc69700 1 -- 172.21.15.7:0/3912522978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3334004810 msgr2=0x7f3334004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334cc69700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3334004810 0x7f3334004c80 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ba0 tx=0x7f3330008040 comp rx=0 tx=0).stop 2023-10-14T19:10:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334cc69700 1 -- 172.21.15.7:0/3912522978 shutdown_connections 2023-10-14T19:10:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334cc69700 1 --2- 172.21.15.7:0/3912522978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3334004810 0x7f3334004c80 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.353+0000 7f334cc69700 1 -- 172.21.15.7:0/3912522978 >> 172.21.15.7:0/3912522978 conn(0x7f3348070e30 msgr2=0x7f33480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.354+0000 7f334cc69700 1 -- 172.21.15.7:0/3912522978 shutdown_connections 2023-10-14T19:10:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.354+0000 7f334cc69700 1 -- 172.21.15.7:0/3912522978 wait complete. 2023-10-14T19:10:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 Processor -- start 2023-10-14T19:10:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 -- start start 2023-10-14T19:10:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334004810 0x7f3348141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33480b5770 0x7f33480b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 0x7f33480c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c6620 con 0x7f33480c5c70 2023-10-14T19:10:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480b4370 con 0x7f33480b5770 2023-10-14T19:10:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f334cc69700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c7bd0 con 0x7f3334004810 2023-10-14T19:10:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f3346d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 0x7f33480c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f3346d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 0x7f33480c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45676/0 (socket says 172.21.15.7:45676) 2023-10-14T19:10:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.355+0000 7f3346d9d700 1 -- 172.21.15.7:0/2882606650 learned_addr learned my addr 172.21.15.7:0/2882606650 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f334659c700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334004810 0x7f3348141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3345d9b700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33480b5770 0x7f33480b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3346d9d700 1 -- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334004810 msgr2=0x7f3348141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3346d9d700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334004810 0x7f3348141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3346d9d700 1 -- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33480b5770 msgr2=0x7f33480b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3346d9d700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33480b5770 0x7f33480b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3346d9d700 1 -- 172.21.15.7:0/2882606650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480b3db0 con 0x7f33480c5c70 2023-10-14T19:10:37.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f3346d9d700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 0x7f33480c60e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f33480b3250 tx=0x7f3338007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:37.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338006a30 con 0x7f33480c5c70 2023-10-14T19:10:37.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338006bb0 con 0x7f33480c5c70 2023-10-14T19:10:37.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33480b4090 con 0x7f33480c5c70 2023-10-14T19:10:37.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338007030 con 0x7f33480c5c70 2023-10-14T19:10:37.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.356+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3348141580 con 0x7f33480c5c70 2023-10-14T19:10:37.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.357+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33480c7a20 con 0x7f33480c5c70 2023-10-14T19:10:37.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.357+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3338007420 con 0x7f33480c5c70 2023-10-14T19:10:37.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.358+0000 7f333e7fc700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3328067320 0x7f33280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:37.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.358+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3338083f20 con 0x7f33480c5c70 2023-10-14T19:10:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.358+0000 7f334659c700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3328067320 0x7f33280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.359+0000 7f334659c700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3328067320 0x7f33280697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f334806fd70 tx=0x7f3340006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.362+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3338050fc0 con 0x7f33480c5c70 2023-10-14T19:10:37.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.634+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f334804c3c0 con 0x7f33480c5c70 2023-10-14T19:10:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.862+0000 7f333e7fc700 1 -- 172.21.15.7:0/2882606650 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v372) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3338019020 con 0x7f33480c5c70 2023-10-14T19:10:37.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3328067320 msgr2=0x7f33280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3328067320 0x7f33280697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f334806fd70 tx=0x7f3340006040 comp rx=0 tx=0).stop 2023-10-14T19:10:37.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 msgr2=0x7f33480c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 0x7f33480c60e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f33480b3250 tx=0x7f3338007d30 comp rx=0 tx=0).stop 2023-10-14T19:10:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 shutdown_connections 2023-10-14T19:10:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3328067320 0x7f33280697d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480c5c70 0x7f33480c60e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3334004810 0x7f3348141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 --2- 172.21.15.7:0/2882606650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33480b5770 0x7f33480b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 >> 172.21.15.7:0/2882606650 conn(0x7f3348070e30 msgr2=0x7f33480b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 shutdown_connections 2023-10-14T19:10:37.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.864+0000 7f334cc69700 1 -- 172.21.15.7:0/2882606650 wait complete. 2023-10-14T19:10:37.877 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. ... ok 2023-10-14T19:10:37.878 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) That renaming volume fails without --yes-i-really-mean-it flag. 2023-10-14T19:10:37.878 INFO:tasks.cephfs_test_runner:test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:10:37.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-14T19:10:38.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:37.999+0000 7f09ebec7700 1 Processor -- start 2023-10-14T19:10:38.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.000+0000 7f09ebec7700 1 -- start start 2023-10-14T19:10:38.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.000+0000 7f09ebec7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09e415a5d0 0x7f09e4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.000+0000 7f09ebec7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e415ae40 con 0x7f09e40cb5a0 2023-10-14T19:10:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.000+0000 7f09ebec7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e415ab60 con 0x7f09e40cb970 2023-10-14T19:10:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.000+0000 7f09ebec7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40ce0f0 con 0x7f09e415a5d0 2023-10-14T19:10:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e9c63700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f09e40cb5a0 0x7f09e40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35688/0 (socket says 172.21.15.7:35688) 2023-10-14T19:10:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e9c63700 1 -- 172.21.15.7:0/1530579640 learned_addr learned my addr 172.21.15.7:0/1530579640 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09ea464700 1 --2- 172.21.15.7:0/1530579640 >> v2:172.21.15.148:3300/0 conn(0x7f09e415a5d0 0x7f09e4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718465863 0 0) 0x7f09e415ae40 con 0x7f09e40cb5a0 2023-10-14T19:10:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09cc003570 con 0x7f09e40cb5a0 2023-10-14T19:10:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1673274107 0 0) 0x7f09cc003570 con 0x7f09e40cb5a0 2023-10-14T19:10:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 >> v2:172.21.15.148:3300/0 conn(0x7f09e415a5d0 msgr2=0x7f09e4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 --2- 172.21.15.7:0/1530579640 >> v2:172.21.15.148:3300/0 conn(0x7f09e415a5d0 0x7f09e4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 >> v1:172.21.15.148:6789/0 conn(0x7f09e40cb970 legacy=0x7f09e4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40ccf00 con 0x7f09e40cb5a0 2023-10-14T19:10:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f09dc001470 con 0x7f09e40cb5a0 2023-10-14T19:10:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 >> v1:172.21.15.7:6789/0 conn(0x7f09e40cb5a0 legacy=0x7f09e40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09cc003a60 0x7f09cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09cc004810 0x7f09cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc0051c0 0x7f09cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40ce0f0 con 0x7f09cc003a60 2023-10-14T19:10:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc00c0d0 con 0x7f09cc004810 2023-10-14T19:10:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc00c290 con 0x7f09cc0051c0 2023-10-14T19:10:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.001+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09cc003a60 0x7f09cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9462700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09cc004810 0x7f09cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9c63700 1 -- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc0051c0 msgr2=0x7f09cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09ea464700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc0051c0 0x7f09cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc0051c0 0x7f09cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9c63700 1 -- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09cc004810 msgr2=0x7f09cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09cc004810 0x7f09cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9c63700 1 -- 172.21.15.7:0/1530579640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc003570 con 0x7f09cc003a60 2023-10-14T19:10:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9462700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09cc004810 0x7f09cc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09ea464700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc0051c0 0x7f09cc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09ea464700 1 -- 172.21.15.7:0/1530579640 reap_dead start 2023-10-14T19:10:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09cc003a60 0x7f09cc003e70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c3c0 tx=0x7f09dc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a106e44112cdf027 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00cc90 con 0x7f09cc003a60 2023-10-14T19:10:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00cdf0 con 0x7f09cc003a60 2023-10-14T19:10:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.002+0000 7f09e8c61700 1 -- 172.21.15.7:0/1530579640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc005b50 con 0x7f09cc003a60 2023-10-14T19:10:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 -- 172.21.15.7:0/1530579640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09cc003a60 msgr2=0x7f09cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09cc003a60 0x7f09cc003e70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c3c0 tx=0x7f09dc001e50 comp rx=0 tx=0).stop 2023-10-14T19:10:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 -- 172.21.15.7:0/1530579640 shutdown_connections 2023-10-14T19:10:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1530579640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09cc003a60 0x7f09cc003e70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 -- 172.21.15.7:0/1530579640 >> 172.21.15.7:0/1530579640 conn(0x7f09e4070e30 msgr2=0x7f09e40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 -- 172.21.15.7:0/1530579640 shutdown_connections 2023-10-14T19:10:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.003+0000 7f09ebec7700 1 -- 172.21.15.7:0/1530579640 wait complete. 2023-10-14T19:10:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 Processor -- start 2023-10-14T19:10:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 -- start start 2023-10-14T19:10:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc003a60 0x7f09e40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 0x7f09e41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e40ca560 0x7f09e415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c9240 con 0x7f09e40b5bb0 2023-10-14T19:10:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c94c0 con 0x7f09e40ca560 2023-10-14T19:10:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.004+0000 7f09ebec7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c97a0 con 0x7f09cc003a60 2023-10-14T19:10:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 0x7f09e41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 0x7f09e41511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45696/0 (socket says 172.21.15.7:45696) 2023-10-14T19:10:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 -- 172.21.15.7:0/1812069877 learned_addr learned my addr 172.21.15.7:0/1812069877 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc003a60 0x7f09e40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09ea464700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e40ca560 0x7f09e415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 -- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc003a60 msgr2=0x7f09e40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc003a60 0x7f09e40c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 -- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e40ca560 msgr2=0x7f09e415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e40ca560 0x7f09e415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 -- 172.21.15.7:0/1812069877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40c9a80 con 0x7f09e40b5bb0 2023-10-14T19:10:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09ea464700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e40ca560 0x7f09e415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e9462700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 0x7f09e41511b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f09d8000c00 tx=0x7f09d8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8017070 con 0x7f09e40b5bb0 2023-10-14T19:10:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8006820 con 0x7f09e40b5bb0 2023-10-14T19:10:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e40c9d60 con 0x7f09e40b5bb0 2023-10-14T19:10:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.005+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8006bc0 con 0x7f09e40b5bb0 2023-10-14T19:10:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.006+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e41516f0 con 0x7f09e40b5bb0 2023-10-14T19:10:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.006+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40ca200 con 0x7f09e40b5bb0 2023-10-14T19:10:38.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.007+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f09d8007020 con 0x7f09e40b5bb0 2023-10-14T19:10:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.007+0000 7f09e1ffb700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09d0067320 0x7f09d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.007+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f09d80844e0 con 0x7f09e40b5bb0 2023-10-14T19:10:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.007+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09d0067320 0x7f09d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.008+0000 7f09e9c63700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09d0067320 0x7f09d00697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f09dc001ed0 tx=0x7f09dc015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.011+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09d8051470 con 0x7f09e40b5bb0 2023-10-14T19:10:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.284+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f09e40ca3b0 con 0x7f09e40b5bb0 2023-10-14T19:10:38.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.864+0000 7f09e1ffb700 1 -- 172.21.15.7:0/1812069877 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v373) v1 ==== 170+0+0 (secure 0 0 0) 0x7f09d8054a90 con 0x7f09e40b5bb0 2023-10-14T19:10:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09d0067320 msgr2=0x7f09d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09d0067320 0x7f09d00697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f09dc001ed0 tx=0x7f09dc015000 comp rx=0 tx=0).stop 2023-10-14T19:10:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 msgr2=0x7f09e41511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 0x7f09e41511b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f09d8000c00 tx=0x7f09d8009040 comp rx=0 tx=0).stop 2023-10-14T19:10:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 shutdown_connections 2023-10-14T19:10:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09d0067320 0x7f09d00697d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e40ca560 0x7f09e415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09cc003a60 0x7f09e40c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 --2- 172.21.15.7:0/1812069877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e40b5bb0 0x7f09e41511b0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.866+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 >> 172.21.15.7:0/1812069877 conn(0x7f09e4070e30 msgr2=0x7f09e40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.867+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 shutdown_connections 2023-10-14T19:10:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:38.867+0000 7f09ebec7700 1 -- 172.21.15.7:0/1812069877 wait complete. 2023-10-14T19:10:38.881 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:10:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.009+0000 7f609884e700 1 Processor -- start 2023-10-14T19:10:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.009+0000 7f609884e700 1 -- start start 2023-10-14T19:10:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609884e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6094153a00 0x7f6094153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609884e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60940cea00 0x7f60940cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609884e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609415ac50 con 0x7f609415de50 2023-10-14T19:10:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609884e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609415d010 con 0x7f6094153a00 2023-10-14T19:10:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609884e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60940cf3c0 con 0x7f60940cea00 2023-10-14T19:10:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f6092d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6094153a00 0x7f6094153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609259c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f609415de50 0x7f609415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35698/0 (socket says 172.21.15.7:35698) 2023-10-14T19:10:39.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609259c700 1 -- 172.21.15.7:0/2402107085 learned_addr learned my addr 172.21.15.7:0/2402107085 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:39.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f609359e700 1 --2- 172.21.15.7:0/2402107085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60940cea00 0x7f60940cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f6092d9d700 1 -- 172.21.15.7:0/2402107085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60940cea00 msgr2=0x7f60940cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:39.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f6092d9d700 1 --2- 172.21.15.7:0/2402107085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60940cea00 0x7f60940cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f6092d9d700 1 -- 172.21.15.7:0/2402107085 >> v1:172.21.15.7:6789/0 conn(0x7f609415de50 legacy=0x7f609415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f6092d9d700 1 -- 172.21.15.7:0/2402107085 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609415af60 con 0x7f6094153a00 2023-10-14T19:10:39.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.010+0000 7f6091d9b700 1 -- 172.21.15.7:0/2402107085 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133285426 0 0) 0x7f609415ac50 con 0x7f609415de50 2023-10-14T19:10:39.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f6092d9d700 1 --2- 172.21.15.7:0/2402107085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6094153a00 0x7f6094153dd0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f608c0098e0 tx=0x7f608c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77296d44a4e5a76c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f6091d9b700 1 -- 172.21.15.7:0/2402107085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c009e80 con 0x7f6094153a00 2023-10-14T19:10:39.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f6091d9b700 1 -- 172.21.15.7:0/2402107085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00b860 con 0x7f6094153a00 2023-10-14T19:10:39.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f6091d9b700 1 -- 172.21.15.7:0/2402107085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00bbe0 con 0x7f6094153a00 2023-10-14T19:10:39.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 -- 172.21.15.7:0/2402107085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6094153a00 msgr2=0x7f6094153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 --2- 172.21.15.7:0/2402107085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6094153a00 0x7f6094153dd0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f608c0098e0 tx=0x7f608c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 -- 172.21.15.7:0/2402107085 shutdown_connections 2023-10-14T19:10:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 --2- 172.21.15.7:0/2402107085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6094153a00 0x7f6094153dd0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 --2- 172.21.15.7:0/2402107085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60940cea00 0x7f60940cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 -- 172.21.15.7:0/2402107085 >> 172.21.15.7:0/2402107085 conn(0x7f60940703a0 msgr2=0x7f60940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 -- 172.21.15.7:0/2402107085 shutdown_connections 2023-10-14T19:10:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.011+0000 7f609884e700 1 -- 172.21.15.7:0/2402107085 wait complete. 2023-10-14T19:10:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 Processor -- start 2023-10-14T19:10:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 -- start start 2023-10-14T19:10:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 0x7f60940b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6094153a00 0x7f60940b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609415de50 0x7f60940c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940b0c50 con 0x7f60940cea00 2023-10-14T19:10:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940b1a70 con 0x7f609415de50 2023-10-14T19:10:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f609884e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60940b0e60 con 0x7f6094153a00 2023-10-14T19:10:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f6092d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 0x7f60940b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f6092d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 0x7f60940b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45718/0 (socket says 172.21.15.7:45718) 2023-10-14T19:10:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.013+0000 7f6092d9d700 1 -- 172.21.15.7:0/2855986953 learned_addr learned my addr 172.21.15.7:0/2855986953 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f609259c700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6094153a00 0x7f60940b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f609359e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609415de50 0x7f60940c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f6092d9d700 1 -- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6094153a00 msgr2=0x7f60940b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f6092d9d700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6094153a00 0x7f60940b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f6092d9d700 1 -- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609415de50 msgr2=0x7f60940c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f6092d9d700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609415de50 0x7f60940c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f6092d9d700 1 -- 172.21.15.7:0/2855986953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009420 con 0x7f60940cea00 2023-10-14T19:10:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f6092d9d700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 0x7f60940b1f00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f609406eb00 tx=0x7f608c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00b9d0 con 0x7f60940cea00 2023-10-14T19:10:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00bb30 con 0x7f60940cea00 2023-10-14T19:10:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c011650 con 0x7f60940cea00 2023-10-14T19:10:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60940b1140 con 0x7f60940cea00 2023-10-14T19:10:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.014+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60940b1700 con 0x7f60940cea00 2023-10-14T19:10:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.015+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609404c3c0 con 0x7f60940cea00 2023-10-14T19:10:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.016+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f608c011a00 con 0x7f60940cea00 2023-10-14T19:10:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.016+0000 7f608affd700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6074067320 0x7f60740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.016+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f608c085e30 con 0x7f60940cea00 2023-10-14T19:10:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.016+0000 7f609259c700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6074067320 0x7f60740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.017+0000 7f609259c700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6074067320 0x7f60740697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f60940b2770 tx=0x7f607c007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.020+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f608c052e40 con 0x7f60940cea00 2023-10-14T19:10:39.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.214+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f60940cc070 con 0x7f60940cea00 2023-10-14T19:10:39.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.217+0000 7f608affd700 1 -- 172.21.15.7:0/2855986953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f608c0280c0 con 0x7f60940cea00 2023-10-14T19:10:39.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6074067320 msgr2=0x7f60740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6074067320 0x7f60740697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f60940b2770 tx=0x7f607c007f50 comp rx=0 tx=0).stop 2023-10-14T19:10:39.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 msgr2=0x7f60940b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 0x7f60940b1f00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f609406eb00 tx=0x7f608c017000 comp rx=0 tx=0).stop 2023-10-14T19:10:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 shutdown_connections 2023-10-14T19:10:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6074067320 0x7f60740697d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609415de50 0x7f60940c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60940cea00 0x7f60940b1f00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 --2- 172.21.15.7:0/2855986953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6094153a00 0x7f60940b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 >> 172.21.15.7:0/2855986953 conn(0x7f60940703a0 msgr2=0x7f609415bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 shutdown_connections 2023-10-14T19:10:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.219+0000 7f609884e700 1 -- 172.21.15.7:0/2855986953 wait complete. 2023-10-14T19:10:39.232 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:10:39.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:39.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:39.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:10:39.327 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:10:39.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.445+0000 7f95318f0700 1 Processor -- start 2023-10-14T19:10:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.445+0000 7f95318f0700 1 -- start start 2023-10-14T19:10:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.446+0000 7f95318f0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f952c06d280 0x7f952c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.446+0000 7f95318f0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0ce1a0 con 0x7f952c0aee90 2023-10-14T19:10:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.446+0000 7f95318f0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0cd5d0 con 0x7f952c0a8be0 2023-10-14T19:10:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.446+0000 7f95318f0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c0cd870 con 0x7f952c06d280 2023-10-14T19:10:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.446+0000 7f952a7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f952c0aee90 0x7f952c0b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35708/0 (socket says 172.21.15.7:35708) 2023-10-14T19:10:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.446+0000 7f952a7fc700 1 -- 172.21.15.7:0/1845390574 learned_addr learned my addr 172.21.15.7:0/1845390574 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761241561 0 0) 0x7f952c0ce1a0 con 0x7f952c0aee90 2023-10-14T19:10:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9518003570 con 0x7f952c0aee90 2023-10-14T19:10:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952b7fe700 1 --2- 172.21.15.7:0/1845390574 >> v2:172.21.15.148:3300/0 conn(0x7f952c06d280 0x7f952c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 540985013 0 0) 0x7f9518003570 con 0x7f952c0aee90 2023-10-14T19:10:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 >> v2:172.21.15.148:3300/0 conn(0x7f952c06d280 msgr2=0x7f952c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 --2- 172.21.15.7:0/1845390574 >> v2:172.21.15.148:3300/0 conn(0x7f952c06d280 0x7f952c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 >> v1:172.21.15.148:6789/0 conn(0x7f952c0a8be0 legacy=0x7f952c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0cdb50 con 0x7f952c0aee90 2023-10-14T19:10:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f95140015f0 con 0x7f952c0aee90 2023-10-14T19:10:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 >> v1:172.21.15.7:6789/0 conn(0x7f952c0aee90 legacy=0x7f952c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9518003a60 0x7f9518003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9518004810 0x7f9518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95180051c0 0x7f951800fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0cd870 con 0x7f9518004810 2023-10-14T19:10:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180104e0 con 0x7f95180051c0 2023-10-14T19:10:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180106a0 con 0x7f9518003a60 2023-10-14T19:10:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9518004810 0x7f9518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952b7fe700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95180051c0 0x7f951800fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952affd700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9518003a60 0x7f9518003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 -- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9518003a60 msgr2=0x7f9518003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9518003a60 0x7f9518003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 -- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95180051c0 msgr2=0x7f951800fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95180051c0 0x7f951800fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952b7fe700 1 -- 172.21.15.7:0/1845390574 reap_dead start 2023-10-14T19:10:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 -- 172.21.15.7:0/1845390574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518003570 con 0x7f9518004810 2023-10-14T19:10:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.447+0000 7f952a7fc700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9518004810 0x7f9518004c80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f951400c390 tx=0x7f9514007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb79925dc70deb33 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400cbe0 con 0x7f9518004810 2023-10-14T19:10:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400cd60 con 0x7f9518004810 2023-10-14T19:10:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f9529ffb700 1 -- 172.21.15.7:0/1845390574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514007320 con 0x7f9518004810 2023-10-14T19:10:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 -- 172.21.15.7:0/1845390574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9518004810 msgr2=0x7f9518004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9518004810 0x7f9518004c80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f951400c390 tx=0x7f9514007920 comp rx=0 tx=0).stop 2023-10-14T19:10:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 -- 172.21.15.7:0/1845390574 shutdown_connections 2023-10-14T19:10:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 --2- 172.21.15.7:0/1845390574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9518004810 0x7f9518004c80 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 -- 172.21.15.7:0/1845390574 >> 172.21.15.7:0/1845390574 conn(0x7f952c06ce80 msgr2=0x7f952c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 -- 172.21.15.7:0/1845390574 shutdown_connections 2023-10-14T19:10:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.448+0000 7f95318f0700 1 -- 172.21.15.7:0/1845390574 wait complete. 2023-10-14T19:10:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.449+0000 7f95318f0700 1 Processor -- start 2023-10-14T19:10:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.449+0000 7f95318f0700 1 -- start start 2023-10-14T19:10:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f95318f0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518004810 0x7f952c146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f95318f0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 0x7f952c09b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f95318f0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f952c0ac4b0 0x7f952c0ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f95318f0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ace60 con 0x7f952c0a9b70 2023-10-14T19:10:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f95318f0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c146e80 con 0x7f9518004810 2023-10-14T19:10:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f95318f0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0aa0e0 con 0x7f952c0ac4b0 2023-10-14T19:10:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f952a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 0x7f952c09b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f952a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 0x7f952c09b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45728/0 (socket says 172.21.15.7:45728) 2023-10-14T19:10:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f952a7fc700 1 -- 172.21.15.7:0/4147411051 learned_addr learned my addr 172.21.15.7:0/4147411051 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f952affd700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518004810 0x7f952c146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.450+0000 7f952b7fe700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f952c0ac4b0 0x7f952c0ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952a7fc700 1 -- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f952c0ac4b0 msgr2=0x7f952c0ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952a7fc700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f952c0ac4b0 0x7f952c0ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952a7fc700 1 -- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518004810 msgr2=0x7f952c146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952a7fc700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518004810 0x7f952c146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952a7fc700 1 -- 172.21.15.7:0/4147411051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0aa3c0 con 0x7f952c0a9b70 2023-10-14T19:10:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952b7fe700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f952c0ac4b0 0x7f952c0ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f952a7fc700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 0x7f952c09b590 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f951400c980 tx=0x7f9514015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514002d00 con 0x7f952c0a9b70 2023-10-14T19:10:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400cbe0 con 0x7f952c0a9b70 2023-10-14T19:10:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514001dc0 con 0x7f952c0a9b70 2023-10-14T19:10:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0aa6a0 con 0x7f952c0a9b70 2023-10-14T19:10:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.451+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c0aac60 con 0x7f952c0a9b70 2023-10-14T19:10:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.452+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c04c3c0 con 0x7f952c0a9b70 2023-10-14T19:10:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.452+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9514005a00 con 0x7f952c0a9b70 2023-10-14T19:10:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.453+0000 7f9522ffd700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f950c067320 0x7f950c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.453+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9514085680 con 0x7f952c0a9b70 2023-10-14T19:10:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.453+0000 7f952affd700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f950c067320 0x7f950c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.453+0000 7f952affd700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f950c067320 0x7f950c0697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9524007fd0 tx=0x7f9524009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.457+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95140525d0 con 0x7f952c0a9b70 2023-10-14T19:10:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.693+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f952c067b20 con 0x7f952c0a9b70 2023-10-14T19:10:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.694+0000 7f9522ffd700 1 -- 172.21.15.7:0/4147411051 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f9514017de0 con 0x7f952c0a9b70 2023-10-14T19:10:39.695 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:39.695 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6850,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3561235391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3561235391},{"type":"v1","addr":"172.21.15.148:6836","nonce":3561235391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":6853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1612433008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1612433008},{"type":"v1","addr":"172.21.15.148:6837","nonce":1612433008}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7503,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3588106990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3588106990},{"type":"v1","addr":"172.21.15.7:6834","nonce":3588106990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/312059110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":312059110},{"type":"v1","addr":"172.21.15.7:6835","nonce":312059110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95}],"filesystems":[]} 2023-10-14T19:10:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.695+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f950c067320 msgr2=0x7f950c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.695+0000 7f95318f0700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f950c067320 0x7f950c0697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9524007fd0 tx=0x7f9524009040 comp rx=0 tx=0).stop 2023-10-14T19:10:39.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.695+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 msgr2=0x7f952c09b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.695+0000 7f95318f0700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 0x7f952c09b590 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f951400c980 tx=0x7f9514015000 comp rx=0 tx=0).stop 2023-10-14T19:10:39.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 shutdown_connections 2023-10-14T19:10:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f950c067320 0x7f950c0697d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518004810 0x7f952c146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f952c0ac4b0 0x7f952c0ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 --2- 172.21.15.7:0/4147411051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f952c0a9b70 0x7f952c09b590 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 >> 172.21.15.7:0/4147411051 conn(0x7f952c06ce80 msgr2=0x7f952c0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 shutdown_connections 2023-10-14T19:10:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.696+0000 7f95318f0700 1 -- 172.21.15.7:0/4147411051 wait complete. 2023-10-14T19:10:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 95 2023-10-14T19:10:39.709 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:10:39.709 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:10:39.710 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:10:39.710 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:39.710 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:10:39.711 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:10:39.711 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:10:39.711 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:39.712 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:10:39.712 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:10:39.712 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:10:39.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:39.713 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:10:39.713 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:10:39.714 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:10:39.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:10:39.718 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:10:39.719 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:10:39.720 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:10:39.721 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:10:39.724 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:10:39.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:10:39.727 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:10:39.728 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:10:39.762 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:10:39.763 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:39.764 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:10:39.764 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:39.769 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:10:39.770 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:39.771 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:10:39.771 DEBUG:teuthology.parallel:result is None 2023-10-14T19:10:39.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:10:39.839 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:10:39.840 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:10:39.853 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:10:39.854 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:10:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.897+0000 7fb70538c700 1 Processor -- start 2023-10-14T19:10:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 -- start start 2023-10-14T19:10:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7001595d0 0x7fb7001599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7000675a0 0x7fb70006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb70006b230 0x7fb7000c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70006bd00 con 0x7fb7001595d0 2023-10-14T19:10:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7000c7f50 con 0x7fb70006b230 2023-10-14T19:10:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb70538c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70006b740 con 0x7fb7000675a0 2023-10-14T19:10:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.898+0000 7fb6feffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7001595d0 0x7fb7001599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7001595d0 0x7fb7001599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45756/0 (socket says 172.21.15.7:45756) 2023-10-14T19:10:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 -- 172.21.15.7:0/1842786164 learned_addr learned my addr 172.21.15.7:0/1842786164 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6ff7fe700 1 --2- 172.21.15.7:0/1842786164 >> v2:172.21.15.148:3300/0 conn(0x7fb70006b230 0x7fb7000c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6fe7fc700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7000675a0 0x7fb70006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 -- 172.21.15.7:0/1842786164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7000675a0 msgr2=0x7fb70006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7000675a0 0x7fb70006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 -- 172.21.15.7:0/1842786164 >> v2:172.21.15.148:3300/0 conn(0x7fb70006b230 msgr2=0x7fb7000c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 --2- 172.21.15.7:0/1842786164 >> v2:172.21.15.148:3300/0 conn(0x7fb70006b230 0x7fb7000c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 -- 172.21.15.7:0/1842786164 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70006ba20 con 0x7fb7001595d0 2023-10-14T19:10:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6fe7fc700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7000675a0 0x7fb70006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6feffd700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7001595d0 0x7fb7001599a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb700064a20 tx=0x7fb6f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e1f9a8fe180c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6fdffb700 1 -- 172.21.15.7:0/1842786164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0009e70 con 0x7fb7001595d0 2023-10-14T19:10:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6fdffb700 1 -- 172.21.15.7:0/1842786164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f000b860 con 0x7fb7001595d0 2023-10-14T19:10:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.899+0000 7fb6fdffb700 1 -- 172.21.15.7:0/1842786164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000bc00 con 0x7fb7001595d0 2023-10-14T19:10:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 -- 172.21.15.7:0/1842786164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7001595d0 msgr2=0x7fb7001599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7001595d0 0x7fb7001599a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb700064a20 tx=0x7fb6f0009250 comp rx=0 tx=0).stop 2023-10-14T19:10:39.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 -- 172.21.15.7:0/1842786164 shutdown_connections 2023-10-14T19:10:39.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 --2- 172.21.15.7:0/1842786164 >> v2:172.21.15.148:3300/0 conn(0x7fb70006b230 0x7fb7000c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7001595d0 0x7fb7001599a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 --2- 172.21.15.7:0/1842786164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7000675a0 0x7fb70006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 -- 172.21.15.7:0/1842786164 >> 172.21.15.7:0/1842786164 conn(0x7fb7000cd400 msgr2=0x7fb7000cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 -- 172.21.15.7:0/1842786164 shutdown_connections 2023-10-14T19:10:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.900+0000 7fb70538c700 1 -- 172.21.15.7:0/1842786164 wait complete. 2023-10-14T19:10:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.901+0000 7fb70538c700 1 Processor -- start 2023-10-14T19:10:39.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.901+0000 7fb70538c700 1 -- start start 2023-10-14T19:10:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 0x7fb700147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb70006b230 0x7fb70015b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7001595d0 0x7fb70015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70015bca0 con 0x7fb7000675a0 2023-10-14T19:10:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000c5310 con 0x7fb7001595d0 2023-10-14T19:10:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb700155530 con 0x7fb70006b230 2023-10-14T19:10:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 0x7fb700147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 0x7fb700147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45766/0 (socket says 172.21.15.7:45766) 2023-10-14T19:10:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 -- 172.21.15.7:0/4072771647 learned_addr learned my addr 172.21.15.7:0/4072771647 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6ff7fe700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7001595d0 0x7fb70015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 -- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb70006b230 msgr2=0x7fb70015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb70006b230 0x7fb70015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 -- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7001595d0 msgr2=0x7fb70015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7001595d0 0x7fb70015b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 -- 172.21.15.7:0/4072771647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00094f0 con 0x7fb7000675a0 2023-10-14T19:10:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6feffd700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 0x7fb700147da0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009290 tx=0x7fb6f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000bbe0 con 0x7fb7000675a0 2023-10-14T19:10:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f001f070 con 0x7fb7000675a0 2023-10-14T19:10:39.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.902+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7000c4550 con 0x7fb7000675a0 2023-10-14T19:10:39.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.903+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0026690 con 0x7fb7000675a0 2023-10-14T19:10:39.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.903+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7000c4b10 con 0x7fb7000675a0 2023-10-14T19:10:39.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.904+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70004c3c0 con 0x7fb7000675a0 2023-10-14T19:10:39.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.904+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb6f001a430 con 0x7fb7000675a0 2023-10-14T19:10:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.904+0000 7fb6e6ffd700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ec067320 0x7fb6ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.904+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb6f0021070 con 0x7fb7000675a0 2023-10-14T19:10:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.905+0000 7fb6fe7fc700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ec067320 0x7fb6ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.905+0000 7fb6fe7fc700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ec067320 0x7fb6ec0697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4006fd0 tx=0x7fb6f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:39.909+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6f0053770 con 0x7fb7000675a0 2023-10-14T19:10:40.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.118+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb700068bc0 con 0x7fb7000675a0 2023-10-14T19:10:40.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.224+0000 7fb6e6ffd700 1 -- 172.21.15.7:0/4072771647 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v149) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb6f0015080 con 0x7fb7000675a0 2023-10-14T19:10:40.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ec067320 msgr2=0x7fb6ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ec067320 0x7fb6ec0697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4006fd0 tx=0x7fb6f4008040 comp rx=0 tx=0).stop 2023-10-14T19:10:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 msgr2=0x7fb700147da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 0x7fb700147da0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009290 tx=0x7fb6f0017000 comp rx=0 tx=0).stop 2023-10-14T19:10:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 shutdown_connections 2023-10-14T19:10:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb6ec067320 0x7fb6ec0697d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7001595d0 0x7fb70015b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7000675a0 0x7fb700147da0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 --2- 172.21.15.7:0/4072771647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb70006b230 0x7fb70015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 >> 172.21.15.7:0/4072771647 conn(0x7fb7000cd400 msgr2=0x7fb7000cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:40.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 shutdown_connections 2023-10-14T19:10:40.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.227+0000 7fb70538c700 1 -- 172.21.15.7:0/4072771647 wait complete. 2023-10-14T19:10:40.231 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:10:40.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:10:40.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.359+0000 7fa8810dd700 1 Processor -- start 2023-10-14T19:10:40.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.359+0000 7fa8810dd700 1 -- start start 2023-10-14T19:10:40.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa8810dd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa87c0cb970 0x7fa87c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa8810dd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c15ae40 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa8810dd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c15ab60 con 0x7fa87c15a400 2023-10-14T19:10:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa8810dd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0ce0f0 con 0x7fa87c0cb970 2023-10-14T19:10:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87ad9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa87c0cb5a0 0x7fa87c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35724/0 (socket says 172.21.15.7:35724) 2023-10-14T19:10:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87ad9d700 1 -- 172.21.15.7:0/2956064270 learned_addr learned my addr 172.21.15.7:0/2956064270 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87a59c700 1 --2- 172.21.15.7:0/2956064270 >> v2:172.21.15.148:3300/0 conn(0x7fa87c0cb970 0x7fa87c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69382855 0 0) 0x7fa87c15ae40 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa868003570 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737317143 0 0) 0x7fa87c15ab60 con 0x7fa87c15a400 2023-10-14T19:10:40.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa87c15ae40 con 0x7fa87c15a400 2023-10-14T19:10:40.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87a59c700 1 -- 172.21.15.7:0/2956064270 >> v1:172.21.15.148:6789/0 conn(0x7fa87c15a400 legacy=0x7fa87c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87a59c700 1 -- 172.21.15.7:0/2956064270 >> v1:172.21.15.7:6789/0 conn(0x7fa87c0cb5a0 legacy=0x7fa87c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87a59c700 1 -- 172.21.15.7:0/2956064270 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0ccf00 con 0x7fa87c0cb970 2023-10-14T19:10:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.360+0000 7fa87a59c700 1 --2- 172.21.15.7:0/2956064270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c159ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa8640098e0 tx=0x7fa8640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d018271883a5a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864011630 con 0x7fa87c0cb970 2023-10-14T19:10:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864011790 con 0x7fa87c0cb970 2023-10-14T19:10:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa879d9b700 1 -- 172.21.15.7:0/2956064270 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864011b30 con 0x7fa87c0cb970 2023-10-14T19:10:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 -- 172.21.15.7:0/2956064270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 msgr2=0x7fa87c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 --2- 172.21.15.7:0/2956064270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c159ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa8640098e0 tx=0x7fa8640091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 -- 172.21.15.7:0/2956064270 shutdown_connections 2023-10-14T19:10:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 --2- 172.21.15.7:0/2956064270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c159ec0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 -- 172.21.15.7:0/2956064270 >> 172.21.15.7:0/2956064270 conn(0x7fa87c070e30 msgr2=0x7fa87c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 -- 172.21.15.7:0/2956064270 shutdown_connections 2023-10-14T19:10:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.361+0000 7fa8810dd700 1 -- 172.21.15.7:0/2956064270 wait complete. 2023-10-14T19:10:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.362+0000 7fa8810dd700 1 Processor -- start 2023-10-14T19:10:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.362+0000 7fa8810dd700 1 -- start start 2023-10-14T19:10:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa8810dd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 0x7fa87c16d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa8810dd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa8810dd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c15a400 0x7fa87c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa8810dd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c16dc40 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa8810dd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c16df20 con 0x7fa87c0cb970 2023-10-14T19:10:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa8810dd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c16e200 con 0x7fa87c15a400 2023-10-14T19:10:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa87ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 0x7fa87c16d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa87ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 0x7fa87c16d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45780/0 (socket says 172.21.15.7:45780) 2023-10-14T19:10:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa87ad9d700 1 -- 172.21.15.7:0/1302497093 learned_addr learned my addr 172.21.15.7:0/1302497093 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa87a59c700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa87b59e700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c15a400 0x7fa87c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.363+0000 7fa87ad9d700 1 -- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c15a400 msgr2=0x7fa87c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87ad9d700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c15a400 0x7fa87c0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87ad9d700 1 -- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 msgr2=0x7fa87c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87ad9d700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87ad9d700 1 -- 172.21.15.7:0/1302497093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864009420 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87a59c700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87b59e700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c15a400 0x7fa87c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa87ad9d700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 0x7fa87c16d3f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa86c002250 tx=0x7fa86c001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00ab30 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00ac90 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c007300 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c15b070 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.364+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c16d930 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.365+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c04c3c0 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.365+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa86c0076f0 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.366+0000 7fa872ffd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa85c067320 0x7fa85c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.366+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa86c084e90 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.366+0000 7fa87a59c700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa85c067320 0x7fa85c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.366+0000 7fa87a59c700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa85c067320 0x7fa85c0697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0cee10 tx=0x7fa864017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.370+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa86c051eb0 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.643+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa87c0cb1c0 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.644+0000 7fa872ffd700 1 -- 172.21.15.7:0/1302497093 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa86c0554d0 con 0x7fa87c0cb5a0 2023-10-14T19:10:40.645 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:40.645 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:10:40.645 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:10:40.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.646 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:10:40.646 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:10:40.646 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.647 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.647 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:40.647 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:40.647 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.648 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:10:40.648 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:10:40.648 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.648 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:40.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:40.649 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.650 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:10:40.650 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:10:40.650 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.650 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.651 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:40.651 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:40.651 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.652 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:10:40.652 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:10:40.652 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.652 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.652 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:40.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:40.653 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.653 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.654 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:10:40.654 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:10:40.654 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.655 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.655 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:10:40.655 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:10:40.656 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.656 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.657 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:10:40.657 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:10:40.657 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.658 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.658 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.659 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:10:40.659 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:10:40.659 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.660 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.660 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:10:40.661 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:10:40.661 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.661 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.661 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.661 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.662 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:10:40.662 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:10:40.662 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.663 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.663 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.664 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:10:40.664 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:10:40.664 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.664 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.665 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.665 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.666 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:10:40.666 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:10:40.666 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.666 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:10:40.666 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:10:40.667 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.667 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.667 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:10:40.667 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:10:40.668 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.668 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.668 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:10:40.668 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:10:40.668 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.669 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:10:40.669 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:10:40.669 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.670 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.670 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:10:40.670 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:10:40.670 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:10:40.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.671 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:10:40.671 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:10:40.671 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.671 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.672 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:10:40.672 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:10:40.672 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:10:40.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.673 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:10:40.673 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:10:40.673 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.673 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:10:40.674 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:10:40.674 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:10:40.674 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:10:40.674 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.675 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:10:40.675 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:10:40.675 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:10:40.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:10:40.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:10:40.676 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.676 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.677 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:10:40.677 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:10:40.677 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:10:40.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:10:40.678 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.678 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:10:40.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:40.678 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:10:40.679 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:10:40.679 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:10:40.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:10:40.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:10:40.679 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:10:40.679 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:40.680 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:10:40.680 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:10:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa85c067320 msgr2=0x7fa85c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa85c067320 0x7fa85c0697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0cee10 tx=0x7fa864017000 comp rx=0 tx=0).stop 2023-10-14T19:10:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 msgr2=0x7fa87c16d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 0x7fa87c16d3f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa86c002250 tx=0x7fa86c001bb0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 shutdown_connections 2023-10-14T19:10:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa85c067320 0x7fa85c0697d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c15a400 0x7fa87c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa87c0cb5a0 0x7fa87c16d3f0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 --2- 172.21.15.7:0/1302497093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cb970 0x7fa87c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 >> 172.21.15.7:0/1302497093 conn(0x7fa87c070e30 msgr2=0x7fa87c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 shutdown_connections 2023-10-14T19:10:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.646+0000 7fa8810dd700 1 -- 172.21.15.7:0/1302497093 wait complete. 2023-10-14T19:10:40.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.803+0000 7f59a2698700 1 Processor -- start 2023-10-14T19:10:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.803+0000 7f59a2698700 1 -- start start 2023-10-14T19:10:40.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f59a2698700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f599c15a5d0 0x7f599c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f59a2698700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c15ae40 con 0x7f599c0cb970 2023-10-14T19:10:40.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f59a2698700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c15ab60 con 0x7f599c0cb5a0 2023-10-14T19:10:40.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f59a2698700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c0ce0f0 con 0x7f599c15a5d0 2023-10-14T19:10:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f59a0c35700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f599c15a5d0 0x7f599c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f599b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f599c0cb970 0x7f599c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35730/0 (socket says 172.21.15.7:35730) 2023-10-14T19:10:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.804+0000 7f599b7fe700 1 -- 172.21.15.7:0/1025922005 learned_addr learned my addr 172.21.15.7:0/1025922005 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f59a0c35700 1 -- 172.21.15.7:0/1025922005 >> v1:172.21.15.148:6789/0 conn(0x7f599c0cb5a0 legacy=0x7f599c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f59a0c35700 1 -- 172.21.15.7:0/1025922005 >> v1:172.21.15.7:6789/0 conn(0x7f599c0cb970 legacy=0x7f599c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f599affd700 1 -- 172.21.15.7:0/1025922005 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360176890 0 0) 0x7f599c15ab60 con 0x7f599c0cb5a0 2023-10-14T19:10:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f59a0c35700 1 -- 172.21.15.7:0/1025922005 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0ccf00 con 0x7f599c15a5d0 2023-10-14T19:10:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f59a0c35700 1 --2- 172.21.15.7:0/1025922005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c15a5d0 0x7f599c156e90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5994009e60 tx=0x7f5994009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68497519bc299916 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f599affd700 1 -- 172.21.15.7:0/1025922005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400e070 con 0x7f599c15a5d0 2023-10-14T19:10:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f599affd700 1 -- 172.21.15.7:0/1025922005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400bb30 con 0x7f599c15a5d0 2023-10-14T19:10:40.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.805+0000 7f599affd700 1 -- 172.21.15.7:0/1025922005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994012430 con 0x7f599c15a5d0 2023-10-14T19:10:40.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 -- 172.21.15.7:0/1025922005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c15a5d0 msgr2=0x7f599c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 --2- 172.21.15.7:0/1025922005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c15a5d0 0x7f599c156e90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5994009e60 tx=0x7f5994009780 comp rx=0 tx=0).stop 2023-10-14T19:10:40.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 -- 172.21.15.7:0/1025922005 shutdown_connections 2023-10-14T19:10:40.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 --2- 172.21.15.7:0/1025922005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c15a5d0 0x7f599c156e90 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 -- 172.21.15.7:0/1025922005 >> 172.21.15.7:0/1025922005 conn(0x7f599c070e30 msgr2=0x7f599c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:40.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 -- 172.21.15.7:0/1025922005 shutdown_connections 2023-10-14T19:10:40.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.806+0000 7f59a2698700 1 -- 172.21.15.7:0/1025922005 wait complete. 2023-10-14T19:10:40.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.807+0000 7f59a2698700 1 Processor -- start 2023-10-14T19:10:40.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.807+0000 7f59a2698700 1 -- start start 2023-10-14T19:10:40.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c0cb5a0 0x7f599c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 0x7f599c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f599c15a5d0 0x7f599c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15cc00 con 0x7f599c0cb970 2023-10-14T19:10:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c151730 con 0x7f599c0cb5a0 2023-10-14T19:10:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15bff0 con 0x7f599c15a5d0 2023-10-14T19:10:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 0x7f599c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 0x7f599c156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45802/0 (socket says 172.21.15.7:45802) 2023-10-14T19:10:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 -- 172.21.15.7:0/3867445515 learned_addr learned my addr 172.21.15.7:0/3867445515 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599bfff700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c0cb5a0 0x7f599c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a0c35700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f599c15a5d0 0x7f599c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 -- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f599c15a5d0 msgr2=0x7f599c1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f599c15a5d0 0x7f599c1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 -- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c0cb5a0 msgr2=0x7f599c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c0cb5a0 0x7f599c0b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 -- 172.21.15.7:0/3867445515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009a20 con 0x7f599c0cb970 2023-10-14T19:10:40.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a0c35700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f599c15a5d0 0x7f599c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:40.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599bfff700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c0cb5a0 0x7f599c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:40.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f599b7fe700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 0x7f599c156c60 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f598400c760 tx=0x7f5984007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:40.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984005b30 con 0x7f599c0cb970 2023-10-14T19:10:40.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984005cb0 con 0x7f599c0cb970 2023-10-14T19:10:40.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984007340 con 0x7f599c0cb970 2023-10-14T19:10:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c15c2d0 con 0x7f599c0cb970 2023-10-14T19:10:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.808+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c15c890 con 0x7f599c0cb970 2023-10-14T19:10:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.809+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c15cd70 con 0x7f599c0cb970 2023-10-14T19:10:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.810+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f598401b400 con 0x7f599c0cb970 2023-10-14T19:10:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.810+0000 7f5993fff700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f597c067320 0x7f597c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.810+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f59840844c0 con 0x7f599c0cb970 2023-10-14T19:10:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.811+0000 7f599bfff700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f597c067320 0x7f597c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.811+0000 7f599bfff700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f597c067320 0x7f597c0697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f599c159c60 tx=0x7f598c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:40.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:40.815+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5984051520 con 0x7f599c0cb970 2023-10-14T19:10:41.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.011+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f599c04c3c0 con 0x7f599c0cb970 2023-10-14T19:10:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.012+0000 7f5993fff700 1 -- 172.21.15.7:0/3867445515 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f598405a030 con 0x7f599c0cb970 2023-10-14T19:10:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:41.013 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":149,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:40.222458+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f597c067320 msgr2=0x7f597c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f597c067320 0x7f597c0697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f599c159c60 tx=0x7f598c009040 comp rx=0 tx=0).stop 2023-10-14T19:10:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 msgr2=0x7f599c156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 0x7f599c156c60 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f598400c760 tx=0x7f5984007ef0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 shutdown_connections 2023-10-14T19:10:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f597c067320 0x7f597c0697d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c0cb5a0 0x7f599c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f599c15a5d0 0x7f599c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 --2- 172.21.15.7:0/3867445515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c0cb970 0x7f599c156c60 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 >> 172.21.15.7:0/3867445515 conn(0x7f599c070e30 msgr2=0x7f599c153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 shutdown_connections 2023-10-14T19:10:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.014+0000 7f59a2698700 1 -- 172.21.15.7:0/3867445515 wait complete. 2023-10-14T19:10:41.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:10:41.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:10:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.149+0000 7f99628a7700 1 Processor -- start 2023-10-14T19:10:41.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.149+0000 7f99628a7700 1 -- start start 2023-10-14T19:10:41.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f99628a7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f995c159860 0x7f995c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f99628a7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c0cf510 con 0x7f995c0ccfa0 2023-10-14T19:10:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f99628a7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c0cc210 con 0x7f995c0cbd90 2023-10-14T19:10:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f99628a7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0d00b0 con 0x7f995c159860 2023-10-14T19:10:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f995bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f995c159860 0x7f995c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f9960e44700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f995c0ccfa0 0x7f995c0cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35736/0 (socket says 172.21.15.7:35736) 2023-10-14T19:10:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.150+0000 7f9960e44700 1 -- 172.21.15.7:0/3308890794 learned_addr learned my addr 172.21.15.7:0/3308890794 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995bfff700 1 -- 172.21.15.7:0/3308890794 >> v1:172.21.15.148:6789/0 conn(0x7f995c0cbd90 legacy=0x7f995c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995bfff700 1 -- 172.21.15.7:0/3308890794 >> v1:172.21.15.7:6789/0 conn(0x7f995c0ccfa0 legacy=0x7f995c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995bfff700 1 -- 172.21.15.7:0/3308890794 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0ce900 con 0x7f995c159860 2023-10-14T19:10:41.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995affd700 1 -- 172.21.15.7:0/3308890794 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238832401 0 0) 0x7f995c0cf510 con 0x7f995c0ccfa0 2023-10-14T19:10:41.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995bfff700 1 --2- 172.21.15.7:0/3308890794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c159860 0x7f995c0ce220 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f994c0098d0 tx=0x7f994c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea7d270dd356802 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995affd700 1 -- 172.21.15.7:0/3308890794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c009e70 con 0x7f995c159860 2023-10-14T19:10:41.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995affd700 1 -- 172.21.15.7:0/3308890794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c005c10 con 0x7f995c159860 2023-10-14T19:10:41.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f995affd700 1 -- 172.21.15.7:0/3308890794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00b610 con 0x7f995c159860 2023-10-14T19:10:41.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f99628a7700 1 -- 172.21.15.7:0/3308890794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c159860 msgr2=0x7f995c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f99628a7700 1 --2- 172.21.15.7:0/3308890794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c159860 0x7f995c0ce220 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f994c0098d0 tx=0x7f994c009120 comp rx=0 tx=0).stop 2023-10-14T19:10:41.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f99628a7700 1 -- 172.21.15.7:0/3308890794 shutdown_connections 2023-10-14T19:10:41.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f99628a7700 1 --2- 172.21.15.7:0/3308890794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c159860 0x7f995c0ce220 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.151+0000 7f99628a7700 1 -- 172.21.15.7:0/3308890794 >> 172.21.15.7:0/3308890794 conn(0x7f995c0999b0 msgr2=0x7f995c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.152+0000 7f99628a7700 1 -- 172.21.15.7:0/3308890794 shutdown_connections 2023-10-14T19:10:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.152+0000 7f99628a7700 1 -- 172.21.15.7:0/3308890794 wait complete. 2023-10-14T19:10:41.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 Processor -- start 2023-10-14T19:10:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 -- start start 2023-10-14T19:10:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 0x7f995c09dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f995c0ccfa0 0x7f995c0c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f995c159860 0x7f995c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c7030 con 0x7f995c0cbd90 2023-10-14T19:10:41.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c16b3c0 con 0x7f995c159860 2023-10-14T19:10:41.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.153+0000 7f99628a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c16b6a0 con 0x7f995c0ccfa0 2023-10-14T19:10:41.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 0x7f995c09dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 0x7f995c09dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45818/0 (socket says 172.21.15.7:45818) 2023-10-14T19:10:41.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 -- 172.21.15.7:0/2193301714 learned_addr learned my addr 172.21.15.7:0/2193301714 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:41.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f9960e44700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f995c159860 0x7f995c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995b7fe700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f995c0ccfa0 0x7f995c0c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 -- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f995c0ccfa0 msgr2=0x7f995c0c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f995c0ccfa0 0x7f995c0c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 -- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f995c159860 msgr2=0x7f995c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f995c159860 0x7f995c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 -- 172.21.15.7:0/2193301714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0093c0 con 0x7f995c0cbd90 2023-10-14T19:10:41.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f9960e44700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f995c159860 0x7f995c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:41.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f995bfff700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 0x7f995c09dd30 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f994c009160 tx=0x7f994c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c011cc0 con 0x7f995c0cbd90 2023-10-14T19:10:41.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c011e40 con 0x7f995c0cbd90 2023-10-14T19:10:41.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c16b980 con 0x7f995c0cbd90 2023-10-14T19:10:41.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c01d680 con 0x7f995c0cbd90 2023-10-14T19:10:41.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.154+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c0c7700 con 0x7f995c0cbd90 2023-10-14T19:10:41.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.155+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c16bea0 con 0x7f995c0cbd90 2023-10-14T19:10:41.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.156+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f994c01da30 con 0x7f995c0cbd90 2023-10-14T19:10:41.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.156+0000 7f9943fff700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9948067350 0x7f9948069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.156+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f994c086490 con 0x7f995c0cbd90 2023-10-14T19:10:41.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.156+0000 7f995b7fe700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9948067350 0x7f9948069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.157+0000 7f995b7fe700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9948067350 0x7f9948069800 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f99500038a0 tx=0x7f9950009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.160+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f995c16bea0 con 0x7f995c0cbd90 2023-10-14T19:10:41.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.353+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f995c09e270 con 0x7f995c0cbd90 2023-10-14T19:10:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.354+0000 7f9943fff700 1 -- 172.21.15.7:0/2193301714 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7f994c053470 con 0x7f995c0cbd90 2023-10-14T19:10:41.355 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:10:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9948067350 msgr2=0x7f9948069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9948067350 0x7f9948069800 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f99500038a0 tx=0x7f9950009040 comp rx=0 tx=0).stop 2023-10-14T19:10:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 msgr2=0x7f995c09dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 0x7f995c09dd30 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f994c009160 tx=0x7f994c015000 comp rx=0 tx=0).stop 2023-10-14T19:10:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 shutdown_connections 2023-10-14T19:10:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9948067350 0x7f9948069800 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f995c159860 0x7f995c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f995c0cbd90 0x7f995c09dd30 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 --2- 172.21.15.7:0/2193301714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f995c0ccfa0 0x7f995c0c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.355+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 >> 172.21.15.7:0/2193301714 conn(0x7f995c0999b0 msgr2=0x7f995c0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.356+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 shutdown_connections 2023-10-14T19:10:41.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.356+0000 7f99628a7700 1 -- 172.21.15.7:0/2193301714 wait complete. 2023-10-14T19:10:41.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:10:41.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.487+0000 7f5e424da700 1 Processor -- start 2023-10-14T19:10:41.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.487+0000 7f5e424da700 1 -- start start 2023-10-14T19:10:41.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.488+0000 7f5e424da700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e3c159c80 0x7f5e3c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.488+0000 7f5e424da700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0ce9d0 con 0x7f5e3c0cfe70 2023-10-14T19:10:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.488+0000 7f5e424da700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0af960 con 0x7f5e3c1598b0 2023-10-14T19:10:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.488+0000 7f5e424da700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c0afc30 con 0x7f5e3c159c80 2023-10-14T19:10:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.488+0000 7f5e40a77700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5e3c0cfe70 0x7f5e3c163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35738/0 (socket says 172.21.15.7:35738) 2023-10-14T19:10:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.488+0000 7f5e40a77700 1 -- 172.21.15.7:0/1068107620 learned_addr learned my addr 172.21.15.7:0/1068107620 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3b7fe700 1 --2- 172.21.15.7:0/1068107620 >> v2:172.21.15.148:3300/0 conn(0x7f5e3c159c80 0x7f5e3c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534318966 0 0) 0x7f5e3c0ce9d0 con 0x7f5e3c0cfe70 2023-10-14T19:10:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e24003570 con 0x7f5e3c0cfe70 2023-10-14T19:10:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302962411 0 0) 0x7f5e3c0af960 con 0x7f5e3c1598b0 2023-10-14T19:10:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e3c0ce9d0 con 0x7f5e3c1598b0 2023-10-14T19:10:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640488595 0 0) 0x7f5e24003570 con 0x7f5e3c0cfe70 2023-10-14T19:10:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3b7fe700 1 -- 172.21.15.7:0/1068107620 >> v1:172.21.15.148:6789/0 conn(0x7f5e3c1598b0 legacy=0x7f5e3c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3b7fe700 1 -- 172.21.15.7:0/1068107620 >> v1:172.21.15.7:6789/0 conn(0x7f5e3c0cfe70 legacy=0x7f5e3c163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3b7fe700 1 -- 172.21.15.7:0/1068107620 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0aff10 con 0x7f5e3c159c80 2023-10-14T19:10:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3b7fe700 1 --2- 172.21.15.7:0/1068107620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c159c80 0x7f5e3c0cb6f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098e0 tx=0x7f5e300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7a3b695bbf9dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34001770 con 0x7f5e3c159c80 2023-10-14T19:10:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30011420 con 0x7f5e3c159c80 2023-10-14T19:10:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.489+0000 7f5e3affd700 1 -- 172.21.15.7:0/1068107620 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300117c0 con 0x7f5e3c159c80 2023-10-14T19:10:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 -- 172.21.15.7:0/1068107620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c159c80 msgr2=0x7f5e3c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 --2- 172.21.15.7:0/1068107620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c159c80 0x7f5e3c0cb6f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098e0 tx=0x7f5e300091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 -- 172.21.15.7:0/1068107620 shutdown_connections 2023-10-14T19:10:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 --2- 172.21.15.7:0/1068107620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c159c80 0x7f5e3c0cb6f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 -- 172.21.15.7:0/1068107620 >> 172.21.15.7:0/1068107620 conn(0x7f5e3c070e30 msgr2=0x7f5e3c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 -- 172.21.15.7:0/1068107620 shutdown_connections 2023-10-14T19:10:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.490+0000 7f5e424da700 1 -- 172.21.15.7:0/1068107620 wait complete. 2023-10-14T19:10:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.491+0000 7f5e424da700 1 Processor -- start 2023-10-14T19:10:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.491+0000 7f5e424da700 1 -- start start 2023-10-14T19:10:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e424da700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c0cfe70 0x7f5e3c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e424da700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e3c1598b0 0x7f5e3c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e424da700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 0x7f5e3c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e424da700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0c8720 con 0x7f5e3c159c80 2023-10-14T19:10:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e424da700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0c8a00 con 0x7f5e3c0cfe70 2023-10-14T19:10:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e424da700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0c8ce0 con 0x7f5e3c1598b0 2023-10-14T19:10:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 0x7f5e3c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 0x7f5e3c1578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45826/0 (socket says 172.21.15.7:45826) 2023-10-14T19:10:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 -- 172.21.15.7:0/1751140177 learned_addr learned my addr 172.21.15.7:0/1751140177 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e3bfff700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c0cfe70 0x7f5e3c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e3b7fe700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e3c1598b0 0x7f5e3c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 -- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e3c1598b0 msgr2=0x7f5e3c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e3c1598b0 0x7f5e3c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 -- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c0cfe70 msgr2=0x7f5e3c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.492+0000 7f5e40a77700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c0cfe70 0x7f5e3c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e40a77700 1 -- 172.21.15.7:0/1751140177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009420 con 0x7f5e3c159c80 2023-10-14T19:10:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e40a77700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 0x7f5e3c1578b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400cb70 tx=0x7f5e34001920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004dc0 con 0x7f5e3c159c80 2023-10-14T19:10:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400a5d0 con 0x7f5e3c159c80 2023-10-14T19:10:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c0c8fc0 con 0x7f5e3c159c80 2023-10-14T19:10:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400a990 con 0x7f5e3c159c80 2023-10-14T19:10:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.493+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c15ed30 con 0x7f5e3c159c80 2023-10-14T19:10:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.494+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c0d06e0 con 0x7f5e3c159c80 2023-10-14T19:10:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.494+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5e34007150 con 0x7f5e3c159c80 2023-10-14T19:10:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.495+0000 7f5e23fff700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e28067320 0x7f5e280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.495+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e34084300 con 0x7f5e3c159c80 2023-10-14T19:10:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.495+0000 7f5e3bfff700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e28067320 0x7f5e280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.496+0000 7f5e3bfff700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e28067320 0x7f5e280697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007fd0 tx=0x7f5e2c007d90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.499+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e340513e0 con 0x7f5e3c159c80 2023-10-14T19:10:41.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.695+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e3c169e90 con 0x7f5e3c159c80 2023-10-14T19:10:41.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.696+0000 7f5e23fff700 1 -- 172.21.15.7:0/1751140177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5e34018090 con 0x7f5e3c159c80 2023-10-14T19:10:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:41.697 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:10:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:10:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:10:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:41.698 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:10:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e28067320 msgr2=0x7f5e280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e28067320 0x7f5e280697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007fd0 tx=0x7f5e2c007d90 comp rx=0 tx=0).stop 2023-10-14T19:10:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 msgr2=0x7f5e3c1578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 0x7f5e3c1578b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400cb70 tx=0x7f5e34001920 comp rx=0 tx=0).stop 2023-10-14T19:10:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 shutdown_connections 2023-10-14T19:10:41.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5e28067320 0x7f5e280697d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e3c0cfe70 0x7f5e3c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e3c159c80 0x7f5e3c1578b0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 --2- 172.21.15.7:0/1751140177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e3c1598b0 0x7f5e3c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 >> 172.21.15.7:0/1751140177 conn(0x7f5e3c070e30 msgr2=0x7f5e3c0b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:41.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 shutdown_connections 2023-10-14T19:10:41.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.698+0000 7f5e424da700 1 -- 172.21.15.7:0/1751140177 wait complete. 2023-10-14T19:10:41.711 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:10:41.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:10:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.833+0000 7f4513f05700 1 Processor -- start 2023-10-14T19:10:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 -- start start 2023-10-14T19:10:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f450c159530 0x7f450c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f450c06dcf0 0x7f450c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c0ccfd0 con 0x7f450c159530 2023-10-14T19:10:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c15a410 con 0x7f450c06dcf0 2023-10-14T19:10:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.834+0000 7f4513f05700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15a6f0 con 0x7f450c159e40 2023-10-14T19:10:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f450c159530 0x7f450c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f450c159530 0x7f450c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45828/0 (socket says 172.21.15.7:45828) 2023-10-14T19:10:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 -- 172.21.15.7:0/1444408289 learned_addr learned my addr 172.21.15.7:0/1444408289 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f45114a0700 1 --2- 172.21.15.7:0/1444408289 >> v2:172.21.15.148:3300/0 conn(0x7f450c06dcf0 0x7f450c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f45124a2700 1 --2- 172.21.15.7:0/1444408289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 -- 172.21.15.7:0/1444408289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 msgr2=0x7f450c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 --2- 172.21.15.7:0/1444408289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 -- 172.21.15.7:0/1444408289 >> v2:172.21.15.148:3300/0 conn(0x7f450c06dcf0 msgr2=0x7f450c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 --2- 172.21.15.7:0/1444408289 >> v2:172.21.15.148:3300/0 conn(0x7f450c06dcf0 0x7f450c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 -- 172.21.15.7:0/1444408289 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c15a9d0 con 0x7f450c159530 2023-10-14T19:10:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4511ca1700 1 --2- 172.21.15.7:0/1444408289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c0ceba0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f450c15d390 tx=0x7f4504009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6366499c163ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4510c9f700 1 -- 172.21.15.7:0/1444408289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400e070 con 0x7f450c159530 2023-10-14T19:10:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4510c9f700 1 -- 172.21.15.7:0/1444408289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400b970 con 0x7f450c159530 2023-10-14T19:10:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.835+0000 7f4510c9f700 1 -- 172.21.15.7:0/1444408289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040092e0 con 0x7f450c159530 2023-10-14T19:10:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 -- 172.21.15.7:0/1444408289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 msgr2=0x7f450c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 --2- 172.21.15.7:0/1444408289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c0ceba0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f450c15d390 tx=0x7f4504009840 comp rx=0 tx=0).stop 2023-10-14T19:10:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 -- 172.21.15.7:0/1444408289 shutdown_connections 2023-10-14T19:10:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 --2- 172.21.15.7:0/1444408289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 --2- 172.21.15.7:0/1444408289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c0ceba0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 --2- 172.21.15.7:0/1444408289 >> v2:172.21.15.148:3300/0 conn(0x7f450c06dcf0 0x7f450c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 -- 172.21.15.7:0/1444408289 >> 172.21.15.7:0/1444408289 conn(0x7f450c0703a0 msgr2=0x7f450c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 -- 172.21.15.7:0/1444408289 shutdown_connections 2023-10-14T19:10:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.836+0000 7f4513f05700 1 -- 172.21.15.7:0/1444408289 wait complete. 2023-10-14T19:10:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.837+0000 7f4513f05700 1 Processor -- start 2023-10-14T19:10:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.837+0000 7f4513f05700 1 -- start start 2023-10-14T19:10:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f450c06dcf0 0x7f450c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c158830 con 0x7f450c159530 2023-10-14T19:10:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15ed50 con 0x7f450c06dcf0 2023-10-14T19:10:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15e4b0 con 0x7f450c159e40 2023-10-14T19:10:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45844/0 (socket says 172.21.15.7:45844) 2023-10-14T19:10:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 -- 172.21.15.7:0/171392870 learned_addr learned my addr 172.21.15.7:0/171392870 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4511ca1700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f450c06dcf0 0x7f450c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 -- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 msgr2=0x7f450c1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 -- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f450c06dcf0 msgr2=0x7f450c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f450c06dcf0 0x7f450c15ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 -- 172.21.15.7:0/171392870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009ae0 con 0x7f450c159530 2023-10-14T19:10:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4511ca1700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f450c06dcf0 0x7f450c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f45114a0700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c1582f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f450000ec80 tx=0x7f45000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000c9d0 con 0x7f450c159530 2023-10-14T19:10:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000cb30 con 0x7f450c159530 2023-10-14T19:10:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c15e790 con 0x7f450c159530 2023-10-14T19:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.838+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500013470 con 0x7f450c159530 2023-10-14T19:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.839+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c0c8750 con 0x7f450c159530 2023-10-14T19:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.839+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c04c3c0 con 0x7f450c159530 2023-10-14T19:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.840+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4500013820 con 0x7f450c159530 2023-10-14T19:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.840+0000 7f4509ffb700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f44f8067320 0x7f44f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.841+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4500084cd0 con 0x7f450c159530 2023-10-14T19:10:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.841+0000 7f4511ca1700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f44f8067320 0x7f44f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.841+0000 7f4511ca1700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f44f8067320 0x7f44f80697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f450c071170 tx=0x7f4504018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:41.845+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4500051c70 con 0x7f450c159530 2023-10-14T19:10:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.037+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f450c15acb0 con 0x7f450c159530 2023-10-14T19:10:42.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.871+0000 7f4509ffb700 1 -- 172.21.15.7:0/171392870 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4500055290 con 0x7f450c159530 2023-10-14T19:10:42.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.875+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f44f8067320 msgr2=0x7f44f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:42.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.875+0000 7f4513f05700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f44f8067320 0x7f44f80697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f450c071170 tx=0x7f4504018000 comp rx=0 tx=0).stop 2023-10-14T19:10:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.875+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 msgr2=0x7f450c1582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.875+0000 7f4513f05700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c1582f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f450000ec80 tx=0x7f45000091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 shutdown_connections 2023-10-14T19:10:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f44f8067320 0x7f44f80697d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f450c06dcf0 0x7f450c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f450c159e40 0x7f450c1450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 --2- 172.21.15.7:0/171392870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f450c159530 0x7f450c1582f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 >> 172.21.15.7:0/171392870 conn(0x7f450c0703a0 msgr2=0x7f450c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:42.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 shutdown_connections 2023-10-14T19:10:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:42.876+0000 7f4513f05700 1 -- 172.21.15.7:0/171392870 wait complete. 2023-10-14T19:10:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:10:42.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:10:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.029+0000 7fd289a18700 1 Processor -- start 2023-10-14T19:10:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.029+0000 7fd289a18700 1 -- start start 2023-10-14T19:10:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd289a18700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc320 0x7fd28413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd289a18700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2840cc6f0 0x7fd28413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd289a18700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd284069a00 0x7fd284069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd289a18700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28406d7b0 con 0x7fd2840cc6f0 2023-10-14T19:10:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd289a18700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28406e330 con 0x7fd284069a00 2023-10-14T19:10:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd289a18700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28406da00 con 0x7fd2840cc320 2023-10-14T19:10:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd2827fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2840cc6f0 0x7fd28413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd2827fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2840cc6f0 0x7fd28413c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45858/0 (socket says 172.21.15.7:45858) 2023-10-14T19:10:43.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.030+0000 7fd2827fc700 1 -- 172.21.15.7:0/569719548 learned_addr learned my addr 172.21.15.7:0/569719548 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:43.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd282ffd700 1 --2- 172.21.15.7:0/569719548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc320 0x7fd28413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2837fe700 1 --2- 172.21.15.7:0/569719548 >> v2:172.21.15.148:3300/0 conn(0x7fd284069a00 0x7fd284069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2827fc700 1 -- 172.21.15.7:0/569719548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc320 msgr2=0x7fd28413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:43.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2827fc700 1 --2- 172.21.15.7:0/569719548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc320 0x7fd28413c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2827fc700 1 -- 172.21.15.7:0/569719548 >> v2:172.21.15.148:3300/0 conn(0x7fd284069a00 msgr2=0x7fd284069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2827fc700 1 --2- 172.21.15.7:0/569719548 >> v2:172.21.15.148:3300/0 conn(0x7fd284069a00 0x7fd284069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2827fc700 1 -- 172.21.15.7:0/569719548 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28406dce0 con 0x7fd2840cc6f0 2023-10-14T19:10:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2837fe700 1 --2- 172.21.15.7:0/569719548 >> v2:172.21.15.148:3300/0 conn(0x7fd284069a00 0x7fd284069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd2827fc700 1 --2- 172.21.15.7:0/569719548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc6f0 0x7fd28413c7e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd28406aa30 tx=0x7fd26c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de246df9dad22c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd281ffb700 1 -- 172.21.15.7:0/569719548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c009e70 con 0x7fd2840cc6f0 2023-10-14T19:10:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd281ffb700 1 -- 172.21.15.7:0/569719548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00b860 con 0x7fd2840cc6f0 2023-10-14T19:10:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.031+0000 7fd281ffb700 1 -- 172.21.15.7:0/569719548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00bc00 con 0x7fd2840cc6f0 2023-10-14T19:10:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 -- 172.21.15.7:0/569719548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc6f0 msgr2=0x7fd28413c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 --2- 172.21.15.7:0/569719548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc6f0 0x7fd28413c7e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd28406aa30 tx=0x7fd26c009250 comp rx=0 tx=0).stop 2023-10-14T19:10:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 -- 172.21.15.7:0/569719548 shutdown_connections 2023-10-14T19:10:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 --2- 172.21.15.7:0/569719548 >> v2:172.21.15.148:3300/0 conn(0x7fd284069a00 0x7fd284069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 --2- 172.21.15.7:0/569719548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc320 0x7fd28413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 --2- 172.21.15.7:0/569719548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc6f0 0x7fd28413c7e0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 -- 172.21.15.7:0/569719548 >> 172.21.15.7:0/569719548 conn(0x7fd284067f00 msgr2=0x7fd284068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 -- 172.21.15.7:0/569719548 shutdown_connections 2023-10-14T19:10:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.032+0000 7fd289a18700 1 -- 172.21.15.7:0/569719548 wait complete. 2023-10-14T19:10:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.033+0000 7fd289a18700 1 Processor -- start 2023-10-14T19:10:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.033+0000 7fd289a18700 1 -- start start 2023-10-14T19:10:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd284069a00 0x7fd284153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 0x7fd2840a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc6f0 0x7fd28413ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840abc50 con 0x7fd2840cc320 2023-10-14T19:10:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840abde0 con 0x7fd284069a00 2023-10-14T19:10:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840c76b0 con 0x7fd2840cc6f0 2023-10-14T19:10:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 0x7fd2840a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 0x7fd2840a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45862/0 (socket says 172.21.15.7:45862) 2023-10-14T19:10:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 -- 172.21.15.7:0/3971388952 learned_addr learned my addr 172.21.15.7:0/3971388952 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd282ffd700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd284069a00 0x7fd284153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2837fe700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc6f0 0x7fd28413ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 -- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc6f0 msgr2=0x7fd28413ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc6f0 0x7fd28413ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 -- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd284069a00 msgr2=0x7fd284153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd284069a00 0x7fd284153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 -- 172.21.15.7:0/3971388952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c0094f0 con 0x7fd2840cc320 2023-10-14T19:10:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd2827fc700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 0x7fd2840a9b30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009290 tx=0x7fd26c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00bbe0 con 0x7fd2840cc320 2023-10-14T19:10:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c01a450 con 0x7fd2840cc320 2023-10-14T19:10:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2840c7990 con 0x7fd2840cc320 2023-10-14T19:10:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.034+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c01a810 con 0x7fd2840cc320 2023-10-14T19:10:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.035+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2840c7f50 con 0x7fd2840cc320 2023-10-14T19:10:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.035+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd284154190 con 0x7fd2840cc320 2023-10-14T19:10:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.036+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd26c01ab80 con 0x7fd2840cc320 2023-10-14T19:10:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.037+0000 7fd27affd700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd264067320 0x7fd2640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.037+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd26c085fc0 con 0x7fd2840cc320 2023-10-14T19:10:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.037+0000 7fd282ffd700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd264067320 0x7fd2640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:43.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.037+0000 7fd282ffd700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd264067320 0x7fd2640697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0076a0 tx=0x7fd27c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:43.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.041+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd26c052df0 con 0x7fd2840cc320 2023-10-14T19:10:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.233+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd28404c3c0 con 0x7fd2840cc320 2023-10-14T19:10:43.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.881+0000 7fd27affd700 1 -- 172.21.15.7:0/3971388952 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd26c02a0d0 con 0x7fd2840cc320 2023-10-14T19:10:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd264067320 msgr2=0x7fd2640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd264067320 0x7fd2640697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0076a0 tx=0x7fd27c00b040 comp rx=0 tx=0).stop 2023-10-14T19:10:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 msgr2=0x7fd2840a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 0x7fd2840a9b30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009290 tx=0x7fd26c017000 comp rx=0 tx=0).stop 2023-10-14T19:10:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 shutdown_connections 2023-10-14T19:10:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd264067320 0x7fd2640697d0 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0076a0 tx=0x7fd27c00b040 comp rx=0 tx=0).stop 2023-10-14T19:10:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd284069a00 0x7fd284153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2840cc6f0 0x7fd28413ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 --2- 172.21.15.7:0/3971388952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840cc320 0x7fd2840a9b30 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.899+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 >> 172.21.15.7:0/3971388952 conn(0x7fd284067f00 msgr2=0x7fd2840cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.900+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 shutdown_connections 2023-10-14T19:10:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:43.901+0000 7fd289a18700 1 -- 172.21.15.7:0/3971388952 wait complete. 2023-10-14T19:10:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:10:43.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:10:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.039+0000 7fb1bdbcd700 1 Processor -- start 2023-10-14T19:10:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.039+0000 7fb1bdbcd700 1 -- start start 2023-10-14T19:10:44.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.040+0000 7fb1bdbcd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 0x7fb1b80acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.040+0000 7fb1bdbcd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b80adf10 con 0x7fb1b80b0e90 2023-10-14T19:10:44.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.040+0000 7fb1bdbcd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b80ae4d0 con 0x7fb1b8156510 2023-10-14T19:10:44.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.040+0000 7fb1bdbcd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ad300 con 0x7fb1b81568e0 2023-10-14T19:10:44.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.040+0000 7fb1b6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb1b80b0e90 0x7fb1b815e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35744/0 (socket says 172.21.15.7:35744) 2023-10-14T19:10:44.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.040+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/982899532 learned_addr learned my addr 172.21.15.7:0/982899532 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:44.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b7fff700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 0x7fb1b80acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274895356 0 0) 0x7fb1b80adf10 con 0x7fb1b80b0e90 2023-10-14T19:10:44.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003570 con 0x7fb1b80b0e90 2023-10-14T19:10:44.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949111493 0 0) 0x7fb1a0003570 con 0x7fb1b80b0e90 2023-10-14T19:10:44.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 msgr2=0x7fb1b80acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:44.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 0x7fb1b80acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 >> v1:172.21.15.148:6789/0 conn(0x7fb1b8156510 legacy=0x7fb1b80b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80ad5e0 con 0x7fb1b80b0e90 2023-10-14T19:10:44.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fb1ac001470 con 0x7fb1b80b0e90 2023-10-14T19:10:44.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 >> v1:172.21.15.7:6789/0 conn(0x7fb1b80b0e90 legacy=0x7fb1b815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0003a90 0x7fb1a0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0004810 0x7fb1a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 0x7fb1a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ad300 con 0x7fb1a0004810 2023-10-14T19:10:44.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000bb10 con 0x7fb1a0003a90 2023-10-14T19:10:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000dee0 con 0x7fb1b81568e0 2023-10-14T19:10:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0004810 0x7fb1a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b77fe700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0003a90 0x7fb1a0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b7fff700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 0x7fb1a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 msgr2=0x7fb1a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:44.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.041+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b81568e0 0x7fb1a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0003a90 msgr2=0x7fb1a0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:44.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0003a90 0x7fb1a0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/982899532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0003570 con 0x7fb1a0004810 2023-10-14T19:10:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0004810 0x7fb1a0004c80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c390 tx=0x7fb1ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb08a4b7fcf0bab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00cc60 con 0x7fb1a0004810 2023-10-14T19:10:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00cdc0 con 0x7fb1a0004810 2023-10-14T19:10:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b67fc700 1 -- 172.21.15.7:0/982899532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac005b70 con 0x7fb1a0004810 2023-10-14T19:10:44.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/982899532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0004810 msgr2=0x7fb1a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/982899532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0004810 0x7fb1a0004c80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c390 tx=0x7fb1ac001e70 comp rx=0 tx=0).stop 2023-10-14T19:10:44.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1b7fff700 1 -- 172.21.15.7:0/982899532 reap_dead start 2023-10-14T19:10:44.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/982899532 shutdown_connections 2023-10-14T19:10:44.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/982899532 >> 172.21.15.7:0/982899532 conn(0x7fb1b806e790 msgr2=0x7fb1b806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:44.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/982899532 shutdown_connections 2023-10-14T19:10:44.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.042+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/982899532 wait complete. 2023-10-14T19:10:44.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 Processor -- start 2023-10-14T19:10:44.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 -- start start 2023-10-14T19:10:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0004810 0x7fb1b814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 0x7fb1b815a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b814bf60 0x7fb1b8152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8155bd0 con 0x7fb1b814c6c0 2023-10-14T19:10:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8155000 con 0x7fb1a0004810 2023-10-14T19:10:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1bdbcd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b814a840 con 0x7fb1b814bf60 2023-10-14T19:10:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1b6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 0x7fb1b815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1b6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 0x7fb1b815a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45870/0 (socket says 172.21.15.7:45870) 2023-10-14T19:10:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.044+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/3550902514 learned_addr learned my addr 172.21.15.7:0/3550902514 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b77fe700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0004810 0x7fb1b814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b7fff700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b814bf60 0x7fb1b8152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b814bf60 msgr2=0x7fb1b8152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b814bf60 0x7fb1b8152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0004810 msgr2=0x7fb1b814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0004810 0x7fb1b814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b6ffd700 1 -- 172.21.15.7:0/3550902514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b81552a0 con 0x7fb1b814c6c0 2023-10-14T19:10:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1b6ffd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 0x7fb1b815a730 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0004770 tx=0x7fb1ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00cc60 con 0x7fb1b814c6c0 2023-10-14T19:10:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac000fe0 con 0x7fb1b814c6c0 2023-10-14T19:10:44.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b8155580 con 0x7fb1b814c6c0 2023-10-14T19:10:44.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac007530 con 0x7fb1b814c6c0 2023-10-14T19:10:44.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.045+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b815ac70 con 0x7fb1b814c6c0 2023-10-14T19:10:44.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.046+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b804c3c0 con 0x7fb1b814c6c0 2023-10-14T19:10:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.047+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb1ac019030 con 0x7fb1b814c6c0 2023-10-14T19:10:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.047+0000 7fb19f7fe700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4067320 0x7fb1a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.047+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb1ac086150 con 0x7fb1b814c6c0 2023-10-14T19:10:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.047+0000 7fb1b77fe700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4067320 0x7fb1a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.048+0000 7fb1b77fe700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4067320 0x7fb1a40697d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8003d10 tx=0x7fb1a8007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.052+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1ac052ef0 con 0x7fb1b814c6c0 2023-10-14T19:10:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.292+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb1b80ad8c0 con 0x7fb1b814c6c0 2023-10-14T19:10:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.884+0000 7fb19f7fe700 1 -- 172.21.15.7:0/3550902514 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v98) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb1ac056510 con 0x7fb1b814c6c0 2023-10-14T19:10:44.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.888+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4067320 msgr2=0x7fb1a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.888+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4067320 0x7fb1a40697d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8003d10 tx=0x7fb1a8007d10 comp rx=0 tx=0).stop 2023-10-14T19:10:44.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.888+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 msgr2=0x7fb1b815a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.888+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 0x7fb1b815a730 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0004770 tx=0x7fb1ac015000 comp rx=0 tx=0).stop 2023-10-14T19:10:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.889+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 shutdown_connections 2023-10-14T19:10:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.889+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a4067320 0x7fb1a40697d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.889+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1a0004810 0x7fb1b814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.889+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b814bf60 0x7fb1b8152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.889+0000 7fb1bdbcd700 1 --2- 172.21.15.7:0/3550902514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b814c6c0 0x7fb1b815a730 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:44.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.889+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 >> 172.21.15.7:0/3550902514 conn(0x7fb1b806e790 msgr2=0x7fb1b80af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:44.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.891+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 shutdown_connections 2023-10-14T19:10:44.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:44.893+0000 7fb1bdbcd700 1 -- 172.21.15.7:0/3550902514 wait complete. 2023-10-14T19:10:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 26 and data pool 27 2023-10-14T19:10:44.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:45.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.039+0000 7fc49f485700 1 Processor -- start 2023-10-14T19:10:45.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.039+0000 7fc49f485700 1 -- start start 2023-10-14T19:10:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49f485700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc49815de50 0x7fc4980cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49f485700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 0x7fc49815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49f485700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4980cf3c0 con 0x7fc498153c30 2023-10-14T19:10:45.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49f485700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49815afd0 con 0x7fc49815de50 2023-10-14T19:10:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49f485700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49815b2b0 con 0x7fc4980cef40 2023-10-14T19:10:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49e483700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc498153c30 0x7fc49815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35758/0 (socket says 172.21.15.7:35758) 2023-10-14T19:10:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49e483700 1 -- 172.21.15.7:0/876783542 learned_addr learned my addr 172.21.15.7:0/876783542 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:45.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49dc82700 1 --2- 172.21.15.7:0/876783542 >> v2:172.21.15.148:3300/0 conn(0x7fc49815de50 0x7fc4980cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49ec84700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 0x7fc49815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243896938 0 0) 0x7fc4980cf3c0 con 0x7fc498153c30 2023-10-14T19:10:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.040+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc484003570 con 0x7fc498153c30 2023-10-14T19:10:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1975244178 0 0) 0x7fc484003570 con 0x7fc498153c30 2023-10-14T19:10:45.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 msgr2=0x7fc49815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 0x7fc49815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 >> v2:172.21.15.148:3300/0 conn(0x7fc49815de50 msgr2=0x7fc4980cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 --2- 172.21.15.7:0/876783542 >> v2:172.21.15.148:3300/0 conn(0x7fc49815de50 0x7fc4980cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49815b590 con 0x7fc498153c30 2023-10-14T19:10:45.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fc494001470 con 0x7fc498153c30 2023-10-14T19:10:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 >> v1:172.21.15.7:6789/0 conn(0x7fc498153c30 legacy=0x7fc49815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 0x7fc484003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484003fe0 0x7fc484004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc484004d50 0x7fc4840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49815afd0 con 0x7fc484004d50 2023-10-14T19:10:45.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49815b2b0 con 0x7fc484003fe0 2023-10-14T19:10:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48400ba90 con 0x7fc4980cef40 2023-10-14T19:10:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49dc82700 1 --2- 172.21.15.7:0/876783542 >> v2:172.21.15.148:3300/0 conn(0x7fc49815de50 0x7fc4980cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc484004d50 0x7fc4840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49e483700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 0x7fc484003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49dc82700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484003fe0 0x7fc484004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 -- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 msgr2=0x7fc484003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980cef40 0x7fc484003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 -- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484003fe0 msgr2=0x7fc484004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484003fe0 0x7fc484004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 -- 172.21.15.7:0/876783542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484003570 con 0x7fc484004d50 2023-10-14T19:10:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49dc82700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484003fe0 0x7fc484004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.041+0000 7fc49ec84700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc484004d50 0x7fc4840051c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fc49000e210 tx=0x7fc49000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9c678a24323bec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000ea60 con 0x7fc484004d50 2023-10-14T19:10:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49000f040 con 0x7fc484004d50 2023-10-14T19:10:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49d481700 1 -- 172.21.15.7:0/876783542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000ee10 con 0x7fc484004d50 2023-10-14T19:10:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49f485700 1 -- 172.21.15.7:0/876783542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc484004d50 msgr2=0x7fc4840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49f485700 1 --2- 172.21.15.7:0/876783542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc484004d50 0x7fc4840051c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fc49000e210 tx=0x7fc49000b040 comp rx=0 tx=0).stop 2023-10-14T19:10:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49ec84700 1 -- 172.21.15.7:0/876783542 reap_dead start 2023-10-14T19:10:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49f485700 1 -- 172.21.15.7:0/876783542 shutdown_connections 2023-10-14T19:10:45.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49f485700 1 -- 172.21.15.7:0/876783542 >> 172.21.15.7:0/876783542 conn(0x7fc4980703a0 msgr2=0x7fc4980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49f485700 1 -- 172.21.15.7:0/876783542 shutdown_connections 2023-10-14T19:10:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.042+0000 7fc49f485700 1 -- 172.21.15.7:0/876783542 wait complete. 2023-10-14T19:10:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.043+0000 7fc49f485700 1 Processor -- start 2023-10-14T19:10:45.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.043+0000 7fc49f485700 1 -- start start 2023-10-14T19:10:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49f485700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484004d50 0x7fc498151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49f485700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 0x7fc4980c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49f485700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980ca0a0 0x7fc4980cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49f485700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980c8ce0 con 0x7fc4980c96f0 2023-10-14T19:10:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49f485700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980cb2d0 con 0x7fc484004d50 2023-10-14T19:10:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49f485700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980c8440 con 0x7fc4980ca0a0 2023-10-14T19:10:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 0x7fc4980c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 0x7fc4980c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45886/0 (socket says 172.21.15.7:45886) 2023-10-14T19:10:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 -- 172.21.15.7:0/508957511 learned_addr learned my addr 172.21.15.7:0/508957511 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:45.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49e483700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484004d50 0x7fc498151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49ec84700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980ca0a0 0x7fc4980cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 -- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980ca0a0 msgr2=0x7fc4980cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980ca0a0 0x7fc4980cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 -- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484004d50 msgr2=0x7fc498151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484004d50 0x7fc498151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49dc82700 1 -- 172.21.15.7:0/508957511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980c8720 con 0x7fc4980c96f0 2023-10-14T19:10:45.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.044+0000 7fc49ec84700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980ca0a0 0x7fc4980cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:45.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.045+0000 7fc49dc82700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 0x7fc4980c9b60 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc4880119c0 tx=0x7fc488008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.045+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800f8e0 con 0x7fc4980c96f0 2023-10-14T19:10:45.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.045+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800fa40 con 0x7fc4980c96f0 2023-10-14T19:10:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.045+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4980c8a00 con 0x7fc4980c96f0 2023-10-14T19:10:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.045+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800fdc0 con 0x7fc4980c96f0 2023-10-14T19:10:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.045+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4980c7ff0 con 0x7fc4980c96f0 2023-10-14T19:10:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.046+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49804c3c0 con 0x7fc4980c96f0 2023-10-14T19:10:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.046+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc488015670 con 0x7fc4980c96f0 2023-10-14T19:10:45.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.047+0000 7fc48e7fc700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc47c067320 0x7fc47c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.047+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc488085650 con 0x7fc4980c96f0 2023-10-14T19:10:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.047+0000 7fc49e483700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc47c067320 0x7fc47c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.047+0000 7fc49e483700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc47c067320 0x7fc47c0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc494001050 tx=0x7fc494009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.051+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4880522e0 con 0x7fc4980c96f0 2023-10-14T19:10:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.247+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4980cb410 con 0x7fc4980c96f0 2023-10-14T19:10:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.248+0000 7fc48e7fc700 1 -- 172.21.15.7:0/508957511 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fc488055900 con 0x7fc4980c96f0 2023-10-14T19:10:45.249 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:45.249 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":152,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:44.293498+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:42.068244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:43.264160+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc47c067320 msgr2=0x7fc47c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc47c067320 0x7fc47c0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc494001050 tx=0x7fc494009040 comp rx=0 tx=0).stop 2023-10-14T19:10:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 msgr2=0x7fc4980c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 0x7fc4980c9b60 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc4880119c0 tx=0x7fc488008040 comp rx=0 tx=0).stop 2023-10-14T19:10:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 shutdown_connections 2023-10-14T19:10:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc47c067320 0x7fc47c0697d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc484004d50 0x7fc498151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4980ca0a0 0x7fc4980cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.249+0000 7fc49f485700 1 --2- 172.21.15.7:0/508957511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4980c96f0 0x7fc4980c9b60 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.250+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 >> 172.21.15.7:0/508957511 conn(0x7fc4980703a0 msgr2=0x7fc4980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.250+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 shutdown_connections 2023-10-14T19:10:45.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.250+0000 7fc49f485700 1 -- 172.21.15.7:0/508957511 wait complete. 2023-10-14T19:10:45.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:45.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.381+0000 7fa735f19700 1 Processor -- start 2023-10-14T19:10:45.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.381+0000 7fa735f19700 1 -- start start 2023-10-14T19:10:45.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa735f19700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7300a90d0 0x7fa73006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa735f19700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa7300af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa735f19700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7300aeee0 con 0x7fa7300a8d00 2023-10-14T19:10:45.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa735f19700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73006e820 con 0x7fa7300a90d0 2023-10-14T19:10:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa735f19700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7300ae680 con 0x7fa73006e380 2023-10-14T19:10:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa72effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7300a90d0 0x7fa73006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa72effd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7300a90d0 0x7fa73006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45890/0 (socket says 172.21.15.7:45890) 2023-10-14T19:10:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.382+0000 7fa72effd700 1 -- 172.21.15.7:0/3143404537 learned_addr learned my addr 172.21.15.7:0/3143404537 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72ffff700 1 --2- 172.21.15.7:0/3143404537 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa7300af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72effd700 1 -- 172.21.15.7:0/3143404537 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 msgr2=0x7fa7300af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72effd700 1 --2- 172.21.15.7:0/3143404537 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa7300af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72effd700 1 -- 172.21.15.7:0/3143404537 >> v1:172.21.15.148:6789/0 conn(0x7fa7300a8d00 legacy=0x7fa7300cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72effd700 1 -- 172.21.15.7:0/3143404537 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300cf490 con 0x7fa7300a90d0 2023-10-14T19:10:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72effd700 1 --2- 172.21.15.7:0/3143404537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa73006de40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa724009990 tx=0x7fa724009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a249cf36ae617ce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72e7fc700 1 -- 172.21.15.7:0/3143404537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724005c10 con 0x7fa7300a90d0 2023-10-14T19:10:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72e7fc700 1 -- 172.21.15.7:0/3143404537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724005d70 con 0x7fa7300a90d0 2023-10-14T19:10:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa72e7fc700 1 -- 172.21.15.7:0/3143404537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72400b880 con 0x7fa7300a90d0 2023-10-14T19:10:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa735f19700 1 -- 172.21.15.7:0/3143404537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 msgr2=0x7fa73006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.383+0000 7fa735f19700 1 --2- 172.21.15.7:0/3143404537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa73006de40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa724009990 tx=0x7fa724009220 comp rx=0 tx=0).stop 2023-10-14T19:10:45.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.384+0000 7fa735f19700 1 -- 172.21.15.7:0/3143404537 shutdown_connections 2023-10-14T19:10:45.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.384+0000 7fa735f19700 1 --2- 172.21.15.7:0/3143404537 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa7300af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.384+0000 7fa735f19700 1 --2- 172.21.15.7:0/3143404537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa73006de40 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.384+0000 7fa735f19700 1 -- 172.21.15.7:0/3143404537 >> 172.21.15.7:0/3143404537 conn(0x7fa73006ce80 msgr2=0x7fa7300ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:45.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.384+0000 7fa735f19700 1 -- 172.21.15.7:0/3143404537 shutdown_connections 2023-10-14T19:10:45.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.384+0000 7fa735f19700 1 -- 172.21.15.7:0/3143404537 wait complete. 2023-10-14T19:10:45.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.385+0000 7fa735f19700 1 Processor -- start 2023-10-14T19:10:45.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.385+0000 7fa735f19700 1 -- start start 2023-10-14T19:10:45.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa735f19700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa73015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa735f19700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7300a8d00 0x7fa730157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa735f19700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa730158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa735f19700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73015a120 con 0x7fa7300a90d0 2023-10-14T19:10:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa735f19700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73015e710 con 0x7fa7300a8d00 2023-10-14T19:10:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa735f19700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73015e9f0 con 0x7fa73006e380 2023-10-14T19:10:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa730158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa730158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45898/0 (socket says 172.21.15.7:45898) 2023-10-14T19:10:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 -- 172.21.15.7:0/1508388827 learned_addr learned my addr 172.21.15.7:0/1508388827 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72effd700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7300a8d00 0x7fa730157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72f7fe700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa73015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 -- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 msgr2=0x7fa73015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa73015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 -- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7300a8d00 msgr2=0x7fa730157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7300a8d00 0x7fa730157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 -- 172.21.15.7:0/1508388827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724009480 con 0x7fa7300a90d0 2023-10-14T19:10:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72f7fe700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa73015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa72ffff700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa730158330 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa728007f20 tx=0x7fa728009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.386+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800ebf0 con 0x7fa7300a90d0 2023-10-14T19:10:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.387+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800ed70 con 0x7fa7300a90d0 2023-10-14T19:10:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.387+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728014670 con 0x7fa7300a90d0 2023-10-14T19:10:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.387+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73015ecd0 con 0x7fa7300a90d0 2023-10-14T19:10:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.387+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73015c920 con 0x7fa7300a90d0 2023-10-14T19:10:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.387+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73015a2d0 con 0x7fa7300a90d0 2023-10-14T19:10:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.388+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7280149e0 con 0x7fa7300a90d0 2023-10-14T19:10:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.388+0000 7fa7177fe700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa71c067320 0x7fa71c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.388+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa728085300 con 0x7fa7300a90d0 2023-10-14T19:10:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.388+0000 7fa72f7fe700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa71c067320 0x7fa71c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.389+0000 7fa72f7fe700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa71c067320 0x7fa71c0697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa7200018f0 tx=0x7fa720009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.393+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa73015a2d0 con 0x7fa7300a90d0 2023-10-14T19:10:45.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.585+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa73015a2d0 con 0x7fa7300a90d0 2023-10-14T19:10:45.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.586+0000 7fa7177fe700 1 -- 172.21.15.7:0/1508388827 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fa73015a2d0 con 0x7fa7300a90d0 2023-10-14T19:10:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:45.587 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":152,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:44.293498+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:42.068244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:43.264160+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:45.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa71c067320 msgr2=0x7fa71c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa71c067320 0x7fa71c0697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa7200018f0 tx=0x7fa720009040 comp rx=0 tx=0).stop 2023-10-14T19:10:45.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 msgr2=0x7fa730158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa730158330 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa728007f20 tx=0x7fa728009860 comp rx=0 tx=0).stop 2023-10-14T19:10:45.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 shutdown_connections 2023-10-14T19:10:45.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa71c067320 0x7fa71c0697d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7300a90d0 0x7fa730158330 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa73006e380 0x7fa73015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 --2- 172.21.15.7:0/1508388827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7300a8d00 0x7fa730157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 >> 172.21.15.7:0/1508388827 conn(0x7fa73006ce80 msgr2=0x7fa7300cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:45.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 shutdown_connections 2023-10-14T19:10:45.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.588+0000 7fa735f19700 1 -- 172.21.15.7:0/1508388827 wait complete. 2023-10-14T19:10:45.601 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:10:45.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.723+0000 7f3108e8a700 1 Processor -- start 2023-10-14T19:10:45.724 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.723+0000 7f3108e8a700 1 -- start start 2023-10-14T19:10:45.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3108e8a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3104159550 0x7f31040ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3108e8a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f310415dfd0 0x7f31040aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3108e8a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040acc00 con 0x7f3104159920 2023-10-14T19:10:45.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3108e8a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31040abff0 con 0x7f3104159550 2023-10-14T19:10:45.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3108e8a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31040ac2d0 con 0x7f310415dfd0 2023-10-14T19:10:45.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f31037fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3104159550 0x7f31040ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3103fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3104159920 0x7f31040ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35764/0 (socket says 172.21.15.7:35764) 2023-10-14T19:10:45.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3103fff700 1 -- 172.21.15.7:0/3028216366 learned_addr learned my addr 172.21.15.7:0/3028216366 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:45.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f3102ffd700 1 --2- 172.21.15.7:0/3028216366 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f310415dfd0 0x7f31040aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f31037fe700 1 -- 172.21.15.7:0/3028216366 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f310415dfd0 msgr2=0x7f31040aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:45.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f31037fe700 1 --2- 172.21.15.7:0/3028216366 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f310415dfd0 0x7f31040aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f31037fe700 1 -- 172.21.15.7:0/3028216366 >> v1:172.21.15.7:6789/0 conn(0x7f3104159920 legacy=0x7f31040ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.724+0000 7f31027fc700 1 -- 172.21.15.7:0/3028216366 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088414657 0 0) 0x7f31040acc00 con 0x7f3104159920 2023-10-14T19:10:45.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f31037fe700 1 -- 172.21.15.7:0/3028216366 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040ac5b0 con 0x7f3104159550 2023-10-14T19:10:45.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f31037fe700 1 --2- 172.21.15.7:0/3028216366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3104159550 0x7f31040ceac0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098e0 tx=0x7f30f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cf46917f0a986c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f31027fc700 1 -- 172.21.15.7:0/3028216366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f400b640 con 0x7f3104159550 2023-10-14T19:10:45.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f31027fc700 1 -- 172.21.15.7:0/3028216366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f400b7a0 con 0x7f3104159550 2023-10-14T19:10:45.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f31027fc700 1 -- 172.21.15.7:0/3028216366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f400bb40 con 0x7f3104159550 2023-10-14T19:10:45.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 -- 172.21.15.7:0/3028216366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3104159550 msgr2=0x7f31040ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3028216366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3104159550 0x7f31040ceac0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098e0 tx=0x7f30f40091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 -- 172.21.15.7:0/3028216366 shutdown_connections 2023-10-14T19:10:45.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3028216366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3104159550 0x7f31040ceac0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3028216366 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f310415dfd0 0x7f31040aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 -- 172.21.15.7:0/3028216366 >> 172.21.15.7:0/3028216366 conn(0x7f310406ce80 msgr2=0x7f31040ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:45.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 -- 172.21.15.7:0/3028216366 shutdown_connections 2023-10-14T19:10:45.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.725+0000 7f3108e8a700 1 -- 172.21.15.7:0/3028216366 wait complete. 2023-10-14T19:10:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 Processor -- start 2023-10-14T19:10:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 -- start start 2023-10-14T19:10:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3104159550 0x7f310409b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3104159920 0x7f31041565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 0x7f3104098040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040b1150 con 0x7f310415dfd0 2023-10-14T19:10:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040b1cd0 con 0x7f3104159550 2023-10-14T19:10:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3108e8a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310409beb0 con 0x7f3104159920 2023-10-14T19:10:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3103fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 0x7f3104098040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.727+0000 7f3103fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 0x7f3104098040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45924/0 (socket says 172.21.15.7:45924) 2023-10-14T19:10:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 -- 172.21.15.7:0/3454506114 learned_addr learned my addr 172.21.15.7:0/3454506114 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f31037fe700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3104159550 0x7f310409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3102ffd700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3104159920 0x7f31041565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 -- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3104159920 msgr2=0x7f31041565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3104159920 0x7f31041565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 -- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3104159550 msgr2=0x7f310409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3104159550 0x7f310409b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 -- 172.21.15.7:0/3454506114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009420 con 0x7f310415dfd0 2023-10-14T19:10:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3103fff700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 0x7f3104098040 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00cc90 tx=0x7f30fc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00a8b0 con 0x7f310415dfd0 2023-10-14T19:10:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc00aa10 con 0x7f310415dfd0 2023-10-14T19:10:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31040b13a0 con 0x7f310415dfd0 2023-10-14T19:10:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00add0 con 0x7f310415dfd0 2023-10-14T19:10:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.728+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31040b1960 con 0x7f310415dfd0 2023-10-14T19:10:45.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.729+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31040b1e40 con 0x7f310415dfd0 2023-10-14T19:10:45.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.730+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30fc007300 con 0x7f310415dfd0 2023-10-14T19:10:45.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.730+0000 7f30eb7fe700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30f0067320 0x7f30f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:45.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.730+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30fc084fa0 con 0x7f310415dfd0 2023-10-14T19:10:45.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.730+0000 7f31037fe700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30f0067320 0x7f30f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:45.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.731+0000 7f31037fe700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30f0067320 0x7f30f00697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f30f40093f0 tx=0x7f30f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:45.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.734+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30fc051cb0 con 0x7f310415dfd0 2023-10-14T19:10:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:45.979+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f310404c3c0 con 0x7f310415dfd0 2023-10-14T19:10:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.919+0000 7f30eb7fe700 1 -- 172.21.15.7:0/3454506114 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v101) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30fc0552d0 con 0x7f310415dfd0 2023-10-14T19:10:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30f0067320 msgr2=0x7f30f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30f0067320 0x7f30f00697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f30f40093f0 tx=0x7f30f4017000 comp rx=0 tx=0).stop 2023-10-14T19:10:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 msgr2=0x7f3104098040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 0x7f3104098040 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00cc90 tx=0x7f30fc001a80 comp rx=0 tx=0).stop 2023-10-14T19:10:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 shutdown_connections 2023-10-14T19:10:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30f0067320 0x7f30f00697d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3104159550 0x7f310409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f310415dfd0 0x7f3104098040 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 --2- 172.21.15.7:0/3454506114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3104159920 0x7f31041565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.921+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 >> 172.21.15.7:0/3454506114 conn(0x7f310406ce80 msgr2=0x7f3104069510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.922+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 shutdown_connections 2023-10-14T19:10:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:46.922+0000 7f3108e8a700 1 -- 172.21.15.7:0/3454506114 wait complete. 2023-10-14T19:10:46.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:10:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.067+0000 7f1fcdbdd700 1 Processor -- start 2023-10-14T19:10:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.067+0000 7f1fcdbdd700 1 -- start start 2023-10-14T19:10:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fcdbdd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 0x7f1fc80c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fcdbdd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1fc80c8bd0 0x7f1fc80b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fcdbdd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80adbc0 con 0x7f1fc80b0f80 2023-10-14T19:10:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fcdbdd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc80b1400 con 0x7f1fc80c8bd0 2023-10-14T19:10:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fcdbdd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80c9d30 con 0x7f1fc80c8800 2023-10-14T19:10:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fc7fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1fc80b0f80 0x7f1fc80ae050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54516/0 (socket says 172.21.15.7:54516) 2023-10-14T19:10:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fc7fff700 1 -- 172.21.15.7:0/4136004118 learned_addr learned my addr 172.21.15.7:0/4136004118 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fc6ffd700 1 --2- 172.21.15.7:0/4136004118 >> v2:172.21.15.148:3300/0 conn(0x7f1fc80c8bd0 0x7f1fc80b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fc77fe700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 0x7f1fc80c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.068+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601010333 0 0) 0x7f1fc80adbc0 con 0x7f1fc80b0f80 2023-10-14T19:10:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb0003570 con 0x7f1fc80b0f80 2023-10-14T19:10:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4009900065 0 0) 0x7f1fb0003570 con 0x7f1fc80b0f80 2023-10-14T19:10:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 msgr2=0x7f1fc80c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 0x7f1fc80c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 >> v2:172.21.15.148:3300/0 conn(0x7f1fc80c8bd0 msgr2=0x7f1fc80b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 --2- 172.21.15.7:0/4136004118 >> v2:172.21.15.148:3300/0 conn(0x7f1fc80c8bd0 0x7f1fc80b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80acfb0 con 0x7f1fc80b0f80 2023-10-14T19:10:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f1fc00017f0 con 0x7f1fc80b0f80 2023-10-14T19:10:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 >> v1:172.21.15.7:6789/0 conn(0x7f1fc80b0f80 legacy=0x7f1fc80ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 0x7f1fb0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb0003fe0 0x7f1fb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0004d50 0x7f1fb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80b1400 con 0x7f1fb0003fe0 2023-10-14T19:10:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80c9d30 con 0x7f1fb0004d50 2023-10-14T19:10:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb000ba90 con 0x7f1fc80c8800 2023-10-14T19:10:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc6ffd700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb0003fe0 0x7f1fb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc77fe700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 0x7f1fb0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc7fff700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0004d50 0x7f1fb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc6ffd700 1 -- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 msgr2=0x7f1fb0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc6ffd700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc80c8800 0x7f1fb0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc6ffd700 1 -- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0004d50 msgr2=0x7f1fb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc6ffd700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0004d50 0x7f1fb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.069+0000 7f1fc6ffd700 1 -- 172.21.15.7:0/4136004118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0003570 con 0x7f1fb0003fe0 2023-10-14T19:10:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fc6ffd700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb0003fe0 0x7f1fb0004810 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009c00 tx=0x7f1fbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc4176a06abad1e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00e6b0 con 0x7f1fb0003fe0 2023-10-14T19:10:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00e810 con 0x7f1fb0003fe0 2023-10-14T19:10:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fc67fc700 1 -- 172.21.15.7:0/4136004118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00ebd0 con 0x7f1fb0003fe0 2023-10-14T19:10:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4136004118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb0003fe0 msgr2=0x7f1fb0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4136004118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb0003fe0 0x7f1fb0004810 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009c00 tx=0x7f1fbc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fc7fff700 1 -- 172.21.15.7:0/4136004118 reap_dead start 2023-10-14T19:10:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4136004118 shutdown_connections 2023-10-14T19:10:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4136004118 >> 172.21.15.7:0/4136004118 conn(0x7f1fc806d170 msgr2=0x7f1fc80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4136004118 shutdown_connections 2023-10-14T19:10:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.070+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4136004118 wait complete. 2023-10-14T19:10:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.071+0000 7f1fcdbdd700 1 Processor -- start 2023-10-14T19:10:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.071+0000 7f1fcdbdd700 1 -- start start 2023-10-14T19:10:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fcdbdd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0003fe0 0x7f1fc8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fcdbdd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc81665e0 0x7f1fc8166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fcdbdd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 0x7f1fc8154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fcdbdd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc816d870 con 0x7f1fc8153d40 2023-10-14T19:10:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fcdbdd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc816cca0 con 0x7f1fb0003fe0 2023-10-14T19:10:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fcdbdd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc816cf40 con 0x7f1fc81665e0 2023-10-14T19:10:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fc7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 0x7f1fc8154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fc7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 0x7f1fc8154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45150/0 (socket says 172.21.15.7:45150) 2023-10-14T19:10:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fc7fff700 1 -- 172.21.15.7:0/4063333216 learned_addr learned my addr 172.21.15.7:0/4063333216 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fc77fe700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0003fe0 0x7f1fc8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.072+0000 7f1fc6ffd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc81665e0 0x7f1fc8166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fc7fff700 1 -- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc81665e0 msgr2=0x7f1fc8166a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fc7fff700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc81665e0 0x7f1fc8166a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fc7fff700 1 -- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0003fe0 msgr2=0x7f1fc8159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fc7fff700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0003fe0 0x7f1fc8159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fc7fff700 1 -- 172.21.15.7:0/4063333216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc816d220 con 0x7f1fc8153d40 2023-10-14T19:10:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fc7fff700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 0x7f1fc8154170 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0000f80 tx=0x7f1fc0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000ad80 con 0x7f1fc8153d40 2023-10-14T19:10:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00133f0 con 0x7f1fc8153d40 2023-10-14T19:10:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc816d500 con 0x7f1fc8153d40 2023-10-14T19:10:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00137b0 con 0x7f1fc8153d40 2023-10-14T19:10:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.073+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8152c10 con 0x7f1fc8153d40 2023-10-14T19:10:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.074+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc816d9e0 con 0x7f1fc8153d40 2023-10-14T19:10:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.074+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1fc0013b60 con 0x7f1fc8153d40 2023-10-14T19:10:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.075+0000 7f1faf7fe700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fb4067320 0x7f1fb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.075+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fc00855f0 con 0x7f1fc8153d40 2023-10-14T19:10:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.075+0000 7f1fc77fe700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fb4067320 0x7f1fb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.075+0000 7f1fc77fe700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fb4067320 0x7f1fb40697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80b01a0 tx=0x7f1fb80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.079+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fc0052380 con 0x7f1fc8153d40 2023-10-14T19:10:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.318+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1fc804c3c0 con 0x7f1fc8153d40 2023-10-14T19:10:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.923+0000 7f1faf7fe700 1 -- 172.21.15.7:0/4063333216 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v102) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1fc00559a0 con 0x7f1fc8153d40 2023-10-14T19:10:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fb4067320 msgr2=0x7f1fb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fb4067320 0x7f1fb40697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80b01a0 tx=0x7f1fb80091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 msgr2=0x7f1fc8154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:47.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 0x7f1fc8154170 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0000f80 tx=0x7f1fc0002210 comp rx=0 tx=0).stop 2023-10-14T19:10:47.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 shutdown_connections 2023-10-14T19:10:47.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fb4067320 0x7f1fb40697d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb0003fe0 0x7f1fc8159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc8153d40 0x7f1fc8154170 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 --2- 172.21.15.7:0/4063333216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fc81665e0 0x7f1fc8166a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:47.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 >> 172.21.15.7:0/4063333216 conn(0x7f1fc806d170 msgr2=0x7f1fc80af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:47.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 shutdown_connections 2023-10-14T19:10:47.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:47.926+0000 7f1fcdbdd700 1 -- 172.21.15.7:0/4063333216 wait complete. 2023-10-14T19:10:47.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:48.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.066+0000 7f09f5dbb700 1 Processor -- start 2023-10-14T19:10:48.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.066+0000 7f09f5dbb700 1 -- start start 2023-10-14T19:10:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.066+0000 7f09f5dbb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09f0159c80 0x7f09f00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.066+0000 7f09f5dbb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00ce9d0 con 0x7f09f01598b0 2023-10-14T19:10:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.066+0000 7f09f5dbb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00af960 con 0x7f09f00cfe70 2023-10-14T19:10:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.066+0000 7f09f5dbb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00afc30 con 0x7f09f0159c80 2023-10-14T19:10:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ef7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f09f01598b0 0x7f09f00af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54528/0 (socket says 172.21.15.7:54528) 2023-10-14T19:10:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ef7fe700 1 -- 172.21.15.7:0/2792591605 learned_addr learned my addr 172.21.15.7:0/2792591605 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09eeffd700 1 --2- 172.21.15.7:0/2792591605 >> v2:172.21.15.148:3300/0 conn(0x7f09f0159c80 0x7f09f00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185525198 0 0) 0x7f09f00ce9d0 con 0x7f09f01598b0 2023-10-14T19:10:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d8003570 con 0x7f09f01598b0 2023-10-14T19:10:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811444653 0 0) 0x7f09d8003570 con 0x7f09f01598b0 2023-10-14T19:10:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 >> v2:172.21.15.148:3300/0 conn(0x7f09f0159c80 msgr2=0x7f09f00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 --2- 172.21.15.7:0/2792591605 >> v2:172.21.15.148:3300/0 conn(0x7f09f0159c80 0x7f09f00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 >> v1:172.21.15.148:6789/0 conn(0x7f09f00cfe70 legacy=0x7f09f0163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00aff10 con 0x7f09f01598b0 2023-10-14T19:10:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f09e0001470 con 0x7f09f01598b0 2023-10-14T19:10:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09eeffd700 1 --2- 172.21.15.7:0/2792591605 >> v2:172.21.15.148:3300/0 conn(0x7f09f0159c80 0x7f09f00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 >> v1:172.21.15.7:6789/0 conn(0x7f09f01598b0 legacy=0x7f09f00af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d8004810 0x7f09d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d80051c0 0x7f09d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00afc30 con 0x7f09d8003a60 2023-10-14T19:10:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d800c0d0 con 0x7f09d80051c0 2023-10-14T19:10:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d800c290 con 0x7f09d8004810 2023-10-14T19:10:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.067+0000 7f09effff700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d80051c0 0x7f09d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09eeffd700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d8004810 0x7f09d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ef7fe700 1 -- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d8004810 msgr2=0x7f09d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d8004810 0x7f09d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ef7fe700 1 -- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d80051c0 msgr2=0x7f09d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d80051c0 0x7f09d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09effff700 1 -- 172.21.15.7:0/2792591605 reap_dead start 2023-10-14T19:10:48.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ef7fe700 1 -- 172.21.15.7:0/2792591605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8003570 con 0x7f09d8003a60 2023-10-14T19:10:48.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09d8003e70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f09e000c3c0 tx=0x7f09e0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc0de0a776155b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000cc90 con 0x7f09d8003a60 2023-10-14T19:10:48.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000cdf0 con 0x7f09d8003a60 2023-10-14T19:10:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09ee7fc700 1 -- 172.21.15.7:0/2792591605 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0005b70 con 0x7f09d8003a60 2023-10-14T19:10:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09f5dbb700 1 -- 172.21.15.7:0/2792591605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 msgr2=0x7f09d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09d8003e70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f09e000c3c0 tx=0x7f09e0001e50 comp rx=0 tx=0).stop 2023-10-14T19:10:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09f5dbb700 1 -- 172.21.15.7:0/2792591605 shutdown_connections 2023-10-14T19:10:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/2792591605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09d8003e70 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.068+0000 7f09f5dbb700 1 -- 172.21.15.7:0/2792591605 >> 172.21.15.7:0/2792591605 conn(0x7f09f0070e30 msgr2=0x7f09f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.069+0000 7f09f5dbb700 1 -- 172.21.15.7:0/2792591605 shutdown_connections 2023-10-14T19:10:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.069+0000 7f09f5dbb700 1 -- 172.21.15.7:0/2792591605 wait complete. 2023-10-14T19:10:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.070+0000 7f09f5dbb700 1 Processor -- start 2023-10-14T19:10:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.070+0000 7f09f5dbb700 1 -- start start 2023-10-14T19:10:48.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.070+0000 7f09f5dbb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09f015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.070+0000 7f09f5dbb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09f014b610 0x7f09f015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09f5dbb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09f0153220 0x7f09f0153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09f5dbb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00b5ab0 con 0x7f09d8003a60 2023-10-14T19:10:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09f5dbb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0154a40 con 0x7f09f014b610 2023-10-14T19:10:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09f5dbb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0153bd0 con 0x7f09f0153220 2023-10-14T19:10:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09f015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09f015f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45180/0 (socket says 172.21.15.7:45180) 2023-10-14T19:10:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 -- 172.21.15.7:0/4078322149 learned_addr learned my addr 172.21.15.7:0/4078322149 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09eeffd700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09f014b610 0x7f09f015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09effff700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09f0153220 0x7f09f0153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 -- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09f0153220 msgr2=0x7f09f0153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09f0153220 0x7f09f0153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 -- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09f014b610 msgr2=0x7f09f015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09f014b610 0x7f09f015fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 -- 172.21.15.7:0/4078322149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0153e30 con 0x7f09d8003a60 2023-10-14T19:10:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09ef7fe700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09f015f730 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f09e0001e90 tx=0x7f09e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0001540 con 0x7f09d8003a60 2023-10-14T19:10:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e00070d0 con 0x7f09d8003a60 2023-10-14T19:10:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f0154110 con 0x7f09d8003a60 2023-10-14T19:10:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e00074b0 con 0x7f09d8003a60 2023-10-14T19:10:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.071+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f01546d0 con 0x7f09d8003a60 2023-10-14T19:10:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.072+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f004c3c0 con 0x7f09d8003a60 2023-10-14T19:10:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.073+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f09e001e430 con 0x7f09d8003a60 2023-10-14T19:10:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.073+0000 7f09d77fe700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09dc067320 0x7f09dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.073+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09e0085540 con 0x7f09d8003a60 2023-10-14T19:10:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.073+0000 7f09eeffd700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09dc067320 0x7f09dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.074+0000 7f09eeffd700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09dc067320 0x7f09dc0697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f09e40093f0 tx=0x7f09e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.077+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09e0052280 con 0x7f09d8003a60 2023-10-14T19:10:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.320+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f00ce380 con 0x7f09d8003a60 2023-10-14T19:10:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.321+0000 7f09d77fe700 1 -- 172.21.15.7:0/4078322149 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4594 (secure 0 0 0) 0x7f09e00558a0 con 0x7f09d8003a60 2023-10-14T19:10:48.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:48.322 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:44.293797+0000","modified":"2023-10-14T19:10:47.918922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7869":{"gid":7869,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/302383037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":302383037},{"type":"v1","addr":"172.21.15.7:6835","nonce":302383037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-14T19:10:48.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09dc067320 msgr2=0x7f09dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09dc067320 0x7f09dc0697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f09e40093f0 tx=0x7f09e4008040 comp rx=0 tx=0).stop 2023-10-14T19:10:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 msgr2=0x7f09f015f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09f015f730 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f09e0001e90 tx=0x7f09e0015000 comp rx=0 tx=0).stop 2023-10-14T19:10:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 shutdown_connections 2023-10-14T19:10:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09dc067320 0x7f09dc0697d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09f0153220 0x7f09f0153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d8003a60 0x7f09f015f730 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 --2- 172.21.15.7:0/4078322149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09f014b610 0x7f09f015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 >> 172.21.15.7:0/4078322149 conn(0x7f09f0070e30 msgr2=0x7f09f00b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 shutdown_connections 2023-10-14T19:10:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.323+0000 7f09f5dbb700 1 -- 172.21.15.7:0/4078322149 wait complete. 2023-10-14T19:10:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 102 2023-10-14T19:10:48.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.454+0000 7fcd57861700 1 Processor -- start 2023-10-14T19:10:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.455+0000 7fcd57861700 1 -- start start 2023-10-14T19:10:48.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.455+0000 7fcd57861700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcd500b07d0 0x7fcd500ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.455+0000 7fcd57861700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500cf200 0x7fcd500cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.455+0000 7fcd57861700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5015a280 con 0x7fcd500b0ba0 2023-10-14T19:10:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.455+0000 7fcd57861700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5006e180 con 0x7fcd500b07d0 2023-10-14T19:10:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.455+0000 7fcd57861700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500cd540 con 0x7fcd500cf200 2023-10-14T19:10:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd555fd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcd500b07d0 0x7fcd500ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd55dfe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcd500b0ba0 0x7fcd5006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54544/0 (socket says 172.21.15.7:54544) 2023-10-14T19:10:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd55dfe700 1 -- 172.21.15.7:0/458815746 learned_addr learned my addr 172.21.15.7:0/458815746 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd54dfc700 1 --2- 172.21.15.7:0/458815746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500cf200 0x7fcd500cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd555fd700 1 -- 172.21.15.7:0/458815746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500cf200 msgr2=0x7fcd500cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd555fd700 1 --2- 172.21.15.7:0/458815746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500cf200 0x7fcd500cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd555fd700 1 -- 172.21.15.7:0/458815746 >> v1:172.21.15.7:6789/0 conn(0x7fcd500b0ba0 legacy=0x7fcd5006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd555fd700 1 -- 172.21.15.7:0/458815746 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5006d850 con 0x7fcd500b07d0 2023-10-14T19:10:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd4ffff700 1 -- 172.21.15.7:0/458815746 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260375680 0 0) 0x7fcd5015a280 con 0x7fcd500b0ba0 2023-10-14T19:10:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd555fd700 1 --2- 172.21.15.7:0/458815746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500ccac0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098d0 tx=0x7fcd48009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ebdf76df89eb84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd4ffff700 1 -- 172.21.15.7:0/458815746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48009e70 con 0x7fcd500b07d0 2023-10-14T19:10:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd4ffff700 1 -- 172.21.15.7:0/458815746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48005c10 con 0x7fcd500b07d0 2023-10-14T19:10:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.456+0000 7fcd4ffff700 1 -- 172.21.15.7:0/458815746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800b6e0 con 0x7fcd500b07d0 2023-10-14T19:10:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 -- 172.21.15.7:0/458815746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 msgr2=0x7fcd500ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 --2- 172.21.15.7:0/458815746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500ccac0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098d0 tx=0x7fcd48009120 comp rx=0 tx=0).stop 2023-10-14T19:10:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 -- 172.21.15.7:0/458815746 shutdown_connections 2023-10-14T19:10:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 --2- 172.21.15.7:0/458815746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500ccac0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 --2- 172.21.15.7:0/458815746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500cf200 0x7fcd500cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 -- 172.21.15.7:0/458815746 >> 172.21.15.7:0/458815746 conn(0x7fcd5006ce80 msgr2=0x7fcd500ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 -- 172.21.15.7:0/458815746 shutdown_connections 2023-10-14T19:10:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.457+0000 7fcd57861700 1 -- 172.21.15.7:0/458815746 wait complete. 2023-10-14T19:10:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.458+0000 7fcd57861700 1 Processor -- start 2023-10-14T19:10:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.458+0000 7fcd57861700 1 -- start start 2023-10-14T19:10:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd57861700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd57861700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500b0ba0 0x7fcd50154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd57861700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd500cf200 0x7fcd500c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd57861700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c7760 con 0x7fcd500b07d0 2023-10-14T19:10:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd57861700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50155ef0 con 0x7fcd500cf200 2023-10-14T19:10:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd57861700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c5c50 con 0x7fcd500b0ba0 2023-10-14T19:10:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45204/0 (socket says 172.21.15.7:45204) 2023-10-14T19:10:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 -- 172.21.15.7:0/157354468 learned_addr learned my addr 172.21.15.7:0/157354468 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 -- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500b0ba0 msgr2=0x7fcd50154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500b0ba0 0x7fcd50154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 -- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd500cf200 msgr2=0x7fcd500c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd500cf200 0x7fcd500c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.459+0000 7fcd555fd700 1 -- 172.21.15.7:0/157354468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd480093c0 con 0x7fcd500b07d0 2023-10-14T19:10:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.460+0000 7fcd555fd700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500c55c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fcd48002f90 tx=0x7fcd48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.460+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48006540 con 0x7fcd500b07d0 2023-10-14T19:10:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.460+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd480066a0 con 0x7fcd500b07d0 2023-10-14T19:10:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.460+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011420 con 0x7fcd500b07d0 2023-10-14T19:10:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.460+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500c5f30 con 0x7fcd500b07d0 2023-10-14T19:10:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.460+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500c64f0 con 0x7fcd500b07d0 2023-10-14T19:10:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.461+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5004c3c0 con 0x7fcd500b07d0 2023-10-14T19:10:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.461+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcd48011810 con 0x7fcd500b07d0 2023-10-14T19:10:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.462+0000 7fcd4d7fa700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd3c067320 0x7fcd3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.462+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd48086540 con 0x7fcd500b07d0 2023-10-14T19:10:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.462+0000 7fcd54dfc700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd3c067320 0x7fcd3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.462+0000 7fcd54dfc700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd3c067320 0x7fcd3c0697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcd5016d180 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.466+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd480531d0 con 0x7fcd500b07d0 2023-10-14T19:10:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.661+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd5006db30 con 0x7fcd500b07d0 2023-10-14T19:10:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.661+0000 7fcd4d7fa700 1 -- 172.21.15.7:0/157354468 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fcd480567f0 con 0x7fcd500b07d0 2023-10-14T19:10:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:48.663 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":153,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:45.881332+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:42.068244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:43.264160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:10:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd3c067320 msgr2=0x7fcd3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd3c067320 0x7fcd3c0697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcd5016d180 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2023-10-14T19:10:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 msgr2=0x7fcd500c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500c55c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fcd48002f90 tx=0x7fcd48016000 comp rx=0 tx=0).stop 2023-10-14T19:10:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 shutdown_connections 2023-10-14T19:10:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd3c067320 0x7fcd3c0697d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd500cf200 0x7fcd500c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd500b07d0 0x7fcd500c55c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 --2- 172.21.15.7:0/157354468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd500b0ba0 0x7fcd50154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 >> 172.21.15.7:0/157354468 conn(0x7fcd5006ce80 msgr2=0x7fcd500c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:48.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 shutdown_connections 2023-10-14T19:10:48.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.664+0000 7fcd57861700 1 -- 172.21.15.7:0/157354468 wait complete. 2023-10-14T19:10:48.677 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:10:48.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.796+0000 7f2e34ed3700 1 Processor -- start 2023-10-14T19:10:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.796+0000 7f2e34ed3700 1 -- start start 2023-10-14T19:10:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e34ed3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e30153c30 0x7f2e3015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e34ed3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e3015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e34ed3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3015afd0 con 0x7f2e3015de50 2023-10-14T19:10:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e34ed3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3015b2b0 con 0x7f2e30153c30 2023-10-14T19:10:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e34ed3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3015b590 con 0x7f2e300cf110 2023-10-14T19:10:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2f7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e30153c30 0x7f2e3015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2e3015de50 0x7f2e300cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54558/0 (socket says 172.21.15.7:54558) 2023-10-14T19:10:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2effd700 1 -- 172.21.15.7:0/3140877414 learned_addr learned my addr 172.21.15.7:0/3140877414 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:48.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2f7fe700 1 -- 172.21.15.7:0/3140877414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 msgr2=0x7f2e3015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:48.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2ffff700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e3015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2f7fe700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e3015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2e7fc700 1 -- 172.21.15.7:0/3140877414 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015900884 0 0) 0x7f2e3015afd0 con 0x7f2e3015de50 2023-10-14T19:10:48.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2f7fe700 1 -- 172.21.15.7:0/3140877414 >> v1:172.21.15.7:6789/0 conn(0x7f2e3015de50 legacy=0x7f2e300cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.797+0000 7f2e2f7fe700 1 -- 172.21.15.7:0/3140877414 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3015b870 con 0x7f2e30153c30 2023-10-14T19:10:48.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e2ffff700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e3015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:48.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e2f7fe700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e3015a5e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098e0 tx=0x7f2e200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fd80d7c83944e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e2e7fc700 1 -- 172.21.15.7:0/3140877414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20009e80 con 0x7f2e30153c30 2023-10-14T19:10:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e2e7fc700 1 -- 172.21.15.7:0/3140877414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2000b860 con 0x7f2e30153c30 2023-10-14T19:10:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e2e7fc700 1 -- 172.21.15.7:0/3140877414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000bbe0 con 0x7f2e30153c30 2023-10-14T19:10:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 -- 172.21.15.7:0/3140877414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 msgr2=0x7f2e3015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e3015a5e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098e0 tx=0x7f2e200091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 -- 172.21.15.7:0/3140877414 shutdown_connections 2023-10-14T19:10:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e3015a5e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/3140877414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e3015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 -- 172.21.15.7:0/3140877414 >> 172.21.15.7:0/3140877414 conn(0x7f2e300703a0 msgr2=0x7f2e300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 -- 172.21.15.7:0/3140877414 shutdown_connections 2023-10-14T19:10:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.798+0000 7f2e34ed3700 1 -- 172.21.15.7:0/3140877414 wait complete. 2023-10-14T19:10:48.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 Processor -- start 2023-10-14T19:10:48.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 -- start start 2023-10-14T19:10:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e301526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e300b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3015de50 0x7f2e300b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30152c00 con 0x7f2e30153c30 2023-10-14T19:10:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30151620 con 0x7f2e3015de50 2023-10-14T19:10:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e34ed3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30151900 con 0x7f2e300cf110 2023-10-14T19:10:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e300b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e300b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45220/0 (socket says 172.21.15.7:45220) 2023-10-14T19:10:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.800+0000 7f2e2effd700 1 -- 172.21.15.7:0/2247326475 learned_addr learned my addr 172.21.15.7:0/2247326475 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2f7fe700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e301526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2effd700 1 -- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 msgr2=0x7f2e301526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2ffff700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3015de50 0x7f2e300b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2effd700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e301526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2effd700 1 -- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3015de50 msgr2=0x7f2e300b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2effd700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3015de50 0x7f2e300b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2effd700 1 -- 172.21.15.7:0/2247326475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009420 con 0x7f2e30153c30 2023-10-14T19:10:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e2effd700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e300b5740 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c5b0 tx=0x7f2e24001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24005b30 con 0x7f2e30153c30 2023-10-14T19:10:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24005c90 con 0x7f2e30153c30 2023-10-14T19:10:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e30151be0 con 0x7f2e30153c30 2023-10-14T19:10:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24007300 con 0x7f2e30153c30 2023-10-14T19:10:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.801+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301521a0 con 0x7f2e30153c30 2023-10-14T19:10:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.802+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e301523c0 con 0x7f2e30153c30 2023-10-14T19:10:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.802+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2e240076b0 con 0x7f2e30153c30 2023-10-14T19:10:48.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.803+0000 7f2e177fe700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e1c067320 0x7f2e1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:48.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.803+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e24084160 con 0x7f2e30153c30 2023-10-14T19:10:48.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.803+0000 7f2e2f7fe700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e1c067320 0x7f2e1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:48.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.804+0000 7f2e2f7fe700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e1c067320 0x7f2e1c0697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2e3015a2e0 tx=0x7f2e20017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:48.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.807+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e24050df0 con 0x7f2e30153c30 2023-10-14T19:10:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:48.995+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e3004c3c0 con 0x7f2e1c067320 2023-10-14T19:10:49.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.003+0000 7f2e177fe700 1 -- 172.21.15.7:0/2247326475 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275103 (secure 0 0 0) 0x7f2e3004c3c0 con 0x7f2e1c067320 2023-10-14T19:10:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e1c067320 msgr2=0x7f2e1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e1c067320 0x7f2e1c0697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2e3015a2e0 tx=0x7f2e20017000 comp rx=0 tx=0).stop 2023-10-14T19:10:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 msgr2=0x7f2e300b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e300b5740 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c5b0 tx=0x7f2e24001070 comp rx=0 tx=0).stop 2023-10-14T19:10:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 shutdown_connections 2023-10-14T19:10:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2e1c067320 0x7f2e1c0697d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3015de50 0x7f2e300b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e300cf110 0x7f2e301526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 --2- 172.21.15.7:0/2247326475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e30153c30 0x7f2e300b5740 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 >> 172.21.15.7:0/2247326475 conn(0x7f2e300703a0 msgr2=0x7f2e300c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 shutdown_connections 2023-10-14T19:10:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.006+0000 7f2e34ed3700 1 -- 172.21.15.7:0/2247326475 wait complete. 2023-10-14T19:10:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2023-10-14T19:10:47.732383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2426984,"kb_used_data":15912,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547736,"statfs":{"total":773094113280,"available":770608881664,"internally_reserved":0,"allocated":16293888,"data_stored":7909960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.860271"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T19:10:40.116341+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:40.116341+0000","last_peered":"2023-10-14T19:10:40.116341+0000","last_clean":"2023-10-14T19:10:40.116341+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:40.116341+0000","last_undegraded":"2023-10-14T19:10:40.116341+0000","last_fullsized":"2023-10-14T19:10:40.116341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2482176,"data_stored":1431521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.505}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.53500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.749}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.628}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.309}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.40500000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.46899999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.495}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2482176,"data_stored":1431521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.44}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.35099999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.495},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.629}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.311}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.67900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.505}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.33200000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.443}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76700000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:49.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:49.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.178+0000 7ff3507ae700 1 Processor -- start 2023-10-14T19:10:49.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.178+0000 7ff3507ae700 1 -- start start 2023-10-14T19:10:49.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff3507ae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3480cb970 0x7ff348159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff3507ae700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff34815a400 0x7ff348156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff3507ae700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34815ae40 con 0x7ff3480cb5a0 2023-10-14T19:10:49.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff3507ae700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3480ce0f0 con 0x7ff34815a400 2023-10-14T19:10:49.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff3507ae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480cbde0 con 0x7ff3480cb970 2023-10-14T19:10:49.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff34ed4b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff34815a400 0x7ff348156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff34ed4b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff34815a400 0x7ff348156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45224/0 (socket says 172.21.15.7:45224) 2023-10-14T19:10:49.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.179+0000 7ff34ed4b700 1 -- 172.21.15.7:0/2944070788 learned_addr learned my addr 172.21.15.7:0/2944070788 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:49.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34dd49700 1 --2- 172.21.15.7:0/2944070788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3480cb970 0x7ff348159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34ed4b700 1 -- 172.21.15.7:0/2944070788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3480cb970 msgr2=0x7ff348159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:49.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34ed4b700 1 --2- 172.21.15.7:0/2944070788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3480cb970 0x7ff348159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34ed4b700 1 -- 172.21.15.7:0/2944070788 >> v1:172.21.15.148:6789/0 conn(0x7ff3480cb5a0 legacy=0x7ff3480cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:49.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34ed4b700 1 -- 172.21.15.7:0/2944070788 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34815ab60 con 0x7ff34815a400 2023-10-14T19:10:49.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34ed4b700 1 --2- 172.21.15.7:0/2944070788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff34815a400 0x7ff348156e90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff3380099e0 tx=0x7ff338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6583910eab440a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34d548700 1 -- 172.21.15.7:0/2944070788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800b7e0 con 0x7ff34815a400 2023-10-14T19:10:49.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34d548700 1 -- 172.21.15.7:0/2944070788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800b940 con 0x7ff34815a400 2023-10-14T19:10:49.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff34d548700 1 -- 172.21.15.7:0/2944070788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800bce0 con 0x7ff34815a400 2023-10-14T19:10:49.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff3507ae700 1 -- 172.21.15.7:0/2944070788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff34815a400 msgr2=0x7ff348156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.180+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2944070788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff34815a400 0x7ff348156e90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff3380099e0 tx=0x7ff338009250 comp rx=0 tx=0).stop 2023-10-14T19:10:49.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.181+0000 7ff3507ae700 1 -- 172.21.15.7:0/2944070788 shutdown_connections 2023-10-14T19:10:49.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.181+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2944070788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff34815a400 0x7ff348156e90 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.181+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2944070788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3480cb970 0x7ff348159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.181+0000 7ff3507ae700 1 -- 172.21.15.7:0/2944070788 >> 172.21.15.7:0/2944070788 conn(0x7ff348070e30 msgr2=0x7ff3480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:49.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.181+0000 7ff3507ae700 1 -- 172.21.15.7:0/2944070788 shutdown_connections 2023-10-14T19:10:49.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.181+0000 7ff3507ae700 1 -- 172.21.15.7:0/2944070788 wait complete. 2023-10-14T19:10:49.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 Processor -- start 2023-10-14T19:10:49.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 -- start start 2023-10-14T19:10:49.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3480cb5a0 0x7ff3480b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.189 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 0x7ff3480b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff34815a400 0x7ff3480b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff348152350 con 0x7ff3480cb970 2023-10-14T19:10:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34815cfc0 con 0x7ff3480cb5a0 2023-10-14T19:10:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.182+0000 7ff3507ae700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34815d2a0 con 0x7ff34815a400 2023-10-14T19:10:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 0x7ff3480b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 0x7ff3480b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45228/0 (socket says 172.21.15.7:45228) 2023-10-14T19:10:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 -- 172.21.15.7:0/2142427472 learned_addr learned my addr 172.21.15.7:0/2142427472 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34e54a700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3480cb5a0 0x7ff3480b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34ed4b700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff34815a400 0x7ff3480b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 -- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff34815a400 msgr2=0x7ff3480b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff34815a400 0x7ff3480b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 -- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3480cb5a0 msgr2=0x7ff3480b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3480cb5a0 0x7ff3480b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 -- 172.21.15.7:0/2142427472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380094f0 con 0x7ff3480cb970 2023-10-14T19:10:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff34dd49700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 0x7ff3480b4c20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00d890 tx=0x7ff33c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0125f0 con 0x7ff3480cb970 2023-10-14T19:10:49.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c012750 con 0x7ff3480cb970 2023-10-14T19:10:49.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34815d580 con 0x7ff3480cb970 2023-10-14T19:10:49.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c012af0 con 0x7ff3480cb970 2023-10-14T19:10:49.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.183+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3480b6350 con 0x7ff3480cb970 2023-10-14T19:10:49.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.184+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3480c7850 con 0x7ff3480cb970 2023-10-14T19:10:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.185+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff33c01e460 con 0x7ff3480cb970 2023-10-14T19:10:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.185+0000 7ff3467fc700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff334067320 0x7ff3340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.185+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff33c0850d0 con 0x7ff3480cb970 2023-10-14T19:10:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.185+0000 7ff34e54a700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff334067320 0x7ff3340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.186+0000 7ff34e54a700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff334067320 0x7ff3340697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff340007fd0 tx=0x7ff3400026a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.189+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3480c7850 con 0x7ff3480cb970 2023-10-14T19:10:49.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:10:49.294 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:10:49.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.378+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3480c7850 con 0x7ff334067320 2023-10-14T19:10:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.386+0000 7ff3467fc700 1 -- 172.21.15.7:0/2142427472 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275103 (secure 0 0 0) 0x7ff3480c7850 con 0x7ff334067320 2023-10-14T19:10:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:49.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff334067320 msgr2=0x7ff3340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff334067320 0x7ff3340697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff340007fd0 tx=0x7ff3400026a0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 msgr2=0x7ff3480b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 0x7ff3480b4c20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00d890 tx=0x7ff33c008040 comp rx=0 tx=0).stop 2023-10-14T19:10:49.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 shutdown_connections 2023-10-14T19:10:49.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff334067320 0x7ff3340697d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3480cb5a0 0x7ff3480b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff34815a400 0x7ff3480b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 --2- 172.21.15.7:0/2142427472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3480cb970 0x7ff3480b4c20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 >> 172.21.15.7:0/2142427472 conn(0x7ff348070e30 msgr2=0x7ff3480c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 shutdown_connections 2023-10-14T19:10:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.389+0000 7ff3507ae700 1 -- 172.21.15.7:0/2142427472 wait complete. 2023-10-14T19:10:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:49.401 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2023-10-14T19:10:47.732383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2426984,"kb_used_data":15912,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547736,"statfs":{"total":773094113280,"available":770608881664,"internally_reserved":0,"allocated":16293888,"data_stored":7909960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.860271"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:43.871650+0000","last_change":"2023-10-14T19:10:43.871650+0000","last_active":"2023-10-14T19:10:43.871650+0000","last_peered":"2023-10-14T19:10:43.871650+0000","last_clean":"2023-10-14T19:10:43.871650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:43.871650+0000","last_undegraded":"2023-10-14T19:10:43.871650+0000","last_fullsized":"2023-10-14T19:10:43.871650+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:10:42.866774+0000","last_change":"2023-10-14T19:10:42.866774+0000","last_active":"2023-10-14T19:10:42.866774+0000","last_peered":"2023-10-14T19:10:42.866774+0000","last_clean":"2023-10-14T19:10:42.866774+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:10:42.866774+0000","last_undegraded":"2023-10-14T19:10:42.866774+0000","last_fullsized":"2023-10-14T19:10:42.866774+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T19:10:40.116341+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:40.116341+0000","last_peered":"2023-10-14T19:10:40.116341+0000","last_clean":"2023-10-14T19:10:40.116341+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:40.116341+0000","last_undegraded":"2023-10-14T19:10:40.116341+0000","last_fullsized":"2023-10-14T19:10:40.116341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2482176,"data_stored":1431521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.505}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.53500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.749}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.628}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.309}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.40500000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.46899999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.495}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2482176,"data_stored":1431521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.44}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.35099999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.495},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.629}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.311}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.67900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.505}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.33200000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.443}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303228,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068612,"statfs":{"total":96636764160,"available":96326258688,"internally_reserved":0,"allocated":1888256,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76700000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:49.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:49.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.560+0000 7efeaf7a3700 1 Processor -- start 2023-10-14T19:10:49.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.560+0000 7efeaf7a3700 1 -- start start 2023-10-14T19:10:49.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efeaf7a3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efea80cb5a0 0x7efea80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efeaf7a3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efeaf7a3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea815ae40 con 0x7efea80cd9e0 2023-10-14T19:10:49.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efeaf7a3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80d13f0 con 0x7efea80cb5a0 2023-10-14T19:10:49.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efeaf7a3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea815ab60 con 0x7efea815a5d0 2023-10-14T19:10:49.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efead53f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efea80cb5a0 0x7efea80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efead53f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efea80cb5a0 0x7efea80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45242/0 (socket says 172.21.15.7:45242) 2023-10-14T19:10:49.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.561+0000 7efead53f700 1 -- 172.21.15.7:0/2219983715 learned_addr learned my addr 172.21.15.7:0/2219983715 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:49.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efeadd40700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efead53f700 1 -- 172.21.15.7:0/2219983715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 msgr2=0x7efea8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:49.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efead53f700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efead53f700 1 -- 172.21.15.7:0/2219983715 >> v1:172.21.15.148:6789/0 conn(0x7efea80cd9e0 legacy=0x7efea8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:49.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efead53f700 1 -- 172.21.15.7:0/2219983715 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80ccf00 con 0x7efea80cb5a0 2023-10-14T19:10:49.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efeadd40700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efead53f700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cb970 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7efea00099e0 tx=0x7efea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1784f17253fbbc60 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efea7fff700 1 -- 172.21.15.7:0/2219983715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000b820 con 0x7efea80cb5a0 2023-10-14T19:10:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efea7fff700 1 -- 172.21.15.7:0/2219983715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea000b980 con 0x7efea80cb5a0 2023-10-14T19:10:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efea7fff700 1 -- 172.21.15.7:0/2219983715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000bd20 con 0x7efea80cb5a0 2023-10-14T19:10:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efeaf7a3700 1 -- 172.21.15.7:0/2219983715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 msgr2=0x7efea80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.562+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cb970 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7efea00099e0 tx=0x7efea0009250 comp rx=0 tx=0).stop 2023-10-14T19:10:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.563+0000 7efeaf7a3700 1 -- 172.21.15.7:0/2219983715 shutdown_connections 2023-10-14T19:10:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.563+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.563+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/2219983715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cb970 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.563+0000 7efeaf7a3700 1 -- 172.21.15.7:0/2219983715 >> 172.21.15.7:0/2219983715 conn(0x7efea8070e30 msgr2=0x7efea80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:49.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.563+0000 7efeaf7a3700 1 -- 172.21.15.7:0/2219983715 shutdown_connections 2023-10-14T19:10:49.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.563+0000 7efeaf7a3700 1 -- 172.21.15.7:0/2219983715 wait complete. 2023-10-14T19:10:49.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.564+0000 7efeaf7a3700 1 Processor -- start 2023-10-14T19:10:49.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.564+0000 7efeaf7a3700 1 -- start start 2023-10-14T19:10:49.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efea80cd9e0 0x7efea81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8157a10 con 0x7efea80cb5a0 2023-10-14T19:10:49.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8156e00 con 0x7efea80cd9e0 2023-10-14T19:10:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea81570e0 con 0x7efea815a5d0 2023-10-14T19:10:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45256/0 (socket says 172.21.15.7:45256) 2023-10-14T19:10:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 -- 172.21.15.7:0/1946096897 learned_addr learned my addr 172.21.15.7:0/1946096897 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeacd3e700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efea80cd9e0 0x7efea81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeadd40700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 -- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 msgr2=0x7efea815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 -- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efea80cd9e0 msgr2=0x7efea81525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efea80cd9e0 0x7efea81525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 -- 172.21.15.7:0/1946096897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00094f0 con 0x7efea80cb5a0 2023-10-14T19:10:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeacd3e700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efea80cd9e0 0x7efea81525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efead53f700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cf800 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7efea806ea60 tx=0x7efea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea001a630 con 0x7efea80cb5a0 2023-10-14T19:10:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea001a790 con 0x7efea80cb5a0 2023-10-14T19:10:49.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea81573c0 con 0x7efea80cb5a0 2023-10-14T19:10:49.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea001ab50 con 0x7efea80cb5a0 2023-10-14T19:10:49.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.565+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea8152b30 con 0x7efea80cb5a0 2023-10-14T19:10:49.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.566+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea804c3c0 con 0x7efea80cb5a0 2023-10-14T19:10:49.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.567+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efea002d440 con 0x7efea80cb5a0 2023-10-14T19:10:49.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.567+0000 7efea57fa700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe94067320 0x7efe940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.567+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efea00868c0 con 0x7efea80cb5a0 2023-10-14T19:10:49.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.568+0000 7efeacd3e700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe94067320 0x7efe940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.568+0000 7efeacd3e700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe94067320 0x7efe940697d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efe9c007fd0 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.572+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efea0053550 con 0x7efea80cb5a0 2023-10-14T19:10:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.761+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efea80cd1e0 con 0x7efe94067320 2023-10-14T19:10:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.769+0000 7efea57fa700 1 -- 172.21.15.7:0/1946096897 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290313 (secure 0 0 0) 0x7efea80cd1e0 con 0x7efe94067320 2023-10-14T19:10:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.772+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe94067320 msgr2=0x7efe940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.772+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe94067320 0x7efe940697d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efe9c007fd0 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2023-10-14T19:10:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.772+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 msgr2=0x7efea80cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.772+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cf800 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7efea806ea60 tx=0x7efea0017000 comp rx=0 tx=0).stop 2023-10-14T19:10:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.772+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 shutdown_connections 2023-10-14T19:10:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe94067320 0x7efe940697d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efea815a5d0 0x7efea815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea80cb5a0 0x7efea80cf800 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 --2- 172.21.15.7:0/1946096897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efea80cd9e0 0x7efea81525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 >> 172.21.15.7:0/1946096897 conn(0x7efea8070e30 msgr2=0x7efea80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 shutdown_connections 2023-10-14T19:10:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.773+0000 7efeaf7a3700 1 -- 172.21.15.7:0/1946096897 wait complete. 2023-10-14T19:10:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:49.785 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2023-10-14T19:10:49.732844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427432,"kb_used_data":16360,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547288,"statfs":{"total":773094113280,"available":770608422912,"internally_reserved":0,"allocated":16752640,"data_stored":8115524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001262"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914375+0000","last_change":"2023-10-14T19:10:44.911246+0000","last_active":"2023-10-14T19:10:44.914375+0000","last_peered":"2023-10-14T19:10:44.914375+0000","last_clean":"2023-10-14T19:10:44.914375+0000","last_became_active":"2023-10-14T19:10:44.904491+0000","last_became_peered":"2023-10-14T19:10:44.904491+0000","last_unstale":"2023-10-14T19:10:44.914375+0000","last_undegraded":"2023-10-14T19:10:44.914375+0000","last_fullsized":"2023-10-14T19:10:44.914375+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:17.082005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909417+0000","last_change":"2023-10-14T19:10:44.906839+0000","last_active":"2023-10-14T19:10:44.909417+0000","last_peered":"2023-10-14T19:10:44.909417+0000","last_clean":"2023-10-14T19:10:44.909417+0000","last_became_active":"2023-10-14T19:10:44.906435+0000","last_became_peered":"2023-10-14T19:10:44.906435+0000","last_unstale":"2023-10-14T19:10:44.909417+0000","last_undegraded":"2023-10-14T19:10:44.909417+0000","last_fullsized":"2023-10-14T19:10:44.909417+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:47.837491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910169+0000","last_change":"2023-10-14T19:10:44.902918+0000","last_active":"2023-10-14T19:10:44.910169+0000","last_peered":"2023-10-14T19:10:44.910169+0000","last_clean":"2023-10-14T19:10:44.910169+0000","last_became_active":"2023-10-14T19:10:44.902513+0000","last_became_peered":"2023-10-14T19:10:44.902513+0000","last_unstale":"2023-10-14T19:10:44.910169+0000","last_undegraded":"2023-10-14T19:10:44.910169+0000","last_fullsized":"2023-10-14T19:10:44.910169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:37.177680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906259+0000","last_change":"2023-10-14T19:10:44.903497+0000","last_active":"2023-10-14T19:10:44.906259+0000","last_peered":"2023-10-14T19:10:44.906259+0000","last_clean":"2023-10-14T19:10:44.906259+0000","last_became_active":"2023-10-14T19:10:44.903214+0000","last_became_peered":"2023-10-14T19:10:44.903214+0000","last_unstale":"2023-10-14T19:10:44.906259+0000","last_undegraded":"2023-10-14T19:10:44.906259+0000","last_fullsized":"2023-10-14T19:10:44.906259+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:04:24.819286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905922+0000","last_change":"2023-10-14T19:10:44.898295+0000","last_active":"2023-10-14T19:10:44.905922+0000","last_peered":"2023-10-14T19:10:44.905922+0000","last_clean":"2023-10-14T19:10:44.905922+0000","last_became_active":"2023-10-14T19:10:44.898032+0000","last_became_peered":"2023-10-14T19:10:44.898032+0000","last_unstale":"2023-10-14T19:10:44.905922+0000","last_undegraded":"2023-10-14T19:10:44.905922+0000","last_fullsized":"2023-10-14T19:10:44.905922+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.471086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910169+0000","last_change":"2023-10-14T19:10:44.907219+0000","last_active":"2023-10-14T19:10:44.910169+0000","last_peered":"2023-10-14T19:10:44.910169+0000","last_clean":"2023-10-14T19:10:44.910169+0000","last_became_active":"2023-10-14T19:10:44.906890+0000","last_became_peered":"2023-10-14T19:10:44.906890+0000","last_unstale":"2023-10-14T19:10:44.910169+0000","last_undegraded":"2023-10-14T19:10:44.910169+0000","last_fullsized":"2023-10-14T19:10:44.910169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:56.776503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913703+0000","last_change":"2023-10-14T19:10:44.904440+0000","last_active":"2023-10-14T19:10:44.913703+0000","last_peered":"2023-10-14T19:10:44.913703+0000","last_clean":"2023-10-14T19:10:44.913703+0000","last_became_active":"2023-10-14T19:10:44.903875+0000","last_became_peered":"2023-10-14T19:10:44.903875+0000","last_unstale":"2023-10-14T19:10:44.913703+0000","last_undegraded":"2023-10-14T19:10:44.913703+0000","last_fullsized":"2023-10-14T19:10:44.913703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:24.780148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915009+0000","last_change":"2023-10-14T19:10:44.914161+0000","last_active":"2023-10-14T19:10:44.915009+0000","last_peered":"2023-10-14T19:10:44.915009+0000","last_clean":"2023-10-14T19:10:44.915009+0000","last_became_active":"2023-10-14T19:10:44.913883+0000","last_became_peered":"2023-10-14T19:10:44.913883+0000","last_unstale":"2023-10-14T19:10:44.915009+0000","last_undegraded":"2023-10-14T19:10:44.915009+0000","last_fullsized":"2023-10-14T19:10:44.915009+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:08.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909479+0000","last_change":"2023-10-14T19:10:44.904994+0000","last_active":"2023-10-14T19:10:44.909479+0000","last_peered":"2023-10-14T19:10:44.909479+0000","last_clean":"2023-10-14T19:10:44.909479+0000","last_became_active":"2023-10-14T19:10:44.904791+0000","last_became_peered":"2023-10-14T19:10:44.904791+0000","last_unstale":"2023-10-14T19:10:44.909479+0000","last_undegraded":"2023-10-14T19:10:44.909479+0000","last_fullsized":"2023-10-14T19:10:44.909479+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:26.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908388+0000","last_change":"2023-10-14T19:10:44.903088+0000","last_active":"2023-10-14T19:10:44.908388+0000","last_peered":"2023-10-14T19:10:44.908388+0000","last_clean":"2023-10-14T19:10:44.908388+0000","last_became_active":"2023-10-14T19:10:44.901631+0000","last_became_peered":"2023-10-14T19:10:44.901631+0000","last_unstale":"2023-10-14T19:10:44.908388+0000","last_undegraded":"2023-10-14T19:10:44.908388+0000","last_fullsized":"2023-10-14T19:10:44.908388+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:01.803614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910185+0000","last_change":"2023-10-14T19:10:44.903564+0000","last_active":"2023-10-14T19:10:44.910185+0000","last_peered":"2023-10-14T19:10:44.910185+0000","last_clean":"2023-10-14T19:10:44.910185+0000","last_became_active":"2023-10-14T19:10:44.903246+0000","last_became_peered":"2023-10-14T19:10:44.903246+0000","last_unstale":"2023-10-14T19:10:44.910185+0000","last_undegraded":"2023-10-14T19:10:44.910185+0000","last_fullsized":"2023-10-14T19:10:44.910185+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:05.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908114+0000","last_change":"2023-10-14T19:10:44.905038+0000","last_active":"2023-10-14T19:10:44.908114+0000","last_peered":"2023-10-14T19:10:44.908114+0000","last_clean":"2023-10-14T19:10:44.908114+0000","last_became_active":"2023-10-14T19:10:44.904751+0000","last_became_peered":"2023-10-14T19:10:44.904751+0000","last_unstale":"2023-10-14T19:10:44.908114+0000","last_undegraded":"2023-10-14T19:10:44.908114+0000","last_fullsized":"2023-10-14T19:10:44.908114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:06:29.018958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.901803+0000","last_change":"2023-10-14T19:10:44.898390+0000","last_active":"2023-10-14T19:10:44.901803+0000","last_peered":"2023-10-14T19:10:44.901803+0000","last_clean":"2023-10-14T19:10:44.901803+0000","last_became_active":"2023-10-14T19:10:44.897896+0000","last_became_peered":"2023-10-14T19:10:44.897896+0000","last_unstale":"2023-10-14T19:10:44.901803+0000","last_undegraded":"2023-10-14T19:10:44.901803+0000","last_fullsized":"2023-10-14T19:10:44.901803+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:03.906136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.892423+0000","last_change":"2023-10-14T19:10:44.891482+0000","last_active":"2023-10-14T19:10:44.892423+0000","last_peered":"2023-10-14T19:10:44.892423+0000","last_clean":"2023-10-14T19:10:44.892423+0000","last_became_active":"2023-10-14T19:10:44.891019+0000","last_became_peered":"2023-10-14T19:10:44.891019+0000","last_unstale":"2023-10-14T19:10:44.892423+0000","last_undegraded":"2023-10-14T19:10:44.892423+0000","last_fullsized":"2023-10-14T19:10:44.892423+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:36.134369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913306+0000","last_change":"2023-10-14T19:10:44.897953+0000","last_active":"2023-10-14T19:10:44.913306+0000","last_peered":"2023-10-14T19:10:44.913306+0000","last_clean":"2023-10-14T19:10:44.913306+0000","last_became_active":"2023-10-14T19:10:44.897621+0000","last_became_peered":"2023-10-14T19:10:44.897621+0000","last_unstale":"2023-10-14T19:10:44.913306+0000","last_undegraded":"2023-10-14T19:10:44.913306+0000","last_fullsized":"2023-10-14T19:10:44.913306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:35.400464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.898939+0000","last_change":"2023-10-14T19:10:44.895728+0000","last_active":"2023-10-14T19:10:44.898939+0000","last_peered":"2023-10-14T19:10:44.898939+0000","last_clean":"2023-10-14T19:10:44.898939+0000","last_became_active":"2023-10-14T19:10:44.895434+0000","last_became_peered":"2023-10-14T19:10:44.895434+0000","last_unstale":"2023-10-14T19:10:44.898939+0000","last_undegraded":"2023-10-14T19:10:44.898939+0000","last_fullsized":"2023-10-14T19:10:44.898939+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914349+0000","last_change":"2023-10-14T19:10:44.911025+0000","last_active":"2023-10-14T19:10:44.914349+0000","last_peered":"2023-10-14T19:10:44.914349+0000","last_clean":"2023-10-14T19:10:44.914349+0000","last_became_active":"2023-10-14T19:10:44.910691+0000","last_became_peered":"2023-10-14T19:10:44.910691+0000","last_unstale":"2023-10-14T19:10:44.914349+0000","last_undegraded":"2023-10-14T19:10:44.914349+0000","last_fullsized":"2023-10-14T19:10:44.914349+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:03.646566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.901491+0000","last_change":"2023-10-14T19:10:44.896191+0000","last_active":"2023-10-14T19:10:44.901491+0000","last_peered":"2023-10-14T19:10:44.901491+0000","last_clean":"2023-10-14T19:10:44.901491+0000","last_became_active":"2023-10-14T19:10:44.895915+0000","last_became_peered":"2023-10-14T19:10:44.895915+0000","last_unstale":"2023-10-14T19:10:44.901491+0000","last_undegraded":"2023-10-14T19:10:44.901491+0000","last_fullsized":"2023-10-14T19:10:44.901491+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:37.341940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909552+0000","last_change":"2023-10-14T19:10:44.903810+0000","last_active":"2023-10-14T19:10:44.909552+0000","last_peered":"2023-10-14T19:10:44.909552+0000","last_clean":"2023-10-14T19:10:44.909552+0000","last_became_active":"2023-10-14T19:10:44.903544+0000","last_became_peered":"2023-10-14T19:10:44.903544+0000","last_unstale":"2023-10-14T19:10:44.909552+0000","last_undegraded":"2023-10-14T19:10:44.909552+0000","last_fullsized":"2023-10-14T19:10:44.909552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:55:08.742523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906114+0000","last_change":"2023-10-14T19:10:44.903164+0000","last_active":"2023-10-14T19:10:44.906114+0000","last_peered":"2023-10-14T19:10:44.906114+0000","last_clean":"2023-10-14T19:10:44.906114+0000","last_became_active":"2023-10-14T19:10:44.902891+0000","last_became_peered":"2023-10-14T19:10:44.902891+0000","last_unstale":"2023-10-14T19:10:44.906114+0000","last_undegraded":"2023-10-14T19:10:44.906114+0000","last_fullsized":"2023-10-14T19:10:44.906114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:37.304748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906868+0000","last_change":"2023-10-14T19:10:44.903420+0000","last_active":"2023-10-14T19:10:44.906868+0000","last_peered":"2023-10-14T19:10:44.906868+0000","last_clean":"2023-10-14T19:10:44.906868+0000","last_became_active":"2023-10-14T19:10:44.903124+0000","last_became_peered":"2023-10-14T19:10:44.903124+0000","last_unstale":"2023-10-14T19:10:44.906868+0000","last_undegraded":"2023-10-14T19:10:44.906868+0000","last_fullsized":"2023-10-14T19:10:44.906868+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:56.241659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904555+0000","last_change":"2023-10-14T19:10:44.901471+0000","last_active":"2023-10-14T19:10:44.904555+0000","last_peered":"2023-10-14T19:10:44.904555+0000","last_clean":"2023-10-14T19:10:44.904555+0000","last_became_active":"2023-10-14T19:10:44.901180+0000","last_became_peered":"2023-10-14T19:10:44.901180+0000","last_unstale":"2023-10-14T19:10:44.904555+0000","last_undegraded":"2023-10-14T19:10:44.904555+0000","last_fullsized":"2023-10-14T19:10:44.904555+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:00.520236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902507+0000","last_change":"2023-10-14T19:10:44.893421+0000","last_active":"2023-10-14T19:10:44.902507+0000","last_peered":"2023-10-14T19:10:44.902507+0000","last_clean":"2023-10-14T19:10:44.902507+0000","last_became_active":"2023-10-14T19:10:44.893146+0000","last_became_peered":"2023-10-14T19:10:44.893146+0000","last_unstale":"2023-10-14T19:10:44.902507+0000","last_undegraded":"2023-10-14T19:10:44.902507+0000","last_fullsized":"2023-10-14T19:10:44.902507+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:37.332548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906190+0000","last_change":"2023-10-14T19:10:44.903652+0000","last_active":"2023-10-14T19:10:44.906190+0000","last_peered":"2023-10-14T19:10:44.906190+0000","last_clean":"2023-10-14T19:10:44.906190+0000","last_became_active":"2023-10-14T19:10:44.902806+0000","last_became_peered":"2023-10-14T19:10:44.902806+0000","last_unstale":"2023-10-14T19:10:44.906190+0000","last_undegraded":"2023-10-14T19:10:44.906190+0000","last_fullsized":"2023-10-14T19:10:44.906190+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:50.002060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912277+0000","last_change":"2023-10-14T19:10:44.909396+0000","last_active":"2023-10-14T19:10:44.912277+0000","last_peered":"2023-10-14T19:10:44.912277+0000","last_clean":"2023-10-14T19:10:44.912277+0000","last_became_active":"2023-10-14T19:10:44.909147+0000","last_became_peered":"2023-10-14T19:10:44.909147+0000","last_unstale":"2023-10-14T19:10:44.912277+0000","last_undegraded":"2023-10-14T19:10:44.912277+0000","last_fullsized":"2023-10-14T19:10:44.912277+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:40.735176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913439+0000","last_change":"2023-10-14T19:10:44.901848+0000","last_active":"2023-10-14T19:10:44.913439+0000","last_peered":"2023-10-14T19:10:44.913439+0000","last_clean":"2023-10-14T19:10:44.913439+0000","last_became_active":"2023-10-14T19:10:44.901608+0000","last_became_peered":"2023-10-14T19:10:44.901608+0000","last_unstale":"2023-10-14T19:10:44.913439+0000","last_undegraded":"2023-10-14T19:10:44.913439+0000","last_fullsized":"2023-10-14T19:10:44.913439+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:18.706521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908129+0000","last_change":"2023-10-14T19:10:44.905057+0000","last_active":"2023-10-14T19:10:44.908129+0000","last_peered":"2023-10-14T19:10:44.908129+0000","last_clean":"2023-10-14T19:10:44.908129+0000","last_became_active":"2023-10-14T19:10:44.904761+0000","last_became_peered":"2023-10-14T19:10:44.904761+0000","last_unstale":"2023-10-14T19:10:44.908129+0000","last_undegraded":"2023-10-14T19:10:44.908129+0000","last_fullsized":"2023-10-14T19:10:44.908129+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:26.308671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910510+0000","last_change":"2023-10-14T19:10:44.907311+0000","last_active":"2023-10-14T19:10:44.910510+0000","last_peered":"2023-10-14T19:10:44.910510+0000","last_clean":"2023-10-14T19:10:44.910510+0000","last_became_active":"2023-10-14T19:10:44.907027+0000","last_became_peered":"2023-10-14T19:10:44.907027+0000","last_unstale":"2023-10-14T19:10:44.910510+0000","last_undegraded":"2023-10-14T19:10:44.910510+0000","last_fullsized":"2023-10-14T19:10:44.910510+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:01.897170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910630+0000","last_change":"2023-10-14T19:10:44.907445+0000","last_active":"2023-10-14T19:10:44.910630+0000","last_peered":"2023-10-14T19:10:44.910630+0000","last_clean":"2023-10-14T19:10:44.910630+0000","last_became_active":"2023-10-14T19:10:44.907118+0000","last_became_peered":"2023-10-14T19:10:44.907118+0000","last_unstale":"2023-10-14T19:10:44.910630+0000","last_undegraded":"2023-10-14T19:10:44.910630+0000","last_fullsized":"2023-10-14T19:10:44.910630+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:04.771169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910173+0000","last_change":"2023-10-14T19:10:44.908434+0000","last_active":"2023-10-14T19:10:44.910173+0000","last_peered":"2023-10-14T19:10:44.910173+0000","last_clean":"2023-10-14T19:10:44.910173+0000","last_became_active":"2023-10-14T19:10:44.907576+0000","last_became_peered":"2023-10-14T19:10:44.907576+0000","last_unstale":"2023-10-14T19:10:44.910173+0000","last_undegraded":"2023-10-14T19:10:44.910173+0000","last_fullsized":"2023-10-14T19:10:44.910173+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:03.906136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902648+0000","last_change":"2023-10-14T19:10:44.897063+0000","last_active":"2023-10-14T19:10:44.902648+0000","last_peered":"2023-10-14T19:10:44.902648+0000","last_clean":"2023-10-14T19:10:44.902648+0000","last_became_active":"2023-10-14T19:10:44.896717+0000","last_became_peered":"2023-10-14T19:10:44.896717+0000","last_unstale":"2023-10-14T19:10:44.902648+0000","last_undegraded":"2023-10-14T19:10:44.902648+0000","last_fullsized":"2023-10-14T19:10:44.902648+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:46.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913437+0000","last_change":"2023-10-14T19:10:44.900657+0000","last_active":"2023-10-14T19:10:44.913437+0000","last_peered":"2023-10-14T19:10:44.913437+0000","last_clean":"2023-10-14T19:10:44.913437+0000","last_became_active":"2023-10-14T19:10:44.898256+0000","last_became_peered":"2023-10-14T19:10:44.898256+0000","last_unstale":"2023-10-14T19:10:44.913437+0000","last_undegraded":"2023-10-14T19:10:44.913437+0000","last_fullsized":"2023-10-14T19:10:44.913437+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:17:30.798848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912698+0000","last_change":"2023-10-14T19:10:44.910856+0000","last_active":"2023-10-14T19:10:44.912698+0000","last_peered":"2023-10-14T19:10:44.912698+0000","last_clean":"2023-10-14T19:10:44.912698+0000","last_became_active":"2023-10-14T19:10:44.910555+0000","last_became_peered":"2023-10-14T19:10:44.910555+0000","last_unstale":"2023-10-14T19:10:44.912698+0000","last_undegraded":"2023-10-14T19:10:44.912698+0000","last_fullsized":"2023-10-14T19:10:44.912698+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:29.089378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":14,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.907303+0000","last_change":"2023-10-14T19:10:43.897050+0000","last_active":"2023-10-14T19:10:44.907303+0000","last_peered":"2023-10-14T19:10:44.907303+0000","last_clean":"2023-10-14T19:10:44.907303+0000","last_became_active":"2023-10-14T19:10:43.896752+0000","last_became_peered":"2023-10-14T19:10:43.896752+0000","last_unstale":"2023-10-14T19:10:44.907303+0000","last_undegraded":"2023-10-14T19:10:44.907303+0000","last_fullsized":"2023-10-14T19:10:44.907303+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:00.892294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.895499+0000","last_change":"2023-10-14T19:10:44.892412+0000","last_active":"2023-10-14T19:10:44.895499+0000","last_peered":"2023-10-14T19:10:44.895499+0000","last_clean":"2023-10-14T19:10:44.895499+0000","last_became_active":"2023-10-14T19:10:44.892128+0000","last_became_peered":"2023-10-14T19:10:44.892128+0000","last_unstale":"2023-10-14T19:10:44.895499+0000","last_undegraded":"2023-10-14T19:10:44.895499+0000","last_fullsized":"2023-10-14T19:10:44.895499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:47.837491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908325+0000","last_change":"2023-10-14T19:10:43.899189+0000","last_active":"2023-10-14T19:10:44.908325+0000","last_peered":"2023-10-14T19:10:44.908325+0000","last_clean":"2023-10-14T19:10:44.908325+0000","last_became_active":"2023-10-14T19:10:43.898885+0000","last_became_peered":"2023-10-14T19:10:43.898885+0000","last_unstale":"2023-10-14T19:10:44.908325+0000","last_undegraded":"2023-10-14T19:10:44.908325+0000","last_fullsized":"2023-10-14T19:10:44.908325+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:17.594439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913351+0000","last_change":"2023-10-14T19:10:44.900339+0000","last_active":"2023-10-14T19:10:44.913351+0000","last_peered":"2023-10-14T19:10:44.913351+0000","last_clean":"2023-10-14T19:10:44.913351+0000","last_became_active":"2023-10-14T19:10:44.897971+0000","last_became_peered":"2023-10-14T19:10:44.897971+0000","last_unstale":"2023-10-14T19:10:44.913351+0000","last_undegraded":"2023-10-14T19:10:44.913351+0000","last_fullsized":"2023-10-14T19:10:44.913351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908066+0000","last_change":"2023-10-14T19:10:43.896205+0000","last_active":"2023-10-14T19:10:44.908066+0000","last_peered":"2023-10-14T19:10:44.908066+0000","last_clean":"2023-10-14T19:10:44.908066+0000","last_became_active":"2023-10-14T19:10:43.895957+0000","last_became_peered":"2023-10-14T19:10:43.895957+0000","last_unstale":"2023-10-14T19:10:44.908066+0000","last_undegraded":"2023-10-14T19:10:44.908066+0000","last_fullsized":"2023-10-14T19:10:44.908066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:48.097648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903373+0000","last_change":"2023-10-14T19:10:44.900932+0000","last_active":"2023-10-14T19:10:44.903373+0000","last_peered":"2023-10-14T19:10:44.903373+0000","last_clean":"2023-10-14T19:10:44.903373+0000","last_became_active":"2023-10-14T19:10:44.900382+0000","last_became_peered":"2023-10-14T19:10:44.900382+0000","last_unstale":"2023-10-14T19:10:44.903373+0000","last_undegraded":"2023-10-14T19:10:44.903373+0000","last_fullsized":"2023-10-14T19:10:44.903373+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:17:38.048435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913690+0000","last_change":"2023-10-14T19:10:43.897448+0000","last_active":"2023-10-14T19:10:44.913690+0000","last_peered":"2023-10-14T19:10:44.913690+0000","last_clean":"2023-10-14T19:10:44.913690+0000","last_became_active":"2023-10-14T19:10:43.897073+0000","last_became_peered":"2023-10-14T19:10:43.897073+0000","last_unstale":"2023-10-14T19:10:44.913690+0000","last_undegraded":"2023-10-14T19:10:44.913690+0000","last_fullsized":"2023-10-14T19:10:44.913690+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:01:56.721007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906884+0000","last_change":"2023-10-14T19:10:44.904496+0000","last_active":"2023-10-14T19:10:44.906884+0000","last_peered":"2023-10-14T19:10:44.906884+0000","last_clean":"2023-10-14T19:10:44.906884+0000","last_became_active":"2023-10-14T19:10:44.904225+0000","last_became_peered":"2023-10-14T19:10:44.904225+0000","last_unstale":"2023-10-14T19:10:44.906884+0000","last_undegraded":"2023-10-14T19:10:44.906884+0000","last_fullsized":"2023-10-14T19:10:44.906884+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.720903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905858+0000","last_change":"2023-10-14T19:10:43.899262+0000","last_active":"2023-10-14T19:10:44.905858+0000","last_peered":"2023-10-14T19:10:44.905858+0000","last_clean":"2023-10-14T19:10:44.905858+0000","last_became_active":"2023-10-14T19:10:43.898687+0000","last_became_peered":"2023-10-14T19:10:43.898687+0000","last_unstale":"2023-10-14T19:10:44.905858+0000","last_undegraded":"2023-10-14T19:10:44.905858+0000","last_fullsized":"2023-10-14T19:10:44.905858+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.472815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906110+0000","last_change":"2023-10-14T19:10:44.904160+0000","last_active":"2023-10-14T19:10:44.906110+0000","last_peered":"2023-10-14T19:10:44.906110+0000","last_clean":"2023-10-14T19:10:44.906110+0000","last_became_active":"2023-10-14T19:10:44.903881+0000","last_became_peered":"2023-10-14T19:10:44.903881+0000","last_unstale":"2023-10-14T19:10:44.906110+0000","last_undegraded":"2023-10-14T19:10:44.906110+0000","last_fullsized":"2023-10-14T19:10:44.906110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:06.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887596+0000","last_change":"2023-10-14T19:10:43.896786+0000","last_active":"2023-10-14T19:10:44.887596+0000","last_peered":"2023-10-14T19:10:44.887596+0000","last_clean":"2023-10-14T19:10:44.887596+0000","last_became_active":"2023-10-14T19:10:43.896490+0000","last_became_peered":"2023-10-14T19:10:43.896490+0000","last_unstale":"2023-10-14T19:10:44.887596+0000","last_undegraded":"2023-10-14T19:10:44.887596+0000","last_fullsized":"2023-10-14T19:10:44.887596+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:36.327673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906226+0000","last_change":"2023-10-14T19:10:44.903855+0000","last_active":"2023-10-14T19:10:44.906226+0000","last_peered":"2023-10-14T19:10:44.906226+0000","last_clean":"2023-10-14T19:10:44.906226+0000","last_became_active":"2023-10-14T19:10:44.903585+0000","last_became_peered":"2023-10-14T19:10:44.903585+0000","last_unstale":"2023-10-14T19:10:44.906226+0000","last_undegraded":"2023-10-14T19:10:44.906226+0000","last_fullsized":"2023-10-14T19:10:44.906226+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:11.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.888688+0000","last_change":"2023-10-14T19:10:43.898809+0000","last_active":"2023-10-14T19:10:44.888688+0000","last_peered":"2023-10-14T19:10:44.888688+0000","last_clean":"2023-10-14T19:10:44.888688+0000","last_became_active":"2023-10-14T19:10:43.898533+0000","last_became_peered":"2023-10-14T19:10:43.898533+0000","last_unstale":"2023-10-14T19:10:44.888688+0000","last_undegraded":"2023-10-14T19:10:44.888688+0000","last_fullsized":"2023-10-14T19:10:44.888688+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:03.766293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910600+0000","last_change":"2023-10-14T19:10:44.907014+0000","last_active":"2023-10-14T19:10:44.910600+0000","last_peered":"2023-10-14T19:10:44.910600+0000","last_clean":"2023-10-14T19:10:44.910600+0000","last_became_active":"2023-10-14T19:10:44.906732+0000","last_became_peered":"2023-10-14T19:10:44.906732+0000","last_unstale":"2023-10-14T19:10:44.910600+0000","last_undegraded":"2023-10-14T19:10:44.910600+0000","last_fullsized":"2023-10-14T19:10:44.910600+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:28.785128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887138+0000","last_change":"2023-10-14T19:10:43.896796+0000","last_active":"2023-10-14T19:10:44.887138+0000","last_peered":"2023-10-14T19:10:44.887138+0000","last_clean":"2023-10-14T19:10:44.887138+0000","last_became_active":"2023-10-14T19:10:43.896541+0000","last_became_peered":"2023-10-14T19:10:43.896541+0000","last_unstale":"2023-10-14T19:10:44.887138+0000","last_undegraded":"2023-10-14T19:10:44.887138+0000","last_fullsized":"2023-10-14T19:10:44.887138+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:25.585439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903143+0000","last_change":"2023-10-14T19:10:44.898610+0000","last_active":"2023-10-14T19:10:44.903143+0000","last_peered":"2023-10-14T19:10:44.903143+0000","last_clean":"2023-10-14T19:10:44.903143+0000","last_became_active":"2023-10-14T19:10:44.898308+0000","last_became_peered":"2023-10-14T19:10:44.898308+0000","last_unstale":"2023-10-14T19:10:44.903143+0000","last_undegraded":"2023-10-14T19:10:44.903143+0000","last_fullsized":"2023-10-14T19:10:44.903143+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:18.599315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.889819+0000","last_change":"2023-10-14T19:10:43.897099+0000","last_active":"2023-10-14T19:10:44.889819+0000","last_peered":"2023-10-14T19:10:44.889819+0000","last_clean":"2023-10-14T19:10:44.889819+0000","last_became_active":"2023-10-14T19:10:43.896842+0000","last_became_peered":"2023-10-14T19:10:43.896842+0000","last_unstale":"2023-10-14T19:10:44.889819+0000","last_undegraded":"2023-10-14T19:10:44.889819+0000","last_fullsized":"2023-10-14T19:10:44.889819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:33.244937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905389+0000","last_change":"2023-10-14T19:10:44.901305+0000","last_active":"2023-10-14T19:10:44.905389+0000","last_peered":"2023-10-14T19:10:44.905389+0000","last_clean":"2023-10-14T19:10:44.905389+0000","last_became_active":"2023-10-14T19:10:44.901042+0000","last_became_peered":"2023-10-14T19:10:44.901042+0000","last_unstale":"2023-10-14T19:10:44.905389+0000","last_undegraded":"2023-10-14T19:10:44.905389+0000","last_fullsized":"2023-10-14T19:10:44.905389+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:30.114861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915421+0000","last_change":"2023-10-14T19:10:43.894223+0000","last_active":"2023-10-14T19:10:44.915421+0000","last_peered":"2023-10-14T19:10:44.915421+0000","last_clean":"2023-10-14T19:10:44.915421+0000","last_became_active":"2023-10-14T19:10:43.893955+0000","last_became_peered":"2023-10-14T19:10:43.893955+0000","last_unstale":"2023-10-14T19:10:44.915421+0000","last_undegraded":"2023-10-14T19:10:44.915421+0000","last_fullsized":"2023-10-14T19:10:44.915421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:27.300391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914419+0000","last_change":"2023-10-14T19:10:44.911478+0000","last_active":"2023-10-14T19:10:44.914419+0000","last_peered":"2023-10-14T19:10:44.914419+0000","last_clean":"2023-10-14T19:10:44.914419+0000","last_became_active":"2023-10-14T19:10:44.910748+0000","last_became_peered":"2023-10-14T19:10:44.910748+0000","last_unstale":"2023-10-14T19:10:44.914419+0000","last_undegraded":"2023-10-14T19:10:44.914419+0000","last_fullsized":"2023-10-14T19:10:44.914419+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:58.543757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912831+0000","last_change":"2023-10-14T19:10:43.897286+0000","last_active":"2023-10-14T19:10:44.912831+0000","last_peered":"2023-10-14T19:10:44.912831+0000","last_clean":"2023-10-14T19:10:44.912831+0000","last_became_active":"2023-10-14T19:10:43.896768+0000","last_became_peered":"2023-10-14T19:10:43.896768+0000","last_unstale":"2023-10-14T19:10:44.912831+0000","last_undegraded":"2023-10-14T19:10:44.912831+0000","last_fullsized":"2023-10-14T19:10:44.912831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:21.618756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905954+0000","last_change":"2023-10-14T19:10:44.899156+0000","last_active":"2023-10-14T19:10:44.905954+0000","last_peered":"2023-10-14T19:10:44.905954+0000","last_clean":"2023-10-14T19:10:44.905954+0000","last_became_active":"2023-10-14T19:10:44.898891+0000","last_became_peered":"2023-10-14T19:10:44.898891+0000","last_unstale":"2023-10-14T19:10:44.905954+0000","last_undegraded":"2023-10-14T19:10:44.905954+0000","last_fullsized":"2023-10-14T19:10:44.905954+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:22.623632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906480+0000","last_change":"2023-10-14T19:10:43.899218+0000","last_active":"2023-10-14T19:10:44.906480+0000","last_peered":"2023-10-14T19:10:44.906480+0000","last_clean":"2023-10-14T19:10:44.906480+0000","last_became_active":"2023-10-14T19:10:43.898937+0000","last_became_peered":"2023-10-14T19:10:43.898937+0000","last_unstale":"2023-10-14T19:10:44.906480+0000","last_undegraded":"2023-10-14T19:10:44.906480+0000","last_fullsized":"2023-10-14T19:10:44.906480+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:40.620170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915358+0000","last_change":"2023-10-14T19:10:44.909199+0000","last_active":"2023-10-14T19:10:44.915358+0000","last_peered":"2023-10-14T19:10:44.915358+0000","last_clean":"2023-10-14T19:10:44.915358+0000","last_became_active":"2023-10-14T19:10:44.908149+0000","last_became_peered":"2023-10-14T19:10:44.908149+0000","last_unstale":"2023-10-14T19:10:44.915358+0000","last_undegraded":"2023-10-14T19:10:44.915358+0000","last_fullsized":"2023-10-14T19:10:44.915358+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:44.857129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.888947+0000","last_change":"2023-10-14T19:10:43.893311+0000","last_active":"2023-10-14T19:10:44.888947+0000","last_peered":"2023-10-14T19:10:44.888947+0000","last_clean":"2023-10-14T19:10:44.888947+0000","last_became_active":"2023-10-14T19:10:43.893008+0000","last_became_peered":"2023-10-14T19:10:43.893008+0000","last_unstale":"2023-10-14T19:10:44.888947+0000","last_undegraded":"2023-10-14T19:10:44.888947+0000","last_fullsized":"2023-10-14T19:10:44.888947+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:02.901260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910057+0000","last_change":"2023-10-14T19:10:44.904608+0000","last_active":"2023-10-14T19:10:44.910057+0000","last_peered":"2023-10-14T19:10:44.910057+0000","last_clean":"2023-10-14T19:10:44.910057+0000","last_became_active":"2023-10-14T19:10:44.904210+0000","last_became_peered":"2023-10-14T19:10:44.904210+0000","last_unstale":"2023-10-14T19:10:44.910057+0000","last_undegraded":"2023-10-14T19:10:44.910057+0000","last_fullsized":"2023-10-14T19:10:44.910057+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:18.817926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.890399+0000","last_change":"2023-10-14T19:10:43.892989+0000","last_active":"2023-10-14T19:10:44.890399+0000","last_peered":"2023-10-14T19:10:44.890399+0000","last_clean":"2023-10-14T19:10:44.890399+0000","last_became_active":"2023-10-14T19:10:43.892607+0000","last_became_peered":"2023-10-14T19:10:43.892607+0000","last_unstale":"2023-10-14T19:10:44.890399+0000","last_undegraded":"2023-10-14T19:10:44.890399+0000","last_fullsized":"2023-10-14T19:10:44.890399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:51:20.457406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914535+0000","last_change":"2023-10-14T19:10:44.911800+0000","last_active":"2023-10-14T19:10:44.914535+0000","last_peered":"2023-10-14T19:10:44.914535+0000","last_clean":"2023-10-14T19:10:44.914535+0000","last_became_active":"2023-10-14T19:10:44.911560+0000","last_became_peered":"2023-10-14T19:10:44.911560+0000","last_unstale":"2023-10-14T19:10:44.914535+0000","last_undegraded":"2023-10-14T19:10:44.914535+0000","last_fullsized":"2023-10-14T19:10:44.914535+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:51.872613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910005+0000","last_change":"2023-10-14T19:10:43.895737+0000","last_active":"2023-10-14T19:10:44.910005+0000","last_peered":"2023-10-14T19:10:44.910005+0000","last_clean":"2023-10-14T19:10:44.910005+0000","last_became_active":"2023-10-14T19:10:43.895453+0000","last_became_peered":"2023-10-14T19:10:43.895453+0000","last_unstale":"2023-10-14T19:10:44.910005+0000","last_undegraded":"2023-10-14T19:10:44.910005+0000","last_fullsized":"2023-10-14T19:10:44.910005+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:19.720670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909395+0000","last_change":"2023-10-14T19:10:44.906699+0000","last_active":"2023-10-14T19:10:44.909395+0000","last_peered":"2023-10-14T19:10:44.909395+0000","last_clean":"2023-10-14T19:10:44.909395+0000","last_became_active":"2023-10-14T19:10:44.906097+0000","last_became_peered":"2023-10-14T19:10:44.906097+0000","last_unstale":"2023-10-14T19:10:44.909395+0000","last_undegraded":"2023-10-14T19:10:44.909395+0000","last_fullsized":"2023-10-14T19:10:44.909395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:09.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.907470+0000","last_change":"2023-10-14T19:10:43.896278+0000","last_active":"2023-10-14T19:10:44.907470+0000","last_peered":"2023-10-14T19:10:44.907470+0000","last_clean":"2023-10-14T19:10:44.907470+0000","last_became_active":"2023-10-14T19:10:43.896005+0000","last_became_peered":"2023-10-14T19:10:43.896005+0000","last_unstale":"2023-10-14T19:10:44.907470+0000","last_undegraded":"2023-10-14T19:10:44.907470+0000","last_fullsized":"2023-10-14T19:10:44.907470+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:08.147952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912635+0000","last_change":"2023-10-14T19:10:44.909908+0000","last_active":"2023-10-14T19:10:44.912635+0000","last_peered":"2023-10-14T19:10:44.912635+0000","last_clean":"2023-10-14T19:10:44.912635+0000","last_became_active":"2023-10-14T19:10:44.909674+0000","last_became_peered":"2023-10-14T19:10:44.909674+0000","last_unstale":"2023-10-14T19:10:44.912635+0000","last_undegraded":"2023-10-14T19:10:44.912635+0000","last_fullsized":"2023-10-14T19:10:44.912635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:47.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913473+0000","last_change":"2023-10-14T19:10:43.898631+0000","last_active":"2023-10-14T19:10:44.913473+0000","last_peered":"2023-10-14T19:10:44.913473+0000","last_clean":"2023-10-14T19:10:44.913473+0000","last_became_active":"2023-10-14T19:10:43.898378+0000","last_became_peered":"2023-10-14T19:10:43.898378+0000","last_unstale":"2023-10-14T19:10:44.913473+0000","last_undegraded":"2023-10-14T19:10:44.913473+0000","last_fullsized":"2023-10-14T19:10:44.913473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:00.892294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910534+0000","last_change":"2023-10-14T19:10:44.909345+0000","last_active":"2023-10-14T19:10:44.910534+0000","last_peered":"2023-10-14T19:10:44.910534+0000","last_clean":"2023-10-14T19:10:44.910534+0000","last_became_active":"2023-10-14T19:10:44.909079+0000","last_became_peered":"2023-10-14T19:10:44.909079+0000","last_unstale":"2023-10-14T19:10:44.910534+0000","last_undegraded":"2023-10-14T19:10:44.910534+0000","last_fullsized":"2023-10-14T19:10:44.910534+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:39.684528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915560+0000","last_change":"2023-10-14T19:10:43.896830+0000","last_active":"2023-10-14T19:10:44.915560+0000","last_peered":"2023-10-14T19:10:44.915560+0000","last_clean":"2023-10-14T19:10:44.915560+0000","last_became_active":"2023-10-14T19:10:43.896505+0000","last_became_peered":"2023-10-14T19:10:43.896505+0000","last_unstale":"2023-10-14T19:10:44.915560+0000","last_undegraded":"2023-10-14T19:10:44.915560+0000","last_fullsized":"2023-10-14T19:10:44.915560+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:32.246459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903395+0000","last_change":"2023-10-14T19:10:44.901342+0000","last_active":"2023-10-14T19:10:44.903395+0000","last_peered":"2023-10-14T19:10:44.903395+0000","last_clean":"2023-10-14T19:10:44.903395+0000","last_became_active":"2023-10-14T19:10:44.900672+0000","last_became_peered":"2023-10-14T19:10:44.900672+0000","last_unstale":"2023-10-14T19:10:44.903395+0000","last_undegraded":"2023-10-14T19:10:44.903395+0000","last_fullsized":"2023-10-14T19:10:44.903395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:44.615357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.894357+0000","last_change":"2023-10-14T19:10:43.895735+0000","last_active":"2023-10-14T19:10:44.894357+0000","last_peered":"2023-10-14T19:10:44.894357+0000","last_clean":"2023-10-14T19:10:44.894357+0000","last_became_active":"2023-10-14T19:10:43.895175+0000","last_became_peered":"2023-10-14T19:10:43.895175+0000","last_unstale":"2023-10-14T19:10:44.894357+0000","last_undegraded":"2023-10-14T19:10:44.894357+0000","last_fullsized":"2023-10-14T19:10:44.894357+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:51:48.470404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913117+0000","last_change":"2023-10-14T19:10:44.907697+0000","last_active":"2023-10-14T19:10:44.913117+0000","last_peered":"2023-10-14T19:10:44.913117+0000","last_clean":"2023-10-14T19:10:44.913117+0000","last_became_active":"2023-10-14T19:10:44.907401+0000","last_became_peered":"2023-10-14T19:10:44.907401+0000","last_unstale":"2023-10-14T19:10:44.913117+0000","last_undegraded":"2023-10-14T19:10:44.913117+0000","last_fullsized":"2023-10-14T19:10:44.913117+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:57.761982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914973+0000","last_change":"2023-10-14T19:10:43.896635+0000","last_active":"2023-10-14T19:10:44.914973+0000","last_peered":"2023-10-14T19:10:44.914973+0000","last_clean":"2023-10-14T19:10:44.914973+0000","last_became_active":"2023-10-14T19:10:43.896363+0000","last_became_peered":"2023-10-14T19:10:43.896363+0000","last_unstale":"2023-10-14T19:10:44.914973+0000","last_undegraded":"2023-10-14T19:10:44.914973+0000","last_fullsized":"2023-10-14T19:10:44.914973+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:29.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910514+0000","last_change":"2023-10-14T19:10:44.907399+0000","last_active":"2023-10-14T19:10:44.910514+0000","last_peered":"2023-10-14T19:10:44.910514+0000","last_clean":"2023-10-14T19:10:44.910514+0000","last_became_active":"2023-10-14T19:10:44.907071+0000","last_became_peered":"2023-10-14T19:10:44.907071+0000","last_unstale":"2023-10-14T19:10:44.910514+0000","last_undegraded":"2023-10-14T19:10:44.910514+0000","last_fullsized":"2023-10-14T19:10:44.910514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:37:16.136472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.884829+0000","last_change":"2023-10-14T19:10:43.894297+0000","last_active":"2023-10-14T19:10:44.884829+0000","last_peered":"2023-10-14T19:10:44.884829+0000","last_clean":"2023-10-14T19:10:44.884829+0000","last_became_active":"2023-10-14T19:10:43.894006+0000","last_became_peered":"2023-10-14T19:10:43.894006+0000","last_unstale":"2023-10-14T19:10:44.884829+0000","last_undegraded":"2023-10-14T19:10:44.884829+0000","last_fullsized":"2023-10-14T19:10:44.884829+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:21.241131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909544+0000","last_change":"2023-10-14T19:10:44.906664+0000","last_active":"2023-10-14T19:10:44.909544+0000","last_peered":"2023-10-14T19:10:44.909544+0000","last_clean":"2023-10-14T19:10:44.909544+0000","last_became_active":"2023-10-14T19:10:44.906394+0000","last_became_peered":"2023-10-14T19:10:44.906394+0000","last_unstale":"2023-10-14T19:10:44.909544+0000","last_undegraded":"2023-10-14T19:10:44.909544+0000","last_fullsized":"2023-10-14T19:10:44.909544+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:47.228675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.885651+0000","last_change":"2023-10-14T19:10:43.895774+0000","last_active":"2023-10-14T19:10:44.885651+0000","last_peered":"2023-10-14T19:10:44.885651+0000","last_clean":"2023-10-14T19:10:44.885651+0000","last_became_active":"2023-10-14T19:10:43.895510+0000","last_became_peered":"2023-10-14T19:10:43.895510+0000","last_unstale":"2023-10-14T19:10:44.885651+0000","last_undegraded":"2023-10-14T19:10:44.885651+0000","last_fullsized":"2023-10-14T19:10:44.885651+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:48.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903852+0000","last_change":"2023-10-14T19:10:44.895955+0000","last_active":"2023-10-14T19:10:44.903852+0000","last_peered":"2023-10-14T19:10:44.903852+0000","last_clean":"2023-10-14T19:10:44.903852+0000","last_became_active":"2023-10-14T19:10:44.895720+0000","last_became_peered":"2023-10-14T19:10:44.895720+0000","last_unstale":"2023-10-14T19:10:44.903852+0000","last_undegraded":"2023-10-14T19:10:44.903852+0000","last_fullsized":"2023-10-14T19:10:44.903852+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:17.972151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893365+0000","last_change":"2023-10-14T19:10:43.898901+0000","last_active":"2023-10-14T19:10:44.893365+0000","last_peered":"2023-10-14T19:10:44.893365+0000","last_clean":"2023-10-14T19:10:44.893365+0000","last_became_active":"2023-10-14T19:10:43.898613+0000","last_became_peered":"2023-10-14T19:10:43.898613+0000","last_unstale":"2023-10-14T19:10:44.893365+0000","last_undegraded":"2023-10-14T19:10:44.893365+0000","last_fullsized":"2023-10-14T19:10:44.893365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:28.084502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.900940+0000","last_change":"2023-10-14T19:10:44.897056+0000","last_active":"2023-10-14T19:10:44.900940+0000","last_peered":"2023-10-14T19:10:44.900940+0000","last_clean":"2023-10-14T19:10:44.900940+0000","last_became_active":"2023-10-14T19:10:44.896748+0000","last_became_peered":"2023-10-14T19:10:44.896748+0000","last_unstale":"2023-10-14T19:10:44.900940+0000","last_undegraded":"2023-10-14T19:10:44.900940+0000","last_fullsized":"2023-10-14T19:10:44.900940+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:40.382502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906518+0000","last_change":"2023-10-14T19:10:43.899992+0000","last_active":"2023-10-14T19:10:44.906518+0000","last_peered":"2023-10-14T19:10:44.906518+0000","last_clean":"2023-10-14T19:10:44.906518+0000","last_became_active":"2023-10-14T19:10:43.899595+0000","last_became_peered":"2023-10-14T19:10:43.899595+0000","last_unstale":"2023-10-14T19:10:44.906518+0000","last_undegraded":"2023-10-14T19:10:44.906518+0000","last_fullsized":"2023-10-14T19:10:44.906518+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:49.352138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913265+0000","last_change":"2023-10-14T19:10:44.897649+0000","last_active":"2023-10-14T19:10:44.913265+0000","last_peered":"2023-10-14T19:10:44.913265+0000","last_clean":"2023-10-14T19:10:44.913265+0000","last_became_active":"2023-10-14T19:10:44.897361+0000","last_became_peered":"2023-10-14T19:10:44.897361+0000","last_unstale":"2023-10-14T19:10:44.913265+0000","last_undegraded":"2023-10-14T19:10:44.913265+0000","last_fullsized":"2023-10-14T19:10:44.913265+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:11.023360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893836+0000","last_change":"2023-10-14T19:10:43.896575+0000","last_active":"2023-10-14T19:10:44.893836+0000","last_peered":"2023-10-14T19:10:44.893836+0000","last_clean":"2023-10-14T19:10:44.893836+0000","last_became_active":"2023-10-14T19:10:43.896203+0000","last_became_peered":"2023-10-14T19:10:43.896203+0000","last_unstale":"2023-10-14T19:10:44.893836+0000","last_undegraded":"2023-10-14T19:10:44.893836+0000","last_fullsized":"2023-10-14T19:10:44.893836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:07.649541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915363+0000","last_change":"2023-10-14T19:10:44.914375+0000","last_active":"2023-10-14T19:10:44.915363+0000","last_peered":"2023-10-14T19:10:44.915363+0000","last_clean":"2023-10-14T19:10:44.915363+0000","last_became_active":"2023-10-14T19:10:44.914104+0000","last_became_peered":"2023-10-14T19:10:44.914104+0000","last_unstale":"2023-10-14T19:10:44.915363+0000","last_undegraded":"2023-10-14T19:10:44.915363+0000","last_fullsized":"2023-10-14T19:10:44.915363+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:41.625045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887188+0000","last_change":"2023-10-14T19:10:43.898048+0000","last_active":"2023-10-14T19:10:44.887188+0000","last_peered":"2023-10-14T19:10:44.887188+0000","last_clean":"2023-10-14T19:10:44.887188+0000","last_became_active":"2023-10-14T19:10:43.897867+0000","last_became_peered":"2023-10-14T19:10:43.897867+0000","last_unstale":"2023-10-14T19:10:44.887188+0000","last_undegraded":"2023-10-14T19:10:44.887188+0000","last_fullsized":"2023-10-14T19:10:44.887188+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:59.515361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904477+0000","last_change":"2023-10-14T19:10:44.899094+0000","last_active":"2023-10-14T19:10:44.904477+0000","last_peered":"2023-10-14T19:10:44.904477+0000","last_clean":"2023-10-14T19:10:44.904477+0000","last_became_active":"2023-10-14T19:10:44.898810+0000","last_became_peered":"2023-10-14T19:10:44.898810+0000","last_unstale":"2023-10-14T19:10:44.904477+0000","last_undegraded":"2023-10-14T19:10:44.904477+0000","last_fullsized":"2023-10-14T19:10:44.904477+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:09.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.896635+0000","last_change":"2023-10-14T19:10:43.897735+0000","last_active":"2023-10-14T19:10:44.896635+0000","last_peered":"2023-10-14T19:10:44.896635+0000","last_clean":"2023-10-14T19:10:44.896635+0000","last_became_active":"2023-10-14T19:10:43.897300+0000","last_became_peered":"2023-10-14T19:10:43.897300+0000","last_unstale":"2023-10-14T19:10:44.896635+0000","last_undegraded":"2023-10-14T19:10:44.896635+0000","last_fullsized":"2023-10-14T19:10:44.896635+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:26.042416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913803+0000","last_change":"2023-10-14T19:10:44.910715+0000","last_active":"2023-10-14T19:10:44.913803+0000","last_peered":"2023-10-14T19:10:44.913803+0000","last_clean":"2023-10-14T19:10:44.913803+0000","last_became_active":"2023-10-14T19:10:44.904113+0000","last_became_peered":"2023-10-14T19:10:44.904113+0000","last_unstale":"2023-10-14T19:10:44.913803+0000","last_undegraded":"2023-10-14T19:10:44.913803+0000","last_fullsized":"2023-10-14T19:10:44.913803+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:06:19.212950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.894524+0000","last_change":"2023-10-14T19:10:43.900069+0000","last_active":"2023-10-14T19:10:44.894524+0000","last_peered":"2023-10-14T19:10:44.894524+0000","last_clean":"2023-10-14T19:10:44.894524+0000","last_became_active":"2023-10-14T19:10:43.899776+0000","last_became_peered":"2023-10-14T19:10:43.899776+0000","last_unstale":"2023-10-14T19:10:44.894524+0000","last_undegraded":"2023-10-14T19:10:44.894524+0000","last_fullsized":"2023-10-14T19:10:44.894524+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:05.293638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.900333+0000","last_change":"2023-10-14T19:10:44.896699+0000","last_active":"2023-10-14T19:10:44.900333+0000","last_peered":"2023-10-14T19:10:44.900333+0000","last_clean":"2023-10-14T19:10:44.900333+0000","last_became_active":"2023-10-14T19:10:44.896417+0000","last_became_peered":"2023-10-14T19:10:44.896417+0000","last_unstale":"2023-10-14T19:10:44.900333+0000","last_undegraded":"2023-10-14T19:10:44.900333+0000","last_fullsized":"2023-10-14T19:10:44.900333+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:34.249813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887922+0000","last_change":"2023-10-14T19:10:43.898905+0000","last_active":"2023-10-14T19:10:44.887922+0000","last_peered":"2023-10-14T19:10:44.887922+0000","last_clean":"2023-10-14T19:10:44.887922+0000","last_became_active":"2023-10-14T19:10:43.898553+0000","last_became_peered":"2023-10-14T19:10:43.898553+0000","last_unstale":"2023-10-14T19:10:44.887922+0000","last_undegraded":"2023-10-14T19:10:44.887922+0000","last_fullsized":"2023-10-14T19:10:44.887922+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:46.832615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902108+0000","last_change":"2023-10-14T19:10:44.899767+0000","last_active":"2023-10-14T19:10:44.902108+0000","last_peered":"2023-10-14T19:10:44.902108+0000","last_clean":"2023-10-14T19:10:44.902108+0000","last_became_active":"2023-10-14T19:10:44.899482+0000","last_became_peered":"2023-10-14T19:10:44.899482+0000","last_unstale":"2023-10-14T19:10:44.902108+0000","last_undegraded":"2023-10-14T19:10:44.902108+0000","last_fullsized":"2023-10-14T19:10:44.902108+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:32.663743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.889412+0000","last_change":"2023-10-14T19:10:43.895101+0000","last_active":"2023-10-14T19:10:44.889412+0000","last_peered":"2023-10-14T19:10:44.889412+0000","last_clean":"2023-10-14T19:10:44.889412+0000","last_became_active":"2023-10-14T19:10:43.894786+0000","last_became_peered":"2023-10-14T19:10:43.894786+0000","last_unstale":"2023-10-14T19:10:44.889412+0000","last_undegraded":"2023-10-14T19:10:44.889412+0000","last_fullsized":"2023-10-14T19:10:44.889412+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:06:28.014083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909412+0000","last_change":"2023-10-14T19:10:44.905673+0000","last_active":"2023-10-14T19:10:44.909412+0000","last_peered":"2023-10-14T19:10:44.909412+0000","last_clean":"2023-10-14T19:10:44.909412+0000","last_became_active":"2023-10-14T19:10:44.905374+0000","last_became_peered":"2023-10-14T19:10:44.905374+0000","last_unstale":"2023-10-14T19:10:44.909412+0000","last_undegraded":"2023-10-14T19:10:44.909412+0000","last_fullsized":"2023-10-14T19:10:44.909412+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:38.477691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.890949+0000","last_change":"2023-10-14T19:10:43.893414+0000","last_active":"2023-10-14T19:10:44.890949+0000","last_peered":"2023-10-14T19:10:44.890949+0000","last_clean":"2023-10-14T19:10:44.890949+0000","last_became_active":"2023-10-14T19:10:43.893168+0000","last_became_peered":"2023-10-14T19:10:43.893168+0000","last_unstale":"2023-10-14T19:10:44.890949+0000","last_undegraded":"2023-10-14T19:10:44.890949+0000","last_fullsized":"2023-10-14T19:10:44.890949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:36.172804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913463+0000","last_change":"2023-10-14T19:10:44.900046+0000","last_active":"2023-10-14T19:10:44.913463+0000","last_peered":"2023-10-14T19:10:44.913463+0000","last_clean":"2023-10-14T19:10:44.913463+0000","last_became_active":"2023-10-14T19:10:44.899771+0000","last_became_peered":"2023-10-14T19:10:44.899771+0000","last_unstale":"2023-10-14T19:10:44.913463+0000","last_undegraded":"2023-10-14T19:10:44.913463+0000","last_fullsized":"2023-10-14T19:10:44.913463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:23:37.989440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904697+0000","last_change":"2023-10-14T19:10:43.895310+0000","last_active":"2023-10-14T19:10:44.904697+0000","last_peered":"2023-10-14T19:10:44.904697+0000","last_clean":"2023-10-14T19:10:44.904697+0000","last_became_active":"2023-10-14T19:10:43.895007+0000","last_became_peered":"2023-10-14T19:10:43.895007+0000","last_unstale":"2023-10-14T19:10:44.904697+0000","last_undegraded":"2023-10-14T19:10:44.904697+0000","last_fullsized":"2023-10-14T19:10:44.904697+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:17.594439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893898+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:44.893898+0000","last_peered":"2023-10-14T19:10:44.893898+0000","last_clean":"2023-10-14T19:10:44.893898+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:44.893898+0000","last_undegraded":"2023-10-14T19:10:44.893898+0000","last_fullsized":"2023-10-14T19:10:44.893898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.505}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.53500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.72699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46700000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":866328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.497},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1456730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.495}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.746}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":866272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.314}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.438},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303288,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068552,"statfs":{"total":96636764160,"available":96326197248,"internally_reserved":0,"allocated":1949696,"data_stored":866454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.621}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303296,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068544,"statfs":{"total":96636764160,"available":96326189056,"internally_reserved":0,"allocated":1957888,"data_stored":867912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.76000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.379},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.46899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.64000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:49.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T19:10:49.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.943+0000 7fcf075b6700 1 Processor -- start 2023-10-14T19:10:49.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.943+0000 7fcf075b6700 1 -- start start 2023-10-14T19:10:49.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.944+0000 7fcf075b6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.944+0000 7fcf075b6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf00159c80 0x7fcf000cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.944+0000 7fcf075b6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000ce9d0 con 0x7fcf000af790 2023-10-14T19:10:49.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.944+0000 7fcf075b6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000afc30 con 0x7fcf00159c80 2023-10-14T19:10:49.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.944+0000 7fcf075b6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000aff10 con 0x7fcf001598b0 2023-10-14T19:10:49.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf05352700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf00159c80 0x7fcf000cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf00159c80 0x7fcf000cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:33282/0 (socket says 172.21.15.7:33282) 2023-10-14T19:10:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf05352700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:45384/0 (socket says 172.21.15.7:45384) 2023-10-14T19:10:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf05b53700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcf000af790 0x7fcf000cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:57422/0 (socket says 172.21.15.7:57422) 2023-10-14T19:10:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 -- 172.21.15.7:0/1978211729 learned_addr learned my addr 172.21.15.7:0/1978211729 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 -- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 msgr2=0x7fcf000af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 --2- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 -- 172.21.15.7:0/1978211729 >> v1:172.21.15.148:6789/0 conn(0x7fcf000af790 legacy=0x7fcf000cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 -- 172.21.15.7:0/1978211729 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000ce380 con 0x7fcf00159c80 2023-10-14T19:10:49.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf05352700 1 --2- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:10:49.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcf04b51700 1 --2- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf000cb6f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcef40099b0 tx=0x7fcef4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21a54c8ecff5b280 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcefffff700 1 -- 172.21.15.7:0/1978211729 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4009ea0 con 0x7fcf00159c80 2023-10-14T19:10:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcefffff700 1 -- 172.21.15.7:0/1978211729 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef400b860 con 0x7fcf00159c80 2023-10-14T19:10:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.945+0000 7fcefffff700 1 -- 172.21.15.7:0/1978211729 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400bc00 con 0x7fcf00159c80 2023-10-14T19:10:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 -- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 msgr2=0x7fcf000cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 --2- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf000cb6f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcef40099b0 tx=0x7fcef4009250 comp rx=0 tx=0).stop 2023-10-14T19:10:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 -- 172.21.15.7:0/1978211729 shutdown_connections 2023-10-14T19:10:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 --2- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 --2- 172.21.15.7:0/1978211729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf000cb6f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 -- 172.21.15.7:0/1978211729 >> 172.21.15.7:0/1978211729 conn(0x7fcf00070e30 msgr2=0x7fcf000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:49.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 -- 172.21.15.7:0/1978211729 shutdown_connections 2023-10-14T19:10:49.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.946+0000 7fcf075b6700 1 -- 172.21.15.7:0/1978211729 wait complete. 2023-10-14T19:10:49.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.947+0000 7fcf075b6700 1 Processor -- start 2023-10-14T19:10:49.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.947+0000 7fcf075b6700 1 -- start start 2023-10-14T19:10:49.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf075b6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 0x7fcf00155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf075b6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf075b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf0014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf075b6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000b5c20 con 0x7fcf000af790 2023-10-14T19:10:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf075b6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0014b790 con 0x7fcf00159c80 2023-10-14T19:10:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf075b6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000c7bc0 con 0x7fcf001598b0 2023-10-14T19:10:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 0x7fcf00155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 0x7fcf00155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45260/0 (socket says 172.21.15.7:45260) 2023-10-14T19:10:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 -- 172.21.15.7:0/2754285757 learned_addr learned my addr 172.21.15.7:0/2754285757 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05b53700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf0014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf04b51700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 -- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 msgr2=0x7fcf000b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 -- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 msgr2=0x7fcf0014b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf0014b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.948+0000 7fcf05352700 1 -- 172.21.15.7:0/2754285757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009420 con 0x7fcf000af790 2023-10-14T19:10:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.949+0000 7fcf05352700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 0x7fcf00155bf0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fcef000ec80 tx=0x7fcef00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.949+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000c920 con 0x7fcf000af790 2023-10-14T19:10:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.949+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef000ca80 con 0x7fcf000af790 2023-10-14T19:10:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.949+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef40094f0 con 0x7fcf000af790 2023-10-14T19:10:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.949+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000ce00 con 0x7fcf000af790 2023-10-14T19:10:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.949+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf00156520 con 0x7fcf000af790 2023-10-14T19:10:49.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.950+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000c7e80 con 0x7fcf000af790 2023-10-14T19:10:49.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.950+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcef0013680 con 0x7fcf000af790 2023-10-14T19:10:49.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.951+0000 7fcefd7fa700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fceec067320 0x7fceec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:49.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.951+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcef0085050 con 0x7fcf000af790 2023-10-14T19:10:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.951+0000 7fcf04b51700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fceec067320 0x7fceec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.951+0000 7fcf04b51700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fceec067320 0x7fceec0697d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcef40099b0 tx=0x7fcef4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:49.955+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcef0051ce0 con 0x7fcf000af790 2023-10-14T19:10:50.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.224+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcf0004c3c0 con 0x7fcf000af790 2023-10-14T19:10:50.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.224+0000 7fcefd7fa700 1 -- 172.21.15.7:0/2754285757 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1439 (secure 0 0 0) 0x7fcef0055300 con 0x7fcf000af790 2023-10-14T19:10:50.226 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:50.226 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":478,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1697310181,"num_in_osds":8,"osd_in_since":1697310174,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2485690368,"bytes_avail":770608422912,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":102,"id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"a","status":"up:active","gid":7869}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-14T19:10:33.729621+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-14T19:10:50.227 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-14T19:10:50.226+0000 7fb0490ea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:10:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fceec067320 msgr2=0x7fceec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fceec067320 0x7fceec0697d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcef40099b0 tx=0x7fcef4017000 comp rx=0 tx=0).stop 2023-10-14T19:10:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 msgr2=0x7fcf00155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 0x7fcf00155bf0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fcef000ec80 tx=0x7fcef00091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 shutdown_connections 2023-10-14T19:10:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fceec067320 0x7fceec0697d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf00159c80 0x7fcf0014b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf000af790 0x7fcf00155bf0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 --2- 172.21.15.7:0/2754285757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf001598b0 0x7fcf000b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 >> 172.21.15.7:0/2754285757 conn(0x7fcf00070e30 msgr2=0x7fcf0014e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 shutdown_connections 2023-10-14T19:10:50.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.227+0000 7fcf075b6700 1 -- 172.21.15.7:0/2754285757 wait complete. 2023-10-14T19:10:50.240 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T19:10:50.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:50.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.359+0000 7fea0900f700 1 Processor -- start 2023-10-14T19:10:50.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.359+0000 7fea0900f700 1 -- start start 2023-10-14T19:10:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea0900f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea040c3250 0x7fea0415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea0900f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0406c7d0 con 0x7fea04143200 2023-10-14T19:10:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea0900f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040c37a0 con 0x7fea0415aa20 2023-10-14T19:10:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea0900f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea041171e0 con 0x7fea040c3250 2023-10-14T19:10:50.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea0259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea040c3250 0x7fea0415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea02d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fea04143200 0x7fea04159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54560/0 (socket says 172.21.15.7:54560) 2023-10-14T19:10:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.360+0000 7fea02d9d700 1 -- 172.21.15.7:0/1924286928 learned_addr learned my addr 172.21.15.7:0/1924286928 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea01d9b700 1 -- 172.21.15.7:0/1924286928 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851536254 0 0) 0x7fea0406c7d0 con 0x7fea04143200 2023-10-14T19:10:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea01d9b700 1 -- 172.21.15.7:0/1924286928 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f0003570 con 0x7fea04143200 2023-10-14T19:10:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea0259c700 1 -- 172.21.15.7:0/1924286928 >> v1:172.21.15.148:6789/0 conn(0x7fea0415aa20 legacy=0x7fea04163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea0259c700 1 -- 172.21.15.7:0/1924286928 >> v1:172.21.15.7:6789/0 conn(0x7fea04143200 legacy=0x7fea04159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea0259c700 1 -- 172.21.15.7:0/1924286928 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040cc090 con 0x7fea040c3250 2023-10-14T19:10:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea0259c700 1 --2- 172.21.15.7:0/1924286928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea040c3250 0x7fea0415a4e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0098e0 tx=0x7fe9ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08db082ca4b7548 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea01d9b700 1 -- 172.21.15.7:0/1924286928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00b640 con 0x7fea040c3250 2023-10-14T19:10:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea01d9b700 1 -- 172.21.15.7:0/1924286928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00b7a0 con 0x7fea040c3250 2023-10-14T19:10:50.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.361+0000 7fea01d9b700 1 -- 172.21.15.7:0/1924286928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00bb40 con 0x7fea040c3250 2023-10-14T19:10:50.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 -- 172.21.15.7:0/1924286928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea040c3250 msgr2=0x7fea0415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 --2- 172.21.15.7:0/1924286928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea040c3250 0x7fea0415a4e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0098e0 tx=0x7fe9ec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 -- 172.21.15.7:0/1924286928 shutdown_connections 2023-10-14T19:10:50.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 --2- 172.21.15.7:0/1924286928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea040c3250 0x7fea0415a4e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 -- 172.21.15.7:0/1924286928 >> 172.21.15.7:0/1924286928 conn(0x7fea040ccb60 msgr2=0x7fea040ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:50.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 -- 172.21.15.7:0/1924286928 shutdown_connections 2023-10-14T19:10:50.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.362+0000 7fea0900f700 1 -- 172.21.15.7:0/1924286928 wait complete. 2023-10-14T19:10:50.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.363+0000 7fea0900f700 1 Processor -- start 2023-10-14T19:10:50.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.363+0000 7fea0900f700 1 -- start start 2023-10-14T19:10:50.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea040c3250 0x7fea0415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:50.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea04143200 0x7fea0413aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:50.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 0x7fea0415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:50.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea041375e0 con 0x7fea0415aa20 2023-10-14T19:10:50.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0413b160 con 0x7fea04143200 2023-10-14T19:10:50.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0413b440 con 0x7fea040c3250 2023-10-14T19:10:50.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 0x7fea0415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:50.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 0x7fea0415a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45276/0 (socket says 172.21.15.7:45276) 2023-10-14T19:10:50.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 -- 172.21.15.7:0/1917812152 learned_addr learned my addr 172.21.15.7:0/1917812152 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:50.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea02d9d700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea040c3250 0x7fea0415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:50.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0259c700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea04143200 0x7fea0413aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 -- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea040c3250 msgr2=0x7fea0415b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea040c3250 0x7fea0415b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 -- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea04143200 msgr2=0x7fea0413aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea04143200 0x7fea0413aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 -- 172.21.15.7:0/1917812152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec009420 con 0x7fea0415aa20 2023-10-14T19:10:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0259c700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea04143200 0x7fea0413aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea02d9d700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea040c3250 0x7fea0415b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0359e700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 0x7fea0415a010 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c4c0 tx=0x7fe9f4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4011590 con 0x7fea0415aa20 2023-10-14T19:10:50.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4011710 con 0x7fea0415aa20 2023-10-14T19:10:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0413b720 con 0x7fea0415aa20 2023-10-14T19:10:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4011ad0 con 0x7fea0415aa20 2023-10-14T19:10:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.364+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0415dc60 con 0x7fea0415aa20 2023-10-14T19:10:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.365+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0415dac0 con 0x7fea0415aa20 2023-10-14T19:10:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.366+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe9f401b3b0 con 0x7fea0415aa20 2023-10-14T19:10:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.366+0000 7fe9faffd700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9e4067320 0x7fe9e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.366+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9f4084150 con 0x7fea0415aa20 2023-10-14T19:10:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.366+0000 7fea02d9d700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9e4067320 0x7fe9e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.367+0000 7fea02d9d700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9e4067320 0x7fe9e40697d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005c50 tx=0x7fe9fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:50.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.370+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea0415dac0 con 0x7fea0415aa20 2023-10-14T19:10:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.561+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea0415dac0 con 0x7fe9e4067320 2023-10-14T19:10:50.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.570+0000 7fe9faffd700 1 -- 172.21.15.7:0/1917812152 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290313 (secure 0 0 0) 0x7fea0415dac0 con 0x7fe9e4067320 2023-10-14T19:10:50.574 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:50.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9e4067320 msgr2=0x7fe9e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9e4067320 0x7fe9e40697d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005c50 tx=0x7fe9fc009040 comp rx=0 tx=0).stop 2023-10-14T19:10:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 msgr2=0x7fea0415a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 0x7fea0415a010 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c4c0 tx=0x7fe9f4007f50 comp rx=0 tx=0).stop 2023-10-14T19:10:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 shutdown_connections 2023-10-14T19:10:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9e4067320 0x7fe9e40697d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea0415aa20 0x7fea0415a010 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea040c3250 0x7fea0415b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 --2- 172.21.15.7:0/1917812152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea04143200 0x7fea0413aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:50.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 >> 172.21.15.7:0/1917812152 conn(0x7fea040ccb60 msgr2=0x7fea0413a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 shutdown_connections 2023-10-14T19:10:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:50.573+0000 7fea0900f700 1 -- 172.21.15.7:0/1917812152 wait complete. 2023-10-14T19:10:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2023-10-14T19:10:49.732844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427432,"kb_used_data":16360,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547288,"statfs":{"total":773094113280,"available":770608422912,"internally_reserved":0,"allocated":16752640,"data_stored":8115524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001262"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914375+0000","last_change":"2023-10-14T19:10:44.911246+0000","last_active":"2023-10-14T19:10:44.914375+0000","last_peered":"2023-10-14T19:10:44.914375+0000","last_clean":"2023-10-14T19:10:44.914375+0000","last_became_active":"2023-10-14T19:10:44.904491+0000","last_became_peered":"2023-10-14T19:10:44.904491+0000","last_unstale":"2023-10-14T19:10:44.914375+0000","last_undegraded":"2023-10-14T19:10:44.914375+0000","last_fullsized":"2023-10-14T19:10:44.914375+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:17.082005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909417+0000","last_change":"2023-10-14T19:10:44.906839+0000","last_active":"2023-10-14T19:10:44.909417+0000","last_peered":"2023-10-14T19:10:44.909417+0000","last_clean":"2023-10-14T19:10:44.909417+0000","last_became_active":"2023-10-14T19:10:44.906435+0000","last_became_peered":"2023-10-14T19:10:44.906435+0000","last_unstale":"2023-10-14T19:10:44.909417+0000","last_undegraded":"2023-10-14T19:10:44.909417+0000","last_fullsized":"2023-10-14T19:10:44.909417+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:47.837491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910169+0000","last_change":"2023-10-14T19:10:44.902918+0000","last_active":"2023-10-14T19:10:44.910169+0000","last_peered":"2023-10-14T19:10:44.910169+0000","last_clean":"2023-10-14T19:10:44.910169+0000","last_became_active":"2023-10-14T19:10:44.902513+0000","last_became_peered":"2023-10-14T19:10:44.902513+0000","last_unstale":"2023-10-14T19:10:44.910169+0000","last_undegraded":"2023-10-14T19:10:44.910169+0000","last_fullsized":"2023-10-14T19:10:44.910169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:37.177680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906259+0000","last_change":"2023-10-14T19:10:44.903497+0000","last_active":"2023-10-14T19:10:44.906259+0000","last_peered":"2023-10-14T19:10:44.906259+0000","last_clean":"2023-10-14T19:10:44.906259+0000","last_became_active":"2023-10-14T19:10:44.903214+0000","last_became_peered":"2023-10-14T19:10:44.903214+0000","last_unstale":"2023-10-14T19:10:44.906259+0000","last_undegraded":"2023-10-14T19:10:44.906259+0000","last_fullsized":"2023-10-14T19:10:44.906259+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:04:24.819286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905922+0000","last_change":"2023-10-14T19:10:44.898295+0000","last_active":"2023-10-14T19:10:44.905922+0000","last_peered":"2023-10-14T19:10:44.905922+0000","last_clean":"2023-10-14T19:10:44.905922+0000","last_became_active":"2023-10-14T19:10:44.898032+0000","last_became_peered":"2023-10-14T19:10:44.898032+0000","last_unstale":"2023-10-14T19:10:44.905922+0000","last_undegraded":"2023-10-14T19:10:44.905922+0000","last_fullsized":"2023-10-14T19:10:44.905922+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.471086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910169+0000","last_change":"2023-10-14T19:10:44.907219+0000","last_active":"2023-10-14T19:10:44.910169+0000","last_peered":"2023-10-14T19:10:44.910169+0000","last_clean":"2023-10-14T19:10:44.910169+0000","last_became_active":"2023-10-14T19:10:44.906890+0000","last_became_peered":"2023-10-14T19:10:44.906890+0000","last_unstale":"2023-10-14T19:10:44.910169+0000","last_undegraded":"2023-10-14T19:10:44.910169+0000","last_fullsized":"2023-10-14T19:10:44.910169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:56.776503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913703+0000","last_change":"2023-10-14T19:10:44.904440+0000","last_active":"2023-10-14T19:10:44.913703+0000","last_peered":"2023-10-14T19:10:44.913703+0000","last_clean":"2023-10-14T19:10:44.913703+0000","last_became_active":"2023-10-14T19:10:44.903875+0000","last_became_peered":"2023-10-14T19:10:44.903875+0000","last_unstale":"2023-10-14T19:10:44.913703+0000","last_undegraded":"2023-10-14T19:10:44.913703+0000","last_fullsized":"2023-10-14T19:10:44.913703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:24.780148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915009+0000","last_change":"2023-10-14T19:10:44.914161+0000","last_active":"2023-10-14T19:10:44.915009+0000","last_peered":"2023-10-14T19:10:44.915009+0000","last_clean":"2023-10-14T19:10:44.915009+0000","last_became_active":"2023-10-14T19:10:44.913883+0000","last_became_peered":"2023-10-14T19:10:44.913883+0000","last_unstale":"2023-10-14T19:10:44.915009+0000","last_undegraded":"2023-10-14T19:10:44.915009+0000","last_fullsized":"2023-10-14T19:10:44.915009+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:08.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909479+0000","last_change":"2023-10-14T19:10:44.904994+0000","last_active":"2023-10-14T19:10:44.909479+0000","last_peered":"2023-10-14T19:10:44.909479+0000","last_clean":"2023-10-14T19:10:44.909479+0000","last_became_active":"2023-10-14T19:10:44.904791+0000","last_became_peered":"2023-10-14T19:10:44.904791+0000","last_unstale":"2023-10-14T19:10:44.909479+0000","last_undegraded":"2023-10-14T19:10:44.909479+0000","last_fullsized":"2023-10-14T19:10:44.909479+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:26.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908388+0000","last_change":"2023-10-14T19:10:44.903088+0000","last_active":"2023-10-14T19:10:44.908388+0000","last_peered":"2023-10-14T19:10:44.908388+0000","last_clean":"2023-10-14T19:10:44.908388+0000","last_became_active":"2023-10-14T19:10:44.901631+0000","last_became_peered":"2023-10-14T19:10:44.901631+0000","last_unstale":"2023-10-14T19:10:44.908388+0000","last_undegraded":"2023-10-14T19:10:44.908388+0000","last_fullsized":"2023-10-14T19:10:44.908388+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:01.803614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910185+0000","last_change":"2023-10-14T19:10:44.903564+0000","last_active":"2023-10-14T19:10:44.910185+0000","last_peered":"2023-10-14T19:10:44.910185+0000","last_clean":"2023-10-14T19:10:44.910185+0000","last_became_active":"2023-10-14T19:10:44.903246+0000","last_became_peered":"2023-10-14T19:10:44.903246+0000","last_unstale":"2023-10-14T19:10:44.910185+0000","last_undegraded":"2023-10-14T19:10:44.910185+0000","last_fullsized":"2023-10-14T19:10:44.910185+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:05.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908114+0000","last_change":"2023-10-14T19:10:44.905038+0000","last_active":"2023-10-14T19:10:44.908114+0000","last_peered":"2023-10-14T19:10:44.908114+0000","last_clean":"2023-10-14T19:10:44.908114+0000","last_became_active":"2023-10-14T19:10:44.904751+0000","last_became_peered":"2023-10-14T19:10:44.904751+0000","last_unstale":"2023-10-14T19:10:44.908114+0000","last_undegraded":"2023-10-14T19:10:44.908114+0000","last_fullsized":"2023-10-14T19:10:44.908114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:06:29.018958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.901803+0000","last_change":"2023-10-14T19:10:44.898390+0000","last_active":"2023-10-14T19:10:44.901803+0000","last_peered":"2023-10-14T19:10:44.901803+0000","last_clean":"2023-10-14T19:10:44.901803+0000","last_became_active":"2023-10-14T19:10:44.897896+0000","last_became_peered":"2023-10-14T19:10:44.897896+0000","last_unstale":"2023-10-14T19:10:44.901803+0000","last_undegraded":"2023-10-14T19:10:44.901803+0000","last_fullsized":"2023-10-14T19:10:44.901803+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:03.906136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.892423+0000","last_change":"2023-10-14T19:10:44.891482+0000","last_active":"2023-10-14T19:10:44.892423+0000","last_peered":"2023-10-14T19:10:44.892423+0000","last_clean":"2023-10-14T19:10:44.892423+0000","last_became_active":"2023-10-14T19:10:44.891019+0000","last_became_peered":"2023-10-14T19:10:44.891019+0000","last_unstale":"2023-10-14T19:10:44.892423+0000","last_undegraded":"2023-10-14T19:10:44.892423+0000","last_fullsized":"2023-10-14T19:10:44.892423+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:36.134369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913306+0000","last_change":"2023-10-14T19:10:44.897953+0000","last_active":"2023-10-14T19:10:44.913306+0000","last_peered":"2023-10-14T19:10:44.913306+0000","last_clean":"2023-10-14T19:10:44.913306+0000","last_became_active":"2023-10-14T19:10:44.897621+0000","last_became_peered":"2023-10-14T19:10:44.897621+0000","last_unstale":"2023-10-14T19:10:44.913306+0000","last_undegraded":"2023-10-14T19:10:44.913306+0000","last_fullsized":"2023-10-14T19:10:44.913306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:35.400464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.898939+0000","last_change":"2023-10-14T19:10:44.895728+0000","last_active":"2023-10-14T19:10:44.898939+0000","last_peered":"2023-10-14T19:10:44.898939+0000","last_clean":"2023-10-14T19:10:44.898939+0000","last_became_active":"2023-10-14T19:10:44.895434+0000","last_became_peered":"2023-10-14T19:10:44.895434+0000","last_unstale":"2023-10-14T19:10:44.898939+0000","last_undegraded":"2023-10-14T19:10:44.898939+0000","last_fullsized":"2023-10-14T19:10:44.898939+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914349+0000","last_change":"2023-10-14T19:10:44.911025+0000","last_active":"2023-10-14T19:10:44.914349+0000","last_peered":"2023-10-14T19:10:44.914349+0000","last_clean":"2023-10-14T19:10:44.914349+0000","last_became_active":"2023-10-14T19:10:44.910691+0000","last_became_peered":"2023-10-14T19:10:44.910691+0000","last_unstale":"2023-10-14T19:10:44.914349+0000","last_undegraded":"2023-10-14T19:10:44.914349+0000","last_fullsized":"2023-10-14T19:10:44.914349+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:03.646566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.901491+0000","last_change":"2023-10-14T19:10:44.896191+0000","last_active":"2023-10-14T19:10:44.901491+0000","last_peered":"2023-10-14T19:10:44.901491+0000","last_clean":"2023-10-14T19:10:44.901491+0000","last_became_active":"2023-10-14T19:10:44.895915+0000","last_became_peered":"2023-10-14T19:10:44.895915+0000","last_unstale":"2023-10-14T19:10:44.901491+0000","last_undegraded":"2023-10-14T19:10:44.901491+0000","last_fullsized":"2023-10-14T19:10:44.901491+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:37.341940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909552+0000","last_change":"2023-10-14T19:10:44.903810+0000","last_active":"2023-10-14T19:10:44.909552+0000","last_peered":"2023-10-14T19:10:44.909552+0000","last_clean":"2023-10-14T19:10:44.909552+0000","last_became_active":"2023-10-14T19:10:44.903544+0000","last_became_peered":"2023-10-14T19:10:44.903544+0000","last_unstale":"2023-10-14T19:10:44.909552+0000","last_undegraded":"2023-10-14T19:10:44.909552+0000","last_fullsized":"2023-10-14T19:10:44.909552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:55:08.742523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906114+0000","last_change":"2023-10-14T19:10:44.903164+0000","last_active":"2023-10-14T19:10:44.906114+0000","last_peered":"2023-10-14T19:10:44.906114+0000","last_clean":"2023-10-14T19:10:44.906114+0000","last_became_active":"2023-10-14T19:10:44.902891+0000","last_became_peered":"2023-10-14T19:10:44.902891+0000","last_unstale":"2023-10-14T19:10:44.906114+0000","last_undegraded":"2023-10-14T19:10:44.906114+0000","last_fullsized":"2023-10-14T19:10:44.906114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:37.304748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906868+0000","last_change":"2023-10-14T19:10:44.903420+0000","last_active":"2023-10-14T19:10:44.906868+0000","last_peered":"2023-10-14T19:10:44.906868+0000","last_clean":"2023-10-14T19:10:44.906868+0000","last_became_active":"2023-10-14T19:10:44.903124+0000","last_became_peered":"2023-10-14T19:10:44.903124+0000","last_unstale":"2023-10-14T19:10:44.906868+0000","last_undegraded":"2023-10-14T19:10:44.906868+0000","last_fullsized":"2023-10-14T19:10:44.906868+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:56.241659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904555+0000","last_change":"2023-10-14T19:10:44.901471+0000","last_active":"2023-10-14T19:10:44.904555+0000","last_peered":"2023-10-14T19:10:44.904555+0000","last_clean":"2023-10-14T19:10:44.904555+0000","last_became_active":"2023-10-14T19:10:44.901180+0000","last_became_peered":"2023-10-14T19:10:44.901180+0000","last_unstale":"2023-10-14T19:10:44.904555+0000","last_undegraded":"2023-10-14T19:10:44.904555+0000","last_fullsized":"2023-10-14T19:10:44.904555+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:00.520236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902507+0000","last_change":"2023-10-14T19:10:44.893421+0000","last_active":"2023-10-14T19:10:44.902507+0000","last_peered":"2023-10-14T19:10:44.902507+0000","last_clean":"2023-10-14T19:10:44.902507+0000","last_became_active":"2023-10-14T19:10:44.893146+0000","last_became_peered":"2023-10-14T19:10:44.893146+0000","last_unstale":"2023-10-14T19:10:44.902507+0000","last_undegraded":"2023-10-14T19:10:44.902507+0000","last_fullsized":"2023-10-14T19:10:44.902507+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:37.332548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906190+0000","last_change":"2023-10-14T19:10:44.903652+0000","last_active":"2023-10-14T19:10:44.906190+0000","last_peered":"2023-10-14T19:10:44.906190+0000","last_clean":"2023-10-14T19:10:44.906190+0000","last_became_active":"2023-10-14T19:10:44.902806+0000","last_became_peered":"2023-10-14T19:10:44.902806+0000","last_unstale":"2023-10-14T19:10:44.906190+0000","last_undegraded":"2023-10-14T19:10:44.906190+0000","last_fullsized":"2023-10-14T19:10:44.906190+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:50.002060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912277+0000","last_change":"2023-10-14T19:10:44.909396+0000","last_active":"2023-10-14T19:10:44.912277+0000","last_peered":"2023-10-14T19:10:44.912277+0000","last_clean":"2023-10-14T19:10:44.912277+0000","last_became_active":"2023-10-14T19:10:44.909147+0000","last_became_peered":"2023-10-14T19:10:44.909147+0000","last_unstale":"2023-10-14T19:10:44.912277+0000","last_undegraded":"2023-10-14T19:10:44.912277+0000","last_fullsized":"2023-10-14T19:10:44.912277+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:40.735176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913439+0000","last_change":"2023-10-14T19:10:44.901848+0000","last_active":"2023-10-14T19:10:44.913439+0000","last_peered":"2023-10-14T19:10:44.913439+0000","last_clean":"2023-10-14T19:10:44.913439+0000","last_became_active":"2023-10-14T19:10:44.901608+0000","last_became_peered":"2023-10-14T19:10:44.901608+0000","last_unstale":"2023-10-14T19:10:44.913439+0000","last_undegraded":"2023-10-14T19:10:44.913439+0000","last_fullsized":"2023-10-14T19:10:44.913439+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:18.706521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908129+0000","last_change":"2023-10-14T19:10:44.905057+0000","last_active":"2023-10-14T19:10:44.908129+0000","last_peered":"2023-10-14T19:10:44.908129+0000","last_clean":"2023-10-14T19:10:44.908129+0000","last_became_active":"2023-10-14T19:10:44.904761+0000","last_became_peered":"2023-10-14T19:10:44.904761+0000","last_unstale":"2023-10-14T19:10:44.908129+0000","last_undegraded":"2023-10-14T19:10:44.908129+0000","last_fullsized":"2023-10-14T19:10:44.908129+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:26.308671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910510+0000","last_change":"2023-10-14T19:10:44.907311+0000","last_active":"2023-10-14T19:10:44.910510+0000","last_peered":"2023-10-14T19:10:44.910510+0000","last_clean":"2023-10-14T19:10:44.910510+0000","last_became_active":"2023-10-14T19:10:44.907027+0000","last_became_peered":"2023-10-14T19:10:44.907027+0000","last_unstale":"2023-10-14T19:10:44.910510+0000","last_undegraded":"2023-10-14T19:10:44.910510+0000","last_fullsized":"2023-10-14T19:10:44.910510+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:01.897170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910630+0000","last_change":"2023-10-14T19:10:44.907445+0000","last_active":"2023-10-14T19:10:44.910630+0000","last_peered":"2023-10-14T19:10:44.910630+0000","last_clean":"2023-10-14T19:10:44.910630+0000","last_became_active":"2023-10-14T19:10:44.907118+0000","last_became_peered":"2023-10-14T19:10:44.907118+0000","last_unstale":"2023-10-14T19:10:44.910630+0000","last_undegraded":"2023-10-14T19:10:44.910630+0000","last_fullsized":"2023-10-14T19:10:44.910630+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:04.771169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910173+0000","last_change":"2023-10-14T19:10:44.908434+0000","last_active":"2023-10-14T19:10:44.910173+0000","last_peered":"2023-10-14T19:10:44.910173+0000","last_clean":"2023-10-14T19:10:44.910173+0000","last_became_active":"2023-10-14T19:10:44.907576+0000","last_became_peered":"2023-10-14T19:10:44.907576+0000","last_unstale":"2023-10-14T19:10:44.910173+0000","last_undegraded":"2023-10-14T19:10:44.910173+0000","last_fullsized":"2023-10-14T19:10:44.910173+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:03.906136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902648+0000","last_change":"2023-10-14T19:10:44.897063+0000","last_active":"2023-10-14T19:10:44.902648+0000","last_peered":"2023-10-14T19:10:44.902648+0000","last_clean":"2023-10-14T19:10:44.902648+0000","last_became_active":"2023-10-14T19:10:44.896717+0000","last_became_peered":"2023-10-14T19:10:44.896717+0000","last_unstale":"2023-10-14T19:10:44.902648+0000","last_undegraded":"2023-10-14T19:10:44.902648+0000","last_fullsized":"2023-10-14T19:10:44.902648+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:46.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913437+0000","last_change":"2023-10-14T19:10:44.900657+0000","last_active":"2023-10-14T19:10:44.913437+0000","last_peered":"2023-10-14T19:10:44.913437+0000","last_clean":"2023-10-14T19:10:44.913437+0000","last_became_active":"2023-10-14T19:10:44.898256+0000","last_became_peered":"2023-10-14T19:10:44.898256+0000","last_unstale":"2023-10-14T19:10:44.913437+0000","last_undegraded":"2023-10-14T19:10:44.913437+0000","last_fullsized":"2023-10-14T19:10:44.913437+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:17:30.798848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912698+0000","last_change":"2023-10-14T19:10:44.910856+0000","last_active":"2023-10-14T19:10:44.912698+0000","last_peered":"2023-10-14T19:10:44.912698+0000","last_clean":"2023-10-14T19:10:44.912698+0000","last_became_active":"2023-10-14T19:10:44.910555+0000","last_became_peered":"2023-10-14T19:10:44.910555+0000","last_unstale":"2023-10-14T19:10:44.912698+0000","last_undegraded":"2023-10-14T19:10:44.912698+0000","last_fullsized":"2023-10-14T19:10:44.912698+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:29.089378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":14,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.907303+0000","last_change":"2023-10-14T19:10:43.897050+0000","last_active":"2023-10-14T19:10:44.907303+0000","last_peered":"2023-10-14T19:10:44.907303+0000","last_clean":"2023-10-14T19:10:44.907303+0000","last_became_active":"2023-10-14T19:10:43.896752+0000","last_became_peered":"2023-10-14T19:10:43.896752+0000","last_unstale":"2023-10-14T19:10:44.907303+0000","last_undegraded":"2023-10-14T19:10:44.907303+0000","last_fullsized":"2023-10-14T19:10:44.907303+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:00.892294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.895499+0000","last_change":"2023-10-14T19:10:44.892412+0000","last_active":"2023-10-14T19:10:44.895499+0000","last_peered":"2023-10-14T19:10:44.895499+0000","last_clean":"2023-10-14T19:10:44.895499+0000","last_became_active":"2023-10-14T19:10:44.892128+0000","last_became_peered":"2023-10-14T19:10:44.892128+0000","last_unstale":"2023-10-14T19:10:44.895499+0000","last_undegraded":"2023-10-14T19:10:44.895499+0000","last_fullsized":"2023-10-14T19:10:44.895499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:47.837491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908325+0000","last_change":"2023-10-14T19:10:43.899189+0000","last_active":"2023-10-14T19:10:44.908325+0000","last_peered":"2023-10-14T19:10:44.908325+0000","last_clean":"2023-10-14T19:10:44.908325+0000","last_became_active":"2023-10-14T19:10:43.898885+0000","last_became_peered":"2023-10-14T19:10:43.898885+0000","last_unstale":"2023-10-14T19:10:44.908325+0000","last_undegraded":"2023-10-14T19:10:44.908325+0000","last_fullsized":"2023-10-14T19:10:44.908325+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:17.594439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913351+0000","last_change":"2023-10-14T19:10:44.900339+0000","last_active":"2023-10-14T19:10:44.913351+0000","last_peered":"2023-10-14T19:10:44.913351+0000","last_clean":"2023-10-14T19:10:44.913351+0000","last_became_active":"2023-10-14T19:10:44.897971+0000","last_became_peered":"2023-10-14T19:10:44.897971+0000","last_unstale":"2023-10-14T19:10:44.913351+0000","last_undegraded":"2023-10-14T19:10:44.913351+0000","last_fullsized":"2023-10-14T19:10:44.913351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908066+0000","last_change":"2023-10-14T19:10:43.896205+0000","last_active":"2023-10-14T19:10:44.908066+0000","last_peered":"2023-10-14T19:10:44.908066+0000","last_clean":"2023-10-14T19:10:44.908066+0000","last_became_active":"2023-10-14T19:10:43.895957+0000","last_became_peered":"2023-10-14T19:10:43.895957+0000","last_unstale":"2023-10-14T19:10:44.908066+0000","last_undegraded":"2023-10-14T19:10:44.908066+0000","last_fullsized":"2023-10-14T19:10:44.908066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:48.097648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903373+0000","last_change":"2023-10-14T19:10:44.900932+0000","last_active":"2023-10-14T19:10:44.903373+0000","last_peered":"2023-10-14T19:10:44.903373+0000","last_clean":"2023-10-14T19:10:44.903373+0000","last_became_active":"2023-10-14T19:10:44.900382+0000","last_became_peered":"2023-10-14T19:10:44.900382+0000","last_unstale":"2023-10-14T19:10:44.903373+0000","last_undegraded":"2023-10-14T19:10:44.903373+0000","last_fullsized":"2023-10-14T19:10:44.903373+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:17:38.048435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913690+0000","last_change":"2023-10-14T19:10:43.897448+0000","last_active":"2023-10-14T19:10:44.913690+0000","last_peered":"2023-10-14T19:10:44.913690+0000","last_clean":"2023-10-14T19:10:44.913690+0000","last_became_active":"2023-10-14T19:10:43.897073+0000","last_became_peered":"2023-10-14T19:10:43.897073+0000","last_unstale":"2023-10-14T19:10:44.913690+0000","last_undegraded":"2023-10-14T19:10:44.913690+0000","last_fullsized":"2023-10-14T19:10:44.913690+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:01:56.721007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906884+0000","last_change":"2023-10-14T19:10:44.904496+0000","last_active":"2023-10-14T19:10:44.906884+0000","last_peered":"2023-10-14T19:10:44.906884+0000","last_clean":"2023-10-14T19:10:44.906884+0000","last_became_active":"2023-10-14T19:10:44.904225+0000","last_became_peered":"2023-10-14T19:10:44.904225+0000","last_unstale":"2023-10-14T19:10:44.906884+0000","last_undegraded":"2023-10-14T19:10:44.906884+0000","last_fullsized":"2023-10-14T19:10:44.906884+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.720903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905858+0000","last_change":"2023-10-14T19:10:43.899262+0000","last_active":"2023-10-14T19:10:44.905858+0000","last_peered":"2023-10-14T19:10:44.905858+0000","last_clean":"2023-10-14T19:10:44.905858+0000","last_became_active":"2023-10-14T19:10:43.898687+0000","last_became_peered":"2023-10-14T19:10:43.898687+0000","last_unstale":"2023-10-14T19:10:44.905858+0000","last_undegraded":"2023-10-14T19:10:44.905858+0000","last_fullsized":"2023-10-14T19:10:44.905858+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.472815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906110+0000","last_change":"2023-10-14T19:10:44.904160+0000","last_active":"2023-10-14T19:10:44.906110+0000","last_peered":"2023-10-14T19:10:44.906110+0000","last_clean":"2023-10-14T19:10:44.906110+0000","last_became_active":"2023-10-14T19:10:44.903881+0000","last_became_peered":"2023-10-14T19:10:44.903881+0000","last_unstale":"2023-10-14T19:10:44.906110+0000","last_undegraded":"2023-10-14T19:10:44.906110+0000","last_fullsized":"2023-10-14T19:10:44.906110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:06.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887596+0000","last_change":"2023-10-14T19:10:43.896786+0000","last_active":"2023-10-14T19:10:44.887596+0000","last_peered":"2023-10-14T19:10:44.887596+0000","last_clean":"2023-10-14T19:10:44.887596+0000","last_became_active":"2023-10-14T19:10:43.896490+0000","last_became_peered":"2023-10-14T19:10:43.896490+0000","last_unstale":"2023-10-14T19:10:44.887596+0000","last_undegraded":"2023-10-14T19:10:44.887596+0000","last_fullsized":"2023-10-14T19:10:44.887596+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:36.327673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906226+0000","last_change":"2023-10-14T19:10:44.903855+0000","last_active":"2023-10-14T19:10:44.906226+0000","last_peered":"2023-10-14T19:10:44.906226+0000","last_clean":"2023-10-14T19:10:44.906226+0000","last_became_active":"2023-10-14T19:10:44.903585+0000","last_became_peered":"2023-10-14T19:10:44.903585+0000","last_unstale":"2023-10-14T19:10:44.906226+0000","last_undegraded":"2023-10-14T19:10:44.906226+0000","last_fullsized":"2023-10-14T19:10:44.906226+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:11.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.888688+0000","last_change":"2023-10-14T19:10:43.898809+0000","last_active":"2023-10-14T19:10:44.888688+0000","last_peered":"2023-10-14T19:10:44.888688+0000","last_clean":"2023-10-14T19:10:44.888688+0000","last_became_active":"2023-10-14T19:10:43.898533+0000","last_became_peered":"2023-10-14T19:10:43.898533+0000","last_unstale":"2023-10-14T19:10:44.888688+0000","last_undegraded":"2023-10-14T19:10:44.888688+0000","last_fullsized":"2023-10-14T19:10:44.888688+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:03.766293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910600+0000","last_change":"2023-10-14T19:10:44.907014+0000","last_active":"2023-10-14T19:10:44.910600+0000","last_peered":"2023-10-14T19:10:44.910600+0000","last_clean":"2023-10-14T19:10:44.910600+0000","last_became_active":"2023-10-14T19:10:44.906732+0000","last_became_peered":"2023-10-14T19:10:44.906732+0000","last_unstale":"2023-10-14T19:10:44.910600+0000","last_undegraded":"2023-10-14T19:10:44.910600+0000","last_fullsized":"2023-10-14T19:10:44.910600+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:28.785128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887138+0000","last_change":"2023-10-14T19:10:43.896796+0000","last_active":"2023-10-14T19:10:44.887138+0000","last_peered":"2023-10-14T19:10:44.887138+0000","last_clean":"2023-10-14T19:10:44.887138+0000","last_became_active":"2023-10-14T19:10:43.896541+0000","last_became_peered":"2023-10-14T19:10:43.896541+0000","last_unstale":"2023-10-14T19:10:44.887138+0000","last_undegraded":"2023-10-14T19:10:44.887138+0000","last_fullsized":"2023-10-14T19:10:44.887138+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:25.585439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903143+0000","last_change":"2023-10-14T19:10:44.898610+0000","last_active":"2023-10-14T19:10:44.903143+0000","last_peered":"2023-10-14T19:10:44.903143+0000","last_clean":"2023-10-14T19:10:44.903143+0000","last_became_active":"2023-10-14T19:10:44.898308+0000","last_became_peered":"2023-10-14T19:10:44.898308+0000","last_unstale":"2023-10-14T19:10:44.903143+0000","last_undegraded":"2023-10-14T19:10:44.903143+0000","last_fullsized":"2023-10-14T19:10:44.903143+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:18.599315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.889819+0000","last_change":"2023-10-14T19:10:43.897099+0000","last_active":"2023-10-14T19:10:44.889819+0000","last_peered":"2023-10-14T19:10:44.889819+0000","last_clean":"2023-10-14T19:10:44.889819+0000","last_became_active":"2023-10-14T19:10:43.896842+0000","last_became_peered":"2023-10-14T19:10:43.896842+0000","last_unstale":"2023-10-14T19:10:44.889819+0000","last_undegraded":"2023-10-14T19:10:44.889819+0000","last_fullsized":"2023-10-14T19:10:44.889819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:33.244937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905389+0000","last_change":"2023-10-14T19:10:44.901305+0000","last_active":"2023-10-14T19:10:44.905389+0000","last_peered":"2023-10-14T19:10:44.905389+0000","last_clean":"2023-10-14T19:10:44.905389+0000","last_became_active":"2023-10-14T19:10:44.901042+0000","last_became_peered":"2023-10-14T19:10:44.901042+0000","last_unstale":"2023-10-14T19:10:44.905389+0000","last_undegraded":"2023-10-14T19:10:44.905389+0000","last_fullsized":"2023-10-14T19:10:44.905389+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:30.114861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915421+0000","last_change":"2023-10-14T19:10:43.894223+0000","last_active":"2023-10-14T19:10:44.915421+0000","last_peered":"2023-10-14T19:10:44.915421+0000","last_clean":"2023-10-14T19:10:44.915421+0000","last_became_active":"2023-10-14T19:10:43.893955+0000","last_became_peered":"2023-10-14T19:10:43.893955+0000","last_unstale":"2023-10-14T19:10:44.915421+0000","last_undegraded":"2023-10-14T19:10:44.915421+0000","last_fullsized":"2023-10-14T19:10:44.915421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:27.300391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914419+0000","last_change":"2023-10-14T19:10:44.911478+0000","last_active":"2023-10-14T19:10:44.914419+0000","last_peered":"2023-10-14T19:10:44.914419+0000","last_clean":"2023-10-14T19:10:44.914419+0000","last_became_active":"2023-10-14T19:10:44.910748+0000","last_became_peered":"2023-10-14T19:10:44.910748+0000","last_unstale":"2023-10-14T19:10:44.914419+0000","last_undegraded":"2023-10-14T19:10:44.914419+0000","last_fullsized":"2023-10-14T19:10:44.914419+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:58.543757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912831+0000","last_change":"2023-10-14T19:10:43.897286+0000","last_active":"2023-10-14T19:10:44.912831+0000","last_peered":"2023-10-14T19:10:44.912831+0000","last_clean":"2023-10-14T19:10:44.912831+0000","last_became_active":"2023-10-14T19:10:43.896768+0000","last_became_peered":"2023-10-14T19:10:43.896768+0000","last_unstale":"2023-10-14T19:10:44.912831+0000","last_undegraded":"2023-10-14T19:10:44.912831+0000","last_fullsized":"2023-10-14T19:10:44.912831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:21.618756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905954+0000","last_change":"2023-10-14T19:10:44.899156+0000","last_active":"2023-10-14T19:10:44.905954+0000","last_peered":"2023-10-14T19:10:44.905954+0000","last_clean":"2023-10-14T19:10:44.905954+0000","last_became_active":"2023-10-14T19:10:44.898891+0000","last_became_peered":"2023-10-14T19:10:44.898891+0000","last_unstale":"2023-10-14T19:10:44.905954+0000","last_undegraded":"2023-10-14T19:10:44.905954+0000","last_fullsized":"2023-10-14T19:10:44.905954+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:22.623632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906480+0000","last_change":"2023-10-14T19:10:43.899218+0000","last_active":"2023-10-14T19:10:44.906480+0000","last_peered":"2023-10-14T19:10:44.906480+0000","last_clean":"2023-10-14T19:10:44.906480+0000","last_became_active":"2023-10-14T19:10:43.898937+0000","last_became_peered":"2023-10-14T19:10:43.898937+0000","last_unstale":"2023-10-14T19:10:44.906480+0000","last_undegraded":"2023-10-14T19:10:44.906480+0000","last_fullsized":"2023-10-14T19:10:44.906480+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:40.620170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915358+0000","last_change":"2023-10-14T19:10:44.909199+0000","last_active":"2023-10-14T19:10:44.915358+0000","last_peered":"2023-10-14T19:10:44.915358+0000","last_clean":"2023-10-14T19:10:44.915358+0000","last_became_active":"2023-10-14T19:10:44.908149+0000","last_became_peered":"2023-10-14T19:10:44.908149+0000","last_unstale":"2023-10-14T19:10:44.915358+0000","last_undegraded":"2023-10-14T19:10:44.915358+0000","last_fullsized":"2023-10-14T19:10:44.915358+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:44.857129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.888947+0000","last_change":"2023-10-14T19:10:43.893311+0000","last_active":"2023-10-14T19:10:44.888947+0000","last_peered":"2023-10-14T19:10:44.888947+0000","last_clean":"2023-10-14T19:10:44.888947+0000","last_became_active":"2023-10-14T19:10:43.893008+0000","last_became_peered":"2023-10-14T19:10:43.893008+0000","last_unstale":"2023-10-14T19:10:44.888947+0000","last_undegraded":"2023-10-14T19:10:44.888947+0000","last_fullsized":"2023-10-14T19:10:44.888947+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:02.901260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910057+0000","last_change":"2023-10-14T19:10:44.904608+0000","last_active":"2023-10-14T19:10:44.910057+0000","last_peered":"2023-10-14T19:10:44.910057+0000","last_clean":"2023-10-14T19:10:44.910057+0000","last_became_active":"2023-10-14T19:10:44.904210+0000","last_became_peered":"2023-10-14T19:10:44.904210+0000","last_unstale":"2023-10-14T19:10:44.910057+0000","last_undegraded":"2023-10-14T19:10:44.910057+0000","last_fullsized":"2023-10-14T19:10:44.910057+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:18.817926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.890399+0000","last_change":"2023-10-14T19:10:43.892989+0000","last_active":"2023-10-14T19:10:44.890399+0000","last_peered":"2023-10-14T19:10:44.890399+0000","last_clean":"2023-10-14T19:10:44.890399+0000","last_became_active":"2023-10-14T19:10:43.892607+0000","last_became_peered":"2023-10-14T19:10:43.892607+0000","last_unstale":"2023-10-14T19:10:44.890399+0000","last_undegraded":"2023-10-14T19:10:44.890399+0000","last_fullsized":"2023-10-14T19:10:44.890399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:51:20.457406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914535+0000","last_change":"2023-10-14T19:10:44.911800+0000","last_active":"2023-10-14T19:10:44.914535+0000","last_peered":"2023-10-14T19:10:44.914535+0000","last_clean":"2023-10-14T19:10:44.914535+0000","last_became_active":"2023-10-14T19:10:44.911560+0000","last_became_peered":"2023-10-14T19:10:44.911560+0000","last_unstale":"2023-10-14T19:10:44.914535+0000","last_undegraded":"2023-10-14T19:10:44.914535+0000","last_fullsized":"2023-10-14T19:10:44.914535+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:51.872613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910005+0000","last_change":"2023-10-14T19:10:43.895737+0000","last_active":"2023-10-14T19:10:44.910005+0000","last_peered":"2023-10-14T19:10:44.910005+0000","last_clean":"2023-10-14T19:10:44.910005+0000","last_became_active":"2023-10-14T19:10:43.895453+0000","last_became_peered":"2023-10-14T19:10:43.895453+0000","last_unstale":"2023-10-14T19:10:44.910005+0000","last_undegraded":"2023-10-14T19:10:44.910005+0000","last_fullsized":"2023-10-14T19:10:44.910005+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:19.720670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909395+0000","last_change":"2023-10-14T19:10:44.906699+0000","last_active":"2023-10-14T19:10:44.909395+0000","last_peered":"2023-10-14T19:10:44.909395+0000","last_clean":"2023-10-14T19:10:44.909395+0000","last_became_active":"2023-10-14T19:10:44.906097+0000","last_became_peered":"2023-10-14T19:10:44.906097+0000","last_unstale":"2023-10-14T19:10:44.909395+0000","last_undegraded":"2023-10-14T19:10:44.909395+0000","last_fullsized":"2023-10-14T19:10:44.909395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:09.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.907470+0000","last_change":"2023-10-14T19:10:43.896278+0000","last_active":"2023-10-14T19:10:44.907470+0000","last_peered":"2023-10-14T19:10:44.907470+0000","last_clean":"2023-10-14T19:10:44.907470+0000","last_became_active":"2023-10-14T19:10:43.896005+0000","last_became_peered":"2023-10-14T19:10:43.896005+0000","last_unstale":"2023-10-14T19:10:44.907470+0000","last_undegraded":"2023-10-14T19:10:44.907470+0000","last_fullsized":"2023-10-14T19:10:44.907470+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:08.147952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912635+0000","last_change":"2023-10-14T19:10:44.909908+0000","last_active":"2023-10-14T19:10:44.912635+0000","last_peered":"2023-10-14T19:10:44.912635+0000","last_clean":"2023-10-14T19:10:44.912635+0000","last_became_active":"2023-10-14T19:10:44.909674+0000","last_became_peered":"2023-10-14T19:10:44.909674+0000","last_unstale":"2023-10-14T19:10:44.912635+0000","last_undegraded":"2023-10-14T19:10:44.912635+0000","last_fullsized":"2023-10-14T19:10:44.912635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:47.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913473+0000","last_change":"2023-10-14T19:10:43.898631+0000","last_active":"2023-10-14T19:10:44.913473+0000","last_peered":"2023-10-14T19:10:44.913473+0000","last_clean":"2023-10-14T19:10:44.913473+0000","last_became_active":"2023-10-14T19:10:43.898378+0000","last_became_peered":"2023-10-14T19:10:43.898378+0000","last_unstale":"2023-10-14T19:10:44.913473+0000","last_undegraded":"2023-10-14T19:10:44.913473+0000","last_fullsized":"2023-10-14T19:10:44.913473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:00.892294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910534+0000","last_change":"2023-10-14T19:10:44.909345+0000","last_active":"2023-10-14T19:10:44.910534+0000","last_peered":"2023-10-14T19:10:44.910534+0000","last_clean":"2023-10-14T19:10:44.910534+0000","last_became_active":"2023-10-14T19:10:44.909079+0000","last_became_peered":"2023-10-14T19:10:44.909079+0000","last_unstale":"2023-10-14T19:10:44.910534+0000","last_undegraded":"2023-10-14T19:10:44.910534+0000","last_fullsized":"2023-10-14T19:10:44.910534+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:39.684528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915560+0000","last_change":"2023-10-14T19:10:43.896830+0000","last_active":"2023-10-14T19:10:44.915560+0000","last_peered":"2023-10-14T19:10:44.915560+0000","last_clean":"2023-10-14T19:10:44.915560+0000","last_became_active":"2023-10-14T19:10:43.896505+0000","last_became_peered":"2023-10-14T19:10:43.896505+0000","last_unstale":"2023-10-14T19:10:44.915560+0000","last_undegraded":"2023-10-14T19:10:44.915560+0000","last_fullsized":"2023-10-14T19:10:44.915560+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:32.246459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903395+0000","last_change":"2023-10-14T19:10:44.901342+0000","last_active":"2023-10-14T19:10:44.903395+0000","last_peered":"2023-10-14T19:10:44.903395+0000","last_clean":"2023-10-14T19:10:44.903395+0000","last_became_active":"2023-10-14T19:10:44.900672+0000","last_became_peered":"2023-10-14T19:10:44.900672+0000","last_unstale":"2023-10-14T19:10:44.903395+0000","last_undegraded":"2023-10-14T19:10:44.903395+0000","last_fullsized":"2023-10-14T19:10:44.903395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:44.615357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.894357+0000","last_change":"2023-10-14T19:10:43.895735+0000","last_active":"2023-10-14T19:10:44.894357+0000","last_peered":"2023-10-14T19:10:44.894357+0000","last_clean":"2023-10-14T19:10:44.894357+0000","last_became_active":"2023-10-14T19:10:43.895175+0000","last_became_peered":"2023-10-14T19:10:43.895175+0000","last_unstale":"2023-10-14T19:10:44.894357+0000","last_undegraded":"2023-10-14T19:10:44.894357+0000","last_fullsized":"2023-10-14T19:10:44.894357+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:51:48.470404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913117+0000","last_change":"2023-10-14T19:10:44.907697+0000","last_active":"2023-10-14T19:10:44.913117+0000","last_peered":"2023-10-14T19:10:44.913117+0000","last_clean":"2023-10-14T19:10:44.913117+0000","last_became_active":"2023-10-14T19:10:44.907401+0000","last_became_peered":"2023-10-14T19:10:44.907401+0000","last_unstale":"2023-10-14T19:10:44.913117+0000","last_undegraded":"2023-10-14T19:10:44.913117+0000","last_fullsized":"2023-10-14T19:10:44.913117+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:57.761982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914973+0000","last_change":"2023-10-14T19:10:43.896635+0000","last_active":"2023-10-14T19:10:44.914973+0000","last_peered":"2023-10-14T19:10:44.914973+0000","last_clean":"2023-10-14T19:10:44.914973+0000","last_became_active":"2023-10-14T19:10:43.896363+0000","last_became_peered":"2023-10-14T19:10:43.896363+0000","last_unstale":"2023-10-14T19:10:44.914973+0000","last_undegraded":"2023-10-14T19:10:44.914973+0000","last_fullsized":"2023-10-14T19:10:44.914973+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:29.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910514+0000","last_change":"2023-10-14T19:10:44.907399+0000","last_active":"2023-10-14T19:10:44.910514+0000","last_peered":"2023-10-14T19:10:44.910514+0000","last_clean":"2023-10-14T19:10:44.910514+0000","last_became_active":"2023-10-14T19:10:44.907071+0000","last_became_peered":"2023-10-14T19:10:44.907071+0000","last_unstale":"2023-10-14T19:10:44.910514+0000","last_undegraded":"2023-10-14T19:10:44.910514+0000","last_fullsized":"2023-10-14T19:10:44.910514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:37:16.136472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.884829+0000","last_change":"2023-10-14T19:10:43.894297+0000","last_active":"2023-10-14T19:10:44.884829+0000","last_peered":"2023-10-14T19:10:44.884829+0000","last_clean":"2023-10-14T19:10:44.884829+0000","last_became_active":"2023-10-14T19:10:43.894006+0000","last_became_peered":"2023-10-14T19:10:43.894006+0000","last_unstale":"2023-10-14T19:10:44.884829+0000","last_undegraded":"2023-10-14T19:10:44.884829+0000","last_fullsized":"2023-10-14T19:10:44.884829+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:21.241131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909544+0000","last_change":"2023-10-14T19:10:44.906664+0000","last_active":"2023-10-14T19:10:44.909544+0000","last_peered":"2023-10-14T19:10:44.909544+0000","last_clean":"2023-10-14T19:10:44.909544+0000","last_became_active":"2023-10-14T19:10:44.906394+0000","last_became_peered":"2023-10-14T19:10:44.906394+0000","last_unstale":"2023-10-14T19:10:44.909544+0000","last_undegraded":"2023-10-14T19:10:44.909544+0000","last_fullsized":"2023-10-14T19:10:44.909544+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:47.228675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.885651+0000","last_change":"2023-10-14T19:10:43.895774+0000","last_active":"2023-10-14T19:10:44.885651+0000","last_peered":"2023-10-14T19:10:44.885651+0000","last_clean":"2023-10-14T19:10:44.885651+0000","last_became_active":"2023-10-14T19:10:43.895510+0000","last_became_peered":"2023-10-14T19:10:43.895510+0000","last_unstale":"2023-10-14T19:10:44.885651+0000","last_undegraded":"2023-10-14T19:10:44.885651+0000","last_fullsized":"2023-10-14T19:10:44.885651+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:48.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903852+0000","last_change":"2023-10-14T19:10:44.895955+0000","last_active":"2023-10-14T19:10:44.903852+0000","last_peered":"2023-10-14T19:10:44.903852+0000","last_clean":"2023-10-14T19:10:44.903852+0000","last_became_active":"2023-10-14T19:10:44.895720+0000","last_became_peered":"2023-10-14T19:10:44.895720+0000","last_unstale":"2023-10-14T19:10:44.903852+0000","last_undegraded":"2023-10-14T19:10:44.903852+0000","last_fullsized":"2023-10-14T19:10:44.903852+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:17.972151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893365+0000","last_change":"2023-10-14T19:10:43.898901+0000","last_active":"2023-10-14T19:10:44.893365+0000","last_peered":"2023-10-14T19:10:44.893365+0000","last_clean":"2023-10-14T19:10:44.893365+0000","last_became_active":"2023-10-14T19:10:43.898613+0000","last_became_peered":"2023-10-14T19:10:43.898613+0000","last_unstale":"2023-10-14T19:10:44.893365+0000","last_undegraded":"2023-10-14T19:10:44.893365+0000","last_fullsized":"2023-10-14T19:10:44.893365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:28.084502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.900940+0000","last_change":"2023-10-14T19:10:44.897056+0000","last_active":"2023-10-14T19:10:44.900940+0000","last_peered":"2023-10-14T19:10:44.900940+0000","last_clean":"2023-10-14T19:10:44.900940+0000","last_became_active":"2023-10-14T19:10:44.896748+0000","last_became_peered":"2023-10-14T19:10:44.896748+0000","last_unstale":"2023-10-14T19:10:44.900940+0000","last_undegraded":"2023-10-14T19:10:44.900940+0000","last_fullsized":"2023-10-14T19:10:44.900940+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:40.382502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906518+0000","last_change":"2023-10-14T19:10:43.899992+0000","last_active":"2023-10-14T19:10:44.906518+0000","last_peered":"2023-10-14T19:10:44.906518+0000","last_clean":"2023-10-14T19:10:44.906518+0000","last_became_active":"2023-10-14T19:10:43.899595+0000","last_became_peered":"2023-10-14T19:10:43.899595+0000","last_unstale":"2023-10-14T19:10:44.906518+0000","last_undegraded":"2023-10-14T19:10:44.906518+0000","last_fullsized":"2023-10-14T19:10:44.906518+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:49.352138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913265+0000","last_change":"2023-10-14T19:10:44.897649+0000","last_active":"2023-10-14T19:10:44.913265+0000","last_peered":"2023-10-14T19:10:44.913265+0000","last_clean":"2023-10-14T19:10:44.913265+0000","last_became_active":"2023-10-14T19:10:44.897361+0000","last_became_peered":"2023-10-14T19:10:44.897361+0000","last_unstale":"2023-10-14T19:10:44.913265+0000","last_undegraded":"2023-10-14T19:10:44.913265+0000","last_fullsized":"2023-10-14T19:10:44.913265+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:11.023360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893836+0000","last_change":"2023-10-14T19:10:43.896575+0000","last_active":"2023-10-14T19:10:44.893836+0000","last_peered":"2023-10-14T19:10:44.893836+0000","last_clean":"2023-10-14T19:10:44.893836+0000","last_became_active":"2023-10-14T19:10:43.896203+0000","last_became_peered":"2023-10-14T19:10:43.896203+0000","last_unstale":"2023-10-14T19:10:44.893836+0000","last_undegraded":"2023-10-14T19:10:44.893836+0000","last_fullsized":"2023-10-14T19:10:44.893836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:07.649541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915363+0000","last_change":"2023-10-14T19:10:44.914375+0000","last_active":"2023-10-14T19:10:44.915363+0000","last_peered":"2023-10-14T19:10:44.915363+0000","last_clean":"2023-10-14T19:10:44.915363+0000","last_became_active":"2023-10-14T19:10:44.914104+0000","last_became_peered":"2023-10-14T19:10:44.914104+0000","last_unstale":"2023-10-14T19:10:44.915363+0000","last_undegraded":"2023-10-14T19:10:44.915363+0000","last_fullsized":"2023-10-14T19:10:44.915363+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:41.625045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887188+0000","last_change":"2023-10-14T19:10:43.898048+0000","last_active":"2023-10-14T19:10:44.887188+0000","last_peered":"2023-10-14T19:10:44.887188+0000","last_clean":"2023-10-14T19:10:44.887188+0000","last_became_active":"2023-10-14T19:10:43.897867+0000","last_became_peered":"2023-10-14T19:10:43.897867+0000","last_unstale":"2023-10-14T19:10:44.887188+0000","last_undegraded":"2023-10-14T19:10:44.887188+0000","last_fullsized":"2023-10-14T19:10:44.887188+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:59.515361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904477+0000","last_change":"2023-10-14T19:10:44.899094+0000","last_active":"2023-10-14T19:10:44.904477+0000","last_peered":"2023-10-14T19:10:44.904477+0000","last_clean":"2023-10-14T19:10:44.904477+0000","last_became_active":"2023-10-14T19:10:44.898810+0000","last_became_peered":"2023-10-14T19:10:44.898810+0000","last_unstale":"2023-10-14T19:10:44.904477+0000","last_undegraded":"2023-10-14T19:10:44.904477+0000","last_fullsized":"2023-10-14T19:10:44.904477+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:09.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.896635+0000","last_change":"2023-10-14T19:10:43.897735+0000","last_active":"2023-10-14T19:10:44.896635+0000","last_peered":"2023-10-14T19:10:44.896635+0000","last_clean":"2023-10-14T19:10:44.896635+0000","last_became_active":"2023-10-14T19:10:43.897300+0000","last_became_peered":"2023-10-14T19:10:43.897300+0000","last_unstale":"2023-10-14T19:10:44.896635+0000","last_undegraded":"2023-10-14T19:10:44.896635+0000","last_fullsized":"2023-10-14T19:10:44.896635+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:26.042416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913803+0000","last_change":"2023-10-14T19:10:44.910715+0000","last_active":"2023-10-14T19:10:44.913803+0000","last_peered":"2023-10-14T19:10:44.913803+0000","last_clean":"2023-10-14T19:10:44.913803+0000","last_became_active":"2023-10-14T19:10:44.904113+0000","last_became_peered":"2023-10-14T19:10:44.904113+0000","last_unstale":"2023-10-14T19:10:44.913803+0000","last_undegraded":"2023-10-14T19:10:44.913803+0000","last_fullsized":"2023-10-14T19:10:44.913803+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:06:19.212950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.894524+0000","last_change":"2023-10-14T19:10:43.900069+0000","last_active":"2023-10-14T19:10:44.894524+0000","last_peered":"2023-10-14T19:10:44.894524+0000","last_clean":"2023-10-14T19:10:44.894524+0000","last_became_active":"2023-10-14T19:10:43.899776+0000","last_became_peered":"2023-10-14T19:10:43.899776+0000","last_unstale":"2023-10-14T19:10:44.894524+0000","last_undegraded":"2023-10-14T19:10:44.894524+0000","last_fullsized":"2023-10-14T19:10:44.894524+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:05.293638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.900333+0000","last_change":"2023-10-14T19:10:44.896699+0000","last_active":"2023-10-14T19:10:44.900333+0000","last_peered":"2023-10-14T19:10:44.900333+0000","last_clean":"2023-10-14T19:10:44.900333+0000","last_became_active":"2023-10-14T19:10:44.896417+0000","last_became_peered":"2023-10-14T19:10:44.896417+0000","last_unstale":"2023-10-14T19:10:44.900333+0000","last_undegraded":"2023-10-14T19:10:44.900333+0000","last_fullsized":"2023-10-14T19:10:44.900333+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:34.249813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887922+0000","last_change":"2023-10-14T19:10:43.898905+0000","last_active":"2023-10-14T19:10:44.887922+0000","last_peered":"2023-10-14T19:10:44.887922+0000","last_clean":"2023-10-14T19:10:44.887922+0000","last_became_active":"2023-10-14T19:10:43.898553+0000","last_became_peered":"2023-10-14T19:10:43.898553+0000","last_unstale":"2023-10-14T19:10:44.887922+0000","last_undegraded":"2023-10-14T19:10:44.887922+0000","last_fullsized":"2023-10-14T19:10:44.887922+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:46.832615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902108+0000","last_change":"2023-10-14T19:10:44.899767+0000","last_active":"2023-10-14T19:10:44.902108+0000","last_peered":"2023-10-14T19:10:44.902108+0000","last_clean":"2023-10-14T19:10:44.902108+0000","last_became_active":"2023-10-14T19:10:44.899482+0000","last_became_peered":"2023-10-14T19:10:44.899482+0000","last_unstale":"2023-10-14T19:10:44.902108+0000","last_undegraded":"2023-10-14T19:10:44.902108+0000","last_fullsized":"2023-10-14T19:10:44.902108+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:32.663743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.889412+0000","last_change":"2023-10-14T19:10:43.895101+0000","last_active":"2023-10-14T19:10:44.889412+0000","last_peered":"2023-10-14T19:10:44.889412+0000","last_clean":"2023-10-14T19:10:44.889412+0000","last_became_active":"2023-10-14T19:10:43.894786+0000","last_became_peered":"2023-10-14T19:10:43.894786+0000","last_unstale":"2023-10-14T19:10:44.889412+0000","last_undegraded":"2023-10-14T19:10:44.889412+0000","last_fullsized":"2023-10-14T19:10:44.889412+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:06:28.014083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909412+0000","last_change":"2023-10-14T19:10:44.905673+0000","last_active":"2023-10-14T19:10:44.909412+0000","last_peered":"2023-10-14T19:10:44.909412+0000","last_clean":"2023-10-14T19:10:44.909412+0000","last_became_active":"2023-10-14T19:10:44.905374+0000","last_became_peered":"2023-10-14T19:10:44.905374+0000","last_unstale":"2023-10-14T19:10:44.909412+0000","last_undegraded":"2023-10-14T19:10:44.909412+0000","last_fullsized":"2023-10-14T19:10:44.909412+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:38.477691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.890949+0000","last_change":"2023-10-14T19:10:43.893414+0000","last_active":"2023-10-14T19:10:44.890949+0000","last_peered":"2023-10-14T19:10:44.890949+0000","last_clean":"2023-10-14T19:10:44.890949+0000","last_became_active":"2023-10-14T19:10:43.893168+0000","last_became_peered":"2023-10-14T19:10:43.893168+0000","last_unstale":"2023-10-14T19:10:44.890949+0000","last_undegraded":"2023-10-14T19:10:44.890949+0000","last_fullsized":"2023-10-14T19:10:44.890949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:36.172804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913463+0000","last_change":"2023-10-14T19:10:44.900046+0000","last_active":"2023-10-14T19:10:44.913463+0000","last_peered":"2023-10-14T19:10:44.913463+0000","last_clean":"2023-10-14T19:10:44.913463+0000","last_became_active":"2023-10-14T19:10:44.899771+0000","last_became_peered":"2023-10-14T19:10:44.899771+0000","last_unstale":"2023-10-14T19:10:44.913463+0000","last_undegraded":"2023-10-14T19:10:44.913463+0000","last_fullsized":"2023-10-14T19:10:44.913463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:23:37.989440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904697+0000","last_change":"2023-10-14T19:10:43.895310+0000","last_active":"2023-10-14T19:10:44.904697+0000","last_peered":"2023-10-14T19:10:44.904697+0000","last_clean":"2023-10-14T19:10:44.904697+0000","last_became_active":"2023-10-14T19:10:43.895007+0000","last_became_peered":"2023-10-14T19:10:43.895007+0000","last_unstale":"2023-10-14T19:10:44.904697+0000","last_undegraded":"2023-10-14T19:10:44.904697+0000","last_fullsized":"2023-10-14T19:10:44.904697+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:17.594439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893898+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:44.893898+0000","last_peered":"2023-10-14T19:10:44.893898+0000","last_clean":"2023-10-14T19:10:44.893898+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:44.893898+0000","last_undegraded":"2023-10-14T19:10:44.893898+0000","last_fullsized":"2023-10-14T19:10:44.893898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.505}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.53500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.72699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46700000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":866328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.497},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1456730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.495}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.746}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":866272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.314}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.438},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303288,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068552,"statfs":{"total":96636764160,"available":96326197248,"internally_reserved":0,"allocated":1949696,"data_stored":866454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.621}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303296,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068544,"statfs":{"total":96636764160,"available":96326189056,"internally_reserved":0,"allocated":1957888,"data_stored":867912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.76000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.379},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.46899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.64000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:53.592 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:10:53.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.725+0000 7f2905ecf700 1 Processor -- start 2023-10-14T19:10:53.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.725+0000 7f2905ecf700 1 -- start start 2023-10-14T19:10:53.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f2905ecf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29000b0910 0x7f29001579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:53.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f2905ecf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2900156f50 0x7f2900157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f2905ecf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2900157510 con 0x7f2900155b70 2023-10-14T19:10:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f2905ecf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29000ae2f0 con 0x7f2900156f50 2023-10-14T19:10:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f2905ecf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000ae5d0 con 0x7f29000b0910 2023-10-14T19:10:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28ff7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2900155b70 0x7f29000b0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54570/0 (socket says 172.21.15.7:54570) 2023-10-14T19:10:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28ff7fe700 1 -- 172.21.15.7:0/3263550573 learned_addr learned my addr 172.21.15.7:0/3263550573 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fffff700 1 --2- 172.21.15.7:0/3263550573 >> v2:172.21.15.7:3300/0 conn(0x7f2900156f50 0x7f2900157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fe7fc700 1 -- 172.21.15.7:0/3263550573 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189530685 0 0) 0x7f2900157510 con 0x7f2900155b70 2023-10-14T19:10:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fe7fc700 1 -- 172.21.15.7:0/3263550573 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28ec003570 con 0x7f2900155b70 2023-10-14T19:10:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28feffd700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29000b0910 0x7f29001579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fffff700 1 -- 172.21.15.7:0/3263550573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29000b0910 msgr2=0x7f29001579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fffff700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29000b0910 0x7f29001579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fffff700 1 -- 172.21.15.7:0/3263550573 >> v1:172.21.15.7:6789/0 conn(0x7f2900155b70 legacy=0x7f29000b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fffff700 1 -- 172.21.15.7:0/3263550573 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000ae8b0 con 0x7f2900156f50 2023-10-14T19:10:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28feffd700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29000b0910 0x7f29001579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.726+0000 7f28fffff700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900156f50 0x7f2900157ee0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009e60 tx=0x7f28f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef076979e321b296 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f28fe7fc700 1 -- 172.21.15.7:0/3263550573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000bb60 con 0x7f2900156f50 2023-10-14T19:10:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f28fe7fc700 1 -- 172.21.15.7:0/3263550573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000bcc0 con 0x7f2900156f50 2023-10-14T19:10:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f28fe7fc700 1 -- 172.21.15.7:0/3263550573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0011650 con 0x7f2900156f50 2023-10-14T19:10:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 -- 172.21.15.7:0/3263550573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900156f50 msgr2=0x7f2900157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:53.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900156f50 0x7f2900157ee0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009e60 tx=0x7f28f0009780 comp rx=0 tx=0).stop 2023-10-14T19:10:53.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 -- 172.21.15.7:0/3263550573 shutdown_connections 2023-10-14T19:10:53.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900156f50 0x7f2900157ee0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 --2- 172.21.15.7:0/3263550573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29000b0910 0x7f29001579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 -- 172.21.15.7:0/3263550573 >> 172.21.15.7:0/3263550573 conn(0x7f290006d170 msgr2=0x7f29000cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:53.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 -- 172.21.15.7:0/3263550573 shutdown_connections 2023-10-14T19:10:53.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.727+0000 7f2905ecf700 1 -- 172.21.15.7:0/3263550573 wait complete. 2023-10-14T19:10:53.736 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.728+0000 7f2905ecf700 1 Processor -- start 2023-10-14T19:10:53.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 -- start start 2023-10-14T19:10:53.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29000b0910 0x7f29000a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:53.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 0x7f29000a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:53.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2900156f50 0x7f29000abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:53.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000a9ac0 con 0x7f2900155b70 2023-10-14T19:10:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000aa080 con 0x7f29000b0910 2023-10-14T19:10:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f2905ecf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29001504e0 con 0x7f2900156f50 2023-10-14T19:10:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f28feffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 0x7f29000a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f28feffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 0x7f29000a85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45290/0 (socket says 172.21.15.7:45290) 2023-10-14T19:10:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.729+0000 7f28feffd700 1 -- 172.21.15.7:0/4079771746 learned_addr learned my addr 172.21.15.7:0/4079771746 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28fffff700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2900156f50 0x7f29000abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28ff7fe700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29000b0910 0x7f29000a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28feffd700 1 -- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2900156f50 msgr2=0x7f29000abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28feffd700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2900156f50 0x7f29000abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28feffd700 1 -- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29000b0910 msgr2=0x7f29000a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28feffd700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29000b0910 0x7f29000a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28feffd700 1 -- 172.21.15.7:0/4079771746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f0009a20 con 0x7f2900155b70 2023-10-14T19:10:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28ff7fe700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29000b0910 0x7f29000a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28fffff700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2900156f50 0x7f29000abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28feffd700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 0x7f29000a85e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c850 tx=0x7f28e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8011600 con 0x7f2900155b70 2023-10-14T19:10:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8011780 con 0x7f2900155b70 2023-10-14T19:10:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000a8c20 con 0x7f2900155b70 2023-10-14T19:10:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8011b40 con 0x7f2900155b70 2023-10-14T19:10:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.730+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29000a9d10 con 0x7f2900155b70 2023-10-14T19:10:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.731+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29000aa1f0 con 0x7f2900155b70 2023-10-14T19:10:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.731+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f28e80073b0 con 0x7f2900155b70 2023-10-14T19:10:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.732+0000 7f28f77fe700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f28e0067320 0x7f28e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.732+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28e8084cb0 con 0x7f2900155b70 2023-10-14T19:10:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.732+0000 7f28ff7fe700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f28e0067320 0x7f28e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.733+0000 7f28ff7fe700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f28e0067320 0x7f28e00697d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f28f80058d0 tx=0x7f28f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.736+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28e8051830 con 0x7f2900155b70 2023-10-14T19:10:53.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.926+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f290004c3c0 con 0x7f28e0067320 2023-10-14T19:10:53.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.934+0000 7f28f77fe700 1 -- 172.21.15.7:0/4079771746 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290178 (secure 0 0 0) 0x7f290004c3c0 con 0x7f28e0067320 2023-10-14T19:10:53.938 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f28e0067320 msgr2=0x7f28e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f28e0067320 0x7f28e00697d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f28f80058d0 tx=0x7f28f8009040 comp rx=0 tx=0).stop 2023-10-14T19:10:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 msgr2=0x7f29000a85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 0x7f29000a85e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c850 tx=0x7f28e8008040 comp rx=0 tx=0).stop 2023-10-14T19:10:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 shutdown_connections 2023-10-14T19:10:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f28e0067320 0x7f28e00697d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29000b0910 0x7f29000a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2900156f50 0x7f29000abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 --2- 172.21.15.7:0/4079771746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900155b70 0x7f29000a85e0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 >> 172.21.15.7:0/4079771746 conn(0x7f290006d170 msgr2=0x7f290006e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.937+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 shutdown_connections 2023-10-14T19:10:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:53.938+0000 7f2905ecf700 1 -- 172.21.15.7:0/4079771746 wait complete. 2023-10-14T19:10:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:10:53.950 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2023-10-14T19:10:53.733748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427432,"kb_used_data":16360,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547288,"statfs":{"total":773094113280,"available":770608422912,"internally_reserved":0,"allocated":16752640,"data_stored":8115524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.849045"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914375+0000","last_change":"2023-10-14T19:10:44.911246+0000","last_active":"2023-10-14T19:10:44.914375+0000","last_peered":"2023-10-14T19:10:44.914375+0000","last_clean":"2023-10-14T19:10:44.914375+0000","last_became_active":"2023-10-14T19:10:44.904491+0000","last_became_peered":"2023-10-14T19:10:44.904491+0000","last_unstale":"2023-10-14T19:10:44.914375+0000","last_undegraded":"2023-10-14T19:10:44.914375+0000","last_fullsized":"2023-10-14T19:10:44.914375+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:17.082005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909417+0000","last_change":"2023-10-14T19:10:44.906839+0000","last_active":"2023-10-14T19:10:44.909417+0000","last_peered":"2023-10-14T19:10:44.909417+0000","last_clean":"2023-10-14T19:10:44.909417+0000","last_became_active":"2023-10-14T19:10:44.906435+0000","last_became_peered":"2023-10-14T19:10:44.906435+0000","last_unstale":"2023-10-14T19:10:44.909417+0000","last_undegraded":"2023-10-14T19:10:44.909417+0000","last_fullsized":"2023-10-14T19:10:44.909417+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:47.837491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910169+0000","last_change":"2023-10-14T19:10:44.902918+0000","last_active":"2023-10-14T19:10:44.910169+0000","last_peered":"2023-10-14T19:10:44.910169+0000","last_clean":"2023-10-14T19:10:44.910169+0000","last_became_active":"2023-10-14T19:10:44.902513+0000","last_became_peered":"2023-10-14T19:10:44.902513+0000","last_unstale":"2023-10-14T19:10:44.910169+0000","last_undegraded":"2023-10-14T19:10:44.910169+0000","last_fullsized":"2023-10-14T19:10:44.910169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:37.177680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906259+0000","last_change":"2023-10-14T19:10:44.903497+0000","last_active":"2023-10-14T19:10:44.906259+0000","last_peered":"2023-10-14T19:10:44.906259+0000","last_clean":"2023-10-14T19:10:44.906259+0000","last_became_active":"2023-10-14T19:10:44.903214+0000","last_became_peered":"2023-10-14T19:10:44.903214+0000","last_unstale":"2023-10-14T19:10:44.906259+0000","last_undegraded":"2023-10-14T19:10:44.906259+0000","last_fullsized":"2023-10-14T19:10:44.906259+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:04:24.819286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905922+0000","last_change":"2023-10-14T19:10:44.898295+0000","last_active":"2023-10-14T19:10:44.905922+0000","last_peered":"2023-10-14T19:10:44.905922+0000","last_clean":"2023-10-14T19:10:44.905922+0000","last_became_active":"2023-10-14T19:10:44.898032+0000","last_became_peered":"2023-10-14T19:10:44.898032+0000","last_unstale":"2023-10-14T19:10:44.905922+0000","last_undegraded":"2023-10-14T19:10:44.905922+0000","last_fullsized":"2023-10-14T19:10:44.905922+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.471086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910169+0000","last_change":"2023-10-14T19:10:44.907219+0000","last_active":"2023-10-14T19:10:44.910169+0000","last_peered":"2023-10-14T19:10:44.910169+0000","last_clean":"2023-10-14T19:10:44.910169+0000","last_became_active":"2023-10-14T19:10:44.906890+0000","last_became_peered":"2023-10-14T19:10:44.906890+0000","last_unstale":"2023-10-14T19:10:44.910169+0000","last_undegraded":"2023-10-14T19:10:44.910169+0000","last_fullsized":"2023-10-14T19:10:44.910169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:56.776503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913703+0000","last_change":"2023-10-14T19:10:44.904440+0000","last_active":"2023-10-14T19:10:44.913703+0000","last_peered":"2023-10-14T19:10:44.913703+0000","last_clean":"2023-10-14T19:10:44.913703+0000","last_became_active":"2023-10-14T19:10:44.903875+0000","last_became_peered":"2023-10-14T19:10:44.903875+0000","last_unstale":"2023-10-14T19:10:44.913703+0000","last_undegraded":"2023-10-14T19:10:44.913703+0000","last_fullsized":"2023-10-14T19:10:44.913703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:24.780148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915009+0000","last_change":"2023-10-14T19:10:44.914161+0000","last_active":"2023-10-14T19:10:44.915009+0000","last_peered":"2023-10-14T19:10:44.915009+0000","last_clean":"2023-10-14T19:10:44.915009+0000","last_became_active":"2023-10-14T19:10:44.913883+0000","last_became_peered":"2023-10-14T19:10:44.913883+0000","last_unstale":"2023-10-14T19:10:44.915009+0000","last_undegraded":"2023-10-14T19:10:44.915009+0000","last_fullsized":"2023-10-14T19:10:44.915009+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:08.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909479+0000","last_change":"2023-10-14T19:10:44.904994+0000","last_active":"2023-10-14T19:10:44.909479+0000","last_peered":"2023-10-14T19:10:44.909479+0000","last_clean":"2023-10-14T19:10:44.909479+0000","last_became_active":"2023-10-14T19:10:44.904791+0000","last_became_peered":"2023-10-14T19:10:44.904791+0000","last_unstale":"2023-10-14T19:10:44.909479+0000","last_undegraded":"2023-10-14T19:10:44.909479+0000","last_fullsized":"2023-10-14T19:10:44.909479+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:26.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908388+0000","last_change":"2023-10-14T19:10:44.903088+0000","last_active":"2023-10-14T19:10:44.908388+0000","last_peered":"2023-10-14T19:10:44.908388+0000","last_clean":"2023-10-14T19:10:44.908388+0000","last_became_active":"2023-10-14T19:10:44.901631+0000","last_became_peered":"2023-10-14T19:10:44.901631+0000","last_unstale":"2023-10-14T19:10:44.908388+0000","last_undegraded":"2023-10-14T19:10:44.908388+0000","last_fullsized":"2023-10-14T19:10:44.908388+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:01.803614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910185+0000","last_change":"2023-10-14T19:10:44.903564+0000","last_active":"2023-10-14T19:10:44.910185+0000","last_peered":"2023-10-14T19:10:44.910185+0000","last_clean":"2023-10-14T19:10:44.910185+0000","last_became_active":"2023-10-14T19:10:44.903246+0000","last_became_peered":"2023-10-14T19:10:44.903246+0000","last_unstale":"2023-10-14T19:10:44.910185+0000","last_undegraded":"2023-10-14T19:10:44.910185+0000","last_fullsized":"2023-10-14T19:10:44.910185+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:05.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908114+0000","last_change":"2023-10-14T19:10:44.905038+0000","last_active":"2023-10-14T19:10:44.908114+0000","last_peered":"2023-10-14T19:10:44.908114+0000","last_clean":"2023-10-14T19:10:44.908114+0000","last_became_active":"2023-10-14T19:10:44.904751+0000","last_became_peered":"2023-10-14T19:10:44.904751+0000","last_unstale":"2023-10-14T19:10:44.908114+0000","last_undegraded":"2023-10-14T19:10:44.908114+0000","last_fullsized":"2023-10-14T19:10:44.908114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:06:29.018958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.901803+0000","last_change":"2023-10-14T19:10:44.898390+0000","last_active":"2023-10-14T19:10:44.901803+0000","last_peered":"2023-10-14T19:10:44.901803+0000","last_clean":"2023-10-14T19:10:44.901803+0000","last_became_active":"2023-10-14T19:10:44.897896+0000","last_became_peered":"2023-10-14T19:10:44.897896+0000","last_unstale":"2023-10-14T19:10:44.901803+0000","last_undegraded":"2023-10-14T19:10:44.901803+0000","last_fullsized":"2023-10-14T19:10:44.901803+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:03.906136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.892423+0000","last_change":"2023-10-14T19:10:44.891482+0000","last_active":"2023-10-14T19:10:44.892423+0000","last_peered":"2023-10-14T19:10:44.892423+0000","last_clean":"2023-10-14T19:10:44.892423+0000","last_became_active":"2023-10-14T19:10:44.891019+0000","last_became_peered":"2023-10-14T19:10:44.891019+0000","last_unstale":"2023-10-14T19:10:44.892423+0000","last_undegraded":"2023-10-14T19:10:44.892423+0000","last_fullsized":"2023-10-14T19:10:44.892423+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:36.134369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913306+0000","last_change":"2023-10-14T19:10:44.897953+0000","last_active":"2023-10-14T19:10:44.913306+0000","last_peered":"2023-10-14T19:10:44.913306+0000","last_clean":"2023-10-14T19:10:44.913306+0000","last_became_active":"2023-10-14T19:10:44.897621+0000","last_became_peered":"2023-10-14T19:10:44.897621+0000","last_unstale":"2023-10-14T19:10:44.913306+0000","last_undegraded":"2023-10-14T19:10:44.913306+0000","last_fullsized":"2023-10-14T19:10:44.913306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:35.400464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.898939+0000","last_change":"2023-10-14T19:10:44.895728+0000","last_active":"2023-10-14T19:10:44.898939+0000","last_peered":"2023-10-14T19:10:44.898939+0000","last_clean":"2023-10-14T19:10:44.898939+0000","last_became_active":"2023-10-14T19:10:44.895434+0000","last_became_peered":"2023-10-14T19:10:44.895434+0000","last_unstale":"2023-10-14T19:10:44.898939+0000","last_undegraded":"2023-10-14T19:10:44.898939+0000","last_fullsized":"2023-10-14T19:10:44.898939+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914349+0000","last_change":"2023-10-14T19:10:44.911025+0000","last_active":"2023-10-14T19:10:44.914349+0000","last_peered":"2023-10-14T19:10:44.914349+0000","last_clean":"2023-10-14T19:10:44.914349+0000","last_became_active":"2023-10-14T19:10:44.910691+0000","last_became_peered":"2023-10-14T19:10:44.910691+0000","last_unstale":"2023-10-14T19:10:44.914349+0000","last_undegraded":"2023-10-14T19:10:44.914349+0000","last_fullsized":"2023-10-14T19:10:44.914349+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:03.646566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.901491+0000","last_change":"2023-10-14T19:10:44.896191+0000","last_active":"2023-10-14T19:10:44.901491+0000","last_peered":"2023-10-14T19:10:44.901491+0000","last_clean":"2023-10-14T19:10:44.901491+0000","last_became_active":"2023-10-14T19:10:44.895915+0000","last_became_peered":"2023-10-14T19:10:44.895915+0000","last_unstale":"2023-10-14T19:10:44.901491+0000","last_undegraded":"2023-10-14T19:10:44.901491+0000","last_fullsized":"2023-10-14T19:10:44.901491+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:37.341940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909552+0000","last_change":"2023-10-14T19:10:44.903810+0000","last_active":"2023-10-14T19:10:44.909552+0000","last_peered":"2023-10-14T19:10:44.909552+0000","last_clean":"2023-10-14T19:10:44.909552+0000","last_became_active":"2023-10-14T19:10:44.903544+0000","last_became_peered":"2023-10-14T19:10:44.903544+0000","last_unstale":"2023-10-14T19:10:44.909552+0000","last_undegraded":"2023-10-14T19:10:44.909552+0000","last_fullsized":"2023-10-14T19:10:44.909552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:55:08.742523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906114+0000","last_change":"2023-10-14T19:10:44.903164+0000","last_active":"2023-10-14T19:10:44.906114+0000","last_peered":"2023-10-14T19:10:44.906114+0000","last_clean":"2023-10-14T19:10:44.906114+0000","last_became_active":"2023-10-14T19:10:44.902891+0000","last_became_peered":"2023-10-14T19:10:44.902891+0000","last_unstale":"2023-10-14T19:10:44.906114+0000","last_undegraded":"2023-10-14T19:10:44.906114+0000","last_fullsized":"2023-10-14T19:10:44.906114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:37.304748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906868+0000","last_change":"2023-10-14T19:10:44.903420+0000","last_active":"2023-10-14T19:10:44.906868+0000","last_peered":"2023-10-14T19:10:44.906868+0000","last_clean":"2023-10-14T19:10:44.906868+0000","last_became_active":"2023-10-14T19:10:44.903124+0000","last_became_peered":"2023-10-14T19:10:44.903124+0000","last_unstale":"2023-10-14T19:10:44.906868+0000","last_undegraded":"2023-10-14T19:10:44.906868+0000","last_fullsized":"2023-10-14T19:10:44.906868+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:56.241659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904555+0000","last_change":"2023-10-14T19:10:44.901471+0000","last_active":"2023-10-14T19:10:44.904555+0000","last_peered":"2023-10-14T19:10:44.904555+0000","last_clean":"2023-10-14T19:10:44.904555+0000","last_became_active":"2023-10-14T19:10:44.901180+0000","last_became_peered":"2023-10-14T19:10:44.901180+0000","last_unstale":"2023-10-14T19:10:44.904555+0000","last_undegraded":"2023-10-14T19:10:44.904555+0000","last_fullsized":"2023-10-14T19:10:44.904555+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:00.520236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902507+0000","last_change":"2023-10-14T19:10:44.893421+0000","last_active":"2023-10-14T19:10:44.902507+0000","last_peered":"2023-10-14T19:10:44.902507+0000","last_clean":"2023-10-14T19:10:44.902507+0000","last_became_active":"2023-10-14T19:10:44.893146+0000","last_became_peered":"2023-10-14T19:10:44.893146+0000","last_unstale":"2023-10-14T19:10:44.902507+0000","last_undegraded":"2023-10-14T19:10:44.902507+0000","last_fullsized":"2023-10-14T19:10:44.902507+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:37.332548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906190+0000","last_change":"2023-10-14T19:10:44.903652+0000","last_active":"2023-10-14T19:10:44.906190+0000","last_peered":"2023-10-14T19:10:44.906190+0000","last_clean":"2023-10-14T19:10:44.906190+0000","last_became_active":"2023-10-14T19:10:44.902806+0000","last_became_peered":"2023-10-14T19:10:44.902806+0000","last_unstale":"2023-10-14T19:10:44.906190+0000","last_undegraded":"2023-10-14T19:10:44.906190+0000","last_fullsized":"2023-10-14T19:10:44.906190+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:50.002060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912277+0000","last_change":"2023-10-14T19:10:44.909396+0000","last_active":"2023-10-14T19:10:44.912277+0000","last_peered":"2023-10-14T19:10:44.912277+0000","last_clean":"2023-10-14T19:10:44.912277+0000","last_became_active":"2023-10-14T19:10:44.909147+0000","last_became_peered":"2023-10-14T19:10:44.909147+0000","last_unstale":"2023-10-14T19:10:44.912277+0000","last_undegraded":"2023-10-14T19:10:44.912277+0000","last_fullsized":"2023-10-14T19:10:44.912277+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:37:40.735176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913439+0000","last_change":"2023-10-14T19:10:44.901848+0000","last_active":"2023-10-14T19:10:44.913439+0000","last_peered":"2023-10-14T19:10:44.913439+0000","last_clean":"2023-10-14T19:10:44.913439+0000","last_became_active":"2023-10-14T19:10:44.901608+0000","last_became_peered":"2023-10-14T19:10:44.901608+0000","last_unstale":"2023-10-14T19:10:44.913439+0000","last_undegraded":"2023-10-14T19:10:44.913439+0000","last_fullsized":"2023-10-14T19:10:44.913439+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:18.706521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908129+0000","last_change":"2023-10-14T19:10:44.905057+0000","last_active":"2023-10-14T19:10:44.908129+0000","last_peered":"2023-10-14T19:10:44.908129+0000","last_clean":"2023-10-14T19:10:44.908129+0000","last_became_active":"2023-10-14T19:10:44.904761+0000","last_became_peered":"2023-10-14T19:10:44.904761+0000","last_unstale":"2023-10-14T19:10:44.908129+0000","last_undegraded":"2023-10-14T19:10:44.908129+0000","last_fullsized":"2023-10-14T19:10:44.908129+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:26.308671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910510+0000","last_change":"2023-10-14T19:10:44.907311+0000","last_active":"2023-10-14T19:10:44.910510+0000","last_peered":"2023-10-14T19:10:44.910510+0000","last_clean":"2023-10-14T19:10:44.910510+0000","last_became_active":"2023-10-14T19:10:44.907027+0000","last_became_peered":"2023-10-14T19:10:44.907027+0000","last_unstale":"2023-10-14T19:10:44.910510+0000","last_undegraded":"2023-10-14T19:10:44.910510+0000","last_fullsized":"2023-10-14T19:10:44.910510+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:01.897170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910630+0000","last_change":"2023-10-14T19:10:44.907445+0000","last_active":"2023-10-14T19:10:44.910630+0000","last_peered":"2023-10-14T19:10:44.910630+0000","last_clean":"2023-10-14T19:10:44.910630+0000","last_became_active":"2023-10-14T19:10:44.907118+0000","last_became_peered":"2023-10-14T19:10:44.907118+0000","last_unstale":"2023-10-14T19:10:44.910630+0000","last_undegraded":"2023-10-14T19:10:44.910630+0000","last_fullsized":"2023-10-14T19:10:44.910630+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:04.771169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910173+0000","last_change":"2023-10-14T19:10:44.908434+0000","last_active":"2023-10-14T19:10:44.910173+0000","last_peered":"2023-10-14T19:10:44.910173+0000","last_clean":"2023-10-14T19:10:44.910173+0000","last_became_active":"2023-10-14T19:10:44.907576+0000","last_became_peered":"2023-10-14T19:10:44.907576+0000","last_unstale":"2023-10-14T19:10:44.910173+0000","last_undegraded":"2023-10-14T19:10:44.910173+0000","last_fullsized":"2023-10-14T19:10:44.910173+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:03.906136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902648+0000","last_change":"2023-10-14T19:10:44.897063+0000","last_active":"2023-10-14T19:10:44.902648+0000","last_peered":"2023-10-14T19:10:44.902648+0000","last_clean":"2023-10-14T19:10:44.902648+0000","last_became_active":"2023-10-14T19:10:44.896717+0000","last_became_peered":"2023-10-14T19:10:44.896717+0000","last_unstale":"2023-10-14T19:10:44.902648+0000","last_undegraded":"2023-10-14T19:10:44.902648+0000","last_fullsized":"2023-10-14T19:10:44.902648+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:46.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913437+0000","last_change":"2023-10-14T19:10:44.900657+0000","last_active":"2023-10-14T19:10:44.913437+0000","last_peered":"2023-10-14T19:10:44.913437+0000","last_clean":"2023-10-14T19:10:44.913437+0000","last_became_active":"2023-10-14T19:10:44.898256+0000","last_became_peered":"2023-10-14T19:10:44.898256+0000","last_unstale":"2023-10-14T19:10:44.913437+0000","last_undegraded":"2023-10-14T19:10:44.913437+0000","last_fullsized":"2023-10-14T19:10:44.913437+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:17:30.798848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912698+0000","last_change":"2023-10-14T19:10:44.910856+0000","last_active":"2023-10-14T19:10:44.912698+0000","last_peered":"2023-10-14T19:10:44.912698+0000","last_clean":"2023-10-14T19:10:44.912698+0000","last_became_active":"2023-10-14T19:10:44.910555+0000","last_became_peered":"2023-10-14T19:10:44.910555+0000","last_unstale":"2023-10-14T19:10:44.912698+0000","last_undegraded":"2023-10-14T19:10:44.912698+0000","last_fullsized":"2023-10-14T19:10:44.912698+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:29.089378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":14,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.907303+0000","last_change":"2023-10-14T19:10:43.897050+0000","last_active":"2023-10-14T19:10:44.907303+0000","last_peered":"2023-10-14T19:10:44.907303+0000","last_clean":"2023-10-14T19:10:44.907303+0000","last_became_active":"2023-10-14T19:10:43.896752+0000","last_became_peered":"2023-10-14T19:10:43.896752+0000","last_unstale":"2023-10-14T19:10:44.907303+0000","last_undegraded":"2023-10-14T19:10:44.907303+0000","last_fullsized":"2023-10-14T19:10:44.907303+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:00.892294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.895499+0000","last_change":"2023-10-14T19:10:44.892412+0000","last_active":"2023-10-14T19:10:44.895499+0000","last_peered":"2023-10-14T19:10:44.895499+0000","last_clean":"2023-10-14T19:10:44.895499+0000","last_became_active":"2023-10-14T19:10:44.892128+0000","last_became_peered":"2023-10-14T19:10:44.892128+0000","last_unstale":"2023-10-14T19:10:44.895499+0000","last_undegraded":"2023-10-14T19:10:44.895499+0000","last_fullsized":"2023-10-14T19:10:44.895499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:47.837491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908325+0000","last_change":"2023-10-14T19:10:43.899189+0000","last_active":"2023-10-14T19:10:44.908325+0000","last_peered":"2023-10-14T19:10:44.908325+0000","last_clean":"2023-10-14T19:10:44.908325+0000","last_became_active":"2023-10-14T19:10:43.898885+0000","last_became_peered":"2023-10-14T19:10:43.898885+0000","last_unstale":"2023-10-14T19:10:44.908325+0000","last_undegraded":"2023-10-14T19:10:44.908325+0000","last_fullsized":"2023-10-14T19:10:44.908325+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:17.594439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913351+0000","last_change":"2023-10-14T19:10:44.900339+0000","last_active":"2023-10-14T19:10:44.913351+0000","last_peered":"2023-10-14T19:10:44.913351+0000","last_clean":"2023-10-14T19:10:44.913351+0000","last_became_active":"2023-10-14T19:10:44.897971+0000","last_became_peered":"2023-10-14T19:10:44.897971+0000","last_unstale":"2023-10-14T19:10:44.913351+0000","last_undegraded":"2023-10-14T19:10:44.913351+0000","last_fullsized":"2023-10-14T19:10:44.913351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.908066+0000","last_change":"2023-10-14T19:10:43.896205+0000","last_active":"2023-10-14T19:10:44.908066+0000","last_peered":"2023-10-14T19:10:44.908066+0000","last_clean":"2023-10-14T19:10:44.908066+0000","last_became_active":"2023-10-14T19:10:43.895957+0000","last_became_peered":"2023-10-14T19:10:43.895957+0000","last_unstale":"2023-10-14T19:10:44.908066+0000","last_undegraded":"2023-10-14T19:10:44.908066+0000","last_fullsized":"2023-10-14T19:10:44.908066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:48.097648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903373+0000","last_change":"2023-10-14T19:10:44.900932+0000","last_active":"2023-10-14T19:10:44.903373+0000","last_peered":"2023-10-14T19:10:44.903373+0000","last_clean":"2023-10-14T19:10:44.903373+0000","last_became_active":"2023-10-14T19:10:44.900382+0000","last_became_peered":"2023-10-14T19:10:44.900382+0000","last_unstale":"2023-10-14T19:10:44.903373+0000","last_undegraded":"2023-10-14T19:10:44.903373+0000","last_fullsized":"2023-10-14T19:10:44.903373+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:17:38.048435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913690+0000","last_change":"2023-10-14T19:10:43.897448+0000","last_active":"2023-10-14T19:10:44.913690+0000","last_peered":"2023-10-14T19:10:44.913690+0000","last_clean":"2023-10-14T19:10:44.913690+0000","last_became_active":"2023-10-14T19:10:43.897073+0000","last_became_peered":"2023-10-14T19:10:43.897073+0000","last_unstale":"2023-10-14T19:10:44.913690+0000","last_undegraded":"2023-10-14T19:10:44.913690+0000","last_fullsized":"2023-10-14T19:10:44.913690+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:01:56.721007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906884+0000","last_change":"2023-10-14T19:10:44.904496+0000","last_active":"2023-10-14T19:10:44.906884+0000","last_peered":"2023-10-14T19:10:44.906884+0000","last_clean":"2023-10-14T19:10:44.906884+0000","last_became_active":"2023-10-14T19:10:44.904225+0000","last_became_peered":"2023-10-14T19:10:44.904225+0000","last_unstale":"2023-10-14T19:10:44.906884+0000","last_undegraded":"2023-10-14T19:10:44.906884+0000","last_fullsized":"2023-10-14T19:10:44.906884+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:24.720903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905858+0000","last_change":"2023-10-14T19:10:43.899262+0000","last_active":"2023-10-14T19:10:44.905858+0000","last_peered":"2023-10-14T19:10:44.905858+0000","last_clean":"2023-10-14T19:10:44.905858+0000","last_became_active":"2023-10-14T19:10:43.898687+0000","last_became_peered":"2023-10-14T19:10:43.898687+0000","last_unstale":"2023-10-14T19:10:44.905858+0000","last_undegraded":"2023-10-14T19:10:44.905858+0000","last_fullsized":"2023-10-14T19:10:44.905858+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:37.472815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906110+0000","last_change":"2023-10-14T19:10:44.904160+0000","last_active":"2023-10-14T19:10:44.906110+0000","last_peered":"2023-10-14T19:10:44.906110+0000","last_clean":"2023-10-14T19:10:44.906110+0000","last_became_active":"2023-10-14T19:10:44.903881+0000","last_became_peered":"2023-10-14T19:10:44.903881+0000","last_unstale":"2023-10-14T19:10:44.906110+0000","last_undegraded":"2023-10-14T19:10:44.906110+0000","last_fullsized":"2023-10-14T19:10:44.906110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:06.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887596+0000","last_change":"2023-10-14T19:10:43.896786+0000","last_active":"2023-10-14T19:10:44.887596+0000","last_peered":"2023-10-14T19:10:44.887596+0000","last_clean":"2023-10-14T19:10:44.887596+0000","last_became_active":"2023-10-14T19:10:43.896490+0000","last_became_peered":"2023-10-14T19:10:43.896490+0000","last_unstale":"2023-10-14T19:10:44.887596+0000","last_undegraded":"2023-10-14T19:10:44.887596+0000","last_fullsized":"2023-10-14T19:10:44.887596+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:35:36.327673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906226+0000","last_change":"2023-10-14T19:10:44.903855+0000","last_active":"2023-10-14T19:10:44.906226+0000","last_peered":"2023-10-14T19:10:44.906226+0000","last_clean":"2023-10-14T19:10:44.906226+0000","last_became_active":"2023-10-14T19:10:44.903585+0000","last_became_peered":"2023-10-14T19:10:44.903585+0000","last_unstale":"2023-10-14T19:10:44.906226+0000","last_undegraded":"2023-10-14T19:10:44.906226+0000","last_fullsized":"2023-10-14T19:10:44.906226+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:11.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.888688+0000","last_change":"2023-10-14T19:10:43.898809+0000","last_active":"2023-10-14T19:10:44.888688+0000","last_peered":"2023-10-14T19:10:44.888688+0000","last_clean":"2023-10-14T19:10:44.888688+0000","last_became_active":"2023-10-14T19:10:43.898533+0000","last_became_peered":"2023-10-14T19:10:43.898533+0000","last_unstale":"2023-10-14T19:10:44.888688+0000","last_undegraded":"2023-10-14T19:10:44.888688+0000","last_fullsized":"2023-10-14T19:10:44.888688+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:03.766293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910600+0000","last_change":"2023-10-14T19:10:44.907014+0000","last_active":"2023-10-14T19:10:44.910600+0000","last_peered":"2023-10-14T19:10:44.910600+0000","last_clean":"2023-10-14T19:10:44.910600+0000","last_became_active":"2023-10-14T19:10:44.906732+0000","last_became_peered":"2023-10-14T19:10:44.906732+0000","last_unstale":"2023-10-14T19:10:44.910600+0000","last_undegraded":"2023-10-14T19:10:44.910600+0000","last_fullsized":"2023-10-14T19:10:44.910600+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:28.785128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887138+0000","last_change":"2023-10-14T19:10:43.896796+0000","last_active":"2023-10-14T19:10:44.887138+0000","last_peered":"2023-10-14T19:10:44.887138+0000","last_clean":"2023-10-14T19:10:44.887138+0000","last_became_active":"2023-10-14T19:10:43.896541+0000","last_became_peered":"2023-10-14T19:10:43.896541+0000","last_unstale":"2023-10-14T19:10:44.887138+0000","last_undegraded":"2023-10-14T19:10:44.887138+0000","last_fullsized":"2023-10-14T19:10:44.887138+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:25.585439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903143+0000","last_change":"2023-10-14T19:10:44.898610+0000","last_active":"2023-10-14T19:10:44.903143+0000","last_peered":"2023-10-14T19:10:44.903143+0000","last_clean":"2023-10-14T19:10:44.903143+0000","last_became_active":"2023-10-14T19:10:44.898308+0000","last_became_peered":"2023-10-14T19:10:44.898308+0000","last_unstale":"2023-10-14T19:10:44.903143+0000","last_undegraded":"2023-10-14T19:10:44.903143+0000","last_fullsized":"2023-10-14T19:10:44.903143+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:18.599315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.889819+0000","last_change":"2023-10-14T19:10:43.897099+0000","last_active":"2023-10-14T19:10:44.889819+0000","last_peered":"2023-10-14T19:10:44.889819+0000","last_clean":"2023-10-14T19:10:44.889819+0000","last_became_active":"2023-10-14T19:10:43.896842+0000","last_became_peered":"2023-10-14T19:10:43.896842+0000","last_unstale":"2023-10-14T19:10:44.889819+0000","last_undegraded":"2023-10-14T19:10:44.889819+0000","last_fullsized":"2023-10-14T19:10:44.889819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:33.244937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905389+0000","last_change":"2023-10-14T19:10:44.901305+0000","last_active":"2023-10-14T19:10:44.905389+0000","last_peered":"2023-10-14T19:10:44.905389+0000","last_clean":"2023-10-14T19:10:44.905389+0000","last_became_active":"2023-10-14T19:10:44.901042+0000","last_became_peered":"2023-10-14T19:10:44.901042+0000","last_unstale":"2023-10-14T19:10:44.905389+0000","last_undegraded":"2023-10-14T19:10:44.905389+0000","last_fullsized":"2023-10-14T19:10:44.905389+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:30.114861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915421+0000","last_change":"2023-10-14T19:10:43.894223+0000","last_active":"2023-10-14T19:10:44.915421+0000","last_peered":"2023-10-14T19:10:44.915421+0000","last_clean":"2023-10-14T19:10:44.915421+0000","last_became_active":"2023-10-14T19:10:43.893955+0000","last_became_peered":"2023-10-14T19:10:43.893955+0000","last_unstale":"2023-10-14T19:10:44.915421+0000","last_undegraded":"2023-10-14T19:10:44.915421+0000","last_fullsized":"2023-10-14T19:10:44.915421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:27.300391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914419+0000","last_change":"2023-10-14T19:10:44.911478+0000","last_active":"2023-10-14T19:10:44.914419+0000","last_peered":"2023-10-14T19:10:44.914419+0000","last_clean":"2023-10-14T19:10:44.914419+0000","last_became_active":"2023-10-14T19:10:44.910748+0000","last_became_peered":"2023-10-14T19:10:44.910748+0000","last_unstale":"2023-10-14T19:10:44.914419+0000","last_undegraded":"2023-10-14T19:10:44.914419+0000","last_fullsized":"2023-10-14T19:10:44.914419+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:58.543757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912831+0000","last_change":"2023-10-14T19:10:43.897286+0000","last_active":"2023-10-14T19:10:44.912831+0000","last_peered":"2023-10-14T19:10:44.912831+0000","last_clean":"2023-10-14T19:10:44.912831+0000","last_became_active":"2023-10-14T19:10:43.896768+0000","last_became_peered":"2023-10-14T19:10:43.896768+0000","last_unstale":"2023-10-14T19:10:44.912831+0000","last_undegraded":"2023-10-14T19:10:44.912831+0000","last_fullsized":"2023-10-14T19:10:44.912831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:21.618756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.905954+0000","last_change":"2023-10-14T19:10:44.899156+0000","last_active":"2023-10-14T19:10:44.905954+0000","last_peered":"2023-10-14T19:10:44.905954+0000","last_clean":"2023-10-14T19:10:44.905954+0000","last_became_active":"2023-10-14T19:10:44.898891+0000","last_became_peered":"2023-10-14T19:10:44.898891+0000","last_unstale":"2023-10-14T19:10:44.905954+0000","last_undegraded":"2023-10-14T19:10:44.905954+0000","last_fullsized":"2023-10-14T19:10:44.905954+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:31:22.623632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906480+0000","last_change":"2023-10-14T19:10:43.899218+0000","last_active":"2023-10-14T19:10:44.906480+0000","last_peered":"2023-10-14T19:10:44.906480+0000","last_clean":"2023-10-14T19:10:44.906480+0000","last_became_active":"2023-10-14T19:10:43.898937+0000","last_became_peered":"2023-10-14T19:10:43.898937+0000","last_unstale":"2023-10-14T19:10:44.906480+0000","last_undegraded":"2023-10-14T19:10:44.906480+0000","last_fullsized":"2023-10-14T19:10:44.906480+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:40.620170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915358+0000","last_change":"2023-10-14T19:10:44.909199+0000","last_active":"2023-10-14T19:10:44.915358+0000","last_peered":"2023-10-14T19:10:44.915358+0000","last_clean":"2023-10-14T19:10:44.915358+0000","last_became_active":"2023-10-14T19:10:44.908149+0000","last_became_peered":"2023-10-14T19:10:44.908149+0000","last_unstale":"2023-10-14T19:10:44.915358+0000","last_undegraded":"2023-10-14T19:10:44.915358+0000","last_fullsized":"2023-10-14T19:10:44.915358+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:44.857129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.888947+0000","last_change":"2023-10-14T19:10:43.893311+0000","last_active":"2023-10-14T19:10:44.888947+0000","last_peered":"2023-10-14T19:10:44.888947+0000","last_clean":"2023-10-14T19:10:44.888947+0000","last_became_active":"2023-10-14T19:10:43.893008+0000","last_became_peered":"2023-10-14T19:10:43.893008+0000","last_unstale":"2023-10-14T19:10:44.888947+0000","last_undegraded":"2023-10-14T19:10:44.888947+0000","last_fullsized":"2023-10-14T19:10:44.888947+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:08:02.901260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910057+0000","last_change":"2023-10-14T19:10:44.904608+0000","last_active":"2023-10-14T19:10:44.910057+0000","last_peered":"2023-10-14T19:10:44.910057+0000","last_clean":"2023-10-14T19:10:44.910057+0000","last_became_active":"2023-10-14T19:10:44.904210+0000","last_became_peered":"2023-10-14T19:10:44.904210+0000","last_unstale":"2023-10-14T19:10:44.910057+0000","last_undegraded":"2023-10-14T19:10:44.910057+0000","last_fullsized":"2023-10-14T19:10:44.910057+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:18.817926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.890399+0000","last_change":"2023-10-14T19:10:43.892989+0000","last_active":"2023-10-14T19:10:44.890399+0000","last_peered":"2023-10-14T19:10:44.890399+0000","last_clean":"2023-10-14T19:10:44.890399+0000","last_became_active":"2023-10-14T19:10:43.892607+0000","last_became_peered":"2023-10-14T19:10:43.892607+0000","last_unstale":"2023-10-14T19:10:44.890399+0000","last_undegraded":"2023-10-14T19:10:44.890399+0000","last_fullsized":"2023-10-14T19:10:44.890399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:51:20.457406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914535+0000","last_change":"2023-10-14T19:10:44.911800+0000","last_active":"2023-10-14T19:10:44.914535+0000","last_peered":"2023-10-14T19:10:44.914535+0000","last_clean":"2023-10-14T19:10:44.914535+0000","last_became_active":"2023-10-14T19:10:44.911560+0000","last_became_peered":"2023-10-14T19:10:44.911560+0000","last_unstale":"2023-10-14T19:10:44.914535+0000","last_undegraded":"2023-10-14T19:10:44.914535+0000","last_fullsized":"2023-10-14T19:10:44.914535+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:51.872613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910005+0000","last_change":"2023-10-14T19:10:43.895737+0000","last_active":"2023-10-14T19:10:44.910005+0000","last_peered":"2023-10-14T19:10:44.910005+0000","last_clean":"2023-10-14T19:10:44.910005+0000","last_became_active":"2023-10-14T19:10:43.895453+0000","last_became_peered":"2023-10-14T19:10:43.895453+0000","last_unstale":"2023-10-14T19:10:44.910005+0000","last_undegraded":"2023-10-14T19:10:44.910005+0000","last_fullsized":"2023-10-14T19:10:44.910005+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:59:19.720670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909395+0000","last_change":"2023-10-14T19:10:44.906699+0000","last_active":"2023-10-14T19:10:44.909395+0000","last_peered":"2023-10-14T19:10:44.909395+0000","last_clean":"2023-10-14T19:10:44.909395+0000","last_became_active":"2023-10-14T19:10:44.906097+0000","last_became_peered":"2023-10-14T19:10:44.906097+0000","last_unstale":"2023-10-14T19:10:44.909395+0000","last_undegraded":"2023-10-14T19:10:44.909395+0000","last_fullsized":"2023-10-14T19:10:44.909395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:09.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.907470+0000","last_change":"2023-10-14T19:10:43.896278+0000","last_active":"2023-10-14T19:10:44.907470+0000","last_peered":"2023-10-14T19:10:44.907470+0000","last_clean":"2023-10-14T19:10:44.907470+0000","last_became_active":"2023-10-14T19:10:43.896005+0000","last_became_peered":"2023-10-14T19:10:43.896005+0000","last_unstale":"2023-10-14T19:10:44.907470+0000","last_undegraded":"2023-10-14T19:10:44.907470+0000","last_fullsized":"2023-10-14T19:10:44.907470+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:08.147952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.912635+0000","last_change":"2023-10-14T19:10:44.909908+0000","last_active":"2023-10-14T19:10:44.912635+0000","last_peered":"2023-10-14T19:10:44.912635+0000","last_clean":"2023-10-14T19:10:44.912635+0000","last_became_active":"2023-10-14T19:10:44.909674+0000","last_became_peered":"2023-10-14T19:10:44.909674+0000","last_unstale":"2023-10-14T19:10:44.912635+0000","last_undegraded":"2023-10-14T19:10:44.912635+0000","last_fullsized":"2023-10-14T19:10:44.912635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:47.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913473+0000","last_change":"2023-10-14T19:10:43.898631+0000","last_active":"2023-10-14T19:10:44.913473+0000","last_peered":"2023-10-14T19:10:44.913473+0000","last_clean":"2023-10-14T19:10:44.913473+0000","last_became_active":"2023-10-14T19:10:43.898378+0000","last_became_peered":"2023-10-14T19:10:43.898378+0000","last_unstale":"2023-10-14T19:10:44.913473+0000","last_undegraded":"2023-10-14T19:10:44.913473+0000","last_fullsized":"2023-10-14T19:10:44.913473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:00.892294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910534+0000","last_change":"2023-10-14T19:10:44.909345+0000","last_active":"2023-10-14T19:10:44.910534+0000","last_peered":"2023-10-14T19:10:44.910534+0000","last_clean":"2023-10-14T19:10:44.910534+0000","last_became_active":"2023-10-14T19:10:44.909079+0000","last_became_peered":"2023-10-14T19:10:44.909079+0000","last_unstale":"2023-10-14T19:10:44.910534+0000","last_undegraded":"2023-10-14T19:10:44.910534+0000","last_fullsized":"2023-10-14T19:10:44.910534+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:39.684528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915560+0000","last_change":"2023-10-14T19:10:43.896830+0000","last_active":"2023-10-14T19:10:44.915560+0000","last_peered":"2023-10-14T19:10:44.915560+0000","last_clean":"2023-10-14T19:10:44.915560+0000","last_became_active":"2023-10-14T19:10:43.896505+0000","last_became_peered":"2023-10-14T19:10:43.896505+0000","last_unstale":"2023-10-14T19:10:44.915560+0000","last_undegraded":"2023-10-14T19:10:44.915560+0000","last_fullsized":"2023-10-14T19:10:44.915560+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:00:32.246459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903395+0000","last_change":"2023-10-14T19:10:44.901342+0000","last_active":"2023-10-14T19:10:44.903395+0000","last_peered":"2023-10-14T19:10:44.903395+0000","last_clean":"2023-10-14T19:10:44.903395+0000","last_became_active":"2023-10-14T19:10:44.900672+0000","last_became_peered":"2023-10-14T19:10:44.900672+0000","last_unstale":"2023-10-14T19:10:44.903395+0000","last_undegraded":"2023-10-14T19:10:44.903395+0000","last_fullsized":"2023-10-14T19:10:44.903395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:14:44.615357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.894357+0000","last_change":"2023-10-14T19:10:43.895735+0000","last_active":"2023-10-14T19:10:44.894357+0000","last_peered":"2023-10-14T19:10:44.894357+0000","last_clean":"2023-10-14T19:10:44.894357+0000","last_became_active":"2023-10-14T19:10:43.895175+0000","last_became_peered":"2023-10-14T19:10:43.895175+0000","last_unstale":"2023-10-14T19:10:44.894357+0000","last_undegraded":"2023-10-14T19:10:44.894357+0000","last_fullsized":"2023-10-14T19:10:44.894357+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:51:48.470404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913117+0000","last_change":"2023-10-14T19:10:44.907697+0000","last_active":"2023-10-14T19:10:44.913117+0000","last_peered":"2023-10-14T19:10:44.913117+0000","last_clean":"2023-10-14T19:10:44.913117+0000","last_became_active":"2023-10-14T19:10:44.907401+0000","last_became_peered":"2023-10-14T19:10:44.907401+0000","last_unstale":"2023-10-14T19:10:44.913117+0000","last_undegraded":"2023-10-14T19:10:44.913117+0000","last_fullsized":"2023-10-14T19:10:44.913117+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:57.761982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.914973+0000","last_change":"2023-10-14T19:10:43.896635+0000","last_active":"2023-10-14T19:10:44.914973+0000","last_peered":"2023-10-14T19:10:44.914973+0000","last_clean":"2023-10-14T19:10:44.914973+0000","last_became_active":"2023-10-14T19:10:43.896363+0000","last_became_peered":"2023-10-14T19:10:43.896363+0000","last_unstale":"2023-10-14T19:10:44.914973+0000","last_undegraded":"2023-10-14T19:10:44.914973+0000","last_fullsized":"2023-10-14T19:10:44.914973+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:29.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.910514+0000","last_change":"2023-10-14T19:10:44.907399+0000","last_active":"2023-10-14T19:10:44.910514+0000","last_peered":"2023-10-14T19:10:44.910514+0000","last_clean":"2023-10-14T19:10:44.910514+0000","last_became_active":"2023-10-14T19:10:44.907071+0000","last_became_peered":"2023-10-14T19:10:44.907071+0000","last_unstale":"2023-10-14T19:10:44.910514+0000","last_undegraded":"2023-10-14T19:10:44.910514+0000","last_fullsized":"2023-10-14T19:10:44.910514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:37:16.136472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.884829+0000","last_change":"2023-10-14T19:10:43.894297+0000","last_active":"2023-10-14T19:10:44.884829+0000","last_peered":"2023-10-14T19:10:44.884829+0000","last_clean":"2023-10-14T19:10:44.884829+0000","last_became_active":"2023-10-14T19:10:43.894006+0000","last_became_peered":"2023-10-14T19:10:43.894006+0000","last_unstale":"2023-10-14T19:10:44.884829+0000","last_undegraded":"2023-10-14T19:10:44.884829+0000","last_fullsized":"2023-10-14T19:10:44.884829+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:21.241131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909544+0000","last_change":"2023-10-14T19:10:44.906664+0000","last_active":"2023-10-14T19:10:44.909544+0000","last_peered":"2023-10-14T19:10:44.909544+0000","last_clean":"2023-10-14T19:10:44.909544+0000","last_became_active":"2023-10-14T19:10:44.906394+0000","last_became_peered":"2023-10-14T19:10:44.906394+0000","last_unstale":"2023-10-14T19:10:44.909544+0000","last_undegraded":"2023-10-14T19:10:44.909544+0000","last_fullsized":"2023-10-14T19:10:44.909544+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:47.228675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.885651+0000","last_change":"2023-10-14T19:10:43.895774+0000","last_active":"2023-10-14T19:10:44.885651+0000","last_peered":"2023-10-14T19:10:44.885651+0000","last_clean":"2023-10-14T19:10:44.885651+0000","last_became_active":"2023-10-14T19:10:43.895510+0000","last_became_peered":"2023-10-14T19:10:43.895510+0000","last_unstale":"2023-10-14T19:10:44.885651+0000","last_undegraded":"2023-10-14T19:10:44.885651+0000","last_fullsized":"2023-10-14T19:10:44.885651+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:48.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.903852+0000","last_change":"2023-10-14T19:10:44.895955+0000","last_active":"2023-10-14T19:10:44.903852+0000","last_peered":"2023-10-14T19:10:44.903852+0000","last_clean":"2023-10-14T19:10:44.903852+0000","last_became_active":"2023-10-14T19:10:44.895720+0000","last_became_peered":"2023-10-14T19:10:44.895720+0000","last_unstale":"2023-10-14T19:10:44.903852+0000","last_undegraded":"2023-10-14T19:10:44.903852+0000","last_fullsized":"2023-10-14T19:10:44.903852+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:17.972151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893365+0000","last_change":"2023-10-14T19:10:43.898901+0000","last_active":"2023-10-14T19:10:44.893365+0000","last_peered":"2023-10-14T19:10:44.893365+0000","last_clean":"2023-10-14T19:10:44.893365+0000","last_became_active":"2023-10-14T19:10:43.898613+0000","last_became_peered":"2023-10-14T19:10:43.898613+0000","last_unstale":"2023-10-14T19:10:44.893365+0000","last_undegraded":"2023-10-14T19:10:44.893365+0000","last_fullsized":"2023-10-14T19:10:44.893365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:28.084502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.900940+0000","last_change":"2023-10-14T19:10:44.897056+0000","last_active":"2023-10-14T19:10:44.900940+0000","last_peered":"2023-10-14T19:10:44.900940+0000","last_clean":"2023-10-14T19:10:44.900940+0000","last_became_active":"2023-10-14T19:10:44.896748+0000","last_became_peered":"2023-10-14T19:10:44.896748+0000","last_unstale":"2023-10-14T19:10:44.900940+0000","last_undegraded":"2023-10-14T19:10:44.900940+0000","last_fullsized":"2023-10-14T19:10:44.900940+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:40.382502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.906518+0000","last_change":"2023-10-14T19:10:43.899992+0000","last_active":"2023-10-14T19:10:44.906518+0000","last_peered":"2023-10-14T19:10:44.906518+0000","last_clean":"2023-10-14T19:10:44.906518+0000","last_became_active":"2023-10-14T19:10:43.899595+0000","last_became_peered":"2023-10-14T19:10:43.899595+0000","last_unstale":"2023-10-14T19:10:44.906518+0000","last_undegraded":"2023-10-14T19:10:44.906518+0000","last_fullsized":"2023-10-14T19:10:44.906518+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:49.352138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913265+0000","last_change":"2023-10-14T19:10:44.897649+0000","last_active":"2023-10-14T19:10:44.913265+0000","last_peered":"2023-10-14T19:10:44.913265+0000","last_clean":"2023-10-14T19:10:44.913265+0000","last_became_active":"2023-10-14T19:10:44.897361+0000","last_became_peered":"2023-10-14T19:10:44.897361+0000","last_unstale":"2023-10-14T19:10:44.913265+0000","last_undegraded":"2023-10-14T19:10:44.913265+0000","last_fullsized":"2023-10-14T19:10:44.913265+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:11.023360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T19:10:45.889735+0000","last_change":"2023-10-14T19:10:43.896575+0000","last_active":"2023-10-14T19:10:45.889735+0000","last_peered":"2023-10-14T19:10:45.889735+0000","last_clean":"2023-10-14T19:10:45.889735+0000","last_became_active":"2023-10-14T19:10:43.896203+0000","last_became_peered":"2023-10-14T19:10:43.896203+0000","last_unstale":"2023-10-14T19:10:45.889735+0000","last_undegraded":"2023-10-14T19:10:45.889735+0000","last_fullsized":"2023-10-14T19:10:45.889735+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:07.649541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.915363+0000","last_change":"2023-10-14T19:10:44.914375+0000","last_active":"2023-10-14T19:10:44.915363+0000","last_peered":"2023-10-14T19:10:44.915363+0000","last_clean":"2023-10-14T19:10:44.915363+0000","last_became_active":"2023-10-14T19:10:44.914104+0000","last_became_peered":"2023-10-14T19:10:44.914104+0000","last_unstale":"2023-10-14T19:10:44.915363+0000","last_undegraded":"2023-10-14T19:10:44.915363+0000","last_fullsized":"2023-10-14T19:10:44.915363+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:42:41.625045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887188+0000","last_change":"2023-10-14T19:10:43.898048+0000","last_active":"2023-10-14T19:10:44.887188+0000","last_peered":"2023-10-14T19:10:44.887188+0000","last_clean":"2023-10-14T19:10:44.887188+0000","last_became_active":"2023-10-14T19:10:43.897867+0000","last_became_peered":"2023-10-14T19:10:43.897867+0000","last_unstale":"2023-10-14T19:10:44.887188+0000","last_undegraded":"2023-10-14T19:10:44.887188+0000","last_fullsized":"2023-10-14T19:10:44.887188+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:59.515361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904477+0000","last_change":"2023-10-14T19:10:44.899094+0000","last_active":"2023-10-14T19:10:44.904477+0000","last_peered":"2023-10-14T19:10:44.904477+0000","last_clean":"2023-10-14T19:10:44.904477+0000","last_became_active":"2023-10-14T19:10:44.898810+0000","last_became_peered":"2023-10-14T19:10:44.898810+0000","last_unstale":"2023-10-14T19:10:44.904477+0000","last_undegraded":"2023-10-14T19:10:44.904477+0000","last_fullsized":"2023-10-14T19:10:44.904477+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:54:09.152827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.896635+0000","last_change":"2023-10-14T19:10:43.897735+0000","last_active":"2023-10-14T19:10:44.896635+0000","last_peered":"2023-10-14T19:10:44.896635+0000","last_clean":"2023-10-14T19:10:44.896635+0000","last_became_active":"2023-10-14T19:10:43.897300+0000","last_became_peered":"2023-10-14T19:10:43.897300+0000","last_unstale":"2023-10-14T19:10:44.896635+0000","last_undegraded":"2023-10-14T19:10:44.896635+0000","last_fullsized":"2023-10-14T19:10:44.896635+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:26.042416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913803+0000","last_change":"2023-10-14T19:10:44.910715+0000","last_active":"2023-10-14T19:10:44.913803+0000","last_peered":"2023-10-14T19:10:44.913803+0000","last_clean":"2023-10-14T19:10:44.913803+0000","last_became_active":"2023-10-14T19:10:44.904113+0000","last_became_peered":"2023-10-14T19:10:44.904113+0000","last_unstale":"2023-10-14T19:10:44.913803+0000","last_undegraded":"2023-10-14T19:10:44.913803+0000","last_fullsized":"2023-10-14T19:10:44.913803+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:06:19.212950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.894524+0000","last_change":"2023-10-14T19:10:43.900069+0000","last_active":"2023-10-14T19:10:44.894524+0000","last_peered":"2023-10-14T19:10:44.894524+0000","last_clean":"2023-10-14T19:10:44.894524+0000","last_became_active":"2023-10-14T19:10:43.899776+0000","last_became_peered":"2023-10-14T19:10:43.899776+0000","last_unstale":"2023-10-14T19:10:44.894524+0000","last_undegraded":"2023-10-14T19:10:44.894524+0000","last_fullsized":"2023-10-14T19:10:44.894524+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:06:05.293638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.900333+0000","last_change":"2023-10-14T19:10:44.896699+0000","last_active":"2023-10-14T19:10:44.900333+0000","last_peered":"2023-10-14T19:10:44.900333+0000","last_clean":"2023-10-14T19:10:44.900333+0000","last_became_active":"2023-10-14T19:10:44.896417+0000","last_became_peered":"2023-10-14T19:10:44.896417+0000","last_unstale":"2023-10-14T19:10:44.900333+0000","last_undegraded":"2023-10-14T19:10:44.900333+0000","last_fullsized":"2023-10-14T19:10:44.900333+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:34.249813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.887922+0000","last_change":"2023-10-14T19:10:43.898905+0000","last_active":"2023-10-14T19:10:44.887922+0000","last_peered":"2023-10-14T19:10:44.887922+0000","last_clean":"2023-10-14T19:10:44.887922+0000","last_became_active":"2023-10-14T19:10:43.898553+0000","last_became_peered":"2023-10-14T19:10:43.898553+0000","last_unstale":"2023-10-14T19:10:44.887922+0000","last_undegraded":"2023-10-14T19:10:44.887922+0000","last_fullsized":"2023-10-14T19:10:44.887922+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:23:46.832615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.902108+0000","last_change":"2023-10-14T19:10:44.899767+0000","last_active":"2023-10-14T19:10:44.902108+0000","last_peered":"2023-10-14T19:10:44.902108+0000","last_clean":"2023-10-14T19:10:44.902108+0000","last_became_active":"2023-10-14T19:10:44.899482+0000","last_became_peered":"2023-10-14T19:10:44.899482+0000","last_unstale":"2023-10-14T19:10:44.902108+0000","last_undegraded":"2023-10-14T19:10:44.902108+0000","last_fullsized":"2023-10-14T19:10:44.902108+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:34:32.663743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.889412+0000","last_change":"2023-10-14T19:10:43.895101+0000","last_active":"2023-10-14T19:10:44.889412+0000","last_peered":"2023-10-14T19:10:44.889412+0000","last_clean":"2023-10-14T19:10:44.889412+0000","last_became_active":"2023-10-14T19:10:43.894786+0000","last_became_peered":"2023-10-14T19:10:43.894786+0000","last_unstale":"2023-10-14T19:10:44.889412+0000","last_undegraded":"2023-10-14T19:10:44.889412+0000","last_fullsized":"2023-10-14T19:10:44.889412+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:06:28.014083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.909412+0000","last_change":"2023-10-14T19:10:44.905673+0000","last_active":"2023-10-14T19:10:44.909412+0000","last_peered":"2023-10-14T19:10:44.909412+0000","last_clean":"2023-10-14T19:10:44.909412+0000","last_became_active":"2023-10-14T19:10:44.905374+0000","last_became_peered":"2023-10-14T19:10:44.905374+0000","last_unstale":"2023-10-14T19:10:44.909412+0000","last_undegraded":"2023-10-14T19:10:44.909412+0000","last_fullsized":"2023-10-14T19:10:44.909412+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:38.477691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.890949+0000","last_change":"2023-10-14T19:10:43.893414+0000","last_active":"2023-10-14T19:10:44.890949+0000","last_peered":"2023-10-14T19:10:44.890949+0000","last_clean":"2023-10-14T19:10:44.890949+0000","last_became_active":"2023-10-14T19:10:43.893168+0000","last_became_peered":"2023-10-14T19:10:43.893168+0000","last_unstale":"2023-10-14T19:10:44.890949+0000","last_undegraded":"2023-10-14T19:10:44.890949+0000","last_fullsized":"2023-10-14T19:10:44.890949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:36.172804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.913463+0000","last_change":"2023-10-14T19:10:44.900046+0000","last_active":"2023-10-14T19:10:44.913463+0000","last_peered":"2023-10-14T19:10:44.913463+0000","last_clean":"2023-10-14T19:10:44.913463+0000","last_became_active":"2023-10-14T19:10:44.899771+0000","last_became_peered":"2023-10-14T19:10:44.899771+0000","last_unstale":"2023-10-14T19:10:44.913463+0000","last_undegraded":"2023-10-14T19:10:44.913463+0000","last_fullsized":"2023-10-14T19:10:44.913463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:43.871650+0000","last_clean_scrub_stamp":"2023-10-14T19:10:43.871650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:23:37.989440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.904697+0000","last_change":"2023-10-14T19:10:43.895310+0000","last_active":"2023-10-14T19:10:44.904697+0000","last_peered":"2023-10-14T19:10:44.904697+0000","last_clean":"2023-10-14T19:10:44.904697+0000","last_became_active":"2023-10-14T19:10:43.895007+0000","last_became_peered":"2023-10-14T19:10:43.895007+0000","last_unstale":"2023-10-14T19:10:44.904697+0000","last_undegraded":"2023-10-14T19:10:44.904697+0000","last_fullsized":"2023-10-14T19:10:44.904697+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:10:42.866774+0000","last_clean_scrub_stamp":"2023-10-14T19:10:42.866774+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:17.594439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T19:10:44.893898+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:10:44.893898+0000","last_peered":"2023-10-14T19:10:44.893898+0000","last_clean":"2023-10-14T19:10:44.893898+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:10:44.893898+0000","last_undegraded":"2023-10-14T19:10:44.893898+0000","last_fullsized":"2023-10-14T19:10:44.893898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.70599999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.629},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.439},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.66400000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40699999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":866328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.317}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.442},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.495}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.46400000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1456730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.371},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39000000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":866272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.372},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.64200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303288,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068552,"statfs":{"total":96636764160,"available":96326197248,"internally_reserved":0,"allocated":1949696,"data_stored":866454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.375}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.68600000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.621}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303296,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068544,"statfs":{"total":96636764160,"available":96326189056,"internally_reserved":0,"allocated":1957888,"data_stored":867912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.59099999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.497}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.442}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.626}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:10:53.957 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:10:53.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:10:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.116+0000 7f1054ea6700 1 Processor -- start 2023-10-14T19:10:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.116+0000 7f1054ea6700 1 -- start start 2023-10-14T19:10:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f1054ea6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 0x7f1050159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f1054ea6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10500ccfa0 con 0x7f10500cb3f0 2023-10-14T19:10:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f1054ea6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10500cb880 con 0x7f10500cea00 2023-10-14T19:10:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f1054ea6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10500cbb60 con 0x7f1050159380 2023-10-14T19:10:54.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f104effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f10500cb3f0 0x7f105015dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54576/0 (socket says 172.21.15.7:54576) 2023-10-14T19:10:54.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f104effd700 1 -- 172.21.15.7:0/4226029611 learned_addr learned my addr 172.21.15.7:0/4226029611 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:54.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.117+0000 7f104f7fe700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 0x7f1050159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507028765 0 0) 0x7f10500ccfa0 con 0x7f10500cb3f0 2023-10-14T19:10:54.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1038003570 con 0x7f10500cb3f0 2023-10-14T19:10:54.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2589331770 0 0) 0x7f1038003570 con 0x7f10500cb3f0 2023-10-14T19:10:54.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 msgr2=0x7f1050159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:54.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 0x7f1050159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 >> v1:172.21.15.148:6789/0 conn(0x7f10500cea00 legacy=0x7f10500cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10500cbe40 con 0x7f10500cb3f0 2023-10-14T19:10:54.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f1044001470 con 0x7f10500cb3f0 2023-10-14T19:10:54.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 >> v1:172.21.15.7:6789/0 conn(0x7f10500cb3f0 legacy=0x7f105015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 0x7f1038003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1038003fd0 0x7f1038004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1038004d50 0x7f10380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10500cbb60 con 0x7f1038004d50 2023-10-14T19:10:54.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103800bb40 con 0x7f1038003fd0 2023-10-14T19:10:54.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103800bd00 con 0x7f1050159380 2023-10-14T19:10:54.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104ffff700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1038004d50 0x7f10380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104f7fe700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 0x7f1038003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104effd700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1038003fd0 0x7f1038004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104ffff700 1 -- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 msgr2=0x7f1038003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:54.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104ffff700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1050159380 0x7f1038003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104ffff700 1 -- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1038003fd0 msgr2=0x7f1038004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:54.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104ffff700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1038003fd0 0x7f1038004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.118+0000 7f104ffff700 1 -- 172.21.15.7:0/4226029611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038003570 con 0x7f1038004d50 2023-10-14T19:10:54.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f104ffff700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1038004d50 0x7f10380051c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f1048002060 tx=0x7f10480016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e871d9d77365ff5c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:54.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480019f0 con 0x7f1038004d50 2023-10-14T19:10:54.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104800c8b0 con 0x7f1038004d50 2023-10-14T19:10:54.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f104e7fc700 1 -- 172.21.15.7:0/4226029611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104800cc70 con 0x7f1038004d50 2023-10-14T19:10:54.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f1054ea6700 1 -- 172.21.15.7:0/4226029611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1038004d50 msgr2=0x7f10380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f1054ea6700 1 --2- 172.21.15.7:0/4226029611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1038004d50 0x7f10380051c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f1048002060 tx=0x7f10480016e0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f104ffff700 1 -- 172.21.15.7:0/4226029611 reap_dead start 2023-10-14T19:10:54.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f1054ea6700 1 -- 172.21.15.7:0/4226029611 shutdown_connections 2023-10-14T19:10:54.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f1054ea6700 1 -- 172.21.15.7:0/4226029611 >> 172.21.15.7:0/4226029611 conn(0x7f10500703a0 msgr2=0x7f10500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:54.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f1054ea6700 1 -- 172.21.15.7:0/4226029611 shutdown_connections 2023-10-14T19:10:54.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.119+0000 7f1054ea6700 1 -- 172.21.15.7:0/4226029611 wait complete. 2023-10-14T19:10:54.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 Processor -- start 2023-10-14T19:10:54.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 -- start start 2023-10-14T19:10:54.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1038004d50 0x7f10500b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10500ca1f0 0x7f1050148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 0x7f10500b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10500b1c10 con 0x7f1050149130 2023-10-14T19:10:54.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10501495a0 con 0x7f10500ca1f0 2023-10-14T19:10:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f1054ea6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10500b3810 con 0x7f1038004d50 2023-10-14T19:10:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f104ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 0x7f10500b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f104ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 0x7f10500b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45298/0 (socket says 172.21.15.7:45298) 2023-10-14T19:10:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.121+0000 7f104ffff700 1 -- 172.21.15.7:0/1055114780 learned_addr learned my addr 172.21.15.7:0/1055114780 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104effd700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10500ca1f0 0x7f1050148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104f7fe700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1038004d50 0x7f10500b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104ffff700 1 -- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1038004d50 msgr2=0x7f10500b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104ffff700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1038004d50 0x7f10500b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104ffff700 1 -- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10500ca1f0 msgr2=0x7f1050148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104ffff700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10500ca1f0 0x7f1050148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104ffff700 1 -- 172.21.15.7:0/1055114780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10500c8570 con 0x7f1050149130 2023-10-14T19:10:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f104ffff700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 0x7f10500b20a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f104800c6a0 tx=0x7f1048015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048024070 con 0x7f1050149130 2023-10-14T19:10:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104800cea0 con 0x7f1050149130 2023-10-14T19:10:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10500b12e0 con 0x7f1050149130 2023-10-14T19:10:54.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480019f0 con 0x7f1050149130 2023-10-14T19:10:54.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.122+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10500b18a0 con 0x7f1050149130 2023-10-14T19:10:54.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.123+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105004c3c0 con 0x7f1050149130 2023-10-14T19:10:54.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.124+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f104801f620 con 0x7f1050149130 2023-10-14T19:10:54.136 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.124+0000 7f10377fe700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f103c067320 0x7f103c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.124+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1048086600 con 0x7f1050149130 2023-10-14T19:10:54.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.124+0000 7f104f7fe700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f103c067320 0x7f103c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.125+0000 7f104f7fe700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f103c067320 0x7f103c0697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1040006f00 tx=0x7f1040008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:54.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.128+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1048053390 con 0x7f1050149130 2023-10-14T19:10:54.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.398+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f10500ccd80 con 0x7f1050149130 2023-10-14T19:10:54.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.404+0000 7f10377fe700 1 -- 172.21.15.7:0/1055114780 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f10480170e0 con 0x7f1050149130 2023-10-14T19:10:54.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.406+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f103c067320 msgr2=0x7f103c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.406+0000 7f1054ea6700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f103c067320 0x7f103c0697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1040006f00 tx=0x7f1040008040 comp rx=0 tx=0).stop 2023-10-14T19:10:54.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.406+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 msgr2=0x7f10500b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.406+0000 7f1054ea6700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 0x7f10500b20a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f104800c6a0 tx=0x7f1048015000 comp rx=0 tx=0).stop 2023-10-14T19:10:54.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 shutdown_connections 2023-10-14T19:10:54.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f103c067320 0x7f103c0697d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1050149130 0x7f10500b20a0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1038004d50 0x7f10500b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 --2- 172.21.15.7:0/1055114780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10500ca1f0 0x7f1050148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 >> 172.21.15.7:0/1055114780 conn(0x7f10500703a0 msgr2=0x7f10500c61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:54.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 shutdown_connections 2023-10-14T19:10:54.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.407+0000 7f1054ea6700 1 -- 172.21.15.7:0/1055114780 wait complete. 2023-10-14T19:10:54.411 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:10:54.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:54.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.538+0000 7f66192d5700 1 Processor -- start 2023-10-14T19:10:54.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.538+0000 7f66192d5700 1 -- start start 2023-10-14T19:10:54.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66192d5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f661415cb50 0x7f66140b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66192d5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66192d5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661415ad50 con 0x7f66140b0710 2023-10-14T19:10:54.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66192d5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661415a140 con 0x7f661415cb50 2023-10-14T19:10:54.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66192d5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661415a420 con 0x7f661415cf20 2023-10-14T19:10:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f6612ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f661415cb50 0x7f66140b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66137fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f66140b0710 0x7f66141536c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54584/0 (socket says 172.21.15.7:54584) 2023-10-14T19:10:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66137fe700 1 -- 172.21.15.7:0/3506307256 learned_addr learned my addr 172.21.15.7:0/3506307256 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.539+0000 7f66127fc700 1 --2- 172.21.15.7:0/3506307256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6612ffd700 1 -- 172.21.15.7:0/3506307256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 msgr2=0x7f66140b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6612ffd700 1 --2- 172.21.15.7:0/3506307256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6612ffd700 1 -- 172.21.15.7:0/3506307256 >> v1:172.21.15.7:6789/0 conn(0x7f66140b0710 legacy=0x7f66141536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6612ffd700 1 -- 172.21.15.7:0/3506307256 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661415a700 con 0x7f661415cb50 2023-10-14T19:10:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6611ffb700 1 -- 172.21.15.7:0/3506307256 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399785739 0 0) 0x7f661415ad50 con 0x7f66140b0710 2023-10-14T19:10:54.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6612ffd700 1 --2- 172.21.15.7:0/3506307256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661415cb50 0x7f66140b01d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f66040098e0 tx=0x7f66040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5d9dc55ace79ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6611ffb700 1 -- 172.21.15.7:0/3506307256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400b640 con 0x7f661415cb50 2023-10-14T19:10:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6611ffb700 1 -- 172.21.15.7:0/3506307256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400b7a0 con 0x7f661415cb50 2023-10-14T19:10:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.540+0000 7f6611ffb700 1 -- 172.21.15.7:0/3506307256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400bb40 con 0x7f661415cb50 2023-10-14T19:10:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 -- 172.21.15.7:0/3506307256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661415cb50 msgr2=0x7f66140b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 --2- 172.21.15.7:0/3506307256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661415cb50 0x7f66140b01d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f66040098e0 tx=0x7f66040091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 -- 172.21.15.7:0/3506307256 shutdown_connections 2023-10-14T19:10:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 --2- 172.21.15.7:0/3506307256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661415cb50 0x7f66140b01d0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 --2- 172.21.15.7:0/3506307256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 -- 172.21.15.7:0/3506307256 >> 172.21.15.7:0/3506307256 conn(0x7f66140cded0 msgr2=0x7f661406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 -- 172.21.15.7:0/3506307256 shutdown_connections 2023-10-14T19:10:54.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.541+0000 7f66192d5700 1 -- 172.21.15.7:0/3506307256 wait complete. 2023-10-14T19:10:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.542+0000 7f66192d5700 1 Processor -- start 2023-10-14T19:10:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.542+0000 7f66192d5700 1 -- start start 2023-10-14T19:10:54.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 0x7f66140aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661415cb50 0x7f6614143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140adc20 con 0x7f66140b0710 2023-10-14T19:10:54.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140adf00 con 0x7f661415cb50 2023-10-14T19:10:54.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140ae1e0 con 0x7f661415cf20 2023-10-14T19:10:54.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 0x7f66140aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 0x7f66140aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45318/0 (socket says 172.21.15.7:45318) 2023-10-14T19:10:54.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 -- 172.21.15.7:0/3950983964 learned_addr learned my addr 172.21.15.7:0/3950983964 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:54.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66137fe700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66127fc700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661415cb50 0x7f6614143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 -- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 msgr2=0x7f66140aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 -- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661415cb50 msgr2=0x7f6614143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661415cb50 0x7f6614143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 -- 172.21.15.7:0/3950983964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009420 con 0x7f66140b0710 2023-10-14T19:10:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66137fe700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66127fc700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661415cb50 0x7f6614143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f6612ffd700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 0x7f66140aecc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f6604009f80 tx=0x7f6604017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400bb20 con 0x7f66140b0710 2023-10-14T19:10:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604011420 con 0x7f66140b0710 2023-10-14T19:10:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604011800 con 0x7f66140b0710 2023-10-14T19:10:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66140ae4c0 con 0x7f66140b0710 2023-10-14T19:10:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.543+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6614144350 con 0x7f66140b0710 2023-10-14T19:10:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.544+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66140ae9e0 con 0x7f66140b0710 2023-10-14T19:10:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.545+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6604011c30 con 0x7f66140b0710 2023-10-14T19:10:54.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.545+0000 7f65faffd700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6600067320 0x7f66000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:54.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.545+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66040862f0 con 0x7f66140b0710 2023-10-14T19:10:54.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.546+0000 7f66127fc700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6600067320 0x7f66000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:54.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.546+0000 7f66127fc700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6600067320 0x7f66000697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6614156ee0 tx=0x7f6608008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:54.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.550+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66140ae9e0 con 0x7f66140b0710 2023-10-14T19:10:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.788+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66140ae9e0 con 0x7f66140b0710 2023-10-14T19:10:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.789+0000 7f65faffd700 1 -- 172.21.15.7:0/3950983964 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4594 (secure 0 0 0) 0x7f66140ae9e0 con 0x7f66140b0710 2023-10-14T19:10:54.790 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:54.791 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:44.293797+0000","modified":"2023-10-14T19:10:47.918922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7869":{"gid":7869,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/302383037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":302383037},{"type":"v1","addr":"172.21.15.7:6835","nonce":302383037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-14T19:10:54.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6600067320 msgr2=0x7f66000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6600067320 0x7f66000697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6614156ee0 tx=0x7f6608008040 comp rx=0 tx=0).stop 2023-10-14T19:10:54.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 msgr2=0x7f66140aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:54.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 0x7f66140aecc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f6604009f80 tx=0x7f6604017000 comp rx=0 tx=0).stop 2023-10-14T19:10:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 shutdown_connections 2023-10-14T19:10:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6600067320 0x7f66000697d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f661415cf20 0x7f66140aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66140b0710 0x7f66140aecc0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 --2- 172.21.15.7:0/3950983964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661415cb50 0x7f6614143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:54.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 >> 172.21.15.7:0/3950983964 conn(0x7f66140cded0 msgr2=0x7f66140675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:54.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 shutdown_connections 2023-10-14T19:10:54.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:54.791+0000 7f66192d5700 1 -- 172.21.15.7:0/3950983964 wait complete. 2023-10-14T19:10:54.795 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 102 2023-10-14T19:10:55.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:10:44.293797+0000', 'modified': '2023-10-14T19:10:47.918922+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7869}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7869': {'gid': 7869, 'name': 'a', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/302383037', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6833', 'nonce': 302383037}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 302383037}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:10:55.207 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:10:55.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T19:10:55.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.331+0000 7fa0da642700 1 Processor -- start 2023-10-14T19:10:55.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.331+0000 7fa0da642700 1 -- start start 2023-10-14T19:10:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0da642700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0d415de50 0x7fa0d40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0da642700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 0x7fa0d415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0da642700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40cf3c0 con 0x7fa0d4153c30 2023-10-14T19:10:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0da642700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d415afd0 con 0x7fa0d415de50 2023-10-14T19:10:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0da642700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d415b2b0 con 0x7fa0d40cef40 2023-10-14T19:10:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d9640700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa0d4153c30 0x7fa0d415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54596/0 (socket says 172.21.15.7:54596) 2023-10-14T19:10:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d9640700 1 -- 172.21.15.7:0/1338006292 learned_addr learned my addr 172.21.15.7:0/1338006292 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 0x7fa0d415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126986195 0 0) 0x7fa0d40cf3c0 con 0x7fa0d4153c30 2023-10-14T19:10:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1338006292 >> v2:172.21.15.148:3300/0 conn(0x7fa0d415de50 0x7fa0d40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0bc003570 con 0x7fa0d4153c30 2023-10-14T19:10:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2367025437 0 0) 0x7fa0bc003570 con 0x7fa0d4153c30 2023-10-14T19:10:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 msgr2=0x7fa0d415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d3fff700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 0x7fa0d415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.332+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 >> v2:172.21.15.148:3300/0 conn(0x7fa0d415de50 msgr2=0x7fa0d40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 --2- 172.21.15.7:0/1338006292 >> v2:172.21.15.148:3300/0 conn(0x7fa0d415de50 0x7fa0d40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d415b590 con 0x7fa0d4153c30 2023-10-14T19:10:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa0cc001470 con 0x7fa0d4153c30 2023-10-14T19:10:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 >> v1:172.21.15.7:6789/0 conn(0x7fa0d4153c30 legacy=0x7fa0d415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 0x7fa0bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0bc004d50 0x7fa0bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d415afd0 con 0x7fa0bc003a60 2023-10-14T19:10:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d415b2b0 con 0x7fa0bc004d50 2023-10-14T19:10:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc00ba60 con 0x7fa0d40cef40 2023-10-14T19:10:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 0x7fa0bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0bc004d50 0x7fa0bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 -- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 msgr2=0x7fa0bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d40cef40 0x7fa0bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 -- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0bc004d50 msgr2=0x7fa0bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0bc004d50 0x7fa0bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 -- 172.21.15.7:0/1338006292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc003570 con 0x7fa0bc003a60 2023-10-14T19:10:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0bc004d50 0x7fa0bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0bc003e70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c3c0 tx=0x7fa0d4159c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17e8b682feddb07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00cc30 con 0x7fa0bc003a60 2023-10-14T19:10:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc00cd90 con 0x7fa0bc003a60 2023-10-14T19:10:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.333+0000 7fa0d3fff700 1 -- 172.21.15.7:0/1338006292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc005b70 con 0x7fa0bc003a60 2023-10-14T19:10:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0da642700 1 -- 172.21.15.7:0/1338006292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 msgr2=0x7fa0bc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0da642700 1 --2- 172.21.15.7:0/1338006292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0bc003e70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c3c0 tx=0x7fa0d4159c60 comp rx=0 tx=0).stop 2023-10-14T19:10:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0d9e41700 1 -- 172.21.15.7:0/1338006292 reap_dead start 2023-10-14T19:10:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0da642700 1 -- 172.21.15.7:0/1338006292 shutdown_connections 2023-10-14T19:10:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0da642700 1 -- 172.21.15.7:0/1338006292 >> 172.21.15.7:0/1338006292 conn(0x7fa0d40703a0 msgr2=0x7fa0d40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0da642700 1 -- 172.21.15.7:0/1338006292 shutdown_connections 2023-10-14T19:10:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.334+0000 7fa0da642700 1 -- 172.21.15.7:0/1338006292 wait complete. 2023-10-14T19:10:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.335+0000 7fa0da642700 1 Processor -- start 2023-10-14T19:10:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.335+0000 7fa0da642700 1 -- start start 2023-10-14T19:10:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0da642700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0d4159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0da642700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d415e3c0 0x7fa0d415e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0da642700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40b32d0 0x7fa0d40b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0da642700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b3c60 con 0x7fa0bc003a60 2023-10-14T19:10:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0da642700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d415ee80 con 0x7fa0d40b32d0 2023-10-14T19:10:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0da642700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d415f160 con 0x7fa0d415e3c0 2023-10-14T19:10:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0d4159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0d4159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45330/0 (socket says 172.21.15.7:45330) 2023-10-14T19:10:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 -- 172.21.15.7:0/1738578048 learned_addr learned my addr 172.21.15.7:0/1738578048 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d415e3c0 0x7fa0d415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40b32d0 0x7fa0d40b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 -- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d415e3c0 msgr2=0x7fa0d415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d415e3c0 0x7fa0d415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 -- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40b32d0 msgr2=0x7fa0d40b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40b32d0 0x7fa0d40b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9640700 1 -- 172.21.15.7:0/1738578048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d415f440 con 0x7fa0bc003a60 2023-10-14T19:10:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.336+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40b32d0 0x7fa0d40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.337+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0d4159820 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc004760 tx=0x7fa0cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.337+0000 7fa0d17fa700 1 -- 172.21.15.7:0/1738578048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00cc30 con 0x7fa0bc003a60 2023-10-14T19:10:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.337+0000 7fa0d17fa700 1 -- 172.21.15.7:0/1738578048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0072e0 con 0x7fa0bc003a60 2023-10-14T19:10:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.337+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d415f720 con 0x7fa0bc003a60 2023-10-14T19:10:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.337+0000 7fa0d17fa700 1 -- 172.21.15.7:0/1738578048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc007680 con 0x7fa0bc003a60 2023-10-14T19:10:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.337+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d4159d60 con 0x7fa0bc003a60 2023-10-14T19:10:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.338+0000 7fa0d17fa700 1 -- 172.21.15.7:0/1738578048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa0cc019030 con 0x7fa0bc003a60 2023-10-14T19:10:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.339+0000 7fa0d17fa700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0c0067320 0x7fa0c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.339+0000 7fa0d17fa700 1 -- 172.21.15.7:0/1738578048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0cc086890 con 0x7fa0bc003a60 2023-10-14T19:10:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.339+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0c0067320 0x7fa0c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.339+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0c0067320 0x7fa0c00697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8006dc0 tx=0x7fa0c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 Processor -- start 2023-10-14T19:10:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 -- start start 2023-10-14T19:10:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc610977d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610b8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc6106dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc60fc4a70 con 0x55dc6106b5f0 2023-10-14T19:10:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc60fc2270 con 0x55dc6106db80 2023-10-14T19:10:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc60fbe060 con 0x55dc610b8480 2023-10-14T19:10:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0d8e3f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0d8e3f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45332/0 (socket says 172.21.15.7:45332) 2023-10-14T19:10:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.341+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/1197309844 learned_addr learned my addr 172.21.15.7:0/1197309844 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc6106dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d9640700 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc610977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 msgr2=0x55dc610977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc610977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 msgr2=0x55dc6106dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc6106dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/1197309844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc60e58270 con 0x55dc6106b5f0 2023-10-14T19:10:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610b8850 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8014e00 tx=0x7fa0c801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a767d67c86ee20c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0ba7fc700 1 -- 172.21.15.7:0/1197309844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8009a40 con 0x55dc6106b5f0 2023-10-14T19:10:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0ba7fc700 1 -- 172.21.15.7:0/1197309844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8016b20 con 0x55dc6106b5f0 2023-10-14T19:10:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.342+0000 7fa0ba7fc700 1 -- 172.21.15.7:0/1197309844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8016ea0 con 0x55dc6106b5f0 2023-10-14T19:10:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/1197309844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 msgr2=0x55dc610b8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610b8850 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8014e00 tx=0x7fa0c801b000 comp rx=0 tx=0).stop 2023-10-14T19:10:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/1197309844 shutdown_connections 2023-10-14T19:10:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc6106dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc610977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/1197309844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610b8850 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/1197309844 >> 172.21.15.7:0/1197309844 conn(0x55dc6106f0c0 msgr2=0x55dc6106f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/1197309844 shutdown_connections 2023-10-14T19:10:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/1197309844 wait complete. 2023-10-14T19:10:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.343+0000 7fa0e4b9db80 1 -- start start 2023-10-14T19:10:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 Processor -- start 2023-10-14T19:10:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106b5f0 0x55dc610920d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 0x55dc610c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61099030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc60f69890 con 0x55dc6106db80 2023-10-14T19:10:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc60f84ea0 con 0x55dc6106b5f0 2023-10-14T19:10:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc60e40e30 con 0x55dc610b8480 2023-10-14T19:10:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0e4b9db80 10 client.0 _ll_register_callbacks cb 0x55dc610312c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:10:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0d8e3f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 0x55dc610c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0d8e3f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 0x55dc610c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45334/0 (socket says 172.21.15.7:45334) 2023-10-14T19:10:55.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/3501171643 learned_addr learned my addr 172.21.15.7:0/3501171643 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:55.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0d9640700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106b5f0 0x55dc610920d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.344+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61099030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 msgr2=0x55dc61099030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61099030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106b5f0 msgr2=0x55dc610920d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106b5f0 0x55dc610920d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0d8e3f700 1 -- 172.21.15.7:0/3501171643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c8014ab0 con 0x55dc6106db80 2023-10-14T19:10:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 0x55dc610c7fd0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8008010 tx=0x7fa0c801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b6b7fb7af78d3c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:10:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3501171643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8032070 con 0x55dc6106db80 2023-10-14T19:10:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3501171643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0c8023b40 con 0x55dc6106db80 2023-10-14T19:10:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc61062cd0 con 0x55dc6106db80 2023-10-14T19:10:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3501171643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0c8037470 con 0x55dc6106db80 2023-10-14T19:10:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0e4b9db80 10 client.8046 fetch_fsmap learned FSMap version 102 2023-10-14T19:10:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x55dc60dfafe0 con 0x55dc6106db80 2023-10-14T19:10:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3501171643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc61062cd0 con 0x55dc6106db80 2023-10-14T19:10:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3501171643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 102) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa0c80375d0 con 0x55dc6106db80 2023-10-14T19:10:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0e4b9db80 10 client.8046 fetch_fsmap finished waiting for FSMap version 102 2023-10-14T19:10:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0e4b9db80 10 client.8046 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:10:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.345+0000 7fa0e4b9db80 20 client.8046 populate_metadata read hostname 'smithi007' 2023-10-14T19:10:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc610b4980 0x55dc61096830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0e4b9db80 4 client.8046 mds_command: new command op to 7869 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:10:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 --> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc6103faa0 con 0x55dc610b4980 2023-10-14T19:10:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0d9640700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc610b4980 0x55dc61096830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0b37fe700 10 client.8046 ms_handle_connect on v2:172.21.15.7:6833/302383037 2023-10-14T19:10:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0d9640700 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc610b4980 0x55dc61096830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eefee4d984cd3aa8 server_cookie=a33c744a9efe71aa in_seq=0 out_seq=0 2023-10-14T19:10:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3501171643 <== mds.0 v2:172.21.15.7:6833/302383037 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dc6103faa0 con 0x55dc610b4980 2023-10-14T19:10:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0b37fe700 10 client.8046 handle_command_reply: tid=0 2023-10-14T19:10:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.346+0000 7fa0e4b9db80 1 client.8046 shutdown 2023-10-14T19:10:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 msgr2=0x55dc610c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 0x55dc610c7fd0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8008010 tx=0x7fa0c801e000 comp rx=0 tx=0).stop 2023-10-14T19:10:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 shutdown_connections 2023-10-14T19:10:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc610b4980 0x55dc61096830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106b5f0 0x55dc610920d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61099030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3501171643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106db80 0x55dc610c7fd0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0b37fe700 0 client.8046 ms_handle_reset on v2:172.21.15.7:6833/302383037 2023-10-14T19:10:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 >> 172.21.15.7:0/3501171643 conn(0x55dc6106f0c0 msgr2=0x55dc61069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 shutdown_connections 2023-10-14T19:10:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3501171643 wait complete. 2023-10-14T19:10:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.347+0000 7fa0e4b9db80 20 client.8046 trim_cache size 0 max 16384 2023-10-14T19:10:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 Processor -- start 2023-10-14T19:10:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 -- start start 2023-10-14T19:10:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc61064840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61064d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc61093ba0 con 0x55dc6106b5f0 2023-10-14T19:10:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc61064060 con 0x55dc6106db80 2023-10-14T19:10:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc610b5d70 con 0x55dc610b8480 2023-10-14T19:10:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0d9640700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0d9640700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45350/0 (socket says 172.21.15.7:45350) 2023-10-14T19:10:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.364+0000 7fa0d9640700 1 -- 172.21.15.7:0/2319049552 learned_addr learned my addr 172.21.15.7:0/2319049552 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d9640700 1 -- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 msgr2=0x55dc61064d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc61064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d9640700 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d9640700 1 -- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 msgr2=0x55dc61064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d9640700 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc61064840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d9640700 1 -- 172.21.15.7:0/2319049552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc60f8c780 con 0x55dc6106b5f0 2023-10-14T19:10:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0d9640700 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610c36e0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc056ee0 tx=0x7fa0cc020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9742b5a0df3839 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0baffd700 1 -- 172.21.15.7:0/2319049552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0578e0 con 0x55dc6106b5f0 2023-10-14T19:10:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0baffd700 1 -- 172.21.15.7:0/2319049552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0571e0 con 0x55dc6106b5f0 2023-10-14T19:10:55.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0baffd700 1 -- 172.21.15.7:0/2319049552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc05a430 con 0x55dc6106b5f0 2023-10-14T19:10:55.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/2319049552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 msgr2=0x55dc610c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610c36e0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc056ee0 tx=0x7fa0cc020040 comp rx=0 tx=0).stop 2023-10-14T19:10:55.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/2319049552 shutdown_connections 2023-10-14T19:10:55.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc610b8480 0x55dc61064d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc610c36e0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.365+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/2319049552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6106db80 0x55dc61064840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.366+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/2319049552 >> 172.21.15.7:0/2319049552 conn(0x55dc6106f0c0 msgr2=0x55dc610b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.366+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/2319049552 shutdown_connections 2023-10-14T19:10:55.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.366+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/2319049552 wait complete. 2023-10-14T19:10:55.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.366+0000 7fa0e4b9db80 1 -- start start 2023-10-14T19:10:55.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.366+0000 7fa0e4b9db80 1 Processor -- start 2023-10-14T19:10:55.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc61099a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc6106db80 0x55dc610924b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc610b8480 0x55dc610929f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc610b3a50 con 0x55dc6106b5f0 2023-10-14T19:10:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc6106a710 con 0x55dc610b8480 2023-10-14T19:10:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc6109a2e0 con 0x55dc6106db80 2023-10-14T19:10:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0e4b9db80 10 client.0 _ll_register_callbacks cb 0x55dc610312c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:10:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc61099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc61099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45356/0 (socket says 172.21.15.7:45356) 2023-10-14T19:10:55.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 -- 172.21.15.7:0/3465069930 learned_addr learned my addr 172.21.15.7:0/3465069930 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:55.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc6106db80 0x55dc610924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9e41700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc610b8480 0x55dc610929f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 -- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc6106db80 msgr2=0x55dc610924b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc6106db80 0x55dc610924b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 -- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc610b8480 msgr2=0x55dc610929f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc610b8480 0x55dc610929f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.367+0000 7fa0d9640700 1 -- 172.21.15.7:0/3465069930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d4159d60 con 0x55dc6106b5f0 2023-10-14T19:10:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0d9640700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc61099a20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc056ee0 tx=0x7fa0cc009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d280a9f6b051d5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:10:55.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3465069930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc057960 con 0x55dc6106b5f0 2023-10-14T19:10:55.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3465069930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0cc05e180 con 0x55dc6106b5f0 2023-10-14T19:10:55.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0c8016b20 con 0x55dc6106b5f0 2023-10-14T19:10:55.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3465069930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0cc011570 con 0x55dc6106b5f0 2023-10-14T19:10:55.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 10 client.8052 fetch_fsmap learned FSMap version 102 2023-10-14T19:10:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x55dc60f73470 con 0x55dc6106b5f0 2023-10-14T19:10:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3465069930 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8016b20 con 0x55dc6106b5f0 2023-10-14T19:10:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3465069930 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 102) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa0cc0566d0 con 0x55dc6106b5f0 2023-10-14T19:10:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 10 client.8052 fetch_fsmap finished waiting for FSMap version 102 2023-10-14T19:10:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 10 client.8052 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:10:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 20 client.8052 populate_metadata read hostname 'smithi007' 2023-10-14T19:10:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc61117260 0x55dc61070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 4 client.8052 mds_command: new command op to 7869 tid=0[{"prefix": "status"}] 2023-10-14T19:10:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 --> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc60f60e00 con 0x55dc61117260 2023-10-14T19:10:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.368+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc61117260 0x55dc61070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0d8e3f700 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc61117260 0x55dc61070e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d609daee69e4c07b server_cookie=4bd868a02a1972a5 in_seq=0 out_seq=0 2023-10-14T19:10:55.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0b37fe700 10 client.8052 ms_handle_connect on v2:172.21.15.7:6833/302383037 2023-10-14T19:10:55.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0b37fe700 1 -- 172.21.15.7:0/3465069930 <== mds.0 v2:172.21.15.7:6833/302383037 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x55dc60f60e00 con 0x55dc61117260 2023-10-14T19:10:55.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0b37fe700 10 client.8052 handle_command_reply: tid=0 2023-10-14T19:10:55.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 client.8052 shutdown 2023-10-14T19:10:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 msgr2=0x55dc61099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc61099a20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc056ee0 tx=0x7fa0cc009000 comp rx=0 tx=0).stop 2023-10-14T19:10:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 shutdown_connections 2023-10-14T19:10:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:6833/302383037,v1:172.21.15.7:6835/302383037] conn(0x55dc61117260 0x55dc61070e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc610b8480 0x55dc610929f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc6106b5f0 0x55dc61099a20 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0b37fe700 0 client.8052 ms_handle_reset on v2:172.21.15.7:6833/302383037 2023-10-14T19:10:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 --2- 172.21.15.7:0/3465069930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55dc6106db80 0x55dc610924b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 >> 172.21.15.7:0/3465069930 conn(0x55dc6106f0c0 msgr2=0x55dc61064800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 shutdown_connections 2023-10-14T19:10:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 1 -- 172.21.15.7:0/3465069930 wait complete. 2023-10-14T19:10:55.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.369+0000 7fa0e4b9db80 20 client.8052 trim_cache size 0 max 16384 2023-10-14T19:10:55.398 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:10:55.398 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:10:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:10:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7869, 2023-10-14T19:10:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:10:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:10:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:10:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 10.488457849, 2023-10-14T19:10:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 102, 2023-10-14T19:10:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 153, 2023-10-14T19:10:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 153, 2023-10-14T19:10:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 15.529869536 2023-10-14T19:10:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:10:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0c0067320 msgr2=0x7fa0c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0c0067320 0x7fa0c00697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8006dc0 tx=0x7fa0c8008040 comp rx=0 tx=0).stop 2023-10-14T19:10:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 msgr2=0x7fa0d4159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0d4159820 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc004760 tx=0x7fa0cc015000 comp rx=0 tx=0).stop 2023-10-14T19:10:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 shutdown_connections 2023-10-14T19:10:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0c0067320 0x7fa0c00697d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40b32d0 0x7fa0d40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0bc003a60 0x7fa0d4159820 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 --2- 172.21.15.7:0/1738578048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0d415e3c0 0x7fa0d415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 >> 172.21.15.7:0/1738578048 conn(0x7fa0d40703a0 msgr2=0x7fa0d40c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 shutdown_connections 2023-10-14T19:10:55.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.370+0000 7fa0da642700 1 -- 172.21.15.7:0/1738578048 wait complete. 2023-10-14T19:10:55.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:10:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.524+0000 7f9704fd3700 1 Processor -- start 2023-10-14T19:10:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.524+0000 7f9704fd3700 1 -- start start 2023-10-14T19:10:55.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f9704fd3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f970015a5d0 0x7f9700156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f9704fd3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970015ae40 con 0x7f97000cb970 2023-10-14T19:10:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f9704fd3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970015ab60 con 0x7f97000cb5a0 2023-10-14T19:10:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f9704fd3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97000ce0f0 con 0x7f970015a5d0 2023-10-14T19:10:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fdd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f97000cb970 0x7f9700159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54602/0 (socket says 172.21.15.7:54602) 2023-10-14T19:10:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fdd9b700 1 -- 172.21.15.7:0/2478751978 learned_addr learned my addr 172.21.15.7:0/2478751978 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fed9d700 1 --2- 172.21.15.7:0/2478751978 >> v2:172.21.15.148:3300/0 conn(0x7f970015a5d0 0x7f9700156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513128905 0 0) 0x7f970015ae40 con 0x7f97000cb970 2023-10-14T19:10:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ec003570 con 0x7f97000cb970 2023-10-14T19:10:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986107105 0 0) 0x7f970015ab60 con 0x7f97000cb5a0 2023-10-14T19:10:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f970015ae40 con 0x7f97000cb5a0 2023-10-14T19:10:55.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fed9d700 1 -- 172.21.15.7:0/2478751978 >> v1:172.21.15.148:6789/0 conn(0x7f97000cb5a0 legacy=0x7f97000cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fed9d700 1 -- 172.21.15.7:0/2478751978 >> v1:172.21.15.7:6789/0 conn(0x7f97000cb970 legacy=0x7f9700159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.525+0000 7f96fed9d700 1 -- 172.21.15.7:0/2478751978 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000ccf00 con 0x7f970015a5d0 2023-10-14T19:10:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f96fed9d700 1 --2- 172.21.15.7:0/2478751978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f970015a5d0 0x7f9700156e90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009e60 tx=0x7f96f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb76a45bc66a189c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000e070 con 0x7f970015a5d0 2023-10-14T19:10:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f000bab0 con 0x7f970015a5d0 2023-10-14T19:10:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f96fd59a700 1 -- 172.21.15.7:0/2478751978 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000be30 con 0x7f970015a5d0 2023-10-14T19:10:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 -- 172.21.15.7:0/2478751978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f970015a5d0 msgr2=0x7f9700156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 --2- 172.21.15.7:0/2478751978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f970015a5d0 0x7f9700156e90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009e60 tx=0x7f96f0009780 comp rx=0 tx=0).stop 2023-10-14T19:10:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 -- 172.21.15.7:0/2478751978 shutdown_connections 2023-10-14T19:10:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 --2- 172.21.15.7:0/2478751978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f970015a5d0 0x7f9700156e90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 -- 172.21.15.7:0/2478751978 >> 172.21.15.7:0/2478751978 conn(0x7f9700070e30 msgr2=0x7f97000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 -- 172.21.15.7:0/2478751978 shutdown_connections 2023-10-14T19:10:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.526+0000 7f9704fd3700 1 -- 172.21.15.7:0/2478751978 wait complete. 2023-10-14T19:10:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.527+0000 7f9704fd3700 1 Processor -- start 2023-10-14T19:10:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 -- start start 2023-10-14T19:10:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97000cb5a0 0x7f97000b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97000cb970 0x7f97001522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 0x7f970015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97000c95f0 con 0x7f970015a5d0 2023-10-14T19:10:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97000c89e0 con 0x7f97000cb970 2023-10-14T19:10:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f9704fd3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97000c8cc0 con 0x7f97000cb5a0 2023-10-14T19:10:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f96fed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 0x7f970015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f96fed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 0x7f970015d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45362/0 (socket says 172.21.15.7:45362) 2023-10-14T19:10:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.528+0000 7f96fed9d700 1 -- 172.21.15.7:0/1479677790 learned_addr learned my addr 172.21.15.7:0/1479677790 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fdd9b700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97000cb970 0x7f97001522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fe59c700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97000cb5a0 0x7f97000b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fed9d700 1 -- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97000cb5a0 msgr2=0x7f97000b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fed9d700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97000cb5a0 0x7f97000b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fed9d700 1 -- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97000cb970 msgr2=0x7f97001522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fed9d700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97000cb970 0x7f97001522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fed9d700 1 -- 172.21.15.7:0/1479677790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0009a20 con 0x7f970015a5d0 2023-10-14T19:10:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96fed9d700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 0x7f970015d720 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f970006ea60 tx=0x7f96f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0027470 con 0x7f970015a5d0 2023-10-14T19:10:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f00275d0 con 0x7f970015a5d0 2023-10-14T19:10:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97000c8fa0 con 0x7f970015a5d0 2023-10-14T19:10:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0027970 con 0x7f970015a5d0 2023-10-14T19:10:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.529+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97000b39f0 con 0x7f970015a5d0 2023-10-14T19:10:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.530+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97000c97a0 con 0x7f970015a5d0 2023-10-14T19:10:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.530+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f96f0024070 con 0x7f970015a5d0 2023-10-14T19:10:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.531+0000 7f96f67fc700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96e0067320 0x7f96e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.531+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96f0087460 con 0x7f970015a5d0 2023-10-14T19:10:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.531+0000 7f96fe59c700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96e0067320 0x7f96e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.531+0000 7f96fe59c700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96e0067320 0x7f96e00697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f96f8000c00 tx=0x7f96f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.535+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97000c97a0 con 0x7f970015a5d0 2023-10-14T19:10:55.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.772+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f970004c3c0 con 0x7f970015a5d0 2023-10-14T19:10:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.773+0000 7f96f67fc700 1 -- 172.21.15.7:0/1479677790 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f96f0057b80 con 0x7f970015a5d0 2023-10-14T19:10:55.775 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:10:55.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96e0067320 msgr2=0x7f96e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96e0067320 0x7f96e00697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f96f8000c00 tx=0x7f96f8009040 comp rx=0 tx=0).stop 2023-10-14T19:10:55.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 msgr2=0x7f970015d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:55.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 0x7f970015d720 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f970006ea60 tx=0x7f96f0019000 comp rx=0 tx=0).stop 2023-10-14T19:10:55.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 shutdown_connections 2023-10-14T19:10:55.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96e0067320 0x7f96e00697d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f970015a5d0 0x7f970015d720 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97000cb5a0 0x7f97000b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 --2- 172.21.15.7:0/1479677790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97000cb970 0x7f97001522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:55.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 >> 172.21.15.7:0/1479677790 conn(0x7f9700070e30 msgr2=0x7f97000ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:55.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 shutdown_connections 2023-10-14T19:10:55.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:55.775+0000 7f9704fd3700 1 -- 172.21.15.7:0/1479677790 wait complete. 2023-10-14T19:10:55.788 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:10:55.788 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:10:55.788 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:10:55.789 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:10:55.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:55.789 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:10:55.790 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:10:55.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:10:55.790 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:10:55.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:55.791 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:10:55.807 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:10:55.809 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:10:55.809 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:10:55.810 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.810 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:10:55.811 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.811 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:55.811 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:55.812 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:10:55.812 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:55.812 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:55.813 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:10:55.813 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:10:55.814 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:55.814 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:10:55.814 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:10:55.815 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 41998sec preferred_lft 41998sec 2023-10-14T19:10:55.815 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:10:55.815 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.815 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:55.816 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:55.816 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:10:55.816 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:10:55.816 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:55.816 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:10:55.817 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.817 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:10:55.817 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.817 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:55.817 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:10:55.817 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:10:55.818 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.818 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:55.818 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:10:55.818 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:10:55.818 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:55.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:55.819 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:10:55.871 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:10:55.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:55.873 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:10:55.929 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:10:55.930 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:10:55.930 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:10:55.930 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:10:55.930 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:10:55.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:55.931 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:10:55.931 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:10:55.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:10:55.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:10:55.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:10:55.933 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:10:56.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.033 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:10:56.048 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:10:56.048 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:10:56.049 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:10:56.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:10:56.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:56.114 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:56.169 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:10:56.170 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:56.170 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:56.225 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:10:56.225 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:10:56.226 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:56.306 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:56.307 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:10:56.307 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:10:56.315 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:56.315 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:10:56.315 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:10:56.316 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:56.316 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:56.337 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:10:56.337 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:10:56.338 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:10:56.338 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:56.338 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:56.338 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:10:56.339 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:10:56.339 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:10:56.340 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:10:56.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:56.406 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:10:56.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.565+0000 7f3752a09700 1 Processor -- start 2023-10-14T19:10:56.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.565+0000 7f3752a09700 1 -- start start 2023-10-14T19:10:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f3752a09700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f374c0cb5a0 0x7f374c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f3752a09700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c15ae40 con 0x7f374c15a5d0 2023-10-14T19:10:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f3752a09700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c15ab60 con 0x7f374c0cd9e0 2023-10-14T19:10:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f3752a09700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0d13f0 con 0x7f374c0cb5a0 2023-10-14T19:10:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f374bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f374c0cb5a0 0x7f374c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f3750fa6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f374c15a5d0 0x7f374c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54616/0 (socket says 172.21.15.7:54616) 2023-10-14T19:10:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.566+0000 7f3750fa6700 1 -- 172.21.15.7:0/3938917685 learned_addr learned my addr 172.21.15.7:0/3938917685 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374bfff700 1 -- 172.21.15.7:0/3938917685 >> v1:172.21.15.148:6789/0 conn(0x7f374c0cd9e0 legacy=0x7f374c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374bfff700 1 -- 172.21.15.7:0/3938917685 >> v1:172.21.15.7:6789/0 conn(0x7f374c15a5d0 legacy=0x7f374c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374bfff700 1 -- 172.21.15.7:0/3938917685 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0ccf00 con 0x7f374c0cb5a0 2023-10-14T19:10:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374affd700 1 -- 172.21.15.7:0/3938917685 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899454236 0 0) 0x7f374c15ae40 con 0x7f374c15a5d0 2023-10-14T19:10:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374bfff700 1 --2- 172.21.15.7:0/3938917685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c0cb5a0 0x7f374c0cb970 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f373c009910 tx=0x7f373c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5716ff6d715c3e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374affd700 1 -- 172.21.15.7:0/3938917685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00b7e0 con 0x7f374c0cb5a0 2023-10-14T19:10:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374affd700 1 -- 172.21.15.7:0/3938917685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c00b940 con 0x7f374c0cb5a0 2023-10-14T19:10:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f374affd700 1 -- 172.21.15.7:0/3938917685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00bce0 con 0x7f374c0cb5a0 2023-10-14T19:10:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f3752a09700 1 -- 172.21.15.7:0/3938917685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c0cb5a0 msgr2=0x7f374c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.567+0000 7f3752a09700 1 --2- 172.21.15.7:0/3938917685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c0cb5a0 0x7f374c0cb970 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f373c009910 tx=0x7f373c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.568+0000 7f3752a09700 1 -- 172.21.15.7:0/3938917685 shutdown_connections 2023-10-14T19:10:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.568+0000 7f3752a09700 1 --2- 172.21.15.7:0/3938917685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c0cb5a0 0x7f374c0cb970 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.568+0000 7f3752a09700 1 -- 172.21.15.7:0/3938917685 >> 172.21.15.7:0/3938917685 conn(0x7f374c070e30 msgr2=0x7f374c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.568+0000 7f3752a09700 1 -- 172.21.15.7:0/3938917685 shutdown_connections 2023-10-14T19:10:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.568+0000 7f3752a09700 1 -- 172.21.15.7:0/3938917685 wait complete. 2023-10-14T19:10:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.569+0000 7f3752a09700 1 Processor -- start 2023-10-14T19:10:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.569+0000 7f3752a09700 1 -- start start 2023-10-14T19:10:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c0cb5a0 0x7f374c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f374c0cd9e0 0x7f374c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:56.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 0x7f374c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:56.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b4a10 con 0x7f374c15a5d0 2023-10-14T19:10:56.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b4cf0 con 0x7f374c0cb5a0 2023-10-14T19:10:56.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b4fd0 con 0x7f374c0cd9e0 2023-10-14T19:10:56.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 0x7f374c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:56.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 0x7f374c0c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45390/0 (socket says 172.21.15.7:45390) 2023-10-14T19:10:56.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 -- 172.21.15.7:0/2973092857 learned_addr learned my addr 172.21.15.7:0/2973092857 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:56.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f374bfff700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c0cb5a0 0x7f374c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:56.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f374b7fe700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f374c0cd9e0 0x7f374c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:56.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 -- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f374c0cd9e0 msgr2=0x7f374c0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:56.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f374c0cd9e0 0x7f374c0c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 -- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c0cb5a0 msgr2=0x7f374c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:56.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c0cb5a0 0x7f374c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 -- 172.21.15.7:0/2973092857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c009420 con 0x7f374c15a5d0 2023-10-14T19:10:56.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f374bfff700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c0cb5a0 0x7f374c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:56.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3750fa6700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 0x7f374c0c6a70 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f374400cbf0 tx=0x7f37440019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:56.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400a9c0 con 0x7f374c15a5d0 2023-10-14T19:10:56.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400ab20 con 0x7f374c15a5d0 2023-10-14T19:10:56.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c0b52b0 con 0x7f374c15a5d0 2023-10-14T19:10:56.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440070f0 con 0x7f374c15a5d0 2023-10-14T19:10:56.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.570+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c151660 con 0x7f374c15a5d0 2023-10-14T19:10:56.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.571+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c04c3c0 con 0x7f374c15a5d0 2023-10-14T19:10:56.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.572+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3744007520 con 0x7f374c15a5d0 2023-10-14T19:10:56.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.572+0000 7f3733fff700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3738067320 0x7f37380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:56.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.572+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37440850c0 con 0x7f374c15a5d0 2023-10-14T19:10:56.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.572+0000 7f374bfff700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3738067320 0x7f37380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:56.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.573+0000 7f374bfff700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3738067320 0x7f37380697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f373c0093f0 tx=0x7f373c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:56.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.576+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3744051dd0 con 0x7f374c15a5d0 2023-10-14T19:10:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.813+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f374c0cd1e0 con 0x7f374c15a5d0 2023-10-14T19:10:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.813+0000 7f3733fff700 1 -- 172.21.15.7:0/2973092857 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37440553f0 con 0x7f374c15a5d0 2023-10-14T19:10:56.814 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:10:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3738067320 msgr2=0x7f37380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3738067320 0x7f37380697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f373c0093f0 tx=0x7f373c016000 comp rx=0 tx=0).stop 2023-10-14T19:10:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 msgr2=0x7f374c0c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 0x7f374c0c6a70 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f374400cbf0 tx=0x7f37440019b0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 shutdown_connections 2023-10-14T19:10:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3738067320 0x7f37380697d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c0cb5a0 0x7f374c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f374c15a5d0 0x7f374c0c6a70 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 --2- 172.21.15.7:0/2973092857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f374c0cd9e0 0x7f374c0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:56.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 >> 172.21.15.7:0/2973092857 conn(0x7f374c070e30 msgr2=0x7f374c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:56.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 shutdown_connections 2023-10-14T19:10:56.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:56.815+0000 7f3752a09700 1 -- 172.21.15.7:0/2973092857 wait complete. 2023-10-14T19:10:56.830 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:10:56.830 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:10:56.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:10:56.831 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:10:56.831 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:56.831 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:10:56.832 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:10:56.832 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:10:56.832 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:10:56.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.833 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:10:56.852 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:10:56.852 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:10:56.853 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:10:56.853 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.853 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:10:56.854 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.854 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:56.854 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:56.854 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:10:56.854 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:56.855 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:56.855 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:10:56.855 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:10:56.855 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:56.856 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:10:56.856 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:56.856 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:10:56.856 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42007sec preferred_lft 42007sec 2023-10-14T19:10:56.857 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:10:56.857 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.857 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:10:56.858 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:10:56.858 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:10:56.858 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.858 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:10:56.859 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.859 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:56.859 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:10:56.859 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:10:56.860 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.860 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:10:56.860 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:10:56.860 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:10:56.861 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:10:56.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.862 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:10:56.920 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:10:56.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.922 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:10:56.980 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:10:56.980 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:10:56.980 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:10:56.980 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:10:56.981 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:10:56.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:56.981 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:10:56.982 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:10:56.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:10:56.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:10:56.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:10:56.983 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:10:57.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:57.089 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:10:57.105 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:10:57.106 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:10:57.106 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:10:57.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:57.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:10:57.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:57.172 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:57.226 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:10:57.227 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:10:57.227 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:57.281 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:10:57.282 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:10:57.282 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:57.362 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:57.362 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:10:57.362 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:10:57.370 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:57.370 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:10:57.370 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:10:57.370 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:57.371 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:57.392 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:10:57.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:10:57.393 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:10:57.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:10:57.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:10:57.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:10:57.394 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:10:57.394 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:10:57.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:10:57.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:57.396 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:57.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:10:57.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.591+0000 7fa17c14d700 1 Processor -- start 2023-10-14T19:10:57.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.592+0000 7fa17c14d700 1 -- start start 2023-10-14T19:10:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.592+0000 7fa17c14d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa174159530 0x7fa1740ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.592+0000 7fa17c14d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa1740cb6f0 0x7fa1740cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:57.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.592+0000 7fa17c14d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1740ccfd0 con 0x7fa17406dcf0 2023-10-14T19:10:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.592+0000 7fa17c14d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1740cc0b0 con 0x7fa1740cb6f0 2023-10-14T19:10:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.592+0000 7fa17c14d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17415a410 con 0x7fa174159530 2023-10-14T19:10:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa1740cb6f0 0x7fa1740cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa1740cb6f0 0x7fa1740cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51982/0 (socket says 172.21.15.7:51982) 2023-10-14T19:10:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 -- 172.21.15.7:0/2776371066 learned_addr learned my addr 172.21.15.7:0/2776371066 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa179ee9700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa174159530 0x7fa1740ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 -- 172.21.15.7:0/2776371066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa174159530 msgr2=0x7fa1740ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa174159530 0x7fa1740ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 -- 172.21.15.7:0/2776371066 >> v1:172.21.15.148:6789/0 conn(0x7fa17406dcf0 legacy=0x7fa174159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 -- 172.21.15.7:0/2776371066 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17415a6f0 con 0x7fa1740cb6f0 2023-10-14T19:10:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa179ee9700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa174159530 0x7fa1740ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa17a6ea700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1740cb6f0 0x7fa1740cbb70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa164009f20 tx=0x7fa164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d603f5ab63df3217 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa178ee7700 1 -- 172.21.15.7:0/2776371066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16400e070 con 0x7fa1740cb6f0 2023-10-14T19:10:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa178ee7700 1 -- 172.21.15.7:0/2776371066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16400ba80 con 0x7fa1740cb6f0 2023-10-14T19:10:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.593+0000 7fa178ee7700 1 -- 172.21.15.7:0/2776371066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640092e0 con 0x7fa1740cb6f0 2023-10-14T19:10:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 -- 172.21.15.7:0/2776371066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1740cb6f0 msgr2=0x7fa1740cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1740cb6f0 0x7fa1740cbb70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa164009f20 tx=0x7fa164009840 comp rx=0 tx=0).stop 2023-10-14T19:10:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 -- 172.21.15.7:0/2776371066 shutdown_connections 2023-10-14T19:10:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1740cb6f0 0x7fa1740cbb70 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 --2- 172.21.15.7:0/2776371066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa174159530 0x7fa1740ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 -- 172.21.15.7:0/2776371066 >> 172.21.15.7:0/2776371066 conn(0x7fa1740703a0 msgr2=0x7fa1740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 -- 172.21.15.7:0/2776371066 shutdown_connections 2023-10-14T19:10:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.594+0000 7fa17c14d700 1 -- 172.21.15.7:0/2776371066 wait complete. 2023-10-14T19:10:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.595+0000 7fa17c14d700 1 Processor -- start 2023-10-14T19:10:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.595+0000 7fa17c14d700 1 -- start start 2023-10-14T19:10:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17c14d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa17406dcf0 0x7fa17414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:57.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17c14d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1740cb6f0 0x7fa17415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17c14d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 0x7fa17415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17c14d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740b3890 con 0x7fa174159530 2023-10-14T19:10:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17c14d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17415d940 con 0x7fa17406dcf0 2023-10-14T19:10:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17c14d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17415dc20 con 0x7fa1740cb6f0 2023-10-14T19:10:57.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 0x7fa17415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 0x7fa17415cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51986/0 (socket says 172.21.15.7:51986) 2023-10-14T19:10:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 -- 172.21.15.7:0/3368673005 learned_addr learned my addr 172.21.15.7:0/3368673005 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa179ee9700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa17406dcf0 0x7fa17414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa1796e8700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1740cb6f0 0x7fa17415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:57.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 -- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1740cb6f0 msgr2=0x7fa17415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1740cb6f0 0x7fa17415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 -- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa17406dcf0 msgr2=0x7fa17414a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa17406dcf0 0x7fa17414a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.596+0000 7fa17a6ea700 1 -- 172.21.15.7:0/3368673005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa164009ae0 con 0x7fa174159530 2023-10-14T19:10:57.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.597+0000 7fa17a6ea700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 0x7fa17415cb60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa16400b6c0 tx=0x7fa164018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.597+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640032f0 con 0x7fa174159530 2023-10-14T19:10:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.597+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164008d50 con 0x7fa174159530 2023-10-14T19:10:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.597+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164026690 con 0x7fa174159530 2023-10-14T19:10:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.597+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17415df00 con 0x7fa174159530 2023-10-14T19:10:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.597+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17414a770 con 0x7fa174159530 2023-10-14T19:10:57.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.598+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1740b3a40 con 0x7fa174159530 2023-10-14T19:10:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.598+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa164003040 con 0x7fa174159530 2023-10-14T19:10:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.599+0000 7fa171ffb700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa160067320 0x7fa1600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.599+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa164086bb0 con 0x7fa174159530 2023-10-14T19:10:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.599+0000 7fa179ee9700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa160067320 0x7fa1600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:57.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.599+0000 7fa179ee9700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa160067320 0x7fa1600697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa16c006f00 tx=0x7fa16c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:57.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.603+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa164053730 con 0x7fa174159530 2023-10-14T19:10:57.842 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.842+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa17404c3c0 con 0x7fa174159530 2023-10-14T19:10:57.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.947+0000 7fa171ffb700 1 -- 172.21.15.7:0/3368673005 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa164056d50 con 0x7fa174159530 2023-10-14T19:10:57.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa160067320 msgr2=0x7fa1600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:57.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa160067320 0x7fa1600697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa16c006f00 tx=0x7fa16c008040 comp rx=0 tx=0).stop 2023-10-14T19:10:57.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 msgr2=0x7fa17415cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:57.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 0x7fa17415cb60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa16400b6c0 tx=0x7fa164018000 comp rx=0 tx=0).stop 2023-10-14T19:10:57.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 shutdown_connections 2023-10-14T19:10:57.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa160067320 0x7fa1600697d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa17406dcf0 0x7fa17414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa174159530 0x7fa17415cb60 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 --2- 172.21.15.7:0/3368673005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1740cb6f0 0x7fa17415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:57.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 >> 172.21.15.7:0/3368673005 conn(0x7fa1740703a0 msgr2=0x7fa1740c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:57.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.949+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 shutdown_connections 2023-10-14T19:10:57.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:57.950+0000 7fa17c14d700 1 -- 172.21.15.7:0/3368673005 wait complete. 2023-10-14T19:10:57.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:10:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.082+0000 7fc8ce2f3700 1 Processor -- start 2023-10-14T19:10:58.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.082+0000 7fc8ce2f3700 1 -- start start 2023-10-14T19:10:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.082+0000 7fc8ce2f3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8c80cb970 0x7fc8c8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8ce2f3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8c815a400 0x7fc8c8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8ce2f3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c815ae40 con 0x7fc8c80cb5a0 2023-10-14T19:10:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8ce2f3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c80ce0f0 con 0x7fc8c815a400 2023-10-14T19:10:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8ce2f3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c80d13f0 con 0x7fc8c80cb970 2023-10-14T19:10:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8c815a400 0x7fc8c8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8c815a400 0x7fc8c8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51998/0 (socket says 172.21.15.7:51998) 2023-10-14T19:10:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 -- 172.21.15.7:0/3662024412 learned_addr learned my addr 172.21.15.7:0/3662024412 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8c77fe700 1 --2- 172.21.15.7:0/3662024412 >> v2:172.21.15.148:3300/0 conn(0x7fc8c80cb970 0x7fc8c8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 -- 172.21.15.7:0/3662024412 >> v2:172.21.15.148:3300/0 conn(0x7fc8c80cb970 msgr2=0x7fc8c8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 --2- 172.21.15.7:0/3662024412 >> v2:172.21.15.148:3300/0 conn(0x7fc8c80cb970 0x7fc8c8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 -- 172.21.15.7:0/3662024412 >> v1:172.21.15.148:6789/0 conn(0x7fc8c80cb5a0 legacy=0x7fc8c80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 -- 172.21.15.7:0/3662024412 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c815ab60 con 0x7fc8c815a400 2023-10-14T19:10:58.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8cc890700 1 --2- 172.21.15.7:0/3662024412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c8156e90 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80d1780 tx=0x7fc8c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef6b1f59063763f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8c6ffd700 1 -- 172.21.15.7:0/3662024412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000e070 con 0x7fc8c815a400 2023-10-14T19:10:58.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8c6ffd700 1 -- 172.21.15.7:0/3662024412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000ba50 con 0x7fc8c815a400 2023-10-14T19:10:58.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.083+0000 7fc8c6ffd700 1 -- 172.21.15.7:0/3662024412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00092e0 con 0x7fc8c815a400 2023-10-14T19:10:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3662024412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 msgr2=0x7fc8c8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3662024412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c8156e90 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80d1780 tx=0x7fc8c0009840 comp rx=0 tx=0).stop 2023-10-14T19:10:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3662024412 shutdown_connections 2023-10-14T19:10:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3662024412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c8156e90 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3662024412 >> v2:172.21.15.148:3300/0 conn(0x7fc8c80cb970 0x7fc8c8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3662024412 >> 172.21.15.7:0/3662024412 conn(0x7fc8c8070e30 msgr2=0x7fc8c80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3662024412 shutdown_connections 2023-10-14T19:10:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.084+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3662024412 wait complete. 2023-10-14T19:10:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.085+0000 7fc8ce2f3700 1 Processor -- start 2023-10-14T19:10:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.085+0000 7fc8ce2f3700 1 -- start start 2023-10-14T19:10:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8ce2f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8c80cb5a0 0x7fc8c81512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8ce2f3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8c80cb970 0x7fc8c8154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8ce2f3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8ce2f3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c81517f0 con 0x7fc8c815a400 2023-10-14T19:10:58.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8ce2f3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c9d10 con 0x7fc8c80cb5a0 2023-10-14T19:10:58.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8ce2f3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c9ff0 con 0x7fc8c80cb970 2023-10-14T19:10:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c81545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52012/0 (socket says 172.21.15.7:52012) 2023-10-14T19:10:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 -- 172.21.15.7:0/3990931016 learned_addr learned my addr 172.21.15.7:0/3990931016 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8c7fff700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8c80cb5a0 0x7fc8c81512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8c77fe700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8c80cb970 0x7fc8c8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 -- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8c80cb970 msgr2=0x7fc8c8154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8c80cb970 0x7fc8c8154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 -- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8c80cb5a0 msgr2=0x7fc8c81512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8c80cb5a0 0x7fc8c81512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.086+0000 7fc8cc890700 1 -- 172.21.15.7:0/3990931016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009ae0 con 0x7fc8c815a400 2023-10-14T19:10:58.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.087+0000 7fc8cc890700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c81545c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc8c806ea60 tx=0x7fc8c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.087+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000be60 con 0x7fc8c815a400 2023-10-14T19:10:58.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.087+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0008d20 con 0x7fc8c815a400 2023-10-14T19:10:58.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.087+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c001c660 con 0x7fc8c815a400 2023-10-14T19:10:58.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.087+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c80ca2d0 con 0x7fc8c815a400 2023-10-14T19:10:58.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.087+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c815b110 con 0x7fc8c815a400 2023-10-14T19:10:58.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.088+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c815b300 con 0x7fc8c815a400 2023-10-14T19:10:58.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.088+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc8c0003040 con 0x7fc8c815a400 2023-10-14T19:10:58.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.089+0000 7fc8affff700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8b4067320 0x7fc8b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.089+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8c00865b0 con 0x7fc8c815a400 2023-10-14T19:10:58.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.089+0000 7fc8c7fff700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8b4067320 0x7fc8b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.089+0000 7fc8c7fff700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8b4067320 0x7fc8b40697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8003a80 tx=0x7fc8b8007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.093+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8c0053130 con 0x7fc8c815a400 2023-10-14T19:10:58.316 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.316+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c804c3c0 con 0x7fc8b4067320 2023-10-14T19:10:58.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.318+0000 7fc8affff700 1 -- 172.21.15.7:0/3990931016 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc8c804c3c0 con 0x7fc8b4067320 2023-10-14T19:10:58.318 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:10:58.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:10:58.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:10:58.319 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:10:58.319 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:10:58.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8b4067320 msgr2=0x7fc8b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8b4067320 0x7fc8b40697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8003a80 tx=0x7fc8b8007ec0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 msgr2=0x7fc8c81545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c81545c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc8c806ea60 tx=0x7fc8c0018000 comp rx=0 tx=0).stop 2023-10-14T19:10:58.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 shutdown_connections 2023-10-14T19:10:58.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc8b4067320 0x7fc8b40697d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8c80cb5a0 0x7fc8c81512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8c815a400 0x7fc8c81545c0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 --2- 172.21.15.7:0/3990931016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8c80cb970 0x7fc8c8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 >> 172.21.15.7:0/3990931016 conn(0x7fc8c8070e30 msgr2=0x7fc8c8155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:58.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.319+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 shutdown_connections 2023-10-14T19:10:58.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.320+0000 7fc8ce2f3700 1 -- 172.21.15.7:0/3990931016 wait complete. 2023-10-14T19:10:58.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:10:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.454+0000 7efdade76700 1 Processor -- start 2023-10-14T19:10:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.454+0000 7efdade76700 1 -- start start 2023-10-14T19:10:58.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdade76700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efda8153a00 0x7efda8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdade76700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda815de50 0x7efda815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdade76700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda815af60 con 0x7efda80cea00 2023-10-14T19:10:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdade76700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda815d010 con 0x7efda8153a00 2023-10-14T19:10:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdade76700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda815b240 con 0x7efda815de50 2023-10-14T19:10:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdace74700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efda8153a00 0x7efda8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdace74700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efda8153a00 0x7efda8153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52020/0 (socket says 172.21.15.7:52020) 2023-10-14T19:10:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdace74700 1 -- 172.21.15.7:0/1905004848 learned_addr learned my addr 172.21.15.7:0/1905004848 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efda7fff700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda815de50 0x7efda815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdace74700 1 -- 172.21.15.7:0/1905004848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda815de50 msgr2=0x7efda815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdace74700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda815de50 0x7efda815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.455+0000 7efdace74700 1 -- 172.21.15.7:0/1905004848 >> v1:172.21.15.148:6789/0 conn(0x7efda80cea00 legacy=0x7efda80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdace74700 1 -- 172.21.15.7:0/1905004848 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda815b520 con 0x7efda8153a00 2023-10-14T19:10:58.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efda7fff700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda815de50 0x7efda815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:10:58.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdace74700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda8153a00 0x7efda8153dd0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7efda0009f20 tx=0x7efda0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4e2cf24f9accf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efda77fe700 1 -- 172.21.15.7:0/1905004848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda000e070 con 0x7efda8153a00 2023-10-14T19:10:58.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efda77fe700 1 -- 172.21.15.7:0/1905004848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda000ba80 con 0x7efda8153a00 2023-10-14T19:10:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efda77fe700 1 -- 172.21.15.7:0/1905004848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00092e0 con 0x7efda8153a00 2023-10-14T19:10:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 -- 172.21.15.7:0/1905004848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda8153a00 msgr2=0x7efda8153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda8153a00 0x7efda8153dd0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7efda0009f20 tx=0x7efda0009840 comp rx=0 tx=0).stop 2023-10-14T19:10:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 -- 172.21.15.7:0/1905004848 shutdown_connections 2023-10-14T19:10:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda8153a00 0x7efda8153dd0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 --2- 172.21.15.7:0/1905004848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda815de50 0x7efda815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 -- 172.21.15.7:0/1905004848 >> 172.21.15.7:0/1905004848 conn(0x7efda80703a0 msgr2=0x7efda80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 -- 172.21.15.7:0/1905004848 shutdown_connections 2023-10-14T19:10:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.456+0000 7efdade76700 1 -- 172.21.15.7:0/1905004848 wait complete. 2023-10-14T19:10:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 Processor -- start 2023-10-14T19:10:58.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 -- start start 2023-10-14T19:10:58.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda80cea00 0x7efda8156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda8153a00 0x7efda80cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 0x7efda80cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cc290 con 0x7efda815de50 2023-10-14T19:10:58.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80ccfe0 con 0x7efda8153a00 2023-10-14T19:10:58.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.458+0000 7efdade76700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cbcd0 con 0x7efda80cea00 2023-10-14T19:10:58.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 0x7efda80cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 0x7efda80cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52032/0 (socket says 172.21.15.7:52032) 2023-10-14T19:10:58.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 -- 172.21.15.7:0/3627796390 learned_addr learned my addr 172.21.15.7:0/3627796390 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:58.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efda7fff700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda8153a00 0x7efda80cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdace74700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda80cea00 0x7efda8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 -- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda80cea00 msgr2=0x7efda8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda80cea00 0x7efda8156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 -- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda8153a00 msgr2=0x7efda80cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda8153a00 0x7efda80cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 -- 172.21.15.7:0/3627796390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0009ae0 con 0x7efda815de50 2023-10-14T19:10:58.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdad675700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 0x7efda80cb650 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c560 tx=0x7efd98007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98011590 con 0x7efda815de50 2023-10-14T19:10:58.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd980116f0 con 0x7efda815de50 2023-10-14T19:10:58.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda80cbfb0 con 0x7efda815de50 2023-10-14T19:10:58.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98011ab0 con 0x7efda815de50 2023-10-14T19:10:58.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.459+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda81519c0 con 0x7efda815de50 2023-10-14T19:10:58.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.460+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda804c3c0 con 0x7efda815de50 2023-10-14T19:10:58.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.461+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efd9801b3b0 con 0x7efda815de50 2023-10-14T19:10:58.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.461+0000 7efda4ff9700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd94067320 0x7efd940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.461+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd98084000 con 0x7efda815de50 2023-10-14T19:10:58.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.461+0000 7efdace74700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd94067320 0x7efd940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.462+0000 7efdace74700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd94067320 0x7efd940697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efda0009880 tx=0x7efda0018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.466+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd98050c90 con 0x7efda815de50 2023-10-14T19:10:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.659+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efda80caef0 con 0x7efda815de50 2023-10-14T19:10:58.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.660+0000 7efda4ff9700 1 -- 172.21.15.7:0/3627796390 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7efd98017070 con 0x7efda815de50 2023-10-14T19:10:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd94067320 msgr2=0x7efd940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd94067320 0x7efd940697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efda0009880 tx=0x7efda0018000 comp rx=0 tx=0).stop 2023-10-14T19:10:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 msgr2=0x7efda80cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 0x7efda80cb650 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c560 tx=0x7efd98007ef0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 shutdown_connections 2023-10-14T19:10:58.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd94067320 0x7efd940697d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda815de50 0x7efda80cb650 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efda80cea00 0x7efda8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 --2- 172.21.15.7:0/3627796390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda8153a00 0x7efda80cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 >> 172.21.15.7:0/3627796390 conn(0x7efda80703a0 msgr2=0x7efda815bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 shutdown_connections 2023-10-14T19:10:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.662+0000 7efdade76700 1 -- 172.21.15.7:0/3627796390 wait complete. 2023-10-14T19:10:58.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000517628 2023-10-14T19:10:58.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.796+0000 7f34dff9b700 1 Processor -- start 2023-10-14T19:10:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34dff9b700 1 -- start start 2023-10-14T19:10:58.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34dff9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34dff9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34d80ccfa0 0x7f34d80cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34dff9b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80cf510 con 0x7f34d8159860 2023-10-14T19:10:58.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34dff9b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80d00b0 con 0x7f34d80ccfa0 2023-10-14T19:10:58.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34dff9b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80ce670 con 0x7f34d80ce220 2023-10-14T19:10:58.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34de538700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34d80ccfa0 0x7f34d80cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.797+0000 7f34ddd37700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f34d8159860 0x7f34d80cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52840/0 (socket says 172.21.15.7:52840) 2023-10-14T19:10:58.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34ddd37700 1 -- 172.21.15.7:0/3708824658 learned_addr learned my addr 172.21.15.7:0/3708824658 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:58.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34dcd35700 1 -- 172.21.15.7:0/3708824658 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304272050 0 0) 0x7f34d80cf510 con 0x7f34d8159860 2023-10-14T19:10:58.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34dd536700 1 --2- 172.21.15.7:0/3708824658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34dcd35700 1 -- 172.21.15.7:0/3708824658 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c0003570 con 0x7f34d8159860 2023-10-14T19:10:58.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34de538700 1 -- 172.21.15.7:0/3708824658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 msgr2=0x7f34d80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:58.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34de538700 1 --2- 172.21.15.7:0/3708824658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34de538700 1 -- 172.21.15.7:0/3708824658 >> v1:172.21.15.7:6789/0 conn(0x7f34d8159860 legacy=0x7f34d80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34de538700 1 -- 172.21.15.7:0/3708824658 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80cd960 con 0x7f34d80ccfa0 2023-10-14T19:10:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34de538700 1 --2- 172.21.15.7:0/3708824658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d80ccfa0 0x7f34d80cd420 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009e60 tx=0x7f34c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24046adcac2f0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34dcd35700 1 -- 172.21.15.7:0/3708824658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800e070 con 0x7f34d80ccfa0 2023-10-14T19:10:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34dcd35700 1 -- 172.21.15.7:0/3708824658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c800bb60 con 0x7f34d80ccfa0 2023-10-14T19:10:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.798+0000 7f34dcd35700 1 -- 172.21.15.7:0/3708824658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8012430 con 0x7f34d80ccfa0 2023-10-14T19:10:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 -- 172.21.15.7:0/3708824658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d80ccfa0 msgr2=0x7f34d80cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 --2- 172.21.15.7:0/3708824658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d80ccfa0 0x7f34d80cd420 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009e60 tx=0x7f34c8009780 comp rx=0 tx=0).stop 2023-10-14T19:10:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 -- 172.21.15.7:0/3708824658 shutdown_connections 2023-10-14T19:10:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 --2- 172.21.15.7:0/3708824658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d80ccfa0 0x7f34d80cd420 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 --2- 172.21.15.7:0/3708824658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 -- 172.21.15.7:0/3708824658 >> 172.21.15.7:0/3708824658 conn(0x7f34d80999b0 msgr2=0x7f34d8070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:58.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 -- 172.21.15.7:0/3708824658 shutdown_connections 2023-10-14T19:10:58.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.799+0000 7f34dff9b700 1 -- 172.21.15.7:0/3708824658 wait complete. 2023-10-14T19:10:58.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.800+0000 7f34dff9b700 1 Processor -- start 2023-10-14T19:10:58.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.800+0000 7f34dff9b700 1 -- start start 2023-10-14T19:10:58.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dff9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34d80ccfa0 0x7f34d80c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dff9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dff9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d8159860 0x7f34d80c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dff9b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80c95f0 con 0x7f34d8159860 2023-10-14T19:10:58.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dff9b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d815bb80 con 0x7f34d80ccfa0 2023-10-14T19:10:58.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dff9b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d815be60 con 0x7f34d80ce220 2023-10-14T19:10:58.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d8159860 0x7f34d80c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d8159860 0x7f34d80c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52044/0 (socket says 172.21.15.7:52044) 2023-10-14T19:10:58.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 -- 172.21.15.7:0/3019701217 learned_addr learned my addr 172.21.15.7:0/3019701217 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:58.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34dd536700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34ddd37700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34d80ccfa0 0x7f34d80c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 -- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 msgr2=0x7f34d80ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34d80ce220 0x7f34d80ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 -- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34d80ccfa0 msgr2=0x7f34d80c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:58.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34d80ccfa0 0x7f34d80c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:58.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 -- 172.21.15.7:0/3019701217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c8009a20 con 0x7f34d8159860 2023-10-14T19:10:58.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34de538700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34d8159860 0x7f34d80c8970 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f34d806c7c0 tx=0x7f34c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.801+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8027470 con 0x7f34d8159860 2023-10-14T19:10:58.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.802+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c80275f0 con 0x7f34d8159860 2023-10-14T19:10:58.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.802+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80279b0 con 0x7f34d8159860 2023-10-14T19:10:58.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.802+0000 7f34dff9b700 1 -- 172.21.15.7:0/3019701217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d815c140 con 0x7f34d8159860 2023-10-14T19:10:58.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.802+0000 7f34dff9b700 1 -- 172.21.15.7:0/3019701217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d815b830 con 0x7f34d8159860 2023-10-14T19:10:58.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.803+0000 7f34dff9b700 1 -- 172.21.15.7:0/3019701217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d815c2d0 con 0x7f34d8159860 2023-10-14T19:10:58.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.803+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f34c8024070 con 0x7f34d8159860 2023-10-14T19:10:58.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.804+0000 7f34d5ffb700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f34c4067320 0x7f34c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:58.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.804+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34c8087660 con 0x7f34d8159860 2023-10-14T19:10:58.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.804+0000 7f34ddd37700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f34c4067320 0x7f34c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:58.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.804+0000 7f34ddd37700 1 --2- 172.21.15.7:0/3019701217 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f34c4067320 0x7f34c40697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000c00 tx=0x7f34d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:58.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:58.808+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c80542b0 con 0x7f34d8159860 2023-10-14T19:10:59.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.032+0000 7f34dff9b700 1 -- 172.21.15.7:0/3019701217 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000517628", "target": ["mon-mgr", ""]}) v1 -- 0x7f34d804c3c0 con 0x7f34c4067320 2023-10-14T19:10:59.033 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:10:59.033+0000 7f53c0831700 -1 mgr.server reply reply (1) Operation not permitted WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-14T19:10:59.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.033+0000 7f34d5ffb700 1 -- 172.21.15.7:0/3019701217 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: -1 WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue.) v1 ==== 283+0+0 (secure 0 0 0) 0x7f34d804c3c0 con 0x7f34c4067320 2023-10-14T19:10:59.035 INFO:teuthology.orchestra.run.smithi007.stderr:Error EPERM: WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-14T19:10:59.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:10:59.039 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:10:59.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:59.081 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:10:59.127 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:10:59.128 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:10:59.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:10:59.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:10:59.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:10:59.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:59.169 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:10:59.224 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:10:59.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:10:59.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:10:59.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:10:59.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:10:59.270 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:10:59.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:10:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.405+0000 7fc1b2e06700 1 Processor -- start 2023-10-14T19:10:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.405+0000 7fc1b2e06700 1 -- start start 2023-10-14T19:10:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2e06700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1ac0cf110 0x7fc1ac164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2e06700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac15afd0 con 0x7fc1ac153c30 2023-10-14T19:10:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2e06700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac15b2b0 con 0x7fc1ac15de50 2023-10-14T19:10:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2e06700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac15b590 con 0x7fc1ac0cf110 2023-10-14T19:10:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2605700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1ac0cf110 0x7fc1ac164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2605700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1ac0cf110 0x7fc1ac164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52058/0 (socket says 172.21.15.7:52058) 2023-10-14T19:10:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.406+0000 7fc1b2605700 1 -- 172.21.15.7:0/1921784684 learned_addr learned my addr 172.21.15.7:0/1921784684 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b2605700 1 -- 172.21.15.7:0/1921784684 >> v1:172.21.15.148:6789/0 conn(0x7fc1ac15de50 legacy=0x7fc1ac0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b2605700 1 -- 172.21.15.7:0/1921784684 >> v1:172.21.15.7:6789/0 conn(0x7fc1ac153c30 legacy=0x7fc1ac15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b2605700 1 -- 172.21.15.7:0/1921784684 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac15b870 con 0x7fc1ac0cf110 2023-10-14T19:10:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b0e02700 1 -- 172.21.15.7:0/1921784684 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157428898 0 0) 0x7fc1ac15afd0 con 0x7fc1ac153c30 2023-10-14T19:10:59.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b2605700 1 --2- 172.21.15.7:0/1921784684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac0cf110 0x7fc1ac164600 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0099b0 tx=0x7fc19c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb4004b06318a28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:59.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b0e02700 1 -- 172.21.15.7:0/1921784684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00b820 con 0x7fc1ac0cf110 2023-10-14T19:10:59.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b0e02700 1 -- 172.21.15.7:0/1921784684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00b980 con 0x7fc1ac0cf110 2023-10-14T19:10:59.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.407+0000 7fc1b0e02700 1 -- 172.21.15.7:0/1921784684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00bd20 con 0x7fc1ac0cf110 2023-10-14T19:10:59.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1921784684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac0cf110 msgr2=0x7fc1ac164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1921784684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac0cf110 0x7fc1ac164600 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0099b0 tx=0x7fc19c009250 comp rx=0 tx=0).stop 2023-10-14T19:10:59.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1921784684 shutdown_connections 2023-10-14T19:10:59.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1921784684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac0cf110 0x7fc1ac164600 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1921784684 >> 172.21.15.7:0/1921784684 conn(0x7fc1ac0703a0 msgr2=0x7fc1ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:59.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1921784684 shutdown_connections 2023-10-14T19:10:59.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.408+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1921784684 wait complete. 2023-10-14T19:10:59.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.409+0000 7fc1b2e06700 1 Processor -- start 2023-10-14T19:10:59.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.409+0000 7fc1b2e06700 1 -- start start 2023-10-14T19:10:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1ac0cf110 0x7fc1ac146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac153c30 0x7fc1ac0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 0x7fc1ac0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c8f20 con 0x7fc1ac15de50 2023-10-14T19:10:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c8310 con 0x7fc1ac153c30 2023-10-14T19:10:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c85f0 con 0x7fc1ac0cf110 2023-10-14T19:10:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 0x7fc1ac0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 0x7fc1ac0b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52068/0 (socket says 172.21.15.7:52068) 2023-10-14T19:10:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 -- 172.21.15.7:0/1786898550 learned_addr learned my addr 172.21.15.7:0/1786898550 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b1603700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac153c30 0x7fc1ac0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b1e04700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1ac0cf110 0x7fc1ac146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 -- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1ac0cf110 msgr2=0x7fc1ac146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1ac0cf110 0x7fc1ac146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 -- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac153c30 msgr2=0x7fc1ac0b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac153c30 0x7fc1ac0b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 -- 172.21.15.7:0/1786898550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c0094f0 con 0x7fc1ac15de50 2023-10-14T19:10:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b1603700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac153c30 0x7fc1ac0b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:10:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2605700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 0x7fc1ac0b51a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0094c0 tx=0x7fc19c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c01b450 con 0x7fc1ac15de50 2023-10-14T19:10:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c020070 con 0x7fc1ac15de50 2023-10-14T19:10:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac0c88d0 con 0x7fc1ac15de50 2023-10-14T19:10:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.410+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c01b800 con 0x7fc1ac15de50 2023-10-14T19:10:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.411+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac147350 con 0x7fc1ac15de50 2023-10-14T19:10:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.412+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac0c90d0 con 0x7fc1ac15de50 2023-10-14T19:10:59.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.412+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc19c022030 con 0x7fc1ac15de50 2023-10-14T19:10:59.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.412+0000 7fc1a9ffb700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc198067320 0x7fc1980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.412+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc19c086d30 con 0x7fc1ac15de50 2023-10-14T19:10:59.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.413+0000 7fc1b1e04700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc198067320 0x7fc1980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.413+0000 7fc1b1e04700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc198067320 0x7fc1980697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4001560 tx=0x7fc1a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:59.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.417+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1ac0c90d0 con 0x7fc1ac15de50 2023-10-14T19:10:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.653+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1ac04c3c0 con 0x7fc1ac15de50 2023-10-14T19:10:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.654+0000 7fc1a9ffb700 1 -- 172.21.15.7:0/1786898550 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4594 (secure 0 0 0) 0x7fc19c053a90 con 0x7fc1ac15de50 2023-10-14T19:10:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:59.655 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:44.293797+0000","modified":"2023-10-14T19:10:47.918922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7869":{"gid":7869,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/302383037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":302383037},{"type":"v1","addr":"172.21.15.7:6835","nonce":302383037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-14T19:10:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc198067320 msgr2=0x7fc1980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc198067320 0x7fc1980697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4001560 tx=0x7fc1a4009040 comp rx=0 tx=0).stop 2023-10-14T19:10:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 msgr2=0x7fc1ac0b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 0x7fc1ac0b51a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0094c0 tx=0x7fc19c016000 comp rx=0 tx=0).stop 2023-10-14T19:10:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 shutdown_connections 2023-10-14T19:10:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc198067320 0x7fc1980697d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1ac15de50 0x7fc1ac0b51a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1ac0cf110 0x7fc1ac146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 --2- 172.21.15.7:0/1786898550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac153c30 0x7fc1ac0b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 >> 172.21.15.7:0/1786898550 conn(0x7fc1ac0703a0 msgr2=0x7fc1ac0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 shutdown_connections 2023-10-14T19:10:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.656+0000 7fc1b2e06700 1 -- 172.21.15.7:0/1786898550 wait complete. 2023-10-14T19:10:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 103 2023-10-14T19:10:59.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:10:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.789+0000 7fcb4d0bc700 1 Processor -- start 2023-10-14T19:10:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.789+0000 7fcb4d0bc700 1 -- start start 2023-10-14T19:10:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb4d0bc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb48153c30 0x7fcb4815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb4d0bc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb4815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb4d0bc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4815afd0 con 0x7fcb4815de50 2023-10-14T19:10:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb4d0bc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4815b2b0 con 0x7fcb48153c30 2023-10-14T19:10:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb4d0bc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4815b590 con 0x7fcb480cf110 2023-10-14T19:10:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb47fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb48153c30 0x7fcb4815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb477fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb4815de50 0x7fcb480cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52850/0 (socket says 172.21.15.7:52850) 2023-10-14T19:10:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb477fe700 1 -- 172.21.15.7:0/4115137403 learned_addr learned my addr 172.21.15.7:0/4115137403 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:10:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb4c8bb700 1 --2- 172.21.15.7:0/4115137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb4815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb47fff700 1 -- 172.21.15.7:0/4115137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 msgr2=0x7fcb4815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:10:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb47fff700 1 --2- 172.21.15.7:0/4115137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb4815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb47fff700 1 -- 172.21.15.7:0/4115137403 >> v1:172.21.15.7:6789/0 conn(0x7fcb4815de50 legacy=0x7fcb480cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb47fff700 1 -- 172.21.15.7:0/4115137403 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4815b870 con 0x7fcb48153c30 2023-10-14T19:10:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb46ffd700 1 -- 172.21.15.7:0/4115137403 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079359452 0 0) 0x7fcb4815afd0 con 0x7fcb4815de50 2023-10-14T19:10:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.790+0000 7fcb47fff700 1 --2- 172.21.15.7:0/4115137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb48153c30 0x7fcb4815a5e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fcb380098e0 tx=0x7fcb380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f313428721f235 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:59.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb46ffd700 1 -- 172.21.15.7:0/4115137403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38009e80 con 0x7fcb48153c30 2023-10-14T19:10:59.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb46ffd700 1 -- 172.21.15.7:0/4115137403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3800b860 con 0x7fcb48153c30 2023-10-14T19:10:59.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb46ffd700 1 -- 172.21.15.7:0/4115137403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800bbe0 con 0x7fcb48153c30 2023-10-14T19:10:59.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/4115137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb48153c30 msgr2=0x7fcb4815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/4115137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb48153c30 0x7fcb4815a5e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fcb380098e0 tx=0x7fcb380091a0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/4115137403 shutdown_connections 2023-10-14T19:10:59.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/4115137403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb48153c30 0x7fcb4815a5e0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/4115137403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb4815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/4115137403 >> 172.21.15.7:0/4115137403 conn(0x7fcb480703a0 msgr2=0x7fcb480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:10:59.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/4115137403 shutdown_connections 2023-10-14T19:10:59.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.791+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/4115137403 wait complete. 2023-10-14T19:10:59.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.792+0000 7fcb4d0bc700 1 Processor -- start 2023-10-14T19:10:59.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.792+0000 7fcb4d0bc700 1 -- start start 2023-10-14T19:10:59.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4d0bc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb480b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4d0bc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb48153c30 0x7fcb480b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4d0bc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 0x7fcb480b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4d0bc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b49b0 con 0x7fcb4815de50 2023-10-14T19:10:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4d0bc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b3da0 con 0x7fcb48153c30 2023-10-14T19:10:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4d0bc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b4080 con 0x7fcb480cf110 2023-10-14T19:10:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4c8bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 0x7fcb480b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4c8bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 0x7fcb480b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52086/0 (socket says 172.21.15.7:52086) 2023-10-14T19:10:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb4c8bb700 1 -- 172.21.15.7:0/484911946 learned_addr learned my addr 172.21.15.7:0/484911946 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:10:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb47fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb480b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.793+0000 7fcb477fe700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb48153c30 0x7fcb480b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4c8bb700 1 -- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 msgr2=0x7fcb480b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4c8bb700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb480b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4c8bb700 1 -- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb48153c30 msgr2=0x7fcb480b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:10:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4c8bb700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb48153c30 0x7fcb480b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:10:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4c8bb700 1 -- 172.21.15.7:0/484911946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009420 con 0x7fcb4815de50 2023-10-14T19:10:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4c8bb700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 0x7fcb480b5790 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009fa0 tx=0x7fcb40009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000ebc0 con 0x7fcb4815de50 2023-10-14T19:10:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000ed20 con 0x7fcb4815de50 2023-10-14T19:10:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480b4360 con 0x7fcb4815de50 2023-10-14T19:10:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40014670 con 0x7fcb4815de50 2023-10-14T19:10:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.794+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480b34f0 con 0x7fcb4815de50 2023-10-14T19:10:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.795+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4804c3c0 con 0x7fcb4815de50 2023-10-14T19:10:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.795+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb400149e0 con 0x7fcb4815de50 2023-10-14T19:10:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.796+0000 7fcb2ffff700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb34067320 0x7fcb340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:10:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.796+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb400852d0 con 0x7fcb4815de50 2023-10-14T19:10:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.796+0000 7fcb47fff700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb34067320 0x7fcb340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:10:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.797+0000 7fcb47fff700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb34067320 0x7fcb340697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcb380091e0 tx=0x7fcb38017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:10:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.800+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb40051f60 con 0x7fcb4815de50 2023-10-14T19:10:59.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.997+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb4815bb50 con 0x7fcb4815de50 2023-10-14T19:10:59.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.997+0000 7fcb2ffff700 1 -- 172.21.15.7:0/484911946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fcb40055580 con 0x7fcb4815de50 2023-10-14T19:10:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:10:59.999 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":153,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:45.881332+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:42.068244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:43.264160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.999+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb34067320 msgr2=0x7fcb340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.999+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb34067320 0x7fcb340697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcb380091e0 tx=0x7fcb38017000 comp rx=0 tx=0).stop 2023-10-14T19:11:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.999+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 msgr2=0x7fcb480b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:10:59.999+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 0x7fcb480b5790 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009fa0 tx=0x7fcb40009900 comp rx=0 tx=0).stop 2023-10-14T19:11:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 shutdown_connections 2023-10-14T19:11:00.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb34067320 0x7fcb340697d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb4815de50 0x7fcb480b5790 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb480cf110 0x7fcb480b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 --2- 172.21.15.7:0/484911946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb48153c30 0x7fcb480b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 >> 172.21.15.7:0/484911946 conn(0x7fcb480703a0 msgr2=0x7fcb480c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:00.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 shutdown_connections 2023-10-14T19:11:00.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.000+0000 7fcb4d0bc700 1 -- 172.21.15.7:0/484911946 wait complete. 2023-10-14T19:11:00.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:10:42.068244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:10:43.264160+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:11:00.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:11:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.135+0000 7f3c01ad4700 1 Processor -- start 2023-10-14T19:11:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.135+0000 7f3c01ad4700 1 -- start start 2023-10-14T19:11:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3c01ad4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3bfc0ca2c0 0x7f3bfc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3c01ad4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3bfc0ccba0 0x7f3bfc0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3c01ad4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0c32a0 con 0x7f3bfc157930 2023-10-14T19:11:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3c01ad4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc0c9730 con 0x7f3bfc0ca2c0 2023-10-14T19:11:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3c01ad4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc0cd560 con 0x7f3bfc0ccba0 2023-10-14T19:11:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3bfaffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3bfc0ca2c0 0x7f3bfc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3bfb7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3bfc157930 0x7f3bfc0ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52858/0 (socket says 172.21.15.7:52858) 2023-10-14T19:11:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.136+0000 7f3bfb7fe700 1 -- 172.21.15.7:0/2288286742 learned_addr learned my addr 172.21.15.7:0/2288286742 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfbfff700 1 --2- 172.21.15.7:0/2288286742 >> v2:172.21.15.148:3300/0 conn(0x7f3bfc0ccba0 0x7f3bfc0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfaffd700 1 -- 172.21.15.7:0/2288286742 >> v2:172.21.15.148:3300/0 conn(0x7f3bfc0ccba0 msgr2=0x7f3bfc0cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfaffd700 1 --2- 172.21.15.7:0/2288286742 >> v2:172.21.15.148:3300/0 conn(0x7f3bfc0ccba0 0x7f3bfc0cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfaffd700 1 -- 172.21.15.7:0/2288286742 >> v1:172.21.15.7:6789/0 conn(0x7f3bfc157930 legacy=0x7f3bfc0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfaffd700 1 -- 172.21.15.7:0/2288286742 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0c4100 con 0x7f3bfc0ca2c0 2023-10-14T19:11:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfa7fc700 1 -- 172.21.15.7:0/2288286742 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427386431 0 0) 0x7f3bfc0c32a0 con 0x7f3bfc157930 2023-10-14T19:11:00.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfaffd700 1 --2- 172.21.15.7:0/2288286742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc0ca730 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc06be80 tx=0x7f3be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2b59fe5d9914e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfa7fc700 1 -- 172.21.15.7:0/2288286742 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4009e80 con 0x7f3bfc0ca2c0 2023-10-14T19:11:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfa7fc700 1 -- 172.21.15.7:0/2288286742 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400b820 con 0x7f3bfc0ca2c0 2023-10-14T19:11:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.137+0000 7f3bfa7fc700 1 -- 172.21.15.7:0/2288286742 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400bba0 con 0x7f3bfc0ca2c0 2023-10-14T19:11:00.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 -- 172.21.15.7:0/2288286742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc0ca2c0 msgr2=0x7f3bfc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/2288286742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc0ca730 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc06be80 tx=0x7f3be40091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 -- 172.21.15.7:0/2288286742 shutdown_connections 2023-10-14T19:11:00.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/2288286742 >> v2:172.21.15.148:3300/0 conn(0x7f3bfc0ccba0 0x7f3bfc0cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/2288286742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc0ca730 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 -- 172.21.15.7:0/2288286742 >> 172.21.15.7:0/2288286742 conn(0x7f3bfc088000 msgr2=0x7f3bfc0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:00.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 -- 172.21.15.7:0/2288286742 shutdown_connections 2023-10-14T19:11:00.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.138+0000 7f3c01ad4700 1 -- 172.21.15.7:0/2288286742 wait complete. 2023-10-14T19:11:00.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.139+0000 7f3c01ad4700 1 Processor -- start 2023-10-14T19:11:00.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.139+0000 7f3c01ad4700 1 -- start start 2023-10-14T19:11:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3c01ad4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3c01ad4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bfc0ccba0 0x7f3bfc0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3c01ad4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 0x7f3bfc0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3c01ad4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc144380 con 0x7f3bfc157930 2023-10-14T19:11:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3c01ad4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1531d0 con 0x7f3bfc0ca2c0 2023-10-14T19:11:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3c01ad4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1534b0 con 0x7f3bfc0ccba0 2023-10-14T19:11:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 0x7f3bfc0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 0x7f3bfc0c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52094/0 (socket says 172.21.15.7:52094) 2023-10-14T19:11:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 -- 172.21.15.7:0/1496188168 learned_addr learned my addr 172.21.15.7:0/1496188168 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfb7fe700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfaffd700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bfc0ccba0 0x7f3bfc0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 -- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bfc0ccba0 msgr2=0x7f3bfc0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bfc0ccba0 0x7f3bfc0c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 -- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bfc0ca2c0 msgr2=0x7f3bfc143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 -- 172.21.15.7:0/1496188168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4009420 con 0x7f3bfc157930 2023-10-14T19:11:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.140+0000 7f3bfbfff700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 0x7f3bfc0c4ad0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00d890 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.141+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0125f0 con 0x7f3bfc157930 2023-10-14T19:11:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.141+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec012770 con 0x7f3bfc157930 2023-10-14T19:11:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.141+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec012b30 con 0x7f3bfc157930 2023-10-14T19:11:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.141+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc153790 con 0x7f3bfc157930 2023-10-14T19:11:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.141+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc153d50 con 0x7f3bfc157930 2023-10-14T19:11:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.142+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc04c3c0 con 0x7f3bfc157930 2023-10-14T19:11:00.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.142+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3bec01e460 con 0x7f3bfc157930 2023-10-14T19:11:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.142+0000 7f3bf37fe700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3bdc067320 0x7f3bdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.143+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3bec0851f0 con 0x7f3bfc157930 2023-10-14T19:11:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.143+0000 7f3bfb7fe700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3bdc067320 0x7f3bdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.143+0000 7f3bfb7fe700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3bdc067320 0x7f3bdc0697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007240 tx=0x7f3bf4001990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.147+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bec051e80 con 0x7f3bfc157930 2023-10-14T19:11:00.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.340+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bfc153f40 con 0x7f3bfc157930 2023-10-14T19:11:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.340+0000 7f3bf37fe700 1 -- 172.21.15.7:0/1496188168 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bec0554a0 con 0x7f3bfc157930 2023-10-14T19:11:00.341 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:11:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3bdc067320 msgr2=0x7f3bdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3bdc067320 0x7f3bdc0697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007240 tx=0x7f3bf4001990 comp rx=0 tx=0).stop 2023-10-14T19:11:00.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 msgr2=0x7f3bfc0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 0x7f3bfc0c4ad0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00d890 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2023-10-14T19:11:00.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 shutdown_connections 2023-10-14T19:11:00.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3bdc067320 0x7f3bdc0697d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bfc0ca2c0 0x7f3bfc143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc157930 0x7f3bfc0c4ad0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 --2- 172.21.15.7:0/1496188168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bfc0ccba0 0x7f3bfc0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 >> 172.21.15.7:0/1496188168 conn(0x7f3bfc088000 msgr2=0x7f3bfc0ab070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:00.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 shutdown_connections 2023-10-14T19:11:00.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.342+0000 7f3c01ad4700 1 -- 172.21.15.7:0/1496188168 wait complete. 2023-10-14T19:11:00.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:11:00.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.476+0000 7effd5482700 1 Processor -- start 2023-10-14T19:11:00.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.476+0000 7effd5482700 1 -- start start 2023-10-14T19:11:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effd5482700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7effd00cf180 0x7effd00ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effd5482700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd015e010 con 0x7effd01594d0 2023-10-14T19:11:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effd5482700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd015d420 con 0x7effd00cb1a0 2023-10-14T19:11:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effd5482700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd015d6e0 con 0x7effd00cf180 2023-10-14T19:11:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effceffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7effd01594d0 0x7effd00cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52874/0 (socket says 172.21.15.7:52874) 2023-10-14T19:11:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effceffd700 1 -- 172.21.15.7:0/370429023 learned_addr learned my addr 172.21.15.7:0/370429023 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effce7fc700 1 --2- 172.21.15.7:0/370429023 >> v2:172.21.15.148:3300/0 conn(0x7effd00cf180 0x7effd00ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effcdffb700 1 -- 172.21.15.7:0/370429023 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905109778 0 0) 0x7effd015e010 con 0x7effd01594d0 2023-10-14T19:11:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effcdffb700 1 -- 172.21.15.7:0/370429023 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effbc003570 con 0x7effd01594d0 2023-10-14T19:11:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.477+0000 7effce7fc700 1 -- 172.21.15.7:0/370429023 >> v1:172.21.15.148:6789/0 conn(0x7effd00cb1a0 legacy=0x7effd0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effcdffb700 1 -- 172.21.15.7:0/370429023 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63538773 0 0) 0x7effd015d420 con 0x7effd00cb1a0 2023-10-14T19:11:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effce7fc700 1 -- 172.21.15.7:0/370429023 >> v1:172.21.15.7:6789/0 conn(0x7effd01594d0 legacy=0x7effd00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effce7fc700 1 -- 172.21.15.7:0/370429023 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd015d9c0 con 0x7effd00cf180 2023-10-14T19:11:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effce7fc700 1 --2- 172.21.15.7:0/370429023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cf180 0x7effd00ccfc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7effb80098e0 tx=0x7effb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9562eec94ecc8786 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effcdffb700 1 -- 172.21.15.7:0/370429023 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800b640 con 0x7effd00cf180 2023-10-14T19:11:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effcdffb700 1 -- 172.21.15.7:0/370429023 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800b7a0 con 0x7effd00cf180 2023-10-14T19:11:00.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effcdffb700 1 -- 172.21.15.7:0/370429023 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800bb20 con 0x7effd00cf180 2023-10-14T19:11:00.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effd5482700 1 -- 172.21.15.7:0/370429023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cf180 msgr2=0x7effd00ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.478+0000 7effd5482700 1 --2- 172.21.15.7:0/370429023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cf180 0x7effd00ccfc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7effb80098e0 tx=0x7effb80091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.479+0000 7effd5482700 1 -- 172.21.15.7:0/370429023 shutdown_connections 2023-10-14T19:11:00.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.479+0000 7effd5482700 1 --2- 172.21.15.7:0/370429023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cf180 0x7effd00ccfc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.479+0000 7effd5482700 1 -- 172.21.15.7:0/370429023 >> 172.21.15.7:0/370429023 conn(0x7effd00703a0 msgr2=0x7effd0070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.479+0000 7effd5482700 1 -- 172.21.15.7:0/370429023 shutdown_connections 2023-10-14T19:11:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.479+0000 7effd5482700 1 -- 172.21.15.7:0/370429023 wait complete. 2023-10-14T19:11:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.480+0000 7effd5482700 1 Processor -- start 2023-10-14T19:11:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.480+0000 7effd5482700 1 -- start start 2023-10-14T19:11:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cb1a0 0x7effd0155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 0x7effd0148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effd01594d0 0x7effd016d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd01569c0 con 0x7effd00cf180 2023-10-14T19:11:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd00c7fa0 con 0x7effd00cb1a0 2023-10-14T19:11:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd0156400 con 0x7effd01594d0 2023-10-14T19:11:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 0x7effd0148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 0x7effd0148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52096/0 (socket says 172.21.15.7:52096) 2023-10-14T19:11:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 -- 172.21.15.7:0/3738069900 learned_addr learned my addr 172.21.15.7:0/3738069900 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effceffd700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cb1a0 0x7effd0155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effcf7fe700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effd01594d0 0x7effd016d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 -- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effd01594d0 msgr2=0x7effd016d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effd01594d0 0x7effd016d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 -- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cb1a0 msgr2=0x7effd0155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cb1a0 0x7effd0155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 -- 172.21.15.7:0/3738069900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009420 con 0x7effd00cf180 2023-10-14T19:11:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effceffd700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cb1a0 0x7effd0155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effce7fc700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 0x7effd0148b10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7effb80093f0 tx=0x7effb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800bb20 con 0x7effd00cf180 2023-10-14T19:11:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8000c90 con 0x7effd00cf180 2023-10-14T19:11:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.481+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd01566e0 con 0x7effd00cf180 2023-10-14T19:11:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.482+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb801a660 con 0x7effd00cf180 2023-10-14T19:11:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.482+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd00c8780 con 0x7effd00cf180 2023-10-14T19:11:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.482+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd00c89a0 con 0x7effd00cf180 2023-10-14T19:11:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.483+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7effb801aa50 con 0x7effd00cf180 2023-10-14T19:11:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.483+0000 7effc6ffd700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7effb0067320 0x7effb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.483+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effb8086950 con 0x7effd00cf180 2023-10-14T19:11:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.484+0000 7effceffd700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7effb0067320 0x7effb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.484+0000 7effceffd700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7effb0067320 0x7effb00697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7effc8005c50 tx=0x7effc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.488+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effb80535e0 con 0x7effd00cf180 2023-10-14T19:11:00.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.680+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effd004c3c0 con 0x7effd00cf180 2023-10-14T19:11:00.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.680+0000 7effc6ffd700 1 -- 172.21.15.7:0/3738069900 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v153) v1 ==== 104+0+11 (secure 0 0 0) 0x7effb8056c00 con 0x7effd00cf180 2023-10-14T19:11:00.682 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:11:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7effb0067320 msgr2=0x7effb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7effb0067320 0x7effb00697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7effc8005c50 tx=0x7effc8009040 comp rx=0 tx=0).stop 2023-10-14T19:11:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 msgr2=0x7effd0148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 0x7effd0148b10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7effb80093f0 tx=0x7effb8017000 comp rx=0 tx=0).stop 2023-10-14T19:11:00.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 shutdown_connections 2023-10-14T19:11:00.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7effb0067320 0x7effb00697d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd00cb1a0 0x7effd0155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effd01594d0 0x7effd016d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 --2- 172.21.15.7:0/3738069900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd00cf180 0x7effd0148b10 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 >> 172.21.15.7:0/3738069900 conn(0x7effd00703a0 msgr2=0x7effd01499f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:00.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 shutdown_connections 2023-10-14T19:11:00.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.683+0000 7effd5482700 1 -- 172.21.15.7:0/3738069900 wait complete. 2023-10-14T19:11:00.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:11:00.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.817+0000 7fdbc8c89700 1 Processor -- start 2023-10-14T19:11:00.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.817+0000 7fdbc8c89700 1 -- start start 2023-10-14T19:11:00.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc8c89700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbc40cc320 0x7fdbc413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc8c89700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbc406a110 0x7fdbc413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc8c89700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc406d7b0 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc8c89700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc406a570 con 0x7fdbc406a110 2023-10-14T19:11:00.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc8c89700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc406f7d0 con 0x7fdbc40cc320 2023-10-14T19:11:00.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc2d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbc406a110 0x7fdbc413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdbc40cc6f0 0x7fdbc4069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52878/0 (socket says 172.21.15.7:52878) 2023-10-14T19:11:00.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc1d9b700 1 -- 172.21.15.7:0/3851456970 learned_addr learned my addr 172.21.15.7:0/3851456970 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:00.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc259c700 1 --2- 172.21.15.7:0/3851456970 >> v2:172.21.15.148:3300/0 conn(0x7fdbc40cc320 0x7fdbc413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3851456970 >> v2:172.21.15.148:3300/0 conn(0x7fdbc40cc320 msgr2=0x7fdbc413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:00.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc2d9d700 1 --2- 172.21.15.7:0/3851456970 >> v2:172.21.15.148:3300/0 conn(0x7fdbc40cc320 0x7fdbc413c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3851456970 >> v1:172.21.15.7:6789/0 conn(0x7fdbc40cc6f0 legacy=0x7fdbc4069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.818+0000 7fdbc159a700 1 -- 172.21.15.7:0/3851456970 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672598477 0 0) 0x7fdbc406d7b0 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3851456970 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc406e330 con 0x7fdbc406a110 2023-10-14T19:11:00.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc2d9d700 1 --2- 172.21.15.7:0/3851456970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc406a110 0x7fdbc413c7e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40cf510 tx=0x7fdbb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c319dd0621974e59 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc159a700 1 -- 172.21.15.7:0/3851456970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400e070 con 0x7fdbc406a110 2023-10-14T19:11:00.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc159a700 1 -- 172.21.15.7:0/3851456970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400bbf0 con 0x7fdbc406a110 2023-10-14T19:11:00.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc159a700 1 -- 172.21.15.7:0/3851456970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4012430 con 0x7fdbc406a110 2023-10-14T19:11:00.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3851456970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc406a110 msgr2=0x7fdbc413c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3851456970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc406a110 0x7fdbc413c7e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40cf510 tx=0x7fdbb4009780 comp rx=0 tx=0).stop 2023-10-14T19:11:00.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3851456970 shutdown_connections 2023-10-14T19:11:00.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3851456970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc406a110 0x7fdbc413c7e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3851456970 >> v2:172.21.15.148:3300/0 conn(0x7fdbc40cc320 0x7fdbc413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3851456970 >> 172.21.15.7:0/3851456970 conn(0x7fdbc4067f00 msgr2=0x7fdbc4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:00.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3851456970 shutdown_connections 2023-10-14T19:11:00.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.819+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3851456970 wait complete. 2023-10-14T19:11:00.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 Processor -- start 2023-10-14T19:11:00.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 -- start start 2023-10-14T19:11:00.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc406a110 0x7fdbc40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40cc320 0x7fdbc413b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 0x7fdbc40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40ac7e0 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40abbd0 con 0x7fdbc40cc320 2023-10-14T19:11:00.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc8c89700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40abeb0 con 0x7fdbc406a110 2023-10-14T19:11:00.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 0x7fdbc40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc2d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 0x7fdbc40ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52128/0 (socket says 172.21.15.7:52128) 2023-10-14T19:11:00.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.821+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3109382740 learned_addr learned my addr 172.21.15.7:0/3109382740 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:00.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc259c700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc406a110 0x7fdbc40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc1d9b700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40cc320 0x7fdbc413b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc406a110 msgr2=0x7fdbc40adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc2d9d700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc406a110 0x7fdbc40adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40cc320 msgr2=0x7fdbc413b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc2d9d700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40cc320 0x7fdbc413b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:00.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc2d9d700 1 -- 172.21.15.7:0/3109382740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009a20 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc2d9d700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 0x7fdbc40ab130 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40cf610 tx=0x7fdbb4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4012e80 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb401b630 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb401b9f0 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc40ac190 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.822+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc40ae4c0 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.823+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40ac950 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.823+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdbb401c400 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.824+0000 7fdbba7fc700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdba4067320 0x7fdba40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:00.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.824+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbb4086bb0 con 0x7fdbc40cc6f0 2023-10-14T19:11:00.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.824+0000 7fdbc259c700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdba4067320 0x7fdba40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:00.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.825+0000 7fdbc259c700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdba4067320 0x7fdba40697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc006fd0 tx=0x7fdbbc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:00.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:00.828+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbb4053730 con 0x7fdbc40cc6f0 2023-10-14T19:11:01.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.022+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbc404c3c0 con 0x7fdbc40cc6f0 2023-10-14T19:11:01.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.022+0000 7fdbba7fc700 1 -- 172.21.15.7:0/3109382740 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v153) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbb402a020 con 0x7fdbc40cc6f0 2023-10-14T19:11:01.024 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:11:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdba4067320 msgr2=0x7fdba40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdba4067320 0x7fdba40697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc006fd0 tx=0x7fdbbc008040 comp rx=0 tx=0).stop 2023-10-14T19:11:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 msgr2=0x7fdbc40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 0x7fdbc40ab130 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40cf610 tx=0x7fdbb4019000 comp rx=0 tx=0).stop 2023-10-14T19:11:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 shutdown_connections 2023-10-14T19:11:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdba4067320 0x7fdba40697d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc40cc6f0 0x7fdbc40ab130 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc406a110 0x7fdbc40adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 --2- 172.21.15.7:0/3109382740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40cc320 0x7fdbc413b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 >> 172.21.15.7:0/3109382740 conn(0x7fdbc4067f00 msgr2=0x7fdbc40cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:01.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 shutdown_connections 2023-10-14T19:11:01.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.024+0000 7fdbc8c89700 1 -- 172.21.15.7:0/3109382740 wait complete. 2023-10-14T19:11:01.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.156+0000 7fb5c69c1700 1 Processor -- start 2023-10-14T19:11:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.156+0000 7fb5c69c1700 1 -- start start 2023-10-14T19:11:01.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c69c1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 0x7fb5c015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c69c1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5c00cf110 0x7fb5c015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c69c1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c015afd0 con 0x7fb5c015de50 2023-10-14T19:11:01.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c69c1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c015b2b0 con 0x7fb5c00cf110 2023-10-14T19:11:01.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c69c1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015b590 con 0x7fb5c0153c30 2023-10-14T19:11:01.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c51be700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb5c015de50 0x7fb5c00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52894/0 (socket says 172.21.15.7:52894) 2023-10-14T19:11:01.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c51be700 1 -- 172.21.15.7:0/3588227625 learned_addr learned my addr 172.21.15.7:0/3588227625 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:01.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3588227625 >> v2:172.21.15.148:3300/0 conn(0x7fb5c00cf110 0x7fb5c015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c59bf700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 0x7fb5c015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11896527 0 0) 0x7fb5c015afd0 con 0x7fb5c015de50 2023-10-14T19:11:01.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.157+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a8003570 con 0x7fb5c015de50 2023-10-14T19:11:01.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 379844024 0 0) 0x7fb5a8003570 con 0x7fb5c015de50 2023-10-14T19:11:01.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 msgr2=0x7fb5c015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:01.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 0x7fb5c015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 >> v2:172.21.15.148:3300/0 conn(0x7fb5c00cf110 msgr2=0x7fb5c015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:01.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 --2- 172.21.15.7:0/3588227625 >> v2:172.21.15.148:3300/0 conn(0x7fb5c00cf110 0x7fb5c015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c015b870 con 0x7fb5c015de50 2023-10-14T19:11:01.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fb5b4001470 con 0x7fb5c015de50 2023-10-14T19:11:01.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 >> v1:172.21.15.7:6789/0 conn(0x7fb5c015de50 legacy=0x7fb5c00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a8003a60 0x7fb5a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 0x7fb5a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5a8004d50 0x7fb5a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015b2b0 con 0x7fb5a8004d50 2023-10-14T19:11:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015b590 con 0x7fb5a8003a60 2023-10-14T19:11:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a800ba60 con 0x7fb5c0153c30 2023-10-14T19:11:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5a8004d50 0x7fb5a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c59bf700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a8003a60 0x7fb5a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c51be700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 0x7fb5a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 -- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 msgr2=0x7fb5a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c0153c30 0x7fb5a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 -- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a8003a60 msgr2=0x7fb5a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a8003a60 0x7fb5a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 -- 172.21.15.7:0/3588227625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8003570 con 0x7fb5a8004d50 2023-10-14T19:11:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5a8004d50 0x7fb5a80051c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000e210 tx=0x7fb5b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73870d3b00d0c2cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000ea60 con 0x7fb5a8004d50 2023-10-14T19:11:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000f040 con 0x7fb5a8004d50 2023-10-14T19:11:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.158+0000 7fb5c49bd700 1 -- 172.21.15.7:0/3588227625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000ee10 con 0x7fb5a8004d50 2023-10-14T19:11:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3588227625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5a8004d50 msgr2=0x7fb5a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3588227625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5a8004d50 0x7fb5a80051c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000e210 tx=0x7fb5b000b040 comp rx=0 tx=0).stop 2023-10-14T19:11:01.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c61c0700 1 -- 172.21.15.7:0/3588227625 reap_dead start 2023-10-14T19:11:01.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3588227625 shutdown_connections 2023-10-14T19:11:01.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3588227625 >> 172.21.15.7:0/3588227625 conn(0x7fb5c00703a0 msgr2=0x7fb5c00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:01.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3588227625 shutdown_connections 2023-10-14T19:11:01.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.159+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3588227625 wait complete. 2023-10-14T19:11:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.160+0000 7fb5c69c1700 1 Processor -- start 2023-10-14T19:11:01.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.160+0000 7fb5c69c1700 1 -- start start 2023-10-14T19:11:01.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c69c1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c00b3980 0x7fb5c016cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c69c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 0x7fb5c016d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c69c1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c016d960 0x7fb5c0169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c69c1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0141830 con 0x7fb5c0151930 2023-10-14T19:11:01.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c69c1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00b6250 con 0x7fb5c00b3980 2023-10-14T19:11:01.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c69c1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00b5490 con 0x7fb5c016d960 2023-10-14T19:11:01.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 0x7fb5c016d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 0x7fb5c016d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52140/0 (socket says 172.21.15.7:52140) 2023-10-14T19:11:01.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 -- 172.21.15.7:0/3071820521 learned_addr learned my addr 172.21.15.7:0/3071820521 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:01.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c59bf700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c00b3980 0x7fb5c016cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c016d960 0x7fb5c0169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 -- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c016d960 msgr2=0x7fb5c0169950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c016d960 0x7fb5c0169950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 -- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c00b3980 msgr2=0x7fb5c016cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c00b3980 0x7fb5c016cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 -- 172.21.15.7:0/3071820521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00b5770 con 0x7fb5c0151930 2023-10-14T19:11:01.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c61c0700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c016d960 0x7fb5c0169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:01.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.161+0000 7fb5c51be700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 0x7fb5c016d420 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4000fd0 tx=0x7fb5b4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.162+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4018030 con 0x7fb5c0151930 2023-10-14T19:11:01.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.162+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400f8a0 con 0x7fb5c0151930 2023-10-14T19:11:01.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.162+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c00b5a50 con 0x7fb5c0151930 2023-10-14T19:11:01.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.162+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400fc40 con 0x7fb5c0151930 2023-10-14T19:11:01.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.162+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c00c7bf0 con 0x7fb5c0151930 2023-10-14T19:11:01.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.163+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c004c3c0 con 0x7fb5c0151930 2023-10-14T19:11:01.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.163+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb5b401b070 con 0x7fb5c0151930 2023-10-14T19:11:01.177 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.163+0000 7fb5bdffb700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5ac067350 0x7fb5ac069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.164+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5b4019070 con 0x7fb5c0151930 2023-10-14T19:11:01.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.164+0000 7fb5c59bf700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5ac067350 0x7fb5ac069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.164+0000 7fb5c59bf700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5ac067350 0x7fb5ac069800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8006f00 tx=0x7fb5b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.168+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5b4051780 con 0x7fb5c0151930 2023-10-14T19:11:01.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.405+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c015bb50 con 0x7fb5c0151930 2023-10-14T19:11:01.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.406+0000 7fb5bdffb700 1 -- 172.21.15.7:0/3071820521 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4594 (secure 0 0 0) 0x7fb5b4054da0 con 0x7fb5c0151930 2023-10-14T19:11:01.407 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:01.407 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:44.293797+0000","modified":"2023-10-14T19:10:47.918922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7869":{"gid":7869,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/302383037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":302383037},{"type":"v1","addr":"172.21.15.7:6835","nonce":302383037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-14T19:11:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5ac067350 msgr2=0x7fb5ac069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5ac067350 0x7fb5ac069800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8006f00 tx=0x7fb5b8008040 comp rx=0 tx=0).stop 2023-10-14T19:11:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 msgr2=0x7fb5c016d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 0x7fb5c016d420 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4000fd0 tx=0x7fb5b4001e90 comp rx=0 tx=0).stop 2023-10-14T19:11:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 shutdown_connections 2023-10-14T19:11:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5ac067350 0x7fb5ac069800 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c00b3980 0x7fb5c016cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c016d960 0x7fb5c0169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 --2- 172.21.15.7:0/3071820521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0151930 0x7fb5c016d420 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 >> 172.21.15.7:0/3071820521 conn(0x7fb5c00703a0 msgr2=0x7fb5c00c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 shutdown_connections 2023-10-14T19:11:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.408+0000 7fb5c69c1700 1 -- 172.21.15.7:0/3071820521 wait complete. 2023-10-14T19:11:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 103 2023-10-14T19:11:01.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.539+0000 7f709bf48700 1 Processor -- start 2023-10-14T19:11:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.539+0000 7f709bf48700 1 -- start start 2023-10-14T19:11:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f709bf48700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f709406cdb0 0x7f70940aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f709bf48700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709415a750 con 0x7f709415d810 2023-10-14T19:11:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f709bf48700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709415e3a0 con 0x7f709415d440 2023-10-14T19:11:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f709bf48700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7094159e40 con 0x7f709406cdb0 2023-10-14T19:11:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f70994e3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f709406cdb0 0x7f70940aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f709a4e5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f709415d810 0x7f709415dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52908/0 (socket says 172.21.15.7:52908) 2023-10-14T19:11:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f70994e3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f709406cdb0 0x7f70940aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52150/0 (socket says 172.21.15.7:52150) 2023-10-14T19:11:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.540+0000 7f709a4e5700 1 -- 172.21.15.7:0/800725257 learned_addr learned my addr 172.21.15.7:0/800725257 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f70994e3700 1 -- 172.21.15.7:0/800725257 >> v1:172.21.15.148:6789/0 conn(0x7f709415d440 legacy=0x7f709406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f70994e3700 1 -- 172.21.15.7:0/800725257 >> v1:172.21.15.7:6789/0 conn(0x7f709415d810 legacy=0x7f709415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f70994e3700 1 -- 172.21.15.7:0/800725257 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70940af300 con 0x7f709406cdb0 2023-10-14T19:11:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f7098ce2700 1 -- 172.21.15.7:0/800725257 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809151186 0 0) 0x7f709415a750 con 0x7f709415d810 2023-10-14T19:11:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f70994e3700 1 --2- 172.21.15.7:0/800725257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940aec90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f70880098e0 tx=0x7f70880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33ace78a6aac17d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f7098ce2700 1 -- 172.21.15.7:0/800725257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088009e80 con 0x7f709406cdb0 2023-10-14T19:11:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f7098ce2700 1 -- 172.21.15.7:0/800725257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708800b860 con 0x7f709406cdb0 2023-10-14T19:11:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f7098ce2700 1 -- 172.21.15.7:0/800725257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800bbe0 con 0x7f709406cdb0 2023-10-14T19:11:01.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f709bf48700 1 -- 172.21.15.7:0/800725257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 msgr2=0x7f70940aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f709bf48700 1 --2- 172.21.15.7:0/800725257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940aec90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f70880098e0 tx=0x7f70880091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f709bf48700 1 -- 172.21.15.7:0/800725257 shutdown_connections 2023-10-14T19:11:01.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.541+0000 7f709bf48700 1 --2- 172.21.15.7:0/800725257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940aec90 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.542+0000 7f709bf48700 1 -- 172.21.15.7:0/800725257 >> 172.21.15.7:0/800725257 conn(0x7f709406f190 msgr2=0x7f70940ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.542+0000 7f709bf48700 1 -- 172.21.15.7:0/800725257 shutdown_connections 2023-10-14T19:11:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.542+0000 7f709bf48700 1 -- 172.21.15.7:0/800725257 wait complete. 2023-10-14T19:11:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 Processor -- start 2023-10-14T19:11:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 -- start start 2023-10-14T19:11:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f709415d440 0x7f709413b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709415d810 0x7f709415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70940b2800 con 0x7f709406cdb0 2023-10-14T19:11:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70940b25d0 con 0x7f709415d810 2023-10-14T19:11:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f709bf48700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70941518c0 con 0x7f709415d440 2023-10-14T19:11:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.543+0000 7f7099ce4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52162/0 (socket says 172.21.15.7:52162) 2023-10-14T19:11:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 -- 172.21.15.7:0/2205807543 learned_addr learned my addr 172.21.15.7:0/2205807543 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f709a4e5700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709415d810 0x7f709415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f70994e3700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f709415d440 0x7f709413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 -- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f709415d440 msgr2=0x7f709413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f709415d440 0x7f709413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 -- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709415d810 msgr2=0x7f709415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709415d810 0x7f709415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 -- 172.21.15.7:0/2205807543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088009420 con 0x7f709406cdb0 2023-10-14T19:11:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f709a4e5700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709415d810 0x7f709415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f70994e3700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f709415d440 0x7f709413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7099ce4700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940b2090 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c5c0 tx=0x7f708c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011590 con 0x7f709406cdb0 2023-10-14T19:11:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c011710 con 0x7f709406cdb0 2023-10-14T19:11:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7094150f90 con 0x7f709406cdb0 2023-10-14T19:11:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011ad0 con 0x7f709406cdb0 2023-10-14T19:11:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.544+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7094151550 con 0x7f709406cdb0 2023-10-14T19:11:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.545+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70940705f0 con 0x7f709406cdb0 2023-10-14T19:11:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.546+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f708c01b3b0 con 0x7f709406cdb0 2023-10-14T19:11:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.546+0000 7f7091ffb700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7080067320 0x7f70800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.546+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f708c084210 con 0x7f709406cdb0 2023-10-14T19:11:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.546+0000 7f70994e3700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7080067320 0x7f70800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.547+0000 7f70994e3700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7080067320 0x7f70800697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f709406d1b0 tx=0x7f7088017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.550+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f708c050ea0 con 0x7f709406cdb0 2023-10-14T19:11:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.745+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f709404c3c0 con 0x7f709406cdb0 2023-10-14T19:11:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.745+0000 7f7091ffb700 1 -- 172.21.15.7:0/2205807543 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f708c017090 con 0x7f709406cdb0 2023-10-14T19:11:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:01.747 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":153,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:45.881332+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:42.068244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:43.264160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:01.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7080067320 msgr2=0x7f70800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7080067320 0x7f70800697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f709406d1b0 tx=0x7f7088017000 comp rx=0 tx=0).stop 2023-10-14T19:11:01.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 msgr2=0x7f70940b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940b2090 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c5c0 tx=0x7f708c00c980 comp rx=0 tx=0).stop 2023-10-14T19:11:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 shutdown_connections 2023-10-14T19:11:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7080067320 0x7f70800697d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709415d810 0x7f709415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f709406cdb0 0x7f70940b2090 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 --2- 172.21.15.7:0/2205807543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f709415d440 0x7f709413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 >> 172.21.15.7:0/2205807543 conn(0x7f709406f190 msgr2=0x7f709415c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 shutdown_connections 2023-10-14T19:11:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.748+0000 7f709bf48700 1 -- 172.21.15.7:0/2205807543 wait complete. 2023-10-14T19:11:01.761 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:11:01.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:01.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.880+0000 7f1194e73700 1 Processor -- start 2023-10-14T19:11:01.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 -- start start 2023-10-14T19:11:01.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11900cb5a0 0x7f11900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900cd9e0 0x7f1190159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11900cde50 0x7f119015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900d13f0 con 0x7f11900cb5a0 2023-10-14T19:11:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119015a940 con 0x7f11900cde50 2023-10-14T19:11:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.881+0000 7f1194e73700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119015ae40 con 0x7f11900cd9e0 2023-10-14T19:11:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11900cb5a0 0x7f11900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11900cb5a0 0x7f11900cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52164/0 (socket says 172.21.15.7:52164) 2023-10-14T19:11:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 -- 172.21.15.7:0/645452288 learned_addr learned my addr 172.21.15.7:0/645452288 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:01.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118ed9d700 1 --2- 172.21.15.7:0/645452288 >> v2:172.21.15.148:3300/0 conn(0x7f11900cde50 0x7f119015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 -- 172.21.15.7:0/645452288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900cd9e0 msgr2=0x7f1190159ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:11:01.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 --2- 172.21.15.7:0/645452288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900cd9e0 0x7f1190159ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 -- 172.21.15.7:0/645452288 >> v2:172.21.15.148:3300/0 conn(0x7f11900cde50 msgr2=0x7f119015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 --2- 172.21.15.7:0/645452288 >> v2:172.21.15.148:3300/0 conn(0x7f11900cde50 0x7f119015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 -- 172.21.15.7:0/645452288 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119015ab60 con 0x7f11900cb5a0 2023-10-14T19:11:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118e59c700 1 --2- 172.21.15.7:0/645452288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f11900cb970 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f11900cbeb0 tx=0x7f1188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f077a0c439dc8d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118d59a700 1 -- 172.21.15.7:0/645452288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188009ea0 con 0x7f11900cb5a0 2023-10-14T19:11:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118d59a700 1 -- 172.21.15.7:0/645452288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800b820 con 0x7f11900cb5a0 2023-10-14T19:11:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.882+0000 7f118d59a700 1 -- 172.21.15.7:0/645452288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800bbc0 con 0x7f11900cb5a0 2023-10-14T19:11:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 -- 172.21.15.7:0/645452288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 msgr2=0x7f11900cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 --2- 172.21.15.7:0/645452288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f11900cb970 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f11900cbeb0 tx=0x7f1188009250 comp rx=0 tx=0).stop 2023-10-14T19:11:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 -- 172.21.15.7:0/645452288 shutdown_connections 2023-10-14T19:11:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 --2- 172.21.15.7:0/645452288 >> v2:172.21.15.148:3300/0 conn(0x7f11900cde50 0x7f119015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 --2- 172.21.15.7:0/645452288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f11900cb970 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 --2- 172.21.15.7:0/645452288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900cd9e0 0x7f1190159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 -- 172.21.15.7:0/645452288 >> 172.21.15.7:0/645452288 conn(0x7f1190070e30 msgr2=0x7f11900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:01.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 -- 172.21.15.7:0/645452288 shutdown_connections 2023-10-14T19:11:01.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.883+0000 7f1194e73700 1 -- 172.21.15.7:0/645452288 wait complete. 2023-10-14T19:11:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.884+0000 7f1194e73700 1 Processor -- start 2023-10-14T19:11:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.884+0000 7f1194e73700 1 -- start start 2023-10-14T19:11:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f1190151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11900cd9e0 0x7f11900b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900b53e0 0x7f1190152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b34b0 con 0x7f11900cb5a0 2023-10-14T19:11:01.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b3700 con 0x7f11900cd9e0 2023-10-14T19:11:01.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b39e0 con 0x7f11900b53e0 2023-10-14T19:11:01.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f1190151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f1190151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52178/0 (socket says 172.21.15.7:52178) 2023-10-14T19:11:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 -- 172.21.15.7:0/2604666147 learned_addr learned my addr 172.21.15.7:0/2604666147 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 -- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900b53e0 msgr2=0x7f1190152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900b53e0 0x7f1190152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 -- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11900cd9e0 msgr2=0x7f11900b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11900cd9e0 0x7f11900b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 -- 172.21.15.7:0/2604666147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11880094f0 con 0x7f11900cb5a0 2023-10-14T19:11:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f118e59c700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f1190151480 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f11880099b0 tx=0x7f1188017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800b990 con 0x7f11900cb5a0 2023-10-14T19:11:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800baf0 con 0x7f11900cb5a0 2023-10-14T19:11:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11900b3cc0 con 0x7f11900cb5a0 2023-10-14T19:11:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.885+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188025650 con 0x7f11900cb5a0 2023-10-14T19:11:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.886+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900b4280 con 0x7f11900cb5a0 2023-10-14T19:11:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.886+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119004c3c0 con 0x7f11900cb5a0 2023-10-14T19:11:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.887+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1188023070 con 0x7f11900cb5a0 2023-10-14T19:11:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.887+0000 7f11867fc700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1170067320 0x7f11700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.887+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11880861a0 con 0x7f11900cb5a0 2023-10-14T19:11:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.888+0000 7f118dd9b700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1170067320 0x7f11700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.888+0000 7f118dd9b700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1170067320 0x7f11700697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1178006fd0 tx=0x7f1178006cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:01.892+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1188052e30 con 0x7f11900cb5a0 2023-10-14T19:11:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.129+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11900ccf00 con 0x7f11900cb5a0 2023-10-14T19:11:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.129+0000 7f11867fc700 1 -- 172.21.15.7:0/2604666147 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4594 (secure 0 0 0) 0x7f1188056450 con 0x7f11900cb5a0 2023-10-14T19:11:02.131 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:02.131 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:44.293797+0000","modified":"2023-10-14T19:10:47.918922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7869":{"gid":7869,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/302383037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":302383037},{"type":"v1","addr":"172.21.15.7:6835","nonce":302383037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-14T19:11:02.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1170067320 msgr2=0x7f11700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1170067320 0x7f11700697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1178006fd0 tx=0x7f1178006cd0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 msgr2=0x7f1190151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f1190151480 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f11880099b0 tx=0x7f1188017000 comp rx=0 tx=0).stop 2023-10-14T19:11:02.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 shutdown_connections 2023-10-14T19:11:02.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1170067320 0x7f11700697d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11900b53e0 0x7f1190152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11900cb5a0 0x7f1190151480 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 --2- 172.21.15.7:0/2604666147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11900cd9e0 0x7f11900b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 >> 172.21.15.7:0/2604666147 conn(0x7f1190070e30 msgr2=0x7f11900b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.131+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 shutdown_connections 2023-10-14T19:11:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.132+0000 7f1194e73700 1 -- 172.21.15.7:0/2604666147 wait complete. 2023-10-14T19:11:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 103 2023-10-14T19:11:02.144 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 Processor -- start 2023-10-14T19:11:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 -- start start 2023-10-14T19:11:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a00a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc9a00aee90 0x7fc9a00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00ce1a0 con 0x7fc9a006d280 2023-10-14T19:11:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00cd5d0 con 0x7fc9a00aee90 2023-10-14T19:11:02.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.263+0000 7fc9a6afc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00cd870 con 0x7fc9a00a8be0 2023-10-14T19:11:02.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc9a5099700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc9a00aee90 0x7fc9a00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc99ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc9a006d280 0x7fc9a00ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52916/0 (socket says 172.21.15.7:52916) 2023-10-14T19:11:02.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc99ffff700 1 -- 172.21.15.7:0/2045590103 learned_addr learned my addr 172.21.15.7:0/2045590103 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:02.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc9a5099700 1 -- 172.21.15.7:0/2045590103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 msgr2=0x7fc9a00a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:02.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc9a5099700 1 --2- 172.21.15.7:0/2045590103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a00a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc9a5099700 1 -- 172.21.15.7:0/2045590103 >> v1:172.21.15.7:6789/0 conn(0x7fc9a006d280 legacy=0x7fc9a00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc9a5099700 1 -- 172.21.15.7:0/2045590103 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00cdb50 con 0x7fc9a00aee90 2023-10-14T19:11:02.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc99f7fe700 1 -- 172.21.15.7:0/2045590103 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241174148 0 0) 0x7fc9a00ce1a0 con 0x7fc9a006d280 2023-10-14T19:11:02.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc9a5099700 1 --2- 172.21.15.7:0/2045590103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a00aee90 0x7fc9a00b08c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e60 tx=0x7fc998009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d412cb28ee5b14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc99f7fe700 1 -- 172.21.15.7:0/2045590103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800e070 con 0x7fc9a00aee90 2023-10-14T19:11:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc99f7fe700 1 -- 172.21.15.7:0/2045590103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99800bcc0 con 0x7fc9a00aee90 2023-10-14T19:11:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.264+0000 7fc99f7fe700 1 -- 172.21.15.7:0/2045590103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998012680 con 0x7fc9a00aee90 2023-10-14T19:11:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2045590103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a00aee90 msgr2=0x7fc9a00b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2045590103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a00aee90 0x7fc9a00b08c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e60 tx=0x7fc998009780 comp rx=0 tx=0).stop 2023-10-14T19:11:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2045590103 shutdown_connections 2023-10-14T19:11:02.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2045590103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a00aee90 0x7fc9a00b08c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2045590103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a00a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2045590103 >> 172.21.15.7:0/2045590103 conn(0x7fc9a006ce80 msgr2=0x7fc9a00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:02.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2045590103 shutdown_connections 2023-10-14T19:11:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.265+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2045590103 wait complete. 2023-10-14T19:11:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.266+0000 7fc9a6afc700 1 Processor -- start 2023-10-14T19:11:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.266+0000 7fc9a6afc700 1 -- start start 2023-10-14T19:11:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a6afc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 0x7fc9a015aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a6afc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a009a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a6afc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9a00aee90 0x7fc9a00aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a6afc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a009a360 con 0x7fc9a006d280 2023-10-14T19:11:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a6afc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a015afc0 con 0x7fc9a00aee90 2023-10-14T19:11:02.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a6afc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0099750 con 0x7fc9a00a8be0 2023-10-14T19:11:02.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 0x7fc9a015aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 0x7fc9a015aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52210/0 (socket says 172.21.15.7:52210) 2023-10-14T19:11:02.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 -- 172.21.15.7:0/2744079729 learned_addr learned my addr 172.21.15.7:0/2744079729 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:02.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a5099700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9a00aee90 0x7fc9a00aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc99ffff700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a009a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 -- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 msgr2=0x7fc9a009a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a009a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 -- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9a00aee90 msgr2=0x7fc9a00aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9a00aee90 0x7fc9a00aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 -- 172.21.15.7:0/2744079729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009a20 con 0x7fc9a006d280 2023-10-14T19:11:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a5099700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9a00aee90 0x7fc9a00aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.267+0000 7fc9a4898700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 0x7fc9a015aa80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc98800b810 tx=0x7fc988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.268+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800f5f0 con 0x7fc9a006d280 2023-10-14T19:11:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.268+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800f770 con 0x7fc9a006d280 2023-10-14T19:11:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.268+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a0099a30 con 0x7fc9a006d280 2023-10-14T19:11:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.268+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800fb30 con 0x7fc9a006d280 2023-10-14T19:11:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.268+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a0099ff0 con 0x7fc9a006d280 2023-10-14T19:11:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.269+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a009a640 con 0x7fc9a006d280 2023-10-14T19:11:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.269+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc988010480 con 0x7fc9a006d280 2023-10-14T19:11:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.270+0000 7fc99cff9700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc980067320 0x7fc9800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.270+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc988084c20 con 0x7fc9a006d280 2023-10-14T19:11:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.270+0000 7fc99ffff700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc980067320 0x7fc9800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.270+0000 7fc99ffff700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc980067320 0x7fc9800697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00a9fc0 tx=0x7fc990009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.274+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc988051930 con 0x7fc9a006d280 2023-10-14T19:11:02.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.510+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a004c3c0 con 0x7fc9a006d280 2023-10-14T19:11:02.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.511+0000 7fc99cff9700 1 -- 172.21.15.7:0/2744079729 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4594 (secure 0 0 0) 0x7fc988054f50 con 0x7fc9a006d280 2023-10-14T19:11:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:02.512 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:10:44.293797+0000","modified":"2023-10-14T19:10:47.918922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7869":{"gid":7869,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/302383037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":302383037},{"type":"v1","addr":"172.21.15.7:6835","nonce":302383037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-14T19:11:02.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.512+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc980067320 msgr2=0x7fc9800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.512+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc980067320 0x7fc9800697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00a9fc0 tx=0x7fc990009040 comp rx=0 tx=0).stop 2023-10-14T19:11:02.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 msgr2=0x7fc9a015aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 0x7fc9a015aa80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc98800b810 tx=0x7fc988009250 comp rx=0 tx=0).stop 2023-10-14T19:11:02.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 shutdown_connections 2023-10-14T19:11:02.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc980067320 0x7fc9800697d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9a00aee90 0x7fc9a00aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a006d280 0x7fc9a015aa80 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 --2- 172.21.15.7:0/2744079729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9a00a8be0 0x7fc9a009a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 >> 172.21.15.7:0/2744079729 conn(0x7fc9a006ce80 msgr2=0x7fc9a0068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:02.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 shutdown_connections 2023-10-14T19:11:02.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.513+0000 7fc9a6afc700 1 -- 172.21.15.7:0/2744079729 wait complete. 2023-10-14T19:11:02.516 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 103 2023-10-14T19:11:02.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.644+0000 7f2f8f14f700 1 Processor -- start 2023-10-14T19:11:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.644+0000 7f2f8f14f700 1 -- start start 2023-10-14T19:11:02.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8f14f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f880a8be0 0x7f2f880a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8f14f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880aee90 0x7f2f880b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8f14f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880ce1a0 con 0x7f2f8806d280 2023-10-14T19:11:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8f14f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880cd5d0 con 0x7f2f880a8be0 2023-10-14T19:11:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8f14f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880cd870 con 0x7f2f880aee90 2023-10-14T19:11:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8ceeb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f880a8be0 0x7f2f880a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8ceeb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f880a8be0 0x7f2f880a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52222/0 (socket says 172.21.15.7:52222) 2023-10-14T19:11:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.645+0000 7f2f8ceeb700 1 -- 172.21.15.7:0/4177461655 learned_addr learned my addr 172.21.15.7:0/4177461655 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f8d6ec700 1 --2- 172.21.15.7:0/4177461655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880aee90 0x7f2f880b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f8ceeb700 1 -- 172.21.15.7:0/4177461655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880aee90 msgr2=0x7f2f880b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f8ceeb700 1 --2- 172.21.15.7:0/4177461655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880aee90 0x7f2f880b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f8ceeb700 1 -- 172.21.15.7:0/4177461655 >> v1:172.21.15.148:6789/0 conn(0x7f2f8806d280 legacy=0x7f2f880ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f8ceeb700 1 -- 172.21.15.7:0/4177461655 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880cdb50 con 0x7f2f880a8be0 2023-10-14T19:11:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f8ceeb700 1 --2- 172.21.15.7:0/4177461655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880a8be0 0x7f2f880a8fb0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009f70 tx=0x7f2f80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ea03a27d82f9c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f877fe700 1 -- 172.21.15.7:0/4177461655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000e070 con 0x7f2f880a8be0 2023-10-14T19:11:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f877fe700 1 -- 172.21.15.7:0/4177461655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000bb60 con 0x7f2f880a8be0 2023-10-14T19:11:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.646+0000 7f2f877fe700 1 -- 172.21.15.7:0/4177461655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800092e0 con 0x7f2f880a8be0 2023-10-14T19:11:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 -- 172.21.15.7:0/4177461655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880a8be0 msgr2=0x7f2f880a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/4177461655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880a8be0 0x7f2f880a8fb0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009f70 tx=0x7f2f80009840 comp rx=0 tx=0).stop 2023-10-14T19:11:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 -- 172.21.15.7:0/4177461655 shutdown_connections 2023-10-14T19:11:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/4177461655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880aee90 0x7f2f880b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/4177461655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880a8be0 0x7f2f880a8fb0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 -- 172.21.15.7:0/4177461655 >> 172.21.15.7:0/4177461655 conn(0x7f2f8806ce80 msgr2=0x7f2f880ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 -- 172.21.15.7:0/4177461655 shutdown_connections 2023-10-14T19:11:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.647+0000 7f2f8f14f700 1 -- 172.21.15.7:0/4177461655 wait complete. 2023-10-14T19:11:02.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.648+0000 7f2f8f14f700 1 Processor -- start 2023-10-14T19:11:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.648+0000 7f2f8f14f700 1 -- start start 2023-10-14T19:11:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8f14f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8806d280 0x7f2f8806d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8f14f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880a8be0 0x7f2f8814b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8f14f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 0x7f2f880a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8f14f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8806e120 con 0x7f2f880aee90 2023-10-14T19:11:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8f14f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8806dec0 con 0x7f2f8806d280 2023-10-14T19:11:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8f14f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8806ee40 con 0x7f2f880a8be0 2023-10-14T19:11:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 0x7f2f880a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 0x7f2f880a9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52228/0 (socket says 172.21.15.7:52228) 2023-10-14T19:11:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 -- 172.21.15.7:0/3782256552 learned_addr learned my addr 172.21.15.7:0/3782256552 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8ceeb700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8806d280 0x7f2f8806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f87fff700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880a8be0 0x7f2f8814b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 -- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880a8be0 msgr2=0x7f2f8814b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880a8be0 0x7f2f8814b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 -- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8806d280 msgr2=0x7f2f8806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8806d280 0x7f2f8806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 -- 172.21.15.7:0/3782256552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80009ae0 con 0x7f2f880aee90 2023-10-14T19:11:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8ceeb700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8806d280 0x7f2f8806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f8d6ec700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 0x7f2f880a9960 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800d860 tx=0x7f2f78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780125f0 con 0x7f2f880aee90 2023-10-14T19:11:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.649+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78012770 con 0x7f2f880aee90 2023-10-14T19:11:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.650+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8806f120 con 0x7f2f880aee90 2023-10-14T19:11:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.650+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78012b30 con 0x7f2f880aee90 2023-10-14T19:11:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.650+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8806f6e0 con 0x7f2f880aee90 2023-10-14T19:11:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.651+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8804c3c0 con 0x7f2f880aee90 2023-10-14T19:11:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.651+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f7801e460 con 0x7f2f880aee90 2023-10-14T19:11:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.651+0000 7f2f84ff9700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f74067320 0x7f2f740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.651+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f780852e0 con 0x7f2f880aee90 2023-10-14T19:11:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.652+0000 7f2f8ceeb700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f74067320 0x7f2f740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.652+0000 7f2f8ceeb700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f74067320 0x7f2f740697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009880 tx=0x7f2f80018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:02.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.656+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f78055a00 con 0x7f2f880aee90 2023-10-14T19:11:02.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.849+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f880cb7a0 con 0x7f2f880aee90 2023-10-14T19:11:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.850+0000 7f2f84ff9700 1 -- 172.21.15.7:0/3782256552 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f2f78055590 con 0x7f2f880aee90 2023-10-14T19:11:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:02.979 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":153,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:10:45.881332+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:10:42.068244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-14T19:10:43.264160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:02.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.852+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f74067320 msgr2=0x7f2f740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.852+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f74067320 0x7f2f740697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009880 tx=0x7f2f80018000 comp rx=0 tx=0).stop 2023-10-14T19:11:02.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.852+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 msgr2=0x7f2f880a9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:02.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.852+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 0x7f2f880a9960 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800d860 tx=0x7f2f78008040 comp rx=0 tx=0).stop 2023-10-14T19:11:02.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 shutdown_connections 2023-10-14T19:11:02.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2f74067320 0x7f2f740697d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8806d280 0x7f2f8806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f880aee90 0x7f2f880a9960 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 --2- 172.21.15.7:0/3782256552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f880a8be0 0x7f2f8814b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 >> 172.21.15.7:0/3782256552 conn(0x7f2f8806ce80 msgr2=0x7f2f88159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 shutdown_connections 2023-10-14T19:11:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:02.853+0000 7f2f8f14f700 1 -- 172.21.15.7:0/3782256552 wait complete. 2023-10-14T19:11:02.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:11:03.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.104+0000 7f274a8a1700 1 Processor -- start 2023-10-14T19:11:03.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.104+0000 7f274a8a1700 1 -- start start 2023-10-14T19:11:03.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f274a8a1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27440a8be0 0x7f27440a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f274a8a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 0x7f27440b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f274a8a1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440ce1a0 con 0x7f27440ae780 2023-10-14T19:11:03.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f274a8a1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440cd5d0 con 0x7f27440a8be0 2023-10-14T19:11:03.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f274a8a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27440cd870 con 0x7f274406d280 2023-10-14T19:11:03.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f2748e3e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f27440ae780 0x7f27440cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52932/0 (socket says 172.21.15.7:52932) 2023-10-14T19:11:03.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.105+0000 7f2748e3e700 1 -- 172.21.15.7:0/1606297444 learned_addr learned my addr 172.21.15.7:0/1606297444 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:03.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077846380 0 0) 0x7f27440ce1a0 con 0x7f27440ae780 2023-10-14T19:11:03.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f272c003570 con 0x7f27440ae780 2023-10-14T19:11:03.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f27437fe700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 0x7f27440b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 --2- 172.21.15.7:0/1606297444 >> v2:172.21.15.148:3300/0 conn(0x7f27440a8be0 0x7f27440a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867506612 0 0) 0x7f272c003570 con 0x7f27440ae780 2023-10-14T19:11:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 msgr2=0x7f27440b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 0x7f27440b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 >> v2:172.21.15.148:3300/0 conn(0x7f27440a8be0 msgr2=0x7f27440a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 --2- 172.21.15.7:0/1606297444 >> v2:172.21.15.148:3300/0 conn(0x7f27440a8be0 0x7f27440a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440cdb50 con 0x7f27440ae780 2023-10-14T19:11:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f273c0017f0 con 0x7f27440ae780 2023-10-14T19:11:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 >> v1:172.21.15.7:6789/0 conn(0x7f27440ae780 legacy=0x7f27440cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c003ae0 0x7f272c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 0x7f272c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c004d50 0x7f272c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440cd5d0 con 0x7f272c003ae0 2023-10-14T19:11:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440cd870 con 0x7f272c004d50 2023-10-14T19:11:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c00bb40 con 0x7f274406d280 2023-10-14T19:11:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c003ae0 0x7f272c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2748e3e700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c004d50 0x7f272c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f27437fe700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 0x7f272c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 -- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 msgr2=0x7f272c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f274406d280 0x7f272c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 -- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c004d50 msgr2=0x7f272c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c004d50 0x7f272c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.106+0000 7f2743fff700 1 -- 172.21.15.7:0/1606297444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c003570 con 0x7f272c003ae0 2023-10-14T19:11:03.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f2743fff700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c003ae0 0x7f272c003ef0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2734009bf0 tx=0x7f2734009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2496ca53bd1fdf77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:03.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734005a00 con 0x7f272c003ae0 2023-10-14T19:11:03.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734005b60 con 0x7f272c003ae0 2023-10-14T19:11:03.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f2742ffd700 1 -- 172.21.15.7:0/1606297444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400e6b0 con 0x7f272c003ae0 2023-10-14T19:11:03.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f274a8a1700 1 -- 172.21.15.7:0/1606297444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c003ae0 msgr2=0x7f272c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f274a8a1700 1 --2- 172.21.15.7:0/1606297444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c003ae0 0x7f272c003ef0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2734009bf0 tx=0x7f2734009120 comp rx=0 tx=0).stop 2023-10-14T19:11:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f2748e3e700 1 -- 172.21.15.7:0/1606297444 reap_dead start 2023-10-14T19:11:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f274a8a1700 1 -- 172.21.15.7:0/1606297444 shutdown_connections 2023-10-14T19:11:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f274a8a1700 1 -- 172.21.15.7:0/1606297444 >> 172.21.15.7:0/1606297444 conn(0x7f274406ce80 msgr2=0x7f27440ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f274a8a1700 1 -- 172.21.15.7:0/1606297444 shutdown_connections 2023-10-14T19:11:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.107+0000 7f274a8a1700 1 -- 172.21.15.7:0/1606297444 wait complete. 2023-10-14T19:11:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.108+0000 7f274a8a1700 1 Processor -- start 2023-10-14T19:11:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 -- start start 2023-10-14T19:11:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c003ae0 0x7f274415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440acaa0 0x7f27440aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 0x7f274416af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274416b440 con 0x7f274416aa90 2023-10-14T19:11:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440aa030 con 0x7f272c003ae0 2023-10-14T19:11:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f274a8a1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27440a9140 con 0x7f27440acaa0 2023-10-14T19:11:03.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f2748e3e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 0x7f274416af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f2748e3e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 0x7f274416af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52232/0 (socket says 172.21.15.7:52232) 2023-10-14T19:11:03.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f2748e3e700 1 -- 172.21.15.7:0/436943559 learned_addr learned my addr 172.21.15.7:0/436943559 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:03.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f27437fe700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440acaa0 0x7f27440aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.109+0000 7f2743fff700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c003ae0 0x7f274415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f2748e3e700 1 -- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440acaa0 msgr2=0x7f27440aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f2748e3e700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440acaa0 0x7f27440aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f2748e3e700 1 -- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c003ae0 msgr2=0x7f274415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f2748e3e700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c003ae0 0x7f274415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f2748e3e700 1 -- 172.21.15.7:0/436943559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440a9420 con 0x7f274416aa90 2023-10-14T19:11:03.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f27437fe700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440acaa0 0x7f27440aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:03.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f2748e3e700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 0x7f274416af00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f273c0013d0 tx=0x7f273c0018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:03.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00ebc0 con 0x7f274416aa90 2023-10-14T19:11:03.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c00ed40 con 0x7f274416aa90 2023-10-14T19:11:03.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440a9700 con 0x7f274416aa90 2023-10-14T19:11:03.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c013670 con 0x7f274416aa90 2023-10-14T19:11:03.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.110+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27440a9cc0 con 0x7f274416aa90 2023-10-14T19:11:03.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.111+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27440aa1a0 con 0x7f274416aa90 2023-10-14T19:11:03.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.111+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f273c013a20 con 0x7f274416aa90 2023-10-14T19:11:03.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.112+0000 7f272bfff700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2730067320 0x7f27300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.112+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f273c0851d0 con 0x7f274416aa90 2023-10-14T19:11:03.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.112+0000 7f2743fff700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2730067320 0x7f27300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.113+0000 7f2743fff700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2730067320 0x7f27300697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2734009160 tx=0x7f2734019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:03.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.116+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f273c051e60 con 0x7f274416aa90 2023-10-14T19:11:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.355+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f27440aa330 con 0x7f274416aa90 2023-10-14T19:11:03.356 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:11:03.355+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:11:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.359+0000 7f272bfff700 1 -- 172.21.15.7:0/436943559 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v104) v1 ==== 161+0+0 (secure 0 0 0) 0x7f273c055480 con 0x7f274416aa90 2023-10-14T19:11:03.360 INFO:tasks.ceph.mds.a.smithi007.stderr: -717> 2023-10-14T19:10:50.226+0000 7fb0490ea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:11:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2730067320 msgr2=0x7f27300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2730067320 0x7f27300697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2734009160 tx=0x7f2734019000 comp rx=0 tx=0).stop 2023-10-14T19:11:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 msgr2=0x7f274416af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 0x7f274416af00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f273c0013d0 tx=0x7f273c0018b0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 shutdown_connections 2023-10-14T19:11:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2730067320 0x7f27300697d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f272c003ae0 0x7f274415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f274416aa90 0x7f274416af00 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 --2- 172.21.15.7:0/436943559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27440acaa0 0x7f27440aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 >> 172.21.15.7:0/436943559 conn(0x7f274406ce80 msgr2=0x7f27440b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 shutdown_connections 2023-10-14T19:11:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.361+0000 7f274a8a1700 1 -- 172.21.15.7:0/436943559 wait complete. 2023-10-14T19:11:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:11:03.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:11:03.381 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:11:03.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.496+0000 7f034191f700 1 Processor -- start 2023-10-14T19:11:03.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.496+0000 7f034191f700 1 -- start start 2023-10-14T19:11:03.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f034191f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f033c159b10 0x7f033c0af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f034191f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f034191f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c06d070 con 0x7f033c159ee0 2023-10-14T19:11:03.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f034191f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0c9270 con 0x7f033c159b10 2023-10-14T19:11:03.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f034191f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c06c740 con 0x7f033c0afe60 2023-10-14T19:11:03.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f033affd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f033c159b10 0x7f033c0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f033b7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f033c159ee0 0x7f033c06d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52948/0 (socket says 172.21.15.7:52948) 2023-10-14T19:11:03.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f033b7fe700 1 -- 172.21.15.7:0/3249489810 learned_addr learned my addr 172.21.15.7:0/3249489810 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:03.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f033a7fc700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.497+0000 7f033affd700 1 -- 172.21.15.7:0/3249489810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 msgr2=0x7f033c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:03.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f033affd700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f033affd700 1 -- 172.21.15.7:0/3249489810 >> v1:172.21.15.7:6789/0 conn(0x7f033c159ee0 legacy=0x7f033c06d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f0339ffb700 1 -- 172.21.15.7:0/3249489810 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711412470 0 0) 0x7f033c06d070 con 0x7f033c159ee0 2023-10-14T19:11:03.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f033affd700 1 -- 172.21.15.7:0/3249489810 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c06ca20 con 0x7f033c159b10 2023-10-14T19:11:03.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f033a7fc700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f033affd700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c0af920 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f032c009ee0 tx=0x7f032c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ec4cf263b0b7d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f0339ffb700 1 -- 172.21.15.7:0/3249489810 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00e070 con 0x7f033c159b10 2023-10-14T19:11:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f0339ffb700 1 -- 172.21.15.7:0/3249489810 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00bc10 con 0x7f033c159b10 2023-10-14T19:11:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f0339ffb700 1 -- 172.21.15.7:0/3249489810 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c012430 con 0x7f033c159b10 2023-10-14T19:11:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f034191f700 1 -- 172.21.15.7:0/3249489810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 msgr2=0x7f033c0af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f034191f700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c0af920 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f032c009ee0 tx=0x7f032c009780 comp rx=0 tx=0).stop 2023-10-14T19:11:03.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f034191f700 1 -- 172.21.15.7:0/3249489810 shutdown_connections 2023-10-14T19:11:03.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f034191f700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c0af920 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f034191f700 1 --2- 172.21.15.7:0/3249489810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.498+0000 7f034191f700 1 -- 172.21.15.7:0/3249489810 >> 172.21.15.7:0/3249489810 conn(0x7f033c0ccb60 msgr2=0x7f033c0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:03.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.499+0000 7f034191f700 1 -- 172.21.15.7:0/3249489810 shutdown_connections 2023-10-14T19:11:03.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.499+0000 7f034191f700 1 -- 172.21.15.7:0/3249489810 wait complete. 2023-10-14T19:11:03.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.500+0000 7f034191f700 1 Processor -- start 2023-10-14T19:11:03.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.500+0000 7f034191f700 1 -- start start 2023-10-14T19:11:03.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c13a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f033c159ee0 0x7f033c157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c148c80 con 0x7f033c159b10 2023-10-14T19:11:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c158160 con 0x7f033c159ee0 2023-10-14T19:11:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c148950 con 0x7f033c0afe60 2023-10-14T19:11:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c14a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52258/0 (socket says 172.21.15.7:52258) 2023-10-14T19:11:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 -- 172.21.15.7:0/1642486017 learned_addr learned my addr 172.21.15.7:0/1642486017 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033affd700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c13a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033b7fe700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f033c159ee0 0x7f033c157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 -- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 msgr2=0x7f033c13a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c13a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 -- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f033c159ee0 msgr2=0x7f033c157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f033c159ee0 0x7f033c157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 -- 172.21.15.7:0/1642486017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c009a20 con 0x7f033c159b10 2023-10-14T19:11:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033b7fe700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f033c159ee0 0x7f033c157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f033a7fc700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c14a150 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f032400c850 tx=0x7f0324008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:03.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324011600 con 0x7f033c159b10 2023-10-14T19:11:03.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324011760 con 0x7f033c159b10 2023-10-14T19:11:03.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c157ba0 con 0x7f033c159b10 2023-10-14T19:11:03.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324011b00 con 0x7f033c159b10 2023-10-14T19:11:03.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.501+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c13ab10 con 0x7f033c159b10 2023-10-14T19:11:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.502+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c148df0 con 0x7f033c159b10 2023-10-14T19:11:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.503+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f03240073b0 con 0x7f033c159b10 2023-10-14T19:11:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.503+0000 7f0332ffd700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f031c067320 0x7f031c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.503+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0324084db0 con 0x7f033c159b10 2023-10-14T19:11:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.503+0000 7f033affd700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f031c067320 0x7f031c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:03.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.504+0000 7f033affd700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f031c067320 0x7f031c0697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f032c0097c0 tx=0x7f032c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:03.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.507+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0324089070 con 0x7f033c159b10 2023-10-14T19:11:03.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:03.747+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f033c04c3c0 con 0x7f033c159b10 2023-10-14T19:11:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.362+0000 7f0332ffd700 1 -- 172.21.15.7:0/1642486017 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v105) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03240518e0 con 0x7f033c159b10 2023-10-14T19:11:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f031c067320 msgr2=0x7f031c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f031c067320 0x7f031c0697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f032c0097c0 tx=0x7f032c019000 comp rx=0 tx=0).stop 2023-10-14T19:11:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 msgr2=0x7f033c14a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c14a150 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f032400c850 tx=0x7f0324008040 comp rx=0 tx=0).stop 2023-10-14T19:11:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 shutdown_connections 2023-10-14T19:11:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f031c067320 0x7f031c0697d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f033c159ee0 0x7f033c157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f033c0afe60 0x7f033c13a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 --2- 172.21.15.7:0/1642486017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033c159b10 0x7f033c14a150 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 >> 172.21.15.7:0/1642486017 conn(0x7f033c0ccb60 msgr2=0x7f033c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 shutdown_connections 2023-10-14T19:11:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.365+0000 7f034191f700 1 -- 172.21.15.7:0/1642486017 wait complete. 2023-10-14T19:11:04.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:11:04.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.551+0000 7fbb728b2700 1 Processor -- start 2023-10-14T19:11:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.551+0000 7fbb728b2700 1 -- start start 2023-10-14T19:11:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.552+0000 7fbb728b2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb6c06eaa0 0x7fbb6c0ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.552+0000 7fbb728b2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6c0af090 con 0x7fbb6c0ae6f0 2023-10-14T19:11:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.552+0000 7fbb728b2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6c0c7100 con 0x7fbb6c1575a0 2023-10-14T19:11:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.552+0000 7fbb728b2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6c06a950 con 0x7fbb6c06eaa0 2023-10-14T19:11:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.552+0000 7fbb70e4f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbb6c0ae6f0 0x7fbb6c0c7590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52958/0 (socket says 172.21.15.7:52958) 2023-10-14T19:11:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.552+0000 7fbb70e4f700 1 -- 172.21.15.7:0/527235916 learned_addr learned my addr 172.21.15.7:0/527235916 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400207776 0 0) 0x7fbb6c0af090 con 0x7fbb6c0ae6f0 2023-10-14T19:11:04.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb58003570 con 0x7fbb6c0ae6f0 2023-10-14T19:11:04.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6b7fe700 1 --2- 172.21.15.7:0/527235916 >> v2:172.21.15.148:3300/0 conn(0x7fbb6c06eaa0 0x7fbb6c0ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55743554 0 0) 0x7fbb58003570 con 0x7fbb6c0ae6f0 2023-10-14T19:11:04.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 >> v2:172.21.15.148:3300/0 conn(0x7fbb6c06eaa0 msgr2=0x7fbb6c0ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 --2- 172.21.15.7:0/527235916 >> v2:172.21.15.148:3300/0 conn(0x7fbb6c06eaa0 0x7fbb6c0ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 >> v1:172.21.15.148:6789/0 conn(0x7fbb6c1575a0 legacy=0x7fbb6c069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c0aeb30 con 0x7fbb6c0ae6f0 2023-10-14T19:11:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fbb640017f0 con 0x7fbb6c0ae6f0 2023-10-14T19:11:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 >> v1:172.21.15.7:6789/0 conn(0x7fbb6c0ae6f0 legacy=0x7fbb6c0c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb58003a60 0x7fbb58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb58004810 0x7fbb58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c06a950 con 0x7fbb580053c0 2023-10-14T19:11:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5800c2d0 con 0x7fbb58003a60 2023-10-14T19:11:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5800c490 con 0x7fbb58004810 2023-10-14T19:11:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6bfff700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb58003a60 0x7fbb58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb6b7fe700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb58004810 0x7fbb58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 -- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb58004810 msgr2=0x7fbb58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:04.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb58004810 0x7fbb58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 -- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb58003a60 msgr2=0x7fbb58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:04.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb58003a60 0x7fbb58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 -- 172.21.15.7:0/527235916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58003570 con 0x7fbb580053c0 2023-10-14T19:11:04.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.553+0000 7fbb70e4f700 1 -- 172.21.15.7:0/527235916 reap_dead start 2023-10-14T19:11:04.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb70e4f700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb5800ba60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400a900 tx=0x7fbb6c0cd3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3dd351cb0614f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:04.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640070d0 con 0x7fbb580053c0 2023-10-14T19:11:04.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb64007270 con 0x7fbb580053c0 2023-10-14T19:11:04.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb6affd700 1 -- 172.21.15.7:0/527235916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64007630 con 0x7fbb580053c0 2023-10-14T19:11:04.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 -- 172.21.15.7:0/527235916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 msgr2=0x7fbb5800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb5800ba60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400a900 tx=0x7fbb6c0cd3a0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 -- 172.21.15.7:0/527235916 shutdown_connections 2023-10-14T19:11:04.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 --2- 172.21.15.7:0/527235916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb5800ba60 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 -- 172.21.15.7:0/527235916 >> 172.21.15.7:0/527235916 conn(0x7fbb6c06d170 msgr2=0x7fbb6c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:04.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 -- 172.21.15.7:0/527235916 shutdown_connections 2023-10-14T19:11:04.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.554+0000 7fbb728b2700 1 -- 172.21.15.7:0/527235916 wait complete. 2023-10-14T19:11:04.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.555+0000 7fbb728b2700 1 Processor -- start 2023-10-14T19:11:04.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 -- start start 2023-10-14T19:11:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb6c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6c0c59c0 0x7fbb6c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c0c5e30 0x7fbb6c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0b0040 con 0x7fbb580053c0 2023-10-14T19:11:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0af430 con 0x7fbb6c0c5e30 2023-10-14T19:11:04.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb728b2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0af710 con 0x7fbb6c0c59c0 2023-10-14T19:11:04.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb6bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb6c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb6bfff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb6c152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52278/0 (socket says 172.21.15.7:52278) 2023-10-14T19:11:04.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.556+0000 7fbb6bfff700 1 -- 172.21.15.7:0/1392302863 learned_addr learned my addr 172.21.15.7:0/1392302863 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:04.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6bfff700 1 -- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6c0c59c0 msgr2=0x7fbb6c0b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6b7fe700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6c0c59c0 0x7fbb6c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb70e4f700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c0c5e30 0x7fbb6c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6bfff700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6c0c59c0 0x7fbb6c0b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6bfff700 1 -- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c0c5e30 msgr2=0x7fbb6c0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:04.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6bfff700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c0c5e30 0x7fbb6c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6bfff700 1 -- 172.21.15.7:0/1392302863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c0af9f0 con 0x7fbb580053c0 2023-10-14T19:11:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb6bfff700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb6c152090 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c002950 tx=0x7fbb5c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c002e90 con 0x7fbb580053c0 2023-10-14T19:11:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c00f8d0 con 0x7fbb580053c0 2023-10-14T19:11:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c0afcd0 con 0x7fbb580053c0 2023-10-14T19:11:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c00fc70 con 0x7fbb580053c0 2023-10-14T19:11:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.557+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c0af090 con 0x7fbb580053c0 2023-10-14T19:11:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.558+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c0b0320 con 0x7fbb580053c0 2023-10-14T19:11:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.558+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbb5c0133f0 con 0x7fbb580053c0 2023-10-14T19:11:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.559+0000 7fbb63fff700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb4c067320 0x7fbb4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.559+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbb5c084aa0 con 0x7fbb580053c0 2023-10-14T19:11:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.559+0000 7fbb6b7fe700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb4c067320 0x7fbb4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.560+0000 7fbb6b7fe700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb4c067320 0x7fbb4c0697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400b2d0 tx=0x7fbb5400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.563+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb5c0516e0 con 0x7fbb580053c0 2023-10-14T19:11:04.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:04.761+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb6c04c3c0 con 0x7fbb580053c0 2023-10-14T19:11:05.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.364+0000 7fbb63fff700 1 -- 172.21.15.7:0/1392302863 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v155) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb5c054d00 con 0x7fbb580053c0 2023-10-14T19:11:05.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb4c067320 msgr2=0x7fbb4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:05.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb4c067320 0x7fbb4c0697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400b2d0 tx=0x7fbb5400b040 comp rx=0 tx=0).stop 2023-10-14T19:11:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 msgr2=0x7fbb6c152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb6c152090 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c002950 tx=0x7fbb5c007d30 comp rx=0 tx=0).stop 2023-10-14T19:11:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 shutdown_connections 2023-10-14T19:11:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb4c067320 0x7fbb4c0697d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c0c5e30 0x7fbb6c0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb580053c0 0x7fbb6c152090 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 --2- 172.21.15.7:0/1392302863 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6c0c59c0 0x7fbb6c0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 >> 172.21.15.7:0/1392302863 conn(0x7fbb6c06d170 msgr2=0x7fbb6c06e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 shutdown_connections 2023-10-14T19:11:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.366+0000 7fbb728b2700 1 -- 172.21.15.7:0/1392302863 wait complete. 2023-10-14T19:11:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:11:05.382 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:11:05.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.509+0000 7ff0a0885700 1 Processor -- start 2023-10-14T19:11:05.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.509+0000 7ff0a0885700 1 -- start start 2023-10-14T19:11:05.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.509+0000 7ff0a0885700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff09c1598d0 0x7ff09c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:05.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff0a0885700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff09c159ca0 0x7ff09c0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:05.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff0a0885700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0cc4d0 con 0x7ff09c068710 2023-10-14T19:11:05.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff0a0885700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0cb8c0 con 0x7ff09c1598d0 2023-10-14T19:11:05.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff0a0885700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0cbba0 con 0x7ff09c159ca0 2023-10-14T19:11:05.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff09c1598d0 0x7ff09c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:05.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff09c1598d0 0x7ff09c0cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52294/0 (socket says 172.21.15.7:52294) 2023-10-14T19:11:05.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 -- 172.21.15.7:0/1138741023 learned_addr learned my addr 172.21.15.7:0/1138741023 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:05.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff099d9b700 1 --2- 172.21.15.7:0/1138741023 >> v2:172.21.15.148:3300/0 conn(0x7ff09c159ca0 0x7ff09c0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:05.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 -- 172.21.15.7:0/1138741023 >> v2:172.21.15.148:3300/0 conn(0x7ff09c159ca0 msgr2=0x7ff09c0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:05.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 --2- 172.21.15.7:0/1138741023 >> v2:172.21.15.148:3300/0 conn(0x7ff09c159ca0 0x7ff09c0cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 -- 172.21.15.7:0/1138741023 >> v1:172.21.15.148:6789/0 conn(0x7ff09c068710 legacy=0x7ff09c0c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:05.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 -- 172.21.15.7:0/1138741023 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0cbe80 con 0x7ff09c1598d0 2023-10-14T19:11:05.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff099d9b700 1 --2- 172.21.15.7:0/1138741023 >> v2:172.21.15.148:3300/0 conn(0x7ff09c159ca0 0x7ff09c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:05.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09a59c700 1 --2- 172.21.15.7:0/1138741023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0cafc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff09c06aba0 tx=0x7ff08c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7893246c265a6fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:05.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09959a700 1 -- 172.21.15.7:0/1138741023 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00e070 con 0x7ff09c1598d0 2023-10-14T19:11:05.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09959a700 1 -- 172.21.15.7:0/1138741023 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00ba50 con 0x7ff09c1598d0 2023-10-14T19:11:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.510+0000 7ff09959a700 1 -- 172.21.15.7:0/1138741023 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0092e0 con 0x7ff09c1598d0 2023-10-14T19:11:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 -- 172.21.15.7:0/1138741023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 msgr2=0x7ff09c0cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 --2- 172.21.15.7:0/1138741023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0cafc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff09c06aba0 tx=0x7ff08c009840 comp rx=0 tx=0).stop 2023-10-14T19:11:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 -- 172.21.15.7:0/1138741023 shutdown_connections 2023-10-14T19:11:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 --2- 172.21.15.7:0/1138741023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0cafc0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 --2- 172.21.15.7:0/1138741023 >> v2:172.21.15.148:3300/0 conn(0x7ff09c159ca0 0x7ff09c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 -- 172.21.15.7:0/1138741023 >> 172.21.15.7:0/1138741023 conn(0x7ff09c0cde40 msgr2=0x7ff09c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 -- 172.21.15.7:0/1138741023 shutdown_connections 2023-10-14T19:11:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.511+0000 7ff0a0885700 1 -- 172.21.15.7:0/1138741023 wait complete. 2023-10-14T19:11:05.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.512+0000 7ff0a0885700 1 Processor -- start 2023-10-14T19:11:05.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.512+0000 7ff0a0885700 1 -- start start 2023-10-14T19:11:05.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0a0885700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09c068710 0x7ff09c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:05.520 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0a0885700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:05.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0a0885700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff09c159ca0 0x7ff09c0c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:05.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0a0885700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c153660 con 0x7ff09c1598d0 2023-10-14T19:11:05.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0a0885700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0b0190 con 0x7ff09c068710 2023-10-14T19:11:05.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0a0885700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0c5d50 con 0x7ff09c159ca0 2023-10-14T19:11:05.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:05.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52310/0 (socket says 172.21.15.7:52310) 2023-10-14T19:11:05.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 -- 172.21.15.7:0/625732686 learned_addr learned my addr 172.21.15.7:0/625732686 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:05.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff09a59c700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09c068710 0x7ff09c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:05.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff09ad9d700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff09c159ca0 0x7ff09c0c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 -- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff09c159ca0 msgr2=0x7ff09c0c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff09c159ca0 0x7ff09c0c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 -- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09c068710 msgr2=0x7ff09c158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09c068710 0x7ff09c158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 -- 172.21.15.7:0/625732686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009ae0 con 0x7ff09c1598d0 2023-10-14T19:11:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff09a59c700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09c068710 0x7ff09c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff099d9b700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0c3370 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff08400d860 tx=0x7ff084008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.513+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840125f0 con 0x7ff09c1598d0 2023-10-14T19:11:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.514+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084012750 con 0x7ff09c1598d0 2023-10-14T19:11:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.514+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c0c5140 con 0x7ff09c1598d0 2023-10-14T19:11:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.514+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084012ad0 con 0x7ff09c1598d0 2023-10-14T19:11:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.514+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c0c5700 con 0x7ff09c1598d0 2023-10-14T19:11:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.515+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c063230 con 0x7ff09c1598d0 2023-10-14T19:11:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.515+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff084014430 con 0x7ff09c1598d0 2023-10-14T19:11:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.515+0000 7ff0927fc700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff07c067320 0x7ff07c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:05.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.516+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff084084f40 con 0x7ff09c1598d0 2023-10-14T19:11:05.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.516+0000 7ff09a59c700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff07c067320 0x7ff07c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:05.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.516+0000 7ff09a59c700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff07c067320 0x7ff07c0697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009880 tx=0x7ff08c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:05.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.520+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff09c063230 con 0x7ff09c1598d0 2023-10-14T19:11:05.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:05.723+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff09c04c3c0 con 0x7ff09c1598d0 2023-10-14T19:11:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.370+0000 7ff0927fc700 1 -- 172.21.15.7:0/625732686 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v156) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0840557c0 con 0x7ff09c1598d0 2023-10-14T19:11:06.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff07c067320 msgr2=0x7ff07c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff07c067320 0x7ff07c0697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009880 tx=0x7ff08c018000 comp rx=0 tx=0).stop 2023-10-14T19:11:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 msgr2=0x7ff09c0c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0c3370 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff08400d860 tx=0x7ff084008040 comp rx=0 tx=0).stop 2023-10-14T19:11:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 shutdown_connections 2023-10-14T19:11:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff07c067320 0x7ff07c0697d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09c068710 0x7ff09c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff09c159ca0 0x7ff09c0c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 --2- 172.21.15.7:0/625732686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff09c1598d0 0x7ff09c0c3370 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 >> 172.21.15.7:0/625732686 conn(0x7ff09c0cde40 msgr2=0x7ff09c154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:06.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 shutdown_connections 2023-10-14T19:11:06.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.373+0000 7ff0a0885700 1 -- 172.21.15.7:0/625732686 wait complete. 2023-10-14T19:11:06.377 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:11:06.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:11:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.509+0000 7f8bb18a7700 1 Processor -- start 2023-10-14T19:11:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.509+0000 7f8bb18a7700 1 -- start start 2023-10-14T19:11:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bb18a7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 0x7f8bac0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bb18a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 0x7f8bac0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bb18a7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac15e010 con 0x7f8bac0cb1a0 2023-10-14T19:11:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bb18a7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac15d420 con 0x7f8bac1594d0 2023-10-14T19:11:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bb18a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac15d6e0 con 0x7f8bac1598a0 2023-10-14T19:11:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bab7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 0x7f8bac0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8baaffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 0x7f8bac0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8baa7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8bac0cb1a0 0x7f8bac0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:54050/0 (socket says 172.21.15.7:54050) 2023-10-14T19:11:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8baaffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 0x7f8bac0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:40272/0 (socket says 172.21.15.7:40272) 2023-10-14T19:11:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8bab7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 0x7f8bac0cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:57362/0 (socket says 172.21.15.7:57362) 2023-10-14T19:11:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.510+0000 7f8baa7fc700 1 -- 172.21.15.7:0/2051633959 learned_addr learned my addr 172.21.15.7:0/2051633959 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8bab7fe700 1 -- 172.21.15.7:0/2051633959 >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 msgr2=0x7f8bac0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8bab7fe700 1 --2- 172.21.15.7:0/2051633959 >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 0x7f8bac0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8bab7fe700 1 -- 172.21.15.7:0/2051633959 >> v1:172.21.15.148:6789/0 conn(0x7f8bac0cb1a0 legacy=0x7f8bac0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8bab7fe700 1 -- 172.21.15.7:0/2051633959 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac15d9c0 con 0x7f8bac1598a0 2023-10-14T19:11:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8baaffd700 1 --2- 172.21.15.7:0/2051633959 >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 0x7f8bac0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8bab7fe700 1 --2- 172.21.15.7:0/2051633959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 0x7f8bac0cefb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009e60 tx=0x7f8b9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e033a6073cef3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8ba9ffb700 1 -- 172.21.15.7:0/2051633959 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00e070 con 0x7f8bac1598a0 2023-10-14T19:11:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8ba9ffb700 1 -- 172.21.15.7:0/2051633959 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c00bb60 con 0x7f8bac1598a0 2023-10-14T19:11:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.511+0000 7f8ba9ffb700 1 -- 172.21.15.7:0/2051633959 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c012430 con 0x7f8bac1598a0 2023-10-14T19:11:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 -- 172.21.15.7:0/2051633959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 msgr2=0x7f8bac0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/2051633959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 0x7f8bac0cefb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009e60 tx=0x7f8b9c009780 comp rx=0 tx=0).stop 2023-10-14T19:11:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 -- 172.21.15.7:0/2051633959 shutdown_connections 2023-10-14T19:11:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/2051633959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac1598a0 0x7f8bac0cefb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/2051633959 >> v2:172.21.15.148:3300/0 conn(0x7f8bac1594d0 0x7f8bac0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 -- 172.21.15.7:0/2051633959 >> 172.21.15.7:0/2051633959 conn(0x7f8bac0703a0 msgr2=0x7f8bac070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:06.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 -- 172.21.15.7:0/2051633959 shutdown_connections 2023-10-14T19:11:06.519 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.512+0000 7f8bb18a7700 1 -- 172.21.15.7:0/2051633959 wait complete. 2023-10-14T19:11:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.513+0000 7f8bb18a7700 1 Processor -- start 2023-10-14T19:11:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.513+0000 7f8bb18a7700 1 -- start start 2023-10-14T19:11:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bb18a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cb1a0 0x7f8bac1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bb18a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 0x7f8bac154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bb18a7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1598a0 0x7f8bac0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bb18a7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0b4550 con 0x7f8bac1594d0 2023-10-14T19:11:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bb18a7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0b4270 con 0x7f8bac1598a0 2023-10-14T19:11:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bb18a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0c8cb0 con 0x7f8bac0cb1a0 2023-10-14T19:11:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 0x7f8bac154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 0x7f8bac154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52324/0 (socket says 172.21.15.7:52324) 2023-10-14T19:11:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 -- 172.21.15.7:0/1692326627 learned_addr learned my addr 172.21.15.7:0/1692326627 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baaffd700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cb1a0 0x7f8bac1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8bab7fe700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1598a0 0x7f8bac0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 -- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cb1a0 msgr2=0x7f8bac1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cb1a0 0x7f8bac1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 -- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1598a0 msgr2=0x7f8bac0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1598a0 0x7f8bac0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.514+0000 7f8baa7fc700 1 -- 172.21.15.7:0/1692326627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4009420 con 0x7f8bac1594d0 2023-10-14T19:11:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.515+0000 7f8baa7fc700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 0x7f8bac154f10 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400c790 tx=0x7f8b94007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.515+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94005b30 con 0x7f8bac1594d0 2023-10-14T19:11:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.515+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b94005cb0 con 0x7f8bac1594d0 2023-10-14T19:11:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.515+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c009a20 con 0x7f8bac1594d0 2023-10-14T19:11:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.515+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94004a80 con 0x7f8bac1594d0 2023-10-14T19:11:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.515+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac0c9270 con 0x7f8bac1594d0 2023-10-14T19:11:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.516+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac0c9460 con 0x7f8bac1594d0 2023-10-14T19:11:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.516+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8b940070d0 con 0x7f8bac1594d0 2023-10-14T19:11:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.517+0000 7f8ba2ffd700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8b8c067320 0x7f8b8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.517+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8b94083ca0 con 0x7f8bac1594d0 2023-10-14T19:11:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.517+0000 7f8baaffd700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8b8c067320 0x7f8b8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.517+0000 7f8baaffd700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8b8c067320 0x7f8b8c0697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009f40 tx=0x7f8ba40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.521+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b9404b5a0 con 0x7f8bac1594d0 2023-10-14T19:11:06.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.722+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8bac04c3c0 con 0x7f8bac1594d0 2023-10-14T19:11:06.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.726+0000 7f8ba2ffd700 1 -- 172.21.15.7:0/1692326627 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b94050bf0 con 0x7f8bac1594d0 2023-10-14T19:11:06.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8b8c067320 msgr2=0x7f8b8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8b8c067320 0x7f8b8c0697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009f40 tx=0x7f8ba40091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 msgr2=0x7f8bac154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 0x7f8bac154f10 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400c790 tx=0x7f8b94007f40 comp rx=0 tx=0).stop 2023-10-14T19:11:06.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 shutdown_connections 2023-10-14T19:11:06.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8b8c067320 0x7f8b8c0697d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1598a0 0x7f8bac0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cb1a0 0x7f8bac1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 --2- 172.21.15.7:0/1692326627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac1594d0 0x7f8bac154f10 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 >> 172.21.15.7:0/1692326627 conn(0x7f8bac0703a0 msgr2=0x7f8bac0ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:06.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 shutdown_connections 2023-10-14T19:11:06.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.728+0000 7f8bb18a7700 1 -- 172.21.15.7:0/1692326627 wait complete. 2023-10-14T19:11:06.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-14T19:11:06.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.860+0000 7ff5b6551700 1 Processor -- start 2023-10-14T19:11:06.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.860+0000 7ff5b6551700 1 -- start start 2023-10-14T19:11:06.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b6551700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b01595d0 0x7ff5b01599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b6551700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff5b00675a0 0x7ff5b006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b6551700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5b006b230 0x7ff5b00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b6551700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b006bd00 con 0x7ff5b006b230 2023-10-14T19:11:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b6551700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00c7f50 con 0x7ff5b00675a0 2023-10-14T19:11:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b6551700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b006b740 con 0x7ff5b01595d0 2023-10-14T19:11:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5b006b230 0x7ff5b00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5b006b230 0x7ff5b00c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42064/0 (socket says 172.21.15.7:42064) 2023-10-14T19:11:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 -- 172.21.15.7:0/2726409678 learned_addr learned my addr 172.21.15.7:0/2726409678 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5affff700 1 --2- 172.21.15.7:0/2726409678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b01595d0 0x7ff5b01599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5af7fe700 1 --2- 172.21.15.7:0/2726409678 >> v2:172.21.15.148:3300/0 conn(0x7ff5b00675a0 0x7ff5b006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 -- 172.21.15.7:0/2726409678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b01595d0 msgr2=0x7ff5b01599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 --2- 172.21.15.7:0/2726409678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b01595d0 0x7ff5b01599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 -- 172.21.15.7:0/2726409678 >> v2:172.21.15.148:3300/0 conn(0x7ff5b00675a0 msgr2=0x7ff5b006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 --2- 172.21.15.7:0/2726409678 >> v2:172.21.15.148:3300/0 conn(0x7ff5b00675a0 0x7ff5b006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 -- 172.21.15.7:0/2726409678 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b006ba20 con 0x7ff5b006b230 2023-10-14T19:11:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5af7fe700 1 --2- 172.21.15.7:0/2726409678 >> v2:172.21.15.148:3300/0 conn(0x7ff5b00675a0 0x7ff5b006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.861+0000 7ff5b4aee700 1 --2- 172.21.15.7:0/2726409678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b006b230 0x7ff5b00c83e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0064900 tx=0x7ff5a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23db645fa203c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5aeffd700 1 -- 172.21.15.7:0/2726409678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800e070 con 0x7ff5b006b230 2023-10-14T19:11:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5aeffd700 1 -- 172.21.15.7:0/2726409678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a800ba20 con 0x7ff5b006b230 2023-10-14T19:11:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5aeffd700 1 -- 172.21.15.7:0/2726409678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80092e0 con 0x7ff5b006b230 2023-10-14T19:11:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 -- 172.21.15.7:0/2726409678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b006b230 msgr2=0x7ff5b00c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 --2- 172.21.15.7:0/2726409678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b006b230 0x7ff5b00c83e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0064900 tx=0x7ff5a8009840 comp rx=0 tx=0).stop 2023-10-14T19:11:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 -- 172.21.15.7:0/2726409678 shutdown_connections 2023-10-14T19:11:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 --2- 172.21.15.7:0/2726409678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b006b230 0x7ff5b00c83e0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 --2- 172.21.15.7:0/2726409678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b01595d0 0x7ff5b01599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 --2- 172.21.15.7:0/2726409678 >> v2:172.21.15.148:3300/0 conn(0x7ff5b00675a0 0x7ff5b006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 -- 172.21.15.7:0/2726409678 >> 172.21.15.7:0/2726409678 conn(0x7ff5b00cd400 msgr2=0x7ff5b00cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 -- 172.21.15.7:0/2726409678 shutdown_connections 2023-10-14T19:11:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.862+0000 7ff5b6551700 1 -- 172.21.15.7:0/2726409678 wait complete. 2023-10-14T19:11:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.863+0000 7ff5b6551700 1 Processor -- start 2023-10-14T19:11:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.863+0000 7ff5b6551700 1 -- start start 2023-10-14T19:11:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b6551700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b00675a0 0x7ff5b016c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b6551700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b006b230 0x7ff5b015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b6551700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 0x7ff5b015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b6551700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015b6a0 con 0x7ff5b01595d0 2023-10-14T19:11:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b6551700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015b980 con 0x7ff5b00675a0 2023-10-14T19:11:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b6551700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015bc60 con 0x7ff5b006b230 2023-10-14T19:11:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b4aee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 0x7ff5b015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b4aee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 0x7ff5b015d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42072/0 (socket says 172.21.15.7:42072) 2023-10-14T19:11:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b4aee700 1 -- 172.21.15.7:0/4165525442 learned_addr learned my addr 172.21.15.7:0/4165525442 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5affff700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b00675a0 0x7ff5b016c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5af7fe700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b006b230 0x7ff5b015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b4aee700 1 -- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b006b230 msgr2=0x7ff5b015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.864+0000 7ff5b4aee700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b006b230 0x7ff5b015d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff5b4aee700 1 -- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b00675a0 msgr2=0x7ff5b016c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff5b4aee700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b00675a0 0x7ff5b016c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff5b4aee700 1 -- 172.21.15.7:0/4165525442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009ae0 con 0x7ff5b01595d0 2023-10-14T19:11:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff5b4aee700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 0x7ff5b015d940 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8012000 tx=0x7ff5a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80032f0 con 0x7ff5b01595d0 2023-10-14T19:11:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8008db0 con 0x7ff5b01595d0 2023-10-14T19:11:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b015bf40 con 0x7ff5b01595d0 2023-10-14T19:11:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8026690 con 0x7ff5b01595d0 2023-10-14T19:11:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.865+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b016c940 con 0x7ff5b01595d0 2023-10-14T19:11:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.866+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b004c3c0 con 0x7ff5b01595d0 2023-10-14T19:11:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.866+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff5a8003040 con 0x7ff5b01595d0 2023-10-14T19:11:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.867+0000 7ff597fff700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff59c067320 0x7ff59c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.867+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff5a80864f0 con 0x7ff5b01595d0 2023-10-14T19:11:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.867+0000 7ff5affff700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff59c067320 0x7ff59c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.867+0000 7ff5affff700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff59c067320 0x7ff59c0697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00c7780 tx=0x7ff5a00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:06.871+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5a8053420 con 0x7ff5b01595d0 2023-10-14T19:11:07.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.143+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7ff5b00c7be0 con 0x7ff5b01595d0 2023-10-14T19:11:07.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.371+0000 7ff597fff700 1 -- 172.21.15.7:0/4165525442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v400) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff5a8056a40 con 0x7ff5b01595d0 2023-10-14T19:11:07.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff59c067320 msgr2=0x7ff59c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:07.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff59c067320 0x7ff59c0697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00c7780 tx=0x7ff5a00091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 msgr2=0x7ff5b015d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 0x7ff5b015d940 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8012000 tx=0x7ff5a8018000 comp rx=0 tx=0).stop 2023-10-14T19:11:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 shutdown_connections 2023-10-14T19:11:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff59c067320 0x7ff59c0697d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b00675a0 0x7ff5b016c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b01595d0 0x7ff5b015d940 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 --2- 172.21.15.7:0/4165525442 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5b006b230 0x7ff5b015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 >> 172.21.15.7:0/4165525442 conn(0x7ff5b00cd400 msgr2=0x7ff5b00c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 shutdown_connections 2023-10-14T19:11:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.373+0000 7ff5b6551700 1 -- 172.21.15.7:0/4165525442 wait complete. 2023-10-14T19:11:07.386 INFO:tasks.cephfs_test_runner:That renaming volume fails without --yes-i-really-mean-it flag. ... ok 2023-10-14T19:11:07.387 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) That renaming a volume with more than one data pool does not change 2023-10-14T19:11:07.387 INFO:tasks.cephfs_test_runner:test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:11:07.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-14T19:11:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.508+0000 7f1b0f5a4700 1 Processor -- start 2023-10-14T19:11:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.508+0000 7f1b0f5a4700 1 -- start start 2023-10-14T19:11:07.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0f5a4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:07.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0f5a4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b0815a400 0x7f1b08156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:07.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0f5a4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0815ae40 con 0x7f1b080cb5a0 2023-10-14T19:11:07.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0f5a4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080ce0f0 con 0x7f1b0815a400 2023-10-14T19:11:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0f5a4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080cbde0 con 0x7f1b080cb970 2023-10-14T19:11:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b0815a400 0x7f1b08156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b0815a400 0x7f1b08156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42078/0 (socket says 172.21.15.7:42078) 2023-10-14T19:11:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 -- 172.21.15.7:0/2888346833 learned_addr learned my addr 172.21.15.7:0/2888346833 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0cb3f700 1 --2- 172.21.15.7:0/2888346833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 -- 172.21.15.7:0/2888346833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 msgr2=0x7f1b08159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 --2- 172.21.15.7:0/2888346833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b08159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 -- 172.21.15.7:0/2888346833 >> v1:172.21.15.148:6789/0 conn(0x7f1b080cb5a0 legacy=0x7f1b080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 -- 172.21.15.7:0/2888346833 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0815ab60 con 0x7f1b0815a400 2023-10-14T19:11:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.509+0000 7f1b0db41700 1 --2- 172.21.15.7:0/2888346833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b0815a400 0x7f1b08156e90 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009f50 tx=0x7f1b00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa747645fe33d546 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1afffff700 1 -- 172.21.15.7:0/2888346833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000e070 con 0x7f1b0815a400 2023-10-14T19:11:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1afffff700 1 -- 172.21.15.7:0/2888346833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000ba30 con 0x7f1b0815a400 2023-10-14T19:11:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1afffff700 1 -- 172.21.15.7:0/2888346833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b000092e0 con 0x7f1b0815a400 2023-10-14T19:11:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/2888346833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b0815a400 msgr2=0x7f1b08156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/2888346833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b0815a400 0x7f1b08156e90 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009f50 tx=0x7f1b00009840 comp rx=0 tx=0).stop 2023-10-14T19:11:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/2888346833 shutdown_connections 2023-10-14T19:11:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/2888346833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b0815a400 0x7f1b08156e90 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/2888346833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b08159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/2888346833 >> 172.21.15.7:0/2888346833 conn(0x7f1b08070e30 msgr2=0x7f1b080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/2888346833 shutdown_connections 2023-10-14T19:11:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.510+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/2888346833 wait complete. 2023-10-14T19:11:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.511+0000 7f1b0f5a4700 1 Processor -- start 2023-10-14T19:11:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.511+0000 7f1b0f5a4700 1 -- start start 2023-10-14T19:11:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0f5a4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 0x7f1b0815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0f5a4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b0815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0f5a4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0815a400 0x7f1b080b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0f5a4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080b6420 con 0x7f1b080cb5a0 2023-10-14T19:11:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0f5a4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0815de80 con 0x7f1b0815a400 2023-10-14T19:11:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0f5a4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0815c8a0 con 0x7f1b080cb970 2023-10-14T19:11:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0d340700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 0x7f1b0815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0d340700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 0x7f1b0815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42094/0 (socket says 172.21.15.7:42094) 2023-10-14T19:11:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0d340700 1 -- 172.21.15.7:0/1774544975 learned_addr learned my addr 172.21.15.7:0/1774544975 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0db41700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0815a400 0x7f1b080b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.512+0000 7f1b0cb3f700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b0815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0d340700 1 -- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 msgr2=0x7f1b0815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0d340700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b0815d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0d340700 1 -- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0815a400 msgr2=0x7f1b080b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0d340700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0815a400 0x7f1b080b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0d340700 1 -- 172.21.15.7:0/1774544975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009ae0 con 0x7f1b080cb5a0 2023-10-14T19:11:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0d340700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 0x7f1b0815c1c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400b5e0 tx=0x7f1b04009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400f510 con 0x7f1b080cb5a0 2023-10-14T19:11:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400f670 con 0x7f1b080cb5a0 2023-10-14T19:11:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0815cb80 con 0x7f1b080cb5a0 2023-10-14T19:11:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400fa30 con 0x7f1b080cb5a0 2023-10-14T19:11:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.513+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0815d140 con 0x7f1b080cb5a0 2023-10-14T19:11:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.514+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0804c3c0 con 0x7f1b080cb5a0 2023-10-14T19:11:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.514+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1b0401a400 con 0x7f1b080cb5a0 2023-10-14T19:11:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.515+0000 7f1afd7fa700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1aec067320 0x7f1aec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.515+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1b04084360 con 0x7f1b080cb5a0 2023-10-14T19:11:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.515+0000 7f1b0cb3f700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1aec067320 0x7f1aec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.515+0000 7f1b0cb3f700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1aec067320 0x7f1aec0697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1af800acb0 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.519+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b04051370 con 0x7f1b080cb5a0 2023-10-14T19:11:07.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:07.791+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7f1b080b0600 con 0x7f1b080cb5a0 2023-10-14T19:11:08.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.375+0000 7f1afd7fa700 1 -- 172.21.15.7:0/1774544975 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v401) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1b04054990 con 0x7f1b080cb5a0 2023-10-14T19:11:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1aec067320 msgr2=0x7f1aec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1aec067320 0x7f1aec0697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1af800acb0 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2023-10-14T19:11:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 msgr2=0x7f1b0815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 0x7f1b0815c1c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400b5e0 tx=0x7f1b04009120 comp rx=0 tx=0).stop 2023-10-14T19:11:08.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 shutdown_connections 2023-10-14T19:11:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1aec067320 0x7f1aec0697d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0815a400 0x7f1b080b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b080cb5a0 0x7f1b0815c1c0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 --2- 172.21.15.7:0/1774544975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b080cb970 0x7f1b0815d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 >> 172.21.15.7:0/1774544975 conn(0x7f1b08070e30 msgr2=0x7f1b080b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:08.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 shutdown_connections 2023-10-14T19:11:08.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.378+0000 7f1b0f5a4700 1 -- 172.21.15.7:0/1774544975 wait complete. 2023-10-14T19:11:08.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:11:08.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.520+0000 7fa2f9dfc700 1 Processor -- start 2023-10-14T19:11:08.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.520+0000 7fa2f9dfc700 1 -- start start 2023-10-14T19:11:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f9dfc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 0x7fa2f4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f9dfc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f415ac50 con 0x7fa2f40cea00 2023-10-14T19:11:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f9dfc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f415d010 con 0x7fa2f415de50 2023-10-14T19:11:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f9dfc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415af60 con 0x7fa2f4153a00 2023-10-14T19:11:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f95fb700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa2f40cea00 0x7fa2f40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42068/0 (socket says 172.21.15.7:42068) 2023-10-14T19:11:08.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f95fb700 1 -- 172.21.15.7:0/3803065134 learned_addr learned my addr 172.21.15.7:0/3803065134 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 0x7fa2f4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995403011 0 0) 0x7fa2f415ac50 con 0x7fa2f40cea00 2023-10-14T19:11:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.521+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2dc003570 con 0x7fa2f40cea00 2023-10-14T19:11:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062812694 0 0) 0x7fa2f415d010 con 0x7fa2f415de50 2023-10-14T19:11:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f415ac50 con 0x7fa2f415de50 2023-10-14T19:11:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192496395 0 0) 0x7fa2dc003570 con 0x7fa2f40cea00 2023-10-14T19:11:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 msgr2=0x7fa2f4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 0x7fa2f4153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 >> v1:172.21.15.148:6789/0 conn(0x7fa2f415de50 legacy=0x7fa2f415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f415b240 con 0x7fa2f40cea00 2023-10-14T19:11:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa2e4001470 con 0x7fa2f40cea00 2023-10-14T19:11:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 >> v1:172.21.15.7:6789/0 conn(0x7fa2f40cea00 legacy=0x7fa2f40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2dc003c20 0x7fa2dc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc004810 0x7fa2dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 0x7fa2dc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415af60 con 0x7fa2dc003c20 2023-10-14T19:11:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc00bbf0 con 0x7fa2dc004810 2023-10-14T19:11:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc00bdb0 con 0x7fa2f4153a00 2023-10-14T19:11:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2dc003c20 0x7fa2dc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f3fff700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc004810 0x7fa2dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f95fb700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 0x7fa2dc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 -- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 msgr2=0x7fa2dc005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f4153a00 0x7fa2dc005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 -- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc004810 msgr2=0x7fa2dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc004810 0x7fa2dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 -- 172.21.15.7:0/3803065134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc003570 con 0x7fa2dc003c20 2023-10-14T19:11:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.522+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2dc003c20 0x7fa2dc004010 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00e210 tx=0x7fa2ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0baf84c231d5c07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00eac0 con 0x7fa2dc003c20 2023-10-14T19:11:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec00f040 con 0x7fa2dc003c20 2023-10-14T19:11:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f37fe700 1 -- 172.21.15.7:0/3803065134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00ee70 con 0x7fa2dc003c20 2023-10-14T19:11:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/3803065134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2dc003c20 msgr2=0x7fa2dc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/3803065134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2dc003c20 0x7fa2dc004010 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00e210 tx=0x7fa2ec00b040 comp rx=0 tx=0).stop 2023-10-14T19:11:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f95fb700 1 -- 172.21.15.7:0/3803065134 reap_dead start 2023-10-14T19:11:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/3803065134 shutdown_connections 2023-10-14T19:11:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/3803065134 >> 172.21.15.7:0/3803065134 conn(0x7fa2f40703a0 msgr2=0x7fa2f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:08.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/3803065134 shutdown_connections 2023-10-14T19:11:08.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.523+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/3803065134 wait complete. 2023-10-14T19:11:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.524+0000 7fa2f9dfc700 1 Processor -- start 2023-10-14T19:11:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.524+0000 7fa2f9dfc700 1 -- start start 2023-10-14T19:11:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f9dfc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc003c20 0x7fa2f4146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f9dfc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 0x7fa2f415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f9dfc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f40ca180 0x7fa2f415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f9dfc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4155020 con 0x7fa2f40c9d10 2023-10-14T19:11:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f9dfc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4156180 con 0x7fa2dc003c20 2023-10-14T19:11:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f9dfc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4156460 con 0x7fa2f40ca180 2023-10-14T19:11:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 0x7fa2f415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 0x7fa2f415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42112/0 (socket says 172.21.15.7:42112) 2023-10-14T19:11:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 -- 172.21.15.7:0/1273691177 learned_addr learned my addr 172.21.15.7:0/1273691177 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc003c20 0x7fa2f4146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f95fb700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f40ca180 0x7fa2f415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 -- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f40ca180 msgr2=0x7fa2f415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f40ca180 0x7fa2f415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 -- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc003c20 msgr2=0x7fa2f4146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc003c20 0x7fa2f4146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.525+0000 7fa2f3fff700 1 -- 172.21.15.7:0/1273691177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4156740 con 0x7fa2f40c9d10 2023-10-14T19:11:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc003c20 0x7fa2f4146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f3fff700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 0x7fa2f415c1a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8002bd0 tx=0x7fa2e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8006a30 con 0x7fa2f40c9d10 2023-10-14T19:11:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8006b90 con 0x7fa2f40c9d10 2023-10-14T19:11:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f4156a20 con 0x7fa2f40c9d10 2023-10-14T19:11:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800f840 con 0x7fa2f40c9d10 2023-10-14T19:11:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.526+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f41527d0 con 0x7fa2f40c9d10 2023-10-14T19:11:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.527+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4159ad0 con 0x7fa2f40c9d10 2023-10-14T19:11:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.527+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa2e800fc30 con 0x7fa2f40c9d10 2023-10-14T19:11:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.528+0000 7fa2f0ff9700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa2e0067320 0x7fa2e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.528+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa2e8084db0 con 0x7fa2f40c9d10 2023-10-14T19:11:08.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.528+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa2e0067320 0x7fa2e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.528+0000 7fa2f8dfa700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa2e0067320 0x7fa2e00697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00afd0 tx=0x7fa2ec01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:08.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.532+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2e8089070 con 0x7fa2f40c9d10 2023-10-14T19:11:08.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.725+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa2f4156bb0 con 0x7fa2f40c9d10 2023-10-14T19:11:08.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.728+0000 7fa2f0ff9700 1 -- 172.21.15.7:0/1273691177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2e8051e50 con 0x7fa2f40c9d10 2023-10-14T19:11:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa2e0067320 msgr2=0x7fa2e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa2e0067320 0x7fa2e00697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00afd0 tx=0x7fa2ec01a000 comp rx=0 tx=0).stop 2023-10-14T19:11:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 msgr2=0x7fa2f415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 0x7fa2f415c1a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8002bd0 tx=0x7fa2e8007d30 comp rx=0 tx=0).stop 2023-10-14T19:11:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 shutdown_connections 2023-10-14T19:11:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa2e0067320 0x7fa2e00697d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2dc003c20 0x7fa2f4146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f40ca180 0x7fa2f415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 --2- 172.21.15.7:0/1273691177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f40c9d10 0x7fa2f415c1a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 >> 172.21.15.7:0/1273691177 conn(0x7fa2f40703a0 msgr2=0x7fa2f40b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 shutdown_connections 2023-10-14T19:11:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.731+0000 7fa2f9dfc700 1 -- 172.21.15.7:0/1273691177 wait complete. 2023-10-14T19:11:08.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:11:08.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:11:08.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:11:08.841 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:11:08.842 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:11:08.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.961+0000 7fd07587a700 1 Processor -- start 2023-10-14T19:11:08.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.962+0000 7fd07587a700 1 -- start start 2023-10-14T19:11:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.962+0000 7fd07587a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd070157600 0x7fd0700b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.962+0000 7fd07587a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd070158210 con 0x7fd0701579d0 2023-10-14T19:11:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.962+0000 7fd07587a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0700cb290 con 0x7fd0700ccba0 2023-10-14T19:11:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.962+0000 7fd07587a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700cb850 con 0x7fd070157600 2023-10-14T19:11:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd0701579d0 0x7fd0701586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42080/0 (socket says 172.21.15.7:42080) 2023-10-14T19:11:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06e7fc700 1 -- 172.21.15.7:0/456400219 learned_addr learned my addr 172.21.15.7:0/456400219 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650305098 0 0) 0x7fd070158210 con 0x7fd0701579d0 2023-10-14T19:11:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06effd700 1 --2- 172.21.15.7:0/456400219 >> v2:172.21.15.148:3300/0 conn(0x7fd070157600 0x7fd0700b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c003570 con 0x7fd0701579d0 2023-10-14T19:11:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3406863559 0 0) 0x7fd05c003570 con 0x7fd0701579d0 2023-10-14T19:11:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 >> v2:172.21.15.148:3300/0 conn(0x7fd070157600 msgr2=0x7fd0700b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 --2- 172.21.15.7:0/456400219 >> v2:172.21.15.148:3300/0 conn(0x7fd070157600 0x7fd0700b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 >> v1:172.21.15.148:6789/0 conn(0x7fd0700ccba0 legacy=0x7fd070158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700cb570 con 0x7fd0701579d0 2023-10-14T19:11:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fd058001470 con 0x7fd0701579d0 2023-10-14T19:11:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 >> v1:172.21.15.7:6789/0 conn(0x7fd0701579d0 legacy=0x7fd0701586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c003a60 0x7fd05c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd05c004810 0x7fd05c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd05c0051c0 0x7fd05c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700cb850 con 0x7fd05c004810 2023-10-14T19:11:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c00c0d0 con 0x7fd05c003a60 2023-10-14T19:11:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c00c290 con 0x7fd05c0051c0 2023-10-14T19:11:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06effd700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c003a60 0x7fd05c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd05c004810 0x7fd05c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.963+0000 7fd06f7fe700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd05c0051c0 0x7fd05c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06e7fc700 1 -- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd05c0051c0 msgr2=0x7fd05c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd05c0051c0 0x7fd05c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06e7fc700 1 -- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c003a60 msgr2=0x7fd05c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c003a60 0x7fd05c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06e7fc700 1 -- 172.21.15.7:0/456400219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c003570 con 0x7fd05c004810 2023-10-14T19:11:08.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06f7fe700 1 -- 172.21.15.7:0/456400219 reap_dead start 2023-10-14T19:11:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06effd700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c003a60 0x7fd05c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd05c004810 0x7fd05c004c80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c3c0 tx=0x7fd058001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba0b336382c2307 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800cc50 con 0x7fd05c004810 2023-10-14T19:11:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800cdb0 con 0x7fd05c004810 2023-10-14T19:11:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.964+0000 7fd06dffb700 1 -- 172.21.15.7:0/456400219 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058005b50 con 0x7fd05c004810 2023-10-14T19:11:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 -- 172.21.15.7:0/456400219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd05c004810 msgr2=0x7fd05c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd05c004810 0x7fd05c004c80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c3c0 tx=0x7fd058001e50 comp rx=0 tx=0).stop 2023-10-14T19:11:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 -- 172.21.15.7:0/456400219 shutdown_connections 2023-10-14T19:11:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 --2- 172.21.15.7:0/456400219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd05c004810 0x7fd05c004c80 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 -- 172.21.15.7:0/456400219 >> 172.21.15.7:0/456400219 conn(0x7fd07006d170 msgr2=0x7fd0700cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 -- 172.21.15.7:0/456400219 shutdown_connections 2023-10-14T19:11:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.965+0000 7fd07587a700 1 -- 172.21.15.7:0/456400219 wait complete. 2023-10-14T19:11:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.966+0000 7fd07587a700 1 Processor -- start 2023-10-14T19:11:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.966+0000 7fd07587a700 1 -- start start 2023-10-14T19:11:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c004810 0x7fd07013e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 0x7fd0700b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0701693e0 0x7fd0700b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd070150360 con 0x7fd070168f70 2023-10-14T19:11:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0701520c0 con 0x7fd05c004810 2023-10-14T19:11:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b1110 con 0x7fd0701693e0 2023-10-14T19:11:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 0x7fd0700b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 0x7fd0700b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42134/0 (socket says 172.21.15.7:42134) 2023-10-14T19:11:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 -- 172.21.15.7:0/4281538645 learned_addr learned my addr 172.21.15.7:0/4281538645 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 -- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0701693e0 msgr2=0x7fd0700b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0701693e0 0x7fd0700b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 -- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c004810 msgr2=0x7fd07013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c004810 0x7fd07013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 -- 172.21.15.7:0/4281538645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070152380 con 0x7fd070168f70 2023-10-14T19:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd06e7fc700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 0x7fd0700b0530 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fd058007cd0 tx=0x7fd058015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580070d0 con 0x7fd070168f70 2023-10-14T19:11:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058007230 con 0x7fd070168f70 2023-10-14T19:11:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.967+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd070152660 con 0x7fd070168f70 2023-10-14T19:11:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.968+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580075f0 con 0x7fd070168f70 2023-10-14T19:11:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.968+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd070159620 con 0x7fd070168f70 2023-10-14T19:11:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.968+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07004c3c0 con 0x7fd070168f70 2023-10-14T19:11:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.969+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd0580273b0 con 0x7fd070168f70 2023-10-14T19:11:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.969+0000 7fd066ffd700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd050067320 0x7fd0500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.969+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd0580856c0 con 0x7fd070168f70 2023-10-14T19:11:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.970+0000 7fd06effd700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd050067320 0x7fd0500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.970+0000 7fd06effd700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd050067320 0x7fd0500697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd068009c30 tx=0x7fd06800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:08.973+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd058052610 con 0x7fd070168f70 2023-10-14T19:11:09.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.210+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd070152b00 con 0x7fd070168f70 2023-10-14T19:11:09.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.211+0000 7fd066ffd700 1 -- 172.21.15.7:0/4281538645 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+3522 (secure 0 0 0) 0x7fd058023de0 con 0x7fd070168f70 2023-10-14T19:11:09.212 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:09.212 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":105,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/165592563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":165592563},{"type":"v1","addr":"172.21.15.148:6837","nonce":165592563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/3025214505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3025214505},{"type":"v1","addr":"172.21.15.148:6836","nonce":3025214505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/636409175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":636409175},{"type":"v1","addr":"172.21.15.7:6834","nonce":636409175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":8190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/545959654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":545959654},{"type":"v1","addr":"172.21.15.7:6835","nonce":545959654}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[]} 2023-10-14T19:11:09.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd050067320 msgr2=0x7fd0500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:09.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd050067320 0x7fd0500697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd068009c30 tx=0x7fd06800b040 comp rx=0 tx=0).stop 2023-10-14T19:11:09.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 msgr2=0x7fd0700b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:09.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 0x7fd0700b0530 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fd058007cd0 tx=0x7fd058015000 comp rx=0 tx=0).stop 2023-10-14T19:11:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 shutdown_connections 2023-10-14T19:11:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd050067320 0x7fd0500697d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd05c004810 0x7fd07013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0701693e0 0x7fd0700b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 --2- 172.21.15.7:0/4281538645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd070168f70 0x7fd0700b0530 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 >> 172.21.15.7:0/4281538645 conn(0x7fd07006d170 msgr2=0x7fd07006e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 shutdown_connections 2023-10-14T19:11:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.213+0000 7fd07587a700 1 -- 172.21.15.7:0/4281538645 wait complete. 2023-10-14T19:11:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 105 2023-10-14T19:11:09.227 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:11:09.227 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:11:09.228 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:11:09.228 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:09.229 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:11:09.229 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:11:09.229 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:11:09.230 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:09.230 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:11:09.230 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:11:09.231 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:11:09.231 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:09.232 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:11:09.232 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:11:09.233 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:11:09.233 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:09.237 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:11:09.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:11:09.239 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:11:09.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:11:09.243 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:11:09.243 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:11:09.245 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:11:09.245 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:11:09.280 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:11:09.281 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:09.282 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:11:09.282 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:09.286 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:11:09.286 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:09.287 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:11:09.287 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:09.288 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:11:09.356 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:11:09.357 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:11:09.369 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:11:09.370 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:11:09.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.415+0000 7fd23c1ef700 1 Processor -- start 2023-10-14T19:11:09.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.415+0000 7fd23c1ef700 1 -- start start 2023-10-14T19:11:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23c1ef700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd2340cb5a0 0x7fd2340cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23c1ef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cd9e0 0x7fd234159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23c1ef700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2340cde50 0x7fd23415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23c1ef700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2340d13f0 con 0x7fd2340cde50 2023-10-14T19:11:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23c1ef700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23415a940 con 0x7fd2340cb5a0 2023-10-14T19:11:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23c1ef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23415ae40 con 0x7fd2340cd9e0 2023-10-14T19:11:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2340cde50 0x7fd23415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2340cde50 0x7fd23415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42178/0 (socket says 172.21.15.7:42178) 2023-10-14T19:11:09.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 -- 172.21.15.7:0/3830584205 learned_addr learned my addr 172.21.15.7:0/3830584205 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd239f8b700 1 --2- 172.21.15.7:0/3830584205 >> v2:172.21.15.148:3300/0 conn(0x7fd2340cb5a0 0x7fd2340cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23978a700 1 --2- 172.21.15.7:0/3830584205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cd9e0 0x7fd234159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 -- 172.21.15.7:0/3830584205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cd9e0 msgr2=0x7fd234159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 --2- 172.21.15.7:0/3830584205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cd9e0 0x7fd234159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 -- 172.21.15.7:0/3830584205 >> v2:172.21.15.148:3300/0 conn(0x7fd2340cb5a0 msgr2=0x7fd2340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 --2- 172.21.15.7:0/3830584205 >> v2:172.21.15.148:3300/0 conn(0x7fd2340cb5a0 0x7fd2340cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.416+0000 7fd23a78c700 1 -- 172.21.15.7:0/3830584205 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23415ab60 con 0x7fd2340cde50 2023-10-14T19:11:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23a78c700 1 --2- 172.21.15.7:0/3830584205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340cde50 0x7fd23415a400 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd234065120 tx=0x7fd22c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c726a72558b79c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd238f89700 1 -- 172.21.15.7:0/3830584205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00b640 con 0x7fd2340cde50 2023-10-14T19:11:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd238f89700 1 -- 172.21.15.7:0/3830584205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c00b7a0 con 0x7fd2340cde50 2023-10-14T19:11:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd238f89700 1 -- 172.21.15.7:0/3830584205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00bb40 con 0x7fd2340cde50 2023-10-14T19:11:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3830584205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340cde50 msgr2=0x7fd23415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3830584205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340cde50 0x7fd23415a400 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd234065120 tx=0x7fd22c009250 comp rx=0 tx=0).stop 2023-10-14T19:11:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3830584205 shutdown_connections 2023-10-14T19:11:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3830584205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340cde50 0x7fd23415a400 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3830584205 >> v2:172.21.15.148:3300/0 conn(0x7fd2340cb5a0 0x7fd2340cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3830584205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cd9e0 0x7fd234159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3830584205 >> 172.21.15.7:0/3830584205 conn(0x7fd234070e30 msgr2=0x7fd2340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3830584205 shutdown_connections 2023-10-14T19:11:09.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.417+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3830584205 wait complete. 2023-10-14T19:11:09.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.418+0000 7fd23c1ef700 1 Processor -- start 2023-10-14T19:11:09.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.418+0000 7fd23c1ef700 1 -- start start 2023-10-14T19:11:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23c1ef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cb5a0 0x7fd234156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23c1ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2340cd9e0 0x7fd2340ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23c1ef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 0x7fd2340b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23c1ef700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340c7ee0 con 0x7fd234156cd0 2023-10-14T19:11:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23c1ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23415b070 con 0x7fd2340cd9e0 2023-10-14T19:11:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23c1ef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd234159370 con 0x7fd2340cb5a0 2023-10-14T19:11:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23a78c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 0x7fd2340b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd239f8b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cb5a0 0x7fd234156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23a78c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 0x7fd2340b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42192/0 (socket says 172.21.15.7:42192) 2023-10-14T19:11:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23a78c700 1 -- 172.21.15.7:0/3060465965 learned_addr learned my addr 172.21.15.7:0/3060465965 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.419+0000 7fd23978a700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2340cd9e0 0x7fd2340ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd239f8b700 1 -- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2340cd9e0 msgr2=0x7fd2340ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd239f8b700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2340cd9e0 0x7fd2340ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd239f8b700 1 -- 172.21.15.7:0/3060465965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 msgr2=0x7fd2340b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd239f8b700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 0x7fd2340b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd239f8b700 1 -- 172.21.15.7:0/3060465965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0094f0 con 0x7fd2340cb5a0 2023-10-14T19:11:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd23a78c700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 0x7fd2340b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd239f8b700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cb5a0 0x7fd234156290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd224009ef0 tx=0x7fd22400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400cb70 con 0x7fd2340cb5a0 2023-10-14T19:11:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22400f040 con 0x7fd2340cb5a0 2023-10-14T19:11:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234159650 con 0x7fd2340cb5a0 2023-10-14T19:11:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224014480 con 0x7fd2340cb5a0 2023-10-14T19:11:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.420+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234159c10 con 0x7fd2340cb5a0 2023-10-14T19:11:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.421+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23404c3c0 con 0x7fd2340cb5a0 2023-10-14T19:11:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.421+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd224014830 con 0x7fd2340cb5a0 2023-10-14T19:11:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.422+0000 7fd231ffb700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd220067320 0x7fd2200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.422+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd224085700 con 0x7fd2340cb5a0 2023-10-14T19:11:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.422+0000 7fd23978a700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd220067320 0x7fd2200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.423+0000 7fd23978a700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd220067320 0x7fd2200697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd2341582d0 tx=0x7fd2280091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.427+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd224052540 con 0x7fd2340cb5a0 2023-10-14T19:11:09.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:09.635+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd2340ccf00 con 0x7fd2340cb5a0 2023-10-14T19:11:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.740+0000 7fd231ffb700 1 -- 172.21.15.7:0/3060465965 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v161) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd224055b60 con 0x7fd2340cb5a0 2023-10-14T19:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd220067320 msgr2=0x7fd2200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd220067320 0x7fd2200697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd2341582d0 tx=0x7fd2280091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cb5a0 msgr2=0x7fd234156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cb5a0 0x7fd234156290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd224009ef0 tx=0x7fd22400b040 comp rx=0 tx=0).stop 2023-10-14T19:11:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 shutdown_connections 2023-10-14T19:11:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd220067320 0x7fd2200697d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234156cd0 0x7fd2340b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2340cb5a0 0x7fd234156290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 --2- 172.21.15.7:0/3060465965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2340cd9e0 0x7fd2340ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 >> 172.21.15.7:0/3060465965 conn(0x7fd234070e30 msgr2=0x7fd2340d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 shutdown_connections 2023-10-14T19:11:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.743+0000 7fd23c1ef700 1 -- 172.21.15.7:0/3060465965 wait complete. 2023-10-14T19:11:10.747 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:11:10.759 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:11:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.884+0000 7efc562af700 1 Processor -- start 2023-10-14T19:11:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.884+0000 7efc562af700 1 -- start start 2023-10-14T19:11:10.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc562af700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb970 0x7efc50159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:10.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc562af700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc5015a400 0x7efc50156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:10.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc562af700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5015ae40 con 0x7efc500cb5a0 2023-10-14T19:11:10.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc562af700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500ce0f0 con 0x7efc5015a400 2023-10-14T19:11:10.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc562af700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500cbde0 con 0x7efc500cb970 2023-10-14T19:11:10.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc5484c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc5015a400 0x7efc50156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:10.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc5484c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc5015a400 0x7efc50156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42202/0 (socket says 172.21.15.7:42202) 2023-10-14T19:11:10.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc5484c700 1 -- 172.21.15.7:0/3943042453 learned_addr learned my addr 172.21.15.7:0/3943042453 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:10.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.885+0000 7efc4f7fe700 1 --2- 172.21.15.7:0/3943042453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb970 0x7efc50159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:10.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc5484c700 1 -- 172.21.15.7:0/3943042453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb970 msgr2=0x7efc50159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc5484c700 1 --2- 172.21.15.7:0/3943042453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb970 0x7efc50159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc5484c700 1 -- 172.21.15.7:0/3943042453 >> v1:172.21.15.148:6789/0 conn(0x7efc500cb5a0 legacy=0x7efc500cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc5484c700 1 -- 172.21.15.7:0/3943042453 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5015ab60 con 0x7efc5015a400 2023-10-14T19:11:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc5484c700 1 --2- 172.21.15.7:0/3943042453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc50156e90 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7efc48009f50 tx=0x7efc48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c95148ccc9ddfcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc4effd700 1 -- 172.21.15.7:0/3943042453 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800e070 con 0x7efc5015a400 2023-10-14T19:11:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc4effd700 1 -- 172.21.15.7:0/3943042453 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800b9c0 con 0x7efc5015a400 2023-10-14T19:11:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc4effd700 1 -- 172.21.15.7:0/3943042453 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc480092e0 con 0x7efc5015a400 2023-10-14T19:11:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 -- 172.21.15.7:0/3943042453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 msgr2=0x7efc50156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 --2- 172.21.15.7:0/3943042453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc50156e90 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7efc48009f50 tx=0x7efc48009840 comp rx=0 tx=0).stop 2023-10-14T19:11:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 -- 172.21.15.7:0/3943042453 shutdown_connections 2023-10-14T19:11:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 --2- 172.21.15.7:0/3943042453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc50156e90 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 --2- 172.21.15.7:0/3943042453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb970 0x7efc50159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 -- 172.21.15.7:0/3943042453 >> 172.21.15.7:0/3943042453 conn(0x7efc50070e30 msgr2=0x7efc500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 -- 172.21.15.7:0/3943042453 shutdown_connections 2023-10-14T19:11:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.886+0000 7efc562af700 1 -- 172.21.15.7:0/3943042453 wait complete. 2023-10-14T19:11:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 Processor -- start 2023-10-14T19:11:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 -- start start 2023-10-14T19:11:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb5a0 0x7efc500b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc500cb970 0x7efc5016a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc500c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b5950 con 0x7efc5015a400 2023-10-14T19:11:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5016a890 con 0x7efc500cb970 2023-10-14T19:11:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.888+0000 7efc562af700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b4d40 con 0x7efc500cb5a0 2023-10-14T19:11:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc500c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc500c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42216/0 (socket says 172.21.15.7:42216) 2023-10-14T19:11:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 -- 172.21.15.7:0/2229246954 learned_addr learned my addr 172.21.15.7:0/2229246954 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc4f7fe700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc500cb970 0x7efc5016a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc4ffff700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb5a0 0x7efc500b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 -- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb5a0 msgr2=0x7efc500b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb5a0 0x7efc500b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 -- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc500cb970 msgr2=0x7efc5016a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc500cb970 0x7efc5016a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 -- 172.21.15.7:0/2229246954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009ae0 con 0x7efc5015a400 2023-10-14T19:11:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc5484c700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc500c9b30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7efc5006ea60 tx=0x7efc48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48008ba0 con 0x7efc5015a400 2023-10-14T19:11:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48008d00 con 0x7efc5015a400 2023-10-14T19:11:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48026690 con 0x7efc5015a400 2023-10-14T19:11:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc500b5020 con 0x7efc5015a400 2023-10-14T19:11:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.889+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc500b55e0 con 0x7efc5015a400 2023-10-14T19:11:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.890+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5004c3c0 con 0x7efc5015a400 2023-10-14T19:11:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.891+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efc48003040 con 0x7efc5015a400 2023-10-14T19:11:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.891+0000 7efc37fff700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efc3c067320 0x7efc3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.891+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efc480868f0 con 0x7efc5015a400 2023-10-14T19:11:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.891+0000 7efc4ffff700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efc3c067320 0x7efc3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:10.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.892+0000 7efc4ffff700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efc3c067320 0x7efc3c0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efc440039e0 tx=0x7efc44007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:10.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:10.895+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc48053870 con 0x7efc5015a400 2023-10-14T19:11:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.165+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc500b0600 con 0x7efc5015a400 2023-10-14T19:11:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.166+0000 7efc37fff700 1 -- 172.21.15.7:0/2229246954 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efc48056e90 con 0x7efc5015a400 2023-10-14T19:11:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:11.168 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:11:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:11:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:11:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:11:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:11:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:11:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:11:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:11:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:11:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:11:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:11:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:11:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:11:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:11:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:11:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:11:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:11:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:11:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:11:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:11:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:11:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:11:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:11:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:11:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:11:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:11:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:11:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:11:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:11:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:11:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:11:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:11:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:11:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:11:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:11:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:11:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:11:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:11:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:11:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:11:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:11:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:11:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:11:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:11:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:11:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:11:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:11:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:11:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:11:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:11:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:11:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:11:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:11:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:11:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:11:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:11:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:11:11.214 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:11:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efc3c067320 msgr2=0x7efc3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efc3c067320 0x7efc3c0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efc440039e0 tx=0x7efc44007ec0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 msgr2=0x7efc500c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc500c9b30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7efc5006ea60 tx=0x7efc48018000 comp rx=0 tx=0).stop 2023-10-14T19:11:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 shutdown_connections 2023-10-14T19:11:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efc3c067320 0x7efc3c0697d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc5015a400 0x7efc500c9b30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc500cb5a0 0x7efc500b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 --2- 172.21.15.7:0/2229246954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc500cb970 0x7efc5016a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 >> 172.21.15.7:0/2229246954 conn(0x7efc50070e30 msgr2=0x7efc500ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 shutdown_connections 2023-10-14T19:11:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.168+0000 7efc562af700 1 -- 172.21.15.7:0/2229246954 wait complete. 2023-10-14T19:11:11.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.338+0000 7fc6ffe27700 1 Processor -- start 2023-10-14T19:11:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.338+0000 7fc6ffe27700 1 -- start start 2023-10-14T19:11:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6ffe27700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6f80cb970 0x7fc6f8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6ffe27700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6f815a400 0x7fc6f8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6ffe27700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f815ae40 con 0x7fc6f80cb5a0 2023-10-14T19:11:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6ffe27700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80ce0f0 con 0x7fc6f80cb970 2023-10-14T19:11:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6ffe27700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80d13f0 con 0x7fc6f815a400 2023-10-14T19:11:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6f80cb970 0x7fc6f8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6f80cb970 0x7fc6f8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42218/0 (socket says 172.21.15.7:42218) 2023-10-14T19:11:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/3829337195 learned_addr learned my addr 172.21.15.7:0/3829337195 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fe3c4700 1 --2- 172.21.15.7:0/3829337195 >> v2:172.21.15.148:3300/0 conn(0x7fc6f815a400 0x7fc6f8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/3829337195 >> v2:172.21.15.148:3300/0 conn(0x7fc6f815a400 msgr2=0x7fc6f8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 --2- 172.21.15.7:0/3829337195 >> v2:172.21.15.148:3300/0 conn(0x7fc6f815a400 0x7fc6f8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/3829337195 >> v1:172.21.15.148:6789/0 conn(0x7fc6f80cb5a0 legacy=0x7fc6f80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/3829337195 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f815ab60 con 0x7fc6f80cb970 2023-10-14T19:11:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fd3c2700 1 --2- 172.21.15.7:0/3829337195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f8159ec0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80ccdf0 tx=0x7fc6ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538cd5d9382579ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.339+0000 7fc6fcbc1700 1 -- 172.21.15.7:0/3829337195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00b860 con 0x7fc6f80cb970 2023-10-14T19:11:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6fcbc1700 1 -- 172.21.15.7:0/3829337195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec00b9c0 con 0x7fc6f80cb970 2023-10-14T19:11:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6fcbc1700 1 -- 172.21.15.7:0/3829337195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00bd60 con 0x7fc6f80cb970 2023-10-14T19:11:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 -- 172.21.15.7:0/3829337195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 msgr2=0x7fc6f8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/3829337195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f8159ec0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80ccdf0 tx=0x7fc6ec009250 comp rx=0 tx=0).stop 2023-10-14T19:11:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 -- 172.21.15.7:0/3829337195 shutdown_connections 2023-10-14T19:11:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/3829337195 >> v2:172.21.15.148:3300/0 conn(0x7fc6f815a400 0x7fc6f8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/3829337195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f8159ec0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 -- 172.21.15.7:0/3829337195 >> 172.21.15.7:0/3829337195 conn(0x7fc6f8070e30 msgr2=0x7fc6f80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:11.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 -- 172.21.15.7:0/3829337195 shutdown_connections 2023-10-14T19:11:11.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.340+0000 7fc6ffe27700 1 -- 172.21.15.7:0/3829337195 wait complete. 2023-10-14T19:11:11.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.341+0000 7fc6ffe27700 1 Processor -- start 2023-10-14T19:11:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.341+0000 7fc6ffe27700 1 -- start start 2023-10-14T19:11:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6ffe27700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6f80cb5a0 0x7fc6f8150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6ffe27700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f81556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6ffe27700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f815a400 0x7fc6f8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6ffe27700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8155210 con 0x7fc6f80cb970 2023-10-14T19:11:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6ffe27700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8150d40 con 0x7fc6f815a400 2023-10-14T19:11:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6ffe27700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8154320 con 0x7fc6f80cb5a0 2023-10-14T19:11:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f81556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f81556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42230/0 (socket says 172.21.15.7:42230) 2023-10-14T19:11:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/999324141 learned_addr learned my addr 172.21.15.7:0/999324141 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fdbc3700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6f80cb5a0 0x7fc6f8150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fe3c4700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f815a400 0x7fc6f8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6f80cb5a0 msgr2=0x7fc6f8150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6f80cb5a0 0x7fc6f8150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f815a400 msgr2=0x7fc6f8155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f815a400 0x7fc6f8155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fd3c2700 1 -- 172.21.15.7:0/999324141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0094f0 con 0x7fc6f80cb970 2023-10-14T19:11:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fdbc3700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6f80cb5a0 0x7fc6f8150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.342+0000 7fc6fe3c4700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f815a400 0x7fc6f8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.343+0000 7fc6fd3c2700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f81556a0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009290 tx=0x7fc6ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.343+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec026450 con 0x7fc6f80cb970 2023-10-14T19:11:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.343+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec0265b0 con 0x7fc6f80cb970 2023-10-14T19:11:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.343+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f8154600 con 0x7fc6f80cb970 2023-10-14T19:11:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.343+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec026950 con 0x7fc6f80cb970 2023-10-14T19:11:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.343+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f8154bc0 con 0x7fc6f80cb970 2023-10-14T19:11:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.344+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f804c3c0 con 0x7fc6f80cb970 2023-10-14T19:11:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.344+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc6ec0303f0 con 0x7fc6f80cb970 2023-10-14T19:11:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.345+0000 7fc6f5ffb700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc6e4067320 0x7fc6e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.345+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6ec086770 con 0x7fc6f80cb970 2023-10-14T19:11:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.345+0000 7fc6fdbc3700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc6e4067320 0x7fc6e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.347+0000 7fc6fdbc3700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc6e4067320 0x7fc6e40697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8007fd0 tx=0x7fc6e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:11.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.350+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6ec0537d0 con 0x7fc6f80cb970 2023-10-14T19:11:11.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.543+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6f80ccf00 con 0x7fc6f80cb970 2023-10-14T19:11:11.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.544+0000 7fc6f5ffb700 1 -- 172.21.15.7:0/999324141 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+12096 (secure 0 0 0) 0x7fc6ec056df0 con 0x7fc6f80cb970 2023-10-14T19:11:11.545 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:11.545 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":161,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:10.729632+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:11.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc6e4067320 msgr2=0x7fc6e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc6e4067320 0x7fc6e40697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8007fd0 tx=0x7fc6e8009040 comp rx=0 tx=0).stop 2023-10-14T19:11:11.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 msgr2=0x7fc6f81556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f81556a0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009290 tx=0x7fc6ec017000 comp rx=0 tx=0).stop 2023-10-14T19:11:11.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 shutdown_connections 2023-10-14T19:11:11.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc6e4067320 0x7fc6e40697d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f815a400 0x7fc6f8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6f80cb5a0 0x7fc6f8150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 --2- 172.21.15.7:0/999324141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f80cb970 0x7fc6f81556a0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 >> 172.21.15.7:0/999324141 conn(0x7fc6f8070e30 msgr2=0x7fc6f80c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:11.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 shutdown_connections 2023-10-14T19:11:11.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.546+0000 7fc6ffe27700 1 -- 172.21.15.7:0/999324141 wait complete. 2023-10-14T19:11:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:11:11.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:11:11.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.682+0000 7f783dfa2700 1 Processor -- start 2023-10-14T19:11:11.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.682+0000 7f783dfa2700 1 -- start start 2023-10-14T19:11:11.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f783dfa2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7838159530 0x7f78380ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f783dfa2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f783806e0e0 0x7f78380cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f783dfa2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380ccfd0 con 0x7f783806dc70 2023-10-14T19:11:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f783dfa2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78380cf0e0 con 0x7f7838159530 2023-10-14T19:11:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f783dfa2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783815a3d0 con 0x7f783806e0e0 2023-10-14T19:11:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f78377fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7838159530 0x7f78380ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f7836ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f783806dc70 0x7f7838159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42094/0 (socket says 172.21.15.7:42094) 2023-10-14T19:11:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f7836ffd700 1 -- 172.21.15.7:0/1131912586 learned_addr learned my addr 172.21.15.7:0/1131912586 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f7837fff700 1 --2- 172.21.15.7:0/1131912586 >> v2:172.21.15.148:3300/0 conn(0x7f783806e0e0 0x7f78380cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f78377fe700 1 -- 172.21.15.7:0/1131912586 >> v2:172.21.15.148:3300/0 conn(0x7f783806e0e0 msgr2=0x7f78380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f78377fe700 1 --2- 172.21.15.7:0/1131912586 >> v2:172.21.15.148:3300/0 conn(0x7f783806e0e0 0x7f78380cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.683+0000 7f78377fe700 1 -- 172.21.15.7:0/1131912586 >> v1:172.21.15.7:6789/0 conn(0x7f783806dc70 legacy=0x7f7838159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f78367fc700 1 -- 172.21.15.7:0/1131912586 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699841463 0 0) 0x7f78380ccfd0 con 0x7f783806dc70 2023-10-14T19:11:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f78377fe700 1 -- 172.21.15.7:0/1131912586 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783815a6b0 con 0x7f7838159530 2023-10-14T19:11:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f7837fff700 1 --2- 172.21.15.7:0/1131912586 >> v2:172.21.15.148:3300/0 conn(0x7f783806e0e0 0x7f78380cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f78377fe700 1 --2- 172.21.15.7:0/1131912586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7838159530 0x7f78380ceba0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f78380caef0 tx=0x7f78280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b430a0bcfae3fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f78367fc700 1 -- 172.21.15.7:0/1131912586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782800b6b0 con 0x7f7838159530 2023-10-14T19:11:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f78367fc700 1 -- 172.21.15.7:0/1131912586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782800b810 con 0x7f7838159530 2023-10-14T19:11:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f78367fc700 1 -- 172.21.15.7:0/1131912586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782800bbb0 con 0x7f7838159530 2023-10-14T19:11:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f783dfa2700 1 -- 172.21.15.7:0/1131912586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7838159530 msgr2=0x7f78380ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.684+0000 7f783dfa2700 1 --2- 172.21.15.7:0/1131912586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7838159530 0x7f78380ceba0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f78380caef0 tx=0x7f78280091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.685+0000 7f783dfa2700 1 -- 172.21.15.7:0/1131912586 shutdown_connections 2023-10-14T19:11:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.685+0000 7f783dfa2700 1 --2- 172.21.15.7:0/1131912586 >> v2:172.21.15.148:3300/0 conn(0x7f783806e0e0 0x7f78380cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.685+0000 7f783dfa2700 1 --2- 172.21.15.7:0/1131912586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7838159530 0x7f78380ceba0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.685+0000 7f783dfa2700 1 -- 172.21.15.7:0/1131912586 >> 172.21.15.7:0/1131912586 conn(0x7f78380703a0 msgr2=0x7f78380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.685+0000 7f783dfa2700 1 -- 172.21.15.7:0/1131912586 shutdown_connections 2023-10-14T19:11:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.685+0000 7f783dfa2700 1 -- 172.21.15.7:0/1131912586 wait complete. 2023-10-14T19:11:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.686+0000 7f783dfa2700 1 Processor -- start 2023-10-14T19:11:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.686+0000 7f783dfa2700 1 -- start start 2023-10-14T19:11:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 0x7f78380b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f783806e0e0 0x7f783814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7838159530 0x7f78381530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b52f0 con 0x7f783806dc70 2023-10-14T19:11:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b46e0 con 0x7f783806e0e0 2023-10-14T19:11:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b49c0 con 0x7f7838159530 2023-10-14T19:11:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 0x7f78380b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 0x7f78380b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42248/0 (socket says 172.21.15.7:42248) 2023-10-14T19:11:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 -- 172.21.15.7:0/3570553953 learned_addr learned my addr 172.21.15.7:0/3570553953 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f7836ffd700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f783806e0e0 0x7f783814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f7837fff700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7838159530 0x7f78381530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 -- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7838159530 msgr2=0x7f78381530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7838159530 0x7f78381530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 -- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f783806e0e0 msgr2=0x7f783814e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f783806e0e0 0x7f783814e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 -- 172.21.15.7:0/3570553953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828009420 con 0x7f783806dc70 2023-10-14T19:11:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f7836ffd700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f783806e0e0 0x7f783814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f78377fe700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 0x7f78380b3e60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f78280097b0 tx=0x7f7828017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828011420 con 0x7f783806dc70 2023-10-14T19:11:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280115a0 con 0x7f783806dc70 2023-10-14T19:11:11.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380b4ca0 con 0x7f783806dc70 2023-10-14T19:11:11.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828011960 con 0x7f783806dc70 2023-10-14T19:11:11.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.687+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78380b43a0 con 0x7f783806dc70 2023-10-14T19:11:11.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.688+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783804c3c0 con 0x7f783806dc70 2023-10-14T19:11:11.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.689+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7828011cd0 con 0x7f783806dc70 2023-10-14T19:11:11.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.689+0000 7f781f7fe700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7824067320 0x7f78240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:11.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.689+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7828085db0 con 0x7f783806dc70 2023-10-14T19:11:11.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.689+0000 7f7836ffd700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7824067320 0x7f78240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:11.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.690+0000 7f7836ffd700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7824067320 0x7f78240697d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7838153ca0 tx=0x7f782c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:11.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.694+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f782808a070 con 0x7f783806dc70 2023-10-14T19:11:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.887+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f783815a990 con 0x7f783806dc70 2023-10-14T19:11:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.887+0000 7f781f7fe700 1 -- 172.21.15.7:0/3570553953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7828015020 con 0x7f783806dc70 2023-10-14T19:11:11.888 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:11:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7824067320 msgr2=0x7f78240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7824067320 0x7f78240697d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7838153ca0 tx=0x7f782c009040 comp rx=0 tx=0).stop 2023-10-14T19:11:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 msgr2=0x7f78380b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 0x7f78380b3e60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f78280097b0 tx=0x7f7828017000 comp rx=0 tx=0).stop 2023-10-14T19:11:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 shutdown_connections 2023-10-14T19:11:11.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7824067320 0x7f78240697d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7838159530 0x7f78381530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f783806dc70 0x7f78380b3e60 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 --2- 172.21.15.7:0/3570553953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f783806e0e0 0x7f783814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:11.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 >> 172.21.15.7:0/3570553953 conn(0x7f78380703a0 msgr2=0x7f78380cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:11.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 shutdown_connections 2023-10-14T19:11:11.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:11.889+0000 7f783dfa2700 1 -- 172.21.15.7:0/3570553953 wait complete. 2023-10-14T19:11:11.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:11:12.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 Processor -- start 2023-10-14T19:11:12.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 -- start start 2023-10-14T19:11:12.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80af1c0 0x7f74a80c9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74a80c98d0 0x7f74a806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80c9d70 con 0x7f74a80aedf0 2023-10-14T19:11:12.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8157c50 con 0x7f74a80c98d0 2023-10-14T19:11:12.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74ad9b8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a806cd20 con 0x7f74a80af1c0 2023-10-14T19:11:12.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f74a80aedf0 0x7f74a815b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42108/0 (socket says 172.21.15.7:42108) 2023-10-14T19:11:12.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a6ffd700 1 -- 172.21.15.7:0/1600081085 learned_addr learned my addr 172.21.15.7:0/1600081085 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:12.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a77fe700 1 --2- 172.21.15.7:0/1600081085 >> v2:172.21.15.7:3300/0 conn(0x7f74a80c98d0 0x7f74a806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a5ffb700 1 -- 172.21.15.7:0/1600081085 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743310682 0 0) 0x7f74a80c9d70 con 0x7f74a80aedf0 2023-10-14T19:11:12.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a5ffb700 1 -- 172.21.15.7:0/1600081085 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7490003570 con 0x7f74a80aedf0 2023-10-14T19:11:12.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a67fc700 1 --2- 172.21.15.7:0/1600081085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80af1c0 0x7f74a80c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a77fe700 1 -- 172.21.15.7:0/1600081085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80af1c0 msgr2=0x7f74a80c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:12.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a77fe700 1 --2- 172.21.15.7:0/1600081085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80af1c0 0x7f74a80c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a77fe700 1 -- 172.21.15.7:0/1600081085 >> v1:172.21.15.7:6789/0 conn(0x7f74a80aedf0 legacy=0x7f74a815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a77fe700 1 -- 172.21.15.7:0/1600081085 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a806c740 con 0x7f74a80c98d0 2023-10-14T19:11:12.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a77fe700 1 --2- 172.21.15.7:0/1600081085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80c98d0 0x7f74a806d1b0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009e60 tx=0x7f74a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa94cf6e9535896 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:12.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a5ffb700 1 -- 172.21.15.7:0/1600081085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000e070 con 0x7f74a80c98d0 2023-10-14T19:11:12.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a5ffb700 1 -- 172.21.15.7:0/1600081085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000bb60 con 0x7f74a80c98d0 2023-10-14T19:11:12.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.024+0000 7f74a5ffb700 1 -- 172.21.15.7:0/1600081085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0012430 con 0x7f74a80c98d0 2023-10-14T19:11:12.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1600081085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80c98d0 msgr2=0x7f74a806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1600081085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80c98d0 0x7f74a806d1b0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009e60 tx=0x7f74a0009780 comp rx=0 tx=0).stop 2023-10-14T19:11:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1600081085 shutdown_connections 2023-10-14T19:11:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1600081085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80c98d0 0x7f74a806d1b0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1600081085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80af1c0 0x7f74a80c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1600081085 >> 172.21.15.7:0/1600081085 conn(0x7f74a806e710 msgr2=0x7f74a806eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1600081085 shutdown_connections 2023-10-14T19:11:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.025+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1600081085 wait complete. 2023-10-14T19:11:12.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.026+0000 7f74ad9b8700 1 Processor -- start 2023-10-14T19:11:12.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.026+0000 7f74ad9b8700 1 -- start start 2023-10-14T19:11:12.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74ad9b8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 0x7f74a80c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74ad9b8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74a80af1c0 0x7f74a8154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74ad9b8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80c98d0 0x7f74a80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74ad9b8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c08a0 con 0x7f74a80aedf0 2023-10-14T19:11:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74ad9b8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8158b40 con 0x7f74a80af1c0 2023-10-14T19:11:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74ad9b8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8157f30 con 0x7f74a80c98d0 2023-10-14T19:11:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 0x7f74a80c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 0x7f74a80c0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42272/0 (socket says 172.21.15.7:42272) 2023-10-14T19:11:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 -- 172.21.15.7:0/1031578331 learned_addr learned my addr 172.21.15.7:0/1031578331 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a77fe700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80c98d0 0x7f74a80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a67fc700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74a80af1c0 0x7f74a8154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 -- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80c98d0 msgr2=0x7f74a80caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80c98d0 0x7f74a80caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 -- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74a80af1c0 msgr2=0x7f74a8154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74a80af1c0 0x7f74a8154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a6ffd700 1 -- 172.21.15.7:0/1031578331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0009a20 con 0x7f74a80aedf0 2023-10-14T19:11:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a77fe700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80c98d0 0x7f74a80caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.027+0000 7f74a67fc700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74a80af1c0 0x7f74a8154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.028+0000 7f74a6ffd700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 0x7f74a80c0360 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f749c0011e0 tx=0x7f749c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.028+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c005b30 con 0x7f74a80aedf0 2023-10-14T19:11:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.028+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c005c90 con 0x7f74a80aedf0 2023-10-14T19:11:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.028+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a8158210 con 0x7f74a80aedf0 2023-10-14T19:11:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.028+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c007320 con 0x7f74a80aedf0 2023-10-14T19:11:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.028+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a81587d0 con 0x7f74a80aedf0 2023-10-14T19:11:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.029+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804c3c0 con 0x7f74a80aedf0 2023-10-14T19:11:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.029+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f749c007690 con 0x7f74a80aedf0 2023-10-14T19:11:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.031+0000 7f748effd700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7494067320 0x7f74940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.031+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f749c083e20 con 0x7f74a80aedf0 2023-10-14T19:11:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.031+0000 7f74a67fc700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7494067320 0x7f74940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.031+0000 7f74a67fc700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7494067320 0x7f74940697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f74a80cb6a0 tx=0x7f7498008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.034+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f749c050e00 con 0x7f74a80aedf0 2023-10-14T19:11:12.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.230+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74a80ca2f0 con 0x7f74a80aedf0 2023-10-14T19:11:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.231+0000 7f748effd700 1 -- 172.21.15.7:0/1031578331 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) v1 ==== 84+0+65 (secure 0 0 0) 0x7f749c017020 con 0x7f74a80aedf0 2023-10-14T19:11:12.231 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:12.231 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:11:12.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:12.232 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:11:12.232 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:11:12.232 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:12.232 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:11:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7494067320 msgr2=0x7f74940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7494067320 0x7f74940697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f74a80cb6a0 tx=0x7f7498008040 comp rx=0 tx=0).stop 2023-10-14T19:11:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 msgr2=0x7f74a80c0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 0x7f74a80c0360 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f749c0011e0 tx=0x7f749c007df0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 shutdown_connections 2023-10-14T19:11:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7494067320 0x7f74940697d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74a80c98d0 0x7f74a80caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74a80aedf0 0x7f74a80c0360 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 --2- 172.21.15.7:0/1031578331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74a80af1c0 0x7f74a8154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 >> 172.21.15.7:0/1031578331 conn(0x7f74a806e710 msgr2=0x7f74a80cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 shutdown_connections 2023-10-14T19:11:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.233+0000 7f74ad9b8700 1 -- 172.21.15.7:0/1031578331 wait complete. 2023-10-14T19:11:12.245 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:11:12.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:11:12.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.370+0000 7f8dc4f74700 1 Processor -- start 2023-10-14T19:11:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.370+0000 7f8dc4f74700 1 -- start start 2023-10-14T19:11:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dc4f74700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 0x7f8dc0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dc4f74700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc00ccfd0 con 0x7f8dc0159530 2023-10-14T19:11:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dc4f74700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc015a410 con 0x7f8dc0159e40 2023-10-14T19:11:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dc4f74700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc015a6f0 con 0x7f8dc006dcf0 2023-10-14T19:11:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dbe59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8dc0159530 0x7f8dc00ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42110/0 (socket says 172.21.15.7:42110) 2023-10-14T19:11:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dbe59c700 1 -- 172.21.15.7:0/496307265 learned_addr learned my addr 172.21.15.7:0/496307265 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866661940 0 0) 0x7f8dc00ccfd0 con 0x7f8dc0159530 2023-10-14T19:11:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003570 con 0x7f8dc0159530 2023-10-14T19:11:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.371+0000 7f8dbdd9b700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 0x7f8dc0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1813329681 0 0) 0x7f8dac003570 con 0x7f8dc0159530 2023-10-14T19:11:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 msgr2=0x7f8dc0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 0x7f8dc0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 >> v1:172.21.15.148:6789/0 conn(0x7f8dc0159e40 legacy=0x7f8dc00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc015a9d0 con 0x7f8dc0159530 2023-10-14T19:11:12.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8db8001470 con 0x7f8dc0159530 2023-10-14T19:11:12.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 >> v1:172.21.15.7:6789/0 conn(0x7f8dc0159530 legacy=0x7f8dc00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dac003a90 0x7f8dac003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 0x7f8dac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac004d50 0x7f8dac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc015a6f0 con 0x7f8dac003a90 2023-10-14T19:11:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac00bbf0 con 0x7f8dac004d50 2023-10-14T19:11:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac00bd80 con 0x7f8dc006dcf0 2023-10-14T19:11:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dac003a90 0x7f8dac003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbdd9b700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 0x7f8dac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbed9d700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac004d50 0x7f8dac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 -- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 msgr2=0x7f8dac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:12.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc006dcf0 0x7f8dac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 -- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac004d50 msgr2=0x7f8dac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac004d50 0x7f8dac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 -- 172.21.15.7:0/496307265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac003570 con 0x7f8dac003a90 2023-10-14T19:11:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbe59c700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dac003a90 0x7f8dac003ea0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f8db800c2d0 tx=0x7f8db8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff516698750c904 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:12.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800cba0 con 0x7f8dac003a90 2023-10-14T19:11:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db800cd20 con 0x7f8dac003a90 2023-10-14T19:11:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.372+0000 7f8dbd59a700 1 -- 172.21.15.7:0/496307265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8005b70 con 0x7f8dac003a90 2023-10-14T19:11:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dc4f74700 1 -- 172.21.15.7:0/496307265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dac003a90 msgr2=0x7f8dac003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/496307265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dac003a90 0x7f8dac003ea0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f8db800c2d0 tx=0x7f8db8001d80 comp rx=0 tx=0).stop 2023-10-14T19:11:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dbed9d700 1 -- 172.21.15.7:0/496307265 reap_dead start 2023-10-14T19:11:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dc4f74700 1 -- 172.21.15.7:0/496307265 shutdown_connections 2023-10-14T19:11:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dc4f74700 1 -- 172.21.15.7:0/496307265 >> 172.21.15.7:0/496307265 conn(0x7f8dc00703a0 msgr2=0x7f8dc00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dc4f74700 1 -- 172.21.15.7:0/496307265 shutdown_connections 2023-10-14T19:11:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.373+0000 7f8dc4f74700 1 -- 172.21.15.7:0/496307265 wait complete. 2023-10-14T19:11:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.374+0000 7f8dc4f74700 1 Processor -- start 2023-10-14T19:11:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.374+0000 7f8dc4f74700 1 -- start start 2023-10-14T19:11:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dc4f74700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac003a90 0x7f8dc00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dc4f74700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 0x7f8dc01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dc4f74700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc0157a00 0x7f8dc0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dc4f74700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00b6470 con 0x7f8dc00c8150 2023-10-14T19:11:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dc4f74700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0157e80 con 0x7f8dac003a90 2023-10-14T19:11:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dc4f74700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc016a610 con 0x7f8dc0157a00 2023-10-14T19:11:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 0x7f8dc01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 0x7f8dc01574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42290/0 (socket says 172.21.15.7:42290) 2023-10-14T19:11:12.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 -- 172.21.15.7:0/2838989527 learned_addr learned my addr 172.21.15.7:0/2838989527 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:12.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 -- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc0157a00 msgr2=0x7f8dc0155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc0157a00 0x7f8dc0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 -- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac003a90 msgr2=0x7f8dc00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac003a90 0x7f8dc00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 -- 172.21.15.7:0/2838989527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc016a8f0 con 0x7f8dc00c8150 2023-10-14T19:11:12.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.375+0000 7f8dbdd9b700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 0x7f8dc01574c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f8da80119c0 tx=0x7f8da8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:12.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.376+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800f6d0 con 0x7f8dc00c8150 2023-10-14T19:11:12.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.376+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da800f830 con 0x7f8dc00c8150 2023-10-14T19:11:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.376+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc016abd0 con 0x7f8dc00c8150 2023-10-14T19:11:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.376+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800fbf0 con 0x7f8dc00c8150 2023-10-14T19:11:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.376+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc016b190 con 0x7f8dc00c8150 2023-10-14T19:11:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.377+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc004c3c0 con 0x7f8dc00c8150 2023-10-14T19:11:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.377+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8da8015460 con 0x7f8dc00c8150 2023-10-14T19:11:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.377+0000 7f8db67fc700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8da0067320 0x7f8da00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.377+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8da8085090 con 0x7f8dc00c8150 2023-10-14T19:11:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.378+0000 7f8dbe59c700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8da0067320 0x7f8da00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.378+0000 7f8dbe59c700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8da0067320 0x7f8da00697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0157260 tx=0x7f8db8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:12.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.382+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8da8052070 con 0x7f8dc00c8150 2023-10-14T19:11:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.574+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8dc015acb0 con 0x7f8dc00c8150 2023-10-14T19:11:12.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.862+0000 7f8db67fc700 1 -- 172.21.15.7:0/2838989527 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8da8055690 con 0x7f8dc00c8150 2023-10-14T19:11:12.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8da0067320 msgr2=0x7f8da00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8da0067320 0x7f8da00697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0157260 tx=0x7f8db8015000 comp rx=0 tx=0).stop 2023-10-14T19:11:12.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 msgr2=0x7f8dc01574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:12.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 0x7f8dc01574c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f8da80119c0 tx=0x7f8da8008040 comp rx=0 tx=0).stop 2023-10-14T19:11:12.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 shutdown_connections 2023-10-14T19:11:12.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8da0067320 0x7f8da00697d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dac003a90 0x7f8dc00b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8dc0157a00 0x7f8dc0155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 --2- 172.21.15.7:0/2838989527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc00c8150 0x7f8dc01574c0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.865+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 >> 172.21.15.7:0/2838989527 conn(0x7f8dc00703a0 msgr2=0x7f8dc00cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:12.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.866+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 shutdown_connections 2023-10-14T19:11:12.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:12.867+0000 7f8dc4f74700 1 -- 172.21.15.7:0/2838989527 wait complete. 2023-10-14T19:11:12.868 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:11:12.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:11:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.010+0000 7f20352de700 1 Processor -- start 2023-10-14T19:11:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.010+0000 7f20352de700 1 -- start start 2023-10-14T19:11:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f20352de700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f203015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f20352de700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f203013ffd0 0x7f20300cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f20352de700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203015a600 con 0x7f20300cb330 2023-10-14T19:11:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f20352de700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2030159fd0 con 0x7f203013ffd0 2023-10-14T19:11:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f20352de700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300cb8b0 con 0x7f203013fc00 2023-10-14T19:11:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f202f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f20300cb330 0x7f203006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42126/0 (socket says 172.21.15.7:42126) 2023-10-14T19:11:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.011+0000 7f202f7fe700 1 -- 172.21.15.7:0/52501755 learned_addr learned my addr 172.21.15.7:0/52501755 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202e7fc700 1 --2- 172.21.15.7:0/52501755 >> v2:172.21.15.148:3300/0 conn(0x7f203013ffd0 0x7f20300cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:13.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202effd700 1 --2- 172.21.15.7:0/52501755 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f203015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:13.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202dffb700 1 -- 172.21.15.7:0/52501755 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666632175 0 0) 0x7f203015a600 con 0x7f20300cb330 2023-10-14T19:11:13.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202dffb700 1 -- 172.21.15.7:0/52501755 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c003570 con 0x7f20300cb330 2023-10-14T19:11:13.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202dffb700 1 -- 172.21.15.7:0/52501755 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040596512 0 0) 0x7f201c003570 con 0x7f20300cb330 2023-10-14T19:11:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202effd700 1 -- 172.21.15.7:0/52501755 >> v2:172.21.15.148:3300/0 conn(0x7f203013ffd0 msgr2=0x7f20300cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202effd700 1 --2- 172.21.15.7:0/52501755 >> v2:172.21.15.148:3300/0 conn(0x7f203013ffd0 0x7f20300cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202effd700 1 -- 172.21.15.7:0/52501755 >> v1:172.21.15.7:6789/0 conn(0x7f20300cb330 legacy=0x7f203006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202effd700 1 -- 172.21.15.7:0/52501755 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300cbb90 con 0x7f203013fc00 2023-10-14T19:11:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202e7fc700 1 --2- 172.21.15.7:0/52501755 >> v2:172.21.15.148:3300/0 conn(0x7f203013ffd0 0x7f20300cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202effd700 1 --2- 172.21.15.7:0/52501755 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f203015aa90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20280098e0 tx=0x7f20280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694b301c695c31fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202dffb700 1 -- 172.21.15.7:0/52501755 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200017f0 con 0x7f203013fc00 2023-10-14T19:11:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202dffb700 1 -- 172.21.15.7:0/52501755 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028011420 con 0x7f203013fc00 2023-10-14T19:11:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.012+0000 7f202dffb700 1 -- 172.21.15.7:0/52501755 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280117a0 con 0x7f203013fc00 2023-10-14T19:11:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 -- 172.21.15.7:0/52501755 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 msgr2=0x7f203015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 --2- 172.21.15.7:0/52501755 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f203015aa90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20280098e0 tx=0x7f20280091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 -- 172.21.15.7:0/52501755 shutdown_connections 2023-10-14T19:11:13.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 --2- 172.21.15.7:0/52501755 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f203015aa90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 --2- 172.21.15.7:0/52501755 >> v2:172.21.15.148:3300/0 conn(0x7f203013ffd0 0x7f20300cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 -- 172.21.15.7:0/52501755 >> 172.21.15.7:0/52501755 conn(0x7f203006e280 msgr2=0x7f20300cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:13.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 -- 172.21.15.7:0/52501755 shutdown_connections 2023-10-14T19:11:13.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.013+0000 7f20352de700 1 -- 172.21.15.7:0/52501755 wait complete. 2023-10-14T19:11:13.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.014+0000 7f20352de700 1 Processor -- start 2023-10-14T19:11:13.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.014+0000 7f20352de700 1 -- start start 2023-10-14T19:11:13.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f20352de700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 0x7f20300af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:13.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f20352de700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f20301678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:13.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f20352de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f203013ffd0 0x7f2030155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:13.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f20352de700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2030168910 con 0x7f20300cb330 2023-10-14T19:11:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f20352de700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20300b1660 con 0x7f203013ffd0 2023-10-14T19:11:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f20352de700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2030167df0 con 0x7f203013fc00 2023-10-14T19:11:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 0x7f20300af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 0x7f20300af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42306/0 (socket says 172.21.15.7:42306) 2023-10-14T19:11:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 -- 172.21.15.7:0/1984500781 learned_addr learned my addr 172.21.15.7:0/1984500781 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202f7fe700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f203013ffd0 0x7f2030155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202e7fc700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f20301678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 -- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 msgr2=0x7f20301678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f20301678b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 -- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f203013ffd0 msgr2=0x7f2030155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:13.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f203013ffd0 0x7f2030155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 -- 172.21.15.7:0/1984500781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009420 con 0x7f20300cb330 2023-10-14T19:11:13.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202f7fe700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f203013ffd0 0x7f2030155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:13.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.015+0000 7f202effd700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 0x7f20300af650 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb9f0 tx=0x7f2028016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:13.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.016+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202801cba0 con 0x7f20300cb330 2023-10-14T19:11:13.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.016+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202801cd00 con 0x7f20300cb330 2023-10-14T19:11:13.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.016+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2028009420 con 0x7f20300cb330 2023-10-14T19:11:13.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.016+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202801a6a0 con 0x7f20300cb330 2023-10-14T19:11:13.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.016+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2030168350 con 0x7f20300cb330 2023-10-14T19:11:13.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.017+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203004c3c0 con 0x7f20300cb330 2023-10-14T19:11:13.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.017+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f202801aa10 con 0x7f20300cb330 2023-10-14T19:11:13.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.017+0000 7f2026ffd700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2010067320 0x7f20100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:13.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.018+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f20280864c0 con 0x7f20300cb330 2023-10-14T19:11:13.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.018+0000 7f202e7fc700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2010067320 0x7f20100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:13.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.018+0000 7f202e7fc700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2010067320 0x7f20100697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f20180093f0 tx=0x7f2018008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:13.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.022+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2028053330 con 0x7f20300cb330 2023-10-14T19:11:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.213+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f20300cdf60 con 0x7f20300cb330 2023-10-14T19:11:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.869+0000 7f2026ffd700 1 -- 172.21.15.7:0/1984500781 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2028056950 con 0x7f20300cb330 2023-10-14T19:11:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2010067320 msgr2=0x7f20100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2010067320 0x7f20100697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f20180093f0 tx=0x7f2018008040 comp rx=0 tx=0).stop 2023-10-14T19:11:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 msgr2=0x7f20300af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 0x7f20300af650 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb9f0 tx=0x7f2028016000 comp rx=0 tx=0).stop 2023-10-14T19:11:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 shutdown_connections 2023-10-14T19:11:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2010067320 0x7f20100697d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f203013ffd0 0x7f2030155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20300cb330 0x7f20300af650 secure :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb9f0 tx=0x7f2028016000 comp rx=0 tx=0).stop 2023-10-14T19:11:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 --2- 172.21.15.7:0/1984500781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f203013fc00 0x7f20301678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.878+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 >> 172.21.15.7:0/1984500781 conn(0x7f203006e280 msgr2=0x7f203013eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:13.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.881+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 shutdown_connections 2023-10-14T19:11:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:13.881+0000 7f20352de700 1 -- 172.21.15.7:0/1984500781 wait complete. 2023-10-14T19:11:13.884 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:11:13.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:11:14.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.023+0000 7fb3a3076700 1 Processor -- start 2023-10-14T19:11:14.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.023+0000 7fb3a3076700 1 -- start start 2023-10-14T19:11:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.024+0000 7fb3a3076700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb39c0cd6b0 0x7fb39c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.024+0000 7fb3a3076700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c0cf510 con 0x7fb39c159860 2023-10-14T19:11:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.024+0000 7fb3a3076700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c0ce6a0 con 0x7fb39c0ce220 2023-10-14T19:11:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.024+0000 7fb3a3076700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c0d00b0 con 0x7fb39c0cd6b0 2023-10-14T19:11:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.024+0000 7fb3a0e12700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb39c159860 0x7fb39c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42140/0 (socket says 172.21.15.7:42140) 2023-10-14T19:11:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.024+0000 7fb3a0e12700 1 -- 172.21.15.7:0/2506853770 learned_addr learned my addr 172.21.15.7:0/2506853770 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 --2- 172.21.15.7:0/2506853770 >> v2:172.21.15.148:3300/0 conn(0x7fb39c0cd6b0 0x7fb39c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946330438 0 0) 0x7fb39c0cf510 con 0x7fb39c159860 2023-10-14T19:11:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb388003570 con 0x7fb39c159860 2023-10-14T19:11:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799433855 0 0) 0x7fb388003570 con 0x7fb39c159860 2023-10-14T19:11:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 >> v2:172.21.15.148:3300/0 conn(0x7fb39c0cd6b0 msgr2=0x7fb39c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:14.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 --2- 172.21.15.7:0/2506853770 >> v2:172.21.15.148:3300/0 conn(0x7fb39c0cd6b0 0x7fb39c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 >> v1:172.21.15.148:6789/0 conn(0x7fb39c0ce220 legacy=0x7fb39c0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0ce900 con 0x7fb39c159860 2023-10-14T19:11:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fb3940015f0 con 0x7fb39c159860 2023-10-14T19:11:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 >> v1:172.21.15.7:6789/0 conn(0x7fb39c159860 legacy=0x7fb39c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb388003a60 0x7fb388003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb388004810 0x7fb388004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880051c0 0x7fb38800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0d00b0 con 0x7fb3880051c0 2023-10-14T19:11:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800c0d0 con 0x7fb388004810 2023-10-14T19:11:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800c290 con 0x7fb388003a60 2023-10-14T19:11:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880051c0 0x7fb38800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a0e12700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb388003a60 0x7fb388003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb39bfff700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb388004810 0x7fb388004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 -- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb388003a60 msgr2=0x7fb388003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb388003a60 0x7fb388003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 -- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb388004810 msgr2=0x7fb388004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb388004810 0x7fb388004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.025+0000 7fb3a1613700 1 -- 172.21.15.7:0/2506853770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388003570 con 0x7fb3880051c0 2023-10-14T19:11:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a1613700 1 -- 172.21.15.7:0/2506853770 reap_dead start 2023-10-14T19:11:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a1613700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880051c0 0x7fb38800ba60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb384009c00 tx=0x7fb3840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af88f9efd5944df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400e710 con 0x7fb3880051c0 2023-10-14T19:11:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400e890 con 0x7fb3880051c0 2023-10-14T19:11:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb39b7fe700 1 -- 172.21.15.7:0/2506853770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400ec50 con 0x7fb3880051c0 2023-10-14T19:11:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 -- 172.21.15.7:0/2506853770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880051c0 msgr2=0x7fb38800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880051c0 0x7fb38800ba60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb384009c00 tx=0x7fb3840091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 -- 172.21.15.7:0/2506853770 shutdown_connections 2023-10-14T19:11:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 --2- 172.21.15.7:0/2506853770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3880051c0 0x7fb38800ba60 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 -- 172.21.15.7:0/2506853770 >> 172.21.15.7:0/2506853770 conn(0x7fb39c0999b0 msgr2=0x7fb39c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 -- 172.21.15.7:0/2506853770 shutdown_connections 2023-10-14T19:11:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.026+0000 7fb3a3076700 1 -- 172.21.15.7:0/2506853770 wait complete. 2023-10-14T19:11:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.027+0000 7fb3a3076700 1 Processor -- start 2023-10-14T19:11:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 -- start start 2023-10-14T19:11:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880051c0 0x7fb39c0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb39c09d2a0 0x7fb39c09d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 0x7fb39c169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c09dc50 con 0x7fb39c169570 2023-10-14T19:11:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0c9b30 con 0x7fb3880051c0 2023-10-14T19:11:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.028+0000 7fb3a3076700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0c9fc0 con 0x7fb39c09d2a0 2023-10-14T19:11:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 0x7fb39c169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 0x7fb39c169a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42324/0 (socket says 172.21.15.7:42324) 2023-10-14T19:11:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 -- 172.21.15.7:0/665435936 learned_addr learned my addr 172.21.15.7:0/665435936 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a0e12700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880051c0 0x7fb39c0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb39bfff700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb39c09d2a0 0x7fb39c09d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 -- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb39c09d2a0 msgr2=0x7fb39c09d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb39c09d2a0 0x7fb39c09d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 -- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880051c0 msgr2=0x7fb39c0c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880051c0 0x7fb39c0c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 -- 172.21.15.7:0/665435936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0c8f20 con 0x7fb39c169570 2023-10-14T19:11:14.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a1613700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 0x7fb39c169a10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb39c088950 tx=0x7fb384019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384006e50 con 0x7fb39c169570 2023-10-14T19:11:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400e710 con 0x7fb39c169570 2023-10-14T19:11:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38401c6c0 con 0x7fb39c169570 2023-10-14T19:11:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c0c9200 con 0x7fb39c169570 2023-10-14T19:11:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.029+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c0c97c0 con 0x7fb39c169570 2023-10-14T19:11:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.030+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c0c9ce0 con 0x7fb39c169570 2023-10-14T19:11:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.031+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb38401ca70 con 0x7fb39c169570 2023-10-14T19:11:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.031+0000 7fb398ff9700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb37c067320 0x7fb37c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.031+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb384086960 con 0x7fb39c169570 2023-10-14T19:11:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.032+0000 7fb3a0e12700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb37c067320 0x7fb37c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.032+0000 7fb3a0e12700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb37c067320 0x7fb37c0697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb394007a30 tx=0x7fb394009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.035+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb384053750 con 0x7fb39c169570 2023-10-14T19:11:14.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.274+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb39c0c9ca0 con 0x7fb39c169570 2023-10-14T19:11:14.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.886+0000 7fb398ff9700 1 -- 172.21.15.7:0/665435936 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v107) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb38402d0c0 con 0x7fb39c169570 2023-10-14T19:11:14.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb37c067320 msgr2=0x7fb37c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb37c067320 0x7fb37c0697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb394007a30 tx=0x7fb394009040 comp rx=0 tx=0).stop 2023-10-14T19:11:14.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 msgr2=0x7fb39c169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:14.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 0x7fb39c169a10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb39c088950 tx=0x7fb384019000 comp rx=0 tx=0).stop 2023-10-14T19:11:14.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 shutdown_connections 2023-10-14T19:11:14.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb37c067320 0x7fb37c0697d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3880051c0 0x7fb39c0c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb39c169570 0x7fb39c169a10 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 --2- 172.21.15.7:0/665435936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb39c09d2a0 0x7fb39c09d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:14.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 >> 172.21.15.7:0/665435936 conn(0x7fb39c0999b0 msgr2=0x7fb39c0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:14.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 shutdown_connections 2023-10-14T19:11:14.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:14.905+0000 7fb3a3076700 1 -- 172.21.15.7:0/665435936 wait complete. 2023-10-14T19:11:14.908 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 28 and data pool 29 2023-10-14T19:11:14.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:15.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.042+0000 7ff23c8fb700 1 Processor -- start 2023-10-14T19:11:15.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.042+0000 7ff23c8fb700 1 -- start start 2023-10-14T19:11:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff23c8fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 0x7ff23815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff23c8fb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23815afd0 con 0x7ff23815de50 2023-10-14T19:11:15.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff23c8fb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23815b2b0 con 0x7ff2380cf110 2023-10-14T19:11:15.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff23c8fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23815b590 con 0x7ff238153c30 2023-10-14T19:11:15.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff236ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff23815de50 0x7ff2380cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42144/0 (socket says 172.21.15.7:42144) 2023-10-14T19:11:15.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff236ffd700 1 -- 172.21.15.7:0/540470884 learned_addr learned my addr 172.21.15.7:0/540470884 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:15.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff2377fe700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 0x7ff23815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706385631 0 0) 0x7ff23815afd0 con 0x7ff23815de50 2023-10-14T19:11:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.043+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff220003570 con 0x7ff23815de50 2023-10-14T19:11:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343622236 0 0) 0x7ff23815b2b0 con 0x7ff2380cf110 2023-10-14T19:11:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff23815afd0 con 0x7ff2380cf110 2023-10-14T19:11:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1549884785 0 0) 0x7ff220003570 con 0x7ff23815de50 2023-10-14T19:11:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 msgr2=0x7ff23815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 0x7ff23815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 >> v1:172.21.15.148:6789/0 conn(0x7ff2380cf110 legacy=0x7ff23815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23815b870 con 0x7ff23815de50 2023-10-14T19:11:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff22c001470 con 0x7ff23815de50 2023-10-14T19:11:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 >> v1:172.21.15.7:6789/0 conn(0x7ff23815de50 legacy=0x7ff2380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 0x7ff220003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2200041d0 0x7ff220004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff220004d50 0x7ff2200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23815b590 con 0x7ff2200041d0 2023-10-14T19:11:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22000bbf0 con 0x7ff220004d50 2023-10-14T19:11:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22000bdb0 con 0x7ff238153c30 2023-10-14T19:11:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2200041d0 0x7ff220004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2377fe700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 0x7ff220003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff237fff700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff220004d50 0x7ff2200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 -- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 msgr2=0x7ff220003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff238153c30 0x7ff220003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 -- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff220004d50 msgr2=0x7ff2200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff220004d50 0x7ff2200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 -- 172.21.15.7:0/540470884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220003570 con 0x7ff2200041d0 2023-10-14T19:11:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff236ffd700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2200041d0 0x7ff220004810 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c1e0 tx=0x7ff22c001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a09db5cd21abeb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00cab0 con 0x7ff2200041d0 2023-10-14T19:11:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00cc10 con 0x7ff2200041d0 2023-10-14T19:11:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.044+0000 7ff2367fc700 1 -- 172.21.15.7:0/540470884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c005920 con 0x7ff2200041d0 2023-10-14T19:11:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff23c8fb700 1 -- 172.21.15.7:0/540470884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2200041d0 msgr2=0x7ff220004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/540470884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2200041d0 0x7ff220004810 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c1e0 tx=0x7ff22c001d40 comp rx=0 tx=0).stop 2023-10-14T19:11:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff237fff700 1 -- 172.21.15.7:0/540470884 reap_dead start 2023-10-14T19:11:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff23c8fb700 1 -- 172.21.15.7:0/540470884 shutdown_connections 2023-10-14T19:11:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff23c8fb700 1 -- 172.21.15.7:0/540470884 >> 172.21.15.7:0/540470884 conn(0x7ff2380703a0 msgr2=0x7ff2380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff23c8fb700 1 -- 172.21.15.7:0/540470884 shutdown_connections 2023-10-14T19:11:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.045+0000 7ff23c8fb700 1 -- 172.21.15.7:0/540470884 wait complete. 2023-10-14T19:11:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.046+0000 7ff23c8fb700 1 Processor -- start 2023-10-14T19:11:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.046+0000 7ff23c8fb700 1 -- start start 2023-10-14T19:11:15.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff23c8fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2200041d0 0x7ff238142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff23c8fb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 0x7ff23816a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff23c8fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2380c68f0 0x7ff2380c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff23c8fb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380b4930 con 0x7ff2380b32d0 2023-10-14T19:11:15.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff23c8fb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238143530 con 0x7ff2380c68f0 2023-10-14T19:11:15.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff23c8fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380c72a0 con 0x7ff2200041d0 2023-10-14T19:11:15.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 0x7ff23816a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 0x7ff23816a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42356/0 (socket says 172.21.15.7:42356) 2023-10-14T19:11:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 -- 172.21.15.7:0/1329260690 learned_addr learned my addr 172.21.15.7:0/1329260690 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff2377fe700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2200041d0 0x7ff238142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff237fff700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2380c68f0 0x7ff2380c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 -- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2200041d0 msgr2=0x7ff238142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2200041d0 0x7ff238142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 -- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2380c68f0 msgr2=0x7ff2380c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2380c68f0 0x7ff2380c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff236ffd700 1 -- 172.21.15.7:0/1329260690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23816acb0 con 0x7ff2380b32d0 2023-10-14T19:11:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.047+0000 7ff2377fe700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2200041d0 0x7ff238142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.048+0000 7ff236ffd700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 0x7ff23816a770 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff22c000fd0 tx=0x7ff22c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.048+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00ce50 con 0x7ff2380b32d0 2023-10-14T19:11:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.048+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0070d0 con 0x7ff2380b32d0 2023-10-14T19:11:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.048+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2380b3890 con 0x7ff2380b32d0 2023-10-14T19:11:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.048+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c007490 con 0x7ff2380b32d0 2023-10-14T19:11:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.048+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2380b3e50 con 0x7ff2380b32d0 2023-10-14T19:11:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.049+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23804c3c0 con 0x7ff2380b32d0 2023-10-14T19:11:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.049+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff22c01f410 con 0x7ff2380b32d0 2023-10-14T19:11:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.050+0000 7ff21f7fe700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff224067320 0x7ff2240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.050+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff22c0863a0 con 0x7ff2380b32d0 2023-10-14T19:11:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.050+0000 7ff2377fe700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff224067320 0x7ff2240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.050+0000 7ff2377fe700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff224067320 0x7ff2240697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff228006dc0 tx=0x7ff228008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.054+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff22c053030 con 0x7ff2380b32d0 2023-10-14T19:11:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.249+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff23815bb50 con 0x7ff2380b32d0 2023-10-14T19:11:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.250+0000 7ff21f7fe700 1 -- 172.21.15.7:0/1329260690 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15329 (secure 0 0 0) 0x7ff22c056650 con 0x7ff2380b32d0 2023-10-14T19:11:15.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:15.250 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":164,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:14.274673+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff224067320 msgr2=0x7ff2240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff224067320 0x7ff2240697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff228006dc0 tx=0x7ff228008040 comp rx=0 tx=0).stop 2023-10-14T19:11:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 msgr2=0x7ff23816a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 0x7ff23816a770 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff22c000fd0 tx=0x7ff22c015000 comp rx=0 tx=0).stop 2023-10-14T19:11:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 shutdown_connections 2023-10-14T19:11:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff224067320 0x7ff2240697d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2380c68f0 0x7ff2380c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2200041d0 0x7ff238142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 --2- 172.21.15.7:0/1329260690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2380b32d0 0x7ff23816a770 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 >> 172.21.15.7:0/1329260690 conn(0x7ff2380703a0 msgr2=0x7ff2380d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 shutdown_connections 2023-10-14T19:11:15.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.252+0000 7ff23c8fb700 1 -- 172.21.15.7:0/1329260690 wait complete. 2023-10-14T19:11:15.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.385+0000 7f3dff092700 1 Processor -- start 2023-10-14T19:11:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.385+0000 7f3dff092700 1 -- start start 2023-10-14T19:11:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dff092700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dff092700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3df813fef0 0x7f3df80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dff092700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3df806aaa0 0x7f3df80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dff092700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80c8410 con 0x7f3df806aaa0 2023-10-14T19:11:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dff092700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df815ae70 con 0x7f3df813fef0 2023-10-14T19:11:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dff092700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df806af60 con 0x7f3df813fb20 2023-10-14T19:11:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3df806aaa0 0x7f3df80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3df806aaa0 0x7f3df80c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42358/0 (socket says 172.21.15.7:42358) 2023-10-14T19:11:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 -- 172.21.15.7:0/729250256 learned_addr learned my addr 172.21.15.7:0/729250256 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe090700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfd88f700 1 --2- 172.21.15.7:0/729250256 >> v2:172.21.15.148:3300/0 conn(0x7f3df813fef0 0x7f3df80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 -- 172.21.15.7:0/729250256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 msgr2=0x7f3df815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 -- 172.21.15.7:0/729250256 >> v2:172.21.15.148:3300/0 conn(0x7f3df813fef0 msgr2=0x7f3df80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 --2- 172.21.15.7:0/729250256 >> v2:172.21.15.148:3300/0 conn(0x7f3df813fef0 0x7f3df80c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 -- 172.21.15.7:0/729250256 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df806b240 con 0x7f3df806aaa0 2023-10-14T19:11:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfd88f700 1 --2- 172.21.15.7:0/729250256 >> v2:172.21.15.148:3300/0 conn(0x7f3df813fef0 0x7f3df80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe090700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.386+0000 7f3dfe891700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df806aaa0 0x7f3df80c7ed0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3df80cc090 tx=0x7f3df0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bd9550ce38b303 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dfd08e700 1 -- 172.21.15.7:0/729250256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000e070 con 0x7f3df806aaa0 2023-10-14T19:11:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dfd08e700 1 -- 172.21.15.7:0/729250256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000ba50 con 0x7f3df806aaa0 2023-10-14T19:11:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dfd08e700 1 -- 172.21.15.7:0/729250256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00092e0 con 0x7f3df806aaa0 2023-10-14T19:11:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 -- 172.21.15.7:0/729250256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df806aaa0 msgr2=0x7f3df80c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df806aaa0 0x7f3df80c7ed0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3df80cc090 tx=0x7f3df0009840 comp rx=0 tx=0).stop 2023-10-14T19:11:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 -- 172.21.15.7:0/729250256 shutdown_connections 2023-10-14T19:11:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df806aaa0 0x7f3df80c7ed0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 --2- 172.21.15.7:0/729250256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 --2- 172.21.15.7:0/729250256 >> v2:172.21.15.148:3300/0 conn(0x7f3df813fef0 0x7f3df80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 -- 172.21.15.7:0/729250256 >> 172.21.15.7:0/729250256 conn(0x7f3df806d170 msgr2=0x7f3df80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:15.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 -- 172.21.15.7:0/729250256 shutdown_connections 2023-10-14T19:11:15.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.387+0000 7f3dff092700 1 -- 172.21.15.7:0/729250256 wait complete. 2023-10-14T19:11:15.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.388+0000 7f3dff092700 1 Processor -- start 2023-10-14T19:11:15.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.388+0000 7f3dff092700 1 -- start start 2023-10-14T19:11:15.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dff092700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3df806aaa0 0x7f3df8135140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dff092700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df8155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dff092700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 0x7f3df8156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dff092700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df814f510 con 0x7f3df813fef0 2023-10-14T19:11:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dff092700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8158000 con 0x7f3df806aaa0 2023-10-14T19:11:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dff092700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8157760 con 0x7f3df813fb20 2023-10-14T19:11:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dfe891700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 0x7f3df8156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dfe891700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 0x7f3df8156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42362/0 (socket says 172.21.15.7:42362) 2023-10-14T19:11:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dfe891700 1 -- 172.21.15.7:0/240643871 learned_addr learned my addr 172.21.15.7:0/240643871 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.389+0000 7f3dfe090700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3df806aaa0 0x7f3df8135140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfd88f700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df8155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfe891700 1 -- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 msgr2=0x7f3df8155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfe891700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df8155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfe891700 1 -- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3df806aaa0 msgr2=0x7f3df8135140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfe891700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3df806aaa0 0x7f3df8135140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfe891700 1 -- 172.21.15.7:0/240643871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009ae0 con 0x7f3df813fef0 2023-10-14T19:11:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfd88f700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df8155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dfe891700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 0x7f3df8156260 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f3df0012000 tx=0x7f3df0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00092e0 con 0x7f3df813fef0 2023-10-14T19:11:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0008dd0 con 0x7f3df813fef0 2023-10-14T19:11:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8157a40 con 0x7f3df813fef0 2023-10-14T19:11:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df001c660 con 0x7f3df813fef0 2023-10-14T19:11:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.390+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df814f720 con 0x7f3df813fef0 2023-10-14T19:11:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.391+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df814f910 con 0x7f3df813fef0 2023-10-14T19:11:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.391+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3df0003040 con 0x7f3df813fef0 2023-10-14T19:11:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.392+0000 7f3dee7fc700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ddc067320 0x7f3ddc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.392+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3df0086880 con 0x7f3df813fef0 2023-10-14T19:11:15.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.392+0000 7f3dfe090700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ddc067320 0x7f3ddc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.392+0000 7f3dfe090700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ddc067320 0x7f3ddc0697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006f00 tx=0x7f3df4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.396+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3df0053400 con 0x7f3df813fef0 2023-10-14T19:11:15.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.589+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3df804c3c0 con 0x7f3df813fef0 2023-10-14T19:11:15.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.590+0000 7f3dee7fc700 1 -- 172.21.15.7:0/240643871 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f3df0056a20 con 0x7f3df813fef0 2023-10-14T19:11:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:15.590 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":164,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:14.274673+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:15.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ddc067320 msgr2=0x7f3ddc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ddc067320 0x7f3ddc0697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006f00 tx=0x7f3df4008040 comp rx=0 tx=0).stop 2023-10-14T19:11:15.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 msgr2=0x7f3df8156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 0x7f3df8156260 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f3df0012000 tx=0x7f3df0018000 comp rx=0 tx=0).stop 2023-10-14T19:11:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 shutdown_connections 2023-10-14T19:11:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3ddc067320 0x7f3ddc0697d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3df806aaa0 0x7f3df8135140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df813fef0 0x7f3df8156260 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 --2- 172.21.15.7:0/240643871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3df813fb20 0x7f3df8155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 >> 172.21.15.7:0/240643871 conn(0x7f3df806d170 msgr2=0x7f3df80c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:15.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 shutdown_connections 2023-10-14T19:11:15.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.592+0000 7f3dff092700 1 -- 172.21.15.7:0/240643871 wait complete. 2023-10-14T19:11:15.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:11:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.726+0000 7f4079ce3700 1 Processor -- start 2023-10-14T19:11:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.726+0000 7f4079ce3700 1 -- start start 2023-10-14T19:11:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4079ce3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4074150c80 0x7f40740ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4079ce3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f40740675a0 0x7f40740679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4079ce3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40740cddf0 con 0x7f40741508b0 2023-10-14T19:11:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4079ce3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740b0360 con 0x7f40740675a0 2023-10-14T19:11:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4079ce3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4074067ee0 con 0x7f4074150c80 2023-10-14T19:11:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4073fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f40740675a0 0x7f40740679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4073fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f40740675a0 0x7f40740679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42374/0 (socket says 172.21.15.7:42374) 2023-10-14T19:11:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.727+0000 7f4073fff700 1 -- 172.21.15.7:0/4213593508 learned_addr learned my addr 172.21.15.7:0/4213593508 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f4072ffd700 1 --2- 172.21.15.7:0/4213593508 >> v2:172.21.15.148:3300/0 conn(0x7f4074150c80 0x7f40740ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f4073fff700 1 -- 172.21.15.7:0/4213593508 >> v2:172.21.15.148:3300/0 conn(0x7f4074150c80 msgr2=0x7f40740ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f4073fff700 1 --2- 172.21.15.7:0/4213593508 >> v2:172.21.15.148:3300/0 conn(0x7f4074150c80 0x7f40740ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f4073fff700 1 -- 172.21.15.7:0/4213593508 >> v1:172.21.15.148:6789/0 conn(0x7f40741508b0 legacy=0x7f40741573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f4073fff700 1 -- 172.21.15.7:0/4213593508 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740cd550 con 0x7f40740675a0 2023-10-14T19:11:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f4073fff700 1 --2- 172.21.15.7:0/4213593508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f40740679a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f407406a1f0 tx=0x7f406c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c94a1dc11fe272 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f40727fc700 1 -- 172.21.15.7:0/4213593508 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00e070 con 0x7f40740675a0 2023-10-14T19:11:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f40727fc700 1 -- 172.21.15.7:0/4213593508 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c00ba10 con 0x7f40740675a0 2023-10-14T19:11:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.728+0000 7f40727fc700 1 -- 172.21.15.7:0/4213593508 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c0092e0 con 0x7f40740675a0 2023-10-14T19:11:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 -- 172.21.15.7:0/4213593508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 msgr2=0x7f40740679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 --2- 172.21.15.7:0/4213593508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f40740679a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f407406a1f0 tx=0x7f406c009840 comp rx=0 tx=0).stop 2023-10-14T19:11:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 -- 172.21.15.7:0/4213593508 shutdown_connections 2023-10-14T19:11:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 --2- 172.21.15.7:0/4213593508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f40740679a0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 --2- 172.21.15.7:0/4213593508 >> v2:172.21.15.148:3300/0 conn(0x7f4074150c80 0x7f40740ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 -- 172.21.15.7:0/4213593508 >> 172.21.15.7:0/4213593508 conn(0x7f407406d7b0 msgr2=0x7f407406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 -- 172.21.15.7:0/4213593508 shutdown_connections 2023-10-14T19:11:15.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.729+0000 7f4079ce3700 1 -- 172.21.15.7:0/4213593508 wait complete. 2023-10-14T19:11:15.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.730+0000 7f4079ce3700 1 Processor -- start 2023-10-14T19:11:15.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.730+0000 7f4079ce3700 1 -- start start 2023-10-14T19:11:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f4074144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40741508b0 0x7f40740c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4074150c80 0x7f40740cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40740c46d0 con 0x7f40740675a0 2023-10-14T19:11:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40740c3ac0 con 0x7f40741508b0 2023-10-14T19:11:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40740c3da0 con 0x7f4074150c80 2023-10-14T19:11:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f4074144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f4074144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42390/0 (socket says 172.21.15.7:42390) 2023-10-14T19:11:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 -- 172.21.15.7:0/3958891245 learned_addr learned my addr 172.21.15.7:0/3958891245 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4072ffd700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40741508b0 0x7f40740c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4073fff700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4074150c80 0x7f40740cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 -- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4074150c80 msgr2=0x7f40740cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4074150c80 0x7f40740cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 -- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40741508b0 msgr2=0x7f40740c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:15.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40741508b0 0x7f40740c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:15.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 -- 172.21.15.7:0/3958891245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c009ae0 con 0x7f40740675a0 2023-10-14T19:11:15.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4073fff700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4074150c80 0x7f40740cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:15.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f40737fe700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f4074144ef0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f406400c5d0 tx=0x7f4064007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011590 con 0x7f40740675a0 2023-10-14T19:11:15.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064011710 con 0x7f40740675a0 2023-10-14T19:11:15.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011ad0 con 0x7f40740675a0 2023-10-14T19:11:15.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40740c4080 con 0x7f40740675a0 2023-10-14T19:11:15.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.731+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40740c51e0 con 0x7f40740675a0 2023-10-14T19:11:15.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.732+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407406b850 con 0x7f40740675a0 2023-10-14T19:11:15.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.733+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f406401c460 con 0x7f40740675a0 2023-10-14T19:11:15.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.733+0000 7f405b7fe700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4060067320 0x7f40600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:15.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.733+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40640849d0 con 0x7f40740675a0 2023-10-14T19:11:15.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.733+0000 7f4072ffd700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4060067320 0x7f40600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:15.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.734+0000 7f4072ffd700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4060067320 0x7f40600697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f40740c4bc0 tx=0x7f4068008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:15.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.737+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4064051660 con 0x7f40740675a0 2023-10-14T19:11:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:15.977+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f407404c3c0 con 0x7f40740675a0 2023-10-14T19:11:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.892+0000 7f405b7fe700 1 -- 172.21.15.7:0/3958891245 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v110) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4064054c80 con 0x7f40740675a0 2023-10-14T19:11:16.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4060067320 msgr2=0x7f40600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:16.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4060067320 0x7f40600697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f40740c4bc0 tx=0x7f4068008040 comp rx=0 tx=0).stop 2023-10-14T19:11:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 msgr2=0x7f4074144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f4074144ef0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f406400c5d0 tx=0x7f4064007f60 comp rx=0 tx=0).stop 2023-10-14T19:11:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 shutdown_connections 2023-10-14T19:11:16.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4060067320 0x7f40600697d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:16.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4074150c80 0x7f40740cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:16.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40740675a0 0x7f4074144ef0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:16.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 --2- 172.21.15.7:0/3958891245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40741508b0 0x7f40740c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:16.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 >> 172.21.15.7:0/3958891245 conn(0x7f407406d7b0 msgr2=0x7f407414fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:16.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 shutdown_connections 2023-10-14T19:11:16.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:16.895+0000 7f4079ce3700 1 -- 172.21.15.7:0/3958891245 wait complete. 2023-10-14T19:11:16.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:11:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.043+0000 7fbeb1177700 1 Processor -- start 2023-10-14T19:11:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.043+0000 7fbeb1177700 1 -- start start 2023-10-14T19:11:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.044+0000 7fbeb1177700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbeac13c9b0 0x7fbeac069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.044+0000 7fbeb1177700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac06f7d0 con 0x7fbeac0cc6f0 2023-10-14T19:11:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.044+0000 7fbeb1177700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac06d7b0 con 0x7fbeac0cc320 2023-10-14T19:11:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.044+0000 7fbeb1177700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac06e330 con 0x7fbeac13c9b0 2023-10-14T19:11:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.044+0000 7fbeab59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbeac0cc6f0 0x7fbeac069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42030/0 (socket says 172.21.15.7:42030) 2023-10-14T19:11:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.044+0000 7fbeab59e700 1 -- 172.21.15.7:0/432342765 learned_addr learned my addr 172.21.15.7:0/432342765 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbeaa59c700 1 --2- 172.21.15.7:0/432342765 >> v2:172.21.15.148:3300/0 conn(0x7fbeac13c9b0 0x7fbeac069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427159566 0 0) 0x7fbeac06f7d0 con 0x7fbeac0cc6f0 2023-10-14T19:11:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe98003570 con 0x7fbeac0cc6f0 2023-10-14T19:11:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3207901257 0 0) 0x7fbe98003570 con 0x7fbeac0cc6f0 2023-10-14T19:11:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 >> v2:172.21.15.148:3300/0 conn(0x7fbeac13c9b0 msgr2=0x7fbeac069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 --2- 172.21.15.7:0/432342765 >> v2:172.21.15.148:3300/0 conn(0x7fbeac13c9b0 0x7fbeac069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 >> v1:172.21.15.148:6789/0 conn(0x7fbeac0cc320 legacy=0x7fbeac13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac06da00 con 0x7fbeac0cc6f0 2023-10-14T19:11:17.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fbea4001470 con 0x7fbeac0cc6f0 2023-10-14T19:11:17.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 >> v1:172.21.15.7:6789/0 conn(0x7fbeac0cc6f0 legacy=0x7fbeac069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbe98003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe98004810 0x7fbe98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe980051c0 0x7fbe9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac06e330 con 0x7fbe98003a60 2023-10-14T19:11:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9800c0e0 con 0x7fbe980051c0 2023-10-14T19:11:17.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9800c2a0 con 0x7fbe98004810 2023-10-14T19:11:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbe98003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbeaa59c700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe98004810 0x7fbe98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.045+0000 7fbeab59e700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe980051c0 0x7fbe9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeaad9d700 1 -- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe98004810 msgr2=0x7fbe98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe98004810 0x7fbe98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeaad9d700 1 -- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe980051c0 msgr2=0x7fbe9800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe980051c0 0x7fbe9800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeaad9d700 1 -- 172.21.15.7:0/432342765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98003570 con 0x7fbe98003a60 2023-10-14T19:11:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeab59e700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe980051c0 0x7fbe9800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeab59e700 1 -- 172.21.15.7:0/432342765 reap_dead start 2023-10-14T19:11:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbe98003e30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0020a0 tx=0x7fbe9c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1851c2a85e3ed8ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0019e0 con 0x7fbe98003a60 2023-10-14T19:11:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00c8b0 con 0x7fbe98003a60 2023-10-14T19:11:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbea9d9b700 1 -- 172.21.15.7:0/432342765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00cc50 con 0x7fbe98003a60 2023-10-14T19:11:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeb1177700 1 -- 172.21.15.7:0/432342765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 msgr2=0x7fbe98003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeb1177700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbe98003e30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0020a0 tx=0x7fbe9c0016d0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeb1177700 1 -- 172.21.15.7:0/432342765 shutdown_connections 2023-10-14T19:11:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeb1177700 1 --2- 172.21.15.7:0/432342765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbe98003e30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.046+0000 7fbeb1177700 1 -- 172.21.15.7:0/432342765 >> 172.21.15.7:0/432342765 conn(0x7fbeac067f00 msgr2=0x7fbeac068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:17.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.047+0000 7fbeb1177700 1 -- 172.21.15.7:0/432342765 shutdown_connections 2023-10-14T19:11:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.047+0000 7fbeb1177700 1 -- 172.21.15.7:0/432342765 wait complete. 2023-10-14T19:11:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 Processor -- start 2023-10-14T19:11:17.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 -- start start 2023-10-14T19:11:17.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbeac0ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeac0c60d0 0x7fbeac0c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeac0c8460 0x7fbeac0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0c65b0 con 0x7fbe98003a60 2023-10-14T19:11:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0c6890 con 0x7fbeac0c60d0 2023-10-14T19:11:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.048+0000 7fbeb1177700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0c6b70 con 0x7fbeac0c8460 2023-10-14T19:11:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbeac0ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbeac0ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33188/0 (socket says 172.21.15.7:33188) 2023-10-14T19:11:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 -- 172.21.15.7:0/2569499228 learned_addr learned my addr 172.21.15.7:0/2569499228 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:17.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeab59e700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeac0c8460 0x7fbeac0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaa59c700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeac0c60d0 0x7fbeac0c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 -- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeac0c8460 msgr2=0x7fbeac0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeac0c8460 0x7fbeac0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 -- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeac0c60d0 msgr2=0x7fbeac0c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeac0c60d0 0x7fbeac0c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 -- 172.21.15.7:0/2569499228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0c6e50 con 0x7fbe98003a60 2023-10-14T19:11:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeaad9d700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbeac0ad330 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00c6a0 tx=0x7fbe9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c01e710 con 0x7fbe98003a60 2023-10-14T19:11:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c01e890 con 0x7fbe98003a60 2023-10-14T19:11:17.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c01ec50 con 0x7fbe98003a60 2023-10-14T19:11:17.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac0ab030 con 0x7fbe98003a60 2023-10-14T19:11:17.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.049+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac0b3da0 con 0x7fbe98003a60 2023-10-14T19:11:17.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.050+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac04c3c0 con 0x7fbe98003a60 2023-10-14T19:11:17.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.051+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbe9c007250 con 0x7fbe98003a60 2023-10-14T19:11:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.051+0000 7fbea2ffd700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe8c067320 0x7fbe8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.051+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe9c086d60 con 0x7fbe98003a60 2023-10-14T19:11:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.051+0000 7fbeaa59c700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe8c067320 0x7fbe8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.052+0000 7fbeaa59c700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe8c067320 0x7fbe8c0697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0c64e0 tx=0x7fbe940091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.056+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe9c0539f0 con 0x7fbe98003a60 2023-10-14T19:11:17.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.296+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbeac0b3f90 con 0x7fbe98003a60 2023-10-14T19:11:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.898+0000 7fbea2ffd700 1 -- 172.21.15.7:0/2569499228 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v111) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe9c01edb0 con 0x7fbe98003a60 2023-10-14T19:11:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe8c067320 msgr2=0x7fbe8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe8c067320 0x7fbe8c0697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0c64e0 tx=0x7fbe940091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 msgr2=0x7fbeac0ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbeac0ad330 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00c6a0 tx=0x7fbe9c016000 comp rx=0 tx=0).stop 2023-10-14T19:11:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 shutdown_connections 2023-10-14T19:11:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbe8c067320 0x7fbe8c0697d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeac0c8460 0x7fbeac0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe98003a60 0x7fbeac0ad330 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 --2- 172.21.15.7:0/2569499228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeac0c60d0 0x7fbeac0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 >> 172.21.15.7:0/2569499228 conn(0x7fbeac067f00 msgr2=0x7fbeac068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 shutdown_connections 2023-10-14T19:11:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:17.901+0000 7fbeb1177700 1 -- 172.21.15.7:0/2569499228 wait complete. 2023-10-14T19:11:17.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:18.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.043+0000 7f38fabd0700 1 Processor -- start 2023-10-14T19:11:18.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.043+0000 7f38fabd0700 1 -- start start 2023-10-14T19:11:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38fabd0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38f4153c30 0x7f38f415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38fabd0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40cf110 0x7f38f415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38fabd0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f415afd0 con 0x7f38f415de50 2023-10-14T19:11:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38fabd0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f415b2b0 con 0x7f38f4153c30 2023-10-14T19:11:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38fabd0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f415b590 con 0x7f38f40cf110 2023-10-14T19:11:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38f93cd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38f415de50 0x7f38f40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42036/0 (socket says 172.21.15.7:42036) 2023-10-14T19:11:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38f93cd700 1 -- 172.21.15.7:0/3224837921 learned_addr learned my addr 172.21.15.7:0/3224837921 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3224837921 >> v2:172.21.15.148:3300/0 conn(0x7f38f4153c30 0x7f38f415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38fa3cf700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40cf110 0x7f38f415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022820948 0 0) 0x7f38f415afd0 con 0x7f38f415de50 2023-10-14T19:11:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.044+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38dc003570 con 0x7f38f415de50 2023-10-14T19:11:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1514399281 0 0) 0x7f38dc003570 con 0x7f38f415de50 2023-10-14T19:11:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40cf110 msgr2=0x7f38f415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40cf110 0x7f38f415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 >> v2:172.21.15.148:3300/0 conn(0x7f38f4153c30 msgr2=0x7f38f415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 --2- 172.21.15.7:0/3224837921 >> v2:172.21.15.148:3300/0 conn(0x7f38f4153c30 0x7f38f415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f415b870 con 0x7f38f415de50 2023-10-14T19:11:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f38e8001470 con 0x7f38f415de50 2023-10-14T19:11:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 >> v1:172.21.15.7:6789/0 conn(0x7f38f415de50 legacy=0x7f38f40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38dc003a60 0x7f38dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38dc004810 0x7f38dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc0051c0 0x7f38dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f415b2b0 con 0x7f38dc003a60 2023-10-14T19:11:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f415b590 con 0x7f38dc0051c0 2023-10-14T19:11:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc00bfa0 con 0x7f38dc004810 2023-10-14T19:11:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3224837921 >> v2:172.21.15.148:3300/0 conn(0x7f38f4153c30 0x7f38f415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38fa3cf700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40cf110 0x7f38f415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38dc003a60 0x7f38dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f93cd700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38dc004810 0x7f38dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38fa3cf700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc0051c0 0x7f38dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 -- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38dc004810 msgr2=0x7f38dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38dc004810 0x7f38dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 -- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc0051c0 msgr2=0x7f38dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc0051c0 0x7f38dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.045+0000 7f38f9bce700 1 -- 172.21.15.7:0/3224837921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc003570 con 0x7f38dc003a60 2023-10-14T19:11:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38dc003a60 0x7f38dc003e70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f38e400e3c0 tx=0x7f38e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf69cf7719c342a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400ec70 con 0x7f38dc003a60 2023-10-14T19:11:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e400f040 con 0x7f38dc003a60 2023-10-14T19:11:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38f8bcc700 1 -- 172.21.15.7:0/3224837921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4014480 con 0x7f38dc003a60 2023-10-14T19:11:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fabd0700 1 -- 172.21.15.7:0/3224837921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38dc003a60 msgr2=0x7f38dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3224837921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38dc003a60 0x7f38dc003e70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f38e400e3c0 tx=0x7f38e400b040 comp rx=0 tx=0).stop 2023-10-14T19:11:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fa3cf700 1 -- 172.21.15.7:0/3224837921 reap_dead start 2023-10-14T19:11:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fabd0700 1 -- 172.21.15.7:0/3224837921 shutdown_connections 2023-10-14T19:11:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fabd0700 1 -- 172.21.15.7:0/3224837921 >> 172.21.15.7:0/3224837921 conn(0x7f38f40703a0 msgr2=0x7f38f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fabd0700 1 -- 172.21.15.7:0/3224837921 shutdown_connections 2023-10-14T19:11:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.046+0000 7f38fabd0700 1 -- 172.21.15.7:0/3224837921 wait complete. 2023-10-14T19:11:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.047+0000 7f38fabd0700 1 Processor -- start 2023-10-14T19:11:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 -- start start 2023-10-14T19:11:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc003a60 0x7f38f40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 0x7f38f40b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40c9900 0x7f38f40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40c8a80 con 0x7f38f40c9490 2023-10-14T19:11:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40b3810 con 0x7f38dc003a60 2023-10-14T19:11:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38fabd0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40b0d90 con 0x7f38f40c9900 2023-10-14T19:11:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38f93cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 0x7f38f40b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38f93cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 0x7f38f40b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33210/0 (socket says 172.21.15.7:33210) 2023-10-14T19:11:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38f93cd700 1 -- 172.21.15.7:0/3525517659 learned_addr learned my addr 172.21.15.7:0/3525517659 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.048+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc003a60 0x7f38f40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38fa3cf700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40c9900 0x7f38f40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f93cd700 1 -- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40c9900 msgr2=0x7f38f40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f93cd700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40c9900 0x7f38f40b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f93cd700 1 -- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc003a60 msgr2=0x7f38f40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f93cd700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc003a60 0x7f38f40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f93cd700 1 -- 172.21.15.7:0/3525517659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40c7700 con 0x7f38f40c9490 2023-10-14T19:11:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f93cd700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 0x7f38f40b0310 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f38e80016e0 tx=0x7f38f415a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8018030 con 0x7f38f40c9490 2023-10-14T19:11:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800f8d0 con 0x7f38f40c9490 2023-10-14T19:11:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f40c79e0 con 0x7f38f40c9490 2023-10-14T19:11:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800fc70 con 0x7f38f40c9490 2023-10-14T19:11:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.049+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f40c8c90 con 0x7f38f40c9490 2023-10-14T19:11:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.050+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f40c7e80 con 0x7f38f40c9490 2023-10-14T19:11:18.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.050+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f38e801b070 con 0x7f38f40c9490 2023-10-14T19:11:18.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.051+0000 7f38f1ffb700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e0067320 0x7f38e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.051+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38e8019070 con 0x7f38f40c9490 2023-10-14T19:11:18.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.051+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e0067320 0x7f38e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.052+0000 7f38f9bce700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e0067320 0x7f38e00697d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f38f41522b0 tx=0x7f38e4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.055+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38e80518c0 con 0x7f38f40c9490 2023-10-14T19:11:18.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.292+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38f404c3c0 con 0x7f38f40c9490 2023-10-14T19:11:18.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.293+0000 7f38f1ffb700 1 -- 172.21.15.7:0/3525517659 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f38e8054ee0 con 0x7f38f40c9490 2023-10-14T19:11:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:18.293 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":111,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:17.891546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e0067320 msgr2=0x7f38e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e0067320 0x7f38e00697d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f38f41522b0 tx=0x7f38e4019000 comp rx=0 tx=0).stop 2023-10-14T19:11:18.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 msgr2=0x7f38f40b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 0x7f38f40b0310 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f38e80016e0 tx=0x7f38f415a170 comp rx=0 tx=0).stop 2023-10-14T19:11:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 shutdown_connections 2023-10-14T19:11:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f38e0067320 0x7f38e00697d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38dc003a60 0x7f38f40b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38f40c9900 0x7f38f40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 --2- 172.21.15.7:0/3525517659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f40c9490 0x7f38f40b0310 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 >> 172.21.15.7:0/3525517659 conn(0x7f38f40703a0 msgr2=0x7f38f40c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 shutdown_connections 2023-10-14T19:11:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.295+0000 7f38fabd0700 1 -- 172.21.15.7:0/3525517659 wait complete. 2023-10-14T19:11:18.300 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 111 2023-10-14T19:11:18.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:18.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.427+0000 7f0a9bac4700 1 Processor -- start 2023-10-14T19:11:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.427+0000 7f0a9bac4700 1 -- start start 2023-10-14T19:11:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.427+0000 7f0a9bac4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a94159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9bac4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9415ae40 con 0x7f0a9415a400 2023-10-14T19:11:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9bac4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9415ab60 con 0x7f0a940cb5a0 2023-10-14T19:11:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9bac4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940ce0f0 con 0x7f0a940cb970 2023-10-14T19:11:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9a061700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0a9415a400 0x7f0a94156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42042/0 (socket says 172.21.15.7:42042) 2023-10-14T19:11:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9a061700 1 -- 172.21.15.7:0/3323477428 learned_addr learned my addr 172.21.15.7:0/3323477428 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9905f700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a94159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305181536 0 0) 0x7f0a9415ae40 con 0x7f0a9415a400 2023-10-14T19:11:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a7c003570 con 0x7f0a9415a400 2023-10-14T19:11:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1045075277 0 0) 0x7f0a7c003570 con 0x7f0a9415a400 2023-10-14T19:11:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 msgr2=0x7f0a94159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a94159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 >> v1:172.21.15.148:6789/0 conn(0x7f0a940cb5a0 legacy=0x7f0a940cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940ccf00 con 0x7f0a9415a400 2023-10-14T19:11:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f0a840017f0 con 0x7f0a9415a400 2023-10-14T19:11:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 >> v1:172.21.15.7:6789/0 conn(0x7f0a9415a400 legacy=0x7f0a94156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a7c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004010 0x7f0a7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a7c004d50 0x7f0a7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940ce0f0 con 0x7f0a7c004d50 2023-10-14T19:11:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c00bbf0 con 0x7f0a7c004010 2023-10-14T19:11:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.428+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c00bdb0 con 0x7f0a940cb970 2023-10-14T19:11:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a7c004d50 0x7f0a7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9905f700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004010 0x7f0a7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a99860700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a7c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 -- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 msgr2=0x7f0a7c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a7c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 -- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004010 msgr2=0x7f0a7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004010 0x7f0a7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 -- 172.21.15.7:0/3323477428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c003570 con 0x7f0a7c004d50 2023-10-14T19:11:18.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a99860700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940cb970 0x7f0a7c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:18.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a7c004d50 0x7f0a7c0051c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400a900 tx=0x7f0a840021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c535872d684126 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840070d0 con 0x7f0a7c004d50 2023-10-14T19:11:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84007230 con 0x7f0a7c004d50 2023-10-14T19:11:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.429+0000 7f0a9885e700 1 -- 172.21.15.7:0/3323477428 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840075f0 con 0x7f0a7c004d50 2023-10-14T19:11:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3323477428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a7c004d50 msgr2=0x7f0a7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3323477428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a7c004d50 0x7f0a7c0051c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400a900 tx=0x7f0a840021d0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9a061700 1 -- 172.21.15.7:0/3323477428 reap_dead start 2023-10-14T19:11:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3323477428 shutdown_connections 2023-10-14T19:11:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3323477428 >> 172.21.15.7:0/3323477428 conn(0x7f0a94070e30 msgr2=0x7f0a940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3323477428 shutdown_connections 2023-10-14T19:11:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.430+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3323477428 wait complete. 2023-10-14T19:11:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.431+0000 7f0a9bac4700 1 Processor -- start 2023-10-14T19:11:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.431+0000 7f0a9bac4700 1 -- start start 2023-10-14T19:11:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004d50 0x7f0a940c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940b5850 0x7f0a94152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 0x7f0a94152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940cbde0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940c8240 con 0x7f0a7c004d50 2023-10-14T19:11:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94153180 con 0x7f0a940b5850 2023-10-14T19:11:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 0x7f0a94152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 0x7f0a94152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33234/0 (socket says 172.21.15.7:33234) 2023-10-14T19:11:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 -- 172.21.15.7:0/3130559813 learned_addr learned my addr 172.21.15.7:0/3130559813 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a99860700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004d50 0x7f0a940c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9905f700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940b5850 0x7f0a94152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 -- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940b5850 msgr2=0x7f0a94152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940b5850 0x7f0a94152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 -- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004d50 msgr2=0x7f0a940c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004d50 0x7f0a940c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 -- 172.21.15.7:0/3130559813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9415c6f0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a99860700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004d50 0x7f0a940c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9a061700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 0x7f0a94152c40 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0a84012000 tx=0x7f0a84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840073a0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84007560 con 0x7f0a940b5cc0 2023-10-14T19:11:18.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a940c8450 con 0x7f0a940b5cc0 2023-10-14T19:11:18.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.432+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8401e680 con 0x7f0a940b5cc0 2023-10-14T19:11:18.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.433+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a940c8a10 con 0x7f0a940b5cc0 2023-10-14T19:11:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.433+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a940c7d60 con 0x7f0a940b5cc0 2023-10-14T19:11:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.434+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a8401e9f0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.434+0000 7f0a91ffb700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a80067320 0x7f0a800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.434+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a84087140 con 0x7f0a940b5cc0 2023-10-14T19:11:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.435+0000 7f0a99860700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a80067320 0x7f0a800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.435+0000 7f0a99860700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a80067320 0x7f0a800697d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c007fd0 tx=0x7f0a8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.439+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a84053dd0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.633+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a9404c3c0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.633+0000 7f0a91ffb700 1 -- 172.21.15.7:0/3130559813 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f0a8401cea0 con 0x7f0a940b5cc0 2023-10-14T19:11:18.633 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:18.634 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":165,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:15.868157+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a80067320 msgr2=0x7f0a800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a80067320 0x7f0a800697d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c007fd0 tx=0x7f0a8c009040 comp rx=0 tx=0).stop 2023-10-14T19:11:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 msgr2=0x7f0a94152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 0x7f0a94152c40 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0a84012000 tx=0x7f0a84016000 comp rx=0 tx=0).stop 2023-10-14T19:11:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 shutdown_connections 2023-10-14T19:11:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0a80067320 0x7f0a800697d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c004d50 0x7f0a940c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.635+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a940b5cc0 0x7f0a94152c40 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.636+0000 7f0a9bac4700 1 --2- 172.21.15.7:0/3130559813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a940b5850 0x7f0a94152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.636+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 >> 172.21.15.7:0/3130559813 conn(0x7f0a94070e30 msgr2=0x7f0a940b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.636+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 shutdown_connections 2023-10-14T19:11:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.636+0000 7f0a9bac4700 1 -- 172.21.15.7:0/3130559813 wait complete. 2023-10-14T19:11:18.648 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:11:18.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:18.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.773+0000 7f2a033bc700 1 Processor -- start 2023-10-14T19:11:18.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.773+0000 7f2a033bc700 1 -- start start 2023-10-14T19:11:18.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a033bc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 0x7f29fc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a033bc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29fc06c6a0 0x7f29fc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a033bc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc06d050 con 0x7f29fc15d810 2023-10-14T19:11:18.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a033bc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc15a750 con 0x7f29fc06c6a0 2023-10-14T19:11:18.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a033bc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15e3a0 con 0x7f29fc15d440 2023-10-14T19:11:18.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a01959700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f29fc15d810 0x7f29fc15dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42052/0 (socket says 172.21.15.7:42052) 2023-10-14T19:11:18.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a01959700 1 -- 172.21.15.7:0/2509242067 learned_addr learned my addr 172.21.15.7:0/2509242067 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:18.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a00957700 1 --2- 172.21.15.7:0/2509242067 >> v2:172.21.15.148:3300/0 conn(0x7f29fc06c6a0 0x7f29fc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.774+0000 7f2a01158700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 0x7f29fc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674204115 0 0) 0x7f29fc06d050 con 0x7f29fc15d810 2023-10-14T19:11:18.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e4003570 con 0x7f29fc15d810 2023-10-14T19:11:18.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686158936 0 0) 0x7f29e4003570 con 0x7f29fc15d810 2023-10-14T19:11:18.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 msgr2=0x7f29fc0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 0x7f29fc0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 >> v2:172.21.15.148:3300/0 conn(0x7f29fc06c6a0 msgr2=0x7f29fc06cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 --2- 172.21.15.7:0/2509242067 >> v2:172.21.15.148:3300/0 conn(0x7f29fc06c6a0 0x7f29fc06cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc159e40 con 0x7f29fc15d810 2023-10-14T19:11:18.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f29ec0017f0 con 0x7f29fc15d810 2023-10-14T19:11:18.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 >> v1:172.21.15.7:6789/0 conn(0x7f29fc15d810 legacy=0x7f29fc15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e4004810 0x7f29e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 0x7f29e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15a750 con 0x7f29e4003a60 2023-10-14T19:11:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15e3a0 con 0x7f29e4004810 2023-10-14T19:11:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e400ba60 con 0x7f29fc15d440 2023-10-14T19:11:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a00957700 1 --2- 172.21.15.7:0/2509242067 >> v2:172.21.15.148:3300/0 conn(0x7f29fc06c6a0 0x7f29fc06cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01158700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01959700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 0x7f29e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.783 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a00957700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e4004810 0x7f29e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01158700 1 -- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 msgr2=0x7f29e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01158700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc15d440 0x7f29e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01158700 1 -- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e4004810 msgr2=0x7f29e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:18.784 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01158700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e4004810 0x7f29e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a01158700 1 -- 172.21.15.7:0/2509242067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4003570 con 0x7f29e4003a60 2023-10-14T19:11:18.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.775+0000 7f2a00957700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e4004810 0x7f29e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:18.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a01158700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29e4003e70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009c30 tx=0x7f29f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfce6631502f775 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400e710 con 0x7f29e4003a60 2023-10-14T19:11:18.785 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f400e870 con 0x7f29e4003a60 2023-10-14T19:11:18.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f29fbfff700 1 -- 172.21.15.7:0/2509242067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400ec30 con 0x7f29e4003a60 2023-10-14T19:11:18.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a033bc700 1 -- 172.21.15.7:0/2509242067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 msgr2=0x7f29e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2509242067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29e4003e70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009c30 tx=0x7f29f40091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a01959700 1 -- 172.21.15.7:0/2509242067 reap_dead start 2023-10-14T19:11:18.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a033bc700 1 -- 172.21.15.7:0/2509242067 shutdown_connections 2023-10-14T19:11:18.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a033bc700 1 -- 172.21.15.7:0/2509242067 >> 172.21.15.7:0/2509242067 conn(0x7f29fc06f190 msgr2=0x7f29fc0ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:18.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a033bc700 1 -- 172.21.15.7:0/2509242067 shutdown_connections 2023-10-14T19:11:18.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.776+0000 7f2a033bc700 1 -- 172.21.15.7:0/2509242067 wait complete. 2023-10-14T19:11:18.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.777+0000 7f2a033bc700 1 Processor -- start 2023-10-14T19:11:18.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.777+0000 7f2a033bc700 1 -- start start 2023-10-14T19:11:18.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a033bc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29fc13f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a033bc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29fc169a40 0x7f29fc150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a033bc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc151320 0x7f29fc15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a033bc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1517a0 con 0x7f29e4003a60 2023-10-14T19:11:18.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a033bc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0b02c0 con 0x7f29fc169a40 2023-10-14T19:11:18.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a033bc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0b0560 con 0x7f29fc151320 2023-10-14T19:11:18.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a01158700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29fc13f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a01158700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29fc13f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33260/0 (socket says 172.21.15.7:33260) 2023-10-14T19:11:18.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.778+0000 7f2a01158700 1 -- 172.21.15.7:0/2505654550 learned_addr learned my addr 172.21.15.7:0/2505654550 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:18.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a00957700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29fc169a40 0x7f29fc150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01959700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc151320 0x7f29fc15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01158700 1 -- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc151320 msgr2=0x7f29fc15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01158700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc151320 0x7f29fc15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01158700 1 -- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29fc169a40 msgr2=0x7f29fc150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01158700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29fc169a40 0x7f29fc150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01158700 1 -- 172.21.15.7:0/2505654550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0b0840 con 0x7f29e4003a60 2023-10-14T19:11:18.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01959700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc151320 0x7f29fc15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a01158700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29fc13f590 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f29e40046d0 tx=0x7f29f401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4022070 con 0x7f29e4003a60 2023-10-14T19:11:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f400e9e0 con 0x7f29e4003a60 2023-10-14T19:11:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc0b0b20 con 0x7f29e4003a60 2023-10-14T19:11:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f401c450 con 0x7f29e4003a60 2023-10-14T19:11:18.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.779+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc15fe00 con 0x7f29e4003a60 2023-10-14T19:11:18.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.780+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc151720 con 0x7f29e4003a60 2023-10-14T19:11:18.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.780+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f29f401c840 con 0x7f29e4003a60 2023-10-14T19:11:18.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.781+0000 7f29f97fa700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e8067320 0x7f29e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:18.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.781+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29f40864f0 con 0x7f29e4003a60 2023-10-14T19:11:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.781+0000 7f2a00957700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e8067320 0x7f29e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.782+0000 7f2a00957700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e8067320 0x7f29e80697d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009f00 tx=0x7f29f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.785+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29f4053240 con 0x7f29e4003a60 2023-10-14T19:11:18.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.974+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29fc04c3c0 con 0x7f29e8067320 2023-10-14T19:11:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.982+0000 7f29f97fa700 1 -- 172.21.15.7:0/2505654550 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275117 (secure 0 0 0) 0x7f29fc04c3c0 con 0x7f29e8067320 2023-10-14T19:11:18.985 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e8067320 msgr2=0x7f29e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e8067320 0x7f29e80697d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009f00 tx=0x7f29f0008040 comp rx=0 tx=0).stop 2023-10-14T19:11:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 msgr2=0x7f29fc13f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29fc13f590 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f29e40046d0 tx=0x7f29f401a000 comp rx=0 tx=0).stop 2023-10-14T19:11:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 shutdown_connections 2023-10-14T19:11:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f29e8067320 0x7f29e80697d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29fc151320 0x7f29fc15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e4003a60 0x7f29fc13f590 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 --2- 172.21.15.7:0/2505654550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29fc169a40 0x7f29fc150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 >> 172.21.15.7:0/2505654550 conn(0x7f29fc06f190 msgr2=0x7f29fc14e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 shutdown_connections 2023-10-14T19:11:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:18.985+0000 7f2a033bc700 1 -- 172.21.15.7:0/2505654550 wait complete. 2023-10-14T19:11:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:18.997 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2023-10-14T19:11:17.739395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2428200,"kb_used_data":17128,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546520,"statfs":{"total":773094113280,"available":770607636480,"internally_reserved":0,"allocated":17539072,"data_stored":8456928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.877380"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":276,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T19:11:10.250655+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:10.250655+0000","last_peered":"2023-10-14T19:11:10.250655+0000","last_clean":"2023-10-14T19:11:10.250655+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:10.250655+0000","last_undegraded":"2023-10-14T19:11:10.250655+0000","last_fullsized":"2023-10-14T19:11:10.250655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1499892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.51700000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.377}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.42399999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.45000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.62},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.67900000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.745},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.5},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.307},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.58199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1499892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.32200000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.622},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.253},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.38}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.53400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.307},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.437},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.71399999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.64400000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.754},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.73499999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:19.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.157+0000 7fa6e4b0f700 1 Processor -- start 2023-10-14T19:11:19.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.157+0000 7fa6e4b0f700 1 -- start start 2023-10-14T19:11:19.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.158+0000 7fa6e4b0f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 0x7fa6e0164860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.158+0000 7fa6e4b0f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00aeee0 con 0x7fa6e00a90d0 2023-10-14T19:11:19.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.158+0000 7fa6e4b0f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00cf490 con 0x7fa6e00a8d00 2023-10-14T19:11:19.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.158+0000 7fa6e4b0f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00ae680 con 0x7fa6e006e550 2023-10-14T19:11:19.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.158+0000 7fa6ddd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa6e00a90d0 0x7fa6e006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42058/0 (socket says 172.21.15.7:42058) 2023-10-14T19:11:19.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.158+0000 7fa6ddd9b700 1 -- 172.21.15.7:0/2451559295 learned_addr learned my addr 172.21.15.7:0/2451559295 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:19.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973383040 0 0) 0x7fa6e00aeee0 con 0x7fa6e00a90d0 2023-10-14T19:11:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 0x7fa6e0164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6cc003570 con 0x7fa6e00a90d0 2023-10-14T19:11:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4105514543 0 0) 0x7fa6cc003570 con 0x7fa6e00a90d0 2023-10-14T19:11:19.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 msgr2=0x7fa6e0164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 0x7fa6e0164860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 >> v1:172.21.15.148:6789/0 conn(0x7fa6e00a8d00 legacy=0x7fa6e00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00cf1b0 con 0x7fa6e00a90d0 2023-10-14T19:11:19.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa6c80015f0 con 0x7fa6e00a90d0 2023-10-14T19:11:19.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 >> v1:172.21.15.7:6789/0 conn(0x7fa6e00a90d0 legacy=0x7fa6e006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 0x7fa6cc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc004010 0x7fa6cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc004d50 0x7fa6cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00ae680 con 0x7fa6cc004d50 2023-10-14T19:11:19.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc00bbf0 con 0x7fa6cc004010 2023-10-14T19:11:19.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc00bdb0 con 0x7fa6e006e550 2023-10-14T19:11:19.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc004d50 0x7fa6cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ddd9b700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc004010 0x7fa6cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6de59c700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 0x7fa6cc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 -- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 msgr2=0x7fa6cc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e006e550 0x7fa6cc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 -- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc004010 msgr2=0x7fa6cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc004010 0x7fa6cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ded9d700 1 -- 172.21.15.7:0/2451559295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc003570 con 0x7fa6cc004d50 2023-10-14T19:11:19.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.159+0000 7fa6ddd9b700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6cc004010 0x7fa6cc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:19.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc004d50 0x7fa6cc0051c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00094d0 tx=0x7fa6d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d8c1ed79e5e879 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000ea60 con 0x7fa6cc004d50 2023-10-14T19:11:19.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d000f040 con 0x7fa6cc004d50 2023-10-14T19:11:19.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6dd59a700 1 -- 172.21.15.7:0/2451559295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000edf0 con 0x7fa6cc004d50 2023-10-14T19:11:19.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/2451559295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc004d50 msgr2=0x7fa6cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/2451559295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc004d50 0x7fa6cc0051c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00094d0 tx=0x7fa6d000b040 comp rx=0 tx=0).stop 2023-10-14T19:11:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6ded9d700 1 -- 172.21.15.7:0/2451559295 reap_dead start 2023-10-14T19:11:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/2451559295 shutdown_connections 2023-10-14T19:11:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/2451559295 >> 172.21.15.7:0/2451559295 conn(0x7fa6e006ce80 msgr2=0x7fa6e00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/2451559295 shutdown_connections 2023-10-14T19:11:19.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.160+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/2451559295 wait complete. 2023-10-14T19:11:19.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.161+0000 7fa6e4b0f700 1 Processor -- start 2023-10-14T19:11:19.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 -- start start 2023-10-14T19:11:19.178 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc004d50 0x7fa6e0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e016cf10 0x7fa6e0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 0x7fa6e00cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00ce2f0 con 0x7fa6e00cd940 2023-10-14T19:11:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e009a3b0 con 0x7fa6e016cf10 2023-10-14T19:11:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6e4b0f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e009a0b0 con 0x7fa6cc004d50 2023-10-14T19:11:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6ded9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 0x7fa6e00cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6ded9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 0x7fa6e00cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33284/0 (socket says 172.21.15.7:33284) 2023-10-14T19:11:19.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.162+0000 7fa6ded9d700 1 -- 172.21.15.7:0/1480617511 learned_addr learned my addr 172.21.15.7:0/1480617511 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:19.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ddd9b700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e016cf10 0x7fa6e0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6de59c700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc004d50 0x7fa6e0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ded9d700 1 -- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc004d50 msgr2=0x7fa6e0157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc004d50 0x7fa6e0157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ded9d700 1 -- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e016cf10 msgr2=0x7fa6e0156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e016cf10 0x7fa6e0156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ded9d700 1 -- 172.21.15.7:0/1480617511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e016d760 con 0x7fa6e00cd940 2023-10-14T19:11:19.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ddd9b700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e016cf10 0x7fa6e0156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:19.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6de59c700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc004d50 0x7fa6e0157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:19.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6ded9d700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 0x7fa6e00cddb0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006e950 tx=0x7fa6d001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000ee60 con 0x7fa6e00cd940 2023-10-14T19:11:19.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d001e640 con 0x7fa6e00cd940 2023-10-14T19:11:19.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e016da40 con 0x7fa6e00cd940 2023-10-14T19:11:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d001ea40 con 0x7fa6e00cd940 2023-10-14T19:11:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.163+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e01570a0 con 0x7fa6e00cd940 2023-10-14T19:11:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.164+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e009a520 con 0x7fa6e00cd940 2023-10-14T19:11:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.164+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa6d0003040 con 0x7fa6e00cd940 2023-10-14T19:11:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.165+0000 7fa6d67fc700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6c0067320 0x7fa6c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.165+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6d0086da0 con 0x7fa6e00cd940 2023-10-14T19:11:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.165+0000 7fa6de59c700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6c0067320 0x7fa6c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.166+0000 7fa6de59c700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6c0067320 0x7fa6c00697d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8007e90 tx=0x7fa6d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.169+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6d0053920 con 0x7fa6e00cd940 2023-10-14T19:11:19.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:11:19.355 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:11:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.360+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6e004c3c0 con 0x7fa6c0067320 2023-10-14T19:11:19.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.368+0000 7fa6d67fc700 1 -- 172.21.15.7:0/1480617511 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275117 (secure 0 0 0) 0x7fa6e004c3c0 con 0x7fa6c0067320 2023-10-14T19:11:19.371 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6c0067320 msgr2=0x7fa6c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6c0067320 0x7fa6c00697d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8007e90 tx=0x7fa6d8009040 comp rx=0 tx=0).stop 2023-10-14T19:11:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 msgr2=0x7fa6e00cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 0x7fa6e00cddb0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006e950 tx=0x7fa6d001a000 comp rx=0 tx=0).stop 2023-10-14T19:11:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 shutdown_connections 2023-10-14T19:11:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa6c0067320 0x7fa6c00697d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6e00cd940 0x7fa6e00cddb0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6cc004d50 0x7fa6e0157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 --2- 172.21.15.7:0/1480617511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e016cf10 0x7fa6e0156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 >> 172.21.15.7:0/1480617511 conn(0x7fa6e006ce80 msgr2=0x7fa6e0159670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 shutdown_connections 2023-10-14T19:11:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.372+0000 7fa6e4b0f700 1 -- 172.21.15.7:0/1480617511 wait complete. 2023-10-14T19:11:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:19.385 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2023-10-14T19:11:17.739395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2428200,"kb_used_data":17128,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546520,"statfs":{"total":773094113280,"available":770607636480,"internally_reserved":0,"allocated":17539072,"data_stored":8456928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.877380"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:13.861651+0000","last_change":"2023-10-14T19:11:13.861651+0000","last_active":"2023-10-14T19:11:13.861651+0000","last_peered":"2023-10-14T19:11:13.861651+0000","last_clean":"2023-10-14T19:11:13.861651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:13.861651+0000","last_undegraded":"2023-10-14T19:11:13.861651+0000","last_fullsized":"2023-10-14T19:11:13.861651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T19:11:12.853657+0000","last_change":"2023-10-14T19:11:12.853657+0000","last_active":"2023-10-14T19:11:12.853657+0000","last_peered":"2023-10-14T19:11:12.853657+0000","last_clean":"2023-10-14T19:11:12.853657+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T19:11:12.853657+0000","last_undegraded":"2023-10-14T19:11:12.853657+0000","last_fullsized":"2023-10-14T19:11:12.853657+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":276,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T19:11:10.250655+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:10.250655+0000","last_peered":"2023-10-14T19:11:10.250655+0000","last_clean":"2023-10-14T19:11:10.250655+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:10.250655+0000","last_undegraded":"2023-10-14T19:11:10.250655+0000","last_fullsized":"2023-10-14T19:11:10.250655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1499892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50600000000000001,"15min":0.65300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51400000000000001,"15min":0.65400000000000003},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.65700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67000000000000004,"5min":0.755,"15min":3.1480000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.51700000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.75600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.746},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":2.4620000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.68400000000000005},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.377}]},{"osd":5,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.88100000000000001,"15min":3.4119999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":2.883},"last":0.42399999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.65800000000000003},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.91400000000000003,"15min":5.383},"last":0.45000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.27800000000000002},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":5.6820000000000004},"last":0.62},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.73499999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.67900000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.72099999999999997},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":7.8680000000000003},"last":0.745},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.78800000000000003,"15min":7.8250000000000002},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.75600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":8.0210000000000008},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.77000000000000002},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.67100000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.78600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":8.1120000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.5},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 14 19:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.307},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.58199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1499892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.32200000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.622},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.35499999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.253},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":2.028},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.38400000000000001},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.72899999999999998},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":11.269},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.69999999999999996},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.56499999999999995,"15min":11.318},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.38}]},{"osd":4,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81299999999999994,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.98699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":11.379},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.99099999999999999},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.97299999999999998,"15min":11.404},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.629,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.53400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.307},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68999999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.437},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75600000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34599999999999997},"max":{"1min":0.71599999999999997,"5min":2.597,"15min":2.597},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.214,"15min":1.214},"last":0.71399999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":0.83299999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.997,"15min":0.997},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.64400000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.754},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.73499999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303380,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068460,"statfs":{"total":96636764160,"available":96326103040,"internally_reserved":0,"allocated":2043904,"data_stored":909524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83899999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67600000000000005,"5min":1.784,"15min":1.784},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.76100000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.83199999999999996},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.876},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.60699999999999998,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80100000000000005,"5min":0.82999999999999996,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.32900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:19.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.567+0000 7fa490304700 1 Processor -- start 2023-10-14T19:11:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.567+0000 7fa490304700 1 -- start start 2023-10-14T19:11:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa490304700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 0x7fa48806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa490304700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa48806b230 0x7fa4880c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa490304700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4880c7f50 con 0x7fa4881595d0 2023-10-14T19:11:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa490304700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48806bd00 con 0x7fa48806b230 2023-10-14T19:11:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa490304700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48806b740 con 0x7fa4881599a0 2023-10-14T19:11:19.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa48e0a0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa4881595d0 0x7fa4880675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42060/0 (socket says 172.21.15.7:42060) 2023-10-14T19:11:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.568+0000 7fa48e0a0700 1 -- 172.21.15.7:0/3268969338 learned_addr learned my addr 172.21.15.7:0/3268969338 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:19.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884022366 0 0) 0x7fa4880c7f50 con 0x7fa4881595d0 2023-10-14T19:11:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa470003570 con 0x7fa4881595d0 2023-10-14T19:11:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 0x7fa48806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48e8a1700 1 --2- 172.21.15.7:0/3268969338 >> v2:172.21.15.148:3300/0 conn(0x7fa48806b230 0x7fa4880c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 881581288 0 0) 0x7fa470003570 con 0x7fa4881595d0 2023-10-14T19:11:19.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 msgr2=0x7fa48806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 0x7fa48806acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 >> v2:172.21.15.148:3300/0 conn(0x7fa48806b230 msgr2=0x7fa4880c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 --2- 172.21.15.7:0/3268969338 >> v2:172.21.15.148:3300/0 conn(0x7fa48806b230 0x7fa4880c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48806ba20 con 0x7fa4881595d0 2023-10-14T19:11:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa4800017f0 con 0x7fa4881595d0 2023-10-14T19:11:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 >> v1:172.21.15.7:6789/0 conn(0x7fa4881595d0 legacy=0x7fa4880675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa470003a60 0x7fa470003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa470004810 0x7fa470004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 0x7fa4700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48806b740 con 0x7fa470004810 2023-10-14T19:11:19.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47000bb40 con 0x7fa470003a60 2023-10-14T19:11:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47000bd00 con 0x7fa4881599a0 2023-10-14T19:11:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa470004810 0x7fa470004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48e0a0700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa470003a60 0x7fa470003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48e8a1700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 0x7fa4700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 -- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 msgr2=0x7fa4700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4881599a0 0x7fa4700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 -- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa470003a60 msgr2=0x7fa470003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa470003a60 0x7fa470003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.569+0000 7fa48d89f700 1 -- 172.21.15.7:0/3268969338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470003570 con 0x7fa470004810 2023-10-14T19:11:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa48d89f700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa470004810 0x7fa470004c80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00bb90 tx=0x7fa47c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed3e35b76983e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00d5d0 con 0x7fa470004810 2023-10-14T19:11:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00d730 con 0x7fa470004810 2023-10-14T19:11:19.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa48d09e700 1 -- 172.21.15.7:0/3268969338 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00daf0 con 0x7fa470004810 2023-10-14T19:11:19.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa490304700 1 -- 172.21.15.7:0/3268969338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa470004810 msgr2=0x7fa470004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa490304700 1 --2- 172.21.15.7:0/3268969338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa470004810 0x7fa470004c80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00bb90 tx=0x7fa47c008040 comp rx=0 tx=0).stop 2023-10-14T19:11:19.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa48e8a1700 1 -- 172.21.15.7:0/3268969338 reap_dead start 2023-10-14T19:11:19.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa490304700 1 -- 172.21.15.7:0/3268969338 shutdown_connections 2023-10-14T19:11:19.588 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa490304700 1 -- 172.21.15.7:0/3268969338 >> 172.21.15.7:0/3268969338 conn(0x7fa4880cd400 msgr2=0x7fa4880cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa490304700 1 -- 172.21.15.7:0/3268969338 shutdown_connections 2023-10-14T19:11:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.570+0000 7fa490304700 1 -- 172.21.15.7:0/3268969338 wait complete. 2023-10-14T19:11:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.571+0000 7fa490304700 1 Processor -- start 2023-10-14T19:11:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.571+0000 7fa490304700 1 -- start start 2023-10-14T19:11:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa490304700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa470004810 0x7fa488155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa490304700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa48815e960 0x7fa4880b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa490304700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 0x7fa48816cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa490304700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b1fa0 con 0x7fa4880b1b20 2023-10-14T19:11:19.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa490304700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48816dc60 con 0x7fa48815e960 2023-10-14T19:11:19.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa490304700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488155690 con 0x7fa470004810 2023-10-14T19:11:19.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa48e8a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 0x7fa48816cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa48e8a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 0x7fa48816cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33308/0 (socket says 172.21.15.7:33308) 2023-10-14T19:11:19.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa48e8a1700 1 -- 172.21.15.7:0/858647915 learned_addr learned my addr 172.21.15.7:0/858647915 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:19.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa48d89f700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa48815e960 0x7fa4880b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.572+0000 7fa48e0a0700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa470004810 0x7fa488155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e8a1700 1 -- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa470004810 msgr2=0x7fa488155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e8a1700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa470004810 0x7fa488155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e8a1700 1 -- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa48815e960 msgr2=0x7fa4880b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e8a1700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa48815e960 0x7fa4880b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e8a1700 1 -- 172.21.15.7:0/858647915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48815dba0 con 0x7fa4880b1b20 2023-10-14T19:11:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48d89f700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa48815e960 0x7fa4880b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e0a0700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa470004810 0x7fa488155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa48e8a1700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 0x7fa48816cef0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa48806b670 tx=0x7fa478008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800e660 con 0x7fa4880b1b20 2023-10-14T19:11:19.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47800e7c0 con 0x7fa4880b1b20 2023-10-14T19:11:19.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800eb80 con 0x7fa4880b1b20 2023-10-14T19:11:19.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48815de80 con 0x7fa4880b1b20 2023-10-14T19:11:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.573+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48815e440 con 0x7fa4880b1b20 2023-10-14T19:11:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.574+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48815e630 con 0x7fa4880b1b20 2023-10-14T19:11:19.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.574+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa478014470 con 0x7fa4880b1b20 2023-10-14T19:11:19.596 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.575+0000 7fa4867fc700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa474067320 0x7fa4740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.575+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4780852f0 con 0x7fa4880b1b20 2023-10-14T19:11:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.575+0000 7fa48e0a0700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa474067320 0x7fa4740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.576+0000 7fa48e0a0700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa474067320 0x7fa4740697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa480001190 tx=0x7fa480006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.579+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa478051f80 con 0x7fa4880b1b20 2023-10-14T19:11:19.734 INFO:tasks.ceph.mds.c.smithi007.stderr:2023-10-14T19:11:19.735+0000 7fdc20e38700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:11:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.772+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa48804c3c0 con 0x7fa474067320 2023-10-14T19:11:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.780+0000 7fa4867fc700 1 -- 172.21.15.7:0/858647915 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289922 (secure 0 0 0) 0x7fa48804c3c0 con 0x7fa474067320 2023-10-14T19:11:19.784 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.783+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa474067320 msgr2=0x7fa4740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.783+0000 7fa490304700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa474067320 0x7fa4740697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa480001190 tx=0x7fa480006040 comp rx=0 tx=0).stop 2023-10-14T19:11:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.783+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 msgr2=0x7fa48816cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.783+0000 7fa490304700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 0x7fa48816cef0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa48806b670 tx=0x7fa478008040 comp rx=0 tx=0).stop 2023-10-14T19:11:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 shutdown_connections 2023-10-14T19:11:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa474067320 0x7fa4740697d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4880b1b20 0x7fa48816cef0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa470004810 0x7fa488155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 --2- 172.21.15.7:0/858647915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa48815e960 0x7fa4880b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 >> 172.21.15.7:0/858647915 conn(0x7fa4880cd400 msgr2=0x7fa488068030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 shutdown_connections 2023-10-14T19:11:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.784+0000 7fa490304700 1 -- 172.21.15.7:0/858647915 wait complete. 2023-10-14T19:11:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:19.795 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2023-10-14T19:11:19.739929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428648,"kb_used_data":17576,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546072,"statfs":{"total":773094113280,"available":770607177728,"internally_reserved":0,"allocated":17997824,"data_stored":8662492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001627"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904354+0000","last_change":"2023-10-14T19:11:14.901991+0000","last_active":"2023-10-14T19:11:14.904354+0000","last_peered":"2023-10-14T19:11:14.904354+0000","last_clean":"2023-10-14T19:11:14.904354+0000","last_became_active":"2023-10-14T19:11:14.901426+0000","last_became_peered":"2023-10-14T19:11:14.901426+0000","last_unstale":"2023-10-14T19:11:14.904354+0000","last_undegraded":"2023-10-14T19:11:14.904354+0000","last_fullsized":"2023-10-14T19:11:14.904354+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:43.985400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887108+0000","last_change":"2023-10-14T19:11:14.884331+0000","last_active":"2023-10-14T19:11:14.887108+0000","last_peered":"2023-10-14T19:11:14.887108+0000","last_clean":"2023-10-14T19:11:14.887108+0000","last_became_active":"2023-10-14T19:11:14.884042+0000","last_became_peered":"2023-10-14T19:11:14.884042+0000","last_unstale":"2023-10-14T19:11:14.887108+0000","last_undegraded":"2023-10-14T19:11:14.887108+0000","last_fullsized":"2023-10-14T19:11:14.887108+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:31.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890565+0000","last_change":"2023-10-14T19:11:14.888613+0000","last_active":"2023-10-14T19:11:14.890565+0000","last_peered":"2023-10-14T19:11:14.890565+0000","last_clean":"2023-10-14T19:11:14.890565+0000","last_became_active":"2023-10-14T19:11:14.888292+0000","last_became_peered":"2023-10-14T19:11:14.888292+0000","last_unstale":"2023-10-14T19:11:14.890565+0000","last_undegraded":"2023-10-14T19:11:14.890565+0000","last_fullsized":"2023-10-14T19:11:14.890565+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898084+0000","last_change":"2023-10-14T19:11:14.893088+0000","last_active":"2023-10-14T19:11:14.898084+0000","last_peered":"2023-10-14T19:11:14.898084+0000","last_clean":"2023-10-14T19:11:14.898084+0000","last_became_active":"2023-10-14T19:11:14.892823+0000","last_became_peered":"2023-10-14T19:11:14.892823+0000","last_unstale":"2023-10-14T19:11:14.898084+0000","last_undegraded":"2023-10-14T19:11:14.898084+0000","last_fullsized":"2023-10-14T19:11:14.898084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:09.182588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.900224+0000","last_change":"2023-10-14T19:11:14.895506+0000","last_active":"2023-10-14T19:11:14.900224+0000","last_peered":"2023-10-14T19:11:14.900224+0000","last_clean":"2023-10-14T19:11:14.900224+0000","last_became_active":"2023-10-14T19:11:14.894979+0000","last_became_peered":"2023-10-14T19:11:14.894979+0000","last_unstale":"2023-10-14T19:11:14.900224+0000","last_undegraded":"2023-10-14T19:11:14.900224+0000","last_fullsized":"2023-10-14T19:11:14.900224+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:39.196624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894002+0000","last_change":"2023-10-14T19:11:14.891032+0000","last_active":"2023-10-14T19:11:14.894002+0000","last_peered":"2023-10-14T19:11:14.894002+0000","last_clean":"2023-10-14T19:11:14.894002+0000","last_became_active":"2023-10-14T19:11:14.890718+0000","last_became_peered":"2023-10-14T19:11:14.890718+0000","last_unstale":"2023-10-14T19:11:14.894002+0000","last_undegraded":"2023-10-14T19:11:14.894002+0000","last_fullsized":"2023-10-14T19:11:14.894002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:31.261627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.896243+0000","last_change":"2023-10-14T19:11:14.889416+0000","last_active":"2023-10-14T19:11:14.896243+0000","last_peered":"2023-10-14T19:11:14.896243+0000","last_clean":"2023-10-14T19:11:14.896243+0000","last_became_active":"2023-10-14T19:11:14.889107+0000","last_became_peered":"2023-10-14T19:11:14.889107+0000","last_unstale":"2023-10-14T19:11:14.896243+0000","last_undegraded":"2023-10-14T19:11:14.896243+0000","last_fullsized":"2023-10-14T19:11:14.896243+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:31.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880681+0000","last_change":"2023-10-14T19:11:14.880019+0000","last_active":"2023-10-14T19:11:14.880681+0000","last_peered":"2023-10-14T19:11:14.880681+0000","last_clean":"2023-10-14T19:11:14.880681+0000","last_became_active":"2023-10-14T19:11:14.879735+0000","last_became_peered":"2023-10-14T19:11:14.879735+0000","last_unstale":"2023-10-14T19:11:14.880681+0000","last_undegraded":"2023-10-14T19:11:14.880681+0000","last_fullsized":"2023-10-14T19:11:14.880681+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:19.992061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898829+0000","last_change":"2023-10-14T19:11:14.895595+0000","last_active":"2023-10-14T19:11:14.898829+0000","last_peered":"2023-10-14T19:11:14.898829+0000","last_clean":"2023-10-14T19:11:14.898829+0000","last_became_active":"2023-10-14T19:11:14.895328+0000","last_became_peered":"2023-10-14T19:11:14.895328+0000","last_unstale":"2023-10-14T19:11:14.898829+0000","last_undegraded":"2023-10-14T19:11:14.898829+0000","last_fullsized":"2023-10-14T19:11:14.898829+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:00.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878033+0000","last_change":"2023-10-14T19:11:14.877244+0000","last_active":"2023-10-14T19:11:14.878033+0000","last_peered":"2023-10-14T19:11:14.878033+0000","last_clean":"2023-10-14T19:11:14.878033+0000","last_became_active":"2023-10-14T19:11:14.876941+0000","last_became_peered":"2023-10-14T19:11:14.876941+0000","last_unstale":"2023-10-14T19:11:14.878033+0000","last_undegraded":"2023-10-14T19:11:14.878033+0000","last_fullsized":"2023-10-14T19:11:14.878033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:40.337173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905520+0000","last_change":"2023-10-14T19:11:14.904151+0000","last_active":"2023-10-14T19:11:14.905520+0000","last_peered":"2023-10-14T19:11:14.905520+0000","last_clean":"2023-10-14T19:11:14.905520+0000","last_became_active":"2023-10-14T19:11:14.903594+0000","last_became_peered":"2023-10-14T19:11:14.903594+0000","last_unstale":"2023-10-14T19:11:14.905520+0000","last_undegraded":"2023-10-14T19:11:14.905520+0000","last_fullsized":"2023-10-14T19:11:14.905520+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:33.032227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899165+0000","last_change":"2023-10-14T19:11:14.893034+0000","last_active":"2023-10-14T19:11:14.899165+0000","last_peered":"2023-10-14T19:11:14.899165+0000","last_clean":"2023-10-14T19:11:14.899165+0000","last_became_active":"2023-10-14T19:11:14.892767+0000","last_became_peered":"2023-10-14T19:11:14.892767+0000","last_unstale":"2023-10-14T19:11:14.899165+0000","last_undegraded":"2023-10-14T19:11:14.899165+0000","last_fullsized":"2023-10-14T19:11:14.899165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:06.124370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898270+0000","last_change":"2023-10-14T19:11:14.891165+0000","last_active":"2023-10-14T19:11:14.898270+0000","last_peered":"2023-10-14T19:11:14.898270+0000","last_clean":"2023-10-14T19:11:14.898270+0000","last_became_active":"2023-10-14T19:11:14.890919+0000","last_became_peered":"2023-10-14T19:11:14.890919+0000","last_unstale":"2023-10-14T19:11:14.898270+0000","last_undegraded":"2023-10-14T19:11:14.898270+0000","last_fullsized":"2023-10-14T19:11:14.898270+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890411+0000","last_change":"2023-10-14T19:11:14.887113+0000","last_active":"2023-10-14T19:11:14.890411+0000","last_peered":"2023-10-14T19:11:14.890411+0000","last_clean":"2023-10-14T19:11:14.890411+0000","last_became_active":"2023-10-14T19:11:14.886821+0000","last_became_peered":"2023-10-14T19:11:14.886821+0000","last_unstale":"2023-10-14T19:11:14.890411+0000","last_undegraded":"2023-10-14T19:11:14.890411+0000","last_fullsized":"2023-10-14T19:11:14.890411+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887033+0000","last_change":"2023-10-14T19:11:14.883200+0000","last_active":"2023-10-14T19:11:14.887033+0000","last_peered":"2023-10-14T19:11:14.887033+0000","last_clean":"2023-10-14T19:11:14.887033+0000","last_became_active":"2023-10-14T19:11:14.882856+0000","last_became_peered":"2023-10-14T19:11:14.882856+0000","last_unstale":"2023-10-14T19:11:14.887033+0000","last_undegraded":"2023-10-14T19:11:14.887033+0000","last_fullsized":"2023-10-14T19:11:14.887033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:34.191576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.892636+0000","last_change":"2023-10-14T19:11:14.887496+0000","last_active":"2023-10-14T19:11:14.892636+0000","last_peered":"2023-10-14T19:11:14.892636+0000","last_clean":"2023-10-14T19:11:14.892636+0000","last_became_active":"2023-10-14T19:11:14.887193+0000","last_became_peered":"2023-10-14T19:11:14.887193+0000","last_unstale":"2023-10-14T19:11:14.892636+0000","last_undegraded":"2023-10-14T19:11:14.892636+0000","last_fullsized":"2023-10-14T19:11:14.892636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:33.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890768+0000","last_change":"2023-10-14T19:11:14.889661+0000","last_active":"2023-10-14T19:11:14.890768+0000","last_peered":"2023-10-14T19:11:14.890768+0000","last_clean":"2023-10-14T19:11:14.890768+0000","last_became_active":"2023-10-14T19:11:14.887488+0000","last_became_peered":"2023-10-14T19:11:14.887488+0000","last_unstale":"2023-10-14T19:11:14.890768+0000","last_undegraded":"2023-10-14T19:11:14.890768+0000","last_fullsized":"2023-10-14T19:11:14.890768+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:41.013361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.886998+0000","last_change":"2023-10-14T19:11:14.885069+0000","last_active":"2023-10-14T19:11:14.886998+0000","last_peered":"2023-10-14T19:11:14.886998+0000","last_clean":"2023-10-14T19:11:14.886998+0000","last_became_active":"2023-10-14T19:11:14.884796+0000","last_became_peered":"2023-10-14T19:11:14.884796+0000","last_unstale":"2023-10-14T19:11:14.886998+0000","last_undegraded":"2023-10-14T19:11:14.886998+0000","last_fullsized":"2023-10-14T19:11:14.886998+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:43.985400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903234+0000","last_change":"2023-10-14T19:11:14.901829+0000","last_active":"2023-10-14T19:11:14.903234+0000","last_peered":"2023-10-14T19:11:14.903234+0000","last_clean":"2023-10-14T19:11:14.903234+0000","last_became_active":"2023-10-14T19:11:14.900088+0000","last_became_peered":"2023-10-14T19:11:14.900088+0000","last_unstale":"2023-10-14T19:11:14.903234+0000","last_undegraded":"2023-10-14T19:11:14.903234+0000","last_fullsized":"2023-10-14T19:11:14.903234+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:16.117414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878910+0000","last_change":"2023-10-14T19:11:14.878073+0000","last_active":"2023-10-14T19:11:14.878910+0000","last_peered":"2023-10-14T19:11:14.878910+0000","last_clean":"2023-10-14T19:11:14.878910+0000","last_became_active":"2023-10-14T19:11:14.877781+0000","last_became_peered":"2023-10-14T19:11:14.877781+0000","last_unstale":"2023-10-14T19:11:14.878910+0000","last_undegraded":"2023-10-14T19:11:14.878910+0000","last_fullsized":"2023-10-14T19:11:14.878910+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:35.546493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894781+0000","last_change":"2023-10-14T19:11:14.889823+0000","last_active":"2023-10-14T19:11:14.894781+0000","last_peered":"2023-10-14T19:11:14.894781+0000","last_clean":"2023-10-14T19:11:14.894781+0000","last_became_active":"2023-10-14T19:11:14.889570+0000","last_became_peered":"2023-10-14T19:11:14.889570+0000","last_unstale":"2023-10-14T19:11:14.894781+0000","last_undegraded":"2023-10-14T19:11:14.894781+0000","last_fullsized":"2023-10-14T19:11:14.894781+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:51.900240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880456+0000","last_change":"2023-10-14T19:11:14.879997+0000","last_active":"2023-10-14T19:11:14.880456+0000","last_peered":"2023-10-14T19:11:14.880456+0000","last_clean":"2023-10-14T19:11:14.880456+0000","last_became_active":"2023-10-14T19:11:14.879676+0000","last_became_peered":"2023-10-14T19:11:14.879676+0000","last_unstale":"2023-10-14T19:11:14.880456+0000","last_undegraded":"2023-10-14T19:11:14.880456+0000","last_fullsized":"2023-10-14T19:11:14.880456+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:38:12.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898146+0000","last_change":"2023-10-14T19:11:14.895092+0000","last_active":"2023-10-14T19:11:14.898146+0000","last_peered":"2023-10-14T19:11:14.898146+0000","last_clean":"2023-10-14T19:11:14.898146+0000","last_became_active":"2023-10-14T19:11:14.894651+0000","last_became_peered":"2023-10-14T19:11:14.894651+0000","last_unstale":"2023-10-14T19:11:14.898146+0000","last_undegraded":"2023-10-14T19:11:14.898146+0000","last_fullsized":"2023-10-14T19:11:14.898146+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:35.546493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.891324+0000","last_change":"2023-10-14T19:11:14.889196+0000","last_active":"2023-10-14T19:11:14.891324+0000","last_peered":"2023-10-14T19:11:14.891324+0000","last_clean":"2023-10-14T19:11:14.891324+0000","last_became_active":"2023-10-14T19:11:14.888787+0000","last_became_peered":"2023-10-14T19:11:14.888787+0000","last_unstale":"2023-10-14T19:11:14.891324+0000","last_undegraded":"2023-10-14T19:11:14.891324+0000","last_fullsized":"2023-10-14T19:11:14.891324+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.462907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904456+0000","last_change":"2023-10-14T19:11:14.902015+0000","last_active":"2023-10-14T19:11:14.904456+0000","last_peered":"2023-10-14T19:11:14.904456+0000","last_clean":"2023-10-14T19:11:14.904456+0000","last_became_active":"2023-10-14T19:11:14.901761+0000","last_became_peered":"2023-10-14T19:11:14.901761+0000","last_unstale":"2023-10-14T19:11:14.904456+0000","last_undegraded":"2023-10-14T19:11:14.904456+0000","last_fullsized":"2023-10-14T19:11:14.904456+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:47:29.218531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.897350+0000","last_change":"2023-10-14T19:11:14.893257+0000","last_active":"2023-10-14T19:11:14.897350+0000","last_peered":"2023-10-14T19:11:14.897350+0000","last_clean":"2023-10-14T19:11:14.897350+0000","last_became_active":"2023-10-14T19:11:14.892936+0000","last_became_peered":"2023-10-14T19:11:14.892936+0000","last_unstale":"2023-10-14T19:11:14.897350+0000","last_undegraded":"2023-10-14T19:11:14.897350+0000","last_fullsized":"2023-10-14T19:11:14.897350+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.880227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905532+0000","last_change":"2023-10-14T19:11:14.904268+0000","last_active":"2023-10-14T19:11:14.905532+0000","last_peered":"2023-10-14T19:11:14.905532+0000","last_clean":"2023-10-14T19:11:14.905532+0000","last_became_active":"2023-10-14T19:11:14.903890+0000","last_became_peered":"2023-10-14T19:11:14.903890+0000","last_unstale":"2023-10-14T19:11:14.905532+0000","last_undegraded":"2023-10-14T19:11:14.905532+0000","last_fullsized":"2023-10-14T19:11:14.905532+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:23.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898332+0000","last_change":"2023-10-14T19:11:14.893878+0000","last_active":"2023-10-14T19:11:14.898332+0000","last_peered":"2023-10-14T19:11:14.898332+0000","last_clean":"2023-10-14T19:11:14.898332+0000","last_became_active":"2023-10-14T19:11:14.893621+0000","last_became_peered":"2023-10-14T19:11:14.893621+0000","last_unstale":"2023-10-14T19:11:14.898332+0000","last_undegraded":"2023-10-14T19:11:14.898332+0000","last_fullsized":"2023-10-14T19:11:14.898332+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:23.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.891857+0000","last_change":"2023-10-14T19:11:14.889810+0000","last_active":"2023-10-14T19:11:14.891857+0000","last_peered":"2023-10-14T19:11:14.891857+0000","last_clean":"2023-10-14T19:11:14.891857+0000","last_became_active":"2023-10-14T19:11:14.887448+0000","last_became_peered":"2023-10-14T19:11:14.887448+0000","last_unstale":"2023-10-14T19:11:14.891857+0000","last_undegraded":"2023-10-14T19:11:14.891857+0000","last_fullsized":"2023-10-14T19:11:14.891857+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902797+0000","last_change":"2023-10-14T19:11:14.898600+0000","last_active":"2023-10-14T19:11:14.902797+0000","last_peered":"2023-10-14T19:11:14.902797+0000","last_clean":"2023-10-14T19:11:14.902797+0000","last_became_active":"2023-10-14T19:11:14.898333+0000","last_became_peered":"2023-10-14T19:11:14.898333+0000","last_unstale":"2023-10-14T19:11:14.902797+0000","last_undegraded":"2023-10-14T19:11:14.902797+0000","last_fullsized":"2023-10-14T19:11:14.902797+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898682+0000","last_change":"2023-10-14T19:11:14.897462+0000","last_active":"2023-10-14T19:11:14.898682+0000","last_peered":"2023-10-14T19:11:14.898682+0000","last_clean":"2023-10-14T19:11:14.898682+0000","last_became_active":"2023-10-14T19:11:14.896964+0000","last_became_peered":"2023-10-14T19:11:14.896964+0000","last_unstale":"2023-10-14T19:11:14.898682+0000","last_undegraded":"2023-10-14T19:11:14.898682+0000","last_fullsized":"2023-10-14T19:11:14.898682+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:08.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881736+0000","last_change":"2023-10-14T19:11:14.881329+0000","last_active":"2023-10-14T19:11:14.881736+0000","last_peered":"2023-10-14T19:11:14.881736+0000","last_clean":"2023-10-14T19:11:14.881736+0000","last_became_active":"2023-10-14T19:11:14.881011+0000","last_became_peered":"2023-10-14T19:11:14.881011+0000","last_unstale":"2023-10-14T19:11:14.881736+0000","last_undegraded":"2023-10-14T19:11:14.881736+0000","last_fullsized":"2023-10-14T19:11:14.881736+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:03.249614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899434+0000","last_change":"2023-10-14T19:11:14.896541+0000","last_active":"2023-10-14T19:11:14.899434+0000","last_peered":"2023-10-14T19:11:14.899434+0000","last_clean":"2023-10-14T19:11:14.899434+0000","last_became_active":"2023-10-14T19:11:14.896243+0000","last_became_peered":"2023-10-14T19:11:14.896243+0000","last_unstale":"2023-10-14T19:11:14.899434+0000","last_undegraded":"2023-10-14T19:11:14.899434+0000","last_fullsized":"2023-10-14T19:11:14.899434+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:33.386724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903568+0000","last_change":"2023-10-14T19:11:13.881701+0000","last_active":"2023-10-14T19:11:14.903568+0000","last_peered":"2023-10-14T19:11:14.903568+0000","last_clean":"2023-10-14T19:11:14.903568+0000","last_became_active":"2023-10-14T19:11:13.881447+0000","last_became_peered":"2023-10-14T19:11:13.881447+0000","last_unstale":"2023-10-14T19:11:14.903568+0000","last_undegraded":"2023-10-14T19:11:14.903568+0000","last_fullsized":"2023-10-14T19:11:14.903568+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:30.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894227+0000","last_change":"2023-10-14T19:11:14.886806+0000","last_active":"2023-10-14T19:11:14.894227+0000","last_peered":"2023-10-14T19:11:14.894227+0000","last_clean":"2023-10-14T19:11:14.894227+0000","last_became_active":"2023-10-14T19:11:14.886529+0000","last_became_peered":"2023-10-14T19:11:14.886529+0000","last_unstale":"2023-10-14T19:11:14.894227+0000","last_undegraded":"2023-10-14T19:11:14.894227+0000","last_fullsized":"2023-10-14T19:11:14.894227+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:58.775129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902213+0000","last_change":"2023-10-14T19:11:13.887162+0000","last_active":"2023-10-14T19:11:14.902213+0000","last_peered":"2023-10-14T19:11:14.902213+0000","last_clean":"2023-10-14T19:11:14.902213+0000","last_became_active":"2023-10-14T19:11:13.886862+0000","last_became_peered":"2023-10-14T19:11:13.886862+0000","last_unstale":"2023-10-14T19:11:14.902213+0000","last_undegraded":"2023-10-14T19:11:14.902213+0000","last_fullsized":"2023-10-14T19:11:14.902213+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:18:07.030442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.896346+0000","last_change":"2023-10-14T19:11:14.889097+0000","last_active":"2023-10-14T19:11:14.896346+0000","last_peered":"2023-10-14T19:11:14.896346+0000","last_clean":"2023-10-14T19:11:14.896346+0000","last_became_active":"2023-10-14T19:11:14.888786+0000","last_became_peered":"2023-10-14T19:11:14.888786+0000","last_unstale":"2023-10-14T19:11:14.896346+0000","last_undegraded":"2023-10-14T19:11:14.896346+0000","last_fullsized":"2023-10-14T19:11:14.896346+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:27.993025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904722+0000","last_change":"2023-10-14T19:11:13.885512+0000","last_active":"2023-10-14T19:11:14.904722+0000","last_peered":"2023-10-14T19:11:14.904722+0000","last_clean":"2023-10-14T19:11:14.904722+0000","last_became_active":"2023-10-14T19:11:13.883379+0000","last_became_peered":"2023-10-14T19:11:13.883379+0000","last_unstale":"2023-10-14T19:11:14.904722+0000","last_undegraded":"2023-10-14T19:11:14.904722+0000","last_fullsized":"2023-10-14T19:11:14.904722+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:06.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904903+0000","last_change":"2023-10-14T19:11:14.903518+0000","last_active":"2023-10-14T19:11:14.904903+0000","last_peered":"2023-10-14T19:11:14.904903+0000","last_clean":"2023-10-14T19:11:14.904903+0000","last_became_active":"2023-10-14T19:11:14.903220+0000","last_became_peered":"2023-10-14T19:11:14.903220+0000","last_unstale":"2023-10-14T19:11:14.904903+0000","last_undegraded":"2023-10-14T19:11:14.904903+0000","last_fullsized":"2023-10-14T19:11:14.904903+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:03.949775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898679+0000","last_change":"2023-10-14T19:11:13.875180+0000","last_active":"2023-10-14T19:11:14.898679+0000","last_peered":"2023-10-14T19:11:14.898679+0000","last_clean":"2023-10-14T19:11:14.898679+0000","last_became_active":"2023-10-14T19:11:13.874859+0000","last_became_peered":"2023-10-14T19:11:13.874859+0000","last_unstale":"2023-10-14T19:11:14.898679+0000","last_undegraded":"2023-10-14T19:11:14.898679+0000","last_fullsized":"2023-10-14T19:11:14.898679+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:54.077166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.900202+0000","last_change":"2023-10-14T19:11:14.895290+0000","last_active":"2023-10-14T19:11:14.900202+0000","last_peered":"2023-10-14T19:11:14.900202+0000","last_clean":"2023-10-14T19:11:14.900202+0000","last_became_active":"2023-10-14T19:11:14.894574+0000","last_became_peered":"2023-10-14T19:11:14.894574+0000","last_unstale":"2023-10-14T19:11:14.900202+0000","last_undegraded":"2023-10-14T19:11:14.900202+0000","last_fullsized":"2023-10-14T19:11:14.900202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:23.854695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902611+0000","last_change":"2023-10-14T19:11:13.882362+0000","last_active":"2023-10-14T19:11:14.902611+0000","last_peered":"2023-10-14T19:11:14.902611+0000","last_clean":"2023-10-14T19:11:14.902611+0000","last_became_active":"2023-10-14T19:11:13.882064+0000","last_became_peered":"2023-10-14T19:11:13.882064+0000","last_unstale":"2023-10-14T19:11:14.902611+0000","last_undegraded":"2023-10-14T19:11:14.902611+0000","last_fullsized":"2023-10-14T19:11:14.902611+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:35.880560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890695+0000","last_change":"2023-10-14T19:11:14.886201+0000","last_active":"2023-10-14T19:11:14.890695+0000","last_peered":"2023-10-14T19:11:14.890695+0000","last_clean":"2023-10-14T19:11:14.890695+0000","last_became_active":"2023-10-14T19:11:14.885769+0000","last_became_peered":"2023-10-14T19:11:14.885769+0000","last_unstale":"2023-10-14T19:11:14.890695+0000","last_undegraded":"2023-10-14T19:11:14.890695+0000","last_fullsized":"2023-10-14T19:11:14.890695+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:47:29.218531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880390+0000","last_change":"2023-10-14T19:11:13.884179+0000","last_active":"2023-10-14T19:11:14.880390+0000","last_peered":"2023-10-14T19:11:14.880390+0000","last_clean":"2023-10-14T19:11:14.880390+0000","last_became_active":"2023-10-14T19:11:13.883909+0000","last_became_peered":"2023-10-14T19:11:13.883909+0000","last_unstale":"2023-10-14T19:11:14.880390+0000","last_undegraded":"2023-10-14T19:11:14.880390+0000","last_fullsized":"2023-10-14T19:11:14.880390+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:38:28.750831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885169+0000","last_change":"2023-10-14T19:11:14.884066+0000","last_active":"2023-10-14T19:11:14.885169+0000","last_peered":"2023-10-14T19:11:14.885169+0000","last_clean":"2023-10-14T19:11:14.885169+0000","last_became_active":"2023-10-14T19:11:14.883782+0000","last_became_peered":"2023-10-14T19:11:14.883782+0000","last_unstale":"2023-10-14T19:11:14.885169+0000","last_undegraded":"2023-10-14T19:11:14.885169+0000","last_fullsized":"2023-10-14T19:11:14.885169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:54.770149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873977+0000","last_change":"2023-10-14T19:11:13.890847+0000","last_active":"2023-10-14T19:11:14.873977+0000","last_peered":"2023-10-14T19:11:14.873977+0000","last_clean":"2023-10-14T19:11:14.873977+0000","last_became_active":"2023-10-14T19:11:13.890640+0000","last_became_peered":"2023-10-14T19:11:13.890640+0000","last_unstale":"2023-10-14T19:11:14.873977+0000","last_undegraded":"2023-10-14T19:11:14.873977+0000","last_fullsized":"2023-10-14T19:11:14.873977+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:50.892246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887089+0000","last_change":"2023-10-14T19:11:14.884301+0000","last_active":"2023-10-14T19:11:14.887089+0000","last_peered":"2023-10-14T19:11:14.887089+0000","last_clean":"2023-10-14T19:11:14.887089+0000","last_became_active":"2023-10-14T19:11:14.883672+0000","last_became_peered":"2023-10-14T19:11:14.883672+0000","last_unstale":"2023-10-14T19:11:14.887089+0000","last_undegraded":"2023-10-14T19:11:14.887089+0000","last_fullsized":"2023-10-14T19:11:14.887089+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894909+0000","last_change":"2023-10-14T19:11:13.891161+0000","last_active":"2023-10-14T19:11:14.894909+0000","last_peered":"2023-10-14T19:11:14.894909+0000","last_clean":"2023-10-14T19:11:14.894909+0000","last_became_active":"2023-10-14T19:11:13.890699+0000","last_became_peered":"2023-10-14T19:11:13.890699+0000","last_unstale":"2023-10-14T19:11:14.894909+0000","last_undegraded":"2023-10-14T19:11:14.894909+0000","last_fullsized":"2023-10-14T19:11:14.894909+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:33.339743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904472+0000","last_change":"2023-10-14T19:11:14.902485+0000","last_active":"2023-10-14T19:11:14.904472+0000","last_peered":"2023-10-14T19:11:14.904472+0000","last_clean":"2023-10-14T19:11:14.904472+0000","last_became_active":"2023-10-14T19:11:14.902227+0000","last_became_peered":"2023-10-14T19:11:14.902227+0000","last_unstale":"2023-10-14T19:11:14.904472+0000","last_undegraded":"2023-10-14T19:11:14.904472+0000","last_fullsized":"2023-10-14T19:11:14.904472+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:41.184247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873004+0000","last_change":"2023-10-14T19:11:13.882199+0000","last_active":"2023-10-14T19:11:14.873004+0000","last_peered":"2023-10-14T19:11:14.873004+0000","last_clean":"2023-10-14T19:11:14.873004+0000","last_became_active":"2023-10-14T19:11:13.881972+0000","last_became_peered":"2023-10-14T19:11:13.881972+0000","last_unstale":"2023-10-14T19:11:14.873004+0000","last_undegraded":"2023-10-14T19:11:14.873004+0000","last_fullsized":"2023-10-14T19:11:14.873004+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:43.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.893210+0000","last_change":"2023-10-14T19:11:14.892195+0000","last_active":"2023-10-14T19:11:14.893210+0000","last_peered":"2023-10-14T19:11:14.893210+0000","last_clean":"2023-10-14T19:11:14.893210+0000","last_became_active":"2023-10-14T19:11:14.891933+0000","last_became_peered":"2023-10-14T19:11:14.891933+0000","last_unstale":"2023-10-14T19:11:14.893210+0000","last_undegraded":"2023-10-14T19:11:14.893210+0000","last_fullsized":"2023-10-14T19:11:14.893210+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:13.158859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903697+0000","last_change":"2023-10-14T19:11:13.882365+0000","last_active":"2023-10-14T19:11:14.903697+0000","last_peered":"2023-10-14T19:11:14.903697+0000","last_clean":"2023-10-14T19:11:14.903697+0000","last_became_active":"2023-10-14T19:11:13.882076+0000","last_became_peered":"2023-10-14T19:11:13.882076+0000","last_unstale":"2023-10-14T19:11:14.903697+0000","last_undegraded":"2023-10-14T19:11:14.903697+0000","last_fullsized":"2023-10-14T19:11:14.903697+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:20.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904432+0000","last_change":"2023-10-14T19:11:14.902501+0000","last_active":"2023-10-14T19:11:14.904432+0000","last_peered":"2023-10-14T19:11:14.904432+0000","last_clean":"2023-10-14T19:11:14.904432+0000","last_became_active":"2023-10-14T19:11:14.902237+0000","last_became_peered":"2023-10-14T19:11:14.902237+0000","last_unstale":"2023-10-14T19:11:14.904432+0000","last_undegraded":"2023-10-14T19:11:14.904432+0000","last_fullsized":"2023-10-14T19:11:14.904432+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:07.451584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903813+0000","last_change":"2023-10-14T19:11:13.879812+0000","last_active":"2023-10-14T19:11:14.903813+0000","last_peered":"2023-10-14T19:11:14.903813+0000","last_clean":"2023-10-14T19:11:14.903813+0000","last_became_active":"2023-10-14T19:11:13.877900+0000","last_became_peered":"2023-10-14T19:11:13.877900+0000","last_unstale":"2023-10-14T19:11:14.903813+0000","last_undegraded":"2023-10-14T19:11:14.903813+0000","last_fullsized":"2023-10-14T19:11:14.903813+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:09:18.043936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878588+0000","last_change":"2023-10-14T19:11:14.877191+0000","last_active":"2023-10-14T19:11:14.878588+0000","last_peered":"2023-10-14T19:11:14.878588+0000","last_clean":"2023-10-14T19:11:14.878588+0000","last_became_active":"2023-10-14T19:11:14.876890+0000","last_became_peered":"2023-10-14T19:11:14.876890+0000","last_unstale":"2023-10-14T19:11:14.878588+0000","last_undegraded":"2023-10-14T19:11:14.878588+0000","last_fullsized":"2023-10-14T19:11:14.878588+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:10.726113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899205+0000","last_change":"2023-10-14T19:11:13.886304+0000","last_active":"2023-10-14T19:11:14.899205+0000","last_peered":"2023-10-14T19:11:14.899205+0000","last_clean":"2023-10-14T19:11:14.899205+0000","last_became_active":"2023-10-14T19:11:13.886029+0000","last_became_peered":"2023-10-14T19:11:13.886029+0000","last_unstale":"2023-10-14T19:11:14.899205+0000","last_undegraded":"2023-10-14T19:11:14.899205+0000","last_fullsized":"2023-10-14T19:11:14.899205+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:02.233342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881835+0000","last_change":"2023-10-14T19:11:14.878751+0000","last_active":"2023-10-14T19:11:14.881835+0000","last_peered":"2023-10-14T19:11:14.881835+0000","last_clean":"2023-10-14T19:11:14.881835+0000","last_became_active":"2023-10-14T19:11:14.878365+0000","last_became_peered":"2023-10-14T19:11:14.878365+0000","last_unstale":"2023-10-14T19:11:14.881835+0000","last_undegraded":"2023-10-14T19:11:14.881835+0000","last_fullsized":"2023-10-14T19:11:14.881835+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:00.788849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873743+0000","last_change":"2023-10-14T19:11:13.889576+0000","last_active":"2023-10-14T19:11:14.873743+0000","last_peered":"2023-10-14T19:11:14.873743+0000","last_clean":"2023-10-14T19:11:14.873743+0000","last_became_active":"2023-10-14T19:11:13.889281+0000","last_became_peered":"2023-10-14T19:11:13.889281+0000","last_unstale":"2023-10-14T19:11:14.873743+0000","last_undegraded":"2023-10-14T19:11:14.873743+0000","last_fullsized":"2023-10-14T19:11:14.873743+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:17.378271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.882202+0000","last_change":"2023-10-14T19:11:14.880077+0000","last_active":"2023-10-14T19:11:14.882202+0000","last_peered":"2023-10-14T19:11:14.882202+0000","last_clean":"2023-10-14T19:11:14.882202+0000","last_became_active":"2023-10-14T19:11:14.879799+0000","last_became_peered":"2023-10-14T19:11:14.879799+0000","last_unstale":"2023-10-14T19:11:14.882202+0000","last_undegraded":"2023-10-14T19:11:14.882202+0000","last_fullsized":"2023-10-14T19:11:14.882202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:25:10.359841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884958+0000","last_change":"2023-10-14T19:11:13.882108+0000","last_active":"2023-10-14T19:11:14.884958+0000","last_peered":"2023-10-14T19:11:14.884958+0000","last_clean":"2023-10-14T19:11:14.884958+0000","last_became_active":"2023-10-14T19:11:13.881840+0000","last_became_peered":"2023-10-14T19:11:13.881840+0000","last_unstale":"2023-10-14T19:11:14.884958+0000","last_undegraded":"2023-10-14T19:11:14.884958+0000","last_fullsized":"2023-10-14T19:11:14.884958+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:12.150865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890422+0000","last_change":"2023-10-14T19:11:14.886567+0000","last_active":"2023-10-14T19:11:14.890422+0000","last_peered":"2023-10-14T19:11:14.890422+0000","last_clean":"2023-10-14T19:11:14.890422+0000","last_became_active":"2023-10-14T19:11:14.885671+0000","last_became_peered":"2023-10-14T19:11:14.885671+0000","last_unstale":"2023-10-14T19:11:14.890422+0000","last_undegraded":"2023-10-14T19:11:14.890422+0000","last_fullsized":"2023-10-14T19:11:14.890422+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:00.788849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905474+0000","last_change":"2023-10-14T19:11:13.886012+0000","last_active":"2023-10-14T19:11:14.905474+0000","last_peered":"2023-10-14T19:11:14.905474+0000","last_clean":"2023-10-14T19:11:14.905474+0000","last_became_active":"2023-10-14T19:11:13.884751+0000","last_became_peered":"2023-10-14T19:11:13.884751+0000","last_unstale":"2023-10-14T19:11:14.905474+0000","last_undegraded":"2023-10-14T19:11:14.905474+0000","last_fullsized":"2023-10-14T19:11:14.905474+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:51.526736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880640+0000","last_change":"2023-10-14T19:11:14.879161+0000","last_active":"2023-10-14T19:11:14.880640+0000","last_peered":"2023-10-14T19:11:14.880640+0000","last_clean":"2023-10-14T19:11:14.880640+0000","last_became_active":"2023-10-14T19:11:14.878662+0000","last_became_peered":"2023-10-14T19:11:14.878662+0000","last_unstale":"2023-10-14T19:11:14.880640+0000","last_undegraded":"2023-10-14T19:11:14.880640+0000","last_fullsized":"2023-10-14T19:11:14.880640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:52.236007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899439+0000","last_change":"2023-10-14T19:11:13.882975+0000","last_active":"2023-10-14T19:11:14.899439+0000","last_peered":"2023-10-14T19:11:14.899439+0000","last_clean":"2023-10-14T19:11:14.899439+0000","last_became_active":"2023-10-14T19:11:13.882712+0000","last_became_peered":"2023-10-14T19:11:13.882712+0000","last_unstale":"2023-10-14T19:11:14.899439+0000","last_undegraded":"2023-10-14T19:11:14.899439+0000","last_fullsized":"2023-10-14T19:11:14.899439+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:15.977144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.888466+0000","last_change":"2023-10-14T19:11:14.885731+0000","last_active":"2023-10-14T19:11:14.888466+0000","last_peered":"2023-10-14T19:11:14.888466+0000","last_clean":"2023-10-14T19:11:14.888466+0000","last_became_active":"2023-10-14T19:11:14.884038+0000","last_became_peered":"2023-10-14T19:11:14.884038+0000","last_unstale":"2023-10-14T19:11:14.888466+0000","last_undegraded":"2023-10-14T19:11:14.888466+0000","last_fullsized":"2023-10-14T19:11:14.888466+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:33.032227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901351+0000","last_change":"2023-10-14T19:11:13.876738+0000","last_active":"2023-10-14T19:11:14.901351+0000","last_peered":"2023-10-14T19:11:14.901351+0000","last_clean":"2023-10-14T19:11:14.901351+0000","last_became_active":"2023-10-14T19:11:13.876437+0000","last_became_peered":"2023-10-14T19:11:13.876437+0000","last_unstale":"2023-10-14T19:11:14.901351+0000","last_undegraded":"2023-10-14T19:11:14.901351+0000","last_fullsized":"2023-10-14T19:11:14.901351+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:22.659840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899505+0000","last_change":"2023-10-14T19:11:14.897612+0000","last_active":"2023-10-14T19:11:14.899505+0000","last_peered":"2023-10-14T19:11:14.899505+0000","last_clean":"2023-10-14T19:11:14.899505+0000","last_became_active":"2023-10-14T19:11:14.897362+0000","last_became_peered":"2023-10-14T19:11:14.897362+0000","last_unstale":"2023-10-14T19:11:14.899505+0000","last_undegraded":"2023-10-14T19:11:14.899505+0000","last_fullsized":"2023-10-14T19:11:14.899505+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:11.347384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901993+0000","last_change":"2023-10-14T19:11:13.884462+0000","last_active":"2023-10-14T19:11:14.901993+0000","last_peered":"2023-10-14T19:11:14.901993+0000","last_clean":"2023-10-14T19:11:14.901993+0000","last_became_active":"2023-10-14T19:11:13.884160+0000","last_became_peered":"2023-10-14T19:11:13.884160+0000","last_unstale":"2023-10-14T19:11:14.901993+0000","last_undegraded":"2023-10-14T19:11:14.901993+0000","last_fullsized":"2023-10-14T19:11:14.901993+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:05.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.892107+0000","last_change":"2023-10-14T19:11:14.891675+0000","last_active":"2023-10-14T19:11:14.892107+0000","last_peered":"2023-10-14T19:11:14.892107+0000","last_clean":"2023-10-14T19:11:14.892107+0000","last_became_active":"2023-10-14T19:11:14.891421+0000","last_became_peered":"2023-10-14T19:11:14.891421+0000","last_unstale":"2023-10-14T19:11:14.892107+0000","last_undegraded":"2023-10-14T19:11:14.892107+0000","last_fullsized":"2023-10-14T19:11:14.892107+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:34.372203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.876136+0000","last_change":"2023-10-14T19:11:13.884362+0000","last_active":"2023-10-14T19:11:14.876136+0000","last_peered":"2023-10-14T19:11:14.876136+0000","last_clean":"2023-10-14T19:11:14.876136+0000","last_became_active":"2023-10-14T19:11:13.884051+0000","last_became_peered":"2023-10-14T19:11:13.884051+0000","last_unstale":"2023-10-14T19:11:14.876136+0000","last_undegraded":"2023-10-14T19:11:14.876136+0000","last_fullsized":"2023-10-14T19:11:14.876136+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:27.422618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898581+0000","last_change":"2023-10-14T19:11:14.896189+0000","last_active":"2023-10-14T19:11:14.898581+0000","last_peered":"2023-10-14T19:11:14.898581+0000","last_clean":"2023-10-14T19:11:14.898581+0000","last_became_active":"2023-10-14T19:11:14.895894+0000","last_became_peered":"2023-10-14T19:11:14.895894+0000","last_unstale":"2023-10-14T19:11:14.898581+0000","last_undegraded":"2023-10-14T19:11:14.898581+0000","last_fullsized":"2023-10-14T19:11:14.898581+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:10.991741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903518+0000","last_change":"2023-10-14T19:11:13.889060+0000","last_active":"2023-10-14T19:11:14.903518+0000","last_peered":"2023-10-14T19:11:14.903518+0000","last_clean":"2023-10-14T19:11:14.903518+0000","last_became_active":"2023-10-14T19:11:13.888806+0000","last_became_peered":"2023-10-14T19:11:13.888806+0000","last_unstale":"2023-10-14T19:11:14.903518+0000","last_undegraded":"2023-10-14T19:11:14.903518+0000","last_fullsized":"2023-10-14T19:11:14.903518+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:55:37.724530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890597+0000","last_change":"2023-10-14T19:11:14.886655+0000","last_active":"2023-10-14T19:11:14.890597+0000","last_peered":"2023-10-14T19:11:14.890597+0000","last_clean":"2023-10-14T19:11:14.890597+0000","last_became_active":"2023-10-14T19:11:14.886391+0000","last_became_peered":"2023-10-14T19:11:14.886391+0000","last_unstale":"2023-10-14T19:11:14.890597+0000","last_undegraded":"2023-10-14T19:11:14.890597+0000","last_fullsized":"2023-10-14T19:11:14.890597+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:12:08.223917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885430+0000","last_change":"2023-10-14T19:11:13.884899+0000","last_active":"2023-10-14T19:11:14.885430+0000","last_peered":"2023-10-14T19:11:14.885430+0000","last_clean":"2023-10-14T19:11:14.885430+0000","last_became_active":"2023-10-14T19:11:13.883808+0000","last_became_peered":"2023-10-14T19:11:13.883808+0000","last_unstale":"2023-10-14T19:11:14.885430+0000","last_undegraded":"2023-10-14T19:11:14.885430+0000","last_fullsized":"2023-10-14T19:11:14.885430+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:51.526736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878380+0000","last_change":"2023-10-14T19:11:14.877343+0000","last_active":"2023-10-14T19:11:14.878380+0000","last_peered":"2023-10-14T19:11:14.878380+0000","last_clean":"2023-10-14T19:11:14.878380+0000","last_became_active":"2023-10-14T19:11:14.877086+0000","last_became_peered":"2023-10-14T19:11:14.877086+0000","last_unstale":"2023-10-14T19:11:14.878380+0000","last_undegraded":"2023-10-14T19:11:14.878380+0000","last_fullsized":"2023-10-14T19:11:14.878380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:10:26.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881517+0000","last_change":"2023-10-14T19:11:13.888013+0000","last_active":"2023-10-14T19:11:14.881517+0000","last_peered":"2023-10-14T19:11:14.881517+0000","last_clean":"2023-10-14T19:11:14.881517+0000","last_became_active":"2023-10-14T19:11:13.887693+0000","last_became_peered":"2023-10-14T19:11:13.887693+0000","last_unstale":"2023-10-14T19:11:14.881517+0000","last_undegraded":"2023-10-14T19:11:14.881517+0000","last_fullsized":"2023-10-14T19:11:14.881517+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:05.380969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890018+0000","last_change":"2023-10-14T19:11:14.888740+0000","last_active":"2023-10-14T19:11:14.890018+0000","last_peered":"2023-10-14T19:11:14.890018+0000","last_clean":"2023-10-14T19:11:14.890018+0000","last_became_active":"2023-10-14T19:11:14.888442+0000","last_became_peered":"2023-10-14T19:11:14.888442+0000","last_unstale":"2023-10-14T19:11:14.890018+0000","last_undegraded":"2023-10-14T19:11:14.890018+0000","last_fullsized":"2023-10-14T19:11:14.890018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:26.935615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.872890+0000","last_change":"2023-10-14T19:11:13.879918+0000","last_active":"2023-10-14T19:11:14.872890+0000","last_peered":"2023-10-14T19:11:14.872890+0000","last_clean":"2023-10-14T19:11:14.872890+0000","last_became_active":"2023-10-14T19:11:13.879488+0000","last_became_peered":"2023-10-14T19:11:13.879488+0000","last_unstale":"2023-10-14T19:11:14.872890+0000","last_undegraded":"2023-10-14T19:11:14.872890+0000","last_fullsized":"2023-10-14T19:11:14.872890+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:15:13.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.889262+0000","last_change":"2023-10-14T19:11:14.888109+0000","last_active":"2023-10-14T19:11:14.889262+0000","last_peered":"2023-10-14T19:11:14.889262+0000","last_clean":"2023-10-14T19:11:14.889262+0000","last_became_active":"2023-10-14T19:11:14.887896+0000","last_became_peered":"2023-10-14T19:11:14.887896+0000","last_unstale":"2023-10-14T19:11:14.889262+0000","last_undegraded":"2023-10-14T19:11:14.889262+0000","last_fullsized":"2023-10-14T19:11:14.889262+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:34.347737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902751+0000","last_change":"2023-10-14T19:11:13.887469+0000","last_active":"2023-10-14T19:11:14.902751+0000","last_peered":"2023-10-14T19:11:14.902751+0000","last_clean":"2023-10-14T19:11:14.902751+0000","last_became_active":"2023-10-14T19:11:13.887225+0000","last_became_peered":"2023-10-14T19:11:13.887225+0000","last_unstale":"2023-10-14T19:11:14.902751+0000","last_undegraded":"2023-10-14T19:11:14.902751+0000","last_fullsized":"2023-10-14T19:11:14.902751+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:26.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884451+0000","last_change":"2023-10-14T19:11:14.881256+0000","last_active":"2023-10-14T19:11:14.884451+0000","last_peered":"2023-10-14T19:11:14.884451+0000","last_clean":"2023-10-14T19:11:14.884451+0000","last_became_active":"2023-10-14T19:11:14.880933+0000","last_became_peered":"2023-10-14T19:11:14.880933+0000","last_unstale":"2023-10-14T19:11:14.884451+0000","last_undegraded":"2023-10-14T19:11:14.884451+0000","last_fullsized":"2023-10-14T19:11:14.884451+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:27.993025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887709+0000","last_change":"2023-10-14T19:11:13.882926+0000","last_active":"2023-10-14T19:11:14.887709+0000","last_peered":"2023-10-14T19:11:14.887709+0000","last_clean":"2023-10-14T19:11:14.887709+0000","last_became_active":"2023-10-14T19:11:13.881598+0000","last_became_peered":"2023-10-14T19:11:13.881598+0000","last_unstale":"2023-10-14T19:11:14.887709+0000","last_undegraded":"2023-10-14T19:11:14.887709+0000","last_fullsized":"2023-10-14T19:11:14.887709+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:25.927621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890295+0000","last_change":"2023-10-14T19:11:14.886172+0000","last_active":"2023-10-14T19:11:14.890295+0000","last_peered":"2023-10-14T19:11:14.890295+0000","last_clean":"2023-10-14T19:11:14.890295+0000","last_became_active":"2023-10-14T19:11:14.885903+0000","last_became_peered":"2023-10-14T19:11:14.885903+0000","last_unstale":"2023-10-14T19:11:14.890295+0000","last_undegraded":"2023-10-14T19:11:14.890295+0000","last_fullsized":"2023-10-14T19:11:14.890295+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:42.177435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894184+0000","last_change":"2023-10-14T19:11:13.879863+0000","last_active":"2023-10-14T19:11:14.894184+0000","last_peered":"2023-10-14T19:11:14.894184+0000","last_clean":"2023-10-14T19:11:14.894184+0000","last_became_active":"2023-10-14T19:11:13.879393+0000","last_became_peered":"2023-10-14T19:11:13.879393+0000","last_unstale":"2023-10-14T19:11:14.894184+0000","last_undegraded":"2023-10-14T19:11:14.894184+0000","last_fullsized":"2023-10-14T19:11:14.894184+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:05:17.442589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.886601+0000","last_change":"2023-10-14T19:11:14.885272+0000","last_active":"2023-10-14T19:11:14.886601+0000","last_peered":"2023-10-14T19:11:14.886601+0000","last_clean":"2023-10-14T19:11:14.886601+0000","last_became_active":"2023-10-14T19:11:14.884988+0000","last_became_peered":"2023-10-14T19:11:14.884988+0000","last_unstale":"2023-10-14T19:11:14.886601+0000","last_undegraded":"2023-10-14T19:11:14.886601+0000","last_fullsized":"2023-10-14T19:11:14.886601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:33.314415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873506+0000","last_change":"2023-10-14T19:11:13.886696+0000","last_active":"2023-10-14T19:11:14.873506+0000","last_peered":"2023-10-14T19:11:14.873506+0000","last_clean":"2023-10-14T19:11:14.873506+0000","last_became_active":"2023-10-14T19:11:13.886411+0000","last_became_peered":"2023-10-14T19:11:13.886411+0000","last_unstale":"2023-10-14T19:11:14.873506+0000","last_undegraded":"2023-10-14T19:11:14.873506+0000","last_fullsized":"2023-10-14T19:11:14.873506+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:37:26.743989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.879380+0000","last_change":"2023-10-14T19:11:14.878150+0000","last_active":"2023-10-14T19:11:14.879380+0000","last_peered":"2023-10-14T19:11:14.879380+0000","last_clean":"2023-10-14T19:11:14.879380+0000","last_became_active":"2023-10-14T19:11:14.877854+0000","last_became_peered":"2023-10-14T19:11:14.877854+0000","last_unstale":"2023-10-14T19:11:14.879380+0000","last_undegraded":"2023-10-14T19:11:14.879380+0000","last_fullsized":"2023-10-14T19:11:14.879380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:41.013361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881933+0000","last_change":"2023-10-14T19:11:13.889408+0000","last_active":"2023-10-14T19:11:14.881933+0000","last_peered":"2023-10-14T19:11:14.881933+0000","last_clean":"2023-10-14T19:11:14.881933+0000","last_became_active":"2023-10-14T19:11:13.889150+0000","last_became_peered":"2023-10-14T19:11:13.889150+0000","last_unstale":"2023-10-14T19:11:14.881933+0000","last_undegraded":"2023-10-14T19:11:14.881933+0000","last_fullsized":"2023-10-14T19:11:14.881933+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:45.782424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884481+0000","last_change":"2023-10-14T19:11:14.881097+0000","last_active":"2023-10-14T19:11:14.884481+0000","last_peered":"2023-10-14T19:11:14.884481+0000","last_clean":"2023-10-14T19:11:14.884481+0000","last_became_active":"2023-10-14T19:11:14.880822+0000","last_became_peered":"2023-10-14T19:11:14.880822+0000","last_unstale":"2023-10-14T19:11:14.884481+0000","last_undegraded":"2023-10-14T19:11:14.884481+0000","last_fullsized":"2023-10-14T19:11:14.884481+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873844+0000","last_change":"2023-10-14T19:11:13.883283+0000","last_active":"2023-10-14T19:11:14.873844+0000","last_peered":"2023-10-14T19:11:14.873844+0000","last_clean":"2023-10-14T19:11:14.873844+0000","last_became_active":"2023-10-14T19:11:13.883002+0000","last_became_peered":"2023-10-14T19:11:13.883002+0000","last_unstale":"2023-10-14T19:11:14.873844+0000","last_undegraded":"2023-10-14T19:11:14.873844+0000","last_fullsized":"2023-10-14T19:11:14.873844+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:39.329179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881972+0000","last_change":"2023-10-14T19:11:14.878962+0000","last_active":"2023-10-14T19:11:14.881972+0000","last_peered":"2023-10-14T19:11:14.881972+0000","last_clean":"2023-10-14T19:11:14.881972+0000","last_became_active":"2023-10-14T19:11:14.878661+0000","last_became_peered":"2023-10-14T19:11:14.878661+0000","last_unstale":"2023-10-14T19:11:14.881972+0000","last_undegraded":"2023-10-14T19:11:14.881972+0000","last_fullsized":"2023-10-14T19:11:14.881972+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:13.158859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885108+0000","last_change":"2023-10-14T19:11:13.887614+0000","last_active":"2023-10-14T19:11:14.885108+0000","last_peered":"2023-10-14T19:11:14.885108+0000","last_clean":"2023-10-14T19:11:14.885108+0000","last_became_active":"2023-10-14T19:11:13.887266+0000","last_became_peered":"2023-10-14T19:11:13.887266+0000","last_unstale":"2023-10-14T19:11:14.885108+0000","last_undegraded":"2023-10-14T19:11:14.885108+0000","last_fullsized":"2023-10-14T19:11:14.885108+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:30.977491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898119+0000","last_change":"2023-10-14T19:11:14.894921+0000","last_active":"2023-10-14T19:11:14.898119+0000","last_peered":"2023-10-14T19:11:14.898119+0000","last_clean":"2023-10-14T19:11:14.898119+0000","last_became_active":"2023-10-14T19:11:14.894289+0000","last_became_peered":"2023-10-14T19:11:14.894289+0000","last_unstale":"2023-10-14T19:11:14.898119+0000","last_undegraded":"2023-10-14T19:11:14.898119+0000","last_fullsized":"2023-10-14T19:11:14.898119+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:08.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.872954+0000","last_change":"2023-10-14T19:11:13.879744+0000","last_active":"2023-10-14T19:11:14.872954+0000","last_peered":"2023-10-14T19:11:14.872954+0000","last_clean":"2023-10-14T19:11:14.872954+0000","last_became_active":"2023-10-14T19:11:13.879150+0000","last_became_peered":"2023-10-14T19:11:13.879150+0000","last_unstale":"2023-10-14T19:11:14.872954+0000","last_undegraded":"2023-10-14T19:11:14.872954+0000","last_fullsized":"2023-10-14T19:11:14.872954+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:43:13.839136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901924+0000","last_change":"2023-10-14T19:11:14.898080+0000","last_active":"2023-10-14T19:11:14.901924+0000","last_peered":"2023-10-14T19:11:14.901924+0000","last_clean":"2023-10-14T19:11:14.901924+0000","last_became_active":"2023-10-14T19:11:14.897787+0000","last_became_peered":"2023-10-14T19:11:14.897787+0000","last_unstale":"2023-10-14T19:11:14.901924+0000","last_undegraded":"2023-10-14T19:11:14.901924+0000","last_fullsized":"2023-10-14T19:11:14.901924+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:28.430611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902912+0000","last_change":"2023-10-14T19:11:13.889060+0000","last_active":"2023-10-14T19:11:14.902912+0000","last_peered":"2023-10-14T19:11:14.902912+0000","last_clean":"2023-10-14T19:11:14.902912+0000","last_became_active":"2023-10-14T19:11:13.888783+0000","last_became_peered":"2023-10-14T19:11:13.888783+0000","last_unstale":"2023-10-14T19:11:14.902912+0000","last_undegraded":"2023-10-14T19:11:14.902912+0000","last_fullsized":"2023-10-14T19:11:14.902912+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:47.688528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":280,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885575+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:14.885575+0000","last_peered":"2023-10-14T19:11:14.885575+0000","last_clean":"2023-10-14T19:11:14.885575+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:14.885575+0000","last_undegraded":"2023-10-14T19:11:14.885575+0000","last_fullsized":"2023-10-14T19:11:14.885575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304012,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067828,"statfs":{"total":96636764160,"available":96325455872,"internally_reserved":0,"allocated":2691072,"data_stored":1525081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.63800000000000001},"min":{"1min":0.35699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.60999999999999999,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.432}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.64100000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.755,"15min":3.1480000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89600000000000002,"15min":3.23},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.73299999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74299999999999999,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.73499999999999999,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.55600000000000005},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.875,"15min":2.4620000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.66900000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.746},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.63600000000000001},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":2.883},"last":0.71499999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.64900000000000002},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":5.383},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574951,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303436,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068404,"statfs":{"total":96636764160,"available":96326045696,"internally_reserved":0,"allocated":2101248,"data_stored":934699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.65800000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":5.6820000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.745,"5min":0.745,"15min":7.8680000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78900000000000003,"15min":8.0210000000000008},"last":0.439},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.78500000000000003},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.498}]},{"osd":3,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.745},"min":{"1min":0.379,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.76000000000000001},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":8.1120000000000001},"last":0.373}]},{"osd":4,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.33000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.54700000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73599999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42199999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.58999999999999997},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.61899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":934733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.503},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304016,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067824,"statfs":{"total":96636764160,"available":96325451776,"internally_reserved":0,"allocated":2695168,"data_stored":1525655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303448,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068392,"statfs":{"total":96636764160,"available":96326033408,"internally_reserved":0,"allocated":2113536,"data_stored":936235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.45400000000000001,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.42499999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":0.65800000000000003,"15min":2.028},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53400000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38100000000000001,"15min":0.69099999999999995},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":11.269},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.66200000000000003},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":11.318},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59599999999999997,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.67200000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.94699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":11.379},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.95199999999999996},"min":{"1min":0.438,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":11.404},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.96499999999999997},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2109440,"data_stored":936249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49099999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.38100000000000001},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32200000000000001,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.26300000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54200000000000004,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.433},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.44700000000000001},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":2.597,"15min":2.597},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.214,"15min":1.214},"last":0.77800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.133,"15min":1.133},"last":0.753},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.752,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.379,"15min":0.379},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":0.997},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":935197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.371}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.35299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.47599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.498}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":934643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32700000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.83199999999999996,"5min":1.784,"15min":1.784},"last":0.83199999999999996}]},{"osd":1,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81499999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.876},"last":0.753},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.75900000000000001},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.88100000000000001,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.88100000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.84499999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":1.008,"15min":1.008},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:19.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T19:11:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.958+0000 7f65fd460700 1 Processor -- start 2023-10-14T19:11:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.958+0000 7f65fd460700 1 -- start start 2023-10-14T19:11:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fd460700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65f8153a00 0x7f65f8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fd460700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f65f80cea00 0x7f65f80ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fd460700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f815bb70 con 0x7f65f815dff0 2023-10-14T19:11:19.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fd460700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f815ac80 con 0x7f65f8153a00 2023-10-14T19:11:19.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fd460700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f815d010 con 0x7f65f80cea00 2023-10-14T19:11:19.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65f8153a00 0x7f65f8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65f8153a00 0x7f65f8153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33320/0 (socket says 172.21.15.7:33320) 2023-10-14T19:11:19.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 -- 172.21.15.7:0/4049151126 learned_addr learned my addr 172.21.15.7:0/4049151126 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:19.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fcc5f700 1 --2- 172.21.15.7:0/4049151126 >> v2:172.21.15.148:3300/0 conn(0x7f65f80cea00 0x7f65f80ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 -- 172.21.15.7:0/4049151126 >> v2:172.21.15.148:3300/0 conn(0x7f65f80cea00 msgr2=0x7f65f80ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:19.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 --2- 172.21.15.7:0/4049151126 >> v2:172.21.15.148:3300/0 conn(0x7f65f80cea00 0x7f65f80ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 -- 172.21.15.7:0/4049151126 >> v1:172.21.15.148:6789/0 conn(0x7f65f815dff0 legacy=0x7f65f815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65f7fff700 1 -- 172.21.15.7:0/4049151126 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80cf3e0 con 0x7f65f8153a00 2023-10-14T19:11:19.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.959+0000 7f65fcc5f700 1 --2- 172.21.15.7:0/4049151126 >> v2:172.21.15.148:3300/0 conn(0x7f65f80cea00 0x7f65f80ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:19.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65f7fff700 1 --2- 172.21.15.7:0/4049151126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f8153a00 0x7f65f8153dd0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f65e00099b0 tx=0x7f65e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb236d3db9271b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65f6ffd700 1 -- 172.21.15.7:0/4049151126 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000b820 con 0x7f65f8153a00 2023-10-14T19:11:19.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65f6ffd700 1 -- 172.21.15.7:0/4049151126 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e000b980 con 0x7f65f8153a00 2023-10-14T19:11:19.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65f6ffd700 1 -- 172.21.15.7:0/4049151126 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000bd20 con 0x7f65f8153a00 2023-10-14T19:11:19.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 -- 172.21.15.7:0/4049151126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f8153a00 msgr2=0x7f65f8153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 --2- 172.21.15.7:0/4049151126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f8153a00 0x7f65f8153dd0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f65e00099b0 tx=0x7f65e0009250 comp rx=0 tx=0).stop 2023-10-14T19:11:19.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 -- 172.21.15.7:0/4049151126 shutdown_connections 2023-10-14T19:11:19.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 --2- 172.21.15.7:0/4049151126 >> v2:172.21.15.148:3300/0 conn(0x7f65f80cea00 0x7f65f80ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 --2- 172.21.15.7:0/4049151126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f8153a00 0x7f65f8153dd0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 -- 172.21.15.7:0/4049151126 >> 172.21.15.7:0/4049151126 conn(0x7f65f80703a0 msgr2=0x7f65f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:19.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 -- 172.21.15.7:0/4049151126 shutdown_connections 2023-10-14T19:11:19.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.960+0000 7f65fd460700 1 -- 172.21.15.7:0/4049151126 wait complete. 2023-10-14T19:11:19.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.961+0000 7f65fd460700 1 Processor -- start 2023-10-14T19:11:19.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 -- start start 2023-10-14T19:11:19.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f80cea00 0x7f65f80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f8153a00 0x7f65f815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 0x7f65f80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8169660 con 0x7f65f815dff0 2023-10-14T19:11:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8169940 con 0x7f65f80cea00 2023-10-14T19:11:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fd460700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8169c20 con 0x7f65f8153a00 2023-10-14T19:11:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fcc5f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 0x7f65f80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fcc5f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 0x7f65f80b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33336/0 (socket says 172.21.15.7:33336) 2023-10-14T19:11:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.962+0000 7f65fcc5f700 1 -- 172.21.15.7:0/1146807099 learned_addr learned my addr 172.21.15.7:0/1146807099 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65f7fff700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f80cea00 0x7f65f80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65f77fe700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f8153a00 0x7f65f815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fcc5f700 1 -- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f8153a00 msgr2=0x7f65f815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fcc5f700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f8153a00 0x7f65f815f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fcc5f700 1 -- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f80cea00 msgr2=0x7f65f80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fcc5f700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f80cea00 0x7f65f80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fcc5f700 1 -- 172.21.15.7:0/1146807099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00094f0 con 0x7f65f815dff0 2023-10-14T19:11:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65f7fff700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f80cea00 0x7f65f80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fcc5f700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 0x7f65f80b13a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009fc0 tx=0x7f65f00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000dd40 con 0x7f65f815dff0 2023-10-14T19:11:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f000f040 con 0x7f65f815dff0 2023-10-14T19:11:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0015690 con 0x7f65f815dff0 2023-10-14T19:11:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f8169f00 con 0x7f65f815dff0 2023-10-14T19:11:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.963+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f80b2270 con 0x7f65f815dff0 2023-10-14T19:11:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.964+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f816a400 con 0x7f65f815dff0 2023-10-14T19:11:19.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.965+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f65f001e3b0 con 0x7f65f815dff0 2023-10-14T19:11:19.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.965+0000 7f65effff700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65d8067320 0x7f65d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:19.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.965+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65f00852d0 con 0x7f65f815dff0 2023-10-14T19:11:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.965+0000 7f65f7fff700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65d8067320 0x7f65d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.966+0000 7f65f7fff700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65d8067320 0x7f65d80697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f65e00099b0 tx=0x7f65e0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:19.969+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65f0051e50 con 0x7f65f815dff0 2023-10-14T19:11:20.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.239+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f65f804c3c0 con 0x7f65f815dff0 2023-10-14T19:11:20.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.240+0000 7f65effff700 1 -- 172.21.15.7:0/1146807099 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1439 (secure 0 0 0) 0x7f65f0055470 con 0x7f65f815dff0 2023-10-14T19:11:20.241 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:20.241 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":508,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1697310181,"num_in_osds":8,"osd_in_since":1697310174,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2486935552,"bytes_avail":770607177728,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":111,"id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"c","status":"up:active","gid":8250}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-10-14T19:11:03.736465+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-14T19:11:20.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65d8067320 msgr2=0x7f65d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65d8067320 0x7f65d80697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f65e00099b0 tx=0x7f65e0017000 comp rx=0 tx=0).stop 2023-10-14T19:11:20.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 msgr2=0x7f65f80b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 0x7f65f80b13a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009fc0 tx=0x7f65f00099b0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 shutdown_connections 2023-10-14T19:11:20.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65d8067320 0x7f65d80697d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f80cea00 0x7f65f80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f815dff0 0x7f65f80b13a0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 --2- 172.21.15.7:0/1146807099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f8153a00 0x7f65f815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 >> 172.21.15.7:0/1146807099 conn(0x7f65f80703a0 msgr2=0x7f65f80d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:20.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.241+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 shutdown_connections 2023-10-14T19:11:20.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.242+0000 7f65fd460700 1 -- 172.21.15.7:0/1146807099 wait complete. 2023-10-14T19:11:20.254 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T19:11:20.255 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:20.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.373+0000 7f003a4ab700 1 Processor -- start 2023-10-14T19:11:20.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f003a4ab700 1 -- start start 2023-10-14T19:11:20.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f003a4ab700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00341598b0 0x7f00340af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:20.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f003a4ab700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340ce9d0 con 0x7f00340af790 2023-10-14T19:11:20.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f003a4ab700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340afc30 con 0x7f0034159c80 2023-10-14T19:11:20.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f003a4ab700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340aff10 con 0x7f00341598b0 2023-10-14T19:11:20.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f0038a48700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00340af790 0x7f0034163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42072/0 (socket says 172.21.15.7:42072) 2023-10-14T19:11:20.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.374+0000 7f0038a48700 1 -- 172.21.15.7:0/1637701271 learned_addr learned my addr 172.21.15.7:0/1637701271 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:20.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0033fff700 1 --2- 172.21.15.7:0/1637701271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00341598b0 0x7f00340af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:20.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736346266 0 0) 0x7f00340ce9d0 con 0x7f00340af790 2023-10-14T19:11:20.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c003570 con 0x7f00340af790 2023-10-14T19:11:20.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115005650 0 0) 0x7f00340afc30 con 0x7f0034159c80 2023-10-14T19:11:20.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00340ce9d0 con 0x7f0034159c80 2023-10-14T19:11:20.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0033fff700 1 -- 172.21.15.7:0/1637701271 >> v1:172.21.15.148:6789/0 conn(0x7f0034159c80 legacy=0x7f00340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0033fff700 1 -- 172.21.15.7:0/1637701271 >> v1:172.21.15.7:6789/0 conn(0x7f00340af790 legacy=0x7f0034163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0033fff700 1 -- 172.21.15.7:0/1637701271 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00340ce380 con 0x7f00341598b0 2023-10-14T19:11:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0033fff700 1 --2- 172.21.15.7:0/1637701271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00341598b0 0x7f00340af250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0024009910 tx=0x7f00240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae370ca10762c96e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024011630 con 0x7f00341598b0 2023-10-14T19:11:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024011790 con 0x7f00341598b0 2023-10-14T19:11:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.375+0000 7f0032ffd700 1 -- 172.21.15.7:0/1637701271 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024011b30 con 0x7f00341598b0 2023-10-14T19:11:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 -- 172.21.15.7:0/1637701271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00341598b0 msgr2=0x7f00340af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 --2- 172.21.15.7:0/1637701271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00341598b0 0x7f00340af250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0024009910 tx=0x7f00240091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 -- 172.21.15.7:0/1637701271 shutdown_connections 2023-10-14T19:11:20.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 --2- 172.21.15.7:0/1637701271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00341598b0 0x7f00340af250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 -- 172.21.15.7:0/1637701271 >> 172.21.15.7:0/1637701271 conn(0x7f0034070e30 msgr2=0x7f00340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 -- 172.21.15.7:0/1637701271 shutdown_connections 2023-10-14T19:11:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.376+0000 7f003a4ab700 1 -- 172.21.15.7:0/1637701271 wait complete. 2023-10-14T19:11:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.377+0000 7f003a4ab700 1 Processor -- start 2023-10-14T19:11:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.377+0000 7f003a4ab700 1 -- start start 2023-10-14T19:11:20.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f003a4ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00340af790 0x7f00340b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:20.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f003a4ab700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 0x7f00340b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:20.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f003a4ab700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0034159c80 0x7f003415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:20.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f003a4ab700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00340b4e90 con 0x7f00341598b0 2023-10-14T19:11:20.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f003a4ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003415aab0 con 0x7f00340af790 2023-10-14T19:11:20.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f003a4ab700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003415c1f0 con 0x7f0034159c80 2023-10-14T19:11:20.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 0x7f00340b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:20.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 0x7f00340b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33340/0 (socket says 172.21.15.7:33340) 2023-10-14T19:11:20.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 -- 172.21.15.7:0/523842505 learned_addr learned my addr 172.21.15.7:0/523842505 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f0033fff700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00340af790 0x7f00340b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f0038a48700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0034159c80 0x7f003415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 -- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0034159c80 msgr2=0x7f003415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0034159c80 0x7f003415e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 -- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00340af790 msgr2=0x7f00340b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00340af790 0x7f00340b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.378+0000 7f00337fe700 1 -- 172.21.15.7:0/523842505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009420 con 0x7f00341598b0 2023-10-14T19:11:20.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.379+0000 7f00337fe700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 0x7f00340b48b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f002800c580 tx=0x7f0028007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:20.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.379+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028010510 con 0x7f00341598b0 2023-10-14T19:11:20.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.379+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0028010670 con 0x7f00341598b0 2023-10-14T19:11:20.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.379+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003415a180 con 0x7f00341598b0 2023-10-14T19:11:20.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.379+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028010a30 con 0x7f00341598b0 2023-10-14T19:11:20.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.379+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003415a740 con 0x7f00341598b0 2023-10-14T19:11:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.380+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003415ac60 con 0x7f00341598b0 2023-10-14T19:11:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.380+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f002801b400 con 0x7f00341598b0 2023-10-14T19:11:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.381+0000 7f001bfff700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0020067320 0x7f00200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.381+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0028084660 con 0x7f00341598b0 2023-10-14T19:11:20.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.381+0000 7f0033fff700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0020067320 0x7f00200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:20.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.381+0000 7f0033fff700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0020067320 0x7f00200697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0024009860 tx=0x7f0024017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:20.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.385+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f003415ac60 con 0x7f00341598b0 2023-10-14T19:11:20.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.575+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f003415ac20 con 0x7f0020067320 2023-10-14T19:11:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.583+0000 7f001bfff700 1 -- 172.21.15.7:0/523842505 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289922 (secure 0 0 0) 0x7f003415ac20 con 0x7f0020067320 2023-10-14T19:11:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0020067320 msgr2=0x7f00200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0020067320 0x7f00200697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0024009860 tx=0x7f0024017000 comp rx=0 tx=0).stop 2023-10-14T19:11:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 msgr2=0x7f00340b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 0x7f00340b48b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f002800c580 tx=0x7f0028007e10 comp rx=0 tx=0).stop 2023-10-14T19:11:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 shutdown_connections 2023-10-14T19:11:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0020067320 0x7f00200697d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00340af790 0x7f00340b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0034159c80 0x7f003415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 --2- 172.21.15.7:0/523842505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00341598b0 0x7f00340b48b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 >> 172.21.15.7:0/523842505 conn(0x7f0034070e30 msgr2=0x7f00340cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 shutdown_connections 2023-10-14T19:11:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:20.587+0000 7f003a4ab700 1 -- 172.21.15.7:0/523842505 wait complete. 2023-10-14T19:11:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:20.600 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2023-10-14T19:11:19.739929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428648,"kb_used_data":17576,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546072,"statfs":{"total":773094113280,"available":770607177728,"internally_reserved":0,"allocated":17997824,"data_stored":8662492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001627"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904354+0000","last_change":"2023-10-14T19:11:14.901991+0000","last_active":"2023-10-14T19:11:14.904354+0000","last_peered":"2023-10-14T19:11:14.904354+0000","last_clean":"2023-10-14T19:11:14.904354+0000","last_became_active":"2023-10-14T19:11:14.901426+0000","last_became_peered":"2023-10-14T19:11:14.901426+0000","last_unstale":"2023-10-14T19:11:14.904354+0000","last_undegraded":"2023-10-14T19:11:14.904354+0000","last_fullsized":"2023-10-14T19:11:14.904354+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:43.985400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887108+0000","last_change":"2023-10-14T19:11:14.884331+0000","last_active":"2023-10-14T19:11:14.887108+0000","last_peered":"2023-10-14T19:11:14.887108+0000","last_clean":"2023-10-14T19:11:14.887108+0000","last_became_active":"2023-10-14T19:11:14.884042+0000","last_became_peered":"2023-10-14T19:11:14.884042+0000","last_unstale":"2023-10-14T19:11:14.887108+0000","last_undegraded":"2023-10-14T19:11:14.887108+0000","last_fullsized":"2023-10-14T19:11:14.887108+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:31.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890565+0000","last_change":"2023-10-14T19:11:14.888613+0000","last_active":"2023-10-14T19:11:14.890565+0000","last_peered":"2023-10-14T19:11:14.890565+0000","last_clean":"2023-10-14T19:11:14.890565+0000","last_became_active":"2023-10-14T19:11:14.888292+0000","last_became_peered":"2023-10-14T19:11:14.888292+0000","last_unstale":"2023-10-14T19:11:14.890565+0000","last_undegraded":"2023-10-14T19:11:14.890565+0000","last_fullsized":"2023-10-14T19:11:14.890565+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898084+0000","last_change":"2023-10-14T19:11:14.893088+0000","last_active":"2023-10-14T19:11:14.898084+0000","last_peered":"2023-10-14T19:11:14.898084+0000","last_clean":"2023-10-14T19:11:14.898084+0000","last_became_active":"2023-10-14T19:11:14.892823+0000","last_became_peered":"2023-10-14T19:11:14.892823+0000","last_unstale":"2023-10-14T19:11:14.898084+0000","last_undegraded":"2023-10-14T19:11:14.898084+0000","last_fullsized":"2023-10-14T19:11:14.898084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:09.182588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.900224+0000","last_change":"2023-10-14T19:11:14.895506+0000","last_active":"2023-10-14T19:11:14.900224+0000","last_peered":"2023-10-14T19:11:14.900224+0000","last_clean":"2023-10-14T19:11:14.900224+0000","last_became_active":"2023-10-14T19:11:14.894979+0000","last_became_peered":"2023-10-14T19:11:14.894979+0000","last_unstale":"2023-10-14T19:11:14.900224+0000","last_undegraded":"2023-10-14T19:11:14.900224+0000","last_fullsized":"2023-10-14T19:11:14.900224+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:39.196624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894002+0000","last_change":"2023-10-14T19:11:14.891032+0000","last_active":"2023-10-14T19:11:14.894002+0000","last_peered":"2023-10-14T19:11:14.894002+0000","last_clean":"2023-10-14T19:11:14.894002+0000","last_became_active":"2023-10-14T19:11:14.890718+0000","last_became_peered":"2023-10-14T19:11:14.890718+0000","last_unstale":"2023-10-14T19:11:14.894002+0000","last_undegraded":"2023-10-14T19:11:14.894002+0000","last_fullsized":"2023-10-14T19:11:14.894002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:31.261627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.896243+0000","last_change":"2023-10-14T19:11:14.889416+0000","last_active":"2023-10-14T19:11:14.896243+0000","last_peered":"2023-10-14T19:11:14.896243+0000","last_clean":"2023-10-14T19:11:14.896243+0000","last_became_active":"2023-10-14T19:11:14.889107+0000","last_became_peered":"2023-10-14T19:11:14.889107+0000","last_unstale":"2023-10-14T19:11:14.896243+0000","last_undegraded":"2023-10-14T19:11:14.896243+0000","last_fullsized":"2023-10-14T19:11:14.896243+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:31.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880681+0000","last_change":"2023-10-14T19:11:14.880019+0000","last_active":"2023-10-14T19:11:14.880681+0000","last_peered":"2023-10-14T19:11:14.880681+0000","last_clean":"2023-10-14T19:11:14.880681+0000","last_became_active":"2023-10-14T19:11:14.879735+0000","last_became_peered":"2023-10-14T19:11:14.879735+0000","last_unstale":"2023-10-14T19:11:14.880681+0000","last_undegraded":"2023-10-14T19:11:14.880681+0000","last_fullsized":"2023-10-14T19:11:14.880681+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:19.992061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898829+0000","last_change":"2023-10-14T19:11:14.895595+0000","last_active":"2023-10-14T19:11:14.898829+0000","last_peered":"2023-10-14T19:11:14.898829+0000","last_clean":"2023-10-14T19:11:14.898829+0000","last_became_active":"2023-10-14T19:11:14.895328+0000","last_became_peered":"2023-10-14T19:11:14.895328+0000","last_unstale":"2023-10-14T19:11:14.898829+0000","last_undegraded":"2023-10-14T19:11:14.898829+0000","last_fullsized":"2023-10-14T19:11:14.898829+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:00.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878033+0000","last_change":"2023-10-14T19:11:14.877244+0000","last_active":"2023-10-14T19:11:14.878033+0000","last_peered":"2023-10-14T19:11:14.878033+0000","last_clean":"2023-10-14T19:11:14.878033+0000","last_became_active":"2023-10-14T19:11:14.876941+0000","last_became_peered":"2023-10-14T19:11:14.876941+0000","last_unstale":"2023-10-14T19:11:14.878033+0000","last_undegraded":"2023-10-14T19:11:14.878033+0000","last_fullsized":"2023-10-14T19:11:14.878033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:40.337173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905520+0000","last_change":"2023-10-14T19:11:14.904151+0000","last_active":"2023-10-14T19:11:14.905520+0000","last_peered":"2023-10-14T19:11:14.905520+0000","last_clean":"2023-10-14T19:11:14.905520+0000","last_became_active":"2023-10-14T19:11:14.903594+0000","last_became_peered":"2023-10-14T19:11:14.903594+0000","last_unstale":"2023-10-14T19:11:14.905520+0000","last_undegraded":"2023-10-14T19:11:14.905520+0000","last_fullsized":"2023-10-14T19:11:14.905520+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:33.032227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899165+0000","last_change":"2023-10-14T19:11:14.893034+0000","last_active":"2023-10-14T19:11:14.899165+0000","last_peered":"2023-10-14T19:11:14.899165+0000","last_clean":"2023-10-14T19:11:14.899165+0000","last_became_active":"2023-10-14T19:11:14.892767+0000","last_became_peered":"2023-10-14T19:11:14.892767+0000","last_unstale":"2023-10-14T19:11:14.899165+0000","last_undegraded":"2023-10-14T19:11:14.899165+0000","last_fullsized":"2023-10-14T19:11:14.899165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:06.124370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898270+0000","last_change":"2023-10-14T19:11:14.891165+0000","last_active":"2023-10-14T19:11:14.898270+0000","last_peered":"2023-10-14T19:11:14.898270+0000","last_clean":"2023-10-14T19:11:14.898270+0000","last_became_active":"2023-10-14T19:11:14.890919+0000","last_became_peered":"2023-10-14T19:11:14.890919+0000","last_unstale":"2023-10-14T19:11:14.898270+0000","last_undegraded":"2023-10-14T19:11:14.898270+0000","last_fullsized":"2023-10-14T19:11:14.898270+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890411+0000","last_change":"2023-10-14T19:11:14.887113+0000","last_active":"2023-10-14T19:11:14.890411+0000","last_peered":"2023-10-14T19:11:14.890411+0000","last_clean":"2023-10-14T19:11:14.890411+0000","last_became_active":"2023-10-14T19:11:14.886821+0000","last_became_peered":"2023-10-14T19:11:14.886821+0000","last_unstale":"2023-10-14T19:11:14.890411+0000","last_undegraded":"2023-10-14T19:11:14.890411+0000","last_fullsized":"2023-10-14T19:11:14.890411+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887033+0000","last_change":"2023-10-14T19:11:14.883200+0000","last_active":"2023-10-14T19:11:14.887033+0000","last_peered":"2023-10-14T19:11:14.887033+0000","last_clean":"2023-10-14T19:11:14.887033+0000","last_became_active":"2023-10-14T19:11:14.882856+0000","last_became_peered":"2023-10-14T19:11:14.882856+0000","last_unstale":"2023-10-14T19:11:14.887033+0000","last_undegraded":"2023-10-14T19:11:14.887033+0000","last_fullsized":"2023-10-14T19:11:14.887033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:34.191576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.892636+0000","last_change":"2023-10-14T19:11:14.887496+0000","last_active":"2023-10-14T19:11:14.892636+0000","last_peered":"2023-10-14T19:11:14.892636+0000","last_clean":"2023-10-14T19:11:14.892636+0000","last_became_active":"2023-10-14T19:11:14.887193+0000","last_became_peered":"2023-10-14T19:11:14.887193+0000","last_unstale":"2023-10-14T19:11:14.892636+0000","last_undegraded":"2023-10-14T19:11:14.892636+0000","last_fullsized":"2023-10-14T19:11:14.892636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:33.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890768+0000","last_change":"2023-10-14T19:11:14.889661+0000","last_active":"2023-10-14T19:11:14.890768+0000","last_peered":"2023-10-14T19:11:14.890768+0000","last_clean":"2023-10-14T19:11:14.890768+0000","last_became_active":"2023-10-14T19:11:14.887488+0000","last_became_peered":"2023-10-14T19:11:14.887488+0000","last_unstale":"2023-10-14T19:11:14.890768+0000","last_undegraded":"2023-10-14T19:11:14.890768+0000","last_fullsized":"2023-10-14T19:11:14.890768+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:41.013361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.886998+0000","last_change":"2023-10-14T19:11:14.885069+0000","last_active":"2023-10-14T19:11:14.886998+0000","last_peered":"2023-10-14T19:11:14.886998+0000","last_clean":"2023-10-14T19:11:14.886998+0000","last_became_active":"2023-10-14T19:11:14.884796+0000","last_became_peered":"2023-10-14T19:11:14.884796+0000","last_unstale":"2023-10-14T19:11:14.886998+0000","last_undegraded":"2023-10-14T19:11:14.886998+0000","last_fullsized":"2023-10-14T19:11:14.886998+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:43.985400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903234+0000","last_change":"2023-10-14T19:11:14.901829+0000","last_active":"2023-10-14T19:11:14.903234+0000","last_peered":"2023-10-14T19:11:14.903234+0000","last_clean":"2023-10-14T19:11:14.903234+0000","last_became_active":"2023-10-14T19:11:14.900088+0000","last_became_peered":"2023-10-14T19:11:14.900088+0000","last_unstale":"2023-10-14T19:11:14.903234+0000","last_undegraded":"2023-10-14T19:11:14.903234+0000","last_fullsized":"2023-10-14T19:11:14.903234+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:16.117414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878910+0000","last_change":"2023-10-14T19:11:14.878073+0000","last_active":"2023-10-14T19:11:14.878910+0000","last_peered":"2023-10-14T19:11:14.878910+0000","last_clean":"2023-10-14T19:11:14.878910+0000","last_became_active":"2023-10-14T19:11:14.877781+0000","last_became_peered":"2023-10-14T19:11:14.877781+0000","last_unstale":"2023-10-14T19:11:14.878910+0000","last_undegraded":"2023-10-14T19:11:14.878910+0000","last_fullsized":"2023-10-14T19:11:14.878910+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:35.546493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894781+0000","last_change":"2023-10-14T19:11:14.889823+0000","last_active":"2023-10-14T19:11:14.894781+0000","last_peered":"2023-10-14T19:11:14.894781+0000","last_clean":"2023-10-14T19:11:14.894781+0000","last_became_active":"2023-10-14T19:11:14.889570+0000","last_became_peered":"2023-10-14T19:11:14.889570+0000","last_unstale":"2023-10-14T19:11:14.894781+0000","last_undegraded":"2023-10-14T19:11:14.894781+0000","last_fullsized":"2023-10-14T19:11:14.894781+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:51.900240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880456+0000","last_change":"2023-10-14T19:11:14.879997+0000","last_active":"2023-10-14T19:11:14.880456+0000","last_peered":"2023-10-14T19:11:14.880456+0000","last_clean":"2023-10-14T19:11:14.880456+0000","last_became_active":"2023-10-14T19:11:14.879676+0000","last_became_peered":"2023-10-14T19:11:14.879676+0000","last_unstale":"2023-10-14T19:11:14.880456+0000","last_undegraded":"2023-10-14T19:11:14.880456+0000","last_fullsized":"2023-10-14T19:11:14.880456+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:38:12.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898146+0000","last_change":"2023-10-14T19:11:14.895092+0000","last_active":"2023-10-14T19:11:14.898146+0000","last_peered":"2023-10-14T19:11:14.898146+0000","last_clean":"2023-10-14T19:11:14.898146+0000","last_became_active":"2023-10-14T19:11:14.894651+0000","last_became_peered":"2023-10-14T19:11:14.894651+0000","last_unstale":"2023-10-14T19:11:14.898146+0000","last_undegraded":"2023-10-14T19:11:14.898146+0000","last_fullsized":"2023-10-14T19:11:14.898146+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:35.546493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.891324+0000","last_change":"2023-10-14T19:11:14.889196+0000","last_active":"2023-10-14T19:11:14.891324+0000","last_peered":"2023-10-14T19:11:14.891324+0000","last_clean":"2023-10-14T19:11:14.891324+0000","last_became_active":"2023-10-14T19:11:14.888787+0000","last_became_peered":"2023-10-14T19:11:14.888787+0000","last_unstale":"2023-10-14T19:11:14.891324+0000","last_undegraded":"2023-10-14T19:11:14.891324+0000","last_fullsized":"2023-10-14T19:11:14.891324+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.462907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904456+0000","last_change":"2023-10-14T19:11:14.902015+0000","last_active":"2023-10-14T19:11:14.904456+0000","last_peered":"2023-10-14T19:11:14.904456+0000","last_clean":"2023-10-14T19:11:14.904456+0000","last_became_active":"2023-10-14T19:11:14.901761+0000","last_became_peered":"2023-10-14T19:11:14.901761+0000","last_unstale":"2023-10-14T19:11:14.904456+0000","last_undegraded":"2023-10-14T19:11:14.904456+0000","last_fullsized":"2023-10-14T19:11:14.904456+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:47:29.218531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.897350+0000","last_change":"2023-10-14T19:11:14.893257+0000","last_active":"2023-10-14T19:11:14.897350+0000","last_peered":"2023-10-14T19:11:14.897350+0000","last_clean":"2023-10-14T19:11:14.897350+0000","last_became_active":"2023-10-14T19:11:14.892936+0000","last_became_peered":"2023-10-14T19:11:14.892936+0000","last_unstale":"2023-10-14T19:11:14.897350+0000","last_undegraded":"2023-10-14T19:11:14.897350+0000","last_fullsized":"2023-10-14T19:11:14.897350+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.880227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905532+0000","last_change":"2023-10-14T19:11:14.904268+0000","last_active":"2023-10-14T19:11:14.905532+0000","last_peered":"2023-10-14T19:11:14.905532+0000","last_clean":"2023-10-14T19:11:14.905532+0000","last_became_active":"2023-10-14T19:11:14.903890+0000","last_became_peered":"2023-10-14T19:11:14.903890+0000","last_unstale":"2023-10-14T19:11:14.905532+0000","last_undegraded":"2023-10-14T19:11:14.905532+0000","last_fullsized":"2023-10-14T19:11:14.905532+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:23.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898332+0000","last_change":"2023-10-14T19:11:14.893878+0000","last_active":"2023-10-14T19:11:14.898332+0000","last_peered":"2023-10-14T19:11:14.898332+0000","last_clean":"2023-10-14T19:11:14.898332+0000","last_became_active":"2023-10-14T19:11:14.893621+0000","last_became_peered":"2023-10-14T19:11:14.893621+0000","last_unstale":"2023-10-14T19:11:14.898332+0000","last_undegraded":"2023-10-14T19:11:14.898332+0000","last_fullsized":"2023-10-14T19:11:14.898332+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:23.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.891857+0000","last_change":"2023-10-14T19:11:14.889810+0000","last_active":"2023-10-14T19:11:14.891857+0000","last_peered":"2023-10-14T19:11:14.891857+0000","last_clean":"2023-10-14T19:11:14.891857+0000","last_became_active":"2023-10-14T19:11:14.887448+0000","last_became_peered":"2023-10-14T19:11:14.887448+0000","last_unstale":"2023-10-14T19:11:14.891857+0000","last_undegraded":"2023-10-14T19:11:14.891857+0000","last_fullsized":"2023-10-14T19:11:14.891857+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902797+0000","last_change":"2023-10-14T19:11:14.898600+0000","last_active":"2023-10-14T19:11:14.902797+0000","last_peered":"2023-10-14T19:11:14.902797+0000","last_clean":"2023-10-14T19:11:14.902797+0000","last_became_active":"2023-10-14T19:11:14.898333+0000","last_became_peered":"2023-10-14T19:11:14.898333+0000","last_unstale":"2023-10-14T19:11:14.902797+0000","last_undegraded":"2023-10-14T19:11:14.902797+0000","last_fullsized":"2023-10-14T19:11:14.902797+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898682+0000","last_change":"2023-10-14T19:11:14.897462+0000","last_active":"2023-10-14T19:11:14.898682+0000","last_peered":"2023-10-14T19:11:14.898682+0000","last_clean":"2023-10-14T19:11:14.898682+0000","last_became_active":"2023-10-14T19:11:14.896964+0000","last_became_peered":"2023-10-14T19:11:14.896964+0000","last_unstale":"2023-10-14T19:11:14.898682+0000","last_undegraded":"2023-10-14T19:11:14.898682+0000","last_fullsized":"2023-10-14T19:11:14.898682+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:08.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881736+0000","last_change":"2023-10-14T19:11:14.881329+0000","last_active":"2023-10-14T19:11:14.881736+0000","last_peered":"2023-10-14T19:11:14.881736+0000","last_clean":"2023-10-14T19:11:14.881736+0000","last_became_active":"2023-10-14T19:11:14.881011+0000","last_became_peered":"2023-10-14T19:11:14.881011+0000","last_unstale":"2023-10-14T19:11:14.881736+0000","last_undegraded":"2023-10-14T19:11:14.881736+0000","last_fullsized":"2023-10-14T19:11:14.881736+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:03.249614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899434+0000","last_change":"2023-10-14T19:11:14.896541+0000","last_active":"2023-10-14T19:11:14.899434+0000","last_peered":"2023-10-14T19:11:14.899434+0000","last_clean":"2023-10-14T19:11:14.899434+0000","last_became_active":"2023-10-14T19:11:14.896243+0000","last_became_peered":"2023-10-14T19:11:14.896243+0000","last_unstale":"2023-10-14T19:11:14.899434+0000","last_undegraded":"2023-10-14T19:11:14.899434+0000","last_fullsized":"2023-10-14T19:11:14.899434+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:33.386724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903568+0000","last_change":"2023-10-14T19:11:13.881701+0000","last_active":"2023-10-14T19:11:14.903568+0000","last_peered":"2023-10-14T19:11:14.903568+0000","last_clean":"2023-10-14T19:11:14.903568+0000","last_became_active":"2023-10-14T19:11:13.881447+0000","last_became_peered":"2023-10-14T19:11:13.881447+0000","last_unstale":"2023-10-14T19:11:14.903568+0000","last_undegraded":"2023-10-14T19:11:14.903568+0000","last_fullsized":"2023-10-14T19:11:14.903568+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:30.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894227+0000","last_change":"2023-10-14T19:11:14.886806+0000","last_active":"2023-10-14T19:11:14.894227+0000","last_peered":"2023-10-14T19:11:14.894227+0000","last_clean":"2023-10-14T19:11:14.894227+0000","last_became_active":"2023-10-14T19:11:14.886529+0000","last_became_peered":"2023-10-14T19:11:14.886529+0000","last_unstale":"2023-10-14T19:11:14.894227+0000","last_undegraded":"2023-10-14T19:11:14.894227+0000","last_fullsized":"2023-10-14T19:11:14.894227+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:58.775129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902213+0000","last_change":"2023-10-14T19:11:13.887162+0000","last_active":"2023-10-14T19:11:14.902213+0000","last_peered":"2023-10-14T19:11:14.902213+0000","last_clean":"2023-10-14T19:11:14.902213+0000","last_became_active":"2023-10-14T19:11:13.886862+0000","last_became_peered":"2023-10-14T19:11:13.886862+0000","last_unstale":"2023-10-14T19:11:14.902213+0000","last_undegraded":"2023-10-14T19:11:14.902213+0000","last_fullsized":"2023-10-14T19:11:14.902213+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:18:07.030442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.896346+0000","last_change":"2023-10-14T19:11:14.889097+0000","last_active":"2023-10-14T19:11:14.896346+0000","last_peered":"2023-10-14T19:11:14.896346+0000","last_clean":"2023-10-14T19:11:14.896346+0000","last_became_active":"2023-10-14T19:11:14.888786+0000","last_became_peered":"2023-10-14T19:11:14.888786+0000","last_unstale":"2023-10-14T19:11:14.896346+0000","last_undegraded":"2023-10-14T19:11:14.896346+0000","last_fullsized":"2023-10-14T19:11:14.896346+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:27.993025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904722+0000","last_change":"2023-10-14T19:11:13.885512+0000","last_active":"2023-10-14T19:11:14.904722+0000","last_peered":"2023-10-14T19:11:14.904722+0000","last_clean":"2023-10-14T19:11:14.904722+0000","last_became_active":"2023-10-14T19:11:13.883379+0000","last_became_peered":"2023-10-14T19:11:13.883379+0000","last_unstale":"2023-10-14T19:11:14.904722+0000","last_undegraded":"2023-10-14T19:11:14.904722+0000","last_fullsized":"2023-10-14T19:11:14.904722+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:06.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904903+0000","last_change":"2023-10-14T19:11:14.903518+0000","last_active":"2023-10-14T19:11:14.904903+0000","last_peered":"2023-10-14T19:11:14.904903+0000","last_clean":"2023-10-14T19:11:14.904903+0000","last_became_active":"2023-10-14T19:11:14.903220+0000","last_became_peered":"2023-10-14T19:11:14.903220+0000","last_unstale":"2023-10-14T19:11:14.904903+0000","last_undegraded":"2023-10-14T19:11:14.904903+0000","last_fullsized":"2023-10-14T19:11:14.904903+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:03.949775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898679+0000","last_change":"2023-10-14T19:11:13.875180+0000","last_active":"2023-10-14T19:11:14.898679+0000","last_peered":"2023-10-14T19:11:14.898679+0000","last_clean":"2023-10-14T19:11:14.898679+0000","last_became_active":"2023-10-14T19:11:13.874859+0000","last_became_peered":"2023-10-14T19:11:13.874859+0000","last_unstale":"2023-10-14T19:11:14.898679+0000","last_undegraded":"2023-10-14T19:11:14.898679+0000","last_fullsized":"2023-10-14T19:11:14.898679+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:54.077166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.900202+0000","last_change":"2023-10-14T19:11:14.895290+0000","last_active":"2023-10-14T19:11:14.900202+0000","last_peered":"2023-10-14T19:11:14.900202+0000","last_clean":"2023-10-14T19:11:14.900202+0000","last_became_active":"2023-10-14T19:11:14.894574+0000","last_became_peered":"2023-10-14T19:11:14.894574+0000","last_unstale":"2023-10-14T19:11:14.900202+0000","last_undegraded":"2023-10-14T19:11:14.900202+0000","last_fullsized":"2023-10-14T19:11:14.900202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:23.854695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902611+0000","last_change":"2023-10-14T19:11:13.882362+0000","last_active":"2023-10-14T19:11:14.902611+0000","last_peered":"2023-10-14T19:11:14.902611+0000","last_clean":"2023-10-14T19:11:14.902611+0000","last_became_active":"2023-10-14T19:11:13.882064+0000","last_became_peered":"2023-10-14T19:11:13.882064+0000","last_unstale":"2023-10-14T19:11:14.902611+0000","last_undegraded":"2023-10-14T19:11:14.902611+0000","last_fullsized":"2023-10-14T19:11:14.902611+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:35.880560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890695+0000","last_change":"2023-10-14T19:11:14.886201+0000","last_active":"2023-10-14T19:11:14.890695+0000","last_peered":"2023-10-14T19:11:14.890695+0000","last_clean":"2023-10-14T19:11:14.890695+0000","last_became_active":"2023-10-14T19:11:14.885769+0000","last_became_peered":"2023-10-14T19:11:14.885769+0000","last_unstale":"2023-10-14T19:11:14.890695+0000","last_undegraded":"2023-10-14T19:11:14.890695+0000","last_fullsized":"2023-10-14T19:11:14.890695+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:47:29.218531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880390+0000","last_change":"2023-10-14T19:11:13.884179+0000","last_active":"2023-10-14T19:11:14.880390+0000","last_peered":"2023-10-14T19:11:14.880390+0000","last_clean":"2023-10-14T19:11:14.880390+0000","last_became_active":"2023-10-14T19:11:13.883909+0000","last_became_peered":"2023-10-14T19:11:13.883909+0000","last_unstale":"2023-10-14T19:11:14.880390+0000","last_undegraded":"2023-10-14T19:11:14.880390+0000","last_fullsized":"2023-10-14T19:11:14.880390+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:38:28.750831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885169+0000","last_change":"2023-10-14T19:11:14.884066+0000","last_active":"2023-10-14T19:11:14.885169+0000","last_peered":"2023-10-14T19:11:14.885169+0000","last_clean":"2023-10-14T19:11:14.885169+0000","last_became_active":"2023-10-14T19:11:14.883782+0000","last_became_peered":"2023-10-14T19:11:14.883782+0000","last_unstale":"2023-10-14T19:11:14.885169+0000","last_undegraded":"2023-10-14T19:11:14.885169+0000","last_fullsized":"2023-10-14T19:11:14.885169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:54.770149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873977+0000","last_change":"2023-10-14T19:11:13.890847+0000","last_active":"2023-10-14T19:11:14.873977+0000","last_peered":"2023-10-14T19:11:14.873977+0000","last_clean":"2023-10-14T19:11:14.873977+0000","last_became_active":"2023-10-14T19:11:13.890640+0000","last_became_peered":"2023-10-14T19:11:13.890640+0000","last_unstale":"2023-10-14T19:11:14.873977+0000","last_undegraded":"2023-10-14T19:11:14.873977+0000","last_fullsized":"2023-10-14T19:11:14.873977+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:50.892246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887089+0000","last_change":"2023-10-14T19:11:14.884301+0000","last_active":"2023-10-14T19:11:14.887089+0000","last_peered":"2023-10-14T19:11:14.887089+0000","last_clean":"2023-10-14T19:11:14.887089+0000","last_became_active":"2023-10-14T19:11:14.883672+0000","last_became_peered":"2023-10-14T19:11:14.883672+0000","last_unstale":"2023-10-14T19:11:14.887089+0000","last_undegraded":"2023-10-14T19:11:14.887089+0000","last_fullsized":"2023-10-14T19:11:14.887089+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894909+0000","last_change":"2023-10-14T19:11:13.891161+0000","last_active":"2023-10-14T19:11:14.894909+0000","last_peered":"2023-10-14T19:11:14.894909+0000","last_clean":"2023-10-14T19:11:14.894909+0000","last_became_active":"2023-10-14T19:11:13.890699+0000","last_became_peered":"2023-10-14T19:11:13.890699+0000","last_unstale":"2023-10-14T19:11:14.894909+0000","last_undegraded":"2023-10-14T19:11:14.894909+0000","last_fullsized":"2023-10-14T19:11:14.894909+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:33.339743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904472+0000","last_change":"2023-10-14T19:11:14.902485+0000","last_active":"2023-10-14T19:11:14.904472+0000","last_peered":"2023-10-14T19:11:14.904472+0000","last_clean":"2023-10-14T19:11:14.904472+0000","last_became_active":"2023-10-14T19:11:14.902227+0000","last_became_peered":"2023-10-14T19:11:14.902227+0000","last_unstale":"2023-10-14T19:11:14.904472+0000","last_undegraded":"2023-10-14T19:11:14.904472+0000","last_fullsized":"2023-10-14T19:11:14.904472+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:41.184247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873004+0000","last_change":"2023-10-14T19:11:13.882199+0000","last_active":"2023-10-14T19:11:14.873004+0000","last_peered":"2023-10-14T19:11:14.873004+0000","last_clean":"2023-10-14T19:11:14.873004+0000","last_became_active":"2023-10-14T19:11:13.881972+0000","last_became_peered":"2023-10-14T19:11:13.881972+0000","last_unstale":"2023-10-14T19:11:14.873004+0000","last_undegraded":"2023-10-14T19:11:14.873004+0000","last_fullsized":"2023-10-14T19:11:14.873004+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:43.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.893210+0000","last_change":"2023-10-14T19:11:14.892195+0000","last_active":"2023-10-14T19:11:14.893210+0000","last_peered":"2023-10-14T19:11:14.893210+0000","last_clean":"2023-10-14T19:11:14.893210+0000","last_became_active":"2023-10-14T19:11:14.891933+0000","last_became_peered":"2023-10-14T19:11:14.891933+0000","last_unstale":"2023-10-14T19:11:14.893210+0000","last_undegraded":"2023-10-14T19:11:14.893210+0000","last_fullsized":"2023-10-14T19:11:14.893210+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:13.158859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903697+0000","last_change":"2023-10-14T19:11:13.882365+0000","last_active":"2023-10-14T19:11:14.903697+0000","last_peered":"2023-10-14T19:11:14.903697+0000","last_clean":"2023-10-14T19:11:14.903697+0000","last_became_active":"2023-10-14T19:11:13.882076+0000","last_became_peered":"2023-10-14T19:11:13.882076+0000","last_unstale":"2023-10-14T19:11:14.903697+0000","last_undegraded":"2023-10-14T19:11:14.903697+0000","last_fullsized":"2023-10-14T19:11:14.903697+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:20.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904432+0000","last_change":"2023-10-14T19:11:14.902501+0000","last_active":"2023-10-14T19:11:14.904432+0000","last_peered":"2023-10-14T19:11:14.904432+0000","last_clean":"2023-10-14T19:11:14.904432+0000","last_became_active":"2023-10-14T19:11:14.902237+0000","last_became_peered":"2023-10-14T19:11:14.902237+0000","last_unstale":"2023-10-14T19:11:14.904432+0000","last_undegraded":"2023-10-14T19:11:14.904432+0000","last_fullsized":"2023-10-14T19:11:14.904432+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:07.451584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903813+0000","last_change":"2023-10-14T19:11:13.879812+0000","last_active":"2023-10-14T19:11:14.903813+0000","last_peered":"2023-10-14T19:11:14.903813+0000","last_clean":"2023-10-14T19:11:14.903813+0000","last_became_active":"2023-10-14T19:11:13.877900+0000","last_became_peered":"2023-10-14T19:11:13.877900+0000","last_unstale":"2023-10-14T19:11:14.903813+0000","last_undegraded":"2023-10-14T19:11:14.903813+0000","last_fullsized":"2023-10-14T19:11:14.903813+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:09:18.043936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878588+0000","last_change":"2023-10-14T19:11:14.877191+0000","last_active":"2023-10-14T19:11:14.878588+0000","last_peered":"2023-10-14T19:11:14.878588+0000","last_clean":"2023-10-14T19:11:14.878588+0000","last_became_active":"2023-10-14T19:11:14.876890+0000","last_became_peered":"2023-10-14T19:11:14.876890+0000","last_unstale":"2023-10-14T19:11:14.878588+0000","last_undegraded":"2023-10-14T19:11:14.878588+0000","last_fullsized":"2023-10-14T19:11:14.878588+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:10.726113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899205+0000","last_change":"2023-10-14T19:11:13.886304+0000","last_active":"2023-10-14T19:11:14.899205+0000","last_peered":"2023-10-14T19:11:14.899205+0000","last_clean":"2023-10-14T19:11:14.899205+0000","last_became_active":"2023-10-14T19:11:13.886029+0000","last_became_peered":"2023-10-14T19:11:13.886029+0000","last_unstale":"2023-10-14T19:11:14.899205+0000","last_undegraded":"2023-10-14T19:11:14.899205+0000","last_fullsized":"2023-10-14T19:11:14.899205+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:02.233342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881835+0000","last_change":"2023-10-14T19:11:14.878751+0000","last_active":"2023-10-14T19:11:14.881835+0000","last_peered":"2023-10-14T19:11:14.881835+0000","last_clean":"2023-10-14T19:11:14.881835+0000","last_became_active":"2023-10-14T19:11:14.878365+0000","last_became_peered":"2023-10-14T19:11:14.878365+0000","last_unstale":"2023-10-14T19:11:14.881835+0000","last_undegraded":"2023-10-14T19:11:14.881835+0000","last_fullsized":"2023-10-14T19:11:14.881835+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:00.788849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873743+0000","last_change":"2023-10-14T19:11:13.889576+0000","last_active":"2023-10-14T19:11:14.873743+0000","last_peered":"2023-10-14T19:11:14.873743+0000","last_clean":"2023-10-14T19:11:14.873743+0000","last_became_active":"2023-10-14T19:11:13.889281+0000","last_became_peered":"2023-10-14T19:11:13.889281+0000","last_unstale":"2023-10-14T19:11:14.873743+0000","last_undegraded":"2023-10-14T19:11:14.873743+0000","last_fullsized":"2023-10-14T19:11:14.873743+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:17.378271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.882202+0000","last_change":"2023-10-14T19:11:14.880077+0000","last_active":"2023-10-14T19:11:14.882202+0000","last_peered":"2023-10-14T19:11:14.882202+0000","last_clean":"2023-10-14T19:11:14.882202+0000","last_became_active":"2023-10-14T19:11:14.879799+0000","last_became_peered":"2023-10-14T19:11:14.879799+0000","last_unstale":"2023-10-14T19:11:14.882202+0000","last_undegraded":"2023-10-14T19:11:14.882202+0000","last_fullsized":"2023-10-14T19:11:14.882202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:25:10.359841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884958+0000","last_change":"2023-10-14T19:11:13.882108+0000","last_active":"2023-10-14T19:11:14.884958+0000","last_peered":"2023-10-14T19:11:14.884958+0000","last_clean":"2023-10-14T19:11:14.884958+0000","last_became_active":"2023-10-14T19:11:13.881840+0000","last_became_peered":"2023-10-14T19:11:13.881840+0000","last_unstale":"2023-10-14T19:11:14.884958+0000","last_undegraded":"2023-10-14T19:11:14.884958+0000","last_fullsized":"2023-10-14T19:11:14.884958+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:12.150865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890422+0000","last_change":"2023-10-14T19:11:14.886567+0000","last_active":"2023-10-14T19:11:14.890422+0000","last_peered":"2023-10-14T19:11:14.890422+0000","last_clean":"2023-10-14T19:11:14.890422+0000","last_became_active":"2023-10-14T19:11:14.885671+0000","last_became_peered":"2023-10-14T19:11:14.885671+0000","last_unstale":"2023-10-14T19:11:14.890422+0000","last_undegraded":"2023-10-14T19:11:14.890422+0000","last_fullsized":"2023-10-14T19:11:14.890422+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:00.788849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905474+0000","last_change":"2023-10-14T19:11:13.886012+0000","last_active":"2023-10-14T19:11:14.905474+0000","last_peered":"2023-10-14T19:11:14.905474+0000","last_clean":"2023-10-14T19:11:14.905474+0000","last_became_active":"2023-10-14T19:11:13.884751+0000","last_became_peered":"2023-10-14T19:11:13.884751+0000","last_unstale":"2023-10-14T19:11:14.905474+0000","last_undegraded":"2023-10-14T19:11:14.905474+0000","last_fullsized":"2023-10-14T19:11:14.905474+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:51.526736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880640+0000","last_change":"2023-10-14T19:11:14.879161+0000","last_active":"2023-10-14T19:11:14.880640+0000","last_peered":"2023-10-14T19:11:14.880640+0000","last_clean":"2023-10-14T19:11:14.880640+0000","last_became_active":"2023-10-14T19:11:14.878662+0000","last_became_peered":"2023-10-14T19:11:14.878662+0000","last_unstale":"2023-10-14T19:11:14.880640+0000","last_undegraded":"2023-10-14T19:11:14.880640+0000","last_fullsized":"2023-10-14T19:11:14.880640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:52.236007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899439+0000","last_change":"2023-10-14T19:11:13.882975+0000","last_active":"2023-10-14T19:11:14.899439+0000","last_peered":"2023-10-14T19:11:14.899439+0000","last_clean":"2023-10-14T19:11:14.899439+0000","last_became_active":"2023-10-14T19:11:13.882712+0000","last_became_peered":"2023-10-14T19:11:13.882712+0000","last_unstale":"2023-10-14T19:11:14.899439+0000","last_undegraded":"2023-10-14T19:11:14.899439+0000","last_fullsized":"2023-10-14T19:11:14.899439+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:15.977144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.888466+0000","last_change":"2023-10-14T19:11:14.885731+0000","last_active":"2023-10-14T19:11:14.888466+0000","last_peered":"2023-10-14T19:11:14.888466+0000","last_clean":"2023-10-14T19:11:14.888466+0000","last_became_active":"2023-10-14T19:11:14.884038+0000","last_became_peered":"2023-10-14T19:11:14.884038+0000","last_unstale":"2023-10-14T19:11:14.888466+0000","last_undegraded":"2023-10-14T19:11:14.888466+0000","last_fullsized":"2023-10-14T19:11:14.888466+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:33.032227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901351+0000","last_change":"2023-10-14T19:11:13.876738+0000","last_active":"2023-10-14T19:11:14.901351+0000","last_peered":"2023-10-14T19:11:14.901351+0000","last_clean":"2023-10-14T19:11:14.901351+0000","last_became_active":"2023-10-14T19:11:13.876437+0000","last_became_peered":"2023-10-14T19:11:13.876437+0000","last_unstale":"2023-10-14T19:11:14.901351+0000","last_undegraded":"2023-10-14T19:11:14.901351+0000","last_fullsized":"2023-10-14T19:11:14.901351+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:22.659840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899505+0000","last_change":"2023-10-14T19:11:14.897612+0000","last_active":"2023-10-14T19:11:14.899505+0000","last_peered":"2023-10-14T19:11:14.899505+0000","last_clean":"2023-10-14T19:11:14.899505+0000","last_became_active":"2023-10-14T19:11:14.897362+0000","last_became_peered":"2023-10-14T19:11:14.897362+0000","last_unstale":"2023-10-14T19:11:14.899505+0000","last_undegraded":"2023-10-14T19:11:14.899505+0000","last_fullsized":"2023-10-14T19:11:14.899505+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:11.347384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901993+0000","last_change":"2023-10-14T19:11:13.884462+0000","last_active":"2023-10-14T19:11:14.901993+0000","last_peered":"2023-10-14T19:11:14.901993+0000","last_clean":"2023-10-14T19:11:14.901993+0000","last_became_active":"2023-10-14T19:11:13.884160+0000","last_became_peered":"2023-10-14T19:11:13.884160+0000","last_unstale":"2023-10-14T19:11:14.901993+0000","last_undegraded":"2023-10-14T19:11:14.901993+0000","last_fullsized":"2023-10-14T19:11:14.901993+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:05.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.892107+0000","last_change":"2023-10-14T19:11:14.891675+0000","last_active":"2023-10-14T19:11:14.892107+0000","last_peered":"2023-10-14T19:11:14.892107+0000","last_clean":"2023-10-14T19:11:14.892107+0000","last_became_active":"2023-10-14T19:11:14.891421+0000","last_became_peered":"2023-10-14T19:11:14.891421+0000","last_unstale":"2023-10-14T19:11:14.892107+0000","last_undegraded":"2023-10-14T19:11:14.892107+0000","last_fullsized":"2023-10-14T19:11:14.892107+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:34.372203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.876136+0000","last_change":"2023-10-14T19:11:13.884362+0000","last_active":"2023-10-14T19:11:14.876136+0000","last_peered":"2023-10-14T19:11:14.876136+0000","last_clean":"2023-10-14T19:11:14.876136+0000","last_became_active":"2023-10-14T19:11:13.884051+0000","last_became_peered":"2023-10-14T19:11:13.884051+0000","last_unstale":"2023-10-14T19:11:14.876136+0000","last_undegraded":"2023-10-14T19:11:14.876136+0000","last_fullsized":"2023-10-14T19:11:14.876136+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:27.422618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898581+0000","last_change":"2023-10-14T19:11:14.896189+0000","last_active":"2023-10-14T19:11:14.898581+0000","last_peered":"2023-10-14T19:11:14.898581+0000","last_clean":"2023-10-14T19:11:14.898581+0000","last_became_active":"2023-10-14T19:11:14.895894+0000","last_became_peered":"2023-10-14T19:11:14.895894+0000","last_unstale":"2023-10-14T19:11:14.898581+0000","last_undegraded":"2023-10-14T19:11:14.898581+0000","last_fullsized":"2023-10-14T19:11:14.898581+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:10.991741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903518+0000","last_change":"2023-10-14T19:11:13.889060+0000","last_active":"2023-10-14T19:11:14.903518+0000","last_peered":"2023-10-14T19:11:14.903518+0000","last_clean":"2023-10-14T19:11:14.903518+0000","last_became_active":"2023-10-14T19:11:13.888806+0000","last_became_peered":"2023-10-14T19:11:13.888806+0000","last_unstale":"2023-10-14T19:11:14.903518+0000","last_undegraded":"2023-10-14T19:11:14.903518+0000","last_fullsized":"2023-10-14T19:11:14.903518+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:55:37.724530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890597+0000","last_change":"2023-10-14T19:11:14.886655+0000","last_active":"2023-10-14T19:11:14.890597+0000","last_peered":"2023-10-14T19:11:14.890597+0000","last_clean":"2023-10-14T19:11:14.890597+0000","last_became_active":"2023-10-14T19:11:14.886391+0000","last_became_peered":"2023-10-14T19:11:14.886391+0000","last_unstale":"2023-10-14T19:11:14.890597+0000","last_undegraded":"2023-10-14T19:11:14.890597+0000","last_fullsized":"2023-10-14T19:11:14.890597+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:12:08.223917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885430+0000","last_change":"2023-10-14T19:11:13.884899+0000","last_active":"2023-10-14T19:11:14.885430+0000","last_peered":"2023-10-14T19:11:14.885430+0000","last_clean":"2023-10-14T19:11:14.885430+0000","last_became_active":"2023-10-14T19:11:13.883808+0000","last_became_peered":"2023-10-14T19:11:13.883808+0000","last_unstale":"2023-10-14T19:11:14.885430+0000","last_undegraded":"2023-10-14T19:11:14.885430+0000","last_fullsized":"2023-10-14T19:11:14.885430+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:51.526736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878380+0000","last_change":"2023-10-14T19:11:14.877343+0000","last_active":"2023-10-14T19:11:14.878380+0000","last_peered":"2023-10-14T19:11:14.878380+0000","last_clean":"2023-10-14T19:11:14.878380+0000","last_became_active":"2023-10-14T19:11:14.877086+0000","last_became_peered":"2023-10-14T19:11:14.877086+0000","last_unstale":"2023-10-14T19:11:14.878380+0000","last_undegraded":"2023-10-14T19:11:14.878380+0000","last_fullsized":"2023-10-14T19:11:14.878380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:10:26.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881517+0000","last_change":"2023-10-14T19:11:13.888013+0000","last_active":"2023-10-14T19:11:14.881517+0000","last_peered":"2023-10-14T19:11:14.881517+0000","last_clean":"2023-10-14T19:11:14.881517+0000","last_became_active":"2023-10-14T19:11:13.887693+0000","last_became_peered":"2023-10-14T19:11:13.887693+0000","last_unstale":"2023-10-14T19:11:14.881517+0000","last_undegraded":"2023-10-14T19:11:14.881517+0000","last_fullsized":"2023-10-14T19:11:14.881517+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:05.380969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890018+0000","last_change":"2023-10-14T19:11:14.888740+0000","last_active":"2023-10-14T19:11:14.890018+0000","last_peered":"2023-10-14T19:11:14.890018+0000","last_clean":"2023-10-14T19:11:14.890018+0000","last_became_active":"2023-10-14T19:11:14.888442+0000","last_became_peered":"2023-10-14T19:11:14.888442+0000","last_unstale":"2023-10-14T19:11:14.890018+0000","last_undegraded":"2023-10-14T19:11:14.890018+0000","last_fullsized":"2023-10-14T19:11:14.890018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:26.935615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.872890+0000","last_change":"2023-10-14T19:11:13.879918+0000","last_active":"2023-10-14T19:11:14.872890+0000","last_peered":"2023-10-14T19:11:14.872890+0000","last_clean":"2023-10-14T19:11:14.872890+0000","last_became_active":"2023-10-14T19:11:13.879488+0000","last_became_peered":"2023-10-14T19:11:13.879488+0000","last_unstale":"2023-10-14T19:11:14.872890+0000","last_undegraded":"2023-10-14T19:11:14.872890+0000","last_fullsized":"2023-10-14T19:11:14.872890+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:15:13.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.889262+0000","last_change":"2023-10-14T19:11:14.888109+0000","last_active":"2023-10-14T19:11:14.889262+0000","last_peered":"2023-10-14T19:11:14.889262+0000","last_clean":"2023-10-14T19:11:14.889262+0000","last_became_active":"2023-10-14T19:11:14.887896+0000","last_became_peered":"2023-10-14T19:11:14.887896+0000","last_unstale":"2023-10-14T19:11:14.889262+0000","last_undegraded":"2023-10-14T19:11:14.889262+0000","last_fullsized":"2023-10-14T19:11:14.889262+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:34.347737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902751+0000","last_change":"2023-10-14T19:11:13.887469+0000","last_active":"2023-10-14T19:11:14.902751+0000","last_peered":"2023-10-14T19:11:14.902751+0000","last_clean":"2023-10-14T19:11:14.902751+0000","last_became_active":"2023-10-14T19:11:13.887225+0000","last_became_peered":"2023-10-14T19:11:13.887225+0000","last_unstale":"2023-10-14T19:11:14.902751+0000","last_undegraded":"2023-10-14T19:11:14.902751+0000","last_fullsized":"2023-10-14T19:11:14.902751+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:26.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884451+0000","last_change":"2023-10-14T19:11:14.881256+0000","last_active":"2023-10-14T19:11:14.884451+0000","last_peered":"2023-10-14T19:11:14.884451+0000","last_clean":"2023-10-14T19:11:14.884451+0000","last_became_active":"2023-10-14T19:11:14.880933+0000","last_became_peered":"2023-10-14T19:11:14.880933+0000","last_unstale":"2023-10-14T19:11:14.884451+0000","last_undegraded":"2023-10-14T19:11:14.884451+0000","last_fullsized":"2023-10-14T19:11:14.884451+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:27.993025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887709+0000","last_change":"2023-10-14T19:11:13.882926+0000","last_active":"2023-10-14T19:11:14.887709+0000","last_peered":"2023-10-14T19:11:14.887709+0000","last_clean":"2023-10-14T19:11:14.887709+0000","last_became_active":"2023-10-14T19:11:13.881598+0000","last_became_peered":"2023-10-14T19:11:13.881598+0000","last_unstale":"2023-10-14T19:11:14.887709+0000","last_undegraded":"2023-10-14T19:11:14.887709+0000","last_fullsized":"2023-10-14T19:11:14.887709+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:25.927621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890295+0000","last_change":"2023-10-14T19:11:14.886172+0000","last_active":"2023-10-14T19:11:14.890295+0000","last_peered":"2023-10-14T19:11:14.890295+0000","last_clean":"2023-10-14T19:11:14.890295+0000","last_became_active":"2023-10-14T19:11:14.885903+0000","last_became_peered":"2023-10-14T19:11:14.885903+0000","last_unstale":"2023-10-14T19:11:14.890295+0000","last_undegraded":"2023-10-14T19:11:14.890295+0000","last_fullsized":"2023-10-14T19:11:14.890295+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:42.177435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894184+0000","last_change":"2023-10-14T19:11:13.879863+0000","last_active":"2023-10-14T19:11:14.894184+0000","last_peered":"2023-10-14T19:11:14.894184+0000","last_clean":"2023-10-14T19:11:14.894184+0000","last_became_active":"2023-10-14T19:11:13.879393+0000","last_became_peered":"2023-10-14T19:11:13.879393+0000","last_unstale":"2023-10-14T19:11:14.894184+0000","last_undegraded":"2023-10-14T19:11:14.894184+0000","last_fullsized":"2023-10-14T19:11:14.894184+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:05:17.442589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.886601+0000","last_change":"2023-10-14T19:11:14.885272+0000","last_active":"2023-10-14T19:11:14.886601+0000","last_peered":"2023-10-14T19:11:14.886601+0000","last_clean":"2023-10-14T19:11:14.886601+0000","last_became_active":"2023-10-14T19:11:14.884988+0000","last_became_peered":"2023-10-14T19:11:14.884988+0000","last_unstale":"2023-10-14T19:11:14.886601+0000","last_undegraded":"2023-10-14T19:11:14.886601+0000","last_fullsized":"2023-10-14T19:11:14.886601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:33.314415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873506+0000","last_change":"2023-10-14T19:11:13.886696+0000","last_active":"2023-10-14T19:11:14.873506+0000","last_peered":"2023-10-14T19:11:14.873506+0000","last_clean":"2023-10-14T19:11:14.873506+0000","last_became_active":"2023-10-14T19:11:13.886411+0000","last_became_peered":"2023-10-14T19:11:13.886411+0000","last_unstale":"2023-10-14T19:11:14.873506+0000","last_undegraded":"2023-10-14T19:11:14.873506+0000","last_fullsized":"2023-10-14T19:11:14.873506+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:37:26.743989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.879380+0000","last_change":"2023-10-14T19:11:14.878150+0000","last_active":"2023-10-14T19:11:14.879380+0000","last_peered":"2023-10-14T19:11:14.879380+0000","last_clean":"2023-10-14T19:11:14.879380+0000","last_became_active":"2023-10-14T19:11:14.877854+0000","last_became_peered":"2023-10-14T19:11:14.877854+0000","last_unstale":"2023-10-14T19:11:14.879380+0000","last_undegraded":"2023-10-14T19:11:14.879380+0000","last_fullsized":"2023-10-14T19:11:14.879380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:41.013361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881933+0000","last_change":"2023-10-14T19:11:13.889408+0000","last_active":"2023-10-14T19:11:14.881933+0000","last_peered":"2023-10-14T19:11:14.881933+0000","last_clean":"2023-10-14T19:11:14.881933+0000","last_became_active":"2023-10-14T19:11:13.889150+0000","last_became_peered":"2023-10-14T19:11:13.889150+0000","last_unstale":"2023-10-14T19:11:14.881933+0000","last_undegraded":"2023-10-14T19:11:14.881933+0000","last_fullsized":"2023-10-14T19:11:14.881933+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:45.782424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884481+0000","last_change":"2023-10-14T19:11:14.881097+0000","last_active":"2023-10-14T19:11:14.884481+0000","last_peered":"2023-10-14T19:11:14.884481+0000","last_clean":"2023-10-14T19:11:14.884481+0000","last_became_active":"2023-10-14T19:11:14.880822+0000","last_became_peered":"2023-10-14T19:11:14.880822+0000","last_unstale":"2023-10-14T19:11:14.884481+0000","last_undegraded":"2023-10-14T19:11:14.884481+0000","last_fullsized":"2023-10-14T19:11:14.884481+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873844+0000","last_change":"2023-10-14T19:11:13.883283+0000","last_active":"2023-10-14T19:11:14.873844+0000","last_peered":"2023-10-14T19:11:14.873844+0000","last_clean":"2023-10-14T19:11:14.873844+0000","last_became_active":"2023-10-14T19:11:13.883002+0000","last_became_peered":"2023-10-14T19:11:13.883002+0000","last_unstale":"2023-10-14T19:11:14.873844+0000","last_undegraded":"2023-10-14T19:11:14.873844+0000","last_fullsized":"2023-10-14T19:11:14.873844+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:39.329179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881972+0000","last_change":"2023-10-14T19:11:14.878962+0000","last_active":"2023-10-14T19:11:14.881972+0000","last_peered":"2023-10-14T19:11:14.881972+0000","last_clean":"2023-10-14T19:11:14.881972+0000","last_became_active":"2023-10-14T19:11:14.878661+0000","last_became_peered":"2023-10-14T19:11:14.878661+0000","last_unstale":"2023-10-14T19:11:14.881972+0000","last_undegraded":"2023-10-14T19:11:14.881972+0000","last_fullsized":"2023-10-14T19:11:14.881972+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:13.158859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885108+0000","last_change":"2023-10-14T19:11:13.887614+0000","last_active":"2023-10-14T19:11:14.885108+0000","last_peered":"2023-10-14T19:11:14.885108+0000","last_clean":"2023-10-14T19:11:14.885108+0000","last_became_active":"2023-10-14T19:11:13.887266+0000","last_became_peered":"2023-10-14T19:11:13.887266+0000","last_unstale":"2023-10-14T19:11:14.885108+0000","last_undegraded":"2023-10-14T19:11:14.885108+0000","last_fullsized":"2023-10-14T19:11:14.885108+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:30.977491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898119+0000","last_change":"2023-10-14T19:11:14.894921+0000","last_active":"2023-10-14T19:11:14.898119+0000","last_peered":"2023-10-14T19:11:14.898119+0000","last_clean":"2023-10-14T19:11:14.898119+0000","last_became_active":"2023-10-14T19:11:14.894289+0000","last_became_peered":"2023-10-14T19:11:14.894289+0000","last_unstale":"2023-10-14T19:11:14.898119+0000","last_undegraded":"2023-10-14T19:11:14.898119+0000","last_fullsized":"2023-10-14T19:11:14.898119+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:08.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.872954+0000","last_change":"2023-10-14T19:11:13.879744+0000","last_active":"2023-10-14T19:11:14.872954+0000","last_peered":"2023-10-14T19:11:14.872954+0000","last_clean":"2023-10-14T19:11:14.872954+0000","last_became_active":"2023-10-14T19:11:13.879150+0000","last_became_peered":"2023-10-14T19:11:13.879150+0000","last_unstale":"2023-10-14T19:11:14.872954+0000","last_undegraded":"2023-10-14T19:11:14.872954+0000","last_fullsized":"2023-10-14T19:11:14.872954+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:43:13.839136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901924+0000","last_change":"2023-10-14T19:11:14.898080+0000","last_active":"2023-10-14T19:11:14.901924+0000","last_peered":"2023-10-14T19:11:14.901924+0000","last_clean":"2023-10-14T19:11:14.901924+0000","last_became_active":"2023-10-14T19:11:14.897787+0000","last_became_peered":"2023-10-14T19:11:14.897787+0000","last_unstale":"2023-10-14T19:11:14.901924+0000","last_undegraded":"2023-10-14T19:11:14.901924+0000","last_fullsized":"2023-10-14T19:11:14.901924+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:28.430611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902912+0000","last_change":"2023-10-14T19:11:13.889060+0000","last_active":"2023-10-14T19:11:14.902912+0000","last_peered":"2023-10-14T19:11:14.902912+0000","last_clean":"2023-10-14T19:11:14.902912+0000","last_became_active":"2023-10-14T19:11:13.888783+0000","last_became_peered":"2023-10-14T19:11:13.888783+0000","last_unstale":"2023-10-14T19:11:14.902912+0000","last_undegraded":"2023-10-14T19:11:14.902912+0000","last_fullsized":"2023-10-14T19:11:14.902912+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:47.688528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":280,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885575+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:14.885575+0000","last_peered":"2023-10-14T19:11:14.885575+0000","last_clean":"2023-10-14T19:11:14.885575+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:14.885575+0000","last_undegraded":"2023-10-14T19:11:14.885575+0000","last_fullsized":"2023-10-14T19:11:14.885575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304012,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067828,"statfs":{"total":96636764160,"available":96325455872,"internally_reserved":0,"allocated":2691072,"data_stored":1525081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.63800000000000001},"min":{"1min":0.35699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.60999999999999999,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.432}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.64100000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.755,"15min":3.1480000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89600000000000002,"15min":3.23},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.73299999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74299999999999999,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.73499999999999999,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.55600000000000005},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.875,"15min":2.4620000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.66900000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.746},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.63600000000000001},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":2.883},"last":0.71499999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.64900000000000002},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":5.383},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574951,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303436,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068404,"statfs":{"total":96636764160,"available":96326045696,"internally_reserved":0,"allocated":2101248,"data_stored":934699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.65800000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":5.6820000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.745,"5min":0.745,"15min":7.8680000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78900000000000003,"15min":8.0210000000000008},"last":0.439},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.78500000000000003},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.498}]},{"osd":3,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.745},"min":{"1min":0.379,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.76000000000000001},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":8.1120000000000001},"last":0.373}]},{"osd":4,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.33000000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.54700000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73599999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42199999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.58999999999999997},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.61899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":934733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.495,"15min":0.50800000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.20300000000000001},"max":{"1min":0.47499999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.30299999999999999,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.33600000000000002},"max":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":1.032},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.503},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.76800000000000002,"5min":1.627,"15min":1.627},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":1.079},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.59299999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304016,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067824,"statfs":{"total":96636764160,"available":96325451776,"internally_reserved":0,"allocated":2695168,"data_stored":1525655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.59999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.62},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.55700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.36699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84099999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303448,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068392,"statfs":{"total":96636764160,"available":96326033408,"internally_reserved":0,"allocated":2113536,"data_stored":936235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.45400000000000001,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.42499999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":0.65800000000000003,"15min":2.028},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53400000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38100000000000001,"15min":0.69099999999999995},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":11.269},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.66200000000000003},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":11.318},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59599999999999997,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.67200000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.94699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":11.379},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.95199999999999996},"min":{"1min":0.438,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":11.404},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.96499999999999997},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2109440,"data_stored":936249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49099999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.38100000000000001},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32200000000000001,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.26300000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54200000000000004,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.433},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.44700000000000001},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":2.597,"15min":2.597},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.214,"15min":1.214},"last":0.77800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.133,"15min":1.133},"last":0.753},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.752,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.379,"15min":0.379},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":0.997},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":935197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.7910000000000004,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.371}]},{"osd":1,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.46300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.35299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.47599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.378},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.5269999999999999},"last":0.498}]},{"osd":6,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":934643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32700000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.83199999999999996,"5min":1.784,"15min":1.784},"last":0.83199999999999996}]},{"osd":1,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81499999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.876},"last":0.753},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.75900000000000001},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.88100000000000001,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.88100000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.84499999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":1.008,"15min":1.008},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:23.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.742+0000 7fb4870cf700 1 Processor -- start 2023-10-14T19:11:23.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.742+0000 7fb4870cf700 1 -- start start 2023-10-14T19:11:23.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4870cf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb480142c00 0x7fb48006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4870cf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48006bd20 0x7fb4800c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4870cf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb480142fd0 0x7fb4800c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4870cf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800ca480 con 0x7fb480142c00 2023-10-14T19:11:23.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4870cf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48015e240 con 0x7fb480142fd0 2023-10-14T19:11:23.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4870cf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006b350 con 0x7fb48006bd20 2023-10-14T19:11:23.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.743+0000 7fb4860cd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb480142c00 0x7fb48006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb480142c00 0x7fb48006b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33356/0 (socket says 172.21.15.7:33356) 2023-10-14T19:11:23.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 -- 172.21.15.7:0/3735957998 learned_addr learned my addr 172.21.15.7:0/3735957998 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:23.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4868ce700 1 --2- 172.21.15.7:0/3735957998 >> v2:172.21.15.148:3300/0 conn(0x7fb480142fd0 0x7fb4800c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4858cc700 1 --2- 172.21.15.7:0/3735957998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48006bd20 0x7fb4800c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 -- 172.21.15.7:0/3735957998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48006bd20 msgr2=0x7fb4800c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:23.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 --2- 172.21.15.7:0/3735957998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48006bd20 0x7fb4800c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 -- 172.21.15.7:0/3735957998 >> v2:172.21.15.148:3300/0 conn(0x7fb480142fd0 msgr2=0x7fb4800c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:23.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 --2- 172.21.15.7:0/3735957998 >> v2:172.21.15.148:3300/0 conn(0x7fb480142fd0 0x7fb4800c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 -- 172.21.15.7:0/3735957998 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48015df60 con 0x7fb480142c00 2023-10-14T19:11:23.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4868ce700 1 --2- 172.21.15.7:0/3735957998 >> v2:172.21.15.148:3300/0 conn(0x7fb480142fd0 0x7fb4800c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:23.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4860cd700 1 --2- 172.21.15.7:0/3735957998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb480142c00 0x7fb48006b7e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fb4800ca8c0 tx=0x7fb470009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6f390f5690bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:23.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4850cb700 1 -- 172.21.15.7:0/3735957998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000b860 con 0x7fb480142c00 2023-10-14T19:11:23.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4850cb700 1 -- 172.21.15.7:0/3735957998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47000b9c0 con 0x7fb480142c00 2023-10-14T19:11:23.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.744+0000 7fb4850cb700 1 -- 172.21.15.7:0/3735957998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000bd80 con 0x7fb480142c00 2023-10-14T19:11:23.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 -- 172.21.15.7:0/3735957998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb480142c00 msgr2=0x7fb48006b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:23.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 --2- 172.21.15.7:0/3735957998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb480142c00 0x7fb48006b7e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fb4800ca8c0 tx=0x7fb470009250 comp rx=0 tx=0).stop 2023-10-14T19:11:23.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 -- 172.21.15.7:0/3735957998 shutdown_connections 2023-10-14T19:11:23.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 --2- 172.21.15.7:0/3735957998 >> v2:172.21.15.148:3300/0 conn(0x7fb480142fd0 0x7fb4800c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 --2- 172.21.15.7:0/3735957998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb480142c00 0x7fb48006b7e0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 --2- 172.21.15.7:0/3735957998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48006bd20 0x7fb4800c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 -- 172.21.15.7:0/3735957998 >> 172.21.15.7:0/3735957998 conn(0x7fb4800675a0 msgr2=0x7fb4800679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 -- 172.21.15.7:0/3735957998 shutdown_connections 2023-10-14T19:11:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.745+0000 7fb4870cf700 1 -- 172.21.15.7:0/3735957998 wait complete. 2023-10-14T19:11:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.746+0000 7fb4870cf700 1 Processor -- start 2023-10-14T19:11:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.746+0000 7fb4870cf700 1 -- start start 2023-10-14T19:11:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4870cf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 0x7fb480169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4870cf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb480142c00 0x7fb4800b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4870cf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb480142fd0 0x7fb480140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4870cf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c7660 con 0x7fb48006bd20 2023-10-14T19:11:23.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4870cf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c48c0 con 0x7fb480142fd0 2023-10-14T19:11:23.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4870cf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b22b0 con 0x7fb480142c00 2023-10-14T19:11:23.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 0x7fb480169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 0x7fb480169f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33362/0 (socket says 172.21.15.7:33362) 2023-10-14T19:11:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 -- 172.21.15.7:0/480214064 learned_addr learned my addr 172.21.15.7:0/480214064 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4858cc700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb480142c00 0x7fb4800b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4868ce700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb480142fd0 0x7fb480140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 -- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb480142c00 msgr2=0x7fb4800b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:23.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb480142c00 0x7fb4800b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 -- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb480142fd0 msgr2=0x7fb480140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:23.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb480142fd0 0x7fb480140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 -- 172.21.15.7:0/480214064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700094f0 con 0x7fb48006bd20 2023-10-14T19:11:23.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4868ce700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb480142fd0 0x7fb480140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:23.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.747+0000 7fb4860cd700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 0x7fb480169f10 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb48006f290 tx=0x7fb470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:23.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.748+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470006a90 con 0x7fb48006bd20 2023-10-14T19:11:23.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.748+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470026450 con 0x7fb48006bd20 2023-10-14T19:11:23.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.748+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4800c7380 con 0x7fb48006bd20 2023-10-14T19:11:23.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.748+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470026810 con 0x7fb48006bd20 2023-10-14T19:11:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.748+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800b1570 con 0x7fb48006bd20 2023-10-14T19:11:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.749+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48004c3c0 con 0x7fb48006bd20 2023-10-14T19:11:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.749+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb47001a420 con 0x7fb48006bd20 2023-10-14T19:11:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.750+0000 7fb47e7fc700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb46c067320 0x7fb46c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.750+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4700866a0 con 0x7fb48006bd20 2023-10-14T19:11:23.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.750+0000 7fb4858cc700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb46c067320 0x7fb46c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:23.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.750+0000 7fb4858cc700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb46c067320 0x7fb46c0697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb4800b0c70 tx=0x7fb474008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:23.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.754+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb470053480 con 0x7fb48006bd20 2023-10-14T19:11:23.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.943+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb48006ad00 con 0x7fb46c067320 2023-10-14T19:11:23.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.952+0000 7fb47e7fc700 1 -- 172.21.15.7:0/480214064 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289719 (secure 0 0 0) 0x7fb48006ad00 con 0x7fb46c067320 2023-10-14T19:11:23.959 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:23.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb46c067320 msgr2=0x7fb46c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:23.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb46c067320 0x7fb46c0697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb4800b0c70 tx=0x7fb474008040 comp rx=0 tx=0).stop 2023-10-14T19:11:23.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 msgr2=0x7fb480169f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:23.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 0x7fb480169f10 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb48006f290 tx=0x7fb470017000 comp rx=0 tx=0).stop 2023-10-14T19:11:23.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 shutdown_connections 2023-10-14T19:11:23.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb46c067320 0x7fb46c0697d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb480142fd0 0x7fb480140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb48006bd20 0x7fb480169f10 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 --2- 172.21.15.7:0/480214064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb480142c00 0x7fb4800b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:23.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 >> 172.21.15.7:0/480214064 conn(0x7fb4800675a0 msgr2=0x7fb4800c2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:23.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 shutdown_connections 2023-10-14T19:11:23.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:23.955+0000 7fb4870cf700 1 -- 172.21.15.7:0/480214064 wait complete. 2023-10-14T19:11:23.965 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:23.968 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2023-10-14T19:11:23.740874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428648,"kb_used_data":17576,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546072,"statfs":{"total":773094113280,"available":770607177728,"internally_reserved":0,"allocated":17997824,"data_stored":8662492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.865958"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904354+0000","last_change":"2023-10-14T19:11:14.901991+0000","last_active":"2023-10-14T19:11:14.904354+0000","last_peered":"2023-10-14T19:11:14.904354+0000","last_clean":"2023-10-14T19:11:14.904354+0000","last_became_active":"2023-10-14T19:11:14.901426+0000","last_became_peered":"2023-10-14T19:11:14.901426+0000","last_unstale":"2023-10-14T19:11:14.904354+0000","last_undegraded":"2023-10-14T19:11:14.904354+0000","last_fullsized":"2023-10-14T19:11:14.904354+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:43.985400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887108+0000","last_change":"2023-10-14T19:11:14.884331+0000","last_active":"2023-10-14T19:11:14.887108+0000","last_peered":"2023-10-14T19:11:14.887108+0000","last_clean":"2023-10-14T19:11:14.887108+0000","last_became_active":"2023-10-14T19:11:14.884042+0000","last_became_peered":"2023-10-14T19:11:14.884042+0000","last_unstale":"2023-10-14T19:11:14.887108+0000","last_undegraded":"2023-10-14T19:11:14.887108+0000","last_fullsized":"2023-10-14T19:11:14.887108+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:31.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890565+0000","last_change":"2023-10-14T19:11:14.888613+0000","last_active":"2023-10-14T19:11:14.890565+0000","last_peered":"2023-10-14T19:11:14.890565+0000","last_clean":"2023-10-14T19:11:14.890565+0000","last_became_active":"2023-10-14T19:11:14.888292+0000","last_became_peered":"2023-10-14T19:11:14.888292+0000","last_unstale":"2023-10-14T19:11:14.890565+0000","last_undegraded":"2023-10-14T19:11:14.890565+0000","last_fullsized":"2023-10-14T19:11:14.890565+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898084+0000","last_change":"2023-10-14T19:11:14.893088+0000","last_active":"2023-10-14T19:11:14.898084+0000","last_peered":"2023-10-14T19:11:14.898084+0000","last_clean":"2023-10-14T19:11:14.898084+0000","last_became_active":"2023-10-14T19:11:14.892823+0000","last_became_peered":"2023-10-14T19:11:14.892823+0000","last_unstale":"2023-10-14T19:11:14.898084+0000","last_undegraded":"2023-10-14T19:11:14.898084+0000","last_fullsized":"2023-10-14T19:11:14.898084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:25:09.182588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.900224+0000","last_change":"2023-10-14T19:11:14.895506+0000","last_active":"2023-10-14T19:11:14.900224+0000","last_peered":"2023-10-14T19:11:14.900224+0000","last_clean":"2023-10-14T19:11:14.900224+0000","last_became_active":"2023-10-14T19:11:14.894979+0000","last_became_peered":"2023-10-14T19:11:14.894979+0000","last_unstale":"2023-10-14T19:11:14.900224+0000","last_undegraded":"2023-10-14T19:11:14.900224+0000","last_fullsized":"2023-10-14T19:11:14.900224+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:39.196624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894002+0000","last_change":"2023-10-14T19:11:14.891032+0000","last_active":"2023-10-14T19:11:14.894002+0000","last_peered":"2023-10-14T19:11:14.894002+0000","last_clean":"2023-10-14T19:11:14.894002+0000","last_became_active":"2023-10-14T19:11:14.890718+0000","last_became_peered":"2023-10-14T19:11:14.890718+0000","last_unstale":"2023-10-14T19:11:14.894002+0000","last_undegraded":"2023-10-14T19:11:14.894002+0000","last_fullsized":"2023-10-14T19:11:14.894002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:31.261627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.896243+0000","last_change":"2023-10-14T19:11:14.889416+0000","last_active":"2023-10-14T19:11:14.896243+0000","last_peered":"2023-10-14T19:11:14.896243+0000","last_clean":"2023-10-14T19:11:14.896243+0000","last_became_active":"2023-10-14T19:11:14.889107+0000","last_became_peered":"2023-10-14T19:11:14.889107+0000","last_unstale":"2023-10-14T19:11:14.896243+0000","last_undegraded":"2023-10-14T19:11:14.896243+0000","last_fullsized":"2023-10-14T19:11:14.896243+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:31.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880681+0000","last_change":"2023-10-14T19:11:14.880019+0000","last_active":"2023-10-14T19:11:14.880681+0000","last_peered":"2023-10-14T19:11:14.880681+0000","last_clean":"2023-10-14T19:11:14.880681+0000","last_became_active":"2023-10-14T19:11:14.879735+0000","last_became_peered":"2023-10-14T19:11:14.879735+0000","last_unstale":"2023-10-14T19:11:14.880681+0000","last_undegraded":"2023-10-14T19:11:14.880681+0000","last_fullsized":"2023-10-14T19:11:14.880681+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:19.992061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898829+0000","last_change":"2023-10-14T19:11:14.895595+0000","last_active":"2023-10-14T19:11:14.898829+0000","last_peered":"2023-10-14T19:11:14.898829+0000","last_clean":"2023-10-14T19:11:14.898829+0000","last_became_active":"2023-10-14T19:11:14.895328+0000","last_became_peered":"2023-10-14T19:11:14.895328+0000","last_unstale":"2023-10-14T19:11:14.898829+0000","last_undegraded":"2023-10-14T19:11:14.898829+0000","last_fullsized":"2023-10-14T19:11:14.898829+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:49:00.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878033+0000","last_change":"2023-10-14T19:11:14.877244+0000","last_active":"2023-10-14T19:11:14.878033+0000","last_peered":"2023-10-14T19:11:14.878033+0000","last_clean":"2023-10-14T19:11:14.878033+0000","last_became_active":"2023-10-14T19:11:14.876941+0000","last_became_peered":"2023-10-14T19:11:14.876941+0000","last_unstale":"2023-10-14T19:11:14.878033+0000","last_undegraded":"2023-10-14T19:11:14.878033+0000","last_fullsized":"2023-10-14T19:11:14.878033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:40.337173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905520+0000","last_change":"2023-10-14T19:11:14.904151+0000","last_active":"2023-10-14T19:11:14.905520+0000","last_peered":"2023-10-14T19:11:14.905520+0000","last_clean":"2023-10-14T19:11:14.905520+0000","last_became_active":"2023-10-14T19:11:14.903594+0000","last_became_peered":"2023-10-14T19:11:14.903594+0000","last_unstale":"2023-10-14T19:11:14.905520+0000","last_undegraded":"2023-10-14T19:11:14.905520+0000","last_fullsized":"2023-10-14T19:11:14.905520+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:33.032227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899165+0000","last_change":"2023-10-14T19:11:14.893034+0000","last_active":"2023-10-14T19:11:14.899165+0000","last_peered":"2023-10-14T19:11:14.899165+0000","last_clean":"2023-10-14T19:11:14.899165+0000","last_became_active":"2023-10-14T19:11:14.892767+0000","last_became_peered":"2023-10-14T19:11:14.892767+0000","last_unstale":"2023-10-14T19:11:14.899165+0000","last_undegraded":"2023-10-14T19:11:14.899165+0000","last_fullsized":"2023-10-14T19:11:14.899165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:06.124370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898270+0000","last_change":"2023-10-14T19:11:14.891165+0000","last_active":"2023-10-14T19:11:14.898270+0000","last_peered":"2023-10-14T19:11:14.898270+0000","last_clean":"2023-10-14T19:11:14.898270+0000","last_became_active":"2023-10-14T19:11:14.890919+0000","last_became_peered":"2023-10-14T19:11:14.890919+0000","last_unstale":"2023-10-14T19:11:14.898270+0000","last_undegraded":"2023-10-14T19:11:14.898270+0000","last_fullsized":"2023-10-14T19:11:14.898270+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890411+0000","last_change":"2023-10-14T19:11:14.887113+0000","last_active":"2023-10-14T19:11:14.890411+0000","last_peered":"2023-10-14T19:11:14.890411+0000","last_clean":"2023-10-14T19:11:14.890411+0000","last_became_active":"2023-10-14T19:11:14.886821+0000","last_became_peered":"2023-10-14T19:11:14.886821+0000","last_unstale":"2023-10-14T19:11:14.890411+0000","last_undegraded":"2023-10-14T19:11:14.890411+0000","last_fullsized":"2023-10-14T19:11:14.890411+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887033+0000","last_change":"2023-10-14T19:11:14.883200+0000","last_active":"2023-10-14T19:11:14.887033+0000","last_peered":"2023-10-14T19:11:14.887033+0000","last_clean":"2023-10-14T19:11:14.887033+0000","last_became_active":"2023-10-14T19:11:14.882856+0000","last_became_peered":"2023-10-14T19:11:14.882856+0000","last_unstale":"2023-10-14T19:11:14.887033+0000","last_undegraded":"2023-10-14T19:11:14.887033+0000","last_fullsized":"2023-10-14T19:11:14.887033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:34.191576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.892636+0000","last_change":"2023-10-14T19:11:14.887496+0000","last_active":"2023-10-14T19:11:14.892636+0000","last_peered":"2023-10-14T19:11:14.892636+0000","last_clean":"2023-10-14T19:11:14.892636+0000","last_became_active":"2023-10-14T19:11:14.887193+0000","last_became_peered":"2023-10-14T19:11:14.887193+0000","last_unstale":"2023-10-14T19:11:14.892636+0000","last_undegraded":"2023-10-14T19:11:14.892636+0000","last_fullsized":"2023-10-14T19:11:14.892636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:33.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890768+0000","last_change":"2023-10-14T19:11:14.889661+0000","last_active":"2023-10-14T19:11:14.890768+0000","last_peered":"2023-10-14T19:11:14.890768+0000","last_clean":"2023-10-14T19:11:14.890768+0000","last_became_active":"2023-10-14T19:11:14.887488+0000","last_became_peered":"2023-10-14T19:11:14.887488+0000","last_unstale":"2023-10-14T19:11:14.890768+0000","last_undegraded":"2023-10-14T19:11:14.890768+0000","last_fullsized":"2023-10-14T19:11:14.890768+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:41.013361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.886998+0000","last_change":"2023-10-14T19:11:14.885069+0000","last_active":"2023-10-14T19:11:14.886998+0000","last_peered":"2023-10-14T19:11:14.886998+0000","last_clean":"2023-10-14T19:11:14.886998+0000","last_became_active":"2023-10-14T19:11:14.884796+0000","last_became_peered":"2023-10-14T19:11:14.884796+0000","last_unstale":"2023-10-14T19:11:14.886998+0000","last_undegraded":"2023-10-14T19:11:14.886998+0000","last_fullsized":"2023-10-14T19:11:14.886998+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:43.985400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903234+0000","last_change":"2023-10-14T19:11:14.901829+0000","last_active":"2023-10-14T19:11:14.903234+0000","last_peered":"2023-10-14T19:11:14.903234+0000","last_clean":"2023-10-14T19:11:14.903234+0000","last_became_active":"2023-10-14T19:11:14.900088+0000","last_became_peered":"2023-10-14T19:11:14.900088+0000","last_unstale":"2023-10-14T19:11:14.903234+0000","last_undegraded":"2023-10-14T19:11:14.903234+0000","last_fullsized":"2023-10-14T19:11:14.903234+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:16.117414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878910+0000","last_change":"2023-10-14T19:11:14.878073+0000","last_active":"2023-10-14T19:11:14.878910+0000","last_peered":"2023-10-14T19:11:14.878910+0000","last_clean":"2023-10-14T19:11:14.878910+0000","last_became_active":"2023-10-14T19:11:14.877781+0000","last_became_peered":"2023-10-14T19:11:14.877781+0000","last_unstale":"2023-10-14T19:11:14.878910+0000","last_undegraded":"2023-10-14T19:11:14.878910+0000","last_fullsized":"2023-10-14T19:11:14.878910+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:35.546493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894781+0000","last_change":"2023-10-14T19:11:14.889823+0000","last_active":"2023-10-14T19:11:14.894781+0000","last_peered":"2023-10-14T19:11:14.894781+0000","last_clean":"2023-10-14T19:11:14.894781+0000","last_became_active":"2023-10-14T19:11:14.889570+0000","last_became_peered":"2023-10-14T19:11:14.889570+0000","last_unstale":"2023-10-14T19:11:14.894781+0000","last_undegraded":"2023-10-14T19:11:14.894781+0000","last_fullsized":"2023-10-14T19:11:14.894781+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:51.900240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880456+0000","last_change":"2023-10-14T19:11:14.879997+0000","last_active":"2023-10-14T19:11:14.880456+0000","last_peered":"2023-10-14T19:11:14.880456+0000","last_clean":"2023-10-14T19:11:14.880456+0000","last_became_active":"2023-10-14T19:11:14.879676+0000","last_became_peered":"2023-10-14T19:11:14.879676+0000","last_unstale":"2023-10-14T19:11:14.880456+0000","last_undegraded":"2023-10-14T19:11:14.880456+0000","last_fullsized":"2023-10-14T19:11:14.880456+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:38:12.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898146+0000","last_change":"2023-10-14T19:11:14.895092+0000","last_active":"2023-10-14T19:11:14.898146+0000","last_peered":"2023-10-14T19:11:14.898146+0000","last_clean":"2023-10-14T19:11:14.898146+0000","last_became_active":"2023-10-14T19:11:14.894651+0000","last_became_peered":"2023-10-14T19:11:14.894651+0000","last_unstale":"2023-10-14T19:11:14.898146+0000","last_undegraded":"2023-10-14T19:11:14.898146+0000","last_fullsized":"2023-10-14T19:11:14.898146+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:35.546493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.891324+0000","last_change":"2023-10-14T19:11:14.889196+0000","last_active":"2023-10-14T19:11:14.891324+0000","last_peered":"2023-10-14T19:11:14.891324+0000","last_clean":"2023-10-14T19:11:14.891324+0000","last_became_active":"2023-10-14T19:11:14.888787+0000","last_became_peered":"2023-10-14T19:11:14.888787+0000","last_unstale":"2023-10-14T19:11:14.891324+0000","last_undegraded":"2023-10-14T19:11:14.891324+0000","last_fullsized":"2023-10-14T19:11:14.891324+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:19.462907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904456+0000","last_change":"2023-10-14T19:11:14.902015+0000","last_active":"2023-10-14T19:11:14.904456+0000","last_peered":"2023-10-14T19:11:14.904456+0000","last_clean":"2023-10-14T19:11:14.904456+0000","last_became_active":"2023-10-14T19:11:14.901761+0000","last_became_peered":"2023-10-14T19:11:14.901761+0000","last_unstale":"2023-10-14T19:11:14.904456+0000","last_undegraded":"2023-10-14T19:11:14.904456+0000","last_fullsized":"2023-10-14T19:11:14.904456+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:47:29.218531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.897350+0000","last_change":"2023-10-14T19:11:14.893257+0000","last_active":"2023-10-14T19:11:14.897350+0000","last_peered":"2023-10-14T19:11:14.897350+0000","last_clean":"2023-10-14T19:11:14.897350+0000","last_became_active":"2023-10-14T19:11:14.892936+0000","last_became_peered":"2023-10-14T19:11:14.892936+0000","last_unstale":"2023-10-14T19:11:14.897350+0000","last_undegraded":"2023-10-14T19:11:14.897350+0000","last_fullsized":"2023-10-14T19:11:14.897350+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.880227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905532+0000","last_change":"2023-10-14T19:11:14.904268+0000","last_active":"2023-10-14T19:11:14.905532+0000","last_peered":"2023-10-14T19:11:14.905532+0000","last_clean":"2023-10-14T19:11:14.905532+0000","last_became_active":"2023-10-14T19:11:14.903890+0000","last_became_peered":"2023-10-14T19:11:14.903890+0000","last_unstale":"2023-10-14T19:11:14.905532+0000","last_undegraded":"2023-10-14T19:11:14.905532+0000","last_fullsized":"2023-10-14T19:11:14.905532+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:23.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898332+0000","last_change":"2023-10-14T19:11:14.893878+0000","last_active":"2023-10-14T19:11:14.898332+0000","last_peered":"2023-10-14T19:11:14.898332+0000","last_clean":"2023-10-14T19:11:14.898332+0000","last_became_active":"2023-10-14T19:11:14.893621+0000","last_became_peered":"2023-10-14T19:11:14.893621+0000","last_unstale":"2023-10-14T19:11:14.898332+0000","last_undegraded":"2023-10-14T19:11:14.898332+0000","last_fullsized":"2023-10-14T19:11:14.898332+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:23.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.891857+0000","last_change":"2023-10-14T19:11:14.889810+0000","last_active":"2023-10-14T19:11:14.891857+0000","last_peered":"2023-10-14T19:11:14.891857+0000","last_clean":"2023-10-14T19:11:14.891857+0000","last_became_active":"2023-10-14T19:11:14.887448+0000","last_became_peered":"2023-10-14T19:11:14.887448+0000","last_unstale":"2023-10-14T19:11:14.891857+0000","last_undegraded":"2023-10-14T19:11:14.891857+0000","last_fullsized":"2023-10-14T19:11:14.891857+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902797+0000","last_change":"2023-10-14T19:11:14.898600+0000","last_active":"2023-10-14T19:11:14.902797+0000","last_peered":"2023-10-14T19:11:14.902797+0000","last_clean":"2023-10-14T19:11:14.902797+0000","last_became_active":"2023-10-14T19:11:14.898333+0000","last_became_peered":"2023-10-14T19:11:14.898333+0000","last_unstale":"2023-10-14T19:11:14.902797+0000","last_undegraded":"2023-10-14T19:11:14.902797+0000","last_fullsized":"2023-10-14T19:11:14.902797+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898682+0000","last_change":"2023-10-14T19:11:14.897462+0000","last_active":"2023-10-14T19:11:14.898682+0000","last_peered":"2023-10-14T19:11:14.898682+0000","last_clean":"2023-10-14T19:11:14.898682+0000","last_became_active":"2023-10-14T19:11:14.896964+0000","last_became_peered":"2023-10-14T19:11:14.896964+0000","last_unstale":"2023-10-14T19:11:14.898682+0000","last_undegraded":"2023-10-14T19:11:14.898682+0000","last_fullsized":"2023-10-14T19:11:14.898682+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:08.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881736+0000","last_change":"2023-10-14T19:11:14.881329+0000","last_active":"2023-10-14T19:11:14.881736+0000","last_peered":"2023-10-14T19:11:14.881736+0000","last_clean":"2023-10-14T19:11:14.881736+0000","last_became_active":"2023-10-14T19:11:14.881011+0000","last_became_peered":"2023-10-14T19:11:14.881011+0000","last_unstale":"2023-10-14T19:11:14.881736+0000","last_undegraded":"2023-10-14T19:11:14.881736+0000","last_fullsized":"2023-10-14T19:11:14.881736+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:03.249614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899434+0000","last_change":"2023-10-14T19:11:14.896541+0000","last_active":"2023-10-14T19:11:14.899434+0000","last_peered":"2023-10-14T19:11:14.899434+0000","last_clean":"2023-10-14T19:11:14.899434+0000","last_became_active":"2023-10-14T19:11:14.896243+0000","last_became_peered":"2023-10-14T19:11:14.896243+0000","last_unstale":"2023-10-14T19:11:14.899434+0000","last_undegraded":"2023-10-14T19:11:14.899434+0000","last_fullsized":"2023-10-14T19:11:14.899434+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:33.386724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903568+0000","last_change":"2023-10-14T19:11:13.881701+0000","last_active":"2023-10-14T19:11:14.903568+0000","last_peered":"2023-10-14T19:11:14.903568+0000","last_clean":"2023-10-14T19:11:14.903568+0000","last_became_active":"2023-10-14T19:11:13.881447+0000","last_became_peered":"2023-10-14T19:11:13.881447+0000","last_unstale":"2023-10-14T19:11:14.903568+0000","last_undegraded":"2023-10-14T19:11:14.903568+0000","last_fullsized":"2023-10-14T19:11:14.903568+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:30.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894227+0000","last_change":"2023-10-14T19:11:14.886806+0000","last_active":"2023-10-14T19:11:14.894227+0000","last_peered":"2023-10-14T19:11:14.894227+0000","last_clean":"2023-10-14T19:11:14.894227+0000","last_became_active":"2023-10-14T19:11:14.886529+0000","last_became_peered":"2023-10-14T19:11:14.886529+0000","last_unstale":"2023-10-14T19:11:14.894227+0000","last_undegraded":"2023-10-14T19:11:14.894227+0000","last_fullsized":"2023-10-14T19:11:14.894227+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:58.775129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902213+0000","last_change":"2023-10-14T19:11:13.887162+0000","last_active":"2023-10-14T19:11:14.902213+0000","last_peered":"2023-10-14T19:11:14.902213+0000","last_clean":"2023-10-14T19:11:14.902213+0000","last_became_active":"2023-10-14T19:11:13.886862+0000","last_became_peered":"2023-10-14T19:11:13.886862+0000","last_unstale":"2023-10-14T19:11:14.902213+0000","last_undegraded":"2023-10-14T19:11:14.902213+0000","last_fullsized":"2023-10-14T19:11:14.902213+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:18:07.030442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.896346+0000","last_change":"2023-10-14T19:11:14.889097+0000","last_active":"2023-10-14T19:11:14.896346+0000","last_peered":"2023-10-14T19:11:14.896346+0000","last_clean":"2023-10-14T19:11:14.896346+0000","last_became_active":"2023-10-14T19:11:14.888786+0000","last_became_peered":"2023-10-14T19:11:14.888786+0000","last_unstale":"2023-10-14T19:11:14.896346+0000","last_undegraded":"2023-10-14T19:11:14.896346+0000","last_fullsized":"2023-10-14T19:11:14.896346+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:27.993025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904722+0000","last_change":"2023-10-14T19:11:13.885512+0000","last_active":"2023-10-14T19:11:14.904722+0000","last_peered":"2023-10-14T19:11:14.904722+0000","last_clean":"2023-10-14T19:11:14.904722+0000","last_became_active":"2023-10-14T19:11:13.883379+0000","last_became_peered":"2023-10-14T19:11:13.883379+0000","last_unstale":"2023-10-14T19:11:14.904722+0000","last_undegraded":"2023-10-14T19:11:14.904722+0000","last_fullsized":"2023-10-14T19:11:14.904722+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:06.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904903+0000","last_change":"2023-10-14T19:11:14.903518+0000","last_active":"2023-10-14T19:11:14.904903+0000","last_peered":"2023-10-14T19:11:14.904903+0000","last_clean":"2023-10-14T19:11:14.904903+0000","last_became_active":"2023-10-14T19:11:14.903220+0000","last_became_peered":"2023-10-14T19:11:14.903220+0000","last_unstale":"2023-10-14T19:11:14.904903+0000","last_undegraded":"2023-10-14T19:11:14.904903+0000","last_fullsized":"2023-10-14T19:11:14.904903+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:03.949775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898679+0000","last_change":"2023-10-14T19:11:13.875180+0000","last_active":"2023-10-14T19:11:14.898679+0000","last_peered":"2023-10-14T19:11:14.898679+0000","last_clean":"2023-10-14T19:11:14.898679+0000","last_became_active":"2023-10-14T19:11:13.874859+0000","last_became_peered":"2023-10-14T19:11:13.874859+0000","last_unstale":"2023-10-14T19:11:14.898679+0000","last_undegraded":"2023-10-14T19:11:14.898679+0000","last_fullsized":"2023-10-14T19:11:14.898679+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:54.077166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.900202+0000","last_change":"2023-10-14T19:11:14.895290+0000","last_active":"2023-10-14T19:11:14.900202+0000","last_peered":"2023-10-14T19:11:14.900202+0000","last_clean":"2023-10-14T19:11:14.900202+0000","last_became_active":"2023-10-14T19:11:14.894574+0000","last_became_peered":"2023-10-14T19:11:14.894574+0000","last_unstale":"2023-10-14T19:11:14.900202+0000","last_undegraded":"2023-10-14T19:11:14.900202+0000","last_fullsized":"2023-10-14T19:11:14.900202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:26:23.854695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902611+0000","last_change":"2023-10-14T19:11:13.882362+0000","last_active":"2023-10-14T19:11:14.902611+0000","last_peered":"2023-10-14T19:11:14.902611+0000","last_clean":"2023-10-14T19:11:14.902611+0000","last_became_active":"2023-10-14T19:11:13.882064+0000","last_became_peered":"2023-10-14T19:11:13.882064+0000","last_unstale":"2023-10-14T19:11:14.902611+0000","last_undegraded":"2023-10-14T19:11:14.902611+0000","last_fullsized":"2023-10-14T19:11:14.902611+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:41:35.880560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890695+0000","last_change":"2023-10-14T19:11:14.886201+0000","last_active":"2023-10-14T19:11:14.890695+0000","last_peered":"2023-10-14T19:11:14.890695+0000","last_clean":"2023-10-14T19:11:14.890695+0000","last_became_active":"2023-10-14T19:11:14.885769+0000","last_became_peered":"2023-10-14T19:11:14.885769+0000","last_unstale":"2023-10-14T19:11:14.890695+0000","last_undegraded":"2023-10-14T19:11:14.890695+0000","last_fullsized":"2023-10-14T19:11:14.890695+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:47:29.218531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880390+0000","last_change":"2023-10-14T19:11:13.884179+0000","last_active":"2023-10-14T19:11:14.880390+0000","last_peered":"2023-10-14T19:11:14.880390+0000","last_clean":"2023-10-14T19:11:14.880390+0000","last_became_active":"2023-10-14T19:11:13.883909+0000","last_became_peered":"2023-10-14T19:11:13.883909+0000","last_unstale":"2023-10-14T19:11:14.880390+0000","last_undegraded":"2023-10-14T19:11:14.880390+0000","last_fullsized":"2023-10-14T19:11:14.880390+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:38:28.750831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885169+0000","last_change":"2023-10-14T19:11:14.884066+0000","last_active":"2023-10-14T19:11:14.885169+0000","last_peered":"2023-10-14T19:11:14.885169+0000","last_clean":"2023-10-14T19:11:14.885169+0000","last_became_active":"2023-10-14T19:11:14.883782+0000","last_became_peered":"2023-10-14T19:11:14.883782+0000","last_unstale":"2023-10-14T19:11:14.885169+0000","last_undegraded":"2023-10-14T19:11:14.885169+0000","last_fullsized":"2023-10-14T19:11:14.885169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:54.770149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873977+0000","last_change":"2023-10-14T19:11:13.890847+0000","last_active":"2023-10-14T19:11:14.873977+0000","last_peered":"2023-10-14T19:11:14.873977+0000","last_clean":"2023-10-14T19:11:14.873977+0000","last_became_active":"2023-10-14T19:11:13.890640+0000","last_became_peered":"2023-10-14T19:11:13.890640+0000","last_unstale":"2023-10-14T19:11:14.873977+0000","last_undegraded":"2023-10-14T19:11:14.873977+0000","last_fullsized":"2023-10-14T19:11:14.873977+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:50.892246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.887089+0000","last_change":"2023-10-14T19:11:14.884301+0000","last_active":"2023-10-14T19:11:14.887089+0000","last_peered":"2023-10-14T19:11:14.887089+0000","last_clean":"2023-10-14T19:11:14.887089+0000","last_became_active":"2023-10-14T19:11:14.883672+0000","last_became_peered":"2023-10-14T19:11:14.883672+0000","last_unstale":"2023-10-14T19:11:14.887089+0000","last_undegraded":"2023-10-14T19:11:14.887089+0000","last_fullsized":"2023-10-14T19:11:14.887089+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:21.862614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894909+0000","last_change":"2023-10-14T19:11:13.891161+0000","last_active":"2023-10-14T19:11:14.894909+0000","last_peered":"2023-10-14T19:11:14.894909+0000","last_clean":"2023-10-14T19:11:14.894909+0000","last_became_active":"2023-10-14T19:11:13.890699+0000","last_became_peered":"2023-10-14T19:11:13.890699+0000","last_unstale":"2023-10-14T19:11:14.894909+0000","last_undegraded":"2023-10-14T19:11:14.894909+0000","last_fullsized":"2023-10-14T19:11:14.894909+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:33.339743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904472+0000","last_change":"2023-10-14T19:11:14.902485+0000","last_active":"2023-10-14T19:11:14.904472+0000","last_peered":"2023-10-14T19:11:14.904472+0000","last_clean":"2023-10-14T19:11:14.904472+0000","last_became_active":"2023-10-14T19:11:14.902227+0000","last_became_peered":"2023-10-14T19:11:14.902227+0000","last_unstale":"2023-10-14T19:11:14.904472+0000","last_undegraded":"2023-10-14T19:11:14.904472+0000","last_fullsized":"2023-10-14T19:11:14.904472+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:41.184247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873004+0000","last_change":"2023-10-14T19:11:13.882199+0000","last_active":"2023-10-14T19:11:14.873004+0000","last_peered":"2023-10-14T19:11:14.873004+0000","last_clean":"2023-10-14T19:11:14.873004+0000","last_became_active":"2023-10-14T19:11:13.881972+0000","last_became_peered":"2023-10-14T19:11:13.881972+0000","last_unstale":"2023-10-14T19:11:14.873004+0000","last_undegraded":"2023-10-14T19:11:14.873004+0000","last_fullsized":"2023-10-14T19:11:14.873004+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:43.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.893210+0000","last_change":"2023-10-14T19:11:14.892195+0000","last_active":"2023-10-14T19:11:14.893210+0000","last_peered":"2023-10-14T19:11:14.893210+0000","last_clean":"2023-10-14T19:11:14.893210+0000","last_became_active":"2023-10-14T19:11:14.891933+0000","last_became_peered":"2023-10-14T19:11:14.891933+0000","last_unstale":"2023-10-14T19:11:14.893210+0000","last_undegraded":"2023-10-14T19:11:14.893210+0000","last_fullsized":"2023-10-14T19:11:14.893210+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:13.158859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903697+0000","last_change":"2023-10-14T19:11:13.882365+0000","last_active":"2023-10-14T19:11:14.903697+0000","last_peered":"2023-10-14T19:11:14.903697+0000","last_clean":"2023-10-14T19:11:14.903697+0000","last_became_active":"2023-10-14T19:11:13.882076+0000","last_became_peered":"2023-10-14T19:11:13.882076+0000","last_unstale":"2023-10-14T19:11:14.903697+0000","last_undegraded":"2023-10-14T19:11:14.903697+0000","last_fullsized":"2023-10-14T19:11:14.903697+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:20.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.904432+0000","last_change":"2023-10-14T19:11:14.902501+0000","last_active":"2023-10-14T19:11:14.904432+0000","last_peered":"2023-10-14T19:11:14.904432+0000","last_clean":"2023-10-14T19:11:14.904432+0000","last_became_active":"2023-10-14T19:11:14.902237+0000","last_became_peered":"2023-10-14T19:11:14.902237+0000","last_unstale":"2023-10-14T19:11:14.904432+0000","last_undegraded":"2023-10-14T19:11:14.904432+0000","last_fullsized":"2023-10-14T19:11:14.904432+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:07.451584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903813+0000","last_change":"2023-10-14T19:11:13.879812+0000","last_active":"2023-10-14T19:11:14.903813+0000","last_peered":"2023-10-14T19:11:14.903813+0000","last_clean":"2023-10-14T19:11:14.903813+0000","last_became_active":"2023-10-14T19:11:13.877900+0000","last_became_peered":"2023-10-14T19:11:13.877900+0000","last_unstale":"2023-10-14T19:11:14.903813+0000","last_undegraded":"2023-10-14T19:11:14.903813+0000","last_fullsized":"2023-10-14T19:11:14.903813+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:09:18.043936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878588+0000","last_change":"2023-10-14T19:11:14.877191+0000","last_active":"2023-10-14T19:11:14.878588+0000","last_peered":"2023-10-14T19:11:14.878588+0000","last_clean":"2023-10-14T19:11:14.878588+0000","last_became_active":"2023-10-14T19:11:14.876890+0000","last_became_peered":"2023-10-14T19:11:14.876890+0000","last_unstale":"2023-10-14T19:11:14.878588+0000","last_undegraded":"2023-10-14T19:11:14.878588+0000","last_fullsized":"2023-10-14T19:11:14.878588+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:10.726113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899205+0000","last_change":"2023-10-14T19:11:13.886304+0000","last_active":"2023-10-14T19:11:14.899205+0000","last_peered":"2023-10-14T19:11:14.899205+0000","last_clean":"2023-10-14T19:11:14.899205+0000","last_became_active":"2023-10-14T19:11:13.886029+0000","last_became_peered":"2023-10-14T19:11:13.886029+0000","last_unstale":"2023-10-14T19:11:14.899205+0000","last_undegraded":"2023-10-14T19:11:14.899205+0000","last_fullsized":"2023-10-14T19:11:14.899205+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:02.233342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881835+0000","last_change":"2023-10-14T19:11:14.878751+0000","last_active":"2023-10-14T19:11:14.881835+0000","last_peered":"2023-10-14T19:11:14.881835+0000","last_clean":"2023-10-14T19:11:14.881835+0000","last_became_active":"2023-10-14T19:11:14.878365+0000","last_became_peered":"2023-10-14T19:11:14.878365+0000","last_unstale":"2023-10-14T19:11:14.881835+0000","last_undegraded":"2023-10-14T19:11:14.881835+0000","last_fullsized":"2023-10-14T19:11:14.881835+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:00.788849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873743+0000","last_change":"2023-10-14T19:11:13.889576+0000","last_active":"2023-10-14T19:11:14.873743+0000","last_peered":"2023-10-14T19:11:14.873743+0000","last_clean":"2023-10-14T19:11:14.873743+0000","last_became_active":"2023-10-14T19:11:13.889281+0000","last_became_peered":"2023-10-14T19:11:13.889281+0000","last_unstale":"2023-10-14T19:11:14.873743+0000","last_undegraded":"2023-10-14T19:11:14.873743+0000","last_fullsized":"2023-10-14T19:11:14.873743+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:17.378271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.882202+0000","last_change":"2023-10-14T19:11:14.880077+0000","last_active":"2023-10-14T19:11:14.882202+0000","last_peered":"2023-10-14T19:11:14.882202+0000","last_clean":"2023-10-14T19:11:14.882202+0000","last_became_active":"2023-10-14T19:11:14.879799+0000","last_became_peered":"2023-10-14T19:11:14.879799+0000","last_unstale":"2023-10-14T19:11:14.882202+0000","last_undegraded":"2023-10-14T19:11:14.882202+0000","last_fullsized":"2023-10-14T19:11:14.882202+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:25:10.359841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884958+0000","last_change":"2023-10-14T19:11:13.882108+0000","last_active":"2023-10-14T19:11:14.884958+0000","last_peered":"2023-10-14T19:11:14.884958+0000","last_clean":"2023-10-14T19:11:14.884958+0000","last_became_active":"2023-10-14T19:11:13.881840+0000","last_became_peered":"2023-10-14T19:11:13.881840+0000","last_unstale":"2023-10-14T19:11:14.884958+0000","last_undegraded":"2023-10-14T19:11:14.884958+0000","last_fullsized":"2023-10-14T19:11:14.884958+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:12.150865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890422+0000","last_change":"2023-10-14T19:11:14.886567+0000","last_active":"2023-10-14T19:11:14.890422+0000","last_peered":"2023-10-14T19:11:14.890422+0000","last_clean":"2023-10-14T19:11:14.890422+0000","last_became_active":"2023-10-14T19:11:14.885671+0000","last_became_peered":"2023-10-14T19:11:14.885671+0000","last_unstale":"2023-10-14T19:11:14.890422+0000","last_undegraded":"2023-10-14T19:11:14.890422+0000","last_fullsized":"2023-10-14T19:11:14.890422+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:00.788849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.905474+0000","last_change":"2023-10-14T19:11:13.886012+0000","last_active":"2023-10-14T19:11:14.905474+0000","last_peered":"2023-10-14T19:11:14.905474+0000","last_clean":"2023-10-14T19:11:14.905474+0000","last_became_active":"2023-10-14T19:11:13.884751+0000","last_became_peered":"2023-10-14T19:11:13.884751+0000","last_unstale":"2023-10-14T19:11:14.905474+0000","last_undegraded":"2023-10-14T19:11:14.905474+0000","last_fullsized":"2023-10-14T19:11:14.905474+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:51.526736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.880640+0000","last_change":"2023-10-14T19:11:14.879161+0000","last_active":"2023-10-14T19:11:14.880640+0000","last_peered":"2023-10-14T19:11:14.880640+0000","last_clean":"2023-10-14T19:11:14.880640+0000","last_became_active":"2023-10-14T19:11:14.878662+0000","last_became_peered":"2023-10-14T19:11:14.878662+0000","last_unstale":"2023-10-14T19:11:14.880640+0000","last_undegraded":"2023-10-14T19:11:14.880640+0000","last_fullsized":"2023-10-14T19:11:14.880640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:52.236007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899439+0000","last_change":"2023-10-14T19:11:13.882975+0000","last_active":"2023-10-14T19:11:14.899439+0000","last_peered":"2023-10-14T19:11:14.899439+0000","last_clean":"2023-10-14T19:11:14.899439+0000","last_became_active":"2023-10-14T19:11:13.882712+0000","last_became_peered":"2023-10-14T19:11:13.882712+0000","last_unstale":"2023-10-14T19:11:14.899439+0000","last_undegraded":"2023-10-14T19:11:14.899439+0000","last_fullsized":"2023-10-14T19:11:14.899439+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:15.977144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.888466+0000","last_change":"2023-10-14T19:11:14.885731+0000","last_active":"2023-10-14T19:11:14.888466+0000","last_peered":"2023-10-14T19:11:14.888466+0000","last_clean":"2023-10-14T19:11:14.888466+0000","last_became_active":"2023-10-14T19:11:14.884038+0000","last_became_peered":"2023-10-14T19:11:14.884038+0000","last_unstale":"2023-10-14T19:11:14.888466+0000","last_undegraded":"2023-10-14T19:11:14.888466+0000","last_fullsized":"2023-10-14T19:11:14.888466+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:33.032227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901351+0000","last_change":"2023-10-14T19:11:13.876738+0000","last_active":"2023-10-14T19:11:14.901351+0000","last_peered":"2023-10-14T19:11:14.901351+0000","last_clean":"2023-10-14T19:11:14.901351+0000","last_became_active":"2023-10-14T19:11:13.876437+0000","last_became_peered":"2023-10-14T19:11:13.876437+0000","last_unstale":"2023-10-14T19:11:14.901351+0000","last_undegraded":"2023-10-14T19:11:14.901351+0000","last_fullsized":"2023-10-14T19:11:14.901351+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:22.659840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.899505+0000","last_change":"2023-10-14T19:11:14.897612+0000","last_active":"2023-10-14T19:11:14.899505+0000","last_peered":"2023-10-14T19:11:14.899505+0000","last_clean":"2023-10-14T19:11:14.899505+0000","last_became_active":"2023-10-14T19:11:14.897362+0000","last_became_peered":"2023-10-14T19:11:14.897362+0000","last_unstale":"2023-10-14T19:11:14.899505+0000","last_undegraded":"2023-10-14T19:11:14.899505+0000","last_fullsized":"2023-10-14T19:11:14.899505+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:11.347384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901993+0000","last_change":"2023-10-14T19:11:13.884462+0000","last_active":"2023-10-14T19:11:14.901993+0000","last_peered":"2023-10-14T19:11:14.901993+0000","last_clean":"2023-10-14T19:11:14.901993+0000","last_became_active":"2023-10-14T19:11:13.884160+0000","last_became_peered":"2023-10-14T19:11:13.884160+0000","last_unstale":"2023-10-14T19:11:14.901993+0000","last_undegraded":"2023-10-14T19:11:14.901993+0000","last_fullsized":"2023-10-14T19:11:14.901993+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:05.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.892107+0000","last_change":"2023-10-14T19:11:14.891675+0000","last_active":"2023-10-14T19:11:14.892107+0000","last_peered":"2023-10-14T19:11:14.892107+0000","last_clean":"2023-10-14T19:11:14.892107+0000","last_became_active":"2023-10-14T19:11:14.891421+0000","last_became_peered":"2023-10-14T19:11:14.891421+0000","last_unstale":"2023-10-14T19:11:14.892107+0000","last_undegraded":"2023-10-14T19:11:14.892107+0000","last_fullsized":"2023-10-14T19:11:14.892107+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:34.372203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.876136+0000","last_change":"2023-10-14T19:11:13.884362+0000","last_active":"2023-10-14T19:11:14.876136+0000","last_peered":"2023-10-14T19:11:14.876136+0000","last_clean":"2023-10-14T19:11:14.876136+0000","last_became_active":"2023-10-14T19:11:13.884051+0000","last_became_peered":"2023-10-14T19:11:13.884051+0000","last_unstale":"2023-10-14T19:11:14.876136+0000","last_undegraded":"2023-10-14T19:11:14.876136+0000","last_fullsized":"2023-10-14T19:11:14.876136+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:27.422618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898581+0000","last_change":"2023-10-14T19:11:14.896189+0000","last_active":"2023-10-14T19:11:14.898581+0000","last_peered":"2023-10-14T19:11:14.898581+0000","last_clean":"2023-10-14T19:11:14.898581+0000","last_became_active":"2023-10-14T19:11:14.895894+0000","last_became_peered":"2023-10-14T19:11:14.895894+0000","last_unstale":"2023-10-14T19:11:14.898581+0000","last_undegraded":"2023-10-14T19:11:14.898581+0000","last_fullsized":"2023-10-14T19:11:14.898581+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:10.991741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.903518+0000","last_change":"2023-10-14T19:11:13.889060+0000","last_active":"2023-10-14T19:11:14.903518+0000","last_peered":"2023-10-14T19:11:14.903518+0000","last_clean":"2023-10-14T19:11:14.903518+0000","last_became_active":"2023-10-14T19:11:13.888806+0000","last_became_peered":"2023-10-14T19:11:13.888806+0000","last_unstale":"2023-10-14T19:11:14.903518+0000","last_undegraded":"2023-10-14T19:11:14.903518+0000","last_fullsized":"2023-10-14T19:11:14.903518+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:55:37.724530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890597+0000","last_change":"2023-10-14T19:11:14.886655+0000","last_active":"2023-10-14T19:11:14.890597+0000","last_peered":"2023-10-14T19:11:14.890597+0000","last_clean":"2023-10-14T19:11:14.890597+0000","last_became_active":"2023-10-14T19:11:14.886391+0000","last_became_peered":"2023-10-14T19:11:14.886391+0000","last_unstale":"2023-10-14T19:11:14.890597+0000","last_undegraded":"2023-10-14T19:11:14.890597+0000","last_fullsized":"2023-10-14T19:11:14.890597+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:12:08.223917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885430+0000","last_change":"2023-10-14T19:11:13.884899+0000","last_active":"2023-10-14T19:11:14.885430+0000","last_peered":"2023-10-14T19:11:14.885430+0000","last_clean":"2023-10-14T19:11:14.885430+0000","last_became_active":"2023-10-14T19:11:13.883808+0000","last_became_peered":"2023-10-14T19:11:13.883808+0000","last_unstale":"2023-10-14T19:11:14.885430+0000","last_undegraded":"2023-10-14T19:11:14.885430+0000","last_fullsized":"2023-10-14T19:11:14.885430+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:17:51.526736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.878380+0000","last_change":"2023-10-14T19:11:14.877343+0000","last_active":"2023-10-14T19:11:14.878380+0000","last_peered":"2023-10-14T19:11:14.878380+0000","last_clean":"2023-10-14T19:11:14.878380+0000","last_became_active":"2023-10-14T19:11:14.877086+0000","last_became_peered":"2023-10-14T19:11:14.877086+0000","last_unstale":"2023-10-14T19:11:14.878380+0000","last_undegraded":"2023-10-14T19:11:14.878380+0000","last_fullsized":"2023-10-14T19:11:14.878380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:10:26.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881517+0000","last_change":"2023-10-14T19:11:13.888013+0000","last_active":"2023-10-14T19:11:14.881517+0000","last_peered":"2023-10-14T19:11:14.881517+0000","last_clean":"2023-10-14T19:11:14.881517+0000","last_became_active":"2023-10-14T19:11:13.887693+0000","last_became_peered":"2023-10-14T19:11:13.887693+0000","last_unstale":"2023-10-14T19:11:14.881517+0000","last_undegraded":"2023-10-14T19:11:14.881517+0000","last_fullsized":"2023-10-14T19:11:14.881517+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:05.380969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890018+0000","last_change":"2023-10-14T19:11:14.888740+0000","last_active":"2023-10-14T19:11:14.890018+0000","last_peered":"2023-10-14T19:11:14.890018+0000","last_clean":"2023-10-14T19:11:14.890018+0000","last_became_active":"2023-10-14T19:11:14.888442+0000","last_became_peered":"2023-10-14T19:11:14.888442+0000","last_unstale":"2023-10-14T19:11:14.890018+0000","last_undegraded":"2023-10-14T19:11:14.890018+0000","last_fullsized":"2023-10-14T19:11:14.890018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:26.935615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.872890+0000","last_change":"2023-10-14T19:11:13.879918+0000","last_active":"2023-10-14T19:11:14.872890+0000","last_peered":"2023-10-14T19:11:14.872890+0000","last_clean":"2023-10-14T19:11:14.872890+0000","last_became_active":"2023-10-14T19:11:13.879488+0000","last_became_peered":"2023-10-14T19:11:13.879488+0000","last_unstale":"2023-10-14T19:11:14.872890+0000","last_undegraded":"2023-10-14T19:11:14.872890+0000","last_fullsized":"2023-10-14T19:11:14.872890+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:15:13.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.889262+0000","last_change":"2023-10-14T19:11:14.888109+0000","last_active":"2023-10-14T19:11:14.889262+0000","last_peered":"2023-10-14T19:11:14.889262+0000","last_clean":"2023-10-14T19:11:14.889262+0000","last_became_active":"2023-10-14T19:11:14.887896+0000","last_became_peered":"2023-10-14T19:11:14.887896+0000","last_unstale":"2023-10-14T19:11:14.889262+0000","last_undegraded":"2023-10-14T19:11:14.889262+0000","last_fullsized":"2023-10-14T19:11:14.889262+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:34.347737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902751+0000","last_change":"2023-10-14T19:11:13.887469+0000","last_active":"2023-10-14T19:11:14.902751+0000","last_peered":"2023-10-14T19:11:14.902751+0000","last_clean":"2023-10-14T19:11:14.902751+0000","last_became_active":"2023-10-14T19:11:13.887225+0000","last_became_peered":"2023-10-14T19:11:13.887225+0000","last_unstale":"2023-10-14T19:11:14.902751+0000","last_undegraded":"2023-10-14T19:11:14.902751+0000","last_fullsized":"2023-10-14T19:11:14.902751+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:26.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884451+0000","last_change":"2023-10-14T19:11:14.881256+0000","last_active":"2023-10-14T19:11:14.884451+0000","last_peered":"2023-10-14T19:11:14.884451+0000","last_clean":"2023-10-14T19:11:14.884451+0000","last_became_active":"2023-10-14T19:11:14.880933+0000","last_became_peered":"2023-10-14T19:11:14.880933+0000","last_unstale":"2023-10-14T19:11:14.884451+0000","last_undegraded":"2023-10-14T19:11:14.884451+0000","last_fullsized":"2023-10-14T19:11:14.884451+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:03:27.993025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T19:11:16.190143+0000","last_change":"2023-10-14T19:11:13.882926+0000","last_active":"2023-10-14T19:11:16.190143+0000","last_peered":"2023-10-14T19:11:16.190143+0000","last_clean":"2023-10-14T19:11:16.190143+0000","last_became_active":"2023-10-14T19:11:13.881598+0000","last_became_peered":"2023-10-14T19:11:13.881598+0000","last_unstale":"2023-10-14T19:11:16.190143+0000","last_undegraded":"2023-10-14T19:11:16.190143+0000","last_fullsized":"2023-10-14T19:11:16.190143+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:00:25.927621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.890295+0000","last_change":"2023-10-14T19:11:14.886172+0000","last_active":"2023-10-14T19:11:14.890295+0000","last_peered":"2023-10-14T19:11:14.890295+0000","last_clean":"2023-10-14T19:11:14.890295+0000","last_became_active":"2023-10-14T19:11:14.885903+0000","last_became_peered":"2023-10-14T19:11:14.885903+0000","last_unstale":"2023-10-14T19:11:14.890295+0000","last_undegraded":"2023-10-14T19:11:14.890295+0000","last_fullsized":"2023-10-14T19:11:14.890295+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:42.177435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.894184+0000","last_change":"2023-10-14T19:11:13.879863+0000","last_active":"2023-10-14T19:11:14.894184+0000","last_peered":"2023-10-14T19:11:14.894184+0000","last_clean":"2023-10-14T19:11:14.894184+0000","last_became_active":"2023-10-14T19:11:13.879393+0000","last_became_peered":"2023-10-14T19:11:13.879393+0000","last_unstale":"2023-10-14T19:11:14.894184+0000","last_undegraded":"2023-10-14T19:11:14.894184+0000","last_fullsized":"2023-10-14T19:11:14.894184+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:05:17.442589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.886601+0000","last_change":"2023-10-14T19:11:14.885272+0000","last_active":"2023-10-14T19:11:14.886601+0000","last_peered":"2023-10-14T19:11:14.886601+0000","last_clean":"2023-10-14T19:11:14.886601+0000","last_became_active":"2023-10-14T19:11:14.884988+0000","last_became_peered":"2023-10-14T19:11:14.884988+0000","last_unstale":"2023-10-14T19:11:14.886601+0000","last_undegraded":"2023-10-14T19:11:14.886601+0000","last_fullsized":"2023-10-14T19:11:14.886601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:33.314415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873506+0000","last_change":"2023-10-14T19:11:13.886696+0000","last_active":"2023-10-14T19:11:14.873506+0000","last_peered":"2023-10-14T19:11:14.873506+0000","last_clean":"2023-10-14T19:11:14.873506+0000","last_became_active":"2023-10-14T19:11:13.886411+0000","last_became_peered":"2023-10-14T19:11:13.886411+0000","last_unstale":"2023-10-14T19:11:14.873506+0000","last_undegraded":"2023-10-14T19:11:14.873506+0000","last_fullsized":"2023-10-14T19:11:14.873506+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:37:26.743989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.879380+0000","last_change":"2023-10-14T19:11:14.878150+0000","last_active":"2023-10-14T19:11:14.879380+0000","last_peered":"2023-10-14T19:11:14.879380+0000","last_clean":"2023-10-14T19:11:14.879380+0000","last_became_active":"2023-10-14T19:11:14.877854+0000","last_became_peered":"2023-10-14T19:11:14.877854+0000","last_unstale":"2023-10-14T19:11:14.879380+0000","last_undegraded":"2023-10-14T19:11:14.879380+0000","last_fullsized":"2023-10-14T19:11:14.879380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:41.013361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881933+0000","last_change":"2023-10-14T19:11:13.889408+0000","last_active":"2023-10-14T19:11:14.881933+0000","last_peered":"2023-10-14T19:11:14.881933+0000","last_clean":"2023-10-14T19:11:14.881933+0000","last_became_active":"2023-10-14T19:11:13.889150+0000","last_became_peered":"2023-10-14T19:11:13.889150+0000","last_unstale":"2023-10-14T19:11:14.881933+0000","last_undegraded":"2023-10-14T19:11:14.881933+0000","last_fullsized":"2023-10-14T19:11:14.881933+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:45.782424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.884481+0000","last_change":"2023-10-14T19:11:14.881097+0000","last_active":"2023-10-14T19:11:14.884481+0000","last_peered":"2023-10-14T19:11:14.884481+0000","last_clean":"2023-10-14T19:11:14.884481+0000","last_became_active":"2023-10-14T19:11:14.880822+0000","last_became_peered":"2023-10-14T19:11:14.880822+0000","last_unstale":"2023-10-14T19:11:14.884481+0000","last_undegraded":"2023-10-14T19:11:14.884481+0000","last_fullsized":"2023-10-14T19:11:14.884481+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:46:47.072006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.873844+0000","last_change":"2023-10-14T19:11:13.883283+0000","last_active":"2023-10-14T19:11:14.873844+0000","last_peered":"2023-10-14T19:11:14.873844+0000","last_clean":"2023-10-14T19:11:14.873844+0000","last_became_active":"2023-10-14T19:11:13.883002+0000","last_became_peered":"2023-10-14T19:11:13.883002+0000","last_unstale":"2023-10-14T19:11:14.873844+0000","last_undegraded":"2023-10-14T19:11:14.873844+0000","last_fullsized":"2023-10-14T19:11:14.873844+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:09:39.329179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.881972+0000","last_change":"2023-10-14T19:11:14.878962+0000","last_active":"2023-10-14T19:11:14.881972+0000","last_peered":"2023-10-14T19:11:14.881972+0000","last_clean":"2023-10-14T19:11:14.881972+0000","last_became_active":"2023-10-14T19:11:14.878661+0000","last_became_peered":"2023-10-14T19:11:14.878661+0000","last_unstale":"2023-10-14T19:11:14.881972+0000","last_undegraded":"2023-10-14T19:11:14.881972+0000","last_fullsized":"2023-10-14T19:11:14.881972+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:13.158859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885108+0000","last_change":"2023-10-14T19:11:13.887614+0000","last_active":"2023-10-14T19:11:14.885108+0000","last_peered":"2023-10-14T19:11:14.885108+0000","last_clean":"2023-10-14T19:11:14.885108+0000","last_became_active":"2023-10-14T19:11:13.887266+0000","last_became_peered":"2023-10-14T19:11:13.887266+0000","last_unstale":"2023-10-14T19:11:14.885108+0000","last_undegraded":"2023-10-14T19:11:14.885108+0000","last_fullsized":"2023-10-14T19:11:14.885108+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:53:30.977491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.898119+0000","last_change":"2023-10-14T19:11:14.894921+0000","last_active":"2023-10-14T19:11:14.898119+0000","last_peered":"2023-10-14T19:11:14.898119+0000","last_clean":"2023-10-14T19:11:14.898119+0000","last_became_active":"2023-10-14T19:11:14.894289+0000","last_became_peered":"2023-10-14T19:11:14.894289+0000","last_unstale":"2023-10-14T19:11:14.898119+0000","last_undegraded":"2023-10-14T19:11:14.898119+0000","last_fullsized":"2023-10-14T19:11:14.898119+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:08.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.872954+0000","last_change":"2023-10-14T19:11:13.879744+0000","last_active":"2023-10-14T19:11:14.872954+0000","last_peered":"2023-10-14T19:11:14.872954+0000","last_clean":"2023-10-14T19:11:14.872954+0000","last_became_active":"2023-10-14T19:11:13.879150+0000","last_became_peered":"2023-10-14T19:11:13.879150+0000","last_unstale":"2023-10-14T19:11:14.872954+0000","last_undegraded":"2023-10-14T19:11:14.872954+0000","last_fullsized":"2023-10-14T19:11:14.872954+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:43:13.839136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.901924+0000","last_change":"2023-10-14T19:11:14.898080+0000","last_active":"2023-10-14T19:11:14.901924+0000","last_peered":"2023-10-14T19:11:14.901924+0000","last_clean":"2023-10-14T19:11:14.901924+0000","last_became_active":"2023-10-14T19:11:14.897787+0000","last_became_peered":"2023-10-14T19:11:14.897787+0000","last_unstale":"2023-10-14T19:11:14.901924+0000","last_undegraded":"2023-10-14T19:11:14.901924+0000","last_fullsized":"2023-10-14T19:11:14.901924+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:13.861651+0000","last_clean_scrub_stamp":"2023-10-14T19:11:13.861651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:28.430611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.902912+0000","last_change":"2023-10-14T19:11:13.889060+0000","last_active":"2023-10-14T19:11:14.902912+0000","last_peered":"2023-10-14T19:11:14.902912+0000","last_clean":"2023-10-14T19:11:14.902912+0000","last_became_active":"2023-10-14T19:11:13.888783+0000","last_became_peered":"2023-10-14T19:11:13.888783+0000","last_unstale":"2023-10-14T19:11:14.902912+0000","last_undegraded":"2023-10-14T19:11:14.902912+0000","last_fullsized":"2023-10-14T19:11:14.902912+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:12.853657+0000","last_clean_scrub_stamp":"2023-10-14T19:11:12.853657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:47.688528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":280,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T19:11:14.885575+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:14.885575+0000","last_peered":"2023-10-14T19:11:14.885575+0000","last_clean":"2023-10-14T19:11:14.885575+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:14.885575+0000","last_undegraded":"2023-10-14T19:11:14.885575+0000","last_fullsized":"2023-10-14T19:11:14.885575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574952,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304012,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067828,"statfs":{"total":96636764160,"available":96325455872,"internally_reserved":0,"allocated":2691072,"data_stored":1525081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.63800000000000001},"min":{"1min":0.35699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.60999999999999999,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.64100000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.755,"15min":3.1480000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.629},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89600000000000002,"15min":3.23},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.73299999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74299999999999999,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.73499999999999999,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.55600000000000005},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.875,"15min":2.4620000000000002},"last":0.313},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.66900000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.33300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.63600000000000001},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":2.883},"last":0.35299999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.64900000000000002},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.379},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":5.383},"last":0.39500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303436,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068404,"statfs":{"total":96636764160,"available":96326045696,"internally_reserved":0,"allocated":2101248,"data_stored":934699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.65800000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":5.6820000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.81899999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.745,"5min":0.745,"15min":7.8680000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78900000000000003,"15min":8.0210000000000008},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.78500000000000003},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.81000000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.745},"min":{"1min":0.379,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.76000000000000001},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":8.1120000000000001},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71599999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.54700000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73599999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.58999999999999997},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.61899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.78100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":934733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32400000000000001,"15min":0.314},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63500000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.624,"15min":0.67300000000000004},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.216},"max":{"1min":0.45800000000000002,"5min":0.873,"15min":0.873},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":1.032},"last":0.68799999999999994}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.57999999999999996},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.85699999999999998,"5min":1.627,"15min":1.627},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90100000000000002,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.91600000000000004,"15min":1.079},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.38800000000000001},"max":{"1min":0.746,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304016,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067824,"statfs":{"total":96636764160,"available":96325451776,"internally_reserved":0,"allocated":2695168,"data_stored":1525655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.34399999999999997},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47599999999999998,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.495,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55400000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.504}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.62},"last":0.437},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.29699999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77400000000000002,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.39200000000000002},"max":{"1min":0.90700000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77300000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.96199999999999997,"15min":0.98799999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.51100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.91900000000000004,"15min":0.95599999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.501,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.88700000000000001,"15min":0.96599999999999997},"last":0.83899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303448,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068392,"statfs":{"total":96636764160,"available":96326033408,"internally_reserved":0,"allocated":2113536,"data_stored":936235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.45400000000000001,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.315},{"interface":"front","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.42499999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":0.65800000000000003,"15min":2.028},"last":0.41699999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53400000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38100000000000001,"15min":0.69099999999999995},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":11.269},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.66200000000000003},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":11.318},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59599999999999997,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.67200000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.94699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":11.379},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.95199999999999996},"min":{"1min":0.438,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":11.404},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.96499999999999997},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2109440,"data_stored":936249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49099999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.38100000000000001},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32200000000000001,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.377}]},{"osd":2,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54200000000000004,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.44700000000000001},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":2.597,"15min":2.597},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.214,"15min":1.214},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.133,"15min":1.133},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.752,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.379,"15min":0.379},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":0.997},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":935197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.53900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.752,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":1.589,"15min":1.589},"last":0.34699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74299999999999999,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.61799999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.38}]},{"osd":5,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48799999999999999,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64500000000000002,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.627,"5min":1.222,"15min":1.5269999999999999},"last":0.40899999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.65900000000000003,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.626},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57999999999999996,"15min":0.64000000000000001},"min":{"1min":0.42199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":934643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32700000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.83199999999999996,"5min":1.784,"15min":1.784},"last":0.42999999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.876},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.75900000000000001},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.88100000000000001,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":1.008,"15min":1.008},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:23.975 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:11:23.976 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:11:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.134+0000 7fba510c9700 1 Processor -- start 2023-10-14T19:11:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.134+0000 7fba510c9700 1 -- start start 2023-10-14T19:11:24.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba510c9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba4c0cc320 0x7fba4c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba510c9700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba4c06a110 0x7fba4c13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba510c9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c06d7b0 con 0x7fba4c0cc6f0 2023-10-14T19:11:24.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba510c9700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c06a570 con 0x7fba4c06a110 2023-10-14T19:11:24.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba510c9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c06f7d0 con 0x7fba4c0cc320 2023-10-14T19:11:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba4c06a110 0x7fba4c13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba4c06a110 0x7fba4c13c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33374/0 (socket says 172.21.15.7:33374) 2023-10-14T19:11:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 -- 172.21.15.7:0/1276428654 learned_addr learned my addr 172.21.15.7:0/1276428654 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4ad9d700 1 --2- 172.21.15.7:0/1276428654 >> v2:172.21.15.148:3300/0 conn(0x7fba4c0cc320 0x7fba4c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 -- 172.21.15.7:0/1276428654 >> v2:172.21.15.148:3300/0 conn(0x7fba4c0cc320 msgr2=0x7fba4c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 --2- 172.21.15.7:0/1276428654 >> v2:172.21.15.148:3300/0 conn(0x7fba4c0cc320 0x7fba4c13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 -- 172.21.15.7:0/1276428654 >> v1:172.21.15.148:6789/0 conn(0x7fba4c0cc6f0 legacy=0x7fba4c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 -- 172.21.15.7:0/1276428654 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c06e330 con 0x7fba4c06a110 2023-10-14T19:11:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4ad9d700 1 --2- 172.21.15.7:0/1276428654 >> v2:172.21.15.148:3300/0 conn(0x7fba4c0cc320 0x7fba4c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.135+0000 7fba4b59e700 1 --2- 172.21.15.7:0/1276428654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c06a110 0x7fba4c13c7e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0cf510 tx=0x7fba44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e781092df6b2e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba4a59c700 1 -- 172.21.15.7:0/1276428654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400e070 con 0x7fba4c06a110 2023-10-14T19:11:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba4a59c700 1 -- 172.21.15.7:0/1276428654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4400ba00 con 0x7fba4c06a110 2023-10-14T19:11:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba4a59c700 1 -- 172.21.15.7:0/1276428654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440092e0 con 0x7fba4c06a110 2023-10-14T19:11:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 -- 172.21.15.7:0/1276428654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c06a110 msgr2=0x7fba4c13c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 --2- 172.21.15.7:0/1276428654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c06a110 0x7fba4c13c7e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0cf510 tx=0x7fba44009840 comp rx=0 tx=0).stop 2023-10-14T19:11:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 -- 172.21.15.7:0/1276428654 shutdown_connections 2023-10-14T19:11:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 --2- 172.21.15.7:0/1276428654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c06a110 0x7fba4c13c7e0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 --2- 172.21.15.7:0/1276428654 >> v2:172.21.15.148:3300/0 conn(0x7fba4c0cc320 0x7fba4c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 -- 172.21.15.7:0/1276428654 >> 172.21.15.7:0/1276428654 conn(0x7fba4c067f00 msgr2=0x7fba4c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 -- 172.21.15.7:0/1276428654 shutdown_connections 2023-10-14T19:11:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.136+0000 7fba510c9700 1 -- 172.21.15.7:0/1276428654 wait complete. 2023-10-14T19:11:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.137+0000 7fba510c9700 1 Processor -- start 2023-10-14T19:11:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.137+0000 7fba510c9700 1 -- start start 2023-10-14T19:11:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba510c9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba4c06a110 0x7fba4c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba510c9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 0x7fba4c0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba510c9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba4c0cc6f0 0x7fba4c0682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba510c9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0c55b0 con 0x7fba4c0cc320 2023-10-14T19:11:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba510c9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c13ba90 con 0x7fba4c0cc6f0 2023-10-14T19:11:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba510c9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0c78b0 con 0x7fba4c06a110 2023-10-14T19:11:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 0x7fba4c0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 0x7fba4c0c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33390/0 (socket says 172.21.15.7:33390) 2023-10-14T19:11:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 -- 172.21.15.7:0/2261266017 learned_addr learned my addr 172.21.15.7:0/2261266017 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 -- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba4c06a110 msgr2=0x7fba4c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba4c06a110 0x7fba4c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 -- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba4c0cc6f0 msgr2=0x7fba4c0682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba4b59e700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba4c0cc6f0 0x7fba4c0682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba4c0cc6f0 0x7fba4c0682d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.138+0000 7fba43fff700 1 -- 172.21.15.7:0/2261266017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009ae0 con 0x7fba4c0cc320 2023-10-14T19:11:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.139+0000 7fba43fff700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 0x7fba4c0c6fa0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fba3400b5e0 tx=0x7fba34009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.139+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400f510 con 0x7fba4c0cc320 2023-10-14T19:11:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.139+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3400f670 con 0x7fba4c0cc320 2023-10-14T19:11:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.139+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c0c7b90 con 0x7fba4c0cc320 2023-10-14T19:11:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.139+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400fa30 con 0x7fba4c0cc320 2023-10-14T19:11:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.139+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c0c8150 con 0x7fba4c0cc320 2023-10-14T19:11:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.140+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c0c8370 con 0x7fba4c0cc320 2023-10-14T19:11:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.140+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fba3401a400 con 0x7fba4c0cc320 2023-10-14T19:11:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.141+0000 7fba42ffd700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fba2c067320 0x7fba2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.141+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba340846f0 con 0x7fba4c0cc320 2023-10-14T19:11:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.142+0000 7fba4ad9d700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fba2c067320 0x7fba2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.143+0000 7fba4ad9d700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fba2c067320 0x7fba2c0697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007aa0 tx=0x7fba3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.145+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba34051420 con 0x7fba4c0cc320 2023-10-14T19:11:24.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.417+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fba4c04c420 con 0x7fba4c0cc320 2023-10-14T19:11:24.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.421+0000 7fba42ffd700 1 -- 172.21.15.7:0/2261266017 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fba34054a40 con 0x7fba4c0cc320 2023-10-14T19:11:24.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fba2c067320 msgr2=0x7fba2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fba2c067320 0x7fba2c0697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007aa0 tx=0x7fba3c008040 comp rx=0 tx=0).stop 2023-10-14T19:11:24.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 msgr2=0x7fba4c0c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 0x7fba4c0c6fa0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fba3400b5e0 tx=0x7fba34009120 comp rx=0 tx=0).stop 2023-10-14T19:11:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 shutdown_connections 2023-10-14T19:11:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fba2c067320 0x7fba2c0697d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba4c0cc6f0 0x7fba4c0682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba4c06a110 0x7fba4c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 --2- 172.21.15.7:0/2261266017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba4c0cc320 0x7fba4c0c6fa0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 >> 172.21.15.7:0/2261266017 conn(0x7fba4c067f00 msgr2=0x7fba4c153970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 shutdown_connections 2023-10-14T19:11:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.423+0000 7fba510c9700 1 -- 172.21.15.7:0/2261266017 wait complete. 2023-10-14T19:11:24.427 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:11:24.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.554+0000 7f2366de3700 1 Processor -- start 2023-10-14T19:11:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 -- start start 2023-10-14T19:11:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23600cb5a0 0x7f23600cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23600cd9e0 0x7f2360159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236015a400 0x7f2360156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600d13f0 con 0x7f23600cd9e0 2023-10-14T19:11:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236015ae40 con 0x7f23600cb5a0 2023-10-14T19:11:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.555+0000 7f2366de3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236015ab60 con 0x7f236015a400 2023-10-14T19:11:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23600cd9e0 0x7f2360159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23600cd9e0 0x7f2360159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33402/0 (socket says 172.21.15.7:33402) 2023-10-14T19:11:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 -- 172.21.15.7:0/2391449149 learned_addr learned my addr 172.21.15.7:0/2391449149 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f2365380700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236015a400 0x7f2360156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f2364b7f700 1 --2- 172.21.15.7:0/2391449149 >> v2:172.21.15.148:3300/0 conn(0x7f23600cb5a0 0x7f23600cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 -- 172.21.15.7:0/2391449149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236015a400 msgr2=0x7f2360156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236015a400 0x7f2360156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 -- 172.21.15.7:0/2391449149 >> v2:172.21.15.148:3300/0 conn(0x7f23600cb5a0 msgr2=0x7f23600cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 --2- 172.21.15.7:0/2391449149 >> v2:172.21.15.148:3300/0 conn(0x7f23600cb5a0 0x7f23600cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 -- 172.21.15.7:0/2391449149 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600ccf00 con 0x7f23600cd9e0 2023-10-14T19:11:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f2364b7f700 1 --2- 172.21.15.7:0/2391449149 >> v2:172.21.15.148:3300/0 conn(0x7f23600cb5a0 0x7f23600cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f2365380700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236015a400 0x7f2360156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235ffff700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23600cd9e0 0x7f2360159ec0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f2350009f20 tx=0x7f2350009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c310d0edfdc98760 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235f7fe700 1 -- 172.21.15.7:0/2391449149 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000e070 con 0x7f23600cd9e0 2023-10-14T19:11:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235f7fe700 1 -- 172.21.15.7:0/2391449149 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000ba40 con 0x7f23600cd9e0 2023-10-14T19:11:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.556+0000 7f235f7fe700 1 -- 172.21.15.7:0/2391449149 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500092e0 con 0x7f23600cd9e0 2023-10-14T19:11:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 -- 172.21.15.7:0/2391449149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23600cd9e0 msgr2=0x7f2360159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23600cd9e0 0x7f2360159ec0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f2350009f20 tx=0x7f2350009840 comp rx=0 tx=0).stop 2023-10-14T19:11:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 -- 172.21.15.7:0/2391449149 shutdown_connections 2023-10-14T19:11:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236015a400 0x7f2360156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 --2- 172.21.15.7:0/2391449149 >> v2:172.21.15.148:3300/0 conn(0x7f23600cb5a0 0x7f23600cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 --2- 172.21.15.7:0/2391449149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23600cd9e0 0x7f2360159ec0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 -- 172.21.15.7:0/2391449149 >> 172.21.15.7:0/2391449149 conn(0x7f2360070e30 msgr2=0x7f23600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 -- 172.21.15.7:0/2391449149 shutdown_connections 2023-10-14T19:11:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.557+0000 7f2366de3700 1 -- 172.21.15.7:0/2391449149 wait complete. 2023-10-14T19:11:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.558+0000 7f2366de3700 1 Processor -- start 2023-10-14T19:11:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.558+0000 7f2366de3700 1 -- start start 2023-10-14T19:11:24.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23600cb5a0 0x7f2360151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23600cd9e0 0x7f236014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 0x7f236014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601512f0 con 0x7f236015a400 2023-10-14T19:11:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2360150410 con 0x7f23600cb5a0 2023-10-14T19:11:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23601506e0 con 0x7f23600cd9e0 2023-10-14T19:11:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 0x7f236014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 0x7f236014e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33406/0 (socket says 172.21.15.7:33406) 2023-10-14T19:11:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 -- 172.21.15.7:0/3170474114 learned_addr learned my addr 172.21.15.7:0/3170474114 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 -- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23600cd9e0 msgr2=0x7f236014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23600cd9e0 0x7f236014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 -- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23600cb5a0 msgr2=0x7f2360151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23600cb5a0 0x7f2360151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 -- 172.21.15.7:0/3170474114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009ae0 con 0x7f236015a400 2023-10-14T19:11:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2365380700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 0x7f236014e050 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f235800d890 tx=0x7f2358008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580125f0 con 0x7f236015a400 2023-10-14T19:11:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358012750 con 0x7f236015a400 2023-10-14T19:11:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23601509c0 con 0x7f236015a400 2023-10-14T19:11:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.559+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358012ad0 con 0x7f236015a400 2023-10-14T19:11:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.560+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2360150f80 con 0x7f236015a400 2023-10-14T19:11:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.561+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236004c3c0 con 0x7f236015a400 2023-10-14T19:11:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.561+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2358014430 con 0x7f236015a400 2023-10-14T19:11:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.561+0000 7f235cff9700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2340067350 0x7f2340069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.561+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2358084de0 con 0x7f236015a400 2023-10-14T19:11:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.562+0000 7f2364b7f700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2340067350 0x7f2340069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.562+0000 7f2364b7f700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2340067350 0x7f2340069800 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2348006fd0 tx=0x7f2348008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.566+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2358055610 con 0x7f236015a400 2023-10-14T19:11:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.803+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2360151430 con 0x7f236015a400 2023-10-14T19:11:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.803+0000 7f235cff9700 1 -- 172.21.15.7:0/3170474114 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f23580551a0 con 0x7f236015a400 2023-10-14T19:11:24.804 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:24.805 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":111,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:17.891546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2340067350 msgr2=0x7f2340069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2340067350 0x7f2340069800 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2348006fd0 tx=0x7f2348008040 comp rx=0 tx=0).stop 2023-10-14T19:11:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 msgr2=0x7f236014e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 0x7f236014e050 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f235800d890 tx=0x7f2358008040 comp rx=0 tx=0).stop 2023-10-14T19:11:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 shutdown_connections 2023-10-14T19:11:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2340067350 0x7f2340069800 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23600cb5a0 0x7f2360151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f236015a400 0x7f236014e050 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 --2- 172.21.15.7:0/3170474114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23600cd9e0 0x7f236014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 >> 172.21.15.7:0/3170474114 conn(0x7f2360070e30 msgr2=0x7f2360155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 shutdown_connections 2023-10-14T19:11:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:24.805+0000 7f2366de3700 1 -- 172.21.15.7:0/3170474114 wait complete. 2023-10-14T19:11:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 111 2023-10-14T19:11:25.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:11:14.275053+0000', 'modified': '2023-10-14T19:11:17.891546+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8250': {'gid': 8250, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/3325863759', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3325863759}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 3325863759}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:11:25.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:11:25.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T19:11:25.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.346+0000 7f43cc3cd700 1 Processor -- start 2023-10-14T19:11:25.347 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.346+0000 7f43cc3cd700 1 -- start start 2023-10-14T19:11:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.347+0000 7f43cc3cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f43c415a5d0 0x7f43c4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.347+0000 7f43cc3cd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c415ae40 con 0x7f43c40cb5a0 2023-10-14T19:11:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.347+0000 7f43cc3cd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c415ab60 con 0x7f43c40cb970 2023-10-14T19:11:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.347+0000 7f43cc3cd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40ce0f0 con 0x7f43c415a5d0 2023-10-14T19:11:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.347+0000 7f43ca169700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43c40cb5a0 0x7f43c40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42078/0 (socket says 172.21.15.7:42078) 2023-10-14T19:11:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.347+0000 7f43ca169700 1 -- 172.21.15.7:0/615131529 learned_addr learned my addr 172.21.15.7:0/615131529 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444080189 0 0) 0x7f43c415ae40 con 0x7f43c40cb5a0 2023-10-14T19:11:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac003570 con 0x7f43c40cb5a0 2023-10-14T19:11:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca96a700 1 --2- 172.21.15.7:0/615131529 >> v2:172.21.15.148:3300/0 conn(0x7f43c415a5d0 0x7f43c4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 352308731 0 0) 0x7f43ac003570 con 0x7f43c40cb5a0 2023-10-14T19:11:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 >> v2:172.21.15.148:3300/0 conn(0x7f43c415a5d0 msgr2=0x7f43c4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 --2- 172.21.15.7:0/615131529 >> v2:172.21.15.148:3300/0 conn(0x7f43c415a5d0 0x7f43c4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 >> v1:172.21.15.148:6789/0 conn(0x7f43c40cb970 legacy=0x7f43c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40ccf00 con 0x7f43c40cb5a0 2023-10-14T19:11:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f43bc001470 con 0x7f43c40cb5a0 2023-10-14T19:11:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 >> v1:172.21.15.7:6789/0 conn(0x7f43c40cb5a0 legacy=0x7f43c40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43ac003a60 0x7f43ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40ce0f0 con 0x7f43ac003a60 2023-10-14T19:11:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac00c0d0 con 0x7f43ac004810 2023-10-14T19:11:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac00c290 con 0x7f43ac0051c0 2023-10-14T19:11:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43ac003a60 0x7f43ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9968700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca96a700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 -- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac0051c0 msgr2=0x7f43ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 -- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ac004810 msgr2=0x7f43ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 -- 172.21.15.7:0/615131529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac003570 con 0x7f43ac003a60 2023-10-14T19:11:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43c9968700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca96a700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca96a700 1 -- 172.21.15.7:0/615131529 reap_dead start 2023-10-14T19:11:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.348+0000 7f43ca169700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43ac003a60 0x7f43ac003e70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c3c0 tx=0x7f43bc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff968290e655c938 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00cc90 con 0x7f43ac003a60 2023-10-14T19:11:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00cdf0 con 0x7f43ac003a60 2023-10-14T19:11:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43c9167700 1 -- 172.21.15.7:0/615131529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc005b50 con 0x7f43ac003a60 2023-10-14T19:11:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 -- 172.21.15.7:0/615131529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43ac003a60 msgr2=0x7f43ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43ac003a60 0x7f43ac003e70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c3c0 tx=0x7f43bc001e50 comp rx=0 tx=0).stop 2023-10-14T19:11:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 -- 172.21.15.7:0/615131529 shutdown_connections 2023-10-14T19:11:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/615131529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43ac003a60 0x7f43ac003e70 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 -- 172.21.15.7:0/615131529 >> 172.21.15.7:0/615131529 conn(0x7f43c4070e30 msgr2=0x7f43c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 -- 172.21.15.7:0/615131529 shutdown_connections 2023-10-14T19:11:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.349+0000 7f43cc3cd700 1 -- 172.21.15.7:0/615131529 wait complete. 2023-10-14T19:11:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.350+0000 7f43cc3cd700 1 Processor -- start 2023-10-14T19:11:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.350+0000 7f43cc3cd700 1 -- start start 2023-10-14T19:11:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43cc3cd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac003a60 0x7f43c40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43cc3cd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 0x7f43c41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43cc3cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c40ca560 0x7f43c415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43cc3cd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c9240 con 0x7f43c40b5bb0 2023-10-14T19:11:25.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43cc3cd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c94c0 con 0x7f43c40ca560 2023-10-14T19:11:25.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43cc3cd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c97a0 con 0x7f43ac003a60 2023-10-14T19:11:25.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 0x7f43c41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 0x7f43c41511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33436/0 (socket says 172.21.15.7:33436) 2023-10-14T19:11:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 -- 172.21.15.7:0/3926219861 learned_addr learned my addr 172.21.15.7:0/3926219861 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 -- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac003a60 msgr2=0x7f43c40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac003a60 0x7f43c40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 -- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c40ca560 msgr2=0x7f43c415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c40ca560 0x7f43c415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.351+0000 7f43c9968700 1 -- 172.21.15.7:0/3926219861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40c9a80 con 0x7f43c40b5bb0 2023-10-14T19:11:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.352+0000 7f43c9968700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 0x7f43c41511b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f43b8000c00 tx=0x7f43b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.352+0000 7f43c27fc700 1 -- 172.21.15.7:0/3926219861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8017070 con 0x7f43c40b5bb0 2023-10-14T19:11:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.352+0000 7f43c27fc700 1 -- 172.21.15.7:0/3926219861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8006820 con 0x7f43c40b5bb0 2023-10-14T19:11:25.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.352+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c40c9d60 con 0x7f43c40b5bb0 2023-10-14T19:11:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.352+0000 7f43c27fc700 1 -- 172.21.15.7:0/3926219861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8006bc0 con 0x7f43c40b5bb0 2023-10-14T19:11:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.352+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c41516f0 con 0x7f43c40b5bb0 2023-10-14T19:11:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.353+0000 7f43c27fc700 1 -- 172.21.15.7:0/3926219861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f43b8007020 con 0x7f43c40b5bb0 2023-10-14T19:11:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.354+0000 7f43c27fc700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43b0067320 0x7f43b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.354+0000 7f43c27fc700 1 -- 172.21.15.7:0/3926219861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43b8084860 con 0x7f43c40b5bb0 2023-10-14T19:11:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.354+0000 7f43ca169700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43b0067320 0x7f43b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.354+0000 7f43ca169700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43b0067320 0x7f43b00697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c3c0 tx=0x7f43bc015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 Processor -- start 2023-10-14T19:11:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 -- start start 2023-10-14T19:11:25.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d326e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d370d00 0x55d67d34fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d322cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d27da70 con 0x55d67d326a50 2023-10-14T19:11:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d27b270 con 0x55d67d370d00 2023-10-14T19:11:25.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67d277060 con 0x55d67d34ff60 2023-10-14T19:11:25.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.356+0000 7f43ca169700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d326e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d326e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33440/0 (socket says 172.21.15.7:33440) 2023-10-14T19:11:25.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 -- 172.21.15.7:0/2137507859 learned_addr learned my addr 172.21.15.7:0/2137507859 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:25.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca96a700 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d322cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.375 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43c9968700 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d370d00 0x55d67d34fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 -- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 msgr2=0x55d67d322cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d322cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 -- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d370d00 msgr2=0x55d67d34fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d370d00 0x55d67d34fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 -- 172.21.15.7:0/2137507859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d67d111270 con 0x55d67d326a50 2023-10-14T19:11:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ca169700 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d326e20 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00cc90 tx=0x7f43bc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9647cb0a2da9763b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ab7fe700 1 -- 172.21.15.7:0/2137507859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc026070 con 0x55d67d326a50 2023-10-14T19:11:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ab7fe700 1 -- 172.21.15.7:0/2137507859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc007b90 con 0x55d67d326a50 2023-10-14T19:11:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.357+0000 7f43ab7fe700 1 -- 172.21.15.7:0/2137507859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc001470 con 0x55d67d326a50 2023-10-14T19:11:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 -- 172.21.15.7:0/2137507859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 msgr2=0x55d67d326e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d326e20 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00cc90 tx=0x7f43bc01d000 comp rx=0 tx=0).stop 2023-10-14T19:11:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 -- 172.21.15.7:0/2137507859 shutdown_connections 2023-10-14T19:11:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d322cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d326e20 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/2137507859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d370d00 0x55d67d34fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 -- 172.21.15.7:0/2137507859 >> 172.21.15.7:0/2137507859 conn(0x55d67d328370 msgr2=0x55d67d328740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 -- 172.21.15.7:0/2137507859 shutdown_connections 2023-10-14T19:11:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 -- 172.21.15.7:0/2137507859 wait complete. 2023-10-14T19:11:25.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.358+0000 7f43d56c6b80 1 -- start start 2023-10-14T19:11:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 Processor -- start 2023-10-14T19:11:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d365fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 0x55d67d365530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d222890 con 0x55d67d370d00 2023-10-14T19:11:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d23dea0 con 0x55d67d326a50 2023-10-14T19:11:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.359+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67d0f9e30 con 0x55d67d34ff60 2023-10-14T19:11:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43d56c6b80 10 client.0 _ll_register_callbacks cb 0x55d67d2ea110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:11:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 0x55d67d365530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 0x55d67d365530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33452/0 (socket says 172.21.15.7:33452) 2023-10-14T19:11:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 -- 172.21.15.7:0/4113797307 learned_addr learned my addr 172.21.15.7:0/4113797307 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca169700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43c9968700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d365fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 -- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 msgr2=0x55d67d365fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d365fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 -- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 msgr2=0x55d67d37d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 -- 172.21.15.7:0/4113797307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac003570 con 0x55d67d370d00 2023-10-14T19:11:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43ca96a700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 0x55d67d365530 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f43c4064ad0 tx=0x7f43b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d659d9abf05f5c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:11:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43a8ff9700 1 -- 172.21.15.7:0/4113797307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400e050 con 0x55d67d370d00 2023-10-14T19:11:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43a8ff9700 1 -- 172.21.15.7:0/4113797307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43b4016710 con 0x55d67d370d00 2023-10-14T19:11:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d67d31bb70 con 0x55d67d370d00 2023-10-14T19:11:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43a8ff9700 1 -- 172.21.15.7:0/4113797307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b4016ae0 con 0x55d67d370d00 2023-10-14T19:11:25.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43d56c6b80 10 client.8409 fetch_fsmap learned FSMap version 111 2023-10-14T19:11:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.360+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55d67d0b3fe0 con 0x55d67d370d00 2023-10-14T19:11:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43a8ff9700 1 -- 172.21.15.7:0/4113797307 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d67d31bb70 con 0x55d67d370d00 2023-10-14T19:11:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43a8ff9700 1 -- 172.21.15.7:0/4113797307 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 111) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f43b4016c40 con 0x55d67d370d00 2023-10-14T19:11:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43d56c6b80 10 client.8409 fetch_fsmap finished waiting for FSMap version 111 2023-10-14T19:11:25.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43d56c6b80 10 client.8409 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T19:11:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43d56c6b80 20 client.8409 populate_metadata read hostname 'smithi007' 2023-10-14T19:11:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d356340 0x55d67d380760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43d56c6b80 4 client.8409 mds_command: new command op to 8250 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:11:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 --> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d67d2f8aa0 con 0x55d67d356340 2023-10-14T19:11:25.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43ca169700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d356340 0x55d67d380760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43a8ff9700 10 client.8409 ms_handle_connect on v2:172.21.15.7:6834/3325863759 2023-10-14T19:11:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.361+0000 7f43ca169700 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d356340 0x55d67d380760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363c4f948a28b95b server_cookie=de59e44d45d31b78 in_seq=0 out_seq=0 2023-10-14T19:11:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43a8ff9700 1 -- 172.21.15.7:0/4113797307 <== mds.0 v2:172.21.15.7:6834/3325863759 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d67d2f8aa0 con 0x55d67d356340 2023-10-14T19:11:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43a8ff9700 10 client.8409 handle_command_reply: tid=0 2023-10-14T19:11:25.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 client.8409 shutdown 2023-10-14T19:11:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 msgr2=0x55d67d365530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 0x55d67d365530 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f43c4064ad0 tx=0x7f43b400b040 comp rx=0 tx=0).stop 2023-10-14T19:11:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 shutdown_connections 2023-10-14T19:11:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d356340 0x55d67d380760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43a8ff9700 0 client.8409 ms_handle_reset on v2:172.21.15.7:6834/3325863759 2023-10-14T19:11:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d370d00 0x55d67d365530 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/4113797307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d365fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 >> 172.21.15.7:0/4113797307 conn(0x55d67d328370 msgr2=0x55d67d36c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 shutdown_connections 2023-10-14T19:11:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.362+0000 7f43d56c6b80 1 -- 172.21.15.7:0/4113797307 wait complete. 2023-10-14T19:11:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.363+0000 7f43d56c6b80 20 client.8409 trim_cache size 0 max 16384 2023-10-14T19:11:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 Processor -- start 2023-10-14T19:11:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 -- start start 2023-10-14T19:11:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 0x55d67d31f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d326ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d353580 con 0x55d67d328370 2023-10-14T19:11:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d326370 con 0x55d67d326a50 2023-10-14T19:11:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67d3294e0 con 0x55d67d34ff60 2023-10-14T19:11:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43ca169700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 0x55d67d31f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43ca169700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 0x55d67d31f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33460/0 (socket says 172.21.15.7:33460) 2023-10-14T19:11:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.380+0000 7f43ca169700 1 -- 172.21.15.7:0/1097600084 learned_addr learned my addr 172.21.15.7:0/1097600084 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43ca169700 1 -- 172.21.15.7:0/1097600084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 msgr2=0x55d67d326ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43ca169700 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d326ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43ca169700 1 -- 172.21.15.7:0/1097600084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 msgr2=0x55d67d37a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43ca169700 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43ca169700 1 -- 172.21.15.7:0/1097600084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d67d245780 con 0x55d67d328370 2023-10-14T19:11:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43ca169700 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 0x55d67d31f4b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f43bc001d60 tx=0x7f43bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d30496e65898781 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43abfff700 1 -- 172.21.15.7:0/1097600084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc026020 con 0x55d67d328370 2023-10-14T19:11:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43abfff700 1 -- 172.21.15.7:0/1097600084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc0013b0 con 0x55d67d328370 2023-10-14T19:11:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43abfff700 1 -- 172.21.15.7:0/1097600084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc001540 con 0x55d67d328370 2023-10-14T19:11:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 -- 172.21.15.7:0/1097600084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 msgr2=0x55d67d31f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 0x55d67d31f4b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f43bc001d60 tx=0x7f43bc012000 comp rx=0 tx=0).stop 2023-10-14T19:11:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 -- 172.21.15.7:0/1097600084 shutdown_connections 2023-10-14T19:11:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d326ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d328370 0x55d67d31f4b0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/1097600084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d326a50 0x55d67d37a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.381+0000 7f43d56c6b80 1 -- 172.21.15.7:0/1097600084 >> 172.21.15.7:0/1097600084 conn(0x55d67d325fa0 msgr2=0x55d67d3681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.382+0000 7f43d56c6b80 1 -- 172.21.15.7:0/1097600084 shutdown_connections 2023-10-14T19:11:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.382+0000 7f43d56c6b80 1 -- 172.21.15.7:0/1097600084 wait complete. 2023-10-14T19:11:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.382+0000 7f43d56c6b80 1 -- start start 2023-10-14T19:11:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.382+0000 7f43d56c6b80 1 Processor -- start 2023-10-14T19:11:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d34c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d328370 0x55d67d3ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d370230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d31f9c0 con 0x55d67d326a50 2023-10-14T19:11:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67d3cd0a0 con 0x55d67d328370 2023-10-14T19:11:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67d34d170 con 0x55d67d34ff60 2023-10-14T19:11:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43d56c6b80 10 client.0 _ll_register_callbacks cb 0x55d67d2ea110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:11:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d34c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d34c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33474/0 (socket says 172.21.15.7:33474) 2023-10-14T19:11:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 -- 172.21.15.7:0/3341618385 learned_addr learned my addr 172.21.15.7:0/3341618385 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:25.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43c9968700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d328370 0x55d67d3ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca96a700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d370230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 -- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 msgr2=0x55d67d370230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d370230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 -- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d328370 msgr2=0x55d67d3ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d328370 0x55d67d3ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca169700 1 -- 172.21.15.7:0/3341618385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc02e040 con 0x55d67d326a50 2023-10-14T19:11:25.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.383+0000 7f43ca96a700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d370230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:25.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43ca169700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d34c870 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f43bc02d040 tx=0x7f43bc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4452900dffbd155 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:11:25.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43a8ff9700 1 -- 172.21.15.7:0/3341618385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc026040 con 0x55d67d326a50 2023-10-14T19:11:25.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43a8ff9700 1 -- 172.21.15.7:0/3341618385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43bc037c00 con 0x55d67d326a50 2023-10-14T19:11:25.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43bc007b90 con 0x55d67d326a50 2023-10-14T19:11:25.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43a8ff9700 1 -- 172.21.15.7:0/3341618385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43bc007490 con 0x55d67d326a50 2023-10-14T19:11:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 10 client.8415 fetch_fsmap learned FSMap version 111 2023-10-14T19:11:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55d67d22c470 con 0x55d67d326a50 2023-10-14T19:11:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43a8ff9700 1 -- 172.21.15.7:0/3341618385 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc007b90 con 0x55d67d326a50 2023-10-14T19:11:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43a8ff9700 1 -- 172.21.15.7:0/3341618385 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 111) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f43bc0075f0 con 0x55d67d326a50 2023-10-14T19:11:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 10 client.8415 fetch_fsmap finished waiting for FSMap version 111 2023-10-14T19:11:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 10 client.8415 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T19:11:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 20 client.8415 populate_metadata read hostname 'smithi007' 2023-10-14T19:11:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d370d00 0x55d67d3710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 4 client.8415 mds_command: new command op to 8250 tid=0[{"prefix": "status"}] 2023-10-14T19:11:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 --> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d67d219e00 con 0x55d67d370d00 2023-10-14T19:11:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.384+0000 7f43c9968700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d370d00 0x55d67d3710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43a8ff9700 10 client.8415 ms_handle_connect on v2:172.21.15.7:6834/3325863759 2023-10-14T19:11:25.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43c9968700 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d370d00 0x55d67d3710d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c4178804b9705b1 server_cookie=6e95f3f0b32e4eb2 in_seq=0 out_seq=0 2023-10-14T19:11:25.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43a8ff9700 1 -- 172.21.15.7:0/3341618385 <== mds.0 v2:172.21.15.7:6834/3325863759 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55d67d219e00 con 0x55d67d370d00 2023-10-14T19:11:25.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43a8ff9700 10 client.8415 handle_command_reply: tid=0 2023-10-14T19:11:25.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 client.8415 shutdown 2023-10-14T19:11:25.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 msgr2=0x55d67d34c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d34c870 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f43bc02d040 tx=0x7f43bc032000 comp rx=0 tx=0).stop 2023-10-14T19:11:25.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 shutdown_connections 2023-10-14T19:11:25.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:6834/3325863759,v1:172.21.15.7:6835/3325863759] conn(0x55d67d370d00 0x55d67d3710d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d67d34ff60 0x55d67d370230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d67d326a50 0x55d67d34c870 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43a8ff9700 0 client.8415 ms_handle_reset on v2:172.21.15.7:6834/3325863759 2023-10-14T19:11:25.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 --2- 172.21.15.7:0/3341618385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d67d328370 0x55d67d3ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 >> 172.21.15.7:0/3341618385 conn(0x55d67d325fa0 msgr2=0x55d67d3681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 shutdown_connections 2023-10-14T19:11:25.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 1 -- 172.21.15.7:0/3341618385 wait complete. 2023-10-14T19:11:25.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.385+0000 7f43d56c6b80 20 client.8415 trim_cache size 0 max 16384 2023-10-14T19:11:25.412 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:11:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:11:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:11:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8250, 2023-10-14T19:11:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:11:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:11:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:11:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 10.499506232, 2023-10-14T19:11:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 111, 2023-10-14T19:11:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 165, 2023-10-14T19:11:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 165, 2023-10-14T19:11:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 16.026419086000001 2023-10-14T19:11:25.415 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:11:25.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43b0067320 msgr2=0x7f43b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43b0067320 0x7f43b00697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c3c0 tx=0x7f43bc015000 comp rx=0 tx=0).stop 2023-10-14T19:11:25.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 msgr2=0x7f43c41511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 0x7f43c41511b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f43b8000c00 tx=0x7f43b8009040 comp rx=0 tx=0).stop 2023-10-14T19:11:25.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 shutdown_connections 2023-10-14T19:11:25.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f43b0067320 0x7f43b00697d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43c40ca560 0x7f43c415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43ac003a60 0x7f43c40c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 --2- 172.21.15.7:0/3926219861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c40b5bb0 0x7f43c41511b0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 >> 172.21.15.7:0/3926219861 conn(0x7f43c4070e30 msgr2=0x7f43c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 shutdown_connections 2023-10-14T19:11:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.386+0000 7f43cc3cd700 1 -- 172.21.15.7:0/3926219861 wait complete. 2023-10-14T19:11:25.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:11:25.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.538+0000 7efd877fb700 1 Processor -- start 2023-10-14T19:11:25.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.538+0000 7efd877fb700 1 -- start start 2023-10-14T19:11:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd877fb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd800cb970 0x7efd80159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd877fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd80156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd877fb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8015ae40 con 0x7efd800cb5a0 2023-10-14T19:11:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd877fb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800ce0f0 con 0x7efd800cb970 2023-10-14T19:11:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd877fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800d13f0 con 0x7efd8015a400 2023-10-14T19:11:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd85597700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efd800cb5a0 0x7efd800cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42084/0 (socket says 172.21.15.7:42084) 2023-10-14T19:11:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd85597700 1 -- 172.21.15.7:0/2536661413 learned_addr learned my addr 172.21.15.7:0/2536661413 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd84d96700 1 --2- 172.21.15.7:0/2536661413 >> v2:172.21.15.148:3300/0 conn(0x7efd800cb970 0x7efd80159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd85d98700 1 --2- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd80156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.539+0000 7efd7ffff700 1 -- 172.21.15.7:0/2536661413 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552324303 0 0) 0x7efd8015ae40 con 0x7efd800cb5a0 2023-10-14T19:11:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd7ffff700 1 -- 172.21.15.7:0/2536661413 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd68003570 con 0x7efd800cb5a0 2023-10-14T19:11:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd84d96700 1 -- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 msgr2=0x7efd80156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd84d96700 1 --2- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd80156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd84d96700 1 -- 172.21.15.7:0/2536661413 >> v1:172.21.15.7:6789/0 conn(0x7efd800cb5a0 legacy=0x7efd800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd84d96700 1 -- 172.21.15.7:0/2536661413 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8015ab60 con 0x7efd800cb970 2023-10-14T19:11:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd84d96700 1 --2- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd80159ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efd740098e0 tx=0x7efd740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a904c9ee4f238b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd7ffff700 1 -- 172.21.15.7:0/2536661413 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74011630 con 0x7efd800cb970 2023-10-14T19:11:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd7ffff700 1 -- 172.21.15.7:0/2536661413 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74011790 con 0x7efd800cb970 2023-10-14T19:11:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.540+0000 7efd7ffff700 1 -- 172.21.15.7:0/2536661413 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74011b30 con 0x7efd800cb970 2023-10-14T19:11:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 -- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 msgr2=0x7efd80159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 --2- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd80159ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efd740098e0 tx=0x7efd740091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 -- 172.21.15.7:0/2536661413 shutdown_connections 2023-10-14T19:11:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 --2- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd80156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 --2- 172.21.15.7:0/2536661413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd80159ec0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 -- 172.21.15.7:0/2536661413 >> 172.21.15.7:0/2536661413 conn(0x7efd80070e30 msgr2=0x7efd800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 -- 172.21.15.7:0/2536661413 shutdown_connections 2023-10-14T19:11:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.541+0000 7efd877fb700 1 -- 172.21.15.7:0/2536661413 wait complete. 2023-10-14T19:11:25.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.542+0000 7efd877fb700 1 Processor -- start 2023-10-14T19:11:25.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.542+0000 7efd877fb700 1 -- start start 2023-10-14T19:11:25.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd877fb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 0x7efd80158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd877fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd800b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd877fb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd800b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd877fb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800af8d0 con 0x7efd800cb5a0 2023-10-14T19:11:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd877fb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80158eb0 con 0x7efd800cb970 2023-10-14T19:11:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd877fb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd80159190 con 0x7efd8015a400 2023-10-14T19:11:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 0x7efd80158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 0x7efd80158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33480/0 (socket says 172.21.15.7:33480) 2023-10-14T19:11:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 -- 172.21.15.7:0/2008956813 learned_addr learned my addr 172.21.15.7:0/2008956813 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd84d96700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd800b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85d98700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd800b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 -- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 msgr2=0x7efd800b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd800b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 -- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 msgr2=0x7efd800b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd800b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 -- 172.21.15.7:0/2008956813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74009420 con 0x7efd800cb5a0 2023-10-14T19:11:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd85597700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 0x7efd80158660 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c7c0 tx=0x7efd78007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78005b30 con 0x7efd800cb5a0 2023-10-14T19:11:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.543+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78005c90 con 0x7efd800cb5a0 2023-10-14T19:11:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.544+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78007340 con 0x7efd800cb5a0 2023-10-14T19:11:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.544+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd80159470 con 0x7efd800cb5a0 2023-10-14T19:11:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.544+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80159a30 con 0x7efd800cb5a0 2023-10-14T19:11:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.544+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd800b1400 con 0x7efd800cb5a0 2023-10-14T19:11:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.545+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efd7801b400 con 0x7efd800cb5a0 2023-10-14T19:11:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.545+0000 7efd7d7fa700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd6c067320 0x7efd6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.545+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd78084800 con 0x7efd800cb5a0 2023-10-14T19:11:25.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.546+0000 7efd84d96700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd6c067320 0x7efd6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:25.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.546+0000 7efd84d96700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd6c067320 0x7efd6c0697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efd800afbf0 tx=0x7efd74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:25.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.550+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd780514d0 con 0x7efd800cb5a0 2023-10-14T19:11:25.787 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.786+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd80159c50 con 0x7efd800cb5a0 2023-10-14T19:11:25.788 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.787+0000 7efd7d7fa700 1 -- 172.21.15.7:0/2008956813 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v111) v1 ==== 53+0+73 (secure 0 0 0) 0x7efd78054af0 con 0x7efd800cb5a0 2023-10-14T19:11:25.788 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:11:25.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd6c067320 msgr2=0x7efd6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd6c067320 0x7efd6c0697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efd800afbf0 tx=0x7efd74017000 comp rx=0 tx=0).stop 2023-10-14T19:11:25.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 msgr2=0x7efd80158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:25.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 0x7efd80158660 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c7c0 tx=0x7efd78007e00 comp rx=0 tx=0).stop 2023-10-14T19:11:25.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 shutdown_connections 2023-10-14T19:11:25.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd6c067320 0x7efd6c0697d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8015a400 0x7efd800b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd800cb5a0 0x7efd80158660 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 --2- 172.21.15.7:0/2008956813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800cb970 0x7efd800b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 >> 172.21.15.7:0/2008956813 conn(0x7efd80070e30 msgr2=0x7efd800d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 shutdown_connections 2023-10-14T19:11:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:25.789+0000 7efd877fb700 1 -- 172.21.15.7:0/2008956813 wait complete. 2023-10-14T19:11:25.802 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:11:25.802 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:11:25.803 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:11:25.803 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:11:25.803 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:25.804 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:11:25.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:11:25.804 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:11:25.805 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:11:25.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:25.805 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:11:25.822 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:11:25.822 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:11:25.822 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:11:25.823 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.823 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:11:25.823 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.823 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:25.823 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:25.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:11:25.824 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:25.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:25.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:11:25.825 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:11:25.825 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:25.825 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:11:25.825 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:11:25.825 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 41968sec preferred_lft 41968sec 2023-10-14T19:11:25.826 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:11:25.826 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.826 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:25.826 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:25.827 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:11:25.827 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:11:25.827 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:25.827 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:11:25.827 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.828 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:11:25.828 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.828 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:25.828 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:11:25.828 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:11:25.829 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.829 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:25.829 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:11:25.829 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:11:25.829 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:25.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:25.830 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:11:25.886 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:11:25.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:25.889 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:11:25.945 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:11:25.945 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:11:25.945 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:11:25.945 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:11:25.946 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:11:25.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:25.947 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:11:25.947 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:11:25.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:11:25.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:11:25.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:11:25.948 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:11:26.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.048 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:11:26.063 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:11:26.064 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:11:26.064 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:11:26.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:11:26.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:26.129 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:26.184 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:11:26.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:26.185 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:26.239 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:11:26.240 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:11:26.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:11:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:11:26.341 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:26.342 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:11:26.342 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:11:26.342 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:26.342 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:26.364 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:26.364 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:11:26.364 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:11:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:11:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:11:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:11:26.367 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:11:26.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:26.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:11:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.552+0000 7f92432ed700 1 Processor -- start 2023-10-14T19:11:26.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.552+0000 7f92432ed700 1 -- start start 2023-10-14T19:11:26.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f92432ed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb970 0x7f923c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:26.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f92432ed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f923c15a400 0x7f923c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:26.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f92432ed700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c15ae40 con 0x7f923c0cb5a0 2023-10-14T19:11:26.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f92432ed700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0ce0f0 con 0x7f923c15a400 2023-10-14T19:11:26.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f92432ed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0cbde0 con 0x7f923c0cb970 2023-10-14T19:11:26.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f924188a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f923c15a400 0x7f923c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:26.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f9241089700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f923c0cb5a0 0x7f923c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42096/0 (socket says 172.21.15.7:42096) 2023-10-14T19:11:26.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f9241089700 1 -- 172.21.15.7:0/579666080 learned_addr learned my addr 172.21.15.7:0/579666080 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:26.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f9240888700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb970 0x7f923c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:26.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f924188a700 1 -- 172.21.15.7:0/579666080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb970 msgr2=0x7f923c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:26.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f924188a700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb970 0x7f923c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f924188a700 1 -- 172.21.15.7:0/579666080 >> v1:172.21.15.7:6789/0 conn(0x7f923c0cb5a0 legacy=0x7f923c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:26.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f924188a700 1 -- 172.21.15.7:0/579666080 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c15ab60 con 0x7f923c15a400 2023-10-14T19:11:26.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f923bfff700 1 -- 172.21.15.7:0/579666080 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715362528 0 0) 0x7f923c15ae40 con 0x7f923c0cb5a0 2023-10-14T19:11:26.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f9240888700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb970 0x7f923c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:26.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f924188a700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c156e90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9234009e90 tx=0x7f9234009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301569955b38ba56 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:26.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.553+0000 7f923bfff700 1 -- 172.21.15.7:0/579666080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400e070 con 0x7f923c15a400 2023-10-14T19:11:26.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f923bfff700 1 -- 172.21.15.7:0/579666080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923400bbf0 con 0x7f923c15a400 2023-10-14T19:11:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f923bfff700 1 -- 172.21.15.7:0/579666080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234012430 con 0x7f923c15a400 2023-10-14T19:11:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 -- 172.21.15.7:0/579666080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 msgr2=0x7f923c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c156e90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9234009e90 tx=0x7f9234009780 comp rx=0 tx=0).stop 2023-10-14T19:11:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 -- 172.21.15.7:0/579666080 shutdown_connections 2023-10-14T19:11:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c156e90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 --2- 172.21.15.7:0/579666080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb970 0x7f923c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 -- 172.21.15.7:0/579666080 >> 172.21.15.7:0/579666080 conn(0x7f923c070e30 msgr2=0x7f923c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 -- 172.21.15.7:0/579666080 shutdown_connections 2023-10-14T19:11:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.554+0000 7f92432ed700 1 -- 172.21.15.7:0/579666080 wait complete. 2023-10-14T19:11:26.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.555+0000 7f92432ed700 1 Processor -- start 2023-10-14T19:11:26.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.555+0000 7f92432ed700 1 -- start start 2023-10-14T19:11:26.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f92432ed700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb5a0 0x7f923c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:26.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f92432ed700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f923c0cb970 0x7f923c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f92432ed700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f92432ed700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c152790 con 0x7f923c15a400 2023-10-14T19:11:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f92432ed700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0b42d0 con 0x7f923c0cb970 2023-10-14T19:11:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f92432ed700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c15dca0 con 0x7f923c0cb5a0 2023-10-14T19:11:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f924188a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f924188a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c0c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33502/0 (socket says 172.21.15.7:33502) 2023-10-14T19:11:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f924188a700 1 -- 172.21.15.7:0/2723516812 learned_addr learned my addr 172.21.15.7:0/2723516812 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f9241089700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb5a0 0x7f923c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.556+0000 7f9240888700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f923c0cb970 0x7f923c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f924188a700 1 -- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb5a0 msgr2=0x7f923c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f924188a700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb5a0 0x7f923c0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f924188a700 1 -- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f923c0cb970 msgr2=0x7f923c152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f924188a700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f923c0cb970 0x7f923c152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f924188a700 1 -- 172.21.15.7:0/2723516812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234009a20 con 0x7f923c15a400 2023-10-14T19:11:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f9240888700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f923c0cb970 0x7f923c152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f924188a700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c0c7cc0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f923400b880 tx=0x7f9234019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923401b420 con 0x7f923c15a400 2023-10-14T19:11:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923401b5c0 con 0x7f923c15a400 2023-10-14T19:11:26.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c15df80 con 0x7f923c15a400 2023-10-14T19:11:26.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923401b980 con 0x7f923c15a400 2023-10-14T19:11:26.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.557+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c0b3f60 con 0x7f923c15a400 2023-10-14T19:11:26.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.558+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c04c3c0 con 0x7f923c15a400 2023-10-14T19:11:26.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.559+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f923401c400 con 0x7f923c15a400 2023-10-14T19:11:26.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.559+0000 7f92397fa700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9228067320 0x7f92280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:26.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.559+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9234086bb0 con 0x7f923c15a400 2023-10-14T19:11:26.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.559+0000 7f9241089700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9228067320 0x7f92280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:26.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.560+0000 7f9241089700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9228067320 0x7f92280697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f922c007160 tx=0x7f922c007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:26.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.563+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9234053730 con 0x7f923c15a400 2023-10-14T19:11:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.800+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f923c0b4410 con 0x7f923c15a400 2023-10-14T19:11:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.801+0000 7f92397fa700 1 -- 172.21.15.7:0/2723516812 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v111) v1 ==== 53+0+73 (secure 0 0 0) 0x7f923402a060 con 0x7f923c15a400 2023-10-14T19:11:26.802 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:11:26.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.802+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9228067320 msgr2=0x7f92280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:26.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.802+0000 7f92432ed700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9228067320 0x7f92280697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f922c007160 tx=0x7f922c007f50 comp rx=0 tx=0).stop 2023-10-14T19:11:26.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.802+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 msgr2=0x7f923c0c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:26.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.802+0000 7f92432ed700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c0c7cc0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f923400b880 tx=0x7f9234019000 comp rx=0 tx=0).stop 2023-10-14T19:11:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 shutdown_connections 2023-10-14T19:11:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9228067320 0x7f92280697d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923c15a400 0x7f923c0c7cc0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f923c0cb5a0 0x7f923c0b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 --2- 172.21.15.7:0/2723516812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f923c0cb970 0x7f923c152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 >> 172.21.15.7:0/2723516812 conn(0x7f923c070e30 msgr2=0x7f923c0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 shutdown_connections 2023-10-14T19:11:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:26.803+0000 7f92432ed700 1 -- 172.21.15.7:0/2723516812 wait complete. 2023-10-14T19:11:26.815 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:11:26.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:11:26.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:11:26.817 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:11:26.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:26.817 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:11:26.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:11:26.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:11:26.819 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:11:26.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.819 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:11:26.838 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:11:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:11:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:11:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:11:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.839 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:11:26.840 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:11:26.840 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:26.841 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:11:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:11:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41977sec preferred_lft 41977sec 2023-10-14T19:11:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:11:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.842 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:11:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:11:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:11:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.843 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:11:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:11:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.844 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:11:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:11:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:26.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.845 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:11:26.906 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:11:26.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.908 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:11:26.966 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:11:26.967 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:11:26.967 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:11:26.967 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:11:26.967 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:11:26.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:26.968 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:11:26.969 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:11:26.969 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:11:26.969 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:11:26.970 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:11:26.970 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:11:27.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:27.072 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:11:27.088 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:11:27.088 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:11:27.089 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:11:27.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:27.089 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:11:27.154 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:27.154 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:27.209 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:11:27.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:27.210 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:27.264 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:11:27.264 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:11:27.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:27.344 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:27.344 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:11:27.344 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:11:27.352 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:27.352 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:11:27.352 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:11:27.353 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:27.353 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:27.375 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:27.375 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:11:27.375 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:11:27.375 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:27.376 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:27.376 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:11:27.376 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:11:27.376 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:11:27.377 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:11:27.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:27.378 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:27.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:11:27.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.575+0000 7fcb13393700 1 Processor -- start 2023-10-14T19:11:27.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.575+0000 7fcb13393700 1 -- start start 2023-10-14T19:11:27.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb13393700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb0c0a8aa0 0x7fcb0c0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:27.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb13393700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c088400 0x7fcb0c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:27.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb13393700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c0ce1c0 con 0x7fcb0c0ae6f0 2023-10-14T19:11:27.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb13393700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c0cd5b0 con 0x7fcb0c0a8aa0 2023-10-14T19:11:27.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb13393700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0cd890 con 0x7fcb0c088400 2023-10-14T19:11:27.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb1112f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb0c0a8aa0 0x7fcb0c0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:27.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb1112f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb0c0a8aa0 0x7fcb0c0a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58548/0 (socket says 172.21.15.7:58548) 2023-10-14T19:11:27.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb11930700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb0c0ae6f0 0x7fcb0c0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55290/0 (socket says 172.21.15.7:55290) 2023-10-14T19:11:27.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.576+0000 7fcb1112f700 1 -- 172.21.15.7:0/3248835928 learned_addr learned my addr 172.21.15.7:0/3248835928 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:27.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb1092e700 1 --2- 172.21.15.7:0/3248835928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c088400 0x7fcb0c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:27.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb1112f700 1 -- 172.21.15.7:0/3248835928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c088400 msgr2=0x7fcb0c0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:27.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb1112f700 1 --2- 172.21.15.7:0/3248835928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c088400 0x7fcb0c0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb1112f700 1 -- 172.21.15.7:0/3248835928 >> v1:172.21.15.7:6789/0 conn(0x7fcb0c0ae6f0 legacy=0x7fcb0c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:27.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb1112f700 1 -- 172.21.15.7:0/3248835928 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0cdb70 con 0x7fcb0c0a8aa0 2023-10-14T19:11:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb1112f700 1 --2- 172.21.15.7:0/3248835928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0a8e70 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009f70 tx=0x7fcb08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f455223432002b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb03fff700 1 -- 172.21.15.7:0/3248835928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800e070 con 0x7fcb0c0a8aa0 2023-10-14T19:11:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb03fff700 1 -- 172.21.15.7:0/3248835928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0800bad0 con 0x7fcb0c0a8aa0 2023-10-14T19:11:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.577+0000 7fcb03fff700 1 -- 172.21.15.7:0/3248835928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080092e0 con 0x7fcb0c0a8aa0 2023-10-14T19:11:27.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 -- 172.21.15.7:0/3248835928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0a8aa0 msgr2=0x7fcb0c0a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:27.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 --2- 172.21.15.7:0/3248835928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0a8e70 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009f70 tx=0x7fcb08009840 comp rx=0 tx=0).stop 2023-10-14T19:11:27.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 -- 172.21.15.7:0/3248835928 shutdown_connections 2023-10-14T19:11:27.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 --2- 172.21.15.7:0/3248835928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0a8e70 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 --2- 172.21.15.7:0/3248835928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c088400 0x7fcb0c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 -- 172.21.15.7:0/3248835928 >> 172.21.15.7:0/3248835928 conn(0x7fcb0c088000 msgr2=0x7fcb0c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:27.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 -- 172.21.15.7:0/3248835928 shutdown_connections 2023-10-14T19:11:27.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.578+0000 7fcb13393700 1 -- 172.21.15.7:0/3248835928 wait complete. 2023-10-14T19:11:27.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.579+0000 7fcb13393700 1 Processor -- start 2023-10-14T19:11:27.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.579+0000 7fcb13393700 1 -- start start 2023-10-14T19:11:27.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb13393700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:27.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb13393700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c0ae6f0 0x7fcb0c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:27.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb13393700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 0x7fcb0c09b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:27.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb13393700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c099e10 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb13393700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0ca0f0 con 0x7fcb0c0a8aa0 2023-10-14T19:11:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb13393700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c150bf0 con 0x7fcb0c0ae6f0 2023-10-14T19:11:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 0x7fcb0c09b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 0x7fcb0c09b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58564/0 (socket says 172.21.15.7:58564) 2023-10-14T19:11:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 -- 172.21.15.7:0/1243793658 learned_addr learned my addr 172.21.15.7:0/1243793658 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb1092e700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c0ae6f0 0x7fcb0c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb1112f700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 -- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c0ae6f0 msgr2=0x7fcb0c1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c0ae6f0 0x7fcb0c1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 -- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb0c0a8aa0 msgr2=0x7fcb0c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.580+0000 7fcb11930700 1 -- 172.21.15.7:0/1243793658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08009ae0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.581+0000 7fcb11930700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 0x7fcb0c09b4e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c590 tx=0x7fcb04007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.581+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04005a70 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.592 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.581+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04005bf0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.581+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c0c8b10 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.581+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040070d0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.581+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c0c90d0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.582+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c04c3c0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.593 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.582+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb040074c0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.583+0000 7fcb017fa700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaf0067320 0x7fcaf00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:27.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.583+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb04083fc0 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.583+0000 7fcb1112f700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaf0067320 0x7fcaf00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:27.594 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.583+0000 7fcb1112f700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaf0067320 0x7fcaf00697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009880 tx=0x7fcb08018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:27.595 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.587+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb04050c50 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.827+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb0c067b20 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.927+0000 7fcb017fa700 1 -- 172.21.15.7:0/1243793658 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v112) v1 ==== 136+0+0 (secure 0 0 0) 0x7fcb04017020 con 0x7fcb0c0c7da0 2023-10-14T19:11:27.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaf0067320 msgr2=0x7fcaf00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:27.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaf0067320 0x7fcaf00697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009880 tx=0x7fcb08018000 comp rx=0 tx=0).stop 2023-10-14T19:11:27.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 msgr2=0x7fcb0c09b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:27.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 0x7fcb0c09b4e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c590 tx=0x7fcb04007ef0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 shutdown_connections 2023-10-14T19:11:27.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaf0067320 0x7fcaf00697d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb0c0a8aa0 0x7fcb0c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb0c0c7da0 0x7fcb0c09b4e0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 --2- 172.21.15.7:0/1243793658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb0c0ae6f0 0x7fcb0c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:27.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 >> 172.21.15.7:0/1243793658 conn(0x7fcb0c088000 msgr2=0x7fcb0c0695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 shutdown_connections 2023-10-14T19:11:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:27.929+0000 7fcb13393700 1 -- 172.21.15.7:0/1243793658 wait complete. 2023-10-14T19:11:27.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:11:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.062+0000 7ff9df59e700 1 Processor -- start 2023-10-14T19:11:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.062+0000 7ff9df59e700 1 -- start start 2023-10-14T19:11:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9df59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9df59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e00cf3c0 con 0x7ff9e0153c30 2023-10-14T19:11:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9df59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e015afd0 con 0x7ff9e00cef40 2023-10-14T19:11:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9df59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e015b2b0 con 0x7ff9e015de50 2023-10-14T19:11:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9ddd9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9de59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff9e0153c30 0x7ff9e015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55300/0 (socket says 172.21.15.7:55300) 2023-10-14T19:11:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9de59c700 1 -- 172.21.15.7:0/3500636104 learned_addr learned my addr 172.21.15.7:0/3500636104 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9ddd9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58568/0 (socket says 172.21.15.7:58568) 2023-10-14T19:11:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9ddd9b700 1 -- 172.21.15.7:0/3500636104 >> v1:172.21.15.148:6789/0 conn(0x7ff9e00cef40 legacy=0x7ff9e015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9ddd9b700 1 -- 172.21.15.7:0/3500636104 >> v1:172.21.15.7:6789/0 conn(0x7ff9e0153c30 legacy=0x7ff9e015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9dd59a700 1 -- 172.21.15.7:0/3500636104 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142700787 0 0) 0x7ff9e015afd0 con 0x7ff9e00cef40 2023-10-14T19:11:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9ddd9b700 1 -- 172.21.15.7:0/3500636104 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e015b590 con 0x7ff9e015de50 2023-10-14T19:11:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.063+0000 7ff9ddd9b700 1 --2- 172.21.15.7:0/3500636104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00cea00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80098e0 tx=0x7ff9c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46687f1bd342679 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9dd59a700 1 -- 172.21.15.7:0/3500636104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8009e80 con 0x7ff9e015de50 2023-10-14T19:11:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9dd59a700 1 -- 172.21.15.7:0/3500636104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c800b760 con 0x7ff9e015de50 2023-10-14T19:11:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9dd59a700 1 -- 172.21.15.7:0/3500636104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800bae0 con 0x7ff9e015de50 2023-10-14T19:11:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 -- 172.21.15.7:0/3500636104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 msgr2=0x7ff9e00cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 --2- 172.21.15.7:0/3500636104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00cea00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80098e0 tx=0x7ff9c80091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 -- 172.21.15.7:0/3500636104 shutdown_connections 2023-10-14T19:11:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 --2- 172.21.15.7:0/3500636104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 -- 172.21.15.7:0/3500636104 >> 172.21.15.7:0/3500636104 conn(0x7ff9e00703a0 msgr2=0x7ff9e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 -- 172.21.15.7:0/3500636104 shutdown_connections 2023-10-14T19:11:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.064+0000 7ff9df59e700 1 -- 172.21.15.7:0/3500636104 wait complete. 2023-10-14T19:11:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.065+0000 7ff9df59e700 1 Processor -- start 2023-10-14T19:11:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 -- start start 2023-10-14T19:11:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9e00cef40 0x7ff9e01470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9e0153c30 0x7ff9e00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0147610 con 0x7ff9e015de50 2023-10-14T19:11:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00c8bb0 con 0x7ff9e00cef40 2023-10-14T19:11:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9df59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00c9040 con 0x7ff9e0153c30 2023-10-14T19:11:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9ded9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9ded9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58574/0 (socket says 172.21.15.7:58574) 2023-10-14T19:11:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.066+0000 7ff9ded9d700 1 -- 172.21.15.7:0/1587581405 learned_addr learned my addr 172.21.15.7:0/1587581405 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ddd9b700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9e0153c30 0x7ff9e00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9de59c700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9e00cef40 0x7ff9e01470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ded9d700 1 -- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9e0153c30 msgr2=0x7ff9e00c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ded9d700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9e0153c30 0x7ff9e00c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ded9d700 1 -- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9e00cef40 msgr2=0x7ff9e01470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ded9d700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9e00cef40 0x7ff9e01470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ded9d700 1 -- 172.21.15.7:0/1587581405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009420 con 0x7ff9e015de50 2023-10-14T19:11:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9ded9d700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00b4c20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c4c0 tx=0x7ff9d8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8011590 con 0x7ff9e015de50 2023-10-14T19:11:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d80116f0 con 0x7ff9e015de50 2023-10-14T19:11:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e00c7fa0 con 0x7ff9e015de50 2023-10-14T19:11:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8011ab0 con 0x7ff9e015de50 2023-10-14T19:11:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.067+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e00c8560 con 0x7ff9e015de50 2023-10-14T19:11:28.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.068+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e016a920 con 0x7ff9e015de50 2023-10-14T19:11:28.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.068+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff9d801b3b0 con 0x7ff9e015de50 2023-10-14T19:11:28.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.069+0000 7ff9d67fc700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff9c0067320 0x7ff9c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.069+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9d8084120 con 0x7ff9e015de50 2023-10-14T19:11:28.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.069+0000 7ff9de59c700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff9c0067320 0x7ff9c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.069+0000 7ff9de59c700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff9c0067320 0x7ff9c00697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0005c50 tx=0x7ff9d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:28.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.073+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9d8050db0 con 0x7ff9e015de50 2023-10-14T19:11:28.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.296+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9e004c3c0 con 0x7ff9c0067320 2023-10-14T19:11:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.297+0000 7ff9d67fc700 1 -- 172.21.15.7:0/1587581405 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff9e004c3c0 con 0x7ff9c0067320 2023-10-14T19:11:28.298 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:11:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:11:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:28.299 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:11:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff9c0067320 msgr2=0x7ff9c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff9c0067320 0x7ff9c00697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0005c50 tx=0x7ff9d0009040 comp rx=0 tx=0).stop 2023-10-14T19:11:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 msgr2=0x7ff9e00b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00b4c20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c4c0 tx=0x7ff9d8007f40 comp rx=0 tx=0).stop 2023-10-14T19:11:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 shutdown_connections 2023-10-14T19:11:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff9c0067320 0x7ff9c00697d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9e00cef40 0x7ff9e01470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e015de50 0x7ff9e00b4c20 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 --2- 172.21.15.7:0/1587581405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9e0153c30 0x7ff9e00c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 >> 172.21.15.7:0/1587581405 conn(0x7ff9e00703a0 msgr2=0x7ff9e00638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:28.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.299+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 shutdown_connections 2023-10-14T19:11:28.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.300+0000 7ff9df59e700 1 -- 172.21.15.7:0/1587581405 wait complete. 2023-10-14T19:11:28.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:11:28.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.434+0000 7f7f5a281700 1 Processor -- start 2023-10-14T19:11:28.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.434+0000 7f7f5a281700 1 -- start start 2023-10-14T19:11:28.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f5a281700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f54159530 0x7f7f540ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f5a281700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406dc70 0x7f7f54159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f5a281700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f540ccfd0 con 0x7f7f5406e0e0 2023-10-14T19:11:28.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f5a281700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f540cf0e0 con 0x7f7f54159530 2023-10-14T19:11:28.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f5a281700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5415a3d0 con 0x7f7f5406dc70 2023-10-14T19:11:28.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f54159530 0x7f7f540ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f54159530 0x7f7f540ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:34600/0 (socket says 172.21.15.7:34600) 2023-10-14T19:11:28.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f5881e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7f5406e0e0 0x7f7f540cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:59908/0 (socket says 172.21.15.7:59908) 2023-10-14T19:11:28.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f537fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406dc70 0x7f7f54159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 -- 172.21.15.7:0/407521817 learned_addr learned my addr 172.21.15.7:0/407521817 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:28.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 -- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406dc70 msgr2=0x7f7f54159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:28.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 --2- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406dc70 0x7f7f54159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 -- 172.21.15.7:0/407521817 >> v1:172.21.15.148:6789/0 conn(0x7f7f5406e0e0 legacy=0x7f7f540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f53fff700 1 -- 172.21.15.7:0/407521817 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5415a6b0 con 0x7f7f54159530 2023-10-14T19:11:28.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f52ffd700 1 -- 172.21.15.7:0/407521817 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659003443 0 0) 0x7f7f540ccfd0 con 0x7f7f5406e0e0 2023-10-14T19:11:28.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.435+0000 7f7f537fe700 1 --2- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406dc70 0x7f7f54159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:28.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f53fff700 1 --2- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f540ceba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7f440099b0 tx=0x7f7f44009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb3e554505aac8cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:28.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f52ffd700 1 -- 172.21.15.7:0/407521817 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44009ea0 con 0x7f7f54159530 2023-10-14T19:11:28.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f52ffd700 1 -- 172.21.15.7:0/407521817 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4400b860 con 0x7f7f54159530 2023-10-14T19:11:28.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f52ffd700 1 -- 172.21.15.7:0/407521817 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4400bc00 con 0x7f7f54159530 2023-10-14T19:11:28.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 -- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 msgr2=0x7f7f540ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 --2- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f540ceba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7f440099b0 tx=0x7f7f44009250 comp rx=0 tx=0).stop 2023-10-14T19:11:28.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 -- 172.21.15.7:0/407521817 shutdown_connections 2023-10-14T19:11:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 --2- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f540ceba0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 --2- 172.21.15.7:0/407521817 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406dc70 0x7f7f54159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 -- 172.21.15.7:0/407521817 >> 172.21.15.7:0/407521817 conn(0x7f7f540703a0 msgr2=0x7f7f540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 -- 172.21.15.7:0/407521817 shutdown_connections 2023-10-14T19:11:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.436+0000 7f7f5a281700 1 -- 172.21.15.7:0/407521817 wait complete. 2023-10-14T19:11:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.437+0000 7f7f5a281700 1 Processor -- start 2023-10-14T19:11:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 -- start start 2023-10-14T19:11:28.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 0x7f7f540b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406e0e0 0x7f7f540b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f54169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c7b00 con 0x7f7f5406dc70 2023-10-14T19:11:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c7de0 con 0x7f7f54159530 2023-10-14T19:11:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f5a281700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c80c0 con 0x7f7f5406e0e0 2023-10-14T19:11:28.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f53fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 0x7f7f540b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f53fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 0x7f7f540b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58578/0 (socket says 172.21.15.7:58578) 2023-10-14T19:11:28.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.438+0000 7f7f53fff700 1 -- 172.21.15.7:0/2796363958 learned_addr learned my addr 172.21.15.7:0/2796363958 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:28.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f537fe700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406e0e0 0x7f7f540b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f5881e700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f54169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f53fff700 1 -- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406e0e0 msgr2=0x7f7f540b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f53fff700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406e0e0 0x7f7f540b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f53fff700 1 -- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 msgr2=0x7f7f54169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f53fff700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f54169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f53fff700 1 -- 172.21.15.7:0/2796363958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009420 con 0x7f7f5406dc70 2023-10-14T19:11:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f53fff700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 0x7f7f540b5910 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f7f54089650 tx=0x7f7f44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44000d10 con 0x7f7f5406dc70 2023-10-14T19:11:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4400bbe0 con 0x7f7f5406dc70 2023-10-14T19:11:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f440094f0 con 0x7f7f5406dc70 2023-10-14T19:11:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44011690 con 0x7f7f5406dc70 2023-10-14T19:11:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.439+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f540c8680 con 0x7f7f5406dc70 2023-10-14T19:11:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.440+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5404c3c0 con 0x7f7f5406dc70 2023-10-14T19:11:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.441+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7f44011ac0 con 0x7f7f5406dc70 2023-10-14T19:11:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.441+0000 7f7f3bfff700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f40067320 0x7f7f400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:28.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.441+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f440864f0 con 0x7f7f5406dc70 2023-10-14T19:11:28.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.441+0000 7f7f537fe700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f40067320 0x7f7f400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:28.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.442+0000 7f7f537fe700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f40067320 0x7f7f400697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7f540b4fe0 tx=0x7f7f480091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:28.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.445+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f44053180 con 0x7f7f5406dc70 2023-10-14T19:11:28.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.637+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7f5415a990 con 0x7f7f5406dc70 2023-10-14T19:11:28.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.637+0000 7f7f3bfff700 1 -- 172.21.15.7:0/2796363958 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f440567a0 con 0x7f7f5406dc70 2023-10-14T19:11:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f40067320 msgr2=0x7f7f400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f40067320 0x7f7f400697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7f540b4fe0 tx=0x7f7f480091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 msgr2=0x7f7f540b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 0x7f7f540b5910 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f7f54089650 tx=0x7f7f44017000 comp rx=0 tx=0).stop 2023-10-14T19:11:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 shutdown_connections 2023-10-14T19:11:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f40067320 0x7f7f400697d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f54159530 0x7f7f54169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5406dc70 0x7f7f540b5910 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 --2- 172.21.15.7:0/2796363958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5406e0e0 0x7f7f540b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 >> 172.21.15.7:0/2796363958 conn(0x7f7f540703a0 msgr2=0x7f7f5415af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 shutdown_connections 2023-10-14T19:11:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:28.640+0000 7f7f5a281700 1 -- 172.21.15.7:0/2796363958 wait complete. 2023-10-14T19:11:28.653 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:11:28.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:11:28.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:28.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:11:28.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:28.692 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:11:28.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:11:28.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:11:28.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:28.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:11:28.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:28.800 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:11:28.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:11:28.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:28.857 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T19:11:28.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:11:28.875 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T19:11:28.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:11:28.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:28.877 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T19:11:28.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:11:28.912 INFO:teuthology.orchestra.run.smithi148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T19:11:28.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create another-data-pool --pg_num_min 64 2023-10-14T19:11:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.040+0000 7fc51b3e7700 1 Processor -- start 2023-10-14T19:11:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.040+0000 7fc51b3e7700 1 -- start start 2023-10-14T19:11:29.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc51b3e7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc514159530 0x7fc5140ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc51b3e7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc51406dcf0 0x7fc514159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc51b3e7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc514159e40 0x7fc5140cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc51b3e7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140ccfd0 con 0x7fc514159e40 2023-10-14T19:11:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc51b3e7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51415a410 con 0x7fc514159530 2023-10-14T19:11:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc51b3e7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51415a6f0 con 0x7fc51406dcf0 2023-10-14T19:11:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc514159e40 0x7fc5140cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc514159e40 0x7fc5140cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58592/0 (socket says 172.21.15.7:58592) 2023-10-14T19:11:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 -- 172.21.15.7:0/4196142847 learned_addr learned my addr 172.21.15.7:0/4196142847 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519183700 1 --2- 172.21.15.7:0/4196142847 >> v2:172.21.15.148:3300/0 conn(0x7fc514159530 0x7fc5140ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc518982700 1 --2- 172.21.15.7:0/4196142847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc51406dcf0 0x7fc514159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 -- 172.21.15.7:0/4196142847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc51406dcf0 msgr2=0x7fc514159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 --2- 172.21.15.7:0/4196142847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc51406dcf0 0x7fc514159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 -- 172.21.15.7:0/4196142847 >> v2:172.21.15.148:3300/0 conn(0x7fc514159530 msgr2=0x7fc5140ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 --2- 172.21.15.7:0/4196142847 >> v2:172.21.15.148:3300/0 conn(0x7fc514159530 0x7fc5140ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 -- 172.21.15.7:0/4196142847 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51415a9d0 con 0x7fc514159e40 2023-10-14T19:11:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519183700 1 --2- 172.21.15.7:0/4196142847 >> v2:172.21.15.148:3300/0 conn(0x7fc514159530 0x7fc5140ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc519984700 1 --2- 172.21.15.7:0/4196142847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc514159e40 0x7fc5140cb6f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fc51406d630 tx=0x7fc50c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209d53ee6f6db18c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc513fff700 1 -- 172.21.15.7:0/4196142847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00b860 con 0x7fc514159e40 2023-10-14T19:11:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc513fff700 1 -- 172.21.15.7:0/4196142847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c00b9c0 con 0x7fc514159e40 2023-10-14T19:11:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.041+0000 7fc513fff700 1 -- 172.21.15.7:0/4196142847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00bd60 con 0x7fc514159e40 2023-10-14T19:11:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 -- 172.21.15.7:0/4196142847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc514159e40 msgr2=0x7fc5140cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/4196142847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc514159e40 0x7fc5140cb6f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fc51406d630 tx=0x7fc50c009250 comp rx=0 tx=0).stop 2023-10-14T19:11:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 -- 172.21.15.7:0/4196142847 shutdown_connections 2023-10-14T19:11:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/4196142847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc514159e40 0x7fc5140cb6f0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/4196142847 >> v2:172.21.15.148:3300/0 conn(0x7fc514159530 0x7fc5140ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/4196142847 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc51406dcf0 0x7fc514159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 -- 172.21.15.7:0/4196142847 >> 172.21.15.7:0/4196142847 conn(0x7fc5140703a0 msgr2=0x7fc5140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 -- 172.21.15.7:0/4196142847 shutdown_connections 2023-10-14T19:11:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.042+0000 7fc51b3e7700 1 -- 172.21.15.7:0/4196142847 wait complete. 2023-10-14T19:11:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.043+0000 7fc51b3e7700 1 Processor -- start 2023-10-14T19:11:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.043+0000 7fc51b3e7700 1 -- start start 2023-10-14T19:11:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc51b3e7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 0x7fc5140b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc51b3e7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc514159530 0x7fc5140b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc51b3e7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc514159e40 0x7fc51414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc51b3e7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51415ca60 con 0x7fc51406dcf0 2023-10-14T19:11:29.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc51b3e7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140b44e0 con 0x7fc514159e40 2023-10-14T19:11:29.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc51b3e7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140b47c0 con 0x7fc514159530 2023-10-14T19:11:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 0x7fc5140b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 0x7fc5140b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58600/0 (socket says 172.21.15.7:58600) 2023-10-14T19:11:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 -- 172.21.15.7:0/1849837545 learned_addr learned my addr 172.21.15.7:0/1849837545 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519984700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc514159e40 0x7fc51414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc518982700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc514159530 0x7fc5140b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 -- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc514159530 msgr2=0x7fc5140b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc514159530 0x7fc5140b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 -- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc514159e40 msgr2=0x7fc51414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc514159e40 0x7fc51414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc519183700 1 -- 172.21.15.7:0/1849837545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0094f0 con 0x7fc51406dcf0 2023-10-14T19:11:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.044+0000 7fc518982700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc514159530 0x7fc5140b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.045+0000 7fc519183700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 0x7fc5140b3c90 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fc50400d1d0 tx=0x7fc504009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.045+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400ddc0 con 0x7fc51406dcf0 2023-10-14T19:11:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.045+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50400f040 con 0x7fc51406dcf0 2023-10-14T19:11:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.045+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5140b4aa0 con 0x7fc51406dcf0 2023-10-14T19:11:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.045+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504015670 con 0x7fc51406dcf0 2023-10-14T19:11:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.045+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5140c7790 con 0x7fc51406dcf0 2023-10-14T19:11:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.046+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51415cd40 con 0x7fc51406dcf0 2023-10-14T19:11:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.046+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc504015a60 con 0x7fc51406dcf0 2023-10-14T19:11:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.047+0000 7fc5117fa700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.047+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5040851e0 con 0x7fc51406dcf0 2023-10-14T19:11:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.047+0000 7fc518982700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.047+0000 7fc518982700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc5140c7130 tx=0x7fc508008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.051+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc50404e5a0 con 0x7fc51406dcf0 2023-10-14T19:11:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.244+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64} v 0) v1 -- 0x7fc5140b4c90 con 0x7fc51406dcf0 2023-10-14T19:11:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.933+0000 7fc5117fa700 1 -- 172.21.15.7:0/1849837545 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64}]=0 pool 'another-data-pool' created v166) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc504051dd0 con 0x7fc51406dcf0 2023-10-14T19:11:29.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 msgr2=0x7fc5000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:29.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc5140c7130 tx=0x7fc508008040 comp rx=0 tx=0).stop 2023-10-14T19:11:29.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 msgr2=0x7fc5140b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:29.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 0x7fc5140b3c90 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fc50400d1d0 tx=0x7fc504009a90 comp rx=0 tx=0).stop 2023-10-14T19:11:29.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 shutdown_connections 2023-10-14T19:11:29.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc500067320 0x7fc5000697d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc514159e40 0x7fc51414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51406dcf0 0x7fc5140b3c90 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 --2- 172.21.15.7:0/1849837545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc514159530 0x7fc5140b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:29.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 >> 172.21.15.7:0/1849837545 conn(0x7fc5140703a0 msgr2=0x7fc5140c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:29.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 shutdown_connections 2023-10-14T19:11:29.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:29.937+0000 7fc51b3e7700 1 -- 172.21.15.7:0/1849837545 wait complete. 2023-10-14T19:11:29.940 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'another-data-pool' created 2023-10-14T19:11:29.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs another-data-pool 2023-10-14T19:11:30.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.080+0000 7f6972b1b700 1 Processor -- start 2023-10-14T19:11:30.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.080+0000 7f6972b1b700 1 -- start start 2023-10-14T19:11:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f6972b1b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f696c0ce220 0x7f696c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f6972b1b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f696c0ccfa0 0x7f696c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f6972b1b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c0cf510 con 0x7f696c159860 2023-10-14T19:11:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f6972b1b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c0d00b0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f6972b1b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c0ce6a0 con 0x7f696c0ce220 2023-10-14T19:11:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f69708b7700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f696c159860 0x7f696c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55310/0 (socket says 172.21.15.7:55310) 2023-10-14T19:11:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f69708b7700 1 -- 172.21.15.7:0/632241585 learned_addr learned my addr 172.21.15.7:0/632241585 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.081+0000 7f69710b8700 1 --2- 172.21.15.7:0/632241585 >> v2:172.21.15.7:3300/0 conn(0x7f696c0ccfa0 0x7f696c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f696bfff700 1 --2- 172.21.15.7:0/632241585 >> v2:172.21.15.148:3300/0 conn(0x7f696c0ce220 0x7f696c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f696b7fe700 1 -- 172.21.15.7:0/632241585 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360899488 0 0) 0x7f696c0cf510 con 0x7f696c159860 2023-10-14T19:11:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f696b7fe700 1 -- 172.21.15.7:0/632241585 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6958003570 con 0x7f696c159860 2023-10-14T19:11:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f69710b8700 1 -- 172.21.15.7:0/632241585 >> v2:172.21.15.148:3300/0 conn(0x7f696c0ce220 msgr2=0x7f696c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f69710b8700 1 --2- 172.21.15.7:0/632241585 >> v2:172.21.15.148:3300/0 conn(0x7f696c0ce220 0x7f696c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f69710b8700 1 -- 172.21.15.7:0/632241585 >> v1:172.21.15.7:6789/0 conn(0x7f696c159860 legacy=0x7f696c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f69710b8700 1 -- 172.21.15.7:0/632241585 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0ce900 con 0x7f696c0ccfa0 2023-10-14T19:11:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f69710b8700 1 --2- 172.21.15.7:0/632241585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c0cd400 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f696c064890 tx=0x7f69540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f81ab625648a6c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f696b7fe700 1 -- 172.21.15.7:0/632241585 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954011630 con 0x7f696c0ccfa0 2023-10-14T19:11:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f696b7fe700 1 -- 172.21.15.7:0/632241585 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69540117b0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.082+0000 7f696b7fe700 1 -- 172.21.15.7:0/632241585 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954011b70 con 0x7f696c0ccfa0 2023-10-14T19:11:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 -- 172.21.15.7:0/632241585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 msgr2=0x7f696c0cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 --2- 172.21.15.7:0/632241585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c0cd400 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f696c064890 tx=0x7f69540091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 -- 172.21.15.7:0/632241585 shutdown_connections 2023-10-14T19:11:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 --2- 172.21.15.7:0/632241585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c0cd400 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 --2- 172.21.15.7:0/632241585 >> v2:172.21.15.148:3300/0 conn(0x7f696c0ce220 0x7f696c0cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 -- 172.21.15.7:0/632241585 >> 172.21.15.7:0/632241585 conn(0x7f696c0999b0 msgr2=0x7f696c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 -- 172.21.15.7:0/632241585 shutdown_connections 2023-10-14T19:11:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.083+0000 7f6972b1b700 1 -- 172.21.15.7:0/632241585 wait complete. 2023-10-14T19:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.084+0000 7f6972b1b700 1 Processor -- start 2023-10-14T19:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.084+0000 7f6972b1b700 1 -- start start 2023-10-14T19:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f6972b1b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f6972b1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f696c0ce220 0x7f696c168f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f6972b1b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f696c159860 0x7f696c1694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f6972b1b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15b9a0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f6972b1b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15ab20 con 0x7f696c0ce220 2023-10-14T19:11:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f6972b1b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15ad20 con 0x7f696c159860 2023-10-14T19:11:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c15c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58618/0 (socket says 172.21.15.7:58618) 2023-10-14T19:11:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 -- 172.21.15.7:0/59727626 learned_addr learned my addr 172.21.15.7:0/59727626 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f696bfff700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f696c0ce220 0x7f696c168f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69710b8700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f696c159860 0x7f696c1694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 -- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f696c159860 msgr2=0x7f696c1694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f696c159860 0x7f696c1694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 -- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f696c0ce220 msgr2=0x7f696c168f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f696c0ce220 0x7f696c168f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 -- 172.21.15.7:0/59727626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009420 con 0x7f696c0ccfa0 2023-10-14T19:11:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69710b8700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f696c159860 0x7f696c1694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.085+0000 7f69708b7700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c15c2c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f696400c790 tx=0x7f6964007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:30.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.086+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640072e0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.086+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964007440 con 0x7f696c0ccfa0 2023-10-14T19:11:30.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.086+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c15b000 con 0x7f696c0ccfa0 2023-10-14T19:11:30.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.086+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640057f0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.086+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c15b5c0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.086+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c04c3c0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.087+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6964005c20 con 0x7f696c0ccfa0 2023-10-14T19:11:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.087+0000 7f6968ff9700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f694c067320 0x7f694c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.087+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f69640841a0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.088+0000 7f696bfff700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f694c067320 0x7f694c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:30.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.088+0000 7f696bfff700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f694c067320 0x7f694c0697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f695c00f5b0 tx=0x7f695c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:30.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.092+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f696404b5a0 con 0x7f696c0ccfa0 2023-10-14T19:11:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.332+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"} v 0) v1 -- 0x7f696c15b780 con 0x7f696c0ccfa0 2023-10-14T19:11:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.936+0000 7f6968ff9700 1 -- 172.21.15.7:0/59727626 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"}]=0 added data pool 30 to fsmap v113) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6964050d70 con 0x7f696c0ccfa0 2023-10-14T19:11:30.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f694c067320 msgr2=0x7f694c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:30.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f694c067320 0x7f694c0697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f695c00f5b0 tx=0x7f695c00b040 comp rx=0 tx=0).stop 2023-10-14T19:11:30.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 msgr2=0x7f696c15c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:30.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c15c2c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f696400c790 tx=0x7f6964007c80 comp rx=0 tx=0).stop 2023-10-14T19:11:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 shutdown_connections 2023-10-14T19:11:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f694c067320 0x7f694c0697d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f696c159860 0x7f696c1694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696c0ccfa0 0x7f696c15c2c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 --2- 172.21.15.7:0/59727626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f696c0ce220 0x7f696c168f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:30.951 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.948+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 >> 172.21.15.7:0/59727626 conn(0x7f696c0999b0 msgr2=0x7f696c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:30.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.951+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 shutdown_connections 2023-10-14T19:11:30.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:30.952+0000 7f6972b1b700 1 -- 172.21.15.7:0/59727626 wait complete. 2023-10-14T19:11:30.953 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 30 to fsmap 2023-10-14T19:11:30.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:31.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.090+0000 7f0aff59e700 1 Processor -- start 2023-10-14T19:11:31.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.090+0000 7f0aff59e700 1 -- start start 2023-10-14T19:11:31.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0aff59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b0015de50 0x7f0b000cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0aff59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0b000cef40 0x7f0b0015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0aff59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000cf3c0 con 0x7f0b00153c30 2023-10-14T19:11:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0aff59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0015afd0 con 0x7f0b0015de50 2023-10-14T19:11:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0aff59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0015b2b0 con 0x7f0b000cef40 2023-10-14T19:11:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afdd9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b0015de50 0x7f0b000cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afe59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0b00153c30 0x7f0b0015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55326/0 (socket says 172.21.15.7:55326) 2023-10-14T19:11:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afe59c700 1 -- 172.21.15.7:0/494777977 learned_addr learned my addr 172.21.15.7:0/494777977 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afed9d700 1 --2- 172.21.15.7:0/494777977 >> v2:172.21.15.148:3300/0 conn(0x7f0b000cef40 0x7f0b0015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afdd9b700 1 -- 172.21.15.7:0/494777977 >> v2:172.21.15.148:3300/0 conn(0x7f0b000cef40 msgr2=0x7f0b0015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afdd9b700 1 --2- 172.21.15.7:0/494777977 >> v2:172.21.15.148:3300/0 conn(0x7f0b000cef40 0x7f0b0015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afdd9b700 1 -- 172.21.15.7:0/494777977 >> v1:172.21.15.7:6789/0 conn(0x7f0b00153c30 legacy=0x7f0b0015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afdd9b700 1 -- 172.21.15.7:0/494777977 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0015b590 con 0x7f0b0015de50 2023-10-14T19:11:31.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.091+0000 7f0afed9d700 1 --2- 172.21.15.7:0/494777977 >> v2:172.21.15.148:3300/0 conn(0x7f0b000cef40 0x7f0b0015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:31.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0afdd9b700 1 --2- 172.21.15.7:0/494777977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b0015de50 0x7f0b000cea00 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f0b000cdab0 tx=0x7f0ae80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8298eb188083d016 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0afd59a700 1 -- 172.21.15.7:0/494777977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800b6b0 con 0x7f0b0015de50 2023-10-14T19:11:31.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0afd59a700 1 -- 172.21.15.7:0/494777977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800b810 con 0x7f0b0015de50 2023-10-14T19:11:31.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0afd59a700 1 -- 172.21.15.7:0/494777977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800bbb0 con 0x7f0b0015de50 2023-10-14T19:11:31.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 -- 172.21.15.7:0/494777977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b0015de50 msgr2=0x7f0b000cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 --2- 172.21.15.7:0/494777977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b0015de50 0x7f0b000cea00 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f0b000cdab0 tx=0x7f0ae80091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 -- 172.21.15.7:0/494777977 shutdown_connections 2023-10-14T19:11:31.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 --2- 172.21.15.7:0/494777977 >> v2:172.21.15.148:3300/0 conn(0x7f0b000cef40 0x7f0b0015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 --2- 172.21.15.7:0/494777977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b0015de50 0x7f0b000cea00 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 -- 172.21.15.7:0/494777977 >> 172.21.15.7:0/494777977 conn(0x7f0b000703a0 msgr2=0x7f0b000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:31.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 -- 172.21.15.7:0/494777977 shutdown_connections 2023-10-14T19:11:31.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.092+0000 7f0aff59e700 1 -- 172.21.15.7:0/494777977 wait complete. 2023-10-14T19:11:31.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.093+0000 7f0aff59e700 1 Processor -- start 2023-10-14T19:11:31.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 -- start start 2023-10-14T19:11:31.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 0x7f0b00150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b00153c30 0x7f0b000b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b0015de50 0x7f0b000b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c75e0 con 0x7f0b000cef40 2023-10-14T19:11:31.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c8160 con 0x7f0b0015de50 2023-10-14T19:11:31.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0aff59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c7830 con 0x7f0b00153c30 2023-10-14T19:11:31.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0afe59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 0x7f0b00150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0afe59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 0x7f0b00150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58636/0 (socket says 172.21.15.7:58636) 2023-10-14T19:11:31.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.094+0000 7f0afe59c700 1 -- 172.21.15.7:0/317005591 learned_addr learned my addr 172.21.15.7:0/317005591 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:31.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afed9d700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b0015de50 0x7f0b000b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afe59c700 1 -- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b00153c30 msgr2=0x7f0b000b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afe59c700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b00153c30 0x7f0b000b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afe59c700 1 -- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b0015de50 msgr2=0x7f0b000b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afe59c700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b0015de50 0x7f0b000b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afe59c700 1 -- 172.21.15.7:0/317005591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009420 con 0x7f0b000cef40 2023-10-14T19:11:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0afe59c700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 0x7f0b00150fe0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c590 tx=0x7f0af8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8005b30 con 0x7f0b000cef40 2023-10-14T19:11:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8005c90 con 0x7f0b000cef40 2023-10-14T19:11:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000c7b10 con 0x7f0b000cef40 2023-10-14T19:11:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8007320 con 0x7f0b000cef40 2023-10-14T19:11:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.095+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b00151520 con 0x7f0b000cef40 2023-10-14T19:11:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.096+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0004c3c0 con 0x7f0b000cef40 2023-10-14T19:11:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.096+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0af801b3b0 con 0x7f0b000cef40 2023-10-14T19:11:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.097+0000 7f0af67fc700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ae0067320 0x7f0ae00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.097+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f0af80843b0 con 0x7f0b000cef40 2023-10-14T19:11:31.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.097+0000 7f0afdd9b700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ae0067320 0x7f0ae00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.097+0000 7f0afdd9b700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ae0067320 0x7f0ae00697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0b0016cc40 tx=0x7f0ae8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.101+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0af8050eb0 con 0x7f0b000cef40 2023-10-14T19:11:31.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.337+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b00063d50 con 0x7f0b000cef40 2023-10-14T19:11:31.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.337+0000 7f0af67fc700 1 -- 172.21.15.7:0/317005591 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f0af80544d0 con 0x7f0b000cef40 2023-10-14T19:11:31.338 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:31.339 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":113,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:30.933022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ae0067320 msgr2=0x7f0ae00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ae0067320 0x7f0ae00697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0b0016cc40 tx=0x7f0ae8017000 comp rx=0 tx=0).stop 2023-10-14T19:11:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 msgr2=0x7f0b00150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 0x7f0b00150fe0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c590 tx=0x7f0af8001020 comp rx=0 tx=0).stop 2023-10-14T19:11:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 shutdown_connections 2023-10-14T19:11:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0ae0067320 0x7f0ae00697d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b0015de50 0x7f0b000b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b000cef40 0x7f0b00150fe0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 --2- 172.21.15.7:0/317005591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b00153c30 0x7f0b000b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 >> 172.21.15.7:0/317005591 conn(0x7f0b000703a0 msgr2=0x7f0b000c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 shutdown_connections 2023-10-14T19:11:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.339+0000 7f0aff59e700 1 -- 172.21.15.7:0/317005591 wait complete. 2023-10-14T19:11:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 113 2023-10-14T19:11:31.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:31.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.471+0000 7fc2d3199700 1 Processor -- start 2023-10-14T19:11:31.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.471+0000 7fc2d3199700 1 -- start start 2023-10-14T19:11:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d3199700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2cc0b07d0 0x7fc2cc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d3199700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc2cc0cf200 0x7fc2cc0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d3199700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d3199700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc15a280 con 0x7fc2cc0b07d0 2023-10-14T19:11:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d3199700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc06e180 con 0x7fc2cc0cf200 2023-10-14T19:11:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d3199700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0cd540 con 0x7fc2cc0b0ba0 2023-10-14T19:11:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2cc0b07d0 0x7fc2cc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2cc0b07d0 0x7fc2cc0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58650/0 (socket says 172.21.15.7:58650) 2023-10-14T19:11:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 -- 172.21.15.7:0/1010928864 learned_addr learned my addr 172.21.15.7:0/1010928864 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2cbfff700 1 --2- 172.21.15.7:0/1010928864 >> v2:172.21.15.148:3300/0 conn(0x7fc2cc0cf200 0x7fc2cc0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 -- 172.21.15.7:0/1010928864 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 msgr2=0x7fc2cc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d1736700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 -- 172.21.15.7:0/1010928864 >> v2:172.21.15.148:3300/0 conn(0x7fc2cc0cf200 msgr2=0x7fc2cc0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 --2- 172.21.15.7:0/1010928864 >> v2:172.21.15.148:3300/0 conn(0x7fc2cc0cf200 0x7fc2cc0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 -- 172.21.15.7:0/1010928864 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc06d850 con 0x7fc2cc0b07d0 2023-10-14T19:11:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d1736700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2cbfff700 1 --2- 172.21.15.7:0/1010928864 >> v2:172.21.15.148:3300/0 conn(0x7fc2cc0cf200 0x7fc2cc0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:31.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.472+0000 7fc2d0f35700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc0ccac0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0cab40 tx=0x7fc2c0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603ace1268747227 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2cb7fe700 1 -- 172.21.15.7:0/1010928864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0005c10 con 0x7fc2cc0b07d0 2023-10-14T19:11:31.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2cb7fe700 1 -- 172.21.15.7:0/1010928864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c0005d70 con 0x7fc2cc0b07d0 2023-10-14T19:11:31.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2cb7fe700 1 -- 172.21.15.7:0/1010928864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000b910 con 0x7fc2cc0b07d0 2023-10-14T19:11:31.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 -- 172.21.15.7:0/1010928864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0b07d0 msgr2=0x7fc2cc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc0ccac0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0cab40 tx=0x7fc2c0009220 comp rx=0 tx=0).stop 2023-10-14T19:11:31.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 -- 172.21.15.7:0/1010928864 shutdown_connections 2023-10-14T19:11:31.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 --2- 172.21.15.7:0/1010928864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc0ccac0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 --2- 172.21.15.7:0/1010928864 >> v2:172.21.15.148:3300/0 conn(0x7fc2cc0cf200 0x7fc2cc0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 -- 172.21.15.7:0/1010928864 >> 172.21.15.7:0/1010928864 conn(0x7fc2cc06ce80 msgr2=0x7fc2cc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:31.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 -- 172.21.15.7:0/1010928864 shutdown_connections 2023-10-14T19:11:31.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.473+0000 7fc2d3199700 1 -- 172.21.15.7:0/1010928864 wait complete. 2023-10-14T19:11:31.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.474+0000 7fc2d3199700 1 Processor -- start 2023-10-14T19:11:31.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 -- start start 2023-10-14T19:11:31.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 0x7fc2cc0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0b2270 con 0x7fc2cc0cf200 2023-10-14T19:11:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0b34d0 con 0x7fc2cc0b07d0 2023-10-14T19:11:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d3199700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0b1cb0 con 0x7fc2cc0b0ba0 2023-10-14T19:11:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d1736700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 0x7fc2cc0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d1736700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 0x7fc2cc0b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58664/0 (socket says 172.21.15.7:58664) 2023-10-14T19:11:31.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.475+0000 7fc2d1736700 1 -- 172.21.15.7:0/2155268053 learned_addr learned my addr 172.21.15.7:0/2155268053 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:31.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d0f35700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2cbfff700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d1736700 1 -- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 msgr2=0x7fc2cc0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d1736700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d1736700 1 -- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2cc0b07d0 msgr2=0x7fc2cc1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d1736700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d1736700 1 -- 172.21.15.7:0/2155268053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0009480 con 0x7fc2cc0cf200 2023-10-14T19:11:31.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2cbfff700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:31.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d1736700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 0x7fc2cc0b3960 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400a380 tx=0x7fc2c4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4015440 con 0x7fc2cc0cf200 2023-10-14T19:11:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40155a0 con 0x7fc2cc0cf200 2023-10-14T19:11:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4015960 con 0x7fc2cc0cf200 2023-10-14T19:11:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc0b1f90 con 0x7fc2cc0cf200 2023-10-14T19:11:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.476+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc157600 con 0x7fc2cc0cf200 2023-10-14T19:11:31.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.477+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc04c3c0 con 0x7fc2cc0cf200 2023-10-14T19:11:31.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.477+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc2c400d440 con 0x7fc2cc0cf200 2023-10-14T19:11:31.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.478+0000 7fc2c8ff9700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc2b0067320 0x7fc2b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.478+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fc2c4085990 con 0x7fc2cc0cf200 2023-10-14T19:11:31.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.478+0000 7fc2d0f35700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc2b0067320 0x7fc2b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.478+0000 7fc2d0f35700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc2b0067320 0x7fc2b00697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009260 tx=0x7fc2c0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.482+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2c4052490 con 0x7fc2cc0cf200 2023-10-14T19:11:31.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.677+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2cc06db30 con 0x7fc2cc0cf200 2023-10-14T19:11:31.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.678+0000 7fc2c8ff9700 1 -- 172.21.15.7:0/2155268053 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16899 (secure 0 0 0) 0x7fc2c401a020 con 0x7fc2cc0cf200 2023-10-14T19:11:31.680 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:31.680 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":167,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:30.334364+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-14T19:11:29.275510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc2b0067320 msgr2=0x7fc2b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc2b0067320 0x7fc2b00697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009260 tx=0x7fc2c0016000 comp rx=0 tx=0).stop 2023-10-14T19:11:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 msgr2=0x7fc2cc0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 0x7fc2cc0b3960 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400a380 tx=0x7fc2c4007900 comp rx=0 tx=0).stop 2023-10-14T19:11:31.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 shutdown_connections 2023-10-14T19:11:31.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc2b0067320 0x7fc2b00697d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2cc0b07d0 0x7fc2cc1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc0cf200 0x7fc2cc0b3960 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 --2- 172.21.15.7:0/2155268053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2cc0b0ba0 0x7fc2cc0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 >> 172.21.15.7:0/2155268053 conn(0x7fc2cc06ce80 msgr2=0x7fc2cc158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:31.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 shutdown_connections 2023-10-14T19:11:31.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.680+0000 7fc2d3199700 1 -- 172.21.15.7:0/2155268053 wait complete. 2023-10-14T19:11:31.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.812+0000 7f22b853e700 1 Processor -- start 2023-10-14T19:11:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.813+0000 7f22b853e700 1 -- start start 2023-10-14T19:11:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.813+0000 7f22b853e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22b00b07d0 0x7f22b00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.813+0000 7f22b853e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b015a280 con 0x7f22b00cf200 2023-10-14T19:11:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.813+0000 7f22b853e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b006e180 con 0x7f22b00b0ba0 2023-10-14T19:11:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.813+0000 7f22b853e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b006d850 con 0x7f22b00b07d0 2023-10-14T19:11:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b62da700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22b00b07d0 0x7f22b00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b5ad9700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f22b00cf200 0x7f22b006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55332/0 (socket says 172.21.15.7:55332) 2023-10-14T19:11:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b5ad9700 1 -- 172.21.15.7:0/1117458702 learned_addr learned my addr 172.21.15.7:0/1117458702 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b62da700 1 -- 172.21.15.7:0/1117458702 >> v1:172.21.15.148:6789/0 conn(0x7f22b00b0ba0 legacy=0x7f22b006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b62da700 1 -- 172.21.15.7:0/1117458702 >> v1:172.21.15.7:6789/0 conn(0x7f22b00cf200 legacy=0x7f22b006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b62da700 1 -- 172.21.15.7:0/1117458702 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b006db30 con 0x7f22b00b07d0 2023-10-14T19:11:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b52d8700 1 -- 172.21.15.7:0/1117458702 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607244649 0 0) 0x7f22b015a280 con 0x7f22b00cf200 2023-10-14T19:11:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b62da700 1 --2- 172.21.15.7:0/1117458702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00b07d0 0x7f22b00ccac0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f22a80098d0 tx=0x7f22a8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d433f1d9ebc9e12c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b52d8700 1 -- 172.21.15.7:0/1117458702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8009e70 con 0x7f22b00b07d0 2023-10-14T19:11:31.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b52d8700 1 -- 172.21.15.7:0/1117458702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8005c10 con 0x7f22b00b07d0 2023-10-14T19:11:31.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.814+0000 7f22b52d8700 1 -- 172.21.15.7:0/1117458702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800b6a0 con 0x7f22b00b07d0 2023-10-14T19:11:31.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 -- 172.21.15.7:0/1117458702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00b07d0 msgr2=0x7f22b00ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 --2- 172.21.15.7:0/1117458702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00b07d0 0x7f22b00ccac0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f22a80098d0 tx=0x7f22a8009120 comp rx=0 tx=0).stop 2023-10-14T19:11:31.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 -- 172.21.15.7:0/1117458702 shutdown_connections 2023-10-14T19:11:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 --2- 172.21.15.7:0/1117458702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00b07d0 0x7f22b00ccac0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 -- 172.21.15.7:0/1117458702 >> 172.21.15.7:0/1117458702 conn(0x7f22b006ce80 msgr2=0x7f22b00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 -- 172.21.15.7:0/1117458702 shutdown_connections 2023-10-14T19:11:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.815+0000 7f22b853e700 1 -- 172.21.15.7:0/1117458702 wait complete. 2023-10-14T19:11:31.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.816+0000 7f22b853e700 1 Processor -- start 2023-10-14T19:11:31.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.816+0000 7f22b853e700 1 -- start start 2023-10-14T19:11:31.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b00b07d0 0x7f22b01563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22b00b0ba0 0x7f22b00c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 0x7f22b00c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00ca290 con 0x7f22b00cf200 2023-10-14T19:11:31.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b016d1f0 con 0x7f22b00b07d0 2023-10-14T19:11:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00c9680 con 0x7f22b00b0ba0 2023-10-14T19:11:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 0x7f22b00c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 0x7f22b00c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58688/0 (socket says 172.21.15.7:58688) 2023-10-14T19:11:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 -- 172.21.15.7:0/3836108049 learned_addr learned my addr 172.21.15.7:0/3836108049 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b62da700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b00b07d0 0x7f22b01563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b5ad9700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22b00b0ba0 0x7f22b00c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 -- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22b00b0ba0 msgr2=0x7f22b00c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22b00b0ba0 0x7f22b00c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 -- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b00b07d0 msgr2=0x7f22b01563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b00b07d0 0x7f22b01563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 -- 172.21.15.7:0/3836108049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80093c0 con 0x7f22b00cf200 2023-10-14T19:11:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b62da700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b00b07d0 0x7f22b01563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b6adb700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 0x7f22b00c9070 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c930 tx=0x7f22a00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000ce70 con 0x7f22b00cf200 2023-10-14T19:11:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000a7e0 con 0x7f22b00cf200 2023-10-14T19:11:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b00c9960 con 0x7f22b00cf200 2023-10-14T19:11:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.817+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000aba0 con 0x7f22b00cf200 2023-10-14T19:11:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.818+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00c9f20 con 0x7f22b00cf200 2023-10-14T19:11:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.818+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b00ca400 con 0x7f22b00cf200 2023-10-14T19:11:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.819+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f22a0012420 con 0x7f22b00cf200 2023-10-14T19:11:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.819+0000 7f22ae7fc700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f229c067320 0x7f229c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:31.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.820+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f22a0085240 con 0x7f22b00cf200 2023-10-14T19:11:31.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.820+0000 7f22b62da700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f229c067320 0x7f229c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:31.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.820+0000 7f22b62da700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f229c067320 0x7f229c0697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009390 tx=0x7f22a8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:31.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:31.824+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a0051df0 con 0x7f22b00cf200 2023-10-14T19:11:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.064+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22b004c3c0 con 0x7f22b00cf200 2023-10-14T19:11:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.064+0000 7f22ae7fc700 1 -- 172.21.15.7:0/3836108049 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f22a0055410 con 0x7f22b00cf200 2023-10-14T19:11:32.066 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:32.066 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":113,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:30.933022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f229c067320 msgr2=0x7f229c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f229c067320 0x7f229c0697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009390 tx=0x7f22a8015000 comp rx=0 tx=0).stop 2023-10-14T19:11:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 msgr2=0x7f22b00c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 0x7f22b00c9070 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c930 tx=0x7f22a00026e0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 shutdown_connections 2023-10-14T19:11:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f229c067320 0x7f229c0697d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b00b07d0 0x7f22b01563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b00cf200 0x7f22b00c9070 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 --2- 172.21.15.7:0/3836108049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22b00b0ba0 0x7f22b00c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 >> 172.21.15.7:0/3836108049 conn(0x7f22b006ce80 msgr2=0x7f22b01554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 shutdown_connections 2023-10-14T19:11:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.066+0000 7f22b853e700 1 -- 172.21.15.7:0/3836108049 wait complete. 2023-10-14T19:11:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 113 2023-10-14T19:11:32.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.198+0000 7f96fa37b700 1 Processor -- start 2023-10-14T19:11:32.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.198+0000 7f96fa37b700 1 -- start start 2023-10-14T19:11:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96fa37b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96f4153c30 0x7f96f415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96fa37b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f40cf110 0x7f96f415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96fa37b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f415afd0 con 0x7f96f415de50 2023-10-14T19:11:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96fa37b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f415b2b0 con 0x7f96f4153c30 2023-10-14T19:11:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96fa37b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f415b590 con 0x7f96f40cf110 2023-10-14T19:11:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9379700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96f4153c30 0x7f96f415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f8b78700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f96f415de50 0x7f96f40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55348/0 (socket says 172.21.15.7:55348) 2023-10-14T19:11:32.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f8b78700 1 -- 172.21.15.7:0/2216068957 learned_addr learned my addr 172.21.15.7:0/2216068957 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:32.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9b7a700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f40cf110 0x7f96f415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9379700 1 -- 172.21.15.7:0/2216068957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f40cf110 msgr2=0x7f96f415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:32.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9379700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f40cf110 0x7f96f415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9379700 1 -- 172.21.15.7:0/2216068957 >> v1:172.21.15.7:6789/0 conn(0x7f96f415de50 legacy=0x7f96f40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96ebfff700 1 -- 172.21.15.7:0/2216068957 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320889576 0 0) 0x7f96f415afd0 con 0x7f96f415de50 2023-10-14T19:11:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9379700 1 -- 172.21.15.7:0/2216068957 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f415b870 con 0x7f96f4153c30 2023-10-14T19:11:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9b7a700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f40cf110 0x7f96f415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.199+0000 7f96f9379700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f4153c30 0x7f96f415a5e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f96f00098e0 tx=0x7f96f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15205e53abce7eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96ebfff700 1 -- 172.21.15.7:0/2216068957 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0009e80 con 0x7f96f4153c30 2023-10-14T19:11:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96ebfff700 1 -- 172.21.15.7:0/2216068957 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f000b860 con 0x7f96f4153c30 2023-10-14T19:11:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96ebfff700 1 -- 172.21.15.7:0/2216068957 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000bbe0 con 0x7f96f4153c30 2023-10-14T19:11:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 -- 172.21.15.7:0/2216068957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f4153c30 msgr2=0x7f96f415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f4153c30 0x7f96f415a5e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f96f00098e0 tx=0x7f96f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 -- 172.21.15.7:0/2216068957 shutdown_connections 2023-10-14T19:11:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f4153c30 0x7f96f415a5e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2216068957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f40cf110 0x7f96f415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 -- 172.21.15.7:0/2216068957 >> 172.21.15.7:0/2216068957 conn(0x7f96f40703a0 msgr2=0x7f96f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 -- 172.21.15.7:0/2216068957 shutdown_connections 2023-10-14T19:11:32.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.200+0000 7f96fa37b700 1 -- 172.21.15.7:0/2216068957 wait complete. 2023-10-14T19:11:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.201+0000 7f96fa37b700 1 Processor -- start 2023-10-14T19:11:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 -- start start 2023-10-14T19:11:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96f40cf110 0x7f96f40b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f4153c30 0x7f96f414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 0x7f96f40b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40b26a0 con 0x7f96f415de50 2023-10-14T19:11:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40b0500 con 0x7f96f40cf110 2023-10-14T19:11:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.202+0000 7f96fa37b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f414b6e0 con 0x7f96f4153c30 2023-10-14T19:11:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 0x7f96f40b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 0x7f96f40b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58714/0 (socket says 172.21.15.7:58714) 2023-10-14T19:11:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 -- 172.21.15.7:0/2037398678 learned_addr learned my addr 172.21.15.7:0/2037398678 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f8b78700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f4153c30 0x7f96f414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9379700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96f40cf110 0x7f96f40b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 -- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f4153c30 msgr2=0x7f96f414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f4153c30 0x7f96f414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 -- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96f40cf110 msgr2=0x7f96f40b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96f40cf110 0x7f96f40b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 -- 172.21.15.7:0/2037398678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0009420 con 0x7f96f415de50 2023-10-14T19:11:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.203+0000 7f96f9b7a700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 0x7f96f40b3b70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00a380 tx=0x7f96ec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.204+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00ae10 con 0x7f96f415de50 2023-10-14T19:11:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.204+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec00d650 con 0x7f96f415de50 2023-10-14T19:11:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.204+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00da10 con 0x7f96f415de50 2023-10-14T19:11:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.204+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f40b1d60 con 0x7f96f415de50 2023-10-14T19:11:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.204+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f416d320 con 0x7f96f415de50 2023-10-14T19:11:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.206+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f96ec015440 con 0x7f96f415de50 2023-10-14T19:11:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.206+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f40b06b0 con 0x7f96f415de50 2023-10-14T19:11:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.206+0000 7f96e97fa700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96d8067320 0x7f96d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.206+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f96ec085700 con 0x7f96f415de50 2023-10-14T19:11:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.206+0000 7f96f9379700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96d8067320 0x7f96d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.207+0000 7f96f9379700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96d8067320 0x7f96d80697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f96f00091e0 tx=0x7f96f0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:32.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.211+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96ec0522b0 con 0x7f96f415de50 2023-10-14T19:11:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.404+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96f415bb50 con 0x7f96f415de50 2023-10-14T19:11:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.405+0000 7f96e97fa700 1 -- 172.21.15.7:0/2037398678 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16886 (secure 0 0 0) 0x7f96ec0558d0 con 0x7f96f415de50 2023-10-14T19:11:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:32.407 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":168,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:31.934407+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-14T19:11:29.275510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:32.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96d8067320 msgr2=0x7f96d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96d8067320 0x7f96d80697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f96f00091e0 tx=0x7f96f0017000 comp rx=0 tx=0).stop 2023-10-14T19:11:32.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 msgr2=0x7f96f40b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 0x7f96f40b3b70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00a380 tx=0x7f96ec007900 comp rx=0 tx=0).stop 2023-10-14T19:11:32.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 shutdown_connections 2023-10-14T19:11:32.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f96d8067320 0x7f96d80697d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96f40cf110 0x7f96f40b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f415de50 0x7f96f40b3b70 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 --2- 172.21.15.7:0/2037398678 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96f4153c30 0x7f96f414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 >> 172.21.15.7:0/2037398678 conn(0x7f96f40703a0 msgr2=0x7f96f40c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 shutdown_connections 2023-10-14T19:11:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.407+0000 7f96fa37b700 1 -- 172.21.15.7:0/2037398678 wait complete. 2023-10-14T19:11:32.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000819117 --yes-i-really-mean-it 2023-10-14T19:11:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.544+0000 7fa04b59e700 1 Processor -- start 2023-10-14T19:11:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.544+0000 7fa04b59e700 1 -- start start 2023-10-14T19:11:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa04b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c142ca0 0x7fa04c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa04b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa04c0cb450 0x7fa04c0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa04b59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c15d8d0 con 0x7fa04c143070 2023-10-14T19:11:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa04b59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c15d2f0 con 0x7fa04c0cb450 2023-10-14T19:11:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa04b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0cc630 con 0x7fa04c142ca0 2023-10-14T19:11:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa04ad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa04c0cb450 0x7fa04c0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa049d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa04c143070 0x7fa04c0cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55350/0 (socket says 172.21.15.7:55350) 2023-10-14T19:11:32.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.545+0000 7fa049d9b700 1 -- 172.21.15.7:0/396041832 learned_addr learned my addr 172.21.15.7:0/396041832 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:32.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04a59c700 1 --2- 172.21.15.7:0/396041832 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c142ca0 0x7fa04c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04ad9d700 1 -- 172.21.15.7:0/396041832 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c142ca0 msgr2=0x7fa04c15dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:32.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04ad9d700 1 --2- 172.21.15.7:0/396041832 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c142ca0 0x7fa04c15dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04ad9d700 1 -- 172.21.15.7:0/396041832 >> v1:172.21.15.7:6789/0 conn(0x7fa04c143070 legacy=0x7fa04c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04959a700 1 -- 172.21.15.7:0/396041832 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867503881 0 0) 0x7fa04c15d8d0 con 0x7fa04c143070 2023-10-14T19:11:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04ad9d700 1 -- 172.21.15.7:0/396041832 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c15d560 con 0x7fa04c0cb450 2023-10-14T19:11:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04ad9d700 1 --2- 172.21.15.7:0/396041832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0cbf30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0098e0 tx=0x7fa03c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc685611da37ec3f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04959a700 1 -- 172.21.15.7:0/396041832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c009e80 con 0x7fa04c0cb450 2023-10-14T19:11:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04959a700 1 -- 172.21.15.7:0/396041832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00b860 con 0x7fa04c0cb450 2023-10-14T19:11:32.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04959a700 1 -- 172.21.15.7:0/396041832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00bbe0 con 0x7fa04c0cb450 2023-10-14T19:11:32.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04b59e700 1 -- 172.21.15.7:0/396041832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 msgr2=0x7fa04c0cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.546+0000 7fa04b59e700 1 --2- 172.21.15.7:0/396041832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0cbf30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0098e0 tx=0x7fa03c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.547+0000 7fa04b59e700 1 -- 172.21.15.7:0/396041832 shutdown_connections 2023-10-14T19:11:32.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.547+0000 7fa04b59e700 1 --2- 172.21.15.7:0/396041832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0cbf30 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.547+0000 7fa04b59e700 1 --2- 172.21.15.7:0/396041832 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c142ca0 0x7fa04c15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.547+0000 7fa04b59e700 1 -- 172.21.15.7:0/396041832 >> 172.21.15.7:0/396041832 conn(0x7fa04c067c80 msgr2=0x7fa04c068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:32.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.547+0000 7fa04b59e700 1 -- 172.21.15.7:0/396041832 shutdown_connections 2023-10-14T19:11:32.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.547+0000 7fa04b59e700 1 -- 172.21.15.7:0/396041832 wait complete. 2023-10-14T19:11:32.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 Processor -- start 2023-10-14T19:11:32.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 -- start start 2023-10-14T19:11:32.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c142ca0 0x7fa04c13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c143070 0x7fa04c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0ad130 con 0x7fa04c0cb450 2023-10-14T19:11:32.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0b25a0 con 0x7fa04c142ca0 2023-10-14T19:11:32.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0b12a0 con 0x7fa04c143070 2023-10-14T19:11:32.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58726/0 (socket says 172.21.15.7:58726) 2023-10-14T19:11:32.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.548+0000 7fa04a59c700 1 -- 172.21.15.7:0/3301625740 learned_addr learned my addr 172.21.15.7:0/3301625740 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:32.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04ad9d700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c143070 0x7fa04c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa049d9b700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c142ca0 0x7fa04c13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04a59c700 1 -- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c143070 msgr2=0x7fa04c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04a59c700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c143070 0x7fa04c0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04a59c700 1 -- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c142ca0 msgr2=0x7fa04c13ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:32.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04a59c700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c142ca0 0x7fa04c13ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:32.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04a59c700 1 -- 172.21.15.7:0/3301625740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c009420 con 0x7fa04c0cb450 2023-10-14T19:11:32.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04a59c700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0b2060 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa04400cfc0 tx=0x7fa044007890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044016430 con 0x7fa04c0cb450 2023-10-14T19:11:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0440165d0 con 0x7fa04c0cb450 2023-10-14T19:11:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044016990 con 0x7fa04c0cb450 2023-10-14T19:11:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c0b1580 con 0x7fa04c0cb450 2023-10-14T19:11:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.549+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c0b1b40 con 0x7fa04c0cb450 2023-10-14T19:11:32.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.550+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c0b1d60 con 0x7fa04c0cb450 2023-10-14T19:11:32.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.550+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa044003020 con 0x7fa04c0cb450 2023-10-14T19:11:32.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.551+0000 7fa0427fc700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa02c067320 0x7fa02c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.551+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fa044012070 con 0x7fa04c0cb450 2023-10-14T19:11:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.551+0000 7fa049d9b700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa02c067320 0x7fa02c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.552+0000 7fa049d9b700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa02c067320 0x7fa02c0697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0cb0a0 tx=0x7fa034009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.555+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0440529c0 con 0x7fa04c0cb450 2023-10-14T19:11:32.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:32.776+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000819117", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa04c0b1410 con 0x7fa02c067320 2023-10-14T19:11:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.967+0000 7fa0427fc700 1 -- 172.21.15.7:0/3301625740 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+127 (secure 0 0 0) 0x7fa04c0b1410 con 0x7fa02c067320 2023-10-14T19:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout:FS volume 'cephfs' renamed to 'volume_0000000000819117'. But failed to rename data pools as more than one data pool was found. 2023-10-14T19:11:33.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa02c067320 msgr2=0x7fa02c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:33.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa02c067320 0x7fa02c0697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0cb0a0 tx=0x7fa034009040 comp rx=0 tx=0).stop 2023-10-14T19:11:33.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 msgr2=0x7fa04c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:33.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0b2060 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa04400cfc0 tx=0x7fa044007890 comp rx=0 tx=0).stop 2023-10-14T19:11:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 shutdown_connections 2023-10-14T19:11:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa02c067320 0x7fa02c0697d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c143070 0x7fa04c0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c0cb450 0x7fa04c0b2060 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 --2- 172.21.15.7:0/3301625740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c142ca0 0x7fa04c13ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 >> 172.21.15.7:0/3301625740 conn(0x7fa04c067c80 msgr2=0x7fa04c0694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 shutdown_connections 2023-10-14T19:11:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:33.970+0000 7fa04b59e700 1 -- 172.21.15.7:0/3301625740 wait complete. 2023-10-14T19:11:33.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:11:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.113+0000 7fb211336700 1 Processor -- start 2023-10-14T19:11:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.113+0000 7fb211336700 1 -- start start 2023-10-14T19:11:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb211336700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb970 0x7fb20c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb211336700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb20c15a400 0x7fb20c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb211336700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c15ae40 con 0x7fb20c0cb5a0 2023-10-14T19:11:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb211336700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c0ce0f0 con 0x7fb20c15a400 2023-10-14T19:11:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb211336700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0cbde0 con 0x7fb20c0cb970 2023-10-14T19:11:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb20c15a400 0x7fb20c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb20c15a400 0x7fb20c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58736/0 (socket says 172.21.15.7:58736) 2023-10-14T19:11:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 -- 172.21.15.7:0/1229201250 learned_addr learned my addr 172.21.15.7:0/1229201250 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20a7fc700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb970 0x7fb20c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 -- 172.21.15.7:0/1229201250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb970 msgr2=0x7fb20c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb970 0x7fb20c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 -- 172.21.15.7:0/1229201250 >> v1:172.21.15.148:6789/0 conn(0x7fb20c0cb5a0 legacy=0x7fb20c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 -- 172.21.15.7:0/1229201250 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c15ab60 con 0x7fb20c15a400 2023-10-14T19:11:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20a7fc700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb970 0x7fb20c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb20b7fe700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c15a400 0x7fb20c156e90 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb204009f50 tx=0x7fb204009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79a3b045ecad443 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb209ffb700 1 -- 172.21.15.7:0/1229201250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400e070 con 0x7fb20c15a400 2023-10-14T19:11:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb209ffb700 1 -- 172.21.15.7:0/1229201250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400ba70 con 0x7fb20c15a400 2023-10-14T19:11:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.114+0000 7fb209ffb700 1 -- 172.21.15.7:0/1229201250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040092e0 con 0x7fb20c15a400 2023-10-14T19:11:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 -- 172.21.15.7:0/1229201250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c15a400 msgr2=0x7fb20c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c15a400 0x7fb20c156e90 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb204009f50 tx=0x7fb204009840 comp rx=0 tx=0).stop 2023-10-14T19:11:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 -- 172.21.15.7:0/1229201250 shutdown_connections 2023-10-14T19:11:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c15a400 0x7fb20c156e90 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 --2- 172.21.15.7:0/1229201250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb970 0x7fb20c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 -- 172.21.15.7:0/1229201250 >> 172.21.15.7:0/1229201250 conn(0x7fb20c070e30 msgr2=0x7fb20c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 -- 172.21.15.7:0/1229201250 shutdown_connections 2023-10-14T19:11:34.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.115+0000 7fb211336700 1 -- 172.21.15.7:0/1229201250 wait complete. 2023-10-14T19:11:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.116+0000 7fb211336700 1 Processor -- start 2023-10-14T19:11:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.116+0000 7fb211336700 1 -- start start 2023-10-14T19:11:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb211336700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb5a0 0x7fb20c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb211336700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 0x7fb20c159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb211336700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb20c15a400 0x7fb20c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb211336700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c159180 con 0x7fb20c0cb970 2023-10-14T19:11:34.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb211336700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c159b50 con 0x7fb20c15a400 2023-10-14T19:11:34.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb211336700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c1582d0 con 0x7fb20c0cb5a0 2023-10-14T19:11:34.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 0x7fb20c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 0x7fb20c159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58746/0 (socket says 172.21.15.7:58746) 2023-10-14T19:11:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 -- 172.21.15.7:0/2083731466 learned_addr learned my addr 172.21.15.7:0/2083731466 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20b7fe700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb20c15a400 0x7fb20c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20affd700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb5a0 0x7fb20c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 -- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb5a0 msgr2=0x7fb20c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb5a0 0x7fb20c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 -- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb20c15a400 msgr2=0x7fb20c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb20c15a400 0x7fb20c157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.117+0000 7fb20a7fc700 1 -- 172.21.15.7:0/2083731466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204009ae0 con 0x7fb20c0cb970 2023-10-14T19:11:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.118+0000 7fb20a7fc700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 0x7fb20c159610 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e8d0 tx=0x7fb200008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.118+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20000ee70 con 0x7fb20c0cb970 2023-10-14T19:11:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.118+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20000c5e0 con 0x7fb20c0cb970 2023-10-14T19:11:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.118+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20000c980 con 0x7fb20c0cb970 2023-10-14T19:11:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.118+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c158570 con 0x7fb20c0cb970 2023-10-14T19:11:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.118+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c158b30 con 0x7fb20c0cb970 2023-10-14T19:11:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.119+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c15a860 con 0x7fb20c0cb970 2023-10-14T19:11:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.119+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb200013410 con 0x7fb20c0cb970 2023-10-14T19:11:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.120+0000 7fb1f2ffd700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1f8067320 0x7fb1f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.120+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb200084dc0 con 0x7fb20c0cb970 2023-10-14T19:11:34.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.120+0000 7fb20affd700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1f8067320 0x7fb1f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.120+0000 7fb20affd700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1f8067320 0x7fb1f80697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0ca940 tx=0x7fb1fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.124+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb200051760 con 0x7fb20c0cb970 2023-10-14T19:11:34.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.344+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb20c04c3c0 con 0x7fb1f8067320 2023-10-14T19:11:34.346 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.345+0000 7fb1f2ffd700 1 -- 172.21.15.7:0/2083731466 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7fb20c04c3c0 con 0x7fb1f8067320 2023-10-14T19:11:34.346 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:11:34.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:34.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volume_0000000000819117" 2023-10-14T19:11:34.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:34.347 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:11:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1f8067320 msgr2=0x7fb1f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1f8067320 0x7fb1f80697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0ca940 tx=0x7fb1fc009040 comp rx=0 tx=0).stop 2023-10-14T19:11:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 msgr2=0x7fb20c159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 0x7fb20c159610 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e8d0 tx=0x7fb200008040 comp rx=0 tx=0).stop 2023-10-14T19:11:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 shutdown_connections 2023-10-14T19:11:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1f8067320 0x7fb1f80697d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb20c15a400 0x7fb20c157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb20c0cb5a0 0x7fb20c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 --2- 172.21.15.7:0/2083731466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb20c0cb970 0x7fb20c159610 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 >> 172.21.15.7:0/2083731466 conn(0x7fb20c070e30 msgr2=0x7fb20c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 shutdown_connections 2023-10-14T19:11:34.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.347+0000 7fb211336700 1 -- 172.21.15.7:0/2083731466 wait complete. 2023-10-14T19:11:34.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.479+0000 7f6466a4d700 1 Processor -- start 2023-10-14T19:11:34.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.479+0000 7f6466a4d700 1 -- start start 2023-10-14T19:11:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6466a4d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f646015de50 0x7f64600cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6466a4d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64600cef40 0x7f646015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6466a4d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600cf3c0 con 0x7f6460153c30 2023-10-14T19:11:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6466a4d700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646015afd0 con 0x7f646015de50 2023-10-14T19:11:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6466a4d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646015b2b0 con 0x7f64600cef40 2023-10-14T19:11:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646524a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f646015de50 0x7f64600cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6465a4b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6460153c30 0x7f646015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55356/0 (socket says 172.21.15.7:55356) 2023-10-14T19:11:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6465a4b700 1 -- 172.21.15.7:0/1616702038 learned_addr learned my addr 172.21.15.7:0/1616702038 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646624c700 1 --2- 172.21.15.7:0/1616702038 >> v2:172.21.15.148:3300/0 conn(0x7f64600cef40 0x7f646015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646524a700 1 -- 172.21.15.7:0/1616702038 >> v2:172.21.15.148:3300/0 conn(0x7f64600cef40 msgr2=0x7f646015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646524a700 1 --2- 172.21.15.7:0/1616702038 >> v2:172.21.15.148:3300/0 conn(0x7f64600cef40 0x7f646015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646524a700 1 -- 172.21.15.7:0/1616702038 >> v1:172.21.15.7:6789/0 conn(0x7f6460153c30 legacy=0x7f646015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646524a700 1 -- 172.21.15.7:0/1616702038 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646015b590 con 0x7f646015de50 2023-10-14T19:11:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6464a49700 1 -- 172.21.15.7:0/1616702038 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432674476 0 0) 0x7f64600cf3c0 con 0x7f6460153c30 2023-10-14T19:11:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f646524a700 1 --2- 172.21.15.7:0/1616702038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646015de50 0x7f64600cea00 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f64600cdab0 tx=0x7f64540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afc93fe0cbf2559 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6464a49700 1 -- 172.21.15.7:0/1616702038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011630 con 0x7f646015de50 2023-10-14T19:11:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6464a49700 1 -- 172.21.15.7:0/1616702038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454011790 con 0x7f646015de50 2023-10-14T19:11:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.480+0000 7f6464a49700 1 -- 172.21.15.7:0/1616702038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011b30 con 0x7f646015de50 2023-10-14T19:11:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 -- 172.21.15.7:0/1616702038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646015de50 msgr2=0x7f64600cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 --2- 172.21.15.7:0/1616702038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646015de50 0x7f64600cea00 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f64600cdab0 tx=0x7f64540091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 -- 172.21.15.7:0/1616702038 shutdown_connections 2023-10-14T19:11:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 --2- 172.21.15.7:0/1616702038 >> v2:172.21.15.148:3300/0 conn(0x7f64600cef40 0x7f646015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 --2- 172.21.15.7:0/1616702038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646015de50 0x7f64600cea00 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 -- 172.21.15.7:0/1616702038 >> 172.21.15.7:0/1616702038 conn(0x7f64600703a0 msgr2=0x7f64600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:34.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 -- 172.21.15.7:0/1616702038 shutdown_connections 2023-10-14T19:11:34.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.481+0000 7f6466a4d700 1 -- 172.21.15.7:0/1616702038 wait complete. 2023-10-14T19:11:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.482+0000 7f6466a4d700 1 Processor -- start 2023-10-14T19:11:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.482+0000 7f6466a4d700 1 -- start start 2023-10-14T19:11:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6466a4d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 0x7f64600c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6466a4d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6460153c30 0x7f64600c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6466a4d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f646015de50 0x7f64601506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6466a4d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c75e0 con 0x7f64600cef40 2023-10-14T19:11:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6466a4d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c8160 con 0x7f6460153c30 2023-10-14T19:11:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6466a4d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c6930 con 0x7f646015de50 2023-10-14T19:11:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 0x7f64600c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 0x7f64600c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58754/0 (socket says 172.21.15.7:58754) 2023-10-14T19:11:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 -- 172.21.15.7:0/2109423842 learned_addr learned my addr 172.21.15.7:0/2109423842 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f646524a700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6460153c30 0x7f64600c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f646624c700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f646015de50 0x7f64601506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 -- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f646015de50 msgr2=0x7f64601506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f646015de50 0x7f64601506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 -- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6460153c30 msgr2=0x7f64600c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6460153c30 0x7f64600c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f6465a4b700 1 -- 172.21.15.7:0/2109423842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454009420 con 0x7f64600cef40 2023-10-14T19:11:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.483+0000 7f646624c700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f646015de50 0x7f64601506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.484+0000 7f6465a4b700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 0x7f64600c9e80 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f645800c5b0 tx=0x7f6458001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.484+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458005b30 con 0x7f64600cef40 2023-10-14T19:11:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.484+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458005c90 con 0x7f64600cef40 2023-10-14T19:11:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.484+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600c7830 con 0x7f64600cef40 2023-10-14T19:11:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.484+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458007300 con 0x7f64600cef40 2023-10-14T19:11:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.484+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600c7df0 con 0x7f64600cef40 2023-10-14T19:11:34.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.485+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646004c3c0 con 0x7f64600cef40 2023-10-14T19:11:34.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.485+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f645801b3b0 con 0x7f64600cef40 2023-10-14T19:11:34.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.486+0000 7f645dffb700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f644c067320 0x7f644c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.486+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f6458084380 con 0x7f64600cef40 2023-10-14T19:11:34.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.486+0000 7f646524a700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f644c067320 0x7f644c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.486+0000 7f646524a700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f644c067320 0x7f644c0697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f64540091e0 tx=0x7f6454017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.490+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6458050e30 con 0x7f64600cef40 2023-10-14T19:11:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.727+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64600caef0 con 0x7f64600cef40 2023-10-14T19:11:34.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.728+0000 7f645dffb700 1 -- 172.21.15.7:0/2109423842 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f6458054450 con 0x7f64600cef40 2023-10-14T19:11:34.729 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:34.730 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:32.952866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000819117","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:34.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f644c067320 msgr2=0x7f644c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f644c067320 0x7f644c0697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f64540091e0 tx=0x7f6454017000 comp rx=0 tx=0).stop 2023-10-14T19:11:34.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 msgr2=0x7f64600c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.732 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 0x7f64600c9e80 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f645800c5b0 tx=0x7f6458001070 comp rx=0 tx=0).stop 2023-10-14T19:11:34.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 shutdown_connections 2023-10-14T19:11:34.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f644c067320 0x7f644c0697d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f646015de50 0x7f64601506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64600cef40 0x7f64600c9e80 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.733 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 --2- 172.21.15.7:0/2109423842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6460153c30 0x7f64600c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 >> 172.21.15.7:0/2109423842 conn(0x7f64600703a0 msgr2=0x7f646015bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:34.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 shutdown_connections 2023-10-14T19:11:34.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.730+0000 7f6466a4d700 1 -- 172.21.15.7:0/2109423842 wait complete. 2023-10-14T19:11:34.735 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 114 2023-10-14T19:11:34.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.861+0000 7f84b2db6700 1 Processor -- start 2023-10-14T19:11:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.861+0000 7f84b2db6700 1 -- start start 2023-10-14T19:11:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b2db6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f84ac0cb5a0 0x7f84ac0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b2db6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84ac0cd9e0 0x7f84ac159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b2db6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac15ae40 con 0x7f84ac15a400 2023-10-14T19:11:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b2db6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac0d13f0 con 0x7f84ac0cd9e0 2023-10-14T19:11:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b2db6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac15ab60 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84abfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84ac0cd9e0 0x7f84ac159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b1353700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f84ac15a400 0x7f84ac156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55364/0 (socket says 172.21.15.7:55364) 2023-10-14T19:11:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84abfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84ac0cd9e0 0x7f84ac159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58760/0 (socket says 172.21.15.7:58760) 2023-10-14T19:11:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.862+0000 7f84b1353700 1 -- 172.21.15.7:0/918328622 learned_addr learned my addr 172.21.15.7:0/918328622 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84b0b52700 1 --2- 172.21.15.7:0/918328622 >> v2:172.21.15.148:3300/0 conn(0x7f84ac0cb5a0 0x7f84ac0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84abfff700 1 -- 172.21.15.7:0/918328622 >> v2:172.21.15.148:3300/0 conn(0x7f84ac0cb5a0 msgr2=0x7f84ac0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84abfff700 1 --2- 172.21.15.7:0/918328622 >> v2:172.21.15.148:3300/0 conn(0x7f84ac0cb5a0 0x7f84ac0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84abfff700 1 -- 172.21.15.7:0/918328622 >> v1:172.21.15.7:6789/0 conn(0x7f84ac15a400 legacy=0x7f84ac156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84abfff700 1 -- 172.21.15.7:0/918328622 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0ccf00 con 0x7f84ac0cd9e0 2023-10-14T19:11:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84b0b52700 1 --2- 172.21.15.7:0/918328622 >> v2:172.21.15.148:3300/0 conn(0x7f84ac0cb5a0 0x7f84ac0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84ab7fe700 1 -- 172.21.15.7:0/918328622 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027109200 0 0) 0x7f84ac15ae40 con 0x7f84ac15a400 2023-10-14T19:11:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84abfff700 1 --2- 172.21.15.7:0/918328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac159ec0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f849c009e60 tx=0x7f849c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7f73f6ab325c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84ab7fe700 1 -- 172.21.15.7:0/918328622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00e070 con 0x7f84ac0cd9e0 2023-10-14T19:11:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84ab7fe700 1 -- 172.21.15.7:0/918328622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c00bbf0 con 0x7f84ac0cd9e0 2023-10-14T19:11:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84ab7fe700 1 -- 172.21.15.7:0/918328622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c012430 con 0x7f84ac0cd9e0 2023-10-14T19:11:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84b2db6700 1 -- 172.21.15.7:0/918328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cd9e0 msgr2=0x7f84ac159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.863+0000 7f84b2db6700 1 --2- 172.21.15.7:0/918328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac159ec0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f849c009e60 tx=0x7f849c009780 comp rx=0 tx=0).stop 2023-10-14T19:11:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.864+0000 7f84b2db6700 1 -- 172.21.15.7:0/918328622 shutdown_connections 2023-10-14T19:11:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.864+0000 7f84b2db6700 1 --2- 172.21.15.7:0/918328622 >> v2:172.21.15.148:3300/0 conn(0x7f84ac0cb5a0 0x7f84ac0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.864+0000 7f84b2db6700 1 --2- 172.21.15.7:0/918328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac159ec0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.864+0000 7f84b2db6700 1 -- 172.21.15.7:0/918328622 >> 172.21.15.7:0/918328622 conn(0x7f84ac070e30 msgr2=0x7f84ac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.864+0000 7f84b2db6700 1 -- 172.21.15.7:0/918328622 shutdown_connections 2023-10-14T19:11:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.864+0000 7f84b2db6700 1 -- 172.21.15.7:0/918328622 wait complete. 2023-10-14T19:11:34.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.865+0000 7f84b2db6700 1 Processor -- start 2023-10-14T19:11:34.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.865+0000 7f84b2db6700 1 -- start start 2023-10-14T19:11:34.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 0x7f84ac0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84ac15a400 0x7f84ac15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0c9810 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0c9af0 con 0x7f84ac0cd9e0 2023-10-14T19:11:34.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0c9dd0 con 0x7f84ac15a400 2023-10-14T19:11:34.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 0x7f84ac0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 0x7f84ac0c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58764/0 (socket says 172.21.15.7:58764) 2023-10-14T19:11:34.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 -- 172.21.15.7:0/1613141749 learned_addr learned my addr 172.21.15.7:0/1613141749 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:34.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84abfff700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b1353700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84ac15a400 0x7f84ac15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 -- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84ac15a400 msgr2=0x7f84ac15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84ac15a400 0x7f84ac15c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 -- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84ac0cd9e0 msgr2=0x7f84ac0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:34.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:34.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 -- 172.21.15.7:0/1613141749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c009a20 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b0b52700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 0x7f84ac0c8a40 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f84a400e8d0 tx=0x7f84a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40093b0 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4013410 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac0ca0b0 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40137b0 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.866+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac152820 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.867+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac0b3680 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.868+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f84a4013be0 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.868+0000 7f84a8ff9700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f848c067320 0x7f848c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.868+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f84a4084f40 con 0x7f84ac0cb5a0 2023-10-14T19:11:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.869+0000 7f84abfff700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f848c067320 0x7f848c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.869+0000 7f84abfff700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f848c067320 0x7f848c0697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f849c0099f0 tx=0x7f849c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:34.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:34.873+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84a40518a0 con 0x7f84ac0cb5a0 2023-10-14T19:11:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.066+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84ac04c3c0 con 0x7f84ac0cb5a0 2023-10-14T19:11:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.067+0000 7f84a8ff9700 1 -- 172.21.15.7:0/1613141749 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f84a4020090 con 0x7f84ac0cb5a0 2023-10-14T19:11:35.068 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:35.068 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":170,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:33.959795+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000819117.meta","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000819117"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-14T19:11:29.275510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f848c067320 msgr2=0x7f848c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f848c067320 0x7f848c0697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f849c0099f0 tx=0x7f849c019000 comp rx=0 tx=0).stop 2023-10-14T19:11:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 msgr2=0x7f84ac0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 0x7f84ac0c8a40 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f84a400e8d0 tx=0x7f84a4008040 comp rx=0 tx=0).stop 2023-10-14T19:11:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 shutdown_connections 2023-10-14T19:11:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f848c067320 0x7f848c0697d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84ac15a400 0x7f84ac15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ac0cb5a0 0x7f84ac0c8a40 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 --2- 172.21.15.7:0/1613141749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84ac0cd9e0 0x7f84ac0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 >> 172.21.15.7:0/1613141749 conn(0x7f84ac070e30 msgr2=0x7f84ac0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 shutdown_connections 2023-10-14T19:11:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.069+0000 7f84b2db6700 1 -- 172.21.15.7:0/1613141749 wait complete. 2023-10-14T19:11:35.082 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:11:35.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:11:35.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:11:35.165 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:11:35.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:35.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.285+0000 7fc4c152b700 1 Processor -- start 2023-10-14T19:11:35.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.285+0000 7fc4c152b700 1 -- start start 2023-10-14T19:11:35.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4c152b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4c152b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc15e010 con 0x7fc4bc0cf180 2023-10-14T19:11:35.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4c152b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc15d420 con 0x7fc4bc1594d0 2023-10-14T19:11:35.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4c152b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15d6e0 con 0x7fc4bc0cb1a0 2023-10-14T19:11:35.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4ba7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc4bc0cf180 0x7fc4bc0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55368/0 (socket says 172.21.15.7:55368) 2023-10-14T19:11:35.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4ba7fc700 1 -- 172.21.15.7:0/623682961 learned_addr learned my addr 172.21.15.7:0/623682961 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:35.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4bb7fe700 1 --2- 172.21.15.7:0/623682961 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730268025 0 0) 0x7fc4bc15e010 con 0x7fc4bc0cf180 2023-10-14T19:11:35.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.286+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a4003570 con 0x7fc4bc0cf180 2023-10-14T19:11:35.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213779908 0 0) 0x7fc4bc15d420 con 0x7fc4bc1594d0 2023-10-14T19:11:35.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc15e010 con 0x7fc4bc1594d0 2023-10-14T19:11:35.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 961038406 0 0) 0x7fc4a4003570 con 0x7fc4bc0cf180 2023-10-14T19:11:35.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4bb7fe700 1 -- 172.21.15.7:0/623682961 >> v1:172.21.15.148:6789/0 conn(0x7fc4bc1594d0 legacy=0x7fc4bc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4bb7fe700 1 -- 172.21.15.7:0/623682961 >> v1:172.21.15.7:6789/0 conn(0x7fc4bc0cf180 legacy=0x7fc4bc0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4bb7fe700 1 -- 172.21.15.7:0/623682961 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc15d9c0 con 0x7fc4bc0cb1a0 2023-10-14T19:11:35.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4bb7fe700 1 --2- 172.21.15.7:0/623682961 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc164640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009e90 tx=0x7fc4b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96fb066e18e3fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:35.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400e070 con 0x7fc4bc0cb1a0 2023-10-14T19:11:35.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400b870 con 0x7fc4bc0cb1a0 2023-10-14T19:11:35.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4b9ffb700 1 -- 172.21.15.7:0/623682961 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0001470 con 0x7fc4bc0cb1a0 2023-10-14T19:11:35.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4c152b700 1 -- 172.21.15.7:0/623682961 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 msgr2=0x7fc4bc164640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4c152b700 1 --2- 172.21.15.7:0/623682961 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc164640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009e90 tx=0x7fc4b4009780 comp rx=0 tx=0).stop 2023-10-14T19:11:35.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4c152b700 1 -- 172.21.15.7:0/623682961 shutdown_connections 2023-10-14T19:11:35.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.287+0000 7fc4c152b700 1 --2- 172.21.15.7:0/623682961 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc164640 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.288+0000 7fc4c152b700 1 -- 172.21.15.7:0/623682961 >> 172.21.15.7:0/623682961 conn(0x7fc4bc0703a0 msgr2=0x7fc4bc070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:35.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.288+0000 7fc4c152b700 1 -- 172.21.15.7:0/623682961 shutdown_connections 2023-10-14T19:11:35.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.288+0000 7fc4c152b700 1 -- 172.21.15.7:0/623682961 wait complete. 2023-10-14T19:11:35.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.289+0000 7fc4c152b700 1 Processor -- start 2023-10-14T19:11:35.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.289+0000 7fc4c152b700 1 -- start start 2023-10-14T19:11:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 0x7fc4bc0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4bc1594d0 0x7fc4bc0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b0c20 con 0x7fc4bc0cf180 2023-10-14T19:11:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b14c0 con 0x7fc4bc1594d0 2023-10-14T19:11:35.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c87f0 con 0x7fc4bc0cb1a0 2023-10-14T19:11:35.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 0x7fc4bc0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 0x7fc4bc0c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58768/0 (socket says 172.21.15.7:58768) 2023-10-14T19:11:35.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 -- 172.21.15.7:0/2491779852 learned_addr learned my addr 172.21.15.7:0/2491779852 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:35.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4baffd700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4bb7fe700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4bc1594d0 0x7fc4bc0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 -- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 msgr2=0x7fc4bc159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 -- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4bc1594d0 msgr2=0x7fc4bc0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4bc1594d0 0x7fc4bc0b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 -- 172.21.15.7:0/2491779852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009a20 con 0x7fc4bc0cf180 2023-10-14T19:11:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4ba7fc700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 0x7fc4bc0c7fb0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000c8e0 tx=0x7fc4b00019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000ce20 con 0x7fc4bc0cf180 2023-10-14T19:11:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b0005b10 con 0x7fc4bc0cf180 2023-10-14T19:11:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0b0e70 con 0x7fc4bc0cf180 2023-10-14T19:11:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.290+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00070f0 con 0x7fc4bc0cf180 2023-10-14T19:11:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.291+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0c84f0 con 0x7fc4bc0cf180 2023-10-14T19:11:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.291+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc0b1630 con 0x7fc4bc0cf180 2023-10-14T19:11:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.292+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc4b0007460 con 0x7fc4bc0cf180 2023-10-14T19:11:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.292+0000 7fc4a2ffd700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc4a8067320 0x7fc4a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.292+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fc4b0084bb0 con 0x7fc4bc0cf180 2023-10-14T19:11:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.292+0000 7fc4baffd700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc4a8067320 0x7fc4a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.293+0000 7fc4baffd700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc4a8067320 0x7fc4a80697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0b2a10 tx=0x7fc4ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.297+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4b00516e0 con 0x7fc4bc0cf180 2023-10-14T19:11:35.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.534+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4bc04c3c0 con 0x7fc4bc0cf180 2023-10-14T19:11:35.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.534+0000 7fc4a2ffd700 1 -- 172.21.15.7:0/2491779852 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4624 (secure 0 0 0) 0x7fc4b0054d00 con 0x7fc4bc0cf180 2023-10-14T19:11:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:35.536 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:32.952866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000819117","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:35.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc4a8067320 msgr2=0x7fc4a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc4a8067320 0x7fc4a80697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0b2a10 tx=0x7fc4ac009040 comp rx=0 tx=0).stop 2023-10-14T19:11:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 msgr2=0x7fc4bc0c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 0x7fc4bc0c7fb0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000c8e0 tx=0x7fc4b00019d0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 shutdown_connections 2023-10-14T19:11:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc4a8067320 0x7fc4a80697d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4bc1594d0 0x7fc4bc0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 --2- 172.21.15.7:0/2491779852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4bc0cf180 0x7fc4bc0c7fb0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.536+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 >> 172.21.15.7:0/2491779852 conn(0x7fc4bc0703a0 msgr2=0x7fc4bc1499d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:35.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.537+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 shutdown_connections 2023-10-14T19:11:35.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.537+0000 7fc4c152b700 1 -- 172.21.15.7:0/2491779852 wait complete. 2023-10-14T19:11:35.540 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 114 2023-10-14T19:11:35.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:35.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.670+0000 7fcfaa4fa700 1 Processor -- start 2023-10-14T19:11:35.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.670+0000 7fcfaa4fa700 1 -- start start 2023-10-14T19:11:35.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfaa4fa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcfa40b07d0 0x7fcfa40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfaa4fa700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcfa40cf200 0x7fcfa40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfaa4fa700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa415a280 con 0x7fcfa40b0ba0 2023-10-14T19:11:35.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfaa4fa700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa406e180 con 0x7fcfa40cf200 2023-10-14T19:11:35.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfaa4fa700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa40cd540 con 0x7fcfa40b07d0 2023-10-14T19:11:35.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcfa40cf200 0x7fcfa40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfa8a97700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcfa40b0ba0 0x7fcfa406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55380/0 (socket says 172.21.15.7:55380) 2023-10-14T19:11:35.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcfa40cf200 0x7fcfa40cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58782/0 (socket says 172.21.15.7:58782) 2023-10-14T19:11:35.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfa8a97700 1 -- 172.21.15.7:0/4194754790 learned_addr learned my addr 172.21.15.7:0/4194754790 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:35.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.671+0000 7fcfa3fff700 1 --2- 172.21.15.7:0/4194754790 >> v2:172.21.15.148:3300/0 conn(0x7fcfa40b07d0 0x7fcfa40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa37fe700 1 -- 172.21.15.7:0/4194754790 >> v2:172.21.15.148:3300/0 conn(0x7fcfa40b07d0 msgr2=0x7fcfa40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:35.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa37fe700 1 --2- 172.21.15.7:0/4194754790 >> v2:172.21.15.148:3300/0 conn(0x7fcfa40b07d0 0x7fcfa40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa37fe700 1 -- 172.21.15.7:0/4194754790 >> v1:172.21.15.7:6789/0 conn(0x7fcfa40b0ba0 legacy=0x7fcfa406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa37fe700 1 -- 172.21.15.7:0/4194754790 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa406d850 con 0x7fcfa40cf200 2023-10-14T19:11:35.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa3fff700 1 --2- 172.21.15.7:0/4194754790 >> v2:172.21.15.148:3300/0 conn(0x7fcfa40b07d0 0x7fcfa40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:35.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa37fe700 1 --2- 172.21.15.7:0/4194754790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa40cd000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4064720 tx=0x7fcf980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b931ec2e148713 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:35.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa2ffd700 1 -- 172.21.15.7:0/4194754790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800b740 con 0x7fcfa40cf200 2023-10-14T19:11:35.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa2ffd700 1 -- 172.21.15.7:0/4194754790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9800b8a0 con 0x7fcfa40cf200 2023-10-14T19:11:35.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfa2ffd700 1 -- 172.21.15.7:0/4194754790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800bc40 con 0x7fcfa40cf200 2023-10-14T19:11:35.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/4194754790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 msgr2=0x7fcfa40cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/4194754790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa40cd000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4064720 tx=0x7fcf980091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/4194754790 shutdown_connections 2023-10-14T19:11:35.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/4194754790 >> v2:172.21.15.148:3300/0 conn(0x7fcfa40b07d0 0x7fcfa40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/4194754790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa40cd000 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.672+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/4194754790 >> 172.21.15.7:0/4194754790 conn(0x7fcfa406ce80 msgr2=0x7fcfa40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:35.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.673+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/4194754790 shutdown_connections 2023-10-14T19:11:35.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.673+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/4194754790 wait complete. 2023-10-14T19:11:35.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 Processor -- start 2023-10-14T19:11:35.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 -- start start 2023-10-14T19:11:35.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfa40b07d0 0x7fcfa4148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfa40b0ba0 0x7fcfa415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415e7f0 con 0x7fcfa40cf200 2023-10-14T19:11:35.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415e230 con 0x7fcfa40b07d0 2023-10-14T19:11:35.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.674+0000 7fcfaa4fa700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415e510 con 0x7fcfa40b0ba0 2023-10-14T19:11:35.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa415c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58798/0 (socket says 172.21.15.7:58798) 2023-10-14T19:11:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 -- 172.21.15.7:0/3397891162 learned_addr learned my addr 172.21.15.7:0/3397891162 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa3fff700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfa40b07d0 0x7fcfa4148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa37fe700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfa40b0ba0 0x7fcfa415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 -- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfa40b0ba0 msgr2=0x7fcfa415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfa40b0ba0 0x7fcfa415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 -- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfa40b07d0 msgr2=0x7fcfa4148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfa40b07d0 0x7fcfa4148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 -- 172.21.15.7:0/3397891162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009420 con 0x7fcfa40cf200 2023-10-14T19:11:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfa8a97700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa415c800 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00cc40 tx=0x7fcf9c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00a910 con 0x7fcfa40cf200 2023-10-14T19:11:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00aa70 con 0x7fcfa40cf200 2023-10-14T19:11:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4098370 con 0x7fcfa40cf200 2023-10-14T19:11:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00ae30 con 0x7fcfa40cf200 2023-10-14T19:11:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.675+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa4148840 con 0x7fcfa40cf200 2023-10-14T19:11:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.676+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40981d0 con 0x7fcfa40cf200 2023-10-14T19:11:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.677+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcf9c007300 con 0x7fcfa40cf200 2023-10-14T19:11:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.677+0000 7fcf8bfff700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcf90067320 0x7fcf900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.677+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fcf9c085180 con 0x7fcfa40cf200 2023-10-14T19:11:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.677+0000 7fcfa3fff700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcf90067320 0x7fcf900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.678+0000 7fcfa3fff700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcf90067320 0x7fcf900697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcf94006ea0 tx=0x7fcf94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:35.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.681+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfa40981d0 con 0x7fcfa40cf200 2023-10-14T19:11:35.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.876+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa40981d0 con 0x7fcfa40cf200 2023-10-14T19:11:35.878 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.877+0000 7fcf8bfff700 1 -- 172.21.15.7:0/3397891162 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7fcfa40981d0 con 0x7fcfa40cf200 2023-10-14T19:11:35.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:35.879 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":170,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:33.959795+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000819117.meta","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000819117"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-14T19:11:29.275510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:35.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcf90067320 msgr2=0x7fcf900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcf90067320 0x7fcf900697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcf94006ea0 tx=0x7fcf94008040 comp rx=0 tx=0).stop 2023-10-14T19:11:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 msgr2=0x7fcfa415c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa415c800 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00cc40 tx=0x7fcf9c001a50 comp rx=0 tx=0).stop 2023-10-14T19:11:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 shutdown_connections 2023-10-14T19:11:35.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcf90067320 0x7fcf900697d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfa40b07d0 0x7fcfa4148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa40cf200 0x7fcfa415c800 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 --2- 172.21.15.7:0/3397891162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfa40b0ba0 0x7fcfa415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.879+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 >> 172.21.15.7:0/3397891162 conn(0x7fcfa406ce80 msgr2=0x7fcfa40cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.880+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 shutdown_connections 2023-10-14T19:11:35.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:35.880+0000 7fcfaa4fa700 1 -- 172.21.15.7:0/3397891162 wait complete. 2023-10-14T19:11:35.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 28, 'pool_name': 'cephfs.volume_0000000000819117.meta', 'create_time': '2023-10-14T19:11:12.605229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000819117'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:11:13.244514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000819117'}}}, {'pool': 30, 'pool_name': 'another-data-pool', 'create_time': '2023-10-14T19:11:29.275510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000819117'}}}] 2023-10-14T19:11:35.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:11:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.015+0000 7fb5df26a700 1 Processor -- start 2023-10-14T19:11:36.016 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.015+0000 7fb5df26a700 1 -- start start 2023-10-14T19:11:36.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5df26a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d8159530 0x7fb5d80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5df26a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5d806dc70 0x7fb5d8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5df26a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d80ccfd0 con 0x7fb5d806e0e0 2023-10-14T19:11:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5df26a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d80cf0e0 con 0x7fb5d8159530 2023-10-14T19:11:36.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5df26a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d815a3d0 con 0x7fb5d806dc70 2023-10-14T19:11:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5dd006700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d8159530 0x7fb5d80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5dd807700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb5d806e0e0 0x7fb5d80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55396/0 (socket says 172.21.15.7:55396) 2023-10-14T19:11:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5dd807700 1 -- 172.21.15.7:0/2246498055 learned_addr learned my addr 172.21.15.7:0/2246498055 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.016+0000 7fb5dc805700 1 --2- 172.21.15.7:0/2246498055 >> v2:172.21.15.148:3300/0 conn(0x7fb5d806dc70 0x7fb5d8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5dd006700 1 -- 172.21.15.7:0/2246498055 >> v2:172.21.15.148:3300/0 conn(0x7fb5d806dc70 msgr2=0x7fb5d8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:36.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5dd006700 1 --2- 172.21.15.7:0/2246498055 >> v2:172.21.15.148:3300/0 conn(0x7fb5d806dc70 0x7fb5d8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5dd006700 1 -- 172.21.15.7:0/2246498055 >> v1:172.21.15.7:6789/0 conn(0x7fb5d806e0e0 legacy=0x7fb5d80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5dd006700 1 -- 172.21.15.7:0/2246498055 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d815a6b0 con 0x7fb5d8159530 2023-10-14T19:11:36.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5dc805700 1 --2- 172.21.15.7:0/2246498055 >> v2:172.21.15.148:3300/0 conn(0x7fb5d806dc70 0x7fb5d8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:36.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5dd006700 1 --2- 172.21.15.7:0/2246498055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d8159530 0x7fb5d80ceba0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80b66e0 tx=0x7fb5d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8551354a97c0db54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5d7fff700 1 -- 172.21.15.7:0/2246498055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000b6b0 con 0x7fb5d8159530 2023-10-14T19:11:36.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5d7fff700 1 -- 172.21.15.7:0/2246498055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d000b810 con 0x7fb5d8159530 2023-10-14T19:11:36.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5d7fff700 1 -- 172.21.15.7:0/2246498055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000bbb0 con 0x7fb5d8159530 2023-10-14T19:11:36.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5df26a700 1 -- 172.21.15.7:0/2246498055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d8159530 msgr2=0x7fb5d80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5df26a700 1 --2- 172.21.15.7:0/2246498055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d8159530 0x7fb5d80ceba0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80b66e0 tx=0x7fb5d00091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5df26a700 1 -- 172.21.15.7:0/2246498055 shutdown_connections 2023-10-14T19:11:36.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5df26a700 1 --2- 172.21.15.7:0/2246498055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d8159530 0x7fb5d80ceba0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5df26a700 1 --2- 172.21.15.7:0/2246498055 >> v2:172.21.15.148:3300/0 conn(0x7fb5d806dc70 0x7fb5d8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.017+0000 7fb5df26a700 1 -- 172.21.15.7:0/2246498055 >> 172.21.15.7:0/2246498055 conn(0x7fb5d80703a0 msgr2=0x7fb5d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:36.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.018+0000 7fb5df26a700 1 -- 172.21.15.7:0/2246498055 shutdown_connections 2023-10-14T19:11:36.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.018+0000 7fb5df26a700 1 -- 172.21.15.7:0/2246498055 wait complete. 2023-10-14T19:11:36.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.019+0000 7fb5df26a700 1 Processor -- start 2023-10-14T19:11:36.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.019+0000 7fb5df26a700 1 -- start start 2023-10-14T19:11:36.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 0x7fb5d816d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5d806e0e0 0x7fb5d80b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5d8159530 0x7fb5d80cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d816ae90 con 0x7fb5d806dc70 2023-10-14T19:11:36.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80b64d0 con 0x7fb5d806e0e0 2023-10-14T19:11:36.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d816e010 con 0x7fb5d8159530 2023-10-14T19:11:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 0x7fb5d816d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 0x7fb5d816d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58810/0 (socket says 172.21.15.7:58810) 2023-10-14T19:11:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 -- 172.21.15.7:0/697310802 learned_addr learned my addr 172.21.15.7:0/697310802 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dc805700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5d806e0e0 0x7fb5d80b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 -- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5d8159530 msgr2=0x7fb5d80cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd807700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5d8159530 0x7fb5d80cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5d8159530 0x7fb5d80cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 -- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5d806e0e0 msgr2=0x7fb5d80b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5d806e0e0 0x7fb5d80b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 -- 172.21.15.7:0/697310802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0009420 con 0x7fb5d806dc70 2023-10-14T19:11:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dc805700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5d806e0e0 0x7fb5d80b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5dd006700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 0x7fb5d816d120 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00097b0 tx=0x7fb5d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0011420 con 0x7fb5d806dc70 2023-10-14T19:11:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0011580 con 0x7fb5d806dc70 2023-10-14T19:11:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0011920 con 0x7fb5d806dc70 2023-10-14T19:11:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.020+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d816d770 con 0x7fb5d806dc70 2023-10-14T19:11:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.021+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d816dd30 con 0x7fb5d806dc70 2023-10-14T19:11:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.021+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d804c3c0 con 0x7fb5d806dc70 2023-10-14T19:11:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.022+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb5d0011cd0 con 0x7fb5d806dc70 2023-10-14T19:11:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.022+0000 7fb5d57fa700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5c4067320 0x7fb5c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.022+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb5d00865d0 con 0x7fb5d806dc70 2023-10-14T19:11:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.022+0000 7fb5dc805700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5c4067320 0x7fb5c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.023+0000 7fb5dc805700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5c4067320 0x7fb5c40697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb5d816d6a0 tx=0x7fb5cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.026+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5d00530c0 con 0x7fb5d806dc70 2023-10-14T19:11:36.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.220+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5d815a990 con 0x7fb5d806dc70 2023-10-14T19:11:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.221+0000 7fb5d57fa700 1 -- 172.21.15.7:0/697310802 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5d00566e0 con 0x7fb5d806dc70 2023-10-14T19:11:36.222 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:11:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5c4067320 msgr2=0x7fb5c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5c4067320 0x7fb5c40697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb5d816d6a0 tx=0x7fb5cc008040 comp rx=0 tx=0).stop 2023-10-14T19:11:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 msgr2=0x7fb5d816d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 0x7fb5d816d120 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00097b0 tx=0x7fb5d0017000 comp rx=0 tx=0).stop 2023-10-14T19:11:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 shutdown_connections 2023-10-14T19:11:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb5c4067320 0x7fb5c40697d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5d8159530 0x7fb5d80cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806dc70 0x7fb5d816d120 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 --2- 172.21.15.7:0/697310802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5d806e0e0 0x7fb5d80b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 >> 172.21.15.7:0/697310802 conn(0x7fb5d80703a0 msgr2=0x7fb5d815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:36.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 shutdown_connections 2023-10-14T19:11:36.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.223+0000 7fb5df26a700 1 -- 172.21.15.7:0/697310802 wait complete. 2023-10-14T19:11:36.236 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000819117.meta pg_num 2023-10-14T19:11:36.358 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 Processor -- start 2023-10-14T19:11:36.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 -- start start 2023-10-14T19:11:36.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 0x7f7f80159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f8006e0e0 0x7f7f800cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f800ccfd0 con 0x7f7f80159530 2023-10-14T19:11:36.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8015a3d0 con 0x7f7f8006e0e0 2023-10-14T19:11:36.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.358+0000 7f7f866da700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8015a6b0 con 0x7f7f8006dc70 2023-10-14T19:11:36.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7f80159530 0x7f7f800ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55412/0 (socket says 172.21.15.7:55412) 2023-10-14T19:11:36.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7ffff700 1 -- 172.21.15.7:0/415583346 learned_addr learned my addr 172.21.15.7:0/415583346 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:36.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7f7fe700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 0x7f7f80159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f84c77700 1 --2- 172.21.15.7:0/415583346 >> v2:172.21.15.148:3300/0 conn(0x7f7f8006e0e0 0x7f7f800cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266651428 0 0) 0x7f7f800ccfd0 con 0x7f7f80159530 2023-10-14T19:11:36.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f68003570 con 0x7f7f80159530 2023-10-14T19:11:36.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281187708 0 0) 0x7f7f68003570 con 0x7f7f80159530 2023-10-14T19:11:36.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 msgr2=0x7f7f80159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:36.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 0x7f7f80159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 >> v2:172.21.15.148:3300/0 conn(0x7f7f8006e0e0 msgr2=0x7f7f800cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:36.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 --2- 172.21.15.7:0/415583346 >> v2:172.21.15.148:3300/0 conn(0x7f7f8006e0e0 0x7f7f800cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8015a990 con 0x7f7f80159530 2023-10-14T19:11:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f7f70001470 con 0x7f7f80159530 2023-10-14T19:11:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f84c77700 1 --2- 172.21.15.7:0/415583346 >> v2:172.21.15.148:3300/0 conn(0x7f7f8006e0e0 0x7f7f800cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 >> v1:172.21.15.7:6789/0 conn(0x7f7f80159530 legacy=0x7f7f800ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f68003a60 0x7f7f68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 0x7f7f68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68004d50 0x7f7f680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8015a3d0 con 0x7f7f68003a60 2023-10-14T19:11:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8015a6b0 con 0x7f7f68004d50 2023-10-14T19:11:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6800ba60 con 0x7f7f8006dc70 2023-10-14T19:11:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.359+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f68003a60 0x7f7f68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7f7fe700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 0x7f7f68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f84c77700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68004d50 0x7f7f680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7ffff700 1 -- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 msgr2=0x7f7f68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8006dc70 0x7f7f68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7ffff700 1 -- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68004d50 msgr2=0x7f7f680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68004d50 0x7f7f680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7ffff700 1 -- 172.21.15.7:0/415583346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68003570 con 0x7f7f68003a60 2023-10-14T19:11:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f68003a60 0x7f7f68003e70 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c3c0 tx=0x7f7f800ccf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e289ea2c0ec072d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000cc30 con 0x7f7f68003a60 2023-10-14T19:11:36.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000cd90 con 0x7f7f68003a60 2023-10-14T19:11:36.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f7effd700 1 -- 172.21.15.7:0/415583346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70005b70 con 0x7f7f68003a60 2023-10-14T19:11:36.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.360+0000 7f7f866da700 1 -- 172.21.15.7:0/415583346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f68003a60 msgr2=0x7f7f68003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.361+0000 7f7f866da700 1 --2- 172.21.15.7:0/415583346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f68003a60 0x7f7f68003e70 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c3c0 tx=0x7f7f800ccf40 comp rx=0 tx=0).stop 2023-10-14T19:11:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.361+0000 7f7f84c77700 1 -- 172.21.15.7:0/415583346 reap_dead start 2023-10-14T19:11:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.361+0000 7f7f866da700 1 -- 172.21.15.7:0/415583346 shutdown_connections 2023-10-14T19:11:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.361+0000 7f7f866da700 1 -- 172.21.15.7:0/415583346 >> 172.21.15.7:0/415583346 conn(0x7f7f800703a0 msgr2=0x7f7f800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.361+0000 7f7f866da700 1 -- 172.21.15.7:0/415583346 shutdown_connections 2023-10-14T19:11:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.361+0000 7f7f866da700 1 -- 172.21.15.7:0/415583346 wait complete. 2023-10-14T19:11:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.362+0000 7f7f866da700 1 Processor -- start 2023-10-14T19:11:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.362+0000 7f7f866da700 1 -- start start 2023-10-14T19:11:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8015e540 0x7f7f8015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 0x7f7f800d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f800cf2d0 0x7f7f800cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801502e0 con 0x7f7f800d0c10 2023-10-14T19:11:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80151140 con 0x7f7f800cf2d0 2023-10-14T19:11:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8015ee50 con 0x7f7f8015e540 2023-10-14T19:11:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 0x7f7f800d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 0x7f7f800d1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58836/0 (socket says 172.21.15.7:58836) 2023-10-14T19:11:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 -- 172.21.15.7:0/639122597 learned_addr learned my addr 172.21.15.7:0/639122597 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8015e540 0x7f7f8015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f84c77700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f800cf2d0 0x7f7f800cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 -- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8015e540 msgr2=0x7f7f8015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8015e540 0x7f7f8015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 -- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f800cf2d0 msgr2=0x7f7f800cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f800cf2d0 0x7f7f800cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 -- 172.21.15.7:0/639122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80150530 con 0x7f7f800d0c10 2023-10-14T19:11:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f7f7fe700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 0x7f7f800d1080 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f7f74011990 tx=0x7f7f74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400f650 con 0x7f7f800d0c10 2023-10-14T19:11:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400f7b0 con 0x7f7f800d0c10 2023-10-14T19:11:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f80150810 con 0x7f7f800d0c10 2023-10-14T19:11:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400fb70 con 0x7f7f800d0c10 2023-10-14T19:11:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.363+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f80150dd0 con 0x7f7f800d0c10 2023-10-14T19:11:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.364+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f800cbbc0 con 0x7f7f800d0c10 2023-10-14T19:11:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.365+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7f74015460 con 0x7f7f800d0c10 2023-10-14T19:11:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.365+0000 7f7f67fff700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f6c067320 0x7f7f6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.365+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f7f74085620 con 0x7f7f800d0c10 2023-10-14T19:11:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.365+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f6c067320 0x7f7f6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.366+0000 7f7f7ffff700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f6c067320 0x7f7f6c0697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7f80071370 tx=0x7f7f70015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.369+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f740520d0 con 0x7f7f800d0c10 2023-10-14T19:11:36.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.562+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000819117.meta", "var": "pg_num"} v 0) v1 -- 0x7f7f8004c3c0 con 0x7f7f800d0c10 2023-10-14T19:11:36.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.562+0000 7f7f67fff700 1 -- 172.21.15.7:0/639122597 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000819117.meta", "var": "pg_num"}]=0 v170) v1 ==== 124+0+11 (secure 0 0 0) 0x7f7f740556f0 con 0x7f7f800d0c10 2023-10-14T19:11:36.563 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:11:36.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f6c067320 msgr2=0x7f7f6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f6c067320 0x7f7f6c0697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7f80071370 tx=0x7f7f70015000 comp rx=0 tx=0).stop 2023-10-14T19:11:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 msgr2=0x7f7f800d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 0x7f7f800d1080 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f7f74011990 tx=0x7f7f74008040 comp rx=0 tx=0).stop 2023-10-14T19:11:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 shutdown_connections 2023-10-14T19:11:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f6c067320 0x7f7f6c0697d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f800cf2d0 0x7f7f800cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f8015e540 0x7f7f8015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 --2- 172.21.15.7:0/639122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f800d0c10 0x7f7f800d1080 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 >> 172.21.15.7:0/639122597 conn(0x7f7f800703a0 msgr2=0x7f7f800cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 shutdown_connections 2023-10-14T19:11:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.564+0000 7f7f866da700 1 -- 172.21.15.7:0/639122597 wait complete. 2023-10-14T19:11:36.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:11:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.698+0000 7fed2b42a700 1 Processor -- start 2023-10-14T19:11:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.698+0000 7fed2b42a700 1 -- start start 2023-10-14T19:11:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed2b42a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed24159860 0x7fed240ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed2b42a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed240cbd90 0x7fed240cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed2b42a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed240cf510 con 0x7fed240ccfa0 2023-10-14T19:11:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed2b42a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed240cc1e0 con 0x7fed240cbd90 2023-10-14T19:11:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed2b42a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed240ce900 con 0x7fed24159860 2023-10-14T19:11:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed289c5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed240cbd90 0x7fed240cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed299c7700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fed240ccfa0 0x7fed240cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38038/0 (socket says 172.21.15.7:38038) 2023-10-14T19:11:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.699+0000 7fed299c7700 1 -- 172.21.15.7:0/2376025486 learned_addr learned my addr 172.21.15.7:0/2376025486 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed291c6700 1 --2- 172.21.15.7:0/2376025486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed24159860 0x7fed240ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed289c5700 1 -- 172.21.15.7:0/2376025486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed24159860 msgr2=0x7fed240ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed289c5700 1 --2- 172.21.15.7:0/2376025486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed24159860 0x7fed240ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed289c5700 1 -- 172.21.15.7:0/2376025486 >> v1:172.21.15.7:6789/0 conn(0x7fed240ccfa0 legacy=0x7fed240cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed289c5700 1 -- 172.21.15.7:0/2376025486 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240cebe0 con 0x7fed240cbd90 2023-10-14T19:11:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed1bfff700 1 -- 172.21.15.7:0/2376025486 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265741551 0 0) 0x7fed240cf510 con 0x7fed240ccfa0 2023-10-14T19:11:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed289c5700 1 --2- 172.21.15.7:0/2376025486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed240cf9a0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fed140098d0 tx=0x7fed14009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cf508ca2288c95 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed1bfff700 1 -- 172.21.15.7:0/2376025486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14005c10 con 0x7fed240cbd90 2023-10-14T19:11:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed1bfff700 1 -- 172.21.15.7:0/2376025486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed14005d70 con 0x7fed240cbd90 2023-10-14T19:11:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.700+0000 7fed1bfff700 1 -- 172.21.15.7:0/2376025486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14006280 con 0x7fed240cbd90 2023-10-14T19:11:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 -- 172.21.15.7:0/2376025486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 msgr2=0x7fed240cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 --2- 172.21.15.7:0/2376025486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed240cf9a0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fed140098d0 tx=0x7fed14009120 comp rx=0 tx=0).stop 2023-10-14T19:11:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 -- 172.21.15.7:0/2376025486 shutdown_connections 2023-10-14T19:11:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 --2- 172.21.15.7:0/2376025486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed24159860 0x7fed240ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 --2- 172.21.15.7:0/2376025486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed240cf9a0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 -- 172.21.15.7:0/2376025486 >> 172.21.15.7:0/2376025486 conn(0x7fed240999b0 msgr2=0x7fed24070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 -- 172.21.15.7:0/2376025486 shutdown_connections 2023-10-14T19:11:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.701+0000 7fed2b42a700 1 -- 172.21.15.7:0/2376025486 wait complete. 2023-10-14T19:11:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.702+0000 7fed2b42a700 1 Processor -- start 2023-10-14T19:11:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.702+0000 7fed2b42a700 1 -- start start 2023-10-14T19:11:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed2b42a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed2409c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed2b42a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed240ccfa0 0x7fed241579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed2b42a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed24159860 0x7fed2409ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed2b42a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2409be40 con 0x7fed240cbd90 2023-10-14T19:11:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed2b42a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2409b230 con 0x7fed24159860 2023-10-14T19:11:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed2b42a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2409b510 con 0x7fed240ccfa0 2023-10-14T19:11:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed2409c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed2409c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35510/0 (socket says 172.21.15.7:35510) 2023-10-14T19:11:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 -- 172.21.15.7:0/3395132718 learned_addr learned my addr 172.21.15.7:0/3395132718 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed289c5700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed240ccfa0 0x7fed241579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed299c7700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed24159860 0x7fed2409ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 -- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed240ccfa0 msgr2=0x7fed241579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed240ccfa0 0x7fed241579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 -- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed24159860 msgr2=0x7fed2409ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed24159860 0x7fed2409ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed291c6700 1 -- 172.21.15.7:0/3395132718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140093c0 con 0x7fed240cbd90 2023-10-14T19:11:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.703+0000 7fed299c7700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed24159860 0x7fed2409ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.704+0000 7fed291c6700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed2409c2d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fed2000ea00 tx=0x7fed20009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.704+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000c850 con 0x7fed240cbd90 2023-10-14T19:11:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.704+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000c9b0 con 0x7fed240cbd90 2023-10-14T19:11:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.704+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2409b7f0 con 0x7fed240cbd90 2023-10-14T19:11:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.704+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000cd30 con 0x7fed240cbd90 2023-10-14T19:11:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.704+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed24157f00 con 0x7fed240cbd90 2023-10-14T19:11:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.705+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2409c120 con 0x7fed240cbd90 2023-10-14T19:11:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.705+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fed20013680 con 0x7fed240cbd90 2023-10-14T19:11:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.706+0000 7fed197fa700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed08067320 0x7fed080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.706+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fed200855d0 con 0x7fed240cbd90 2023-10-14T19:11:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.706+0000 7fed289c5700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed08067320 0x7fed080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.706+0000 7fed289c5700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed08067320 0x7fed080697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fed14009160 tx=0x7fed14016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.710+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed20052080 con 0x7fed240cbd90 2023-10-14T19:11:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.902+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed2404c3c0 con 0x7fed240cbd90 2023-10-14T19:11:36.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.902+0000 7fed197fa700 1 -- 172.21.15.7:0/3395132718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed200556a0 con 0x7fed240cbd90 2023-10-14T19:11:36.904 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:11:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed08067320 msgr2=0x7fed080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed08067320 0x7fed080697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fed14009160 tx=0x7fed14016000 comp rx=0 tx=0).stop 2023-10-14T19:11:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 msgr2=0x7fed2409c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed2409c2d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fed2000ea00 tx=0x7fed20009120 comp rx=0 tx=0).stop 2023-10-14T19:11:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 shutdown_connections 2023-10-14T19:11:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed08067320 0x7fed080697d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed24159860 0x7fed2409ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed240cbd90 0x7fed2409c2d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 --2- 172.21.15.7:0/3395132718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed240ccfa0 0x7fed241579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:36.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 >> 172.21.15.7:0/3395132718 conn(0x7fed240999b0 msgr2=0x7fed2415bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:36.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 shutdown_connections 2023-10-14T19:11:36.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:36.904+0000 7fed2b42a700 1 -- 172.21.15.7:0/3395132718 wait complete. 2023-10-14T19:11:36.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get another-data-pool pg_num 2023-10-14T19:11:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.040+0000 7f907547b700 1 Processor -- start 2023-10-14T19:11:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.040+0000 7f907547b700 1 -- start start 2023-10-14T19:11:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f907547b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9070159530 0x7f90700ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f907547b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700ccfd0 con 0x7f907006dc70 2023-10-14T19:11:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f907547b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700cf0e0 con 0x7f907006e0e0 2023-10-14T19:11:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f907547b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907015a3d0 con 0x7f9070159530 2023-10-14T19:11:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f906e7fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f907006dc70 0x7f9070159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38046/0 (socket says 172.21.15.7:38046) 2023-10-14T19:11:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f906e7fc700 1 -- 172.21.15.7:0/3042794242 learned_addr learned my addr 172.21.15.7:0/3042794242 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f906effd700 1 --2- 172.21.15.7:0/3042794242 >> v2:172.21.15.148:3300/0 conn(0x7f9070159530 0x7f90700ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f906dffb700 1 -- 172.21.15.7:0/3042794242 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833775010 0 0) 0x7f90700ccfd0 con 0x7f907006dc70 2023-10-14T19:11:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.041+0000 7f906dffb700 1 -- 172.21.15.7:0/3042794242 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f905c003570 con 0x7f907006dc70 2023-10-14T19:11:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906effd700 1 -- 172.21.15.7:0/3042794242 >> v1:172.21.15.148:6789/0 conn(0x7f907006e0e0 legacy=0x7f90700cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906dffb700 1 -- 172.21.15.7:0/3042794242 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1834181939 0 0) 0x7f905c003570 con 0x7f907006dc70 2023-10-14T19:11:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906effd700 1 -- 172.21.15.7:0/3042794242 >> v1:172.21.15.7:6789/0 conn(0x7f907006dc70 legacy=0x7f9070159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906effd700 1 -- 172.21.15.7:0/3042794242 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907015a6b0 con 0x7f9070159530 2023-10-14T19:11:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906effd700 1 --2- 172.21.15.7:0/3042794242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90700ceba0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f90680098e0 tx=0x7f90680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5789a798bec9123 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906dffb700 1 -- 172.21.15.7:0/3042794242 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058001470 con 0x7f9070159530 2023-10-14T19:11:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906dffb700 1 -- 172.21.15.7:0/3042794242 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068011420 con 0x7f9070159530 2023-10-14T19:11:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.042+0000 7f906dffb700 1 -- 172.21.15.7:0/3042794242 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680117a0 con 0x7f9070159530 2023-10-14T19:11:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 -- 172.21.15.7:0/3042794242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 msgr2=0x7f90700ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 --2- 172.21.15.7:0/3042794242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90700ceba0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f90680098e0 tx=0x7f90680091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 -- 172.21.15.7:0/3042794242 shutdown_connections 2023-10-14T19:11:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 --2- 172.21.15.7:0/3042794242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90700ceba0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 -- 172.21.15.7:0/3042794242 >> 172.21.15.7:0/3042794242 conn(0x7f90700703a0 msgr2=0x7f90700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 -- 172.21.15.7:0/3042794242 shutdown_connections 2023-10-14T19:11:37.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.043+0000 7f907547b700 1 -- 172.21.15.7:0/3042794242 wait complete. 2023-10-14T19:11:37.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.044+0000 7f907547b700 1 Processor -- start 2023-10-14T19:11:37.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.044+0000 7f907547b700 1 -- start start 2023-10-14T19:11:37.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 0x7f907014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f907006e0e0 0x7f9070155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90701531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907014e8c0 con 0x7f907006dc70 2023-10-14T19:11:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700ca600 con 0x7f9070159530 2023-10-14T19:11:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9070152d10 con 0x7f907006e0e0 2023-10-14T19:11:37.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 0x7f907014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 0x7f907014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35516/0 (socket says 172.21.15.7:35516) 2023-10-14T19:11:37.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 -- 172.21.15.7:0/141669445 learned_addr learned my addr 172.21.15.7:0/141669445 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:37.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906e7fc700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f907006e0e0 0x7f9070155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906f7fe700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90701531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 -- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f907006e0e0 msgr2=0x7f9070155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f907006e0e0 0x7f9070155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 -- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 msgr2=0x7f90701531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90701531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 -- 172.21.15.7:0/141669445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068009420 con 0x7f907006dc70 2023-10-14T19:11:37.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f906effd700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 0x7f907014e380 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f9070089650 tx=0x7f9068016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906801cce0 con 0x7f907006dc70 2023-10-14T19:11:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906801ce40 con 0x7f907006dc70 2023-10-14T19:11:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90700c9da0 con 0x7f907006dc70 2023-10-14T19:11:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906801a6a0 con 0x7f907006dc70 2023-10-14T19:11:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.045+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90700ca320 con 0x7f907006dc70 2023-10-14T19:11:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.046+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9070152ab0 con 0x7f907006dc70 2023-10-14T19:11:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.047+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f906801aad0 con 0x7f907006dc70 2023-10-14T19:11:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.047+0000 7f9066ffd700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9050067320 0x7f90500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.047+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f9068086820 con 0x7f907006dc70 2023-10-14T19:11:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.047+0000 7f906e7fc700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9050067320 0x7f90500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.048+0000 7f906e7fc700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9050067320 0x7f90500697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f90700b66b0 tx=0x7f9058000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.052+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90680532d0 con 0x7f907006dc70 2023-10-14T19:11:37.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.242+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"} v 0) v1 -- 0x7f9070152ff0 con 0x7f907006dc70 2023-10-14T19:11:37.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.243+0000 7f9066ffd700 1 -- 172.21.15.7:0/141669445 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"}]=0 v170) v1 ==== 106+0+11 (secure 0 0 0) 0x7f90680568f0 con 0x7f907006dc70 2023-10-14T19:11:37.244 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:11:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9050067320 msgr2=0x7f90500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9050067320 0x7f90500697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f90700b66b0 tx=0x7f9058000bc0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 msgr2=0x7f907014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 0x7f907014e380 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f9070089650 tx=0x7f9068016000 comp rx=0 tx=0).stop 2023-10-14T19:11:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 shutdown_connections 2023-10-14T19:11:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9050067320 0x7f90500697d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9070159530 0x7f90701531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f907006dc70 0x7f907014e380 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 --2- 172.21.15.7:0/141669445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f907006e0e0 0x7f9070155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 >> 172.21.15.7:0/141669445 conn(0x7f90700703a0 msgr2=0x7f90700d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 shutdown_connections 2023-10-14T19:11:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.245+0000 7f907547b700 1 -- 172.21.15.7:0/141669445 wait complete. 2023-10-14T19:11:37.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:37.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.376+0000 7fe9f0d2d700 1 Processor -- start 2023-10-14T19:11:37.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.376+0000 7fe9f0d2d700 1 -- start start 2023-10-14T19:11:37.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.377+0000 7fe9f0d2d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9ec0a8be0 0x7fe9ec0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.377+0000 7fe9f0d2d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9ec0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.377+0000 7fe9f0d2d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0ce1a0 con 0x7fe9ec0ae780 2023-10-14T19:11:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.377+0000 7fe9f0d2d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cd5d0 con 0x7fe9ec0a8be0 2023-10-14T19:11:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.377+0000 7fe9f0d2d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cd870 con 0x7fe9ec06d280 2023-10-14T19:11:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.377+0000 7fe9ead9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe9ec0ae780 0x7fe9ec0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38052/0 (socket says 172.21.15.7:38052) 2023-10-14T19:11:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9ead9d700 1 -- 172.21.15.7:0/1299663293 learned_addr learned my addr 172.21.15.7:0/1299663293 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9ec0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9ea59c700 1 --2- 172.21.15.7:0/1299663293 >> v2:172.21.15.148:3300/0 conn(0x7fe9ec0a8be0 0x7fe9ec0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953437506 0 0) 0x7fe9ec0ce1a0 con 0x7fe9ec0ae780 2023-10-14T19:11:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d8003570 con 0x7fe9ec0ae780 2023-10-14T19:11:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708029064 0 0) 0x7fe9d8003570 con 0x7fe9ec0ae780 2023-10-14T19:11:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 msgr2=0x7fe9ec0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9ec0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 >> v2:172.21.15.148:3300/0 conn(0x7fe9ec0a8be0 msgr2=0x7fe9ec0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 --2- 172.21.15.7:0/1299663293 >> v2:172.21.15.148:3300/0 conn(0x7fe9ec0a8be0 0x7fe9ec0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0cdb50 con 0x7fe9ec0ae780 2023-10-14T19:11:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fe9dc001470 con 0x7fe9ec0ae780 2023-10-14T19:11:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 >> v1:172.21.15.7:6789/0 conn(0x7fe9ec0ae780 legacy=0x7fe9ec0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9d8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9d8004d50 0x7fe9d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cd5d0 con 0x7fe9d8003fe0 2023-10-14T19:11:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cd870 con 0x7fe9d8004d50 2023-10-14T19:11:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d800ba90 con 0x7fe9ec06d280 2023-10-14T19:11:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9ea59c700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9d8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9ead9d700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9d8004d50 0x7fe9d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e9d9b700 1 -- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 msgr2=0x7fe9d8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.378+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9d8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e9d9b700 1 -- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9d8004d50 msgr2=0x7fe9d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9d8004d50 0x7fe9d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e9d9b700 1 -- 172.21.15.7:0/1299663293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8003570 con 0x7fe9d8003fe0 2023-10-14T19:11:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9ea59c700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec06d280 0x7fe9d8003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9ead9d700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9d8004d50 0x7fe9d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9d8004810 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009bf0 tx=0x7fe9d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3118d499ecd5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4005a00 con 0x7fe9d8003fe0 2023-10-14T19:11:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d4005b60 con 0x7fe9d8003fe0 2023-10-14T19:11:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9e959a700 1 -- 172.21.15.7:0/1299663293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400e6b0 con 0x7fe9d8003fe0 2023-10-14T19:11:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/1299663293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 msgr2=0x7fe9d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/1299663293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9d8004810 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009bf0 tx=0x7fe9d4009120 comp rx=0 tx=0).stop 2023-10-14T19:11:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9ead9d700 1 -- 172.21.15.7:0/1299663293 reap_dead start 2023-10-14T19:11:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/1299663293 shutdown_connections 2023-10-14T19:11:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/1299663293 >> 172.21.15.7:0/1299663293 conn(0x7fe9ec06ce80 msgr2=0x7fe9ec0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/1299663293 shutdown_connections 2023-10-14T19:11:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.379+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/1299663293 wait complete. 2023-10-14T19:11:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 Processor -- start 2023-10-14T19:11:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 -- start start 2023-10-14T19:11:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9ec16b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec0ab200 0x7fe9ec0ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec09aef0 0x7fe9ec09b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0ac2d0 con 0x7fe9d8003fe0 2023-10-14T19:11:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec09b8b0 con 0x7fe9ec09aef0 2023-10-14T19:11:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9f0d2d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0abd10 con 0x7fe9ec0ab200 2023-10-14T19:11:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9ea59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9ec16b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9ea59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9ec16b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35528/0 (socket says 172.21.15.7:35528) 2023-10-14T19:11:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.381+0000 7fe9ea59c700 1 -- 172.21.15.7:0/3642711343 learned_addr learned my addr 172.21.15.7:0/3642711343 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ead9d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec09aef0 0x7fe9ec09b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec0ab200 0x7fe9ec0ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ea59c700 1 -- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec0ab200 msgr2=0x7fe9ec0ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ea59c700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec0ab200 0x7fe9ec0ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ea59c700 1 -- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec09aef0 msgr2=0x7fe9ec09b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ea59c700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec09aef0 0x7fe9ec09b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ea59c700 1 -- 172.21.15.7:0/3642711343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0abff0 con 0x7fe9d8003fe0 2023-10-14T19:11:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9ea59c700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9ec16b170 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4010570 tx=0x7fe9e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e050 con 0x7fe9d8003fe0 2023-10-14T19:11:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e400f040 con 0x7fe9d8003fe0 2023-10-14T19:11:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec168c20 con 0x7fe9d8003fe0 2023-10-14T19:11:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4015860 con 0x7fe9d8003fe0 2023-10-14T19:11:37.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.382+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec16bcd0 con 0x7fe9d8003fe0 2023-10-14T19:11:37.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.383+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec169140 con 0x7fe9d8003fe0 2023-10-14T19:11:37.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.383+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe9e4003020 con 0x7fe9d8003fe0 2023-10-14T19:11:37.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.384+0000 7fe9e27fc700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9cc067320 0x7fe9cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.399 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.384+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fe9e4085ce0 con 0x7fe9d8003fe0 2023-10-14T19:11:37.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.384+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9cc067320 0x7fe9cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.384+0000 7fe9e9d9b700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9cc067320 0x7fe9cc0697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009160 tx=0x7fe9d4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.388+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9ec169140 con 0x7fe9d8003fe0 2023-10-14T19:11:37.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.625+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9ec169140 con 0x7fe9d8003fe0 2023-10-14T19:11:37.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.625+0000 7fe9e27fc700 1 -- 172.21.15.7:0/3642711343 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4624 (secure 0 0 0) 0x7fe9ec169140 con 0x7fe9d8003fe0 2023-10-14T19:11:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:37.627 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:32.952866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000819117","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:37.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9cc067320 msgr2=0x7fe9cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9cc067320 0x7fe9cc0697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009160 tx=0x7fe9d4019000 comp rx=0 tx=0).stop 2023-10-14T19:11:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 msgr2=0x7fe9ec16b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9ec16b170 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4010570 tx=0x7fe9e400b040 comp rx=0 tx=0).stop 2023-10-14T19:11:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 shutdown_connections 2023-10-14T19:11:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe9cc067320 0x7fe9cc0697d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec09aef0 0x7fe9ec09b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d8003fe0 0x7fe9ec16b170 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 --2- 172.21.15.7:0/3642711343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9ec0ab200 0x7fe9ec0ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 >> 172.21.15.7:0/3642711343 conn(0x7fe9ec06ce80 msgr2=0x7fe9ec0adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:37.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 shutdown_connections 2023-10-14T19:11:37.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.627+0000 7fe9f0d2d700 1 -- 172.21.15.7:0/3642711343 wait complete. 2023-10-14T19:11:37.631 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 114 2023-10-14T19:11:37.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.759+0000 7f0c6928f700 1 Processor -- start 2023-10-14T19:11:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.759+0000 7f0c6928f700 1 -- start start 2023-10-14T19:11:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c6928f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 0x7f0c640ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c6928f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6415a280 con 0x7f0c640cf200 2023-10-14T19:11:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c6928f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6406e180 con 0x7f0c640b0ba0 2023-10-14T19:11:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c6928f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6406d850 con 0x7f0c640b07d0 2023-10-14T19:11:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c627fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0c640cf200 0x7f0c6406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38054/0 (socket says 172.21.15.7:38054) 2023-10-14T19:11:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c627fc700 1 -- 172.21.15.7:0/3614977981 learned_addr learned my addr 172.21.15.7:0/3614977981 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c62ffd700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 0x7f0c640ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742191929 0 0) 0x7f0c6415a280 con 0x7f0c640cf200 2023-10-14T19:11:37.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c50003570 con 0x7f0c640cf200 2023-10-14T19:11:37.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175108222 0 0) 0x7f0c50003570 con 0x7f0c640cf200 2023-10-14T19:11:37.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 msgr2=0x7f0c640ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 0x7f0c640ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 >> v1:172.21.15.148:6789/0 conn(0x7f0c640b0ba0 legacy=0x7f0c6406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6406db30 con 0x7f0c640cf200 2023-10-14T19:11:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f0c4c001470 con 0x7f0c640cf200 2023-10-14T19:11:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 >> v1:172.21.15.7:6789/0 conn(0x7f0c640cf200 legacy=0x7f0c6406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 0x7f0c50003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50003fd0 0x7f0c50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c50004d50 0x7f0c500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6406d850 con 0x7f0c50004d50 2023-10-14T19:11:37.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5000bb40 con 0x7f0c50003fd0 2023-10-14T19:11:37.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.760+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5000bd00 con 0x7f0c640b07d0 2023-10-14T19:11:37.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c50004d50 0x7f0c500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c62ffd700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 0x7f0c50003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c627fc700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50003fd0 0x7f0c50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 -- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 msgr2=0x7f0c50003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b07d0 0x7f0c50003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 -- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50003fd0 msgr2=0x7f0c50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50003fd0 0x7f0c50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 -- 172.21.15.7:0/3614977981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c50003570 con 0x7f0c50004d50 2023-10-14T19:11:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c637fe700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c50004d50 0x7f0c500051c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f0c540019a0 tx=0x7f0c54007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb427101211cee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400c5d0 con 0x7f0c50004d50 2023-10-14T19:11:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5400c750 con 0x7f0c50004d50 2023-10-14T19:11:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.761+0000 7f0c61ffb700 1 -- 172.21.15.7:0/3614977981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400cb10 con 0x7f0c50004d50 2023-10-14T19:11:37.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c6928f700 1 -- 172.21.15.7:0/3614977981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c50004d50 msgr2=0x7f0c500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3614977981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c50004d50 0x7f0c500051c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f0c540019a0 tx=0x7f0c54007d10 comp rx=0 tx=0).stop 2023-10-14T19:11:37.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c637fe700 1 -- 172.21.15.7:0/3614977981 reap_dead start 2023-10-14T19:11:37.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c6928f700 1 -- 172.21.15.7:0/3614977981 shutdown_connections 2023-10-14T19:11:37.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c6928f700 1 -- 172.21.15.7:0/3614977981 >> 172.21.15.7:0/3614977981 conn(0x7f0c6406ce80 msgr2=0x7f0c640ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:37.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c6928f700 1 -- 172.21.15.7:0/3614977981 shutdown_connections 2023-10-14T19:11:37.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.762+0000 7f0c6928f700 1 -- 172.21.15.7:0/3614977981 wait complete. 2023-10-14T19:11:37.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.763+0000 7f0c6928f700 1 Processor -- start 2023-10-14T19:11:37.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.763+0000 7f0c6928f700 1 -- start start 2023-10-14T19:11:37.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c6928f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 0x7f0c6409bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c6928f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c64155830 0x7f0c640998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c6928f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b3390 0x7f0c640b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c6928f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640b3d50 con 0x7f0c64155460 2023-10-14T19:11:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c6928f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c641697e0 con 0x7f0c64155830 2023-10-14T19:11:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c6928f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64099fd0 con 0x7f0c640b3390 2023-10-14T19:11:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 0x7f0c6409bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 0x7f0c6409bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35544/0 (socket says 172.21.15.7:35544) 2023-10-14T19:11:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 -- 172.21.15.7:0/3691342620 learned_addr learned my addr 172.21.15.7:0/3691342620 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c627fc700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c64155830 0x7f0c640998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 -- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b3390 msgr2=0x7f0c640b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b3390 0x7f0c640b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 -- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c64155830 msgr2=0x7f0c640998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c64155830 0x7f0c640998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 -- 172.21.15.7:0/3691342620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6409a2b0 con 0x7f0c64155460 2023-10-14T19:11:37.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c62ffd700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 0x7f0c6409bd30 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c011f50 tx=0x7f0c5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.764+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00e040 con 0x7f0c64155460 2023-10-14T19:11:37.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.765+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00f040 con 0x7f0c64155460 2023-10-14T19:11:37.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.765+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6409a590 con 0x7f0c64155460 2023-10-14T19:11:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.765+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c015430 con 0x7f0c64155460 2023-10-14T19:11:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.765+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c64157e10 con 0x7f0c64155460 2023-10-14T19:11:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.766+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6409a7b0 con 0x7f0c64155460 2023-10-14T19:11:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.766+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0c5c0157e0 con 0x7f0c64155460 2023-10-14T19:11:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.766+0000 7f0c5affd700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c44067320 0x7f0c440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.766+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f0c5c085d20 con 0x7f0c64155460 2023-10-14T19:11:37.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.767+0000 7f0c627fc700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c44067320 0x7f0c440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:37.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.767+0000 7f0c627fc700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c44067320 0x7f0c440697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000e10 tx=0x7f0c4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:37.782 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.771+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c5c0526c0 con 0x7f0c64155460 2023-10-14T19:11:37.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.967+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c6404c3c0 con 0x7f0c64155460 2023-10-14T19:11:37.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.969+0000 7f0c5affd700 1 -- 172.21.15.7:0/3691342620 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f0c5c055ce0 con 0x7f0c64155460 2023-10-14T19:11:37.970 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:37.971 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":170,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:33.959795+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000819117.meta","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000819117"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-14T19:11:29.275510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:37.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c44067320 msgr2=0x7f0c440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c44067320 0x7f0c440697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000e10 tx=0x7f0c4c009040 comp rx=0 tx=0).stop 2023-10-14T19:11:37.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 msgr2=0x7f0c6409bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:37.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 0x7f0c6409bd30 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c011f50 tx=0x7f0c5c00b040 comp rx=0 tx=0).stop 2023-10-14T19:11:37.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 shutdown_connections 2023-10-14T19:11:37.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0c44067320 0x7f0c440697d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0c640b3390 0x7f0c640b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c64155460 0x7f0c6409bd30 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 --2- 172.21.15.7:0/3691342620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c64155830 0x7f0c640998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:37.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 >> 172.21.15.7:0/3691342620 conn(0x7f0c6406ce80 msgr2=0x7f0c640cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:37.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.971+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 shutdown_connections 2023-10-14T19:11:37.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:37.972+0000 7f0c6928f700 1 -- 172.21.15.7:0/3691342620 wait complete. 2023-10-14T19:11:37.985 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000819117 and related pools 2023-10-14T19:11:37.985 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:38.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.103+0000 7fda84ce3700 1 Processor -- start 2023-10-14T19:11:38.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.104+0000 7fda84ce3700 1 -- start start 2023-10-14T19:11:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.104+0000 7fda84ce3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda800cb5a0 0x7fda800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda84ce3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda800cd9e0 0x7fda80159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda84ce3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8015ae40 con 0x7fda8015a400 2023-10-14T19:11:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda84ce3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800d13f0 con 0x7fda800cd9e0 2023-10-14T19:11:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda84ce3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8015ab60 con 0x7fda800cb5a0 2023-10-14T19:11:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7dd9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda800cd9e0 0x7fda80159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7ed9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fda8015a400 0x7fda80156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38060/0 (socket says 172.21.15.7:38060) 2023-10-14T19:11:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7ed9d700 1 -- 172.21.15.7:0/3681094515 learned_addr learned my addr 172.21.15.7:0/3681094515 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7e59c700 1 --2- 172.21.15.7:0/3681094515 >> v2:172.21.15.148:3300/0 conn(0x7fda800cb5a0 0x7fda800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3681094515 >> v2:172.21.15.148:3300/0 conn(0x7fda800cb5a0 msgr2=0x7fda800cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7dd9b700 1 --2- 172.21.15.7:0/3681094515 >> v2:172.21.15.148:3300/0 conn(0x7fda800cb5a0 0x7fda800cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3681094515 >> v1:172.21.15.7:6789/0 conn(0x7fda8015a400 legacy=0x7fda80156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3681094515 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800ccf00 con 0x7fda800cd9e0 2023-10-14T19:11:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7d59a700 1 -- 172.21.15.7:0/3681094515 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144538786 0 0) 0x7fda8015ae40 con 0x7fda8015a400 2023-10-14T19:11:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7dd9b700 1 --2- 172.21.15.7:0/3681094515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda80159ec0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fda680098e0 tx=0x7fda680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736da2b577f5a79c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7d59a700 1 -- 172.21.15.7:0/3681094515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011630 con 0x7fda800cd9e0 2023-10-14T19:11:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7d59a700 1 -- 172.21.15.7:0/3681094515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68011790 con 0x7fda800cd9e0 2023-10-14T19:11:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.105+0000 7fda7d59a700 1 -- 172.21.15.7:0/3681094515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011b30 con 0x7fda800cd9e0 2023-10-14T19:11:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 -- 172.21.15.7:0/3681094515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 msgr2=0x7fda80159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3681094515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda80159ec0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fda680098e0 tx=0x7fda680091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 -- 172.21.15.7:0/3681094515 shutdown_connections 2023-10-14T19:11:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3681094515 >> v2:172.21.15.148:3300/0 conn(0x7fda800cb5a0 0x7fda800cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3681094515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda80159ec0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 -- 172.21.15.7:0/3681094515 >> 172.21.15.7:0/3681094515 conn(0x7fda80070e30 msgr2=0x7fda800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 -- 172.21.15.7:0/3681094515 shutdown_connections 2023-10-14T19:11:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.106+0000 7fda84ce3700 1 -- 172.21.15.7:0/3681094515 wait complete. 2023-10-14T19:11:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.107+0000 7fda84ce3700 1 Processor -- start 2023-10-14T19:11:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.107+0000 7fda84ce3700 1 -- start start 2023-10-14T19:11:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda84ce3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda800cb5a0 0x7fda8015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda84ce3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda801503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda84ce3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda8015a400 0x7fda800b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda84ce3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8015ffc0 con 0x7fda800cd9e0 2023-10-14T19:11:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda84ce3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8015f5f0 con 0x7fda800cb5a0 2023-10-14T19:11:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda84ce3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda80150910 con 0x7fda8015a400 2023-10-14T19:11:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda801503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda801503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35572/0 (socket says 172.21.15.7:35572) 2023-10-14T19:11:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3608348596 learned_addr learned my addr 172.21.15.7:0/3608348596 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7e59c700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda800cb5a0 0x7fda8015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7ed9d700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda8015a400 0x7fda800b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda8015a400 msgr2=0x7fda800b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda8015a400 0x7fda800b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda800cb5a0 msgr2=0x7fda8015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda800cb5a0 0x7fda8015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 -- 172.21.15.7:0/3608348596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68009420 con 0x7fda800cd9e0 2023-10-14T19:11:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7e59c700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda800cb5a0 0x7fda8015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.108+0000 7fda7dd9b700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda801503d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fda680091e0 tx=0x7fda68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.109+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011900 con 0x7fda800cd9e0 2023-10-14T19:11:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.109+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68011a80 con 0x7fda800cd9e0 2023-10-14T19:11:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.109+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8015e9e0 con 0x7fda800cd9e0 2023-10-14T19:11:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.109+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68025670 con 0x7fda800cd9e0 2023-10-14T19:11:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.109+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8015efa0 con 0x7fda800cd9e0 2023-10-14T19:11:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.109+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8004c3c0 con 0x7fda800cd9e0 2023-10-14T19:11:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.110+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fda68023070 con 0x7fda800cd9e0 2023-10-14T19:11:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.110+0000 7fda767fc700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda60067320 0x7fda600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.111+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fda68086430 con 0x7fda800cd9e0 2023-10-14T19:11:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.111+0000 7fda7e59c700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda60067320 0x7fda600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.111+0000 7fda7e59c700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda60067320 0x7fda600697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d80 tx=0x7fda78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.115+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda68052ee0 con 0x7fda800cd9e0 2023-10-14T19:11:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.351+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda800cd1e0 con 0x7fda800cd9e0 2023-10-14T19:11:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.352+0000 7fda767fc700 1 -- 172.21.15.7:0/3608348596 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4624 (secure 0 0 0) 0x7fda68056500 con 0x7fda800cd9e0 2023-10-14T19:11:38.353 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:38.353 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:32.952866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000819117","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda60067320 msgr2=0x7fda600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda60067320 0x7fda600697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d80 tx=0x7fda78008040 comp rx=0 tx=0).stop 2023-10-14T19:11:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 msgr2=0x7fda801503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda801503d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fda680091e0 tx=0x7fda68017000 comp rx=0 tx=0).stop 2023-10-14T19:11:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 shutdown_connections 2023-10-14T19:11:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fda60067320 0x7fda600697d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda800cb5a0 0x7fda8015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda8015a400 0x7fda800b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 --2- 172.21.15.7:0/3608348596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda800cd9e0 0x7fda801503d0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 >> 172.21.15.7:0/3608348596 conn(0x7fda80070e30 msgr2=0x7fda801552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 shutdown_connections 2023-10-14T19:11:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.354+0000 7fda84ce3700 1 -- 172.21.15.7:0/3608348596 wait complete. 2023-10-14T19:11:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 114 2023-10-14T19:11:38.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.486+0000 7fde08aef700 1 Processor -- start 2023-10-14T19:11:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.486+0000 7fde08aef700 1 -- start start 2023-10-14T19:11:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde08aef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fde040ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde08aef700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0415a280 con 0x7fde040cf200 2023-10-14T19:11:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde08aef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0406e180 con 0x7fde040b0ba0 2023-10-14T19:11:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde08aef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0406d850 con 0x7fde040b07d0 2023-10-14T19:11:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde01d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fde040cf200 0x7fde0406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38066/0 (socket says 172.21.15.7:38066) 2023-10-14T19:11:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde01d9b700 1 -- 172.21.15.7:0/2888708407 learned_addr learned my addr 172.21.15.7:0/2888708407 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0259c700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fde040ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551637063 0 0) 0x7fde0415a280 con 0x7fde040cf200 2023-10-14T19:11:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003570 con 0x7fde040cf200 2023-10-14T19:11:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43558247 0 0) 0x7fddf0003570 con 0x7fde040cf200 2023-10-14T19:11:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 msgr2=0x7fde040ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fde040ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 >> v1:172.21.15.148:6789/0 conn(0x7fde040b0ba0 legacy=0x7fde0406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0406db30 con 0x7fde040cf200 2023-10-14T19:11:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fddec001470 con 0x7fde040cf200 2023-10-14T19:11:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 >> v1:172.21.15.7:6789/0 conn(0x7fde040cf200 legacy=0x7fde0406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0003a90 0x7fddf0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fddf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0004d50 0x7fddf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0406d850 con 0x7fddf0003a90 2023-10-14T19:11:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bb70 con 0x7fddf0004d50 2023-10-14T19:11:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bd30 con 0x7fde040b07d0 2023-10-14T19:11:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.487+0000 7fde0259c700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0003a90 0x7fddf0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde01d9b700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fddf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde02d9d700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0004d50 0x7fddf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0259c700 1 -- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 msgr2=0x7fddf0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0259c700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fddf0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0259c700 1 -- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0004d50 msgr2=0x7fddf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0259c700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0004d50 0x7fddf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0259c700 1 -- 172.21.15.7:0/2888708407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003570 con 0x7fddf0003a90 2023-10-14T19:11:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde01d9b700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde040b07d0 0x7fddf0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0259c700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0003a90 0x7fddf0003ea0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00e2d0 tx=0x7fddfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57a4c974a8f15c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00eb20 con 0x7fddf0003a90 2023-10-14T19:11:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc00f040 con 0x7fddf0003a90 2023-10-14T19:11:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.488+0000 7fde0159a700 1 -- 172.21.15.7:0/2888708407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00eed0 con 0x7fddf0003a90 2023-10-14T19:11:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde08aef700 1 -- 172.21.15.7:0/2888708407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0003a90 msgr2=0x7fddf0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde08aef700 1 --2- 172.21.15.7:0/2888708407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0003a90 0x7fddf0003ea0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00e2d0 tx=0x7fddfc00b040 comp rx=0 tx=0).stop 2023-10-14T19:11:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde02d9d700 1 -- 172.21.15.7:0/2888708407 reap_dead start 2023-10-14T19:11:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde08aef700 1 -- 172.21.15.7:0/2888708407 shutdown_connections 2023-10-14T19:11:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde08aef700 1 -- 172.21.15.7:0/2888708407 >> 172.21.15.7:0/2888708407 conn(0x7fde0406ce80 msgr2=0x7fde040ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde08aef700 1 -- 172.21.15.7:0/2888708407 shutdown_connections 2023-10-14T19:11:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.489+0000 7fde08aef700 1 -- 172.21.15.7:0/2888708407 wait complete. 2023-10-14T19:11:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.490+0000 7fde08aef700 1 Processor -- start 2023-10-14T19:11:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.490+0000 7fde08aef700 1 -- start start 2023-10-14T19:11:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0003a90 0x7fde0409bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde0416a480 0x7fde0415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 0x7fde0415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0415e680 con 0x7fde0415f9c0 2023-10-14T19:11:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0409c190 con 0x7fddf0003a90 2023-10-14T19:11:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0409abd0 con 0x7fde0416a480 2023-10-14T19:11:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 0x7fde0415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 0x7fde0415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35596/0 (socket says 172.21.15.7:35596) 2023-10-14T19:11:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 -- 172.21.15.7:0/712793237 learned_addr learned my addr 172.21.15.7:0/712793237 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde01d9b700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde0416a480 0x7fde0415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde0259c700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0003a90 0x7fde0409bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 -- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde0416a480 msgr2=0x7fde0415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde0416a480 0x7fde0415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 -- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0003a90 msgr2=0x7fde0409bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0003a90 0x7fde0409bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 -- 172.21.15.7:0/712793237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0409aeb0 con 0x7fde0415f9c0 2023-10-14T19:11:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde02d9d700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 0x7fde0415fe20 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fde0406b550 tx=0x7fddf4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400ede0 con 0x7fde0415f9c0 2023-10-14T19:11:38.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4013420 con 0x7fde0415f9c0 2023-10-14T19:11:38.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40137e0 con 0x7fde0415f9c0 2023-10-14T19:11:38.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.491+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0409b190 con 0x7fde0415f9c0 2023-10-14T19:11:38.505 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.492+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0409b750 con 0x7fde0415f9c0 2023-10-14T19:11:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.492+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0404c3c0 con 0x7fde0415f9c0 2023-10-14T19:11:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.493+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fddf4013bd0 con 0x7fde0415f9c0 2023-10-14T19:11:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.493+0000 7fddfa7fc700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdde4067320 0x7fdde40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.493+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fddf4084900 con 0x7fde0415f9c0 2023-10-14T19:11:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.494+0000 7fde0259c700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdde4067320 0x7fdde40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.494+0000 7fde0259c700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdde4067320 0x7fdde40697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00f010 tx=0x7fddfc01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.497+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddf4051430 con 0x7fde0415f9c0 2023-10-14T19:11:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.733+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde0406de10 con 0x7fde0415f9c0 2023-10-14T19:11:38.735 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.734+0000 7fddfa7fc700 1 -- 172.21.15.7:0/712793237 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4624 (secure 0 0 0) 0x7fddf4054a50 con 0x7fde0415f9c0 2023-10-14T19:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:14.275053+0000","modified":"2023-10-14T19:11:32.952866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8250":{"gid":8250,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/3325863759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3325863759},{"type":"v1","addr":"172.21.15.7:6835","nonce":3325863759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000819117","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-14T19:11:38.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdde4067320 msgr2=0x7fdde40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdde4067320 0x7fdde40697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00f010 tx=0x7fddfc01a000 comp rx=0 tx=0).stop 2023-10-14T19:11:38.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 msgr2=0x7fde0415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 0x7fde0415fe20 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fde0406b550 tx=0x7fddf4009040 comp rx=0 tx=0).stop 2023-10-14T19:11:38.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 shutdown_connections 2023-10-14T19:11:38.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdde4067320 0x7fdde40697d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddf0003a90 0x7fde0409bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde0415f9c0 0x7fde0415fe20 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 --2- 172.21.15.7:0/712793237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde0416a480 0x7fde0415ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 >> 172.21.15.7:0/712793237 conn(0x7fde0406ce80 msgr2=0x7fde04067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 shutdown_connections 2023-10-14T19:11:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.736+0000 7fde08aef700 1 -- 172.21.15.7:0/712793237 wait complete. 2023-10-14T19:11:38.740 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 114 2023-10-14T19:11:38.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.869+0000 7fb41debd700 1 Processor -- start 2023-10-14T19:11:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.869+0000 7fb41debd700 1 -- start start 2023-10-14T19:11:38.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb41debd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb4180cb5a0 0x7fb4180cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb41debd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41815ae40 con 0x7fb41815a5d0 2023-10-14T19:11:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb41debd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41815ab60 con 0x7fb4180cd9e0 2023-10-14T19:11:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb41debd700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180d13f0 con 0x7fb4180cb5a0 2023-10-14T19:11:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb4177fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb4180cb5a0 0x7fb4180cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb417fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb41815a5d0 0x7fb418156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38082/0 (socket says 172.21.15.7:38082) 2023-10-14T19:11:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb417fff700 1 -- 172.21.15.7:0/928629130 learned_addr learned my addr 172.21.15.7:0/928629130 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb4177fe700 1 -- 172.21.15.7:0/928629130 >> v1:172.21.15.148:6789/0 conn(0x7fb4180cd9e0 legacy=0x7fb418159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb4177fe700 1 -- 172.21.15.7:0/928629130 >> v1:172.21.15.7:6789/0 conn(0x7fb41815a5d0 legacy=0x7fb418156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb4177fe700 1 -- 172.21.15.7:0/928629130 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180ccf00 con 0x7fb4180cb5a0 2023-10-14T19:11:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb4167fc700 1 -- 172.21.15.7:0/928629130 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387297893 0 0) 0x7fb41815ae40 con 0x7fb41815a5d0 2023-10-14T19:11:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.870+0000 7fb4177fe700 1 --2- 172.21.15.7:0/928629130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cb5a0 0x7fb4180cb970 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fb408009910 tx=0x7fb4080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c89b56277a94f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb4167fc700 1 -- 172.21.15.7:0/928629130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800b820 con 0x7fb4180cb5a0 2023-10-14T19:11:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb4167fc700 1 -- 172.21.15.7:0/928629130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40800b980 con 0x7fb4180cb5a0 2023-10-14T19:11:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb4167fc700 1 -- 172.21.15.7:0/928629130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800bd20 con 0x7fb4180cb5a0 2023-10-14T19:11:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 -- 172.21.15.7:0/928629130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cb5a0 msgr2=0x7fb4180cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 --2- 172.21.15.7:0/928629130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cb5a0 0x7fb4180cb970 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fb408009910 tx=0x7fb4080091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 -- 172.21.15.7:0/928629130 shutdown_connections 2023-10-14T19:11:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 --2- 172.21.15.7:0/928629130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cb5a0 0x7fb4180cb970 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 -- 172.21.15.7:0/928629130 >> 172.21.15.7:0/928629130 conn(0x7fb418070e30 msgr2=0x7fb4180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 -- 172.21.15.7:0/928629130 shutdown_connections 2023-10-14T19:11:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.871+0000 7fb41debd700 1 -- 172.21.15.7:0/928629130 wait complete. 2023-10-14T19:11:38.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.872+0000 7fb41debd700 1 Processor -- start 2023-10-14T19:11:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.872+0000 7fb41debd700 1 -- start start 2023-10-14T19:11:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb41debd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4180cb5a0 0x7fb4180c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb41debd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 0x7fb4181512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb41debd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41815a5d0 0x7fb4180b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb41debd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180c89b0 con 0x7fb4180cd9e0 2023-10-14T19:11:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb41debd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418151810 con 0x7fb41815a5d0 2023-10-14T19:11:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb41debd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b5c70 con 0x7fb4180cb5a0 2023-10-14T19:11:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 0x7fb4181512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 0x7fb4181512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35606/0 (socket says 172.21.15.7:35606) 2023-10-14T19:11:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 -- 172.21.15.7:0/1810100612 learned_addr learned my addr 172.21.15.7:0/1810100612 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:38.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb417fff700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41815a5d0 0x7fb4180b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb4177fe700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4180cb5a0 0x7fb4180c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 -- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4180cb5a0 msgr2=0x7fb4180c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4180cb5a0 0x7fb4180c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 -- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41815a5d0 msgr2=0x7fb4180b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41815a5d0 0x7fb4180b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.873+0000 7fb416ffd700 1 -- 172.21.15.7:0/1810100612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009420 con 0x7fb4180cd9e0 2023-10-14T19:11:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.874+0000 7fb416ffd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 0x7fb4181512d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c5c0 tx=0x7fb40c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.874+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c011590 con 0x7fb4180cd9e0 2023-10-14T19:11:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.874+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c011710 con 0x7fb4180cd9e0 2023-10-14T19:11:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.874+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180c7da0 con 0x7fb4180cd9e0 2023-10-14T19:11:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.874+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c011ad0 con 0x7fb4180cd9e0 2023-10-14T19:11:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.874+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4180c8360 con 0x7fb4180cd9e0 2023-10-14T19:11:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.875+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41804c3c0 con 0x7fb4180cd9e0 2023-10-14T19:11:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.875+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb40c01b3b0 con 0x7fb4180cd9e0 2023-10-14T19:11:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.876+0000 7fb3ff7fe700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb404067320 0x7fb4040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.876+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb40c084410 con 0x7fb4180cd9e0 2023-10-14T19:11:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.876+0000 7fb4177fe700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb404067320 0x7fb4040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.876+0000 7fb4177fe700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb404067320 0x7fb4040697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb4080093f0 tx=0x7fb408017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:38.880+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb40c050ec0 con 0x7fb4180cd9e0 2023-10-14T19:11:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.079+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4180c8af0 con 0x7fb4180cd9e0 2023-10-14T19:11:39.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.079+0000 7fb3ff7fe700 1 -- 172.21.15.7:0/1810100612 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7fb40c0544e0 con 0x7fb4180cd9e0 2023-10-14T19:11:39.081 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":170,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:33.959795+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000819117.meta","create_time":"2023-10-14T19:11:12.605229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000819117"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:13.244514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-14T19:11:29.275510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000819117"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.081+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb404067320 msgr2=0x7fb4040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.081+0000 7fb41debd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb404067320 0x7fb4040697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb4080093f0 tx=0x7fb408017000 comp rx=0 tx=0).stop 2023-10-14T19:11:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 msgr2=0x7fb4181512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 0x7fb4181512d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c5c0 tx=0x7fb40c00c980 comp rx=0 tx=0).stop 2023-10-14T19:11:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 shutdown_connections 2023-10-14T19:11:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb404067320 0x7fb4040697d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb41815a5d0 0x7fb4180b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4180cb5a0 0x7fb4180c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 --2- 172.21.15.7:0/1810100612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4180cd9e0 0x7fb4181512d0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 >> 172.21.15.7:0/1810100612 conn(0x7fb418070e30 msgr2=0x7fb4180cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 shutdown_connections 2023-10-14T19:11:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.082+0000 7fb41debd700 1 -- 172.21.15.7:0/1810100612 wait complete. 2023-10-14T19:11:39.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000819117 2023-10-14T19:11:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.219+0000 7f1b55f48700 1 Processor -- start 2023-10-14T19:11:39.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.219+0000 7f1b55f48700 1 -- start start 2023-10-14T19:11:39.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b55f48700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b500cb970 0x7f1b50159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b55f48700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5015ae40 con 0x7f1b5015a400 2023-10-14T19:11:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b55f48700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5015ab60 con 0x7f1b500cb5a0 2023-10-14T19:11:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b55f48700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b500ce0f0 con 0x7f1b500cb970 2023-10-14T19:11:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b4ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1b5015a400 0x7f1b50156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38096/0 (socket says 172.21.15.7:38096) 2023-10-14T19:11:39.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b4ffff700 1 -- 172.21.15.7:0/2302439513 learned_addr learned my addr 172.21.15.7:0/2302439513 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.220+0000 7f1b4effd700 1 --2- 172.21.15.7:0/2302439513 >> v2:172.21.15.148:3300/0 conn(0x7f1b500cb970 0x7f1b50159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641005902 0 0) 0x7f1b5015ae40 con 0x7f1b5015a400 2023-10-14T19:11:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b38003570 con 0x7f1b5015a400 2023-10-14T19:11:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146024265 0 0) 0x7f1b5015ab60 con 0x7f1b500cb5a0 2023-10-14T19:11:39.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5015ae40 con 0x7f1b500cb5a0 2023-10-14T19:11:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309610518 0 0) 0x7f1b38003570 con 0x7f1b5015a400 2023-10-14T19:11:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 >> v2:172.21.15.148:3300/0 conn(0x7f1b500cb970 msgr2=0x7f1b50159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 --2- 172.21.15.7:0/2302439513 >> v2:172.21.15.148:3300/0 conn(0x7f1b500cb970 0x7f1b50159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 >> v1:172.21.15.148:6789/0 conn(0x7f1b500cb5a0 legacy=0x7f1b500cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500ccf00 con 0x7f1b5015a400 2023-10-14T19:11:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f1b480017f0 con 0x7f1b5015a400 2023-10-14T19:11:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 >> v1:172.21.15.7:6789/0 conn(0x7f1b5015a400 legacy=0x7f1b50156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38003bf0 0x7f1b38003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b38004810 0x7f1b38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b380051c0 0x7f1b3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500ce0f0 con 0x7f1b38004810 2023-10-14T19:11:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3800c0b0 con 0x7f1b380051c0 2023-10-14T19:11:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3800c270 con 0x7f1b38003bf0 2023-10-14T19:11:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4effd700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b38004810 0x7f1b38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4f7fe700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38003bf0 0x7f1b38003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4effd700 1 -- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38003bf0 msgr2=0x7f1b38003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:39.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4effd700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38003bf0 0x7f1b38003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4effd700 1 -- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b380051c0 msgr2=0x7f1b3800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:39.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4effd700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b380051c0 0x7f1b3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4effd700 1 -- 172.21.15.7:0/2302439513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38003570 con 0x7f1b38004810 2023-10-14T19:11:39.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.221+0000 7f1b4ffff700 1 -- 172.21.15.7:0/2302439513 reap_dead start 2023-10-14T19:11:39.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b4effd700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b38004810 0x7f1b38004c80 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009c00 tx=0x7f1b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866bb40bf84684e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:39.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400e710 con 0x7f1b38004810 2023-10-14T19:11:39.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4400e870 con 0x7f1b38004810 2023-10-14T19:11:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b4e7fc700 1 -- 172.21.15.7:0/2302439513 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400ec30 con 0x7f1b38004810 2023-10-14T19:11:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 -- 172.21.15.7:0/2302439513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b38004810 msgr2=0x7f1b38004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b38004810 0x7f1b38004c80 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009c00 tx=0x7f1b440091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 -- 172.21.15.7:0/2302439513 shutdown_connections 2023-10-14T19:11:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 --2- 172.21.15.7:0/2302439513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b38004810 0x7f1b38004c80 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 -- 172.21.15.7:0/2302439513 >> 172.21.15.7:0/2302439513 conn(0x7f1b50070e30 msgr2=0x7f1b500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 -- 172.21.15.7:0/2302439513 shutdown_connections 2023-10-14T19:11:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.222+0000 7f1b55f48700 1 -- 172.21.15.7:0/2302439513 wait complete. 2023-10-14T19:11:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.223+0000 7f1b55f48700 1 Processor -- start 2023-10-14T19:11:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 -- start start 2023-10-14T19:11:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38004810 0x7f1b50158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 0x7f1b50156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b501571a0 0x7f1b500b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5016a990 con 0x7f1b500c9230 2023-10-14T19:11:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50169d80 con 0x7f1b501571a0 2023-10-14T19:11:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b55f48700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5016a060 con 0x7f1b38004810 2023-10-14T19:11:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 0x7f1b50156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 0x7f1b50156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35622/0 (socket says 172.21.15.7:35622) 2023-10-14T19:11:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.224+0000 7f1b4effd700 1 -- 172.21.15.7:0/3170686349 learned_addr learned my addr 172.21.15.7:0/3170686349 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4f7fe700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38004810 0x7f1b50158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4ffff700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b501571a0 0x7f1b500b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4effd700 1 -- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38004810 msgr2=0x7f1b50158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4effd700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38004810 0x7f1b50158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4effd700 1 -- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b501571a0 msgr2=0x7f1b500b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4effd700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b501571a0 0x7f1b500b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4effd700 1 -- 172.21.15.7:0/3170686349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5016a340 con 0x7f1b500c9230 2023-10-14T19:11:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4f7fe700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38004810 0x7f1b50158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4ffff700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b501571a0 0x7f1b500b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b4effd700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 0x7f1b50156c60 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e4b0 tx=0x7f1b4401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44022070 con 0x7f1b500c9230 2023-10-14T19:11:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44013cd0 con 0x7f1b500c9230 2023-10-14T19:11:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5016a990 con 0x7f1b500c9230 2023-10-14T19:11:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4401c6a0 con 0x7f1b500c9230 2023-10-14T19:11:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.225+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b501585d0 con 0x7f1b500c9230 2023-10-14T19:11:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.226+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5004c3c0 con 0x7f1b500c9230 2023-10-14T19:11:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.226+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1b4401cad0 con 0x7f1b500c9230 2023-10-14T19:11:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.227+0000 7f1b377fe700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1b3c067320 0x7f1b3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.227+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f1b440863c0 con 0x7f1b500c9230 2023-10-14T19:11:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.227+0000 7f1b4f7fe700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1b3c067320 0x7f1b3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.227+0000 7f1b4f7fe700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1b3c067320 0x7f1b3c0697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1b40007fd0 tx=0x7f1b40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.231+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b44052e30 con 0x7f1b500c9230 2023-10-14T19:11:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.469+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000819117"} v 0) v1 -- 0x7f1b500cb1a0 con 0x7f1b500c9230 2023-10-14T19:11:39.471 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:11:39.470+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:11:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.474+0000 7f1b377fe700 1 -- 172.21.15.7:0/3170686349 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000819117"}]=0 volume_0000000000819117 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) v1 ==== 195+0+0 (secure 0 0 0) 0x7f1b44056450 con 0x7f1b500c9230 2023-10-14T19:11:39.475 INFO:tasks.ceph.mds.c.smithi007.stderr: -932> 2023-10-14T19:11:19.735+0000 7fdc20e38700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:11:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1b3c067320 msgr2=0x7f1b3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1b3c067320 0x7f1b3c0697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1b40007fd0 tx=0x7f1b40009040 comp rx=0 tx=0).stop 2023-10-14T19:11:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 msgr2=0x7f1b50156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 0x7f1b50156c60 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e4b0 tx=0x7f1b4401a000 comp rx=0 tx=0).stop 2023-10-14T19:11:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 shutdown_connections 2023-10-14T19:11:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1b3c067320 0x7f1b3c0697d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b501571a0 0x7f1b500b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b38004810 0x7f1b50158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 --2- 172.21.15.7:0/3170686349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b500c9230 0x7f1b50156c60 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 >> 172.21.15.7:0/3170686349 conn(0x7f1b50070e30 msgr2=0x7f1b500b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 shutdown_connections 2023-10-14T19:11:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.477+0000 7f1b55f48700 1 -- 172.21.15.7:0/3170686349 wait complete. 2023-10-14T19:11:39.481 INFO:teuthology.orchestra.run.smithi007.stderr:volume_0000000000819117 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:11:39.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000819117 --yes-i-really-mean-it 2023-10-14T19:11:39.497 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:11:39.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.614+0000 7fcb5b59e700 1 Processor -- start 2023-10-14T19:11:39.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.614+0000 7fcb5b59e700 1 -- start start 2023-10-14T19:11:39.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcb5c153a00 0x7fcb5c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb5c0cea00 0x7fcb5c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c15ac50 con 0x7fcb5c15de50 2023-10-14T19:11:39.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5b59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c15d010 con 0x7fcb5c0cea00 2023-10-14T19:11:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c0cf3c0 con 0x7fcb5c153a00 2023-10-14T19:11:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5ad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb5c0cea00 0x7fcb5c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5ad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb5c0cea00 0x7fcb5c0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35658/0 (socket says 172.21.15.7:35658) 2023-10-14T19:11:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/1926283127 learned_addr learned my addr 172.21.15.7:0/1926283127 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.615+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/1926283127 >> v2:172.21.15.148:3300/0 conn(0x7fcb5c153a00 0x7fcb5c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/1926283127 >> v2:172.21.15.148:3300/0 conn(0x7fcb5c153a00 msgr2=0x7fcb5c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/1926283127 >> v2:172.21.15.148:3300/0 conn(0x7fcb5c153a00 0x7fcb5c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/1926283127 >> v1:172.21.15.148:6789/0 conn(0x7fcb5c15de50 legacy=0x7fcb5c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/1926283127 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c15af60 con 0x7fcb5c0cea00 2023-10-14T19:11:39.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/1926283127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cea00 0x7fcb5c0cee80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0cac20 tx=0x7fcb4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46abc02f50fee9ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:39.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5959a700 1 -- 172.21.15.7:0/1926283127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00e070 con 0x7fcb5c0cea00 2023-10-14T19:11:39.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5959a700 1 -- 172.21.15.7:0/1926283127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00ba20 con 0x7fcb5c0cea00 2023-10-14T19:11:39.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5959a700 1 -- 172.21.15.7:0/1926283127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0092e0 con 0x7fcb5c0cea00 2023-10-14T19:11:39.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5b59e700 1 -- 172.21.15.7:0/1926283127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cea00 msgr2=0x7fcb5c0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.616+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/1926283127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cea00 0x7fcb5c0cee80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0cac20 tx=0x7fcb4c009840 comp rx=0 tx=0).stop 2023-10-14T19:11:39.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.617+0000 7fcb5b59e700 1 -- 172.21.15.7:0/1926283127 shutdown_connections 2023-10-14T19:11:39.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.617+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/1926283127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c0cea00 0x7fcb5c0cee80 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.617+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/1926283127 >> v2:172.21.15.148:3300/0 conn(0x7fcb5c153a00 0x7fcb5c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.617+0000 7fcb5b59e700 1 -- 172.21.15.7:0/1926283127 >> 172.21.15.7:0/1926283127 conn(0x7fcb5c0703a0 msgr2=0x7fcb5c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:39.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.617+0000 7fcb5b59e700 1 -- 172.21.15.7:0/1926283127 shutdown_connections 2023-10-14T19:11:39.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.617+0000 7fcb5b59e700 1 -- 172.21.15.7:0/1926283127 wait complete. 2023-10-14T19:11:39.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 Processor -- start 2023-10-14T19:11:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 -- start start 2023-10-14T19:11:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb5c0cea00 0x7fcb5c1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb5c153a00 0x7fcb5c0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 0x7fcb5c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0cbbe0 con 0x7fcb5c15de50 2023-10-14T19:11:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0cb2f0 con 0x7fcb5c153a00 2023-10-14T19:11:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c156be0 con 0x7fcb5c0cea00 2023-10-14T19:11:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.618+0000 7fcb5ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 0x7fcb5c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 0x7fcb5c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35662/0 (socket says 172.21.15.7:35662) 2023-10-14T19:11:39.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/2826290458 learned_addr learned my addr 172.21.15.7:0/2826290458 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:39.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb5c0cea00 0x7fcb5c1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb59d9b700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb5c153a00 0x7fcb5c0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb5c0cea00 msgr2=0x7fcb5c1509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb5c0cea00 0x7fcb5c1509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb5c153a00 msgr2=0x7fcb5c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb5c153a00 0x7fcb5c0cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 -- 172.21.15.7:0/2826290458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009ae0 con 0x7fcb5c15de50 2023-10-14T19:11:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5ad9d700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 0x7fcb5c153dd0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009880 tx=0x7fcb4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c008a80 con 0x7fcb5c15de50 2023-10-14T19:11:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c008be0 con 0x7fcb5c15de50 2023-10-14T19:11:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c025460 con 0x7fcb5c15de50 2023-10-14T19:11:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c0cb590 con 0x7fcb5c15de50 2023-10-14T19:11:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.619+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c154990 con 0x7fcb5c15de50 2023-10-14T19:11:39.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.620+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c15d1a0 con 0x7fcb5c15de50 2023-10-14T19:11:39.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.621+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb4c003040 con 0x7fcb5c15de50 2023-10-14T19:11:39.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.621+0000 7fcb527fc700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb3c067320 0x7fcb3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:39.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.621+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fcb4c086490 con 0x7fcb5c15de50 2023-10-14T19:11:39.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.621+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb3c067320 0x7fcb3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:39.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.622+0000 7fcb5a59c700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb3c067320 0x7fcb3c0697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009db0 tx=0x7fcb540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:39.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.625+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb4c052e90 con 0x7fcb5c15de50 2023-10-14T19:11:39.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:39.864+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000819117", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb5c04c3c0 con 0x7fcb5c15de50 2023-10-14T19:11:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.477+0000 7fcb527fc700 1 -- 172.21.15.7:0/2826290458 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000819117", "yes_i_really_mean_it": true}]=0 v116) v1 ==== 121+0+0 (secure 0 0 0) 0x7fcb4c0564b0 con 0x7fcb5c15de50 2023-10-14T19:11:40.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb3c067320 msgr2=0x7fcb3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb3c067320 0x7fcb3c0697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009db0 tx=0x7fcb540091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 msgr2=0x7fcb5c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 0x7fcb5c153dd0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009880 tx=0x7fcb4c018000 comp rx=0 tx=0).stop 2023-10-14T19:11:40.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 shutdown_connections 2023-10-14T19:11:40.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcb3c067320 0x7fcb3c0697d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb5c15de50 0x7fcb5c153dd0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb5c0cea00 0x7fcb5c1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 --2- 172.21.15.7:0/2826290458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb5c153a00 0x7fcb5c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 >> 172.21.15.7:0/2826290458 conn(0x7fcb5c0703a0 msgr2=0x7fcb5c0b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:40.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 shutdown_connections 2023-10-14T19:11:40.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.480+0000 7fcb5b59e700 1 -- 172.21.15.7:0/2826290458 wait complete. 2023-10-14T19:11:40.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000819117.meta cephfs.volume_0000000000819117.meta --yes-i-really-really-mean-it 2023-10-14T19:11:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.668+0000 7fd226879700 1 Processor -- start 2023-10-14T19:11:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.668+0000 7fd226879700 1 -- start start 2023-10-14T19:11:40.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd226879700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd2200cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd226879700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200cf340 con 0x7fd2201595e0 2023-10-14T19:11:40.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd226879700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200ce730 con 0x7fd2201599b0 2023-10-14T19:11:40.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd226879700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200cea10 con 0x7fd2200ce270 2023-10-14T19:11:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd2201595e0 0x7fd2200cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38108/0 (socket says 172.21.15.7:38108) 2023-10-14T19:11:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21ffff700 1 -- 172.21.15.7:0/1951870462 learned_addr learned my addr 172.21.15.7:0/1951870462 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd2200cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62039391 0 0) 0x7fd2200cf340 con 0x7fd2201595e0 2023-10-14T19:11:40.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd20c003570 con 0x7fd2201595e0 2023-10-14T19:11:40.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104947266 0 0) 0x7fd2200ce730 con 0x7fd2201599b0 2023-10-14T19:11:40.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2200cf340 con 0x7fd2201599b0 2023-10-14T19:11:40.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1694133988 0 0) 0x7fd20c003570 con 0x7fd2201595e0 2023-10-14T19:11:40.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 msgr2=0x7fd2200cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd2200cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 >> v1:172.21.15.148:6789/0 conn(0x7fd2201599b0 legacy=0x7fd2200ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200cecf0 con 0x7fd2201595e0 2023-10-14T19:11:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fd210001470 con 0x7fd2201595e0 2023-10-14T19:11:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 >> v1:172.21.15.7:6789/0 conn(0x7fd2201595e0 legacy=0x7fd2200cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20c003c20 0x7fd20c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.669+0000 7fd21effd700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd20c004810 0x7fd20c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd20c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200cea10 con 0x7fd20c004810 2023-10-14T19:11:40.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c00bbf0 con 0x7fd20c003c20 2023-10-14T19:11:40.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c00bdb0 con 0x7fd2200ce270 2023-10-14T19:11:40.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd20c004810 0x7fd20c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21ffff700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20c003c20 0x7fd20c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd224e16700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd20c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 -- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 msgr2=0x7fd20c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:40.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd20c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 -- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20c003c20 msgr2=0x7fd20c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:40.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20c003c20 0x7fd20c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 -- 172.21.15.7:0/1951870462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c003570 con 0x7fd20c004810 2023-10-14T19:11:40.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd224e16700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2200ce270 0x7fd20c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd20c004810 0x7fd20c004c80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd2200ce660 tx=0x7fd2080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52a08db60b1a8f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800e710 con 0x7fd20c004810 2023-10-14T19:11:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800e870 con 0x7fd20c004810 2023-10-14T19:11:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.670+0000 7fd21effd700 1 -- 172.21.15.7:0/1951870462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800ec30 con 0x7fd20c004810 2023-10-14T19:11:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd226879700 1 -- 172.21.15.7:0/1951870462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd20c004810 msgr2=0x7fd20c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd226879700 1 --2- 172.21.15.7:0/1951870462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd20c004810 0x7fd20c004c80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd2200ce660 tx=0x7fd2080091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd224e16700 1 -- 172.21.15.7:0/1951870462 reap_dead start 2023-10-14T19:11:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd226879700 1 -- 172.21.15.7:0/1951870462 shutdown_connections 2023-10-14T19:11:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd226879700 1 -- 172.21.15.7:0/1951870462 >> 172.21.15.7:0/1951870462 conn(0x7fd2200999c0 msgr2=0x7fd220070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd226879700 1 -- 172.21.15.7:0/1951870462 shutdown_connections 2023-10-14T19:11:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.671+0000 7fd226879700 1 -- 172.21.15.7:0/1951870462 wait complete. 2023-10-14T19:11:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.672+0000 7fd226879700 1 Processor -- start 2023-10-14T19:11:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.672+0000 7fd226879700 1 -- start start 2023-10-14T19:11:40.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd226879700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd20c004810 0x7fd2200c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd226879700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 0x7fd22016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd226879700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd22009b1f0 0x7fd2200b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd226879700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200caa70 con 0x7fd22009ad80 2023-10-14T19:11:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd226879700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200c9e60 con 0x7fd22009b1f0 2023-10-14T19:11:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd226879700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200ca140 con 0x7fd20c004810 2023-10-14T19:11:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 0x7fd22016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 0x7fd22016b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35682/0 (socket says 172.21.15.7:35682) 2023-10-14T19:11:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 -- 172.21.15.7:0/3889667808 learned_addr learned my addr 172.21.15.7:0/3889667808 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 -- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd20c004810 msgr2=0x7fd2200c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd20c004810 0x7fd2200c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd224e16700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd22009b1f0 0x7fd2200b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 -- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd22009b1f0 msgr2=0x7fd2200b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd22009b1f0 0x7fd2200b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 -- 172.21.15.7:0/3889667808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200ca420 con 0x7fd22009ad80 2023-10-14T19:11:40.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.673+0000 7fd21f7fe700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 0x7fd22016b080 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd20800e4b0 tx=0x7fd20801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:40.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.674+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208022070 con 0x7fd22009ad80 2023-10-14T19:11:40.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.674+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800e9e0 con 0x7fd22009ad80 2023-10-14T19:11:40.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.674+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200ca700 con 0x7fd22009ad80 2023-10-14T19:11:40.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.674+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208027470 con 0x7fd22009ad80 2023-10-14T19:11:40.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.674+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200b5b80 con 0x7fd22009ad80 2023-10-14T19:11:40.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.675+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22004c3c0 con 0x7fd22009ad80 2023-10-14T19:11:40.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.675+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd20801c450 con 0x7fd22009ad80 2023-10-14T19:11:40.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.675+0000 7fd217fff700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd200067350 0x7fd200069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:40.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.675+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fd208086940 con 0x7fd22009ad80 2023-10-14T19:11:40.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.676+0000 7fd21ffff700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd200067350 0x7fd200069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:40.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.676+0000 7fd21ffff700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd200067350 0x7fd200069800 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd210007cc0 tx=0x7fd210001d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:40.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.680+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd208053460 con 0x7fd22009ad80 2023-10-14T19:11:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:40.872+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000819117.meta", "pool2": "cephfs.volume_0000000000819117.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd2200cc440 con 0x7fd22009ad80 2023-10-14T19:11:41.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.479+0000 7fd217fff700 1 -- 172.21.15.7:0/3889667808 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000819117.meta", "pool2": "cephfs.volume_0000000000819117.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000819117.meta' removed v172) v1 ==== 241+0+0 (secure 0 0 0) 0x7fd20802c100 con 0x7fd22009ad80 2023-10-14T19:11:41.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd200067350 msgr2=0x7fd200069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:41.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd200067350 0x7fd200069800 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd210007cc0 tx=0x7fd210001d40 comp rx=0 tx=0).stop 2023-10-14T19:11:41.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 msgr2=0x7fd22016b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:41.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 0x7fd22016b080 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd20800e4b0 tx=0x7fd20801a000 comp rx=0 tx=0).stop 2023-10-14T19:11:41.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 shutdown_connections 2023-10-14T19:11:41.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd200067350 0x7fd200069800 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd22009b1f0 0x7fd2200b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd20c004810 0x7fd2200c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 --2- 172.21.15.7:0/3889667808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd22009ad80 0x7fd22016b080 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 >> 172.21.15.7:0/3889667808 conn(0x7fd2200999c0 msgr2=0x7fd2200ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 shutdown_connections 2023-10-14T19:11:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.482+0000 7fd226879700 1 -- 172.21.15.7:0/3889667808 wait complete. 2023-10-14T19:11:41.486 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs.volume_0000000000819117.meta' removed 2023-10-14T19:11:41.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:11:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.626+0000 7fe194c6c700 1 Processor -- start 2023-10-14T19:11:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.627+0000 7fe194c6c700 1 -- start start 2023-10-14T19:11:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe194c6c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe190159530 0x7fe1900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe194c6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1900cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe194c6c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900cc090 con 0x7fe19006dcf0 2023-10-14T19:11:41.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe194c6c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900ccfd0 con 0x7fe190159530 2023-10-14T19:11:41.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe194c6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19015a410 con 0x7fe1900cb6f0 2023-10-14T19:11:41.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe190159530 0x7fe1900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:41.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe190159530 0x7fe1900ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35692/0 (socket says 172.21.15.7:35692) 2023-10-14T19:11:41.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 -- 172.21.15.7:0/3189801725 learned_addr learned my addr 172.21.15.7:0/3189801725 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18ed9d700 1 --2- 172.21.15.7:0/3189801725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1900cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 -- 172.21.15.7:0/3189801725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 msgr2=0x7fe1900cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 --2- 172.21.15.7:0/3189801725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1900cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 -- 172.21.15.7:0/3189801725 >> v1:172.21.15.148:6789/0 conn(0x7fe19006dcf0 legacy=0x7fe190159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 -- 172.21.15.7:0/3189801725 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19015a6f0 con 0x7fe190159530 2023-10-14T19:11:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18e59c700 1 --2- 172.21.15.7:0/3189801725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900ceba0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe1880099b0 tx=0x7fe188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bd01c9588f01c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18d59a700 1 -- 172.21.15.7:0/3189801725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800b820 con 0x7fe190159530 2023-10-14T19:11:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18d59a700 1 -- 172.21.15.7:0/3189801725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18800b980 con 0x7fe190159530 2023-10-14T19:11:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.628+0000 7fe18d59a700 1 -- 172.21.15.7:0/3189801725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800bd20 con 0x7fe190159530 2023-10-14T19:11:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 -- 172.21.15.7:0/3189801725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 msgr2=0x7fe1900ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 --2- 172.21.15.7:0/3189801725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900ceba0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe1880099b0 tx=0x7fe188009250 comp rx=0 tx=0).stop 2023-10-14T19:11:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 -- 172.21.15.7:0/3189801725 shutdown_connections 2023-10-14T19:11:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 --2- 172.21.15.7:0/3189801725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1900cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 --2- 172.21.15.7:0/3189801725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900ceba0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 -- 172.21.15.7:0/3189801725 >> 172.21.15.7:0/3189801725 conn(0x7fe1900703a0 msgr2=0x7fe1900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 -- 172.21.15.7:0/3189801725 shutdown_connections 2023-10-14T19:11:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.629+0000 7fe194c6c700 1 -- 172.21.15.7:0/3189801725 wait complete. 2023-10-14T19:11:41.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.630+0000 7fe194c6c700 1 Processor -- start 2023-10-14T19:11:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.630+0000 7fe194c6c700 1 -- start start 2023-10-14T19:11:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe194c6c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe19006dcf0 0x7fe1900ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe194c6c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1901547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe194c6c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe194c6c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19016a700 con 0x7fe190159530 2023-10-14T19:11:41.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe194c6c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900ca5f0 con 0x7fe19006dcf0 2023-10-14T19:11:41.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe194c6c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190154d10 con 0x7fe1900cb6f0 2023-10-14T19:11:41.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:41.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35704/0 (socket says 172.21.15.7:35704) 2023-10-14T19:11:41.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 -- 172.21.15.7:0/4058919777 learned_addr learned my addr 172.21.15.7:0/4058919777 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18dd9b700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1901547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18e59c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe19006dcf0 0x7fe1900ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 -- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 msgr2=0x7fe1901547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1901547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 -- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe19006dcf0 msgr2=0x7fe1900ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe19006dcf0 0x7fe1900ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18ed9d700 1 -- 172.21.15.7:0/4058919777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1880094f0 con 0x7fe190159530 2023-10-14T19:11:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.631+0000 7fe18e59c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe19006dcf0 0x7fe1900ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.632+0000 7fe18ed9d700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900b1a10 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fe18000ceb0 tx=0x7fe180007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.632+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18000ae40 con 0x7fe190159530 2023-10-14T19:11:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.632+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180016430 con 0x7fe190159530 2023-10-14T19:11:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.632+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190169af0 con 0x7fe190159530 2023-10-14T19:11:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.632+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800167d0 con 0x7fe190159530 2023-10-14T19:11:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.632+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19016a0b0 con 0x7fe190159530 2023-10-14T19:11:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.633+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19004c3c0 con 0x7fe190159530 2023-10-14T19:11:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.633+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe180003020 con 0x7fe190159530 2023-10-14T19:11:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.634+0000 7fe1867fc700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe170067320 0x7fe1700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.634+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe180012070 con 0x7fe190159530 2023-10-14T19:11:41.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.634+0000 7fe18e59c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe170067320 0x7fe1700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:41.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.634+0000 7fe18e59c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe170067320 0x7fe1700697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe1880099b0 tx=0x7fe188016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:41.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.638+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1800528b0 con 0x7fe190159530 2023-10-14T19:11:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:41.830+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe19015a9d0 con 0x7fe190159530 2023-10-14T19:11:42.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.484+0000 7fe1867fc700 1 -- 172.21.15.7:0/4058919777 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v173) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe180055ed0 con 0x7fe190159530 2023-10-14T19:11:42.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.491+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe170067320 msgr2=0x7fe1700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:42.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.491+0000 7fe194c6c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe170067320 0x7fe1700697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe1880099b0 tx=0x7fe188016000 comp rx=0 tx=0).stop 2023-10-14T19:11:42.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 msgr2=0x7fe1900b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:42.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900b1a10 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fe18000ceb0 tx=0x7fe180007870 comp rx=0 tx=0).stop 2023-10-14T19:11:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 shutdown_connections 2023-10-14T19:11:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe170067320 0x7fe1700697d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe19006dcf0 0x7fe1900ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe190159530 0x7fe1900b1a10 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 --2- 172.21.15.7:0/4058919777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1900cb6f0 0x7fe1901547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 >> 172.21.15.7:0/4058919777 conn(0x7fe1900703a0 msgr2=0x7fe1900c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 shutdown_connections 2023-10-14T19:11:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.492+0000 7fe194c6c700 1 -- 172.21.15.7:0/4058919777 wait complete. 2023-10-14T19:11:42.496 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:11:42.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm another-data-pool another-data-pool --yes-i-really-really-mean-it 2023-10-14T19:11:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.639+0000 7f63dd019700 1 Processor -- start 2023-10-14T19:11:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.639+0000 7f63dd019700 1 -- start start 2023-10-14T19:11:42.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63dd019700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63d8159fb0 0x7f63d815a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:42.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63dd019700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d815a8c0 0x7f63d80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:42.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63dd019700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d80cd830 con 0x7f63d80cd3d0 2023-10-14T19:11:42.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63dd019700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d815e180 con 0x7f63d8159fb0 2023-10-14T19:11:42.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63dd019700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d815d570 con 0x7f63d815a8c0 2023-10-14T19:11:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63d7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63d8159fb0 0x7f63d815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63d7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63d8159fb0 0x7f63d815a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35714/0 (socket says 172.21.15.7:35714) 2023-10-14T19:11:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.640+0000 7f63d7fff700 1 -- 172.21.15.7:0/1022176456 learned_addr learned my addr 172.21.15.7:0/1022176456 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d7fff700 1 -- 172.21.15.7:0/1022176456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d815a8c0 msgr2=0x7f63d80cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d7fff700 1 --2- 172.21.15.7:0/1022176456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d815a8c0 0x7f63d80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d7fff700 1 -- 172.21.15.7:0/1022176456 >> v1:172.21.15.148:6789/0 conn(0x7f63d80cd3d0 legacy=0x7f63d806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:42.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d7fff700 1 -- 172.21.15.7:0/1022176456 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d815d850 con 0x7f63d8159fb0 2023-10-14T19:11:42.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d7fff700 1 --2- 172.21.15.7:0/1022176456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d8159fb0 0x7f63d815a380 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f63c00099b0 tx=0x7f63c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8ff7122d0eb175 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:42.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d6ffd700 1 -- 172.21.15.7:0/1022176456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000b820 con 0x7f63d8159fb0 2023-10-14T19:11:42.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d6ffd700 1 -- 172.21.15.7:0/1022176456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000b980 con 0x7f63d8159fb0 2023-10-14T19:11:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63d6ffd700 1 -- 172.21.15.7:0/1022176456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000bd20 con 0x7f63d8159fb0 2023-10-14T19:11:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 -- 172.21.15.7:0/1022176456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d8159fb0 msgr2=0x7f63d815a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 --2- 172.21.15.7:0/1022176456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d8159fb0 0x7f63d815a380 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f63c00099b0 tx=0x7f63c0009250 comp rx=0 tx=0).stop 2023-10-14T19:11:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 -- 172.21.15.7:0/1022176456 shutdown_connections 2023-10-14T19:11:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 --2- 172.21.15.7:0/1022176456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d8159fb0 0x7f63d815a380 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 --2- 172.21.15.7:0/1022176456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d815a8c0 0x7f63d80cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 -- 172.21.15.7:0/1022176456 >> 172.21.15.7:0/1022176456 conn(0x7f63d80703a0 msgr2=0x7f63d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 -- 172.21.15.7:0/1022176456 shutdown_connections 2023-10-14T19:11:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.641+0000 7f63dd019700 1 -- 172.21.15.7:0/1022176456 wait complete. 2023-10-14T19:11:42.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 Processor -- start 2023-10-14T19:11:42.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 -- start start 2023-10-14T19:11:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d80cd3d0 0x7f63d80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63d8159fb0 0x7f63d80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 0x7f63d80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c86a0 con 0x7f63d815a8c0 2023-10-14T19:11:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c7a90 con 0x7f63d8159fb0 2023-10-14T19:11:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.643+0000 7f63dd019700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c7d70 con 0x7f63d80cd3d0 2023-10-14T19:11:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 0x7f63d80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 0x7f63d80b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35716/0 (socket says 172.21.15.7:35716) 2023-10-14T19:11:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 -- 172.21.15.7:0/1760945155 learned_addr learned my addr 172.21.15.7:0/1760945155 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63d7fff700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d80cd3d0 0x7f63d80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63d77fe700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63d8159fb0 0x7f63d80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 -- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d80cd3d0 msgr2=0x7f63d80b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d80cd3d0 0x7f63d80b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 -- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63d8159fb0 msgr2=0x7f63d80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63d8159fb0 0x7f63d80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 -- 172.21.15.7:0/1760945155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00094f0 con 0x7f63d815a8c0 2023-10-14T19:11:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dc818700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 0x7f63d80b5200 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f63d000bbb0 tx=0x7f63d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00092e0 con 0x7f63d815a8c0 2023-10-14T19:11:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000c630 con 0x7f63d815a8c0 2023-10-14T19:11:42.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d80c8050 con 0x7f63d815a8c0 2023-10-14T19:11:42.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000c9f0 con 0x7f63d815a8c0 2023-10-14T19:11:42.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.644+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d80c7600 con 0x7f63d815a8c0 2023-10-14T19:11:42.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.645+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d80c7820 con 0x7f63d815a8c0 2023-10-14T19:11:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.646+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f63d0012070 con 0x7f63d815a8c0 2023-10-14T19:11:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.646+0000 7f63cffff700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63b8067320 0x7f63b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.646+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5360+0+0 (secure 0 0 0) 0x7f63d00847b0 con 0x7f63d815a8c0 2023-10-14T19:11:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.646+0000 7f63d7fff700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63b8067320 0x7f63b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.647+0000 7f63d7fff700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63b8067320 0x7f63b80697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f63c00099b0 tx=0x7f63c0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.650+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63d0051650 con 0x7f63d815a8c0 2023-10-14T19:11:42.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:42.851+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f63d804c3c0 con 0x7f63d815a8c0 2023-10-14T19:11:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.488+0000 7f63cffff700 1 -- 172.21.15.7:0/1760945155 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true}]=0 pool 'another-data-pool' removed v174) v1 ==== 187+0+0 (secure 0 0 0) 0x7f63d0054c70 con 0x7f63d815a8c0 2023-10-14T19:11:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63b8067320 msgr2=0x7f63b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63b8067320 0x7f63b80697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f63c00099b0 tx=0x7f63c0016000 comp rx=0 tx=0).stop 2023-10-14T19:11:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 msgr2=0x7f63d80b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 0x7f63d80b5200 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f63d000bbb0 tx=0x7f63d0009840 comp rx=0 tx=0).stop 2023-10-14T19:11:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 shutdown_connections 2023-10-14T19:11:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f63b8067320 0x7f63b80697d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d815a8c0 0x7f63d80b5200 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63d80cd3d0 0x7f63d80b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 --2- 172.21.15.7:0/1760945155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63d8159fb0 0x7f63d80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 >> 172.21.15.7:0/1760945155 conn(0x7f63d80703a0 msgr2=0x7f63d80b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 shutdown_connections 2023-10-14T19:11:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.492+0000 7f63dd019700 1 -- 172.21.15.7:0/1760945155 wait complete. 2023-10-14T19:11:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'another-data-pool' removed 2023-10-14T19:11:43.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:11:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.640+0000 7fd8297c7700 1 Processor -- start 2023-10-14T19:11:43.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.640+0000 7fd8297c7700 1 -- start start 2023-10-14T19:11:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd8297c7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8240cc320 0x7fd82413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd8297c7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82406d7b0 con 0x7fd82406a110 2023-10-14T19:11:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd8297c7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82406e330 con 0x7fd8240cc6f0 2023-10-14T19:11:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd8297c7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82406a570 con 0x7fd8240cc320 2023-10-14T19:11:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd822ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8240cc320 0x7fd82413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd8237fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd82406a110 0x7fd82406e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38110/0 (socket says 172.21.15.7:38110) 2023-10-14T19:11:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd8237fe700 1 -- 172.21.15.7:0/3598559697 learned_addr learned my addr 172.21.15.7:0/3598559697 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd822ffd700 1 -- 172.21.15.7:0/3598559697 >> v1:172.21.15.148:6789/0 conn(0x7fd8240cc6f0 legacy=0x7fd824069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd822ffd700 1 -- 172.21.15.7:0/3598559697 >> v1:172.21.15.7:6789/0 conn(0x7fd82406a110 legacy=0x7fd82406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd822ffd700 1 -- 172.21.15.7:0/3598559697 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82406da00 con 0x7fd8240cc320 2023-10-14T19:11:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd821ffb700 1 -- 172.21.15.7:0/3598559697 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215517526 0 0) 0x7fd82406d7b0 con 0x7fd82406a110 2023-10-14T19:11:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd822ffd700 1 --2- 172.21.15.7:0/3598559697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8240cc320 0x7fd82413c2a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd8140098e0 tx=0x7fd8140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42b6da32dabd64c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd821ffb700 1 -- 172.21.15.7:0/3598559697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814009e80 con 0x7fd8240cc320 2023-10-14T19:11:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd821ffb700 1 -- 172.21.15.7:0/3598559697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81400b860 con 0x7fd8240cc320 2023-10-14T19:11:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.641+0000 7fd821ffb700 1 -- 172.21.15.7:0/3598559697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81400bbe0 con 0x7fd8240cc320 2023-10-14T19:11:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 -- 172.21.15.7:0/3598559697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8240cc320 msgr2=0x7fd82413c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 --2- 172.21.15.7:0/3598559697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8240cc320 0x7fd82413c2a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd8140098e0 tx=0x7fd8140091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 -- 172.21.15.7:0/3598559697 shutdown_connections 2023-10-14T19:11:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 --2- 172.21.15.7:0/3598559697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8240cc320 0x7fd82413c2a0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 -- 172.21.15.7:0/3598559697 >> 172.21.15.7:0/3598559697 conn(0x7fd824067f00 msgr2=0x7fd824068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 -- 172.21.15.7:0/3598559697 shutdown_connections 2023-10-14T19:11:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.642+0000 7fd8297c7700 1 -- 172.21.15.7:0/3598559697 wait complete. 2023-10-14T19:11:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.643+0000 7fd8297c7700 1 Processor -- start 2023-10-14T19:11:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.643+0000 7fd8297c7700 1 -- start start 2023-10-14T19:11:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8297c7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 0x7fd8240b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8297c7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8240cc320 0x7fd824138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8297c7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8240cc6f0 0x7fd82416d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8297c7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824138e40 con 0x7fd82406a110 2023-10-14T19:11:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8297c7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240c6620 con 0x7fd8240cc320 2023-10-14T19:11:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8297c7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240c6900 con 0x7fd8240cc6f0 2023-10-14T19:11:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 0x7fd8240b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 0x7fd8240b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35746/0 (socket says 172.21.15.7:35746) 2023-10-14T19:11:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 -- 172.21.15.7:0/1092845 learned_addr learned my addr 172.21.15.7:0/1092845 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8237fe700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8240cc6f0 0x7fd82416d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8227fc700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8240cc320 0x7fd824138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 -- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8240cc6f0 msgr2=0x7fd82416d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8240cc6f0 0x7fd82416d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 -- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8240cc320 msgr2=0x7fd824138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8240cc320 0x7fd824138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd822ffd700 1 -- 172.21.15.7:0/1092845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd814009420 con 0x7fd82406a110 2023-10-14T19:11:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8237fe700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8240cc6f0 0x7fd82416d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.644+0000 7fd8227fc700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8240cc320 0x7fd824138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.645+0000 7fd822ffd700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 0x7fd8240b0ad0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd8240cf610 tx=0x7fd814017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.645+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81401f070 con 0x7fd82406a110 2023-10-14T19:11:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.645+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814011420 con 0x7fd82406a110 2023-10-14T19:11:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.645+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8240c6be0 con 0x7fd82406a110 2023-10-14T19:11:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.645+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81400bbe0 con 0x7fd82406a110 2023-10-14T19:11:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.645+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8240c71a0 con 0x7fd82406a110 2023-10-14T19:11:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.646+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82404c3c0 con 0x7fd82406a110 2023-10-14T19:11:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.646+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd814011a50 con 0x7fd82406a110 2023-10-14T19:11:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.647+0000 7fd80affd700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd810067320 0x7fd8100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.647+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd814085fa0 con 0x7fd82406a110 2023-10-14T19:11:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.647+0000 7fd8227fc700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd810067320 0x7fd8100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.647+0000 7fd8227fc700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd810067320 0x7fd8100697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd8240b3d20 tx=0x7fd818009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.651+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd814052f30 con 0x7fd82406a110 2023-10-14T19:11:43.847 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.846+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd82406dce0 con 0x7fd82406a110 2023-10-14T19:11:43.850 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.850+0000 7fd80affd700 1 -- 172.21.15.7:0/1092845 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd814056550 con 0x7fd82406a110 2023-10-14T19:11:43.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd810067320 msgr2=0x7fd8100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd810067320 0x7fd8100697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd8240b3d20 tx=0x7fd818009040 comp rx=0 tx=0).stop 2023-10-14T19:11:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 msgr2=0x7fd8240b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 0x7fd8240b0ad0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd8240cf610 tx=0x7fd814017000 comp rx=0 tx=0).stop 2023-10-14T19:11:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 shutdown_connections 2023-10-14T19:11:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd810067320 0x7fd8100697d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8240cc6f0 0x7fd82416d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd82406a110 0x7fd8240b0ad0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 --2- 172.21.15.7:0/1092845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8240cc320 0x7fd824138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 >> 172.21.15.7:0/1092845 conn(0x7fd824067f00 msgr2=0x7fd8240b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:43.855 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 shutdown_connections 2023-10-14T19:11:43.856 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.852+0000 7fd8297c7700 1 -- 172.21.15.7:0/1092845 wait complete. 2023-10-14T19:11:43.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-14T19:11:43.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.984+0000 7fbb46521700 1 Processor -- start 2023-10-14T19:11:43.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.984+0000 7fbb46521700 1 -- start start 2023-10-14T19:11:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb46521700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb400cb5a0 0x7fbb400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb46521700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbb4015a5d0 0x7fbb40156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb46521700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4015ae40 con 0x7fbb400cd9e0 2023-10-14T19:11:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb46521700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb400d13f0 con 0x7fbb4015a5d0 2023-10-14T19:11:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb46521700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4015ab60 con 0x7fbb400cb5a0 2023-10-14T19:11:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb44abe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbb4015a5d0 0x7fbb40156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb3f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbb400cd9e0 0x7fbb40159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38126/0 (socket says 172.21.15.7:38126) 2023-10-14T19:11:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb3f7fe700 1 -- 172.21.15.7:0/1715766544 learned_addr learned my addr 172.21.15.7:0/1715766544 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb44abe700 1 -- 172.21.15.7:0/1715766544 >> v2:172.21.15.148:3300/0 conn(0x7fbb400cb5a0 msgr2=0x7fbb400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb44abe700 1 --2- 172.21.15.7:0/1715766544 >> v2:172.21.15.148:3300/0 conn(0x7fbb400cb5a0 0x7fbb400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb44abe700 1 -- 172.21.15.7:0/1715766544 >> v1:172.21.15.7:6789/0 conn(0x7fbb400cd9e0 legacy=0x7fbb40159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb3effd700 1 -- 172.21.15.7:0/1715766544 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372524756 0 0) 0x7fbb4015ae40 con 0x7fbb400cd9e0 2023-10-14T19:11:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.985+0000 7fbb44abe700 1 -- 172.21.15.7:0/1715766544 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb400ccf00 con 0x7fbb4015a5d0 2023-10-14T19:11:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb44abe700 1 --2- 172.21.15.7:0/1715766544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb4015a5d0 0x7fbb40156e90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009e60 tx=0x7fbb38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbae8ba6b1edf30b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb3effd700 1 -- 172.21.15.7:0/1715766544 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800e070 con 0x7fbb4015a5d0 2023-10-14T19:11:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb3effd700 1 -- 172.21.15.7:0/1715766544 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800bbf0 con 0x7fbb4015a5d0 2023-10-14T19:11:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb3effd700 1 -- 172.21.15.7:0/1715766544 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012430 con 0x7fbb4015a5d0 2023-10-14T19:11:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 -- 172.21.15.7:0/1715766544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb4015a5d0 msgr2=0x7fbb40156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 --2- 172.21.15.7:0/1715766544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb4015a5d0 0x7fbb40156e90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009e60 tx=0x7fbb38009780 comp rx=0 tx=0).stop 2023-10-14T19:11:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 -- 172.21.15.7:0/1715766544 shutdown_connections 2023-10-14T19:11:43.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 --2- 172.21.15.7:0/1715766544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb4015a5d0 0x7fbb40156e90 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 --2- 172.21.15.7:0/1715766544 >> v2:172.21.15.148:3300/0 conn(0x7fbb400cb5a0 0x7fbb400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 -- 172.21.15.7:0/1715766544 >> 172.21.15.7:0/1715766544 conn(0x7fbb40070e30 msgr2=0x7fbb400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:43.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 -- 172.21.15.7:0/1715766544 shutdown_connections 2023-10-14T19:11:43.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.986+0000 7fbb46521700 1 -- 172.21.15.7:0/1715766544 wait complete. 2023-10-14T19:11:43.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.987+0000 7fbb46521700 1 Processor -- start 2023-10-14T19:11:43.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 -- start start 2023-10-14T19:11:43.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb400cb5a0 0x7fbb40152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 0x7fbb40154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb4015a5d0 0x7fbb40155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:43.996 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400b4e60 con 0x7fbb400cd9e0 2023-10-14T19:11:43.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400b4250 con 0x7fbb400cb5a0 2023-10-14T19:11:43.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb46521700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400b4530 con 0x7fbb4015a5d0 2023-10-14T19:11:43.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 0x7fbb40154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 0x7fbb40154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35772/0 (socket says 172.21.15.7:35772) 2023-10-14T19:11:43.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.988+0000 7fbb3f7fe700 1 -- 172.21.15.7:0/2880638 learned_addr learned my addr 172.21.15.7:0/2880638 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:43.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3ffff700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb400cb5a0 0x7fbb40152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb44abe700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb4015a5d0 0x7fbb40155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:43.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3f7fe700 1 -- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb4015a5d0 msgr2=0x7fbb40155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3f7fe700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb4015a5d0 0x7fbb40155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3f7fe700 1 -- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb400cb5a0 msgr2=0x7fbb40152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:43.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3f7fe700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb400cb5a0 0x7fbb40152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:43.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3f7fe700 1 -- 172.21.15.7:0/2880638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38009a20 con 0x7fbb400cd9e0 2023-10-14T19:11:43.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb44abe700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb4015a5d0 0x7fbb40155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:43.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb3f7fe700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 0x7fbb40154f50 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c7e0 tx=0x7fbb34007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:43.999 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34005b30 con 0x7fbb400cd9e0 2023-10-14T19:11:44.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb34005c90 con 0x7fbb400cd9e0 2023-10-14T19:11:44.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb400b4810 con 0x7fbb400cd9e0 2023-10-14T19:11:44.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34007300 con 0x7fbb400cd9e0 2023-10-14T19:11:44.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.989+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb40152660 con 0x7fbb400cd9e0 2023-10-14T19:11:44.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.990+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb400afe60 con 0x7fbb400cd9e0 2023-10-14T19:11:44.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.991+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbb340076b0 con 0x7fbb400cd9e0 2023-10-14T19:11:44.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.991+0000 7fbb27fff700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb2c067320 0x7fbb2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.991+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbb34083ee0 con 0x7fbb400cd9e0 2023-10-14T19:11:44.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.991+0000 7fbb3ffff700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb2c067320 0x7fbb2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.992+0000 7fbb3ffff700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb2c067320 0x7fbb2c0697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009bf0 tx=0x7fbb300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:44.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:43.995+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb34050e70 con 0x7fbb400cd9e0 2023-10-14T19:11:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.271+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7fbb400b4cb0 con 0x7fbb400cd9e0 2023-10-14T19:11:44.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.494+0000 7fbb27fff700 1 -- 172.21.15.7:0/2880638 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v435) v1 ==== 163+0+0 (secure 0 0 0) 0x7fbb34017020 con 0x7fbb400cd9e0 2023-10-14T19:11:44.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb2c067320 msgr2=0x7fbb2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:44.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb2c067320 0x7fbb2c0697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009bf0 tx=0x7fbb300091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 msgr2=0x7fbb40154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:44.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 0x7fbb40154f50 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c7e0 tx=0x7fbb34007df0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 shutdown_connections 2023-10-14T19:11:44.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbb2c067320 0x7fbb2c0697d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb400cb5a0 0x7fbb40152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.499 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb4015a5d0 0x7fbb40155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 --2- 172.21.15.7:0/2880638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb400cd9e0 0x7fbb40154f50 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.496+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 >> 172.21.15.7:0/2880638 conn(0x7fbb40070e30 msgr2=0x7fbb400cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:44.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.497+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 shutdown_connections 2023-10-14T19:11:44.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.497+0000 7fbb46521700 1 -- 172.21.15.7:0/2880638 wait complete. 2023-10-14T19:11:44.510 INFO:tasks.cephfs_test_runner:That renaming a volume with more than one data pool does not change ... ok 2023-10-14T19:11:44.510 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) That volume rename is idempotent. 2023-10-14T19:11:44.510 INFO:tasks.cephfs_test_runner:test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:11:44.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-14T19:11:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.630+0000 7fd0164fc700 1 Processor -- start 2023-10-14T19:11:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.630+0000 7fd0164fc700 1 -- start start 2023-10-14T19:11:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd0164fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100cf200 0x7fd0100c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd0164fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd0100b0ba0 0x7fd01006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd0164fc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01015a280 con 0x7fd0100b07d0 2023-10-14T19:11:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd0164fc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01006e180 con 0x7fd0100b0ba0 2023-10-14T19:11:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd0164fc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01006d850 con 0x7fd0100cf200 2023-10-14T19:11:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd00ffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd0100b07d0 0x7fd0100ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38140/0 (socket says 172.21.15.7:38140) 2023-10-14T19:11:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd00ffff700 1 -- 172.21.15.7:0/3544390188 learned_addr learned my addr 172.21.15.7:0/3544390188 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd00f7fe700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100cf200 0x7fd0100c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd014a99700 1 --2- 172.21.15.7:0/3544390188 >> v2:172.21.15.148:3300/0 conn(0x7fd0100b0ba0 0x7fd01006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd00effd700 1 -- 172.21.15.7:0/3544390188 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363364770 0 0) 0x7fd01015a280 con 0x7fd0100b07d0 2023-10-14T19:11:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.631+0000 7fd00effd700 1 -- 172.21.15.7:0/3544390188 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff8003570 con 0x7fd0100b07d0 2023-10-14T19:11:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd00effd700 1 -- 172.21.15.7:0/3544390188 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811192574 0 0) 0x7fcff8003570 con 0x7fd0100b07d0 2023-10-14T19:11:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd014a99700 1 -- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100cf200 msgr2=0x7fd0100c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd014a99700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100cf200 0x7fd0100c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd014a99700 1 -- 172.21.15.7:0/3544390188 >> v1:172.21.15.7:6789/0 conn(0x7fd0100b07d0 legacy=0x7fd0100ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd014a99700 1 -- 172.21.15.7:0/3544390188 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01006db30 con 0x7fd0100b0ba0 2023-10-14T19:11:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd00f7fe700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100cf200 0x7fd0100c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd014a99700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100b0ba0 0x7fd01006e610 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd008009e60 tx=0x7fd008009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241f96cb1b4c2008 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd00effd700 1 -- 172.21.15.7:0/3544390188 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800e070 con 0x7fd0100b0ba0 2023-10-14T19:11:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd00effd700 1 -- 172.21.15.7:0/3544390188 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00800b7a0 con 0x7fd0100b0ba0 2023-10-14T19:11:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.632+0000 7fd00effd700 1 -- 172.21.15.7:0/3544390188 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000015f0 con 0x7fd0100b0ba0 2023-10-14T19:11:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 -- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100b0ba0 msgr2=0x7fd01006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:44.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100b0ba0 0x7fd01006e610 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd008009e60 tx=0x7fd008009780 comp rx=0 tx=0).stop 2023-10-14T19:11:44.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 -- 172.21.15.7:0/3544390188 shutdown_connections 2023-10-14T19:11:44.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100b0ba0 0x7fd01006e610 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 --2- 172.21.15.7:0/3544390188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100cf200 0x7fd0100c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 -- 172.21.15.7:0/3544390188 >> 172.21.15.7:0/3544390188 conn(0x7fd01006ce80 msgr2=0x7fd0100ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:44.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 -- 172.21.15.7:0/3544390188 shutdown_connections 2023-10-14T19:11:44.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.633+0000 7fd0164fc700 1 -- 172.21.15.7:0/3544390188 wait complete. 2023-10-14T19:11:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.634+0000 7fd0164fc700 1 Processor -- start 2023-10-14T19:11:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.634+0000 7fd0164fc700 1 -- start start 2023-10-14T19:11:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd0164fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100b07d0 0x7fd0101513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd0164fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 0x7fd01009baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd0164fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100cf200 0x7fd010099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd0164fc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd010169860 con 0x7fd0100b0ba0 2023-10-14T19:11:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd0164fc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100c5660 con 0x7fd0100cf200 2023-10-14T19:11:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd0164fc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd010098c80 con 0x7fd0100b07d0 2023-10-14T19:11:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 0x7fd01009baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 0x7fd01009baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35778/0 (socket says 172.21.15.7:35778) 2023-10-14T19:11:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 -- 172.21.15.7:0/1501986868 learned_addr learned my addr 172.21.15.7:0/1501986868 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00ffff700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100b07d0 0x7fd0101513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd014a99700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100cf200 0x7fd010099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 -- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100b07d0 msgr2=0x7fd0101513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100b07d0 0x7fd0101513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 -- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100cf200 msgr2=0x7fd010099a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100cf200 0x7fd010099a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 -- 172.21.15.7:0/1501986868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009420 con 0x7fd0100b0ba0 2023-10-14T19:11:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd014a99700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100cf200 0x7fd010099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.635+0000 7fd00f7fe700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 0x7fd01009baa0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd00400ec80 tx=0x7fd0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.636+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400c8f0 con 0x7fd0100b0ba0 2023-10-14T19:11:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.636+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400ca50 con 0x7fd0100b0ba0 2023-10-14T19:11:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.636+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cdd0 con 0x7fd0100b0ba0 2023-10-14T19:11:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.636+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd008009a20 con 0x7fd0100b0ba0 2023-10-14T19:11:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.636+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0100c5980 con 0x7fd0100b0ba0 2023-10-14T19:11:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.636+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01004c3c0 con 0x7fd0100b0ba0 2023-10-14T19:11:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.637+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd004013680 con 0x7fd0100b0ba0 2023-10-14T19:11:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.637+0000 7fcff7fff700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcffc067320 0x7fcffc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.637+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd004084de0 con 0x7fd0100b0ba0 2023-10-14T19:11:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.638+0000 7fd00ffff700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcffc067320 0x7fcffc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.638+0000 7fd00ffff700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcffc067320 0x7fcffc0697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd000006ce0 tx=0x7fd0000012c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.642+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd004051d70 con 0x7fd0100b0ba0 2023-10-14T19:11:44.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:44.914+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7fd01006de10 con 0x7fd0100b0ba0 2023-10-14T19:11:45.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.497+0000 7fcff7fff700 1 -- 172.21.15.7:0/1501986868 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v436) v1 ==== 150+0+0 (secure 0 0 0) 0x7fd0040210d0 con 0x7fd0100b0ba0 2023-10-14T19:11:45.500 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcffc067320 msgr2=0x7fcffc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcffc067320 0x7fcffc0697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd000006ce0 tx=0x7fd0000012c0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 msgr2=0x7fd01009baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 0x7fd01009baa0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd00400ec80 tx=0x7fd0040091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 shutdown_connections 2023-10-14T19:11:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcffc067320 0x7fcffc0697d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0100cf200 0x7fd010099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0100b07d0 0x7fd0101513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 --2- 172.21.15.7:0/1501986868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0100b0ba0 0x7fd01009baa0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 >> 172.21.15.7:0/1501986868 conn(0x7fd01006ce80 msgr2=0x7fd0100ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:45.502 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 shutdown_connections 2023-10-14T19:11:45.503 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.499+0000 7fd0164fc700 1 -- 172.21.15.7:0/1501986868 wait complete. 2023-10-14T19:11:45.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:11:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.642+0000 7f30f5c66700 1 Processor -- start 2023-10-14T19:11:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.642+0000 7f30f5c66700 1 -- start start 2023-10-14T19:11:45.645 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5c66700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30f0153a00 0x7f30f0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5c66700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30f015de50 0x7f30f015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5c66700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f00cea00 0x7f30f00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5c66700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00cf3c0 con 0x7f30f0153a00 2023-10-14T19:11:45.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5c66700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f015af60 con 0x7f30f015de50 2023-10-14T19:11:45.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5c66700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f015b240 con 0x7f30f00cea00 2023-10-14T19:11:45.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30f0153a00 0x7f30f0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30f0153a00 0x7f30f0153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35790/0 (socket says 172.21.15.7:35790) 2023-10-14T19:11:45.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 -- 172.21.15.7:0/2572741501 learned_addr learned my addr 172.21.15.7:0/2572741501 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:45.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30effff700 1 --2- 172.21.15.7:0/2572741501 >> v2:172.21.15.148:3300/0 conn(0x7f30f015de50 0x7f30f015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5465700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f00cea00 0x7f30f00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 -- 172.21.15.7:0/2572741501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f00cea00 msgr2=0x7f30f00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:45.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f00cea00 0x7f30f00cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 -- 172.21.15.7:0/2572741501 >> v2:172.21.15.148:3300/0 conn(0x7f30f015de50 msgr2=0x7f30f015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:45.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 --2- 172.21.15.7:0/2572741501 >> v2:172.21.15.148:3300/0 conn(0x7f30f015de50 0x7f30f015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f4c64700 1 -- 172.21.15.7:0/2572741501 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f015b520 con 0x7f30f0153a00 2023-10-14T19:11:45.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30effff700 1 --2- 172.21.15.7:0/2572741501 >> v2:172.21.15.148:3300/0 conn(0x7f30f015de50 0x7f30f015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:45.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.643+0000 7f30f5465700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f00cea00 0x7f30f00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:45.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f4c64700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f0153dd0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f30f00b3070 tx=0x7f30e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46710772b37d0d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:45.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30ef7fe700 1 -- 172.21.15.7:0/2572741501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800e070 con 0x7f30f0153a00 2023-10-14T19:11:45.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30ef7fe700 1 -- 172.21.15.7:0/2572741501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800ba50 con 0x7f30f0153a00 2023-10-14T19:11:45.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30ef7fe700 1 -- 172.21.15.7:0/2572741501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e80092e0 con 0x7f30f0153a00 2023-10-14T19:11:45.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 -- 172.21.15.7:0/2572741501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 msgr2=0x7f30f0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f0153dd0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f30f00b3070 tx=0x7f30e8009840 comp rx=0 tx=0).stop 2023-10-14T19:11:45.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 -- 172.21.15.7:0/2572741501 shutdown_connections 2023-10-14T19:11:45.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f00cea00 0x7f30f00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 --2- 172.21.15.7:0/2572741501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f0153dd0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 --2- 172.21.15.7:0/2572741501 >> v2:172.21.15.148:3300/0 conn(0x7f30f015de50 0x7f30f015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 -- 172.21.15.7:0/2572741501 >> 172.21.15.7:0/2572741501 conn(0x7f30f00703a0 msgr2=0x7f30f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 -- 172.21.15.7:0/2572741501 shutdown_connections 2023-10-14T19:11:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.644+0000 7f30f5c66700 1 -- 172.21.15.7:0/2572741501 wait complete. 2023-10-14T19:11:45.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.645+0000 7f30f5c66700 1 Processor -- start 2023-10-14T19:11:45.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 -- start start 2023-10-14T19:11:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f00cea00 0x7f30f016af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f00c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f015de50 0x7f30f0169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f016ad20 con 0x7f30f0153a00 2023-10-14T19:11:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00c7a80 con 0x7f30f00cea00 2023-10-14T19:11:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5c66700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f016a760 con 0x7f30f015de50 2023-10-14T19:11:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30effff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f00c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30effff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f00c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35798/0 (socket says 172.21.15.7:35798) 2023-10-14T19:11:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30effff700 1 -- 172.21.15.7:0/3121493256 learned_addr learned my addr 172.21.15.7:0/3121493256 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f4c64700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f00cea00 0x7f30f016af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.646+0000 7f30f5465700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f015de50 0x7f30f0169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30effff700 1 -- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f015de50 msgr2=0x7f30f0169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30effff700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f015de50 0x7f30f0169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30effff700 1 -- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f00cea00 msgr2=0x7f30f016af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30effff700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f00cea00 0x7f30f016af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30effff700 1 -- 172.21.15.7:0/3121493256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009ae0 con 0x7f30f0153a00 2023-10-14T19:11:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30effff700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f00c91e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c830 tx=0x7f30e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4011600 con 0x7f30f0153a00 2023-10-14T19:11:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4011760 con 0x7f30f0153a00 2023-10-14T19:11:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f016aa40 con 0x7f30f0153a00 2023-10-14T19:11:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4011b20 con 0x7f30f0153a00 2023-10-14T19:11:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.647+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f016b440 con 0x7f30f0153a00 2023-10-14T19:11:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.648+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f00c78d0 con 0x7f30f0153a00 2023-10-14T19:11:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.648+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30e40193b0 con 0x7f30f0153a00 2023-10-14T19:11:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.649+0000 7f30ecff9700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30dc067320 0x7f30dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.649+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f30e4084ad0 con 0x7f30f0153a00 2023-10-14T19:11:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.649+0000 7f30f4c64700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30dc067320 0x7f30dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.649+0000 7f30f4c64700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30dc067320 0x7f30dc0697d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009880 tx=0x7f30e8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:45.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.653+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30e4051950 con 0x7f30f0153a00 2023-10-14T19:11:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.844+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f30f004c3c0 con 0x7f30f0153a00 2023-10-14T19:11:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.848+0000 7f30ecff9700 1 -- 172.21.15.7:0/3121493256 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f30e40150c0 con 0x7f30f0153a00 2023-10-14T19:11:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30dc067320 msgr2=0x7f30dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30dc067320 0x7f30dc0697d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009880 tx=0x7f30e8018000 comp rx=0 tx=0).stop 2023-10-14T19:11:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 msgr2=0x7f30f00c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f00c91e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c830 tx=0x7f30e4008040 comp rx=0 tx=0).stop 2023-10-14T19:11:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 shutdown_connections 2023-10-14T19:11:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f30dc067320 0x7f30dc0697d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f00cea00 0x7f30f016af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f015de50 0x7f30f0169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 --2- 172.21.15.7:0/3121493256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30f0153a00 0x7f30f00c91e0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 >> 172.21.15.7:0/3121493256 conn(0x7f30f00703a0 msgr2=0x7f30f015ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 shutdown_connections 2023-10-14T19:11:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:45.850+0000 7f30f5c66700 1 -- 172.21.15.7:0/3121493256 wait complete. 2023-10-14T19:11:45.863 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:11:45.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:11:45.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:11:45.956 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:11:45.957 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:11:45.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.075+0000 7f6e18155700 1 Processor -- start 2023-10-14T19:11:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.075+0000 7f6e18155700 1 -- start start 2023-10-14T19:11:46.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e18155700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6e100cb5a0 0x7f6e100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e18155700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6e1015a5d0 0x7f6e10156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e18155700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1015ae40 con 0x7f6e100cd9e0 2023-10-14T19:11:46.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e18155700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100d13f0 con 0x7f6e100cb5a0 2023-10-14T19:11:46.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e18155700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1015ab60 con 0x7f6e1015a5d0 2023-10-14T19:11:46.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e15ef1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6e100cb5a0 0x7f6e100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e156f0700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6e100cd9e0 0x7f6e10159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38144/0 (socket says 172.21.15.7:38144) 2023-10-14T19:11:46.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.076+0000 7f6e156f0700 1 -- 172.21.15.7:0/3254718534 learned_addr learned my addr 172.21.15.7:0/3254718534 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:46.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e166f2700 1 --2- 172.21.15.7:0/3254718534 >> v2:172.21.15.148:3300/0 conn(0x7f6e1015a5d0 0x7f6e10156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e15ef1700 1 -- 172.21.15.7:0/3254718534 >> v2:172.21.15.148:3300/0 conn(0x7f6e1015a5d0 msgr2=0x7f6e10156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:46.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e15ef1700 1 --2- 172.21.15.7:0/3254718534 >> v2:172.21.15.148:3300/0 conn(0x7f6e1015a5d0 0x7f6e10156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e15ef1700 1 -- 172.21.15.7:0/3254718534 >> v1:172.21.15.7:6789/0 conn(0x7f6e100cd9e0 legacy=0x7f6e10159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e15ef1700 1 -- 172.21.15.7:0/3254718534 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100ccf00 con 0x7f6e100cb5a0 2023-10-14T19:11:46.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e15ef1700 1 --2- 172.21.15.7:0/3254718534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e100cb5a0 0x7f6e100cb970 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0098e0 tx=0x7f6e0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65496b7fd93d017e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:46.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e14eef700 1 -- 172.21.15.7:0/3254718534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c009e80 con 0x7f6e100cb5a0 2023-10-14T19:11:46.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e14eef700 1 -- 172.21.15.7:0/3254718534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c00b820 con 0x7f6e100cb5a0 2023-10-14T19:11:46.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.077+0000 7f6e14eef700 1 -- 172.21.15.7:0/3254718534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00bba0 con 0x7f6e100cb5a0 2023-10-14T19:11:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 -- 172.21.15.7:0/3254718534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e100cb5a0 msgr2=0x7f6e100cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 --2- 172.21.15.7:0/3254718534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e100cb5a0 0x7f6e100cb970 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0098e0 tx=0x7f6e0c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 -- 172.21.15.7:0/3254718534 shutdown_connections 2023-10-14T19:11:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 --2- 172.21.15.7:0/3254718534 >> v2:172.21.15.148:3300/0 conn(0x7f6e1015a5d0 0x7f6e10156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 --2- 172.21.15.7:0/3254718534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e100cb5a0 0x7f6e100cb970 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 -- 172.21.15.7:0/3254718534 >> 172.21.15.7:0/3254718534 conn(0x7f6e10070e30 msgr2=0x7f6e100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:46.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 -- 172.21.15.7:0/3254718534 shutdown_connections 2023-10-14T19:11:46.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.078+0000 7f6e18155700 1 -- 172.21.15.7:0/3254718534 wait complete. 2023-10-14T19:11:46.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.079+0000 7f6e18155700 1 Processor -- start 2023-10-14T19:11:46.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.079+0000 7f6e18155700 1 -- start start 2023-10-14T19:11:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e100cb5a0 0x7f6e10156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e100cd9e0 0x7f6e1015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 0x7f6e100b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015d780 con 0x7f6e1015a5d0 2023-10-14T19:11:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e101566c0 con 0x7f6e100cb5a0 2023-10-14T19:11:46.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015cb70 con 0x7f6e100cd9e0 2023-10-14T19:11:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 0x7f6e100b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 0x7f6e100b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35818/0 (socket says 172.21.15.7:35818) 2023-10-14T19:11:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 -- 172.21.15.7:0/484381398 learned_addr learned my addr 172.21.15.7:0/484381398 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e15ef1700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e100cb5a0 0x7f6e10156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e156f0700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e100cd9e0 0x7f6e1015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 -- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e100cd9e0 msgr2=0x7f6e1015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e100cd9e0 0x7f6e1015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 -- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e100cb5a0 msgr2=0x7f6e10156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e100cb5a0 0x7f6e10156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 -- 172.21.15.7:0/484381398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009420 con 0x7f6e1015a5d0 2023-10-14T19:11:46.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e166f2700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 0x7f6e100b4ee0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f6e08007f20 tx=0x7f6e08009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800eca0 con 0x7f6e1015a5d0 2023-10-14T19:11:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0800ee20 con 0x7f6e1015a5d0 2023-10-14T19:11:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1015ce50 con 0x7f6e1015a5d0 2023-10-14T19:11:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.080+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08014670 con 0x7f6e1015a5d0 2023-10-14T19:11:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.081+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1015d410 con 0x7f6e1015a5d0 2023-10-14T19:11:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.082+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1004c3c0 con 0x7f6e1015a5d0 2023-10-14T19:11:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.082+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6e080149e0 con 0x7f6e1015a5d0 2023-10-14T19:11:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.082+0000 7f6e05ffb700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6df4067320 0x7f6df40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.082+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6e080850a0 con 0x7f6e1015a5d0 2023-10-14T19:11:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.083+0000 7f6e15ef1700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6df4067320 0x7f6df40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.083+0000 7f6e15ef1700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6df4067320 0x7f6df40697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0093f0 tx=0x7f6e0c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.087+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e08052030 con 0x7f6e1015a5d0 2023-10-14T19:11:46.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.324+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e100cd1e0 con 0x7f6e1015a5d0 2023-10-14T19:11:46.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.324+0000 7f6e05ffb700 1 -- 172.21.15.7:0/484381398 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+3531 (secure 0 0 0) 0x7f6e08055650 con 0x7f6e1015a5d0 2023-10-14T19:11:46.326 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:46.326 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":116,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/302809600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":302809600},{"type":"v1","addr":"172.21.15.148:6836","nonce":302809600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4020831411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":4020831411},{"type":"v1","addr":"172.21.15.148:6837","nonce":4020831411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2342476438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2342476438},{"type":"v1","addr":"172.21.15.7:6833","nonce":2342476438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":8628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2878250203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2878250203},{"type":"v1","addr":"172.21.15.7:6835","nonce":2878250203}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[]} 2023-10-14T19:11:46.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6df4067320 msgr2=0x7f6df40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6df4067320 0x7f6df40697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0093f0 tx=0x7f6e0c017000 comp rx=0 tx=0).stop 2023-10-14T19:11:46.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 msgr2=0x7f6e100b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.328 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 0x7f6e100b4ee0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f6e08007f20 tx=0x7f6e08009860 comp rx=0 tx=0).stop 2023-10-14T19:11:46.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 shutdown_connections 2023-10-14T19:11:46.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6df4067320 0x7f6df40697d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e100cb5a0 0x7f6e10156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1015a5d0 0x7f6e100b4ee0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 --2- 172.21.15.7:0/484381398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e100cd9e0 0x7f6e1015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 >> 172.21.15.7:0/484381398 conn(0x7f6e10070e30 msgr2=0x7f6e100c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:46.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 shutdown_connections 2023-10-14T19:11:46.330 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.327+0000 7f6e18155700 1 -- 172.21.15.7:0/484381398 wait complete. 2023-10-14T19:11:46.331 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 116 2023-10-14T19:11:46.340 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:11:46.340 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:11:46.340 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:11:46.341 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:46.341 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:11:46.341 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:11:46.342 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:11:46.342 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:46.343 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:11:46.343 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:11:46.343 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:11:46.344 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:46.344 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:11:46.344 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:11:46.345 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:11:46.345 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:11:46.350 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:11:46.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:11:46.351 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:11:46.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:11:46.354 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:11:46.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:11:46.356 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:11:46.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:11:46.392 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:11:46.393 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:46.393 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:11:46.394 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:46.398 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:11:46.399 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:46.400 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:11:46.400 DEBUG:teuthology.parallel:result is None 2023-10-14T19:11:46.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:11:46.468 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:11:46.469 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:11:46.482 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:11:46.483 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:11:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.530+0000 7fd17bec6700 1 Processor -- start 2023-10-14T19:11:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.530+0000 7fd17bec6700 1 -- start start 2023-10-14T19:11:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd17bec6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1740cb5a0 0x7fd1740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd17bec6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd17415a5d0 0x7fd174156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd17bec6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17415ae40 con 0x7fd1740cd9e0 2023-10-14T19:11:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd17bec6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1740d13f0 con 0x7fd1740cb5a0 2023-10-14T19:11:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd17bec6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17415ab60 con 0x7fd17415a5d0 2023-10-14T19:11:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd179c62700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1740cb5a0 0x7fd1740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd179c62700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1740cb5a0 0x7fd1740cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35862/0 (socket says 172.21.15.7:35862) 2023-10-14T19:11:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd179461700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd1740cd9e0 0x7fd174159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38172/0 (socket says 172.21.15.7:38172) 2023-10-14T19:11:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.531+0000 7fd179c62700 1 -- 172.21.15.7:0/1927579977 learned_addr learned my addr 172.21.15.7:0/1927579977 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd179c62700 1 -- 172.21.15.7:0/1927579977 >> v2:172.21.15.148:3300/0 conn(0x7fd17415a5d0 msgr2=0x7fd174156e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:11:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd179c62700 1 --2- 172.21.15.7:0/1927579977 >> v2:172.21.15.148:3300/0 conn(0x7fd17415a5d0 0x7fd174156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd179c62700 1 -- 172.21.15.7:0/1927579977 >> v1:172.21.15.7:6789/0 conn(0x7fd1740cd9e0 legacy=0x7fd174159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd179c62700 1 -- 172.21.15.7:0/1927579977 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740ccf00 con 0x7fd1740cb5a0 2023-10-14T19:11:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd178c60700 1 -- 172.21.15.7:0/1927579977 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005865782 0 0) 0x7fd17415ae40 con 0x7fd1740cd9e0 2023-10-14T19:11:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd179c62700 1 --2- 172.21.15.7:0/1927579977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1740cb5a0 0x7fd1740cb970 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0099b0 tx=0x7fd16c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc091554808d35fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd178c60700 1 -- 172.21.15.7:0/1927579977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00b820 con 0x7fd1740cb5a0 2023-10-14T19:11:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd178c60700 1 -- 172.21.15.7:0/1927579977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c00b980 con 0x7fd1740cb5a0 2023-10-14T19:11:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd178c60700 1 -- 172.21.15.7:0/1927579977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00bd20 con 0x7fd1740cb5a0 2023-10-14T19:11:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd17bec6700 1 -- 172.21.15.7:0/1927579977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1740cb5a0 msgr2=0x7fd1740cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd17bec6700 1 --2- 172.21.15.7:0/1927579977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1740cb5a0 0x7fd1740cb970 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0099b0 tx=0x7fd16c009250 comp rx=0 tx=0).stop 2023-10-14T19:11:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd17bec6700 1 -- 172.21.15.7:0/1927579977 shutdown_connections 2023-10-14T19:11:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd17bec6700 1 --2- 172.21.15.7:0/1927579977 >> v2:172.21.15.148:3300/0 conn(0x7fd17415a5d0 0x7fd174156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd17bec6700 1 --2- 172.21.15.7:0/1927579977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1740cb5a0 0x7fd1740cb970 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.532+0000 7fd17bec6700 1 -- 172.21.15.7:0/1927579977 >> 172.21.15.7:0/1927579977 conn(0x7fd174070e30 msgr2=0x7fd1740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.533+0000 7fd17bec6700 1 -- 172.21.15.7:0/1927579977 shutdown_connections 2023-10-14T19:11:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.533+0000 7fd17bec6700 1 -- 172.21.15.7:0/1927579977 wait complete. 2023-10-14T19:11:46.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 Processor -- start 2023-10-14T19:11:46.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 -- start start 2023-10-14T19:11:46.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1740cb5a0 0x7fd17416bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1740cd9e0 0x7fd1740c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 0x7fd174152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd174156c60 con 0x7fd17415a5d0 2023-10-14T19:11:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c9a70 con 0x7fd1740cd9e0 2023-10-14T19:11:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17bec6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c9d50 con 0x7fd1740cb5a0 2023-10-14T19:11:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17a463700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 0x7fd174152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17a463700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 0x7fd174152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35878/0 (socket says 172.21.15.7:35878) 2023-10-14T19:11:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.534+0000 7fd17a463700 1 -- 172.21.15.7:0/2145991636 learned_addr learned my addr 172.21.15.7:0/2145991636 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd179461700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1740cd9e0 0x7fd1740c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd179c62700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1740cb5a0 0x7fd17416bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17a463700 1 -- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1740cb5a0 msgr2=0x7fd17416bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17a463700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1740cb5a0 0x7fd17416bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17a463700 1 -- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1740cd9e0 msgr2=0x7fd1740c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17a463700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1740cd9e0 0x7fd1740c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17a463700 1 -- 172.21.15.7:0/2145991636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0094f0 con 0x7fd17415a5d0 2023-10-14T19:11:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17a463700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 0x7fd174152120 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd16400bc30 tx=0x7fd164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640092e0 con 0x7fd17415a5d0 2023-10-14T19:11:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400c630 con 0x7fd17415a5d0 2023-10-14T19:11:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ca10 con 0x7fd17415a5d0 2023-10-14T19:11:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1740ca030 con 0x7fd17415a5d0 2023-10-14T19:11:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.535+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17416c940 con 0x7fd17415a5d0 2023-10-14T19:11:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.536+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17404c3c0 con 0x7fd17415a5d0 2023-10-14T19:11:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.536+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd164012070 con 0x7fd17415a5d0 2023-10-14T19:11:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.537+0000 7fd171ffb700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd160067320 0x7fd1600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.537+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd164084410 con 0x7fd17415a5d0 2023-10-14T19:11:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.537+0000 7fd179c62700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd160067320 0x7fd1600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.538+0000 7fd179c62700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd160067320 0x7fd1600697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0099b0 tx=0x7fd16c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.541+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd164051420 con 0x7fd17415a5d0 2023-10-14T19:11:46.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-14T19:11:46.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-14T19:11:46.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-14T19:11:46.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:46.751+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd1740cd1e0 con 0x7fd17415a5d0 2023-10-14T19:11:47.508 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.507+0000 7fd171ffb700 1 -- 172.21.15.7:0/2145991636 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v179) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd16401a020 con 0x7fd17415a5d0 2023-10-14T19:11:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd160067320 msgr2=0x7fd1600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd160067320 0x7fd1600697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0099b0 tx=0x7fd16c017000 comp rx=0 tx=0).stop 2023-10-14T19:11:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 msgr2=0x7fd174152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 0x7fd174152120 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd16400bc30 tx=0x7fd164009840 comp rx=0 tx=0).stop 2023-10-14T19:11:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 shutdown_connections 2023-10-14T19:11:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd160067320 0x7fd1600697d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd17415a5d0 0x7fd174152120 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1740cb5a0 0x7fd17416bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 --2- 172.21.15.7:0/2145991636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1740cd9e0 0x7fd1740c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 >> 172.21.15.7:0/2145991636 conn(0x7fd174070e30 msgr2=0x7fd1740d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 shutdown_connections 2023-10-14T19:11:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.510+0000 7fd17bec6700 1 -- 172.21.15.7:0/2145991636 wait complete. 2023-10-14T19:11:47.514 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:11:47.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:11:47.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.651+0000 7f71b8717700 1 Processor -- start 2023-10-14T19:11:47.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.651+0000 7f71b8717700 1 -- start start 2023-10-14T19:11:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b8717700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 0x7f71b00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b8717700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 0x7f71b00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b8717700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b015a280 con 0x7f71b00b0ba0 2023-10-14T19:11:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b8717700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b006e180 con 0x7f71b00b07d0 2023-10-14T19:11:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b8717700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00cd540 con 0x7f71b00cf200 2023-10-14T19:11:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b64b3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 0x7f71b00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b5cb2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 0x7f71b00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b6cb4700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f71b00b0ba0 0x7f71b006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36842/0 (socket says 172.21.15.7:36842) 2023-10-14T19:11:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b6cb4700 1 -- 172.21.15.7:0/2985210967 learned_addr learned my addr 172.21.15.7:0/2985210967 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b64b3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 0x7f71b00ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56422/0 (socket says 172.21.15.7:56422) 2023-10-14T19:11:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.652+0000 7f71b5cb2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 0x7f71b00cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:41336/0 (socket says 172.21.15.7:41336) 2023-10-14T19:11:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2985210967 >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 msgr2=0x7f71b00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b5cb2700 1 --2- 172.21.15.7:0/2985210967 >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 0x7f71b00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2985210967 >> v1:172.21.15.148:6789/0 conn(0x7f71b00b0ba0 legacy=0x7f71b006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2985210967 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b006d850 con 0x7f71b00cf200 2023-10-14T19:11:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b64b3700 1 --2- 172.21.15.7:0/2985210967 >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 0x7f71b00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b5cb2700 1 --2- 172.21.15.7:0/2985210967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 0x7f71b00cd000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71a40098e0 tx=0x7f71a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e9fa75bccd80a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b54b1700 1 -- 172.21.15.7:0/2985210967 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400b6d0 con 0x7f71b00cf200 2023-10-14T19:11:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b54b1700 1 -- 172.21.15.7:0/2985210967 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400b830 con 0x7f71b00cf200 2023-10-14T19:11:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.653+0000 7f71b54b1700 1 -- 172.21.15.7:0/2985210967 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400bbd0 con 0x7f71b00cf200 2023-10-14T19:11:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 -- 172.21.15.7:0/2985210967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 msgr2=0x7f71b00cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 --2- 172.21.15.7:0/2985210967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 0x7f71b00cd000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71a40098e0 tx=0x7f71a40091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 -- 172.21.15.7:0/2985210967 shutdown_connections 2023-10-14T19:11:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 --2- 172.21.15.7:0/2985210967 >> v2:172.21.15.148:3300/0 conn(0x7f71b00b07d0 0x7f71b00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 --2- 172.21.15.7:0/2985210967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00cf200 0x7f71b00cd000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 -- 172.21.15.7:0/2985210967 >> 172.21.15.7:0/2985210967 conn(0x7f71b006ce80 msgr2=0x7f71b00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 -- 172.21.15.7:0/2985210967 shutdown_connections 2023-10-14T19:11:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.654+0000 7f71b8717700 1 -- 172.21.15.7:0/2985210967 wait complete. 2023-10-14T19:11:47.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.655+0000 7f71b8717700 1 Processor -- start 2023-10-14T19:11:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.655+0000 7f71b8717700 1 -- start start 2023-10-14T19:11:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b8717700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00b07d0 0x7f71b00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b8717700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 0x7f71b00b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b8717700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b00cf200 0x7f71b00b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b8717700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c7a20 con 0x7f71b00b0ba0 2023-10-14T19:11:47.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b8717700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c6430 con 0x7f71b00cf200 2023-10-14T19:11:47.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b8717700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b015ad60 con 0x7f71b00b07d0 2023-10-14T19:11:47.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 0x7f71b00b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:47.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 0x7f71b00b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57916/0 (socket says 172.21.15.7:57916) 2023-10-14T19:11:47.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2734532111 learned_addr learned my addr 172.21.15.7:0/2734532111 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b64b3700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00b07d0 0x7f71b00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b6cb4700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b00cf200 0x7f71b00b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00b07d0 msgr2=0x7f71b00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00b07d0 0x7f71b00c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b00cf200 msgr2=0x7f71b00b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b00cf200 0x7f71b00b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 -- 172.21.15.7:0/2734532111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80093c0 con 0x7f71b00b0ba0 2023-10-14T19:11:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71b5cb2700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 0x7f71b00b1f00 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f71a40093f0 tx=0x7f71a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.656+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a401bd90 con 0x7f71b00b0ba0 2023-10-14T19:11:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.657+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4011420 con 0x7f71b00b0ba0 2023-10-14T19:11:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.657+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a4009420 con 0x7f71b00b0ba0 2023-10-14T19:11:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.657+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40117e0 con 0x7f71b00b0ba0 2023-10-14T19:11:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.657+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b015a430 con 0x7f71b00b0ba0 2023-10-14T19:11:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.658+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b004c3c0 con 0x7f71b00b0ba0 2023-10-14T19:11:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.658+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f71a4011c10 con 0x7f71b00b0ba0 2023-10-14T19:11:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.658+0000 7f71ae7fc700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f719c067320 0x7f719c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.658+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f71a4085d40 con 0x7f71b00b0ba0 2023-10-14T19:11:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.658+0000 7f71b64b3700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f719c067320 0x7f719c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.659+0000 7f71b64b3700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f719c067320 0x7f719c0697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009f30 tx=0x7f71a8009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.663+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71a4052da0 con 0x7f71b00b0ba0 2023-10-14T19:11:47.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.932+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f71b006db60 con 0x7f71b00b0ba0 2023-10-14T19:11:47.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.933+0000 7f71ae7fc700 1 -- 172.21.15.7:0/2734532111 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f71a40563c0 con 0x7f71b00b0ba0 2023-10-14T19:11:47.934 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:47.934 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:11:47.934 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:11:47.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.935 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:11:47.935 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:11:47.935 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.935 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.936 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:47.936 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:47.936 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.937 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:11:47.937 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:11:47.937 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.937 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.938 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:47.938 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:47.938 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.939 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:11:47.939 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:11:47.940 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.941 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.941 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:47.941 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:47.941 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.942 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:11:47.943 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:11:47.943 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.943 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.943 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:47.943 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:47.944 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.945 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:11:47.945 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:11:47.945 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.946 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.946 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:11:47.947 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:11:47.947 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.948 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:11:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:11:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:11:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:11:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:11:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:11:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:11:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:11:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:11:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:11:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:11:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:11:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:11:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:11:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:11:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:11:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:11:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:11:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:11:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:11:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:11:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:11:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:11:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:11:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:11:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:11:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:11:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:11:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:11:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:11:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:11:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:11:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:11:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:11:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:11:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:11:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:11:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:11:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:11:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:11:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:11:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:11:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:11:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:11:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:11:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:11:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:11:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:11:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:11:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:11:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:11:47.982 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:11:47.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f719c067320 msgr2=0x7f719c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f719c067320 0x7f719c0697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009f30 tx=0x7f71a8009120 comp rx=0 tx=0).stop 2023-10-14T19:11:47.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 msgr2=0x7f71b00b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:47.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 0x7f71b00b1f00 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f71a40093f0 tx=0x7f71a4017000 comp rx=0 tx=0).stop 2023-10-14T19:11:47.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 shutdown_connections 2023-10-14T19:11:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f719c067320 0x7f719c0697d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b00cf200 0x7f71b00b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71b00b07d0 0x7f71b00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 --2- 172.21.15.7:0/2734532111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71b00b0ba0 0x7f71b00b1f00 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 >> 172.21.15.7:0/2734532111 conn(0x7f71b006ce80 msgr2=0x7f71b01583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 shutdown_connections 2023-10-14T19:11:47.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:47.935+0000 7f71b8717700 1 -- 172.21.15.7:0/2734532111 wait complete. 2023-10-14T19:11:47.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:48.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.112+0000 7f8c52e5f700 1 Processor -- start 2023-10-14T19:11:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.112+0000 7f8c52e5f700 1 -- start start 2023-10-14T19:11:48.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c52e5f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 0x7f8c4c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c52e5f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c4c15a400 0x7f8c4c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c52e5f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4c15ae40 con 0x7f8c4c0cb5a0 2023-10-14T19:11:48.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c52e5f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4c0ce0f0 con 0x7f8c4c15a400 2023-10-14T19:11:48.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c52e5f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0cbde0 con 0x7f8c4c0cb970 2023-10-14T19:11:48.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c50bfb700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8c4c0cb5a0 0x7f8c4c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46150/0 (socket says 172.21.15.7:46150) 2023-10-14T19:11:48.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c50bfb700 1 -- 172.21.15.7:0/669370560 learned_addr learned my addr 172.21.15.7:0/669370560 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:48.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c513fc700 1 --2- 172.21.15.7:0/669370560 >> v2:172.21.15.148:3300/0 conn(0x7f8c4c15a400 0x7f8c4c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 0x7f8c4c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239872665 0 0) 0x7f8c4c15ae40 con 0x7f8c4c0cb5a0 2023-10-14T19:11:48.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c34003570 con 0x7f8c4c0cb5a0 2023-10-14T19:11:48.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834134808 0 0) 0x7f8c34003570 con 0x7f8c4c0cb5a0 2023-10-14T19:11:48.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 msgr2=0x7f8c4c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 0x7f8c4c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 >> v2:172.21.15.148:3300/0 conn(0x7f8c4c15a400 msgr2=0x7f8c4c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 --2- 172.21.15.7:0/669370560 >> v2:172.21.15.148:3300/0 conn(0x7f8c4c15a400 0x7f8c4c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c15ab60 con 0x7f8c4c0cb5a0 2023-10-14T19:11:48.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8c3c0017f0 con 0x7f8c4c0cb5a0 2023-10-14T19:11:48.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 >> v1:172.21.15.7:6789/0 conn(0x7f8c4c0cb5a0 legacy=0x7f8c4c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.113+0000 7f8c4b7fe700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34003a90 0x7f8c34003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c34004810 0x7f8c34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 0x7f8c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0ce0f0 con 0x7f8c34004810 2023-10-14T19:11:48.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0cbde0 con 0x7f8c34003a90 2023-10-14T19:11:48.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3400ba90 con 0x7f8c4c0cb970 2023-10-14T19:11:48.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c34004810 0x7f8c34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c50bfb700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34003a90 0x7f8c34003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c513fc700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 0x7f8c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 -- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 msgr2=0x7f8c340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0cb970 0x7f8c340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 -- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34003a90 msgr2=0x7f8c34003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34003a90 0x7f8c34003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 -- 172.21.15.7:0/669370560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34003570 con 0x7f8c34004810 2023-10-14T19:11:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c50bfb700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34003a90 0x7f8c34003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c34004810 0x7f8c34004c80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009c00 tx=0x7f8c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72d437c3ca152a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000e6b0 con 0x7f8c34004810 2023-10-14T19:11:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4000e810 con 0x7f8c34004810 2023-10-14T19:11:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.114+0000 7f8c4b7fe700 1 -- 172.21.15.7:0/669370560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000ebd0 con 0x7f8c34004810 2023-10-14T19:11:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c52e5f700 1 -- 172.21.15.7:0/669370560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c34004810 msgr2=0x7f8c34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/669370560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c34004810 0x7f8c34004c80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009c00 tx=0x7f8c400091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c513fc700 1 -- 172.21.15.7:0/669370560 reap_dead start 2023-10-14T19:11:48.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c52e5f700 1 -- 172.21.15.7:0/669370560 shutdown_connections 2023-10-14T19:11:48.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c52e5f700 1 -- 172.21.15.7:0/669370560 >> 172.21.15.7:0/669370560 conn(0x7f8c4c070e30 msgr2=0x7f8c4c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:48.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c52e5f700 1 -- 172.21.15.7:0/669370560 shutdown_connections 2023-10-14T19:11:48.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.115+0000 7f8c52e5f700 1 -- 172.21.15.7:0/669370560 wait complete. 2023-10-14T19:11:48.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.116+0000 7f8c52e5f700 1 Processor -- start 2023-10-14T19:11:48.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.116+0000 7f8c52e5f700 1 -- start start 2023-10-14T19:11:48.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c52e5f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34004810 0x7f8c4c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c52e5f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0b34b0 0x7f8c4c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c52e5f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 0x7f8c4c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c52e5f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0b4b00 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c52e5f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c15db70 con 0x7f8c34004810 2023-10-14T19:11:48.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c52e5f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0b3a50 con 0x7f8c4c0b34b0 2023-10-14T19:11:48.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 0x7f8c4c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 0x7f8c4c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57930/0 (socket says 172.21.15.7:57930) 2023-10-14T19:11:48.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 -- 172.21.15.7:0/2363556150 learned_addr learned my addr 172.21.15.7:0/2363556150 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:48.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c50bfb700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34004810 0x7f8c4c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0b34b0 0x7f8c4c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 -- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0b34b0 msgr2=0x7f8c4c153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0b34b0 0x7f8c4c153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 -- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34004810 msgr2=0x7f8c4c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34004810 0x7f8c4c0ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 -- 172.21.15.7:0/2363556150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0b3d30 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c50bfb700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34004810 0x7f8c4c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c4bfff700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0b34b0 0x7f8c4c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.117+0000 7f8c513fc700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 0x7f8c4c15d630 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0ccdf0 tx=0x7f8c44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.118+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44015670 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.118+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c440157d0 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.118+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c0b4010 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.118+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44015bd0 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.118+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c0cab70 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.119+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4c0b4c70 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.119+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8c4401e400 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.119+0000 7f8c48ff9700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8c38067320 0x7f8c380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.120+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8c44084c90 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.120+0000 7f8c50bfb700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8c38067320 0x7f8c380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.120+0000 7f8c50bfb700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8c38067320 0x7f8c380697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c001a60 tx=0x7f8c3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.124+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c4c0b4c70 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.320+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c4c0b4c70 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.321+0000 7f8c48ff9700 1 -- 172.21.15.7:0/2363556150 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f8c4c0b4c70 con 0x7f8c4c15d1c0 2023-10-14T19:11:48.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:48.323 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":179,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:47.505543+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8c38067320 msgr2=0x7f8c380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8c38067320 0x7f8c380697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c001a60 tx=0x7f8c3c009040 comp rx=0 tx=0).stop 2023-10-14T19:11:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 msgr2=0x7f8c4c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 0x7f8c4c15d630 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0ccdf0 tx=0x7f8c44008040 comp rx=0 tx=0).stop 2023-10-14T19:11:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 shutdown_connections 2023-10-14T19:11:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f8c38067320 0x7f8c380697d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c34004810 0x7f8c4c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c4c15d1c0 0x7f8c4c15d630 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 --2- 172.21.15.7:0/2363556150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c4c0b34b0 0x7f8c4c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 >> 172.21.15.7:0/2363556150 conn(0x7f8c4c070e30 msgr2=0x7f8c4c0c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 shutdown_connections 2023-10-14T19:11:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.323+0000 7f8c52e5f700 1 -- 172.21.15.7:0/2363556150 wait complete. 2023-10-14T19:11:48.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:11:48.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:11:48.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.458+0000 7f457f3ca700 1 Processor -- start 2023-10-14T19:11:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.459+0000 7f457f3ca700 1 -- start start 2023-10-14T19:11:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.459+0000 7f457f3ca700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45780cc6f0 0x7f457806a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.459+0000 7f457f3ca700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457806f7d0 con 0x7f45780cc320 2023-10-14T19:11:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.459+0000 7f457f3ca700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457806d7b0 con 0x7f457813c9b0 2023-10-14T19:11:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.459+0000 7f457f3ca700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457806e330 con 0x7f45780cc6f0 2023-10-14T19:11:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f457d166700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f45780cc320 0x7f457813c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46160/0 (socket says 172.21.15.7:46160) 2023-10-14T19:11:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f457d166700 1 -- 172.21.15.7:0/3167691872 learned_addr learned my addr 172.21.15.7:0/3167691872 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:48.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762634356 0 0) 0x7f457806f7d0 con 0x7f45780cc320 2023-10-14T19:11:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4560003570 con 0x7f45780cc320 2023-10-14T19:11:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f457d967700 1 --2- 172.21.15.7:0/3167691872 >> v2:172.21.15.148:3300/0 conn(0x7f45780cc6f0 0x7f457806a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603775110 0 0) 0x7f4560003570 con 0x7f45780cc320 2023-10-14T19:11:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 >> v2:172.21.15.148:3300/0 conn(0x7f45780cc6f0 msgr2=0x7f457806a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 --2- 172.21.15.7:0/3167691872 >> v2:172.21.15.148:3300/0 conn(0x7f45780cc6f0 0x7f457806a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 >> v1:172.21.15.148:6789/0 conn(0x7f457813c9b0 legacy=0x7f4578069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457806da00 con 0x7f45780cc320 2023-10-14T19:11:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f45680017f0 con 0x7f45780cc320 2023-10-14T19:11:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 >> v1:172.21.15.7:6789/0 conn(0x7f45780cc320 legacy=0x7f457813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560003a60 0x7f4560003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4560004810 0x7f4560004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45600051c0 0x7f456000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457806e330 con 0x7f4560004810 2023-10-14T19:11:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456000c160 con 0x7f45600051c0 2023-10-14T19:11:48.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456000c320 con 0x7f4560003a60 2023-10-14T19:11:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f457c965700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4560004810 0x7f4560004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f457d166700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560003a60 0x7f4560003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.460+0000 7f457d967700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45600051c0 0x7f456000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457c965700 1 -- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560003a60 msgr2=0x7f4560003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457c965700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560003a60 0x7f4560003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457c965700 1 -- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45600051c0 msgr2=0x7f456000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457c965700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45600051c0 0x7f456000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457c965700 1 -- 172.21.15.7:0/3167691872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560003570 con 0x7f4560004810 2023-10-14T19:11:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457d967700 1 -- 172.21.15.7:0/3167691872 reap_dead start 2023-10-14T19:11:48.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457d166700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560003a60 0x7f4560003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457c965700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4560004810 0x7f4560004c80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f456c001880 tx=0x7f456c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2470738f93a47ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c012420 con 0x7f4560004810 2023-10-14T19:11:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c0125a0 con 0x7f4560004810 2023-10-14T19:11:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f4577fff700 1 -- 172.21.15.7:0/3167691872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c012960 con 0x7f4560004810 2023-10-14T19:11:48.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457f3ca700 1 -- 172.21.15.7:0/3167691872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4560004810 msgr2=0x7f4560004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457f3ca700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4560004810 0x7f4560004c80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f456c001880 tx=0x7f456c007d30 comp rx=0 tx=0).stop 2023-10-14T19:11:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457f3ca700 1 -- 172.21.15.7:0/3167691872 shutdown_connections 2023-10-14T19:11:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457f3ca700 1 --2- 172.21.15.7:0/3167691872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4560004810 0x7f4560004c80 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.461+0000 7f457f3ca700 1 -- 172.21.15.7:0/3167691872 >> 172.21.15.7:0/3167691872 conn(0x7f4578067f00 msgr2=0x7f4578068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:48.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.462+0000 7f457f3ca700 1 -- 172.21.15.7:0/3167691872 shutdown_connections 2023-10-14T19:11:48.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.462+0000 7f457f3ca700 1 -- 172.21.15.7:0/3167691872 wait complete. 2023-10-14T19:11:48.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.463+0000 7f457f3ca700 1 Processor -- start 2023-10-14T19:11:48.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.463+0000 7f457f3ca700 1 -- start start 2023-10-14T19:11:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.463+0000 7f457f3ca700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560004810 0x7f457816cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.463+0000 7f457f3ca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 0x7f45780c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.463+0000 7f457f3ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f457816d340 0x7f457816d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457f3ca700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457816dd20 con 0x7f457816df60 2023-10-14T19:11:48.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457f3ca700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780c7b00 con 0x7f457816d340 2023-10-14T19:11:48.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457f3ca700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457816d110 con 0x7f4560004810 2023-10-14T19:11:48.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 0x7f45780c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 0x7f45780c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57954/0 (socket says 172.21.15.7:57954) 2023-10-14T19:11:48.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 -- 172.21.15.7:0/4056708488 learned_addr learned my addr 172.21.15.7:0/4056708488 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:48.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457d967700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f457816d340 0x7f457816d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457d166700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560004810 0x7f457816cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 -- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560004810 msgr2=0x7f457816cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560004810 0x7f457816cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 -- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f457816d340 msgr2=0x7f457816d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f457816d340 0x7f457816d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 -- 172.21.15.7:0/4056708488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780c6ef0 con 0x7f457816df60 2023-10-14T19:11:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457c965700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 0x7f45780c6580 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f456000c130 tx=0x7f456c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c006820 con 0x7f457816df60 2023-10-14T19:11:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c0069a0 con 0x7f457816df60 2023-10-14T19:11:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c006d60 con 0x7f457816df60 2023-10-14T19:11:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45780c71d0 con 0x7f457816df60 2023-10-14T19:11:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.464+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45780c7790 con 0x7f457816df60 2023-10-14T19:11:48.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.465+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4578143080 con 0x7f457816df60 2023-10-14T19:11:48.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.466+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f456c019030 con 0x7f457816df60 2023-10-14T19:11:48.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.466+0000 7f45757fa700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4564067320 0x7f45640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.466+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f456c0858c0 con 0x7f457816df60 2023-10-14T19:11:48.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.466+0000 7f457d166700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4564067320 0x7f45640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.467+0000 7f457d166700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4564067320 0x7f45640697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4568000fa0 tx=0x7f45680021a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.470+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f456c052960 con 0x7f457816df60 2023-10-14T19:11:48.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.669+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45780c7c70 con 0x7f457816df60 2023-10-14T19:11:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.669+0000 7f45757fa700 1 -- 172.21.15.7:0/4056708488 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f456c02b020 con 0x7f457816df60 2023-10-14T19:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:11:48.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4564067320 msgr2=0x7f45640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4564067320 0x7f45640697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4568000fa0 tx=0x7f45680021a0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 msgr2=0x7f45780c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 0x7f45780c6580 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f456000c130 tx=0x7f456c015000 comp rx=0 tx=0).stop 2023-10-14T19:11:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 shutdown_connections 2023-10-14T19:11:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4564067320 0x7f45640697d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f457816d340 0x7f457816d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4560004810 0x7f457816cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 --2- 172.21.15.7:0/4056708488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f457816df60 0x7f45780c6580 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 >> 172.21.15.7:0/4056708488 conn(0x7f4578067f00 msgr2=0x7f45780b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 shutdown_connections 2023-10-14T19:11:48.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.671+0000 7f457f3ca700 1 -- 172.21.15.7:0/4056708488 wait complete. 2023-10-14T19:11:48.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:11:48.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.803+0000 7f3b8030a700 1 Processor -- start 2023-10-14T19:11:48.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.803+0000 7f3b8030a700 1 -- start start 2023-10-14T19:11:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b8030a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 0x7f3b781599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b8030a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3b78067a10 0x7f3b780c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b8030a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b780c7f50 con 0x7f3b780675a0 2023-10-14T19:11:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b8030a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7806bd00 con 0x7f3b78067a10 2023-10-14T19:11:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b8030a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7806b740 con 0x7f3b781595d0 2023-10-14T19:11:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b7d8a5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3b780675a0 0x7f3b7806acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46162/0 (socket says 172.21.15.7:46162) 2023-10-14T19:11:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.804+0000 7f3b7d8a5700 1 -- 172.21.15.7:0/2945751384 learned_addr learned my addr 172.21.15.7:0/2945751384 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7e0a6700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 0x7f3b781599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7e8a7700 1 --2- 172.21.15.7:0/2945751384 >> v2:172.21.15.148:3300/0 conn(0x7f3b78067a10 0x7f3b780c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529556937 0 0) 0x7f3b780c7f50 con 0x7f3b780675a0 2023-10-14T19:11:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b60003570 con 0x7f3b780675a0 2023-10-14T19:11:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2635908637 0 0) 0x7f3b60003570 con 0x7f3b780675a0 2023-10-14T19:11:48.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 msgr2=0x7f3b781599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 0x7f3b781599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 >> v2:172.21.15.148:3300/0 conn(0x7f3b78067a10 msgr2=0x7f3b780c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 --2- 172.21.15.7:0/2945751384 >> v2:172.21.15.148:3300/0 conn(0x7f3b78067a10 0x7f3b780c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7806ba20 con 0x7f3b780675a0 2023-10-14T19:11:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f3b6c001470 con 0x7f3b780675a0 2023-10-14T19:11:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 >> v1:172.21.15.7:6789/0 conn(0x7f3b780675a0 legacy=0x7f3b7806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 0x7f3b60003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b60004d50 0x7f3b600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7806b740 con 0x7f3b60003fe0 2023-10-14T19:11:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6000ba60 con 0x7f3b60004d50 2023-10-14T19:11:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6000bbd0 con 0x7f3b781595d0 2023-10-14T19:11:48.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7e0a6700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 0x7f3b60003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7e8a7700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b60004d50 0x7f3b600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d8a5700 1 -- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 msgr2=0x7f3b60003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b781595d0 0x7f3b60003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d8a5700 1 -- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b60004d50 msgr2=0x7f3b600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b60004d50 0x7f3b600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.805+0000 7f3b7d8a5700 1 -- 172.21.15.7:0/2945751384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60003570 con 0x7f3b60003fe0 2023-10-14T19:11:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b60004810 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c3c0 tx=0x7f3b78067ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934b2dc08c271dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00cc30 con 0x7f3b60003fe0 2023-10-14T19:11:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00cdd0 con 0x7f3b60003fe0 2023-10-14T19:11:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b7d0a4700 1 -- 172.21.15.7:0/2945751384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c005b70 con 0x7f3b60003fe0 2023-10-14T19:11:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b8030a700 1 -- 172.21.15.7:0/2945751384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 msgr2=0x7f3b60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b8030a700 1 --2- 172.21.15.7:0/2945751384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b60004810 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c3c0 tx=0x7f3b78067ea0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b7e8a7700 1 -- 172.21.15.7:0/2945751384 reap_dead start 2023-10-14T19:11:48.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b8030a700 1 -- 172.21.15.7:0/2945751384 shutdown_connections 2023-10-14T19:11:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b8030a700 1 -- 172.21.15.7:0/2945751384 >> 172.21.15.7:0/2945751384 conn(0x7f3b780cd400 msgr2=0x7f3b780cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b8030a700 1 -- 172.21.15.7:0/2945751384 shutdown_connections 2023-10-14T19:11:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.806+0000 7f3b8030a700 1 -- 172.21.15.7:0/2945751384 wait complete. 2023-10-14T19:11:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.807+0000 7f3b8030a700 1 Processor -- start 2023-10-14T19:11:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.807+0000 7f3b8030a700 1 -- start start 2023-10-14T19:11:48.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b8030a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b78142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b8030a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b781599a0 0x7f3b78159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b8030a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b7815b610 0x7f3b7815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b8030a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7815ced0 con 0x7f3b60003fe0 2023-10-14T19:11:48.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b8030a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7815dd90 con 0x7f3b781599a0 2023-10-14T19:11:48.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b8030a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7815c630 con 0x7f3b7815b610 2023-10-14T19:11:48.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b7e0a6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b78142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b7e0a6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b78142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57986/0 (socket says 172.21.15.7:57986) 2023-10-14T19:11:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b7e0a6700 1 -- 172.21.15.7:0/600662375 learned_addr learned my addr 172.21.15.7:0/600662375 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b7e8a7700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b7815b610 0x7f3b7815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.808+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b781599a0 0x7f3b78159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b7e0a6700 1 -- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b7815b610 msgr2=0x7f3b7815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b7e0a6700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b7815b610 0x7f3b7815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b7e0a6700 1 -- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b781599a0 msgr2=0x7f3b78159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b7e0a6700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b781599a0 0x7f3b78159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b7e0a6700 1 -- 172.21.15.7:0/600662375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7815c910 con 0x7f3b60003fe0 2023-10-14T19:11:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b7e0a6700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b78142df0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f3b70011cf0 tx=0x7f3b700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000f8e0 con 0x7f3b60003fe0 2023-10-14T19:11:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7000fa40 con 0x7f3b60003fe0 2023-10-14T19:11:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000fdc0 con 0x7f3b60003fe0 2023-10-14T19:11:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7815cbf0 con 0x7f3b60003fe0 2023-10-14T19:11:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.809+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7815bfc0 con 0x7f3b60003fe0 2023-10-14T19:11:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.810+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7804c3c0 con 0x7f3b60003fe0 2023-10-14T19:11:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.810+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3b70014650 con 0x7f3b60003fe0 2023-10-14T19:11:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.811+0000 7f3b767fc700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b64067320 0x7f3b640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.811+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3b70018030 con 0x7f3b60003fe0 2023-10-14T19:11:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.811+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b64067320 0x7f3b640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.812+0000 7f3b7d8a5700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b64067320 0x7f3b640697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c3c0 tx=0x7f3b6c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:48.815+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b70052130 con 0x7f3b60003fe0 2023-10-14T19:11:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.009+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3b7815db60 con 0x7f3b60003fe0 2023-10-14T19:11:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.009+0000 7f3b767fc700 1 -- 172.21.15.7:0/600662375 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v179) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3b70055750 con 0x7f3b60003fe0 2023-10-14T19:11:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:11:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:11:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:11:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:11:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:11:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:11:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b64067320 msgr2=0x7f3b640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b64067320 0x7f3b640697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c3c0 tx=0x7f3b6c015000 comp rx=0 tx=0).stop 2023-10-14T19:11:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 msgr2=0x7f3b78142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b78142df0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f3b70011cf0 tx=0x7f3b700091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 shutdown_connections 2023-10-14T19:11:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b64067320 0x7f3b640697d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b7815b610 0x7f3b7815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60003fe0 0x7f3b78142df0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 --2- 172.21.15.7:0/600662375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b781599a0 0x7f3b78159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 >> 172.21.15.7:0/600662375 conn(0x7f3b780cd400 msgr2=0x7f3b780c2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:49.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 shutdown_connections 2023-10-14T19:11:49.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.011+0000 7f3b8030a700 1 -- 172.21.15.7:0/600662375 wait complete. 2023-10-14T19:11:49.024 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:11:49.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:11:49.155 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.146+0000 7fb0abdf2700 1 Processor -- start 2023-10-14T19:11:49.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.146+0000 7fb0abdf2700 1 -- start start 2023-10-14T19:11:49.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0abdf2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0a40cb880 0x7fb0a40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0abdf2700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb0a40cd770 0x7fb0a41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.156 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0abdf2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a40cf330 con 0x7fb0a40b04f0 2023-10-14T19:11:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0abdf2700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40cdbd0 con 0x7fb0a40cd770 2023-10-14T19:11:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0abdf2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40cead0 con 0x7fb0a40cb880 2023-10-14T19:11:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0aa38f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb0a40cd770 0x7fb0a41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0a938d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb0a40b04f0 0x7fb0a40cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46172/0 (socket says 172.21.15.7:46172) 2023-10-14T19:11:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0a938d700 1 -- 172.21.15.7:0/1695184204 learned_addr learned my addr 172.21.15.7:0/1695184204 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:49.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.147+0000 7fb0aa38f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb0a40cd770 0x7fb0a41591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58000/0 (socket says 172.21.15.7:58000) 2023-10-14T19:11:49.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0a9b8e700 1 --2- 172.21.15.7:0/1695184204 >> v2:172.21.15.148:3300/0 conn(0x7fb0a40cb880 0x7fb0a40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0aa38f700 1 -- 172.21.15.7:0/1695184204 >> v2:172.21.15.148:3300/0 conn(0x7fb0a40cb880 msgr2=0x7fb0a40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:49.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0aa38f700 1 --2- 172.21.15.7:0/1695184204 >> v2:172.21.15.148:3300/0 conn(0x7fb0a40cb880 0x7fb0a40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0aa38f700 1 -- 172.21.15.7:0/1695184204 >> v1:172.21.15.7:6789/0 conn(0x7fb0a40b04f0 legacy=0x7fb0a40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0aa38f700 1 -- 172.21.15.7:0/1695184204 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40cddd0 con 0x7fb0a40cd770 2023-10-14T19:11:49.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0a8b8c700 1 -- 172.21.15.7:0/1695184204 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815532355 0 0) 0x7fb0a40cf330 con 0x7fb0a40b04f0 2023-10-14T19:11:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0aa38f700 1 --2- 172.21.15.7:0/1695184204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40cd770 0x7fb0a41591e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40ce1c0 tx=0x7fb094009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d562557702f3e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0a8b8c700 1 -- 172.21.15.7:0/1695184204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400e070 con 0x7fb0a40cd770 2023-10-14T19:11:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0a8b8c700 1 -- 172.21.15.7:0/1695184204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09400bc30 con 0x7fb0a40cd770 2023-10-14T19:11:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.148+0000 7fb0a8b8c700 1 -- 172.21.15.7:0/1695184204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094012430 con 0x7fb0a40cd770 2023-10-14T19:11:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 -- 172.21.15.7:0/1695184204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40cd770 msgr2=0x7fb0a41591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/1695184204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40cd770 0x7fb0a41591e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40ce1c0 tx=0x7fb094009780 comp rx=0 tx=0).stop 2023-10-14T19:11:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 -- 172.21.15.7:0/1695184204 shutdown_connections 2023-10-14T19:11:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/1695184204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40cd770 0x7fb0a41591e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/1695184204 >> v2:172.21.15.148:3300/0 conn(0x7fb0a40cb880 0x7fb0a40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 -- 172.21.15.7:0/1695184204 >> 172.21.15.7:0/1695184204 conn(0x7fb0a40703a0 msgr2=0x7fb0a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 -- 172.21.15.7:0/1695184204 shutdown_connections 2023-10-14T19:11:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.149+0000 7fb0abdf2700 1 -- 172.21.15.7:0/1695184204 wait complete. 2023-10-14T19:11:49.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.150+0000 7fb0abdf2700 1 Processor -- start 2023-10-14T19:11:49.165 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.150+0000 7fb0abdf2700 1 -- start start 2023-10-14T19:11:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 0x7fb0a40b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0a40cb880 0x7fb0a416aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0a40cd770 0x7fb0a40c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b4130 con 0x7fb0a40b04f0 2023-10-14T19:11:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b61b0 con 0x7fb0a40cb880 2023-10-14T19:11:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b3520 con 0x7fb0a40cd770 2023-10-14T19:11:49.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 0x7fb0a40b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 0x7fb0a40b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58008/0 (socket says 172.21.15.7:58008) 2023-10-14T19:11:49.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 -- 172.21.15.7:0/2334954066 learned_addr learned my addr 172.21.15.7:0/2334954066 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:49.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a938d700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0a40cb880 0x7fb0a416aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0aa38f700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0a40cd770 0x7fb0a40c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 -- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0a40cd770 msgr2=0x7fb0a40c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0a40cd770 0x7fb0a40c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 -- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0a40cb880 msgr2=0x7fb0a416aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0a40cb880 0x7fb0a416aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 -- 172.21.15.7:0/2334954066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094009a20 con 0x7fb0a40b04f0 2023-10-14T19:11:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a938d700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0a40cb880 0x7fb0a416aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a9b8e700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 0x7fb0a40b45c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00d8c0 tx=0x7fb09c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00de60 con 0x7fb0a40b04f0 2023-10-14T19:11:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00b780 con 0x7fb0a40b04f0 2023-10-14T19:11:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40b3800 con 0x7fb0a40b04f0 2023-10-14T19:11:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.151+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00bb20 con 0x7fb0a40b04f0 2023-10-14T19:11:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.152+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40b3dc0 con 0x7fb0a40b04f0 2023-10-14T19:11:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.152+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a404c3c0 con 0x7fb0a40b04f0 2023-10-14T19:11:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.153+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb09c01e460 con 0x7fb0a40b04f0 2023-10-14T19:11:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.153+0000 7fb0a1ffb700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb090067320 0x7fb0900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.153+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb09c084fa0 con 0x7fb0a40b04f0 2023-10-14T19:11:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.153+0000 7fb0a938d700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb090067320 0x7fb0900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.154+0000 7fb0a938d700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb090067320 0x7fb0900697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c7260 tx=0x7fb098009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.158+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb09c051f80 con 0x7fb0a40b04f0 2023-10-14T19:11:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.352+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb0a40cece0 con 0x7fb0a40b04f0 2023-10-14T19:11:49.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:11:49.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:11:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.516+0000 7fb0a1ffb700 1 -- 172.21.15.7:0/2334954066 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v180) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb09c0555a0 con 0x7fb0a40b04f0 2023-10-14T19:11:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.519+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb090067320 msgr2=0x7fb0900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.519+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb090067320 0x7fb0900697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c7260 tx=0x7fb098009040 comp rx=0 tx=0).stop 2023-10-14T19:11:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.519+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 msgr2=0x7fb0a40b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.519+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 0x7fb0a40b45c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00d8c0 tx=0x7fb09c008040 comp rx=0 tx=0).stop 2023-10-14T19:11:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.520+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 shutdown_connections 2023-10-14T19:11:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.520+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb090067320 0x7fb0900697d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.520+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0a40cd770 0x7fb0a40c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.520+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a40b04f0 0x7fb0a40b45c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.522 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.520+0000 7fb0abdf2700 1 --2- 172.21.15.7:0/2334954066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0a40cb880 0x7fb0a416aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.520+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 >> 172.21.15.7:0/2334954066 conn(0x7fb0a40703a0 msgr2=0x7fb0a4158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.521+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 shutdown_connections 2023-10-14T19:11:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.521+0000 7fb0abdf2700 1 -- 172.21.15.7:0/2334954066 wait complete. 2023-10-14T19:11:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:11:49.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:11:49.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.701+0000 7fe5ce7e6700 1 Processor -- start 2023-10-14T19:11:49.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.701+0000 7fe5ce7e6700 1 -- start start 2023-10-14T19:11:49.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ce7e6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe5c8159530 0x7fe5c80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ce7e6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c806e0e0 0x7fe5c80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ce7e6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80ccfd0 con 0x7fe5c806dc70 2023-10-14T19:11:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ce7e6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c80cf0e0 con 0x7fe5c806e0e0 2023-10-14T19:11:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ce7e6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c815a3d0 con 0x7fe5c8159530 2023-10-14T19:11:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ccd83700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c806e0e0 0x7fe5c80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5c77fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe5c806dc70 0x7fe5c8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46184/0 (socket says 172.21.15.7:46184) 2023-10-14T19:11:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5c77fe700 1 -- 172.21.15.7:0/756640617 learned_addr learned my addr 172.21.15.7:0/756640617 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ccd83700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c806e0e0 0x7fe5c80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58014/0 (socket says 172.21.15.7:58014) 2023-10-14T19:11:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5c7fff700 1 --2- 172.21.15.7:0/756640617 >> v2:172.21.15.148:3300/0 conn(0x7fe5c8159530 0x7fe5c80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ccd83700 1 -- 172.21.15.7:0/756640617 >> v2:172.21.15.148:3300/0 conn(0x7fe5c8159530 msgr2=0x7fe5c80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ccd83700 1 --2- 172.21.15.7:0/756640617 >> v2:172.21.15.148:3300/0 conn(0x7fe5c8159530 0x7fe5c80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ccd83700 1 -- 172.21.15.7:0/756640617 >> v1:172.21.15.7:6789/0 conn(0x7fe5c806dc70 legacy=0x7fe5c8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5ccd83700 1 -- 172.21.15.7:0/756640617 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c815a6b0 con 0x7fe5c806e0e0 2023-10-14T19:11:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.702+0000 7fe5c6ffd700 1 -- 172.21.15.7:0/756640617 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061245289 0 0) 0x7fe5c80ccfd0 con 0x7fe5c806dc70 2023-10-14T19:11:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ccd83700 1 --2- 172.21.15.7:0/756640617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80cb6f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe5c806d630 tx=0x7fe5c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66cf9e07f60e4b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5c6ffd700 1 -- 172.21.15.7:0/756640617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000e070 con 0x7fe5c806e0e0 2023-10-14T19:11:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5c6ffd700 1 -- 172.21.15.7:0/756640617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000bb60 con 0x7fe5c806e0e0 2023-10-14T19:11:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5c6ffd700 1 -- 172.21.15.7:0/756640617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0012430 con 0x7fe5c806e0e0 2023-10-14T19:11:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/756640617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c806e0e0 msgr2=0x7fe5c80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/756640617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80cb6f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe5c806d630 tx=0x7fe5c0009780 comp rx=0 tx=0).stop 2023-10-14T19:11:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/756640617 shutdown_connections 2023-10-14T19:11:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/756640617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80cb6f0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/756640617 >> v2:172.21.15.148:3300/0 conn(0x7fe5c8159530 0x7fe5c80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/756640617 >> 172.21.15.7:0/756640617 conn(0x7fe5c80703a0 msgr2=0x7fe5c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/756640617 shutdown_connections 2023-10-14T19:11:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.703+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/756640617 wait complete. 2023-10-14T19:11:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.704+0000 7fe5ce7e6700 1 Processor -- start 2023-10-14T19:11:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 -- start start 2023-10-14T19:11:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806dc70 0x7fe5c8143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 0x7fe5c80d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c81548a0 con 0x7fe5c8159530 2023-10-14T19:11:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8155fc0 con 0x7fe5c806e0e0 2023-10-14T19:11:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ce7e6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80c79e0 con 0x7fe5c806dc70 2023-10-14T19:11:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ccd83700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 0x7fe5c80d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ccd83700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 0x7fe5c80d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58028/0 (socket says 172.21.15.7:58028) 2023-10-14T19:11:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5ccd83700 1 -- 172.21.15.7:0/940649523 learned_addr learned my addr 172.21.15.7:0/940649523 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.705+0000 7fe5c77fe700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5c7fff700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806dc70 0x7fe5c8143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ccd83700 1 -- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806dc70 msgr2=0x7fe5c8143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ccd83700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806dc70 0x7fe5c8143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ccd83700 1 -- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c806e0e0 msgr2=0x7fe5c80c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ccd83700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ccd83700 1 -- 172.21.15.7:0/940649523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0009a20 con 0x7fe5c8159530 2023-10-14T19:11:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5c7fff700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806dc70 0x7fe5c8143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ccd83700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 0x7fe5c80d0130 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00099f0 tx=0x7fe5c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0027470 con 0x7fe5c8159530 2023-10-14T19:11:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c00275f0 con 0x7fe5c8159530 2023-10-14T19:11:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c8156260 con 0x7fe5c8159530 2023-10-14T19:11:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00279b0 con 0x7fe5c8159530 2023-10-14T19:11:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.706+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c8156820 con 0x7fe5c8159530 2023-10-14T19:11:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.707+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c8156a40 con 0x7fe5c8159530 2023-10-14T19:11:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.707+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe5c0024070 con 0x7fe5c8159530 2023-10-14T19:11:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.708+0000 7fe5affff700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4067320 0x7fe5b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.708+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe5c00874c0 con 0x7fe5c8159530 2023-10-14T19:11:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.708+0000 7fe5c7fff700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4067320 0x7fe5b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.709+0000 7fe5c7fff700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4067320 0x7fe5b40697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009ce0 tx=0x7fe5b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.713+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5c0054330 con 0x7fe5c8159530 2023-10-14T19:11:49.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:49.905+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe5c804c3c0 con 0x7fe5c8159530 2023-10-14T19:11:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.524+0000 7fe5affff700 1 -- 172.21.15.7:0/940649523 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v181) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe5c0057950 con 0x7fe5c8159530 2023-10-14T19:11:50.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4067320 msgr2=0x7fe5b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:50.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4067320 0x7fe5b40697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009ce0 tx=0x7fe5b8008040 comp rx=0 tx=0).stop 2023-10-14T19:11:50.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 msgr2=0x7fe5c80d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 0x7fe5c80d0130 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00099f0 tx=0x7fe5c0019000 comp rx=0 tx=0).stop 2023-10-14T19:11:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 shutdown_connections 2023-10-14T19:11:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe5b4067320 0x7fe5b40697d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c8159530 0x7fe5c80d0130 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806dc70 0x7fe5c8143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 --2- 172.21.15.7:0/940649523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c806e0e0 0x7fe5c80c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.529+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 >> 172.21.15.7:0/940649523 conn(0x7fe5c80703a0 msgr2=0x7fe5c80d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.540+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 shutdown_connections 2023-10-14T19:11:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.541+0000 7fe5ce7e6700 1 -- 172.21.15.7:0/940649523 wait complete. 2023-10-14T19:11:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:11:50.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:11:50.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.683+0000 7fd70d179700 1 Processor -- start 2023-10-14T19:11:50.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.683+0000 7fd70d179700 1 -- start start 2023-10-14T19:11:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd70d179700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 0x7fd7080ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd70d179700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd70806dc70 0x7fd708159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd70d179700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7080ccfd0 con 0x7fd70806e0e0 2023-10-14T19:11:50.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd70d179700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080cf0e0 con 0x7fd70806dc70 2023-10-14T19:11:50.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd70d179700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70815a3d0 con 0x7fd708159530 2023-10-14T19:11:50.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd706d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 0x7fd7080ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:50.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.684+0000 7fd70659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd70806dc70 0x7fd708159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:50.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70759e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd70806e0e0 0x7fd7080cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36864/0 (socket says 172.21.15.7:36864) 2023-10-14T19:11:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd70806dc70 0x7fd708159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56540/0 (socket says 172.21.15.7:56540) 2023-10-14T19:11:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70759e700 1 -- 172.21.15.7:0/3388357701 learned_addr learned my addr 172.21.15.7:0/3388357701 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd706d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 0x7fd7080ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:41440/0 (socket says 172.21.15.7:41440) 2023-10-14T19:11:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70659c700 1 -- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 msgr2=0x7fd7080ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70659c700 1 --2- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 0x7fd7080ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70659c700 1 -- 172.21.15.7:0/3388357701 >> v1:172.21.15.148:6789/0 conn(0x7fd70806e0e0 legacy=0x7fd7080cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:50.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70659c700 1 -- 172.21.15.7:0/3388357701 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70815a6b0 con 0x7fd70806dc70 2023-10-14T19:11:50.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd706d9d700 1 --2- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 0x7fd7080ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:50.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd70659c700 1 --2- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd70806dc70 0x7fd708159900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00098e0 tx=0x7fd6f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8907d53e9e680b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd705d9b700 1 -- 172.21.15.7:0/3388357701 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000b640 con 0x7fd70806dc70 2023-10-14T19:11:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd705d9b700 1 -- 172.21.15.7:0/3388357701 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f000b7a0 con 0x7fd70806dc70 2023-10-14T19:11:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.685+0000 7fd705d9b700 1 -- 172.21.15.7:0/3388357701 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000bb40 con 0x7fd70806dc70 2023-10-14T19:11:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 -- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd70806dc70 msgr2=0x7fd708159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 --2- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd70806dc70 0x7fd708159900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00098e0 tx=0x7fd6f00091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 -- 172.21.15.7:0/3388357701 shutdown_connections 2023-10-14T19:11:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 --2- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd708159530 0x7fd7080ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 --2- 172.21.15.7:0/3388357701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd70806dc70 0x7fd708159900 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 -- 172.21.15.7:0/3388357701 >> 172.21.15.7:0/3388357701 conn(0x7fd7080703a0 msgr2=0x7fd7080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:50.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 -- 172.21.15.7:0/3388357701 shutdown_connections 2023-10-14T19:11:50.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.686+0000 7fd70d179700 1 -- 172.21.15.7:0/3388357701 wait complete. 2023-10-14T19:11:50.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.687+0000 7fd70d179700 1 Processor -- start 2023-10-14T19:11:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.687+0000 7fd70d179700 1 -- start start 2023-10-14T19:11:50.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70d179700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd70806dc70 0x7fd70814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:50.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70d179700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 0x7fd70814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:50.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70d179700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd708159530 0x7fd70814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70d179700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708153890 con 0x7fd70806e0e0 2023-10-14T19:11:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70d179700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708150250 con 0x7fd708159530 2023-10-14T19:11:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70d179700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd708150530 con 0x7fd70806dc70 2023-10-14T19:11:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 0x7fd70814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 0x7fd70814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58036/0 (socket says 172.21.15.7:58036) 2023-10-14T19:11:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 -- 172.21.15.7:0/186594438 learned_addr learned my addr 172.21.15.7:0/186594438 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd706d9d700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd70806dc70 0x7fd70814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70759e700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd708159530 0x7fd70814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 -- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd70806dc70 msgr2=0x7fd70814d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd70806dc70 0x7fd70814d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 -- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd708159530 msgr2=0x7fd70814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd708159530 0x7fd70814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.688+0000 7fd70659c700 1 -- 172.21.15.7:0/186594438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009a20 con 0x7fd70806e0e0 2023-10-14T19:11:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.689+0000 7fd70659c700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 0x7fd70814f6e0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd708089650 tx=0x7fd6f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.689+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f001bda0 con 0x7fd70806e0e0 2023-10-14T19:11:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.689+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0011420 con 0x7fd70806e0e0 2023-10-14T19:11:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.689+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00117e0 con 0x7fd70806e0e0 2023-10-14T19:11:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.689+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0009420 con 0x7fd70806e0e0 2023-10-14T19:11:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.689+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd708150af0 con 0x7fd70806e0e0 2023-10-14T19:11:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.690+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70804c3c0 con 0x7fd70806e0e0 2023-10-14T19:11:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.690+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd6f0011b50 con 0x7fd70806e0e0 2023-10-14T19:11:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.691+0000 7fd6feffd700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd6e8067320 0x7fd6e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.691+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd6f0086410 con 0x7fd70806e0e0 2023-10-14T19:11:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.691+0000 7fd706d9d700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd6e8067320 0x7fd6e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.692+0000 7fd706d9d700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd6e8067320 0x7fd6e80697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd7000099f0 tx=0x7fd70000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.695+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6f00530c0 con 0x7fd70806e0e0 2023-10-14T19:11:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:50.934+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd70815a990 con 0x7fd70806e0e0 2023-10-14T19:11:51.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.525+0000 7fd6feffd700 1 -- 172.21.15.7:0/186594438 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v118) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd6f00566e0 con 0x7fd70806e0e0 2023-10-14T19:11:51.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.529+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd6e8067320 msgr2=0x7fd6e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.529+0000 7fd70d179700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd6e8067320 0x7fd6e80697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd7000099f0 tx=0x7fd70000b040 comp rx=0 tx=0).stop 2023-10-14T19:11:51.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.529+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 msgr2=0x7fd70814f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.529+0000 7fd70d179700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 0x7fd70814f6e0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd708089650 tx=0x7fd6f0017000 comp rx=0 tx=0).stop 2023-10-14T19:11:51.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.539+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 shutdown_connections 2023-10-14T19:11:51.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.539+0000 7fd70d179700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd6e8067320 0x7fd6e80697d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.539+0000 7fd70d179700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd708159530 0x7fd70814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.539+0000 7fd70d179700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd70806dc70 0x7fd70814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.539+0000 7fd70d179700 1 --2- 172.21.15.7:0/186594438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd70806e0e0 0x7fd70814f6e0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.539+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 >> 172.21.15.7:0/186594438 conn(0x7fd7080703a0 msgr2=0x7fd7080b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:51.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.547+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 shutdown_connections 2023-10-14T19:11:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.548+0000 7fd70d179700 1 -- 172.21.15.7:0/186594438 wait complete. 2023-10-14T19:11:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 31 and data pool 32 2023-10-14T19:11:51.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:51.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.685+0000 7fb1ba2a8700 1 Processor -- start 2023-10-14T19:11:51.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.685+0000 7fb1ba2a8700 1 -- start start 2023-10-14T19:11:51.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1ba2a8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1b4153c30 0x7fb1b415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:51.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1ba2a8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1b40cf110 0x7fb1b415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1ba2a8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b415afd0 con 0x7fb1b415de50 2023-10-14T19:11:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1ba2a8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b415b2b0 con 0x7fb1b4153c30 2023-10-14T19:11:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1ba2a8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b415b590 con 0x7fb1b40cf110 2023-10-14T19:11:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1b4153c30 0x7fb1b415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1b4153c30 0x7fb1b415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58046/0 (socket says 172.21.15.7:58046) 2023-10-14T19:11:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 -- 172.21.15.7:0/4261093568 learned_addr learned my addr 172.21.15.7:0/4261093568 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:51.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b9aa7700 1 --2- 172.21.15.7:0/4261093568 >> v2:172.21.15.148:3300/0 conn(0x7fb1b40cf110 0x7fb1b415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:51.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 -- 172.21.15.7:0/4261093568 >> v2:172.21.15.148:3300/0 conn(0x7fb1b40cf110 msgr2=0x7fb1b415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:51.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 --2- 172.21.15.7:0/4261093568 >> v2:172.21.15.148:3300/0 conn(0x7fb1b40cf110 0x7fb1b415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 -- 172.21.15.7:0/4261093568 >> v1:172.21.15.148:6789/0 conn(0x7fb1b415de50 legacy=0x7fb1b40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.686+0000 7fb1b92a6700 1 -- 172.21.15.7:0/4261093568 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b415b870 con 0x7fb1b4153c30 2023-10-14T19:11:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1b92a6700 1 --2- 172.21.15.7:0/4261093568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4153c30 0x7fb1b415a5e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40cdab0 tx=0x7fb1ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cf13c630fdb4a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1b3fff700 1 -- 172.21.15.7:0/4261093568 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac009e70 con 0x7fb1b4153c30 2023-10-14T19:11:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1b3fff700 1 -- 172.21.15.7:0/4261093568 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00b860 con 0x7fb1b4153c30 2023-10-14T19:11:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1b3fff700 1 -- 172.21.15.7:0/4261093568 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00bc00 con 0x7fb1b4153c30 2023-10-14T19:11:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/4261093568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4153c30 msgr2=0x7fb1b415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/4261093568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4153c30 0x7fb1b415a5e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40cdab0 tx=0x7fb1ac009250 comp rx=0 tx=0).stop 2023-10-14T19:11:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/4261093568 shutdown_connections 2023-10-14T19:11:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/4261093568 >> v2:172.21.15.148:3300/0 conn(0x7fb1b40cf110 0x7fb1b415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/4261093568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b4153c30 0x7fb1b415a5e0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.687+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/4261093568 >> 172.21.15.7:0/4261093568 conn(0x7fb1b40703a0 msgr2=0x7fb1b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.688+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/4261093568 shutdown_connections 2023-10-14T19:11:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.688+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/4261093568 wait complete. 2023-10-14T19:11:51.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 Processor -- start 2023-10-14T19:11:51.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 -- start start 2023-10-14T19:11:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b40cf110 0x7fb1b4147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4153c30 0x7fb1b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 0x7fb1b40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4147590 con 0x7fb1b415de50 2023-10-14T19:11:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40b3f80 con 0x7fb1b40cf110 2023-10-14T19:11:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.689+0000 7fb1ba2a8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40b3370 con 0x7fb1b4153c30 2023-10-14T19:11:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 0x7fb1b40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 0x7fb1b40b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58062/0 (socket says 172.21.15.7:58062) 2023-10-14T19:11:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 -- 172.21.15.7:0/707386362 learned_addr learned my addr 172.21.15.7:0/707386362 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b92a6700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b40cf110 0x7fb1b4147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:51.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b8aa5700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4153c30 0x7fb1b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:51.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 -- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4153c30 msgr2=0x7fb1b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4153c30 0x7fb1b40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 -- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b40cf110 msgr2=0x7fb1b4147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b40cf110 0x7fb1b4147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 -- 172.21.15.7:0/707386362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0094f0 con 0x7fb1b415de50 2023-10-14T19:11:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b9aa7700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 0x7fb1b40b2140 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009e90 tx=0x7fb1a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400cb70 con 0x7fb1b415de50 2023-10-14T19:11:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400f040 con 0x7fb1b415de50 2023-10-14T19:11:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b40b3650 con 0x7fb1b415de50 2023-10-14T19:11:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4014480 con 0x7fb1b415de50 2023-10-14T19:11:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.690+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b40b3c10 con 0x7fb1b415de50 2023-10-14T19:11:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.691+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b40b4110 con 0x7fb1b415de50 2023-10-14T19:11:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.692+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb1a4014830 con 0x7fb1b415de50 2023-10-14T19:11:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.692+0000 7fb1b17fa700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a0067320 0x7fb1a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:51.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.692+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1a4085650 con 0x7fb1b415de50 2023-10-14T19:11:51.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.692+0000 7fb1b92a6700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a0067320 0x7fb1a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:51.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.693+0000 7fb1b92a6700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a0067320 0x7fb1a00697d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40cdab0 tx=0x7fb1ac017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.697+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1a40522d0 con 0x7fb1b415de50 2023-10-14T19:11:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.892+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b40b4310 con 0x7fb1b415de50 2023-10-14T19:11:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.893+0000 7fb1b17fa700 1 -- 172.21.15.7:0/707386362 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fb1a40558f0 con 0x7fb1b415de50 2023-10-14T19:11:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:51.894 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":182,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:50.936158+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:49.937199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a0067320 msgr2=0x7fb1a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a0067320 0x7fb1a00697d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40cdab0 tx=0x7fb1ac017000 comp rx=0 tx=0).stop 2023-10-14T19:11:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 msgr2=0x7fb1b40b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 0x7fb1b40b2140 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009e90 tx=0x7fb1a400b040 comp rx=0 tx=0).stop 2023-10-14T19:11:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 shutdown_connections 2023-10-14T19:11:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb1a0067320 0x7fb1a00697d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b40cf110 0x7fb1b4147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1b415de50 0x7fb1b40b2140 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 --2- 172.21.15.7:0/707386362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4153c30 0x7fb1b40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 >> 172.21.15.7:0/707386362 conn(0x7fb1b40703a0 msgr2=0x7fb1b41531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 shutdown_connections 2023-10-14T19:11:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:51.895+0000 7fb1ba2a8700 1 -- 172.21.15.7:0/707386362 wait complete. 2023-10-14T19:11:51.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:52.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.027+0000 7f2d660c1700 1 Processor -- start 2023-10-14T19:11:52.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.027+0000 7f2d660c1700 1 -- start start 2023-10-14T19:11:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.027+0000 7f2d660c1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d6015c210 0x7f2d601536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.027+0000 7f2d660c1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6015ad50 con 0x7f2d6015cf20 2023-10-14T19:11:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.027+0000 7f2d660c1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6015a140 con 0x7f2d6015cb50 2023-10-14T19:11:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.027+0000 7f2d660c1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6015a420 con 0x7f2d6015c210 2023-10-14T19:11:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5effd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2d6015cf20 0x7f2d600b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46190/0 (socket says 172.21.15.7:46190) 2023-10-14T19:11:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5effd700 1 -- 172.21.15.7:0/773533868 learned_addr learned my addr 172.21.15.7:0/773533868 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5ffff700 1 --2- 172.21.15.7:0/773533868 >> v2:172.21.15.148:3300/0 conn(0x7f2d6015c210 0x7f2d601536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332292861 0 0) 0x7f2d6015ad50 con 0x7f2d6015cf20 2023-10-14T19:11:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d48003570 con 0x7f2d6015cf20 2023-10-14T19:11:52.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276632961 0 0) 0x7f2d6015a140 con 0x7f2d6015cb50 2023-10-14T19:11:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d6015ad50 con 0x7f2d6015cb50 2023-10-14T19:11:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490207131 0 0) 0x7f2d48003570 con 0x7f2d6015cf20 2023-10-14T19:11:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 >> v2:172.21.15.148:3300/0 conn(0x7f2d6015c210 msgr2=0x7f2d601536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 --2- 172.21.15.7:0/773533868 >> v2:172.21.15.148:3300/0 conn(0x7f2d6015c210 0x7f2d601536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 >> v1:172.21.15.148:6789/0 conn(0x7f2d6015cb50 legacy=0x7f2d600b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6015a700 con 0x7f2d6015cf20 2023-10-14T19:11:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2d54001470 con 0x7f2d6015cf20 2023-10-14T19:11:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 >> v1:172.21.15.7:6789/0 conn(0x7f2d6015cf20 legacy=0x7f2d600b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48003bf0 0x7f2d48003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d48004810 0x7f2d48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d480051c0 0x7f2d4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6015a420 con 0x7f2d48003bf0 2023-10-14T19:11:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4800c0b0 con 0x7f2d48004810 2023-10-14T19:11:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4800c270 con 0x7f2d480051c0 2023-10-14T19:11:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5ffff700 1 --2- 172.21.15.7:0/773533868 >> v2:172.21.15.148:3300/0 conn(0x7f2d6015c210 0x7f2d601536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:52.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48003bf0 0x7f2d48003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.028+0000 7f2d5effd700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d48004810 0x7f2d48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5ffff700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d480051c0 0x7f2d4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5f7fe700 1 -- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d480051c0 msgr2=0x7f2d4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:52.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d480051c0 0x7f2d4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5f7fe700 1 -- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d48004810 msgr2=0x7f2d48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d48004810 0x7f2d48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5ffff700 1 -- 172.21.15.7:0/773533868 reap_dead start 2023-10-14T19:11:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5f7fe700 1 -- 172.21.15.7:0/773533868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48003570 con 0x7f2d48003bf0 2023-10-14T19:11:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48003bf0 0x7f2d48003fe0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f2d50001a10 tx=0x7f2d50007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da8848d8e8bbd98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000c590 con 0x7f2d48003bf0 2023-10-14T19:11:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000c6f0 con 0x7f2d48003bf0 2023-10-14T19:11:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d5e7fc700 1 -- 172.21.15.7:0/773533868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000cab0 con 0x7f2d48003bf0 2023-10-14T19:11:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d660c1700 1 -- 172.21.15.7:0/773533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48003bf0 msgr2=0x7f2d48003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.029+0000 7f2d660c1700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48003bf0 0x7f2d48003fe0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f2d50001a10 tx=0x7f2d50007d10 comp rx=0 tx=0).stop 2023-10-14T19:11:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.030+0000 7f2d660c1700 1 -- 172.21.15.7:0/773533868 shutdown_connections 2023-10-14T19:11:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.030+0000 7f2d660c1700 1 --2- 172.21.15.7:0/773533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48003bf0 0x7f2d48003fe0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.030+0000 7f2d660c1700 1 -- 172.21.15.7:0/773533868 >> 172.21.15.7:0/773533868 conn(0x7f2d600cded0 msgr2=0x7f2d6006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.030+0000 7f2d660c1700 1 -- 172.21.15.7:0/773533868 shutdown_connections 2023-10-14T19:11:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.030+0000 7f2d660c1700 1 -- 172.21.15.7:0/773533868 wait complete. 2023-10-14T19:11:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.031+0000 7f2d660c1700 1 Processor -- start 2023-10-14T19:11:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.031+0000 7f2d660c1700 1 -- start start 2023-10-14T19:11:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d48003bf0 0x7f2d6015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 0x7f2d600cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d6015e680 0x7f2d600c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6015fb30 con 0x7f2d600af500 2023-10-14T19:11:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60160500 con 0x7f2d6015e680 2023-10-14T19:11:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600cc060 con 0x7f2d48003bf0 2023-10-14T19:11:52.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 0x7f2d600cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 0x7f2d600cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58066/0 (socket says 172.21.15.7:58066) 2023-10-14T19:11:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 -- 172.21.15.7:0/2201768542 learned_addr learned my addr 172.21.15.7:0/2201768542 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d48003bf0 0x7f2d6015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5ffff700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d6015e680 0x7f2d600c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 -- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d48003bf0 msgr2=0x7f2d6015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d48003bf0 0x7f2d6015ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 -- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d6015e680 msgr2=0x7f2d600c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d6015e680 0x7f2d600c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 -- 172.21.15.7:0/2201768542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6015ef20 con 0x7f2d600af500 2023-10-14T19:11:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d5effd700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 0x7f2d600cbb20 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f2d540070e0 tx=0x7f2d54001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54012560 con 0x7f2d600af500 2023-10-14T19:11:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d540126c0 con 0x7f2d600af500 2023-10-14T19:11:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54012a80 con 0x7f2d600af500 2023-10-14T19:11:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6015f200 con 0x7f2d600af500 2023-10-14T19:11:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.032+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6015f7c0 con 0x7f2d600af500 2023-10-14T19:11:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.033+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6015fca0 con 0x7f2d600af500 2023-10-14T19:11:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.034+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d5401d460 con 0x7f2d600af500 2023-10-14T19:11:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.034+0000 7f2d477fe700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d4c067350 0x7f2d4c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.034+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d54084c80 con 0x7f2d600af500 2023-10-14T19:11:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.034+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d4c067350 0x7f2d4c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.035+0000 7f2d5f7fe700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d4c067350 0x7f2d4c069800 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2d60158ab0 tx=0x7f2d50015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.039+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d54051910 con 0x7f2d600af500 2023-10-14T19:11:52.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.235+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d6004c3c0 con 0x7f2d600af500 2023-10-14T19:11:52.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.236+0000 7f2d477fe700 1 -- 172.21.15.7:0/2201768542 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f2d54054f30 con 0x7f2d600af500 2023-10-14T19:11:52.237 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:52.237 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":182,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:50.936158+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:49.937199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:52.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d4c067350 msgr2=0x7f2d4c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d4c067350 0x7f2d4c069800 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2d60158ab0 tx=0x7f2d50015000 comp rx=0 tx=0).stop 2023-10-14T19:11:52.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 msgr2=0x7f2d600cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 0x7f2d600cbb20 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f2d540070e0 tx=0x7f2d54001df0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 shutdown_connections 2023-10-14T19:11:52.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2d4c067350 0x7f2d4c069800 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d6015e680 0x7f2d600c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d48003bf0 0x7f2d6015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 --2- 172.21.15.7:0/2201768542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d600af500 0x7f2d600cbb20 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 >> 172.21.15.7:0/2201768542 conn(0x7f2d600cded0 msgr2=0x7f2d6006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 shutdown_connections 2023-10-14T19:11:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.238+0000 7f2d660c1700 1 -- 172.21.15.7:0/2201768542 wait complete. 2023-10-14T19:11:52.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:11:52.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.373+0000 7f9e86ab5700 1 Processor -- start 2023-10-14T19:11:52.374 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.373+0000 7f9e86ab5700 1 -- start start 2023-10-14T19:11:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e86ab5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e800cd2b0 0x7f9e800ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e86ab5700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800c32a0 con 0x7f9e80157930 2023-10-14T19:11:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e86ab5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800c4100 con 0x7f9e800ca2c0 2023-10-14T19:11:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e86ab5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e800c9730 con 0x7f9e800cd2b0 2023-10-14T19:11:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e85052700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e800cd2b0 0x7f9e800ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e84851700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9e80157930 0x7f9e800ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46202/0 (socket says 172.21.15.7:46202) 2023-10-14T19:11:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e85052700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e800cd2b0 0x7f9e800ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58080/0 (socket says 172.21.15.7:58080) 2023-10-14T19:11:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.374+0000 7f9e84851700 1 -- 172.21.15.7:0/3242838551 learned_addr learned my addr 172.21.15.7:0/3242838551 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e85052700 1 -- 172.21.15.7:0/3242838551 >> v1:172.21.15.148:6789/0 conn(0x7f9e800ca2c0 legacy=0x7f9e800ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e85052700 1 -- 172.21.15.7:0/3242838551 >> v1:172.21.15.7:6789/0 conn(0x7f9e80157930 legacy=0x7f9e800ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e85052700 1 -- 172.21.15.7:0/3242838551 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800c34f0 con 0x7f9e800cd2b0 2023-10-14T19:11:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e85052700 1 --2- 172.21.15.7:0/3242838551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e800cd2b0 0x7f9e800ca730 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098e0 tx=0x7f9e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4201f435148900a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e7f7fe700 1 -- 172.21.15.7:0/3242838551 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68009e80 con 0x7f9e800cd2b0 2023-10-14T19:11:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e7f7fe700 1 -- 172.21.15.7:0/3242838551 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800b820 con 0x7f9e800cd2b0 2023-10-14T19:11:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.375+0000 7f9e7f7fe700 1 -- 172.21.15.7:0/3242838551 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800bba0 con 0x7f9e800cd2b0 2023-10-14T19:11:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 -- 172.21.15.7:0/3242838551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e800cd2b0 msgr2=0x7f9e800ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/3242838551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e800cd2b0 0x7f9e800ca730 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098e0 tx=0x7f9e680091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 -- 172.21.15.7:0/3242838551 shutdown_connections 2023-10-14T19:11:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/3242838551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e800cd2b0 0x7f9e800ca730 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 -- 172.21.15.7:0/3242838551 >> 172.21.15.7:0/3242838551 conn(0x7f9e80088000 msgr2=0x7f9e800883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 -- 172.21.15.7:0/3242838551 shutdown_connections 2023-10-14T19:11:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.376+0000 7f9e86ab5700 1 -- 172.21.15.7:0/3242838551 wait complete. 2023-10-14T19:11:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.377+0000 7f9e86ab5700 1 Processor -- start 2023-10-14T19:11:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.377+0000 7f9e86ab5700 1 -- start start 2023-10-14T19:11:52.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e800ca2c0 0x7f9e8015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800cd2b0 0x7f9e800addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 0x7f9e800afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801544b0 con 0x7f9e80157930 2023-10-14T19:11:52.384 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80158740 con 0x7f9e800cd2b0 2023-10-14T19:11:52.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800b0950 con 0x7f9e800ca2c0 2023-10-14T19:11:52.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 0x7f9e800afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 0x7f9e800afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58092/0 (socket says 172.21.15.7:58092) 2023-10-14T19:11:52.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 -- 172.21.15.7:0/2273933669 learned_addr learned my addr 172.21.15.7:0/2273933669 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:52.385 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e84851700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e800ca2c0 0x7f9e8015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e7ffff700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800cd2b0 0x7f9e800addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 -- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e800ca2c0 msgr2=0x7f9e8015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e800ca2c0 0x7f9e8015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 -- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800cd2b0 msgr2=0x7f9e800addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800cd2b0 0x7f9e800addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 -- 172.21.15.7:0/2273933669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009420 con 0x7f9e80157930 2023-10-14T19:11:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e84851700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e800ca2c0 0x7f9e8015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e85052700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 0x7f9e800afa30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9e680093f0 tx=0x7f9e68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6801b680 con 0x7f9e80157930 2023-10-14T19:11:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6801b800 con 0x7f9e80157930 2023-10-14T19:11:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e800b0c30 con 0x7f9e80157930 2023-10-14T19:11:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6801bbc0 con 0x7f9e80157930 2023-10-14T19:11:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.378+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8015ae30 con 0x7f9e80157930 2023-10-14T19:11:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.379+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e80158230 con 0x7f9e80157930 2023-10-14T19:11:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.380+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9e6801c450 con 0x7f9e80157930 2023-10-14T19:11:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.380+0000 7f9e7cff9700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e60067320 0x7f9e600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:52.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.380+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e68086c10 con 0x7f9e80157930 2023-10-14T19:11:52.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.380+0000 7f9e84851700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e60067320 0x7f9e600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:52.389 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.381+0000 7f9e84851700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e60067320 0x7f9e600697d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9e780018c0 tx=0x7f9e78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:52.390 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.384+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e80158230 con 0x7f9e80157930 2023-10-14T19:11:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:52.621+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9e80158230 con 0x7f9e80157930 2023-10-14T19:11:53.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-14T19:11:53.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-14T19:11:53.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-14T19:11:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.540+0000 7f9e7cff9700 1 -- 172.21.15.7:0/2273933669 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v120) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9e80158230 con 0x7f9e80157930 2023-10-14T19:11:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e60067320 msgr2=0x7f9e600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e60067320 0x7f9e600697d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9e780018c0 tx=0x7f9e78009040 comp rx=0 tx=0).stop 2023-10-14T19:11:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 msgr2=0x7f9e800afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 0x7f9e800afa30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9e680093f0 tx=0x7f9e68016000 comp rx=0 tx=0).stop 2023-10-14T19:11:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 shutdown_connections 2023-10-14T19:11:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9e60067320 0x7f9e600697d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e80157930 0x7f9e800afa30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e800ca2c0 0x7f9e8015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 --2- 172.21.15.7:0/2273933669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800cd2b0 0x7f9e800addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 >> 172.21.15.7:0/2273933669 conn(0x7f9e80088000 msgr2=0x7f9e800883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 shutdown_connections 2023-10-14T19:11:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.543+0000 7f9e86ab5700 1 -- 172.21.15.7:0/2273933669 wait complete. 2023-10-14T19:11:53.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:11:53.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.688+0000 7f41979b3700 1 Processor -- start 2023-10-14T19:11:53.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.689+0000 7f41979b3700 1 -- start start 2023-10-14T19:11:53.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.689+0000 7f41979b3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f41900cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:53.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.689+0000 7f41979b3700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41900ccfa0 0x7f41900cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:53.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.689+0000 7f41979b3700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41900cf510 con 0x7f4190159860 2023-10-14T19:11:53.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.689+0000 7f41979b3700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41900d00b0 con 0x7f41900ccfa0 2023-10-14T19:11:53.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.689+0000 7f41979b3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41900ce670 con 0x7f41900ce220 2023-10-14T19:11:53.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41900ccfa0 0x7f41900cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:53.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41900ccfa0 0x7f41900cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58094/0 (socket says 172.21.15.7:58094) 2023-10-14T19:11:53.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f419574f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4190159860 0x7f41900cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46210/0 (socket says 172.21.15.7:46210) 2023-10-14T19:11:53.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 -- 172.21.15.7:0/1311275845 learned_addr learned my addr 172.21.15.7:0/1311275845 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:53.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4194f4e700 1 --2- 172.21.15.7:0/1311275845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f41900cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:53.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 -- 172.21.15.7:0/1311275845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 msgr2=0x7f41900cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:53.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 --2- 172.21.15.7:0/1311275845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f41900cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 -- 172.21.15.7:0/1311275845 >> v1:172.21.15.7:6789/0 conn(0x7f4190159860 legacy=0x7f41900cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:53.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 -- 172.21.15.7:0/1311275845 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900cd960 con 0x7f41900ccfa0 2023-10-14T19:11:53.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f418ffff700 1 -- 172.21.15.7:0/1311275845 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416706653 0 0) 0x7f41900cf510 con 0x7f4190159860 2023-10-14T19:11:53.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f4195f50700 1 --2- 172.21.15.7:0/1311275845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41900ccfa0 0x7f41900cd420 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f4180009f20 tx=0x7f4180009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306575d868a28f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:53.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f418ffff700 1 -- 172.21.15.7:0/1311275845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000e070 con 0x7f41900ccfa0 2023-10-14T19:11:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f418ffff700 1 -- 172.21.15.7:0/1311275845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000b9d0 con 0x7f41900ccfa0 2023-10-14T19:11:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.690+0000 7f418ffff700 1 -- 172.21.15.7:0/1311275845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800092e0 con 0x7f41900ccfa0 2023-10-14T19:11:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 -- 172.21.15.7:0/1311275845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41900ccfa0 msgr2=0x7f41900cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 --2- 172.21.15.7:0/1311275845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41900ccfa0 0x7f41900cd420 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f4180009f20 tx=0x7f4180009840 comp rx=0 tx=0).stop 2023-10-14T19:11:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 -- 172.21.15.7:0/1311275845 shutdown_connections 2023-10-14T19:11:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 --2- 172.21.15.7:0/1311275845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41900ccfa0 0x7f41900cd420 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 --2- 172.21.15.7:0/1311275845 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f41900cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 -- 172.21.15.7:0/1311275845 >> 172.21.15.7:0/1311275845 conn(0x7f41900999b0 msgr2=0x7f4190070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:53.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 -- 172.21.15.7:0/1311275845 shutdown_connections 2023-10-14T19:11:53.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.691+0000 7f41979b3700 1 -- 172.21.15.7:0/1311275845 wait complete. 2023-10-14T19:11:53.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.692+0000 7f41979b3700 1 Processor -- start 2023-10-14T19:11:53.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.692+0000 7f41979b3700 1 -- start start 2023-10-14T19:11:53.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f41979b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41900ccfa0 0x7f4190169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f41979b3700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f419006db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f41979b3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 0x7f41900ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f41979b3700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419016a7e0 con 0x7f4190159860 2023-10-14T19:11:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f41979b3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419006e350 con 0x7f41900ccfa0 2023-10-14T19:11:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f41979b3700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419006e630 con 0x7f41900ce220 2023-10-14T19:11:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 0x7f41900ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:53.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 0x7f41900ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58100/0 (socket says 172.21.15.7:58100) 2023-10-14T19:11:53.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 -- 172.21.15.7:0/1796539315 learned_addr learned my addr 172.21.15.7:0/1796539315 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:53.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 -- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 msgr2=0x7f419006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:53.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4194f4e700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f419006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f419574f700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41900ccfa0 0x7f4190169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f419006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 -- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41900ccfa0 msgr2=0x7f4190169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41900ccfa0 0x7f4190169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 -- 172.21.15.7:0/1796539315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180009ae0 con 0x7f4190159860 2023-10-14T19:11:53.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.693+0000 7f4195f50700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 0x7f41900ca5e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f419006c7c0 tx=0x7f4180018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:53.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.694+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180008c70 con 0x7f4190159860 2023-10-14T19:11:53.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.694+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180008df0 con 0x7f4190159860 2023-10-14T19:11:53.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.694+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419006e910 con 0x7f4190159860 2023-10-14T19:11:53.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.694+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800256b0 con 0x7f4190159860 2023-10-14T19:11:53.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.694+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419006e060 con 0x7f4190159860 2023-10-14T19:11:53.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.695+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419004c3c0 con 0x7f4190159860 2023-10-14T19:11:53.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.695+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4180003040 con 0x7f4190159860 2023-10-14T19:11:53.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.696+0000 7f418d7fa700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f417c067350 0x7f417c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:53.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.696+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41800865f0 con 0x7f4190159860 2023-10-14T19:11:53.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.696+0000 7f419574f700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f417c067350 0x7f417c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:53.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.696+0000 7f419574f700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f417c067350 0x7f417c069800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f41880012a0 tx=0x7f4188009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:53.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.700+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4180053320 con 0x7f4190159860 2023-10-14T19:11:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:53.940+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41900b3aa0 con 0x7f4190159860 2023-10-14T19:11:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.544+0000 7f418d7fa700 1 -- 172.21.15.7:0/1796539315 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v121) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4180056940 con 0x7f4190159860 2023-10-14T19:11:54.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f417c067350 msgr2=0x7f417c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f417c067350 0x7f417c069800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f41880012a0 tx=0x7f4188009040 comp rx=0 tx=0).stop 2023-10-14T19:11:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 msgr2=0x7f41900ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 0x7f41900ca5e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f419006c7c0 tx=0x7f4180018000 comp rx=0 tx=0).stop 2023-10-14T19:11:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 shutdown_connections 2023-10-14T19:11:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f417c067350 0x7f417c069800 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41900ccfa0 0x7f4190169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4190159860 0x7f41900ca5e0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 --2- 172.21.15.7:0/1796539315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41900ce220 0x7f419006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 >> 172.21.15.7:0/1796539315 conn(0x7f41900999b0 msgr2=0x7f41900cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.546+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 shutdown_connections 2023-10-14T19:11:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.547+0000 7f41979b3700 1 -- 172.21.15.7:0/1796539315 wait complete. 2023-10-14T19:11:54.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:54.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.680+0000 7ffbec67c700 1 Processor -- start 2023-10-14T19:11:54.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.680+0000 7ffbec67c700 1 -- start start 2023-10-14T19:11:54.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.681+0000 7ffbec67c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe40cb5a0 0x7ffbe40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:54.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.681+0000 7ffbec67c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffbe40cd9e0 0x7ffbe4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:54.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.681+0000 7ffbec67c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe415ae40 con 0x7ffbe40cde50 2023-10-14T19:11:54.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.681+0000 7ffbec67c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40d13f0 con 0x7ffbe40cd9e0 2023-10-14T19:11:54.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.681+0000 7ffbec67c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe415ab60 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.681+0000 7ffbe9c17700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffbe40cd9e0 0x7ffbe4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffbe40cd9e0 0x7ffbe4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58110/0 (socket says 172.21.15.7:58110) 2023-10-14T19:11:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 -- 172.21.15.7:0/1826969998 learned_addr learned my addr 172.21.15.7:0/1826969998 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbea418700 1 --2- 172.21.15.7:0/1826969998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe40cb5a0 0x7ffbe40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 -- 172.21.15.7:0/1826969998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe40cb5a0 msgr2=0x7ffbe40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:54.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 --2- 172.21.15.7:0/1826969998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe40cb5a0 0x7ffbe40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 -- 172.21.15.7:0/1826969998 >> v1:172.21.15.148:6789/0 conn(0x7ffbe40cde50 legacy=0x7ffbe4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 -- 172.21.15.7:0/1826969998 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40ccf00 con 0x7ffbe40cd9e0 2023-10-14T19:11:54.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9c17700 1 --2- 172.21.15.7:0/1826969998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe4159ec0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80099b0 tx=0x7ffbd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e49bbd3fc703530 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:54.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9416700 1 -- 172.21.15.7:0/1826969998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8009ea0 con 0x7ffbe40cd9e0 2023-10-14T19:11:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9416700 1 -- 172.21.15.7:0/1826969998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd800b860 con 0x7ffbe40cd9e0 2023-10-14T19:11:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.682+0000 7ffbe9416700 1 -- 172.21.15.7:0/1826969998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800bc00 con 0x7ffbe40cd9e0 2023-10-14T19:11:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 -- 172.21.15.7:0/1826969998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cd9e0 msgr2=0x7ffbe4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1826969998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe4159ec0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80099b0 tx=0x7ffbd8009250 comp rx=0 tx=0).stop 2023-10-14T19:11:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 -- 172.21.15.7:0/1826969998 shutdown_connections 2023-10-14T19:11:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1826969998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe40cb5a0 0x7ffbe40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1826969998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe4159ec0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 -- 172.21.15.7:0/1826969998 >> 172.21.15.7:0/1826969998 conn(0x7ffbe4070e30 msgr2=0x7ffbe40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 -- 172.21.15.7:0/1826969998 shutdown_connections 2023-10-14T19:11:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.683+0000 7ffbec67c700 1 -- 172.21.15.7:0/1826969998 wait complete. 2023-10-14T19:11:54.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.684+0000 7ffbec67c700 1 Processor -- start 2023-10-14T19:11:54.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.684+0000 7ffbec67c700 1 -- start start 2023-10-14T19:11:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 0x7ffbe4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe415b5b0 0x7ffbe40b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe415bec0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41568d0 con 0x7ffbe40cd9e0 2023-10-14T19:11:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4157de0 con 0x7ffbe415b5b0 2023-10-14T19:11:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 0x7ffbe4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 0x7ffbe4156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58122/0 (socket says 172.21.15.7:58122) 2023-10-14T19:11:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 -- 172.21.15.7:0/1015272088 learned_addr learned my addr 172.21.15.7:0/1015272088 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbe9c17700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:54.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbeac19700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe415b5b0 0x7ffbe40b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:54.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 -- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe415b5b0 msgr2=0x7ffbe40b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe415b5b0 0x7ffbe40b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 -- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe40cd9e0 msgr2=0x7ffbe415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 -- 172.21.15.7:0/1015272088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80094f0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbe9c17700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbea418700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 0x7ffbe4156390 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00ecb0 tx=0x7ffbdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00c9d0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00cb30 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00ced0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40ca7c0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.685+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe4157790 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.686+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe415b9b0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.687+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffbdc013680 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.687+0000 7ffbe27fc700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffbd0067320 0x7ffbd00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.687+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffbdc085030 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.687+0000 7ffbe9c17700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffbd0067320 0x7ffbd00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.688+0000 7ffbe9c17700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffbd0067320 0x7ffbd00697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80099b0 tx=0x7ffbd8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.692+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbdc051cc0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.928+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbe41575f0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.929+0000 7ffbe27fc700 1 -- 172.21.15.7:0/1015272088 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4607 (secure 0 0 0) 0x7ffbe41575f0 con 0x7ffbe40cb5a0 2023-10-14T19:11:54.930 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:54.930 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":121,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:11:54.539953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:11:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffbd0067320 msgr2=0x7ffbd00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffbd0067320 0x7ffbd00697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80099b0 tx=0x7ffbd8017000 comp rx=0 tx=0).stop 2023-10-14T19:11:54.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 msgr2=0x7ffbe4156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:54.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 0x7ffbe4156390 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00ecb0 tx=0x7ffbdc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 shutdown_connections 2023-10-14T19:11:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ffbd0067320 0x7ffbd00697d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe415b5b0 0x7ffbe40b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbe40cb5a0 0x7ffbe4156390 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 --2- 172.21.15.7:0/1015272088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe40cd9e0 0x7ffbe415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 >> 172.21.15.7:0/1015272088 conn(0x7ffbe4070e30 msgr2=0x7ffbe40c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 shutdown_connections 2023-10-14T19:11:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:54.931+0000 7ffbec67c700 1 -- 172.21.15.7:0/1015272088 wait complete. 2023-10-14T19:11:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 121 2023-10-14T19:11:54.944 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:11:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.063+0000 7fee9ba9f700 1 Processor -- start 2023-10-14T19:11:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.063+0000 7fee9ba9f700 1 -- start start 2023-10-14T19:11:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9ba9f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee940cb5a0 0x7fee940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9ba9f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fee940cd9e0 0x7fee94159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9ba9f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9415ae40 con 0x7fee9415a400 2023-10-14T19:11:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9ba9f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee940d13f0 con 0x7fee940cb5a0 2023-10-14T19:11:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9ba9f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9415ab60 con 0x7fee940cd9e0 2023-10-14T19:11:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9983b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee940cb5a0 0x7fee940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.064+0000 7fee9983b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee940cb5a0 0x7fee940cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58126/0 (socket says 172.21.15.7:58126) 2023-10-14T19:11:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9983b700 1 -- 172.21.15.7:0/4191737314 learned_addr learned my addr 172.21.15.7:0/4191737314 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9903a700 1 --2- 172.21.15.7:0/4191737314 >> v2:172.21.15.148:3300/0 conn(0x7fee940cd9e0 0x7fee94159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9983b700 1 -- 172.21.15.7:0/4191737314 >> v2:172.21.15.148:3300/0 conn(0x7fee940cd9e0 msgr2=0x7fee94159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9983b700 1 --2- 172.21.15.7:0/4191737314 >> v2:172.21.15.148:3300/0 conn(0x7fee940cd9e0 0x7fee94159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9983b700 1 -- 172.21.15.7:0/4191737314 >> v1:172.21.15.148:6789/0 conn(0x7fee9415a400 legacy=0x7fee94156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9983b700 1 -- 172.21.15.7:0/4191737314 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940ccf00 con 0x7fee940cb5a0 2023-10-14T19:11:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9903a700 1 --2- 172.21.15.7:0/4191737314 >> v2:172.21.15.148:3300/0 conn(0x7fee940cd9e0 0x7fee94159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee9983b700 1 --2- 172.21.15.7:0/4191737314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee940cb5a0 0x7fee940cb970 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fee84009f20 tx=0x7fee84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a28274bfbe093d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee98839700 1 -- 172.21.15.7:0/4191737314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400e070 con 0x7fee940cb5a0 2023-10-14T19:11:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee98839700 1 -- 172.21.15.7:0/4191737314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400ba00 con 0x7fee940cb5a0 2023-10-14T19:11:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.065+0000 7fee98839700 1 -- 172.21.15.7:0/4191737314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840092e0 con 0x7fee940cb5a0 2023-10-14T19:11:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 -- 172.21.15.7:0/4191737314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee940cb5a0 msgr2=0x7fee940cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/4191737314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee940cb5a0 0x7fee940cb970 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fee84009f20 tx=0x7fee84009840 comp rx=0 tx=0).stop 2023-10-14T19:11:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 -- 172.21.15.7:0/4191737314 shutdown_connections 2023-10-14T19:11:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/4191737314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee940cb5a0 0x7fee940cb970 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/4191737314 >> v2:172.21.15.148:3300/0 conn(0x7fee940cd9e0 0x7fee94159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 -- 172.21.15.7:0/4191737314 >> 172.21.15.7:0/4191737314 conn(0x7fee94070e30 msgr2=0x7fee940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 -- 172.21.15.7:0/4191737314 shutdown_connections 2023-10-14T19:11:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.066+0000 7fee9ba9f700 1 -- 172.21.15.7:0/4191737314 wait complete. 2023-10-14T19:11:55.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.067+0000 7fee9ba9f700 1 Processor -- start 2023-10-14T19:11:55.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.067+0000 7fee9ba9f700 1 -- start start 2023-10-14T19:11:55.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee940cd9e0 0x7fee941595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee9415a400 0x7fee94157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 0x7fee941553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee940afb80 con 0x7fee9416a460 2023-10-14T19:11:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94159380 con 0x7fee940cd9e0 2023-10-14T19:11:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee94159b10 con 0x7fee9415a400 2023-10-14T19:11:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 0x7fee941553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 0x7fee941553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58142/0 (socket says 172.21.15.7:58142) 2023-10-14T19:11:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 -- 172.21.15.7:0/838065429 learned_addr learned my addr 172.21.15.7:0/838065429 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9983b700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee940cd9e0 0x7fee941595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9903a700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee9415a400 0x7fee94157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 -- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee9415a400 msgr2=0x7fee94157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee9415a400 0x7fee94157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 -- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee940cd9e0 msgr2=0x7fee941595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee940cd9e0 0x7fee941595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 -- 172.21.15.7:0/838065429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009ae0 con 0x7fee9416a460 2023-10-14T19:11:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9983b700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee940cd9e0 0x7fee941595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9a03c700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 0x7fee941553a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00b510 tx=0x7fee8c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00f510 con 0x7fee9416a460 2023-10-14T19:11:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00f670 con 0x7fee9416a460 2023-10-14T19:11:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00fa30 con 0x7fee9416a460 2023-10-14T19:11:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.068+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee94158dc0 con 0x7fee9416a460 2023-10-14T19:11:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.069+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee94156e00 con 0x7fee9416a460 2023-10-14T19:11:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.070+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee94156c60 con 0x7fee9416a460 2023-10-14T19:11:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.070+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fee8c01a400 con 0x7fee9416a460 2023-10-14T19:11:55.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.070+0000 7fee91ffb700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee80067320 0x7fee800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.070+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee8c084600 con 0x7fee9416a460 2023-10-14T19:11:55.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.071+0000 7fee9983b700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee80067320 0x7fee800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.071+0000 7fee9983b700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee80067320 0x7fee800697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fee940898f0 tx=0x7fee84017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.075+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee94156c60 con 0x7fee9416a460 2023-10-14T19:11:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.273+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee94156c40 con 0x7fee9416a460 2023-10-14T19:11:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.273+0000 7fee91ffb700 1 -- 172.21.15.7:0/838065429 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fee8c051310 con 0x7fee9416a460 2023-10-14T19:11:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:55.275 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":183,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:11:52.530862+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-14T19:11:49.937199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:11:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee80067320 msgr2=0x7fee800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee80067320 0x7fee800697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fee940898f0 tx=0x7fee84017000 comp rx=0 tx=0).stop 2023-10-14T19:11:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 msgr2=0x7fee941553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 0x7fee941553a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00b510 tx=0x7fee8c006f90 comp rx=0 tx=0).stop 2023-10-14T19:11:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 shutdown_connections 2023-10-14T19:11:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fee80067320 0x7fee800697d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee940cd9e0 0x7fee941595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee9416a460 0x7fee941553a0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 --2- 172.21.15.7:0/838065429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee9415a400 0x7fee94157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 >> 172.21.15.7:0/838065429 conn(0x7fee94070e30 msgr2=0x7fee940b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.275+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 shutdown_connections 2023-10-14T19:11:55.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.276+0000 7fee9ba9f700 1 -- 172.21.15.7:0/838065429 wait complete. 2023-10-14T19:11:55.289 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:11:55.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.408+0000 7f09db62f700 1 Processor -- start 2023-10-14T19:11:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.408+0000 7f09db62f700 1 -- start start 2023-10-14T19:11:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09db62f700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09d40cb970 0x7f09d4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09db62f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d415a400 0x7f09d4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09db62f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d415ae40 con 0x7f09d40cb5a0 2023-10-14T19:11:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09db62f700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40ce0f0 con 0x7f09d40cb970 2023-10-14T19:11:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09db62f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40d13f0 con 0x7f09d415a400 2023-10-14T19:11:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09d40cb970 0x7f09d4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09d40cb970 0x7f09d4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58144/0 (socket says 172.21.15.7:58144) 2023-10-14T19:11:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 -- 172.21.15.7:0/3170958013 learned_addr learned my addr 172.21.15.7:0/3170958013 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d9bcc700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d415a400 0x7f09d4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 -- 172.21.15.7:0/3170958013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d415a400 msgr2=0x7f09d4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d415a400 0x7f09d4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 -- 172.21.15.7:0/3170958013 >> v1:172.21.15.148:6789/0 conn(0x7f09d40cb5a0 legacy=0x7f09d40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 -- 172.21.15.7:0/3170958013 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d415ab60 con 0x7f09d40cb970 2023-10-14T19:11:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d9bcc700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d415a400 0x7f09d4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09d8bca700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4159ec0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f09c40099b0 tx=0x7f09c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e904f632656ec341 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09cbfff700 1 -- 172.21.15.7:0/3170958013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400b860 con 0x7f09d40cb970 2023-10-14T19:11:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09cbfff700 1 -- 172.21.15.7:0/3170958013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c400b9c0 con 0x7f09d40cb970 2023-10-14T19:11:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.409+0000 7f09cbfff700 1 -- 172.21.15.7:0/3170958013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400bd60 con 0x7f09d40cb970 2023-10-14T19:11:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 -- 172.21.15.7:0/3170958013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 msgr2=0x7f09d4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4159ec0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f09c40099b0 tx=0x7f09c4009250 comp rx=0 tx=0).stop 2023-10-14T19:11:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 -- 172.21.15.7:0/3170958013 shutdown_connections 2023-10-14T19:11:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d415a400 0x7f09d4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 --2- 172.21.15.7:0/3170958013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4159ec0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 -- 172.21.15.7:0/3170958013 >> 172.21.15.7:0/3170958013 conn(0x7f09d4070e30 msgr2=0x7f09d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 -- 172.21.15.7:0/3170958013 shutdown_connections 2023-10-14T19:11:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.410+0000 7f09db62f700 1 -- 172.21.15.7:0/3170958013 wait complete. 2023-10-14T19:11:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.411+0000 7f09db62f700 1 Processor -- start 2023-10-14T19:11:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.411+0000 7f09db62f700 1 -- start start 2023-10-14T19:11:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09db62f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d40cb5a0 0x7f09d4154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09db62f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09db62f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d415a400 0x7f09d4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09db62f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d41583b0 con 0x7f09d40cb970 2023-10-14T19:11:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09db62f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d41577a0 con 0x7f09d415a400 2023-10-14T19:11:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09db62f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d4157a80 con 0x7f09d40cb5a0 2023-10-14T19:11:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58146/0 (socket says 172.21.15.7:58146) 2023-10-14T19:11:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 -- 172.21.15.7:0/1745842785 learned_addr learned my addr 172.21.15.7:0/1745842785 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d9bcc700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d415a400 0x7f09d4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d93cb700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d40cb5a0 0x7f09d4154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 -- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d40cb5a0 msgr2=0x7f09d4154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d40cb5a0 0x7f09d4154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 -- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d415a400 msgr2=0x7f09d4155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d415a400 0x7f09d4155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.412+0000 7f09d8bca700 1 -- 172.21.15.7:0/1745842785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c40094f0 con 0x7f09d40cb970 2023-10-14T19:11:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.413+0000 7f09d8bca700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4155580 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009290 tx=0x7f09c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.413+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4026480 con 0x7f09d40cb970 2023-10-14T19:11:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.413+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c401f070 con 0x7f09d40cb970 2023-10-14T19:11:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.413+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d4157d60 con 0x7f09d40cb970 2023-10-14T19:11:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.413+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4026830 con 0x7f09d40cb970 2023-10-14T19:11:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.413+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d41504d0 con 0x7f09d40cb970 2023-10-14T19:11:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.414+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d4158560 con 0x7f09d40cb970 2023-10-14T19:11:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.414+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f09c4026ba0 con 0x7f09d40cb970 2023-10-14T19:11:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.415+0000 7f09c97fa700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09b8067320 0x7f09b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.415+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09c4021070 con 0x7f09d40cb970 2023-10-14T19:11:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.415+0000 7f09d93cb700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09b8067320 0x7f09b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.415+0000 7f09d93cb700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09b8067320 0x7f09b80697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f09d4153020 tx=0x7f09d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.419+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09d4158560 con 0x7f09d40cb970 2023-10-14T19:11:55.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.610+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09d404c3c0 con 0x7f09b8067320 2023-10-14T19:11:55.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.618+0000 7f09c97fa700 1 -- 172.21.15.7:0/1745842785 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289764 (secure 0 0 0) 0x7f09d404c3c0 con 0x7f09b8067320 2023-10-14T19:11:55.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09b8067320 msgr2=0x7f09b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09b8067320 0x7f09b80697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f09d4153020 tx=0x7f09d0009040 comp rx=0 tx=0).stop 2023-10-14T19:11:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 msgr2=0x7f09d4155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4155580 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009290 tx=0x7f09c4017000 comp rx=0 tx=0).stop 2023-10-14T19:11:55.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 shutdown_connections 2023-10-14T19:11:55.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f09b8067320 0x7f09b80697d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09d415a400 0x7f09d4155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09d40cb5a0 0x7f09d4154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 --2- 172.21.15.7:0/1745842785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09d40cb970 0x7f09d4155580 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 >> 172.21.15.7:0/1745842785 conn(0x7f09d4070e30 msgr2=0x7f09d40b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 shutdown_connections 2023-10-14T19:11:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.622+0000 7f09db62f700 1 -- 172.21.15.7:0/1745842785 wait complete. 2023-10-14T19:11:55.629 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:55.635 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2023-10-14T19:11:53.747910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438580,"kb_used_data":19316,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752536140,"statfs":{"total":773094113280,"available":770597007360,"internally_reserved":0,"allocated":19779584,"data_stored":9493636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.231049"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549922+0000","last_change":"2023-10-14T19:11:51.543851+0000","last_active":"2023-10-14T19:11:51.549922+0000","last_peered":"2023-10-14T19:11:51.549922+0000","last_clean":"2023-10-14T19:11:51.549922+0000","last_became_active":"2023-10-14T19:11:51.543539+0000","last_became_peered":"2023-10-14T19:11:51.543539+0000","last_unstale":"2023-10-14T19:11:51.549922+0000","last_undegraded":"2023-10-14T19:11:51.549922+0000","last_fullsized":"2023-10-14T19:11:51.549922+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:46:46.050036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547003+0000","last_change":"2023-10-14T19:11:51.547003+0000","last_active":"2023-10-14T19:11:51.547003+0000","last_peered":"2023-10-14T19:11:51.547003+0000","last_clean":"2023-10-14T19:11:51.547003+0000","last_became_active":"2023-10-14T19:11:51.546392+0000","last_became_peered":"2023-10-14T19:11:51.546392+0000","last_unstale":"2023-10-14T19:11:51.547003+0000","last_undegraded":"2023-10-14T19:11:51.547003+0000","last_fullsized":"2023-10-14T19:11:51.547003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:25:42.067147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.544663+0000","last_change":"2023-10-14T19:11:51.544663+0000","last_active":"2023-10-14T19:11:51.544663+0000","last_peered":"2023-10-14T19:11:51.544663+0000","last_clean":"2023-10-14T19:11:51.544663+0000","last_became_active":"2023-10-14T19:11:51.544375+0000","last_became_peered":"2023-10-14T19:11:51.544375+0000","last_unstale":"2023-10-14T19:11:51.544663+0000","last_undegraded":"2023-10-14T19:11:51.544663+0000","last_fullsized":"2023-10-14T19:11:51.544663+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:06.056088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539818+0000","last_change":"2023-10-14T19:11:51.539818+0000","last_active":"2023-10-14T19:11:51.539818+0000","last_peered":"2023-10-14T19:11:51.539818+0000","last_clean":"2023-10-14T19:11:51.539818+0000","last_became_active":"2023-10-14T19:11:51.538611+0000","last_became_peered":"2023-10-14T19:11:51.538611+0000","last_unstale":"2023-10-14T19:11:51.539818+0000","last_undegraded":"2023-10-14T19:11:51.539818+0000","last_fullsized":"2023-10-14T19:11:51.539818+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:00.686165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.538807+0000","last_change":"2023-10-14T19:11:51.538807+0000","last_active":"2023-10-14T19:11:51.538807+0000","last_peered":"2023-10-14T19:11:51.538807+0000","last_clean":"2023-10-14T19:11:51.538807+0000","last_became_active":"2023-10-14T19:11:51.538536+0000","last_became_peered":"2023-10-14T19:11:51.538536+0000","last_unstale":"2023-10-14T19:11:51.538807+0000","last_undegraded":"2023-10-14T19:11:51.538807+0000","last_fullsized":"2023-10-14T19:11:51.538807+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:01.773817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549892+0000","last_change":"2023-10-14T19:11:51.543603+0000","last_active":"2023-10-14T19:11:51.549892+0000","last_peered":"2023-10-14T19:11:51.549892+0000","last_clean":"2023-10-14T19:11:51.549892+0000","last_became_active":"2023-10-14T19:11:51.543325+0000","last_became_peered":"2023-10-14T19:11:51.543325+0000","last_unstale":"2023-10-14T19:11:51.549892+0000","last_undegraded":"2023-10-14T19:11:51.549892+0000","last_fullsized":"2023-10-14T19:11:51.549892+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:00.515462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545508+0000","last_change":"2023-10-14T19:11:51.541764+0000","last_active":"2023-10-14T19:11:51.545508+0000","last_peered":"2023-10-14T19:11:51.545508+0000","last_clean":"2023-10-14T19:11:51.545508+0000","last_became_active":"2023-10-14T19:11:51.541492+0000","last_became_peered":"2023-10-14T19:11:51.541492+0000","last_unstale":"2023-10-14T19:11:51.545508+0000","last_undegraded":"2023-10-14T19:11:51.545508+0000","last_fullsized":"2023-10-14T19:11:51.545508+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:21:18.394226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545930+0000","last_change":"2023-10-14T19:11:51.545930+0000","last_active":"2023-10-14T19:11:51.545930+0000","last_peered":"2023-10-14T19:11:51.545930+0000","last_clean":"2023-10-14T19:11:51.545930+0000","last_became_active":"2023-10-14T19:11:51.545674+0000","last_became_peered":"2023-10-14T19:11:51.545674+0000","last_unstale":"2023-10-14T19:11:51.545930+0000","last_undegraded":"2023-10-14T19:11:51.545930+0000","last_fullsized":"2023-10-14T19:11:51.545930+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:11.183785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551973+0000","last_change":"2023-10-14T19:11:51.549527+0000","last_active":"2023-10-14T19:11:51.551973+0000","last_peered":"2023-10-14T19:11:51.551973+0000","last_clean":"2023-10-14T19:11:51.551973+0000","last_became_active":"2023-10-14T19:11:51.549202+0000","last_became_peered":"2023-10-14T19:11:51.549202+0000","last_unstale":"2023-10-14T19:11:51.551973+0000","last_undegraded":"2023-10-14T19:11:51.551973+0000","last_fullsized":"2023-10-14T19:11:51.551973+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:07.533888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.548427+0000","last_change":"2023-10-14T19:11:51.548427+0000","last_active":"2023-10-14T19:11:51.548427+0000","last_peered":"2023-10-14T19:11:51.548427+0000","last_clean":"2023-10-14T19:11:51.548427+0000","last_became_active":"2023-10-14T19:11:51.548171+0000","last_became_peered":"2023-10-14T19:11:51.548171+0000","last_unstale":"2023-10-14T19:11:51.548427+0000","last_undegraded":"2023-10-14T19:11:51.548427+0000","last_fullsized":"2023-10-14T19:11:51.548427+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:51.212884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547952+0000","last_change":"2023-10-14T19:11:51.547952+0000","last_active":"2023-10-14T19:11:51.547952+0000","last_peered":"2023-10-14T19:11:51.547952+0000","last_clean":"2023-10-14T19:11:51.547952+0000","last_became_active":"2023-10-14T19:11:51.547671+0000","last_became_peered":"2023-10-14T19:11:51.547671+0000","last_unstale":"2023-10-14T19:11:51.547952+0000","last_undegraded":"2023-10-14T19:11:51.547952+0000","last_fullsized":"2023-10-14T19:11:51.547952+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:28.741384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551605+0000","last_change":"2023-10-14T19:11:51.548426+0000","last_active":"2023-10-14T19:11:51.551605+0000","last_peered":"2023-10-14T19:11:51.551605+0000","last_clean":"2023-10-14T19:11:51.551605+0000","last_became_active":"2023-10-14T19:11:51.547812+0000","last_became_peered":"2023-10-14T19:11:51.547812+0000","last_unstale":"2023-10-14T19:11:51.551605+0000","last_undegraded":"2023-10-14T19:11:51.551605+0000","last_fullsized":"2023-10-14T19:11:51.551605+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:40:09.094070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.546172+0000","last_change":"2023-10-14T19:11:51.540825+0000","last_active":"2023-10-14T19:11:51.546172+0000","last_peered":"2023-10-14T19:11:51.546172+0000","last_clean":"2023-10-14T19:11:51.546172+0000","last_became_active":"2023-10-14T19:11:51.540120+0000","last_became_peered":"2023-10-14T19:11:51.540120+0000","last_unstale":"2023-10-14T19:11:51.546172+0000","last_undegraded":"2023-10-14T19:11:51.546172+0000","last_fullsized":"2023-10-14T19:11:51.546172+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:32.844635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539672+0000","last_change":"2023-10-14T19:11:51.539672+0000","last_active":"2023-10-14T19:11:51.539672+0000","last_peered":"2023-10-14T19:11:51.539672+0000","last_clean":"2023-10-14T19:11:51.539672+0000","last_became_active":"2023-10-14T19:11:51.539315+0000","last_became_peered":"2023-10-14T19:11:51.539315+0000","last_unstale":"2023-10-14T19:11:51.539672+0000","last_undegraded":"2023-10-14T19:11:51.539672+0000","last_fullsized":"2023-10-14T19:11:51.539672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:07.533888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552269+0000","last_change":"2023-10-14T19:11:51.552269+0000","last_active":"2023-10-14T19:11:51.552269+0000","last_peered":"2023-10-14T19:11:51.552269+0000","last_clean":"2023-10-14T19:11:51.552269+0000","last_became_active":"2023-10-14T19:11:51.551969+0000","last_became_peered":"2023-10-14T19:11:51.551969+0000","last_unstale":"2023-10-14T19:11:51.552269+0000","last_undegraded":"2023-10-14T19:11:51.552269+0000","last_fullsized":"2023-10-14T19:11:51.552269+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:28.741384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547761+0000","last_change":"2023-10-14T19:11:51.547761+0000","last_active":"2023-10-14T19:11:51.547761+0000","last_peered":"2023-10-14T19:11:51.547761+0000","last_clean":"2023-10-14T19:11:51.547761+0000","last_became_active":"2023-10-14T19:11:51.547234+0000","last_became_peered":"2023-10-14T19:11:51.547234+0000","last_unstale":"2023-10-14T19:11:51.547761+0000","last_undegraded":"2023-10-14T19:11:51.547761+0000","last_fullsized":"2023-10-14T19:11:51.547761+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:00.081387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549521+0000","last_change":"2023-10-14T19:11:51.546747+0000","last_active":"2023-10-14T19:11:51.549521+0000","last_peered":"2023-10-14T19:11:51.549521+0000","last_clean":"2023-10-14T19:11:51.549521+0000","last_became_active":"2023-10-14T19:11:51.546456+0000","last_became_peered":"2023-10-14T19:11:51.546456+0000","last_unstale":"2023-10-14T19:11:51.549521+0000","last_undegraded":"2023-10-14T19:11:51.549521+0000","last_fullsized":"2023-10-14T19:11:51.549521+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:15.444658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540523+0000","last_change":"2023-10-14T19:11:51.540523+0000","last_active":"2023-10-14T19:11:51.540523+0000","last_peered":"2023-10-14T19:11:51.540523+0000","last_clean":"2023-10-14T19:11:51.540523+0000","last_became_active":"2023-10-14T19:11:51.539337+0000","last_became_peered":"2023-10-14T19:11:51.539337+0000","last_unstale":"2023-10-14T19:11:51.540523+0000","last_undegraded":"2023-10-14T19:11:51.540523+0000","last_fullsized":"2023-10-14T19:11:51.540523+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:22.731792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549726+0000","last_change":"2023-10-14T19:11:51.549726+0000","last_active":"2023-10-14T19:11:51.549726+0000","last_peered":"2023-10-14T19:11:51.549726+0000","last_clean":"2023-10-14T19:11:51.549726+0000","last_became_active":"2023-10-14T19:11:51.549426+0000","last_became_peered":"2023-10-14T19:11:51.549426+0000","last_unstale":"2023-10-14T19:11:51.549726+0000","last_undegraded":"2023-10-14T19:11:51.549726+0000","last_fullsized":"2023-10-14T19:11:51.549726+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:51.212884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545075+0000","last_change":"2023-10-14T19:11:51.545075+0000","last_active":"2023-10-14T19:11:51.545075+0000","last_peered":"2023-10-14T19:11:51.545075+0000","last_clean":"2023-10-14T19:11:51.545075+0000","last_became_active":"2023-10-14T19:11:51.544807+0000","last_became_peered":"2023-10-14T19:11:51.544807+0000","last_unstale":"2023-10-14T19:11:51.545075+0000","last_undegraded":"2023-10-14T19:11:51.545075+0000","last_fullsized":"2023-10-14T19:11:51.545075+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:55.041261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545956+0000","last_change":"2023-10-14T19:11:51.543889+0000","last_active":"2023-10-14T19:11:51.545956+0000","last_peered":"2023-10-14T19:11:51.545956+0000","last_clean":"2023-10-14T19:11:51.545956+0000","last_became_active":"2023-10-14T19:11:51.543399+0000","last_became_peered":"2023-10-14T19:11:51.543399+0000","last_unstale":"2023-10-14T19:11:51.545956+0000","last_undegraded":"2023-10-14T19:11:51.545956+0000","last_fullsized":"2023-10-14T19:11:51.545956+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:34.589259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.548929+0000","last_change":"2023-10-14T19:11:51.545121+0000","last_active":"2023-10-14T19:11:51.548929+0000","last_peered":"2023-10-14T19:11:51.548929+0000","last_clean":"2023-10-14T19:11:51.548929+0000","last_became_active":"2023-10-14T19:11:51.544863+0000","last_became_peered":"2023-10-14T19:11:51.544863+0000","last_unstale":"2023-10-14T19:11:51.548929+0000","last_undegraded":"2023-10-14T19:11:51.548929+0000","last_fullsized":"2023-10-14T19:11:51.548929+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:42.650838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549996+0000","last_change":"2023-10-14T19:11:51.549996+0000","last_active":"2023-10-14T19:11:51.549996+0000","last_peered":"2023-10-14T19:11:51.549996+0000","last_clean":"2023-10-14T19:11:51.549996+0000","last_became_active":"2023-10-14T19:11:51.549538+0000","last_became_peered":"2023-10-14T19:11:51.549538+0000","last_unstale":"2023-10-14T19:11:51.549996+0000","last_undegraded":"2023-10-14T19:11:51.549996+0000","last_fullsized":"2023-10-14T19:11:51.549996+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:18:55.415661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549050+0000","last_change":"2023-10-14T19:11:51.543420+0000","last_active":"2023-10-14T19:11:51.549050+0000","last_peered":"2023-10-14T19:11:51.549050+0000","last_clean":"2023-10-14T19:11:51.549050+0000","last_became_active":"2023-10-14T19:11:51.543014+0000","last_became_peered":"2023-10-14T19:11:51.543014+0000","last_unstale":"2023-10-14T19:11:51.549050+0000","last_undegraded":"2023-10-14T19:11:51.549050+0000","last_fullsized":"2023-10-14T19:11:51.549050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:07.704591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.543295+0000","last_change":"2023-10-14T19:11:51.543295+0000","last_active":"2023-10-14T19:11:51.543295+0000","last_peered":"2023-10-14T19:11:51.543295+0000","last_clean":"2023-10-14T19:11:51.543295+0000","last_became_active":"2023-10-14T19:11:51.543020+0000","last_became_peered":"2023-10-14T19:11:51.543020+0000","last_unstale":"2023-10-14T19:11:51.543295+0000","last_undegraded":"2023-10-14T19:11:51.543295+0000","last_fullsized":"2023-10-14T19:11:51.543295+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:21.581081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545583+0000","last_change":"2023-10-14T19:11:51.542846+0000","last_active":"2023-10-14T19:11:51.545583+0000","last_peered":"2023-10-14T19:11:51.545583+0000","last_clean":"2023-10-14T19:11:51.545583+0000","last_became_active":"2023-10-14T19:11:51.542563+0000","last_became_peered":"2023-10-14T19:11:51.542563+0000","last_unstale":"2023-10-14T19:11:51.545583+0000","last_undegraded":"2023-10-14T19:11:51.545583+0000","last_fullsized":"2023-10-14T19:11:51.545583+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:41.229089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540755+0000","last_change":"2023-10-14T19:11:51.540755+0000","last_active":"2023-10-14T19:11:51.540755+0000","last_peered":"2023-10-14T19:11:51.540755+0000","last_clean":"2023-10-14T19:11:51.540755+0000","last_became_active":"2023-10-14T19:11:51.540496+0000","last_became_peered":"2023-10-14T19:11:51.540496+0000","last_unstale":"2023-10-14T19:11:51.540755+0000","last_undegraded":"2023-10-14T19:11:51.540755+0000","last_fullsized":"2023-10-14T19:11:51.540755+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:56.098115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551625+0000","last_change":"2023-10-14T19:11:51.548619+0000","last_active":"2023-10-14T19:11:51.551625+0000","last_peered":"2023-10-14T19:11:51.551625+0000","last_clean":"2023-10-14T19:11:51.551625+0000","last_became_active":"2023-10-14T19:11:51.548152+0000","last_became_peered":"2023-10-14T19:11:51.548152+0000","last_unstale":"2023-10-14T19:11:51.551625+0000","last_undegraded":"2023-10-14T19:11:51.551625+0000","last_fullsized":"2023-10-14T19:11:51.551625+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:59.529350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.537853+0000","last_change":"2023-10-14T19:11:51.537853+0000","last_active":"2023-10-14T19:11:51.537853+0000","last_peered":"2023-10-14T19:11:51.537853+0000","last_clean":"2023-10-14T19:11:51.537853+0000","last_became_active":"2023-10-14T19:11:51.537411+0000","last_became_peered":"2023-10-14T19:11:51.537411+0000","last_unstale":"2023-10-14T19:11:51.537853+0000","last_undegraded":"2023-10-14T19:11:51.537853+0000","last_fullsized":"2023-10-14T19:11:51.537853+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:59.529350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547172+0000","last_change":"2023-10-14T19:11:51.547172+0000","last_active":"2023-10-14T19:11:51.547172+0000","last_peered":"2023-10-14T19:11:51.547172+0000","last_clean":"2023-10-14T19:11:51.547172+0000","last_became_active":"2023-10-14T19:11:51.546902+0000","last_became_peered":"2023-10-14T19:11:51.546902+0000","last_unstale":"2023-10-14T19:11:51.547172+0000","last_undegraded":"2023-10-14T19:11:51.547172+0000","last_fullsized":"2023-10-14T19:11:51.547172+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.965919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.541741+0000","last_change":"2023-10-14T19:11:51.541741+0000","last_active":"2023-10-14T19:11:51.541741+0000","last_peered":"2023-10-14T19:11:51.541741+0000","last_clean":"2023-10-14T19:11:51.541741+0000","last_became_active":"2023-10-14T19:11:51.541004+0000","last_became_peered":"2023-10-14T19:11:51.541004+0000","last_unstale":"2023-10-14T19:11:51.541741+0000","last_undegraded":"2023-10-14T19:11:51.541741+0000","last_fullsized":"2023-10-14T19:11:51.541741+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:07.916623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551739+0000","last_change":"2023-10-14T19:11:51.549475+0000","last_active":"2023-10-14T19:11:51.551739+0000","last_peered":"2023-10-14T19:11:51.551739+0000","last_clean":"2023-10-14T19:11:51.551739+0000","last_became_active":"2023-10-14T19:11:51.549035+0000","last_became_peered":"2023-10-14T19:11:51.549035+0000","last_unstale":"2023-10-14T19:11:51.551739+0000","last_undegraded":"2023-10-14T19:11:51.551739+0000","last_fullsized":"2023-10-14T19:11:51.551739+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.965919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547954+0000","last_change":"2023-10-14T19:11:51.547954+0000","last_active":"2023-10-14T19:11:51.547954+0000","last_peered":"2023-10-14T19:11:51.547954+0000","last_clean":"2023-10-14T19:11:51.547954+0000","last_became_active":"2023-10-14T19:11:51.547699+0000","last_became_peered":"2023-10-14T19:11:51.547699+0000","last_unstale":"2023-10-14T19:11:51.547954+0000","last_undegraded":"2023-10-14T19:11:51.547954+0000","last_fullsized":"2023-10-14T19:11:51.547954+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:48:00.322829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552794+0000","last_change":"2023-10-14T19:11:50.542261+0000","last_active":"2023-10-14T19:11:51.552794+0000","last_peered":"2023-10-14T19:11:51.552794+0000","last_clean":"2023-10-14T19:11:51.552794+0000","last_became_active":"2023-10-14T19:11:50.541924+0000","last_became_peered":"2023-10-14T19:11:50.541924+0000","last_unstale":"2023-10-14T19:11:51.552794+0000","last_undegraded":"2023-10-14T19:11:51.552794+0000","last_fullsized":"2023-10-14T19:11:51.552794+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:50.208104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547351+0000","last_change":"2023-10-14T19:11:51.547351+0000","last_active":"2023-10-14T19:11:51.547351+0000","last_peered":"2023-10-14T19:11:51.547351+0000","last_clean":"2023-10-14T19:11:51.547351+0000","last_became_active":"2023-10-14T19:11:51.547027+0000","last_became_peered":"2023-10-14T19:11:51.547027+0000","last_unstale":"2023-10-14T19:11:51.547351+0000","last_undegraded":"2023-10-14T19:11:51.547351+0000","last_fullsized":"2023-10-14T19:11:51.547351+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:55:29.343677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.544238+0000","last_change":"2023-10-14T19:11:50.541543+0000","last_active":"2023-10-14T19:11:51.544238+0000","last_peered":"2023-10-14T19:11:51.544238+0000","last_clean":"2023-10-14T19:11:51.544238+0000","last_became_active":"2023-10-14T19:11:50.541232+0000","last_became_peered":"2023-10-14T19:11:50.541232+0000","last_unstale":"2023-10-14T19:11:51.544238+0000","last_undegraded":"2023-10-14T19:11:51.544238+0000","last_fullsized":"2023-10-14T19:11:51.544238+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:53.070640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.550004+0000","last_change":"2023-10-14T19:11:51.545322+0000","last_active":"2023-10-14T19:11:51.550004+0000","last_peered":"2023-10-14T19:11:51.550004+0000","last_clean":"2023-10-14T19:11:51.550004+0000","last_became_active":"2023-10-14T19:11:51.545067+0000","last_became_peered":"2023-10-14T19:11:51.545067+0000","last_unstale":"2023-10-14T19:11:51.550004+0000","last_undegraded":"2023-10-14T19:11:51.550004+0000","last_fullsized":"2023-10-14T19:11:51.550004+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.301073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.550362+0000","last_change":"2023-10-14T19:11:50.538318+0000","last_active":"2023-10-14T19:11:51.550362+0000","last_peered":"2023-10-14T19:11:51.550362+0000","last_clean":"2023-10-14T19:11:51.550362+0000","last_became_active":"2023-10-14T19:11:50.537029+0000","last_became_peered":"2023-10-14T19:11:50.537029+0000","last_unstale":"2023-10-14T19:11:51.550362+0000","last_undegraded":"2023-10-14T19:11:51.550362+0000","last_fullsized":"2023-10-14T19:11:51.550362+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:53:40.608507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.537694+0000","last_change":"2023-10-14T19:11:51.537694+0000","last_active":"2023-10-14T19:11:51.537694+0000","last_peered":"2023-10-14T19:11:51.537694+0000","last_clean":"2023-10-14T19:11:51.537694+0000","last_became_active":"2023-10-14T19:11:51.537302+0000","last_became_peered":"2023-10-14T19:11:51.537302+0000","last_unstale":"2023-10-14T19:11:51.537694+0000","last_undegraded":"2023-10-14T19:11:51.537694+0000","last_fullsized":"2023-10-14T19:11:51.537694+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:00.515462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"182'1","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.537873+0000","last_change":"2023-10-14T19:11:50.538640+0000","last_active":"2023-10-14T19:11:51.537873+0000","last_peered":"2023-10-14T19:11:51.537873+0000","last_clean":"2023-10-14T19:11:51.537873+0000","last_became_active":"2023-10-14T19:11:50.538355+0000","last_became_peered":"2023-10-14T19:11:50.538355+0000","last_unstale":"2023-10-14T19:11:51.537873+0000","last_undegraded":"2023-10-14T19:11:51.537873+0000","last_fullsized":"2023-10-14T19:11:51.537873+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:04:42.493440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.546326+0000","last_change":"2023-10-14T19:11:51.544570+0000","last_active":"2023-10-14T19:11:51.546326+0000","last_peered":"2023-10-14T19:11:51.546326+0000","last_clean":"2023-10-14T19:11:51.546326+0000","last_became_active":"2023-10-14T19:11:51.543736+0000","last_became_peered":"2023-10-14T19:11:51.543736+0000","last_unstale":"2023-10-14T19:11:51.546326+0000","last_undegraded":"2023-10-14T19:11:51.546326+0000","last_fullsized":"2023-10-14T19:11:51.546326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:18.692905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.529921+0000","last_change":"2023-10-14T19:11:50.538090+0000","last_active":"2023-10-14T19:11:51.529921+0000","last_peered":"2023-10-14T19:11:51.529921+0000","last_clean":"2023-10-14T19:11:51.529921+0000","last_became_active":"2023-10-14T19:11:50.537808+0000","last_became_peered":"2023-10-14T19:11:50.537808+0000","last_unstale":"2023-10-14T19:11:51.529921+0000","last_undegraded":"2023-10-14T19:11:51.529921+0000","last_fullsized":"2023-10-14T19:11:51.529921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:07:10.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540243+0000","last_change":"2023-10-14T19:11:51.540243+0000","last_active":"2023-10-14T19:11:51.540243+0000","last_peered":"2023-10-14T19:11:51.540243+0000","last_clean":"2023-10-14T19:11:51.540243+0000","last_became_active":"2023-10-14T19:11:51.538966+0000","last_became_peered":"2023-10-14T19:11:51.538966+0000","last_unstale":"2023-10-14T19:11:51.540243+0000","last_undegraded":"2023-10-14T19:11:51.540243+0000","last_fullsized":"2023-10-14T19:11:51.540243+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:23:02.068350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.546233+0000","last_change":"2023-10-14T19:11:50.538815+0000","last_active":"2023-10-14T19:11:50.546233+0000","last_peered":"2023-10-14T19:11:50.546233+0000","last_clean":"2023-10-14T19:11:50.546233+0000","last_became_active":"2023-10-14T19:11:50.538465+0000","last_became_peered":"2023-10-14T19:11:50.538465+0000","last_unstale":"2023-10-14T19:11:50.546233+0000","last_undegraded":"2023-10-14T19:11:50.546233+0000","last_fullsized":"2023-10-14T19:11:50.546233+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:46.757117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539726+0000","last_change":"2023-10-14T19:11:51.539726+0000","last_active":"2023-10-14T19:11:51.539726+0000","last_peered":"2023-10-14T19:11:51.539726+0000","last_clean":"2023-10-14T19:11:51.539726+0000","last_became_active":"2023-10-14T19:11:51.539387+0000","last_became_peered":"2023-10-14T19:11:51.539387+0000","last_unstale":"2023-10-14T19:11:51.539726+0000","last_undegraded":"2023-10-14T19:11:51.539726+0000","last_fullsized":"2023-10-14T19:11:51.539726+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:47.761897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.534961+0000","last_change":"2023-10-14T19:11:50.539131+0000","last_active":"2023-10-14T19:11:51.534961+0000","last_peered":"2023-10-14T19:11:51.534961+0000","last_clean":"2023-10-14T19:11:51.534961+0000","last_became_active":"2023-10-14T19:11:50.538883+0000","last_became_peered":"2023-10-14T19:11:50.538883+0000","last_unstale":"2023-10-14T19:11:51.534961+0000","last_undegraded":"2023-10-14T19:11:51.534961+0000","last_fullsized":"2023-10-14T19:11:51.534961+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:08.705529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545454+0000","last_change":"2023-10-14T19:11:51.541719+0000","last_active":"2023-10-14T19:11:51.545454+0000","last_peered":"2023-10-14T19:11:51.545454+0000","last_clean":"2023-10-14T19:11:51.545454+0000","last_became_active":"2023-10-14T19:11:51.541089+0000","last_became_peered":"2023-10-14T19:11:51.541089+0000","last_unstale":"2023-10-14T19:11:51.545454+0000","last_undegraded":"2023-10-14T19:11:51.545454+0000","last_fullsized":"2023-10-14T19:11:51.545454+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:56.763057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.543541+0000","last_change":"2023-10-14T19:11:50.540323+0000","last_active":"2023-10-14T19:11:50.543541+0000","last_peered":"2023-10-14T19:11:50.543541+0000","last_clean":"2023-10-14T19:11:50.543541+0000","last_became_active":"2023-10-14T19:11:50.539984+0000","last_became_peered":"2023-10-14T19:11:50.539984+0000","last_unstale":"2023-10-14T19:11:50.543541+0000","last_undegraded":"2023-10-14T19:11:50.543541+0000","last_fullsized":"2023-10-14T19:11:50.543541+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:16.309693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549821+0000","last_change":"2023-10-14T19:11:51.548343+0000","last_active":"2023-10-14T19:11:51.549821+0000","last_peered":"2023-10-14T19:11:51.549821+0000","last_clean":"2023-10-14T19:11:51.549821+0000","last_became_active":"2023-10-14T19:11:51.547780+0000","last_became_peered":"2023-10-14T19:11:51.547780+0000","last_unstale":"2023-10-14T19:11:51.549821+0000","last_undegraded":"2023-10-14T19:11:51.549821+0000","last_fullsized":"2023-10-14T19:11:51.549821+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:53.042570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.546274+0000","last_change":"2023-10-14T19:11:50.539688+0000","last_active":"2023-10-14T19:11:50.546274+0000","last_peered":"2023-10-14T19:11:50.546274+0000","last_clean":"2023-10-14T19:11:50.546274+0000","last_became_active":"2023-10-14T19:11:50.539417+0000","last_became_peered":"2023-10-14T19:11:50.539417+0000","last_unstale":"2023-10-14T19:11:50.546274+0000","last_undegraded":"2023-10-14T19:11:50.546274+0000","last_fullsized":"2023-10-14T19:11:50.546274+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:53.166088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545613+0000","last_change":"2023-10-14T19:11:51.545613+0000","last_active":"2023-10-14T19:11:51.545613+0000","last_peered":"2023-10-14T19:11:51.545613+0000","last_clean":"2023-10-14T19:11:51.545613+0000","last_became_active":"2023-10-14T19:11:51.545322+0000","last_became_peered":"2023-10-14T19:11:51.545322+0000","last_unstale":"2023-10-14T19:11:51.545613+0000","last_undegraded":"2023-10-14T19:11:51.545613+0000","last_fullsized":"2023-10-14T19:11:51.545613+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:55:29.343677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"182'3","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.548656+0000","last_change":"2023-10-14T19:11:50.538819+0000","last_active":"2023-10-14T19:11:51.548656+0000","last_peered":"2023-10-14T19:11:51.548656+0000","last_clean":"2023-10-14T19:11:51.548656+0000","last_became_active":"2023-10-14T19:11:50.538408+0000","last_became_peered":"2023-10-14T19:11:50.538408+0000","last_unstale":"2023-10-14T19:11:51.548656+0000","last_undegraded":"2023-10-14T19:11:51.548656+0000","last_fullsized":"2023-10-14T19:11:51.548656+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:09.636368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545938+0000","last_change":"2023-10-14T19:11:51.543427+0000","last_active":"2023-10-14T19:11:51.545938+0000","last_peered":"2023-10-14T19:11:51.545938+0000","last_clean":"2023-10-14T19:11:51.545938+0000","last_became_active":"2023-10-14T19:11:51.543184+0000","last_became_peered":"2023-10-14T19:11:51.543184+0000","last_unstale":"2023-10-14T19:11:51.545938+0000","last_undegraded":"2023-10-14T19:11:51.545938+0000","last_fullsized":"2023-10-14T19:11:51.545938+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:08.781009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.555822+0000","last_change":"2023-10-14T19:11:50.543989+0000","last_active":"2023-10-14T19:11:51.555822+0000","last_peered":"2023-10-14T19:11:51.555822+0000","last_clean":"2023-10-14T19:11:51.555822+0000","last_became_active":"2023-10-14T19:11:50.543681+0000","last_became_peered":"2023-10-14T19:11:50.543681+0000","last_unstale":"2023-10-14T19:11:51.555822+0000","last_undegraded":"2023-10-14T19:11:51.555822+0000","last_fullsized":"2023-10-14T19:11:51.555822+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:17.949601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.542662+0000","last_change":"2023-10-14T19:11:51.542662+0000","last_active":"2023-10-14T19:11:51.542662+0000","last_peered":"2023-10-14T19:11:51.542662+0000","last_clean":"2023-10-14T19:11:51.542662+0000","last_became_active":"2023-10-14T19:11:51.542155+0000","last_became_peered":"2023-10-14T19:11:51.542155+0000","last_unstale":"2023-10-14T19:11:51.542662+0000","last_undegraded":"2023-10-14T19:11:51.542662+0000","last_fullsized":"2023-10-14T19:11:51.542662+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:39:37.388084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.546426+0000","last_change":"2023-10-14T19:11:50.541874+0000","last_active":"2023-10-14T19:11:51.546426+0000","last_peered":"2023-10-14T19:11:51.546426+0000","last_clean":"2023-10-14T19:11:51.546426+0000","last_became_active":"2023-10-14T19:11:50.541676+0000","last_became_peered":"2023-10-14T19:11:50.541676+0000","last_unstale":"2023-10-14T19:11:51.546426+0000","last_undegraded":"2023-10-14T19:11:51.546426+0000","last_fullsized":"2023-10-14T19:11:51.546426+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:35:01.075297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545563+0000","last_change":"2023-10-14T19:11:51.542303+0000","last_active":"2023-10-14T19:11:51.545563+0000","last_peered":"2023-10-14T19:11:51.545563+0000","last_clean":"2023-10-14T19:11:51.545563+0000","last_became_active":"2023-10-14T19:11:51.542040+0000","last_became_peered":"2023-10-14T19:11:51.542040+0000","last_unstale":"2023-10-14T19:11:51.545563+0000","last_undegraded":"2023-10-14T19:11:51.545563+0000","last_fullsized":"2023-10-14T19:11:51.545563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:25.872209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.540169+0000","last_change":"2023-10-14T19:11:50.537868+0000","last_active":"2023-10-14T19:11:50.540169+0000","last_peered":"2023-10-14T19:11:50.540169+0000","last_clean":"2023-10-14T19:11:50.540169+0000","last_became_active":"2023-10-14T19:11:50.537577+0000","last_became_peered":"2023-10-14T19:11:50.537577+0000","last_unstale":"2023-10-14T19:11:50.540169+0000","last_undegraded":"2023-10-14T19:11:50.540169+0000","last_fullsized":"2023-10-14T19:11:50.540169+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:41.646057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.550786+0000","last_change":"2023-10-14T19:11:51.550786+0000","last_active":"2023-10-14T19:11:51.550786+0000","last_peered":"2023-10-14T19:11:51.550786+0000","last_clean":"2023-10-14T19:11:51.550786+0000","last_became_active":"2023-10-14T19:11:51.550386+0000","last_became_peered":"2023-10-14T19:11:51.550386+0000","last_unstale":"2023-10-14T19:11:51.550786+0000","last_undegraded":"2023-10-14T19:11:51.550786+0000","last_fullsized":"2023-10-14T19:11:51.550786+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:02.607310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.540242+0000","last_change":"2023-10-14T19:11:50.539501+0000","last_active":"2023-10-14T19:11:50.540242+0000","last_peered":"2023-10-14T19:11:50.540242+0000","last_clean":"2023-10-14T19:11:50.540242+0000","last_became_active":"2023-10-14T19:11:50.538817+0000","last_became_peered":"2023-10-14T19:11:50.538817+0000","last_unstale":"2023-10-14T19:11:50.540242+0000","last_undegraded":"2023-10-14T19:11:50.540242+0000","last_fullsized":"2023-10-14T19:11:50.540242+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:52.037790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.536963+0000","last_change":"2023-10-14T19:11:51.536963+0000","last_active":"2023-10-14T19:11:51.536963+0000","last_peered":"2023-10-14T19:11:51.536963+0000","last_clean":"2023-10-14T19:11:51.536963+0000","last_became_active":"2023-10-14T19:11:51.536691+0000","last_became_peered":"2023-10-14T19:11:51.536691+0000","last_unstale":"2023-10-14T19:11:51.536963+0000","last_undegraded":"2023-10-14T19:11:51.536963+0000","last_fullsized":"2023-10-14T19:11:51.536963+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:29:15.938156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":17,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552349+0000","last_change":"2023-10-14T19:11:50.544584+0000","last_active":"2023-10-14T19:11:51.552349+0000","last_peered":"2023-10-14T19:11:51.552349+0000","last_clean":"2023-10-14T19:11:51.552349+0000","last_became_active":"2023-10-14T19:11:50.544368+0000","last_became_peered":"2023-10-14T19:11:50.544368+0000","last_unstale":"2023-10-14T19:11:51.552349+0000","last_undegraded":"2023-10-14T19:11:51.552349+0000","last_fullsized":"2023-10-14T19:11:51.552349+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:43.101800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539685+0000","last_change":"2023-10-14T19:11:51.539685+0000","last_active":"2023-10-14T19:11:51.539685+0000","last_peered":"2023-10-14T19:11:51.539685+0000","last_clean":"2023-10-14T19:11:51.539685+0000","last_became_active":"2023-10-14T19:11:51.539403+0000","last_became_peered":"2023-10-14T19:11:51.539403+0000","last_unstale":"2023-10-14T19:11:51.539685+0000","last_undegraded":"2023-10-14T19:11:51.539685+0000","last_fullsized":"2023-10-14T19:11:51.539685+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:17:17.430196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549193+0000","last_change":"2023-10-14T19:11:50.537584+0000","last_active":"2023-10-14T19:11:51.549193+0000","last_peered":"2023-10-14T19:11:51.549193+0000","last_clean":"2023-10-14T19:11:51.549193+0000","last_became_active":"2023-10-14T19:11:50.537288+0000","last_became_peered":"2023-10-14T19:11:50.537288+0000","last_unstale":"2023-10-14T19:11:51.549193+0000","last_undegraded":"2023-10-14T19:11:51.549193+0000","last_fullsized":"2023-10-14T19:11:51.549193+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:18:54.410881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.538880+0000","last_change":"2023-10-14T19:11:51.538880+0000","last_active":"2023-10-14T19:11:51.538880+0000","last_peered":"2023-10-14T19:11:51.538880+0000","last_clean":"2023-10-14T19:11:51.538880+0000","last_became_active":"2023-10-14T19:11:51.538570+0000","last_became_peered":"2023-10-14T19:11:51.538570+0000","last_unstale":"2023-10-14T19:11:51.538880+0000","last_undegraded":"2023-10-14T19:11:51.538880+0000","last_fullsized":"2023-10-14T19:11:51.538880+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:05.730721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549355+0000","last_change":"2023-10-14T19:11:50.535312+0000","last_active":"2023-10-14T19:11:51.549355+0000","last_peered":"2023-10-14T19:11:51.549355+0000","last_clean":"2023-10-14T19:11:51.549355+0000","last_became_active":"2023-10-14T19:11:50.535037+0000","last_became_peered":"2023-10-14T19:11:50.535037+0000","last_unstale":"2023-10-14T19:11:51.549355+0000","last_undegraded":"2023-10-14T19:11:51.549355+0000","last_fullsized":"2023-10-14T19:11:51.549355+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:02.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545466+0000","last_change":"2023-10-14T19:11:51.545466+0000","last_active":"2023-10-14T19:11:51.545466+0000","last_peered":"2023-10-14T19:11:51.545466+0000","last_clean":"2023-10-14T19:11:51.545466+0000","last_became_active":"2023-10-14T19:11:51.545190+0000","last_became_peered":"2023-10-14T19:11:51.545190+0000","last_unstale":"2023-10-14T19:11:51.545466+0000","last_undegraded":"2023-10-14T19:11:51.545466+0000","last_fullsized":"2023-10-14T19:11:51.545466+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:13.716481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545275+0000","last_change":"2023-10-14T19:11:50.541049+0000","last_active":"2023-10-14T19:11:51.545275+0000","last_peered":"2023-10-14T19:11:51.545275+0000","last_clean":"2023-10-14T19:11:51.545275+0000","last_became_active":"2023-10-14T19:11:50.540740+0000","last_became_peered":"2023-10-14T19:11:50.540740+0000","last_unstale":"2023-10-14T19:11:51.545275+0000","last_undegraded":"2023-10-14T19:11:51.545275+0000","last_fullsized":"2023-10-14T19:11:51.545275+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:53.468771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545016+0000","last_change":"2023-10-14T19:11:51.545016+0000","last_active":"2023-10-14T19:11:51.545016+0000","last_peered":"2023-10-14T19:11:51.545016+0000","last_clean":"2023-10-14T19:11:51.545016+0000","last_became_active":"2023-10-14T19:11:51.544764+0000","last_became_peered":"2023-10-14T19:11:51.544764+0000","last_unstale":"2023-10-14T19:11:51.545016+0000","last_undegraded":"2023-10-14T19:11:51.545016+0000","last_fullsized":"2023-10-14T19:11:51.545016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:18:55.415661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.537955+0000","last_change":"2023-10-14T19:11:50.535225+0000","last_active":"2023-10-14T19:11:50.537955+0000","last_peered":"2023-10-14T19:11:50.537955+0000","last_clean":"2023-10-14T19:11:50.537955+0000","last_became_active":"2023-10-14T19:11:50.534943+0000","last_became_peered":"2023-10-14T19:11:50.534943+0000","last_unstale":"2023-10-14T19:11:50.537955+0000","last_undegraded":"2023-10-14T19:11:50.537955+0000","last_fullsized":"2023-10-14T19:11:50.537955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:01.673379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540024+0000","last_change":"2023-10-14T19:11:51.540024+0000","last_active":"2023-10-14T19:11:51.540024+0000","last_peered":"2023-10-14T19:11:51.540024+0000","last_clean":"2023-10-14T19:11:51.540024+0000","last_became_active":"2023-10-14T19:11:51.539537+0000","last_became_peered":"2023-10-14T19:11:51.539537+0000","last_unstale":"2023-10-14T19:11:51.540024+0000","last_undegraded":"2023-10-14T19:11:51.540024+0000","last_fullsized":"2023-10-14T19:11:51.540024+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:02.607310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551508+0000","last_change":"2023-10-14T19:11:50.544967+0000","last_active":"2023-10-14T19:11:51.551508+0000","last_peered":"2023-10-14T19:11:51.551508+0000","last_clean":"2023-10-14T19:11:51.551508+0000","last_became_active":"2023-10-14T19:11:50.544561+0000","last_became_peered":"2023-10-14T19:11:50.544561+0000","last_unstale":"2023-10-14T19:11:51.551508+0000","last_undegraded":"2023-10-14T19:11:51.551508+0000","last_fullsized":"2023-10-14T19:11:51.551508+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:39:51.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.542812+0000","last_change":"2023-10-14T19:11:51.542812+0000","last_active":"2023-10-14T19:11:51.542812+0000","last_peered":"2023-10-14T19:11:51.542812+0000","last_clean":"2023-10-14T19:11:51.542812+0000","last_became_active":"2023-10-14T19:11:51.542557+0000","last_became_peered":"2023-10-14T19:11:51.542557+0000","last_unstale":"2023-10-14T19:11:51.542812+0000","last_undegraded":"2023-10-14T19:11:51.542812+0000","last_fullsized":"2023-10-14T19:11:51.542812+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:25.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.530023+0000","last_change":"2023-10-14T19:11:50.541708+0000","last_active":"2023-10-14T19:11:51.530023+0000","last_peered":"2023-10-14T19:11:51.530023+0000","last_clean":"2023-10-14T19:11:51.530023+0000","last_became_active":"2023-10-14T19:11:50.541394+0000","last_became_peered":"2023-10-14T19:11:50.541394+0000","last_unstale":"2023-10-14T19:11:51.530023+0000","last_undegraded":"2023-10-14T19:11:51.530023+0000","last_fullsized":"2023-10-14T19:11:51.530023+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:38:47.880360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549071+0000","last_change":"2023-10-14T19:11:51.546721+0000","last_active":"2023-10-14T19:11:51.549071+0000","last_peered":"2023-10-14T19:11:51.549071+0000","last_clean":"2023-10-14T19:11:51.549071+0000","last_became_active":"2023-10-14T19:11:51.546448+0000","last_became_peered":"2023-10-14T19:11:51.546448+0000","last_unstale":"2023-10-14T19:11:51.549071+0000","last_undegraded":"2023-10-14T19:11:51.549071+0000","last_fullsized":"2023-10-14T19:11:51.549071+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:48.517956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.530106+0000","last_change":"2023-10-14T19:11:50.532923+0000","last_active":"2023-10-14T19:11:51.530106+0000","last_peered":"2023-10-14T19:11:51.530106+0000","last_clean":"2023-10-14T19:11:51.530106+0000","last_became_active":"2023-10-14T19:11:50.532603+0000","last_became_peered":"2023-10-14T19:11:50.532603+0000","last_unstale":"2023-10-14T19:11:51.530106+0000","last_undegraded":"2023-10-14T19:11:51.530106+0000","last_fullsized":"2023-10-14T19:11:51.530106+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:24:24.098191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549503+0000","last_change":"2023-10-14T19:11:51.544573+0000","last_active":"2023-10-14T19:11:51.549503+0000","last_peered":"2023-10-14T19:11:51.549503+0000","last_clean":"2023-10-14T19:11:51.549503+0000","last_became_active":"2023-10-14T19:11:51.544323+0000","last_became_peered":"2023-10-14T19:11:51.544323+0000","last_unstale":"2023-10-14T19:11:51.549503+0000","last_undegraded":"2023-10-14T19:11:51.549503+0000","last_fullsized":"2023-10-14T19:11:51.549503+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:41.229089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.543444+0000","last_change":"2023-10-14T19:11:50.539481+0000","last_active":"2023-10-14T19:11:50.543444+0000","last_peered":"2023-10-14T19:11:50.543444+0000","last_clean":"2023-10-14T19:11:50.543444+0000","last_became_active":"2023-10-14T19:11:50.537708+0000","last_became_peered":"2023-10-14T19:11:50.537708+0000","last_unstale":"2023-10-14T19:11:50.543444+0000","last_undegraded":"2023-10-14T19:11:50.543444+0000","last_fullsized":"2023-10-14T19:11:50.543444+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:17.949601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545478+0000","last_change":"2023-10-14T19:11:51.541886+0000","last_active":"2023-10-14T19:11:51.545478+0000","last_peered":"2023-10-14T19:11:51.545478+0000","last_clean":"2023-10-14T19:11:51.545478+0000","last_became_active":"2023-10-14T19:11:51.541456+0000","last_became_peered":"2023-10-14T19:11:51.541456+0000","last_unstale":"2023-10-14T19:11:51.545478+0000","last_undegraded":"2023-10-14T19:11:51.545478+0000","last_fullsized":"2023-10-14T19:11:51.545478+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:56.274082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552285+0000","last_change":"2023-10-14T19:11:50.540305+0000","last_active":"2023-10-14T19:11:51.552285+0000","last_peered":"2023-10-14T19:11:51.552285+0000","last_clean":"2023-10-14T19:11:51.552285+0000","last_became_active":"2023-10-14T19:11:50.539703+0000","last_became_peered":"2023-10-14T19:11:50.539703+0000","last_unstale":"2023-10-14T19:11:51.552285+0000","last_undegraded":"2023-10-14T19:11:51.552285+0000","last_fullsized":"2023-10-14T19:11:51.552285+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:49:12.170792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549812+0000","last_change":"2023-10-14T19:11:51.549812+0000","last_active":"2023-10-14T19:11:51.549812+0000","last_peered":"2023-10-14T19:11:51.549812+0000","last_clean":"2023-10-14T19:11:51.549812+0000","last_became_active":"2023-10-14T19:11:51.549178+0000","last_became_peered":"2023-10-14T19:11:51.549178+0000","last_unstale":"2023-10-14T19:11:51.549812+0000","last_undegraded":"2023-10-14T19:11:51.549812+0000","last_fullsized":"2023-10-14T19:11:51.549812+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:06.056088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.540150+0000","last_change":"2023-10-14T19:11:50.538001+0000","last_active":"2023-10-14T19:11:50.540150+0000","last_peered":"2023-10-14T19:11:50.540150+0000","last_clean":"2023-10-14T19:11:50.540150+0000","last_became_active":"2023-10-14T19:11:50.537731+0000","last_became_peered":"2023-10-14T19:11:50.537731+0000","last_unstale":"2023-10-14T19:11:50.540150+0000","last_undegraded":"2023-10-14T19:11:50.540150+0000","last_fullsized":"2023-10-14T19:11:50.540150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:37.764225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.541238+0000","last_change":"2023-10-14T19:11:51.541238+0000","last_active":"2023-10-14T19:11:51.541238+0000","last_peered":"2023-10-14T19:11:51.541238+0000","last_clean":"2023-10-14T19:11:51.541238+0000","last_became_active":"2023-10-14T19:11:51.540940+0000","last_became_peered":"2023-10-14T19:11:51.540940+0000","last_unstale":"2023-10-14T19:11:51.541238+0000","last_undegraded":"2023-10-14T19:11:51.541238+0000","last_fullsized":"2023-10-14T19:11:51.541238+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:48.938544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.544160+0000","last_change":"2023-10-14T19:11:50.542021+0000","last_active":"2023-10-14T19:11:50.544160+0000","last_peered":"2023-10-14T19:11:50.544160+0000","last_clean":"2023-10-14T19:11:50.544160+0000","last_became_active":"2023-10-14T19:11:50.541770+0000","last_became_peered":"2023-10-14T19:11:50.541770+0000","last_unstale":"2023-10-14T19:11:50.544160+0000","last_undegraded":"2023-10-14T19:11:50.544160+0000","last_fullsized":"2023-10-14T19:11:50.544160+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:07:16.679329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.541883+0000","last_change":"2023-10-14T19:11:51.541883+0000","last_active":"2023-10-14T19:11:51.541883+0000","last_peered":"2023-10-14T19:11:51.541883+0000","last_clean":"2023-10-14T19:11:51.541883+0000","last_became_active":"2023-10-14T19:11:51.541544+0000","last_became_peered":"2023-10-14T19:11:51.541544+0000","last_unstale":"2023-10-14T19:11:51.541883+0000","last_undegraded":"2023-10-14T19:11:51.541883+0000","last_fullsized":"2023-10-14T19:11:51.541883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:12.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.543236+0000","last_change":"2023-10-14T19:11:50.539177+0000","last_active":"2023-10-14T19:11:50.543236+0000","last_peered":"2023-10-14T19:11:50.543236+0000","last_clean":"2023-10-14T19:11:50.543236+0000","last_became_active":"2023-10-14T19:11:50.538610+0000","last_became_peered":"2023-10-14T19:11:50.538610+0000","last_unstale":"2023-10-14T19:11:50.543236+0000","last_undegraded":"2023-10-14T19:11:50.543236+0000","last_fullsized":"2023-10-14T19:11:50.543236+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:01.465254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.542292+0000","last_change":"2023-10-14T19:11:51.542292+0000","last_active":"2023-10-14T19:11:51.542292+0000","last_peered":"2023-10-14T19:11:51.542292+0000","last_clean":"2023-10-14T19:11:51.542292+0000","last_became_active":"2023-10-14T19:11:51.542007+0000","last_became_peered":"2023-10-14T19:11:51.542007+0000","last_unstale":"2023-10-14T19:11:51.542292+0000","last_undegraded":"2023-10-14T19:11:51.542292+0000","last_fullsized":"2023-10-14T19:11:51.542292+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.301073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.531430+0000","last_change":"2023-10-14T19:11:50.541666+0000","last_active":"2023-10-14T19:11:51.531430+0000","last_peered":"2023-10-14T19:11:51.531430+0000","last_clean":"2023-10-14T19:11:51.531430+0000","last_became_active":"2023-10-14T19:11:50.541344+0000","last_became_peered":"2023-10-14T19:11:50.541344+0000","last_unstale":"2023-10-14T19:11:51.531430+0000","last_undegraded":"2023-10-14T19:11:51.531430+0000","last_fullsized":"2023-10-14T19:11:51.531430+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:48.632072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551658+0000","last_change":"2023-10-14T19:11:51.549396+0000","last_active":"2023-10-14T19:11:51.551658+0000","last_peered":"2023-10-14T19:11:51.551658+0000","last_clean":"2023-10-14T19:11:51.551658+0000","last_became_active":"2023-10-14T19:11:51.549069+0000","last_became_peered":"2023-10-14T19:11:51.549069+0000","last_unstale":"2023-10-14T19:11:51.551658+0000","last_undegraded":"2023-10-14T19:11:51.551658+0000","last_fullsized":"2023-10-14T19:11:51.551658+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:58.211528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.537470+0000","last_change":"2023-10-14T19:11:50.535461+0000","last_active":"2023-10-14T19:11:50.537470+0000","last_peered":"2023-10-14T19:11:50.537470+0000","last_clean":"2023-10-14T19:11:50.537470+0000","last_became_active":"2023-10-14T19:11:50.535197+0000","last_became_peered":"2023-10-14T19:11:50.535197+0000","last_unstale":"2023-10-14T19:11:50.537470+0000","last_undegraded":"2023-10-14T19:11:50.537470+0000","last_fullsized":"2023-10-14T19:11:50.537470+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:31.839855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547171+0000","last_change":"2023-10-14T19:11:51.547171+0000","last_active":"2023-10-14T19:11:51.547171+0000","last_peered":"2023-10-14T19:11:51.547171+0000","last_clean":"2023-10-14T19:11:51.547171+0000","last_became_active":"2023-10-14T19:11:51.546743+0000","last_became_peered":"2023-10-14T19:11:51.546743+0000","last_unstale":"2023-10-14T19:11:51.547171+0000","last_undegraded":"2023-10-14T19:11:51.547171+0000","last_fullsized":"2023-10-14T19:11:51.547171+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:08.115205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.546322+0000","last_change":"2023-10-14T19:11:50.540212+0000","last_active":"2023-10-14T19:11:50.546322+0000","last_peered":"2023-10-14T19:11:50.546322+0000","last_clean":"2023-10-14T19:11:50.546322+0000","last_became_active":"2023-10-14T19:11:50.539942+0000","last_became_peered":"2023-10-14T19:11:50.539942+0000","last_unstale":"2023-10-14T19:11:50.546322+0000","last_undegraded":"2023-10-14T19:11:50.546322+0000","last_fullsized":"2023-10-14T19:11:50.546322+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:55.093335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549538+0000","last_change":"2023-10-14T19:11:51.548079+0000","last_active":"2023-10-14T19:11:51.549538+0000","last_peered":"2023-10-14T19:11:51.549538+0000","last_clean":"2023-10-14T19:11:51.549538+0000","last_became_active":"2023-10-14T19:11:51.547787+0000","last_became_peered":"2023-10-14T19:11:51.547787+0000","last_unstale":"2023-10-14T19:11:51.549538+0000","last_undegraded":"2023-10-14T19:11:51.549538+0000","last_fullsized":"2023-10-14T19:11:51.549538+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:38.769005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.531600+0000","last_change":"2023-10-14T19:11:50.534643+0000","last_active":"2023-10-14T19:11:51.531600+0000","last_peered":"2023-10-14T19:11:51.531600+0000","last_clean":"2023-10-14T19:11:51.531600+0000","last_became_active":"2023-10-14T19:11:50.534423+0000","last_became_peered":"2023-10-14T19:11:50.534423+0000","last_unstale":"2023-10-14T19:11:51.531600+0000","last_undegraded":"2023-10-14T19:11:51.531600+0000","last_fullsized":"2023-10-14T19:11:51.531600+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:38.899830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.544900+0000","last_change":"2023-10-14T19:11:51.540303+0000","last_active":"2023-10-14T19:11:51.544900+0000","last_peered":"2023-10-14T19:11:51.544900+0000","last_clean":"2023-10-14T19:11:51.544900+0000","last_became_active":"2023-10-14T19:11:51.540048+0000","last_became_peered":"2023-10-14T19:11:51.540048+0000","last_unstale":"2023-10-14T19:11:51.544900+0000","last_undegraded":"2023-10-14T19:11:51.544900+0000","last_fullsized":"2023-10-14T19:11:51.544900+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:48:10.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.543919+0000","last_change":"2023-10-14T19:11:50.538101+0000","last_active":"2023-10-14T19:11:51.543919+0000","last_peered":"2023-10-14T19:11:51.543919+0000","last_clean":"2023-10-14T19:11:51.543919+0000","last_became_active":"2023-10-14T19:11:50.537817+0000","last_became_peered":"2023-10-14T19:11:50.537817+0000","last_unstale":"2023-10-14T19:11:51.543919+0000","last_undegraded":"2023-10-14T19:11:51.543919+0000","last_fullsized":"2023-10-14T19:11:51.543919+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:44.105766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":295,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.528360+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:50.528360+0000","last_peered":"2023-10-14T19:11:50.528360+0000","last_clean":"2023-10-14T19:11:50.528360+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:50.528360+0000","last_undegraded":"2023-10-14T19:11:50.528360+0000","last_fullsized":"2023-10-14T19:11:50.528360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304232,"kb_used_data":2848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067608,"statfs":{"total":96636764160,"available":96325230592,"internally_reserved":0,"allocated":2916352,"data_stored":1628242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.63800000000000001},"min":{"1min":0.35699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.60999999999999999,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.47199999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.64100000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.755,"15min":3.1480000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89600000000000002,"15min":3.23},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.73299999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74299999999999999,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.436},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.73499999999999999,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.55600000000000005},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.875,"15min":2.4620000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.66900000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.63600000000000001},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":2.883},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.64900000000000002},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":5.383},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1037862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.65800000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":5.6820000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.745,"5min":0.745,"15min":7.8680000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78900000000000003,"15min":8.0210000000000008},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.78500000000000003},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.745},"min":{"1min":0.379,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.76000000000000001},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":8.1120000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.437}]},{"osd":5,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.54700000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73599999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38200000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.58999999999999997},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.61899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1037750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32400000000000001,"15min":0.314},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63500000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.309},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.624,"15min":0.67300000000000004},"last":0.42099999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.216},"max":{"1min":0.45800000000000002,"5min":0.873,"15min":0.873},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.5},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":1.032},"last":0.375}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.57999999999999996},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.85699999999999998,"5min":1.627,"15min":1.627},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90100000000000002,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.91600000000000004,"15min":1.079},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.38800000000000001},"max":{"1min":0.746,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308332,"kb_used_data":2852,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063508,"statfs":{"total":96636764160,"available":96321032192,"internally_reserved":0,"allocated":2920448,"data_stored":1629654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.34399999999999997},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47599999999999998,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.495,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55400000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.62},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.29699999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77400000000000002,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.39200000000000002},"max":{"1min":0.90700000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.92200000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.96199999999999997,"15min":0.98799999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.51100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.91900000000000004,"15min":0.95599999999999996},"last":0.96299999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.501,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.88700000000000001,"15min":0.96599999999999997},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1038374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.45400000000000001,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.42499999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":0.65800000000000003,"15min":2.028},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53400000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38100000000000001,"15min":0.69099999999999995},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":11.269},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.66200000000000003},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":11.318},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59599999999999997,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.5},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.67200000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.94699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":11.379},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.95199999999999996},"min":{"1min":0.438,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":11.404},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.96499999999999997},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303668,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068172,"statfs":{"total":96636764160,"available":96325808128,"internally_reserved":0,"allocated":2338816,"data_stored":1039896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49099999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.38100000000000001},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32200000000000001,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":3.0699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54200000000000004,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.314},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.44700000000000001},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":2.597,"15min":2.597},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.214,"15min":1.214},"last":0.439}]},{"osd":6,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.133,"15min":1.133},"last":0.498},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.44800000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.752,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.379,"15min":0.379},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":0.997},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068192,"statfs":{"total":96636764160,"available":96325828608,"internally_reserved":0,"allocated":2318336,"data_stored":1037820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.53900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.752,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":1.589,"15min":1.589},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74299999999999999,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.61799999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48799999999999999,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64500000000000002,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.627,"5min":1.222,"15min":1.5269999999999999},"last":0.503}]},{"osd":6,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.65900000000000003,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.441},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.626},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57999999999999996,"15min":0.64000000000000001},"min":{"1min":0.42199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.38100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1044038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32700000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.83199999999999996,"5min":1.784,"15min":1.784},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.876},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.75900000000000001},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.88100000000000001,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.437}]},{"osd":3,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.35799999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.497}]},{"osd":7,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":1.008,"15min":1.008},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:55.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:11:55.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.793+0000 7fbd5b6de700 1 Processor -- start 2023-10-14T19:11:55.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.793+0000 7fbd5b6de700 1 -- start start 2023-10-14T19:11:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd5b6de700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd541598b0 0x7fbd540af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd5b6de700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbd54159c80 0x7fbd540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd5b6de700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540ce9d0 con 0x7fbd540af790 2023-10-14T19:11:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd5b6de700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540afc30 con 0x7fbd54159c80 2023-10-14T19:11:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd5b6de700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540aff10 con 0x7fbd541598b0 2023-10-14T19:11:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbd54159c80 0x7fbd540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbd54159c80 0x7fbd540cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58156/0 (socket says 172.21.15.7:58156) 2023-10-14T19:11:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 -- 172.21.15.7:0/3883005865 learned_addr learned my addr 172.21.15.7:0/3883005865 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd5947a700 1 --2- 172.21.15.7:0/3883005865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd541598b0 0x7fbd540af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 -- 172.21.15.7:0/3883005865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd541598b0 msgr2=0x7fbd540af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 --2- 172.21.15.7:0/3883005865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd541598b0 0x7fbd540af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 -- 172.21.15.7:0/3883005865 >> v1:172.21.15.148:6789/0 conn(0x7fbd540af790 legacy=0x7fbd540cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 -- 172.21.15.7:0/3883005865 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540ce380 con 0x7fbd54159c80 2023-10-14T19:11:55.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd58c79700 1 --2- 172.21.15.7:0/3883005865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd540cb6f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fbd440099b0 tx=0x7fbd44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe9922dff529027 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd4bfff700 1 -- 172.21.15.7:0/3883005865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400b860 con 0x7fbd54159c80 2023-10-14T19:11:55.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd4bfff700 1 -- 172.21.15.7:0/3883005865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4400b9c0 con 0x7fbd54159c80 2023-10-14T19:11:55.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.794+0000 7fbd4bfff700 1 -- 172.21.15.7:0/3883005865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400bd60 con 0x7fbd54159c80 2023-10-14T19:11:55.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 -- 172.21.15.7:0/3883005865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 msgr2=0x7fbd540cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/3883005865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd540cb6f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fbd440099b0 tx=0x7fbd44009250 comp rx=0 tx=0).stop 2023-10-14T19:11:55.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 -- 172.21.15.7:0/3883005865 shutdown_connections 2023-10-14T19:11:55.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/3883005865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd541598b0 0x7fbd540af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/3883005865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd540cb6f0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 -- 172.21.15.7:0/3883005865 >> 172.21.15.7:0/3883005865 conn(0x7fbd54070e30 msgr2=0x7fbd540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:55.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 -- 172.21.15.7:0/3883005865 shutdown_connections 2023-10-14T19:11:55.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.795+0000 7fbd5b6de700 1 -- 172.21.15.7:0/3883005865 wait complete. 2023-10-14T19:11:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.796+0000 7fbd5b6de700 1 Processor -- start 2023-10-14T19:11:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.796+0000 7fbd5b6de700 1 -- start start 2023-10-14T19:11:55.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5b6de700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd540af790 0x7fbd5414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5b6de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd541598b0 0x7fbd540c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5b6de700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd5414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5b6de700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540b3820 con 0x7fbd54159c80 2023-10-14T19:11:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5b6de700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5414b940 con 0x7fbd541598b0 2023-10-14T19:11:55.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5b6de700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540c81a0 con 0x7fbd540af790 2023-10-14T19:11:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd5414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd5414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58158/0 (socket says 172.21.15.7:58158) 2023-10-14T19:11:55.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 -- 172.21.15.7:0/852272169 learned_addr learned my addr 172.21.15.7:0/852272169 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd5947a700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd540af790 0x7fbd5414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd58c79700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd541598b0 0x7fbd540c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 -- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd540af790 msgr2=0x7fbd5414b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd540af790 0x7fbd5414b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 -- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd541598b0 msgr2=0x7fbd540c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd541598b0 0x7fbd540c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.797+0000 7fbd59c7b700 1 -- 172.21.15.7:0/852272169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440094f0 con 0x7fbd54159c80 2023-10-14T19:11:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.798+0000 7fbd59c7b700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd5414cf50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c910 tx=0x7fbd4c0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.798+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00ce50 con 0x7fbd54159c80 2023-10-14T19:11:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.798+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c00a7e0 con 0x7fbd54159c80 2023-10-14T19:11:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.798+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540c8480 con 0x7fbd54159c80 2023-10-14T19:11:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.798+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00ab80 con 0x7fbd54159c80 2023-10-14T19:11:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.798+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd540b34b0 con 0x7fbd54159c80 2023-10-14T19:11:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.799+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd540b3990 con 0x7fbd54159c80 2023-10-14T19:11:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.799+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbd4c012420 con 0x7fbd54159c80 2023-10-14T19:11:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.799+0000 7fbd497fa700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd38067320 0x7fbd380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.800+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd4c084f20 con 0x7fbd54159c80 2023-10-14T19:11:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.800+0000 7fbd5947a700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd38067320 0x7fbd380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.800+0000 7fbd5947a700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd38067320 0x7fbd380697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbd50006fd0 tx=0x7fbd50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:55.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.804+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd4c051bb0 con 0x7fbd54159c80 2023-10-14T19:11:55.993 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:55.992+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd5404c3c0 con 0x7fbd38067320 2023-10-14T19:11:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.001+0000 7fbd497fa700 1 -- 172.21.15.7:0/852272169 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289764 (secure 0 0 0) 0x7fbd5404c3c0 con 0x7fbd38067320 2023-10-14T19:11:56.005 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd38067320 msgr2=0x7fbd380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd38067320 0x7fbd380697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbd50006fd0 tx=0x7fbd50008040 comp rx=0 tx=0).stop 2023-10-14T19:11:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 msgr2=0x7fbd5414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd5414cf50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c910 tx=0x7fbd4c0016b0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 shutdown_connections 2023-10-14T19:11:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbd38067320 0x7fbd380697d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd54159c80 0x7fbd5414cf50 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd540af790 0x7fbd5414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 --2- 172.21.15.7:0/852272169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd541598b0 0x7fbd540c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 >> 172.21.15.7:0/852272169 conn(0x7fbd54070e30 msgr2=0x7fbd5414e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 shutdown_connections 2023-10-14T19:11:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.004+0000 7fbd5b6de700 1 -- 172.21.15.7:0/852272169 wait complete. 2023-10-14T19:11:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:11:56.017 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2023-10-14T19:11:55.748637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438580,"kb_used_data":19316,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752536140,"statfs":{"total":773094113280,"available":770597007360,"internally_reserved":0,"allocated":19779584,"data_stored":9493636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001718"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549922+0000","last_change":"2023-10-14T19:11:51.543851+0000","last_active":"2023-10-14T19:11:51.549922+0000","last_peered":"2023-10-14T19:11:51.549922+0000","last_clean":"2023-10-14T19:11:51.549922+0000","last_became_active":"2023-10-14T19:11:51.543539+0000","last_became_peered":"2023-10-14T19:11:51.543539+0000","last_unstale":"2023-10-14T19:11:51.549922+0000","last_undegraded":"2023-10-14T19:11:51.549922+0000","last_fullsized":"2023-10-14T19:11:51.549922+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:46:46.050036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547003+0000","last_change":"2023-10-14T19:11:51.547003+0000","last_active":"2023-10-14T19:11:51.547003+0000","last_peered":"2023-10-14T19:11:51.547003+0000","last_clean":"2023-10-14T19:11:51.547003+0000","last_became_active":"2023-10-14T19:11:51.546392+0000","last_became_peered":"2023-10-14T19:11:51.546392+0000","last_unstale":"2023-10-14T19:11:51.547003+0000","last_undegraded":"2023-10-14T19:11:51.547003+0000","last_fullsized":"2023-10-14T19:11:51.547003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:25:42.067147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.544663+0000","last_change":"2023-10-14T19:11:51.544663+0000","last_active":"2023-10-14T19:11:51.544663+0000","last_peered":"2023-10-14T19:11:51.544663+0000","last_clean":"2023-10-14T19:11:51.544663+0000","last_became_active":"2023-10-14T19:11:51.544375+0000","last_became_peered":"2023-10-14T19:11:51.544375+0000","last_unstale":"2023-10-14T19:11:51.544663+0000","last_undegraded":"2023-10-14T19:11:51.544663+0000","last_fullsized":"2023-10-14T19:11:51.544663+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:06.056088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539818+0000","last_change":"2023-10-14T19:11:51.539818+0000","last_active":"2023-10-14T19:11:51.539818+0000","last_peered":"2023-10-14T19:11:51.539818+0000","last_clean":"2023-10-14T19:11:51.539818+0000","last_became_active":"2023-10-14T19:11:51.538611+0000","last_became_peered":"2023-10-14T19:11:51.538611+0000","last_unstale":"2023-10-14T19:11:51.539818+0000","last_undegraded":"2023-10-14T19:11:51.539818+0000","last_fullsized":"2023-10-14T19:11:51.539818+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:00.686165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.538807+0000","last_change":"2023-10-14T19:11:51.538807+0000","last_active":"2023-10-14T19:11:51.538807+0000","last_peered":"2023-10-14T19:11:51.538807+0000","last_clean":"2023-10-14T19:11:51.538807+0000","last_became_active":"2023-10-14T19:11:51.538536+0000","last_became_peered":"2023-10-14T19:11:51.538536+0000","last_unstale":"2023-10-14T19:11:51.538807+0000","last_undegraded":"2023-10-14T19:11:51.538807+0000","last_fullsized":"2023-10-14T19:11:51.538807+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:01.773817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549892+0000","last_change":"2023-10-14T19:11:51.543603+0000","last_active":"2023-10-14T19:11:51.549892+0000","last_peered":"2023-10-14T19:11:51.549892+0000","last_clean":"2023-10-14T19:11:51.549892+0000","last_became_active":"2023-10-14T19:11:51.543325+0000","last_became_peered":"2023-10-14T19:11:51.543325+0000","last_unstale":"2023-10-14T19:11:51.549892+0000","last_undegraded":"2023-10-14T19:11:51.549892+0000","last_fullsized":"2023-10-14T19:11:51.549892+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:00.515462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545508+0000","last_change":"2023-10-14T19:11:51.541764+0000","last_active":"2023-10-14T19:11:51.545508+0000","last_peered":"2023-10-14T19:11:51.545508+0000","last_clean":"2023-10-14T19:11:51.545508+0000","last_became_active":"2023-10-14T19:11:51.541492+0000","last_became_peered":"2023-10-14T19:11:51.541492+0000","last_unstale":"2023-10-14T19:11:51.545508+0000","last_undegraded":"2023-10-14T19:11:51.545508+0000","last_fullsized":"2023-10-14T19:11:51.545508+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:21:18.394226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545930+0000","last_change":"2023-10-14T19:11:51.545930+0000","last_active":"2023-10-14T19:11:51.545930+0000","last_peered":"2023-10-14T19:11:51.545930+0000","last_clean":"2023-10-14T19:11:51.545930+0000","last_became_active":"2023-10-14T19:11:51.545674+0000","last_became_peered":"2023-10-14T19:11:51.545674+0000","last_unstale":"2023-10-14T19:11:51.545930+0000","last_undegraded":"2023-10-14T19:11:51.545930+0000","last_fullsized":"2023-10-14T19:11:51.545930+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:11.183785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551973+0000","last_change":"2023-10-14T19:11:51.549527+0000","last_active":"2023-10-14T19:11:51.551973+0000","last_peered":"2023-10-14T19:11:51.551973+0000","last_clean":"2023-10-14T19:11:51.551973+0000","last_became_active":"2023-10-14T19:11:51.549202+0000","last_became_peered":"2023-10-14T19:11:51.549202+0000","last_unstale":"2023-10-14T19:11:51.551973+0000","last_undegraded":"2023-10-14T19:11:51.551973+0000","last_fullsized":"2023-10-14T19:11:51.551973+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:07.533888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.548427+0000","last_change":"2023-10-14T19:11:51.548427+0000","last_active":"2023-10-14T19:11:51.548427+0000","last_peered":"2023-10-14T19:11:51.548427+0000","last_clean":"2023-10-14T19:11:51.548427+0000","last_became_active":"2023-10-14T19:11:51.548171+0000","last_became_peered":"2023-10-14T19:11:51.548171+0000","last_unstale":"2023-10-14T19:11:51.548427+0000","last_undegraded":"2023-10-14T19:11:51.548427+0000","last_fullsized":"2023-10-14T19:11:51.548427+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:51.212884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547952+0000","last_change":"2023-10-14T19:11:51.547952+0000","last_active":"2023-10-14T19:11:51.547952+0000","last_peered":"2023-10-14T19:11:51.547952+0000","last_clean":"2023-10-14T19:11:51.547952+0000","last_became_active":"2023-10-14T19:11:51.547671+0000","last_became_peered":"2023-10-14T19:11:51.547671+0000","last_unstale":"2023-10-14T19:11:51.547952+0000","last_undegraded":"2023-10-14T19:11:51.547952+0000","last_fullsized":"2023-10-14T19:11:51.547952+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:28.741384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551605+0000","last_change":"2023-10-14T19:11:51.548426+0000","last_active":"2023-10-14T19:11:51.551605+0000","last_peered":"2023-10-14T19:11:51.551605+0000","last_clean":"2023-10-14T19:11:51.551605+0000","last_became_active":"2023-10-14T19:11:51.547812+0000","last_became_peered":"2023-10-14T19:11:51.547812+0000","last_unstale":"2023-10-14T19:11:51.551605+0000","last_undegraded":"2023-10-14T19:11:51.551605+0000","last_fullsized":"2023-10-14T19:11:51.551605+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:40:09.094070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.546172+0000","last_change":"2023-10-14T19:11:51.540825+0000","last_active":"2023-10-14T19:11:51.546172+0000","last_peered":"2023-10-14T19:11:51.546172+0000","last_clean":"2023-10-14T19:11:51.546172+0000","last_became_active":"2023-10-14T19:11:51.540120+0000","last_became_peered":"2023-10-14T19:11:51.540120+0000","last_unstale":"2023-10-14T19:11:51.546172+0000","last_undegraded":"2023-10-14T19:11:51.546172+0000","last_fullsized":"2023-10-14T19:11:51.546172+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:32.844635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539672+0000","last_change":"2023-10-14T19:11:51.539672+0000","last_active":"2023-10-14T19:11:51.539672+0000","last_peered":"2023-10-14T19:11:51.539672+0000","last_clean":"2023-10-14T19:11:51.539672+0000","last_became_active":"2023-10-14T19:11:51.539315+0000","last_became_peered":"2023-10-14T19:11:51.539315+0000","last_unstale":"2023-10-14T19:11:51.539672+0000","last_undegraded":"2023-10-14T19:11:51.539672+0000","last_fullsized":"2023-10-14T19:11:51.539672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:07.533888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552269+0000","last_change":"2023-10-14T19:11:51.552269+0000","last_active":"2023-10-14T19:11:51.552269+0000","last_peered":"2023-10-14T19:11:51.552269+0000","last_clean":"2023-10-14T19:11:51.552269+0000","last_became_active":"2023-10-14T19:11:51.551969+0000","last_became_peered":"2023-10-14T19:11:51.551969+0000","last_unstale":"2023-10-14T19:11:51.552269+0000","last_undegraded":"2023-10-14T19:11:51.552269+0000","last_fullsized":"2023-10-14T19:11:51.552269+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:28.741384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547761+0000","last_change":"2023-10-14T19:11:51.547761+0000","last_active":"2023-10-14T19:11:51.547761+0000","last_peered":"2023-10-14T19:11:51.547761+0000","last_clean":"2023-10-14T19:11:51.547761+0000","last_became_active":"2023-10-14T19:11:51.547234+0000","last_became_peered":"2023-10-14T19:11:51.547234+0000","last_unstale":"2023-10-14T19:11:51.547761+0000","last_undegraded":"2023-10-14T19:11:51.547761+0000","last_fullsized":"2023-10-14T19:11:51.547761+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:00.081387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549521+0000","last_change":"2023-10-14T19:11:51.546747+0000","last_active":"2023-10-14T19:11:51.549521+0000","last_peered":"2023-10-14T19:11:51.549521+0000","last_clean":"2023-10-14T19:11:51.549521+0000","last_became_active":"2023-10-14T19:11:51.546456+0000","last_became_peered":"2023-10-14T19:11:51.546456+0000","last_unstale":"2023-10-14T19:11:51.549521+0000","last_undegraded":"2023-10-14T19:11:51.549521+0000","last_fullsized":"2023-10-14T19:11:51.549521+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:15.444658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540523+0000","last_change":"2023-10-14T19:11:51.540523+0000","last_active":"2023-10-14T19:11:51.540523+0000","last_peered":"2023-10-14T19:11:51.540523+0000","last_clean":"2023-10-14T19:11:51.540523+0000","last_became_active":"2023-10-14T19:11:51.539337+0000","last_became_peered":"2023-10-14T19:11:51.539337+0000","last_unstale":"2023-10-14T19:11:51.540523+0000","last_undegraded":"2023-10-14T19:11:51.540523+0000","last_fullsized":"2023-10-14T19:11:51.540523+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:22.731792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549726+0000","last_change":"2023-10-14T19:11:51.549726+0000","last_active":"2023-10-14T19:11:51.549726+0000","last_peered":"2023-10-14T19:11:51.549726+0000","last_clean":"2023-10-14T19:11:51.549726+0000","last_became_active":"2023-10-14T19:11:51.549426+0000","last_became_peered":"2023-10-14T19:11:51.549426+0000","last_unstale":"2023-10-14T19:11:51.549726+0000","last_undegraded":"2023-10-14T19:11:51.549726+0000","last_fullsized":"2023-10-14T19:11:51.549726+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:51.212884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545075+0000","last_change":"2023-10-14T19:11:51.545075+0000","last_active":"2023-10-14T19:11:51.545075+0000","last_peered":"2023-10-14T19:11:51.545075+0000","last_clean":"2023-10-14T19:11:51.545075+0000","last_became_active":"2023-10-14T19:11:51.544807+0000","last_became_peered":"2023-10-14T19:11:51.544807+0000","last_unstale":"2023-10-14T19:11:51.545075+0000","last_undegraded":"2023-10-14T19:11:51.545075+0000","last_fullsized":"2023-10-14T19:11:51.545075+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:23:55.041261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545956+0000","last_change":"2023-10-14T19:11:51.543889+0000","last_active":"2023-10-14T19:11:51.545956+0000","last_peered":"2023-10-14T19:11:51.545956+0000","last_clean":"2023-10-14T19:11:51.545956+0000","last_became_active":"2023-10-14T19:11:51.543399+0000","last_became_peered":"2023-10-14T19:11:51.543399+0000","last_unstale":"2023-10-14T19:11:51.545956+0000","last_undegraded":"2023-10-14T19:11:51.545956+0000","last_fullsized":"2023-10-14T19:11:51.545956+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:34.589259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.548929+0000","last_change":"2023-10-14T19:11:51.545121+0000","last_active":"2023-10-14T19:11:51.548929+0000","last_peered":"2023-10-14T19:11:51.548929+0000","last_clean":"2023-10-14T19:11:51.548929+0000","last_became_active":"2023-10-14T19:11:51.544863+0000","last_became_peered":"2023-10-14T19:11:51.544863+0000","last_unstale":"2023-10-14T19:11:51.548929+0000","last_undegraded":"2023-10-14T19:11:51.548929+0000","last_fullsized":"2023-10-14T19:11:51.548929+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:42.650838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549996+0000","last_change":"2023-10-14T19:11:51.549996+0000","last_active":"2023-10-14T19:11:51.549996+0000","last_peered":"2023-10-14T19:11:51.549996+0000","last_clean":"2023-10-14T19:11:51.549996+0000","last_became_active":"2023-10-14T19:11:51.549538+0000","last_became_peered":"2023-10-14T19:11:51.549538+0000","last_unstale":"2023-10-14T19:11:51.549996+0000","last_undegraded":"2023-10-14T19:11:51.549996+0000","last_fullsized":"2023-10-14T19:11:51.549996+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:18:55.415661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549050+0000","last_change":"2023-10-14T19:11:51.543420+0000","last_active":"2023-10-14T19:11:51.549050+0000","last_peered":"2023-10-14T19:11:51.549050+0000","last_clean":"2023-10-14T19:11:51.549050+0000","last_became_active":"2023-10-14T19:11:51.543014+0000","last_became_peered":"2023-10-14T19:11:51.543014+0000","last_unstale":"2023-10-14T19:11:51.549050+0000","last_undegraded":"2023-10-14T19:11:51.549050+0000","last_fullsized":"2023-10-14T19:11:51.549050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:07.704591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.543295+0000","last_change":"2023-10-14T19:11:51.543295+0000","last_active":"2023-10-14T19:11:51.543295+0000","last_peered":"2023-10-14T19:11:51.543295+0000","last_clean":"2023-10-14T19:11:51.543295+0000","last_became_active":"2023-10-14T19:11:51.543020+0000","last_became_peered":"2023-10-14T19:11:51.543020+0000","last_unstale":"2023-10-14T19:11:51.543295+0000","last_undegraded":"2023-10-14T19:11:51.543295+0000","last_fullsized":"2023-10-14T19:11:51.543295+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:21.581081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545583+0000","last_change":"2023-10-14T19:11:51.542846+0000","last_active":"2023-10-14T19:11:51.545583+0000","last_peered":"2023-10-14T19:11:51.545583+0000","last_clean":"2023-10-14T19:11:51.545583+0000","last_became_active":"2023-10-14T19:11:51.542563+0000","last_became_peered":"2023-10-14T19:11:51.542563+0000","last_unstale":"2023-10-14T19:11:51.545583+0000","last_undegraded":"2023-10-14T19:11:51.545583+0000","last_fullsized":"2023-10-14T19:11:51.545583+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:41.229089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540755+0000","last_change":"2023-10-14T19:11:51.540755+0000","last_active":"2023-10-14T19:11:51.540755+0000","last_peered":"2023-10-14T19:11:51.540755+0000","last_clean":"2023-10-14T19:11:51.540755+0000","last_became_active":"2023-10-14T19:11:51.540496+0000","last_became_peered":"2023-10-14T19:11:51.540496+0000","last_unstale":"2023-10-14T19:11:51.540755+0000","last_undegraded":"2023-10-14T19:11:51.540755+0000","last_fullsized":"2023-10-14T19:11:51.540755+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:56.098115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551625+0000","last_change":"2023-10-14T19:11:51.548619+0000","last_active":"2023-10-14T19:11:51.551625+0000","last_peered":"2023-10-14T19:11:51.551625+0000","last_clean":"2023-10-14T19:11:51.551625+0000","last_became_active":"2023-10-14T19:11:51.548152+0000","last_became_peered":"2023-10-14T19:11:51.548152+0000","last_unstale":"2023-10-14T19:11:51.551625+0000","last_undegraded":"2023-10-14T19:11:51.551625+0000","last_fullsized":"2023-10-14T19:11:51.551625+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:59.529350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.537853+0000","last_change":"2023-10-14T19:11:51.537853+0000","last_active":"2023-10-14T19:11:51.537853+0000","last_peered":"2023-10-14T19:11:51.537853+0000","last_clean":"2023-10-14T19:11:51.537853+0000","last_became_active":"2023-10-14T19:11:51.537411+0000","last_became_peered":"2023-10-14T19:11:51.537411+0000","last_unstale":"2023-10-14T19:11:51.537853+0000","last_undegraded":"2023-10-14T19:11:51.537853+0000","last_fullsized":"2023-10-14T19:11:51.537853+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:59.529350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547172+0000","last_change":"2023-10-14T19:11:51.547172+0000","last_active":"2023-10-14T19:11:51.547172+0000","last_peered":"2023-10-14T19:11:51.547172+0000","last_clean":"2023-10-14T19:11:51.547172+0000","last_became_active":"2023-10-14T19:11:51.546902+0000","last_became_peered":"2023-10-14T19:11:51.546902+0000","last_unstale":"2023-10-14T19:11:51.547172+0000","last_undegraded":"2023-10-14T19:11:51.547172+0000","last_fullsized":"2023-10-14T19:11:51.547172+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.965919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.541741+0000","last_change":"2023-10-14T19:11:51.541741+0000","last_active":"2023-10-14T19:11:51.541741+0000","last_peered":"2023-10-14T19:11:51.541741+0000","last_clean":"2023-10-14T19:11:51.541741+0000","last_became_active":"2023-10-14T19:11:51.541004+0000","last_became_peered":"2023-10-14T19:11:51.541004+0000","last_unstale":"2023-10-14T19:11:51.541741+0000","last_undegraded":"2023-10-14T19:11:51.541741+0000","last_fullsized":"2023-10-14T19:11:51.541741+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:07.916623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551739+0000","last_change":"2023-10-14T19:11:51.549475+0000","last_active":"2023-10-14T19:11:51.551739+0000","last_peered":"2023-10-14T19:11:51.551739+0000","last_clean":"2023-10-14T19:11:51.551739+0000","last_became_active":"2023-10-14T19:11:51.549035+0000","last_became_peered":"2023-10-14T19:11:51.549035+0000","last_unstale":"2023-10-14T19:11:51.551739+0000","last_undegraded":"2023-10-14T19:11:51.551739+0000","last_fullsized":"2023-10-14T19:11:51.551739+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:47.965919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547954+0000","last_change":"2023-10-14T19:11:51.547954+0000","last_active":"2023-10-14T19:11:51.547954+0000","last_peered":"2023-10-14T19:11:51.547954+0000","last_clean":"2023-10-14T19:11:51.547954+0000","last_became_active":"2023-10-14T19:11:51.547699+0000","last_became_peered":"2023-10-14T19:11:51.547699+0000","last_unstale":"2023-10-14T19:11:51.547954+0000","last_undegraded":"2023-10-14T19:11:51.547954+0000","last_fullsized":"2023-10-14T19:11:51.547954+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:48:00.322829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552794+0000","last_change":"2023-10-14T19:11:50.542261+0000","last_active":"2023-10-14T19:11:51.552794+0000","last_peered":"2023-10-14T19:11:51.552794+0000","last_clean":"2023-10-14T19:11:51.552794+0000","last_became_active":"2023-10-14T19:11:50.541924+0000","last_became_peered":"2023-10-14T19:11:50.541924+0000","last_unstale":"2023-10-14T19:11:51.552794+0000","last_undegraded":"2023-10-14T19:11:51.552794+0000","last_fullsized":"2023-10-14T19:11:51.552794+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:13:50.208104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547351+0000","last_change":"2023-10-14T19:11:51.547351+0000","last_active":"2023-10-14T19:11:51.547351+0000","last_peered":"2023-10-14T19:11:51.547351+0000","last_clean":"2023-10-14T19:11:51.547351+0000","last_became_active":"2023-10-14T19:11:51.547027+0000","last_became_peered":"2023-10-14T19:11:51.547027+0000","last_unstale":"2023-10-14T19:11:51.547351+0000","last_undegraded":"2023-10-14T19:11:51.547351+0000","last_fullsized":"2023-10-14T19:11:51.547351+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:55:29.343677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.544238+0000","last_change":"2023-10-14T19:11:50.541543+0000","last_active":"2023-10-14T19:11:51.544238+0000","last_peered":"2023-10-14T19:11:51.544238+0000","last_clean":"2023-10-14T19:11:51.544238+0000","last_became_active":"2023-10-14T19:11:50.541232+0000","last_became_peered":"2023-10-14T19:11:50.541232+0000","last_unstale":"2023-10-14T19:11:51.544238+0000","last_undegraded":"2023-10-14T19:11:51.544238+0000","last_fullsized":"2023-10-14T19:11:51.544238+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:53.070640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.550004+0000","last_change":"2023-10-14T19:11:51.545322+0000","last_active":"2023-10-14T19:11:51.550004+0000","last_peered":"2023-10-14T19:11:51.550004+0000","last_clean":"2023-10-14T19:11:51.550004+0000","last_became_active":"2023-10-14T19:11:51.545067+0000","last_became_peered":"2023-10-14T19:11:51.545067+0000","last_unstale":"2023-10-14T19:11:51.550004+0000","last_undegraded":"2023-10-14T19:11:51.550004+0000","last_fullsized":"2023-10-14T19:11:51.550004+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.301073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.550362+0000","last_change":"2023-10-14T19:11:50.538318+0000","last_active":"2023-10-14T19:11:51.550362+0000","last_peered":"2023-10-14T19:11:51.550362+0000","last_clean":"2023-10-14T19:11:51.550362+0000","last_became_active":"2023-10-14T19:11:50.537029+0000","last_became_peered":"2023-10-14T19:11:50.537029+0000","last_unstale":"2023-10-14T19:11:51.550362+0000","last_undegraded":"2023-10-14T19:11:51.550362+0000","last_fullsized":"2023-10-14T19:11:51.550362+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:53:40.608507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.537694+0000","last_change":"2023-10-14T19:11:51.537694+0000","last_active":"2023-10-14T19:11:51.537694+0000","last_peered":"2023-10-14T19:11:51.537694+0000","last_clean":"2023-10-14T19:11:51.537694+0000","last_became_active":"2023-10-14T19:11:51.537302+0000","last_became_peered":"2023-10-14T19:11:51.537302+0000","last_unstale":"2023-10-14T19:11:51.537694+0000","last_undegraded":"2023-10-14T19:11:51.537694+0000","last_fullsized":"2023-10-14T19:11:51.537694+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:00.515462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"182'1","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.537873+0000","last_change":"2023-10-14T19:11:50.538640+0000","last_active":"2023-10-14T19:11:51.537873+0000","last_peered":"2023-10-14T19:11:51.537873+0000","last_clean":"2023-10-14T19:11:51.537873+0000","last_became_active":"2023-10-14T19:11:50.538355+0000","last_became_peered":"2023-10-14T19:11:50.538355+0000","last_unstale":"2023-10-14T19:11:51.537873+0000","last_undegraded":"2023-10-14T19:11:51.537873+0000","last_fullsized":"2023-10-14T19:11:51.537873+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:04:42.493440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.546326+0000","last_change":"2023-10-14T19:11:51.544570+0000","last_active":"2023-10-14T19:11:51.546326+0000","last_peered":"2023-10-14T19:11:51.546326+0000","last_clean":"2023-10-14T19:11:51.546326+0000","last_became_active":"2023-10-14T19:11:51.543736+0000","last_became_peered":"2023-10-14T19:11:51.543736+0000","last_unstale":"2023-10-14T19:11:51.546326+0000","last_undegraded":"2023-10-14T19:11:51.546326+0000","last_fullsized":"2023-10-14T19:11:51.546326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:18.692905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.529921+0000","last_change":"2023-10-14T19:11:50.538090+0000","last_active":"2023-10-14T19:11:51.529921+0000","last_peered":"2023-10-14T19:11:51.529921+0000","last_clean":"2023-10-14T19:11:51.529921+0000","last_became_active":"2023-10-14T19:11:50.537808+0000","last_became_peered":"2023-10-14T19:11:50.537808+0000","last_unstale":"2023-10-14T19:11:51.529921+0000","last_undegraded":"2023-10-14T19:11:51.529921+0000","last_fullsized":"2023-10-14T19:11:51.529921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:07:10.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540243+0000","last_change":"2023-10-14T19:11:51.540243+0000","last_active":"2023-10-14T19:11:51.540243+0000","last_peered":"2023-10-14T19:11:51.540243+0000","last_clean":"2023-10-14T19:11:51.540243+0000","last_became_active":"2023-10-14T19:11:51.538966+0000","last_became_peered":"2023-10-14T19:11:51.538966+0000","last_unstale":"2023-10-14T19:11:51.540243+0000","last_undegraded":"2023-10-14T19:11:51.540243+0000","last_fullsized":"2023-10-14T19:11:51.540243+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:23:02.068350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.546233+0000","last_change":"2023-10-14T19:11:50.538815+0000","last_active":"2023-10-14T19:11:50.546233+0000","last_peered":"2023-10-14T19:11:50.546233+0000","last_clean":"2023-10-14T19:11:50.546233+0000","last_became_active":"2023-10-14T19:11:50.538465+0000","last_became_peered":"2023-10-14T19:11:50.538465+0000","last_unstale":"2023-10-14T19:11:50.546233+0000","last_undegraded":"2023-10-14T19:11:50.546233+0000","last_fullsized":"2023-10-14T19:11:50.546233+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:46.757117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539726+0000","last_change":"2023-10-14T19:11:51.539726+0000","last_active":"2023-10-14T19:11:51.539726+0000","last_peered":"2023-10-14T19:11:51.539726+0000","last_clean":"2023-10-14T19:11:51.539726+0000","last_became_active":"2023-10-14T19:11:51.539387+0000","last_became_peered":"2023-10-14T19:11:51.539387+0000","last_unstale":"2023-10-14T19:11:51.539726+0000","last_undegraded":"2023-10-14T19:11:51.539726+0000","last_fullsized":"2023-10-14T19:11:51.539726+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:01:47.761897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.534961+0000","last_change":"2023-10-14T19:11:50.539131+0000","last_active":"2023-10-14T19:11:51.534961+0000","last_peered":"2023-10-14T19:11:51.534961+0000","last_clean":"2023-10-14T19:11:51.534961+0000","last_became_active":"2023-10-14T19:11:50.538883+0000","last_became_peered":"2023-10-14T19:11:50.538883+0000","last_unstale":"2023-10-14T19:11:51.534961+0000","last_undegraded":"2023-10-14T19:11:51.534961+0000","last_fullsized":"2023-10-14T19:11:51.534961+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:08.705529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545454+0000","last_change":"2023-10-14T19:11:51.541719+0000","last_active":"2023-10-14T19:11:51.545454+0000","last_peered":"2023-10-14T19:11:51.545454+0000","last_clean":"2023-10-14T19:11:51.545454+0000","last_became_active":"2023-10-14T19:11:51.541089+0000","last_became_peered":"2023-10-14T19:11:51.541089+0000","last_unstale":"2023-10-14T19:11:51.545454+0000","last_undegraded":"2023-10-14T19:11:51.545454+0000","last_fullsized":"2023-10-14T19:11:51.545454+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:56.763057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.543541+0000","last_change":"2023-10-14T19:11:50.540323+0000","last_active":"2023-10-14T19:11:50.543541+0000","last_peered":"2023-10-14T19:11:50.543541+0000","last_clean":"2023-10-14T19:11:50.543541+0000","last_became_active":"2023-10-14T19:11:50.539984+0000","last_became_peered":"2023-10-14T19:11:50.539984+0000","last_unstale":"2023-10-14T19:11:50.543541+0000","last_undegraded":"2023-10-14T19:11:50.543541+0000","last_fullsized":"2023-10-14T19:11:50.543541+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:16.309693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549821+0000","last_change":"2023-10-14T19:11:51.548343+0000","last_active":"2023-10-14T19:11:51.549821+0000","last_peered":"2023-10-14T19:11:51.549821+0000","last_clean":"2023-10-14T19:11:51.549821+0000","last_became_active":"2023-10-14T19:11:51.547780+0000","last_became_peered":"2023-10-14T19:11:51.547780+0000","last_unstale":"2023-10-14T19:11:51.549821+0000","last_undegraded":"2023-10-14T19:11:51.549821+0000","last_fullsized":"2023-10-14T19:11:51.549821+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:53.042570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.546274+0000","last_change":"2023-10-14T19:11:50.539688+0000","last_active":"2023-10-14T19:11:50.546274+0000","last_peered":"2023-10-14T19:11:50.546274+0000","last_clean":"2023-10-14T19:11:50.546274+0000","last_became_active":"2023-10-14T19:11:50.539417+0000","last_became_peered":"2023-10-14T19:11:50.539417+0000","last_unstale":"2023-10-14T19:11:50.546274+0000","last_undegraded":"2023-10-14T19:11:50.546274+0000","last_fullsized":"2023-10-14T19:11:50.546274+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:53.166088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545613+0000","last_change":"2023-10-14T19:11:51.545613+0000","last_active":"2023-10-14T19:11:51.545613+0000","last_peered":"2023-10-14T19:11:51.545613+0000","last_clean":"2023-10-14T19:11:51.545613+0000","last_became_active":"2023-10-14T19:11:51.545322+0000","last_became_peered":"2023-10-14T19:11:51.545322+0000","last_unstale":"2023-10-14T19:11:51.545613+0000","last_undegraded":"2023-10-14T19:11:51.545613+0000","last_fullsized":"2023-10-14T19:11:51.545613+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:55:29.343677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"182'3","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.548656+0000","last_change":"2023-10-14T19:11:50.538819+0000","last_active":"2023-10-14T19:11:51.548656+0000","last_peered":"2023-10-14T19:11:51.548656+0000","last_clean":"2023-10-14T19:11:51.548656+0000","last_became_active":"2023-10-14T19:11:50.538408+0000","last_became_peered":"2023-10-14T19:11:50.538408+0000","last_unstale":"2023-10-14T19:11:51.548656+0000","last_undegraded":"2023-10-14T19:11:51.548656+0000","last_fullsized":"2023-10-14T19:11:51.548656+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:04:09.636368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545938+0000","last_change":"2023-10-14T19:11:51.543427+0000","last_active":"2023-10-14T19:11:51.545938+0000","last_peered":"2023-10-14T19:11:51.545938+0000","last_clean":"2023-10-14T19:11:51.545938+0000","last_became_active":"2023-10-14T19:11:51.543184+0000","last_became_peered":"2023-10-14T19:11:51.543184+0000","last_unstale":"2023-10-14T19:11:51.545938+0000","last_undegraded":"2023-10-14T19:11:51.545938+0000","last_fullsized":"2023-10-14T19:11:51.545938+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:08.781009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.555822+0000","last_change":"2023-10-14T19:11:50.543989+0000","last_active":"2023-10-14T19:11:51.555822+0000","last_peered":"2023-10-14T19:11:51.555822+0000","last_clean":"2023-10-14T19:11:51.555822+0000","last_became_active":"2023-10-14T19:11:50.543681+0000","last_became_peered":"2023-10-14T19:11:50.543681+0000","last_unstale":"2023-10-14T19:11:51.555822+0000","last_undegraded":"2023-10-14T19:11:51.555822+0000","last_fullsized":"2023-10-14T19:11:51.555822+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:17.949601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.542662+0000","last_change":"2023-10-14T19:11:51.542662+0000","last_active":"2023-10-14T19:11:51.542662+0000","last_peered":"2023-10-14T19:11:51.542662+0000","last_clean":"2023-10-14T19:11:51.542662+0000","last_became_active":"2023-10-14T19:11:51.542155+0000","last_became_peered":"2023-10-14T19:11:51.542155+0000","last_unstale":"2023-10-14T19:11:51.542662+0000","last_undegraded":"2023-10-14T19:11:51.542662+0000","last_fullsized":"2023-10-14T19:11:51.542662+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:39:37.388084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.546426+0000","last_change":"2023-10-14T19:11:50.541874+0000","last_active":"2023-10-14T19:11:51.546426+0000","last_peered":"2023-10-14T19:11:51.546426+0000","last_clean":"2023-10-14T19:11:51.546426+0000","last_became_active":"2023-10-14T19:11:50.541676+0000","last_became_peered":"2023-10-14T19:11:50.541676+0000","last_unstale":"2023-10-14T19:11:51.546426+0000","last_undegraded":"2023-10-14T19:11:51.546426+0000","last_fullsized":"2023-10-14T19:11:51.546426+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:35:01.075297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545563+0000","last_change":"2023-10-14T19:11:51.542303+0000","last_active":"2023-10-14T19:11:51.545563+0000","last_peered":"2023-10-14T19:11:51.545563+0000","last_clean":"2023-10-14T19:11:51.545563+0000","last_became_active":"2023-10-14T19:11:51.542040+0000","last_became_peered":"2023-10-14T19:11:51.542040+0000","last_unstale":"2023-10-14T19:11:51.545563+0000","last_undegraded":"2023-10-14T19:11:51.545563+0000","last_fullsized":"2023-10-14T19:11:51.545563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:25.872209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.540169+0000","last_change":"2023-10-14T19:11:50.537868+0000","last_active":"2023-10-14T19:11:50.540169+0000","last_peered":"2023-10-14T19:11:50.540169+0000","last_clean":"2023-10-14T19:11:50.540169+0000","last_became_active":"2023-10-14T19:11:50.537577+0000","last_became_peered":"2023-10-14T19:11:50.537577+0000","last_unstale":"2023-10-14T19:11:50.540169+0000","last_undegraded":"2023-10-14T19:11:50.540169+0000","last_fullsized":"2023-10-14T19:11:50.540169+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:41.646057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.550786+0000","last_change":"2023-10-14T19:11:51.550786+0000","last_active":"2023-10-14T19:11:51.550786+0000","last_peered":"2023-10-14T19:11:51.550786+0000","last_clean":"2023-10-14T19:11:51.550786+0000","last_became_active":"2023-10-14T19:11:51.550386+0000","last_became_peered":"2023-10-14T19:11:51.550386+0000","last_unstale":"2023-10-14T19:11:51.550786+0000","last_undegraded":"2023-10-14T19:11:51.550786+0000","last_fullsized":"2023-10-14T19:11:51.550786+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:02.607310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.540242+0000","last_change":"2023-10-14T19:11:50.539501+0000","last_active":"2023-10-14T19:11:50.540242+0000","last_peered":"2023-10-14T19:11:50.540242+0000","last_clean":"2023-10-14T19:11:50.540242+0000","last_became_active":"2023-10-14T19:11:50.538817+0000","last_became_peered":"2023-10-14T19:11:50.538817+0000","last_unstale":"2023-10-14T19:11:50.540242+0000","last_undegraded":"2023-10-14T19:11:50.540242+0000","last_fullsized":"2023-10-14T19:11:50.540242+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:52.037790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.536963+0000","last_change":"2023-10-14T19:11:51.536963+0000","last_active":"2023-10-14T19:11:51.536963+0000","last_peered":"2023-10-14T19:11:51.536963+0000","last_clean":"2023-10-14T19:11:51.536963+0000","last_became_active":"2023-10-14T19:11:51.536691+0000","last_became_peered":"2023-10-14T19:11:51.536691+0000","last_unstale":"2023-10-14T19:11:51.536963+0000","last_undegraded":"2023-10-14T19:11:51.536963+0000","last_fullsized":"2023-10-14T19:11:51.536963+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:29:15.938156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":17,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552349+0000","last_change":"2023-10-14T19:11:50.544584+0000","last_active":"2023-10-14T19:11:51.552349+0000","last_peered":"2023-10-14T19:11:51.552349+0000","last_clean":"2023-10-14T19:11:51.552349+0000","last_became_active":"2023-10-14T19:11:50.544368+0000","last_became_peered":"2023-10-14T19:11:50.544368+0000","last_unstale":"2023-10-14T19:11:51.552349+0000","last_undegraded":"2023-10-14T19:11:51.552349+0000","last_fullsized":"2023-10-14T19:11:51.552349+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:26:43.101800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.539685+0000","last_change":"2023-10-14T19:11:51.539685+0000","last_active":"2023-10-14T19:11:51.539685+0000","last_peered":"2023-10-14T19:11:51.539685+0000","last_clean":"2023-10-14T19:11:51.539685+0000","last_became_active":"2023-10-14T19:11:51.539403+0000","last_became_peered":"2023-10-14T19:11:51.539403+0000","last_unstale":"2023-10-14T19:11:51.539685+0000","last_undegraded":"2023-10-14T19:11:51.539685+0000","last_fullsized":"2023-10-14T19:11:51.539685+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:17:17.430196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549193+0000","last_change":"2023-10-14T19:11:50.537584+0000","last_active":"2023-10-14T19:11:51.549193+0000","last_peered":"2023-10-14T19:11:51.549193+0000","last_clean":"2023-10-14T19:11:51.549193+0000","last_became_active":"2023-10-14T19:11:50.537288+0000","last_became_peered":"2023-10-14T19:11:50.537288+0000","last_unstale":"2023-10-14T19:11:51.549193+0000","last_undegraded":"2023-10-14T19:11:51.549193+0000","last_fullsized":"2023-10-14T19:11:51.549193+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:18:54.410881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.538880+0000","last_change":"2023-10-14T19:11:51.538880+0000","last_active":"2023-10-14T19:11:51.538880+0000","last_peered":"2023-10-14T19:11:51.538880+0000","last_clean":"2023-10-14T19:11:51.538880+0000","last_became_active":"2023-10-14T19:11:51.538570+0000","last_became_peered":"2023-10-14T19:11:51.538570+0000","last_unstale":"2023-10-14T19:11:51.538880+0000","last_undegraded":"2023-10-14T19:11:51.538880+0000","last_fullsized":"2023-10-14T19:11:51.538880+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:54:05.730721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549355+0000","last_change":"2023-10-14T19:11:50.535312+0000","last_active":"2023-10-14T19:11:51.549355+0000","last_peered":"2023-10-14T19:11:51.549355+0000","last_clean":"2023-10-14T19:11:51.549355+0000","last_became_active":"2023-10-14T19:11:50.535037+0000","last_became_peered":"2023-10-14T19:11:50.535037+0000","last_unstale":"2023-10-14T19:11:51.549355+0000","last_undegraded":"2023-10-14T19:11:51.549355+0000","last_fullsized":"2023-10-14T19:11:51.549355+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:40:02.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545466+0000","last_change":"2023-10-14T19:11:51.545466+0000","last_active":"2023-10-14T19:11:51.545466+0000","last_peered":"2023-10-14T19:11:51.545466+0000","last_clean":"2023-10-14T19:11:51.545466+0000","last_became_active":"2023-10-14T19:11:51.545190+0000","last_became_peered":"2023-10-14T19:11:51.545190+0000","last_unstale":"2023-10-14T19:11:51.545466+0000","last_undegraded":"2023-10-14T19:11:51.545466+0000","last_fullsized":"2023-10-14T19:11:51.545466+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:13.716481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545275+0000","last_change":"2023-10-14T19:11:50.541049+0000","last_active":"2023-10-14T19:11:51.545275+0000","last_peered":"2023-10-14T19:11:51.545275+0000","last_clean":"2023-10-14T19:11:51.545275+0000","last_became_active":"2023-10-14T19:11:50.540740+0000","last_became_peered":"2023-10-14T19:11:50.540740+0000","last_unstale":"2023-10-14T19:11:51.545275+0000","last_undegraded":"2023-10-14T19:11:51.545275+0000","last_fullsized":"2023-10-14T19:11:51.545275+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:53.468771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545016+0000","last_change":"2023-10-14T19:11:51.545016+0000","last_active":"2023-10-14T19:11:51.545016+0000","last_peered":"2023-10-14T19:11:51.545016+0000","last_clean":"2023-10-14T19:11:51.545016+0000","last_became_active":"2023-10-14T19:11:51.544764+0000","last_became_peered":"2023-10-14T19:11:51.544764+0000","last_unstale":"2023-10-14T19:11:51.545016+0000","last_undegraded":"2023-10-14T19:11:51.545016+0000","last_fullsized":"2023-10-14T19:11:51.545016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:18:55.415661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.537955+0000","last_change":"2023-10-14T19:11:50.535225+0000","last_active":"2023-10-14T19:11:50.537955+0000","last_peered":"2023-10-14T19:11:50.537955+0000","last_clean":"2023-10-14T19:11:50.537955+0000","last_became_active":"2023-10-14T19:11:50.534943+0000","last_became_peered":"2023-10-14T19:11:50.534943+0000","last_unstale":"2023-10-14T19:11:50.537955+0000","last_undegraded":"2023-10-14T19:11:50.537955+0000","last_fullsized":"2023-10-14T19:11:50.537955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:01.673379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.540024+0000","last_change":"2023-10-14T19:11:51.540024+0000","last_active":"2023-10-14T19:11:51.540024+0000","last_peered":"2023-10-14T19:11:51.540024+0000","last_clean":"2023-10-14T19:11:51.540024+0000","last_became_active":"2023-10-14T19:11:51.539537+0000","last_became_peered":"2023-10-14T19:11:51.539537+0000","last_unstale":"2023-10-14T19:11:51.540024+0000","last_undegraded":"2023-10-14T19:11:51.540024+0000","last_fullsized":"2023-10-14T19:11:51.540024+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:02.607310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551508+0000","last_change":"2023-10-14T19:11:50.544967+0000","last_active":"2023-10-14T19:11:51.551508+0000","last_peered":"2023-10-14T19:11:51.551508+0000","last_clean":"2023-10-14T19:11:51.551508+0000","last_became_active":"2023-10-14T19:11:50.544561+0000","last_became_peered":"2023-10-14T19:11:50.544561+0000","last_unstale":"2023-10-14T19:11:51.551508+0000","last_undegraded":"2023-10-14T19:11:51.551508+0000","last_fullsized":"2023-10-14T19:11:51.551508+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:39:51.534562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.542812+0000","last_change":"2023-10-14T19:11:51.542812+0000","last_active":"2023-10-14T19:11:51.542812+0000","last_peered":"2023-10-14T19:11:51.542812+0000","last_clean":"2023-10-14T19:11:51.542812+0000","last_became_active":"2023-10-14T19:11:51.542557+0000","last_became_peered":"2023-10-14T19:11:51.542557+0000","last_unstale":"2023-10-14T19:11:51.542812+0000","last_undegraded":"2023-10-14T19:11:51.542812+0000","last_fullsized":"2023-10-14T19:11:51.542812+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:25.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.530023+0000","last_change":"2023-10-14T19:11:50.541708+0000","last_active":"2023-10-14T19:11:51.530023+0000","last_peered":"2023-10-14T19:11:51.530023+0000","last_clean":"2023-10-14T19:11:51.530023+0000","last_became_active":"2023-10-14T19:11:50.541394+0000","last_became_peered":"2023-10-14T19:11:50.541394+0000","last_unstale":"2023-10-14T19:11:51.530023+0000","last_undegraded":"2023-10-14T19:11:51.530023+0000","last_fullsized":"2023-10-14T19:11:51.530023+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:38:47.880360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549071+0000","last_change":"2023-10-14T19:11:51.546721+0000","last_active":"2023-10-14T19:11:51.549071+0000","last_peered":"2023-10-14T19:11:51.549071+0000","last_clean":"2023-10-14T19:11:51.549071+0000","last_became_active":"2023-10-14T19:11:51.546448+0000","last_became_peered":"2023-10-14T19:11:51.546448+0000","last_unstale":"2023-10-14T19:11:51.549071+0000","last_undegraded":"2023-10-14T19:11:51.549071+0000","last_fullsized":"2023-10-14T19:11:51.549071+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:48.517956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.530106+0000","last_change":"2023-10-14T19:11:50.532923+0000","last_active":"2023-10-14T19:11:51.530106+0000","last_peered":"2023-10-14T19:11:51.530106+0000","last_clean":"2023-10-14T19:11:51.530106+0000","last_became_active":"2023-10-14T19:11:50.532603+0000","last_became_peered":"2023-10-14T19:11:50.532603+0000","last_unstale":"2023-10-14T19:11:51.530106+0000","last_undegraded":"2023-10-14T19:11:51.530106+0000","last_fullsized":"2023-10-14T19:11:51.530106+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:24:24.098191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549503+0000","last_change":"2023-10-14T19:11:51.544573+0000","last_active":"2023-10-14T19:11:51.549503+0000","last_peered":"2023-10-14T19:11:51.549503+0000","last_clean":"2023-10-14T19:11:51.549503+0000","last_became_active":"2023-10-14T19:11:51.544323+0000","last_became_peered":"2023-10-14T19:11:51.544323+0000","last_unstale":"2023-10-14T19:11:51.549503+0000","last_undegraded":"2023-10-14T19:11:51.549503+0000","last_fullsized":"2023-10-14T19:11:51.549503+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:41.229089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.543444+0000","last_change":"2023-10-14T19:11:50.539481+0000","last_active":"2023-10-14T19:11:50.543444+0000","last_peered":"2023-10-14T19:11:50.543444+0000","last_clean":"2023-10-14T19:11:50.543444+0000","last_became_active":"2023-10-14T19:11:50.537708+0000","last_became_peered":"2023-10-14T19:11:50.537708+0000","last_unstale":"2023-10-14T19:11:50.543444+0000","last_undegraded":"2023-10-14T19:11:50.543444+0000","last_fullsized":"2023-10-14T19:11:50.543444+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:17.949601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.545478+0000","last_change":"2023-10-14T19:11:51.541886+0000","last_active":"2023-10-14T19:11:51.545478+0000","last_peered":"2023-10-14T19:11:51.545478+0000","last_clean":"2023-10-14T19:11:51.545478+0000","last_became_active":"2023-10-14T19:11:51.541456+0000","last_became_peered":"2023-10-14T19:11:51.541456+0000","last_unstale":"2023-10-14T19:11:51.545478+0000","last_undegraded":"2023-10-14T19:11:51.545478+0000","last_fullsized":"2023-10-14T19:11:51.545478+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:56.274082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.552285+0000","last_change":"2023-10-14T19:11:50.540305+0000","last_active":"2023-10-14T19:11:51.552285+0000","last_peered":"2023-10-14T19:11:51.552285+0000","last_clean":"2023-10-14T19:11:51.552285+0000","last_became_active":"2023-10-14T19:11:50.539703+0000","last_became_peered":"2023-10-14T19:11:50.539703+0000","last_unstale":"2023-10-14T19:11:51.552285+0000","last_undegraded":"2023-10-14T19:11:51.552285+0000","last_fullsized":"2023-10-14T19:11:51.552285+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:49:12.170792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549812+0000","last_change":"2023-10-14T19:11:51.549812+0000","last_active":"2023-10-14T19:11:51.549812+0000","last_peered":"2023-10-14T19:11:51.549812+0000","last_clean":"2023-10-14T19:11:51.549812+0000","last_became_active":"2023-10-14T19:11:51.549178+0000","last_became_peered":"2023-10-14T19:11:51.549178+0000","last_unstale":"2023-10-14T19:11:51.549812+0000","last_undegraded":"2023-10-14T19:11:51.549812+0000","last_fullsized":"2023-10-14T19:11:51.549812+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:06.056088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.540150+0000","last_change":"2023-10-14T19:11:50.538001+0000","last_active":"2023-10-14T19:11:50.540150+0000","last_peered":"2023-10-14T19:11:50.540150+0000","last_clean":"2023-10-14T19:11:50.540150+0000","last_became_active":"2023-10-14T19:11:50.537731+0000","last_became_peered":"2023-10-14T19:11:50.537731+0000","last_unstale":"2023-10-14T19:11:50.540150+0000","last_undegraded":"2023-10-14T19:11:50.540150+0000","last_fullsized":"2023-10-14T19:11:50.540150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:37.764225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.541238+0000","last_change":"2023-10-14T19:11:51.541238+0000","last_active":"2023-10-14T19:11:51.541238+0000","last_peered":"2023-10-14T19:11:51.541238+0000","last_clean":"2023-10-14T19:11:51.541238+0000","last_became_active":"2023-10-14T19:11:51.540940+0000","last_became_peered":"2023-10-14T19:11:51.540940+0000","last_unstale":"2023-10-14T19:11:51.541238+0000","last_undegraded":"2023-10-14T19:11:51.541238+0000","last_fullsized":"2023-10-14T19:11:51.541238+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:48.938544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.544160+0000","last_change":"2023-10-14T19:11:50.542021+0000","last_active":"2023-10-14T19:11:50.544160+0000","last_peered":"2023-10-14T19:11:50.544160+0000","last_clean":"2023-10-14T19:11:50.544160+0000","last_became_active":"2023-10-14T19:11:50.541770+0000","last_became_peered":"2023-10-14T19:11:50.541770+0000","last_unstale":"2023-10-14T19:11:50.544160+0000","last_undegraded":"2023-10-14T19:11:50.544160+0000","last_fullsized":"2023-10-14T19:11:50.544160+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:07:16.679329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.541883+0000","last_change":"2023-10-14T19:11:51.541883+0000","last_active":"2023-10-14T19:11:51.541883+0000","last_peered":"2023-10-14T19:11:51.541883+0000","last_clean":"2023-10-14T19:11:51.541883+0000","last_became_active":"2023-10-14T19:11:51.541544+0000","last_became_peered":"2023-10-14T19:11:51.541544+0000","last_unstale":"2023-10-14T19:11:51.541883+0000","last_undegraded":"2023-10-14T19:11:51.541883+0000","last_fullsized":"2023-10-14T19:11:51.541883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:12.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.543236+0000","last_change":"2023-10-14T19:11:50.539177+0000","last_active":"2023-10-14T19:11:50.543236+0000","last_peered":"2023-10-14T19:11:50.543236+0000","last_clean":"2023-10-14T19:11:50.543236+0000","last_became_active":"2023-10-14T19:11:50.538610+0000","last_became_peered":"2023-10-14T19:11:50.538610+0000","last_unstale":"2023-10-14T19:11:50.543236+0000","last_undegraded":"2023-10-14T19:11:50.543236+0000","last_fullsized":"2023-10-14T19:11:50.543236+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:01.465254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.542292+0000","last_change":"2023-10-14T19:11:51.542292+0000","last_active":"2023-10-14T19:11:51.542292+0000","last_peered":"2023-10-14T19:11:51.542292+0000","last_clean":"2023-10-14T19:11:51.542292+0000","last_became_active":"2023-10-14T19:11:51.542007+0000","last_became_peered":"2023-10-14T19:11:51.542007+0000","last_unstale":"2023-10-14T19:11:51.542292+0000","last_undegraded":"2023-10-14T19:11:51.542292+0000","last_fullsized":"2023-10-14T19:11:51.542292+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.301073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.531430+0000","last_change":"2023-10-14T19:11:50.541666+0000","last_active":"2023-10-14T19:11:51.531430+0000","last_peered":"2023-10-14T19:11:51.531430+0000","last_clean":"2023-10-14T19:11:51.531430+0000","last_became_active":"2023-10-14T19:11:50.541344+0000","last_became_peered":"2023-10-14T19:11:50.541344+0000","last_unstale":"2023-10-14T19:11:51.531430+0000","last_undegraded":"2023-10-14T19:11:51.531430+0000","last_fullsized":"2023-10-14T19:11:51.531430+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:48.632072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.551658+0000","last_change":"2023-10-14T19:11:51.549396+0000","last_active":"2023-10-14T19:11:51.551658+0000","last_peered":"2023-10-14T19:11:51.551658+0000","last_clean":"2023-10-14T19:11:51.551658+0000","last_became_active":"2023-10-14T19:11:51.549069+0000","last_became_peered":"2023-10-14T19:11:51.549069+0000","last_unstale":"2023-10-14T19:11:51.551658+0000","last_undegraded":"2023-10-14T19:11:51.551658+0000","last_fullsized":"2023-10-14T19:11:51.551658+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:58.211528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.537470+0000","last_change":"2023-10-14T19:11:50.535461+0000","last_active":"2023-10-14T19:11:50.537470+0000","last_peered":"2023-10-14T19:11:50.537470+0000","last_clean":"2023-10-14T19:11:50.537470+0000","last_became_active":"2023-10-14T19:11:50.535197+0000","last_became_peered":"2023-10-14T19:11:50.535197+0000","last_unstale":"2023-10-14T19:11:50.537470+0000","last_undegraded":"2023-10-14T19:11:50.537470+0000","last_fullsized":"2023-10-14T19:11:50.537470+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:31.839855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.547171+0000","last_change":"2023-10-14T19:11:51.547171+0000","last_active":"2023-10-14T19:11:51.547171+0000","last_peered":"2023-10-14T19:11:51.547171+0000","last_clean":"2023-10-14T19:11:51.547171+0000","last_became_active":"2023-10-14T19:11:51.546743+0000","last_became_peered":"2023-10-14T19:11:51.546743+0000","last_unstale":"2023-10-14T19:11:51.547171+0000","last_undegraded":"2023-10-14T19:11:51.547171+0000","last_fullsized":"2023-10-14T19:11:51.547171+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:08.115205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.546322+0000","last_change":"2023-10-14T19:11:50.540212+0000","last_active":"2023-10-14T19:11:50.546322+0000","last_peered":"2023-10-14T19:11:50.546322+0000","last_clean":"2023-10-14T19:11:50.546322+0000","last_became_active":"2023-10-14T19:11:50.539942+0000","last_became_peered":"2023-10-14T19:11:50.539942+0000","last_unstale":"2023-10-14T19:11:50.546322+0000","last_undegraded":"2023-10-14T19:11:50.546322+0000","last_fullsized":"2023-10-14T19:11:50.546322+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:55.093335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.549538+0000","last_change":"2023-10-14T19:11:51.548079+0000","last_active":"2023-10-14T19:11:51.549538+0000","last_peered":"2023-10-14T19:11:51.549538+0000","last_clean":"2023-10-14T19:11:51.549538+0000","last_became_active":"2023-10-14T19:11:51.547787+0000","last_became_peered":"2023-10-14T19:11:51.547787+0000","last_unstale":"2023-10-14T19:11:51.549538+0000","last_undegraded":"2023-10-14T19:11:51.549538+0000","last_fullsized":"2023-10-14T19:11:51.549538+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:38.769005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.531600+0000","last_change":"2023-10-14T19:11:50.534643+0000","last_active":"2023-10-14T19:11:51.531600+0000","last_peered":"2023-10-14T19:11:51.531600+0000","last_clean":"2023-10-14T19:11:51.531600+0000","last_became_active":"2023-10-14T19:11:50.534423+0000","last_became_peered":"2023-10-14T19:11:50.534423+0000","last_unstale":"2023-10-14T19:11:51.531600+0000","last_undegraded":"2023-10-14T19:11:51.531600+0000","last_fullsized":"2023-10-14T19:11:51.531600+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:38.899830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.544900+0000","last_change":"2023-10-14T19:11:51.540303+0000","last_active":"2023-10-14T19:11:51.544900+0000","last_peered":"2023-10-14T19:11:51.544900+0000","last_clean":"2023-10-14T19:11:51.544900+0000","last_became_active":"2023-10-14T19:11:51.540048+0000","last_became_peered":"2023-10-14T19:11:51.540048+0000","last_unstale":"2023-10-14T19:11:51.544900+0000","last_undegraded":"2023-10-14T19:11:51.544900+0000","last_fullsized":"2023-10-14T19:11:51.544900+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:50.516646+0000","last_clean_scrub_stamp":"2023-10-14T19:11:50.516646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:48:10.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T19:11:51.543919+0000","last_change":"2023-10-14T19:11:50.538101+0000","last_active":"2023-10-14T19:11:51.543919+0000","last_peered":"2023-10-14T19:11:51.543919+0000","last_clean":"2023-10-14T19:11:51.543919+0000","last_became_active":"2023-10-14T19:11:50.537817+0000","last_became_peered":"2023-10-14T19:11:50.537817+0000","last_unstale":"2023-10-14T19:11:51.543919+0000","last_undegraded":"2023-10-14T19:11:51.543919+0000","last_fullsized":"2023-10-14T19:11:51.543919+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:11:49.511866+0000","last_clean_scrub_stamp":"2023-10-14T19:11:49.511866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:44.105766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":295,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-14T19:11:50.528360+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:11:50.528360+0000","last_peered":"2023-10-14T19:11:50.528360+0000","last_clean":"2023-10-14T19:11:50.528360+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:11:50.528360+0000","last_undegraded":"2023-10-14T19:11:50.528360+0000","last_fullsized":"2023-10-14T19:11:50.528360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304232,"kb_used_data":2848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067608,"statfs":{"total":96636764160,"available":96325230592,"internally_reserved":0,"allocated":2916352,"data_stored":1628242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.63800000000000001},"min":{"1min":0.35699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.60999999999999999,"5min":0.80700000000000005,"15min":3.1949999999999998},"last":0.47199999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.64100000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.755,"15min":3.1480000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":2.3610000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89600000000000002,"15min":3.23},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.73299999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74299999999999999,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.436},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.73499999999999999,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.55600000000000005},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.875,"15min":2.4620000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.66900000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.63600000000000001},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":2.883},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.64900000000000002},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":5.383},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1037862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.65800000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":5.6820000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":5.7030000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.745,"5min":0.745,"15min":7.8680000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78900000000000003,"15min":8.0210000000000008},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.78500000000000003},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":8.0090000000000003},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.745},"min":{"1min":0.379,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":8.1890000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.76000000000000001},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":8.1120000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.437}]},{"osd":5,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.54700000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73599999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38200000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.58999999999999997},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.61899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1037750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32400000000000001,"15min":0.314},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63500000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.309},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.624,"15min":0.67300000000000004},"last":0.42099999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.216},"max":{"1min":0.45800000000000002,"5min":0.873,"15min":0.873},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.5},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":1.032},"last":0.375}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.57999999999999996},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.85699999999999998,"5min":1.627,"15min":1.627},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90100000000000002,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.91600000000000004,"15min":1.079},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.38800000000000001},"max":{"1min":0.746,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308332,"kb_used_data":2852,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063508,"statfs":{"total":96636764160,"available":96321032192,"internally_reserved":0,"allocated":2920448,"data_stored":1629654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.34399999999999997},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47599999999999998,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.495,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55400000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.62},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.29699999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77400000000000002,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.39200000000000002},"max":{"1min":0.90700000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.92200000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.96199999999999997,"15min":0.98799999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.51100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.91900000000000004,"15min":0.95599999999999996},"last":0.96299999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.501,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.88700000000000001,"15min":0.96599999999999997},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1038374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20300000000000001},"max":{"1min":0.45400000000000001,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.42499999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":0.65800000000000003,"15min":2.028},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53400000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38100000000000001,"15min":0.69099999999999995},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":11.269},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.66200000000000003},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":11.318},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59599999999999997,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.5},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.67200000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.94699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":11.379},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.95199999999999996},"min":{"1min":0.438,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":11.404},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86599999999999999,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.96499999999999997},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303668,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068172,"statfs":{"total":96636764160,"available":96325808128,"internally_reserved":0,"allocated":2338816,"data_stored":1039896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49099999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.38100000000000001},"min":{"1min":0.308,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32200000000000001,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.58099999999999996,"15min":0.64500000000000002},"last":3.0699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54200000000000004,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.314},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.44700000000000001},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":2.597,"15min":2.597},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.214,"15min":1.214},"last":0.439}]},{"osd":6,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.133,"15min":1.133},"last":0.498},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.44800000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.752,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.379,"15min":0.379},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":0.997},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303648,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068192,"statfs":{"total":96636764160,"available":96325828608,"internally_reserved":0,"allocated":2318336,"data_stored":1037820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.53900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.752,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.88600000000000001,"15min":3.488},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":1.589,"15min":1.589},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74299999999999999,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.61799999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":1.1950000000000001,"15min":3.5230000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48799999999999999,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64500000000000002,"5min":0.81299999999999994,"15min":1.2949999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.627,"5min":1.222,"15min":1.5269999999999999},"last":0.503}]},{"osd":6,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.65900000000000003,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.441},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.626},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Oct 14 19:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57999999999999996,"15min":0.64000000000000001},"min":{"1min":0.42199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.38100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1044038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32700000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.83199999999999996,"5min":1.784,"15min":1.784},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.876},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.75900000000000001},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.88100000000000001,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.437}]},{"osd":3,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71299999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.35799999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.497}]},{"osd":7,"last update":"Sat Oct 14 19:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":1.008,"15min":1.008},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:11:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:11:56.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:11:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.186+0000 7f19d8b2a700 1 Processor -- start 2023-10-14T19:11:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.186+0000 7f19d8b2a700 1 -- start start 2023-10-14T19:11:56.191 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.187+0000 7f19d8b2a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 0x7f19d4069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.187+0000 7f19d8b2a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f19d40cc6f0 0x7f19d4069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.187+0000 7f19d8b2a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d406d7b0 con 0x7f19d40cc320 2023-10-14T19:11:56.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.187+0000 7f19d8b2a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d406f7d0 con 0x7f19d40cc6f0 2023-10-14T19:11:56.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.187+0000 7f19d8b2a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d406e330 con 0x7f19d413c9b0 2023-10-14T19:11:56.192 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d259c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f19d40cc320 0x7f19d413c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46214/0 (socket says 172.21.15.7:46214) 2023-10-14T19:11:56.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d259c700 1 -- 172.21.15.7:0/3131628773 learned_addr learned my addr 172.21.15.7:0/3131628773 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:56.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d1d9b700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 0x7f19d4069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d2d9d700 1 --2- 172.21.15.7:0/3131628773 >> v2:172.21.15.148:3300/0 conn(0x7f19d40cc6f0 0x7f19d4069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867990136 0 0) 0x7f19d406d7b0 con 0x7f19d40cc320 2023-10-14T19:11:56.193 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c0003570 con 0x7f19d40cc320 2023-10-14T19:11:56.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3212254899 0 0) 0x7f19c0003570 con 0x7f19d40cc320 2023-10-14T19:11:56.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 msgr2=0x7f19d4069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:56.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 0x7f19d4069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.194 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 >> v2:172.21.15.148:3300/0 conn(0x7f19d40cc6f0 msgr2=0x7f19d4069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:56.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 --2- 172.21.15.7:0/3131628773 >> v2:172.21.15.148:3300/0 conn(0x7f19d40cc6f0 0x7f19d4069f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d406da00 con 0x7f19d40cc320 2023-10-14T19:11:56.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f19cc001470 con 0x7f19d40cc320 2023-10-14T19:11:56.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 >> v1:172.21.15.7:6789/0 conn(0x7f19d40cc320 legacy=0x7f19d413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19c0003a60 0x7f19c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.195 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19c0004810 0x7f19c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 0x7f19c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d406f7d0 con 0x7f19c0003a60 2023-10-14T19:11:56.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d406e330 con 0x7f19c0004810 2023-10-14T19:11:56.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c000bae0 con 0x7f19d413c9b0 2023-10-14T19:11:56.196 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.188+0000 7f19d259c700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19c0003a60 0x7f19c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d2d9d700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 0x7f19c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d1d9b700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19c0004810 0x7f19c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d259c700 1 -- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 msgr2=0x7f19c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d259c700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19d413c9b0 0x7f19c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d259c700 1 -- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19c0004810 msgr2=0x7f19c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:56.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d259c700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19c0004810 0x7f19c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d259c700 1 -- 172.21.15.7:0/3131628773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0003570 con 0x7f19c0003a60 2023-10-14T19:11:56.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d259c700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19c0003a60 0x7f19c0003e70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c3c0 tx=0x7f19cc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688efa29638d905 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:56.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00cc90 con 0x7f19c0003a60 2023-10-14T19:11:56.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00ce10 con 0x7f19c0003a60 2023-10-14T19:11:56.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d159a700 1 -- 172.21.15.7:0/3131628773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc005b70 con 0x7f19c0003a60 2023-10-14T19:11:56.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3131628773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19c0003a60 msgr2=0x7f19c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3131628773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19c0003a60 0x7f19c0003e70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c3c0 tx=0x7f19cc001e90 comp rx=0 tx=0).stop 2023-10-14T19:11:56.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.189+0000 7f19d2d9d700 1 -- 172.21.15.7:0/3131628773 reap_dead start 2023-10-14T19:11:56.199 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.190+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3131628773 shutdown_connections 2023-10-14T19:11:56.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.190+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3131628773 >> 172.21.15.7:0/3131628773 conn(0x7f19d4067f00 msgr2=0x7f19d4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:56.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.190+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3131628773 shutdown_connections 2023-10-14T19:11:56.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.190+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3131628773 wait complete. 2023-10-14T19:11:56.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 Processor -- start 2023-10-14T19:11:56.200 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 -- start start 2023-10-14T19:11:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19c0003a60 0x7f19d416d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 0x7f19d40c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d40c7c20 0x7f19d413b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d413aed0 con 0x7f19d4139de0 2023-10-14T19:11:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d413a2c0 con 0x7f19d40c7c20 2023-10-14T19:11:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.191+0000 7f19d8b2a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d413a5a0 con 0x7f19c0003a60 2023-10-14T19:11:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 0x7f19d40c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 0x7f19d40c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58172/0 (socket says 172.21.15.7:58172) 2023-10-14T19:11:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 -- 172.21.15.7:0/3760427718 learned_addr learned my addr 172.21.15.7:0/3760427718 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d259c700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19c0003a60 0x7f19d416d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 -- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19c0003a60 msgr2=0x7f19d416d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19c0003a60 0x7f19d416d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 -- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d40c7c20 msgr2=0x7f19d413b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d2d9d700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d40c7c20 0x7f19d413b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d40c7c20 0x7f19d413b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 -- 172.21.15.7:0/3760427718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d413a880 con 0x7f19d4139de0 2023-10-14T19:11:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d1d9b700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 0x7f19d40c76e0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f19bc011990 tx=0x7f19bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00f6d0 con 0x7f19d4139de0 2023-10-14T19:11:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00f830 con 0x7f19d4139de0 2023-10-14T19:11:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d413ab60 con 0x7f19d4139de0 2023-10-14T19:11:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00fbf0 con 0x7f19d4139de0 2023-10-14T19:11:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.192+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d413b8a0 con 0x7f19d4139de0 2023-10-14T19:11:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.193+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d413bb20 con 0x7f19d4139de0 2023-10-14T19:11:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.194+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f19bc015460 con 0x7f19d4139de0 2023-10-14T19:11:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.194+0000 7f19ca7fc700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f19b4067320 0x7f19b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.194+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19bc084f60 con 0x7f19d4139de0 2023-10-14T19:11:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.195+0000 7f19d259c700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f19b4067320 0x7f19b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.195+0000 7f19d259c700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f19b4067320 0x7f19b40697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001ed0 tx=0x7f19cc015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:56.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.198+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19bc055680 con 0x7f19d4139de0 2023-10-14T19:11:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.472+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f19d404c3c0 con 0x7f19d4139de0 2023-10-14T19:11:56.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.476+0000 7f19ca7fc700 1 -- 172.21.15.7:0/3760427718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f19bc0220e0 con 0x7f19d4139de0 2023-10-14T19:11:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f19b4067320 msgr2=0x7f19b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f19b4067320 0x7f19b40697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001ed0 tx=0x7f19cc015000 comp rx=0 tx=0).stop 2023-10-14T19:11:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 msgr2=0x7f19d40c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 0x7f19d40c76e0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f19bc011990 tx=0x7f19bc008040 comp rx=0 tx=0).stop 2023-10-14T19:11:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 shutdown_connections 2023-10-14T19:11:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f19b4067320 0x7f19b40697d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d40c7c20 0x7f19d413b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19c0003a60 0x7f19d416d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 --2- 172.21.15.7:0/3760427718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d4139de0 0x7f19d40c76e0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 >> 172.21.15.7:0/3760427718 conn(0x7f19d4067f00 msgr2=0x7f19d4153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 shutdown_connections 2023-10-14T19:11:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.478+0000 7f19d8b2a700 1 -- 172.21.15.7:0/3760427718 wait complete. 2023-10-14T19:11:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:11:56.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:11:56.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.610+0000 7f771e8a5700 1 Processor -- start 2023-10-14T19:11:56.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.610+0000 7f771e8a5700 1 -- start start 2023-10-14T19:11:56.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771e8a5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7718153c30 0x7f771815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771e8a5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77180cf110 0x7f771815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771e8a5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771815afd0 con 0x7f771815de50 2023-10-14T19:11:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771e8a5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771815b2b0 con 0x7f7718153c30 2023-10-14T19:11:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771e8a5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771815b590 con 0x7f77180cf110 2023-10-14T19:11:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771d8a3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7718153c30 0x7f771815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771e0a4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77180cf110 0x7f771815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771d8a3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7718153c30 0x7f771815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:56672/0 (socket says 172.21.15.7:56672) 2023-10-14T19:11:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771d0a2700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f771815de50 0x7f77180cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:36924/0 (socket says 172.21.15.7:36924) 2023-10-14T19:11:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.611+0000 7f771d8a3700 1 -- 172.21.15.7:0/3382609665 learned_addr learned my addr 172.21.15.7:0/3382609665 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771d8a3700 1 -- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77180cf110 msgr2=0x7f771815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771d8a3700 1 --2- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77180cf110 0x7f771815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771d8a3700 1 -- 172.21.15.7:0/3382609665 >> v1:172.21.15.148:6789/0 conn(0x7f771815de50 legacy=0x7f77180cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771d8a3700 1 -- 172.21.15.7:0/3382609665 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771815b870 con 0x7f7718153c30 2023-10-14T19:11:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771d8a3700 1 --2- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f771815a5e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f77100099b0 tx=0x7f7710009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65aa777d9e6d734e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771c8a1700 1 -- 172.21.15.7:0/3382609665 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710009ea0 con 0x7f7718153c30 2023-10-14T19:11:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771c8a1700 1 -- 172.21.15.7:0/3382609665 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771000b860 con 0x7f7718153c30 2023-10-14T19:11:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.612+0000 7f771c8a1700 1 -- 172.21.15.7:0/3382609665 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000bc00 con 0x7f7718153c30 2023-10-14T19:11:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 -- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 msgr2=0x7f771815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 --2- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f771815a5e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f77100099b0 tx=0x7f7710009250 comp rx=0 tx=0).stop 2023-10-14T19:11:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 -- 172.21.15.7:0/3382609665 shutdown_connections 2023-10-14T19:11:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 --2- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77180cf110 0x7f771815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 --2- 172.21.15.7:0/3382609665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f771815a5e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 -- 172.21.15.7:0/3382609665 >> 172.21.15.7:0/3382609665 conn(0x7f77180703a0 msgr2=0x7f77180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 -- 172.21.15.7:0/3382609665 shutdown_connections 2023-10-14T19:11:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.613+0000 7f771e8a5700 1 -- 172.21.15.7:0/3382609665 wait complete. 2023-10-14T19:11:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.614+0000 7f771e8a5700 1 Processor -- start 2023-10-14T19:11:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.614+0000 7f771e8a5700 1 -- start start 2023-10-14T19:11:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e8a5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 0x7f77180cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e8a5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f7718151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e8a5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f771815de50 0x7f7718151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e8a5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180cd910 con 0x7f77180cf110 2023-10-14T19:11:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e8a5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180b3d30 con 0x7f7718153c30 2023-10-14T19:11:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e8a5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77181518d0 con 0x7f771815de50 2023-10-14T19:11:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 0x7f77180cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 0x7f77180cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58188/0 (socket says 172.21.15.7:58188) 2023-10-14T19:11:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 -- 172.21.15.7:0/962670922 learned_addr learned my addr 172.21.15.7:0/962670922 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d0a2700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f7718151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771e0a4700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f771815de50 0x7f7718151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 -- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f771815de50 msgr2=0x7f7718151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f771815de50 0x7f7718151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 -- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 msgr2=0x7f7718151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f7718151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 -- 172.21.15.7:0/962670922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77100094f0 con 0x7f77180cf110 2023-10-14T19:11:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f771d8a3700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 0x7f77180cd330 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7710006fd0 tx=0x7f7710017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.615+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000bbe0 con 0x7f77180cf110 2023-10-14T19:11:56.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.616+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710000c90 con 0x7f77180cf110 2023-10-14T19:11:56.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.616+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180b3400 con 0x7f77180cf110 2023-10-14T19:11:56.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.616+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710011650 con 0x7f77180cf110 2023-10-14T19:11:56.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.616+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77180b39c0 con 0x7f77180cf110 2023-10-14T19:11:56.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.617+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771804c3c0 con 0x7f77180cf110 2023-10-14T19:11:56.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.617+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7710011a40 con 0x7f77180cf110 2023-10-14T19:11:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.617+0000 7f7715ffb700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7704067320 0x7f77040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.618+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7710086410 con 0x7f77180cf110 2023-10-14T19:11:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.618+0000 7f771d0a2700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7704067320 0x7f77040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.618+0000 7f771d0a2700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7704067320 0x7f77040697d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f770c004fd0 tx=0x7f770c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.622+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77100530a0 con 0x7f77180cf110 2023-10-14T19:11:56.855 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-10-14T19:11:56.854+0000 7f6977fcb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:11:56.861 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.861+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77180b4010 con 0x7f77180cf110 2023-10-14T19:11:56.862 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.861+0000 7f7715ffb700 1 -- 172.21.15.7:0/962670922 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f77100566c0 con 0x7f77180cf110 2023-10-14T19:11:56.862 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:11:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":121,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:11:54.539953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:11:56.864 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.863+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7704067320 msgr2=0x7f77040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.863+0000 7f771e8a5700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7704067320 0x7f77040697d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f770c004fd0 tx=0x7f770c007eb0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 msgr2=0x7f77180cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:56.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 0x7f77180cd330 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7710006fd0 tx=0x7f7710017000 comp rx=0 tx=0).stop 2023-10-14T19:11:56.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 shutdown_connections 2023-10-14T19:11:56.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7704067320 0x7f77040697d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f771815de50 0x7f7718151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77180cf110 0x7f77180cd330 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 --2- 172.21.15.7:0/962670922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7718153c30 0x7f7718151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:56.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 >> 172.21.15.7:0/962670922 conn(0x7f77180703a0 msgr2=0x7f77180b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:56.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 shutdown_connections 2023-10-14T19:11:56.867 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:56.864+0000 7f771e8a5700 1 -- 172.21.15.7:0/962670922 wait complete. 2023-10-14T19:11:56.867 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 121 2023-10-14T19:11:57.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:11:50.936466+0000', 'modified': '2023-10-14T19:11:54.539953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8721}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8721': {'gid': 8721, 'name': 'b', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6836/2050437130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 2050437130}, {'type': 'v1', 'addr': '172.21.15.148:6836', 'nonce': 2050437130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:11:57.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:11:57.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T19:11:57.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.402+0000 7f7c1339e700 1 Processor -- start 2023-10-14T19:11:57.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.402+0000 7f7c1339e700 1 -- start start 2023-10-14T19:11:57.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.403+0000 7f7c1339e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7c0c0caa00 0x7f7c0c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.403+0000 7f7c1339e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0c3d00 con 0x7f7c0c0c95c0 2023-10-14T19:11:57.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.403+0000 7f7c1339e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0cd660 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.403+0000 7f7c1339e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c3110 con 0x7f7c0c0caa00 2023-10-14T19:11:57.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.403+0000 7f7c1239c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7c0c0c95c0 0x7f7c0c157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54332/0 (socket says 172.21.15.7:54332) 2023-10-14T19:11:57.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c1239c700 1 -- 172.21.15.7:0/889663834 learned_addr learned my addr 172.21.15.7:0/889663834 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:57.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/889663834 >> v2:172.21.15.148:3300/0 conn(0x7f7c0c0caa00 0x7f7c0c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c1139a700 1 -- 172.21.15.7:0/889663834 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438123317 0 0) 0x7f7c0c0c3d00 con 0x7f7c0c0c95c0 2023-10-14T19:11:57.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c1139a700 1 -- 172.21.15.7:0/889663834 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf4003570 con 0x7f7c0c0c95c0 2023-10-14T19:11:57.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c1139a700 1 -- 172.21.15.7:0/889663834 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292104707 0 0) 0x7f7bf4003570 con 0x7f7c0c0c95c0 2023-10-14T19:11:57.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c11b9b700 1 -- 172.21.15.7:0/889663834 >> v1:172.21.15.148:6789/0 conn(0x7f7c0c0aaec0 legacy=0x7f7c0c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c11b9b700 1 -- 172.21.15.7:0/889663834 >> v1:172.21.15.7:6789/0 conn(0x7f7c0c0c95c0 legacy=0x7f7c0c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c11b9b700 1 -- 172.21.15.7:0/889663834 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0c33d0 con 0x7f7c0c0caa00 2023-10-14T19:11:57.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/889663834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c0caa00 0x7f7c0c1579a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c000098e0 tx=0x7f7c000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa62fef68919a9b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.404+0000 7f7c1139a700 1 -- 172.21.15.7:0/889663834 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04001970 con 0x7f7c0c0caa00 2023-10-14T19:11:57.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1139a700 1 -- 172.21.15.7:0/889663834 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00011420 con 0x7f7c0c0caa00 2023-10-14T19:11:57.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1139a700 1 -- 172.21.15.7:0/889663834 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000117a0 con 0x7f7c0c0caa00 2023-10-14T19:11:57.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 -- 172.21.15.7:0/889663834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c0caa00 msgr2=0x7f7c0c1579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 --2- 172.21.15.7:0/889663834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c0caa00 0x7f7c0c1579a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c000098e0 tx=0x7f7c000091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 -- 172.21.15.7:0/889663834 shutdown_connections 2023-10-14T19:11:57.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 --2- 172.21.15.7:0/889663834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c0caa00 0x7f7c0c1579a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 -- 172.21.15.7:0/889663834 >> 172.21.15.7:0/889663834 conn(0x7f7c0c088000 msgr2=0x7f7c0c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 -- 172.21.15.7:0/889663834 shutdown_connections 2023-10-14T19:11:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.405+0000 7f7c1339e700 1 -- 172.21.15.7:0/889663834 wait complete. 2023-10-14T19:11:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.406+0000 7f7c1339e700 1 Processor -- start 2023-10-14T19:11:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.406+0000 7f7c1339e700 1 -- start start 2023-10-14T19:11:57.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1339e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 0x7f7c0c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1339e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c0c0c95c0 0x7f7c0c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1339e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c1499e0 0x7f7c0c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1339e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c151120 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1339e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c158040 con 0x7f7c0c1499e0 2023-10-14T19:11:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1339e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c151310 con 0x7f7c0c0c95c0 2023-10-14T19:11:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 0x7f7c0c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 0x7f7c0c1529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40634/0 (socket says 172.21.15.7:40634) 2023-10-14T19:11:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 -- 172.21.15.7:0/2484234739 learned_addr learned my addr 172.21.15.7:0/2484234739 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 -- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c0c0c95c0 msgr2=0x7f7c0c150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c0c0c95c0 0x7f7c0c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 -- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c1499e0 msgr2=0x7f7c0c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c1499e0 0x7f7c0c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c1499e0 0x7f7c0c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 -- 172.21.15.7:0/2484234739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009420 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c1499e0 0x7f7c0c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.407+0000 7f7c1239c700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 0x7f7c0c1529c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400cbe0 tx=0x7f7c04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.408+0000 7f7c0a7fc700 1 -- 172.21.15.7:0/2484234739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04005d80 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.408+0000 7f7c0a7fc700 1 -- 172.21.15.7:0/2484234739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0400a6f0 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.408+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c1515f0 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.408+0000 7f7c0a7fc700 1 -- 172.21.15.7:0/2484234739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400aab0 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.408+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c151bb0 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.409+0000 7f7c0a7fc700 1 -- 172.21.15.7:0/2484234739 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7c040070f0 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.409+0000 7f7c0a7fc700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7bf8067320 0x7f7bf80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.409+0000 7f7c0a7fc700 1 -- 172.21.15.7:0/2484234739 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c04084d80 con 0x7f7c0c0aaec0 2023-10-14T19:11:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.410+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7bf8067320 0x7f7bf80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.410+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7bf8067320 0x7f7bf80697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0c85e0 tx=0x7f7c00016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 Processor -- start 2023-10-14T19:11:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 -- start start 2023-10-14T19:11:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a639c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a63bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a6372ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.437 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a62c9a70 con 0x5626a63bd480 2023-10-14T19:11:57.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a62c7270 con 0x5626a63705f0 2023-10-14T19:11:57.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a62c3060 con 0x5626a6372b80 2023-10-14T19:11:57.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1239c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a639c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1239c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a639c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40648/0 (socket says 172.21.15.7:40648) 2023-10-14T19:11:57.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.412+0000 7f7c1239c700 1 -- 172.21.15.7:0/1525362747 learned_addr learned my addr 172.21.15.7:0/1525362747 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:57.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a63bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a6372ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c1239c700 1 -- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 msgr2=0x5626a6372ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c1239c700 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a6372ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c1239c700 1 -- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 msgr2=0x5626a63bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c1239c700 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a63bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c1239c700 1 -- 172.21.15.7:0/1525362747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626a615d270 con 0x5626a63bd480 2023-10-14T19:11:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a6372ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7c1239c700 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a639c7d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400a3f0 tx=0x7f7c04051a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4921bcfc6777281a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7bf37fe700 1 -- 172.21.15.7:0/1525362747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c040557d0 con 0x5626a63bd480 2023-10-14T19:11:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7bf37fe700 1 -- 172.21.15.7:0/1525362747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c040589a0 con 0x5626a63bd480 2023-10-14T19:11:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.413+0000 7f7bf37fe700 1 -- 172.21.15.7:0/1525362747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0405c6f0 con 0x5626a63bd480 2023-10-14T19:11:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1525362747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 msgr2=0x5626a639c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a639c7d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400a3f0 tx=0x7f7c04051a90 comp rx=0 tx=0).stop 2023-10-14T19:11:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1525362747 shutdown_connections 2023-10-14T19:11:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a6372ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a639c7d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1525362747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a63bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1525362747 >> 172.21.15.7:0/1525362747 conn(0x5626a63740c0 msgr2=0x5626a63748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1525362747 shutdown_connections 2023-10-14T19:11:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1525362747 wait complete. 2023-10-14T19:11:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.414+0000 7f7c1d8f9b80 1 -- start start 2023-10-14T19:11:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 Processor -- start 2023-10-14T19:11:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 0x5626a639e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a639b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a626e890 con 0x5626a6372b80 2023-10-14T19:11:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a6289ea0 con 0x5626a63705f0 2023-10-14T19:11:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.415+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a6145e30 con 0x5626a63bd480 2023-10-14T19:11:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c1d8f9b80 10 client.0 _ll_register_callbacks cb 0x5626a63362c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:11:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 0x5626a639e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 0x5626a639e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40664/0 (socket says 172.21.15.7:40664) 2023-10-14T19:11:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 -- 172.21.15.7:0/1239433339 learned_addr learned my addr 172.21.15.7:0/1239433339 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c1239c700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a639b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 -- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 msgr2=0x5626a639b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a639b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 -- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 msgr2=0x5626a6394a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 -- 172.21.15.7:0/1239433339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c151bb0 con 0x5626a6372b80 2023-10-14T19:11:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 0x5626a639e2a0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7c00002000 tx=0x7f7c0001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb34dd3c0a816abe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7bf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:11:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/1239433339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0001c920 con 0x5626a6372b80 2023-10-14T19:11:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/1239433339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c00032af0 con 0x5626a6372b80 2023-10-14T19:11:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626a6367cd0 con 0x5626a6372b80 2023-10-14T19:11:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.416+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/1239433339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c0001ca80 con 0x5626a6372b80 2023-10-14T19:11:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 10 client.8850 fetch_fsmap learned FSMap version 121 2023-10-14T19:11:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x5626a60fffe0 con 0x5626a6372b80 2023-10-14T19:11:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/1239433339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626a6367cd0 con 0x5626a6372b80 2023-10-14T19:11:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/1239433339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c0001cbe0 con 0x5626a6372b80 2023-10-14T19:11:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 10 client.8850 fetch_fsmap finished waiting for FSMap version 121 2023-10-14T19:11:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 10 client.8850 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T19:11:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 20 client.8850 populate_metadata read hostname 'smithi007' 2023-10-14T19:11:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a6395480 0x5626a6395850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 4 client.8850 mds_command: new command op to 8721 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:11:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 --> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626a6344aa0 con 0x5626a6395480 2023-10-14T19:11:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.417+0000 7f7c1239c700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a6395480 0x5626a6395850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7bf0ff9700 10 client.8850 ms_handle_connect on v2:172.21.15.148:6834/2050437130 2023-10-14T19:11:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1239c700 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a6395480 0x5626a6395850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f146abb8e851181a server_cookie=d1e64a7084ac7dd0 in_seq=0 out_seq=0 2023-10-14T19:11:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/1239433339 <== mds.0 v2:172.21.15.148:6834/2050437130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5626a6344aa0 con 0x5626a6395480 2023-10-14T19:11:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7bf0ff9700 10 client.8850 handle_command_reply: tid=0 2023-10-14T19:11:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 client.8850 shutdown 2023-10-14T19:11:57.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 msgr2=0x5626a639e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 0x5626a639e2a0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7c00002000 tx=0x7f7c0001e040 comp rx=0 tx=0).stop 2023-10-14T19:11:57.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 shutdown_connections 2023-10-14T19:11:57.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a6395480 0x5626a6395850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a639b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/1239433339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a6372b80 0x5626a639e2a0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7bf0ff9700 0 client.8850 ms_handle_reset on v2:172.21.15.148:6834/2050437130 2023-10-14T19:11:57.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.418+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 >> 172.21.15.7:0/1239433339 conn(0x5626a63740c0 msgr2=0x5626a6369b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.419+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 shutdown_connections 2023-10-14T19:11:57.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.419+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/1239433339 wait complete. 2023-10-14T19:11:57.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.419+0000 7f7c1d8f9b80 20 client.8850 trim_cache size 0 max 16384 2023-10-14T19:11:57.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.436+0000 7f7c1d8f9b80 1 Processor -- start 2023-10-14T19:11:57.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.436+0000 7f7c1d8f9b80 1 -- start start 2023-10-14T19:11:57.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6376220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a636fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a636ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a63bc3b0 con 0x5626a63bd480 2023-10-14T19:11:57.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a6394090 con 0x5626a63705f0 2023-10-14T19:11:57.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a63a0050 con 0x5626a6372b80 2023-10-14T19:11:57.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a636ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a636ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40672/0 (socket says 172.21.15.7:40672) 2023-10-14T19:11:57.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 -- 172.21.15.7:0/3551751011 learned_addr learned my addr 172.21.15.7:0/3551751011 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:57.470 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c1239c700 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6376220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a636fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 -- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 msgr2=0x5626a636fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a636fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 -- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 msgr2=0x5626a6376220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6376220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 -- 172.21.15.7:0/3551751011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626a6291780 con 0x5626a63bd480 2023-10-14T19:11:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a636ffb0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0035c0 tx=0x7f7bfc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486e426d5bde4b66 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7bf3fff700 1 -- 172.21.15.7:0/3551751011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc014430 con 0x5626a63bd480 2023-10-14T19:11:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7bf3fff700 1 -- 172.21.15.7:0/3551751011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00d040 con 0x5626a63bd480 2023-10-14T19:11:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.437+0000 7f7bf3fff700 1 -- 172.21.15.7:0/3551751011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0147e0 con 0x5626a63bd480 2023-10-14T19:11:57.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3551751011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 msgr2=0x5626a636ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a636ffb0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0035c0 tx=0x7f7bfc009040 comp rx=0 tx=0).stop 2023-10-14T19:11:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3551751011 shutdown_connections 2023-10-14T19:11:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a63705f0 0x5626a6376220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63bd480 0x5626a636ffb0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3551751011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a6372b80 0x5626a636fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3551751011 >> 172.21.15.7:0/3551751011 conn(0x5626a63740c0 msgr2=0x5626a6394a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3551751011 shutdown_connections 2023-10-14T19:11:57.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3551751011 wait complete. 2023-10-14T19:11:57.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 -- start start 2023-10-14T19:11:57.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.438+0000 7f7c1d8f9b80 1 Processor -- start 2023-10-14T19:11:57.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a6372b80 0x5626a6422ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a63d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a6374520 con 0x5626a63705f0 2023-10-14T19:11:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a63d1080 con 0x5626a6372b80 2023-10-14T19:11:57.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a63950f0 con 0x5626a63bd480 2023-10-14T19:11:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1d8f9b80 10 client.0 _ll_register_callbacks cb 0x5626a63362c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:11:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.439+0000 7f7c1239c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40680/0 (socket says 172.21.15.7:40680) 2023-10-14T19:11:57.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 -- 172.21.15.7:0/3538210658 learned_addr learned my addr 172.21.15.7:0/3538210658 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:57.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a6372b80 0x5626a6422ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a63d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 -- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 msgr2=0x5626a63d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a63d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 -- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a6372b80 msgr2=0x5626a6422ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:57.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a6372b80 0x5626a6422ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 -- 172.21.15.7:0/3538210658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c0cd660 con 0x5626a63705f0 2023-10-14T19:11:57.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a6372b80 0x5626a6422ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:57.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c12b9d700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a63d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:57.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1239c700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 0x5626a6394a40 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f7c04000f80 tx=0x7f7c0405e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45bd027fe115958 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7bf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:11:57.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/3538210658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04062040 con 0x5626a63705f0 2023-10-14T19:11:57.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/3538210658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c0400ac10 con 0x5626a63705f0 2023-10-14T19:11:57.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626a6373220 con 0x5626a63705f0 2023-10-14T19:11:57.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/3538210658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c04054e50 con 0x5626a63705f0 2023-10-14T19:11:57.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1d8f9b80 10 client.8856 fetch_fsmap learned FSMap version 121 2023-10-14T19:11:57.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x5626a6278470 con 0x5626a63705f0 2023-10-14T19:11:57.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/3538210658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626a6373220 con 0x5626a63705f0 2023-10-14T19:11:57.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/3538210658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c0405c260 con 0x5626a63705f0 2023-10-14T19:11:57.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.440+0000 7f7c1d8f9b80 10 client.8856 fetch_fsmap finished waiting for FSMap version 121 2023-10-14T19:11:57.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 10 client.8856 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T19:11:57.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 20 client.8856 populate_metadata read hostname 'smithi007' 2023-10-14T19:11:57.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a636fa70 0x5626a636fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 4 client.8856 mds_command: new command op to 8721 tid=0[{"prefix": "status"}] 2023-10-14T19:11:57.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 --> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f7c040589a0 con 0x5626a636fa70 2023-10-14T19:11:57.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a636fa70 0x5626a636fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7bf0ff9700 10 client.8856 ms_handle_connect on v2:172.21.15.148:6834/2050437130 2023-10-14T19:11:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c11b9b700 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a636fa70 0x5626a636fe40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=500337a7466a2597 server_cookie=9c7d2cca4a1cfe19 in_seq=0 out_seq=0 2023-10-14T19:11:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7bf0ff9700 1 -- 172.21.15.7:0/3538210658 <== mds.0 v2:172.21.15.148:6834/2050437130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f7c040589a0 con 0x5626a636fa70 2023-10-14T19:11:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7bf0ff9700 10 client.8856 handle_command_reply: tid=0 2023-10-14T19:11:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 client.8856 shutdown 2023-10-14T19:11:57.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 msgr2=0x5626a6394a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 0x5626a6394a40 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f7c04000f80 tx=0x7f7c0405e040 comp rx=0 tx=0).stop 2023-10-14T19:11:57.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 shutdown_connections 2023-10-14T19:11:57.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:6834/2050437130,v1:172.21.15.148:6836/2050437130] conn(0x5626a636fa70 0x5626a636fe40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5626a63bd480 0x5626a63d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626a63705f0 0x5626a6394a40 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 --2- 172.21.15.7:0/3538210658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626a6372b80 0x5626a6422ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7bf0ff9700 0 client.8856 ms_handle_reset on v2:172.21.15.148:6834/2050437130 2023-10-14T19:11:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.441+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 >> 172.21.15.7:0/3538210658 conn(0x5626a63740c0 msgr2=0x5626a6376220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 shutdown_connections 2023-10-14T19:11:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1d8f9b80 1 -- 172.21.15.7:0/3538210658 wait complete. 2023-10-14T19:11:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1d8f9b80 20 client.8856 trim_cache size 0 max 16384 2023-10-14T19:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8721, 2023-10-14T19:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.9182897370000003, 2023-10-14T19:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 121, 2023-10-14T19:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 183, 2023-10-14T19:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 183, 2023-10-14T19:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.95809655 2023-10-14T19:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:11:57.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7bf8067320 msgr2=0x7f7bf80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7bf8067320 0x7f7bf80697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0c85e0 tx=0x7f7c00016000 comp rx=0 tx=0).stop 2023-10-14T19:11:57.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 msgr2=0x7f7c0c1529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 0x7f7c0c1529c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400cbe0 tx=0x7f7c04001ae0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 shutdown_connections 2023-10-14T19:11:57.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7bf8067320 0x7f7bf80697d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c1499e0 0x7f7c0c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c0c0aaec0 0x7f7c0c1529c0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 --2- 172.21.15.7:0/2484234739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c0c0c95c0 0x7f7c0c150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 >> 172.21.15.7:0/2484234739 conn(0x7f7c0c088000 msgr2=0x7f7c0c1538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 shutdown_connections 2023-10-14T19:11:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.442+0000 7f7c1339e700 1 -- 172.21.15.7:0/2484234739 wait complete. 2023-10-14T19:11:57.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:11:57.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.615+0000 7f060b632700 1 Processor -- start 2023-10-14T19:11:57.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.616+0000 7f060b632700 1 -- start start 2023-10-14T19:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.616+0000 7f060b632700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040aee90 0x7f06040a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.616+0000 7f060b632700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040ce1a0 con 0x7f060406d280 2023-10-14T19:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.616+0000 7f060b632700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040cd5d0 con 0x7f06040a8be0 2023-10-14T19:11:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.616+0000 7f060b632700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06040cd870 con 0x7f06040aee90 2023-10-14T19:11:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0609bcf700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f060406d280 0x7f06040b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54348/0 (socket says 172.21.15.7:54348) 2023-10-14T19:11:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0609bcf700 1 -- 172.21.15.7:0/1552482904 learned_addr learned my addr 172.21.15.7:0/1552482904 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0608bcd700 1 --2- 172.21.15.7:0/1552482904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040aee90 0x7f06040a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245824418 0 0) 0x7f06040ce1a0 con 0x7f060406d280 2023-10-14T19:11:57.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ec003570 con 0x7f060406d280 2023-10-14T19:11:57.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46966950 0 0) 0x7f06040cd5d0 con 0x7f06040a8be0 2023-10-14T19:11:57.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06040ce1a0 con 0x7f06040a8be0 2023-10-14T19:11:57.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0608bcd700 1 -- 172.21.15.7:0/1552482904 >> v1:172.21.15.148:6789/0 conn(0x7f06040a8be0 legacy=0x7f06040ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924128888 0 0) 0x7f05ec003570 con 0x7f060406d280 2023-10-14T19:11:57.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0608bcd700 1 -- 172.21.15.7:0/1552482904 >> v1:172.21.15.7:6789/0 conn(0x7f060406d280 legacy=0x7f06040b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0608bcd700 1 -- 172.21.15.7:0/1552482904 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040cdb50 con 0x7f06040aee90 2023-10-14T19:11:57.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.617+0000 7f0608bcd700 1 --2- 172.21.15.7:0/1552482904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040aee90 0x7f06040a8fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009900 tx=0x7f05f8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b04948c8795320 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4001470 con 0x7f06040aee90 2023-10-14T19:11:57.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8011420 con 0x7f06040aee90 2023-10-14T19:11:57.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f0603fff700 1 -- 172.21.15.7:0/1552482904 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80117c0 con 0x7f06040aee90 2023-10-14T19:11:57.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 -- 172.21.15.7:0/1552482904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040aee90 msgr2=0x7f06040a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 --2- 172.21.15.7:0/1552482904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040aee90 0x7f06040a8fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009900 tx=0x7f05f8009120 comp rx=0 tx=0).stop 2023-10-14T19:11:57.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 -- 172.21.15.7:0/1552482904 shutdown_connections 2023-10-14T19:11:57.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 --2- 172.21.15.7:0/1552482904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040aee90 0x7f06040a8fb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 -- 172.21.15.7:0/1552482904 >> 172.21.15.7:0/1552482904 conn(0x7f060406ce80 msgr2=0x7f06040ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 -- 172.21.15.7:0/1552482904 shutdown_connections 2023-10-14T19:11:57.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.618+0000 7f060b632700 1 -- 172.21.15.7:0/1552482904 wait complete. 2023-10-14T19:11:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.619+0000 7f060b632700 1 Processor -- start 2023-10-14T19:11:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.619+0000 7f060b632700 1 -- start start 2023-10-14T19:11:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f060b632700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f060406d280 0x7f06040990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f060b632700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040a8be0 0x7f06040ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f060b632700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 0x7f06040ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f060b632700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060409a770 con 0x7f06040aee90 2023-10-14T19:11:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f060b632700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0604099b60 con 0x7f060406d280 2023-10-14T19:11:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f060b632700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0604099e40 con 0x7f06040a8be0 2023-10-14T19:11:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f0609bcf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 0x7f06040ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f0609bcf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 0x7f06040ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40690/0 (socket says 172.21.15.7:40690) 2023-10-14T19:11:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f0609bcf700 1 -- 172.21.15.7:0/1218787811 learned_addr learned my addr 172.21.15.7:0/1218787811 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.620+0000 7f0608bcd700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040a8be0 0x7f06040ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f06093ce700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f060406d280 0x7f06040990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0609bcf700 1 -- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040a8be0 msgr2=0x7f06040ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0609bcf700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040a8be0 0x7f06040ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0609bcf700 1 -- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f060406d280 msgr2=0x7f06040990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0609bcf700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f060406d280 0x7f06040990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0609bcf700 1 -- 172.21.15.7:0/1218787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80093c0 con 0x7f06040aee90 2023-10-14T19:11:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0608bcd700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040a8be0 0x7f06040ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f06093ce700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f060406d280 0x7f06040990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f0609bcf700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 0x7f06040ab6c0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cb60 tx=0x7f05f4001560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4007150 con 0x7f06040aee90 2023-10-14T19:11:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f40072d0 con 0x7f06040aee90 2023-10-14T19:11:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060409a120 con 0x7f06040aee90 2023-10-14T19:11:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4007690 con 0x7f06040aee90 2023-10-14T19:11:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.621+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06040ad4e0 con 0x7f06040aee90 2023-10-14T19:11:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.622+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060409a8e0 con 0x7f06040aee90 2023-10-14T19:11:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.622+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f05f4004a40 con 0x7f06040aee90 2023-10-14T19:11:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.623+0000 7f06017fa700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f05f0067320 0x7f05f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.623+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05f4084380 con 0x7f06040aee90 2023-10-14T19:11:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.623+0000 7f06093ce700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f05f0067320 0x7f05f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.624+0000 7f06093ce700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f05f0067320 0x7f05f00697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00d300 tx=0x7f05fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:57.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.627+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05f4051090 con 0x7f06040aee90 2023-10-14T19:11:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.865+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f060404c3c0 con 0x7f06040aee90 2023-10-14T19:11:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.865+0000 7f06017fa700 1 -- 172.21.15.7:0/1218787811 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v121) v1 ==== 53+0+73 (secure 0 0 0) 0x7f05f40546b0 con 0x7f06040aee90 2023-10-14T19:11:57.866 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:11:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f05f0067320 msgr2=0x7f05f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f05f0067320 0x7f05f00697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00d300 tx=0x7f05fc009040 comp rx=0 tx=0).stop 2023-10-14T19:11:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 msgr2=0x7f06040ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 0x7f06040ab6c0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cb60 tx=0x7f05f4001560 comp rx=0 tx=0).stop 2023-10-14T19:11:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 shutdown_connections 2023-10-14T19:11:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f05f0067320 0x7f05f00697d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f060406d280 0x7f06040990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06040aee90 0x7f06040ab6c0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 --2- 172.21.15.7:0/1218787811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06040a8be0 0x7f06040ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 >> 172.21.15.7:0/1218787811 conn(0x7f060406ce80 msgr2=0x7f0604068c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 shutdown_connections 2023-10-14T19:11:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:57.867+0000 7f060b632700 1 -- 172.21.15.7:0/1218787811 wait complete. 2023-10-14T19:11:57.880 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:11:57.880 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:11:57.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:11:57.881 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:11:57.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:57.882 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:11:57.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:11:57.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:11:57.883 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:11:57.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:57.884 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:11:57.902 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:11:57.903 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:11:57.903 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:11:57.903 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.903 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:11:57.903 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.904 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:57.904 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:57.904 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:11:57.904 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:57.904 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:57.905 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:11:57.905 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:11:57.905 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:57.905 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:11:57.905 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:11:57.906 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 41936sec preferred_lft 41936sec 2023-10-14T19:11:57.906 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:11:57.906 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.906 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:57.906 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:57.907 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:11:57.907 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:11:57.907 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:57.907 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:11:57.907 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.908 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:11:57.908 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.908 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:57.908 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:11:57.908 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:11:57.908 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.909 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:57.909 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:11:57.909 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:11:57.909 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:57.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:57.910 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:11:57.966 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:11:57.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:57.968 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:11:58.023 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:11:58.024 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:11:58.024 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:11:58.024 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:11:58.024 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:11:58.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:58.025 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:11:58.026 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:11:58.026 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:11:58.026 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:11:58.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:11:58.027 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:11:58.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:58.127 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:11:58.142 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:11:58.142 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:11:58.142 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:11:58.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:58.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:11:58.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:58.208 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:11:58.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:58.264 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:58.318 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:11:58.319 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:11:58.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:58.400 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:58.400 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:11:58.401 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:11:58.408 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:58.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:11:58.409 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:11:58.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:58.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:58.431 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:11:58.431 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:11:58.431 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:11:58.432 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:58.432 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:58.432 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:11:58.432 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:11:58.432 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:11:58.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:11:58.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:58.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:11:58.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:11:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.661+0000 7f0d27fe0700 1 Processor -- start 2023-10-14T19:11:58.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.661+0000 7f0d27fe0700 1 -- start start 2023-10-14T19:11:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d27fe0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d200cb5a0 0x7f0d200cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d27fe0700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2015ae40 con 0x7f0d200cd9e0 2023-10-14T19:11:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d27fe0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2015ab60 con 0x7f0d2015a5d0 2023-10-14T19:11:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d27fe0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d200d13f0 con 0x7f0d200cb5a0 2023-10-14T19:11:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d2557b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0d200cd9e0 0x7f0d20159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54354/0 (socket says 172.21.15.7:54354) 2023-10-14T19:11:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d2557b700 1 -- 172.21.15.7:0/1197964424 learned_addr learned my addr 172.21.15.7:0/1197964424 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/1197964424 >> v2:172.21.15.148:3300/0 conn(0x7f0d200cb5a0 0x7f0d200cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597053979 0 0) 0x7f0d2015ae40 con 0x7f0d200cd9e0 2023-10-14T19:11:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c003570 con 0x7f0d200cd9e0 2023-10-14T19:11:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.662+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843234585 0 0) 0x7f0d0c003570 con 0x7f0d200cd9e0 2023-10-14T19:11:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 >> v2:172.21.15.148:3300/0 conn(0x7f0d200cb5a0 msgr2=0x7f0d200cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 --2- 172.21.15.7:0/1197964424 >> v2:172.21.15.148:3300/0 conn(0x7f0d200cb5a0 0x7f0d200cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 >> v1:172.21.15.148:6789/0 conn(0x7f0d2015a5d0 legacy=0x7f0d20156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200ccf00 con 0x7f0d200cd9e0 2023-10-14T19:11:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f0d10001470 con 0x7f0d200cd9e0 2023-10-14T19:11:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 >> v1:172.21.15.7:6789/0 conn(0x7f0d200cd9e0 legacy=0x7f0d20159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d0c003a60 0x7f0d0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c0051c0 0x7f0d0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00c050 con 0x7f0d0c003a60 2023-10-14T19:11:58.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00c190 con 0x7f0d0c0051c0 2023-10-14T19:11:58.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00c350 con 0x7f0d0c004810 2023-10-14T19:11:58.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d0c003a60 0x7f0d0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d2657d700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c0051c0 0x7f0d0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d2557b700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 -- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d0c004810 msgr2=0x7f0d0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:58.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 -- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c0051c0 msgr2=0x7f0d0c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c0051c0 0x7f0d0c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 -- 172.21.15.7:0/1197964424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c003570 con 0x7f0d0c003a60 2023-10-14T19:11:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d2657d700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c0051c0 0x7f0d0c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:11:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d2657d700 1 -- 172.21.15.7:0/1197964424 reap_dead start 2023-10-14T19:11:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d0c003a60 0x7f0d0c003e30 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009c00 tx=0x7f0d1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f63abd233bcd49c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00e710 con 0x7f0d0c003a60 2023-10-14T19:11:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00e870 con 0x7f0d0c003a60 2023-10-14T19:11:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.663+0000 7f0d24d7a700 1 -- 172.21.15.7:0/1197964424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00ec30 con 0x7f0d0c003a60 2023-10-14T19:11:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 -- 172.21.15.7:0/1197964424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d0c003a60 msgr2=0x7f0d0c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d0c003a60 0x7f0d0c003e30 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009c00 tx=0x7f0d1c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 -- 172.21.15.7:0/1197964424 shutdown_connections 2023-10-14T19:11:58.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/1197964424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d0c003a60 0x7f0d0c003e30 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 -- 172.21.15.7:0/1197964424 >> 172.21.15.7:0/1197964424 conn(0x7f0d20070e30 msgr2=0x7f0d200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:58.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 -- 172.21.15.7:0/1197964424 shutdown_connections 2023-10-14T19:11:58.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.664+0000 7f0d27fe0700 1 -- 172.21.15.7:0/1197964424 wait complete. 2023-10-14T19:11:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.665+0000 7f0d27fe0700 1 Processor -- start 2023-10-14T19:11:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.665+0000 7f0d27fe0700 1 -- start start 2023-10-14T19:11:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d27fe0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c003a60 0x7f0d20153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d27fe0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200b34b0 0x7f0d200b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d27fe0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 0x7f0d200b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d27fe0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015b070 con 0x7f0d200b53c0 2023-10-14T19:11:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d27fe0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015d600 con 0x7f0d0c003a60 2023-10-14T19:11:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d27fe0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015b2c0 con 0x7f0d200b34b0 2023-10-14T19:11:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 0x7f0d200b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 0x7f0d200b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40702/0 (socket says 172.21.15.7:40702) 2023-10-14T19:11:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 -- 172.21.15.7:0/4215875248 learned_addr learned my addr 172.21.15.7:0/4215875248 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c003a60 0x7f0d20153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2557b700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200b34b0 0x7f0d200b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 -- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200b34b0 msgr2=0x7f0d200b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200b34b0 0x7f0d200b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 -- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c003a60 msgr2=0x7f0d20153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c003a60 0x7f0d20153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 -- 172.21.15.7:0/4215875248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2015b5a0 con 0x7f0d200b53c0 2023-10-14T19:11:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c003a60 0x7f0d20153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2557b700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200b34b0 0x7f0d200b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:11:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.666+0000 7f0d2657d700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 0x7f0d200b0aa0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f0d20064ad0 tx=0x7f0d18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:58.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.667+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18013630 con 0x7f0d200b53c0 2023-10-14T19:11:58.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.667+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18013790 con 0x7f0d200b53c0 2023-10-14T19:11:58.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.667+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d201693d0 con 0x7f0d200b53c0 2023-10-14T19:11:58.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.667+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18013b50 con 0x7f0d200b53c0 2023-10-14T19:11:58.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.667+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d200b3920 con 0x7f0d200b53c0 2023-10-14T19:11:58.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.668+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d201695f0 con 0x7f0d200b53c0 2023-10-14T19:11:58.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.668+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0d18003030 con 0x7f0d200b53c0 2023-10-14T19:11:58.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.669+0000 7f0d15ffb700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:58.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.669+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0d18084c20 con 0x7f0d200b53c0 2023-10-14T19:11:58.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.669+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.669+0000 7f0d25d7c700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0091e0 tx=0x7f0d1c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.673+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d18051870 con 0x7f0d200b53c0 2023-10-14T19:11:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.913+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d2004c3c0 con 0x7f0d200b53c0 2023-10-14T19:11:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.913+0000 7f0d15ffb700 1 -- 172.21.15.7:0/4215875248 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v121) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d18054e90 con 0x7f0d200b53c0 2023-10-14T19:11:58.914 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:11:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 msgr2=0x7f0d040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0091e0 tx=0x7f0d1c01a000 comp rx=0 tx=0).stop 2023-10-14T19:11:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 msgr2=0x7f0d200b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 0x7f0d200b0aa0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f0d20064ad0 tx=0x7f0d18009040 comp rx=0 tx=0).stop 2023-10-14T19:11:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 shutdown_connections 2023-10-14T19:11:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0d04067320 0x7f0d040697d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d0c003a60 0x7f0d20153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d200b53c0 0x7f0d200b0aa0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 --2- 172.21.15.7:0/4215875248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200b34b0 0x7f0d200b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 >> 172.21.15.7:0/4215875248 conn(0x7f0d20070e30 msgr2=0x7f0d200cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 shutdown_connections 2023-10-14T19:11:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:58.915+0000 7f0d27fe0700 1 -- 172.21.15.7:0/4215875248 wait complete. 2023-10-14T19:11:58.928 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:11:58.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:11:58.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:11:58.929 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:11:58.930 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:58.930 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:11:58.930 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:11:58.931 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:11:58.931 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:11:58.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:58.932 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:11:58.951 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:11:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:11:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:11:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:11:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.952 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:11:58.953 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:11:58.953 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:11:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:58.954 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:11:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:11:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41945sec preferred_lft 41945sec 2023-10-14T19:11:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:11:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.955 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:11:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:11:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:11:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:11:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.956 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:11:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:11:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.957 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:11:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:11:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:11:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:11:58.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:58.958 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:11:59.020 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:11:59.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:59.022 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:11:59.080 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:11:59.080 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:11:59.080 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:11:59.080 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:11:59.081 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:11:59.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:59.081 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:11:59.082 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:11:59.082 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:11:59.083 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:11:59.083 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:11:59.083 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:11:59.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:59.187 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:11:59.202 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:11:59.203 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:11:59.203 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:11:59.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:59.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:11:59.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:59.269 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:59.323 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:11:59.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:11:59.324 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:59.378 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:11:59.379 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:11:59.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:59.459 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:59.459 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:11:59.459 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:11:59.467 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:59.467 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:11:59.468 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:11:59.468 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:59.468 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:59.489 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:11:59.490 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:11:59.491 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:11:59.491 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:11:59.491 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:11:59.492 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:11:59.492 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:11:59.493 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:11:59.495 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:11:59.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:11:59.497 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:11:59.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:11:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.694+0000 7ff654bce700 1 Processor -- start 2023-10-14T19:11:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.694+0000 7ff654bce700 1 -- start start 2023-10-14T19:11:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff654bce700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff6500b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff654bce700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6500af670 con 0x7ff6500b0e00 2023-10-14T19:11:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff654bce700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6500aa2b0 con 0x7ff65006cdb0 2023-10-14T19:11:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff654bce700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500b12a0 con 0x7ff650159940 2023-10-14T19:11:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64dd9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff6500b0e00 0x7ff65006c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54368/0 (socket says 172.21.15.7:54368) 2023-10-14T19:11:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64dd9b700 1 -- 172.21.15.7:0/2832346077 learned_addr learned my addr 172.21.15.7:0/2832346077 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:11:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff6500b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679366231 0 0) 0x7ff638001110 con 0x7ff6500b0e00 2023-10-14T19:11:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff63c003570 con 0x7ff6500b0e00 2023-10-14T19:11:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 111932889 0 0) 0x7ff63c003570 con 0x7ff6500b0e00 2023-10-14T19:11:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 msgr2=0x7ff6500b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff6500b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 >> v1:172.21.15.148:6789/0 conn(0x7ff65006cdb0 legacy=0x7ff6500aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650159d10 con 0x7ff6500b0e00 2023-10-14T19:11:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff638001600 con 0x7ff6500b0e00 2023-10-14T19:11:59.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff6500b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:11:59.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 >> v1:172.21.15.7:6789/0 conn(0x7ff6500b0e00 legacy=0x7ff65006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:59.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.695+0000 7ff64d59a700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63c003a90 0x7ff63c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c004810 0x7ff63c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff63c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500b12a0 con 0x7ff63c003a90 2023-10-14T19:11:59.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c00bb10 con 0x7ff63c004810 2023-10-14T19:11:59.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c00bc80 con 0x7ff650159940 2023-10-14T19:11:59.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63c003a90 0x7ff63c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64dd9b700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c004810 0x7ff63c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64ed9d700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff63c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 -- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 msgr2=0x7ff63c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:59.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650159940 0x7ff63c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 -- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c004810 msgr2=0x7ff63c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:11:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c004810 0x7ff63c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 -- 172.21.15.7:0/2832346077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640009a20 con 0x7ff63c003a90 2023-10-14T19:11:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63c003a90 0x7ff63c003e60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e570 tx=0x7ff64000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579d5a46d8afcdfe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640009ca0 con 0x7ff63c003a90 2023-10-14T19:11:59.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64000f040 con 0x7ff63c003a90 2023-10-14T19:11:59.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.696+0000 7ff64d59a700 1 -- 172.21.15.7:0/2832346077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000eec0 con 0x7ff63c003a90 2023-10-14T19:11:59.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff654bce700 1 -- 172.21.15.7:0/2832346077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63c003a90 msgr2=0x7ff63c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:59.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff654bce700 1 --2- 172.21.15.7:0/2832346077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff63c003a90 0x7ff63c003e60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e570 tx=0x7ff64000b040 comp rx=0 tx=0).stop 2023-10-14T19:11:59.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff64ed9d700 1 -- 172.21.15.7:0/2832346077 reap_dead start 2023-10-14T19:11:59.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff654bce700 1 -- 172.21.15.7:0/2832346077 shutdown_connections 2023-10-14T19:11:59.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff654bce700 1 -- 172.21.15.7:0/2832346077 >> 172.21.15.7:0/2832346077 conn(0x7ff6500cd3e0 msgr2=0x7ff6500cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:11:59.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff654bce700 1 -- 172.21.15.7:0/2832346077 shutdown_connections 2023-10-14T19:11:59.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.697+0000 7ff654bce700 1 -- 172.21.15.7:0/2832346077 wait complete. 2023-10-14T19:11:59.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.698+0000 7ff654bce700 1 Processor -- start 2023-10-14T19:11:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.698+0000 7ff654bce700 1 -- start start 2023-10-14T19:11:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff654bce700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c003a90 0x7ff650147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff654bce700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500c48c0 0x7ff6500c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff654bce700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 0x7ff65015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff654bce700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6501487f0 con 0x7ff65015b060 2023-10-14T19:11:59.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff654bce700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500c5270 con 0x7ff63c003a90 2023-10-14T19:11:59.723 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff654bce700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500c2180 con 0x7ff6500c48c0 2023-10-14T19:11:59.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 0x7ff65015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 0x7ff65015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40724/0 (socket says 172.21.15.7:40724) 2023-10-14T19:11:59.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 -- 172.21.15.7:0/2221745378 learned_addr learned my addr 172.21.15.7:0/2221745378 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:11:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64dd9b700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500c48c0 0x7ff6500c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c003a90 0x7ff650147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 -- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500c48c0 msgr2=0x7ff6500c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500c48c0 0x7ff6500c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 -- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c003a90 msgr2=0x7ff650147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:11:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c003a90 0x7ff650147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:11:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 -- 172.21.15.7:0/2221745378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6500c23d0 con 0x7ff65015b060 2023-10-14T19:11:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff64ed9d700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 0x7ff65015b4e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff65006d1b0 tx=0x7ff648009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.699+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648012590 con 0x7ff65015b060 2023-10-14T19:11:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.700+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648012710 con 0x7ff65015b060 2023-10-14T19:11:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.700+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6500c26b0 con 0x7ff65015b060 2023-10-14T19:11:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.700+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648012ad0 con 0x7ff65015b060 2023-10-14T19:11:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.700+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6500c2c70 con 0x7ff65015b060 2023-10-14T19:11:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.700+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6500c2e90 con 0x7ff65015b060 2023-10-14T19:11:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.701+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff64801d460 con 0x7ff65015b060 2023-10-14T19:11:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.701+0000 7ff6467fc700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff630067320 0x7ff6300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:11:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.701+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff648084cc0 con 0x7ff65015b060 2023-10-14T19:11:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.702+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff630067320 0x7ff6300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:11:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.702+0000 7ff64e59c700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff630067320 0x7ff6300697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff640009fd0 tx=0x7ff64001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:11:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.706+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff64808b080 con 0x7ff65015b060 2023-10-14T19:11:59.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:11:59.948+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff65004c3c0 con 0x7ff65015b060 2023-10-14T19:12:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.564+0000 7ff6467fc700 1 -- 172.21.15.7:0/2221745378 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v122) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff6480553a0 con 0x7ff65015b060 2023-10-14T19:12:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff630067320 msgr2=0x7ff6300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff630067320 0x7ff6300697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff640009fd0 tx=0x7ff64001a000 comp rx=0 tx=0).stop 2023-10-14T19:12:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 msgr2=0x7ff65015b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 0x7ff65015b4e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff65006d1b0 tx=0x7ff648009040 comp rx=0 tx=0).stop 2023-10-14T19:12:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 shutdown_connections 2023-10-14T19:12:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff630067320 0x7ff6300697d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff63c003a90 0x7ff650147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff65015b060 0x7ff65015b4e0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 --2- 172.21.15.7:0/2221745378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500c48c0 0x7ff6500c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 >> 172.21.15.7:0/2221745378 conn(0x7ff6500cd3e0 msgr2=0x7ff6500ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 shutdown_connections 2023-10-14T19:12:00.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.566+0000 7ff654bce700 1 -- 172.21.15.7:0/2221745378 wait complete. 2023-10-14T19:12:00.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:12:00.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.704+0000 7fd034b01700 1 Processor -- start 2023-10-14T19:12:00.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.704+0000 7fd034b01700 1 -- start start 2023-10-14T19:12:00.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd034b01700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0300cb5a0 0x7fd0300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:00.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd034b01700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cd9e0 0x7fd030159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:00.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd034b01700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03015ae40 con 0x7fd0300cde50 2023-10-14T19:12:00.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd034b01700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300d13f0 con 0x7fd0300cb5a0 2023-10-14T19:12:00.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd034b01700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03015ab60 con 0x7fd0300cd9e0 2023-10-14T19:12:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd02e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0300cb5a0 0x7fd0300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd02e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0300cb5a0 0x7fd0300cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40738/0 (socket says 172.21.15.7:40738) 2023-10-14T19:12:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd02e59c700 1 -- 172.21.15.7:0/109385091 learned_addr learned my addr 172.21.15.7:0/109385091 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.705+0000 7fd02dd9b700 1 --2- 172.21.15.7:0/109385091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cd9e0 0x7fd030159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02e59c700 1 -- 172.21.15.7:0/109385091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cd9e0 msgr2=0x7fd030159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02e59c700 1 --2- 172.21.15.7:0/109385091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cd9e0 0x7fd030159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02e59c700 1 -- 172.21.15.7:0/109385091 >> v1:172.21.15.148:6789/0 conn(0x7fd0300cde50 legacy=0x7fd030156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02e59c700 1 -- 172.21.15.7:0/109385091 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300ccf00 con 0x7fd0300cb5a0 2023-10-14T19:12:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02e59c700 1 --2- 172.21.15.7:0/109385091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300cb5a0 0x7fd0300cb970 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd028009f20 tx=0x7fd028009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d429bf2630e55ebf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02d59a700 1 -- 172.21.15.7:0/109385091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800e070 con 0x7fd0300cb5a0 2023-10-14T19:12:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02d59a700 1 -- 172.21.15.7:0/109385091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02800ba80 con 0x7fd0300cb5a0 2023-10-14T19:12:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd02d59a700 1 -- 172.21.15.7:0/109385091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280092e0 con 0x7fd0300cb5a0 2023-10-14T19:12:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd034b01700 1 -- 172.21.15.7:0/109385091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300cb5a0 msgr2=0x7fd0300cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd034b01700 1 --2- 172.21.15.7:0/109385091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300cb5a0 0x7fd0300cb970 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd028009f20 tx=0x7fd028009840 comp rx=0 tx=0).stop 2023-10-14T19:12:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.706+0000 7fd034b01700 1 -- 172.21.15.7:0/109385091 shutdown_connections 2023-10-14T19:12:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.707+0000 7fd034b01700 1 --2- 172.21.15.7:0/109385091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300cb5a0 0x7fd0300cb970 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.707+0000 7fd034b01700 1 --2- 172.21.15.7:0/109385091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cd9e0 0x7fd030159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.707+0000 7fd034b01700 1 -- 172.21.15.7:0/109385091 >> 172.21.15.7:0/109385091 conn(0x7fd030070e30 msgr2=0x7fd0300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.707+0000 7fd034b01700 1 -- 172.21.15.7:0/109385091 shutdown_connections 2023-10-14T19:12:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.707+0000 7fd034b01700 1 -- 172.21.15.7:0/109385091 wait complete. 2023-10-14T19:12:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 Processor -- start 2023-10-14T19:12:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 -- start start 2023-10-14T19:12:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cb5a0 0x7fd030156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300cd9e0 0x7fd0300b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 0x7fd0300c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b5360 con 0x7fd0300c78a0 2023-10-14T19:12:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b57f0 con 0x7fd0300cd9e0 2023-10-14T19:12:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.708+0000 7fd034b01700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b4750 con 0x7fd0300cb5a0 2023-10-14T19:12:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 0x7fd0300c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 0x7fd0300c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40746/0 (socket says 172.21.15.7:40746) 2023-10-14T19:12:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300cd9e0 0x7fd0300b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02e59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cb5a0 0x7fd030156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 -- 172.21.15.7:0/2422232989 learned_addr learned my addr 172.21.15.7:0/2422232989 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 -- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cb5a0 msgr2=0x7fd030156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cb5a0 0x7fd030156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 -- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300cd9e0 msgr2=0x7fd0300b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300cd9e0 0x7fd0300b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 -- 172.21.15.7:0/2422232989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009ae0 con 0x7fd0300c78a0 2023-10-14T19:12:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd02ed9d700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 0x7fd0300c9f60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fd02000c4c0 tx=0x7fd020007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000ce70 con 0x7fd0300c78a0 2023-10-14T19:12:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020011590 con 0x7fd0300c78a0 2023-10-14T19:12:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0300b4a30 con 0x7fd0300c78a0 2023-10-14T19:12:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020011970 con 0x7fd0300c78a0 2023-10-14T19:12:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.709+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300b4ff0 con 0x7fd0300c78a0 2023-10-14T19:12:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.710+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0300b5510 con 0x7fd0300c78a0 2023-10-14T19:12:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.711+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd020011ce0 con 0x7fd0300c78a0 2023-10-14T19:12:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.711+0000 7fd0267fc700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd010067320 0x7fd0100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.711+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fd020083f90 con 0x7fd0300c78a0 2023-10-14T19:12:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.711+0000 7fd02e59c700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd010067320 0x7fd0100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.712+0000 7fd02e59c700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd010067320 0x7fd0100697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd028009880 tx=0x7fd028018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.715+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0300b5510 con 0x7fd0300c78a0 2023-10-14T19:12:00.938 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.937+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd03004c3c0 con 0x7fd010067320 2023-10-14T19:12:00.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.939+0000 7fd0267fc700 1 -- 172.21.15.7:0/2422232989 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd03004c3c0 con 0x7fd010067320 2023-10-14T19:12:00.940 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:12:00.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:00.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:12:00.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:00.941 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:12:00.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd010067320 msgr2=0x7fd0100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd010067320 0x7fd0100697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd028009880 tx=0x7fd028018000 comp rx=0 tx=0).stop 2023-10-14T19:12:00.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 msgr2=0x7fd0300c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:00.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 0x7fd0300c9f60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fd02000c4c0 tx=0x7fd020007f50 comp rx=0 tx=0).stop 2023-10-14T19:12:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 shutdown_connections 2023-10-14T19:12:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd010067320 0x7fd0100697d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0300c78a0 0x7fd0300c9f60 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300cb5a0 0x7fd030156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 --2- 172.21.15.7:0/2422232989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300cd9e0 0x7fd0300b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:00.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 >> 172.21.15.7:0/2422232989 conn(0x7fd030070e30 msgr2=0x7fd0300b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:00.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 shutdown_connections 2023-10-14T19:12:00.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:00.941+0000 7fd034b01700 1 -- 172.21.15.7:0/2422232989 wait complete. 2023-10-14T19:12:00.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:12:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.075+0000 7f60d09b1700 1 Processor -- start 2023-10-14T19:12:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.075+0000 7f60d09b1700 1 -- start start 2023-10-14T19:12:01.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60d09b1700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc153c90 0x7f60cc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60d09b1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60cc06db20 0x7f60cc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60d09b1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc15ada0 con 0x7f60cc154060 2023-10-14T19:12:01.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60d09b1700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc06ca80 con 0x7f60cc153c90 2023-10-14T19:12:01.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60d09b1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc06cd60 con 0x7f60cc06db20 2023-10-14T19:12:01.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc153c90 0x7f60cc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cb59e700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f60cc154060 0x7f60cc06a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54382/0 (socket says 172.21.15.7:54382) 2023-10-14T19:12:01.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60cc153c90 0x7f60cc15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40748/0 (socket says 172.21.15.7:40748) 2023-10-14T19:12:01.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cb59e700 1 -- 172.21.15.7:0/1634023378 learned_addr learned my addr 172.21.15.7:0/1634023378 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:01.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60ca59c700 1 --2- 172.21.15.7:0/1634023378 >> v2:172.21.15.148:3300/0 conn(0x7f60cc06db20 0x7f60cc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 -- 172.21.15.7:0/1634023378 >> v2:172.21.15.148:3300/0 conn(0x7f60cc06db20 msgr2=0x7f60cc0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:01.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 --2- 172.21.15.7:0/1634023378 >> v2:172.21.15.148:3300/0 conn(0x7f60cc06db20 0x7f60cc0ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 -- 172.21.15.7:0/1634023378 >> v1:172.21.15.7:6789/0 conn(0x7f60cc154060 legacy=0x7f60cc06a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 -- 172.21.15.7:0/1634023378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc06d040 con 0x7f60cc153c90 2023-10-14T19:12:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.076+0000 7f60cad9d700 1 --2- 172.21.15.7:0/1634023378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc153c90 0x7f60cc15a860 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0cc300 tx=0x7f60c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d9b403c60ef8a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60c9d9b700 1 -- 172.21.15.7:0/1634023378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400b6b0 con 0x7f60cc153c90 2023-10-14T19:12:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60c9d9b700 1 -- 172.21.15.7:0/1634023378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c400b810 con 0x7f60cc153c90 2023-10-14T19:12:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60c9d9b700 1 -- 172.21.15.7:0/1634023378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400bbb0 con 0x7f60cc153c90 2023-10-14T19:12:01.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 -- 172.21.15.7:0/1634023378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc153c90 msgr2=0x7f60cc15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 --2- 172.21.15.7:0/1634023378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc153c90 0x7f60cc15a860 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0cc300 tx=0x7f60c40091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 -- 172.21.15.7:0/1634023378 shutdown_connections 2023-10-14T19:12:01.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 --2- 172.21.15.7:0/1634023378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc153c90 0x7f60cc15a860 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 --2- 172.21.15.7:0/1634023378 >> v2:172.21.15.148:3300/0 conn(0x7f60cc06db20 0x7f60cc0ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 -- 172.21.15.7:0/1634023378 >> 172.21.15.7:0/1634023378 conn(0x7f60cc06e720 msgr2=0x7f60cc06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:01.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 -- 172.21.15.7:0/1634023378 shutdown_connections 2023-10-14T19:12:01.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.077+0000 7f60d09b1700 1 -- 172.21.15.7:0/1634023378 wait complete. 2023-10-14T19:12:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.078+0000 7f60d09b1700 1 Processor -- start 2023-10-14T19:12:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.078+0000 7f60d09b1700 1 -- start start 2023-10-14T19:12:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60d09b1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 0x7f60cc169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60d09b1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc153c90 0x7f60cc0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60d09b1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc154060 0x7f60cc16dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60d09b1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc141d30 con 0x7f60cc06db20 2023-10-14T19:12:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60d09b1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0c7de0 con 0x7f60cc154060 2023-10-14T19:12:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60d09b1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0c80c0 con 0x7f60cc153c90 2023-10-14T19:12:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 0x7f60cc169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 0x7f60cc169d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40750/0 (socket says 172.21.15.7:40750) 2023-10-14T19:12:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60cad9d700 1 -- 172.21.15.7:0/3594515555 learned_addr learned my addr 172.21.15.7:0/3594515555 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60cb59e700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc154060 0x7f60cc16dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.079+0000 7f60ca59c700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc153c90 0x7f60cc0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60cad9d700 1 -- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc153c90 msgr2=0x7f60cc0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60cad9d700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc153c90 0x7f60cc0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60cad9d700 1 -- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc154060 msgr2=0x7f60cc16dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60cad9d700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc154060 0x7f60cc16dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60cad9d700 1 -- 172.21.15.7:0/3594515555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c4009420 con 0x7f60cc06db20 2023-10-14T19:12:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60ca59c700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc153c90 0x7f60cc0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60cad9d700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 0x7f60cc169d60 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0c3820 tx=0x7f60c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400bb90 con 0x7f60cc06db20 2023-10-14T19:12:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4011420 con 0x7f60cc06db20 2023-10-14T19:12:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0c83a0 con 0x7f60cc06db20 2023-10-14T19:12:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40117c0 con 0x7f60cc06db20 2023-10-14T19:12:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.080+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0c7a00 con 0x7f60cc06db20 2023-10-14T19:12:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.081+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc04c3c0 con 0x7f60cc06db20 2023-10-14T19:12:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.081+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f60c4011bf0 con 0x7f60cc06db20 2023-10-14T19:12:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.082+0000 7f60c2ffd700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60ac067320 0x7f60ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.082+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f60c40865e0 con 0x7f60cc06db20 2023-10-14T19:12:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.082+0000 7f60ca59c700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60ac067320 0x7f60ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.082+0000 7f60ca59c700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60ac067320 0x7f60ac0697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06f820 tx=0x7f60b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.086+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60c4053230 con 0x7f60cc06db20 2023-10-14T19:12:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.279+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f60cc0b2820 con 0x7f60cc06db20 2023-10-14T19:12:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.280+0000 7f60c2ffd700 1 -- 172.21.15.7:0/3594515555 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60c4056850 con 0x7f60cc06db20 2023-10-14T19:12:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60ac067320 msgr2=0x7f60ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60ac067320 0x7f60ac0697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06f820 tx=0x7f60b4008040 comp rx=0 tx=0).stop 2023-10-14T19:12:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 msgr2=0x7f60cc169d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 0x7f60cc169d60 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0c3820 tx=0x7f60c4017000 comp rx=0 tx=0).stop 2023-10-14T19:12:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 shutdown_connections 2023-10-14T19:12:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f60ac067320 0x7f60ac0697d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60cc154060 0x7f60cc16dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60cc06db20 0x7f60cc169d60 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 --2- 172.21.15.7:0/3594515555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60cc153c90 0x7f60cc0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 >> 172.21.15.7:0/3594515555 conn(0x7f60cc06e720 msgr2=0x7f60cc15c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 shutdown_connections 2023-10-14T19:12:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.282+0000 7f60d09b1700 1 -- 172.21.15.7:0/3594515555 wait complete. 2023-10-14T19:12:01.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:12:01.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:12:01.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:12:01.334 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:12:01.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:01.335 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:12:01.389 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:12:01.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:12:01.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:12:01.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:12:01.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:01.433 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:12:01.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:12:01.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:01.488 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T19:12:01.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:12:01.504 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T19:12:01.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:12:01.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:01.505 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T19:12:01.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:12:01.543 INFO:teuthology.orchestra.run.smithi148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T19:12:01.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000047808 --yes-i-really-mean-it 2023-10-14T19:12:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.667+0000 7fa0f3815700 1 Processor -- start 2023-10-14T19:12:01.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.667+0000 7fa0f3815700 1 -- start start 2023-10-14T19:12:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f3815700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f3815700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec0cf330 con 0x7fa0ec0cd770 2023-10-14T19:12:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f3815700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec0cddd0 con 0x7fa0ec0b04f0 2023-10-14T19:12:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f3815700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0cdbd0 con 0x7fa0ec0cb880 2023-10-14T19:12:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f1db2700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa0ec0cd770 0x7fa0ec1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54384/0 (socket says 172.21.15.7:54384) 2023-10-14T19:12:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f1db2700 1 -- 172.21.15.7:0/3807826075 learned_addr learned my addr 172.21.15.7:0/3807826075 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859627758 0 0) 0x7fa0ec0cf330 con 0x7fa0ec0cd770 2023-10-14T19:12:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.668+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d4003570 con 0x7fa0ec0cd770 2023-10-14T19:12:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093180053 0 0) 0x7fa0d4003570 con 0x7fa0ec0cd770 2023-10-14T19:12:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 msgr2=0x7fa0ec0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 >> v1:172.21.15.148:6789/0 conn(0x7fa0ec0b04f0 legacy=0x7fa0ec0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0cece0 con 0x7fa0ec0cd770 2023-10-14T19:12:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fa0dc0017f0 con 0x7fa0ec0cd770 2023-10-14T19:12:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 >> v1:172.21.15.7:6789/0 conn(0x7fa0ec0cd770 legacy=0x7fa0ec1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0d4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d4003fd0 0x7fa0d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d4004d50 0x7fa0d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0cdbd0 con 0x7fa0d4004d50 2023-10-14T19:12:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d400bb40 con 0x7fa0d4003fd0 2023-10-14T19:12:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d400bd00 con 0x7fa0ec0cb880 2023-10-14T19:12:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0d4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f0db0700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d4003fd0 0x7fa0d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f1db2700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d4004d50 0x7fa0d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 -- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d4003fd0 msgr2=0x7fa0d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d4003fd0 0x7fa0d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 -- 172.21.15.7:0/3807826075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d4004d50 msgr2=0x7fa0d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d4004d50 0x7fa0d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 -- 172.21.15.7:0/3807826075 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4003570 con 0x7fa0ec0cb880 2023-10-14T19:12:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.669+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0d4003a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009c00 tx=0x7fa0e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cfff118ba5d96c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400e710 con 0x7fa0ec0cb880 2023-10-14T19:12:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400e870 con 0x7fa0ec0cb880 2023-10-14T19:12:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0ebfff700 1 -- 172.21.15.7:0/3807826075 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400ec30 con 0x7fa0ec0cb880 2023-10-14T19:12:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f3815700 1 -- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 msgr2=0x7fa0d4003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f3815700 1 --2- 172.21.15.7:0/3807826075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0d4003a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009c00 tx=0x7fa0e40091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f1db2700 1 -- 172.21.15.7:0/3807826075 reap_dead start 2023-10-14T19:12:01.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f3815700 1 -- 172.21.15.7:0/3807826075 shutdown_connections 2023-10-14T19:12:01.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f3815700 1 -- 172.21.15.7:0/3807826075 >> 172.21.15.7:0/3807826075 conn(0x7fa0ec0703a0 msgr2=0x7fa0ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:01.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f3815700 1 -- 172.21.15.7:0/3807826075 shutdown_connections 2023-10-14T19:12:01.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.670+0000 7fa0f3815700 1 -- 172.21.15.7:0/3807826075 wait complete. 2023-10-14T19:12:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.671+0000 7fa0f3815700 1 Processor -- start 2023-10-14T19:12:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.671+0000 7fa0f3815700 1 -- start start 2023-10-14T19:12:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f3815700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f3815700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0ec0b4a40 0x7fa0ec0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f3815700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 0x7fa0ec0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f3815700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec155720 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f3815700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0b45b0 con 0x7fa0ec0b4a40 2023-10-14T19:12:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f3815700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0b36c0 con 0x7fa0ec0cb880 2023-10-14T19:12:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f1db2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 0x7fa0ec0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f1db2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 0x7fa0ec0c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40756/0 (socket says 172.21.15.7:40756) 2023-10-14T19:12:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f1db2700 1 -- 172.21.15.7:0/4142375547 learned_addr learned my addr 172.21.15.7:0/4142375547 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.672+0000 7fa0f0db0700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0ec0b4a40 0x7fa0ec0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f1db2700 1 -- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 msgr2=0x7fa0ec1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f1db2700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f1db2700 1 -- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0ec0b4a40 msgr2=0x7fa0ec0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f1db2700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0ec0b4a40 0x7fa0ec0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f1db2700 1 -- 172.21.15.7:0/4142375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0b39a0 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f1db2700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 0x7fa0ec0c9e50 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0ccae0 tx=0x7fa0dc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc00ae30 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0133f0 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0137b0 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec0b3c80 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.673+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec0b4240 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.674+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec0b4740 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.674+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa0dc013b20 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.675+0000 7fa0e97fa700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0d8067320 0x7fa0d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.675+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa0dc085600 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.675+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0d8067320 0x7fa0d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.676+0000 7fa0f15b1700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0d8067320 0x7fa0d80697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40091e0 tx=0x7fa0e401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.679+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0dc052310 con 0x7fa0ec0b4eb0 2023-10-14T19:12:01.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:01.901+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000047808", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa0ec04c3c0 con 0x7fa0d8067320 2023-10-14T19:12:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.881+0000 7fa0e97fa700 1 -- 172.21.15.7:0/4142375547 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fa0ec04c3c0 con 0x7fa0d8067320 2023-10-14T19:12:04.882 INFO:teuthology.orchestra.run.smithi007.stdout:FS volume 'cephfs' renamed to 'volume_0000000000047808' 2023-10-14T19:12:04.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.883+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0d8067320 msgr2=0x7fa0d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.883+0000 7fa0f3815700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0d8067320 0x7fa0d80697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40091e0 tx=0x7fa0e401a000 comp rx=0 tx=0).stop 2023-10-14T19:12:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.883+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 msgr2=0x7fa0ec0c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.883+0000 7fa0f3815700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 0x7fa0ec0c9e50 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0ccae0 tx=0x7fa0dc0021f0 comp rx=0 tx=0).stop 2023-10-14T19:12:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 shutdown_connections 2023-10-14T19:12:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa0d8067320 0x7fa0d80697d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0ec0b4eb0 0x7fa0ec0c9e50 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0ec0cb880 0x7fa0ec1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 --2- 172.21.15.7:0/4142375547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0ec0b4a40 0x7fa0ec0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 >> 172.21.15.7:0/4142375547 conn(0x7fa0ec0703a0 msgr2=0x7fa0ec0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 shutdown_connections 2023-10-14T19:12:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:04.884+0000 7fa0f3815700 1 -- 172.21.15.7:0/4142375547 wait complete. 2023-10-14T19:12:04.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000047808 --yes-i-really-mean-it 2023-10-14T19:12:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.031+0000 7fb34faf4700 1 Processor -- start 2023-10-14T19:12:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.031+0000 7fb34faf4700 1 -- start start 2023-10-14T19:12:05.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.032+0000 7fb34faf4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 0x7fb3480cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.032+0000 7fb34faf4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3480cf340 con 0x7fb3480ce270 2023-10-14T19:12:05.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.032+0000 7fb34faf4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3480ce730 con 0x7fb3481599b0 2023-10-14T19:12:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.032+0000 7fb34faf4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480cea10 con 0x7fb3481595e0 2023-10-14T19:12:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.032+0000 7fb34d08f700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb3480ce270 0x7fb3480cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54386/0 (socket says 172.21.15.7:54386) 2023-10-14T19:12:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.032+0000 7fb34d08f700 1 -- 172.21.15.7:0/1588662234 learned_addr learned my addr 172.21.15.7:0/1588662234 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d890700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 0x7fb3480cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222906082 0 0) 0x7fb3480cf340 con 0x7fb3480ce270 2023-10-14T19:12:05.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb330003570 con 0x7fb3480ce270 2023-10-14T19:12:05.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270802818 0 0) 0x7fb330003570 con 0x7fb3480ce270 2023-10-14T19:12:05.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 msgr2=0x7fb3480cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:05.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 0x7fb3480cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 >> v1:172.21.15.148:6789/0 conn(0x7fb3481599b0 legacy=0x7fb3480ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480cecf0 con 0x7fb3480ce270 2023-10-14T19:12:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fb33c001470 con 0x7fb3480ce270 2023-10-14T19:12:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 >> v1:172.21.15.7:6789/0 conn(0x7fb3480ce270 legacy=0x7fb3480cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb330003a90 0x7fb330003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb330004810 0x7fb330004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 0x7fb3300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480cea10 con 0x7fb330004810 2023-10-14T19:12:05.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33000bb10 con 0x7fb330003a90 2023-10-14T19:12:05.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33000bcd0 con 0x7fb3481595e0 2023-10-14T19:12:05.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d08f700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb330004810 0x7fb330004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d890700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb330003a90 0x7fb330003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34e091700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 0x7fb3300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d08f700 1 -- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 msgr2=0x7fb3300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:05.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d08f700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3481595e0 0x7fb3300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d08f700 1 -- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb330003a90 msgr2=0x7fb330003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:05.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d08f700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb330003a90 0x7fb330003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.033+0000 7fb34d08f700 1 -- 172.21.15.7:0/1588662234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb330003570 con 0x7fb330004810 2023-10-14T19:12:05.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34d08f700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb330004810 0x7fb330004c80 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c390 tx=0x7fb33c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47583730c3f42a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:05.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00cc60 con 0x7fb330004810 2023-10-14T19:12:05.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00cdc0 con 0x7fb330004810 2023-10-14T19:12:05.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34c88e700 1 -- 172.21.15.7:0/1588662234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005b70 con 0x7fb330004810 2023-10-14T19:12:05.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34faf4700 1 -- 172.21.15.7:0/1588662234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb330004810 msgr2=0x7fb330004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34faf4700 1 --2- 172.21.15.7:0/1588662234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb330004810 0x7fb330004c80 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c390 tx=0x7fb33c001e70 comp rx=0 tx=0).stop 2023-10-14T19:12:05.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34e091700 1 -- 172.21.15.7:0/1588662234 reap_dead start 2023-10-14T19:12:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34faf4700 1 -- 172.21.15.7:0/1588662234 shutdown_connections 2023-10-14T19:12:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34faf4700 1 -- 172.21.15.7:0/1588662234 >> 172.21.15.7:0/1588662234 conn(0x7fb3480999c0 msgr2=0x7fb348070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34faf4700 1 -- 172.21.15.7:0/1588662234 shutdown_connections 2023-10-14T19:12:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.034+0000 7fb34faf4700 1 -- 172.21.15.7:0/1588662234 wait complete. 2023-10-14T19:12:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.035+0000 7fb34faf4700 1 Processor -- start 2023-10-14T19:12:05.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 -- start start 2023-10-14T19:12:05.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb330004810 0x7fb34809dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480c8110 0x7fb3480c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 0x7fb3480ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480c8ac0 con 0x7fb3480ca270 2023-10-14T19:12:05.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480cac20 con 0x7fb3480c8110 2023-10-14T19:12:05.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34faf4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34816a3b0 con 0x7fb330004810 2023-10-14T19:12:05.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34e091700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 0x7fb3480ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34e091700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 0x7fb3480ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40780/0 (socket says 172.21.15.7:40780) 2023-10-14T19:12:05.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34e091700 1 -- 172.21.15.7:0/3536947109 learned_addr learned my addr 172.21.15.7:0/3536947109 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:05.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.036+0000 7fb34d890700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb330004810 0x7fb34809dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34d08f700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480c8110 0x7fb3480c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34e091700 1 -- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb330004810 msgr2=0x7fb34809dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34e091700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb330004810 0x7fb34809dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34e091700 1 -- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480c8110 msgr2=0x7fb3480c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34e091700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480c8110 0x7fb3480c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34e091700 1 -- 172.21.15.7:0/3536947109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480caee0 con 0x7fb3480ca270 2023-10-14T19:12:05.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34d08f700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480c8110 0x7fb3480c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:05.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34e091700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 0x7fb3480ca6e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fb3480ccc50 tx=0x7fb338009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:05.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800ee90 con 0x7fb3480ca270 2023-10-14T19:12:05.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338012590 con 0x7fb3480ca270 2023-10-14T19:12:05.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb338012950 con 0x7fb3480ca270 2023-10-14T19:12:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3480cb1c0 con 0x7fb3480ca270 2023-10-14T19:12:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.037+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3480cb780 con 0x7fb3480ca270 2023-10-14T19:12:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.038+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34804c3c0 con 0x7fb3480ca270 2023-10-14T19:12:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.039+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb338012cc0 con 0x7fb3480ca270 2023-10-14T19:12:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.039+0000 7fb345ffb700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb334067320 0x7fb3340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:05.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.039+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fb338084be0 con 0x7fb3480ca270 2023-10-14T19:12:05.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.039+0000 7fb34d890700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb334067320 0x7fb3340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:05.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.040+0000 7fb34d890700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb334067320 0x7fb3340697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb34806c900 tx=0x7fb34000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:05.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.043+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3380517e0 con 0x7fb3480ca270 2023-10-14T19:12:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.266+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000047808", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb3480cc440 con 0x7fb334067320 2023-10-14T19:12:05.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.890+0000 7fb345ffb700 1 -- 172.21.15.7:0/3536947109 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fb3480cc440 con 0x7fb334067320 2023-10-14T19:12:05.891 INFO:teuthology.orchestra.run.smithi007.stdout:FS volume 'cephfs' renamed to 'volume_0000000000047808' 2023-10-14T19:12:05.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb334067320 msgr2=0x7fb3340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb334067320 0x7fb3340697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb34806c900 tx=0x7fb34000b040 comp rx=0 tx=0).stop 2023-10-14T19:12:05.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 msgr2=0x7fb3480ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:05.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 0x7fb3480ca6e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fb3480ccc50 tx=0x7fb338009040 comp rx=0 tx=0).stop 2023-10-14T19:12:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 shutdown_connections 2023-10-14T19:12:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb334067320 0x7fb3340697d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3480ca270 0x7fb3480ca6e0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb330004810 0x7fb34809dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 --2- 172.21.15.7:0/3536947109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480c8110 0x7fb3480c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.892+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 >> 172.21.15.7:0/3536947109 conn(0x7fb3480999c0 msgr2=0x7fb3480aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.893+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 shutdown_connections 2023-10-14T19:12:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:05.893+0000 7fb34faf4700 1 -- 172.21.15.7:0/3536947109 wait complete. 2023-10-14T19:12:05.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:12:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.032+0000 7f0e5192e700 1 Processor -- start 2023-10-14T19:12:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.032+0000 7f0e5192e700 1 -- start start 2023-10-14T19:12:06.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e5192e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0e4c157600 0x7f0e4c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e5192e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e5192e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e4c0ccba0 0x7f0e4c1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e5192e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c0cb850 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e5192e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c158210 con 0x7f0e4c157600 2023-10-14T19:12:06.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e5192e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0cb290 con 0x7f0e4c1579d0 2023-10-14T19:12:06.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e4c0ccba0 0x7f0e4c1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e4c0ccba0 0x7f0e4c1586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40796/0 (socket says 172.21.15.7:40796) 2023-10-14T19:12:06.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 -- 172.21.15.7:0/3116491200 learned_addr learned my addr 172.21.15.7:0/3116491200 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:06.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4affd700 1 --2- 172.21.15.7:0/3116491200 >> v2:172.21.15.148:3300/0 conn(0x7f0e4c157600 0x7f0e4c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4a7fc700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 -- 172.21.15.7:0/3116491200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 msgr2=0x7f0e4c0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c0b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 -- 172.21.15.7:0/3116491200 >> v2:172.21.15.148:3300/0 conn(0x7f0e4c157600 msgr2=0x7f0e4c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 --2- 172.21.15.7:0/3116491200 >> v2:172.21.15.148:3300/0 conn(0x7f0e4c157600 0x7f0e4c0b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 -- 172.21.15.7:0/3116491200 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0cb570 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4a7fc700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.033+0000 7f0e4b7fe700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c1586a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0650d0 tx=0x7f0e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b22244d707a04a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e49ffb700 1 -- 172.21.15.7:0/3116491200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c009e70 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e49ffb700 1 -- 172.21.15.7:0/3116491200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00b860 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e49ffb700 1 -- 172.21.15.7:0/3116491200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00bc00 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 -- 172.21.15.7:0/3116491200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 msgr2=0x7f0e4c1586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c1586a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0650d0 tx=0x7f0e3c009250 comp rx=0 tx=0).stop 2023-10-14T19:12:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 -- 172.21.15.7:0/3116491200 shutdown_connections 2023-10-14T19:12:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c1586a0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 --2- 172.21.15.7:0/3116491200 >> v2:172.21.15.148:3300/0 conn(0x7f0e4c157600 0x7f0e4c0b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 --2- 172.21.15.7:0/3116491200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 -- 172.21.15.7:0/3116491200 >> 172.21.15.7:0/3116491200 conn(0x7f0e4c06d170 msgr2=0x7f0e4c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 -- 172.21.15.7:0/3116491200 shutdown_connections 2023-10-14T19:12:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.034+0000 7f0e5192e700 1 -- 172.21.15.7:0/3116491200 wait complete. 2023-10-14T19:12:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.035+0000 7f0e5192e700 1 Processor -- start 2023-10-14T19:12:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 -- start start 2023-10-14T19:12:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c0c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e4c157600 0x7f0e4c167030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c167570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0c5710 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0c40f0 con 0x7f0e4c157600 2023-10-14T19:12:06.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e5192e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0c4b00 con 0x7f0e4c1579d0 2023-10-14T19:12:06.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e4affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c0c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e4affd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c0c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40808/0 (socket says 172.21.15.7:40808) 2023-10-14T19:12:06.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e4affd700 1 -- 172.21.15.7:0/4257015235 learned_addr learned my addr 172.21.15.7:0/4257015235 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:06.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.036+0000 7f0e4a7fc700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e4c157600 0x7f0e4c167030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4b7fe700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c167570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4affd700 1 -- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 msgr2=0x7f0e4c167570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4affd700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c167570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4affd700 1 -- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e4c157600 msgr2=0x7f0e4c167030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4affd700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e4c157600 0x7f0e4c167030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4affd700 1 -- 172.21.15.7:0/4257015235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0094f0 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e4affd700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c0c6bf0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009e50 tx=0x7f0e4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400cc20 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400f040 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0c4de0 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44014480 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.037+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c0c53a0 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.038+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c04c3c0 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.038+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0e440147f0 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.039+0000 7f0e42ffd700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0e2c067320 0x7f0e2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.039+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f0e44085850 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.039+0000 7f0e4a7fc700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0e2c067320 0x7f0e2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.039+0000 7f0e4a7fc700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0e2c067320 0x7f0e2c0697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0e34006f00 tx=0x7f0e34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.043+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e44052340 con 0x7f0e4c0ccba0 2023-10-14T19:12:06.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.264+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e4c0c5850 con 0x7f0e2c067320 2023-10-14T19:12:06.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.267+0000 7f0e42ffd700 1 -- 172.21.15.7:0/4257015235 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f0e34010640 con 0x7f0e2c067320 2023-10-14T19:12:06.267 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:12:06.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:06.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volume_0000000000047808" 2023-10-14T19:12:06.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:06.268 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:12:06.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0e2c067320 msgr2=0x7f0e2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0e2c067320 0x7f0e2c0697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0e34006f00 tx=0x7f0e34008040 comp rx=0 tx=0).stop 2023-10-14T19:12:06.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 msgr2=0x7f0e4c0c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c0c6bf0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009e50 tx=0x7f0e4400b040 comp rx=0 tx=0).stop 2023-10-14T19:12:06.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 shutdown_connections 2023-10-14T19:12:06.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f0e2c067320 0x7f0e2c0697d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e4c1579d0 0x7f0e4c167570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c0ccba0 0x7f0e4c0c6bf0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 --2- 172.21.15.7:0/4257015235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e4c157600 0x7f0e4c167030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 >> 172.21.15.7:0/4257015235 conn(0x7f0e4c06d170 msgr2=0x7f0e4c069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:06.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 shutdown_connections 2023-10-14T19:12:06.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.268+0000 7f0e5192e700 1 -- 172.21.15.7:0/4257015235 wait complete. 2023-10-14T19:12:06.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:06.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.399+0000 7fc0a8287700 1 Processor -- start 2023-10-14T19:12:06.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.399+0000 7fc0a8287700 1 -- start start 2023-10-14T19:12:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a8287700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc0a00cb5a0 0x7fc0a00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a8287700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0a015a5d0 0x7fc0a0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a8287700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a015ae40 con 0x7fc0a00cd9e0 2023-10-14T19:12:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a8287700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00d13f0 con 0x7fc0a015a5d0 2023-10-14T19:12:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a8287700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a015ab60 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a6824700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0a015a5d0 0x7fc0a0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a6824700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0a015a5d0 0x7fc0a0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40814/0 (socket says 172.21.15.7:40814) 2023-10-14T19:12:06.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a5822700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc0a00cd9e0 0x7fc0a0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54388/0 (socket says 172.21.15.7:54388) 2023-10-14T19:12:06.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.400+0000 7fc0a6824700 1 -- 172.21.15.7:0/1829878965 learned_addr learned my addr 172.21.15.7:0/1829878965 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:06.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a6023700 1 --2- 172.21.15.7:0/1829878965 >> v2:172.21.15.148:3300/0 conn(0x7fc0a00cb5a0 0x7fc0a00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a6824700 1 -- 172.21.15.7:0/1829878965 >> v2:172.21.15.148:3300/0 conn(0x7fc0a00cb5a0 msgr2=0x7fc0a00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:06.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a6824700 1 --2- 172.21.15.7:0/1829878965 >> v2:172.21.15.148:3300/0 conn(0x7fc0a00cb5a0 0x7fc0a00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a6824700 1 -- 172.21.15.7:0/1829878965 >> v1:172.21.15.7:6789/0 conn(0x7fc0a00cd9e0 legacy=0x7fc0a0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a6824700 1 -- 172.21.15.7:0/1829878965 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00ccf00 con 0x7fc0a015a5d0 2023-10-14T19:12:06.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a6824700 1 --2- 172.21.15.7:0/1829878965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a015a5d0 0x7fc0a0156e90 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc090009f20 tx=0x7fc090009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df7ca50f64cb8f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a5021700 1 -- 172.21.15.7:0/1829878965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000e070 con 0x7fc0a015a5d0 2023-10-14T19:12:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a5021700 1 -- 172.21.15.7:0/1829878965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000ba40 con 0x7fc0a015a5d0 2023-10-14T19:12:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.401+0000 7fc0a5021700 1 -- 172.21.15.7:0/1829878965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900092e0 con 0x7fc0a015a5d0 2023-10-14T19:12:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 -- 172.21.15.7:0/1829878965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a015a5d0 msgr2=0x7fc0a0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 --2- 172.21.15.7:0/1829878965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a015a5d0 0x7fc0a0156e90 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc090009f20 tx=0x7fc090009840 comp rx=0 tx=0).stop 2023-10-14T19:12:06.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 -- 172.21.15.7:0/1829878965 shutdown_connections 2023-10-14T19:12:06.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 --2- 172.21.15.7:0/1829878965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a015a5d0 0x7fc0a0156e90 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 --2- 172.21.15.7:0/1829878965 >> v2:172.21.15.148:3300/0 conn(0x7fc0a00cb5a0 0x7fc0a00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 -- 172.21.15.7:0/1829878965 >> 172.21.15.7:0/1829878965 conn(0x7fc0a0070e30 msgr2=0x7fc0a00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:06.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 -- 172.21.15.7:0/1829878965 shutdown_connections 2023-10-14T19:12:06.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.402+0000 7fc0a8287700 1 -- 172.21.15.7:0/1829878965 wait complete. 2023-10-14T19:12:06.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 Processor -- start 2023-10-14T19:12:06.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 -- start start 2023-10-14T19:12:06.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 0x7fc0a0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a00cd9e0 0x7fc0a0152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a015a5d0 0x7fc0a015de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a015da30 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0152bc0 con 0x7fc0a015a5d0 2023-10-14T19:12:06.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.403+0000 7fc0a8287700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a015e380 con 0x7fc0a00cd9e0 2023-10-14T19:12:06.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 0x7fc0a0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 0x7fc0a0152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40816/0 (socket says 172.21.15.7:40816) 2023-10-14T19:12:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 -- 172.21.15.7:0/3564657429 learned_addr learned my addr 172.21.15.7:0/3564657429 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6824700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a015a5d0 0x7fc0a015de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a5822700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a00cd9e0 0x7fc0a0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 -- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a00cd9e0 msgr2=0x7fc0a0152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a00cd9e0 0x7fc0a0152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 -- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a015a5d0 msgr2=0x7fc0a015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a015a5d0 0x7fc0a015de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 -- 172.21.15.7:0/3564657429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009ae0 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a6023700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 0x7fc0a0152d50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc09800d8c0 tx=0x7fc098008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980125f0 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098012750 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a015b410 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098012af0 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.404+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a00b4b10 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.405+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a004c3c0 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.406+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc09801e460 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.406+0000 7fc09e7fc700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc08c067320 0x7fc08c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.406+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fc098085280 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.406+0000 7fc0a5822700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc08c067320 0x7fc08c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.407+0000 7fc0a5822700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc08c067320 0x7fc08c0697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc0a015b9d0 tx=0x7fc094007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.410+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc098055910 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.649+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0a00cd1e0 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.650+0000 7fc09e7fc700 1 -- 172.21.15.7:0/3564657429 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+4624 (secure 0 0 0) 0x7fc0980554a0 con 0x7fc0a00cb5a0 2023-10-14T19:12:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:06.651 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":124,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:12:02.863533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000047808","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:12:06.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc08c067320 msgr2=0x7fc08c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc08c067320 0x7fc08c0697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc0a015b9d0 tx=0x7fc094007eb0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 msgr2=0x7fc0a0152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 0x7fc0a0152d50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc09800d8c0 tx=0x7fc098008040 comp rx=0 tx=0).stop 2023-10-14T19:12:06.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 shutdown_connections 2023-10-14T19:12:06.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc08c067320 0x7fc08c0697d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a015a5d0 0x7fc0a015de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a00cb5a0 0x7fc0a0152d50 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 --2- 172.21.15.7:0/3564657429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a00cd9e0 0x7fc0a0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 >> 172.21.15.7:0/3564657429 conn(0x7fc0a0070e30 msgr2=0x7fc0a00cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:06.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 shutdown_connections 2023-10-14T19:12:06.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.652+0000 7fc0a8287700 1 -- 172.21.15.7:0/3564657429 wait complete. 2023-10-14T19:12:06.656 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 124 2023-10-14T19:12:06.665 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:06.790 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.783+0000 7f29967cc700 1 Processor -- start 2023-10-14T19:12:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.783+0000 7f29967cc700 1 -- start start 2023-10-14T19:12:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f29967cc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f29900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f29967cc700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299015ae40 con 0x7f29900cd9e0 2023-10-14T19:12:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f29967cc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299015ab60 con 0x7f29900cde50 2023-10-14T19:12:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f29967cc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29900d13f0 con 0x7f29900cb5a0 2023-10-14T19:12:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f29900cd9e0 0x7f2990159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40626/0 (socket says 172.21.15.7:40626) 2023-10-14T19:12:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298f7fe700 1 -- 172.21.15.7:0/3447568345 learned_addr learned my addr 172.21.15.7:0/3447568345 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298ffff700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f29900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883701571 0 0) 0x7f299015ae40 con 0x7f29900cd9e0 2023-10-14T19:12:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2978003570 con 0x7f29900cd9e0 2023-10-14T19:12:06.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2874564598 0 0) 0x7f2978003570 con 0x7f29900cd9e0 2023-10-14T19:12:06.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 msgr2=0x7f29900cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:06.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f29900cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 >> v1:172.21.15.148:6789/0 conn(0x7f29900cde50 legacy=0x7f2990156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.793 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900ccf00 con 0x7f29900cd9e0 2023-10-14T19:12:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2984001470 con 0x7f29900cd9e0 2023-10-14T19:12:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298ffff700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f29900cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 >> v1:172.21.15.7:6789/0 conn(0x7f29900cd9e0 legacy=0x7f2990159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2978003a90 0x7f2978003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.784+0000 7f298effd700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f2978004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2978004d50 0x7f29780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297800bb10 con 0x7f2978004d50 2023-10-14T19:12:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297800bc50 con 0x7f2978003a90 2023-10-14T19:12:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297800bdc0 con 0x7f29900cb5a0 2023-10-14T19:12:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2978004d50 0x7f29780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298ffff700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2978003a90 0x7f2978003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298f7fe700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f2978004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 -- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 msgr2=0x7f2978004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900cb5a0 0x7f2978004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 -- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2978003a90 msgr2=0x7f2978003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2978003a90 0x7f2978003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 -- 172.21.15.7:0/3447568345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980009420 con 0x7f2978004d50 2023-10-14T19:12:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f2994d69700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2978004d50 0x7f29780051c0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f29880020a0 tx=0x7f29880016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe08ce67f030011 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880019e0 con 0x7f2978004d50 2023-10-14T19:12:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800c8b0 con 0x7f2978004d50 2023-10-14T19:12:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.785+0000 7f298effd700 1 -- 172.21.15.7:0/3447568345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800cc50 con 0x7f2978004d50 2023-10-14T19:12:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f29967cc700 1 -- 172.21.15.7:0/3447568345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2978004d50 msgr2=0x7f29780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f29967cc700 1 --2- 172.21.15.7:0/3447568345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2978004d50 0x7f29780051c0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f29880020a0 tx=0x7f29880016d0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f2994d69700 1 -- 172.21.15.7:0/3447568345 reap_dead start 2023-10-14T19:12:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f29967cc700 1 -- 172.21.15.7:0/3447568345 shutdown_connections 2023-10-14T19:12:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f29967cc700 1 -- 172.21.15.7:0/3447568345 >> 172.21.15.7:0/3447568345 conn(0x7f2990070e30 msgr2=0x7f29900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f29967cc700 1 -- 172.21.15.7:0/3447568345 shutdown_connections 2023-10-14T19:12:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.786+0000 7f29967cc700 1 -- 172.21.15.7:0/3447568345 wait complete. 2023-10-14T19:12:06.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.787+0000 7f29967cc700 1 Processor -- start 2023-10-14T19:12:06.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.787+0000 7f29967cc700 1 -- start start 2023-10-14T19:12:06.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f29967cc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 0x7f29901580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f29967cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29901464d0 0x7f2990158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f29967cc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900ce630 0x7f29900cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f29967cc700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29900b5e50 con 0x7f2990146100 2023-10-14T19:12:06.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f29967cc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29900cf010 con 0x7f29901464d0 2023-10-14T19:12:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f29967cc700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2990156ac0 con 0x7f29900ce630 2023-10-14T19:12:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 0x7f29901580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 0x7f29901580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59466/0 (socket says 172.21.15.7:59466) 2023-10-14T19:12:06.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 -- 172.21.15.7:0/3964913032 learned_addr learned my addr 172.21.15.7:0/3964913032 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f2994d69700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900ce630 0x7f29900cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298f7fe700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29901464d0 0x7f2990158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 -- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900ce630 msgr2=0x7f29900cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900ce630 0x7f29900cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 -- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29901464d0 msgr2=0x7f2990158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:06.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29901464d0 0x7f2990158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:06.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 -- 172.21.15.7:0/3964913032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900b43d0 con 0x7f2990146100 2023-10-14T19:12:06.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f298ffff700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 0x7f29901580c0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f2980011d70 tx=0x7f29800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.788+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000fcd0 con 0x7f2990146100 2023-10-14T19:12:06.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.789+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298000fe30 con 0x7f2990146100 2023-10-14T19:12:06.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.789+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29900b46b0 con 0x7f2990146100 2023-10-14T19:12:06.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.789+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298001d6b0 con 0x7f2990146100 2023-10-14T19:12:06.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.789+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29900b4c70 con 0x7f2990146100 2023-10-14T19:12:06.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.789+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299004c3c0 con 0x7f2990146100 2023-10-14T19:12:06.805 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.790+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f298001daa0 con 0x7f2990146100 2023-10-14T19:12:06.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.790+0000 7f2977fff700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f297c067320 0x7f297c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.790+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f2980018070 con 0x7f2990146100 2023-10-14T19:12:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.790+0000 7f298f7fe700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f297c067320 0x7f297c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.791+0000 7f298f7fe700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f297c067320 0x7f297c0697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2984001200 tx=0x7f2984009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.795+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2980052880 con 0x7f2990146100 2023-10-14T19:12:06.997 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.996+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29900cd1e0 con 0x7f2990146100 2023-10-14T19:12:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.997+0000 7f2977fff700 1 -- 172.21.15.7:0/3964913032 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15491 (secure 0 0 0) 0x7f2980055ea0 con 0x7f2990146100 2023-10-14T19:12:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:06.998 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":188,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:04.873183+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000047808.meta","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000047808"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000047808.data","create_time":"2023-10-14T19:11:49.937199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000047808"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.2a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f297c067320 msgr2=0x7f297c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f297c067320 0x7f297c0697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2984001200 tx=0x7f2984009040 comp rx=0 tx=0).stop 2023-10-14T19:12:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 msgr2=0x7f29901580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 0x7f29901580c0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f2980011d70 tx=0x7f29800091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 shutdown_connections 2023-10-14T19:12:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f297c067320 0x7f297c0697d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29900ce630 0x7f29900cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2990146100 0x7f29901580c0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 --2- 172.21.15.7:0/3964913032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29901464d0 0x7f2990158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 >> 172.21.15.7:0/3964913032 conn(0x7f2990070e30 msgr2=0x7f29900b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 shutdown_connections 2023-10-14T19:12:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:06.999+0000 7f29967cc700 1 -- 172.21.15.7:0/3964913032 wait complete. 2023-10-14T19:12:07.012 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:12:07.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:12:07.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:12:07.101 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:12:07.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:07.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.220+0000 7f88eb6f6700 1 Processor -- start 2023-10-14T19:12:07.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.220+0000 7f88eb6f6700 1 -- start start 2023-10-14T19:12:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88eb6f6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88e40cb970 0x7f88e4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88eb6f6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e415ae40 con 0x7f88e415a400 2023-10-14T19:12:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88eb6f6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e415ab60 con 0x7f88e40cb5a0 2023-10-14T19:12:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88eb6f6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e40ce0f0 con 0x7f88e40cb970 2023-10-14T19:12:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88e8c91700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88e40cb970 0x7f88e4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88e9c93700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f88e415a400 0x7f88e4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40638/0 (socket says 172.21.15.7:40638) 2023-10-14T19:12:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.221+0000 7f88e9c93700 1 -- 172.21.15.7:0/1249101716 learned_addr learned my addr 172.21.15.7:0/1249101716 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e8c91700 1 -- 172.21.15.7:0/1249101716 >> v1:172.21.15.148:6789/0 conn(0x7f88e40cb5a0 legacy=0x7f88e40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e8c91700 1 -- 172.21.15.7:0/1249101716 >> v1:172.21.15.7:6789/0 conn(0x7f88e415a400 legacy=0x7f88e4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e8c91700 1 -- 172.21.15.7:0/1249101716 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e40ccf00 con 0x7f88e40cb970 2023-10-14T19:12:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e3fff700 1 -- 172.21.15.7:0/1249101716 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336541898 0 0) 0x7f88e415ae40 con 0x7f88e415a400 2023-10-14T19:12:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e8c91700 1 --2- 172.21.15.7:0/1249101716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e4159ec0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f88d80098e0 tx=0x7f88d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85ef678c395a23a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e3fff700 1 -- 172.21.15.7:0/1249101716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8009e80 con 0x7f88e40cb970 2023-10-14T19:12:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e3fff700 1 -- 172.21.15.7:0/1249101716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800b820 con 0x7f88e40cb970 2023-10-14T19:12:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88e3fff700 1 -- 172.21.15.7:0/1249101716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800bba0 con 0x7f88e40cb970 2023-10-14T19:12:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88eb6f6700 1 -- 172.21.15.7:0/1249101716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 msgr2=0x7f88e4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/1249101716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e4159ec0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f88d80098e0 tx=0x7f88d80091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88eb6f6700 1 -- 172.21.15.7:0/1249101716 shutdown_connections 2023-10-14T19:12:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/1249101716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e4159ec0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.222+0000 7f88eb6f6700 1 -- 172.21.15.7:0/1249101716 >> 172.21.15.7:0/1249101716 conn(0x7f88e4070e30 msgr2=0x7f88e40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.223+0000 7f88eb6f6700 1 -- 172.21.15.7:0/1249101716 shutdown_connections 2023-10-14T19:12:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.223+0000 7f88eb6f6700 1 -- 172.21.15.7:0/1249101716 wait complete. 2023-10-14T19:12:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.224+0000 7f88eb6f6700 1 Processor -- start 2023-10-14T19:12:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.224+0000 7f88eb6f6700 1 -- start start 2023-10-14T19:12:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.224+0000 7f88eb6f6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88e40cb5a0 0x7f88e4151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e40b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e415a400 0x7f88e40b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40c8480 con 0x7f88e40cb970 2023-10-14T19:12:07.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40c8760 con 0x7f88e415a400 2023-10-14T19:12:07.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40c8a40 con 0x7f88e40cb5a0 2023-10-14T19:12:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e40b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e40b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59484/0 (socket says 172.21.15.7:59484) 2023-10-14T19:12:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 -- 172.21.15.7:0/2279206542 learned_addr learned my addr 172.21.15.7:0/2279206542 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 -- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88e40cb5a0 msgr2=0x7f88e4151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88e40cb5a0 0x7f88e4151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 -- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e415a400 msgr2=0x7f88e40b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e415a400 0x7f88e40b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 -- 172.21.15.7:0/2279206542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009420 con 0x7f88e40cb970 2023-10-14T19:12:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e8c91700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e40b0620 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f88d80030c0 tx=0x7f88d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800ba10 con 0x7f88e40cb970 2023-10-14T19:12:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8020070 con 0x7f88e40cb970 2023-10-14T19:12:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e40c8d20 con 0x7f88e40cb970 2023-10-14T19:12:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d801b6a0 con 0x7f88e40cb970 2023-10-14T19:12:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.225+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e40c9520 con 0x7f88e40cb970 2023-10-14T19:12:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.226+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e40c9240 con 0x7f88e40cb970 2023-10-14T19:12:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.227+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f88d8022030 con 0x7f88e40cb970 2023-10-14T19:12:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.227+0000 7f88e17fa700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f88d0067320 0x7f88d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.227+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f88d8086c10 con 0x7f88e40cb970 2023-10-14T19:12:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.227+0000 7f88e9492700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f88d0067320 0x7f88d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.228+0000 7f88e9492700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f88d0067320 0x7f88d00697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009720 tx=0x7f88dc006c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.231+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88e40c9240 con 0x7f88e40cb970 2023-10-14T19:12:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.467+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88e40c9240 con 0x7f88e40cb970 2023-10-14T19:12:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.467+0000 7f88e17fa700 1 -- 172.21.15.7:0/2279206542 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f88e40c9240 con 0x7f88e40cb970 2023-10-14T19:12:07.469 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:07.469 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":124,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:12:02.863533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000047808","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:12:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f88d0067320 msgr2=0x7f88d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f88d0067320 0x7f88d00697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009720 tx=0x7f88dc006c40 comp rx=0 tx=0).stop 2023-10-14T19:12:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 msgr2=0x7f88e40b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e40b0620 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f88d80030c0 tx=0x7f88d8016000 comp rx=0 tx=0).stop 2023-10-14T19:12:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 shutdown_connections 2023-10-14T19:12:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f88d0067320 0x7f88d00697d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e415a400 0x7f88e40b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88e40cb5a0 0x7f88e4151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 --2- 172.21.15.7:0/2279206542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88e40cb970 0x7f88e40b0620 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 >> 172.21.15.7:0/2279206542 conn(0x7f88e4070e30 msgr2=0x7f88e4155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 shutdown_connections 2023-10-14T19:12:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.470+0000 7f88eb6f6700 1 -- 172.21.15.7:0/2279206542 wait complete. 2023-10-14T19:12:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 124 2023-10-14T19:12:07.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.603+0000 7f512cd69700 1 Processor -- start 2023-10-14T19:12:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.603+0000 7f512cd69700 1 -- start start 2023-10-14T19:12:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f512cd69700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51281598b0 0x7f51280af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f512cd69700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5128159c80 0x7f51280cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f512cd69700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51280ce9d0 con 0x7f51280af790 2023-10-14T19:12:07.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f512cd69700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51280afc30 con 0x7f5128159c80 2023-10-14T19:12:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f512cd69700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51280aff10 con 0x7f51281598b0 2023-10-14T19:12:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f5125d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5128159c80 0x7f51280cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.604+0000 7f5126d9d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f51280af790 0x7f51280cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40644/0 (socket says 172.21.15.7:40644) 2023-10-14T19:12:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f5126d9d700 1 -- 172.21.15.7:0/149316787 learned_addr learned my addr 172.21.15.7:0/149316787 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f5125d9b700 1 -- 172.21.15.7:0/149316787 >> v2:172.21.15.148:3300/0 conn(0x7f51281598b0 msgr2=0x7f51280af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f5125d9b700 1 --2- 172.21.15.7:0/149316787 >> v2:172.21.15.148:3300/0 conn(0x7f51281598b0 0x7f51280af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f5125d9b700 1 -- 172.21.15.7:0/149316787 >> v1:172.21.15.7:6789/0 conn(0x7f51280af790 legacy=0x7f51280cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f5125d9b700 1 -- 172.21.15.7:0/149316787 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280ce380 con 0x7f5128159c80 2023-10-14T19:12:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f512559a700 1 -- 172.21.15.7:0/149316787 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844903085 0 0) 0x7f51280ce9d0 con 0x7f51280af790 2023-10-14T19:12:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f5125d9b700 1 --2- 172.21.15.7:0/149316787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5128159c80 0x7f51280cb6f0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5128065860 tx=0x7f51100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfcd0ffea09c730 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f512559a700 1 -- 172.21.15.7:0/149316787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000b6b0 con 0x7f5128159c80 2023-10-14T19:12:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f512559a700 1 -- 172.21.15.7:0/149316787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000b810 con 0x7f5128159c80 2023-10-14T19:12:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.605+0000 7f512559a700 1 -- 172.21.15.7:0/149316787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000bbb0 con 0x7f5128159c80 2023-10-14T19:12:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 -- 172.21.15.7:0/149316787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5128159c80 msgr2=0x7f51280cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 --2- 172.21.15.7:0/149316787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5128159c80 0x7f51280cb6f0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5128065860 tx=0x7f51100091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 -- 172.21.15.7:0/149316787 shutdown_connections 2023-10-14T19:12:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 --2- 172.21.15.7:0/149316787 >> v2:172.21.15.148:3300/0 conn(0x7f51281598b0 0x7f51280af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 --2- 172.21.15.7:0/149316787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5128159c80 0x7f51280cb6f0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 -- 172.21.15.7:0/149316787 >> 172.21.15.7:0/149316787 conn(0x7f5128070e30 msgr2=0x7f51280d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 -- 172.21.15.7:0/149316787 shutdown_connections 2023-10-14T19:12:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.606+0000 7f512cd69700 1 -- 172.21.15.7:0/149316787 wait complete. 2023-10-14T19:12:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.607+0000 7f512cd69700 1 Processor -- start 2023-10-14T19:12:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.607+0000 7f512cd69700 1 -- start start 2023-10-14T19:12:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 0x7f5128158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51281598b0 0x7f5128150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5128159c80 0x7f5128151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512816a000 con 0x7f51280af790 2023-10-14T19:12:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512816a2e0 con 0x7f51281598b0 2023-10-14T19:12:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512816a5c0 con 0x7f5128159c80 2023-10-14T19:12:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 0x7f5128158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 0x7f5128158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59502/0 (socket says 172.21.15.7:59502) 2023-10-14T19:12:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 -- 172.21.15.7:0/1959896404 learned_addr learned my addr 172.21.15.7:0/1959896404 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f5125d9b700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51281598b0 0x7f5128150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 -- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5128159c80 msgr2=0x7f5128151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5128159c80 0x7f5128151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 -- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51281598b0 msgr2=0x7f5128150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51281598b0 0x7f5128150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 -- 172.21.15.7:0/1959896404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110009420 con 0x7f51280af790 2023-10-14T19:12:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512659c700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 0x7f5128158ae0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f512000b810 tx=0x7f5120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512000f5f0 con 0x7f51280af790 2023-10-14T19:12:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512000f770 con 0x7f51280af790 2023-10-14T19:12:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512816a8a0 con 0x7f51280af790 2023-10-14T19:12:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512000fb30 con 0x7f51280af790 2023-10-14T19:12:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.608+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128159020 con 0x7f51280af790 2023-10-14T19:12:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.609+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512816a140 con 0x7f51280af790 2023-10-14T19:12:07.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.610+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5120010480 con 0x7f51280af790 2023-10-14T19:12:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.610+0000 7f511e7fc700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5108067320 0x7f51080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.610+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f5120084c40 con 0x7f51280af790 2023-10-14T19:12:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.611+0000 7f5125d9b700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5108067320 0x7f51080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.611+0000 7f5125d9b700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5108067320 0x7f51080697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f51100093f0 tx=0x7f5110017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.615+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f512816a140 con 0x7f51280af790 2023-10-14T19:12:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.807+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f512816a140 con 0x7f51280af790 2023-10-14T19:12:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.808+0000 7f511e7fc700 1 -- 172.21.15.7:0/1959896404 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15491 (secure 0 0 0) 0x7f512816a140 con 0x7f51280af790 2023-10-14T19:12:07.809 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:07.809 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":188,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:04.873183+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000047808.meta","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000047808"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000047808.data","create_time":"2023-10-14T19:11:49.937199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000047808"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.2a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5108067320 msgr2=0x7f51080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5108067320 0x7f51080697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f51100093f0 tx=0x7f5110017000 comp rx=0 tx=0).stop 2023-10-14T19:12:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 msgr2=0x7f5128158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 0x7f5128158ae0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f512000b810 tx=0x7f5120009250 comp rx=0 tx=0).stop 2023-10-14T19:12:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 shutdown_connections 2023-10-14T19:12:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5108067320 0x7f51080697d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5128159c80 0x7f5128151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51280af790 0x7f5128158ae0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 --2- 172.21.15.7:0/1959896404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51281598b0 0x7f5128150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 >> 172.21.15.7:0/1959896404 conn(0x7f5128070e30 msgr2=0x7f51280b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.810+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 shutdown_connections 2023-10-14T19:12:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.811+0000 7f512cd69700 1 -- 172.21.15.7:0/1959896404 wait complete. 2023-10-14T19:12:07.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 31, 'pool_name': 'cephfs.volume_0000000000047808.meta', 'create_time': '2023-10-14T19:11:49.383671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000047808'}}}, {'pool': 32, 'pool_name': 'cephfs.volume_0000000000047808.data', 'create_time': '2023-10-14T19:11:49.937199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000047808'}}}] 2023-10-14T19:12:07.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:12:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.946+0000 7ff122b43700 1 Processor -- start 2023-10-14T19:12:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff122b43700 1 -- start start 2023-10-14T19:12:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff122b43700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff11c06dc70 0x7ff11c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff122b43700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff11c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff122b43700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c0ccfd0 con 0x7ff11c159530 2023-10-14T19:12:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff122b43700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c15a3d0 con 0x7ff11c06dc70 2023-10-14T19:12:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff122b43700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c15a6b0 con 0x7ff11c06e0e0 2023-10-14T19:12:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff1208df700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff11c159530 0x7ff11c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40652/0 (socket says 172.21.15.7:40652) 2023-10-14T19:12:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.947+0000 7ff1208df700 1 -- 172.21.15.7:0/1183975591 learned_addr learned my addr 172.21.15.7:0/1183975591 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11bfff700 1 --2- 172.21.15.7:0/1183975591 >> v2:172.21.15.148:3300/0 conn(0x7ff11c06dc70 0x7ff11c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff1210e0700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff11c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681678015 0 0) 0x7ff11c0ccfd0 con 0x7ff11c159530 2023-10-14T19:12:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff108003570 con 0x7ff11c159530 2023-10-14T19:12:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99471107 0 0) 0x7ff108003570 con 0x7ff11c159530 2023-10-14T19:12:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 msgr2=0x7ff11c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff11c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 >> v2:172.21.15.148:3300/0 conn(0x7ff11c06dc70 msgr2=0x7ff11c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 --2- 172.21.15.7:0/1183975591 >> v2:172.21.15.148:3300/0 conn(0x7ff11c06dc70 0x7ff11c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c15a990 con 0x7ff11c159530 2023-10-14T19:12:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff114001470 con 0x7ff11c159530 2023-10-14T19:12:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11bfff700 1 --2- 172.21.15.7:0/1183975591 >> v2:172.21.15.148:3300/0 conn(0x7ff11c06dc70 0x7ff11c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 >> v1:172.21.15.7:6789/0 conn(0x7ff11c159530 legacy=0x7ff11c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff108003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff108004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff108004d50 0x7ff1080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c15a3d0 con 0x7ff108003fe0 2023-10-14T19:12:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c15a6b0 con 0x7ff108004d50 2023-10-14T19:12:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10800ba90 con 0x7ff11c06e0e0 2023-10-14T19:12:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.948+0000 7ff11bfff700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff108004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11bfff700 1 -- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 msgr2=0x7ff108003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff1208df700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff108003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff1210e0700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff108004d50 0x7ff1080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11bfff700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff108003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11bfff700 1 -- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff108004d50 msgr2=0x7ff1080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11bfff700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff108004d50 0x7ff1080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11bfff700 1 -- 172.21.15.7:0/1183975591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108003570 con 0x7ff108003fe0 2023-10-14T19:12:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff1208df700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c06e0e0 0x7ff108003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff1210e0700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff108004d50 0x7ff1080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11bfff700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff108004810 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00e3c0 tx=0x7ff10c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a281add555dc17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00ec10 con 0x7ff108003fe0 2023-10-14T19:12:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c00f040 con 0x7ff108003fe0 2023-10-14T19:12:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff11b7fe700 1 -- 172.21.15.7:0/1183975591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c014480 con 0x7ff108003fe0 2023-10-14T19:12:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff122b43700 1 -- 172.21.15.7:0/1183975591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 msgr2=0x7ff108004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff122b43700 1 --2- 172.21.15.7:0/1183975591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff108004810 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00e3c0 tx=0x7ff10c00b040 comp rx=0 tx=0).stop 2023-10-14T19:12:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff1210e0700 1 -- 172.21.15.7:0/1183975591 reap_dead start 2023-10-14T19:12:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff122b43700 1 -- 172.21.15.7:0/1183975591 shutdown_connections 2023-10-14T19:12:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff122b43700 1 -- 172.21.15.7:0/1183975591 >> 172.21.15.7:0/1183975591 conn(0x7ff11c0703a0 msgr2=0x7ff11c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff122b43700 1 -- 172.21.15.7:0/1183975591 shutdown_connections 2023-10-14T19:12:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.949+0000 7ff122b43700 1 -- 172.21.15.7:0/1183975591 wait complete. 2023-10-14T19:12:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.950+0000 7ff122b43700 1 Processor -- start 2023-10-14T19:12:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 -- start start 2023-10-14T19:12:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff11c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c16b000 0x7ff11c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff11c16cb10 0x7ff11c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0c86e0 con 0x7ff108003fe0 2023-10-14T19:12:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0b3db0 con 0x7ff11c16cb10 2023-10-14T19:12:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.951+0000 7ff122b43700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0c8910 con 0x7ff11c16b000 2023-10-14T19:12:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff11c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff11c0b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59512/0 (socket says 172.21.15.7:59512) 2023-10-14T19:12:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 -- 172.21.15.7:0/2427909089 learned_addr learned my addr 172.21.15.7:0/2427909089 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1210e0700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff11c16cb10 0x7ff11c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 -- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c16b000 msgr2=0x7ff11c0c81a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:12:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c16b000 0x7ff11c0c81a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 -- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff11c16cb10 msgr2=0x7ff11c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:07.970 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff11c16cb10 0x7ff11c0c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:07.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 -- 172.21.15.7:0/2427909089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0b3480 con 0x7ff108003fe0 2023-10-14T19:12:07.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff1208df700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff11c0b60a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7ff11400db80 tx=0x7ff114009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.971 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114007360 con 0x7ff108003fe0 2023-10-14T19:12:07.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1140074c0 con 0x7ff108003fe0 2023-10-14T19:12:07.972 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c0b3760 con 0x7ff108003fe0 2023-10-14T19:12:07.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114004830 con 0x7ff108003fe0 2023-10-14T19:12:07.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.952+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c16cfb0 con 0x7ff108003fe0 2023-10-14T19:12:07.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.953+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c16d230 con 0x7ff108003fe0 2023-10-14T19:12:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.954+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff114004bc0 con 0x7ff108003fe0 2023-10-14T19:12:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.954+0000 7ff118ff9700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff0fc067320 0x7ff0fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.954+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7ff1140849b0 con 0x7ff108003fe0 2023-10-14T19:12:07.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.954+0000 7ff11bfff700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff0fc067320 0x7ff0fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:07.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.955+0000 7ff11bfff700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff0fc067320 0x7ff0fc0697d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff11c16b470 tx=0x7ff10c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:07.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:07.958+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff11404d5a0 con 0x7ff108003fe0 2023-10-14T19:12:08.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.152+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff11c04c3c0 con 0x7ff108003fe0 2023-10-14T19:12:08.154 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.153+0000 7ff118ff9700 1 -- 172.21.15.7:0/2427909089 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v188) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff114019020 con 0x7ff108003fe0 2023-10-14T19:12:08.154 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:12:08.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff0fc067320 msgr2=0x7ff0fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff0fc067320 0x7ff0fc0697d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff11c16b470 tx=0x7ff10c01a000 comp rx=0 tx=0).stop 2023-10-14T19:12:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 msgr2=0x7ff11c0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff11c0b60a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7ff11400db80 tx=0x7ff114009040 comp rx=0 tx=0).stop 2023-10-14T19:12:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 shutdown_connections 2023-10-14T19:12:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff0fc067320 0x7ff0fc0697d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff11c16cb10 0x7ff11c0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff108003fe0 0x7ff11c0b60a0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 --2- 172.21.15.7:0/2427909089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff11c16b000 0x7ff11c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 >> 172.21.15.7:0/2427909089 conn(0x7ff11c0703a0 msgr2=0x7ff11c0cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 shutdown_connections 2023-10-14T19:12:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.155+0000 7ff122b43700 1 -- 172.21.15.7:0/2427909089 wait complete. 2023-10-14T19:12:08.168 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000047808.meta pg_num 2023-10-14T19:12:08.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.289+0000 7fb2a6a7c700 1 Processor -- start 2023-10-14T19:12:08.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.289+0000 7fb2a6a7c700 1 -- start start 2023-10-14T19:12:08.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a6a7c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2a0159550 0x7fb2a00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a6a7c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a015dfd0 0x7fb2a00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a6a7c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb2a0159920 0x7fb2a00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a6a7c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00acc00 con 0x7fb2a0159550 2023-10-14T19:12:08.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a6a7c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00abff0 con 0x7fb2a0159920 2023-10-14T19:12:08.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a6a7c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00ac2d0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a5a7a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2a0159550 0x7fb2a00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a5a7a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2a0159550 0x7fb2a00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59514/0 (socket says 172.21.15.7:59514) 2023-10-14T19:12:08.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.290+0000 7fb2a5a7a700 1 -- 172.21.15.7:0/3604419199 learned_addr learned my addr 172.21.15.7:0/3604419199 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:08.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5279700 1 --2- 172.21.15.7:0/3604419199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a015dfd0 0x7fb2a00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a627b700 1 --2- 172.21.15.7:0/3604419199 >> v2:172.21.15.148:3300/0 conn(0x7fb2a0159920 0x7fb2a00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5a7a700 1 -- 172.21.15.7:0/3604419199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a015dfd0 msgr2=0x7fb2a00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:08.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5a7a700 1 --2- 172.21.15.7:0/3604419199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a015dfd0 0x7fb2a00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5a7a700 1 -- 172.21.15.7:0/3604419199 >> v2:172.21.15.148:3300/0 conn(0x7fb2a0159920 msgr2=0x7fb2a00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:08.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5a7a700 1 --2- 172.21.15.7:0/3604419199 >> v2:172.21.15.148:3300/0 conn(0x7fb2a0159920 0x7fb2a00ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5a7a700 1 -- 172.21.15.7:0/3604419199 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00ac5b0 con 0x7fb2a0159550 2023-10-14T19:12:08.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a5a7a700 1 --2- 172.21.15.7:0/3604419199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a0159550 0x7fb2a00ceac0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fb2a006c180 tx=0x7fb298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f85a8db820dd2c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a4a78700 1 -- 172.21.15.7:0/3604419199 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800b860 con 0x7fb2a0159550 2023-10-14T19:12:08.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a4a78700 1 -- 172.21.15.7:0/3604419199 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800b9c0 con 0x7fb2a0159550 2023-10-14T19:12:08.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a4a78700 1 -- 172.21.15.7:0/3604419199 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800bd60 con 0x7fb2a0159550 2023-10-14T19:12:08.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/3604419199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a0159550 msgr2=0x7fb2a00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/3604419199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a0159550 0x7fb2a00ceac0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fb2a006c180 tx=0x7fb298009250 comp rx=0 tx=0).stop 2023-10-14T19:12:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.291+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/3604419199 shutdown_connections 2023-10-14T19:12:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.292+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/3604419199 >> v2:172.21.15.148:3300/0 conn(0x7fb2a0159920 0x7fb2a00ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.292+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/3604419199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a0159550 0x7fb2a00ceac0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.292+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/3604419199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a015dfd0 0x7fb2a00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.292+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/3604419199 >> 172.21.15.7:0/3604419199 conn(0x7fb2a006ce80 msgr2=0x7fb2a00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:08.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.292+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/3604419199 shutdown_connections 2023-10-14T19:12:08.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.292+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/3604419199 wait complete. 2023-10-14T19:12:08.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 Processor -- start 2023-10-14T19:12:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 -- start start 2023-10-14T19:12:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a0159550 0x7fb2a00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a0159920 0x7fb2a00cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 0x7fb2a00af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00cd280 con 0x7fb2a015dfd0 2023-10-14T19:12:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00699a0 con 0x7fb2a0159550 2023-10-14T19:12:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.293+0000 7fb2a6a7c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00ccdf0 con 0x7fb2a0159920 2023-10-14T19:12:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 0x7fb2a00af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 0x7fb2a00af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59522/0 (socket says 172.21.15.7:59522) 2023-10-14T19:12:08.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 -- 172.21.15.7:0/1926553390 learned_addr learned my addr 172.21.15.7:0/1926553390 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:08.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a5a7a700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a0159550 0x7fb2a00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 -- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a0159920 msgr2=0x7fb2a00cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a0159920 0x7fb2a00cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 -- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a0159550 msgr2=0x7fb2a00b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a0159550 0x7fb2a00b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 -- 172.21.15.7:0/1926553390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980094f0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a627b700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 0x7fb2a00af3f0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fb290009fa0 tx=0x7fb290009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29000ec70 con 0x7fb2a015dfd0 2023-10-14T19:12:08.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29000edd0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00cc1e0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290014670 con 0x7fb2a015dfd0 2023-10-14T19:12:08.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.294+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a00cc7a0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.295+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a004c3c0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.296+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb2900149e0 con 0x7fb2a015dfd0 2023-10-14T19:12:08.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.296+0000 7fb29dffb700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb28c067320 0x7fb28c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.296+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fb290085430 con 0x7fb2a015dfd0 2023-10-14T19:12:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.297+0000 7fb2a5a7a700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb28c067320 0x7fb28c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.297+0000 7fb2a5a7a700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb28c067320 0x7fb28c0697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb2a006c180 tx=0x7fb298017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.300+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb290052030 con 0x7fb2a015dfd0 2023-10-14T19:12:08.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.491+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000047808.meta", "var": "pg_num"} v 0) v1 -- 0x7fb2a00ccf30 con 0x7fb2a015dfd0 2023-10-14T19:12:08.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.492+0000 7fb29dffb700 1 -- 172.21.15.7:0/1926553390 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000047808.meta", "var": "pg_num"}]=0 v188) v1 ==== 124+0+11 (secure 0 0 0) 0x7fb290055650 con 0x7fb2a015dfd0 2023-10-14T19:12:08.493 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:12:08.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb28c067320 msgr2=0x7fb28c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb28c067320 0x7fb28c0697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb2a006c180 tx=0x7fb298017000 comp rx=0 tx=0).stop 2023-10-14T19:12:08.495 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 msgr2=0x7fb2a00af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 0x7fb2a00af3f0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fb290009fa0 tx=0x7fb290009900 comp rx=0 tx=0).stop 2023-10-14T19:12:08.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 shutdown_connections 2023-10-14T19:12:08.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fb28c067320 0x7fb28c0697d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a0159550 0x7fb2a00b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2a015dfd0 0x7fb2a00af3f0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 --2- 172.21.15.7:0/1926553390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2a0159920 0x7fb2a00cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 >> 172.21.15.7:0/1926553390 conn(0x7fb2a006ce80 msgr2=0x7fb2a014cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:08.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 shutdown_connections 2023-10-14T19:12:08.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.494+0000 7fb2a6a7c700 1 -- 172.21.15.7:0/1926553390 wait complete. 2023-10-14T19:12:08.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000047808.data pg_num 2023-10-14T19:12:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.628+0000 7f786672c700 1 Processor -- start 2023-10-14T19:12:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.628+0000 7f786672c700 1 -- start start 2023-10-14T19:12:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f786672c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7860159530 0x7f78600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f786672c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78600ccfd0 con 0x7f786006dc70 2023-10-14T19:12:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f786672c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78600cf0e0 con 0x7f786006e0e0 2023-10-14T19:12:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f786672c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786015a3d0 con 0x7f7860159530 2023-10-14T19:12:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f785f7fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f786006dc70 0x7f7860159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40654/0 (socket says 172.21.15.7:40654) 2023-10-14T19:12:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f785f7fe700 1 -- 172.21.15.7:0/3663813584 learned_addr learned my addr 172.21.15.7:0/3663813584 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f785ffff700 1 --2- 172.21.15.7:0/3663813584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7860159530 0x7f78600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117173112 0 0) 0x7f78600ccfd0 con 0x7f786006dc70 2023-10-14T19:12:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.629+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7848003570 con 0x7f786006dc70 2023-10-14T19:12:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915993751 0 0) 0x7f78600cf0e0 con 0x7f786006e0e0 2023-10-14T19:12:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78600ccfd0 con 0x7f786006e0e0 2023-10-14T19:12:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785ffff700 1 -- 172.21.15.7:0/3663813584 >> v1:172.21.15.148:6789/0 conn(0x7f786006e0e0 legacy=0x7f78600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785ffff700 1 -- 172.21.15.7:0/3663813584 >> v1:172.21.15.7:6789/0 conn(0x7f786006dc70 legacy=0x7f7860159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014925955 0 0) 0x7f7848003570 con 0x7f786006dc70 2023-10-14T19:12:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785ffff700 1 -- 172.21.15.7:0/3663813584 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786015a6b0 con 0x7f7860159530 2023-10-14T19:12:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785ffff700 1 --2- 172.21.15.7:0/3663813584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7860159530 0x7f78600ceba0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7850009910 tx=0x7f78500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b2c018c5fa695e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854001470 con 0x7f7860159530 2023-10-14T19:12:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850011420 con 0x7f7860159530 2023-10-14T19:12:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f785effd700 1 -- 172.21.15.7:0/3663813584 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500117c0 con 0x7f7860159530 2023-10-14T19:12:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f786672c700 1 -- 172.21.15.7:0/3663813584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7860159530 msgr2=0x7f78600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f786672c700 1 --2- 172.21.15.7:0/3663813584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7860159530 0x7f78600ceba0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7850009910 tx=0x7f78500091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f786672c700 1 -- 172.21.15.7:0/3663813584 shutdown_connections 2023-10-14T19:12:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.630+0000 7f786672c700 1 --2- 172.21.15.7:0/3663813584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7860159530 0x7f78600ceba0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.631+0000 7f786672c700 1 -- 172.21.15.7:0/3663813584 >> 172.21.15.7:0/3663813584 conn(0x7f78600703a0 msgr2=0x7f78600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.631+0000 7f786672c700 1 -- 172.21.15.7:0/3663813584 shutdown_connections 2023-10-14T19:12:08.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.631+0000 7f786672c700 1 -- 172.21.15.7:0/3663813584 wait complete. 2023-10-14T19:12:08.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 Processor -- start 2023-10-14T19:12:08.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 -- start start 2023-10-14T19:12:08.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f786006dc70 0x7f78601559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f786006e0e0 0x7f786014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 0x7f78600b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860158af0 con 0x7f7860159530 2023-10-14T19:12:08.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.632+0000 7f786672c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78600b3ab0 con 0x7f786006e0e0 2023-10-14T19:12:08.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f786672c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786014b290 con 0x7f786006dc70 2023-10-14T19:12:08.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 0x7f78600b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 0x7f78600b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59532/0 (socket says 172.21.15.7:59532) 2023-10-14T19:12:08.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 -- 172.21.15.7:0/4171609152 learned_addr learned my addr 172.21.15.7:0/4171609152 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:08.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f785ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f786006dc70 0x7f78601559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f785f7fe700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f786006e0e0 0x7f786014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 -- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f786006dc70 msgr2=0x7f78601559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f786006dc70 0x7f78601559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 -- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f786006e0e0 msgr2=0x7f786014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f786006e0e0 0x7f786014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 -- 172.21.15.7:0/4171609152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850009420 con 0x7f7860159530 2023-10-14T19:12:08.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7864cc9700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 0x7f78600b3f40 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f785800c910 tx=0x7f7858007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858012630 con 0x7f7860159530 2023-10-14T19:12:08.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78580127b0 con 0x7f7860159530 2023-10-14T19:12:08.643 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78600b3480 con 0x7f7860159530 2023-10-14T19:12:08.644 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858012b70 con 0x7f7860159530 2023-10-14T19:12:08.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.633+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786014cb30 con 0x7f7860159530 2023-10-14T19:12:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.634+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786004c3c0 con 0x7f7860159530 2023-10-14T19:12:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.635+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f785801b400 con 0x7f7860159530 2023-10-14T19:12:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.635+0000 7f7847fff700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f784c067320 0x7f784c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.635+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f7858084fc0 con 0x7f7860159530 2023-10-14T19:12:08.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.635+0000 7f785ffff700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f784c067320 0x7f784c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.636+0000 7f785ffff700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f784c067320 0x7f784c0697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f78500030c0 tx=0x7f7850016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.639+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7858051bc0 con 0x7f7860159530 2023-10-14T19:12:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.833+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000047808.data", "var": "pg_num"} v 0) v1 -- 0x7f786015a990 con 0x7f7860159530 2023-10-14T19:12:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.833+0000 7f7847fff700 1 -- 172.21.15.7:0/4171609152 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000047808.data", "var": "pg_num"}]=0 v188) v1 ==== 124+0+11 (secure 0 0 0) 0x7f7858016020 con 0x7f7860159530 2023-10-14T19:12:08.835 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:12:08.836 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f784c067320 msgr2=0x7f784c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f784c067320 0x7f784c0697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f78500030c0 tx=0x7f7850016000 comp rx=0 tx=0).stop 2023-10-14T19:12:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 msgr2=0x7f78600b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 0x7f78600b3f40 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f785800c910 tx=0x7f7858007f90 comp rx=0 tx=0).stop 2023-10-14T19:12:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 shutdown_connections 2023-10-14T19:12:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f784c067320 0x7f784c0697d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7860159530 0x7f78600b3f40 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f786006dc70 0x7f78601559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 --2- 172.21.15.7:0/4171609152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f786006e0e0 0x7f786014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 >> 172.21.15.7:0/4171609152 conn(0x7f78600703a0 msgr2=0x7f78600b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 shutdown_connections 2023-10-14T19:12:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.835+0000 7f786672c700 1 -- 172.21.15.7:0/4171609152 wait complete. 2023-10-14T19:12:08.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.967+0000 7f51b776d700 1 Processor -- start 2023-10-14T19:12:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.968+0000 7f51b776d700 1 -- start start 2023-10-14T19:12:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.968+0000 7f51b776d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b00cb5a0 0x7f51b00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.968+0000 7f51b776d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b015ae40 con 0x7f51b00cde50 2023-10-14T19:12:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.968+0000 7f51b776d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b015ab60 con 0x7f51b00cd9e0 2023-10-14T19:12:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.968+0000 7f51b776d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00d13f0 con 0x7f51b00cb5a0 2023-10-14T19:12:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.968+0000 7f51b5d0a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f51b00cde50 0x7f51b0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40668/0 (socket says 172.21.15.7:40668) 2023-10-14T19:12:08.975 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5d0a700 1 -- 172.21.15.7:0/1296391885 learned_addr learned my addr 172.21.15.7:0/1296391885 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141603956 0 0) 0x7f51b015ae40 con 0x7f51b00cde50 2023-10-14T19:12:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5198003570 con 0x7f51b00cde50 2023-10-14T19:12:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795340432 0 0) 0x7f5198003570 con 0x7f51b00cde50 2023-10-14T19:12:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b00cb5a0 msgr2=0x7f51b00cb970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:12:08.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b00cb5a0 0x7f51b00cb970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 >> v1:172.21.15.148:6789/0 conn(0x7f51b00cd9e0 legacy=0x7f51b0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00ccf00 con 0x7f51b00cde50 2023-10-14T19:12:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f51a00017f0 con 0x7f51b00cde50 2023-10-14T19:12:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 >> v1:172.21.15.7:6789/0 conn(0x7f51b00cde50 legacy=0x7f51b0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f5198003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b00cb5a0 0x7f5198004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5198004f50 0x7f519800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5198005570 con 0x7f5198003a90 2023-10-14T19:12:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980056e0 con 0x7f5198004f50 2023-10-14T19:12:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519800c020 con 0x7f51b00cb5a0 2023-10-14T19:12:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5509700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f5198003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5509700 1 -- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b00cb5a0 msgr2=0x7f5198004810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:12:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5509700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b00cb5a0 0x7f5198004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5509700 1 -- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5198004f50 msgr2=0x7f519800ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:12:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5509700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5198004f50 0x7f519800ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.969+0000 7f51b5509700 1 -- 172.21.15.7:0/1296391885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198003570 con 0x7f5198003a90 2023-10-14T19:12:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b5509700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f5198003ea0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009920 tx=0x7f51a8006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacb560e2bd36a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8011400 con 0x7f5198003a90 2023-10-14T19:12:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8011580 con 0x7f5198003a90 2023-10-14T19:12:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51affff700 1 -- 172.21.15.7:0/1296391885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8011940 con 0x7f5198003a90 2023-10-14T19:12:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b776d700 1 -- 172.21.15.7:0/1296391885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 msgr2=0x7f5198003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b776d700 1 --2- 172.21.15.7:0/1296391885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f5198003ea0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009920 tx=0x7f51a8006ef0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b5d0a700 1 -- 172.21.15.7:0/1296391885 reap_dead start 2023-10-14T19:12:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b776d700 1 -- 172.21.15.7:0/1296391885 shutdown_connections 2023-10-14T19:12:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b776d700 1 -- 172.21.15.7:0/1296391885 >> 172.21.15.7:0/1296391885 conn(0x7f51b0070e30 msgr2=0x7f51b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b776d700 1 -- 172.21.15.7:0/1296391885 shutdown_connections 2023-10-14T19:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.970+0000 7f51b776d700 1 -- 172.21.15.7:0/1296391885 wait complete. 2023-10-14T19:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.971+0000 7f51b776d700 1 Processor -- start 2023-10-14T19:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.971+0000 7f51b776d700 1 -- start start 2023-10-14T19:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b776d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f51b0155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b776d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b015d040 0x7f51b015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b776d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b015f650 0x7f51b015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b776d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0160010 con 0x7f5198003a90 2023-10-14T19:12:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b776d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00b34b0 con 0x7f51b015f650 2023-10-14T19:12:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b776d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00b3790 con 0x7f51b015d040 2023-10-14T19:12:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b5509700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f51b0155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b5509700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f51b0155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59562/0 (socket says 172.21.15.7:59562) 2023-10-14T19:12:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.972+0000 7f51b5509700 1 -- 172.21.15.7:0/383164457 learned_addr learned my addr 172.21.15.7:0/383164457 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b4d08700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b015d040 0x7f51b015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5d0a700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b015f650 0x7f51b015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5509700 1 -- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b015d040 msgr2=0x7f51b015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5509700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b015d040 0x7f51b015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5509700 1 -- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b015f650 msgr2=0x7f51b015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5509700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b015f650 0x7f51b015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5509700 1 -- 172.21.15.7:0/383164457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00b3a70 con 0x7f5198003a90 2023-10-14T19:12:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5d0a700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b015f650 0x7f51b015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b5509700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f51b0155050 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009f10 tx=0x7f51a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80116f0 con 0x7f5198003a90 2023-10-14T19:12:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8011850 con 0x7f5198003a90 2023-10-14T19:12:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b00b3d50 con 0x7f5198003a90 2023-10-14T19:12:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a801d680 con 0x7f5198003a90 2023-10-14T19:12:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.973+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b00b4310 con 0x7f5198003a90 2023-10-14T19:12:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.974+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b004c3c0 con 0x7f5198003a90 2023-10-14T19:12:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.974+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f51a801da30 con 0x7f5198003a90 2023-10-14T19:12:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.975+0000 7f51ad7fa700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f519c067320 0x7f519c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.975+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f51a80869f0 con 0x7f5198003a90 2023-10-14T19:12:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.975+0000 7f51b4d08700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f519c067320 0x7f519c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.975+0000 7f51b4d08700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f519c067320 0x7f519c0697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f51a4001050 tx=0x7f51a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:08.979+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51a8053700 con 0x7f5198003a90 2023-10-14T19:12:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.216+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51b00cd1e0 con 0x7f5198003a90 2023-10-14T19:12:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.216+0000 7f51ad7fa700 1 -- 172.21.15.7:0/383164457 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f51a802a090 con 0x7f5198003a90 2023-10-14T19:12:09.218 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:09.218 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":124,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:12:02.863533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000047808","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:12:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f519c067320 msgr2=0x7f519c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f519c067320 0x7f519c0697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f51a4001050 tx=0x7f51a4009040 comp rx=0 tx=0).stop 2023-10-14T19:12:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 msgr2=0x7f51b0155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f51b0155050 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009f10 tx=0x7f51a8012000 comp rx=0 tx=0).stop 2023-10-14T19:12:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 shutdown_connections 2023-10-14T19:12:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f519c067320 0x7f519c0697d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b015f650 0x7f51b015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5198003a90 0x7f51b0155050 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 --2- 172.21.15.7:0/383164457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51b015d040 0x7f51b015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.218+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 >> 172.21.15.7:0/383164457 conn(0x7f51b0070e30 msgr2=0x7f51b00b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:09.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.219+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 shutdown_connections 2023-10-14T19:12:09.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.219+0000 7f51b776d700 1 -- 172.21.15.7:0/383164457 wait complete. 2023-10-14T19:12:09.222 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 124 2023-10-14T19:12:09.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:09.351 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.350+0000 7f381d95f700 1 Processor -- start 2023-10-14T19:12:09.352 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.350+0000 7f381d95f700 1 -- start start 2023-10-14T19:12:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f381d95f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f38180cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f381d95f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38180cb1a0 0x7f38180cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f381d95f700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381815e010 con 0x7f38181598a0 2023-10-14T19:12:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f381d95f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381815d420 con 0x7f38180cb1a0 2023-10-14T19:12:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f381d95f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381815d6e0 con 0x7f38181594d0 2023-10-14T19:12:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f38177fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38181598a0 0x7f38180ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40684/0 (socket says 172.21.15.7:40684) 2023-10-14T19:12:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f38177fe700 1 -- 172.21.15.7:0/2931597727 learned_addr learned my addr 172.21.15.7:0/2931597727 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f38167fc700 1 --2- 172.21.15.7:0/2931597727 >> v2:172.21.15.148:3300/0 conn(0x7f38180cb1a0 0x7f38180cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f3816ffd700 1 --2- 172.21.15.7:0/2931597727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f38180cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f3815ffb700 1 -- 172.21.15.7:0/2931597727 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032153162 0 0) 0x7f381815e010 con 0x7f38181598a0 2023-10-14T19:12:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.351+0000 7f3815ffb700 1 -- 172.21.15.7:0/2931597727 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3804003570 con 0x7f38181598a0 2023-10-14T19:12:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3815ffb700 1 -- 172.21.15.7:0/2931597727 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 577764463 0 0) 0x7f3804003570 con 0x7f38181598a0 2023-10-14T19:12:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3816ffd700 1 -- 172.21.15.7:0/2931597727 >> v2:172.21.15.148:3300/0 conn(0x7f38180cb1a0 msgr2=0x7f38180cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3816ffd700 1 --2- 172.21.15.7:0/2931597727 >> v2:172.21.15.148:3300/0 conn(0x7f38180cb1a0 0x7f38180cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3816ffd700 1 -- 172.21.15.7:0/2931597727 >> v1:172.21.15.7:6789/0 conn(0x7f38181598a0 legacy=0x7f38180ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3816ffd700 1 -- 172.21.15.7:0/2931597727 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381815d9c0 con 0x7f38181594d0 2023-10-14T19:12:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f38167fc700 1 --2- 172.21.15.7:0/2931597727 >> v2:172.21.15.148:3300/0 conn(0x7f38180cb1a0 0x7f38180cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3816ffd700 1 --2- 172.21.15.7:0/2931597727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f38180cea70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38100098e0 tx=0x7f38100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25ee18e44d90881c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3815ffb700 1 -- 172.21.15.7:0/2931597727 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080017f0 con 0x7f38181594d0 2023-10-14T19:12:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3815ffb700 1 -- 172.21.15.7:0/2931597727 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810011420 con 0x7f38181594d0 2023-10-14T19:12:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.352+0000 7f3815ffb700 1 -- 172.21.15.7:0/2931597727 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100117c0 con 0x7f38181594d0 2023-10-14T19:12:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 -- 172.21.15.7:0/2931597727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 msgr2=0x7f38180cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 --2- 172.21.15.7:0/2931597727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f38180cea70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38100098e0 tx=0x7f38100091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 -- 172.21.15.7:0/2931597727 shutdown_connections 2023-10-14T19:12:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 --2- 172.21.15.7:0/2931597727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f38180cea70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 --2- 172.21.15.7:0/2931597727 >> v2:172.21.15.148:3300/0 conn(0x7f38180cb1a0 0x7f38180cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 -- 172.21.15.7:0/2931597727 >> 172.21.15.7:0/2931597727 conn(0x7f38180703a0 msgr2=0x7f3818070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 -- 172.21.15.7:0/2931597727 shutdown_connections 2023-10-14T19:12:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.353+0000 7f381d95f700 1 -- 172.21.15.7:0/2931597727 wait complete. 2023-10-14T19:12:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.354+0000 7f381d95f700 1 Processor -- start 2023-10-14T19:12:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.354+0000 7f381d95f700 1 -- start start 2023-10-14T19:12:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f381d95f700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 0x7f38180ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f381d95f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f381815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f381d95f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38181598a0 0x7f381815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f381d95f700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381815ca50 con 0x7f38180cb1a0 2023-10-14T19:12:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f381d95f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180c7e60 con 0x7f38181598a0 2023-10-14T19:12:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f381d95f700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381815c770 con 0x7f38181594d0 2023-10-14T19:12:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 0x7f38180ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 0x7f38180ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59570/0 (socket says 172.21.15.7:59570) 2023-10-14T19:12:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 -- 172.21.15.7:0/3221244460 learned_addr learned my addr 172.21.15.7:0/3221244460 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f38167fc700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f381815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f38177fe700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38181598a0 0x7f381815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 -- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 msgr2=0x7f381815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f381815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 -- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38181598a0 msgr2=0x7f381815f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38181598a0 0x7f381815f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 -- 172.21.15.7:0/3221244460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800009420 con 0x7f38180cb1a0 2023-10-14T19:12:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f3816ffd700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 0x7f38180ca030 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f38100030c0 tx=0x7f3810016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.355+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381001cb30 con 0x7f38180cb1a0 2023-10-14T19:12:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.356+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381001cc90 con 0x7f38180cb1a0 2023-10-14T19:12:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.356+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3810009420 con 0x7f38180cb1a0 2023-10-14T19:12:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.356+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810025680 con 0x7f38180cb1a0 2023-10-14T19:12:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.356+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180c7a80 con 0x7f38180cb1a0 2023-10-14T19:12:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.357+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38180c7600 con 0x7f38180cb1a0 2023-10-14T19:12:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.357+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f38100193f0 con 0x7f38180cb1a0 2023-10-14T19:12:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.357+0000 7f380effd700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37f8067320 0x7f37f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.357+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f3810085e50 con 0x7f38180cb1a0 2023-10-14T19:12:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.357+0000 7f38167fc700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37f8067320 0x7f37f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.358+0000 7f38167fc700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37f8067320 0x7f37f80697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f38181602c0 tx=0x7f38000091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.362+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38180c7600 con 0x7f38180cb1a0 2023-10-14T19:12:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.557+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38180c7600 con 0x7f38180cb1a0 2023-10-14T19:12:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.558+0000 7f380effd700 1 -- 172.21.15.7:0/3221244460 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15491 (secure 0 0 0) 0x7f38180c7600 con 0x7f38180cb1a0 2023-10-14T19:12:09.560 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:09.560 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":188,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:04.873183+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000047808.meta","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000047808"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000047808.data","create_time":"2023-10-14T19:11:49.937199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000047808"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.2a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37f8067320 msgr2=0x7f37f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37f8067320 0x7f37f80697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f38181602c0 tx=0x7f38000091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 msgr2=0x7f38180ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 0x7f38180ca030 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f38100030c0 tx=0x7f3810016000 comp rx=0 tx=0).stop 2023-10-14T19:12:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 shutdown_connections 2023-10-14T19:12:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37f8067320 0x7f37f80697d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38181598a0 0x7f381815f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38180cb1a0 0x7f38180ca030 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 --2- 172.21.15.7:0/3221244460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38181594d0 0x7f381815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 >> 172.21.15.7:0/3221244460 conn(0x7f38180703a0 msgr2=0x7f381806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 shutdown_connections 2023-10-14T19:12:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.560+0000 7f381d95f700 1 -- 172.21.15.7:0/3221244460 wait complete. 2023-10-14T19:12:09.574 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000047808 and related pools 2023-10-14T19:12:09.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:09.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.693+0000 7f697de92700 1 Processor -- start 2023-10-14T19:12:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.693+0000 7f697de92700 1 -- start start 2023-10-14T19:12:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f697de92700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6978159c20 0x7f69780b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f697de92700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69780b0e70 0x7f69780c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f697de92700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780adb20 con 0x7f6978159850 2023-10-14T19:12:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f697de92700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780ccdc0 con 0x7f6978159c20 2023-10-14T19:12:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f697de92700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780b12f0 con 0x7f69780b0e70 2023-10-14T19:12:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f6976ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6978159c20 0x7f69780b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f69777fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6978159850 0x7f69780adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40696/0 (socket says 172.21.15.7:40696) 2023-10-14T19:12:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f6976ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6978159c20 0x7f69780b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59580/0 (socket says 172.21.15.7:59580) 2023-10-14T19:12:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.694+0000 7f69777fe700 1 -- 172.21.15.7:0/3591870081 learned_addr learned my addr 172.21.15.7:0/3591870081 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6977fff700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69780b0e70 0x7f69780c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6976ffd700 1 -- 172.21.15.7:0/3591870081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69780b0e70 msgr2=0x7f69780c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6976ffd700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69780b0e70 0x7f69780c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6976ffd700 1 -- 172.21.15.7:0/3591870081 >> v1:172.21.15.7:6789/0 conn(0x7f6978159850 legacy=0x7f69780adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6976ffd700 1 -- 172.21.15.7:0/3591870081 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780acf10 con 0x7f6978159c20 2023-10-14T19:12:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f69767fc700 1 -- 172.21.15.7:0/3591870081 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891352825 0 0) 0x7f69780adb20 con 0x7f6978159850 2023-10-14T19:12:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6977fff700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69780b0e70 0x7f69780c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f6976ffd700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6978159c20 0x7f69780b0930 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f696c009910 tx=0x7f696c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730b4fd80b225ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f69767fc700 1 -- 172.21.15.7:0/3591870081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00b820 con 0x7f6978159c20 2023-10-14T19:12:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f69767fc700 1 -- 172.21.15.7:0/3591870081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00b980 con 0x7f6978159c20 2023-10-14T19:12:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.695+0000 7f69767fc700 1 -- 172.21.15.7:0/3591870081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00bd20 con 0x7f6978159c20 2023-10-14T19:12:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 -- 172.21.15.7:0/3591870081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6978159c20 msgr2=0x7f69780b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6978159c20 0x7f69780b0930 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f696c009910 tx=0x7f696c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 -- 172.21.15.7:0/3591870081 shutdown_connections 2023-10-14T19:12:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69780b0e70 0x7f69780c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 --2- 172.21.15.7:0/3591870081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6978159c20 0x7f69780b0930 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 -- 172.21.15.7:0/3591870081 >> 172.21.15.7:0/3591870081 conn(0x7f697806d170 msgr2=0x7f69780cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 -- 172.21.15.7:0/3591870081 shutdown_connections 2023-10-14T19:12:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.696+0000 7f697de92700 1 -- 172.21.15.7:0/3591870081 wait complete. 2023-10-14T19:12:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.697+0000 7f697de92700 1 Processor -- start 2023-10-14T19:12:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.697+0000 7f697de92700 1 -- start start 2023-10-14T19:12:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 0x7f697814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6978159850 0x7f69780cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6978159c20 0x7f6978154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814e800 con 0x7f69780b0e70 2023-10-14T19:12:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814dbf0 con 0x7f6978159c20 2023-10-14T19:12:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697814ded0 con 0x7f6978159850 2023-10-14T19:12:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 0x7f697814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 0x7f697814d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59586/0 (socket says 172.21.15.7:59586) 2023-10-14T19:12:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 -- 172.21.15.7:0/1079379538 learned_addr learned my addr 172.21.15.7:0/1079379538 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f6976ffd700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6978159850 0x7f69780cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f6977fff700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6978159c20 0x7f6978154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 -- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6978159850 msgr2=0x7f69780cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6978159850 0x7f69780cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 -- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6978159c20 msgr2=0x7f6978154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6978159c20 0x7f6978154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 -- 172.21.15.7:0/1079379538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009420 con 0x7f69780b0e70 2023-10-14T19:12:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f69777fe700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 0x7f697814d060 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f696800c7e0 tx=0x7f6968007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968005b30 con 0x7f69780b0e70 2023-10-14T19:12:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968005c90 con 0x7f69780b0e70 2023-10-14T19:12:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968007300 con 0x7f69780b0e70 2023-10-14T19:12:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.698+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697814e1b0 con 0x7f69780b0e70 2023-10-14T19:12:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.699+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697814d8a0 con 0x7f69780b0e70 2023-10-14T19:12:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.699+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697804c3c0 con 0x7f69780b0e70 2023-10-14T19:12:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.700+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f696801b400 con 0x7f69780b0e70 2023-10-14T19:12:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.700+0000 7f695f7fe700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6964067320 0x7f69640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.700+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f6968084790 con 0x7f69780b0e70 2023-10-14T19:12:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.700+0000 7f6976ffd700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6964067320 0x7f69640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.701+0000 7f6976ffd700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6964067320 0x7f69640697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f696c0091e0 tx=0x7f696c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.705+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6968051490 con 0x7f69780b0e70 2023-10-14T19:12:09.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.947+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69780ad1f0 con 0x7f69780b0e70 2023-10-14T19:12:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.948+0000 7f695f7fe700 1 -- 172.21.15.7:0/1079379538 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f6968054ab0 con 0x7f69780b0e70 2023-10-14T19:12:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:09.951 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":124,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:12:02.863533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000047808","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:12:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6964067320 msgr2=0x7f69640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6964067320 0x7f69640697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f696c0091e0 tx=0x7f696c017000 comp rx=0 tx=0).stop 2023-10-14T19:12:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 msgr2=0x7f697814d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 0x7f697814d060 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f696800c7e0 tx=0x7f6968007df0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 shutdown_connections 2023-10-14T19:12:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6964067320 0x7f69640697d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6978159c20 0x7f6978154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69780b0e70 0x7f697814d060 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 --2- 172.21.15.7:0/1079379538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6978159850 0x7f69780cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 >> 172.21.15.7:0/1079379538 conn(0x7f697806d170 msgr2=0x7f697806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 shutdown_connections 2023-10-14T19:12:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:09.950+0000 7f697de92700 1 -- 172.21.15.7:0/1079379538 wait complete. 2023-10-14T19:12:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 124 2023-10-14T19:12:09.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.083+0000 7f193977b700 1 Processor -- start 2023-10-14T19:12:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.083+0000 7f193977b700 1 -- start start 2023-10-14T19:12:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f193977b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f19340b07d0 0x7f19340ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f193977b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19340cf200 0x7f19340cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f193977b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193415a280 con 0x7f19340b0ba0 2023-10-14T19:12:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f193977b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193406e180 con 0x7f19340cf200 2023-10-14T19:12:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f193977b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340cd540 con 0x7f19340b07d0 2023-10-14T19:12:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19327fc700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19340cf200 0x7f19340cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19337fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f19340b0ba0 0x7f193406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40700/0 (socket says 172.21.15.7:40700) 2023-10-14T19:12:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19337fe700 1 -- 172.21.15.7:0/1125485580 learned_addr learned my addr 172.21.15.7:0/1125485580 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f1932ffd700 1 --2- 172.21.15.7:0/1125485580 >> v2:172.21.15.148:3300/0 conn(0x7f19340b07d0 0x7f19340ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19327fc700 1 -- 172.21.15.7:0/1125485580 >> v2:172.21.15.148:3300/0 conn(0x7f19340b07d0 msgr2=0x7f19340ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19327fc700 1 --2- 172.21.15.7:0/1125485580 >> v2:172.21.15.148:3300/0 conn(0x7f19340b07d0 0x7f19340ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19327fc700 1 -- 172.21.15.7:0/1125485580 >> v1:172.21.15.7:6789/0 conn(0x7f19340b0ba0 legacy=0x7f193406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19327fc700 1 -- 172.21.15.7:0/1125485580 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193406d850 con 0x7f19340cf200 2023-10-14T19:12:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.084+0000 7f19327fc700 1 --2- 172.21.15.7:0/1125485580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f19340cd000 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f1934064720 tx=0x7f191c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73ca95d2236e8bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.090 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f1931ffb700 1 -- 172.21.15.7:0/1125485580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00b740 con 0x7f19340cf200 2023-10-14T19:12:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f1931ffb700 1 -- 172.21.15.7:0/1125485580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00b8a0 con 0x7f19340cf200 2023-10-14T19:12:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f1931ffb700 1 -- 172.21.15.7:0/1125485580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00bc40 con 0x7f19340cf200 2023-10-14T19:12:10.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 -- 172.21.15.7:0/1125485580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 msgr2=0x7f19340cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 --2- 172.21.15.7:0/1125485580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f19340cd000 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f1934064720 tx=0x7f191c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 -- 172.21.15.7:0/1125485580 shutdown_connections 2023-10-14T19:12:10.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 --2- 172.21.15.7:0/1125485580 >> v2:172.21.15.148:3300/0 conn(0x7f19340b07d0 0x7f19340ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 --2- 172.21.15.7:0/1125485580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f19340cd000 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 -- 172.21.15.7:0/1125485580 >> 172.21.15.7:0/1125485580 conn(0x7f193406ce80 msgr2=0x7f19340ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:10.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 -- 172.21.15.7:0/1125485580 shutdown_connections 2023-10-14T19:12:10.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.085+0000 7f193977b700 1 -- 172.21.15.7:0/1125485580 wait complete. 2023-10-14T19:12:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.086+0000 7f193977b700 1 Processor -- start 2023-10-14T19:12:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 -- start start 2023-10-14T19:12:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19340b07d0 0x7f1934154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19340b0ba0 0x7f1934151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f1934158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341546d0 con 0x7f19340cf200 2023-10-14T19:12:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193409b0d0 con 0x7f19340b07d0 2023-10-14T19:12:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f193977b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934151b90 con 0x7f19340b0ba0 2023-10-14T19:12:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f19337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f1934158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f19337fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f1934158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59614/0 (socket says 172.21.15.7:59614) 2023-10-14T19:12:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f19337fe700 1 -- 172.21.15.7:0/2222533646 learned_addr learned my addr 172.21.15.7:0/2222533646 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.087+0000 7f1932ffd700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19340b07d0 0x7f1934154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19327fc700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19340b0ba0 0x7f1934151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19337fe700 1 -- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19340b0ba0 msgr2=0x7f1934151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19337fe700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19340b0ba0 0x7f1934151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19337fe700 1 -- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19340b07d0 msgr2=0x7f1934154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19337fe700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19340b07d0 0x7f1934154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19337fe700 1 -- 172.21.15.7:0/2222533646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c009420 con 0x7f19340cf200 2023-10-14T19:12:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f19337fe700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f1934158050 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f192400cc40 tx=0x7f1924001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400a8b0 con 0x7f19340cf200 2023-10-14T19:12:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400aa10 con 0x7f19340cf200 2023-10-14T19:12:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193409a7e0 con 0x7f19340cf200 2023-10-14T19:12:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400add0 con 0x7f19340cf200 2023-10-14T19:12:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.088+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193409aa80 con 0x7f19340cf200 2023-10-14T19:12:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.089+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934159de0 con 0x7f19340cf200 2023-10-14T19:12:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.090+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1924007300 con 0x7f19340cf200 2023-10-14T19:12:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.090+0000 7f192affd700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1914067320 0x7f19140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.090+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f1924084fc0 con 0x7f19340cf200 2023-10-14T19:12:10.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.090+0000 7f1932ffd700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1914067320 0x7f19140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.091+0000 7f1932ffd700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1914067320 0x7f19140697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f192c006aa0 tx=0x7f192c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.094+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1924051c40 con 0x7f19340cf200 2023-10-14T19:12:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.331+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f193409b240 con 0x7f19340cf200 2023-10-14T19:12:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.332+0000 7f192affd700 1 -- 172.21.15.7:0/2222533646 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f1924055260 con 0x7f19340cf200 2023-10-14T19:12:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:10.334 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":124,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:11:50.936466+0000","modified":"2023-10-14T19:12:02.863533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6836/2050437130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2050437130},{"type":"v1","addr":"172.21.15.148:6836","nonce":2050437130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000047808","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-14T19:12:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1914067320 msgr2=0x7f19140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1914067320 0x7f19140697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f192c006aa0 tx=0x7f192c008040 comp rx=0 tx=0).stop 2023-10-14T19:12:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 msgr2=0x7f1934158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f1934158050 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f192400cc40 tx=0x7f1924001a50 comp rx=0 tx=0).stop 2023-10-14T19:12:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 shutdown_connections 2023-10-14T19:12:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1914067320 0x7f19140697d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19340b07d0 0x7f1934154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19340cf200 0x7f1934158050 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 --2- 172.21.15.7:0/2222533646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19340b0ba0 0x7f1934151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 >> 172.21.15.7:0/2222533646 conn(0x7f193406ce80 msgr2=0x7f19340ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 shutdown_connections 2023-10-14T19:12:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.334+0000 7f193977b700 1 -- 172.21.15.7:0/2222533646 wait complete. 2023-10-14T19:12:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 124 2023-10-14T19:12:10.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:10.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.467+0000 7efd75251700 1 Processor -- start 2023-10-14T19:12:10.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.467+0000 7efd75251700 1 -- start start 2023-10-14T19:12:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd75251700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd70153c30 0x7efd7015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd75251700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd700cf110 0x7efd7015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd75251700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7015afd0 con 0x7efd7015de50 2023-10-14T19:12:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd75251700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7015b2b0 con 0x7efd700cf110 2023-10-14T19:12:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd75251700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7015b590 con 0x7efd70153c30 2023-10-14T19:12:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd700cf110 0x7efd7015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd700cf110 0x7efd7015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59616/0 (socket says 172.21.15.7:59616) 2023-10-14T19:12:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 -- 172.21.15.7:0/157354341 learned_addr learned my addr 172.21.15.7:0/157354341 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd6ffff700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd70153c30 0x7efd7015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 -- 172.21.15.7:0/157354341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd70153c30 msgr2=0x7efd7015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:10.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd70153c30 0x7efd7015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 -- 172.21.15.7:0/157354341 >> v1:172.21.15.148:6789/0 conn(0x7efd7015de50 legacy=0x7efd700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:10.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 -- 172.21.15.7:0/157354341 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7015b870 con 0x7efd700cf110 2023-10-14T19:12:10.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd6ffff700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd70153c30 0x7efd7015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:10.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.468+0000 7efd74a50700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd700cf110 0x7efd7015c070 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7efd68009f20 tx=0x7efd68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa945a6e592c829c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd6effd700 1 -- 172.21.15.7:0/157354341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800e070 con 0x7efd700cf110 2023-10-14T19:12:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd6effd700 1 -- 172.21.15.7:0/157354341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6800ba40 con 0x7efd700cf110 2023-10-14T19:12:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd6effd700 1 -- 172.21.15.7:0/157354341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680092e0 con 0x7efd700cf110 2023-10-14T19:12:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 -- 172.21.15.7:0/157354341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd700cf110 msgr2=0x7efd7015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd700cf110 0x7efd7015c070 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7efd68009f20 tx=0x7efd68009840 comp rx=0 tx=0).stop 2023-10-14T19:12:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 -- 172.21.15.7:0/157354341 shutdown_connections 2023-10-14T19:12:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd700cf110 0x7efd7015c070 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 --2- 172.21.15.7:0/157354341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd70153c30 0x7efd7015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 -- 172.21.15.7:0/157354341 >> 172.21.15.7:0/157354341 conn(0x7efd700703a0 msgr2=0x7efd700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 -- 172.21.15.7:0/157354341 shutdown_connections 2023-10-14T19:12:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.469+0000 7efd75251700 1 -- 172.21.15.7:0/157354341 wait complete. 2023-10-14T19:12:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.470+0000 7efd75251700 1 Processor -- start 2023-10-14T19:12:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.470+0000 7efd75251700 1 -- start start 2023-10-14T19:12:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd75251700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd700cf110 0x7efd70151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd75251700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 0x7efd7015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd75251700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd7015de50 0x7efd7015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd75251700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700cbd80 con 0x7efd70153c30 2023-10-14T19:12:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd75251700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700cb1b0 con 0x7efd7015de50 2023-10-14T19:12:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd75251700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd70152410 con 0x7efd700cf110 2023-10-14T19:12:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd6f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 0x7efd7015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd6f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 0x7efd7015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59628/0 (socket says 172.21.15.7:59628) 2023-10-14T19:12:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd6f7fe700 1 -- 172.21.15.7:0/2488132188 learned_addr learned my addr 172.21.15.7:0/2488132188 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd6ffff700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd700cf110 0x7efd70151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.471+0000 7efd74a50700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd7015de50 0x7efd7015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6f7fe700 1 -- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd700cf110 msgr2=0x7efd70151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6f7fe700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd700cf110 0x7efd70151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6f7fe700 1 -- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd7015de50 msgr2=0x7efd7015fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6f7fe700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd7015de50 0x7efd7015fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6f7fe700 1 -- 172.21.15.7:0/2488132188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009ae0 con 0x7efd70153c30 2023-10-14T19:12:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6ffff700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd700cf110 0x7efd70151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd6f7fe700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 0x7efd7015f650 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7efd5800b5e0 tx=0x7efd58009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800f510 con 0x7efd70153c30 2023-10-14T19:12:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800f670 con 0x7efd70153c30 2023-10-14T19:12:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700cc210 con 0x7efd70153c30 2023-10-14T19:12:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800fa30 con 0x7efd70153c30 2023-10-14T19:12:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.472+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700cb730 con 0x7efd70153c30 2023-10-14T19:12:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.473+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7004c3c0 con 0x7efd70153c30 2023-10-14T19:12:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.473+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efd5801a400 con 0x7efd70153c30 2023-10-14T19:12:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.474+0000 7efd67fff700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd50067320 0x7efd500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.474+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7efd580848c0 con 0x7efd70153c30 2023-10-14T19:12:10.485 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.474+0000 7efd6ffff700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd50067320 0x7efd500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.474+0000 7efd6ffff700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd50067320 0x7efd500697d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efd6000ac10 tx=0x7efd60006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.486 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.478+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd58051540 con 0x7efd70153c30 2023-10-14T19:12:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.671+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd700cbec0 con 0x7efd70153c30 2023-10-14T19:12:10.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.672+0000 7efd67fff700 1 -- 172.21.15.7:0/2488132188 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15491 (secure 0 0 0) 0x7efd58084070 con 0x7efd70153c30 2023-10-14T19:12:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:10.674 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":188,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:04.873183+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000047808.meta","create_time":"2023-10-14T19:11:49.383671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000047808"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000047808.data","create_time":"2023-10-14T19:11:49.937199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000047808"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"32.0","mappings":[{"from":6,"to":5}]},{"pgid":"32.2a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:10.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd50067320 msgr2=0x7efd500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd50067320 0x7efd500697d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efd6000ac10 tx=0x7efd60006f90 comp rx=0 tx=0).stop 2023-10-14T19:12:10.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 msgr2=0x7efd7015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 0x7efd7015f650 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7efd5800b5e0 tx=0x7efd58009120 comp rx=0 tx=0).stop 2023-10-14T19:12:10.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 shutdown_connections 2023-10-14T19:12:10.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd50067320 0x7efd500697d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd7015de50 0x7efd7015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd700cf110 0x7efd70151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 --2- 172.21.15.7:0/2488132188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd70153c30 0x7efd7015f650 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 >> 172.21.15.7:0/2488132188 conn(0x7efd700703a0 msgr2=0x7efd700c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 shutdown_connections 2023-10-14T19:12:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.674+0000 7efd75251700 1 -- 172.21.15.7:0/2488132188 wait complete. 2023-10-14T19:12:10.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000047808 2023-10-14T19:12:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.807+0000 7f3faa6db700 1 Processor -- start 2023-10-14T19:12:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.807+0000 7f3faa6db700 1 -- start start 2023-10-14T19:12:10.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3faa6db700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3fa40cb5a0 0x7f3fa40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3faa6db700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3fa40cd9e0 0x7f3fa4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3faa6db700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa415ae40 con 0x7f3fa415a400 2023-10-14T19:12:10.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3faa6db700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40d13f0 con 0x7f3fa40cb5a0 2023-10-14T19:12:10.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3faa6db700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa415ab60 con 0x7f3fa40cd9e0 2023-10-14T19:12:10.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3fa3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3fa40cb5a0 0x7f3fa40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3fa3fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3fa40cb5a0 0x7f3fa40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59634/0 (socket says 172.21.15.7:59634) 2023-10-14T19:12:10.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3fa3fff700 1 -- 172.21.15.7:0/2260657447 learned_addr learned my addr 172.21.15.7:0/2260657447 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:10.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.808+0000 7f3fa37fe700 1 --2- 172.21.15.7:0/2260657447 >> v2:172.21.15.148:3300/0 conn(0x7f3fa40cd9e0 0x7f3fa4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa3fff700 1 -- 172.21.15.7:0/2260657447 >> v2:172.21.15.148:3300/0 conn(0x7f3fa40cd9e0 msgr2=0x7f3fa4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:10.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa3fff700 1 --2- 172.21.15.7:0/2260657447 >> v2:172.21.15.148:3300/0 conn(0x7f3fa40cd9e0 0x7f3fa4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa3fff700 1 -- 172.21.15.7:0/2260657447 >> v1:172.21.15.148:6789/0 conn(0x7f3fa415a400 legacy=0x7f3fa4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa3fff700 1 -- 172.21.15.7:0/2260657447 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40ccf00 con 0x7f3fa40cb5a0 2023-10-14T19:12:10.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa3fff700 1 --2- 172.21.15.7:0/2260657447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40cb970 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45ef46d1a89244d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa2ffd700 1 -- 172.21.15.7:0/2260657447 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400b820 con 0x7f3fa40cb5a0 2023-10-14T19:12:10.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa2ffd700 1 -- 172.21.15.7:0/2260657447 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400b980 con 0x7f3fa40cb5a0 2023-10-14T19:12:10.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3fa2ffd700 1 -- 172.21.15.7:0/2260657447 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400bd20 con 0x7f3fa40cb5a0 2023-10-14T19:12:10.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3faa6db700 1 -- 172.21.15.7:0/2260657447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa40cb5a0 msgr2=0x7f3fa40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3faa6db700 1 --2- 172.21.15.7:0/2260657447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40cb970 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94009250 comp rx=0 tx=0).stop 2023-10-14T19:12:10.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3faa6db700 1 -- 172.21.15.7:0/2260657447 shutdown_connections 2023-10-14T19:12:10.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3faa6db700 1 --2- 172.21.15.7:0/2260657447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40cb970 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3faa6db700 1 --2- 172.21.15.7:0/2260657447 >> v2:172.21.15.148:3300/0 conn(0x7f3fa40cd9e0 0x7f3fa4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.809+0000 7f3faa6db700 1 -- 172.21.15.7:0/2260657447 >> 172.21.15.7:0/2260657447 conn(0x7f3fa4070e30 msgr2=0x7f3fa40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:10.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.810+0000 7f3faa6db700 1 -- 172.21.15.7:0/2260657447 shutdown_connections 2023-10-14T19:12:10.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.810+0000 7f3faa6db700 1 -- 172.21.15.7:0/2260657447 wait complete. 2023-10-14T19:12:10.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.811+0000 7f3faa6db700 1 Processor -- start 2023-10-14T19:12:10.818 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.811+0000 7f3faa6db700 1 -- start start 2023-10-14T19:12:10.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.811+0000 7f3faa6db700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.811+0000 7f3faa6db700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa40cd9e0 0x7f3fa41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.811+0000 7f3faa6db700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 0x7f3fa416a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3faa6db700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c9460 con 0x7f3fa415a400 2023-10-14T19:12:10.819 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3faa6db700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4153830 con 0x7f3fa40cb5a0 2023-10-14T19:12:10.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3faa6db700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa416aec0 con 0x7f3fa40cd9e0 2023-10-14T19:12:10.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 0x7f3fa416a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 0x7f3fa416a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59644/0 (socket says 172.21.15.7:59644) 2023-10-14T19:12:10.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 -- 172.21.15.7:0/170519477 learned_addr learned my addr 172.21.15.7:0/170519477 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:10.820 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa37fe700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa40cd9e0 0x7f3fa41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa3fff700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 -- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa40cd9e0 msgr2=0x7f3fa41532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa40cd9e0 0x7f3fa41532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 -- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa40cb5a0 msgr2=0x7f3fa40c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 -- 172.21.15.7:0/170519477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094f0 con 0x7f3fa415a400 2023-10-14T19:12:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa3fff700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3fa8c78700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 0x7f3fa416a980 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00c870 tx=0x7f3f9c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c012630 con 0x7f3fa415a400 2023-10-14T19:12:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0127b0 con 0x7f3fa415a400 2023-10-14T19:12:10.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40c7da0 con 0x7f3fa415a400 2023-10-14T19:12:10.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c012b70 con 0x7f3fa415a400 2023-10-14T19:12:10.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.812+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa40c8360 con 0x7f3fa415a400 2023-10-14T19:12:10.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.813+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa404c3c0 con 0x7f3fa415a400 2023-10-14T19:12:10.823 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.814+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3f9c003030 con 0x7f3fa415a400 2023-10-14T19:12:10.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.814+0000 7f3f8bfff700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f90067320 0x7f3f900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:10.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.814+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f3f9c084c70 con 0x7f3fa415a400 2023-10-14T19:12:10.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.814+0000 7f3fa3fff700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f90067320 0x7f3f900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:10.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.815+0000 7f3fa3fff700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f90067320 0x7f3f900697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:10.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:10.818+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f9c051870 con 0x7f3fa415a400 2023-10-14T19:12:11.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.057+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000047808"} v 0) v1 -- 0x7f3fa40cd1e0 con 0x7f3fa415a400 2023-10-14T19:12:11.058 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:12:11.057+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:12:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.060+0000 7f3f8bfff700 1 -- 172.21.15.7:0/170519477 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000047808"}]=0 volume_0000000000047808 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v125) v1 ==== 195+0+0 (secure 0 0 0) 0x7f3f9c054e90 con 0x7f3fa415a400 2023-10-14T19:12:11.063 INFO:tasks.ceph.mds.b.smithi148.stderr: -777> 2023-10-14T19:11:56.854+0000 7f6977fcb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:12:11.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f90067320 msgr2=0x7f3f900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:11.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f90067320 0x7f3f900697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94017000 comp rx=0 tx=0).stop 2023-10-14T19:12:11.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 msgr2=0x7f3fa416a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:11.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 0x7f3fa416a980 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00c870 tx=0x7f3f9c001670 comp rx=0 tx=0).stop 2023-10-14T19:12:11.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 shutdown_connections 2023-10-14T19:12:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3f90067320 0x7f3f900697d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa40cb5a0 0x7f3fa40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa415a400 0x7f3fa416a980 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 --2- 172.21.15.7:0/170519477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa40cd9e0 0x7f3fa41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 >> 172.21.15.7:0/170519477 conn(0x7f3fa4070e30 msgr2=0x7f3fa40d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 shutdown_connections 2023-10-14T19:12:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.063+0000 7f3faa6db700 1 -- 172.21.15.7:0/170519477 wait complete. 2023-10-14T19:12:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:volume_0000000000047808 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:12:11.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000047808 --yes-i-really-mean-it 2023-10-14T19:12:11.085 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:12:11.197 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.197+0000 7f6f8aaf6700 1 Processor -- start 2023-10-14T19:12:11.198 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.197+0000 7f6f8aaf6700 1 -- start start 2023-10-14T19:12:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f8aaf6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 0x7f6f840cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f8aaf6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f840ccfa0 0x7f6f840cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f8aaf6700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f840cf510 con 0x7f6f84159860 2023-10-14T19:12:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f8aaf6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f840d00b0 con 0x7f6f840ccfa0 2023-10-14T19:12:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f8aaf6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840ce670 con 0x7f6f840ce220 2023-10-14T19:12:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f88892700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6f84159860 0x7f6f840cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40704/0 (socket says 172.21.15.7:40704) 2023-10-14T19:12:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f88892700 1 -- 172.21.15.7:0/3454795741 learned_addr learned my addr 172.21.15.7:0/3454795741 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058239224 0 0) 0x7f6f840cf510 con 0x7f6f84159860 2023-10-14T19:12:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f70003570 con 0x7f6f84159860 2023-10-14T19:12:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f83fff700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 0x7f6f840cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f89093700 1 --2- 172.21.15.7:0/3454795741 >> v2:172.21.15.148:3300/0 conn(0x7f6f840ccfa0 0x7f6f840cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1210709411 0 0) 0x7f6f70003570 con 0x7f6f84159860 2023-10-14T19:12:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 msgr2=0x7f6f840cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 0x7f6f840cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 >> v2:172.21.15.148:3300/0 conn(0x7f6f840ccfa0 msgr2=0x7f6f840cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:11.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 --2- 172.21.15.7:0/3454795741 >> v2:172.21.15.148:3300/0 conn(0x7f6f840ccfa0 0x7f6f840cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840cd960 con 0x7f6f84159860 2023-10-14T19:12:11.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f6f7c001970 con 0x7f6f84159860 2023-10-14T19:12:11.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 >> v1:172.21.15.7:6789/0 conn(0x7f6f84159860 legacy=0x7f6f840cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:11.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f70003a60 0x7f6f70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 0x7f6f70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f70004d50 0x7f6f700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840d00b0 con 0x7f6f70004d50 2023-10-14T19:12:11.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840ce670 con 0x7f6f70003a60 2023-10-14T19:12:11.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7000bae0 con 0x7f6f840ce220 2023-10-14T19:12:11.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.198+0000 7f6f89093700 1 --2- 172.21.15.7:0/3454795741 >> v2:172.21.15.148:3300/0 conn(0x7f6f840ccfa0 0x7f6f840cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:11.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f70004d50 0x7f6f700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f83fff700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 0x7f6f70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f88892700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f70003a60 0x7f6f70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 -- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 msgr2=0x7f6f70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f840ce220 0x7f6f70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 -- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f70003a60 msgr2=0x7f6f70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f70003a60 0x7f6f70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 -- 172.21.15.7:0/3454795741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70003570 con 0x7f6f70004d50 2023-10-14T19:12:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f89093700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f70004d50 0x7f6f700051c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009ba0 tx=0x7f6f6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cc7f45663fb16e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00c070 con 0x7f6f70004d50 2023-10-14T19:12:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00e5e0 con 0x7f6f70004d50 2023-10-14T19:12:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.199+0000 7f6f837fe700 1 -- 172.21.15.7:0/3454795741 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00e790 con 0x7f6f70004d50 2023-10-14T19:12:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/3454795741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f70004d50 msgr2=0x7f6f700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/3454795741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f70004d50 0x7f6f700051c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009ba0 tx=0x7f6f6c008040 comp rx=0 tx=0).stop 2023-10-14T19:12:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f89093700 1 -- 172.21.15.7:0/3454795741 reap_dead start 2023-10-14T19:12:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/3454795741 shutdown_connections 2023-10-14T19:12:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/3454795741 >> 172.21.15.7:0/3454795741 conn(0x7f6f840999b0 msgr2=0x7f6f84070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/3454795741 shutdown_connections 2023-10-14T19:12:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.200+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/3454795741 wait complete. 2023-10-14T19:12:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.201+0000 7f6f8aaf6700 1 Processor -- start 2023-10-14T19:12:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.201+0000 7f6f8aaf6700 1 -- start start 2023-10-14T19:12:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f70004d50 0x7f6f840c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f84158560 0x7f6f840c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 0x7f6f840c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8415f6c0 con 0x7f6f84157ce0 2023-10-14T19:12:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8415edd0 con 0x7f6f84158560 2023-10-14T19:12:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840c88c0 con 0x7f6f70004d50 2023-10-14T19:12:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 0x7f6f840c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 0x7f6f840c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59664/0 (socket says 172.21.15.7:59664) 2023-10-14T19:12:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 -- 172.21.15.7:0/1947012643 learned_addr learned my addr 172.21.15.7:0/1947012643 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f83fff700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f84158560 0x7f6f840c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f88892700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f70004d50 0x7f6f840c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 -- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f70004d50 msgr2=0x7f6f840c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f70004d50 0x7f6f840c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 -- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f84158560 msgr2=0x7f6f840c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f84158560 0x7f6f840c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 -- 172.21.15.7:0/1947012643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8415f070 con 0x7f6f84157ce0 2023-10-14T19:12:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f89093700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 0x7f6f840c9d60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c006fd0 tx=0x7f6f6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00e750 con 0x7f6f84157ce0 2023-10-14T19:12:11.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c013c30 con 0x7f6f84157ce0 2023-10-14T19:12:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8415f350 con 0x7f6f84157ce0 2023-10-14T19:12:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c01d440 con 0x7f6f84157ce0 2023-10-14T19:12:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.202+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840c5890 con 0x7f6f84157ce0 2023-10-14T19:12:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.204+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8415f870 con 0x7f6f84157ce0 2023-10-14T19:12:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.204+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6f6c01d7d0 con 0x7f6f84157ce0 2023-10-14T19:12:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.204+0000 7f6f80ff9700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6f64067320 0x7f6f640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.204+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f6f6c086120 con 0x7f6f84157ce0 2023-10-14T19:12:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.205+0000 7f6f88892700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6f64067320 0x7f6f640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.205+0000 7f6f88892700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6f64067320 0x7f6f640697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c001270 tx=0x7f6f7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.209+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f8415f870 con 0x7f6f84157ce0 2023-10-14T19:12:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:11.448+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000047808", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6f8404c3c0 con 0x7f6f84157ce0 2023-10-14T19:12:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.064+0000 7f6f80ff9700 1 -- 172.21.15.7:0/1947012643 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000047808", "yes_i_really_mean_it": true}]=0 v126) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6f6c052cd0 con 0x7f6f84157ce0 2023-10-14T19:12:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6f64067320 msgr2=0x7f6f640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6f64067320 0x7f6f640697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c001270 tx=0x7f6f7c009040 comp rx=0 tx=0).stop 2023-10-14T19:12:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 msgr2=0x7f6f840c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 0x7f6f840c9d60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c006fd0 tx=0x7f6f6c01a000 comp rx=0 tx=0).stop 2023-10-14T19:12:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 shutdown_connections 2023-10-14T19:12:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6f64067320 0x7f6f640697d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84157ce0 0x7f6f840c9d60 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.066+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f70004d50 0x7f6f840c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.067+0000 7f6f8aaf6700 1 --2- 172.21.15.7:0/1947012643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f84158560 0x7f6f840c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.067+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 >> 172.21.15.7:0/1947012643 conn(0x7f6f840999b0 msgr2=0x7f6f840b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.067+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 shutdown_connections 2023-10-14T19:12:12.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.067+0000 7f6f8aaf6700 1 -- 172.21.15.7:0/1947012643 wait complete. 2023-10-14T19:12:12.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000047808.meta cephfs.volume_0000000000047808.meta --yes-i-really-really-mean-it 2023-10-14T19:12:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.213+0000 7f14201f8700 1 Processor -- start 2023-10-14T19:12:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.213+0000 7f14201f8700 1 -- start start 2023-10-14T19:12:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f14201f8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14180cb6f0 0x7f14180cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f14201f8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180ccfd0 con 0x7f141806dcf0 2023-10-14T19:12:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f14201f8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180cc040 con 0x7f1418159530 2023-10-14T19:12:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f14201f8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141815a410 con 0x7f14180cb6f0 2023-10-14T19:12:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f141e795700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14180cb6f0 0x7f14180cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f141d793700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f141806dcf0 0x7f1418159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40716/0 (socket says 172.21.15.7:40716) 2023-10-14T19:12:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f141d793700 1 -- 172.21.15.7:0/3974807203 learned_addr learned my addr 172.21.15.7:0/3974807203 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f141e795700 1 -- 172.21.15.7:0/3974807203 >> v1:172.21.15.148:6789/0 conn(0x7f1418159530 legacy=0x7f14180ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f141e795700 1 -- 172.21.15.7:0/3974807203 >> v1:172.21.15.7:6789/0 conn(0x7f141806dcf0 legacy=0x7f1418159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.214+0000 7f141e795700 1 -- 172.21.15.7:0/3974807203 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141815a6f0 con 0x7f14180cb6f0 2023-10-14T19:12:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f141e795700 1 --2- 172.21.15.7:0/3974807203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14180cb6f0 0x7f14180cbb00 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f1408009e60 tx=0x7f1408009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5fb8ed4d4fcea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f141cf92700 1 -- 172.21.15.7:0/3974807203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140800e070 con 0x7f14180cb6f0 2023-10-14T19:12:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f141cf92700 1 -- 172.21.15.7:0/3974807203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140800bb30 con 0x7f14180cb6f0 2023-10-14T19:12:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f141cf92700 1 -- 172.21.15.7:0/3974807203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408012450 con 0x7f14180cb6f0 2023-10-14T19:12:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 -- 172.21.15.7:0/3974807203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14180cb6f0 msgr2=0x7f14180cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 --2- 172.21.15.7:0/3974807203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14180cb6f0 0x7f14180cbb00 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f1408009e60 tx=0x7f1408009780 comp rx=0 tx=0).stop 2023-10-14T19:12:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 -- 172.21.15.7:0/3974807203 shutdown_connections 2023-10-14T19:12:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 --2- 172.21.15.7:0/3974807203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14180cb6f0 0x7f14180cbb00 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 -- 172.21.15.7:0/3974807203 >> 172.21.15.7:0/3974807203 conn(0x7f14180703a0 msgr2=0x7f14180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 -- 172.21.15.7:0/3974807203 shutdown_connections 2023-10-14T19:12:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.215+0000 7f14201f8700 1 -- 172.21.15.7:0/3974807203 wait complete. 2023-10-14T19:12:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.216+0000 7f14201f8700 1 Processor -- start 2023-10-14T19:12:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 -- start start 2023-10-14T19:12:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f141806dcf0 0x7f1418157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14180cb6f0 0x7f14180c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 0x7f14180cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180b4180 con 0x7f1418159530 2023-10-14T19:12:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418158140 con 0x7f14180cb6f0 2023-10-14T19:12:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f14201f8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14180b35b0 con 0x7f141806dcf0 2023-10-14T19:12:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f141e795700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 0x7f14180cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f141e795700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 0x7f14180cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59676/0 (socket says 172.21.15.7:59676) 2023-10-14T19:12:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f141e795700 1 -- 172.21.15.7:0/2140432585 learned_addr learned my addr 172.21.15.7:0/2140432585 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f141d793700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14180cb6f0 0x7f14180c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.217+0000 7f141df94700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f141806dcf0 0x7f1418157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:12.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f141e795700 1 -- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f141806dcf0 msgr2=0x7f1418157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:12.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f141e795700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f141806dcf0 0x7f1418157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f141e795700 1 -- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14180cb6f0 msgr2=0x7f14180c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:12.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f141e795700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14180cb6f0 0x7f14180c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:12.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f141e795700 1 -- 172.21.15.7:0/2140432585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408009a20 con 0x7f1418159530 2023-10-14T19:12:12.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f141e795700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 0x7f14180cd460 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f140800bfd0 tx=0x7f1408017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140801e610 con 0x7f1418159530 2023-10-14T19:12:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140801e790 con 0x7f1418159530 2023-10-14T19:12:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14180b3850 con 0x7f1418159530 2023-10-14T19:12:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140801eb50 con 0x7f1418159530 2023-10-14T19:12:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.218+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14180b3e10 con 0x7f1418159530 2023-10-14T19:12:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.219+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14180c8950 con 0x7f1418159530 2023-10-14T19:12:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.219+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1408019030 con 0x7f1418159530 2023-10-14T19:12:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.220+0000 7f1415ffb700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.220+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f1408086b60 con 0x7f1418159530 2023-10-14T19:12:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.220+0000 7f141df94700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.221+0000 7f141df94700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.225+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14180c8950 con 0x7f1418159530 2023-10-14T19:12:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:12.418+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000047808.meta", "pool2": "cephfs.volume_0000000000047808.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14180c8950 con 0x7f1418159530 2023-10-14T19:12:13.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.066+0000 7f1415ffb700 1 -- 172.21.15.7:0/2140432585 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000047808.meta", "pool2": "cephfs.volume_0000000000047808.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000047808.meta' removed v190) v1 ==== 241+0+0 (secure 0 0 0) 0x7f14180c8950 con 0x7f1418159530 2023-10-14T19:12:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 msgr2=0x7f14040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410008040 comp rx=0 tx=0).stop 2023-10-14T19:12:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 msgr2=0x7f14180cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 0x7f14180cd460 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f140800bfd0 tx=0x7f1408017000 comp rx=0 tx=0).stop 2023-10-14T19:12:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 shutdown_connections 2023-10-14T19:12:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1418159530 0x7f14180cd460 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f141806dcf0 0x7f1418157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 --2- 172.21.15.7:0/2140432585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14180cb6f0 0x7f14180c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 >> 172.21.15.7:0/2140432585 conn(0x7f14180703a0 msgr2=0x7f14180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 shutdown_connections 2023-10-14T19:12:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.069+0000 7f14201f8700 1 -- 172.21.15.7:0/2140432585 wait complete. 2023-10-14T19:12:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs.volume_0000000000047808.meta' removed 2023-10-14T19:12:13.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000047808.data cephfs.volume_0000000000047808.data --yes-i-really-really-mean-it 2023-10-14T19:12:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 Processor -- start 2023-10-14T19:12:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 -- start start 2023-10-14T19:12:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1fb8153da0 0x7f1fb80abde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb80c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80706a0 con 0x7f1fb8154170 2023-10-14T19:12:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb806cdb0 con 0x7f1fb8153da0 2023-10-14T19:12:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.216+0000 7f1fbd150700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb806a560 con 0x7f1fb8159f20 2023-10-14T19:12:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb759e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb80c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb6d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1fb8153da0 0x7f1fb80abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1fb8154170 0x7f1fb806c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:45922/0 (socket says 172.21.15.7:45922) 2023-10-14T19:12:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb659c700 1 -- 172.21.15.7:0/418451416 learned_addr learned my addr 172.21.15.7:0/418451416 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb759e700 1 -- 172.21.15.7:0/418451416 >> v2:172.21.15.148:3300/0 conn(0x7f1fb8153da0 msgr2=0x7f1fb80abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb759e700 1 --2- 172.21.15.7:0/418451416 >> v2:172.21.15.148:3300/0 conn(0x7f1fb8153da0 0x7f1fb80abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb759e700 1 -- 172.21.15.7:0/418451416 >> v1:172.21.15.148:6789/0 conn(0x7f1fb8154170 legacy=0x7f1fb806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb759e700 1 -- 172.21.15.7:0/418451416 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb815a490 con 0x7f1fb8159f20 2023-10-14T19:12:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.217+0000 7f1fb6d9d700 1 --2- 172.21.15.7:0/418451416 >> v2:172.21.15.148:3300/0 conn(0x7f1fb8153da0 0x7f1fb80abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fb759e700 1 --2- 172.21.15.7:0/418451416 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb80c92b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009e60 tx=0x7f1fb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94690a4fa6a60d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fb5d9b700 1 -- 172.21.15.7:0/418451416 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000e070 con 0x7f1fb8159f20 2023-10-14T19:12:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fb5d9b700 1 -- 172.21.15.7:0/418451416 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb000bb60 con 0x7f1fb8159f20 2023-10-14T19:12:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fb5d9b700 1 -- 172.21.15.7:0/418451416 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0012430 con 0x7f1fb8159f20 2023-10-14T19:12:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 -- 172.21.15.7:0/418451416 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 msgr2=0x7f1fb80c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 --2- 172.21.15.7:0/418451416 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb80c92b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009e60 tx=0x7f1fb0009780 comp rx=0 tx=0).stop 2023-10-14T19:12:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 -- 172.21.15.7:0/418451416 shutdown_connections 2023-10-14T19:12:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 --2- 172.21.15.7:0/418451416 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb80c92b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 --2- 172.21.15.7:0/418451416 >> v2:172.21.15.148:3300/0 conn(0x7f1fb8153da0 0x7f1fb80abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 -- 172.21.15.7:0/418451416 >> 172.21.15.7:0/418451416 conn(0x7f1fb80675a0 msgr2=0x7f1fb80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 -- 172.21.15.7:0/418451416 shutdown_connections 2023-10-14T19:12:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.218+0000 7f1fbd150700 1 -- 172.21.15.7:0/418451416 wait complete. 2023-10-14T19:12:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 Processor -- start 2023-10-14T19:12:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 -- start start 2023-10-14T19:12:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 0x7f1fb814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb8154170 0x7f1fb814c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb814d8a0 con 0x7f1fb8153da0 2023-10-14T19:12:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb814bd80 con 0x7f1fb8154170 2023-10-14T19:12:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fbd150700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb814d2e0 con 0x7f1fb8159f20 2023-10-14T19:12:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.220+0000 7f1fb6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 0x7f1fb814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 0x7f1fb814b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59682/0 (socket says 172.21.15.7:59682) 2023-10-14T19:12:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 -- 172.21.15.7:0/3217869470 learned_addr learned my addr 172.21.15.7:0/3217869470 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb659c700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb8154170 0x7f1fb814c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb759e700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 -- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 msgr2=0x7f1fb806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 -- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb8154170 msgr2=0x7f1fb814c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb8154170 0x7f1fb814c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 -- 172.21.15.7:0/3217869470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8009420 con 0x7f1fb8153da0 2023-10-14T19:12:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fb6d9d700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 0x7f1fb814b840 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800ec80 tx=0x7f1fa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800c850 con 0x7f1fb8153da0 2023-10-14T19:12:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa800c9b0 con 0x7f1fb8153da0 2023-10-14T19:12:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb0009a20 con 0x7f1fb8153da0 2023-10-14T19:12:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800cd30 con 0x7f1fb8153da0 2023-10-14T19:12:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.221+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb8154700 con 0x7f1fb8153da0 2023-10-14T19:12:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.222+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb804c3c0 con 0x7f1fb8153da0 2023-10-14T19:12:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.223+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1fa8013680 con 0x7f1fb8153da0 2023-10-14T19:12:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.223+0000 7f1f9effd700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fa4067320 0x7f1fa40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.223+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5452+0+0 (secure 0 0 0) 0x7f1fa8084ef0 con 0x7f1fb8153da0 2023-10-14T19:12:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.223+0000 7f1fb659c700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fa4067320 0x7f1fa40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.224+0000 7f1fb659c700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fa4067320 0x7f1fa40697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1fb81574a0 tx=0x7f1fac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.227+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fa8055710 con 0x7f1fb8153da0 2023-10-14T19:12:13.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:13.419+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000047808.data", "pool2": "cephfs.volume_0000000000047808.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1fb80ac210 con 0x7f1fb8153da0 2023-10-14T19:12:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.073+0000 7f1f9effd700 1 -- 172.21.15.7:0/3217869470 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000047808.data", "pool2": "cephfs.volume_0000000000047808.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000047808.data' removed v191) v1 ==== 241+0+0 (secure 0 0 0) 0x7f1fa80552a0 con 0x7f1fb8153da0 2023-10-14T19:12:14.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fa4067320 msgr2=0x7f1fa40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fa4067320 0x7f1fa40697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1fb81574a0 tx=0x7f1fac009040 comp rx=0 tx=0).stop 2023-10-14T19:12:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 msgr2=0x7f1fb814b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 0x7f1fb814b840 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800ec80 tx=0x7f1fa80091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 shutdown_connections 2023-10-14T19:12:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1fa4067320 0x7f1fa40697d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fb8159f20 0x7f1fb806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb8153da0 0x7f1fb814b840 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 --2- 172.21.15.7:0/3217869470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fb8154170 0x7f1fb814c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 >> 172.21.15.7:0/3217869470 conn(0x7f1fb80675a0 msgr2=0x7f1fb80cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.077+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 shutdown_connections 2023-10-14T19:12:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.078+0000 7f1fbd150700 1 -- 172.21.15.7:0/3217869470 wait complete. 2023-10-14T19:12:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs.volume_0000000000047808.data' removed 2023-10-14T19:12:14.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:12:14.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.224+0000 7f76e3a87700 1 Processor -- start 2023-10-14T19:12:14.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 -- start start 2023-10-14T19:12:14.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc157930 0x7f76dc0ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76dc0ca2c0 0x7f76dc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76dc0ccba0 0x7f76dc0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0c9730 con 0x7f76dc0ca2c0 2023-10-14T19:12:14.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0cd560 con 0x7f76dc0ccba0 2023-10-14T19:12:14.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.225+0000 7f76e3a87700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0c32a0 con 0x7f76dc157930 2023-10-14T19:12:14.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76dc0ca2c0 0x7f76dc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76dc0ca2c0 0x7f76dc0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59684/0 (socket says 172.21.15.7:59684) 2023-10-14T19:12:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 -- 172.21.15.7:0/2859320704 learned_addr learned my addr 172.21.15.7:0/2859320704 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e2024700 1 --2- 172.21.15.7:0/2859320704 >> v2:172.21.15.148:3300/0 conn(0x7f76dc0ccba0 0x7f76dc0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1823700 1 --2- 172.21.15.7:0/2859320704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc157930 0x7f76dc0ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 -- 172.21.15.7:0/2859320704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc157930 msgr2=0x7f76dc0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 --2- 172.21.15.7:0/2859320704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc157930 0x7f76dc0ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 -- 172.21.15.7:0/2859320704 >> v2:172.21.15.148:3300/0 conn(0x7f76dc0ccba0 msgr2=0x7f76dc0cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:14.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 --2- 172.21.15.7:0/2859320704 >> v2:172.21.15.148:3300/0 conn(0x7f76dc0ccba0 0x7f76dc0cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 -- 172.21.15.7:0/2859320704 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0c4100 con 0x7f76dc0ca2c0 2023-10-14T19:12:14.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e2024700 1 --2- 172.21.15.7:0/2859320704 >> v2:172.21.15.148:3300/0 conn(0x7f76dc0ccba0 0x7f76dc0cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:14.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e1022700 1 --2- 172.21.15.7:0/2859320704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc0ca2c0 0x7f76dc0ca730 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f76dc06af00 tx=0x7f76d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b239bfc191d43670 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:14.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e0821700 1 -- 172.21.15.7:0/2859320704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d000b820 con 0x7f76dc0ca2c0 2023-10-14T19:12:14.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e0821700 1 -- 172.21.15.7:0/2859320704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d000b980 con 0x7f76dc0ca2c0 2023-10-14T19:12:14.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.226+0000 7f76e0821700 1 -- 172.21.15.7:0/2859320704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d000bd20 con 0x7f76dc0ca2c0 2023-10-14T19:12:14.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 -- 172.21.15.7:0/2859320704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc0ca2c0 msgr2=0x7f76dc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 --2- 172.21.15.7:0/2859320704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc0ca2c0 0x7f76dc0ca730 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f76dc06af00 tx=0x7f76d0009250 comp rx=0 tx=0).stop 2023-10-14T19:12:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 -- 172.21.15.7:0/2859320704 shutdown_connections 2023-10-14T19:12:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 --2- 172.21.15.7:0/2859320704 >> v2:172.21.15.148:3300/0 conn(0x7f76dc0ccba0 0x7f76dc0cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 --2- 172.21.15.7:0/2859320704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc157930 0x7f76dc0ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 --2- 172.21.15.7:0/2859320704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc0ca2c0 0x7f76dc0ca730 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 -- 172.21.15.7:0/2859320704 >> 172.21.15.7:0/2859320704 conn(0x7f76dc088000 msgr2=0x7f76dc0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 -- 172.21.15.7:0/2859320704 shutdown_connections 2023-10-14T19:12:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.227+0000 7f76e3a87700 1 -- 172.21.15.7:0/2859320704 wait complete. 2023-10-14T19:12:14.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.228+0000 7f76e3a87700 1 Processor -- start 2023-10-14T19:12:14.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.228+0000 7f76e3a87700 1 -- start start 2023-10-14T19:12:14.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e3a87700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc0ca2c0 0x7f76dc146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e3a87700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc0ccba0 0x7f76dc0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e3a87700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 0x7f76dc0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e3a87700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc1444c0 con 0x7f76dc157930 2023-10-14T19:12:14.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e3a87700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0b0a80 con 0x7f76dc0ccba0 2023-10-14T19:12:14.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e3a87700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0b0d60 con 0x7f76dc0ca2c0 2023-10-14T19:12:14.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 0x7f76dc0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 0x7f76dc0c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59698/0 (socket says 172.21.15.7:59698) 2023-10-14T19:12:14.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 -- 172.21.15.7:0/1059118940 learned_addr learned my addr 172.21.15.7:0/1059118940 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:14.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e1022700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc0ccba0 0x7f76dc0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e1823700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc0ca2c0 0x7f76dc146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 -- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc0ca2c0 msgr2=0x7f76dc146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc0ca2c0 0x7f76dc146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 -- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc0ccba0 msgr2=0x7f76dc0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc0ccba0 0x7f76dc0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 -- 172.21.15.7:0/1059118940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00094f0 con 0x7f76dc157930 2023-10-14T19:12:14.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e1823700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc0ca2c0 0x7f76dc146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:14.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76e2024700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 0x7f76dc0c7ef0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00d180 tx=0x7f76cc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:14.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.229+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00dd70 con 0x7f76dc157930 2023-10-14T19:12:14.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.230+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00f040 con 0x7f76dc157930 2023-10-14T19:12:14.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.230+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc143e70 con 0x7f76dc157930 2023-10-14T19:12:14.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.230+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc015690 con 0x7f76dc157930 2023-10-14T19:12:14.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.230+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc0b0790 con 0x7f76dc157930 2023-10-14T19:12:14.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.231+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc0c37f0 con 0x7f76dc157930 2023-10-14T19:12:14.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.231+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f76cc01e3b0 con 0x7f76dc157930 2023-10-14T19:12:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.232+0000 7f76d9ffb700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f76c8067320 0x7f76c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.232+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f76cc084fd0 con 0x7f76dc157930 2023-10-14T19:12:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.232+0000 7f76e1823700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f76c8067320 0x7f76c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.232+0000 7f76e1823700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f76c8067320 0x7f76c80697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f76d4006fd0 tx=0x7f76d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.236+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76cc051e50 con 0x7f76dc157930 2023-10-14T19:12:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.432+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f76dc04c3c0 con 0x7f76dc157930 2023-10-14T19:12:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.436+0000 7f76d9ffb700 1 -- 172.21.15.7:0/1059118940 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76cc055470 con 0x7f76dc157930 2023-10-14T19:12:14.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f76c8067320 msgr2=0x7f76c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f76c8067320 0x7f76c80697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f76d4006fd0 tx=0x7f76d4008040 comp rx=0 tx=0).stop 2023-10-14T19:12:14.439 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 msgr2=0x7f76dc0c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 0x7f76dc0c7ef0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00d180 tx=0x7f76cc009a50 comp rx=0 tx=0).stop 2023-10-14T19:12:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 shutdown_connections 2023-10-14T19:12:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f76c8067320 0x7f76c80697d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76dc157930 0x7f76dc0c7ef0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76dc0ca2c0 0x7f76dc146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 --2- 172.21.15.7:0/1059118940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc0ccba0 0x7f76dc0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 >> 172.21.15.7:0/1059118940 conn(0x7f76dc088000 msgr2=0x7f76dc0694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:14.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 shutdown_connections 2023-10-14T19:12:14.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.438+0000 7f76e3a87700 1 -- 172.21.15.7:0/1059118940 wait complete. 2023-10-14T19:12:14.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-14T19:12:14.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.570+0000 7fc6406a7700 1 Processor -- start 2023-10-14T19:12:14.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.570+0000 7fc6406a7700 1 -- start start 2023-10-14T19:12:14.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc6406a7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc63815a5d0 0x7fc638156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc6406a7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63815ae40 con 0x7fc6380cb970 2023-10-14T19:12:14.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc6406a7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63815ab60 con 0x7fc6380cb5a0 2023-10-14T19:12:14.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc6406a7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380ce0f0 con 0x7fc63815a5d0 2023-10-14T19:12:14.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63dc42700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc6380cb970 0x7fc638159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40720/0 (socket says 172.21.15.7:40720) 2023-10-14T19:12:14.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63dc42700 1 -- 172.21.15.7:0/1559886505 learned_addr learned my addr 172.21.15.7:0/1559886505 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:14.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63ec44700 1 --2- 172.21.15.7:0/1559886505 >> v2:172.21.15.7:3300/0 conn(0x7fc63815a5d0 0x7fc638156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63ec44700 1 -- 172.21.15.7:0/1559886505 >> v1:172.21.15.148:6789/0 conn(0x7fc6380cb5a0 legacy=0x7fc6380cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63ec44700 1 -- 172.21.15.7:0/1559886505 >> v1:172.21.15.7:6789/0 conn(0x7fc6380cb970 legacy=0x7fc638159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63ec44700 1 -- 172.21.15.7:0/1559886505 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380ccf00 con 0x7fc63815a5d0 2023-10-14T19:12:14.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.571+0000 7fc63ec44700 1 --2- 172.21.15.7:0/1559886505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63815a5d0 0x7fc638156e90 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc6280098e0 tx=0x7fc6280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f17ea5b9a1159f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:14.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc63d441700 1 -- 172.21.15.7:0/1559886505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628009e80 con 0x7fc63815a5d0 2023-10-14T19:12:14.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc63d441700 1 -- 172.21.15.7:0/1559886505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800b760 con 0x7fc63815a5d0 2023-10-14T19:12:14.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc63d441700 1 -- 172.21.15.7:0/1559886505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800bae0 con 0x7fc63815a5d0 2023-10-14T19:12:14.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 -- 172.21.15.7:0/1559886505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63815a5d0 msgr2=0x7fc638156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:14.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 --2- 172.21.15.7:0/1559886505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63815a5d0 0x7fc638156e90 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc6280098e0 tx=0x7fc6280091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 -- 172.21.15.7:0/1559886505 shutdown_connections 2023-10-14T19:12:14.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 --2- 172.21.15.7:0/1559886505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63815a5d0 0x7fc638156e90 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 -- 172.21.15.7:0/1559886505 >> 172.21.15.7:0/1559886505 conn(0x7fc638070e30 msgr2=0x7fc6380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:14.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 -- 172.21.15.7:0/1559886505 shutdown_connections 2023-10-14T19:12:14.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.572+0000 7fc6406a7700 1 -- 172.21.15.7:0/1559886505 wait complete. 2023-10-14T19:12:14.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.573+0000 7fc6406a7700 1 Processor -- start 2023-10-14T19:12:14.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.573+0000 7fc6406a7700 1 -- start start 2023-10-14T19:12:14.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc6406a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 0x7fc638153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc6406a7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6380cb970 0x7fc63815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc6406a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63815a5d0 0x7fc63815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc6406a7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815c8d0 con 0x7fc6380cb5a0 2023-10-14T19:12:14.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc6406a7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815e330 con 0x7fc6380cb970 2023-10-14T19:12:14.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc6406a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815bc50 con 0x7fc63815a5d0 2023-10-14T19:12:14.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc63e443700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 0x7fc638153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc63e443700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 0x7fc638153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59716/0 (socket says 172.21.15.7:59716) 2023-10-14T19:12:14.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc63e443700 1 -- 172.21.15.7:0/3574652701 learned_addr learned my addr 172.21.15.7:0/3574652701 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:14.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc63e443700 1 -- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63815a5d0 msgr2=0x7fc63815b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:12:14.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc63e443700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63815a5d0 0x7fc63815b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.574+0000 7fc63e443700 1 -- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6380cb970 msgr2=0x7fc63815b070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T19:12:14.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc63e443700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6380cb970 0x7fc63815b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:14.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc63e443700 1 -- 172.21.15.7:0/3574652701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009420 con 0x7fc6380cb5a0 2023-10-14T19:12:14.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc63e443700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 0x7fc638153630 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fc63000cb10 tx=0x7fc6300017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:14.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000a760 con 0x7fc6380cb5a0 2023-10-14T19:12:14.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000a8e0 con 0x7fc6380cb5a0 2023-10-14T19:12:14.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63815bf30 con 0x7fc6380cb5a0 2023-10-14T19:12:14.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000aca0 con 0x7fc6380cb5a0 2023-10-14T19:12:14.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.575+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63815c4f0 con 0x7fc6380cb5a0 2023-10-14T19:12:14.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.576+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63804c3c0 con 0x7fc6380cb5a0 2023-10-14T19:12:14.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.576+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc630003030 con 0x7fc6380cb5a0 2023-10-14T19:12:14.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.577+0000 7fc6367fc700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc624067320 0x7fc6240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:14.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.577+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc630084a70 con 0x7fc6380cb5a0 2023-10-14T19:12:14.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.577+0000 7fc63dc42700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc624067320 0x7fc6240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:14.586 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.577+0000 7fc63dc42700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc624067320 0x7fc6240697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0058d0 tx=0x7fc62c007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.581+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc630051a00 con 0x7fc6380cb5a0 2023-10-14T19:12:14.858 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:14.858+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7fc6380ced50 con 0x7fc6380cb5a0 2023-10-14T19:12:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.074+0000 7fc6367fc700 1 -- 172.21.15.7:0/3574652701 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v465) v1 ==== 147+0+0 (secure 0 0 0) 0x7fc630055020 con 0x7fc6380cb5a0 2023-10-14T19:12:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc624067320 msgr2=0x7fc6240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc624067320 0x7fc6240697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0058d0 tx=0x7fc62c007a80 comp rx=0 tx=0).stop 2023-10-14T19:12:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 msgr2=0x7fc638153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 0x7fc638153630 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fc63000cb10 tx=0x7fc6300017b0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 shutdown_connections 2023-10-14T19:12:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc624067320 0x7fc6240697d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63815a5d0 0x7fc63815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6380cb5a0 0x7fc638153630 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 --2- 172.21.15.7:0/3574652701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6380cb970 0x7fc63815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 >> 172.21.15.7:0/3574652701 conn(0x7fc638070e30 msgr2=0x7fc6380ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 shutdown_connections 2023-10-14T19:12:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.076+0000 7fc6406a7700 1 -- 172.21.15.7:0/3574652701 wait complete. 2023-10-14T19:12:15.089 INFO:tasks.cephfs_test_runner:That volume rename is idempotent. ... ok 2023-10-14T19:12:15.090 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-14T19:12:15.090 INFO:tasks.cephfs_test_runner:test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:12:15.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-14T19:12:15.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.210+0000 7f2b8f2e1700 1 Processor -- start 2023-10-14T19:12:15.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.210+0000 7f2b8f2e1700 1 -- start start 2023-10-14T19:12:15.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.211+0000 7f2b8f2e1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b880cf110 0x7f2b88164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.211+0000 7f2b8f2e1700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815afd0 con 0x7f2b88153c30 2023-10-14T19:12:15.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.211+0000 7f2b8f2e1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815b2b0 con 0x7f2b8815de50 2023-10-14T19:12:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.211+0000 7f2b8f2e1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8815b590 con 0x7f2b880cf110 2023-10-14T19:12:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.211+0000 7f2b8e2df700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b88153c30 0x7f2b8815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40728/0 (socket says 172.21.15.7:40728) 2023-10-14T19:12:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.211+0000 7f2b8e2df700 1 -- 172.21.15.7:0/3389577588 learned_addr learned my addr 172.21.15.7:0/3389577588 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8eae0700 1 --2- 172.21.15.7:0/3389577588 >> v2:172.21.15.148:3300/0 conn(0x7f2b880cf110 0x7f2b88164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333896551 0 0) 0x7f2b8815afd0 con 0x7f2b88153c30 2023-10-14T19:12:15.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b70003570 con 0x7f2b88153c30 2023-10-14T19:12:15.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588517596 0 0) 0x7f2b70003570 con 0x7f2b88153c30 2023-10-14T19:12:15.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 >> v2:172.21.15.148:3300/0 conn(0x7f2b880cf110 msgr2=0x7f2b88164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:15.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 --2- 172.21.15.7:0/3389577588 >> v2:172.21.15.148:3300/0 conn(0x7f2b880cf110 0x7f2b88164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 >> v1:172.21.15.148:6789/0 conn(0x7f2b8815de50 legacy=0x7f2b880cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8815b870 con 0x7f2b88153c30 2023-10-14T19:12:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f2b80001470 con 0x7f2b88153c30 2023-10-14T19:12:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 >> v1:172.21.15.7:6789/0 conn(0x7f2b88153c30 legacy=0x7f2b8815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b70003a60 0x7f2b70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70004810 0x7f2b70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b700051c0 0x7f2b7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815b590 con 0x7f2b70003a60 2023-10-14T19:12:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7000c0d0 con 0x7f2b70004810 2023-10-14T19:12:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7000c290 con 0x7f2b700051c0 2023-10-14T19:12:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b70003a60 0x7f2b70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8dade700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70004810 0x7f2b70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8eae0700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b700051c0 0x7f2b7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8e2df700 1 -- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b700051c0 msgr2=0x7f2b7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:15.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b700051c0 0x7f2b7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8e2df700 1 -- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70004810 msgr2=0x7f2b70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70004810 0x7f2b70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8e2df700 1 -- 172.21.15.7:0/3389577588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70003570 con 0x7f2b70003a60 2023-10-14T19:12:15.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.212+0000 7f2b8eae0700 1 -- 172.21.15.7:0/3389577588 reap_dead start 2023-10-14T19:12:15.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b70003a60 0x7f2b70003e70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000c390 tx=0x7f2b8815e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a835ea3c36752313 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000cc60 con 0x7f2b70003a60 2023-10-14T19:12:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8000cdc0 con 0x7f2b70003a60 2023-10-14T19:12:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8d2dd700 1 -- 172.21.15.7:0/3389577588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80005b70 con 0x7f2b70003a60 2023-10-14T19:12:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/3389577588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b70003a60 msgr2=0x7f2b70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b70003a60 0x7f2b70003e70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000c390 tx=0x7f2b8815e2d0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/3389577588 shutdown_connections 2023-10-14T19:12:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/3389577588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b70003a60 0x7f2b70003e70 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/3389577588 >> 172.21.15.7:0/3389577588 conn(0x7f2b880703a0 msgr2=0x7f2b880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/3389577588 shutdown_connections 2023-10-14T19:12:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.213+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/3389577588 wait complete. 2023-10-14T19:12:15.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.214+0000 7f2b8f2e1700 1 Processor -- start 2023-10-14T19:12:15.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.214+0000 7f2b8f2e1700 1 -- start start 2023-10-14T19:12:15.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8f2e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70003a60 0x7f2b880c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8f2e1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 0x7f2b880c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8f2e1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b8814abf0 0x7f2b8814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8f2e1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815f720 con 0x7f2b8815e3c0 2023-10-14T19:12:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8f2e1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8814b560 con 0x7f2b70003a60 2023-10-14T19:12:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8f2e1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815eb10 con 0x7f2b8814abf0 2023-10-14T19:12:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8dade700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 0x7f2b880c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8dade700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 0x7f2b880c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59724/0 (socket says 172.21.15.7:59724) 2023-10-14T19:12:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.215+0000 7f2b8dade700 1 -- 172.21.15.7:0/325824304 learned_addr learned my addr 172.21.15.7:0/325824304 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70003a60 0x7f2b880c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8eae0700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b8814abf0 0x7f2b8814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8dade700 1 -- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b8814abf0 msgr2=0x7f2b8814b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8dade700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b8814abf0 0x7f2b8814b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8dade700 1 -- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70003a60 msgr2=0x7f2b880c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:15.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8dade700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70003a60 0x7f2b880c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8dade700 1 -- 172.21.15.7:0/325824304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8815edf0 con 0x7f2b8815e3c0 2023-10-14T19:12:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8dade700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 0x7f2b880c8700 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c002980 tx=0x7f2b7c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00f850 con 0x7f2b8815e3c0 2023-10-14T19:12:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c00f9b0 con 0x7f2b8815e3c0 2023-10-14T19:12:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8815f0d0 con 0x7f2b8815e3c0 2023-10-14T19:12:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00fd50 con 0x7f2b8815e3c0 2023-10-14T19:12:15.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.216+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8815e830 con 0x7f2b8815e3c0 2023-10-14T19:12:15.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.217+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8815f890 con 0x7f2b8815e3c0 2023-10-14T19:12:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.217+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2b7c013600 con 0x7f2b8815e3c0 2023-10-14T19:12:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.218+0000 7f2b867fc700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b74067320 0x7f2b740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.218+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2b7c084e30 con 0x7f2b8815e3c0 2023-10-14T19:12:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.218+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b74067320 0x7f2b740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.219+0000 7f2b8e2df700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b74067320 0x7f2b740697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2b80007cd0 tx=0x7f2b80015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.222+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b7c051dc0 con 0x7f2b8815e3c0 2023-10-14T19:12:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:15.493+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f2b8804c3c0 con 0x7f2b8815e3c0 2023-10-14T19:12:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.077+0000 7f2b867fc700 1 -- 172.21.15.7:0/325824304 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v466) v1 ==== 134+0+0 (secure 0 0 0) 0x7f2b7c0553e0 con 0x7f2b8815e3c0 2023-10-14T19:12:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b74067320 msgr2=0x7f2b740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b74067320 0x7f2b740697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2b80007cd0 tx=0x7f2b80015000 comp rx=0 tx=0).stop 2023-10-14T19:12:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 msgr2=0x7f2b880c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 0x7f2b880c8700 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c002980 tx=0x7f2b7c007d30 comp rx=0 tx=0).stop 2023-10-14T19:12:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 shutdown_connections 2023-10-14T19:12:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2b74067320 0x7f2b740697d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b70003a60 0x7f2b880c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b8814abf0 0x7f2b8814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 --2- 172.21.15.7:0/325824304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8815e3c0 0x7f2b880c8700 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 >> 172.21.15.7:0/325824304 conn(0x7f2b880703a0 msgr2=0x7f2b88151700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:16.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 shutdown_connections 2023-10-14T19:12:16.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.080+0000 7f2b8f2e1700 1 -- 172.21.15.7:0/325824304 wait complete. 2023-10-14T19:12:16.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:12:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.219+0000 7face8c72700 1 Processor -- start 2023-10-14T19:12:16.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.219+0000 7face8c72700 1 -- start start 2023-10-14T19:12:16.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face8c72700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7face41576d0 0x7face40ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face8c72700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7face40b1be0 0x7face4161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face8c72700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40cc060 con 0x7face40aead0 2023-10-14T19:12:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face8c72700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40cb450 con 0x7face41576d0 2023-10-14T19:12:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face8c72700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40cb730 con 0x7face40b1be0 2023-10-14T19:12:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7face41576d0 0x7face40ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7face40aead0 0x7face40b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40744/0 (socket says 172.21.15.7:40744) 2023-10-14T19:12:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.220+0000 7face1d9b700 1 -- 172.21.15.7:0/2302583371 learned_addr learned my addr 172.21.15.7:0/2302583371 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face259c700 1 -- 172.21.15.7:0/2302583371 >> v2:172.21.15.148:3300/0 conn(0x7face40b1be0 msgr2=0x7face4161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:16.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face259c700 1 --2- 172.21.15.7:0/2302583371 >> v2:172.21.15.148:3300/0 conn(0x7face40b1be0 0x7face4161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face259c700 1 -- 172.21.15.7:0/2302583371 >> v1:172.21.15.7:6789/0 conn(0x7face40aead0 legacy=0x7face40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face259c700 1 -- 172.21.15.7:0/2302583371 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40cba10 con 0x7face41576d0 2023-10-14T19:12:16.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face159a700 1 -- 172.21.15.7:0/2302583371 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029721236 0 0) 0x7face40cc060 con 0x7face40aead0 2023-10-14T19:12:16.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face259c700 1 --2- 172.21.15.7:0/2302583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face41576d0 0x7face40ae590 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7face406d940 tx=0x7facdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b29e88fec1f9933 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:16.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face159a700 1 -- 172.21.15.7:0/2302583371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc00b6b0 con 0x7face41576d0 2023-10-14T19:12:16.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face159a700 1 -- 172.21.15.7:0/2302583371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc00b830 con 0x7face41576d0 2023-10-14T19:12:16.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face159a700 1 -- 172.21.15.7:0/2302583371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc00bbf0 con 0x7face41576d0 2023-10-14T19:12:16.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face8c72700 1 -- 172.21.15.7:0/2302583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face41576d0 msgr2=0x7face40ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face8c72700 1 --2- 172.21.15.7:0/2302583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face41576d0 0x7face40ae590 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7face406d940 tx=0x7facdc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face8c72700 1 -- 172.21.15.7:0/2302583371 shutdown_connections 2023-10-14T19:12:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face8c72700 1 --2- 172.21.15.7:0/2302583371 >> v2:172.21.15.148:3300/0 conn(0x7face40b1be0 0x7face4161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face8c72700 1 --2- 172.21.15.7:0/2302583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face41576d0 0x7face40ae590 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.221+0000 7face8c72700 1 -- 172.21.15.7:0/2302583371 >> 172.21.15.7:0/2302583371 conn(0x7face406d170 msgr2=0x7face40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:16.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.222+0000 7face8c72700 1 -- 172.21.15.7:0/2302583371 shutdown_connections 2023-10-14T19:12:16.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.222+0000 7face8c72700 1 -- 172.21.15.7:0/2302583371 wait complete. 2023-10-14T19:12:16.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 Processor -- start 2023-10-14T19:12:16.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 -- start start 2023-10-14T19:12:16.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 0x7face4138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7face40b1be0 0x7face4154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7face41576d0 0x7face41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face415b2b0 con 0x7face40aead0 2023-10-14T19:12:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face415b550 con 0x7face41576d0 2023-10-14T19:12:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face8c72700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face415a400 con 0x7face40b1be0 2023-10-14T19:12:16.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 0x7face4138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 0x7face4138440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59742/0 (socket says 172.21.15.7:59742) 2023-10-14T19:12:16.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face259c700 1 -- 172.21.15.7:0/889423483 learned_addr learned my addr 172.21.15.7:0/889423483 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:16.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.223+0000 7face2d9d700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7face41576d0 0x7face41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face1d9b700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7face40b1be0 0x7face4154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face259c700 1 -- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7face40b1be0 msgr2=0x7face4154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face259c700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7face40b1be0 0x7face4154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face259c700 1 -- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7face41576d0 msgr2=0x7face41554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face259c700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7face41576d0 0x7face41554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face259c700 1 -- 172.21.15.7:0/889423483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc009420 con 0x7face40aead0 2023-10-14T19:12:16.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face1d9b700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7face40b1be0 0x7face4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:16.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face259c700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 0x7face4138440 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7face406e1f0 tx=0x7facdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:16.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc01f070 con 0x7face40aead0 2023-10-14T19:12:16.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc000c90 con 0x7face40aead0 2023-10-14T19:12:16.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face415a6e0 con 0x7face40aead0 2023-10-14T19:12:16.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc00bbd0 con 0x7face40aead0 2023-10-14T19:12:16.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.224+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face4138980 con 0x7face40aead0 2023-10-14T19:12:16.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.225+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face404c3c0 con 0x7face40aead0 2023-10-14T19:12:16.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.225+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7facdc023070 con 0x7face40aead0 2023-10-14T19:12:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.226+0000 7facda7fc700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7facc4067320 0x7facc40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.226+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7facdc085dc0 con 0x7face40aead0 2023-10-14T19:12:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.226+0000 7face1d9b700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7facc4067320 0x7facc40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.227+0000 7face1d9b700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7facc4067320 0x7facc40697d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7face406a2a0 tx=0x7faccc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.230+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facdc052d50 con 0x7face40aead0 2023-10-14T19:12:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.421+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7face40cbcf0 con 0x7face40aead0 2023-10-14T19:12:16.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.425+0000 7facda7fc700 1 -- 172.21.15.7:0/889423483 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7facdc02a020 con 0x7face40aead0 2023-10-14T19:12:16.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7facc4067320 msgr2=0x7facc40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7facc4067320 0x7facc40697d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7face406a2a0 tx=0x7faccc009040 comp rx=0 tx=0).stop 2023-10-14T19:12:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 msgr2=0x7face4138440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 0x7face4138440 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7face406e1f0 tx=0x7facdc017000 comp rx=0 tx=0).stop 2023-10-14T19:12:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 shutdown_connections 2023-10-14T19:12:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7facc4067320 0x7facc40697d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7face41576d0 0x7face41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7face40aead0 0x7face4138440 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 --2- 172.21.15.7:0/889423483 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7face40b1be0 0x7face4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 >> 172.21.15.7:0/889423483 conn(0x7face406d170 msgr2=0x7face4152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 shutdown_connections 2023-10-14T19:12:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.427+0000 7face8c72700 1 -- 172.21.15.7:0/889423483 wait complete. 2023-10-14T19:12:16.440 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:12:16.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:12:16.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:12:16.530 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:12:16.531 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T19:12:16.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4662ed7700 1 Processor -- start 2023-10-14T19:12:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4662ed7700 1 -- start start 2023-10-14T19:12:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4662ed7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f465c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4662ed7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c15ae40 con 0x7f465c15a400 2023-10-14T19:12:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4662ed7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c15ab60 con 0x7f465c0cb5a0 2023-10-14T19:12:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4662ed7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ce0f0 con 0x7f465c0cb970 2023-10-14T19:12:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4661474700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f465c15a400 0x7f465c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40648/0 (socket says 172.21.15.7:40648) 2023-10-14T19:12:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.650+0000 7f4661474700 1 -- 172.21.15.7:0/1105969597 learned_addr learned my addr 172.21.15.7:0/1105969597 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465bfff700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f465c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.659 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016677426 0 0) 0x7f465c15ae40 con 0x7f465c15a400 2023-10-14T19:12:16.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4648003570 con 0x7f465c15a400 2023-10-14T19:12:16.660 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026777077 0 0) 0x7f465c15ab60 con 0x7f465c0cb5a0 2023-10-14T19:12:16.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f465c15ae40 con 0x7f465c0cb5a0 2023-10-14T19:12:16.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1291919139 0 0) 0x7f4648003570 con 0x7f465c15a400 2023-10-14T19:12:16.661 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 msgr2=0x7f465c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:16.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f465c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.662 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 >> v1:172.21.15.148:6789/0 conn(0x7f465c0cb5a0 legacy=0x7f465c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0ccf00 con 0x7f465c15a400 2023-10-14T19:12:16.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f4644001470 con 0x7f465c15a400 2023-10-14T19:12:16.663 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 >> v1:172.21.15.7:6789/0 conn(0x7f465c15a400 legacy=0x7f465c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f4648004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f4648004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.664 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4648004d50 0x7f46480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ce0f0 con 0x7f4648003c20 2023-10-14T19:12:16.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464800bb70 con 0x7f4648004d50 2023-10-14T19:12:16.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464800bd30 con 0x7f465c0cb970 2023-10-14T19:12:16.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f4660c73700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f4648004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.666 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f4661474700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4648004d50 0x7f46480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f465bfff700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f4648004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f4660c73700 1 -- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 msgr2=0x7f4648004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.651+0000 7f4660c73700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f4648004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4660c73700 1 -- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4648004d50 msgr2=0x7f46480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:16.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4660c73700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4648004d50 0x7f46480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4660c73700 1 -- 172.21.15.7:0/1105969597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648003570 con 0x7f4648003c20 2023-10-14T19:12:16.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f465bfff700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c0cb970 0x7f4648004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:16.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4660c73700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f4648004010 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f4654001a10 tx=0x7f4654007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5676a379b6c52a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:16.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400c5d0 con 0x7f4648003c20 2023-10-14T19:12:16.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400c730 con 0x7f4648003c20 2023-10-14T19:12:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f465b7fe700 1 -- 172.21.15.7:0/1105969597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400cad0 con 0x7f4648003c20 2023-10-14T19:12:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4662ed7700 1 -- 172.21.15.7:0/1105969597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 msgr2=0x7f4648004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4662ed7700 1 --2- 172.21.15.7:0/1105969597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f4648004010 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f4654001a10 tx=0x7f4654007d30 comp rx=0 tx=0).stop 2023-10-14T19:12:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4661474700 1 -- 172.21.15.7:0/1105969597 reap_dead start 2023-10-14T19:12:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4662ed7700 1 -- 172.21.15.7:0/1105969597 shutdown_connections 2023-10-14T19:12:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4662ed7700 1 -- 172.21.15.7:0/1105969597 >> 172.21.15.7:0/1105969597 conn(0x7f465c070e30 msgr2=0x7f465c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4662ed7700 1 -- 172.21.15.7:0/1105969597 shutdown_connections 2023-10-14T19:12:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.652+0000 7f4662ed7700 1 -- 172.21.15.7:0/1105969597 wait complete. 2023-10-14T19:12:16.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.653+0000 7f4662ed7700 1 Processor -- start 2023-10-14T19:12:16.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 -- start start 2023-10-14T19:12:16.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f465c153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.672 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c16a520 0x7f465c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f465c1526e0 0x7f465c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0cbde0 con 0x7f4648003c20 2023-10-14T19:12:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c154210 con 0x7f465c1526e0 2023-10-14T19:12:16.673 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4662ed7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c153070 con 0x7f465c16a520 2023-10-14T19:12:16.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.654+0000 7f4660c73700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f465c153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f465c153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38662/0 (socket says 172.21.15.7:38662) 2023-10-14T19:12:16.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 -- 172.21.15.7:0/4094054265 learned_addr learned my addr 172.21.15.7:0/4094054265 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:16.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4661474700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f465c1526e0 0x7f465c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f465bfff700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c16a520 0x7f465c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 -- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c16a520 msgr2=0x7f465c159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c16a520 0x7f465c159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 -- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f465c1526e0 msgr2=0x7f465c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f465c1526e0 0x7f465c152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 -- 172.21.15.7:0/4094054265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c151f70 con 0x7f4648003c20 2023-10-14T19:12:16.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f465bfff700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c16a520 0x7f465c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:16.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4661474700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f465c1526e0 0x7f465c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:16.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4660c73700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f465c153ba0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f4654012f00 tx=0x7f4654015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:16.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400c5d0 con 0x7f4648003c20 2023-10-14T19:12:16.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4654001360 con 0x7f4648003c20 2023-10-14T19:12:16.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c152250 con 0x7f4648003c20 2023-10-14T19:12:16.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400ce40 con 0x7f4648003c20 2023-10-14T19:12:16.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.655+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c0ca360 con 0x7f4648003c20 2023-10-14T19:12:16.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.656+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c0b0e80 con 0x7f4648003c20 2023-10-14T19:12:16.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.656+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4654019070 con 0x7f4648003c20 2023-10-14T19:12:16.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.657+0000 7f4658ff9700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f463c067320 0x7f463c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:16.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.657+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4654085b50 con 0x7f4648003c20 2023-10-14T19:12:16.679 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.657+0000 7f465bfff700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f463c067320 0x7f463c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.658+0000 7f465bfff700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f463c067320 0x7f463c0697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f465c0c9ee0 tx=0x7f464c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.661+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4654052ae0 con 0x7f4648003c20 2023-10-14T19:12:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.904+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f465c04c3c0 con 0x7f4648003c20 2023-10-14T19:12:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.904+0000 7f4658ff9700 1 -- 172.21.15.7:0/4094054265 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+3534 (secure 0 0 0) 0x7f4654023090 con 0x7f4648003c20 2023-10-14T19:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":126,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/3317187783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":3317187783},{"type":"v1","addr":"172.21.15.148:6837","nonce":3317187783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":7939,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2769496928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2769496928},{"type":"v1","addr":"172.21.15.148:6836","nonce":2769496928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":8706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/2492921736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2492921736},{"type":"v1","addr":"172.21.15.7:6834","nonce":2492921736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/3234777746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":3234777746},{"type":"v1","addr":"172.21.15.7:6835","nonce":3234777746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[]} 2023-10-14T19:12:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f463c067320 msgr2=0x7f463c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f463c067320 0x7f463c0697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f465c0c9ee0 tx=0x7f464c00b040 comp rx=0 tx=0).stop 2023-10-14T19:12:16.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 msgr2=0x7f465c153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:16.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f465c153ba0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f4654012f00 tx=0x7f4654015000 comp rx=0 tx=0).stop 2023-10-14T19:12:16.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 shutdown_connections 2023-10-14T19:12:16.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f463c067320 0x7f463c0697d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f465c1526e0 0x7f465c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4648003c20 0x7f465c153ba0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 --2- 172.21.15.7:0/4094054265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f465c16a520 0x7f465c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 >> 172.21.15.7:0/4094054265 conn(0x7f465c070e30 msgr2=0x7f465c0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 shutdown_connections 2023-10-14T19:12:16.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:16.906+0000 7f4662ed7700 1 -- 172.21.15.7:0/4094054265 wait complete. 2023-10-14T19:12:16.912 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 126 2023-10-14T19:12:16.919 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T19:12:16.919 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T19:12:16.920 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:12:16.920 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:12:16.920 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T19:12:16.921 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T19:12:16.921 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:12:16.921 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:12:16.922 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T19:12:16.922 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T19:12:16.922 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:12:16.922 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:12:16.923 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T19:12:16.923 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T19:12:16.923 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:12:16.924 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:12:16.930 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:12:16.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T19:12:16.932 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:12:16.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T19:12:16.933 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:12:16.934 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T19:12:16.935 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:12:16.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T19:12:16.973 INFO:tasks.ceph.mds.a:Started 2023-10-14T19:12:16.974 DEBUG:teuthology.parallel:result is None 2023-10-14T19:12:16.978 INFO:tasks.ceph.mds.c:Started 2023-10-14T19:12:16.978 DEBUG:teuthology.parallel:result is None 2023-10-14T19:12:16.979 INFO:tasks.ceph.mds.b:Started 2023-10-14T19:12:16.979 DEBUG:teuthology.parallel:result is None 2023-10-14T19:12:16.980 INFO:tasks.ceph.mds.d:Started 2023-10-14T19:12:16.980 DEBUG:teuthology.parallel:result is None 2023-10-14T19:12:16.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T19:12:17.048 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2023-10-14T19:12:17.049 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:12:17.059 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-10-14T19:12:17.060 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-10-14T19:12:17.060 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-10-14T19:12:17.060+0000 7f9ae6dd8700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T19:12:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.107+0000 7fa8d3a65700 1 Processor -- start 2023-10-14T19:12:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.107+0000 7fa8d3a65700 1 -- start start 2023-10-14T19:12:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d3a65700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a90d0 0x7fa8cc06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d3a65700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc06e7f0 con 0x7fa8cc0a8d00 2023-10-14T19:12:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d3a65700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0aeee0 con 0x7fa8cc06e380 2023-10-14T19:12:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d3a65700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0ae680 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d1000700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a90d0 0x7fa8cc06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d1801700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa8cc0a8d00 0x7fa8cc0cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40670/0 (socket says 172.21.15.7:40670) 2023-10-14T19:12:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d1801700 1 -- 172.21.15.7:0/698970581 learned_addr learned my addr 172.21.15.7:0/698970581 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8c3fff700 1 -- 172.21.15.7:0/698970581 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125592996 0 0) 0x7fa8cc06e7f0 con 0x7fa8cc0a8d00 2023-10-14T19:12:17.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8c3fff700 1 -- 172.21.15.7:0/698970581 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b8003570 con 0x7fa8cc0a8d00 2023-10-14T19:12:17.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d1000700 1 -- 172.21.15.7:0/698970581 >> v1:172.21.15.148:6789/0 conn(0x7fa8cc06e380 legacy=0x7fa8cc0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:17.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d1000700 1 -- 172.21.15.7:0/698970581 >> v1:172.21.15.7:6789/0 conn(0x7fa8cc0a8d00 legacy=0x7fa8cc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:17.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.108+0000 7fa8d1000700 1 -- 172.21.15.7:0/698970581 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0cf490 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.109+0000 7fa8d1000700 1 --2- 172.21.15.7:0/698970581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a90d0 0x7fa8cc06de40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009900 tx=0x7fa8bc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6cfb99f2445c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:17.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.109+0000 7fa8c3fff700 1 -- 172.21.15.7:0/698970581 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc005c10 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.111+0000 7fa8c3fff700 1 -- 172.21.15.7:0/698970581 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc005d70 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.111+0000 7fa8c3fff700 1 -- 172.21.15.7:0/698970581 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc006240 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 -- 172.21.15.7:0/698970581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a90d0 msgr2=0x7fa8cc06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:17.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/698970581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a90d0 0x7fa8cc06de40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009900 tx=0x7fa8bc009120 comp rx=0 tx=0).stop 2023-10-14T19:12:17.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 -- 172.21.15.7:0/698970581 shutdown_connections 2023-10-14T19:12:17.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/698970581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a90d0 0x7fa8cc06de40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:17.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 -- 172.21.15.7:0/698970581 >> 172.21.15.7:0/698970581 conn(0x7fa8cc06ce80 msgr2=0x7fa8cc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:17.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 -- 172.21.15.7:0/698970581 shutdown_connections 2023-10-14T19:12:17.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.112+0000 7fa8d3a65700 1 -- 172.21.15.7:0/698970581 wait complete. 2023-10-14T19:12:17.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.113+0000 7fa8d3a65700 1 Processor -- start 2023-10-14T19:12:17.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.113+0000 7fa8d3a65700 1 -- start start 2023-10-14T19:12:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d3a65700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc06e380 0x7fa8cc09bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:17.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d3a65700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a8d00 0x7fa8cc0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:17.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d3a65700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 0x7fa8cc16b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:17.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d3a65700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc09c080 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d3a65700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1525f0 con 0x7fa8cc06e380 2023-10-14T19:12:17.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d3a65700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc152840 con 0x7fa8cc0a8d00 2023-10-14T19:12:17.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.114+0000 7fa8d2002700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 0x7fa8cc16b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:17.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 0x7fa8cc16b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38698/0 (socket says 172.21.15.7:38698) 2023-10-14T19:12:17.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 -- 172.21.15.7:0/3757443607 learned_addr learned my addr 172.21.15.7:0/3757443607 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:17.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d1801700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc06e380 0x7fa8cc09bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:17.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d1000700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a8d00 0x7fa8cc0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:17.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 -- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a8d00 msgr2=0x7fa8cc0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:17.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a8d00 0x7fa8cc0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:17.122 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 -- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc06e380 msgr2=0x7fa8cc09bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc06e380 0x7fa8cc09bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 -- 172.21.15.7:0/3757443607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0093c0 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d2002700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 0x7fa8cc16b2e0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c840 tx=0x7fa8c4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4012630 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c40127b0 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc152b20 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4012b70 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.115+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc1530e0 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.116+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc04c3c0 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.117+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8c401a3a0 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.117+0000 7fa8c17fa700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8b0067320 0x7fa8b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.117+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa8c4084aa0 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.117+0000 7fa8d1801700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8b0067320 0x7fa8b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.117+0000 7fa8d1801700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8b0067320 0x7fa8b00697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8007fd0 tx=0x7fa8c8007c70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:17.126 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.121+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8c4051a30 con 0x7fa8cc0a90d0 2023-10-14T19:12:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:17.329+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa8cc067b20 con 0x7fa8cc0a90d0 2023-10-14T19:12:18.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.115+0000 7fa8c17fa700 1 -- 172.21.15.7:0/3757443607 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v196) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa8c4055050 con 0x7fa8cc0a90d0 2023-10-14T19:12:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8b0067320 msgr2=0x7fa8b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8b0067320 0x7fa8b00697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8007fd0 tx=0x7fa8c8007c70 comp rx=0 tx=0).stop 2023-10-14T19:12:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 msgr2=0x7fa8cc16b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 0x7fa8cc16b2e0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c840 tx=0x7fa8c4001670 comp rx=0 tx=0).stop 2023-10-14T19:12:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 shutdown_connections 2023-10-14T19:12:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa8b0067320 0x7fa8b00697d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc06e380 0x7fa8cc09bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc0a90d0 0x7fa8cc16b2e0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 --2- 172.21.15.7:0/3757443607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8cc0a8d00 0x7fa8cc0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 >> 172.21.15.7:0/3757443607 conn(0x7fa8cc06ce80 msgr2=0x7fa8cc159670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 shutdown_connections 2023-10-14T19:12:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.118+0000 7fa8d3a65700 1 -- 172.21.15.7:0/3757443607 wait complete. 2023-10-14T19:12:18.121 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2023-10-14T19:12:18.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T19:12:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.259+0000 7ff606743700 1 Processor -- start 2023-10-14T19:12:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.259+0000 7ff606743700 1 -- start start 2023-10-14T19:12:18.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff606743700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 0x7ff600159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff606743700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60015ae40 con 0x7ff6000cb5a0 2023-10-14T19:12:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff606743700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60015ab60 con 0x7ff60015a400 2023-10-14T19:12:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff606743700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000ce0f0 con 0x7ff6000cb970 2023-10-14T19:12:18.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff5fffff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff6000cb5a0 0x7ff6000cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40672/0 (socket says 172.21.15.7:40672) 2023-10-14T19:12:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff5fffff700 1 -- 172.21.15.7:0/455164996 learned_addr learned my addr 172.21.15.7:0/455164996 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.260+0000 7ff5ff7fe700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 0x7ff600159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583259971 0 0) 0x7ff60015ae40 con 0x7ff6000cb5a0 2023-10-14T19:12:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8003570 con 0x7ff6000cb5a0 2023-10-14T19:12:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712655978 0 0) 0x7ff60015ab60 con 0x7ff60015a400 2023-10-14T19:12:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff60015ae40 con 0x7ff60015a400 2023-10-14T19:12:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1116702290 0 0) 0x7ff5e8003570 con 0x7ff6000cb5a0 2023-10-14T19:12:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 msgr2=0x7ff600159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 0x7ff600159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 >> v1:172.21.15.148:6789/0 conn(0x7ff60015a400 legacy=0x7ff600156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000ccf00 con 0x7ff6000cb5a0 2023-10-14T19:12:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7ff5f0001470 con 0x7ff6000cb5a0 2023-10-14T19:12:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 >> v1:172.21.15.7:6789/0 conn(0x7ff6000cb5a0 legacy=0x7ff6000cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 0x7ff5e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5e80041d0 0x7ff5e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5e8004d50 0x7ff5e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000ce0f0 con 0x7ff5e8004d50 2023-10-14T19:12:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800bbf0 con 0x7ff5e80041d0 2023-10-14T19:12:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800bdb0 con 0x7ff6000cb970 2023-10-14T19:12:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff604ce0700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5e8004d50 0x7ff5e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5ff7fe700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5e80041d0 0x7ff5e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff5fffff700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 0x7ff5e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff604ce0700 1 -- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 msgr2=0x7ff5e8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff604ce0700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6000cb970 0x7ff5e8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff604ce0700 1 -- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5e80041d0 msgr2=0x7ff5e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff604ce0700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5e80041d0 0x7ff5e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.261+0000 7ff604ce0700 1 -- 172.21.15.7:0/455164996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8003570 con 0x7ff5e8004d50 2023-10-14T19:12:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff604ce0700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5e8004d50 0x7ff5e80051c0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8002120 tx=0x7ff5f80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb60d1c7f59361e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8001ab0 con 0x7ff5e8004d50 2023-10-14T19:12:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800c980 con 0x7ff5e8004d50 2023-10-14T19:12:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff5feffd700 1 -- 172.21.15.7:0/455164996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800cd20 con 0x7ff5e8004d50 2023-10-14T19:12:18.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff606743700 1 -- 172.21.15.7:0/455164996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5e8004d50 msgr2=0x7ff5e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff606743700 1 --2- 172.21.15.7:0/455164996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5e8004d50 0x7ff5e80051c0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8002120 tx=0x7ff5f80017a0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff604ce0700 1 -- 172.21.15.7:0/455164996 reap_dead start 2023-10-14T19:12:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff606743700 1 -- 172.21.15.7:0/455164996 shutdown_connections 2023-10-14T19:12:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff606743700 1 -- 172.21.15.7:0/455164996 >> 172.21.15.7:0/455164996 conn(0x7ff600070e30 msgr2=0x7ff6000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff606743700 1 -- 172.21.15.7:0/455164996 shutdown_connections 2023-10-14T19:12:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.262+0000 7ff606743700 1 -- 172.21.15.7:0/455164996 wait complete. 2023-10-14T19:12:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.263+0000 7ff606743700 1 Processor -- start 2023-10-14T19:12:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 -- start start 2023-10-14T19:12:18.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 0x7ff6000af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6001595f0 0x7ff600154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6000c82b0 0x7ff6001553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000cbde0 con 0x7ff6000c7ee0 2023-10-14T19:12:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60015d970 con 0x7ff6000c82b0 2023-10-14T19:12:18.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff606743700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60015d040 con 0x7ff6001595f0 2023-10-14T19:12:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff5fffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 0x7ff6000af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff5fffff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 0x7ff6000af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38710/0 (socket says 172.21.15.7:38710) 2023-10-14T19:12:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.264+0000 7ff5fffff700 1 -- 172.21.15.7:0/1404525424 learned_addr learned my addr 172.21.15.7:0/1404525424 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff604ce0700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6000c82b0 0x7ff6001553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5ff7fe700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6001595f0 0x7ff600154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5fffff700 1 -- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6001595f0 msgr2=0x7ff600154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5fffff700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6001595f0 0x7ff600154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5fffff700 1 -- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6000c82b0 msgr2=0x7ff6001553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5fffff700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6000c82b0 0x7ff6001553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5fffff700 1 -- 172.21.15.7:0/1404525424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60015d320 con 0x7ff6000c7ee0 2023-10-14T19:12:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5fffff700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 0x7ff6000af2f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0007110 tx=0x7ff5f0001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000f610 con 0x7ff6000c7ee0 2023-10-14T19:12:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f000f770 con 0x7ff6000c7ee0 2023-10-14T19:12:18.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60015d600 con 0x7ff6000c7ee0 2023-10-14T19:12:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000fb30 con 0x7ff6000c7ee0 2023-10-14T19:12:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.265+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60016d4c0 con 0x7ff6000c7ee0 2023-10-14T19:12:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.266+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60006fc80 con 0x7ff6000c7ee0 2023-10-14T19:12:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.267+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff5f001d460 con 0x7ff6000c7ee0 2023-10-14T19:12:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.267+0000 7ff5e7fff700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5ec067320 0x7ff5ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.267+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff5f0084950 con 0x7ff6000c7ee0 2023-10-14T19:12:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.267+0000 7ff5ff7fe700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5ec067320 0x7ff5ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.268+0000 7ff5ff7fe700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5ec067320 0x7ff5ec0697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006ed0 tx=0x7ff5f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.271+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5f0051a40 con 0x7ff6000c7ee0 2023-10-14T19:12:18.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.541+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff60004c3c0 con 0x7ff6000c7ee0 2023-10-14T19:12:18.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.542+0000 7ff5e7fff700 1 -- 172.21.15.7:0/1404525424 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff5f000fea0 con 0x7ff6000c7ee0 2023-10-14T19:12:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:18.542 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:12:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2023-10-14T19:12:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2023-10-14T19:12:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Splf57cGhAAwdTGOa1sBJNWLTyc8MrW4w==", 2023-10-14T19:12:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:12:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:12:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2023-10-14T19:12:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplM1leJhAA/UMhY7tqk3ajrhuycwcDBA==", 2023-10-14T19:12:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:12:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:12:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2023-10-14T19:12:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplKnPWIRAAqnHDfTp8NtiwfVGBz8+RlA==", 2023-10-14T19:12:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:12:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:12:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2023-10-14T19:12:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplJkwpLRAAlKeH21XZNPMENedWvVlH1Q==", 2023-10-14T19:12:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:12:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:12:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2023-10-14T19:12:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC+5SploibgFRAAfa7mVM/S145siyaS6FbTUA==", 2023-10-14T19:12:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2023-10-14T19:12:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDB5SplVbHYExAAg70GbDg5mGcEQN3U6jY8Mg==", 2023-10-14T19:12:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2023-10-14T19:12:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDE5Splas/IERAA5Cl68xPcOXWIFK0HpBCW/w==", 2023-10-14T19:12:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2023-10-14T19:12:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDH5SplBo5QDxAARKB9qfRaCOU+wH3gwo55fA==", 2023-10-14T19:12:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2023-10-14T19:12:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDN5SplWUzTEBAAcwfd9XgFVPaI4eBPKBU1/g==", 2023-10-14T19:12:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2023-10-14T19:12:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDQ5SpluNlgDxAArDHgH2brATVyuSKYnViumA==", 2023-10-14T19:12:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2023-10-14T19:12:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDT5Spldb71DxAA9Upcza8sKiy5qx0hCWmd5g==", 2023-10-14T19:12:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2023-10-14T19:12:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQDW5SplGg4LDhAAo2fWbrjKmFK72wK68HrwQg==", 2023-10-14T19:12:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2023-10-14T19:12:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2023-10-14T19:12:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2023-10-14T19:12:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl9kAiMRAAEdVKrBGYDSTCMDTeyuKs0g==", 2023-10-14T19:12:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2023-10-14T19:12:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T19:12:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2023-10-14T19:12:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Spl626mORAAyFgVT1iE2e+rFdDQXi69iA==", 2023-10-14T19:12:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:12:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:12:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:12:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2023-10-14T19:12:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85Sply1mWNhAAZQW2QD3xkoPWSgi6RAK1+g==", 2023-10-14T19:12:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:12:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:12:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:12:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2023-10-14T19:12:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC95SplULtvAxAA0nLYZbhualI7QfKRqv98Vg==", 2023-10-14T19:12:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2023-10-14T19:12:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2023-10-14T19:12:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2023-10-14T19:12:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2023-10-14T19:12:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2023-10-14T19:12:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC75SplX+8xMRAAJqwiJ4/0Np5YZ5ufYxUb8g==", 2023-10-14T19:12:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:12:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2023-10-14T19:12:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2023-10-14T19:12:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2023-10-14T19:12:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplO8aZFxAAkAyuSJjGqkd80yD9BDy9WQ==", 2023-10-14T19:12:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:12:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:12:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-10-14T19:12:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2023-10-14T19:12:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQC85SplAZNgExAAjSxwhjwzW1orMAduG9F8bg==", 2023-10-14T19:12:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2023-10-14T19:12:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2023-10-14T19:12:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2023-10-14T19:12:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2023-10-14T19:12:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-10-14T19:12:18.578 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:12:18.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5ec067320 msgr2=0x7ff5ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5ec067320 0x7ff5ec0697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006ed0 tx=0x7ff5f4008040 comp rx=0 tx=0).stop 2023-10-14T19:12:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 msgr2=0x7ff6000af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 0x7ff6000af2f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0007110 tx=0x7ff5f0001d20 comp rx=0 tx=0).stop 2023-10-14T19:12:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 shutdown_connections 2023-10-14T19:12:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff5ec067320 0x7ff5ec0697d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6000c82b0 0x7ff6001553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6000c7ee0 0x7ff6000af2f0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 --2- 172.21.15.7:0/1404525424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6001595f0 0x7ff600154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 >> 172.21.15.7:0/1404525424 conn(0x7ff600070e30 msgr2=0x7ff6000b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 shutdown_connections 2023-10-14T19:12:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.544+0000 7ff606743700 1 -- 172.21.15.7:0/1404525424 wait complete. 2023-10-14T19:12:18.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.702+0000 7f2704a70700 1 Processor -- start 2023-10-14T19:12:18.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.702+0000 7f2704a70700 1 -- start start 2023-10-14T19:12:18.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.703+0000 7f2704a70700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f27000cb5a0 0x7f27000cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.703+0000 7f2704a70700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27000cd9e0 0x7f2700159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.703+0000 7f2704a70700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270015ae40 con 0x7f270015a400 2023-10-14T19:12:18.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.703+0000 7f2704a70700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000d13f0 con 0x7f27000cb5a0 2023-10-14T19:12:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.703+0000 7f2704a70700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270015ab60 con 0x7f27000cd9e0 2023-10-14T19:12:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f27000cb5a0 0x7f27000cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f27000cb5a0 0x7f27000cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38718/0 (socket says 172.21.15.7:38718) 2023-10-14T19:12:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 -- 172.21.15.7:0/1989978801 learned_addr learned my addr 172.21.15.7:0/1989978801 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fdd9b700 1 --2- 172.21.15.7:0/1989978801 >> v2:172.21.15.148:3300/0 conn(0x7f27000cd9e0 0x7f2700159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 -- 172.21.15.7:0/1989978801 >> v2:172.21.15.148:3300/0 conn(0x7f27000cd9e0 msgr2=0x7f2700159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 --2- 172.21.15.7:0/1989978801 >> v2:172.21.15.148:3300/0 conn(0x7f27000cd9e0 0x7f2700159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 -- 172.21.15.7:0/1989978801 >> v1:172.21.15.148:6789/0 conn(0x7f270015a400 legacy=0x7f2700156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 -- 172.21.15.7:0/1989978801 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000ccf00 con 0x7f27000cb5a0 2023-10-14T19:12:18.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fe59c700 1 --2- 172.21.15.7:0/1989978801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27000cb5a0 0x7f27000cb970 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099b0 tx=0x7f26f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cc369dbafbab17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fd59a700 1 -- 172.21.15.7:0/1989978801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800b820 con 0x7f27000cb5a0 2023-10-14T19:12:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fd59a700 1 -- 172.21.15.7:0/1989978801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f800b980 con 0x7f27000cb5a0 2023-10-14T19:12:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.704+0000 7f26fd59a700 1 -- 172.21.15.7:0/1989978801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800bd20 con 0x7f27000cb5a0 2023-10-14T19:12:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 -- 172.21.15.7:0/1989978801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27000cb5a0 msgr2=0x7f27000cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 --2- 172.21.15.7:0/1989978801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27000cb5a0 0x7f27000cb970 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099b0 tx=0x7f26f8009250 comp rx=0 tx=0).stop 2023-10-14T19:12:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 -- 172.21.15.7:0/1989978801 shutdown_connections 2023-10-14T19:12:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 --2- 172.21.15.7:0/1989978801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27000cb5a0 0x7f27000cb970 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 --2- 172.21.15.7:0/1989978801 >> v2:172.21.15.148:3300/0 conn(0x7f27000cd9e0 0x7f2700159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 -- 172.21.15.7:0/1989978801 >> 172.21.15.7:0/1989978801 conn(0x7f2700070e30 msgr2=0x7f27000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 -- 172.21.15.7:0/1989978801 shutdown_connections 2023-10-14T19:12:18.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.705+0000 7f2704a70700 1 -- 172.21.15.7:0/1989978801 wait complete. 2023-10-14T19:12:18.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.706+0000 7f2704a70700 1 Processor -- start 2023-10-14T19:12:18.713 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.706+0000 7f2704a70700 1 -- start start 2023-10-14T19:12:18.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f2704a70700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27000cb5a0 0x7f270014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f2704a70700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27000cd9e0 0x7f2700153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f2704a70700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 0x7f27000b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f2704a70700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700150a40 con 0x7f270015a400 2023-10-14T19:12:18.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f2704a70700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700152450 con 0x7f27000cd9e0 2023-10-14T19:12:18.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f2704a70700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2700153270 con 0x7f27000cb5a0 2023-10-14T19:12:18.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 0x7f27000b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 0x7f27000b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38728/0 (socket says 172.21.15.7:38728) 2023-10-14T19:12:18.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 -- 172.21.15.7:0/3820872420 learned_addr learned my addr 172.21.15.7:0/3820872420 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:18.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fe59c700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27000cb5a0 0x7f270014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fdd9b700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27000cd9e0 0x7f2700153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 -- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27000cb5a0 msgr2=0x7f270014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27000cb5a0 0x7f270014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 -- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27000cd9e0 msgr2=0x7f2700153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.716 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27000cd9e0 0x7f2700153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 -- 172.21.15.7:0/3820872420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80094f0 con 0x7f270015a400 2023-10-14T19:12:18.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26fed9d700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 0x7f27000b34b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c840 tx=0x7f26f0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:18.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0012630 con 0x7f270015a400 2023-10-14T19:12:18.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.707+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00127b0 con 0x7f270015a400 2023-10-14T19:12:18.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.708+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2700152660 con 0x7f270015a400 2023-10-14T19:12:18.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.708+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0012b70 con 0x7f270015a400 2023-10-14T19:12:18.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.708+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700152c20 con 0x7f270015a400 2023-10-14T19:12:18.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.709+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270004c3c0 con 0x7f270015a400 2023-10-14T19:12:18.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.709+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f26f001a3a0 con 0x7f270015a400 2023-10-14T19:12:18.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.709+0000 7f26f67fc700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26e0067320 0x7f26e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:18.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.709+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f26f0084a50 con 0x7f270015a400 2023-10-14T19:12:18.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.709+0000 7f26fe59c700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26e0067320 0x7f26e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:18.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.710+0000 7f26fe59c700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26e0067320 0x7f26e00697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099b0 tx=0x7f26f8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:18.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.713+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26f0051a30 con 0x7f270015a400 2023-10-14T19:12:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.906+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27000cd1e0 con 0x7f270015a400 2023-10-14T19:12:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.907+0000 7f26f67fc700 1 -- 172.21.15.7:0/3820872420 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f26f0055050 con 0x7f270015a400 2023-10-14T19:12:18.907 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:18.907 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":196,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:18.110604+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26e0067320 msgr2=0x7f26e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26e0067320 0x7f26e00697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099b0 tx=0x7f26f8017000 comp rx=0 tx=0).stop 2023-10-14T19:12:18.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 msgr2=0x7f27000b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:18.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 0x7f27000b34b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c840 tx=0x7f26f0001670 comp rx=0 tx=0).stop 2023-10-14T19:12:18.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 shutdown_connections 2023-10-14T19:12:18.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f26e0067320 0x7f26e00697d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270015a400 0x7f27000b34b0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27000cb5a0 0x7f270014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 --2- 172.21.15.7:0/3820872420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27000cd9e0 0x7f2700153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 >> 172.21.15.7:0/3820872420 conn(0x7f2700070e30 msgr2=0x7f27001553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 shutdown_connections 2023-10-14T19:12:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:18.909+0000 7f2704a70700 1 -- 172.21.15.7:0/3820872420 wait complete. 2023-10-14T19:12:18.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T19:12:18.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:12:19.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.044+0000 7f6180f23700 1 Processor -- start 2023-10-14T19:12:19.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.044+0000 7f6180f23700 1 -- start start 2023-10-14T19:12:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6180f23700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c159860 0x7f617c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6180f23700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f617c0ccfa0 0x7f617c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6180f23700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0cf510 con 0x7f617c0cbd90 2023-10-14T19:12:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6180f23700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0d00b0 con 0x7f617c0ccfa0 2023-10-14T19:12:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6180f23700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0cc1e0 con 0x7f617c159860 2023-10-14T19:12:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6179d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f617c0cbd90 0x7f617c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40688/0 (socket says 172.21.15.7:40688) 2023-10-14T19:12:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f6179d9b700 1 -- 172.21.15.7:0/2603830533 learned_addr learned my addr 172.21.15.7:0/2603830533 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f617a59c700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c159860 0x7f617c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.045+0000 7f617ad9d700 1 --2- 172.21.15.7:0/2603830533 >> v2:172.21.15.148:3300/0 conn(0x7f617c0ccfa0 0x7f617c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617959a700 1 -- 172.21.15.7:0/2603830533 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309574823 0 0) 0x7f617c0cf510 con 0x7f617c0cbd90 2023-10-14T19:12:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617959a700 1 -- 172.21.15.7:0/2603830533 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6168003570 con 0x7f617c0cbd90 2023-10-14T19:12:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617959a700 1 -- 172.21.15.7:0/2603830533 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2461114386 0 0) 0x7f6168003570 con 0x7f617c0cbd90 2023-10-14T19:12:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617ad9d700 1 -- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c159860 msgr2=0x7f617c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617ad9d700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c159860 0x7f617c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617ad9d700 1 -- 172.21.15.7:0/2603830533 >> v1:172.21.15.7:6789/0 conn(0x7f617c0cbd90 legacy=0x7f617c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617ad9d700 1 -- 172.21.15.7:0/2603830533 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0cd960 con 0x7f617c0ccfa0 2023-10-14T19:12:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617a59c700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c159860 0x7f617c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617ad9d700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0ccfa0 0x7f617c0cd420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f616c009e60 tx=0x7f616c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d0081f6c4ac03f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617959a700 1 -- 172.21.15.7:0/2603830533 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00e070 con 0x7f617c0ccfa0 2023-10-14T19:12:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617959a700 1 -- 172.21.15.7:0/2603830533 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c00b7a0 con 0x7f617c0ccfa0 2023-10-14T19:12:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.046+0000 7f617959a700 1 -- 172.21.15.7:0/2603830533 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640015f0 con 0x7f617c0ccfa0 2023-10-14T19:12:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 -- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0ccfa0 msgr2=0x7f617c0cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0ccfa0 0x7f617c0cd420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f616c009e60 tx=0x7f616c009780 comp rx=0 tx=0).stop 2023-10-14T19:12:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 -- 172.21.15.7:0/2603830533 shutdown_connections 2023-10-14T19:12:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0ccfa0 0x7f617c0cd420 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 --2- 172.21.15.7:0/2603830533 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c159860 0x7f617c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 -- 172.21.15.7:0/2603830533 >> 172.21.15.7:0/2603830533 conn(0x7f617c0999b0 msgr2=0x7f617c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 -- 172.21.15.7:0/2603830533 shutdown_connections 2023-10-14T19:12:19.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.047+0000 7f6180f23700 1 -- 172.21.15.7:0/2603830533 wait complete. 2023-10-14T19:12:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.048+0000 7f6180f23700 1 Processor -- start 2023-10-14T19:12:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.048+0000 7f6180f23700 1 -- start start 2023-10-14T19:12:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6180f23700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0cbd90 0x7f617c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6180f23700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c0ccfa0 0x7f617c0c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6180f23700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 0x7f617c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6180f23700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0c9590 con 0x7f617c159860 2023-10-14T19:12:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6180f23700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1591e0 con 0x7f617c0cbd90 2023-10-14T19:12:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6180f23700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c09a5c0 con 0x7f617c0ccfa0 2023-10-14T19:12:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 0x7f617c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 0x7f617c0c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38742/0 (socket says 172.21.15.7:38742) 2023-10-14T19:12:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 -- 172.21.15.7:0/1062253362 learned_addr learned my addr 172.21.15.7:0/1062253362 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617a59c700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0cbd90 0x7f617c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6179d9b700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c0ccfa0 0x7f617c0c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 -- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c0ccfa0 msgr2=0x7f617c0c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c0ccfa0 0x7f617c0c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 -- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0cbd90 msgr2=0x7f617c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0cbd90 0x7f617c158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 -- 172.21.15.7:0/1062253362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740093c0 con 0x7f617c159860 2023-10-14T19:12:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f6179d9b700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c0ccfa0 0x7f617c0c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:19.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f617ad9d700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 0x7f617c0c8350 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f616c00b610 tx=0x7f616c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c012ce0 con 0x7f617c159860 2023-10-14T19:12:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.049+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c012e40 con 0x7f617c159860 2023-10-14T19:12:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.050+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c009a20 con 0x7f617c159860 2023-10-14T19:12:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.050+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c01d680 con 0x7f617c159860 2023-10-14T19:12:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.050+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c0c8c60 con 0x7f617c159860 2023-10-14T19:12:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.050+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c04c3c0 con 0x7f617c159860 2023-10-14T19:12:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.051+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f616c024070 con 0x7f617c159860 2023-10-14T19:12:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.051+0000 7f61727fc700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f615c067320 0x7f615c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.051+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f616c0868c0 con 0x7f617c159860 2023-10-14T19:12:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.052+0000 7f617a59c700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f615c067320 0x7f615c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.053+0000 7f617a59c700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f615c067320 0x7f615c0697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6174009390 tx=0x7f6174008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.056+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f616c0538a0 con 0x7f617c159860 2023-10-14T19:12:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.248+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f617c0ce900 con 0x7f617c159860 2023-10-14T19:12:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.248+0000 7f61727fc700 1 -- 172.21.15.7:0/1062253362 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) v1 ==== 93+0+10 (secure 0 0 0) 0x7f616c02b0a0 con 0x7f617c159860 2023-10-14T19:12:19.249 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:12:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f615c067320 msgr2=0x7f615c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f615c067320 0x7f615c0697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6174009390 tx=0x7f6174008040 comp rx=0 tx=0).stop 2023-10-14T19:12:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 msgr2=0x7f617c0c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 0x7f617c0c8350 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f616c00b610 tx=0x7f616c018000 comp rx=0 tx=0).stop 2023-10-14T19:12:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 shutdown_connections 2023-10-14T19:12:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f615c067320 0x7f615c0697d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f617c0cbd90 0x7f617c158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f617c159860 0x7f617c0c8350 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 --2- 172.21.15.7:0/1062253362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f617c0ccfa0 0x7f617c0c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 >> 172.21.15.7:0/1062253362 conn(0x7f617c0999b0 msgr2=0x7f617c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.250+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 shutdown_connections 2023-10-14T19:12:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.251+0000 7f6180f23700 1 -- 172.21.15.7:0/1062253362 wait complete. 2023-10-14T19:12:19.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T19:12:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.393+0000 7f1dbaddf700 1 Processor -- start 2023-10-14T19:12:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.393+0000 7f1dbaddf700 1 -- start start 2023-10-14T19:12:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1dbaddf700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1db40cb5a0 0x7f1db40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1dbaddf700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db415ae40 con 0x7f1db40cd9e0 2023-10-14T19:12:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1dbaddf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db415ab60 con 0x7f1db415a5d0 2023-10-14T19:12:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1dbaddf700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db40d13f0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1db8b7b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1db40cb5a0 0x7f1db40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1db3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1db40cd9e0 0x7f1db4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40702/0 (socket says 172.21.15.7:40702) 2023-10-14T19:12:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.394+0000 7f1db3fff700 1 -- 172.21.15.7:0/4006730069 learned_addr learned my addr 172.21.15.7:0/4006730069 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db8b7b700 1 -- 172.21.15.7:0/4006730069 >> v1:172.21.15.148:6789/0 conn(0x7f1db415a5d0 legacy=0x7f1db4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db8b7b700 1 -- 172.21.15.7:0/4006730069 >> v1:172.21.15.7:6789/0 conn(0x7f1db40cd9e0 legacy=0x7f1db4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db8b7b700 1 -- 172.21.15.7:0/4006730069 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40ccf00 con 0x7f1db40cb5a0 2023-10-14T19:12:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db37fe700 1 -- 172.21.15.7:0/4006730069 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849928057 0 0) 0x7f1db415ae40 con 0x7f1db40cd9e0 2023-10-14T19:12:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db8b7b700 1 --2- 172.21.15.7:0/4006730069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40cb970 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009e90 tx=0x7f1dac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68452a9888cc0cc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db37fe700 1 -- 172.21.15.7:0/4006730069 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00e070 con 0x7f1db40cb5a0 2023-10-14T19:12:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db37fe700 1 -- 172.21.15.7:0/4006730069 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00bbf0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1db37fe700 1 -- 172.21.15.7:0/4006730069 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac012430 con 0x7f1db40cb5a0 2023-10-14T19:12:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1dbaddf700 1 -- 172.21.15.7:0/4006730069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 msgr2=0x7f1db40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/4006730069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40cb970 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009e90 tx=0x7f1dac009780 comp rx=0 tx=0).stop 2023-10-14T19:12:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1dbaddf700 1 -- 172.21.15.7:0/4006730069 shutdown_connections 2023-10-14T19:12:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/4006730069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40cb970 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.395+0000 7f1dbaddf700 1 -- 172.21.15.7:0/4006730069 >> 172.21.15.7:0/4006730069 conn(0x7f1db4070e30 msgr2=0x7f1db40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.396+0000 7f1dbaddf700 1 -- 172.21.15.7:0/4006730069 shutdown_connections 2023-10-14T19:12:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.396+0000 7f1dbaddf700 1 -- 172.21.15.7:0/4006730069 wait complete. 2023-10-14T19:12:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 Processor -- start 2023-10-14T19:12:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 -- start start 2023-10-14T19:12:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1db40cd9e0 0x7f1db4152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1db415a5d0 0x7f1db4169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4154520 con 0x7f1db40cb5a0 2023-10-14T19:12:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c9f00 con 0x7f1db415a5d0 2023-10-14T19:12:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.397+0000 7f1dbaddf700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40ca1e0 con 0x7f1db40cd9e0 2023-10-14T19:12:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38752/0 (socket says 172.21.15.7:38752) 2023-10-14T19:12:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 -- 172.21.15.7:0/2364222807 learned_addr learned my addr 172.21.15.7:0/2364222807 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db3fff700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1db40cd9e0 0x7f1db4152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db937c700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1db415a5d0 0x7f1db4169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 -- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1db40cd9e0 msgr2=0x7f1db4152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1db40cd9e0 0x7f1db4152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 -- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1db415a5d0 msgr2=0x7f1db4169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1db415a5d0 0x7f1db4169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 -- 172.21.15.7:0/2364222807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac009a20 con 0x7f1db40cb5a0 2023-10-14T19:12:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db8b7b700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40c9840 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f1db406ea60 tx=0x7f1dac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac026480 con 0x7f1db40cb5a0 2023-10-14T19:12:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac0265e0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db40ca4c0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0269a0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.398+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db4152aa0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.399+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db404c3c0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.399+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1dac026d10 con 0x7f1db40cb5a0 2023-10-14T19:12:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.400+0000 7f1db0ff9700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1d94067320 0x7f1d940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.400+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1dac086a70 con 0x7f1db40cb5a0 2023-10-14T19:12:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.400+0000 7f1db3fff700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1d94067320 0x7f1d940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.401+0000 7f1db3fff700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1d94067320 0x7f1d940697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1db40af2e0 tx=0x7f1d9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.404+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dac053940 con 0x7f1db40cb5a0 2023-10-14T19:12:19.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:19.502 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.601+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1db40cd1e0 con 0x7f1db40cb5a0 2023-10-14T19:12:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.601+0000 7f1db0ff9700 1 -- 172.21.15.7:0/2364222807 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v196) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1dac056f60 con 0x7f1db40cb5a0 2023-10-14T19:12:19.601 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:19.602 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:12:19.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:19.602 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-10-14T19:12:19.602 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-10-14T19:12:19.602 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:19.603 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:12:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1d94067320 msgr2=0x7f1d940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1d94067320 0x7f1d940697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1db40af2e0 tx=0x7f1d9c009040 comp rx=0 tx=0).stop 2023-10-14T19:12:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 msgr2=0x7f1db40c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40c9840 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f1db406ea60 tx=0x7f1dac019000 comp rx=0 tx=0).stop 2023-10-14T19:12:19.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 shutdown_connections 2023-10-14T19:12:19.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1d94067320 0x7f1d940697d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1db415a5d0 0x7f1db4169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db40cb5a0 0x7f1db40c9840 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 --2- 172.21.15.7:0/2364222807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1db40cd9e0 0x7f1db4152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 >> 172.21.15.7:0/2364222807 conn(0x7f1db4070e30 msgr2=0x7f1db40b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:19.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 shutdown_connections 2023-10-14T19:12:19.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.603+0000 7f1dbaddf700 1 -- 172.21.15.7:0/2364222807 wait complete. 2023-10-14T19:12:19.615 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T19:12:19.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T19:12:19.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.739+0000 7fc0ae0e6700 1 Processor -- start 2023-10-14T19:12:19.739 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.739+0000 7fc0ae0e6700 1 -- start start 2023-10-14T19:12:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.739+0000 7fc0ae0e6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a8067e50 0x7fc0a815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0ae0e6700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0a80c8c70 0x7fc0a80c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0ae0e6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a815d9f0 con 0x7fc0a8068220 2023-10-14T19:12:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0ae0e6700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a815d3c0 con 0x7fc0a80c8c70 2023-10-14T19:12:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0ae0e6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80c9630 con 0x7fc0a8067e50 2023-10-14T19:12:19.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0a80c8c70 0x7fc0a80c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0a80c8c70 0x7fc0a80c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38754/0 (socket says 172.21.15.7:38754) 2023-10-14T19:12:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 -- 172.21.15.7:0/1289209022 learned_addr learned my addr 172.21.15.7:0/1289209022 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a77fe700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a8067e50 0x7fc0a815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 -- 172.21.15.7:0/1289209022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a8067e50 msgr2=0x7fc0a815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a8067e50 0x7fc0a815de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 -- 172.21.15.7:0/1289209022 >> v1:172.21.15.148:6789/0 conn(0x7fc0a8068220 legacy=0x7fc0a8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 -- 172.21.15.7:0/1289209022 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a815a8f0 con 0x7fc0a80c8c70 2023-10-14T19:12:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a77fe700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a8067e50 0x7fc0a815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a7fff700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a80c8c70 0x7fc0a80c90f0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009f20 tx=0x7fc0a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5c275af0c84534 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a67fc700 1 -- 172.21.15.7:0/1289209022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000e070 con 0x7fc0a80c8c70 2023-10-14T19:12:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a67fc700 1 -- 172.21.15.7:0/1289209022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000ba40 con 0x7fc0a80c8c70 2023-10-14T19:12:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.740+0000 7fc0a67fc700 1 -- 172.21.15.7:0/1289209022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00092e0 con 0x7fc0a80c8c70 2023-10-14T19:12:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/1289209022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a80c8c70 msgr2=0x7fc0a80c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a80c8c70 0x7fc0a80c90f0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009f20 tx=0x7fc0a0009840 comp rx=0 tx=0).stop 2023-10-14T19:12:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/1289209022 shutdown_connections 2023-10-14T19:12:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a80c8c70 0x7fc0a80c90f0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/1289209022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a8067e50 0x7fc0a815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/1289209022 >> 172.21.15.7:0/1289209022 conn(0x7fc0a80ce4a0 msgr2=0x7fc0a80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:19.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/1289209022 shutdown_connections 2023-10-14T19:12:19.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.741+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/1289209022 wait complete. 2023-10-14T19:12:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.742+0000 7fc0ae0e6700 1 Processor -- start 2023-10-14T19:12:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.742+0000 7fc0ae0e6700 1 -- start start 2023-10-14T19:12:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0ae0e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a8067e50 0x7fc0a8152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0ae0e6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 0x7fc0a80c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0ae0e6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a80c8c70 0x7fc0a8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0ae0e6700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80c31f0 con 0x7fc0a8068220 2023-10-14T19:12:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0ae0e6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80c34d0 con 0x7fc0a8067e50 2023-10-14T19:12:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0ae0e6700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80c37b0 con 0x7fc0a80c8c70 2023-10-14T19:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 0x7fc0a80c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 0x7fc0a80c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38756/0 (socket says 172.21.15.7:38756) 2023-10-14T19:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 -- 172.21.15.7:0/4056597608 learned_addr learned my addr 172.21.15.7:0/4056597608 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a7fff700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a80c8c70 0x7fc0a8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a77fe700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a8067e50 0x7fc0a8152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 -- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a80c8c70 msgr2=0x7fc0a8154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a80c8c70 0x7fc0a8154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 -- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a8067e50 msgr2=0x7fc0a8152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a8067e50 0x7fc0a8152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 -- 172.21.15.7:0/4056597608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0009ae0 con 0x7fc0a8068220 2023-10-14T19:12:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a7fff700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a80c8c70 0x7fc0a8154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a77fe700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a8067e50 0x7fc0a8152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.743+0000 7fc0a6ffd700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 0x7fc0a80c2830 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00c5d0 tx=0x7fc09c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.744+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c011590 con 0x7fc0a8068220 2023-10-14T19:12:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.744+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c011710 con 0x7fc0a8068220 2023-10-14T19:12:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.744+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a80c3a90 con 0x7fc0a8068220 2023-10-14T19:12:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.744+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c011ad0 con 0x7fc0a8068220 2023-10-14T19:12:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.744+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a815cfb0 con 0x7fc0a8068220 2023-10-14T19:12:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.745+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a804c3c0 con 0x7fc0a8068220 2023-10-14T19:12:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.745+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc09c01c460 con 0x7fc0a8068220 2023-10-14T19:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.745+0000 7fc08f7fe700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc094067320 0x7fc0940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.745+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc09c0846d0 con 0x7fc0a8068220 2023-10-14T19:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.746+0000 7fc0a77fe700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc094067320 0x7fc0940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.746+0000 7fc0a77fe700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc094067320 0x7fc0940697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc098006fd0 tx=0x7fc098008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.750+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc09c0516b0 con 0x7fc0a8068220 2023-10-14T19:12:19.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:19.942+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc0a815abd0 con 0x7fc0a8068220 2023-10-14T19:12:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.121+0000 7fc08f7fe700 1 -- 172.21.15.7:0/4056597608 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v197) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc09c054cd0 con 0x7fc0a8068220 2023-10-14T19:12:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.125+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc094067320 msgr2=0x7fc0940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.125+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc094067320 0x7fc0940697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc098006fd0 tx=0x7fc098008040 comp rx=0 tx=0).stop 2023-10-14T19:12:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.125+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 msgr2=0x7fc0a80c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.125+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 0x7fc0a80c2830 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00c5d0 tx=0x7fc09c007f60 comp rx=0 tx=0).stop 2023-10-14T19:12:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 shutdown_connections 2023-10-14T19:12:20.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc094067320 0x7fc0940697d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.130 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0a8067e50 0x7fc0a8152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0a80c8c70 0x7fc0a8154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 --2- 172.21.15.7:0/4056597608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0a8068220 0x7fc0a80c2830 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 >> 172.21.15.7:0/4056597608 conn(0x7fc0a80ce4a0 msgr2=0x7fc0a80cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 shutdown_connections 2023-10-14T19:12:20.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.126+0000 7fc0ae0e6700 1 -- 172.21.15.7:0/4056597608 wait complete. 2023-10-14T19:12:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-10-14T19:12:20.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T19:12:20.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.271+0000 7f2420c51700 1 Processor -- start 2023-10-14T19:12:20.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.271+0000 7f2420c51700 1 -- start start 2023-10-14T19:12:20.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f2420c51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f241c159530 0x7f241c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f2420c51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f2420c51700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0ccfd0 con 0x7f241c06dc70 2023-10-14T19:12:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f2420c51700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0cf0e0 con 0x7f241c159530 2023-10-14T19:12:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f2420c51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c15a3d0 con 0x7f241c06e0e0 2023-10-14T19:12:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f241a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f241c159530 0x7f241c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f241ad9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f241a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f241c159530 0x7f241c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:41892/0 (socket says 172.21.15.7:41892) 2023-10-14T19:12:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f2419d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f241c06dc70 0x7f241c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:48228/0 (socket says 172.21.15.7:48228) 2023-10-14T19:12:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f241ad9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:56548/0 (socket says 172.21.15.7:56548) 2023-10-14T19:12:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.272+0000 7f241a59c700 1 -- 172.21.15.7:0/3597304141 learned_addr learned my addr 172.21.15.7:0/3597304141 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241a59c700 1 -- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 msgr2=0x7f241c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241a59c700 1 --2- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241a59c700 1 -- 172.21.15.7:0/3597304141 >> v1:172.21.15.148:6789/0 conn(0x7f241c06dc70 legacy=0x7f241c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241a59c700 1 -- 172.21.15.7:0/3597304141 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c15a6b0 con 0x7f241c159530 2023-10-14T19:12:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241959a700 1 -- 172.21.15.7:0/3597304141 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042838841 0 0) 0x7f241c0ccfd0 con 0x7f241c06dc70 2023-10-14T19:12:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241ad9d700 1 --2- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241a59c700 1 --2- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c159530 0x7f241c0ceba0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f240c0099b0 tx=0x7f240c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cffad6f77a9f931 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241959a700 1 -- 172.21.15.7:0/3597304141 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c009ea0 con 0x7f241c159530 2023-10-14T19:12:20.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241959a700 1 -- 172.21.15.7:0/3597304141 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c00b860 con 0x7f241c159530 2023-10-14T19:12:20.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f241959a700 1 -- 172.21.15.7:0/3597304141 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c00bc00 con 0x7f241c159530 2023-10-14T19:12:20.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f2420c51700 1 -- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c159530 msgr2=0x7f241c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:20.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.273+0000 7f2420c51700 1 --2- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c159530 0x7f241c0ceba0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f240c0099b0 tx=0x7f240c009250 comp rx=0 tx=0).stop 2023-10-14T19:12:20.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.274+0000 7f2420c51700 1 -- 172.21.15.7:0/3597304141 shutdown_connections 2023-10-14T19:12:20.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.274+0000 7f2420c51700 1 --2- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.274+0000 7f2420c51700 1 --2- 172.21.15.7:0/3597304141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c159530 0x7f241c0ceba0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.274+0000 7f2420c51700 1 -- 172.21.15.7:0/3597304141 >> 172.21.15.7:0/3597304141 conn(0x7f241c0703a0 msgr2=0x7f241c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:20.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.274+0000 7f2420c51700 1 -- 172.21.15.7:0/3597304141 shutdown_connections 2023-10-14T19:12:20.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.274+0000 7f2420c51700 1 -- 172.21.15.7:0/3597304141 wait complete. 2023-10-14T19:12:20.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 Processor -- start 2023-10-14T19:12:20.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 -- start start 2023-10-14T19:12:20.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c06dc70 0x7f241c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:20.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:20.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 0x7f241c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:20.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0ca410 con 0x7f241c159530 2023-10-14T19:12:20.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0b3a60 con 0x7f241c06dc70 2023-10-14T19:12:20.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.275+0000 7f2420c51700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0b3d40 con 0x7f241c06e0e0 2023-10-14T19:12:20.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 0x7f241c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:20.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 0x7f241c0cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38758/0 (socket says 172.21.15.7:38758) 2023-10-14T19:12:20.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 -- 172.21.15.7:0/2490549326 learned_addr learned my addr 172.21.15.7:0/2490549326 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:20.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241a59c700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c06dc70 0x7f241c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:20.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f2419d9b700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:20.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 -- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 msgr2=0x7f241c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:20.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 -- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c06dc70 msgr2=0x7f241c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:20.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c06dc70 0x7f241c0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:20.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 -- 172.21.15.7:0/2490549326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414009a20 con 0x7f241c159530 2023-10-14T19:12:20.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f241ad9d700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 0x7f241c0cd6b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f241400ef90 tx=0x7f241400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:20.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400cbd0 con 0x7f241c159530 2023-10-14T19:12:20.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400f040 con 0x7f241c159530 2023-10-14T19:12:20.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0094f0 con 0x7f241c159530 2023-10-14T19:12:20.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414014480 con 0x7f241c159530 2023-10-14T19:12:20.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.276+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c0b4300 con 0x7f241c159530 2023-10-14T19:12:20.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.277+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c04c3c0 con 0x7f241c159530 2023-10-14T19:12:20.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.278+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24140148b0 con 0x7f241c159530 2023-10-14T19:12:20.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.278+0000 7f240a7fc700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23fc067320 0x7f23fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:20.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.278+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f24140858c0 con 0x7f241c159530 2023-10-14T19:12:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.279+0000 7f241a59c700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23fc067320 0x7f23fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.279+0000 7f241a59c700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23fc067320 0x7f23fc0697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f240c0099b0 tx=0x7f240c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.283+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24140525e0 con 0x7f241c159530 2023-10-14T19:12:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:20.473+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f241c0ce6a0 con 0x7f241c159530 2023-10-14T19:12:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.125+0000 7f240a7fc700 1 -- 172.21.15.7:0/2490549326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v198) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2414055c00 con 0x7f241c159530 2023-10-14T19:12:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.132+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23fc067320 msgr2=0x7f23fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23fc067320 0x7f23fc0697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f240c0099b0 tx=0x7f240c017000 comp rx=0 tx=0).stop 2023-10-14T19:12:21.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 msgr2=0x7f241c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.133 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 0x7f241c0cd6b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f241400ef90 tx=0x7f241400b040 comp rx=0 tx=0).stop 2023-10-14T19:12:21.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 shutdown_connections 2023-10-14T19:12:21.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f23fc067320 0x7f23fc0697d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f241c06dc70 0x7f241c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c159530 0x7f241c0cd6b0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.134 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 --2- 172.21.15.7:0/2490549326 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f241c06e0e0 0x7f241c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.133+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 >> 172.21.15.7:0/2490549326 conn(0x7f241c0703a0 msgr2=0x7f241c0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:21.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.134+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 shutdown_connections 2023-10-14T19:12:21.135 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.134+0000 7f2420c51700 1 -- 172.21.15.7:0/2490549326 wait complete. 2023-10-14T19:12:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-10-14T19:12:21.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T19:12:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.280+0000 7f6602c77700 1 Processor -- start 2023-10-14T19:12:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.280+0000 7f6602c77700 1 -- start start 2023-10-14T19:12:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.281+0000 7f6602c77700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65fc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.281+0000 7f6602c77700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0ccfd0 con 0x7f65fc159530 2023-10-14T19:12:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.281+0000 7f6602c77700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc15a3d0 con 0x7f65fc06dc70 2023-10-14T19:12:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.281+0000 7f6602c77700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc15a6b0 con 0x7f65fc06e0e0 2023-10-14T19:12:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.281+0000 7f6600a13700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f65fc159530 0x7f65fc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40718/0 (socket says 172.21.15.7:40718) 2023-10-14T19:12:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.281+0000 7f6600a13700 1 -- 172.21.15.7:0/546225221 learned_addr learned my addr 172.21.15.7:0/546225221 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f6601214700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65fc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010121143 0 0) 0x7f65fc0ccfd0 con 0x7f65fc159530 2023-10-14T19:12:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e8003570 con 0x7f65fc159530 2023-10-14T19:12:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402035145 0 0) 0x7f65e8003570 con 0x7f65fc159530 2023-10-14T19:12:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 msgr2=0x7f65fc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65fc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 >> v1:172.21.15.148:6789/0 conn(0x7f65fc06dc70 legacy=0x7f65fc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc15a990 con 0x7f65fc159530 2023-10-14T19:12:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f65f4001470 con 0x7f65fc159530 2023-10-14T19:12:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 >> v1:172.21.15.7:6789/0 conn(0x7f65fc159530 legacy=0x7f65fc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8003a90 0x7f65e8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65e8004810 0x7f65e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65e80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc15a6b0 con 0x7f65e8004810 2023-10-14T19:12:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e800bbc0 con 0x7f65e8003a90 2023-10-14T19:12:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e800bd80 con 0x7f65fc06e0e0 2023-10-14T19:12:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fbfff700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65e8004810 0x7f65e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f6600a13700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8003a90 0x7f65e8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f6601214700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65e80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fbfff700 1 -- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 msgr2=0x7f65e80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fbfff700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65e80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fbfff700 1 -- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8003a90 msgr2=0x7f65e8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fbfff700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8003a90 0x7f65e8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f65fbfff700 1 -- 172.21.15.7:0/546225221 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8003570 con 0x7f65e8004810 2023-10-14T19:12:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.282+0000 7f6601214700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc06e0e0 0x7f65e80051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f65fbfff700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65e8004810 0x7f65e8004c80 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f65ec001fc0 tx=0x7f65ec001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c617afab61c6cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec001950 con 0x7f65e8004810 2023-10-14T19:12:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec00c8b0 con 0x7f65e8004810 2023-10-14T19:12:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f65fb7fe700 1 -- 172.21.15.7:0/546225221 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00cc50 con 0x7f65e8004810 2023-10-14T19:12:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6602c77700 1 -- 172.21.15.7:0/546225221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65e8004810 msgr2=0x7f65e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6602c77700 1 --2- 172.21.15.7:0/546225221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65e8004810 0x7f65e8004c80 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f65ec001fc0 tx=0x7f65ec001640 comp rx=0 tx=0).stop 2023-10-14T19:12:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6601214700 1 -- 172.21.15.7:0/546225221 reap_dead start 2023-10-14T19:12:21.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6602c77700 1 -- 172.21.15.7:0/546225221 shutdown_connections 2023-10-14T19:12:21.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6602c77700 1 -- 172.21.15.7:0/546225221 >> 172.21.15.7:0/546225221 conn(0x7f65fc0703a0 msgr2=0x7f65fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:21.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6602c77700 1 -- 172.21.15.7:0/546225221 shutdown_connections 2023-10-14T19:12:21.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.283+0000 7f6602c77700 1 -- 172.21.15.7:0/546225221 wait complete. 2023-10-14T19:12:21.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.284+0000 7f6602c77700 1 Processor -- start 2023-10-14T19:12:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 -- start start 2023-10-14T19:12:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8004810 0x7f65fc15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc15eaf0 0x7f65fc15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 0x7f65fc0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc15cec0 con 0x7f65fc15ca50 2023-10-14T19:12:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc15e660 con 0x7f65e8004810 2023-10-14T19:12:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6602c77700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc15da50 con 0x7f65fc15eaf0 2023-10-14T19:12:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6601214700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 0x7f65fc0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6601214700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 0x7f65fc0b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38774/0 (socket says 172.21.15.7:38774) 2023-10-14T19:12:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.285+0000 7f6601214700 1 -- 172.21.15.7:0/653501459 learned_addr learned my addr 172.21.15.7:0/653501459 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f65fbfff700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc15eaf0 0x7f65fc15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6600a13700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8004810 0x7f65fc15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6601214700 1 -- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc15eaf0 msgr2=0x7f65fc15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6601214700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc15eaf0 0x7f65fc15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6601214700 1 -- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8004810 msgr2=0x7f65fc15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6601214700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8004810 0x7f65fc15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6601214700 1 -- 172.21.15.7:0/653501459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc15dd30 con 0x7f65fc15ca50 2023-10-14T19:12:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f65fbfff700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc15eaf0 0x7f65fc15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6600a13700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8004810 0x7f65fc15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6601214700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 0x7f65fc0b3e60 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0cf2d0 tx=0x7f65e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4015670 con 0x7f65fc15ca50 2023-10-14T19:12:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e40157d0 con 0x7f65fc15ca50 2023-10-14T19:12:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4015b90 con 0x7f65fc15ca50 2023-10-14T19:12:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc15e010 con 0x7f65fc15ca50 2023-10-14T19:12:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.286+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc15ef60 con 0x7f65fc15ca50 2023-10-14T19:12:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.287+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc15e4b0 con 0x7f65fc15ca50 2023-10-14T19:12:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.288+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f65e4020460 con 0x7f65fc15ca50 2023-10-14T19:12:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.288+0000 7f65f8ff9700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65dc067320 0x7f65dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.288+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f65e4084e10 con 0x7f65fc15ca50 2023-10-14T19:12:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.288+0000 7f6600a13700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65dc067320 0x7f65dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.289+0000 7f6600a13700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65dc067320 0x7f65dc0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f65f40015a0 tx=0x7f65f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.292+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65e4088030 con 0x7f65fc15ca50 2023-10-14T19:12:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:21.531+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f65fc04c3c0 con 0x7f65fc15ca50 2023-10-14T19:12:22.144 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.144+0000 7f65f8ff9700 1 -- 172.21.15.7:0/653501459 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v128) v1 ==== 174+0+0 (secure 0 0 0) 0x7f65e4055590 con 0x7f65fc15ca50 2023-10-14T19:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.149+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65dc067320 msgr2=0x7f65dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.149+0000 7f6602c77700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65dc067320 0x7f65dc0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f65f40015a0 tx=0x7f65f4009040 comp rx=0 tx=0).stop 2023-10-14T19:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.149+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 msgr2=0x7f65fc0b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.149+0000 7f6602c77700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 0x7f65fc0b3e60 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0cf2d0 tx=0x7f65e4008040 comp rx=0 tx=0).stop 2023-10-14T19:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 shutdown_connections 2023-10-14T19:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f65dc067320 0x7f65dc0697d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65e8004810 0x7f65fc15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc15ca50 0x7f65fc0b3e60 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 --2- 172.21.15.7:0/653501459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65fc15eaf0 0x7f65fc15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 >> 172.21.15.7:0/653501459 conn(0x7f65fc0703a0 msgr2=0x7f65fc15af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.150+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 shutdown_connections 2023-10-14T19:12:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.151+0000 7f6602c77700 1 -- 172.21.15.7:0/653501459 wait complete. 2023-10-14T19:12:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 33 and data pool 34 2023-10-14T19:12:22.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:22.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.288+0000 7f9c67e3e700 1 Processor -- start 2023-10-14T19:12:22.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.288+0000 7f9c67e3e700 1 -- start start 2023-10-14T19:12:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c67e3e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c601599a0 0x7f9c6006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c67e3e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c6006b230 0x7f9c600c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c67e3e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c600c7f50 con 0x7f9c601595d0 2023-10-14T19:12:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c67e3e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6006bd00 con 0x7f9c601599a0 2023-10-14T19:12:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c67e3e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6006b740 con 0x7f9c6006b230 2023-10-14T19:12:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c663db700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c6006b230 0x7f9c600c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.289+0000 7f9c653d9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c601599a0 0x7f9c6006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c65bda700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9c601595d0 0x7f9c600675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:48250/0 (socket says 172.21.15.7:48250) 2023-10-14T19:12:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c65bda700 1 -- 172.21.15.7:0/3967989617 learned_addr learned my addr 172.21.15.7:0/3967989617 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c663db700 1 -- 172.21.15.7:0/3967989617 >> v2:172.21.15.148:3300/0 conn(0x7f9c601599a0 msgr2=0x7f9c6006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c663db700 1 --2- 172.21.15.7:0/3967989617 >> v2:172.21.15.148:3300/0 conn(0x7f9c601599a0 0x7f9c6006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c663db700 1 -- 172.21.15.7:0/3967989617 >> v1:172.21.15.148:6789/0 conn(0x7f9c601595d0 legacy=0x7f9c600675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c64bd8700 1 -- 172.21.15.7:0/3967989617 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360316847 0 0) 0x7f9c600c7f50 con 0x7f9c601595d0 2023-10-14T19:12:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c663db700 1 -- 172.21.15.7:0/3967989617 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6006ba20 con 0x7f9c6006b230 2023-10-14T19:12:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c653d9700 1 --2- 172.21.15.7:0/3967989617 >> v2:172.21.15.148:3300/0 conn(0x7f9c601599a0 0x7f9c6006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c663db700 1 --2- 172.21.15.7:0/3967989617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c6006b230 0x7f9c600c83e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009e60 tx=0x7f9c50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=147e42af889f6be7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c64bd8700 1 -- 172.21.15.7:0/3967989617 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000e070 con 0x7f9c6006b230 2023-10-14T19:12:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c64bd8700 1 -- 172.21.15.7:0/3967989617 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000bb60 con 0x7f9c6006b230 2023-10-14T19:12:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.290+0000 7f9c64bd8700 1 -- 172.21.15.7:0/3967989617 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50012430 con 0x7f9c6006b230 2023-10-14T19:12:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3967989617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c6006b230 msgr2=0x7f9c600c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3967989617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c6006b230 0x7f9c600c83e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009e60 tx=0x7f9c50009780 comp rx=0 tx=0).stop 2023-10-14T19:12:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3967989617 shutdown_connections 2023-10-14T19:12:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3967989617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c6006b230 0x7f9c600c83e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3967989617 >> v2:172.21.15.148:3300/0 conn(0x7f9c601599a0 0x7f9c6006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3967989617 >> 172.21.15.7:0/3967989617 conn(0x7f9c600cd400 msgr2=0x7f9c600cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3967989617 shutdown_connections 2023-10-14T19:12:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.291+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3967989617 wait complete. 2023-10-14T19:12:22.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.292+0000 7f9c67e3e700 1 Processor -- start 2023-10-14T19:12:22.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.292+0000 7f9c67e3e700 1 -- start start 2023-10-14T19:12:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c67e3e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c6006b230 0x7f9c60154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c67e3e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c601595d0 0x7f9c600c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c67e3e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 0x7f9c6015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c67e3e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b1290 con 0x7f9c601599a0 2023-10-14T19:12:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c67e3e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b1570 con 0x7f9c6006b230 2023-10-14T19:12:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c67e3e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b1850 con 0x7f9c601595d0 2023-10-14T19:12:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 0x7f9c6015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 0x7f9c6015b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38786/0 (socket says 172.21.15.7:38786) 2023-10-14T19:12:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 -- 172.21.15.7:0/3764572182 learned_addr learned my addr 172.21.15.7:0/3764572182 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c653d9700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c601595d0 0x7f9c600c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c65bda700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c6006b230 0x7f9c60154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 -- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c601595d0 msgr2=0x7f9c600c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c601595d0 0x7f9c600c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 -- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c6006b230 msgr2=0x7f9c60154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c6006b230 0x7f9c60154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c663db700 1 -- 172.21.15.7:0/3764572182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009420 con 0x7f9c601599a0 2023-10-14T19:12:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.293+0000 7f9c653d9700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c601595d0 0x7f9c600c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:12:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.294+0000 7f9c663db700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 0x7f9c6015b060 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f9c6006b880 tx=0x7f9c50019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.294+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50012e60 con 0x7f9c601599a0 2023-10-14T19:12:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.294+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50027470 con 0x7f9c601599a0 2023-10-14T19:12:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.294+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c50009a20 con 0x7f9c601599a0 2023-10-14T19:12:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.294+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50027830 con 0x7f9c601599a0 2023-10-14T19:12:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.294+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c600b1e10 con 0x7f9c601599a0 2023-10-14T19:12:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.295+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6004c3c0 con 0x7f9c601599a0 2023-10-14T19:12:22.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.295+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9c50024070 con 0x7f9c601599a0 2023-10-14T19:12:22.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.296+0000 7f9c5dffb700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c4c067320 0x7f9c4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.296+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c500872c0 con 0x7f9c601599a0 2023-10-14T19:12:22.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.296+0000 7f9c65bda700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c4c067320 0x7f9c4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.296+0000 7f9c65bda700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c4c067320 0x7f9c4c0697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9c58007fd0 tx=0x7f9c58007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.300+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c50053f50 con 0x7f9c601599a0 2023-10-14T19:12:22.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.493+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c600c7be0 con 0x7f9c601599a0 2023-10-14T19:12:22.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.494+0000 7f9c5dffb700 1 -- 172.21.15.7:0/3764572182 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f9c50057570 con 0x7f9c601599a0 2023-10-14T19:12:22.494 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:22.494 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":199,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:21.531684+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:12:19.972804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-14T19:12:20.504006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c4c067320 msgr2=0x7f9c4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c4c067320 0x7f9c4c0697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9c58007fd0 tx=0x7f9c58007d30 comp rx=0 tx=0).stop 2023-10-14T19:12:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 msgr2=0x7f9c6015b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 0x7f9c6015b060 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f9c6006b880 tx=0x7f9c50019000 comp rx=0 tx=0).stop 2023-10-14T19:12:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 shutdown_connections 2023-10-14T19:12:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9c4c067320 0x7f9c4c0697d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c6006b230 0x7f9c60154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c601599a0 0x7f9c6015b060 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 --2- 172.21.15.7:0/3764572182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c601595d0 0x7f9c600c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 >> 172.21.15.7:0/3764572182 conn(0x7f9c600cd400 msgr2=0x7f9c6006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 shutdown_connections 2023-10-14T19:12:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.496+0000 7f9c67e3e700 1 -- 172.21.15.7:0/3764572182 wait complete. 2023-10-14T19:12:22.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.629+0000 7fdee2dee700 1 Processor -- start 2023-10-14T19:12:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.629+0000 7fdee2dee700 1 -- start start 2023-10-14T19:12:22.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee2dee700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdedc15cf20 0x7fdedc0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee2dee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 0x7fdedc1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee2dee700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc15ad50 con 0x7fdedc15cb50 2023-10-14T19:12:22.637 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee2dee700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc15a140 con 0x7fdedc15cf20 2023-10-14T19:12:22.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee2dee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc15a420 con 0x7fdedc0b2d10 2023-10-14T19:12:22.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee0b8a700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdedc15cb50 0x7fdedc0b01d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40734/0 (socket says 172.21.15.7:40734) 2023-10-14T19:12:22.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee0b8a700 1 -- 172.21.15.7:0/3157595642 learned_addr learned my addr 172.21.15.7:0/3157595642 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:22.638 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded3fff700 1 --2- 172.21.15.7:0/3157595642 >> v2:172.21.15.148:3300/0 conn(0x7fdedc15cf20 0x7fdedc0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fdee138b700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 0x7fdedc1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979702747 0 0) 0x7fdedc15ad50 con 0x7fdedc15cb50 2023-10-14T19:12:22.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4003570 con 0x7fdedc15cb50 2023-10-14T19:12:22.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026200451 0 0) 0x7fdec4003570 con 0x7fdedc15cb50 2023-10-14T19:12:22.639 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 msgr2=0x7fdedc1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 0x7fdedc1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 >> v2:172.21.15.148:3300/0 conn(0x7fdedc15cf20 msgr2=0x7fdedc0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 --2- 172.21.15.7:0/3157595642 >> v2:172.21.15.148:3300/0 conn(0x7fdedc15cf20 0x7fdedc0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.640 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc15a700 con 0x7fdedc15cb50 2023-10-14T19:12:22.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fded80017f0 con 0x7fdedc15cb50 2023-10-14T19:12:22.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 >> v1:172.21.15.7:6789/0 conn(0x7fdedc15cb50 legacy=0x7fdedc0b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 0x7fdec4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdec4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.641 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d50 0x7fdec40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc15a140 con 0x7fdec4003fe0 2023-10-14T19:12:22.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc15a420 con 0x7fdec4004d50 2023-10-14T19:12:22.646 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.630+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400ba90 con 0x7fdedc0b2d10 2023-10-14T19:12:22.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdec4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fdee0b8a700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 0x7fdec4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fdee138b700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d50 0x7fdec40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 -- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 msgr2=0x7fdec4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.647 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc0b2d10 0x7fdec4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 -- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d50 msgr2=0x7fdec40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d50 0x7fdec40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 -- 172.21.15.7:0/3157595642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4003570 con 0x7fdec4003fe0 2023-10-14T19:12:22.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fdee138b700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d50 0x7fdec40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:22.648 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded3fff700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdec4004810 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fdedc15d350 tx=0x7fdecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4850ce4e438374 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00e6b0 con 0x7fdec4003fe0 2023-10-14T19:12:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc00e810 con 0x7fdec4003fe0 2023-10-14T19:12:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.631+0000 7fded37fe700 1 -- 172.21.15.7:0/3157595642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00ebd0 con 0x7fdec4003fe0 2023-10-14T19:12:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee2dee700 1 -- 172.21.15.7:0/3157595642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 msgr2=0x7fdec4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee2dee700 1 --2- 172.21.15.7:0/3157595642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdec4004810 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fdedc15d350 tx=0x7fdecc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee138b700 1 -- 172.21.15.7:0/3157595642 reap_dead start 2023-10-14T19:12:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee2dee700 1 -- 172.21.15.7:0/3157595642 shutdown_connections 2023-10-14T19:12:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee2dee700 1 -- 172.21.15.7:0/3157595642 >> 172.21.15.7:0/3157595642 conn(0x7fdedc0cded0 msgr2=0x7fdedc06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee2dee700 1 -- 172.21.15.7:0/3157595642 shutdown_connections 2023-10-14T19:12:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.632+0000 7fdee2dee700 1 -- 172.21.15.7:0/3157595642 wait complete. 2023-10-14T19:12:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.633+0000 7fdee2dee700 1 Processor -- start 2023-10-14T19:12:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.633+0000 7fdee2dee700 1 -- start start 2023-10-14T19:12:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee2dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdedc0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee2dee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc06b020 0x7fdedc169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee2dee700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc16a4d0 0x7fdedc15f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee2dee700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0aebc0 con 0x7fdec4003fe0 2023-10-14T19:12:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee2dee700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc16a9e0 con 0x7fdedc06b020 2023-10-14T19:12:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee2dee700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc16acc0 con 0x7fdedc16a4d0 2023-10-14T19:12:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdedc0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdedc0ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38800/0 (socket says 172.21.15.7:38800) 2023-10-14T19:12:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 -- 172.21.15.7:0/452898829 learned_addr learned my addr 172.21.15.7:0/452898829 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fded3fff700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc06b020 0x7fdedc169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee138b700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc16a4d0 0x7fdedc15f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 -- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc16a4d0 msgr2=0x7fdedc15f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc16a4d0 0x7fdedc15f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 -- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc06b020 msgr2=0x7fdedc169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc06b020 0x7fdedc169f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 -- 172.21.15.7:0/452898829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0ade80 con 0x7fdec4003fe0 2023-10-14T19:12:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fded3fff700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc06b020 0x7fdedc169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fdee0b8a700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdedc0ae680 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fded8007a90 tx=0x7fded8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.634+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800adb0 con 0x7fdec4003fe0 2023-10-14T19:12:22.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.635+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded80133f0 con 0x7fdec4003fe0 2023-10-14T19:12:22.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.635+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0ae160 con 0x7fdec4003fe0 2023-10-14T19:12:22.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.635+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80137b0 con 0x7fdec4003fe0 2023-10-14T19:12:22.655 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.635+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc06b490 con 0x7fdec4003fe0 2023-10-14T19:12:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.635+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc0adce0 con 0x7fdec4003fe0 2023-10-14T19:12:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.636+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fded8013b60 con 0x7fdec4003fe0 2023-10-14T19:12:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.636+0000 7fded0ff9700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdec8067320 0x7fdec80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.636+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fded80859b0 con 0x7fdec4003fe0 2023-10-14T19:12:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.636+0000 7fded3fff700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdec8067320 0x7fdec80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.637+0000 7fded3fff700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdec8067320 0x7fdec80697d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0ac9d0 tx=0x7fdecc01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.640+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdedc0adce0 con 0x7fdec4003fe0 2023-10-14T19:12:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.834+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdedc0ae3a0 con 0x7fdec4003fe0 2023-10-14T19:12:22.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.835+0000 7fded0ff9700 1 -- 172.21.15.7:0/452898829 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fdedc0ae3a0 con 0x7fdec4003fe0 2023-10-14T19:12:22.835 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:22.836 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":199,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:21.531684+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:12:19.972804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-14T19:12:20.504006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdec8067320 msgr2=0x7fdec80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdec8067320 0x7fdec80697d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0ac9d0 tx=0x7fdecc01a000 comp rx=0 tx=0).stop 2023-10-14T19:12:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 msgr2=0x7fdedc0ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdedc0ae680 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fded8007a90 tx=0x7fded8002210 comp rx=0 tx=0).stop 2023-10-14T19:12:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 shutdown_connections 2023-10-14T19:12:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdec8067320 0x7fdec80697d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc16a4d0 0x7fdedc15f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003fe0 0x7fdedc0ae680 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 --2- 172.21.15.7:0/452898829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc06b020 0x7fdedc169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 >> 172.21.15.7:0/452898829 conn(0x7fdedc0cded0 msgr2=0x7fdedc156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 shutdown_connections 2023-10-14T19:12:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.837+0000 7fdee2dee700 1 -- 172.21.15.7:0/452898829 wait complete. 2023-10-14T19:12:22.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T19:12:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.974+0000 7f7c28f9b700 1 Processor -- start 2023-10-14T19:12:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.974+0000 7f7c28f9b700 1 -- start start 2023-10-14T19:12:22.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c28f9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c24159530 0x7f7c240ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.976 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c28f9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c2406e0e0 0x7f7c240cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c28f9b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c240ccfd0 con 0x7f7c2406dc70 2023-10-14T19:12:22.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c28f9b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240cf0e0 con 0x7f7c2406e0e0 2023-10-14T19:12:22.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c28f9b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2415a3d0 con 0x7f7c24159530 2023-10-14T19:12:22.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c2406e0e0 0x7f7c240cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.977 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c2406e0e0 0x7f7c240cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38802/0 (socket says 172.21.15.7:38802) 2023-10-14T19:12:22.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 -- 172.21.15.7:0/2617765063 learned_addr learned my addr 172.21.15.7:0/2617765063 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:22.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c2259c700 1 --2- 172.21.15.7:0/2617765063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c24159530 0x7f7c240ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 -- 172.21.15.7:0/2617765063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c24159530 msgr2=0x7f7c240ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 --2- 172.21.15.7:0/2617765063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c24159530 0x7f7c240ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.978 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 -- 172.21.15.7:0/2617765063 >> v1:172.21.15.148:6789/0 conn(0x7f7c2406dc70 legacy=0x7f7c24159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 -- 172.21.15.7:0/2617765063 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2415a6b0 con 0x7f7c2406e0e0 2023-10-14T19:12:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c22d9d700 1 --2- 172.21.15.7:0/2617765063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406e0e0 0x7f7c240cb6f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0099b0 tx=0x7f7c1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599bbeb1199b5653 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c2159a700 1 -- 172.21.15.7:0/2617765063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00b820 con 0x7f7c2406e0e0 2023-10-14T19:12:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c2159a700 1 -- 172.21.15.7:0/2617765063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00b980 con 0x7f7c2406e0e0 2023-10-14T19:12:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.975+0000 7f7c2159a700 1 -- 172.21.15.7:0/2617765063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00bd20 con 0x7f7c2406e0e0 2023-10-14T19:12:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 -- 172.21.15.7:0/2617765063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406e0e0 msgr2=0x7f7c240cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/2617765063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406e0e0 0x7f7c240cb6f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0099b0 tx=0x7f7c1c009250 comp rx=0 tx=0).stop 2023-10-14T19:12:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 -- 172.21.15.7:0/2617765063 shutdown_connections 2023-10-14T19:12:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/2617765063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406e0e0 0x7f7c240cb6f0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/2617765063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c24159530 0x7f7c240ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 -- 172.21.15.7:0/2617765063 >> 172.21.15.7:0/2617765063 conn(0x7f7c240703a0 msgr2=0x7f7c240707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 -- 172.21.15.7:0/2617765063 shutdown_connections 2023-10-14T19:12:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.976+0000 7f7c28f9b700 1 -- 172.21.15.7:0/2617765063 wait complete. 2023-10-14T19:12:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.977+0000 7f7c28f9b700 1 Processor -- start 2023-10-14T19:12:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.977+0000 7f7c28f9b700 1 -- start start 2023-10-14T19:12:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c28f9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 0x7f7c24154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c28f9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c2406e0e0 0x7f7c2415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c28f9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c24159530 0x7f7c240b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c28f9b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240b5480 con 0x7f7c2406dc70 2023-10-14T19:12:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c28f9b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240b4870 con 0x7f7c24159530 2023-10-14T19:12:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c28f9b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240b4b50 con 0x7f7c2406e0e0 2023-10-14T19:12:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 0x7f7c24154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 0x7f7c24154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38804/0 (socket says 172.21.15.7:38804) 2023-10-14T19:12:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 -- 172.21.15.7:0/892056701 learned_addr learned my addr 172.21.15.7:0/892056701 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c22d9d700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c24159530 0x7f7c240b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c21d9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c2406e0e0 0x7f7c2415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 -- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c2406e0e0 msgr2=0x7f7c2415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c2406e0e0 0x7f7c2415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 -- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c24159530 msgr2=0x7f7c240b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c24159530 0x7f7c240b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c2259c700 1 -- 172.21.15.7:0/892056701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0094f0 con 0x7f7c2406dc70 2023-10-14T19:12:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.978+0000 7f7c22d9d700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c24159530 0x7f7c240b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.979+0000 7f7c2259c700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 0x7f7c24154320 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f7c14007f60 tx=0x7f7c14009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.979+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400ed80 con 0x7f7c2406dc70 2023-10-14T19:12:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.979+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14014420 con 0x7f7c2406dc70 2023-10-14T19:12:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.979+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c240b4e30 con 0x7f7c2406dc70 2023-10-14T19:12:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.979+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140147e0 con 0x7f7c2406dc70 2023-10-14T19:12:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.979+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c240c8a70 con 0x7f7c2406dc70 2023-10-14T19:12:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.980+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c240b5760 con 0x7f7c2406dc70 2023-10-14T19:12:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.980+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7c14014b50 con 0x7f7c2406dc70 2023-10-14T19:12:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.981+0000 7f7c1a7fc700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7c04067320 0x7f7c040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.981+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c14085420 con 0x7f7c2406dc70 2023-10-14T19:12:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.981+0000 7f7c21d9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7c04067320 0x7f7c040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.981+0000 7f7c21d9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7c04067320 0x7f7c040697d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7c240b0a40 tx=0x7f7c0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:22.985+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c140520b0 con 0x7f7c2406dc70 2023-10-14T19:12:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:23.228+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7c2404c3c0 con 0x7f7c2406dc70 2023-10-14T19:12:24.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.157+0000 7f7c1a7fc700 1 -- 172.21.15.7:0/892056701 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v131) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c140556d0 con 0x7f7c2406dc70 2023-10-14T19:12:24.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7c04067320 msgr2=0x7f7c040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:24.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7c04067320 0x7f7c040697d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7c240b0a40 tx=0x7f7c0c009040 comp rx=0 tx=0).stop 2023-10-14T19:12:24.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 msgr2=0x7f7c24154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:24.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 0x7f7c24154320 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f7c14007f60 tx=0x7f7c14009860 comp rx=0 tx=0).stop 2023-10-14T19:12:24.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 shutdown_connections 2023-10-14T19:12:24.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7c04067320 0x7f7c040697d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c24159530 0x7f7c240b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c2406dc70 0x7f7c24154320 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 --2- 172.21.15.7:0/892056701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c2406e0e0 0x7f7c2415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 >> 172.21.15.7:0/892056701 conn(0x7f7c240703a0 msgr2=0x7f7c240d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:24.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 shutdown_connections 2023-10-14T19:12:24.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.160+0000 7f7c28f9b700 1 -- 172.21.15.7:0/892056701 wait complete. 2023-10-14T19:12:24.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T19:12:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.305+0000 7eff7f59e700 1 Processor -- start 2023-10-14T19:12:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.305+0000 7eff7f59e700 1 -- start start 2023-10-14T19:12:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7f59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff80153a00 0x7eff80153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff8015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7f59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8015af60 con 0x7eff800cea00 2023-10-14T19:12:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7f59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8015d010 con 0x7eff80153a00 2023-10-14T19:12:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8015b240 con 0x7eff8015de50 2023-10-14T19:12:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff80153a00 0x7eff80153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff80153a00 0x7eff80153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38814/0 (socket says 172.21.15.7:38814) 2023-10-14T19:12:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 -- 172.21.15.7:0/1853564289 learned_addr learned my addr 172.21.15.7:0/1853564289 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:24.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7dd9b700 1 --2- 172.21.15.7:0/1853564289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff8015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:24.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 -- 172.21.15.7:0/1853564289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 msgr2=0x7eff8015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:24.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 --2- 172.21.15.7:0/1853564289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff8015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 -- 172.21.15.7:0/1853564289 >> v1:172.21.15.148:6789/0 conn(0x7eff800cea00 legacy=0x7eff800cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:24.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.306+0000 7eff7e59c700 1 -- 172.21.15.7:0/1853564289 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8015b520 con 0x7eff80153a00 2023-10-14T19:12:24.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7e59c700 1 --2- 172.21.15.7:0/1853564289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff80153dd0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7eff780099b0 tx=0x7eff78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de23479843d92fee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:24.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7d59a700 1 -- 172.21.15.7:0/1853564289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800b860 con 0x7eff80153a00 2023-10-14T19:12:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7d59a700 1 -- 172.21.15.7:0/1853564289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800b9c0 con 0x7eff80153a00 2023-10-14T19:12:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7d59a700 1 -- 172.21.15.7:0/1853564289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800bd60 con 0x7eff80153a00 2023-10-14T19:12:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7f59e700 1 -- 172.21.15.7:0/1853564289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 msgr2=0x7eff80153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1853564289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff80153dd0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7eff780099b0 tx=0x7eff78009250 comp rx=0 tx=0).stop 2023-10-14T19:12:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7f59e700 1 -- 172.21.15.7:0/1853564289 shutdown_connections 2023-10-14T19:12:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1853564289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff80153dd0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1853564289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff8015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.307+0000 7eff7f59e700 1 -- 172.21.15.7:0/1853564289 >> 172.21.15.7:0/1853564289 conn(0x7eff800703a0 msgr2=0x7eff800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.308+0000 7eff7f59e700 1 -- 172.21.15.7:0/1853564289 shutdown_connections 2023-10-14T19:12:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.308+0000 7eff7f59e700 1 -- 172.21.15.7:0/1853564289 wait complete. 2023-10-14T19:12:24.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 Processor -- start 2023-10-14T19:12:24.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 -- start start 2023-10-14T19:12:24.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cea00 0x7eff8014a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:24.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff8014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:24.318 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff800cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:24.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800c5ac0 con 0x7eff80153a00 2023-10-14T19:12:24.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800cc7d0 con 0x7eff800cea00 2023-10-14T19:12:24.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7f59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff800cc270 con 0x7eff8015de50 2023-10-14T19:12:24.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff8014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:24.319 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7dd9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff8014f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38820/0 (socket says 172.21.15.7:38820) 2023-10-14T19:12:24.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.309+0000 7eff7dd9b700 1 -- 172.21.15.7:0/1142969647 learned_addr learned my addr 172.21.15.7:0/1142969647 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:24.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7e59c700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cea00 0x7eff8014a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:24.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7ed9d700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff800cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:24.320 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7dd9b700 1 -- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 msgr2=0x7eff800cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:24.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7dd9b700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff800cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7dd9b700 1 -- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cea00 msgr2=0x7eff8014a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:24.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7dd9b700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cea00 0x7eff8014a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:24.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7dd9b700 1 -- 172.21.15.7:0/1142969647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff780094f0 con 0x7eff80153a00 2023-10-14T19:12:24.321 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7ed9d700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff800cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7dd9b700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff8014f350 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7eff6800d860 tx=0x7eff68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680125f0 con 0x7eff80153a00 2023-10-14T19:12:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff68012750 con 0x7eff80153a00 2023-10-14T19:12:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff800cc4f0 con 0x7eff80153a00 2023-10-14T19:12:24.322 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff68012b10 con 0x7eff80153a00 2023-10-14T19:12:24.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.310+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800c5750 con 0x7eff80153a00 2023-10-14T19:12:24.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.311+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800c52d0 con 0x7eff80153a00 2023-10-14T19:12:24.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.311+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff6801e460 con 0x7eff80153a00 2023-10-14T19:12:24.323 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.312+0000 7eff767fc700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff60067320 0x7eff600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.312+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff68085180 con 0x7eff80153a00 2023-10-14T19:12:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.312+0000 7eff7e59c700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff60067320 0x7eff600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.313+0000 7eff7e59c700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff60067320 0x7eff600697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7eff780099b0 tx=0x7eff78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:24.324 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.316+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff800c52d0 con 0x7eff80153a00 2023-10-14T19:12:24.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:24.554+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7eff800c5c70 con 0x7eff80153a00 2023-10-14T19:12:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.158+0000 7eff767fc700 1 -- 172.21.15.7:0/1142969647 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v132) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff800c5c70 con 0x7eff80153a00 2023-10-14T19:12:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff60067320 msgr2=0x7eff600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff60067320 0x7eff600697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7eff780099b0 tx=0x7eff78017000 comp rx=0 tx=0).stop 2023-10-14T19:12:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 msgr2=0x7eff8014f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff8014f350 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7eff6800d860 tx=0x7eff68008040 comp rx=0 tx=0).stop 2023-10-14T19:12:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 shutdown_connections 2023-10-14T19:12:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7eff60067320 0x7eff600697d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff800cea00 0x7eff8014a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff8015de50 0x7eff800cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 --2- 172.21.15.7:0/1142969647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80153a00 0x7eff8014f350 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 >> 172.21.15.7:0/1142969647 conn(0x7eff800703a0 msgr2=0x7eff80158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 shutdown_connections 2023-10-14T19:12:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.160+0000 7eff7f59e700 1 -- 172.21.15.7:0/1142969647 wait complete. 2023-10-14T19:12:25.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:25.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.297+0000 7f3b990c0700 1 Processor -- start 2023-10-14T19:12:25.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.297+0000 7f3b990c0700 1 -- start start 2023-10-14T19:12:25.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b990c0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b9415cb50 0x7f3b940b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b990c0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b940b0710 0x7f3b941536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b990c0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9415ad50 con 0x7f3b9415cf20 2023-10-14T19:12:25.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b990c0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9415a140 con 0x7f3b940b0710 2023-10-14T19:12:25.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b990c0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9415a420 con 0x7f3b9415cb50 2023-10-14T19:12:25.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b9359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b940b0710 0x7f3b941536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b9359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b940b0710 0x7f3b941536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38824/0 (socket says 172.21.15.7:38824) 2023-10-14T19:12:25.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b9359e700 1 -- 172.21.15.7:0/1399663372 learned_addr learned my addr 172.21.15.7:0/1399663372 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.298+0000 7f3b92d9d700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b9415cb50 0x7f3b940b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b9359e700 1 -- 172.21.15.7:0/1399663372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b9415cb50 msgr2=0x7f3b940b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b9359e700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b9415cb50 0x7f3b940b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b9359e700 1 -- 172.21.15.7:0/1399663372 >> v1:172.21.15.148:6789/0 conn(0x7f3b9415cf20 legacy=0x7f3b940b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b9359e700 1 -- 172.21.15.7:0/1399663372 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9415a700 con 0x7f3b940b0710 2023-10-14T19:12:25.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b92d9d700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b9415cb50 0x7f3b940b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:25.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b9359e700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b940b0710 0x7f3b941536c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009f20 tx=0x7f3b8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750a39c81087cc1c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:25.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b91d9b700 1 -- 172.21.15.7:0/1399663372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00e070 con 0x7f3b940b0710 2023-10-14T19:12:25.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b91d9b700 1 -- 172.21.15.7:0/1399663372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c00ba80 con 0x7f3b940b0710 2023-10-14T19:12:25.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b91d9b700 1 -- 172.21.15.7:0/1399663372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0092e0 con 0x7f3b940b0710 2023-10-14T19:12:25.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b990c0700 1 -- 172.21.15.7:0/1399663372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b940b0710 msgr2=0x7f3b941536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b940b0710 0x7f3b941536c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009f20 tx=0x7f3b8c009840 comp rx=0 tx=0).stop 2023-10-14T19:12:25.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b990c0700 1 -- 172.21.15.7:0/1399663372 shutdown_connections 2023-10-14T19:12:25.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b940b0710 0x7f3b941536c0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.299+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1399663372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b9415cb50 0x7f3b940b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.300+0000 7f3b990c0700 1 -- 172.21.15.7:0/1399663372 >> 172.21.15.7:0/1399663372 conn(0x7f3b940cded0 msgr2=0x7f3b9406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:25.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.300+0000 7f3b990c0700 1 -- 172.21.15.7:0/1399663372 shutdown_connections 2023-10-14T19:12:25.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.300+0000 7f3b990c0700 1 -- 172.21.15.7:0/1399663372 wait complete. 2023-10-14T19:12:25.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 Processor -- start 2023-10-14T19:12:25.307 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 -- start start 2023-10-14T19:12:25.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b940b0710 0x7f3b9415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b9415cb50 0x7f3b940c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 0x7f3b94145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94160250 con 0x7f3b9415cf20 2023-10-14T19:12:25.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94145690 con 0x7f3b9415cb50 2023-10-14T19:12:25.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.301+0000 7f3b990c0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940c2e70 con 0x7f3b940b0710 2023-10-14T19:12:25.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 0x7f3b94145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 0x7f3b94145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38830/0 (socket says 172.21.15.7:38830) 2023-10-14T19:12:25.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 -- 172.21.15.7:0/1306944445 learned_addr learned my addr 172.21.15.7:0/1306944445 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:25.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b92d9d700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b940b0710 0x7f3b9415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9259c700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b9415cb50 0x7f3b940c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 -- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b940b0710 msgr2=0x7f3b9415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b940b0710 0x7f3b9415f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 -- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b9415cb50 msgr2=0x7f3b940c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b9415cb50 0x7f3b940c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 -- 172.21.15.7:0/1306944445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c009ae0 con 0x7f3b9415cf20 2023-10-14T19:12:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b9359e700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 0x7f3b94145150 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00b6c0 tx=0x7f3b8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:25.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0032f0 con 0x7f3b9415cf20 2023-10-14T19:12:25.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c008d10 con 0x7f3b9415cf20 2023-10-14T19:12:25.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9415f9b0 con 0x7f3b9415cf20 2023-10-14T19:12:25.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c026690 con 0x7f3b9415cf20 2023-10-14T19:12:25.313 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.302+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9415ff70 con 0x7f3b9415cf20 2023-10-14T19:12:25.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.303+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b940ac9c0 con 0x7f3b9415cf20 2023-10-14T19:12:25.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.304+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3b8c003040 con 0x7f3b9415cf20 2023-10-14T19:12:25.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.304+0000 7f3b7affd700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b80067320 0x7f3b800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.304+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b8c086bd0 con 0x7f3b9415cf20 2023-10-14T19:12:25.314 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.304+0000 7f3b92d9d700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b80067320 0x7f3b800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.305+0000 7f3b92d9d700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b80067320 0x7f3b800697d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3b84006f00 tx=0x7f3b84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:25.315 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.309+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b8c053750 con 0x7f3b9415cf20 2023-10-14T19:12:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.543+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b9404c3c0 con 0x7f3b9415cf20 2023-10-14T19:12:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.544+0000 7f3b7affd700 1 -- 172.21.15.7:0/1306944445 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f3b8c056d70 con 0x7f3b9415cf20 2023-10-14T19:12:25.544 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:25.545 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":132,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:12:21.531996+0000","modified":"2023-10-14T19:12:25.155754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9078":{"gid":9078,"name":"a","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/1294066545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1294066545},{"type":"v1","addr":"172.21.15.7:6835","nonce":1294066545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-14T19:12:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b80067320 msgr2=0x7f3b800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b80067320 0x7f3b800697d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3b84006f00 tx=0x7f3b84008040 comp rx=0 tx=0).stop 2023-10-14T19:12:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 msgr2=0x7f3b94145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 0x7f3b94145150 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00b6c0 tx=0x7f3b8c018000 comp rx=0 tx=0).stop 2023-10-14T19:12:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 shutdown_connections 2023-10-14T19:12:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3b80067320 0x7f3b800697d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9415cf20 0x7f3b94145150 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b940b0710 0x7f3b9415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 --2- 172.21.15.7:0/1306944445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b9415cb50 0x7f3b940c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 >> 172.21.15.7:0/1306944445 conn(0x7f3b940cded0 msgr2=0x7f3b940aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 shutdown_connections 2023-10-14T19:12:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.546+0000 7f3b990c0700 1 -- 172.21.15.7:0/1306944445 wait complete. 2023-10-14T19:12:25.549 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 132 2023-10-14T19:12:25.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:12:25.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.677+0000 7f12fb59e700 1 Processor -- start 2023-10-14T19:12:25.678 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.677+0000 7f12fb59e700 1 -- start start 2023-10-14T19:12:25.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fb59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc153c30 0x7f12fc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fb59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f12fc0cf110 0x7f12fc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fb59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc15afd0 con 0x7f12fc15de50 2023-10-14T19:12:25.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fb59e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc15b2b0 con 0x7f12fc0cf110 2023-10-14T19:12:25.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fb59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc15b590 con 0x7f12fc153c30 2023-10-14T19:12:25.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fad9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f12fc0cf110 0x7f12fc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12f9d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f12fc15de50 0x7f12fc0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40736/0 (socket says 172.21.15.7:40736) 2023-10-14T19:12:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12f9d9b700 1 -- 172.21.15.7:0/1903050175 learned_addr learned my addr 172.21.15.7:0/1903050175 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fa59c700 1 --2- 172.21.15.7:0/1903050175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc153c30 0x7f12fc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fad9d700 1 -- 172.21.15.7:0/1903050175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc153c30 msgr2=0x7f12fc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fad9d700 1 --2- 172.21.15.7:0/1903050175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc153c30 0x7f12fc15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fad9d700 1 -- 172.21.15.7:0/1903050175 >> v1:172.21.15.7:6789/0 conn(0x7f12fc15de50 legacy=0x7f12fc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.678+0000 7f12fad9d700 1 -- 172.21.15.7:0/1903050175 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc15b870 con 0x7f12fc0cf110 2023-10-14T19:12:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fad9d700 1 --2- 172.21.15.7:0/1903050175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc0cf110 0x7f12fc15c070 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e60 tx=0x7f12f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703a49f044b12c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12f959a700 1 -- 172.21.15.7:0/1903050175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400e070 con 0x7f12fc0cf110 2023-10-14T19:12:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12f959a700 1 -- 172.21.15.7:0/1903050175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f400bb60 con 0x7f12fc0cf110 2023-10-14T19:12:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12f959a700 1 -- 172.21.15.7:0/1903050175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4012430 con 0x7f12fc0cf110 2023-10-14T19:12:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 -- 172.21.15.7:0/1903050175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc0cf110 msgr2=0x7f12fc15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1903050175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc0cf110 0x7f12fc15c070 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e60 tx=0x7f12f4009780 comp rx=0 tx=0).stop 2023-10-14T19:12:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 -- 172.21.15.7:0/1903050175 shutdown_connections 2023-10-14T19:12:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1903050175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc0cf110 0x7f12fc15c070 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1903050175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc153c30 0x7f12fc15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 -- 172.21.15.7:0/1903050175 >> 172.21.15.7:0/1903050175 conn(0x7f12fc0703a0 msgr2=0x7f12fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 -- 172.21.15.7:0/1903050175 shutdown_connections 2023-10-14T19:12:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.679+0000 7f12fb59e700 1 -- 172.21.15.7:0/1903050175 wait complete. 2023-10-14T19:12:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.680+0000 7f12fb59e700 1 Processor -- start 2023-10-14T19:12:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.680+0000 7f12fb59e700 1 -- start start 2023-10-14T19:12:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fb59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc0cf110 0x7f12fc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fb59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12fc153c30 0x7f12fc169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fb59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 0x7f12fc153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fb59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b3ca0 con 0x7f12fc15de50 2023-10-14T19:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fb59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b41d0 con 0x7f12fc153c30 2023-10-14T19:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fb59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b3ef0 con 0x7f12fc0cf110 2023-10-14T19:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 0x7f12fc153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 0x7f12fc153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38858/0 (socket says 172.21.15.7:38858) 2023-10-14T19:12:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.681+0000 7f12fad9d700 1 -- 172.21.15.7:0/1495473502 learned_addr learned my addr 172.21.15.7:0/1495473502 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fa59c700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc0cf110 0x7f12fc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12f9d9b700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12fc153c30 0x7f12fc169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fad9d700 1 -- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc0cf110 msgr2=0x7f12fc0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fad9d700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc0cf110 0x7f12fc0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fad9d700 1 -- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12fc153c30 msgr2=0x7f12fc169670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fad9d700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12fc153c30 0x7f12fc169670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fad9d700 1 -- 172.21.15.7:0/1495473502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009a20 con 0x7f12fc15de50 2023-10-14T19:12:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fa59c700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc0cf110 0x7f12fc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12f9d9b700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12fc153c30 0x7f12fc169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fad9d700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 0x7f12fc153080 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f12fc06eb00 tx=0x7f12f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4027470 con 0x7f12fc15de50 2023-10-14T19:12:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f40275f0 con 0x7f12fc15de50 2023-10-14T19:12:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc0c8b60 con 0x7f12fc15de50 2023-10-14T19:12:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40279b0 con 0x7f12fc15de50 2023-10-14T19:12:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.682+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc0c9120 con 0x7f12fc15de50 2023-10-14T19:12:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.683+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc04c3c0 con 0x7f12fc15de50 2023-10-14T19:12:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.683+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f12f4024070 con 0x7f12fc15de50 2023-10-14T19:12:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.684+0000 7f12ea7fc700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12dc067320 0x7f12dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.684+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12f4087690 con 0x7f12fc15de50 2023-10-14T19:12:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.684+0000 7f12fa59c700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12dc067320 0x7f12dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.684+0000 7f12fa59c700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12dc067320 0x7f12dc0697d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006f00 tx=0x7f12ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.688+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12f4054320 con 0x7f12fc15de50 2023-10-14T19:12:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.881+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12fc15bb50 con 0x7f12fc15de50 2023-10-14T19:12:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.882+0000 7f12ea7fc700 1 -- 172.21.15.7:0/1495473502 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f12f4057940 con 0x7f12fc15de50 2023-10-14T19:12:25.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:25.884 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":200,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:12:22.867597+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:12:19.972804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-14T19:12:20.504006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:12:25.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12dc067320 msgr2=0x7f12dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12dc067320 0x7f12dc0697d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006f00 tx=0x7f12ec008040 comp rx=0 tx=0).stop 2023-10-14T19:12:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 msgr2=0x7f12fc153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:25.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 0x7f12fc153080 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f12fc06eb00 tx=0x7f12f4019000 comp rx=0 tx=0).stop 2023-10-14T19:12:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 shutdown_connections 2023-10-14T19:12:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f12dc067320 0x7f12dc0697d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12fc15de50 0x7f12fc153080 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12fc0cf110 0x7f12fc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 --2- 172.21.15.7:0/1495473502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12fc153c30 0x7f12fc169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 >> 172.21.15.7:0/1495473502 conn(0x7f12fc0703a0 msgr2=0x7f12fc0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:25.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 shutdown_connections 2023-10-14T19:12:25.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:25.885+0000 7f12fb59e700 1 -- 172.21.15.7:0/1495473502 wait complete. 2023-10-14T19:12:25.898 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T19:12:25.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:12:26.017 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.017+0000 7fcac4634700 1 Processor -- start 2023-10-14T19:12:26.018 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.017+0000 7fcac4634700 1 -- start start 2023-10-14T19:12:26.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.017+0000 7fcac4634700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcabc0cb5a0 0x7fcabc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac4634700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc15ae40 con 0x7fcabc15a5d0 2023-10-14T19:12:26.020 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac4634700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc15ab60 con 0x7fcabc0cd9e0 2023-10-14T19:12:26.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac4634700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc0d13f0 con 0x7fcabc0cb5a0 2023-10-14T19:12:26.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac2bd1700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcabc15a5d0 0x7fcabc156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40742/0 (socket says 172.21.15.7:40742) 2023-10-14T19:12:26.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac2bd1700 1 -- 172.21.15.7:0/2126682558 learned_addr learned my addr 172.21.15.7:0/2126682558 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:26.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac23d0700 1 --2- 172.21.15.7:0/2126682558 >> v2:172.21.15.148:3300/0 conn(0x7fcabc0cb5a0 0x7fcabc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.021 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac13ce700 1 -- 172.21.15.7:0/2126682558 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379794542 0 0) 0x7fcabc15ae40 con 0x7fcabc15a5d0 2023-10-14T19:12:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac13ce700 1 -- 172.21.15.7:0/2126682558 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaa4003570 con 0x7fcabc15a5d0 2023-10-14T19:12:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac23d0700 1 -- 172.21.15.7:0/2126682558 >> v1:172.21.15.148:6789/0 conn(0x7fcabc0cd9e0 legacy=0x7fcabc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac23d0700 1 -- 172.21.15.7:0/2126682558 >> v1:172.21.15.7:6789/0 conn(0x7fcabc15a5d0 legacy=0x7fcabc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac23d0700 1 -- 172.21.15.7:0/2126682558 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0ccf00 con 0x7fcabc0cb5a0 2023-10-14T19:12:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac23d0700 1 --2- 172.21.15.7:0/2126682558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0cb970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009910 tx=0x7fcab40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d609915ec42e225 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.018+0000 7fcac13ce700 1 -- 172.21.15.7:0/2126682558 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab400b640 con 0x7fcabc0cb5a0 2023-10-14T19:12:26.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac13ce700 1 -- 172.21.15.7:0/2126682558 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab400b7a0 con 0x7fcabc0cb5a0 2023-10-14T19:12:26.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac13ce700 1 -- 172.21.15.7:0/2126682558 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab400bb60 con 0x7fcabc0cb5a0 2023-10-14T19:12:26.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 -- 172.21.15.7:0/2126682558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 msgr2=0x7fcabc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.023 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 --2- 172.21.15.7:0/2126682558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0cb970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009910 tx=0x7fcab40091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 -- 172.21.15.7:0/2126682558 shutdown_connections 2023-10-14T19:12:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 --2- 172.21.15.7:0/2126682558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0cb970 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 -- 172.21.15.7:0/2126682558 >> 172.21.15.7:0/2126682558 conn(0x7fcabc070e30 msgr2=0x7fcabc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 -- 172.21.15.7:0/2126682558 shutdown_connections 2023-10-14T19:12:26.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.019+0000 7fcac4634700 1 -- 172.21.15.7:0/2126682558 wait complete. 2023-10-14T19:12:26.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.020+0000 7fcac4634700 1 Processor -- start 2023-10-14T19:12:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.020+0000 7fcac4634700 1 -- start start 2023-10-14T19:12:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac4634700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac4634700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcabc0cd9e0 0x7fcabc0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac4634700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 0x7fcabc150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac4634700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0c8f10 con 0x7fcabc15a5d0 2023-10-14T19:12:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac4634700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0b4720 con 0x7fcabc0cb5a0 2023-10-14T19:12:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac4634700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0ca140 con 0x7fcabc0cd9e0 2023-10-14T19:12:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 0x7fcabc150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 0x7fcabc150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38862/0 (socket says 172.21.15.7:38862) 2023-10-14T19:12:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 -- 172.21.15.7:0/4006502115 learned_addr learned my addr 172.21.15.7:0/4006502115 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac23d0700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac1bcf700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcabc0cd9e0 0x7fcabc0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 -- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcabc0cd9e0 msgr2=0x7fcabc0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcabc0cd9e0 0x7fcabc0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 -- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 msgr2=0x7fcabc0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 -- 172.21.15.7:0/4006502115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4009420 con 0x7fcabc15a5d0 2023-10-14T19:12:26.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac23d0700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.021+0000 7fcac2bd1700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 0x7fcabc150000 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fcaac001460 tx=0x7fcaac001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.022+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00a950 con 0x7fcabc15a5d0 2023-10-14T19:12:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.022+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac00aab0 con 0x7fcabc15a5d0 2023-10-14T19:12:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.022+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcabc0c9120 con 0x7fcabc15a5d0 2023-10-14T19:12:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.022+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00ae30 con 0x7fcabc15a5d0 2023-10-14T19:12:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.022+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc0c96e0 con 0x7fcabc15a5d0 2023-10-14T19:12:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.022+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcabc0b44a0 con 0x7fcabc15a5d0 2023-10-14T19:12:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.023+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcaac007300 con 0x7fcabc15a5d0 2023-10-14T19:12:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.023+0000 7fcaba7fc700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaa8067320 0x7fcaa80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.023+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcaac0850e0 con 0x7fcabc15a5d0 2023-10-14T19:12:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.024+0000 7fcac23d0700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaa8067320 0x7fcaa80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.024+0000 7fcac23d0700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaa8067320 0x7fcaa80697d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcab40093f0 tx=0x7fcab4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.028+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaac051d70 con 0x7fcabc15a5d0 2023-10-14T19:12:26.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.218+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcabc0cd1e0 con 0x7fcaa8067320 2023-10-14T19:12:26.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.227+0000 7fcaba7fc700 1 -- 172.21.15.7:0/4006502115 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289884 (secure 0 0 0) 0x7fcabc0cd1e0 con 0x7fcaa8067320 2023-10-14T19:12:26.231 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaa8067320 msgr2=0x7fcaa80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaa8067320 0x7fcaa80697d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcab40093f0 tx=0x7fcab4017000 comp rx=0 tx=0).stop 2023-10-14T19:12:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 msgr2=0x7fcabc150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 0x7fcabc150000 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fcaac001460 tx=0x7fcaac001a40 comp rx=0 tx=0).stop 2023-10-14T19:12:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 shutdown_connections 2023-10-14T19:12:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcaa8067320 0x7fcaa80697d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcabc0cb5a0 0x7fcabc0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcabc15a5d0 0x7fcabc150000 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 --2- 172.21.15.7:0/4006502115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcabc0cd9e0 0x7fcabc0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 >> 172.21.15.7:0/4006502115 conn(0x7fcabc070e30 msgr2=0x7fcabc0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:26.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 shutdown_connections 2023-10-14T19:12:26.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.230+0000 7fcac4634700 1 -- 172.21.15.7:0/4006502115 wait complete. 2023-10-14T19:12:26.236 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:12:26.243 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2023-10-14T19:12:25.755163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440216,"kb_used_data":20952,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534504,"statfs":{"total":773094113280,"available":770595332096,"internally_reserved":0,"allocated":21454848,"data_stored":10281610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.634572"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884407+0000","last_change":"2023-10-14T19:12:21.884407+0000","last_active":"2023-10-14T19:12:21.884407+0000","last_peered":"2023-10-14T19:12:21.884407+0000","last_clean":"2023-10-14T19:12:21.884407+0000","last_became_active":"2023-10-14T19:12:21.884099+0000","last_became_peered":"2023-10-14T19:12:21.884099+0000","last_unstale":"2023-10-14T19:12:21.884407+0000","last_undegraded":"2023-10-14T19:12:21.884407+0000","last_fullsized":"2023-10-14T19:12:21.884407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:39.710050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884052+0000","last_change":"2023-10-14T19:12:21.884052+0000","last_active":"2023-10-14T19:12:21.884052+0000","last_peered":"2023-10-14T19:12:21.884052+0000","last_clean":"2023-10-14T19:12:21.884052+0000","last_became_active":"2023-10-14T19:12:21.883777+0000","last_became_peered":"2023-10-14T19:12:21.883777+0000","last_unstale":"2023-10-14T19:12:21.884052+0000","last_undegraded":"2023-10-14T19:12:21.884052+0000","last_fullsized":"2023-10-14T19:12:21.884052+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:03.393890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884745+0000","last_change":"2023-10-14T19:12:21.884745+0000","last_active":"2023-10-14T19:12:21.884745+0000","last_peered":"2023-10-14T19:12:21.884745+0000","last_clean":"2023-10-14T19:12:21.884745+0000","last_became_active":"2023-10-14T19:12:21.884357+0000","last_became_peered":"2023-10-14T19:12:21.884357+0000","last_unstale":"2023-10-14T19:12:21.884745+0000","last_undegraded":"2023-10-14T19:12:21.884745+0000","last_fullsized":"2023-10-14T19:12:21.884745+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:38.137080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888927+0000","last_change":"2023-10-14T19:12:21.888927+0000","last_active":"2023-10-14T19:12:21.888927+0000","last_peered":"2023-10-14T19:12:21.888927+0000","last_clean":"2023-10-14T19:12:21.888927+0000","last_became_active":"2023-10-14T19:12:21.888647+0000","last_became_peered":"2023-10-14T19:12:21.888647+0000","last_unstale":"2023-10-14T19:12:21.888927+0000","last_undegraded":"2023-10-14T19:12:21.888927+0000","last_fullsized":"2023-10-14T19:12:21.888927+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:24.433495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888258+0000","last_change":"2023-10-14T19:12:21.888258+0000","last_active":"2023-10-14T19:12:21.888258+0000","last_peered":"2023-10-14T19:12:21.888258+0000","last_clean":"2023-10-14T19:12:21.888258+0000","last_became_active":"2023-10-14T19:12:21.888018+0000","last_became_peered":"2023-10-14T19:12:21.888018+0000","last_unstale":"2023-10-14T19:12:21.888258+0000","last_undegraded":"2023-10-14T19:12:21.888258+0000","last_fullsized":"2023-10-14T19:12:21.888258+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:57:37.935733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.887885+0000","last_change":"2023-10-14T19:12:21.887885+0000","last_active":"2023-10-14T19:12:21.887885+0000","last_peered":"2023-10-14T19:12:21.887885+0000","last_clean":"2023-10-14T19:12:21.887885+0000","last_became_active":"2023-10-14T19:12:21.887616+0000","last_became_peered":"2023-10-14T19:12:21.887616+0000","last_unstale":"2023-10-14T19:12:21.887885+0000","last_undegraded":"2023-10-14T19:12:21.887885+0000","last_fullsized":"2023-10-14T19:12:21.887885+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:28.094228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.886680+0000","last_change":"2023-10-14T19:12:21.886680+0000","last_active":"2023-10-14T19:12:21.886680+0000","last_peered":"2023-10-14T19:12:21.886680+0000","last_clean":"2023-10-14T19:12:21.886680+0000","last_became_active":"2023-10-14T19:12:21.886129+0000","last_became_peered":"2023-10-14T19:12:21.886129+0000","last_unstale":"2023-10-14T19:12:21.886680+0000","last_undegraded":"2023-10-14T19:12:21.886680+0000","last_fullsized":"2023-10-14T19:12:21.886680+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:34.883239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.887010+0000","last_change":"2023-10-14T19:12:21.887010+0000","last_active":"2023-10-14T19:12:21.887010+0000","last_peered":"2023-10-14T19:12:21.887010+0000","last_clean":"2023-10-14T19:12:21.887010+0000","last_became_active":"2023-10-14T19:12:21.884314+0000","last_became_peered":"2023-10-14T19:12:21.884314+0000","last_unstale":"2023-10-14T19:12:21.887010+0000","last_undegraded":"2023-10-14T19:12:21.887010+0000","last_fullsized":"2023-10-14T19:12:21.887010+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:46.764224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.890109+0000","last_change":"2023-10-14T19:12:21.890109+0000","last_active":"2023-10-14T19:12:21.890109+0000","last_peered":"2023-10-14T19:12:21.890109+0000","last_clean":"2023-10-14T19:12:21.890109+0000","last_became_active":"2023-10-14T19:12:21.889694+0000","last_became_peered":"2023-10-14T19:12:21.889694+0000","last_unstale":"2023-10-14T19:12:21.890109+0000","last_undegraded":"2023-10-14T19:12:21.890109+0000","last_fullsized":"2023-10-14T19:12:21.890109+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:45.284681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879490+0000","last_change":"2023-10-14T19:12:21.879490+0000","last_active":"2023-10-14T19:12:21.879490+0000","last_peered":"2023-10-14T19:12:21.879490+0000","last_clean":"2023-10-14T19:12:21.879490+0000","last_became_active":"2023-10-14T19:12:21.879189+0000","last_became_peered":"2023-10-14T19:12:21.879189+0000","last_unstale":"2023-10-14T19:12:21.879490+0000","last_undegraded":"2023-10-14T19:12:21.879490+0000","last_fullsized":"2023-10-14T19:12:21.879490+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:56:46.750320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.886037+0000","last_change":"2023-10-14T19:12:21.886037+0000","last_active":"2023-10-14T19:12:21.886037+0000","last_peered":"2023-10-14T19:12:21.886037+0000","last_clean":"2023-10-14T19:12:21.886037+0000","last_became_active":"2023-10-14T19:12:21.885760+0000","last_became_peered":"2023-10-14T19:12:21.885760+0000","last_unstale":"2023-10-14T19:12:21.886037+0000","last_undegraded":"2023-10-14T19:12:21.886037+0000","last_fullsized":"2023-10-14T19:12:21.886037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:17.934767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.890767+0000","last_change":"2023-10-14T19:12:21.890767+0000","last_active":"2023-10-14T19:12:21.890767+0000","last_peered":"2023-10-14T19:12:21.890767+0000","last_clean":"2023-10-14T19:12:21.890767+0000","last_became_active":"2023-10-14T19:12:21.890475+0000","last_became_peered":"2023-10-14T19:12:21.890475+0000","last_unstale":"2023-10-14T19:12:21.890767+0000","last_undegraded":"2023-10-14T19:12:21.890767+0000","last_fullsized":"2023-10-14T19:12:21.890767+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:00.689801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.887780+0000","last_change":"2023-10-14T19:12:21.887780+0000","last_active":"2023-10-14T19:12:21.887780+0000","last_peered":"2023-10-14T19:12:21.887780+0000","last_clean":"2023-10-14T19:12:21.887780+0000","last_became_active":"2023-10-14T19:12:21.887514+0000","last_became_peered":"2023-10-14T19:12:21.887514+0000","last_unstale":"2023-10-14T19:12:21.887780+0000","last_undegraded":"2023-10-14T19:12:21.887780+0000","last_fullsized":"2023-10-14T19:12:21.887780+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:08.792066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885258+0000","last_change":"2023-10-14T19:12:21.885258+0000","last_active":"2023-10-14T19:12:21.885258+0000","last_peered":"2023-10-14T19:12:21.885258+0000","last_clean":"2023-10-14T19:12:21.885258+0000","last_became_active":"2023-10-14T19:12:21.884843+0000","last_became_peered":"2023-10-14T19:12:21.884843+0000","last_unstale":"2023-10-14T19:12:21.885258+0000","last_undegraded":"2023-10-14T19:12:21.885258+0000","last_fullsized":"2023-10-14T19:12:21.885258+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:46.607115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888098+0000","last_change":"2023-10-14T19:12:21.888098+0000","last_active":"2023-10-14T19:12:21.888098+0000","last_peered":"2023-10-14T19:12:21.888098+0000","last_clean":"2023-10-14T19:12:21.888098+0000","last_became_active":"2023-10-14T19:12:21.887838+0000","last_became_peered":"2023-10-14T19:12:21.887838+0000","last_unstale":"2023-10-14T19:12:21.888098+0000","last_undegraded":"2023-10-14T19:12:21.888098+0000","last_fullsized":"2023-10-14T19:12:21.888098+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:46.764224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884579+0000","last_change":"2023-10-14T19:12:21.884579+0000","last_active":"2023-10-14T19:12:21.884579+0000","last_peered":"2023-10-14T19:12:21.884579+0000","last_clean":"2023-10-14T19:12:21.884579+0000","last_became_active":"2023-10-14T19:12:21.883312+0000","last_became_peered":"2023-10-14T19:12:21.883312+0000","last_unstale":"2023-10-14T19:12:21.884579+0000","last_undegraded":"2023-10-14T19:12:21.884579+0000","last_fullsized":"2023-10-14T19:12:21.884579+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:12:30.710049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882812+0000","last_change":"2023-10-14T19:12:21.882812+0000","last_active":"2023-10-14T19:12:21.882812+0000","last_peered":"2023-10-14T19:12:21.882812+0000","last_clean":"2023-10-14T19:12:21.882812+0000","last_became_active":"2023-10-14T19:12:21.882031+0000","last_became_peered":"2023-10-14T19:12:21.882031+0000","last_unstale":"2023-10-14T19:12:21.882812+0000","last_undegraded":"2023-10-14T19:12:21.882812+0000","last_fullsized":"2023-10-14T19:12:21.882812+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:19.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.873949+0000","last_change":"2023-10-14T19:12:21.873949+0000","last_active":"2023-10-14T19:12:21.873949+0000","last_peered":"2023-10-14T19:12:21.873949+0000","last_clean":"2023-10-14T19:12:21.873949+0000","last_became_active":"2023-10-14T19:12:21.873750+0000","last_became_peered":"2023-10-14T19:12:21.873750+0000","last_unstale":"2023-10-14T19:12:21.873949+0000","last_undegraded":"2023-10-14T19:12:21.873949+0000","last_fullsized":"2023-10-14T19:12:21.873949+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:26.018854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880219+0000","last_change":"2023-10-14T19:12:21.880219+0000","last_active":"2023-10-14T19:12:21.880219+0000","last_peered":"2023-10-14T19:12:21.880219+0000","last_clean":"2023-10-14T19:12:21.880219+0000","last_became_active":"2023-10-14T19:12:21.879924+0000","last_became_peered":"2023-10-14T19:12:21.879924+0000","last_unstale":"2023-10-14T19:12:21.880219+0000","last_undegraded":"2023-10-14T19:12:21.880219+0000","last_fullsized":"2023-10-14T19:12:21.880219+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:55.517559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888180+0000","last_change":"2023-10-14T19:12:21.888180+0000","last_active":"2023-10-14T19:12:21.888180+0000","last_peered":"2023-10-14T19:12:21.888180+0000","last_clean":"2023-10-14T19:12:21.888180+0000","last_became_active":"2023-10-14T19:12:21.887661+0000","last_became_peered":"2023-10-14T19:12:21.887661+0000","last_unstale":"2023-10-14T19:12:21.888180+0000","last_undegraded":"2023-10-14T19:12:21.888180+0000","last_fullsized":"2023-10-14T19:12:21.888180+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:01.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.886504+0000","last_change":"2023-10-14T19:12:21.886504+0000","last_active":"2023-10-14T19:12:21.886504+0000","last_peered":"2023-10-14T19:12:21.886504+0000","last_clean":"2023-10-14T19:12:21.886504+0000","last_became_active":"2023-10-14T19:12:21.886227+0000","last_became_peered":"2023-10-14T19:12:21.886227+0000","last_unstale":"2023-10-14T19:12:21.886504+0000","last_undegraded":"2023-10-14T19:12:21.886504+0000","last_fullsized":"2023-10-14T19:12:21.886504+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:46:40.935674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882981+0000","last_change":"2023-10-14T19:12:21.882981+0000","last_active":"2023-10-14T19:12:21.882981+0000","last_peered":"2023-10-14T19:12:21.882981+0000","last_clean":"2023-10-14T19:12:21.882981+0000","last_became_active":"2023-10-14T19:12:21.882680+0000","last_became_peered":"2023-10-14T19:12:21.882680+0000","last_unstale":"2023-10-14T19:12:21.882981+0000","last_undegraded":"2023-10-14T19:12:21.882981+0000","last_fullsized":"2023-10-14T19:12:21.882981+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:51.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888634+0000","last_change":"2023-10-14T19:12:21.888634+0000","last_active":"2023-10-14T19:12:21.888634+0000","last_peered":"2023-10-14T19:12:21.888634+0000","last_clean":"2023-10-14T19:12:21.888634+0000","last_became_active":"2023-10-14T19:12:21.888291+0000","last_became_peered":"2023-10-14T19:12:21.888291+0000","last_unstale":"2023-10-14T19:12:21.888634+0000","last_undegraded":"2023-10-14T19:12:21.888634+0000","last_fullsized":"2023-10-14T19:12:21.888634+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:11:36.390674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.878772+0000","last_change":"2023-10-14T19:12:21.878772+0000","last_active":"2023-10-14T19:12:21.878772+0000","last_peered":"2023-10-14T19:12:21.878772+0000","last_clean":"2023-10-14T19:12:21.878772+0000","last_became_active":"2023-10-14T19:12:21.878263+0000","last_became_peered":"2023-10-14T19:12:21.878263+0000","last_unstale":"2023-10-14T19:12:21.878772+0000","last_undegraded":"2023-10-14T19:12:21.878772+0000","last_fullsized":"2023-10-14T19:12:21.878772+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:15:18.569111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888477+0000","last_change":"2023-10-14T19:12:21.888477+0000","last_active":"2023-10-14T19:12:21.888477+0000","last_peered":"2023-10-14T19:12:21.888477+0000","last_clean":"2023-10-14T19:12:21.888477+0000","last_became_active":"2023-10-14T19:12:21.887856+0000","last_became_peered":"2023-10-14T19:12:21.887856+0000","last_unstale":"2023-10-14T19:12:21.888477+0000","last_undegraded":"2023-10-14T19:12:21.888477+0000","last_fullsized":"2023-10-14T19:12:21.888477+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:47:16.653228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879707+0000","last_change":"2023-10-14T19:12:21.879707+0000","last_active":"2023-10-14T19:12:21.879707+0000","last_peered":"2023-10-14T19:12:21.879707+0000","last_clean":"2023-10-14T19:12:21.879707+0000","last_became_active":"2023-10-14T19:12:21.879415+0000","last_became_peered":"2023-10-14T19:12:21.879415+0000","last_unstale":"2023-10-14T19:12:21.879707+0000","last_undegraded":"2023-10-14T19:12:21.879707+0000","last_fullsized":"2023-10-14T19:12:21.879707+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:08.543820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880283+0000","last_change":"2023-10-14T19:12:21.880283+0000","last_active":"2023-10-14T19:12:21.880283+0000","last_peered":"2023-10-14T19:12:21.880283+0000","last_clean":"2023-10-14T19:12:21.880283+0000","last_became_active":"2023-10-14T19:12:21.879988+0000","last_became_peered":"2023-10-14T19:12:21.879988+0000","last_unstale":"2023-10-14T19:12:21.880283+0000","last_undegraded":"2023-10-14T19:12:21.880283+0000","last_fullsized":"2023-10-14T19:12:21.880283+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:25.321798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.877660+0000","last_change":"2023-10-14T19:12:21.877660+0000","last_active":"2023-10-14T19:12:21.877660+0000","last_peered":"2023-10-14T19:12:21.877660+0000","last_clean":"2023-10-14T19:12:21.877660+0000","last_became_active":"2023-10-14T19:12:21.877366+0000","last_became_peered":"2023-10-14T19:12:21.877366+0000","last_unstale":"2023-10-14T19:12:21.877660+0000","last_undegraded":"2023-10-14T19:12:21.877660+0000","last_fullsized":"2023-10-14T19:12:21.877660+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:24.003051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888368+0000","last_change":"2023-10-14T19:12:21.888368+0000","last_active":"2023-10-14T19:12:21.888368+0000","last_peered":"2023-10-14T19:12:21.888368+0000","last_clean":"2023-10-14T19:12:21.888368+0000","last_became_active":"2023-10-14T19:12:21.888138+0000","last_became_peered":"2023-10-14T19:12:21.888138+0000","last_unstale":"2023-10-14T19:12:21.888368+0000","last_undegraded":"2023-10-14T19:12:21.888368+0000","last_fullsized":"2023-10-14T19:12:21.888368+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:40.180895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885880+0000","last_change":"2023-10-14T19:12:21.885880+0000","last_active":"2023-10-14T19:12:21.885880+0000","last_peered":"2023-10-14T19:12:21.885880+0000","last_clean":"2023-10-14T19:12:21.885880+0000","last_became_active":"2023-10-14T19:12:21.885431+0000","last_became_peered":"2023-10-14T19:12:21.885431+0000","last_unstale":"2023-10-14T19:12:21.885880+0000","last_undegraded":"2023-10-14T19:12:21.885880+0000","last_fullsized":"2023-10-14T19:12:21.885880+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:05.758879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883463+0000","last_change":"2023-10-14T19:12:21.883463+0000","last_active":"2023-10-14T19:12:21.883463+0000","last_peered":"2023-10-14T19:12:21.883463+0000","last_clean":"2023-10-14T19:12:21.883463+0000","last_became_active":"2023-10-14T19:12:21.882769+0000","last_became_peered":"2023-10-14T19:12:21.882769+0000","last_unstale":"2023-10-14T19:12:21.883463+0000","last_undegraded":"2023-10-14T19:12:21.883463+0000","last_fullsized":"2023-10-14T19:12:21.883463+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:26:56.353956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885004+0000","last_change":"2023-10-14T19:12:21.885004+0000","last_active":"2023-10-14T19:12:21.885004+0000","last_peered":"2023-10-14T19:12:21.885004+0000","last_clean":"2023-10-14T19:12:21.885004+0000","last_became_active":"2023-10-14T19:12:21.884712+0000","last_became_peered":"2023-10-14T19:12:21.884712+0000","last_unstale":"2023-10-14T19:12:21.885004+0000","last_undegraded":"2023-10-14T19:12:21.885004+0000","last_fullsized":"2023-10-14T19:12:21.885004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:43.352160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"199'4","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.151125+0000","last_change":"2023-10-14T19:12:21.141092+0000","last_active":"2023-10-14T19:12:22.151125+0000","last_peered":"2023-10-14T19:12:22.151125+0000","last_clean":"2023-10-14T19:12:22.151125+0000","last_became_active":"2023-10-14T19:12:21.140779+0000","last_became_peered":"2023-10-14T19:12:21.140779+0000","last_unstale":"2023-10-14T19:12:22.151125+0000","last_undegraded":"2023-10-14T19:12:22.151125+0000","last_fullsized":"2023-10-14T19:12:22.151125+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:29.680625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.875282+0000","last_change":"2023-10-14T19:12:21.875282+0000","last_active":"2023-10-14T19:12:21.875282+0000","last_peered":"2023-10-14T19:12:21.875282+0000","last_clean":"2023-10-14T19:12:21.875282+0000","last_became_active":"2023-10-14T19:12:21.875006+0000","last_became_peered":"2023-10-14T19:12:21.875006+0000","last_unstale":"2023-10-14T19:12:21.875282+0000","last_undegraded":"2023-10-14T19:12:21.875282+0000","last_fullsized":"2023-10-14T19:12:21.875282+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:40.313502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.875511+0000","last_change":"2023-10-14T19:12:21.138922+0000","last_active":"2023-10-14T19:12:21.875511+0000","last_peered":"2023-10-14T19:12:21.875511+0000","last_clean":"2023-10-14T19:12:21.875511+0000","last_became_active":"2023-10-14T19:12:21.138642+0000","last_became_peered":"2023-10-14T19:12:21.138642+0000","last_unstale":"2023-10-14T19:12:21.875511+0000","last_undegraded":"2023-10-14T19:12:21.875511+0000","last_fullsized":"2023-10-14T19:12:21.875511+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:16.930814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879584+0000","last_change":"2023-10-14T19:12:21.879584+0000","last_active":"2023-10-14T19:12:21.879584+0000","last_peered":"2023-10-14T19:12:21.879584+0000","last_clean":"2023-10-14T19:12:21.879584+0000","last_became_active":"2023-10-14T19:12:21.879354+0000","last_became_peered":"2023-10-14T19:12:21.879354+0000","last_unstale":"2023-10-14T19:12:21.879584+0000","last_undegraded":"2023-10-14T19:12:21.879584+0000","last_fullsized":"2023-10-14T19:12:21.879584+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:21.816076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.152621+0000","last_change":"2023-10-14T19:12:21.141016+0000","last_active":"2023-10-14T19:12:22.152621+0000","last_peered":"2023-10-14T19:12:22.152621+0000","last_clean":"2023-10-14T19:12:22.152621+0000","last_became_active":"2023-10-14T19:12:21.140768+0000","last_became_peered":"2023-10-14T19:12:21.140768+0000","last_unstale":"2023-10-14T19:12:22.152621+0000","last_undegraded":"2023-10-14T19:12:22.152621+0000","last_fullsized":"2023-10-14T19:12:22.152621+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:32.069273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884089+0000","last_change":"2023-10-14T19:12:21.884089+0000","last_active":"2023-10-14T19:12:21.884089+0000","last_peered":"2023-10-14T19:12:21.884089+0000","last_clean":"2023-10-14T19:12:21.884089+0000","last_became_active":"2023-10-14T19:12:21.883806+0000","last_became_peered":"2023-10-14T19:12:21.883806+0000","last_unstale":"2023-10-14T19:12:21.884089+0000","last_undegraded":"2023-10-14T19:12:21.884089+0000","last_fullsized":"2023-10-14T19:12:21.884089+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:15:19.460203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.149488+0000","last_change":"2023-10-14T19:12:21.139404+0000","last_active":"2023-10-14T19:12:22.149488+0000","last_peered":"2023-10-14T19:12:22.149488+0000","last_clean":"2023-10-14T19:12:22.149488+0000","last_became_active":"2023-10-14T19:12:21.138886+0000","last_became_peered":"2023-10-14T19:12:21.138886+0000","last_unstale":"2023-10-14T19:12:22.149488+0000","last_undegraded":"2023-10-14T19:12:22.149488+0000","last_fullsized":"2023-10-14T19:12:22.149488+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:22.999098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885799+0000","last_change":"2023-10-14T19:12:21.885799+0000","last_active":"2023-10-14T19:12:21.885799+0000","last_peered":"2023-10-14T19:12:21.885799+0000","last_clean":"2023-10-14T19:12:21.885799+0000","last_became_active":"2023-10-14T19:12:21.885541+0000","last_became_peered":"2023-10-14T19:12:21.885541+0000","last_unstale":"2023-10-14T19:12:21.885799+0000","last_undegraded":"2023-10-14T19:12:21.885799+0000","last_fullsized":"2023-10-14T19:12:21.885799+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:35:59.030185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.871077+0000","last_change":"2023-10-14T19:12:21.143801+0000","last_active":"2023-10-14T19:12:21.871077+0000","last_peered":"2023-10-14T19:12:21.871077+0000","last_clean":"2023-10-14T19:12:21.871077+0000","last_became_active":"2023-10-14T19:12:21.143538+0000","last_became_peered":"2023-10-14T19:12:21.143538+0000","last_unstale":"2023-10-14T19:12:21.871077+0000","last_undegraded":"2023-10-14T19:12:21.871077+0000","last_fullsized":"2023-10-14T19:12:21.871077+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:02.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.876909+0000","last_change":"2023-10-14T19:12:21.876909+0000","last_active":"2023-10-14T19:12:21.876909+0000","last_peered":"2023-10-14T19:12:21.876909+0000","last_clean":"2023-10-14T19:12:21.876909+0000","last_became_active":"2023-10-14T19:12:21.876664+0000","last_became_peered":"2023-10-14T19:12:21.876664+0000","last_unstale":"2023-10-14T19:12:21.876909+0000","last_undegraded":"2023-10-14T19:12:21.876909+0000","last_fullsized":"2023-10-14T19:12:21.876909+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:24.819955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879046+0000","last_change":"2023-10-14T19:12:21.139500+0000","last_active":"2023-10-14T19:12:21.879046+0000","last_peered":"2023-10-14T19:12:21.879046+0000","last_clean":"2023-10-14T19:12:21.879046+0000","last_became_active":"2023-10-14T19:12:21.139009+0000","last_became_peered":"2023-10-14T19:12:21.139009+0000","last_unstale":"2023-10-14T19:12:21.879046+0000","last_undegraded":"2023-10-14T19:12:21.879046+0000","last_fullsized":"2023-10-14T19:12:21.879046+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:00.482808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884701+0000","last_change":"2023-10-14T19:12:21.884701+0000","last_active":"2023-10-14T19:12:21.884701+0000","last_peered":"2023-10-14T19:12:21.884701+0000","last_clean":"2023-10-14T19:12:21.884701+0000","last_became_active":"2023-10-14T19:12:21.884426+0000","last_became_peered":"2023-10-14T19:12:21.884426+0000","last_unstale":"2023-10-14T19:12:21.884701+0000","last_undegraded":"2023-10-14T19:12:21.884701+0000","last_fullsized":"2023-10-14T19:12:21.884701+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:15:18.569111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.139126+0000","last_change":"2023-10-14T19:12:21.138158+0000","last_active":"2023-10-14T19:12:21.139126+0000","last_peered":"2023-10-14T19:12:21.139126+0000","last_clean":"2023-10-14T19:12:21.139126+0000","last_became_active":"2023-10-14T19:12:21.137856+0000","last_became_peered":"2023-10-14T19:12:21.137856+0000","last_unstale":"2023-10-14T19:12:21.139126+0000","last_undegraded":"2023-10-14T19:12:21.139126+0000","last_fullsized":"2023-10-14T19:12:21.139126+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:38.706097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885494+0000","last_change":"2023-10-14T19:12:21.885494+0000","last_active":"2023-10-14T19:12:21.885494+0000","last_peered":"2023-10-14T19:12:21.885494+0000","last_clean":"2023-10-14T19:12:21.885494+0000","last_became_active":"2023-10-14T19:12:21.884461+0000","last_became_peered":"2023-10-14T19:12:21.884461+0000","last_unstale":"2023-10-14T19:12:21.885494+0000","last_undegraded":"2023-10-14T19:12:21.885494+0000","last_fullsized":"2023-10-14T19:12:21.885494+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:27.131147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143808+0000","last_change":"2023-10-14T19:12:21.140203+0000","last_active":"2023-10-14T19:12:21.143808+0000","last_peered":"2023-10-14T19:12:21.143808+0000","last_clean":"2023-10-14T19:12:21.143808+0000","last_became_active":"2023-10-14T19:12:21.139571+0000","last_became_peered":"2023-10-14T19:12:21.139571+0000","last_unstale":"2023-10-14T19:12:21.143808+0000","last_undegraded":"2023-10-14T19:12:21.143808+0000","last_fullsized":"2023-10-14T19:12:21.143808+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:24.112393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884938+0000","last_change":"2023-10-14T19:12:21.884938+0000","last_active":"2023-10-14T19:12:21.884938+0000","last_peered":"2023-10-14T19:12:21.884938+0000","last_clean":"2023-10-14T19:12:21.884938+0000","last_became_active":"2023-10-14T19:12:21.884578+0000","last_became_peered":"2023-10-14T19:12:21.884578+0000","last_unstale":"2023-10-14T19:12:21.884938+0000","last_undegraded":"2023-10-14T19:12:21.884938+0000","last_fullsized":"2023-10-14T19:12:21.884938+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:20:48.976251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.139666+0000","last_change":"2023-10-14T19:12:21.137885+0000","last_active":"2023-10-14T19:12:21.139666+0000","last_peered":"2023-10-14T19:12:21.139666+0000","last_clean":"2023-10-14T19:12:21.139666+0000","last_became_active":"2023-10-14T19:12:21.137616+0000","last_became_peered":"2023-10-14T19:12:21.137616+0000","last_unstale":"2023-10-14T19:12:21.139666+0000","last_undegraded":"2023-10-14T19:12:21.139666+0000","last_fullsized":"2023-10-14T19:12:21.139666+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:07.539866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880200+0000","last_change":"2023-10-14T19:12:21.880200+0000","last_active":"2023-10-14T19:12:21.880200+0000","last_peered":"2023-10-14T19:12:21.880200+0000","last_clean":"2023-10-14T19:12:21.880200+0000","last_became_active":"2023-10-14T19:12:21.879905+0000","last_became_peered":"2023-10-14T19:12:21.879905+0000","last_unstale":"2023-10-14T19:12:21.880200+0000","last_undegraded":"2023-10-14T19:12:21.880200+0000","last_fullsized":"2023-10-14T19:12:21.880200+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:53.334984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.149319+0000","last_change":"2023-10-14T19:12:21.144673+0000","last_active":"2023-10-14T19:12:21.149319+0000","last_peered":"2023-10-14T19:12:21.149319+0000","last_clean":"2023-10-14T19:12:21.149319+0000","last_became_active":"2023-10-14T19:12:21.144343+0000","last_became_peered":"2023-10-14T19:12:21.144343+0000","last_unstale":"2023-10-14T19:12:21.149319+0000","last_undegraded":"2023-10-14T19:12:21.149319+0000","last_fullsized":"2023-10-14T19:12:21.149319+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:35.869528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888662+0000","last_change":"2023-10-14T19:12:21.888662+0000","last_active":"2023-10-14T19:12:21.888662+0000","last_peered":"2023-10-14T19:12:21.888662+0000","last_clean":"2023-10-14T19:12:21.888662+0000","last_became_active":"2023-10-14T19:12:21.888406+0000","last_became_peered":"2023-10-14T19:12:21.888406+0000","last_unstale":"2023-10-14T19:12:21.888662+0000","last_undegraded":"2023-10-14T19:12:21.888662+0000","last_fullsized":"2023-10-14T19:12:21.888662+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:02.403744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"199'3","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.154237+0000","last_change":"2023-10-14T19:12:21.136734+0000","last_active":"2023-10-14T19:12:22.154237+0000","last_peered":"2023-10-14T19:12:22.154237+0000","last_clean":"2023-10-14T19:12:22.154237+0000","last_became_active":"2023-10-14T19:12:21.136468+0000","last_became_peered":"2023-10-14T19:12:21.136468+0000","last_unstale":"2023-10-14T19:12:22.154237+0000","last_undegraded":"2023-10-14T19:12:22.154237+0000","last_fullsized":"2023-10-14T19:12:22.154237+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:46.546410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.877998+0000","last_change":"2023-10-14T19:12:21.877998+0000","last_active":"2023-10-14T19:12:21.877998+0000","last_peered":"2023-10-14T19:12:21.877998+0000","last_clean":"2023-10-14T19:12:21.877998+0000","last_became_active":"2023-10-14T19:12:21.877725+0000","last_became_peered":"2023-10-14T19:12:21.877725+0000","last_unstale":"2023-10-14T19:12:21.877998+0000","last_undegraded":"2023-10-14T19:12:21.877998+0000","last_fullsized":"2023-10-14T19:12:21.877998+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:05.904265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"199'6","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.152266+0000","last_change":"2023-10-14T19:12:21.146318+0000","last_active":"2023-10-14T19:12:22.152266+0000","last_peered":"2023-10-14T19:12:22.152266+0000","last_clean":"2023-10-14T19:12:22.152266+0000","last_became_active":"2023-10-14T19:12:21.145775+0000","last_became_peered":"2023-10-14T19:12:21.145775+0000","last_unstale":"2023-10-14T19:12:22.152266+0000","last_undegraded":"2023-10-14T19:12:22.152266+0000","last_fullsized":"2023-10-14T19:12:22.152266+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:57.205409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880725+0000","last_change":"2023-10-14T19:12:21.880725+0000","last_active":"2023-10-14T19:12:21.880725+0000","last_peered":"2023-10-14T19:12:21.880725+0000","last_clean":"2023-10-14T19:12:21.880725+0000","last_became_active":"2023-10-14T19:12:21.880475+0000","last_became_peered":"2023-10-14T19:12:21.880475+0000","last_unstale":"2023-10-14T19:12:21.880725+0000","last_undegraded":"2023-10-14T19:12:21.880725+0000","last_fullsized":"2023-10-14T19:12:21.880725+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:32.555402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.153788+0000","last_change":"2023-10-14T19:12:21.142130+0000","last_active":"2023-10-14T19:12:22.153788+0000","last_peered":"2023-10-14T19:12:22.153788+0000","last_clean":"2023-10-14T19:12:22.153788+0000","last_became_active":"2023-10-14T19:12:21.140579+0000","last_became_peered":"2023-10-14T19:12:21.140579+0000","last_unstale":"2023-10-14T19:12:22.153788+0000","last_undegraded":"2023-10-14T19:12:22.153788+0000","last_fullsized":"2023-10-14T19:12:22.153788+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:39.176942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879234+0000","last_change":"2023-10-14T19:12:21.879234+0000","last_active":"2023-10-14T19:12:21.879234+0000","last_peered":"2023-10-14T19:12:21.879234+0000","last_clean":"2023-10-14T19:12:21.879234+0000","last_became_active":"2023-10-14T19:12:21.878967+0000","last_became_peered":"2023-10-14T19:12:21.878967+0000","last_unstale":"2023-10-14T19:12:21.879234+0000","last_undegraded":"2023-10-14T19:12:21.879234+0000","last_fullsized":"2023-10-14T19:12:21.879234+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:31.118654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143301+0000","last_change":"2023-10-14T19:12:21.139855+0000","last_active":"2023-10-14T19:12:21.143301+0000","last_peered":"2023-10-14T19:12:21.143301+0000","last_clean":"2023-10-14T19:12:21.143301+0000","last_became_active":"2023-10-14T19:12:21.139398+0000","last_became_peered":"2023-10-14T19:12:21.139398+0000","last_unstale":"2023-10-14T19:12:21.143301+0000","last_undegraded":"2023-10-14T19:12:21.143301+0000","last_fullsized":"2023-10-14T19:12:21.143301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:17.322015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.872520+0000","last_change":"2023-10-14T19:12:21.872520+0000","last_active":"2023-10-14T19:12:21.872520+0000","last_peered":"2023-10-14T19:12:21.872520+0000","last_clean":"2023-10-14T19:12:21.872520+0000","last_became_active":"2023-10-14T19:12:21.872254+0000","last_became_peered":"2023-10-14T19:12:21.872254+0000","last_unstale":"2023-10-14T19:12:21.872520+0000","last_undegraded":"2023-10-14T19:12:21.872520+0000","last_fullsized":"2023-10-14T19:12:21.872520+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:01.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.137078+0000","last_change":"2023-10-14T19:12:21.134610+0000","last_active":"2023-10-14T19:12:21.137078+0000","last_peered":"2023-10-14T19:12:21.137078+0000","last_clean":"2023-10-14T19:12:21.137078+0000","last_became_active":"2023-10-14T19:12:21.134280+0000","last_became_peered":"2023-10-14T19:12:21.134280+0000","last_unstale":"2023-10-14T19:12:21.137078+0000","last_undegraded":"2023-10-14T19:12:21.137078+0000","last_fullsized":"2023-10-14T19:12:21.137078+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:16.361956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.876295+0000","last_change":"2023-10-14T19:12:21.876295+0000","last_active":"2023-10-14T19:12:21.876295+0000","last_peered":"2023-10-14T19:12:21.876295+0000","last_clean":"2023-10-14T19:12:21.876295+0000","last_became_active":"2023-10-14T19:12:21.876018+0000","last_became_peered":"2023-10-14T19:12:21.876018+0000","last_unstale":"2023-10-14T19:12:21.876295+0000","last_undegraded":"2023-10-14T19:12:21.876295+0000","last_fullsized":"2023-10-14T19:12:21.876295+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:39.103078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"199'8","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.155777+0000","last_change":"2023-10-14T19:12:21.138079+0000","last_active":"2023-10-14T19:12:22.155777+0000","last_peered":"2023-10-14T19:12:22.155777+0000","last_clean":"2023-10-14T19:12:22.155777+0000","last_became_active":"2023-10-14T19:12:21.137796+0000","last_became_peered":"2023-10-14T19:12:21.137796+0000","last_unstale":"2023-10-14T19:12:22.155777+0000","last_undegraded":"2023-10-14T19:12:22.155777+0000","last_fullsized":"2023-10-14T19:12:22.155777+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:45.603161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885829+0000","last_change":"2023-10-14T19:12:21.885829+0000","last_active":"2023-10-14T19:12:21.885829+0000","last_peered":"2023-10-14T19:12:21.885829+0000","last_clean":"2023-10-14T19:12:21.885829+0000","last_became_active":"2023-10-14T19:12:21.885552+0000","last_became_peered":"2023-10-14T19:12:21.885552+0000","last_unstale":"2023-10-14T19:12:21.885829+0000","last_undegraded":"2023-10-14T19:12:21.885829+0000","last_fullsized":"2023-10-14T19:12:21.885829+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:15.700512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882880+0000","last_change":"2023-10-14T19:12:21.144933+0000","last_active":"2023-10-14T19:12:21.882880+0000","last_peered":"2023-10-14T19:12:21.882880+0000","last_clean":"2023-10-14T19:12:21.882880+0000","last_became_active":"2023-10-14T19:12:21.144685+0000","last_became_peered":"2023-10-14T19:12:21.144685+0000","last_unstale":"2023-10-14T19:12:21.882880+0000","last_undegraded":"2023-10-14T19:12:21.882880+0000","last_fullsized":"2023-10-14T19:12:21.882880+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.881478+0000","last_change":"2023-10-14T19:12:21.881478+0000","last_active":"2023-10-14T19:12:21.881478+0000","last_peered":"2023-10-14T19:12:21.881478+0000","last_clean":"2023-10-14T19:12:21.881478+0000","last_became_active":"2023-10-14T19:12:21.881191+0000","last_became_peered":"2023-10-14T19:12:21.881191+0000","last_unstale":"2023-10-14T19:12:21.881478+0000","last_undegraded":"2023-10-14T19:12:21.881478+0000","last_fullsized":"2023-10-14T19:12:21.881478+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:40:39.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.151065+0000","last_change":"2023-10-14T19:12:21.142347+0000","last_active":"2023-10-14T19:12:22.151065+0000","last_peered":"2023-10-14T19:12:22.151065+0000","last_clean":"2023-10-14T19:12:22.151065+0000","last_became_active":"2023-10-14T19:12:21.142049+0000","last_became_peered":"2023-10-14T19:12:21.142049+0000","last_unstale":"2023-10-14T19:12:22.151065+0000","last_undegraded":"2023-10-14T19:12:22.151065+0000","last_fullsized":"2023-10-14T19:12:22.151065+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:35:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883704+0000","last_change":"2023-10-14T19:12:21.883704+0000","last_active":"2023-10-14T19:12:21.883704+0000","last_peered":"2023-10-14T19:12:21.883704+0000","last_clean":"2023-10-14T19:12:21.883704+0000","last_became_active":"2023-10-14T19:12:21.883180+0000","last_became_peered":"2023-10-14T19:12:21.883180+0000","last_unstale":"2023-10-14T19:12:21.883704+0000","last_undegraded":"2023-10-14T19:12:21.883704+0000","last_fullsized":"2023-10-14T19:12:21.883704+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:01.930241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.876018+0000","last_change":"2023-10-14T19:12:21.140971+0000","last_active":"2023-10-14T19:12:21.876018+0000","last_peered":"2023-10-14T19:12:21.876018+0000","last_clean":"2023-10-14T19:12:21.876018+0000","last_became_active":"2023-10-14T19:12:21.140717+0000","last_became_peered":"2023-10-14T19:12:21.140717+0000","last_unstale":"2023-10-14T19:12:21.876018+0000","last_undegraded":"2023-10-14T19:12:21.876018+0000","last_fullsized":"2023-10-14T19:12:21.876018+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:07:41.332243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883782+0000","last_change":"2023-10-14T19:12:21.883782+0000","last_active":"2023-10-14T19:12:21.883782+0000","last_peered":"2023-10-14T19:12:21.883782+0000","last_clean":"2023-10-14T19:12:21.883782+0000","last_became_active":"2023-10-14T19:12:21.882911+0000","last_became_peered":"2023-10-14T19:12:21.882911+0000","last_unstale":"2023-10-14T19:12:21.883782+0000","last_undegraded":"2023-10-14T19:12:21.883782+0000","last_fullsized":"2023-10-14T19:12:21.883782+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:48:41.288173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.147179+0000","last_change":"2023-10-14T19:12:21.146073+0000","last_active":"2023-10-14T19:12:21.147179+0000","last_peered":"2023-10-14T19:12:21.147179+0000","last_clean":"2023-10-14T19:12:21.147179+0000","last_became_active":"2023-10-14T19:12:21.145361+0000","last_became_peered":"2023-10-14T19:12:21.145361+0000","last_unstale":"2023-10-14T19:12:21.147179+0000","last_undegraded":"2023-10-14T19:12:21.147179+0000","last_fullsized":"2023-10-14T19:12:21.147179+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:13.097459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880420+0000","last_change":"2023-10-14T19:12:21.880420+0000","last_active":"2023-10-14T19:12:21.880420+0000","last_peered":"2023-10-14T19:12:21.880420+0000","last_clean":"2023-10-14T19:12:21.880420+0000","last_became_active":"2023-10-14T19:12:21.880125+0000","last_became_peered":"2023-10-14T19:12:21.880125+0000","last_unstale":"2023-10-14T19:12:21.880420+0000","last_undegraded":"2023-10-14T19:12:21.880420+0000","last_fullsized":"2023-10-14T19:12:21.880420+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:19.081988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.155387+0000","last_change":"2023-10-14T19:12:21.142244+0000","last_active":"2023-10-14T19:12:22.155387+0000","last_peered":"2023-10-14T19:12:22.155387+0000","last_clean":"2023-10-14T19:12:22.155387+0000","last_became_active":"2023-10-14T19:12:21.141873+0000","last_became_peered":"2023-10-14T19:12:21.141873+0000","last_unstale":"2023-10-14T19:12:22.155387+0000","last_undegraded":"2023-10-14T19:12:22.155387+0000","last_fullsized":"2023-10-14T19:12:22.155387+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:27.090275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885621+0000","last_change":"2023-10-14T19:12:21.885621+0000","last_active":"2023-10-14T19:12:21.885621+0000","last_peered":"2023-10-14T19:12:21.885621+0000","last_clean":"2023-10-14T19:12:21.885621+0000","last_became_active":"2023-10-14T19:12:21.885326+0000","last_became_peered":"2023-10-14T19:12:21.885326+0000","last_unstale":"2023-10-14T19:12:21.885621+0000","last_undegraded":"2023-10-14T19:12:21.885621+0000","last_fullsized":"2023-10-14T19:12:21.885621+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:36.873482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.144288+0000","last_change":"2023-10-14T19:12:21.141648+0000","last_active":"2023-10-14T19:12:21.144288+0000","last_peered":"2023-10-14T19:12:21.144288+0000","last_clean":"2023-10-14T19:12:21.144288+0000","last_became_active":"2023-10-14T19:12:21.141383+0000","last_became_peered":"2023-10-14T19:12:21.141383+0000","last_unstale":"2023-10-14T19:12:21.144288+0000","last_undegraded":"2023-10-14T19:12:21.144288+0000","last_fullsized":"2023-10-14T19:12:21.144288+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:22.888336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885248+0000","last_change":"2023-10-14T19:12:21.885248+0000","last_active":"2023-10-14T19:12:21.885248+0000","last_peered":"2023-10-14T19:12:21.885248+0000","last_clean":"2023-10-14T19:12:21.885248+0000","last_became_active":"2023-10-14T19:12:21.884993+0000","last_became_peered":"2023-10-14T19:12:21.884993+0000","last_unstale":"2023-10-14T19:12:21.885248+0000","last_undegraded":"2023-10-14T19:12:21.885248+0000","last_fullsized":"2023-10-14T19:12:21.885248+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:45.114366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.141634+0000","last_change":"2023-10-14T19:12:21.137687+0000","last_active":"2023-10-14T19:12:21.141634+0000","last_peered":"2023-10-14T19:12:21.141634+0000","last_clean":"2023-10-14T19:12:21.141634+0000","last_became_active":"2023-10-14T19:12:21.135626+0000","last_became_peered":"2023-10-14T19:12:21.135626+0000","last_unstale":"2023-10-14T19:12:21.141634+0000","last_undegraded":"2023-10-14T19:12:21.141634+0000","last_fullsized":"2023-10-14T19:12:21.141634+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:09:37.424571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883194+0000","last_change":"2023-10-14T19:12:21.883194+0000","last_active":"2023-10-14T19:12:21.883194+0000","last_peered":"2023-10-14T19:12:21.883194+0000","last_clean":"2023-10-14T19:12:21.883194+0000","last_became_active":"2023-10-14T19:12:21.882936+0000","last_became_peered":"2023-10-14T19:12:21.882936+0000","last_unstale":"2023-10-14T19:12:21.883194+0000","last_undegraded":"2023-10-14T19:12:21.883194+0000","last_fullsized":"2023-10-14T19:12:21.883194+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:36.705150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143328+0000","last_change":"2023-10-14T19:12:21.141059+0000","last_active":"2023-10-14T19:12:21.143328+0000","last_peered":"2023-10-14T19:12:21.143328+0000","last_clean":"2023-10-14T19:12:21.143328+0000","last_became_active":"2023-10-14T19:12:21.140810+0000","last_became_peered":"2023-10-14T19:12:21.140810+0000","last_unstale":"2023-10-14T19:12:21.143328+0000","last_undegraded":"2023-10-14T19:12:21.143328+0000","last_fullsized":"2023-10-14T19:12:21.143328+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:27.615137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888318+0000","last_change":"2023-10-14T19:12:21.888318+0000","last_active":"2023-10-14T19:12:21.888318+0000","last_peered":"2023-10-14T19:12:21.888318+0000","last_clean":"2023-10-14T19:12:21.888318+0000","last_became_active":"2023-10-14T19:12:21.887969+0000","last_became_peered":"2023-10-14T19:12:21.887969+0000","last_unstale":"2023-10-14T19:12:21.888318+0000","last_undegraded":"2023-10-14T19:12:21.888318+0000","last_fullsized":"2023-10-14T19:12:21.888318+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:09:38.428525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.153168+0000","last_change":"2023-10-14T19:12:21.142901+0000","last_active":"2023-10-14T19:12:22.153168+0000","last_peered":"2023-10-14T19:12:22.153168+0000","last_clean":"2023-10-14T19:12:22.153168+0000","last_became_active":"2023-10-14T19:12:21.142621+0000","last_became_peered":"2023-10-14T19:12:21.142621+0000","last_unstale":"2023-10-14T19:12:22.153168+0000","last_undegraded":"2023-10-14T19:12:22.153168+0000","last_fullsized":"2023-10-14T19:12:22.153168+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:13.542194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.889162+0000","last_change":"2023-10-14T19:12:21.889162+0000","last_active":"2023-10-14T19:12:21.889162+0000","last_peered":"2023-10-14T19:12:21.889162+0000","last_clean":"2023-10-14T19:12:21.889162+0000","last_became_active":"2023-10-14T19:12:21.888880+0000","last_became_peered":"2023-10-14T19:12:21.888880+0000","last_unstale":"2023-10-14T19:12:21.889162+0000","last_undegraded":"2023-10-14T19:12:21.889162+0000","last_fullsized":"2023-10-14T19:12:21.889162+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:25.116347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.144112+0000","last_change":"2023-10-14T19:12:21.141404+0000","last_active":"2023-10-14T19:12:21.144112+0000","last_peered":"2023-10-14T19:12:21.144112+0000","last_clean":"2023-10-14T19:12:21.144112+0000","last_became_active":"2023-10-14T19:12:21.141143+0000","last_became_peered":"2023-10-14T19:12:21.141143+0000","last_unstale":"2023-10-14T19:12:21.144112+0000","last_undegraded":"2023-10-14T19:12:21.144112+0000","last_fullsized":"2023-10-14T19:12:21.144112+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:32.277398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.881085+0000","last_change":"2023-10-14T19:12:21.881085+0000","last_active":"2023-10-14T19:12:21.881085+0000","last_peered":"2023-10-14T19:12:21.881085+0000","last_clean":"2023-10-14T19:12:21.881085+0000","last_became_active":"2023-10-14T19:12:21.880824+0000","last_became_peered":"2023-10-14T19:12:21.880824+0000","last_unstale":"2023-10-14T19:12:21.881085+0000","last_undegraded":"2023-10-14T19:12:21.881085+0000","last_fullsized":"2023-10-14T19:12:21.881085+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:35.867989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.141970+0000","last_change":"2023-10-14T19:12:21.138583+0000","last_active":"2023-10-14T19:12:21.141970+0000","last_peered":"2023-10-14T19:12:21.141970+0000","last_clean":"2023-10-14T19:12:21.141970+0000","last_became_active":"2023-10-14T19:12:21.138287+0000","last_became_peered":"2023-10-14T19:12:21.138287+0000","last_unstale":"2023-10-14T19:12:21.141970+0000","last_undegraded":"2023-10-14T19:12:21.141970+0000","last_fullsized":"2023-10-14T19:12:21.141970+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:32.069273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.891298+0000","last_change":"2023-10-14T19:12:21.891298+0000","last_active":"2023-10-14T19:12:21.891298+0000","last_peered":"2023-10-14T19:12:21.891298+0000","last_clean":"2023-10-14T19:12:21.891298+0000","last_became_active":"2023-10-14T19:12:21.891028+0000","last_became_peered":"2023-10-14T19:12:21.891028+0000","last_unstale":"2023-10-14T19:12:21.891298+0000","last_undegraded":"2023-10-14T19:12:21.891298+0000","last_fullsized":"2023-10-14T19:12:21.891298+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:43.064128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.146336+0000","last_change":"2023-10-14T19:12:21.143946+0000","last_active":"2023-10-14T19:12:21.146336+0000","last_peered":"2023-10-14T19:12:21.146336+0000","last_clean":"2023-10-14T19:12:21.146336+0000","last_became_active":"2023-10-14T19:12:21.143551+0000","last_became_peered":"2023-10-14T19:12:21.143551+0000","last_unstale":"2023-10-14T19:12:21.146336+0000","last_undegraded":"2023-10-14T19:12:21.146336+0000","last_fullsized":"2023-10-14T19:12:21.146336+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:48.553620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.881171+0000","last_change":"2023-10-14T19:12:21.881171+0000","last_active":"2023-10-14T19:12:21.881171+0000","last_peered":"2023-10-14T19:12:21.881171+0000","last_clean":"2023-10-14T19:12:21.881171+0000","last_became_active":"2023-10-14T19:12:21.880896+0000","last_became_peered":"2023-10-14T19:12:21.880896+0000","last_unstale":"2023-10-14T19:12:21.881171+0000","last_undegraded":"2023-10-14T19:12:21.881171+0000","last_fullsized":"2023-10-14T19:12:21.881171+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:51.749613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143576+0000","last_change":"2023-10-14T19:12:21.141590+0000","last_active":"2023-10-14T19:12:21.143576+0000","last_peered":"2023-10-14T19:12:21.143576+0000","last_clean":"2023-10-14T19:12:21.143576+0000","last_became_active":"2023-10-14T19:12:21.140825+0000","last_became_peered":"2023-10-14T19:12:21.140825+0000","last_unstale":"2023-10-14T19:12:21.143576+0000","last_undegraded":"2023-10-14T19:12:21.143576+0000","last_fullsized":"2023-10-14T19:12:21.143576+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:23:22.384997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885709+0000","last_change":"2023-10-14T19:12:21.885709+0000","last_active":"2023-10-14T19:12:21.885709+0000","last_peered":"2023-10-14T19:12:21.885709+0000","last_clean":"2023-10-14T19:12:21.885709+0000","last_became_active":"2023-10-14T19:12:21.885100+0000","last_became_peered":"2023-10-14T19:12:21.885100+0000","last_unstale":"2023-10-14T19:12:21.885709+0000","last_undegraded":"2023-10-14T19:12:21.885709+0000","last_fullsized":"2023-10-14T19:12:21.885709+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:49.379566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143458+0000","last_change":"2023-10-14T19:12:21.138932+0000","last_active":"2023-10-14T19:12:21.143458+0000","last_peered":"2023-10-14T19:12:21.143458+0000","last_clean":"2023-10-14T19:12:21.143458+0000","last_became_active":"2023-10-14T19:12:21.138646+0000","last_became_peered":"2023-10-14T19:12:21.138646+0000","last_unstale":"2023-10-14T19:12:21.143458+0000","last_undegraded":"2023-10-14T19:12:21.143458+0000","last_fullsized":"2023-10-14T19:12:21.143458+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:30.285404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880203+0000","last_change":"2023-10-14T19:12:21.880203+0000","last_active":"2023-10-14T19:12:21.880203+0000","last_peered":"2023-10-14T19:12:21.880203+0000","last_clean":"2023-10-14T19:12:21.880203+0000","last_became_active":"2023-10-14T19:12:21.879297+0000","last_became_peered":"2023-10-14T19:12:21.879297+0000","last_unstale":"2023-10-14T19:12:21.880203+0000","last_undegraded":"2023-10-14T19:12:21.880203+0000","last_fullsized":"2023-10-14T19:12:21.880203+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:47.550363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.132961+0000","last_change":"2023-10-14T19:12:21.131384+0000","last_active":"2023-10-14T19:12:21.132961+0000","last_peered":"2023-10-14T19:12:21.132961+0000","last_clean":"2023-10-14T19:12:21.132961+0000","last_became_active":"2023-10-14T19:12:21.131059+0000","last_became_peered":"2023-10-14T19:12:21.131059+0000","last_unstale":"2023-10-14T19:12:21.132961+0000","last_undegraded":"2023-10-14T19:12:21.132961+0000","last_fullsized":"2023-10-14T19:12:21.132961+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:20.812123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882366+0000","last_change":"2023-10-14T19:12:21.882366+0000","last_active":"2023-10-14T19:12:21.882366+0000","last_peered":"2023-10-14T19:12:21.882366+0000","last_clean":"2023-10-14T19:12:21.882366+0000","last_became_active":"2023-10-14T19:12:21.882087+0000","last_became_peered":"2023-10-14T19:12:21.882087+0000","last_unstale":"2023-10-14T19:12:21.882366+0000","last_undegraded":"2023-10-14T19:12:21.882366+0000","last_fullsized":"2023-10-14T19:12:21.882366+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:40:42.368157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.136552+0000","last_change":"2023-10-14T19:12:21.131760+0000","last_active":"2023-10-14T19:12:21.136552+0000","last_peered":"2023-10-14T19:12:21.136552+0000","last_clean":"2023-10-14T19:12:21.136552+0000","last_became_active":"2023-10-14T19:12:21.130954+0000","last_became_peered":"2023-10-14T19:12:21.130954+0000","last_unstale":"2023-10-14T19:12:21.136552+0000","last_undegraded":"2023-10-14T19:12:21.136552+0000","last_fullsized":"2023-10-14T19:12:21.136552+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:39.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885792+0000","last_change":"2023-10-14T19:12:21.885792+0000","last_active":"2023-10-14T19:12:21.885792+0000","last_peered":"2023-10-14T19:12:21.885792+0000","last_clean":"2023-10-14T19:12:21.885792+0000","last_became_active":"2023-10-14T19:12:21.884796+0000","last_became_peered":"2023-10-14T19:12:21.884796+0000","last_unstale":"2023-10-14T19:12:21.885792+0000","last_undegraded":"2023-10-14T19:12:21.885792+0000","last_fullsized":"2023-10-14T19:12:21.885792+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:40.314070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.141320+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:12:21.141320+0000","last_peered":"2023-10-14T19:12:21.141320+0000","last_clean":"2023-10-14T19:12:21.141320+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:12:21.141320+0000","last_undegraded":"2023-10-14T19:12:21.141320+0000","last_fullsized":"2023-10-14T19:12:21.141320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304436,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067404,"statfs":{"total":96636764160,"available":96325021696,"internally_reserved":0,"allocated":3125248,"data_stored":1727781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.624},"min":{"1min":0.32100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.755,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.502,"15min":0.623},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.1949999999999998},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.628},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":2.3610000000000002},"last":0.49299999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.69599999999999995},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.67400000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.71099999999999997},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60699999999999998,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.70999999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.875,"15min":2.4620000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82299999999999995,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.60899999999999999},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54000000000000004,"15min":0.623},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":2.883},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.63900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58899999999999997,"15min":0.73299999999999998},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86699999999999999,"5min":0.91400000000000003,"15min":5.383},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1137447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.64200000000000002},"min":{"1min":0.38500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.996,"5min":0.996,"15min":5.7030000000000003},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.69099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.72099999999999997,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.71199999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.032,"5min":1.032,"15min":8.0210000000000008},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.58999999999999997,"15min":0.76300000000000001},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54900000000000004,"15min":0.72399999999999998},"min":{"1min":0.33700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.204,"5min":1.204,"15min":8.1890000000000001},"last":0.438},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55300000000000005,"15min":0.73699999999999999},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.67400000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.316},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.39200000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42199999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78100000000000003,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307952,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063888,"statfs":{"total":96636764160,"available":96321421312,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32400000000000001,"15min":0.314},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63500000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.624,"15min":0.67300000000000004},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.216},"max":{"1min":0.45800000000000002,"5min":0.873,"15min":0.873},"last":0.27900000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":1.032},"last":0.623}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.57999999999999996},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.85699999999999998,"5min":1.627,"15min":1.627},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90100000000000002,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.91600000000000004,"15min":1.079},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.38800000000000001},"max":{"1min":0.746,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308532,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063308,"statfs":{"total":96636764160,"available":96320827392,"internally_reserved":0,"allocated":3125248,"data_stored":1727781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.34399999999999997},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47599999999999998,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.495,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55400000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.62},"last":0.37},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.29699999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77400000000000002,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.39200000000000002},"max":{"1min":0.90700000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.96199999999999997,"15min":0.98799999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.51100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.91900000000000004,"15min":0.95599999999999996},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.501,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.88700000000000001,"15min":0.96599999999999997},"last":0.59399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.46000000000000002,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36499999999999999,"15min":0.41599999999999998},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":0.65800000000000003,"15min":2.028},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.49199999999999999,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38300000000000001,"15min":0.65100000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56899999999999995,"5min":0.60199999999999998,"15min":11.269},"last":0.35999999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35299999999999998,"15min":0.622},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.56200000000000006,"15min":11.318},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.52500000000000002,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":0.997,"15min":0.997},"last":0.621},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.65200000000000002},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59899999999999998,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.90400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72399999999999998,"5min":0.93200000000000005,"15min":11.379},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.627,"15min":0.90800000000000003},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.78200000000000003,"5min":0.98699999999999999,"15min":11.404},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.64800000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.746}]},{"osd":7,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63200000000000001,"15min":0.67500000000000004},"min":{"1min":0.44400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78200000000000003,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.92200000000000004},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.82399999999999995,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.34699999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.47699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.35599999999999998,"15min":0.379},"min":{"1min":0.29399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53100000000000003,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.35499999999999998,"15min":0.36299999999999999},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56899999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.316}]},{"osd":2,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60299999999999998,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.78400000000000003,"5min":2.597,"15min":2.597},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79200000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":1.214,"15min":1.214},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.75800000000000001,"5min":1.133,"15min":1.133},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76700000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.754}]},{"osd":7,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82799999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83899999999999997,"5min":0.997,"15min":0.997},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1138949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72599999999999998,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88400000000000001,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76700000000000002,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2709999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.56000000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56899999999999995},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.86499999999999999,"5min":1.589,"15min":1.589},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5529999999999999,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.378},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.5269999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.57299999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.622},"min":{"1min":0.42299999999999999,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.59099999999999997},"min":{"1min":0.46100000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":0.83999999999999997,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85299999999999998,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.81899999999999995,"5min":1.194,"15min":1.194},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72899999999999998,"5min":1.784,"15min":1.784},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.879,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.35099999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77900000000000003,"5min":0.83299999999999996,"15min":0.876},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.60599999999999998,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56100000000000005,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91700000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71599999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72499999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72999999999999998,"5min":1.234,"15min":1.234},"last":0.72299999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71299999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58599999999999997,"15min":0.60599999999999998},"min":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":1.008,"15min":1.008},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:12:26.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:12:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.403+0000 7f6b5d803700 1 Processor -- start 2023-10-14T19:12:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.403+0000 7f6b5d803700 1 -- start start 2023-10-14T19:12:26.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b5d803700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b580cf180 0x7f6b580ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b5d803700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6b580cb1a0 0x7f6b580cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b5d803700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5815e010 con 0x7f6b581594d0 2023-10-14T19:12:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b5d803700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5815d420 con 0x7f6b580cf180 2023-10-14T19:12:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b5d803700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5815d6e0 con 0x7f6b580cb1a0 2023-10-14T19:12:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b4ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b580cf180 0x7f6b580ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b56ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6b581594d0 0x7f6b580cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40754/0 (socket says 172.21.15.7:40754) 2023-10-14T19:12:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b56ffd700 1 -- 172.21.15.7:0/680690716 learned_addr learned my addr 172.21.15.7:0/680690716 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b577fe700 1 --2- 172.21.15.7:0/680690716 >> v2:172.21.15.148:3300/0 conn(0x7f6b580cb1a0 0x7f6b580cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b4ffff700 1 -- 172.21.15.7:0/680690716 >> v2:172.21.15.148:3300/0 conn(0x7f6b580cb1a0 msgr2=0x7f6b580cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:26.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b4ffff700 1 --2- 172.21.15.7:0/680690716 >> v2:172.21.15.148:3300/0 conn(0x7f6b580cb1a0 0x7f6b580cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b4ffff700 1 -- 172.21.15.7:0/680690716 >> v1:172.21.15.7:6789/0 conn(0x7f6b581594d0 legacy=0x7f6b580cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b4ffff700 1 -- 172.21.15.7:0/680690716 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5815d9c0 con 0x7f6b580cf180 2023-10-14T19:12:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b567fc700 1 -- 172.21.15.7:0/680690716 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178516925 0 0) 0x7f6b5815e010 con 0x7f6b581594d0 2023-10-14T19:12:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b577fe700 1 --2- 172.21.15.7:0/680690716 >> v2:172.21.15.148:3300/0 conn(0x7f6b580cb1a0 0x7f6b580cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.404+0000 7f6b4ffff700 1 --2- 172.21.15.7:0/680690716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cf180 0x7f6b580ccfc0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f6b58089530 tx=0x7f6b400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6727338a60b635f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b567fc700 1 -- 172.21.15.7:0/680690716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000b6b0 con 0x7f6b580cf180 2023-10-14T19:12:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b567fc700 1 -- 172.21.15.7:0/680690716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4000b810 con 0x7f6b580cf180 2023-10-14T19:12:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b567fc700 1 -- 172.21.15.7:0/680690716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000bbb0 con 0x7f6b580cf180 2023-10-14T19:12:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 -- 172.21.15.7:0/680690716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cf180 msgr2=0x7f6b580ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 --2- 172.21.15.7:0/680690716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cf180 0x7f6b580ccfc0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f6b58089530 tx=0x7f6b400091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 -- 172.21.15.7:0/680690716 shutdown_connections 2023-10-14T19:12:26.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 --2- 172.21.15.7:0/680690716 >> v2:172.21.15.148:3300/0 conn(0x7f6b580cb1a0 0x7f6b580cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 --2- 172.21.15.7:0/680690716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cf180 0x7f6b580ccfc0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 -- 172.21.15.7:0/680690716 >> 172.21.15.7:0/680690716 conn(0x7f6b580703a0 msgr2=0x7f6b58070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:26.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 -- 172.21.15.7:0/680690716 shutdown_connections 2023-10-14T19:12:26.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.405+0000 7f6b5d803700 1 -- 172.21.15.7:0/680690716 wait complete. 2023-10-14T19:12:26.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.406+0000 7f6b5d803700 1 Processor -- start 2023-10-14T19:12:26.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.406+0000 7f6b5d803700 1 -- start start 2023-10-14T19:12:26.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b5d803700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 0x7f6b5816a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b5d803700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b580cf180 0x7f6b580c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b5d803700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b581594d0 0x7f6b5815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b5d803700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c86d0 con 0x7f6b580cb1a0 2023-10-14T19:12:26.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b5d803700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c7e30 con 0x7f6b580cf180 2023-10-14T19:12:26.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b5d803700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c8110 con 0x7f6b581594d0 2023-10-14T19:12:26.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 0x7f6b5816a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 0x7f6b5816a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38872/0 (socket says 172.21.15.7:38872) 2023-10-14T19:12:26.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 -- 172.21.15.7:0/2624857757 learned_addr learned my addr 172.21.15.7:0/2624857757 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:26.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b577fe700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b581594d0 0x7f6b5815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b4ffff700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b580cf180 0x7f6b580c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 -- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b581594d0 msgr2=0x7f6b5815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b581594d0 0x7f6b5815a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 -- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b580cf180 msgr2=0x7f6b580c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b580cf180 0x7f6b580c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b56ffd700 1 -- 172.21.15.7:0/2624857757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40009420 con 0x7f6b580cb1a0 2023-10-14T19:12:26.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b577fe700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b581594d0 0x7f6b5815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:26.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.407+0000 7f6b4ffff700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b580cf180 0x7f6b580c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:26.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.408+0000 7f6b56ffd700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 0x7f6b5816a950 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c5b0 tx=0x7f6b48001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.408+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48005b30 con 0x7f6b580cb1a0 2023-10-14T19:12:26.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.408+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48005c90 con 0x7f6b580cb1a0 2023-10-14T19:12:26.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.408+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b580c83f0 con 0x7f6b580cb1a0 2023-10-14T19:12:26.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.408+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48007300 con 0x7f6b580cb1a0 2023-10-14T19:12:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.408+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b580c7b40 con 0x7f6b580cb1a0 2023-10-14T19:12:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.409+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b580c9360 con 0x7f6b580cb1a0 2023-10-14T19:12:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.409+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6b4801b3b0 con 0x7f6b580cb1a0 2023-10-14T19:12:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.409+0000 7f6b4effd700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b38067350 0x7f6b38069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.410+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b48084180 con 0x7f6b580cb1a0 2023-10-14T19:12:26.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.410+0000 7f6b4ffff700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b38067350 0x7f6b38069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.410+0000 7f6b4ffff700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b38067350 0x7f6b38069800 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6b58089530 tx=0x7f6b40017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.414+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b580c9360 con 0x7f6b580cb1a0 2023-10-14T19:12:26.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.604+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b580c9360 con 0x7f6b38067350 2023-10-14T19:12:26.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.612+0000 7f6b4effd700 1 -- 172.21.15.7:0/2624857757 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289884 (secure 0 0 0) 0x7f6b580c9360 con 0x7f6b38067350 2023-10-14T19:12:26.617 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b38067350 msgr2=0x7f6b38069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b38067350 0x7f6b38069800 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6b58089530 tx=0x7f6b40017000 comp rx=0 tx=0).stop 2023-10-14T19:12:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 msgr2=0x7f6b5816a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 0x7f6b5816a950 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c5b0 tx=0x7f6b48001070 comp rx=0 tx=0).stop 2023-10-14T19:12:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 shutdown_connections 2023-10-14T19:12:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f6b38067350 0x7f6b38069800 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b581594d0 0x7f6b5815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b580cb1a0 0x7f6b5816a950 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 --2- 172.21.15.7:0/2624857757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b580cf180 0x7f6b580c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 >> 172.21.15.7:0/2624857757 conn(0x7f6b580703a0 msgr2=0x7f6b580c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 shutdown_connections 2023-10-14T19:12:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.615+0000 7f6b5d803700 1 -- 172.21.15.7:0/2624857757 wait complete. 2023-10-14T19:12:26.622 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:12:26.628 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2023-10-14T19:12:25.755163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440216,"kb_used_data":20952,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534504,"statfs":{"total":773094113280,"available":770595332096,"internally_reserved":0,"allocated":21454848,"data_stored":10281610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.634572"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884407+0000","last_change":"2023-10-14T19:12:21.884407+0000","last_active":"2023-10-14T19:12:21.884407+0000","last_peered":"2023-10-14T19:12:21.884407+0000","last_clean":"2023-10-14T19:12:21.884407+0000","last_became_active":"2023-10-14T19:12:21.884099+0000","last_became_peered":"2023-10-14T19:12:21.884099+0000","last_unstale":"2023-10-14T19:12:21.884407+0000","last_undegraded":"2023-10-14T19:12:21.884407+0000","last_fullsized":"2023-10-14T19:12:21.884407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:39.710050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884052+0000","last_change":"2023-10-14T19:12:21.884052+0000","last_active":"2023-10-14T19:12:21.884052+0000","last_peered":"2023-10-14T19:12:21.884052+0000","last_clean":"2023-10-14T19:12:21.884052+0000","last_became_active":"2023-10-14T19:12:21.883777+0000","last_became_peered":"2023-10-14T19:12:21.883777+0000","last_unstale":"2023-10-14T19:12:21.884052+0000","last_undegraded":"2023-10-14T19:12:21.884052+0000","last_fullsized":"2023-10-14T19:12:21.884052+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:03.393890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884745+0000","last_change":"2023-10-14T19:12:21.884745+0000","last_active":"2023-10-14T19:12:21.884745+0000","last_peered":"2023-10-14T19:12:21.884745+0000","last_clean":"2023-10-14T19:12:21.884745+0000","last_became_active":"2023-10-14T19:12:21.884357+0000","last_became_peered":"2023-10-14T19:12:21.884357+0000","last_unstale":"2023-10-14T19:12:21.884745+0000","last_undegraded":"2023-10-14T19:12:21.884745+0000","last_fullsized":"2023-10-14T19:12:21.884745+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:38.137080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888927+0000","last_change":"2023-10-14T19:12:21.888927+0000","last_active":"2023-10-14T19:12:21.888927+0000","last_peered":"2023-10-14T19:12:21.888927+0000","last_clean":"2023-10-14T19:12:21.888927+0000","last_became_active":"2023-10-14T19:12:21.888647+0000","last_became_peered":"2023-10-14T19:12:21.888647+0000","last_unstale":"2023-10-14T19:12:21.888927+0000","last_undegraded":"2023-10-14T19:12:21.888927+0000","last_fullsized":"2023-10-14T19:12:21.888927+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:45:24.433495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888258+0000","last_change":"2023-10-14T19:12:21.888258+0000","last_active":"2023-10-14T19:12:21.888258+0000","last_peered":"2023-10-14T19:12:21.888258+0000","last_clean":"2023-10-14T19:12:21.888258+0000","last_became_active":"2023-10-14T19:12:21.888018+0000","last_became_peered":"2023-10-14T19:12:21.888018+0000","last_unstale":"2023-10-14T19:12:21.888258+0000","last_undegraded":"2023-10-14T19:12:21.888258+0000","last_fullsized":"2023-10-14T19:12:21.888258+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:57:37.935733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.887885+0000","last_change":"2023-10-14T19:12:21.887885+0000","last_active":"2023-10-14T19:12:21.887885+0000","last_peered":"2023-10-14T19:12:21.887885+0000","last_clean":"2023-10-14T19:12:21.887885+0000","last_became_active":"2023-10-14T19:12:21.887616+0000","last_became_peered":"2023-10-14T19:12:21.887616+0000","last_unstale":"2023-10-14T19:12:21.887885+0000","last_undegraded":"2023-10-14T19:12:21.887885+0000","last_fullsized":"2023-10-14T19:12:21.887885+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:28.094228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.886680+0000","last_change":"2023-10-14T19:12:21.886680+0000","last_active":"2023-10-14T19:12:21.886680+0000","last_peered":"2023-10-14T19:12:21.886680+0000","last_clean":"2023-10-14T19:12:21.886680+0000","last_became_active":"2023-10-14T19:12:21.886129+0000","last_became_peered":"2023-10-14T19:12:21.886129+0000","last_unstale":"2023-10-14T19:12:21.886680+0000","last_undegraded":"2023-10-14T19:12:21.886680+0000","last_fullsized":"2023-10-14T19:12:21.886680+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:34.883239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.887010+0000","last_change":"2023-10-14T19:12:21.887010+0000","last_active":"2023-10-14T19:12:21.887010+0000","last_peered":"2023-10-14T19:12:21.887010+0000","last_clean":"2023-10-14T19:12:21.887010+0000","last_became_active":"2023-10-14T19:12:21.884314+0000","last_became_peered":"2023-10-14T19:12:21.884314+0000","last_unstale":"2023-10-14T19:12:21.887010+0000","last_undegraded":"2023-10-14T19:12:21.887010+0000","last_fullsized":"2023-10-14T19:12:21.887010+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:46.764224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.890109+0000","last_change":"2023-10-14T19:12:21.890109+0000","last_active":"2023-10-14T19:12:21.890109+0000","last_peered":"2023-10-14T19:12:21.890109+0000","last_clean":"2023-10-14T19:12:21.890109+0000","last_became_active":"2023-10-14T19:12:21.889694+0000","last_became_peered":"2023-10-14T19:12:21.889694+0000","last_unstale":"2023-10-14T19:12:21.890109+0000","last_undegraded":"2023-10-14T19:12:21.890109+0000","last_fullsized":"2023-10-14T19:12:21.890109+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:45.284681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879490+0000","last_change":"2023-10-14T19:12:21.879490+0000","last_active":"2023-10-14T19:12:21.879490+0000","last_peered":"2023-10-14T19:12:21.879490+0000","last_clean":"2023-10-14T19:12:21.879490+0000","last_became_active":"2023-10-14T19:12:21.879189+0000","last_became_peered":"2023-10-14T19:12:21.879189+0000","last_unstale":"2023-10-14T19:12:21.879490+0000","last_undegraded":"2023-10-14T19:12:21.879490+0000","last_fullsized":"2023-10-14T19:12:21.879490+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:56:46.750320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.886037+0000","last_change":"2023-10-14T19:12:21.886037+0000","last_active":"2023-10-14T19:12:21.886037+0000","last_peered":"2023-10-14T19:12:21.886037+0000","last_clean":"2023-10-14T19:12:21.886037+0000","last_became_active":"2023-10-14T19:12:21.885760+0000","last_became_peered":"2023-10-14T19:12:21.885760+0000","last_unstale":"2023-10-14T19:12:21.886037+0000","last_undegraded":"2023-10-14T19:12:21.886037+0000","last_fullsized":"2023-10-14T19:12:21.886037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:17.934767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.890767+0000","last_change":"2023-10-14T19:12:21.890767+0000","last_active":"2023-10-14T19:12:21.890767+0000","last_peered":"2023-10-14T19:12:21.890767+0000","last_clean":"2023-10-14T19:12:21.890767+0000","last_became_active":"2023-10-14T19:12:21.890475+0000","last_became_peered":"2023-10-14T19:12:21.890475+0000","last_unstale":"2023-10-14T19:12:21.890767+0000","last_undegraded":"2023-10-14T19:12:21.890767+0000","last_fullsized":"2023-10-14T19:12:21.890767+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:00.689801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.887780+0000","last_change":"2023-10-14T19:12:21.887780+0000","last_active":"2023-10-14T19:12:21.887780+0000","last_peered":"2023-10-14T19:12:21.887780+0000","last_clean":"2023-10-14T19:12:21.887780+0000","last_became_active":"2023-10-14T19:12:21.887514+0000","last_became_peered":"2023-10-14T19:12:21.887514+0000","last_unstale":"2023-10-14T19:12:21.887780+0000","last_undegraded":"2023-10-14T19:12:21.887780+0000","last_fullsized":"2023-10-14T19:12:21.887780+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:08.792066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885258+0000","last_change":"2023-10-14T19:12:21.885258+0000","last_active":"2023-10-14T19:12:21.885258+0000","last_peered":"2023-10-14T19:12:21.885258+0000","last_clean":"2023-10-14T19:12:21.885258+0000","last_became_active":"2023-10-14T19:12:21.884843+0000","last_became_peered":"2023-10-14T19:12:21.884843+0000","last_unstale":"2023-10-14T19:12:21.885258+0000","last_undegraded":"2023-10-14T19:12:21.885258+0000","last_fullsized":"2023-10-14T19:12:21.885258+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:46.607115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888098+0000","last_change":"2023-10-14T19:12:21.888098+0000","last_active":"2023-10-14T19:12:21.888098+0000","last_peered":"2023-10-14T19:12:21.888098+0000","last_clean":"2023-10-14T19:12:21.888098+0000","last_became_active":"2023-10-14T19:12:21.887838+0000","last_became_peered":"2023-10-14T19:12:21.887838+0000","last_unstale":"2023-10-14T19:12:21.888098+0000","last_undegraded":"2023-10-14T19:12:21.888098+0000","last_fullsized":"2023-10-14T19:12:21.888098+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:46.764224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884579+0000","last_change":"2023-10-14T19:12:21.884579+0000","last_active":"2023-10-14T19:12:21.884579+0000","last_peered":"2023-10-14T19:12:21.884579+0000","last_clean":"2023-10-14T19:12:21.884579+0000","last_became_active":"2023-10-14T19:12:21.883312+0000","last_became_peered":"2023-10-14T19:12:21.883312+0000","last_unstale":"2023-10-14T19:12:21.884579+0000","last_undegraded":"2023-10-14T19:12:21.884579+0000","last_fullsized":"2023-10-14T19:12:21.884579+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:12:30.710049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882812+0000","last_change":"2023-10-14T19:12:21.882812+0000","last_active":"2023-10-14T19:12:21.882812+0000","last_peered":"2023-10-14T19:12:21.882812+0000","last_clean":"2023-10-14T19:12:21.882812+0000","last_became_active":"2023-10-14T19:12:21.882031+0000","last_became_peered":"2023-10-14T19:12:21.882031+0000","last_unstale":"2023-10-14T19:12:21.882812+0000","last_undegraded":"2023-10-14T19:12:21.882812+0000","last_fullsized":"2023-10-14T19:12:21.882812+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:19.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.873949+0000","last_change":"2023-10-14T19:12:21.873949+0000","last_active":"2023-10-14T19:12:21.873949+0000","last_peered":"2023-10-14T19:12:21.873949+0000","last_clean":"2023-10-14T19:12:21.873949+0000","last_became_active":"2023-10-14T19:12:21.873750+0000","last_became_peered":"2023-10-14T19:12:21.873750+0000","last_unstale":"2023-10-14T19:12:21.873949+0000","last_undegraded":"2023-10-14T19:12:21.873949+0000","last_fullsized":"2023-10-14T19:12:21.873949+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:19:26.018854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880219+0000","last_change":"2023-10-14T19:12:21.880219+0000","last_active":"2023-10-14T19:12:21.880219+0000","last_peered":"2023-10-14T19:12:21.880219+0000","last_clean":"2023-10-14T19:12:21.880219+0000","last_became_active":"2023-10-14T19:12:21.879924+0000","last_became_peered":"2023-10-14T19:12:21.879924+0000","last_unstale":"2023-10-14T19:12:21.880219+0000","last_undegraded":"2023-10-14T19:12:21.880219+0000","last_fullsized":"2023-10-14T19:12:21.880219+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:55.517559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888180+0000","last_change":"2023-10-14T19:12:21.888180+0000","last_active":"2023-10-14T19:12:21.888180+0000","last_peered":"2023-10-14T19:12:21.888180+0000","last_clean":"2023-10-14T19:12:21.888180+0000","last_became_active":"2023-10-14T19:12:21.887661+0000","last_became_peered":"2023-10-14T19:12:21.887661+0000","last_unstale":"2023-10-14T19:12:21.888180+0000","last_undegraded":"2023-10-14T19:12:21.888180+0000","last_fullsized":"2023-10-14T19:12:21.888180+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:01.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.886504+0000","last_change":"2023-10-14T19:12:21.886504+0000","last_active":"2023-10-14T19:12:21.886504+0000","last_peered":"2023-10-14T19:12:21.886504+0000","last_clean":"2023-10-14T19:12:21.886504+0000","last_became_active":"2023-10-14T19:12:21.886227+0000","last_became_peered":"2023-10-14T19:12:21.886227+0000","last_unstale":"2023-10-14T19:12:21.886504+0000","last_undegraded":"2023-10-14T19:12:21.886504+0000","last_fullsized":"2023-10-14T19:12:21.886504+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:46:40.935674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882981+0000","last_change":"2023-10-14T19:12:21.882981+0000","last_active":"2023-10-14T19:12:21.882981+0000","last_peered":"2023-10-14T19:12:21.882981+0000","last_clean":"2023-10-14T19:12:21.882981+0000","last_became_active":"2023-10-14T19:12:21.882680+0000","last_became_peered":"2023-10-14T19:12:21.882680+0000","last_unstale":"2023-10-14T19:12:21.882981+0000","last_undegraded":"2023-10-14T19:12:21.882981+0000","last_fullsized":"2023-10-14T19:12:21.882981+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:51.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888634+0000","last_change":"2023-10-14T19:12:21.888634+0000","last_active":"2023-10-14T19:12:21.888634+0000","last_peered":"2023-10-14T19:12:21.888634+0000","last_clean":"2023-10-14T19:12:21.888634+0000","last_became_active":"2023-10-14T19:12:21.888291+0000","last_became_peered":"2023-10-14T19:12:21.888291+0000","last_unstale":"2023-10-14T19:12:21.888634+0000","last_undegraded":"2023-10-14T19:12:21.888634+0000","last_fullsized":"2023-10-14T19:12:21.888634+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:11:36.390674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.878772+0000","last_change":"2023-10-14T19:12:21.878772+0000","last_active":"2023-10-14T19:12:21.878772+0000","last_peered":"2023-10-14T19:12:21.878772+0000","last_clean":"2023-10-14T19:12:21.878772+0000","last_became_active":"2023-10-14T19:12:21.878263+0000","last_became_peered":"2023-10-14T19:12:21.878263+0000","last_unstale":"2023-10-14T19:12:21.878772+0000","last_undegraded":"2023-10-14T19:12:21.878772+0000","last_fullsized":"2023-10-14T19:12:21.878772+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:15:18.569111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888477+0000","last_change":"2023-10-14T19:12:21.888477+0000","last_active":"2023-10-14T19:12:21.888477+0000","last_peered":"2023-10-14T19:12:21.888477+0000","last_clean":"2023-10-14T19:12:21.888477+0000","last_became_active":"2023-10-14T19:12:21.887856+0000","last_became_peered":"2023-10-14T19:12:21.887856+0000","last_unstale":"2023-10-14T19:12:21.888477+0000","last_undegraded":"2023-10-14T19:12:21.888477+0000","last_fullsized":"2023-10-14T19:12:21.888477+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:47:16.653228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879707+0000","last_change":"2023-10-14T19:12:21.879707+0000","last_active":"2023-10-14T19:12:21.879707+0000","last_peered":"2023-10-14T19:12:21.879707+0000","last_clean":"2023-10-14T19:12:21.879707+0000","last_became_active":"2023-10-14T19:12:21.879415+0000","last_became_peered":"2023-10-14T19:12:21.879415+0000","last_unstale":"2023-10-14T19:12:21.879707+0000","last_undegraded":"2023-10-14T19:12:21.879707+0000","last_fullsized":"2023-10-14T19:12:21.879707+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:08.543820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880283+0000","last_change":"2023-10-14T19:12:21.880283+0000","last_active":"2023-10-14T19:12:21.880283+0000","last_peered":"2023-10-14T19:12:21.880283+0000","last_clean":"2023-10-14T19:12:21.880283+0000","last_became_active":"2023-10-14T19:12:21.879988+0000","last_became_peered":"2023-10-14T19:12:21.879988+0000","last_unstale":"2023-10-14T19:12:21.880283+0000","last_undegraded":"2023-10-14T19:12:21.880283+0000","last_fullsized":"2023-10-14T19:12:21.880283+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:25.321798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.877660+0000","last_change":"2023-10-14T19:12:21.877660+0000","last_active":"2023-10-14T19:12:21.877660+0000","last_peered":"2023-10-14T19:12:21.877660+0000","last_clean":"2023-10-14T19:12:21.877660+0000","last_became_active":"2023-10-14T19:12:21.877366+0000","last_became_peered":"2023-10-14T19:12:21.877366+0000","last_unstale":"2023-10-14T19:12:21.877660+0000","last_undegraded":"2023-10-14T19:12:21.877660+0000","last_fullsized":"2023-10-14T19:12:21.877660+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:24.003051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888368+0000","last_change":"2023-10-14T19:12:21.888368+0000","last_active":"2023-10-14T19:12:21.888368+0000","last_peered":"2023-10-14T19:12:21.888368+0000","last_clean":"2023-10-14T19:12:21.888368+0000","last_became_active":"2023-10-14T19:12:21.888138+0000","last_became_peered":"2023-10-14T19:12:21.888138+0000","last_unstale":"2023-10-14T19:12:21.888368+0000","last_undegraded":"2023-10-14T19:12:21.888368+0000","last_fullsized":"2023-10-14T19:12:21.888368+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:40.180895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885880+0000","last_change":"2023-10-14T19:12:21.885880+0000","last_active":"2023-10-14T19:12:21.885880+0000","last_peered":"2023-10-14T19:12:21.885880+0000","last_clean":"2023-10-14T19:12:21.885880+0000","last_became_active":"2023-10-14T19:12:21.885431+0000","last_became_peered":"2023-10-14T19:12:21.885431+0000","last_unstale":"2023-10-14T19:12:21.885880+0000","last_undegraded":"2023-10-14T19:12:21.885880+0000","last_fullsized":"2023-10-14T19:12:21.885880+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:05.758879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883463+0000","last_change":"2023-10-14T19:12:21.883463+0000","last_active":"2023-10-14T19:12:21.883463+0000","last_peered":"2023-10-14T19:12:21.883463+0000","last_clean":"2023-10-14T19:12:21.883463+0000","last_became_active":"2023-10-14T19:12:21.882769+0000","last_became_peered":"2023-10-14T19:12:21.882769+0000","last_unstale":"2023-10-14T19:12:21.883463+0000","last_undegraded":"2023-10-14T19:12:21.883463+0000","last_fullsized":"2023-10-14T19:12:21.883463+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:26:56.353956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885004+0000","last_change":"2023-10-14T19:12:21.885004+0000","last_active":"2023-10-14T19:12:21.885004+0000","last_peered":"2023-10-14T19:12:21.885004+0000","last_clean":"2023-10-14T19:12:21.885004+0000","last_became_active":"2023-10-14T19:12:21.884712+0000","last_became_peered":"2023-10-14T19:12:21.884712+0000","last_unstale":"2023-10-14T19:12:21.885004+0000","last_undegraded":"2023-10-14T19:12:21.885004+0000","last_fullsized":"2023-10-14T19:12:21.885004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:43.352160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"199'4","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.151125+0000","last_change":"2023-10-14T19:12:21.141092+0000","last_active":"2023-10-14T19:12:22.151125+0000","last_peered":"2023-10-14T19:12:22.151125+0000","last_clean":"2023-10-14T19:12:22.151125+0000","last_became_active":"2023-10-14T19:12:21.140779+0000","last_became_peered":"2023-10-14T19:12:21.140779+0000","last_unstale":"2023-10-14T19:12:22.151125+0000","last_undegraded":"2023-10-14T19:12:22.151125+0000","last_fullsized":"2023-10-14T19:12:22.151125+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:29.680625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.875282+0000","last_change":"2023-10-14T19:12:21.875282+0000","last_active":"2023-10-14T19:12:21.875282+0000","last_peered":"2023-10-14T19:12:21.875282+0000","last_clean":"2023-10-14T19:12:21.875282+0000","last_became_active":"2023-10-14T19:12:21.875006+0000","last_became_peered":"2023-10-14T19:12:21.875006+0000","last_unstale":"2023-10-14T19:12:21.875282+0000","last_undegraded":"2023-10-14T19:12:21.875282+0000","last_fullsized":"2023-10-14T19:12:21.875282+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:40.313502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.875511+0000","last_change":"2023-10-14T19:12:21.138922+0000","last_active":"2023-10-14T19:12:21.875511+0000","last_peered":"2023-10-14T19:12:21.875511+0000","last_clean":"2023-10-14T19:12:21.875511+0000","last_became_active":"2023-10-14T19:12:21.138642+0000","last_became_peered":"2023-10-14T19:12:21.138642+0000","last_unstale":"2023-10-14T19:12:21.875511+0000","last_undegraded":"2023-10-14T19:12:21.875511+0000","last_fullsized":"2023-10-14T19:12:21.875511+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:16.930814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879584+0000","last_change":"2023-10-14T19:12:21.879584+0000","last_active":"2023-10-14T19:12:21.879584+0000","last_peered":"2023-10-14T19:12:21.879584+0000","last_clean":"2023-10-14T19:12:21.879584+0000","last_became_active":"2023-10-14T19:12:21.879354+0000","last_became_peered":"2023-10-14T19:12:21.879354+0000","last_unstale":"2023-10-14T19:12:21.879584+0000","last_undegraded":"2023-10-14T19:12:21.879584+0000","last_fullsized":"2023-10-14T19:12:21.879584+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:21.816076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.152621+0000","last_change":"2023-10-14T19:12:21.141016+0000","last_active":"2023-10-14T19:12:22.152621+0000","last_peered":"2023-10-14T19:12:22.152621+0000","last_clean":"2023-10-14T19:12:22.152621+0000","last_became_active":"2023-10-14T19:12:21.140768+0000","last_became_peered":"2023-10-14T19:12:21.140768+0000","last_unstale":"2023-10-14T19:12:22.152621+0000","last_undegraded":"2023-10-14T19:12:22.152621+0000","last_fullsized":"2023-10-14T19:12:22.152621+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:32.069273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884089+0000","last_change":"2023-10-14T19:12:21.884089+0000","last_active":"2023-10-14T19:12:21.884089+0000","last_peered":"2023-10-14T19:12:21.884089+0000","last_clean":"2023-10-14T19:12:21.884089+0000","last_became_active":"2023-10-14T19:12:21.883806+0000","last_became_peered":"2023-10-14T19:12:21.883806+0000","last_unstale":"2023-10-14T19:12:21.884089+0000","last_undegraded":"2023-10-14T19:12:21.884089+0000","last_fullsized":"2023-10-14T19:12:21.884089+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:15:19.460203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.149488+0000","last_change":"2023-10-14T19:12:21.139404+0000","last_active":"2023-10-14T19:12:22.149488+0000","last_peered":"2023-10-14T19:12:22.149488+0000","last_clean":"2023-10-14T19:12:22.149488+0000","last_became_active":"2023-10-14T19:12:21.138886+0000","last_became_peered":"2023-10-14T19:12:21.138886+0000","last_unstale":"2023-10-14T19:12:22.149488+0000","last_undegraded":"2023-10-14T19:12:22.149488+0000","last_fullsized":"2023-10-14T19:12:22.149488+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:22.999098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885799+0000","last_change":"2023-10-14T19:12:21.885799+0000","last_active":"2023-10-14T19:12:21.885799+0000","last_peered":"2023-10-14T19:12:21.885799+0000","last_clean":"2023-10-14T19:12:21.885799+0000","last_became_active":"2023-10-14T19:12:21.885541+0000","last_became_peered":"2023-10-14T19:12:21.885541+0000","last_unstale":"2023-10-14T19:12:21.885799+0000","last_undegraded":"2023-10-14T19:12:21.885799+0000","last_fullsized":"2023-10-14T19:12:21.885799+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:35:59.030185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.871077+0000","last_change":"2023-10-14T19:12:21.143801+0000","last_active":"2023-10-14T19:12:21.871077+0000","last_peered":"2023-10-14T19:12:21.871077+0000","last_clean":"2023-10-14T19:12:21.871077+0000","last_became_active":"2023-10-14T19:12:21.143538+0000","last_became_peered":"2023-10-14T19:12:21.143538+0000","last_unstale":"2023-10-14T19:12:21.871077+0000","last_undegraded":"2023-10-14T19:12:21.871077+0000","last_fullsized":"2023-10-14T19:12:21.871077+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:02.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.876909+0000","last_change":"2023-10-14T19:12:21.876909+0000","last_active":"2023-10-14T19:12:21.876909+0000","last_peered":"2023-10-14T19:12:21.876909+0000","last_clean":"2023-10-14T19:12:21.876909+0000","last_became_active":"2023-10-14T19:12:21.876664+0000","last_became_peered":"2023-10-14T19:12:21.876664+0000","last_unstale":"2023-10-14T19:12:21.876909+0000","last_undegraded":"2023-10-14T19:12:21.876909+0000","last_fullsized":"2023-10-14T19:12:21.876909+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:24.819955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879046+0000","last_change":"2023-10-14T19:12:21.139500+0000","last_active":"2023-10-14T19:12:21.879046+0000","last_peered":"2023-10-14T19:12:21.879046+0000","last_clean":"2023-10-14T19:12:21.879046+0000","last_became_active":"2023-10-14T19:12:21.139009+0000","last_became_peered":"2023-10-14T19:12:21.139009+0000","last_unstale":"2023-10-14T19:12:21.879046+0000","last_undegraded":"2023-10-14T19:12:21.879046+0000","last_fullsized":"2023-10-14T19:12:21.879046+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:00.482808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884701+0000","last_change":"2023-10-14T19:12:21.884701+0000","last_active":"2023-10-14T19:12:21.884701+0000","last_peered":"2023-10-14T19:12:21.884701+0000","last_clean":"2023-10-14T19:12:21.884701+0000","last_became_active":"2023-10-14T19:12:21.884426+0000","last_became_peered":"2023-10-14T19:12:21.884426+0000","last_unstale":"2023-10-14T19:12:21.884701+0000","last_undegraded":"2023-10-14T19:12:21.884701+0000","last_fullsized":"2023-10-14T19:12:21.884701+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:15:18.569111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.139126+0000","last_change":"2023-10-14T19:12:21.138158+0000","last_active":"2023-10-14T19:12:21.139126+0000","last_peered":"2023-10-14T19:12:21.139126+0000","last_clean":"2023-10-14T19:12:21.139126+0000","last_became_active":"2023-10-14T19:12:21.137856+0000","last_became_peered":"2023-10-14T19:12:21.137856+0000","last_unstale":"2023-10-14T19:12:21.139126+0000","last_undegraded":"2023-10-14T19:12:21.139126+0000","last_fullsized":"2023-10-14T19:12:21.139126+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:38.706097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885494+0000","last_change":"2023-10-14T19:12:21.885494+0000","last_active":"2023-10-14T19:12:21.885494+0000","last_peered":"2023-10-14T19:12:21.885494+0000","last_clean":"2023-10-14T19:12:21.885494+0000","last_became_active":"2023-10-14T19:12:21.884461+0000","last_became_peered":"2023-10-14T19:12:21.884461+0000","last_unstale":"2023-10-14T19:12:21.885494+0000","last_undegraded":"2023-10-14T19:12:21.885494+0000","last_fullsized":"2023-10-14T19:12:21.885494+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:27.131147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143808+0000","last_change":"2023-10-14T19:12:21.140203+0000","last_active":"2023-10-14T19:12:21.143808+0000","last_peered":"2023-10-14T19:12:21.143808+0000","last_clean":"2023-10-14T19:12:21.143808+0000","last_became_active":"2023-10-14T19:12:21.139571+0000","last_became_peered":"2023-10-14T19:12:21.139571+0000","last_unstale":"2023-10-14T19:12:21.143808+0000","last_undegraded":"2023-10-14T19:12:21.143808+0000","last_fullsized":"2023-10-14T19:12:21.143808+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:24.112393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.884938+0000","last_change":"2023-10-14T19:12:21.884938+0000","last_active":"2023-10-14T19:12:21.884938+0000","last_peered":"2023-10-14T19:12:21.884938+0000","last_clean":"2023-10-14T19:12:21.884938+0000","last_became_active":"2023-10-14T19:12:21.884578+0000","last_became_peered":"2023-10-14T19:12:21.884578+0000","last_unstale":"2023-10-14T19:12:21.884938+0000","last_undegraded":"2023-10-14T19:12:21.884938+0000","last_fullsized":"2023-10-14T19:12:21.884938+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:20:48.976251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.139666+0000","last_change":"2023-10-14T19:12:21.137885+0000","last_active":"2023-10-14T19:12:21.139666+0000","last_peered":"2023-10-14T19:12:21.139666+0000","last_clean":"2023-10-14T19:12:21.139666+0000","last_became_active":"2023-10-14T19:12:21.137616+0000","last_became_peered":"2023-10-14T19:12:21.137616+0000","last_unstale":"2023-10-14T19:12:21.139666+0000","last_undegraded":"2023-10-14T19:12:21.139666+0000","last_fullsized":"2023-10-14T19:12:21.139666+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:07.539866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880200+0000","last_change":"2023-10-14T19:12:21.880200+0000","last_active":"2023-10-14T19:12:21.880200+0000","last_peered":"2023-10-14T19:12:21.880200+0000","last_clean":"2023-10-14T19:12:21.880200+0000","last_became_active":"2023-10-14T19:12:21.879905+0000","last_became_peered":"2023-10-14T19:12:21.879905+0000","last_unstale":"2023-10-14T19:12:21.880200+0000","last_undegraded":"2023-10-14T19:12:21.880200+0000","last_fullsized":"2023-10-14T19:12:21.880200+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:53.334984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.149319+0000","last_change":"2023-10-14T19:12:21.144673+0000","last_active":"2023-10-14T19:12:21.149319+0000","last_peered":"2023-10-14T19:12:21.149319+0000","last_clean":"2023-10-14T19:12:21.149319+0000","last_became_active":"2023-10-14T19:12:21.144343+0000","last_became_peered":"2023-10-14T19:12:21.144343+0000","last_unstale":"2023-10-14T19:12:21.149319+0000","last_undegraded":"2023-10-14T19:12:21.149319+0000","last_fullsized":"2023-10-14T19:12:21.149319+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:35.869528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888662+0000","last_change":"2023-10-14T19:12:21.888662+0000","last_active":"2023-10-14T19:12:21.888662+0000","last_peered":"2023-10-14T19:12:21.888662+0000","last_clean":"2023-10-14T19:12:21.888662+0000","last_became_active":"2023-10-14T19:12:21.888406+0000","last_became_peered":"2023-10-14T19:12:21.888406+0000","last_unstale":"2023-10-14T19:12:21.888662+0000","last_undegraded":"2023-10-14T19:12:21.888662+0000","last_fullsized":"2023-10-14T19:12:21.888662+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:02.403744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"199'3","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.154237+0000","last_change":"2023-10-14T19:12:21.136734+0000","last_active":"2023-10-14T19:12:22.154237+0000","last_peered":"2023-10-14T19:12:22.154237+0000","last_clean":"2023-10-14T19:12:22.154237+0000","last_became_active":"2023-10-14T19:12:21.136468+0000","last_became_peered":"2023-10-14T19:12:21.136468+0000","last_unstale":"2023-10-14T19:12:22.154237+0000","last_undegraded":"2023-10-14T19:12:22.154237+0000","last_fullsized":"2023-10-14T19:12:22.154237+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:46.546410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.877998+0000","last_change":"2023-10-14T19:12:21.877998+0000","last_active":"2023-10-14T19:12:21.877998+0000","last_peered":"2023-10-14T19:12:21.877998+0000","last_clean":"2023-10-14T19:12:21.877998+0000","last_became_active":"2023-10-14T19:12:21.877725+0000","last_became_peered":"2023-10-14T19:12:21.877725+0000","last_unstale":"2023-10-14T19:12:21.877998+0000","last_undegraded":"2023-10-14T19:12:21.877998+0000","last_fullsized":"2023-10-14T19:12:21.877998+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:05.904265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"199'6","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.152266+0000","last_change":"2023-10-14T19:12:21.146318+0000","last_active":"2023-10-14T19:12:22.152266+0000","last_peered":"2023-10-14T19:12:22.152266+0000","last_clean":"2023-10-14T19:12:22.152266+0000","last_became_active":"2023-10-14T19:12:21.145775+0000","last_became_peered":"2023-10-14T19:12:21.145775+0000","last_unstale":"2023-10-14T19:12:22.152266+0000","last_undegraded":"2023-10-14T19:12:22.152266+0000","last_fullsized":"2023-10-14T19:12:22.152266+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:57.205409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880725+0000","last_change":"2023-10-14T19:12:21.880725+0000","last_active":"2023-10-14T19:12:21.880725+0000","last_peered":"2023-10-14T19:12:21.880725+0000","last_clean":"2023-10-14T19:12:21.880725+0000","last_became_active":"2023-10-14T19:12:21.880475+0000","last_became_peered":"2023-10-14T19:12:21.880475+0000","last_unstale":"2023-10-14T19:12:21.880725+0000","last_undegraded":"2023-10-14T19:12:21.880725+0000","last_fullsized":"2023-10-14T19:12:21.880725+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:32.555402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.153788+0000","last_change":"2023-10-14T19:12:21.142130+0000","last_active":"2023-10-14T19:12:22.153788+0000","last_peered":"2023-10-14T19:12:22.153788+0000","last_clean":"2023-10-14T19:12:22.153788+0000","last_became_active":"2023-10-14T19:12:21.140579+0000","last_became_peered":"2023-10-14T19:12:21.140579+0000","last_unstale":"2023-10-14T19:12:22.153788+0000","last_undegraded":"2023-10-14T19:12:22.153788+0000","last_fullsized":"2023-10-14T19:12:22.153788+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:39.176942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.879234+0000","last_change":"2023-10-14T19:12:21.879234+0000","last_active":"2023-10-14T19:12:21.879234+0000","last_peered":"2023-10-14T19:12:21.879234+0000","last_clean":"2023-10-14T19:12:21.879234+0000","last_became_active":"2023-10-14T19:12:21.878967+0000","last_became_peered":"2023-10-14T19:12:21.878967+0000","last_unstale":"2023-10-14T19:12:21.879234+0000","last_undegraded":"2023-10-14T19:12:21.879234+0000","last_fullsized":"2023-10-14T19:12:21.879234+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:15:31.118654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143301+0000","last_change":"2023-10-14T19:12:21.139855+0000","last_active":"2023-10-14T19:12:21.143301+0000","last_peered":"2023-10-14T19:12:21.143301+0000","last_clean":"2023-10-14T19:12:21.143301+0000","last_became_active":"2023-10-14T19:12:21.139398+0000","last_became_peered":"2023-10-14T19:12:21.139398+0000","last_unstale":"2023-10-14T19:12:21.143301+0000","last_undegraded":"2023-10-14T19:12:21.143301+0000","last_fullsized":"2023-10-14T19:12:21.143301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:01:17.322015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.872520+0000","last_change":"2023-10-14T19:12:21.872520+0000","last_active":"2023-10-14T19:12:21.872520+0000","last_peered":"2023-10-14T19:12:21.872520+0000","last_clean":"2023-10-14T19:12:21.872520+0000","last_became_active":"2023-10-14T19:12:21.872254+0000","last_became_peered":"2023-10-14T19:12:21.872254+0000","last_unstale":"2023-10-14T19:12:21.872520+0000","last_undegraded":"2023-10-14T19:12:21.872520+0000","last_fullsized":"2023-10-14T19:12:21.872520+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:01:01.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.137078+0000","last_change":"2023-10-14T19:12:21.134610+0000","last_active":"2023-10-14T19:12:21.137078+0000","last_peered":"2023-10-14T19:12:21.137078+0000","last_clean":"2023-10-14T19:12:21.137078+0000","last_became_active":"2023-10-14T19:12:21.134280+0000","last_became_peered":"2023-10-14T19:12:21.134280+0000","last_unstale":"2023-10-14T19:12:21.137078+0000","last_undegraded":"2023-10-14T19:12:21.137078+0000","last_fullsized":"2023-10-14T19:12:21.137078+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:16.361956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.876295+0000","last_change":"2023-10-14T19:12:21.876295+0000","last_active":"2023-10-14T19:12:21.876295+0000","last_peered":"2023-10-14T19:12:21.876295+0000","last_clean":"2023-10-14T19:12:21.876295+0000","last_became_active":"2023-10-14T19:12:21.876018+0000","last_became_peered":"2023-10-14T19:12:21.876018+0000","last_unstale":"2023-10-14T19:12:21.876295+0000","last_undegraded":"2023-10-14T19:12:21.876295+0000","last_fullsized":"2023-10-14T19:12:21.876295+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:39.103078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"199'8","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.155777+0000","last_change":"2023-10-14T19:12:21.138079+0000","last_active":"2023-10-14T19:12:22.155777+0000","last_peered":"2023-10-14T19:12:22.155777+0000","last_clean":"2023-10-14T19:12:22.155777+0000","last_became_active":"2023-10-14T19:12:21.137796+0000","last_became_peered":"2023-10-14T19:12:21.137796+0000","last_unstale":"2023-10-14T19:12:22.155777+0000","last_undegraded":"2023-10-14T19:12:22.155777+0000","last_fullsized":"2023-10-14T19:12:22.155777+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:45.603161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885829+0000","last_change":"2023-10-14T19:12:21.885829+0000","last_active":"2023-10-14T19:12:21.885829+0000","last_peered":"2023-10-14T19:12:21.885829+0000","last_clean":"2023-10-14T19:12:21.885829+0000","last_became_active":"2023-10-14T19:12:21.885552+0000","last_became_peered":"2023-10-14T19:12:21.885552+0000","last_unstale":"2023-10-14T19:12:21.885829+0000","last_undegraded":"2023-10-14T19:12:21.885829+0000","last_fullsized":"2023-10-14T19:12:21.885829+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:15.700512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882880+0000","last_change":"2023-10-14T19:12:21.144933+0000","last_active":"2023-10-14T19:12:21.882880+0000","last_peered":"2023-10-14T19:12:21.882880+0000","last_clean":"2023-10-14T19:12:21.882880+0000","last_became_active":"2023-10-14T19:12:21.144685+0000","last_became_peered":"2023-10-14T19:12:21.144685+0000","last_unstale":"2023-10-14T19:12:21.882880+0000","last_undegraded":"2023-10-14T19:12:21.882880+0000","last_fullsized":"2023-10-14T19:12:21.882880+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.881478+0000","last_change":"2023-10-14T19:12:21.881478+0000","last_active":"2023-10-14T19:12:21.881478+0000","last_peered":"2023-10-14T19:12:21.881478+0000","last_clean":"2023-10-14T19:12:21.881478+0000","last_became_active":"2023-10-14T19:12:21.881191+0000","last_became_peered":"2023-10-14T19:12:21.881191+0000","last_unstale":"2023-10-14T19:12:21.881478+0000","last_undegraded":"2023-10-14T19:12:21.881478+0000","last_fullsized":"2023-10-14T19:12:21.881478+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:40:39.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.151065+0000","last_change":"2023-10-14T19:12:21.142347+0000","last_active":"2023-10-14T19:12:22.151065+0000","last_peered":"2023-10-14T19:12:22.151065+0000","last_clean":"2023-10-14T19:12:22.151065+0000","last_became_active":"2023-10-14T19:12:21.142049+0000","last_became_peered":"2023-10-14T19:12:21.142049+0000","last_unstale":"2023-10-14T19:12:22.151065+0000","last_undegraded":"2023-10-14T19:12:22.151065+0000","last_fullsized":"2023-10-14T19:12:22.151065+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:35:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883704+0000","last_change":"2023-10-14T19:12:21.883704+0000","last_active":"2023-10-14T19:12:21.883704+0000","last_peered":"2023-10-14T19:12:21.883704+0000","last_clean":"2023-10-14T19:12:21.883704+0000","last_became_active":"2023-10-14T19:12:21.883180+0000","last_became_peered":"2023-10-14T19:12:21.883180+0000","last_unstale":"2023-10-14T19:12:21.883704+0000","last_undegraded":"2023-10-14T19:12:21.883704+0000","last_fullsized":"2023-10-14T19:12:21.883704+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:01.930241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.876018+0000","last_change":"2023-10-14T19:12:21.140971+0000","last_active":"2023-10-14T19:12:21.876018+0000","last_peered":"2023-10-14T19:12:21.876018+0000","last_clean":"2023-10-14T19:12:21.876018+0000","last_became_active":"2023-10-14T19:12:21.140717+0000","last_became_peered":"2023-10-14T19:12:21.140717+0000","last_unstale":"2023-10-14T19:12:21.876018+0000","last_undegraded":"2023-10-14T19:12:21.876018+0000","last_fullsized":"2023-10-14T19:12:21.876018+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T07:07:41.332243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883782+0000","last_change":"2023-10-14T19:12:21.883782+0000","last_active":"2023-10-14T19:12:21.883782+0000","last_peered":"2023-10-14T19:12:21.883782+0000","last_clean":"2023-10-14T19:12:21.883782+0000","last_became_active":"2023-10-14T19:12:21.882911+0000","last_became_peered":"2023-10-14T19:12:21.882911+0000","last_unstale":"2023-10-14T19:12:21.883782+0000","last_undegraded":"2023-10-14T19:12:21.883782+0000","last_fullsized":"2023-10-14T19:12:21.883782+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:48:41.288173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.147179+0000","last_change":"2023-10-14T19:12:21.146073+0000","last_active":"2023-10-14T19:12:21.147179+0000","last_peered":"2023-10-14T19:12:21.147179+0000","last_clean":"2023-10-14T19:12:21.147179+0000","last_became_active":"2023-10-14T19:12:21.145361+0000","last_became_peered":"2023-10-14T19:12:21.145361+0000","last_unstale":"2023-10-14T19:12:21.147179+0000","last_undegraded":"2023-10-14T19:12:21.147179+0000","last_fullsized":"2023-10-14T19:12:21.147179+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:05:13.097459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880420+0000","last_change":"2023-10-14T19:12:21.880420+0000","last_active":"2023-10-14T19:12:21.880420+0000","last_peered":"2023-10-14T19:12:21.880420+0000","last_clean":"2023-10-14T19:12:21.880420+0000","last_became_active":"2023-10-14T19:12:21.880125+0000","last_became_peered":"2023-10-14T19:12:21.880125+0000","last_unstale":"2023-10-14T19:12:21.880420+0000","last_undegraded":"2023-10-14T19:12:21.880420+0000","last_fullsized":"2023-10-14T19:12:21.880420+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:19.081988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.155387+0000","last_change":"2023-10-14T19:12:21.142244+0000","last_active":"2023-10-14T19:12:22.155387+0000","last_peered":"2023-10-14T19:12:22.155387+0000","last_clean":"2023-10-14T19:12:22.155387+0000","last_became_active":"2023-10-14T19:12:21.141873+0000","last_became_peered":"2023-10-14T19:12:21.141873+0000","last_unstale":"2023-10-14T19:12:22.155387+0000","last_undegraded":"2023-10-14T19:12:22.155387+0000","last_fullsized":"2023-10-14T19:12:22.155387+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:27.090275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885621+0000","last_change":"2023-10-14T19:12:21.885621+0000","last_active":"2023-10-14T19:12:21.885621+0000","last_peered":"2023-10-14T19:12:21.885621+0000","last_clean":"2023-10-14T19:12:21.885621+0000","last_became_active":"2023-10-14T19:12:21.885326+0000","last_became_peered":"2023-10-14T19:12:21.885326+0000","last_unstale":"2023-10-14T19:12:21.885621+0000","last_undegraded":"2023-10-14T19:12:21.885621+0000","last_fullsized":"2023-10-14T19:12:21.885621+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:36.873482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.144288+0000","last_change":"2023-10-14T19:12:21.141648+0000","last_active":"2023-10-14T19:12:21.144288+0000","last_peered":"2023-10-14T19:12:21.144288+0000","last_clean":"2023-10-14T19:12:21.144288+0000","last_became_active":"2023-10-14T19:12:21.141383+0000","last_became_peered":"2023-10-14T19:12:21.141383+0000","last_unstale":"2023-10-14T19:12:21.144288+0000","last_undegraded":"2023-10-14T19:12:21.144288+0000","last_fullsized":"2023-10-14T19:12:21.144288+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:22.888336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885248+0000","last_change":"2023-10-14T19:12:21.885248+0000","last_active":"2023-10-14T19:12:21.885248+0000","last_peered":"2023-10-14T19:12:21.885248+0000","last_clean":"2023-10-14T19:12:21.885248+0000","last_became_active":"2023-10-14T19:12:21.884993+0000","last_became_peered":"2023-10-14T19:12:21.884993+0000","last_unstale":"2023-10-14T19:12:21.885248+0000","last_undegraded":"2023-10-14T19:12:21.885248+0000","last_fullsized":"2023-10-14T19:12:21.885248+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:45.114366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.141634+0000","last_change":"2023-10-14T19:12:21.137687+0000","last_active":"2023-10-14T19:12:21.141634+0000","last_peered":"2023-10-14T19:12:21.141634+0000","last_clean":"2023-10-14T19:12:21.141634+0000","last_became_active":"2023-10-14T19:12:21.135626+0000","last_became_peered":"2023-10-14T19:12:21.135626+0000","last_unstale":"2023-10-14T19:12:21.141634+0000","last_undegraded":"2023-10-14T19:12:21.141634+0000","last_fullsized":"2023-10-14T19:12:21.141634+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:09:37.424571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.883194+0000","last_change":"2023-10-14T19:12:21.883194+0000","last_active":"2023-10-14T19:12:21.883194+0000","last_peered":"2023-10-14T19:12:21.883194+0000","last_clean":"2023-10-14T19:12:21.883194+0000","last_became_active":"2023-10-14T19:12:21.882936+0000","last_became_peered":"2023-10-14T19:12:21.882936+0000","last_unstale":"2023-10-14T19:12:21.883194+0000","last_undegraded":"2023-10-14T19:12:21.883194+0000","last_fullsized":"2023-10-14T19:12:21.883194+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:36.705150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143328+0000","last_change":"2023-10-14T19:12:21.141059+0000","last_active":"2023-10-14T19:12:21.143328+0000","last_peered":"2023-10-14T19:12:21.143328+0000","last_clean":"2023-10-14T19:12:21.143328+0000","last_became_active":"2023-10-14T19:12:21.140810+0000","last_became_peered":"2023-10-14T19:12:21.140810+0000","last_unstale":"2023-10-14T19:12:21.143328+0000","last_undegraded":"2023-10-14T19:12:21.143328+0000","last_fullsized":"2023-10-14T19:12:21.143328+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:27.615137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.888318+0000","last_change":"2023-10-14T19:12:21.888318+0000","last_active":"2023-10-14T19:12:21.888318+0000","last_peered":"2023-10-14T19:12:21.888318+0000","last_clean":"2023-10-14T19:12:21.888318+0000","last_became_active":"2023-10-14T19:12:21.887969+0000","last_became_peered":"2023-10-14T19:12:21.887969+0000","last_unstale":"2023-10-14T19:12:21.888318+0000","last_undegraded":"2023-10-14T19:12:21.888318+0000","last_fullsized":"2023-10-14T19:12:21.888318+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:09:38.428525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:22.153168+0000","last_change":"2023-10-14T19:12:21.142901+0000","last_active":"2023-10-14T19:12:22.153168+0000","last_peered":"2023-10-14T19:12:22.153168+0000","last_clean":"2023-10-14T19:12:22.153168+0000","last_became_active":"2023-10-14T19:12:21.142621+0000","last_became_peered":"2023-10-14T19:12:21.142621+0000","last_unstale":"2023-10-14T19:12:22.153168+0000","last_undegraded":"2023-10-14T19:12:22.153168+0000","last_fullsized":"2023-10-14T19:12:22.153168+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:35:13.542194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.889162+0000","last_change":"2023-10-14T19:12:21.889162+0000","last_active":"2023-10-14T19:12:21.889162+0000","last_peered":"2023-10-14T19:12:21.889162+0000","last_clean":"2023-10-14T19:12:21.889162+0000","last_became_active":"2023-10-14T19:12:21.888880+0000","last_became_peered":"2023-10-14T19:12:21.888880+0000","last_unstale":"2023-10-14T19:12:21.889162+0000","last_undegraded":"2023-10-14T19:12:21.889162+0000","last_fullsized":"2023-10-14T19:12:21.889162+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:25.116347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.144112+0000","last_change":"2023-10-14T19:12:21.141404+0000","last_active":"2023-10-14T19:12:21.144112+0000","last_peered":"2023-10-14T19:12:21.144112+0000","last_clean":"2023-10-14T19:12:21.144112+0000","last_became_active":"2023-10-14T19:12:21.141143+0000","last_became_peered":"2023-10-14T19:12:21.141143+0000","last_unstale":"2023-10-14T19:12:21.144112+0000","last_undegraded":"2023-10-14T19:12:21.144112+0000","last_fullsized":"2023-10-14T19:12:21.144112+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:32.277398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.881085+0000","last_change":"2023-10-14T19:12:21.881085+0000","last_active":"2023-10-14T19:12:21.881085+0000","last_peered":"2023-10-14T19:12:21.881085+0000","last_clean":"2023-10-14T19:12:21.881085+0000","last_became_active":"2023-10-14T19:12:21.880824+0000","last_became_peered":"2023-10-14T19:12:21.880824+0000","last_unstale":"2023-10-14T19:12:21.881085+0000","last_undegraded":"2023-10-14T19:12:21.881085+0000","last_fullsized":"2023-10-14T19:12:21.881085+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:35.867989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.141970+0000","last_change":"2023-10-14T19:12:21.138583+0000","last_active":"2023-10-14T19:12:21.141970+0000","last_peered":"2023-10-14T19:12:21.141970+0000","last_clean":"2023-10-14T19:12:21.141970+0000","last_became_active":"2023-10-14T19:12:21.138287+0000","last_became_peered":"2023-10-14T19:12:21.138287+0000","last_unstale":"2023-10-14T19:12:21.141970+0000","last_undegraded":"2023-10-14T19:12:21.141970+0000","last_fullsized":"2023-10-14T19:12:21.141970+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:32.069273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.891298+0000","last_change":"2023-10-14T19:12:21.891298+0000","last_active":"2023-10-14T19:12:21.891298+0000","last_peered":"2023-10-14T19:12:21.891298+0000","last_clean":"2023-10-14T19:12:21.891298+0000","last_became_active":"2023-10-14T19:12:21.891028+0000","last_became_peered":"2023-10-14T19:12:21.891028+0000","last_unstale":"2023-10-14T19:12:21.891298+0000","last_undegraded":"2023-10-14T19:12:21.891298+0000","last_fullsized":"2023-10-14T19:12:21.891298+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:43.064128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.146336+0000","last_change":"2023-10-14T19:12:21.143946+0000","last_active":"2023-10-14T19:12:21.146336+0000","last_peered":"2023-10-14T19:12:21.146336+0000","last_clean":"2023-10-14T19:12:21.146336+0000","last_became_active":"2023-10-14T19:12:21.143551+0000","last_became_peered":"2023-10-14T19:12:21.143551+0000","last_unstale":"2023-10-14T19:12:21.146336+0000","last_undegraded":"2023-10-14T19:12:21.146336+0000","last_fullsized":"2023-10-14T19:12:21.146336+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:48.553620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.881171+0000","last_change":"2023-10-14T19:12:21.881171+0000","last_active":"2023-10-14T19:12:21.881171+0000","last_peered":"2023-10-14T19:12:21.881171+0000","last_clean":"2023-10-14T19:12:21.881171+0000","last_became_active":"2023-10-14T19:12:21.880896+0000","last_became_peered":"2023-10-14T19:12:21.880896+0000","last_unstale":"2023-10-14T19:12:21.881171+0000","last_undegraded":"2023-10-14T19:12:21.881171+0000","last_fullsized":"2023-10-14T19:12:21.881171+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:51.749613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143576+0000","last_change":"2023-10-14T19:12:21.141590+0000","last_active":"2023-10-14T19:12:21.143576+0000","last_peered":"2023-10-14T19:12:21.143576+0000","last_clean":"2023-10-14T19:12:21.143576+0000","last_became_active":"2023-10-14T19:12:21.140825+0000","last_became_peered":"2023-10-14T19:12:21.140825+0000","last_unstale":"2023-10-14T19:12:21.143576+0000","last_undegraded":"2023-10-14T19:12:21.143576+0000","last_fullsized":"2023-10-14T19:12:21.143576+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:23:22.384997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885709+0000","last_change":"2023-10-14T19:12:21.885709+0000","last_active":"2023-10-14T19:12:21.885709+0000","last_peered":"2023-10-14T19:12:21.885709+0000","last_clean":"2023-10-14T19:12:21.885709+0000","last_became_active":"2023-10-14T19:12:21.885100+0000","last_became_peered":"2023-10-14T19:12:21.885100+0000","last_unstale":"2023-10-14T19:12:21.885709+0000","last_undegraded":"2023-10-14T19:12:21.885709+0000","last_fullsized":"2023-10-14T19:12:21.885709+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:49.379566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.143458+0000","last_change":"2023-10-14T19:12:21.138932+0000","last_active":"2023-10-14T19:12:21.143458+0000","last_peered":"2023-10-14T19:12:21.143458+0000","last_clean":"2023-10-14T19:12:21.143458+0000","last_became_active":"2023-10-14T19:12:21.138646+0000","last_became_peered":"2023-10-14T19:12:21.138646+0000","last_unstale":"2023-10-14T19:12:21.143458+0000","last_undegraded":"2023-10-14T19:12:21.143458+0000","last_fullsized":"2023-10-14T19:12:21.143458+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:30.285404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.880203+0000","last_change":"2023-10-14T19:12:21.880203+0000","last_active":"2023-10-14T19:12:21.880203+0000","last_peered":"2023-10-14T19:12:21.880203+0000","last_clean":"2023-10-14T19:12:21.880203+0000","last_became_active":"2023-10-14T19:12:21.879297+0000","last_became_peered":"2023-10-14T19:12:21.879297+0000","last_unstale":"2023-10-14T19:12:21.880203+0000","last_undegraded":"2023-10-14T19:12:21.880203+0000","last_fullsized":"2023-10-14T19:12:21.880203+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:47.550363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.132961+0000","last_change":"2023-10-14T19:12:21.131384+0000","last_active":"2023-10-14T19:12:21.132961+0000","last_peered":"2023-10-14T19:12:21.132961+0000","last_clean":"2023-10-14T19:12:21.132961+0000","last_became_active":"2023-10-14T19:12:21.131059+0000","last_became_peered":"2023-10-14T19:12:21.131059+0000","last_unstale":"2023-10-14T19:12:21.132961+0000","last_undegraded":"2023-10-14T19:12:21.132961+0000","last_fullsized":"2023-10-14T19:12:21.132961+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:20.812123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.882366+0000","last_change":"2023-10-14T19:12:21.882366+0000","last_active":"2023-10-14T19:12:21.882366+0000","last_peered":"2023-10-14T19:12:21.882366+0000","last_clean":"2023-10-14T19:12:21.882366+0000","last_became_active":"2023-10-14T19:12:21.882087+0000","last_became_peered":"2023-10-14T19:12:21.882087+0000","last_unstale":"2023-10-14T19:12:21.882366+0000","last_undegraded":"2023-10-14T19:12:21.882366+0000","last_fullsized":"2023-10-14T19:12:21.882366+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:40:42.368157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.136552+0000","last_change":"2023-10-14T19:12:21.131760+0000","last_active":"2023-10-14T19:12:21.136552+0000","last_peered":"2023-10-14T19:12:21.136552+0000","last_clean":"2023-10-14T19:12:21.136552+0000","last_became_active":"2023-10-14T19:12:21.130954+0000","last_became_peered":"2023-10-14T19:12:21.130954+0000","last_unstale":"2023-10-14T19:12:21.136552+0000","last_undegraded":"2023-10-14T19:12:21.136552+0000","last_fullsized":"2023-10-14T19:12:21.136552+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:20.115885+0000","last_clean_scrub_stamp":"2023-10-14T19:12:20.115885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:39.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.885792+0000","last_change":"2023-10-14T19:12:21.885792+0000","last_active":"2023-10-14T19:12:21.885792+0000","last_peered":"2023-10-14T19:12:21.885792+0000","last_clean":"2023-10-14T19:12:21.885792+0000","last_became_active":"2023-10-14T19:12:21.884796+0000","last_became_peered":"2023-10-14T19:12:21.884796+0000","last_unstale":"2023-10-14T19:12:21.885792+0000","last_undegraded":"2023-10-14T19:12:21.885792+0000","last_fullsized":"2023-10-14T19:12:21.885792+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:12:21.119839+0000","last_clean_scrub_stamp":"2023-10-14T19:12:21.119839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:40.314070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-14T19:12:21.141320+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:12:21.141320+0000","last_peered":"2023-10-14T19:12:21.141320+0000","last_clean":"2023-10-14T19:12:21.141320+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:12:21.141320+0000","last_undegraded":"2023-10-14T19:12:21.141320+0000","last_fullsized":"2023-10-14T19:12:21.141320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304436,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067404,"statfs":{"total":96636764160,"available":96325021696,"internally_reserved":0,"allocated":3125248,"data_stored":1727781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.624},"min":{"1min":0.32100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.755,"5min":0.75700000000000001,"15min":4.2080000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.502,"15min":0.623},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.1949999999999998},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.628},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":2.3610000000000002},"last":0.49299999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.69599999999999995},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83599999999999997,"15min":4.0679999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":3.23},"last":0.67400000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.71099999999999997},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.79300000000000004,"15min":4.1269999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60699999999999998,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.40600000000000003,"15min":0.38300000000000001},"max":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":3.3450000000000002},"last":0.70999999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.875,"15min":2.4620000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82299999999999995,"5min":0.97299999999999998,"15min":4.5389999999999997},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.60899999999999999},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":3.4119999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54000000000000004,"15min":0.623},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":2.883},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 14 19:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.63900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":2.7130000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58899999999999997,"15min":0.73299999999999998},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86699999999999999,"5min":0.91400000000000003,"15min":5.383},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1137447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.64200000000000002},"min":{"1min":0.38500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.996,"5min":0.996,"15min":5.7030000000000003},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.69099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.72099999999999997,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.71199999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.032,"5min":1.032,"15min":8.0210000000000008},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.58999999999999997,"15min":0.76300000000000001},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54900000000000004,"15min":0.72399999999999998},"min":{"1min":0.33700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.204,"5min":1.204,"15min":8.1890000000000001},"last":0.438},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55300000000000005,"15min":0.73699999999999999},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.67400000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.316},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.39200000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42199999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78100000000000003,"5min":0.81699999999999995,"15min":0.84599999999999997},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307952,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063888,"statfs":{"total":96636764160,"available":96321421312,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32400000000000001,"15min":0.314},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63500000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.624,"15min":0.67300000000000004},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.216},"max":{"1min":0.45800000000000002,"5min":0.873,"15min":0.873},"last":0.27900000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":1.032},"last":0.623}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.85499999999999998,"15min":1.0620000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.57999999999999996},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"max":{"1min":0.85699999999999998,"5min":1.627,"15min":1.627},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90100000000000002,"5min":0.91300000000000003,"15min":0.99399999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.91600000000000004,"15min":1.079},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.38800000000000001},"max":{"1min":0.746,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":1.0409999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308532,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063308,"statfs":{"total":96636764160,"available":96320827392,"internally_reserved":0,"allocated":3125248,"data_stored":1727781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.34399999999999997},"min":{"1min":0.25800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47599999999999998,"5min":0.51600000000000001,"15min":0.53200000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.495,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55400000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.62},"last":0.37},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.29699999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77400000000000002,"5min":0.90600000000000003,"15min":0.92900000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.39200000000000002},"max":{"1min":0.90700000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.96199999999999997,"15min":0.98799999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.51100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.91900000000000004,"15min":0.95599999999999996},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63700000000000001},"min":{"1min":0.501,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.88700000000000001,"15min":0.96599999999999997},"last":0.59399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.46000000000000002,"5min":0.60499999999999998,"15min":0.60699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36499999999999999,"15min":0.41599999999999998},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":0.65800000000000003,"15min":2.028},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.49199999999999999,"5min":0.55600000000000005,"15min":0.56499999999999995},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38300000000000001,"15min":0.65100000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56899999999999995,"5min":0.60199999999999998,"15min":11.269},"last":0.35999999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35299999999999998,"15min":0.622},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.56200000000000006,"15min":11.318},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.52500000000000002,"5min":0.69899999999999995,"15min":0.69999999999999996},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":0.997,"15min":0.997},"last":0.621},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.65200000000000002},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.97899999999999998,"15min":1.9299999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59899999999999998,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.9710000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.90400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72399999999999998,"5min":0.93200000000000005,"15min":11.379},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.627,"15min":0.90800000000000003},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.78200000000000003,"5min":0.98699999999999999,"15min":11.404},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.64800000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.746}]},{"osd":7,"last update":"Sat Oct 14 19:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63200000000000001,"15min":0.67500000000000004},"min":{"1min":0.44400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78200000000000003,"5min":0.94899999999999995,"15min":2.0009999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.92200000000000004},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.82399999999999995,"5min":0.99399999999999999,"15min":11.351000000000001},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.34699999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.47699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.35599999999999998,"15min":0.379},"min":{"1min":0.29399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53100000000000003,"5min":0.60099999999999998,"15min":0.70099999999999996},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.35499999999999998,"15min":0.36299999999999999},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56899999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.316}]},{"osd":2,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60299999999999998,"5min":0.65900000000000003,"15min":0.81000000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.78400000000000003,"5min":2.597,"15min":2.597},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79200000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":1.214,"15min":1.214},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.75800000000000001,"5min":1.133,"15min":1.133},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76700000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.754}]},{"osd":7,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82799999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83899999999999997,"5min":0.997,"15min":0.997},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1138949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72599999999999998,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88400000000000001,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76700000000000002,"5min":0.85699999999999998,"15min":5.7830000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2709999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.56000000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56899999999999995},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.86499999999999999,"5min":1.589,"15min":1.589},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5529999999999999,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.378},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.5269999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.57299999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.622},"min":{"1min":0.42299999999999999,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.59099999999999997},"min":{"1min":0.46100000000000002,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":0.83999999999999997,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85299999999999998,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1137413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.502,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.81899999999999995,"5min":1.194,"15min":1.194},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72899999999999998,"5min":1.784,"15min":1.784},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.879,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.35099999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77900000000000003,"5min":0.83299999999999996,"15min":0.876},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.60599999999999998,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56100000000000005,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91700000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71599999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72499999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72999999999999998,"5min":1.234,"15min":1.234},"last":0.72299999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71299999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58599999999999997,"15min":0.60599999999999998},"min":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":1.008,"15min":1.008},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:12:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T19:12:26.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T19:12:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.796+0000 7fafd79eb700 1 Processor -- start 2023-10-14T19:12:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.796+0000 7fafd79eb700 1 -- start start 2023-10-14T19:12:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd79eb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006dc70 0x7fafd0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd79eb700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fafd006e0e0 0x7fafd00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd79eb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00ccfd0 con 0x7fafd0159530 2023-10-14T19:12:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd79eb700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd015a3d0 con 0x7fafd006e0e0 2023-10-14T19:12:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd79eb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd015a6b0 con 0x7fafd006dc70 2023-10-14T19:12:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fafd006e0e0 0x7fafd00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fafd006e0e0 0x7fafd00cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50184/0 (socket says 172.21.15.7:50184) 2023-10-14T19:12:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 -- 172.21.15.7:0/3248764929 learned_addr learned my addr 172.21.15.7:0/3248764929 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd4f86700 1 --2- 172.21.15.7:0/3248764929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006dc70 0x7fafd0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 -- 172.21.15.7:0/3248764929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006dc70 msgr2=0x7fafd0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 --2- 172.21.15.7:0/3248764929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006dc70 0x7fafd0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 -- 172.21.15.7:0/3248764929 >> v1:172.21.15.148:6789/0 conn(0x7fafd0159530 legacy=0x7fafd00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 -- 172.21.15.7:0/3248764929 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd015a990 con 0x7fafd006e0e0 2023-10-14T19:12:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.797+0000 7fafd5f88700 1 --2- 172.21.15.7:0/3248764929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd006e0e0 0x7fafd00cb6f0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009f20 tx=0x7fafc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf27081fba738a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafcffff700 1 -- 172.21.15.7:0/3248764929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000e070 con 0x7fafd006e0e0 2023-10-14T19:12:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafcffff700 1 -- 172.21.15.7:0/3248764929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc000ba80 con 0x7fafd006e0e0 2023-10-14T19:12:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafcffff700 1 -- 172.21.15.7:0/3248764929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00092e0 con 0x7fafd006e0e0 2023-10-14T19:12:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 -- 172.21.15.7:0/3248764929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd006e0e0 msgr2=0x7fafd00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 --2- 172.21.15.7:0/3248764929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd006e0e0 0x7fafd00cb6f0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009f20 tx=0x7fafc0009840 comp rx=0 tx=0).stop 2023-10-14T19:12:26.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 -- 172.21.15.7:0/3248764929 shutdown_connections 2023-10-14T19:12:26.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 --2- 172.21.15.7:0/3248764929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd006e0e0 0x7fafd00cb6f0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 --2- 172.21.15.7:0/3248764929 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006dc70 0x7fafd0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.803 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 -- 172.21.15.7:0/3248764929 >> 172.21.15.7:0/3248764929 conn(0x7fafd00703a0 msgr2=0x7fafd00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:26.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 -- 172.21.15.7:0/3248764929 shutdown_connections 2023-10-14T19:12:26.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.798+0000 7fafd79eb700 1 -- 172.21.15.7:0/3248764929 wait complete. 2023-10-14T19:12:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.799+0000 7fafd79eb700 1 Processor -- start 2023-10-14T19:12:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.799+0000 7fafd79eb700 1 -- start start 2023-10-14T19:12:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd79eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd006dc70 0x7fafd00b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd79eb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006e0e0 0x7fafd00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd79eb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 0x7fafd0154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd79eb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0158e10 con 0x7fafd0159530 2023-10-14T19:12:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd79eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd016d370 con 0x7fafd006dc70 2023-10-14T19:12:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd79eb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd016d650 con 0x7fafd006e0e0 2023-10-14T19:12:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd5f88700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 0x7fafd0154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd5f88700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 0x7fafd0154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50186/0 (socket says 172.21.15.7:50186) 2023-10-14T19:12:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.800+0000 7fafd5f88700 1 -- 172.21.15.7:0/2913954987 learned_addr learned my addr 172.21.15.7:0/2913954987 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd4f86700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006e0e0 0x7fafd00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5787700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd006dc70 0x7fafd00b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5f88700 1 -- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006e0e0 msgr2=0x7fafd00cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5f88700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006e0e0 0x7fafd00cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5f88700 1 -- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd006dc70 msgr2=0x7fafd00b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5f88700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd006dc70 0x7fafd00b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5f88700 1 -- 172.21.15.7:0/2913954987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009ae0 con 0x7fafd0159530 2023-10-14T19:12:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5787700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd006dc70 0x7fafd00b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd5f88700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 0x7fafd0154d40 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fafc0012000 tx=0x7fafc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00032f0 con 0x7fafd0159530 2023-10-14T19:12:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0008dd0 con 0x7fafd0159530 2023-10-14T19:12:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0026690 con 0x7fafd0159530 2023-10-14T19:12:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd016d930 con 0x7fafd0159530 2023-10-14T19:12:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.801+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd00b6430 con 0x7fafd0159530 2023-10-14T19:12:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.802+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd004c3c0 con 0x7fafd0159530 2023-10-14T19:12:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.802+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fafc0003040 con 0x7fafd0159530 2023-10-14T19:12:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.803+0000 7fafcd7fa700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fafbc067320 0x7fafbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.803+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafc0086720 con 0x7fafd0159530 2023-10-14T19:12:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.803+0000 7fafd5787700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fafbc067320 0x7fafbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.804+0000 7fafd5787700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fafbc067320 0x7fafbc0697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fafc8007fd0 tx=0x7fafc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:26.807+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafc00533d0 con 0x7fafd0159530 2023-10-14T19:12:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.077+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fafd015ac70 con 0x7fafd0159530 2023-10-14T19:12:27.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.081+0000 7fafcd7fa700 1 -- 172.21.15.7:0/2913954987 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7fafc00569f0 con 0x7fafd0159530 2023-10-14T19:12:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fafbc067320 msgr2=0x7fafbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fafbc067320 0x7fafbc0697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fafc8007fd0 tx=0x7fafc8009040 comp rx=0 tx=0).stop 2023-10-14T19:12:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 msgr2=0x7fafd0154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 0x7fafd0154d40 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fafc0012000 tx=0x7fafc0018000 comp rx=0 tx=0).stop 2023-10-14T19:12:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 shutdown_connections 2023-10-14T19:12:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fafbc067320 0x7fafbc0697d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd006dc70 0x7fafd00b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0159530 0x7fafd0154d40 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 --2- 172.21.15.7:0/2913954987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd006e0e0 0x7fafd00cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 >> 172.21.15.7:0/2913954987 conn(0x7fafd00703a0 msgr2=0x7fafd00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 shutdown_connections 2023-10-14T19:12:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.083+0000 7fafd79eb700 1 -- 172.21.15.7:0/2913954987 wait complete. 2023-10-14T19:12:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2023-10-14T19:12:27.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:12:27.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.215+0000 7f962a771700 1 Processor -- start 2023-10-14T19:12:27.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.215+0000 7f962a771700 1 -- start start 2023-10-14T19:12:27.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f962a771700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96240cf200 0x7f96240c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:27.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f962a771700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96240b0ba0 0x7f962406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:27.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f962a771700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962415a280 con 0x7f96240b07d0 2023-10-14T19:12:27.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f962a771700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962406e180 con 0x7f96240b0ba0 2023-10-14T19:12:27.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f962a771700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962406d850 con 0x7f96240cf200 2023-10-14T19:12:27.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96240b0ba0 0x7f962406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:27.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96240b0ba0 0x7f962406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50190/0 (socket says 172.21.15.7:50190) 2023-10-14T19:12:27.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 -- 172.21.15.7:0/2100428117 learned_addr learned my addr 172.21.15.7:0/2100428117 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:27.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f96237fe700 1 --2- 172.21.15.7:0/2100428117 >> v2:172.21.15.148:3300/0 conn(0x7f96240cf200 0x7f96240c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:27.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 -- 172.21.15.7:0/2100428117 >> v2:172.21.15.148:3300/0 conn(0x7f96240cf200 msgr2=0x7f96240c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:27.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 --2- 172.21.15.7:0/2100428117 >> v2:172.21.15.148:3300/0 conn(0x7f96240cf200 0x7f96240c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 -- 172.21.15.7:0/2100428117 >> v1:172.21.15.148:6789/0 conn(0x7f96240b07d0 legacy=0x7f96240ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:27.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 -- 172.21.15.7:0/2100428117 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962406db30 con 0x7f96240b0ba0 2023-10-14T19:12:27.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.216+0000 7f9628d0e700 1 --2- 172.21.15.7:0/2100428117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f962406e610 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f96240cab40 tx=0x7f961c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b7d6bff80b1e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:27.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f9622ffd700 1 -- 172.21.15.7:0/2100428117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00e070 con 0x7f96240b0ba0 2023-10-14T19:12:27.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f9622ffd700 1 -- 172.21.15.7:0/2100428117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c00ba10 con 0x7f96240b0ba0 2023-10-14T19:12:27.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f9622ffd700 1 -- 172.21.15.7:0/2100428117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c0092e0 con 0x7f96240b0ba0 2023-10-14T19:12:27.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 -- 172.21.15.7:0/2100428117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 msgr2=0x7f962406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 --2- 172.21.15.7:0/2100428117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f962406e610 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f96240cab40 tx=0x7f961c009840 comp rx=0 tx=0).stop 2023-10-14T19:12:27.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 -- 172.21.15.7:0/2100428117 shutdown_connections 2023-10-14T19:12:27.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 --2- 172.21.15.7:0/2100428117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f962406e610 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 --2- 172.21.15.7:0/2100428117 >> v2:172.21.15.148:3300/0 conn(0x7f96240cf200 0x7f96240c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 -- 172.21.15.7:0/2100428117 >> 172.21.15.7:0/2100428117 conn(0x7f962406ce80 msgr2=0x7f96240ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:27.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 -- 172.21.15.7:0/2100428117 shutdown_connections 2023-10-14T19:12:27.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.217+0000 7f962a771700 1 -- 172.21.15.7:0/2100428117 wait complete. 2023-10-14T19:12:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.218+0000 7f962a771700 1 Processor -- start 2023-10-14T19:12:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.218+0000 7f962a771700 1 -- start start 2023-10-14T19:12:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f962a771700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96240b07d0 0x7f9624152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f962a771700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f9624158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f962a771700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96240cf200 0x7f962416d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f962a771700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624144ab0 con 0x7f96240b0ba0 2023-10-14T19:12:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f962a771700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624143cf0 con 0x7f96240b07d0 2023-10-14T19:12:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f962a771700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9624143fd0 con 0x7f96240cf200 2023-10-14T19:12:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f96237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f9624158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f96237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f9624158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50202/0 (socket says 172.21.15.7:50202) 2023-10-14T19:12:27.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f96237fe700 1 -- 172.21.15.7:0/3323368155 learned_addr learned my addr 172.21.15.7:0/3323368155 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:27.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f9628d0e700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96240cf200 0x7f962416d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:27.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f9623fff700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96240b07d0 0x7f9624152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:27.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f96237fe700 1 -- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96240cf200 msgr2=0x7f962416d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.219+0000 7f96237fe700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96240cf200 0x7f962416d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f96237fe700 1 -- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96240b07d0 msgr2=0x7f9624152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f96237fe700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96240b07d0 0x7f9624152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f96237fe700 1 -- 172.21.15.7:0/3323368155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009ae0 con 0x7f96240b0ba0 2023-10-14T19:12:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f96237fe700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f9624158ad0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f961400d890 tx=0x7f9614008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96140125f0 con 0x7f96240b0ba0 2023-10-14T19:12:27.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614012750 con 0x7f96240b0ba0 2023-10-14T19:12:27.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96241442b0 con 0x7f96240b0ba0 2023-10-14T19:12:27.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614012af0 con 0x7f96240b0ba0 2023-10-14T19:12:27.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.220+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9624159010 con 0x7f96240b0ba0 2023-10-14T19:12:27.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.221+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9624144750 con 0x7f96240b0ba0 2023-10-14T19:12:27.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.221+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f961401e460 con 0x7f96240b0ba0 2023-10-14T19:12:27.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.222+0000 7f961bfff700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9604067320 0x7f96040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:27.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.222+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9614085160 con 0x7f96240b0ba0 2023-10-14T19:12:27.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.222+0000 7f9623fff700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9604067320 0x7f96040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:27.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.223+0000 7f9623fff700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9604067320 0x7f96040697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f960c006fd0 tx=0x7f960c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:27.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.226+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9614051df0 con 0x7f96240b0ba0 2023-10-14T19:12:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.463+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f962406d4f0 con 0x7f96240b0ba0 2023-10-14T19:12:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.464+0000 7f961bfff700 1 -- 172.21.15.7:0/3323368155 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f9614055410 con 0x7f96240b0ba0 2023-10-14T19:12:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:12:27.465 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":132,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:12:21.531996+0000","modified":"2023-10-14T19:12:25.155754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9078":{"gid":9078,"name":"a","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/1294066545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1294066545},{"type":"v1","addr":"172.21.15.7:6835","nonce":1294066545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-14T19:12:27.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9604067320 msgr2=0x7f96040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9604067320 0x7f96040697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f960c006fd0 tx=0x7f960c009060 comp rx=0 tx=0).stop 2023-10-14T19:12:27.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 msgr2=0x7f9624158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:27.467 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f9624158ad0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f961400d890 tx=0x7f9614008040 comp rx=0 tx=0).stop 2023-10-14T19:12:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 shutdown_connections 2023-10-14T19:12:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9604067320 0x7f96040697d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96240b07d0 0x7f9624152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96240cf200 0x7f962416d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 --2- 172.21.15.7:0/3323368155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240b0ba0 0x7f9624158ad0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 >> 172.21.15.7:0/3323368155 conn(0x7f962406ce80 msgr2=0x7f9624069550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 shutdown_connections 2023-10-14T19:12:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:27.466+0000 7f962a771700 1 -- 172.21.15.7:0/3323368155 wait complete. 2023-10-14T19:12:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 132 2023-10-14T19:12:27.874 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-10-14T19:12:27.873+0000 7f5b943ee700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:12:27.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 132, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T19:12:21.531996+0000', 'modified': '2023-10-14T19:12:25.155754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9078}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9078': {'gid': 9078, 'name': 'a', 'rank': 0, 'incarnation': 128, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6835/1294066545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6833', 'nonce': 1294066545}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 1294066545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T19:12:27.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T19:12:27.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T19:12:28.003 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.002+0000 7f21191dd700 1 Processor -- start 2023-10-14T19:12:28.004 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 -- start start 2023-10-14T19:12:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2114155b70 0x7f21140b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2114159940 0x7f2114155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2114157510 con 0x7f2114155b70 2023-10-14T19:12:28.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140ae2f0 con 0x7f2114159940 2023-10-14T19:12:28.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f21191dd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140ae5d0 con 0x7f21140add80 2023-10-14T19:12:28.008 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.003+0000 7f2112d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2114155b70 0x7f21140b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2114155b70 0x7f21140b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50210/0 (socket says 172.21.15.7:50210) 2023-10-14T19:12:28.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 -- 172.21.15.7:0/2760361027 learned_addr learned my addr 172.21.15.7:0/2760361027 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 -- 172.21.15.7:0/2760361027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 msgr2=0x7f21140b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f211259c700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.009 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f211359e700 1 --2- 172.21.15.7:0/2760361027 >> v2:172.21.15.148:3300/0 conn(0x7f2114159940 0x7f2114155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 -- 172.21.15.7:0/2760361027 >> v2:172.21.15.148:3300/0 conn(0x7f2114159940 msgr2=0x7f2114155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 --2- 172.21.15.7:0/2760361027 >> v2:172.21.15.148:3300/0 conn(0x7f2114159940 0x7f2114155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 -- 172.21.15.7:0/2760361027 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140ae8b0 con 0x7f2114155b70 2023-10-14T19:12:28.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f211259c700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:28.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f211359e700 1 --2- 172.21.15.7:0/2760361027 >> v2:172.21.15.148:3300/0 conn(0x7f2114159940 0x7f2114155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:12:28.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2112d9d700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114155b70 0x7f21140b0200 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2114068040 tx=0x7f2104009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda80fa39298e543 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.011 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2111d9b700 1 -- 172.21.15.7:0/2760361027 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400e070 con 0x7f2114155b70 2023-10-14T19:12:28.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2111d9b700 1 -- 172.21.15.7:0/2760361027 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400ba50 con 0x7f2114155b70 2023-10-14T19:12:28.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.004+0000 7f2111d9b700 1 -- 172.21.15.7:0/2760361027 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040092e0 con 0x7f2114155b70 2023-10-14T19:12:28.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 -- 172.21.15.7:0/2760361027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114155b70 msgr2=0x7f21140b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.012 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114155b70 0x7f21140b0200 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2114068040 tx=0x7f2104009840 comp rx=0 tx=0).stop 2023-10-14T19:12:28.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 -- 172.21.15.7:0/2760361027 shutdown_connections 2023-10-14T19:12:28.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 --2- 172.21.15.7:0/2760361027 >> v2:172.21.15.148:3300/0 conn(0x7f2114159940 0x7f2114155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114155b70 0x7f21140b0200 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 --2- 172.21.15.7:0/2760361027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.013 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 -- 172.21.15.7:0/2760361027 >> 172.21.15.7:0/2760361027 conn(0x7f211406d170 msgr2=0x7f21140cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 -- 172.21.15.7:0/2760361027 shutdown_connections 2023-10-14T19:12:28.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.005+0000 7f21191dd700 1 -- 172.21.15.7:0/2760361027 wait complete. 2023-10-14T19:12:28.014 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.006+0000 7f21191dd700 1 Processor -- start 2023-10-14T19:12:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.006+0000 7f21191dd700 1 -- start start 2023-10-14T19:12:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f21191dd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f21191dd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2114155b70 0x7f21141535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f21191dd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 0x7f2114153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f21191dd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2114154050 con 0x7f2114159940 2023-10-14T19:12:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f21191dd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140c47a0 con 0x7f2114155b70 2023-10-14T19:12:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f21191dd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140c4a80 con 0x7f21140add80 2023-10-14T19:12:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 0x7f2114153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 0x7f2114153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50226/0 (socket says 172.21.15.7:50226) 2023-10-14T19:12:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 -- 172.21.15.7:0/3489434565 learned_addr learned my addr 172.21.15.7:0/3489434565 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211259c700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2114155b70 0x7f21141535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f2112d9d700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 -- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 msgr2=0x7f21140acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 -- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2114155b70 msgr2=0x7f21141535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2114155b70 0x7f21141535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 -- 172.21.15.7:0/3489434565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104009ae0 con 0x7f2114159940 2023-10-14T19:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f211359e700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 0x7f2114153b10 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c880 tx=0x7f210c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.007+0000 7f210affd700 1 -- 172.21.15.7:0/3489434565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c011600 con 0x7f2114159940 2023-10-14T19:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.008+0000 7f210affd700 1 -- 172.21.15.7:0/3489434565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c011760 con 0x7f2114159940 2023-10-14T19:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.008+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21140c4d60 con 0x7f2114159940 2023-10-14T19:12:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.008+0000 7f210affd700 1 -- 172.21.15.7:0/3489434565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c011b20 con 0x7f2114159940 2023-10-14T19:12:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.008+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21140c5320 con 0x7f2114159940 2023-10-14T19:12:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.009+0000 7f210affd700 1 -- 172.21.15.7:0/3489434565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f210c0193b0 con 0x7f2114159940 2023-10-14T19:12:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.009+0000 7f210affd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20f4067320 0x7f20f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.010+0000 7f210affd700 1 -- 172.21.15.7:0/3489434565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f210c0849b0 con 0x7f2114159940 2023-10-14T19:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.010+0000 7f2112d9d700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20f4067320 0x7f20f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.010+0000 7f2112d9d700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20f4067320 0x7f20f40697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2104009880 tx=0x7f2104018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.011+0000 7f21224d6b80 1 Processor -- start 2023-10-14T19:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 -- start start 2023-10-14T19:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0028a50 0x5602f0028e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0051a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0051f60 0x5602f0024cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eff7fa70 con 0x5602f0072d00 2023-10-14T19:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eff7d270 con 0x5602f0051f60 2023-10-14T19:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602eff79060 con 0x5602f0028a50 2023-10-14T19:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.012+0000 7f211259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0051a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0051a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50242/0 (socket says 172.21.15.7:50242) 2023-10-14T19:12:28.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 -- 172.21.15.7:0/1815958842 learned_addr learned my addr 172.21.15.7:0/1815958842 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f2112d9d700 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0028a50 0x5602f0028e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211359e700 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0051f60 0x5602f0024cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 -- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0028a50 msgr2=0x5602f0028e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0028a50 0x5602f0028e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 -- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0051f60 msgr2=0x5602f0024cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0051f60 0x5602f0024cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 -- 172.21.15.7:0/1815958842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602efe13270 con 0x5602f0072d00 2023-10-14T19:12:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f211259c700 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0051a20 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00ac00 tx=0x7f20fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bc8a6deb56a9d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f20f3fff700 1 -- 172.21.15.7:0/1815958842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00fa10 con 0x5602f0072d00 2023-10-14T19:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f20f3fff700 1 -- 172.21.15.7:0/1815958842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc00c040 con 0x5602f0072d00 2023-10-14T19:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.013+0000 7f20f3fff700 1 -- 172.21.15.7:0/1815958842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00fd80 con 0x5602f0072d00 2023-10-14T19:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 -- 172.21.15.7:0/1815958842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 msgr2=0x5602f0051a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0051a20 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00ac00 tx=0x7f20fc008040 comp rx=0 tx=0).stop 2023-10-14T19:12:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 -- 172.21.15.7:0/1815958842 shutdown_connections 2023-10-14T19:12:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0051f60 0x5602f0024cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0028a50 0x5602f0028e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 --2- 172.21.15.7:0/1815958842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0051a20 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 -- 172.21.15.7:0/1815958842 >> 172.21.15.7:0/1815958842 conn(0x5602f002a370 msgr2=0x5602f002a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 -- 172.21.15.7:0/1815958842 shutdown_connections 2023-10-14T19:12:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.014+0000 7f21224d6b80 1 -- 172.21.15.7:0/1815958842 wait complete. 2023-10-14T19:12:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.015+0000 7f21224d6b80 1 -- start start 2023-10-14T19:12:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.015+0000 7f21224d6b80 1 Processor -- start 2023-10-14T19:12:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f004e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f006f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0023c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eff24890 con 0x5602f0072d00 2023-10-14T19:12:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eff3fea0 con 0x5602f0028a50 2023-10-14T19:12:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602efdfbe30 con 0x5602f0051f60 2023-10-14T19:12:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f21224d6b80 10 client.0 _ll_register_callbacks cb 0x5602effec110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:12:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0023c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0023c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50254/0 (socket says 172.21.15.7:50254) 2023-10-14T19:12:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 -- 172.21.15.7:0/791771866 learned_addr learned my addr 172.21.15.7:0/791771866 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f2112d9d700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f004e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211259c700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 -- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 msgr2=0x5602f006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 -- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 msgr2=0x5602f004e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f004e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 -- 172.21.15.7:0/791771866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc00a7d0 con 0x5602f0072d00 2023-10-14T19:12:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f211359e700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0023c20 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f210c054ef0 tx=0x7f210c055050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f402f6140cca655 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.016+0000 7f20f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:12:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f20f17fa700 1 -- 172.21.15.7:0/791771866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0548f0 con 0x5602f0072d00 2023-10-14T19:12:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f20f17fa700 1 -- 172.21.15.7:0/791771866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f210c05bd00 con 0x5602f0072d00 2023-10-14T19:12:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602f001db70 con 0x5602f0072d00 2023-10-14T19:12:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f20f17fa700 1 -- 172.21.15.7:0/791771866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f210c05a1f0 con 0x5602f0072d00 2023-10-14T19:12:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 10 client.9213 fetch_fsmap learned FSMap version 132 2023-10-14T19:12:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=2+}) v3 -- 0x5602efdb5fe0 con 0x5602f0072d00 2023-10-14T19:12:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f20f17fa700 1 -- 172.21.15.7:0/791771866 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c061020 con 0x5602f0072d00 2023-10-14T19:12:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f20f17fa700 1 -- 172.21.15.7:0/791771866 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 132) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f210c05a350 con 0x5602f0072d00 2023-10-14T19:12:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 10 client.9213 fetch_fsmap finished waiting for FSMap version 132 2023-10-14T19:12:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 10 client.9213 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:12:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 20 client.9213 populate_metadata read hostname 'smithi007' 2023-10-14T19:12:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f0071620 0x5602f00719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 4 client.9213 mds_command: new command op to 9078 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T19:12:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 --> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602efffaaa0 con 0x5602f0071620 2023-10-14T19:12:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f2112d9d700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f0071620 0x5602f00719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f2112d9d700 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f0071620 0x5602f00719f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb9d1b718078c720 server_cookie=322963e5ae160797 in_seq=0 out_seq=0 2023-10-14T19:12:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.017+0000 7f20f17fa700 10 client.9213 ms_handle_connect on v2:172.21.15.7:6833/1294066545 2023-10-14T19:12:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f20f17fa700 1 -- 172.21.15.7:0/791771866 <== mds.0 v2:172.21.15.7:6833/1294066545 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5602efffaaa0 con 0x5602f0071620 2023-10-14T19:12:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f20f17fa700 10 client.9213 handle_command_reply: tid=0 2023-10-14T19:12:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 client.9213 shutdown 2023-10-14T19:12:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 msgr2=0x5602f0023c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0023c20 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f210c054ef0 tx=0x7f210c055050 comp rx=0 tx=0).stop 2023-10-14T19:12:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 shutdown_connections 2023-10-14T19:12:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f0071620 0x5602f00719f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f004e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f0023c20 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f20f17fa700 0 client.9213 ms_handle_reset on v2:172.21.15.7:6833/1294066545 2023-10-14T19:12:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 --2- 172.21.15.7:0/791771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 >> 172.21.15.7:0/791771866 conn(0x5602f002a370 msgr2=0x5602f0025960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 shutdown_connections 2023-10-14T19:12:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 1 -- 172.21.15.7:0/791771866 wait complete. 2023-10-14T19:12:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.018+0000 7f21224d6b80 20 client.9213 trim_cache size 0 max 16384 2023-10-14T19:12:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.035+0000 7f21224d6b80 1 Processor -- start 2023-10-14T19:12:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.035+0000 7f21224d6b80 1 -- start start 2023-10-14T19:12:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f0058360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f21224d6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602f0027c70 con 0x5602f0072d00 2023-10-14T19:12:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602f007f510 con 0x5602f0028a50 2023-10-14T19:12:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602f007f930 con 0x5602f0051f60 2023-10-14T19:12:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f006c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50266/0 (socket says 172.21.15.7:50266) 2023-10-14T19:12:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 -- 172.21.15.7:0/2439253811 learned_addr learned my addr 172.21.15.7:0/2439253811 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f2112d9d700 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f0058360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211259c700 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 -- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 msgr2=0x5602f00588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 -- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 msgr2=0x5602f0058360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f0058360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.036+0000 7f211359e700 1 -- 172.21.15.7:0/2439253811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602f0029d40 con 0x5602f0072d00 2023-10-14T19:12:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f211359e700 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f006c760 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f210c00f040 tx=0x7f210c07d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1de697eda6db9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f2108ff9700 1 -- 172.21.15.7:0/2439253811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c05bd00 con 0x5602f0072d00 2023-10-14T19:12:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f2108ff9700 1 -- 172.21.15.7:0/2439253811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c061040 con 0x5602f0072d00 2023-10-14T19:12:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f2108ff9700 1 -- 172.21.15.7:0/2439253811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0548f0 con 0x5602f0072d00 2023-10-14T19:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 -- 172.21.15.7:0/2439253811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 msgr2=0x5602f006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f006c760 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f210c00f040 tx=0x7f210c07d000 comp rx=0 tx=0).stop 2023-10-14T19:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 -- 172.21.15.7:0/2439253811 shutdown_connections 2023-10-14T19:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0028a50 0x5602f0058360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0072d00 0x5602f006c760 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 --2- 172.21.15.7:0/2439253811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 -- 172.21.15.7:0/2439253811 >> 172.21.15.7:0/2439253811 conn(0x5602f002a370 msgr2=0x5602f00214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 -- 172.21.15.7:0/2439253811 shutdown_connections 2023-10-14T19:12:28.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.037+0000 7f21224d6b80 1 -- 172.21.15.7:0/2439253811 wait complete. 2023-10-14T19:12:28.064 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.038+0000 7f21224d6b80 1 -- start start 2023-10-14T19:12:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.038+0000 7f21224d6b80 1 Processor -- start 2023-10-14T19:12:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 0x5602f006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0072d00 0x5602f0058490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602f006c730 con 0x5602f0028a50 2023-10-14T19:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602f00d5b30 con 0x5602f0072d00 2023-10-14T19:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602f007e6b0 con 0x5602f0051f60 2023-10-14T19:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f21224d6b80 10 client.0 _ll_register_callbacks cb 0x5602effec110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T19:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 0x5602f006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 0x5602f006ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50276/0 (socket says 172.21.15.7:50276) 2023-10-14T19:12:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 -- 172.21.15.7:0/3613245256 learned_addr learned my addr 172.21.15.7:0/3613245256 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 -- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 msgr2=0x5602f00d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f211259c700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f211359e700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0072d00 0x5602f0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 -- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0072d00 msgr2=0x5602f0058490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0072d00 0x5602f0058490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 -- 172.21.15.7:0/3613245256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602efdb5fe0 con 0x5602f0028a50 2023-10-14T19:12:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f2112d9d700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 0x5602f006ce60 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f21040073d0 tx=0x7f2104016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2cb30bda8c9ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.039+0000 7f20f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2023-10-14T19:12:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f20f17fa700 1 -- 172.21.15.7:0/3613245256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040334a0 con 0x5602f0028a50 2023-10-14T19:12:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f20f17fa700 1 -- 172.21.15.7:0/3613245256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2104033600 con 0x5602f0028a50 2023-10-14T19:12:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20fc00c040 con 0x5602f0028a50 2023-10-14T19:12:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f20f17fa700 1 -- 172.21.15.7:0/3613245256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21040339d0 con 0x5602f0028a50 2023-10-14T19:12:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 10 client.9219 fetch_fsmap learned FSMap version 132 2023-10-14T19:12:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=2+}) v3 -- 0x5602eff47780 con 0x5602f0028a50 2023-10-14T19:12:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f20f17fa700 1 -- 172.21.15.7:0/3613245256 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc00c040 con 0x5602f0028a50 2023-10-14T19:12:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f20f17fa700 1 -- 172.21.15.7:0/3613245256 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 132) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2104033b30 con 0x5602f0028a50 2023-10-14T19:12:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 10 client.9219 fetch_fsmap finished waiting for FSMap version 132 2023-10-14T19:12:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 10 client.9219 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T19:12:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 20 client.9219 populate_metadata read hostname 'smithi007' 2023-10-14T19:12:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f00d2680 0x5602f00589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 4 client.9219 mds_command: new command op to 9078 tid=0[{"prefix": "status"}] 2023-10-14T19:12:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 --> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5602eff1be00 con 0x5602f00d2680 2023-10-14T19:12:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f211259c700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f00d2680 0x5602f00589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f20f17fa700 10 client.9219 ms_handle_connect on v2:172.21.15.7:6833/1294066545 2023-10-14T19:12:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.040+0000 7f211259c700 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f00d2680 0x5602f00589d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f407674254153e4 server_cookie=13e112386b6283e0 in_seq=0 out_seq=0 2023-10-14T19:12:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f20f17fa700 1 -- 172.21.15.7:0/3613245256 <== mds.0 v2:172.21.15.7:6833/1294066545 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5602eff1be00 con 0x5602f00d2680 2023-10-14T19:12:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f20f17fa700 10 client.9219 handle_command_reply: tid=0 2023-10-14T19:12:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 client.9219 shutdown 2023-10-14T19:12:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 msgr2=0x5602f006ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 0x5602f006ce60 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f21040073d0 tx=0x7f2104016000 comp rx=0 tx=0).stop 2023-10-14T19:12:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 shutdown_connections 2023-10-14T19:12:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:6833/1294066545,v1:172.21.15.7:6835/1294066545] conn(0x5602f00d2680 0x5602f00589d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.073 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602f0072d00 0x5602f0058490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602f0028a50 0x5602f006ce60 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 --2- 172.21.15.7:0/3613245256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5602f0051f60 0x5602f00d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f20f17fa700 0 client.9219 ms_handle_reset on v2:172.21.15.7:6833/1294066545 2023-10-14T19:12:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 >> 172.21.15.7:0/3613245256 conn(0x5602f002a370 msgr2=0x5602f0050a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 shutdown_connections 2023-10-14T19:12:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 1 -- 172.21.15.7:0/3613245256 wait complete. 2023-10-14T19:12:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21224d6b80 20 client.9219 trim_cache size 0 max 16384 2023-10-14T19:12:28.075 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:12:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "409612cc-2479-4e31-9e57-8fa34eb20ae0", 2023-10-14T19:12:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-10-14T19:12:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9078, 2023-10-14T19:12:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-10-14T19:12:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-10-14T19:12:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-10-14T19:12:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 5.8988684940000002, 2023-10-14T19:12:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 132, 2023-10-14T19:12:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 200, 2023-10-14T19:12:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 200, 2023-10-14T19:12:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.990772341 2023-10-14T19:12:28.078 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:12:28.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20f4067320 msgr2=0x7f20f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21191dd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20f4067320 0x7f20f40697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2104009880 tx=0x7f2104018000 comp rx=0 tx=0).stop 2023-10-14T19:12:28.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 msgr2=0x7f2114153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.041+0000 7f21191dd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 0x7f2114153b10 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c880 tx=0x7f210c008040 comp rx=0 tx=0).stop 2023-10-14T19:12:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 shutdown_connections 2023-10-14T19:12:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f20f4067320 0x7f20f40697d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2114159940 0x7f2114153b10 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21140add80 0x7f21140acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 --2- 172.21.15.7:0/3489434565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2114155b70 0x7f21141535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 >> 172.21.15.7:0/3489434565 conn(0x7f211406d170 msgr2=0x7f21141579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 shutdown_connections 2023-10-14T19:12:28.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.042+0000 7f21191dd700 1 -- 172.21.15.7:0/3489434565 wait complete. 2023-10-14T19:12:28.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:12:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.200+0000 7f281449d700 1 Processor -- start 2023-10-14T19:12:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.200+0000 7f281449d700 1 -- start start 2023-10-14T19:12:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.201+0000 7f281449d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.201+0000 7f281449d700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c0ce9d0 con 0x7f280c159c80 2023-10-14T19:12:28.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.201+0000 7f281449d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c0af960 con 0x7f280c1598b0 2023-10-14T19:12:28.206 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.201+0000 7f281449d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0afc30 con 0x7f280c0cbe00 2023-10-14T19:12:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.201+0000 7f2811a38700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f280c159c80 0x7f280c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37012/0 (socket says 172.21.15.7:37012) 2023-10-14T19:12:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811a38700 1 -- 172.21.15.7:0/3582305053 learned_addr learned my addr 172.21.15.7:0/3582305053 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2812a3a700 1 --2- 172.21.15.7:0/3582305053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697405895 0 0) 0x7f280c0ce9d0 con 0x7f280c159c80 2023-10-14T19:12:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f4003570 con 0x7f280c159c80 2023-10-14T19:12:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966452290 0 0) 0x7f280c0af960 con 0x7f280c1598b0 2023-10-14T19:12:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c0ce9d0 con 0x7f280c1598b0 2023-10-14T19:12:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2812a3a700 1 -- 172.21.15.7:0/3582305053 >> v1:172.21.15.148:6789/0 conn(0x7f280c1598b0 legacy=0x7f280c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293371270 0 0) 0x7f27f4003570 con 0x7f280c159c80 2023-10-14T19:12:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2812a3a700 1 -- 172.21.15.7:0/3582305053 >> v1:172.21.15.7:6789/0 conn(0x7f280c159c80 legacy=0x7f280c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2812a3a700 1 -- 172.21.15.7:0/3582305053 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0aff10 con 0x7f280c0cbe00 2023-10-14T19:12:28.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2812a3a700 1 --2- 172.21.15.7:0/3582305053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c1645a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009e90 tx=0x7f27fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84a4044e45d40e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.202+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00e070 con 0x7f280c0cbe00 2023-10-14T19:12:28.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00b870 con 0x7f280c0cbe00 2023-10-14T19:12:28.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f2811237700 1 -- 172.21.15.7:0/3582305053 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800001470 con 0x7f280c0cbe00 2023-10-14T19:12:28.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 -- 172.21.15.7:0/3582305053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 msgr2=0x7f280c1645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 --2- 172.21.15.7:0/3582305053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c1645a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009e90 tx=0x7f27fc009780 comp rx=0 tx=0).stop 2023-10-14T19:12:28.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 -- 172.21.15.7:0/3582305053 shutdown_connections 2023-10-14T19:12:28.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 --2- 172.21.15.7:0/3582305053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c1645a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 -- 172.21.15.7:0/3582305053 >> 172.21.15.7:0/3582305053 conn(0x7f280c070e30 msgr2=0x7f280c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 -- 172.21.15.7:0/3582305053 shutdown_connections 2023-10-14T19:12:28.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.203+0000 7f281449d700 1 -- 172.21.15.7:0/3582305053 wait complete. 2023-10-14T19:12:28.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.204+0000 7f281449d700 1 Processor -- start 2023-10-14T19:12:28.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.204+0000 7f281449d700 1 -- start start 2023-10-14T19:12:28.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f281449d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f281449d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f280c1598b0 0x7f280c0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f281449d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 0x7f280c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f281449d700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15c140 con 0x7f280c159c80 2023-10-14T19:12:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f281449d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15b570 con 0x7f280c1598b0 2023-10-14T19:12:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f281449d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15b810 con 0x7f280c0cbe00 2023-10-14T19:12:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 0x7f280c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 0x7f280c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50278/0 (socket says 172.21.15.7:50278) 2023-10-14T19:12:28.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 -- 172.21.15.7:0/990638584 learned_addr learned my addr 172.21.15.7:0/990638584 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:28.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2811a38700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f280c1598b0 0x7f280c0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812239700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 -- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 msgr2=0x7f280c151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 -- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f280c1598b0 msgr2=0x7f280c0b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f280c1598b0 0x7f280c0b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.205+0000 7f2812a3a700 1 -- 172.21.15.7:0/990638584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009a20 con 0x7f280c159c80 2023-10-14T19:12:28.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.206+0000 7f2812a3a700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 0x7f280c0b34b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f27fc003000 tx=0x7f27fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.206+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc012bb0 con 0x7f280c159c80 2023-10-14T19:12:28.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.206+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc012d30 con 0x7f280c159c80 2023-10-14T19:12:28.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.206+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c15baf0 con 0x7f280c159c80 2023-10-14T19:12:28.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.206+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc012ea0 con 0x7f280c159c80 2023-10-14T19:12:28.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.206+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c0b6090 con 0x7f280c159c80 2023-10-14T19:12:28.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.207+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c15c2b0 con 0x7f280c159c80 2023-10-14T19:12:28.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.207+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f27fc01e8f0 con 0x7f280c159c80 2023-10-14T19:12:28.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.208+0000 7f280a7fc700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f27f8067320 0x7f27f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:28.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.208+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27fc087180 con 0x7f280c159c80 2023-10-14T19:12:28.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.208+0000 7f2812239700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f27f8067320 0x7f27f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:28.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.208+0000 7f2812239700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f27f8067320 0x7f27f80697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2804007fd0 tx=0x7f2804007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:28.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.212+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27fc053d00 con 0x7f280c159c80 2023-10-14T19:12:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.448+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f280c04c3c0 con 0x7f280c159c80 2023-10-14T19:12:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.448+0000 7f280a7fc700 1 -- 172.21.15.7:0/990638584 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v132) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27fc057320 con 0x7f280c159c80 2023-10-14T19:12:28.450 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:12:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.450+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f27f8067320 msgr2=0x7f27f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.450+0000 7f281449d700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f27f8067320 0x7f27f80697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2804007fd0 tx=0x7f2804007d50 comp rx=0 tx=0).stop 2023-10-14T19:12:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.450+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 msgr2=0x7f280c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.450+0000 7f281449d700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 0x7f280c0b34b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f27fc003000 tx=0x7f27fc017000 comp rx=0 tx=0).stop 2023-10-14T19:12:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 shutdown_connections 2023-10-14T19:12:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f27f8067320 0x7f27f80697d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f280c159c80 0x7f280c0b34b0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f280c0cbe00 0x7f280c151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 --2- 172.21.15.7:0/990638584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f280c1598b0 0x7f280c0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 >> 172.21.15.7:0/990638584 conn(0x7f280c070e30 msgr2=0x7f280c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 shutdown_connections 2023-10-14T19:12:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:28.451+0000 7f281449d700 1 -- 172.21.15.7:0/990638584 wait complete. 2023-10-14T19:12:28.463 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:12:28.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:12:28.464 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-10-14T19:12:28.465 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T19:12:28.465 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T19:12:28.465 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:12:28.466 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:12:28.466 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:12:28.466 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:12:28.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:28.467 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-10-14T19:12:28.484 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:12:28.485 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:12:28.485 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:12:28.485 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.486 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-10-14T19:12:28.486 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.487 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:12:28.487 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:28.488 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2023-10-14T19:12:28.488 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:12:28.488 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:28.489 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2023-10-14T19:12:28.489 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:12:28.490 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:28.490 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2023-10-14T19:12:28.491 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T19:12:28.491 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 41905sec preferred_lft 41905sec 2023-10-14T19:12:28.491 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-10-14T19:12:28.492 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.492 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:12:28.493 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:28.493 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2023-10-14T19:12:28.494 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:12:28.494 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:28.495 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:12:28.495 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.495 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::608c:fdff:feb8:848f/64 scope link 2023-10-14T19:12:28.496 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.496 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:12:28.496 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether ea:17:b0:51:17:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:12:28.496 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::e817:b0ff:fe51:17ff/64 scope link 2023-10-14T19:12:28.497 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.497 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:12:28.497 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 9e:e4:58:b7:ba:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:12:28.497 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::9ce4:58ff:feb7:ba4c/64 scope link 2023-10-14T19:12:28.498 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:28.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:28.499 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:12:28.548 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-10-14T19:12:28.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:28.550 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-10-14T19:12:28.606 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-10-14T19:12:28.607 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:12:28.607 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T19:12:28.608 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T19:12:28.608 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:12:28.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:28.609 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-10-14T19:12:28.610 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-10-14T19:12:28.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T19:12:28.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T19:12:28.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T19:12:28.612 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-10-14T19:12:28.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:28.709 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:12:28.724 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:12:28.725 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:12:28.725 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:12:28.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:28.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-10-14T19:12:28.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:12:28.790 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T19:12:28.845 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T19:12:28.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:12:28.846 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:12:28.900 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:12:28.901 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:12:28.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:12:28.981 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:12:28.982 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:12:28.982 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:12:28.990 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:12:28.990 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:12:28.991 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:12:28.991 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:12:28.991 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:12:29.011 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T19:12:29.012 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T19:12:29.012 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2023-10-14T19:12:29.012 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:12:29.012 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:12:29.013 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:12:29.013 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:12:29.013 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:12:29.014 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:12:29.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.015 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T19:12:29.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T19:12:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.240+0000 7f899b59e700 1 Processor -- start 2023-10-14T19:12:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.240+0000 7f899b59e700 1 -- start start 2023-10-14T19:12:29.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f899c0cf110 0x7f899c164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899b59e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c15afd0 con 0x7f899c153c30 2023-10-14T19:12:29.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c15b2b0 con 0x7f899c15de50 2023-10-14T19:12:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c15b590 con 0x7f899c0cf110 2023-10-14T19:12:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899a59c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f899c153c30 0x7f899c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37016/0 (socket says 172.21.15.7:37016) 2023-10-14T19:12:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899a59c700 1 -- 172.21.15.7:0/1434876922 learned_addr learned my addr 172.21.15.7:0/1434876922 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003013254 0 0) 0x7f899c15afd0 con 0x7f899c153c30 2023-10-14T19:12:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8988003570 con 0x7f899c153c30 2023-10-14T19:12:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.241+0000 7f899ad9d700 1 --2- 172.21.15.7:0/1434876922 >> v2:172.21.15.148:3300/0 conn(0x7f899c0cf110 0x7f899c164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918527142 0 0) 0x7f8988003570 con 0x7f899c153c30 2023-10-14T19:12:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 >> v2:172.21.15.148:3300/0 conn(0x7f899c0cf110 msgr2=0x7f899c164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 --2- 172.21.15.7:0/1434876922 >> v2:172.21.15.148:3300/0 conn(0x7f899c0cf110 0x7f899c164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 >> v1:172.21.15.148:6789/0 conn(0x7f899c15de50 legacy=0x7f899c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c15b870 con 0x7f899c153c30 2023-10-14T19:12:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f8994001470 con 0x7f899c153c30 2023-10-14T19:12:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 >> v1:172.21.15.7:6789/0 conn(0x7f899c153c30 legacy=0x7f899c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988003a60 0x7f8988003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f8988004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89880051c0 0x7f898800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c15b590 con 0x7f8988004810 2023-10-14T19:12:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898800c0d0 con 0x7f8988003a60 2023-10-14T19:12:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898800c290 con 0x7f89880051c0 2023-10-14T19:12:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f8988004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899a59c700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988003a60 0x7f8988003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899ad9d700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89880051c0 0x7f898800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 -- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89880051c0 msgr2=0x7f898800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89880051c0 0x7f898800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 -- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988003a60 msgr2=0x7f8988003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988003a60 0x7f8988003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899ad9d700 1 -- 172.21.15.7:0/1434876922 reap_dead start 2023-10-14T19:12:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 -- 172.21.15.7:0/1434876922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8988003570 con 0x7f8988004810 2023-10-14T19:12:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f8999d9b700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f8988004c80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f89840018b0 tx=0x7f8984007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63881e686ce9b066 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.242+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984012420 con 0x7f8988004810 2023-10-14T19:12:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984012580 con 0x7f8988004810 2023-10-14T19:12:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899959a700 1 -- 172.21.15.7:0/1434876922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984012920 con 0x7f8988004810 2023-10-14T19:12:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 -- 172.21.15.7:0/1434876922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 msgr2=0x7f8988004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f8988004c80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f89840018b0 tx=0x7f8984007d30 comp rx=0 tx=0).stop 2023-10-14T19:12:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 -- 172.21.15.7:0/1434876922 shutdown_connections 2023-10-14T19:12:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 --2- 172.21.15.7:0/1434876922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f8988004c80 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 -- 172.21.15.7:0/1434876922 >> 172.21.15.7:0/1434876922 conn(0x7f899c0703a0 msgr2=0x7f899c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 -- 172.21.15.7:0/1434876922 shutdown_connections 2023-10-14T19:12:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.243+0000 7f899b59e700 1 -- 172.21.15.7:0/1434876922 wait complete. 2023-10-14T19:12:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.244+0000 7f899b59e700 1 Processor -- start 2023-10-14T19:12:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.244+0000 7f899b59e700 1 -- start start 2023-10-14T19:12:29.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899b59e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f899c0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c1500d0 0x7f899c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c146b40 0x7f899c146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899b59e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0cc0c0 con 0x7f8988004810 2023-10-14T19:12:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c1474f0 con 0x7f899c1500d0 2023-10-14T19:12:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0cb4b0 con 0x7f899c146b40 2023-10-14T19:12:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f899c0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f899c0c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50296/0 (socket says 172.21.15.7:50296) 2023-10-14T19:12:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 -- 172.21.15.7:0/3535550548 learned_addr learned my addr 172.21.15.7:0/3535550548 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f8999d9b700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c1500d0 0x7f899c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899ad9d700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c146b40 0x7f899c146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 -- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c146b40 msgr2=0x7f899c146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c146b40 0x7f899c146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 -- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c1500d0 msgr2=0x7f899c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c1500d0 0x7f899c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.245+0000 7f899a59c700 1 -- 172.21.15.7:0/3535550548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0cb790 con 0x7f8988004810 2023-10-14T19:12:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.246+0000 7f899a59c700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f899c0c9c30 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f8994007390 tx=0x7f899c15e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.246+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994018030 con 0x7f8988004810 2023-10-14T19:12:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.246+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400f850 con 0x7f8988004810 2023-10-14T19:12:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.246+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c0cba70 con 0x7f8988004810 2023-10-14T19:12:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.246+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994000ce0 con 0x7f8988004810 2023-10-14T19:12:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.246+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0cb110 con 0x7f8988004810 2023-10-14T19:12:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.247+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c04c3c0 con 0x7f8988004810 2023-10-14T19:12:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.247+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f899401b070 con 0x7f8988004810 2023-10-14T19:12:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.248+0000 7f89927fc700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f897c067320 0x7f897c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.248+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8994019070 con 0x7f8988004810 2023-10-14T19:12:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.248+0000 7f8999d9b700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f897c067320 0x7f897c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:29.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.248+0000 7f8999d9b700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f897c067320 0x7f897c0697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f899c0d0e20 tx=0x7f8984015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:29.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.252+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8994051750 con 0x7f8988004810 2023-10-14T19:12:29.489 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.488+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f899c15bb50 con 0x7f8988004810 2023-10-14T19:12:29.490 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.489+0000 7f89927fc700 1 -- 172.21.15.7:0/3535550548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v132) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8994054d70 con 0x7f8988004810 2023-10-14T19:12:29.490 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T19:12:29.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f897c067320 msgr2=0x7f897c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f897c067320 0x7f897c0697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f899c0d0e20 tx=0x7f8984015000 comp rx=0 tx=0).stop 2023-10-14T19:12:29.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 msgr2=0x7f899c0c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:29.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f899c0c9c30 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f8994007390 tx=0x7f899c15e2d0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.492 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 shutdown_connections 2023-10-14T19:12:29.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f897c067320 0x7f897c0697d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c146b40 0x7f899c146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8988004810 0x7f899c0c9c30 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.493 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 --2- 172.21.15.7:0/3535550548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c1500d0 0x7f899c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:29.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 >> 172.21.15.7:0/3535550548 conn(0x7f899c0703a0 msgr2=0x7f899c0c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:29.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 shutdown_connections 2023-10-14T19:12:29.494 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:29.491+0000 7f899b59e700 1 -- 172.21.15.7:0/3535550548 wait complete. 2023-10-14T19:12:29.504 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T19:12:29.504 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T19:12:29.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-14T19:12:29.505 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T19:12:29.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T19:12:29.506 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T19:12:29.506 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T19:12:29.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T19:12:29.507 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:12:29.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.507 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-14T19:12:29.526 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T19:12:29.526 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T19:12:29.527 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T19:12:29.527 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.527 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-14T19:12:29.527 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.528 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:12:29.528 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:29.528 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-14T19:12:29.528 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:12:29.528 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:29.529 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-14T19:12:29.529 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T19:12:29.529 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:29.529 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T19:12:29.529 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:29.530 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T19:12:29.530 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41915sec preferred_lft 41915sec 2023-10-14T19:12:29.530 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-14T19:12:29.530 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.530 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T19:12:29.531 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff 2023-10-14T19:12:29.531 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T19:12:29.531 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.531 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::709e:c2ff:fee7:1d21/64 scope link 2023-10-14T19:12:29.531 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.532 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:12:29.532 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5a:86:54:4f:82:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:12:29.532 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5886:54ff:fe4f:82ba/64 scope link 2023-10-14T19:12:29.532 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.532 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T19:12:29.532 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 6a:b8:a3:e0:64:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:12:29.533 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::68b8:a3ff:fee0:647b/64 scope link 2023-10-14T19:12:29.533 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-14T19:12:29.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.534 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T19:12:29.594 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-14T19:12:29.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.596 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-14T19:12:29.653 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-14T19:12:29.654 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T19:12:29.654 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T19:12:29.654 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T19:12:29.654 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T19:12:29.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.655 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-14T19:12:29.656 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-14T19:12:29.656 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T19:12:29.656 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T19:12:29.657 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T19:12:29.657 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-14T19:12:29.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.760 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:12:29.776 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:12:29.776 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:12:29.776 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:12:29.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:29.777 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-14T19:12:29.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:12:29.842 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T19:12:29.900 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T19:12:29.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T19:12:29.901 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:12:29.955 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T19:12:29.956 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T19:12:29.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:12:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:12:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:12:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:12:30.044 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:12:30.044 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:12:30.045 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:12:30.045 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:12:30.045 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:12:30.067 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T19:12:30.067 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T19:12:30.067 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-10-14T19:12:30.067 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-10-14T19:12:30.068 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T19:12:30.068 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-10-14T19:12:30.068 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-10-14T19:12:30.068 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=409612cc-2479-4e31-9e57-8fa34eb20ae0" will pass to kernel 2023-10-14T19:12:30.069 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T19:12:30.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:30.070 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T19:12:30.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-14T19:12:30.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.261+0000 7f82b017b700 1 Processor -- start 2023-10-14T19:12:30.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.262+0000 7f82b017b700 1 -- start start 2023-10-14T19:12:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.262+0000 7f82b017b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cb880 0x7f82a80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.262+0000 7f82b017b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80cf330 con 0x7f82a80b04f0 2023-10-14T19:12:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.262+0000 7f82b017b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80cddd0 con 0x7f82a80cd770 2023-10-14T19:12:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.262+0000 7f82b017b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80cdbd0 con 0x7f82a80cb880 2023-10-14T19:12:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82ad716700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f82a80b04f0 0x7f82a80cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37026/0 (socket says 172.21.15.7:37026) 2023-10-14T19:12:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82ad716700 1 -- 172.21.15.7:0/923918153 learned_addr learned my addr 172.21.15.7:0/923918153 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82adf17700 1 --2- 172.21.15.7:0/923918153 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cb880 0x7f82a80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059947570 0 0) 0x7f82a80cf330 con 0x7f82a80b04f0 2023-10-14T19:12:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8294003570 con 0x7f82a80b04f0 2023-10-14T19:12:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089816149 0 0) 0x7f82a80cddd0 con 0x7f82a80cd770 2023-10-14T19:12:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a80cf330 con 0x7f82a80cd770 2023-10-14T19:12:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112115739 0 0) 0x7f8294003570 con 0x7f82a80b04f0 2023-10-14T19:12:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82adf17700 1 -- 172.21.15.7:0/923918153 >> v1:172.21.15.148:6789/0 conn(0x7f82a80cd770 legacy=0x7f82a81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82adf17700 1 -- 172.21.15.7:0/923918153 >> v1:172.21.15.7:6789/0 conn(0x7f82a80b04f0 legacy=0x7f82a80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82adf17700 1 -- 172.21.15.7:0/923918153 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80cece0 con 0x7f82a80cb880 2023-10-14T19:12:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.263+0000 7f82adf17700 1 --2- 172.21.15.7:0/923918153 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cb880 0x7f82a80cbc50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009910 tx=0x7f82a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0d8e99d7e55913 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298001470 con 0x7f82a80cb880 2023-10-14T19:12:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a4011420 con 0x7f82a80cb880 2023-10-14T19:12:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82acf15700 1 -- 172.21.15.7:0/923918153 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40117a0 con 0x7f82a80cb880 2023-10-14T19:12:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 -- 172.21.15.7:0/923918153 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cb880 msgr2=0x7f82a80cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 --2- 172.21.15.7:0/923918153 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cb880 0x7f82a80cbc50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009910 tx=0x7f82a40091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 -- 172.21.15.7:0/923918153 shutdown_connections 2023-10-14T19:12:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 --2- 172.21.15.7:0/923918153 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cb880 0x7f82a80cbc50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 -- 172.21.15.7:0/923918153 >> 172.21.15.7:0/923918153 conn(0x7f82a80703a0 msgr2=0x7f82a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 -- 172.21.15.7:0/923918153 shutdown_connections 2023-10-14T19:12:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.264+0000 7f82b017b700 1 -- 172.21.15.7:0/923918153 wait complete. 2023-10-14T19:12:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.265+0000 7f82b017b700 1 Processor -- start 2023-10-14T19:12:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.265+0000 7f82b017b700 1 -- start start 2023-10-14T19:12:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82b017b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 0x7f82a814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82b017b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82a80cb880 0x7f82a8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82b017b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cd770 0x7f82a80b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82b017b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80c9080 con 0x7f82a80b04f0 2023-10-14T19:12:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82b017b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a815afb0 con 0x7f82a80cb880 2023-10-14T19:12:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82b017b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a814b6f0 con 0x7f82a80cd770 2023-10-14T19:12:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 0x7f82a814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 0x7f82a814b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50300/0 (socket says 172.21.15.7:50300) 2023-10-14T19:12:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 -- 172.21.15.7:0/4131328367 learned_addr learned my addr 172.21.15.7:0/4131328367 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 -- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cd770 msgr2=0x7f82a80b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cd770 0x7f82a80b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82ad716700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82a80cb880 0x7f82a8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 -- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82a80cb880 msgr2=0x7f82a8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82a80cb880 0x7f82a8158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.266+0000 7f82adf17700 1 -- 172.21.15.7:0/4131328367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4009420 con 0x7f82a80b04f0 2023-10-14T19:12:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.267+0000 7f82adf17700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 0x7f82a814b1b0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009860 tx=0x7f82a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.267+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a401cc50 con 0x7f82a80b04f0 2023-10-14T19:12:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.267+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a401cdd0 con 0x7f82a80b04f0 2023-10-14T19:12:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.267+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a815a430 con 0x7f82a80b04f0 2023-10-14T19:12:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.267+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a401a6a0 con 0x7f82a80b04f0 2023-10-14T19:12:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.267+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a815a9f0 con 0x7f82a80b04f0 2023-10-14T19:12:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.268+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a80c91f0 con 0x7f82a80b04f0 2023-10-14T19:12:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.268+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f82a401aad0 con 0x7f82a80b04f0 2023-10-14T19:12:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.269+0000 7f829dffb700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f828c067320 0x7f828c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.269+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82a4086650 con 0x7f82a80b04f0 2023-10-14T19:12:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.269+0000 7f82ad716700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f828c067320 0x7f828c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.269+0000 7f82ad716700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f828c067320 0x7f828c0697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f82980011e0 tx=0x7f8298009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:30.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.273+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82a80c91f0 con 0x7f82a80b04f0 2023-10-14T19:12:30.514 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:30.514+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82a80c91f0 con 0x7f82a80b04f0 2023-10-14T19:12:31.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.091+0000 7f829dffb700 1 -- 172.21.15.7:0/4131328367 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v133) v1 ==== 136+0+0 (secure 0 0 0) 0x7f82a80c91f0 con 0x7f82a80b04f0 2023-10-14T19:12:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f828c067320 msgr2=0x7f828c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f828c067320 0x7f828c0697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f82980011e0 tx=0x7f8298009040 comp rx=0 tx=0).stop 2023-10-14T19:12:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 msgr2=0x7f82a814b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 0x7f82a814b1b0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009860 tx=0x7f82a4016000 comp rx=0 tx=0).stop 2023-10-14T19:12:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 shutdown_connections 2023-10-14T19:12:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f828c067320 0x7f828c0697d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82a80cd770 0x7f82a80b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82a80b04f0 0x7f82a814b1b0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 --2- 172.21.15.7:0/4131328367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82a80cb880 0x7f82a8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 >> 172.21.15.7:0/4131328367 conn(0x7f82a80703a0 msgr2=0x7f82a815c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 shutdown_connections 2023-10-14T19:12:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.094+0000 7f82b017b700 1 -- 172.21.15.7:0/4131328367 wait complete. 2023-10-14T19:12:31.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-14T19:12:31.237 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.236+0000 7fe78d6bb700 1 Processor -- start 2023-10-14T19:12:31.238 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.236+0000 7fe78d6bb700 1 -- start start 2023-10-14T19:12:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe78d6bb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe78815a5d0 0x7fe788156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe78d6bb700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78815ae40 con 0x7fe7880cb5a0 2023-10-14T19:12:31.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe78d6bb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78815ab60 con 0x7fe7880cb970 2023-10-14T19:12:31.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe78d6bb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880ce0f0 con 0x7fe78815a5d0 2023-10-14T19:12:31.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe786ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe7880cb5a0 0x7fe7880cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37028/0 (socket says 172.21.15.7:37028) 2023-10-14T19:12:31.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe786ffd700 1 -- 172.21.15.7:0/3773147136 learned_addr learned my addr 172.21.15.7:0/3773147136 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.237+0000 7fe7877fe700 1 --2- 172.21.15.7:0/3773147136 >> v2:172.21.15.148:3300/0 conn(0x7fe78815a5d0 0x7fe788156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061964413 0 0) 0x7fe78815ae40 con 0x7fe7880cb5a0 2023-10-14T19:12:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe774003570 con 0x7fe7880cb5a0 2023-10-14T19:12:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163031314 0 0) 0x7fe78815ab60 con 0x7fe7880cb970 2023-10-14T19:12:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe78815ae40 con 0x7fe7880cb970 2023-10-14T19:12:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe7877fe700 1 -- 172.21.15.7:0/3773147136 >> v1:172.21.15.148:6789/0 conn(0x7fe7880cb970 legacy=0x7fe788159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe7877fe700 1 -- 172.21.15.7:0/3773147136 >> v1:172.21.15.7:6789/0 conn(0x7fe7880cb5a0 legacy=0x7fe7880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe7877fe700 1 -- 172.21.15.7:0/3773147136 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880ccf00 con 0x7fe78815a5d0 2023-10-14T19:12:31.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe7877fe700 1 --2- 172.21.15.7:0/3773147136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe788156e90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe7780098e0 tx=0x7fe7780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7ba5acb5856d8ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:31.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778011630 con 0x7fe78815a5d0 2023-10-14T19:12:31.244 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe778011790 con 0x7fe78815a5d0 2023-10-14T19:12:31.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.238+0000 7fe785ffb700 1 -- 172.21.15.7:0/3773147136 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778011b30 con 0x7fe78815a5d0 2023-10-14T19:12:31.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 -- 172.21.15.7:0/3773147136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 msgr2=0x7fe788156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/3773147136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe788156e90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe7780098e0 tx=0x7fe7780091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 -- 172.21.15.7:0/3773147136 shutdown_connections 2023-10-14T19:12:31.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/3773147136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe788156e90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 -- 172.21.15.7:0/3773147136 >> 172.21.15.7:0/3773147136 conn(0x7fe788070e30 msgr2=0x7fe7880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:31.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 -- 172.21.15.7:0/3773147136 shutdown_connections 2023-10-14T19:12:31.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.239+0000 7fe78d6bb700 1 -- 172.21.15.7:0/3773147136 wait complete. 2023-10-14T19:12:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.240+0000 7fe78d6bb700 1 Processor -- start 2023-10-14T19:12:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.240+0000 7fe78d6bb700 1 -- start start 2023-10-14T19:12:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe78d6bb700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 0x7fe7880c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe78d6bb700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7880cb970 0x7fe788152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe78d6bb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe7880b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe78d6bb700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788152cd0 con 0x7fe7880cb5a0 2023-10-14T19:12:31.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe78d6bb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b3ea0 con 0x7fe78815a5d0 2023-10-14T19:12:31.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe78d6bb700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b4180 con 0x7fe7880cb970 2023-10-14T19:12:31.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 0x7fe7880c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 0x7fe7880c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50302/0 (socket says 172.21.15.7:50302) 2023-10-14T19:12:31.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 -- 172.21.15.7:0/291883262 learned_addr learned my addr 172.21.15.7:0/291883262 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:31.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe7877fe700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe7880b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe7867fc700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7880cb970 0x7fe788152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 -- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7880cb970 msgr2=0x7fe788152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7880cb970 0x7fe788152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 -- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 msgr2=0x7fe7880b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe7880b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 -- 172.21.15.7:0/291883262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778009420 con 0x7fe7880cb5a0 2023-10-14T19:12:31.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.241+0000 7fe786ffd700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 0x7fe7880c8180 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fe780002250 tx=0x7fe780001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.242+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000ce90 con 0x7fe7880cb5a0 2023-10-14T19:12:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.242+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000aa80 con 0x7fe7880cb5a0 2023-10-14T19:12:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.242+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7880b4460 con 0x7fe7880cb5a0 2023-10-14T19:12:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.242+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000ae20 con 0x7fe7880cb5a0 2023-10-14T19:12:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.242+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7880b4a20 con 0x7fe7880cb5a0 2023-10-14T19:12:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.243+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78804c3c0 con 0x7fe7880cb5a0 2023-10-14T19:12:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.243+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe780007300 con 0x7fe7880cb5a0 2023-10-14T19:12:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.243+0000 7fe77effd700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe768067320 0x7fe7680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.244+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe780085130 con 0x7fe7880cb5a0 2023-10-14T19:12:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.244+0000 7fe7867fc700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe768067320 0x7fe7680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.244+0000 7fe7867fc700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe768067320 0x7fe7680697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe7880c86c0 tx=0x7fe770007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:31.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.248+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe780055810 con 0x7fe7880cb5a0 2023-10-14T19:12:31.469 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.468+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7880b3080 con 0x7fe768067320 2023-10-14T19:12:31.471 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.470+0000 7fe77effd700 1 -- 172.21.15.7:0/291883262 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe7880b3080 con 0x7fe768067320 2023-10-14T19:12:31.471 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-10-14T19:12:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-10-14T19:12:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephfs" 2023-10-14T19:12:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-10-14T19:12:31.473 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-10-14T19:12:31.474 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe768067320 msgr2=0x7fe7680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe768067320 0x7fe7680697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe7880c86c0 tx=0x7fe770007d50 comp rx=0 tx=0).stop 2023-10-14T19:12:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 msgr2=0x7fe7880c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 0x7fe7880c8180 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fe780002250 tx=0x7fe780001bb0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 shutdown_connections 2023-10-14T19:12:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe768067320 0x7fe7680697d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe78815a5d0 0x7fe7880b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7880cb5a0 0x7fe7880c8180 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 --2- 172.21.15.7:0/291883262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7880cb970 0x7fe788152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.477 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 >> 172.21.15.7:0/291883262 conn(0x7fe788070e30 msgr2=0x7fe7880b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 shutdown_connections 2023-10-14T19:12:31.478 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.472+0000 7fe78d6bb700 1 -- 172.21.15.7:0/291883262 wait complete. 2023-10-14T19:12:31.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T19:12:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.606+0000 7f7b8b979700 1 Processor -- start 2023-10-14T19:12:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.607+0000 7f7b8b979700 1 -- start start 2023-10-14T19:12:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.607+0000 7f7b8b979700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 0x7f7b840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.607+0000 7f7b8b979700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b840ccfd0 con 0x7f7b8406e0e0 2023-10-14T19:12:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.607+0000 7f7b8b979700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b840cf0e0 con 0x7f7b8406dc70 2023-10-14T19:12:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.607+0000 7f7b8b979700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8415a3d0 con 0x7f7b84159530 2023-10-14T19:12:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.607+0000 7f7b89f16700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7b8406e0e0 0x7f7b840cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37042/0 (socket says 172.21.15.7:37042) 2023-10-14T19:12:31.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89f16700 1 -- 172.21.15.7:0/1480818661 learned_addr learned my addr 172.21.15.7:0/1480818661 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:31.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 0x7f7b840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928633327 0 0) 0x7f7b840ccfd0 con 0x7f7b8406e0e0 2023-10-14T19:12:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b6c003570 con 0x7f7b8406e0e0 2023-10-14T19:12:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486215737 0 0) 0x7f7b6c003570 con 0x7f7b8406e0e0 2023-10-14T19:12:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 msgr2=0x7f7b840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 0x7f7b840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 >> v1:172.21.15.148:6789/0 conn(0x7f7b8406dc70 legacy=0x7f7b84159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8415a6b0 con 0x7f7b8406e0e0 2023-10-14T19:12:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f7b74001470 con 0x7f7b8406e0e0 2023-10-14T19:12:31.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 >> v1:172.21.15.7:6789/0 conn(0x7f7b8406e0e0 legacy=0x7f7b840cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c003a90 0x7f7b6c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b6c004810 0x7f7b6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 0x7f7b6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8415a3d0 con 0x7f7b6c003a90 2023-10-14T19:12:31.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c00bb10 con 0x7f7b6c004810 2023-10-14T19:12:31.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c00bcd0 con 0x7f7b84159530 2023-10-14T19:12:31.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c003a90 0x7f7b6c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 -- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 msgr2=0x7f7b6c0051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:12:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b84159530 0x7f7b6c0051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 -- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b6c004810 msgr2=0x7f7b6c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T19:12:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b6c004810 0x7f7b6c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.608+0000 7f7b89715700 1 -- 172.21.15.7:0/1480818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c003570 con 0x7f7b6c003a90 2023-10-14T19:12:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b89715700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c003a90 0x7f7b6c003e60 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00e210 tx=0x7f7b7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848f550e29f71390 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c00eac0 con 0x7f7b6c003a90 2023-10-14T19:12:31.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c00f040 con 0x7f7b6c003a90 2023-10-14T19:12:31.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b83fff700 1 -- 172.21.15.7:0/1480818661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c00ee70 con 0x7f7b6c003a90 2023-10-14T19:12:31.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b8b979700 1 -- 172.21.15.7:0/1480818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c003a90 msgr2=0x7f7b6c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b8b979700 1 --2- 172.21.15.7:0/1480818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c003a90 0x7f7b6c003e60 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00e210 tx=0x7f7b7c00b040 comp rx=0 tx=0).stop 2023-10-14T19:12:31.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b89f16700 1 -- 172.21.15.7:0/1480818661 reap_dead start 2023-10-14T19:12:31.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b8b979700 1 -- 172.21.15.7:0/1480818661 shutdown_connections 2023-10-14T19:12:31.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b8b979700 1 -- 172.21.15.7:0/1480818661 >> 172.21.15.7:0/1480818661 conn(0x7f7b840703a0 msgr2=0x7f7b840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:31.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b8b979700 1 -- 172.21.15.7:0/1480818661 shutdown_connections 2023-10-14T19:12:31.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.609+0000 7f7b8b979700 1 -- 172.21.15.7:0/1480818661 wait complete. 2023-10-14T19:12:31.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.610+0000 7f7b8b979700 1 Processor -- start 2023-10-14T19:12:31.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 -- start start 2023-10-14T19:12:31.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b6c003a90 0x7f7b840b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b84153ff0 0x7f7b840c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 0x7f7b840ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840b6300 con 0x7f7b840c9c90 2023-10-14T19:12:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840b5930 con 0x7f7b84153ff0 2023-10-14T19:12:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b8b979700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8415e090 con 0x7f7b6c003a90 2023-10-14T19:12:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.611+0000 7f7b89f16700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 0x7f7b840ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 0x7f7b840ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50322/0 (socket says 172.21.15.7:50322) 2023-10-14T19:12:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 -- 172.21.15.7:0/3428651560 learned_addr learned my addr 172.21.15.7:0/3428651560 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89715700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b6c003a90 0x7f7b840b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b88f14700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b84153ff0 0x7f7b840c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 -- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b6c003a90 msgr2=0x7f7b840b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b6c003a90 0x7f7b840b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 -- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b84153ff0 msgr2=0x7f7b840c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b84153ff0 0x7f7b840c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 -- 172.21.15.7:0/3428651560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b840b5320 con 0x7f7b840c9c90 2023-10-14T19:12:31.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89715700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b6c003a90 0x7f7b840b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:31.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b88f14700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b84153ff0 0x7f7b840c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:31.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b89f16700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 0x7f7b840ca0f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7b8406d630 tx=0x7f7b74001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:31.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74007360 con 0x7f7b840c9c90 2023-10-14T19:12:31.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b740074c0 con 0x7f7b840c9c90 2023-10-14T19:12:31.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8415e2e0 con 0x7f7b840c9c90 2023-10-14T19:12:31.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74004830 con 0x7f7b840c9c90 2023-10-14T19:12:31.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.612+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b840b55c0 con 0x7f7b840c9c90 2023-10-14T19:12:31.627 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.613+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b840b5ae0 con 0x7f7b840c9c90 2023-10-14T19:12:31.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.614+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7b74004c60 con 0x7f7b840c9c90 2023-10-14T19:12:31.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.614+0000 7f7b817fa700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b70067320 0x7f7b700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:31.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.614+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b740848e0 con 0x7f7b840c9c90 2023-10-14T19:12:31.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.614+0000 7f7b89715700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b70067320 0x7f7b700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:31.628 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.615+0000 7f7b89715700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b70067320 0x7f7b700697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00afd0 tx=0x7f7b7c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.618+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b840b5ae0 con 0x7f7b840c9c90 2023-10-14T19:12:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.811+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7b840b5ae0 con 0x7f7b840c9c90 2023-10-14T19:12:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.811+0000 7f7b817fa700 1 -- 172.21.15.7:0/3428651560 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7b840b5ae0 con 0x7f7b840c9c90 2023-10-14T19:12:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b70067320 msgr2=0x7f7b700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b70067320 0x7f7b700697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00afd0 tx=0x7f7b7c01a000 comp rx=0 tx=0).stop 2023-10-14T19:12:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 msgr2=0x7f7b840ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 0x7f7b840ca0f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7b8406d630 tx=0x7f7b74001b50 comp rx=0 tx=0).stop 2023-10-14T19:12:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 shutdown_connections 2023-10-14T19:12:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7b70067320 0x7f7b700697d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b840c9c90 0x7f7b840ca0f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b6c003a90 0x7f7b840b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 --2- 172.21.15.7:0/3428651560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b84153ff0 0x7f7b840c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 >> 172.21.15.7:0/3428651560 conn(0x7f7b840703a0 msgr2=0x7f7b840b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 shutdown_connections 2023-10-14T19:12:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:31.813+0000 7f7b8b979700 1 -- 172.21.15.7:0/3428651560 wait complete. 2023-10-14T19:12:31.826 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T19:12:31.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:12:31.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T19:12:31.872 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:12:31.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:31.873 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T19:12:31.927 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T19:12:31.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T19:12:31.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T19:12:31.972 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:12:31.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:31.974 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T19:12:32.027 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:12:32.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:32.029 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T19:12:32.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:12:32.045 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T19:12:32.045 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:12:32.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:12:32.046 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T19:12:32.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:12:32.084 INFO:teuthology.orchestra.run.smithi148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T19:12:32.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs 2023-10-14T19:12:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.206+0000 7fdbd5fe5700 1 Processor -- start 2023-10-14T19:12:32.207 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.206+0000 7fdbd5fe5700 1 -- start start 2023-10-14T19:12:32.209 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbd5fe5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbd5fe5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbd015de50 0x7fdbd015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbd5fe5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd015af60 con 0x7fdbd00cea00 2023-10-14T19:12:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbd5fe5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd015d010 con 0x7fdbd015de50 2023-10-14T19:12:32.210 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbd5fe5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd015b240 con 0x7fdbd0153a00 2023-10-14T19:12:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbd015de50 0x7fdbd015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdbd015de50 0x7fdbd015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50330/0 (socket says 172.21.15.7:50330) 2023-10-14T19:12:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 -- 172.21.15.7:0/1922942032 learned_addr learned my addr 172.21.15.7:0/1922942032 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbd4fe3700 1 --2- 172.21.15.7:0/1922942032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.211 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 -- 172.21.15.7:0/1922942032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 msgr2=0x7fdbd0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 --2- 172.21.15.7:0/1922942032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 -- 172.21.15.7:0/1922942032 >> v1:172.21.15.148:6789/0 conn(0x7fdbd00cea00 legacy=0x7fdbd00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.207+0000 7fdbcffff700 1 -- 172.21.15.7:0/1922942032 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd015b520 con 0x7fdbd015de50 2023-10-14T19:12:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbcffff700 1 --2- 172.21.15.7:0/1922942032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd015de50 0x7fdbd015a540 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009f20 tx=0x7fdbc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24f0850fc1c9e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:32.212 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbcf7fe700 1 -- 172.21.15.7:0/1922942032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000e070 con 0x7fdbd015de50 2023-10-14T19:12:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbcf7fe700 1 -- 172.21.15.7:0/1922942032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000ba80 con 0x7fdbd015de50 2023-10-14T19:12:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbcf7fe700 1 -- 172.21.15.7:0/1922942032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00092e0 con 0x7fdbd015de50 2023-10-14T19:12:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/1922942032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd015de50 msgr2=0x7fdbd015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 --2- 172.21.15.7:0/1922942032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd015de50 0x7fdbd015a540 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009f20 tx=0x7fdbc0009840 comp rx=0 tx=0).stop 2023-10-14T19:12:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/1922942032 shutdown_connections 2023-10-14T19:12:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 --2- 172.21.15.7:0/1922942032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 --2- 172.21.15.7:0/1922942032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd015de50 0x7fdbd015a540 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/1922942032 >> 172.21.15.7:0/1922942032 conn(0x7fdbd00703a0 msgr2=0x7fdbd00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/1922942032 shutdown_connections 2023-10-14T19:12:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.208+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/1922942032 wait complete. 2023-10-14T19:12:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.210+0000 7fdbd5fe5700 1 Processor -- start 2023-10-14T19:12:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.210+0000 7fdbd5fe5700 1 -- start start 2023-10-14T19:12:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.210+0000 7fdbd5fe5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd00cea00 0x7fdbd00d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd00ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd015de50 0x7fdbd00cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c7fb0 con 0x7fdbd00cea00 2023-10-14T19:12:32.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0151620 con 0x7fdbd015de50 2023-10-14T19:12:32.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00cd6e0 con 0x7fdbd0153a00 2023-10-14T19:12:32.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd00cea00 0x7fdbd00d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd00cea00 0x7fdbd00d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50338/0 (socket says 172.21.15.7:50338) 2023-10-14T19:12:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 -- 172.21.15.7:0/730301972 learned_addr learned my addr 172.21.15.7:0/730301972 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbcffff700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd00ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd57e4700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd015de50 0x7fdbd00cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 -- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 msgr2=0x7fdbd00ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd0153a00 0x7fdbd00ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 -- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd015de50 msgr2=0x7fdbd00cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd015de50 0x7fdbd00cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 -- 172.21.15.7:0/730301972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009ae0 con 0x7fdbd00cea00 2023-10-14T19:12:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd4fe3700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbd00cea00 0x7fdbd00d0730 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800d890 tx=0x7fdbc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80125f0 con 0x7fdbd00cea00 2023-10-14T19:12:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8012750 con 0x7fdbd00cea00 2023-10-14T19:12:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/730301972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00c7680 con 0x7fdbd00cea00 2023-10-14T19:12:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8012af0 con 0x7fdbd00cea00 2023-10-14T19:12:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.211+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/730301972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd00c7c40 con 0x7fdbd00cea00 2023-10-14T19:12:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.212+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/730301972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd004c3c0 con 0x7fdbd00cea00 2023-10-14T19:12:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.213+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdbc801e460 con 0x7fdbd00cea00 2023-10-14T19:12:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.213+0000 7fdbccff9700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbb0067320 0x7fdbb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.213+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbc8085220 con 0x7fdbd00cea00 2023-10-14T19:12:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.213+0000 7fdbcffff700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbb0067320 0x7fdbb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.214+0000 7fdbcffff700 1 --2- 172.21.15.7:0/730301972 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fdbb0067320 0x7fdbb00697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009880 tx=0x7fdbc0018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.218+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbc8051e70 con 0x7fdbd00cea00 2023-10-14T19:12:32.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.436+0000 7fdbd5fe5700 1 -- 172.21.15.7:0/730301972 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbd015b800 con 0x7fdbb0067320 2023-10-14T19:12:32.437 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-10-14T19:12:32.437+0000 7f53c0831700 -1 mgr.server reply reply (1) Operation not permitted WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-14T19:12:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.437+0000 7fdbccff9700 1 -- 172.21.15.7:0/730301972 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: -1 WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it.) v1 ==== 204+0+0 (secure 0 0 0) 0x7fdbd015b800 con 0x7fdbb0067320 2023-10-14T19:12:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-14T19:12:32.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:12:32.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2023-10-14T19:12:32.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.564+0000 7ff1d422a700 1 Processor -- start 2023-10-14T19:12:32.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.565+0000 7ff1d422a700 1 -- start start 2023-10-14T19:12:32.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.565+0000 7ff1d422a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff1cc06dc70 0x7ff1cc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.565+0000 7ff1d422a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1cc06e0e0 0x7ff1cc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.565+0000 7ff1d422a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0ccfd0 con 0x7ff1cc159530 2023-10-14T19:12:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.565+0000 7ff1d422a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc15a3d0 con 0x7ff1cc06dc70 2023-10-14T19:12:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.565+0000 7ff1d422a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc15a6b0 con 0x7ff1cc06e0e0 2023-10-14T19:12:32.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d17c5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff1cc06dc70 0x7ff1cc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d1fc6700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff1cc159530 0x7ff1cc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37058/0 (socket says 172.21.15.7:37058) 2023-10-14T19:12:32.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d1fc6700 1 -- 172.21.15.7:0/2642853479 learned_addr learned my addr 172.21.15.7:0/2642853479 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:12:32.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d27c7700 1 --2- 172.21.15.7:0/2642853479 >> v2:172.21.15.148:3300/0 conn(0x7ff1cc06e0e0 0x7ff1cc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d17c5700 1 -- 172.21.15.7:0/2642853479 >> v2:172.21.15.148:3300/0 conn(0x7ff1cc06e0e0 msgr2=0x7ff1cc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:12:32.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d17c5700 1 --2- 172.21.15.7:0/2642853479 >> v2:172.21.15.148:3300/0 conn(0x7ff1cc06e0e0 0x7ff1cc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d17c5700 1 -- 172.21.15.7:0/2642853479 >> v1:172.21.15.7:6789/0 conn(0x7ff1cc159530 legacy=0x7ff1cc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d0fc4700 1 -- 172.21.15.7:0/2642853479 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680332810 0 0) 0x7ff1cc0ccfd0 con 0x7ff1cc159530 2023-10-14T19:12:32.573 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d17c5700 1 -- 172.21.15.7:0/2642853479 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc15a990 con 0x7ff1cc06dc70 2023-10-14T19:12:32.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d17c5700 1 --2- 172.21.15.7:0/2642853479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc159900 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0cf2b0 tx=0x7ff1c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9923c62c12c23558 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:32.574 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d0fc4700 1 -- 172.21.15.7:0/2642853479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011630 con 0x7ff1cc06dc70 2023-10-14T19:12:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d0fc4700 1 -- 172.21.15.7:0/2642853479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0011790 con 0x7ff1cc06dc70 2023-10-14T19:12:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.566+0000 7ff1d0fc4700 1 -- 172.21.15.7:0/2642853479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011b30 con 0x7ff1cc06dc70 2023-10-14T19:12:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 -- 172.21.15.7:0/2642853479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 msgr2=0x7ff1cc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 --2- 172.21.15.7:0/2642853479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc159900 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0cf2b0 tx=0x7ff1c00091a0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.576 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 -- 172.21.15.7:0/2642853479 shutdown_connections 2023-10-14T19:12:32.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 --2- 172.21.15.7:0/2642853479 >> v2:172.21.15.148:3300/0 conn(0x7ff1cc06e0e0 0x7ff1cc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.577 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 --2- 172.21.15.7:0/2642853479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc159900 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 -- 172.21.15.7:0/2642853479 >> 172.21.15.7:0/2642853479 conn(0x7ff1cc0703a0 msgr2=0x7ff1cc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:12:32.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 -- 172.21.15.7:0/2642853479 shutdown_connections 2023-10-14T19:12:32.578 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.567+0000 7ff1d422a700 1 -- 172.21.15.7:0/2642853479 wait complete. 2023-10-14T19:12:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.568+0000 7ff1d422a700 1 Processor -- start 2023-10-14T19:12:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.568+0000 7ff1d422a700 1 -- start start 2023-10-14T19:12:32.582 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1cc06e0e0 0x7ff1cc0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1cc159530 0x7ff1cc0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b4720 con 0x7ff1cc06dc70 2023-10-14T19:12:32.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b3b10 con 0x7ff1cc06e0e0 2023-10-14T19:12:32.583 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b3df0 con 0x7ff1cc159530 2023-10-14T19:12:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50346/0 (socket says 172.21.15.7:50346) 2023-10-14T19:12:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 -- 172.21.15.7:0/4204786429 learned_addr learned my addr 172.21.15.7:0/4204786429 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:12:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d17c5700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1cc06e0e0 0x7ff1cc0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d27c7700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1cc159530 0x7ff1cc0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 -- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1cc159530 msgr2=0x7ff1cc0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1cc159530 0x7ff1cc0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 -- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1cc06e0e0 msgr2=0x7ff1cc0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:12:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1cc06e0e0 0x7ff1cc0c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:12:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 -- 172.21.15.7:0/4204786429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c0009420 con 0x7ff1cc06dc70 2023-10-14T19:12:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d27c7700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1cc159530 0x7ff1cc0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d17c5700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1cc06e0e0 0x7ff1cc0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:12:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d1fc6700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1cc06dc70 0x7ff1cc0b3480 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400cc70 tx=0x7ff1c4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1c9ffb700 1 -- 172.21.15.7:0/4204786429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ce80 con 0x7ff1cc06dc70 2023-10-14T19:12:32.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1c9ffb700 1 -- 172.21.15.7:0/4204786429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c400ab70 con 0x7ff1cc06dc70 2023-10-14T19:12:32.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1c9ffb700 1 -- 172.21.15.7:0/4204786429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40070f0 con 0x7ff1cc06dc70 2023-10-14T19:12:32.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.569+0000 7ff1d422a700 1 -- 172.21.15.7:0/4204786429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0b40d0 con 0x7ff1cc06dc70 2023-10-14T19:12:32.589 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.570+0000 7ff1d422a700 1 -- 172.21.15.7:0/4204786429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0c88a0 con 0x7ff1cc06dc70 2023-10-14T19:12:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.571+0000 7ff1d422a700 1 -- 172.21.15.7:0/4204786429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc04c3c0 con 0x7ff1cc06dc70 2023-10-14T19:12:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.571+0000 7ff1c9ffb700 1 -- 172.21.15.7:0/4204786429 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff1c40074e0 con 0x7ff1cc06dc70 2023-10-14T19:12:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.571+0000 7ff1c9ffb700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1b8067320 0x7ff1b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:12:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.572+0000 7ff1c9ffb700 1 -- 172.21.15.7:0/4204786429 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1c4085110 con 0x7ff1cc06dc70 2023-10-14T19:12:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.572+0000 7ff1d17c5700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1b8067320 0x7ff1b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:12:32.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.572+0000 7ff1d17c5700 1 --2- 172.21.15.7:0/4204786429 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1b8067320 0x7ff1b80697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00093f0 tx=0x7ff1c0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:12:32.591 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.576+0000 7ff1c9ffb700 1 -- 172.21.15.7:0/4204786429 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1c4051e20 con 0x7ff1cc06dc70 2023-10-14T19:12:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:12:32.795+0000 7ff1d422a700 1 -- 172.21.15.7:0/4204786429 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1cc0b4860 con 0x7ff1b8067320 2023-10-14T19:12:49.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:49.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:19.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:19.662 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:49.738 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:49.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:19.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:19.838 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:32.474 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-14T19:14:32.475 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T19:14:32.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:14:32.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T19:14:32.564 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T19:14:32.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:14:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.693+0000 7f67dda8c700 1 Processor -- start 2023-10-14T19:14:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.693+0000 7f67dda8c700 1 -- start start 2023-10-14T19:14:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67dda8c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67d80b07d0 0x7f67d80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67dda8c700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d815a280 con 0x7f67d80cf200 2023-10-14T19:14:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67dda8c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d806e180 con 0x7f67d80b0ba0 2023-10-14T19:14:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67dda8c700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d806d850 con 0x7f67d80b07d0 2023-10-14T19:14:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d77fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67d80b07d0 0x7f67d80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f67d80cf200 0x7f67d806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42710/0 (socket says 172.21.15.7:42710) 2023-10-14T19:14:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d6ffd700 1 -- 172.21.15.7:0/1172184357 learned_addr learned my addr 172.21.15.7:0/1172184357 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d77fe700 1 -- 172.21.15.7:0/1172184357 >> v1:172.21.15.148:6789/0 conn(0x7f67d80b0ba0 legacy=0x7f67d806ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d77fe700 1 -- 172.21.15.7:0/1172184357 >> v1:172.21.15.7:6789/0 conn(0x7f67d80cf200 legacy=0x7f67d806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d77fe700 1 -- 172.21.15.7:0/1172184357 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d806db30 con 0x7f67d80b07d0 2023-10-14T19:14:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.694+0000 7f67d67fc700 1 -- 172.21.15.7:0/1172184357 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243236890 0 0) 0x7f67d815a280 con 0x7f67d80cf200 2023-10-14T19:14:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67d77fe700 1 --2- 172.21.15.7:0/1172184357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80ccac0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f67c80098d0 tx=0x7f67c8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5582d240a9692674 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67d67fc700 1 -- 172.21.15.7:0/1172184357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8009e70 con 0x7f67d80b07d0 2023-10-14T19:14:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67d67fc700 1 -- 172.21.15.7:0/1172184357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c8005c10 con 0x7f67d80b07d0 2023-10-14T19:14:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67d67fc700 1 -- 172.21.15.7:0/1172184357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800b6e0 con 0x7f67d80b07d0 2023-10-14T19:14:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 -- 172.21.15.7:0/1172184357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 msgr2=0x7f67d80ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 --2- 172.21.15.7:0/1172184357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80ccac0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f67c80098d0 tx=0x7f67c8009120 comp rx=0 tx=0).stop 2023-10-14T19:14:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 -- 172.21.15.7:0/1172184357 shutdown_connections 2023-10-14T19:14:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 --2- 172.21.15.7:0/1172184357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80ccac0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 -- 172.21.15.7:0/1172184357 >> 172.21.15.7:0/1172184357 conn(0x7f67d806ce80 msgr2=0x7f67d80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 -- 172.21.15.7:0/1172184357 shutdown_connections 2023-10-14T19:14:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.695+0000 7f67dda8c700 1 -- 172.21.15.7:0/1172184357 wait complete. 2023-10-14T19:14:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 Processor -- start 2023-10-14T19:14:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 -- start start 2023-10-14T19:14:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:32.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67d80b0ba0 0x7f67d81568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:32.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67d80cf200 0x7f67d8153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:32.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d81592b0 con 0x7f67d80b07d0 2023-10-14T19:14:32.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d809bd00 con 0x7f67d80cf200 2023-10-14T19:14:32.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67dda8c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d809bfe0 con 0x7f67d80b0ba0 2023-10-14T19:14:32.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67d77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:32.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67d77fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36114/0 (socket says 172.21.15.7:36114) 2023-10-14T19:14:32.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.697+0000 7f67d77fe700 1 -- 172.21.15.7:0/353236038 learned_addr learned my addr 172.21.15.7:0/353236038 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:32.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d7fff700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67d80cf200 0x7f67d8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:32.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d6ffd700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67d80b0ba0 0x7f67d81568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:32.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d77fe700 1 -- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67d80b0ba0 msgr2=0x7f67d81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d77fe700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67d80b0ba0 0x7f67d81568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d77fe700 1 -- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67d80cf200 msgr2=0x7f67d8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d77fe700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67d80cf200 0x7f67d8153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d77fe700 1 -- 172.21.15.7:0/353236038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80093c0 con 0x7f67d80b07d0 2023-10-14T19:14:32.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67d77fe700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80c7a80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009160 tx=0x7f67c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:32.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8006550 con 0x7f67d80b07d0 2023-10-14T19:14:32.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80066b0 con 0x7f67d80b07d0 2023-10-14T19:14:32.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d80c7280 con 0x7f67d80b07d0 2023-10-14T19:14:32.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c801b480 con 0x7f67d80b07d0 2023-10-14T19:14:32.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.698+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d8156de0 con 0x7f67d80b07d0 2023-10-14T19:14:32.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.699+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d8159ae0 con 0x7f67d80b07d0 2023-10-14T19:14:32.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.699+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f67c801b830 con 0x7f67d80b07d0 2023-10-14T19:14:32.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.700+0000 7f67bf7fe700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67c4067320 0x7f67c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:32.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.700+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f67c8087010 con 0x7f67d80b07d0 2023-10-14T19:14:32.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.700+0000 7f67d6ffd700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67c4067320 0x7f67c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:32.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.701+0000 7f67d6ffd700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67c4067320 0x7f67c40697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f67d80b21d0 tx=0x7f67cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:32.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.704+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67c8053c50 con 0x7f67d80b07d0 2023-10-14T19:14:32.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.940+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67d804c3c0 con 0x7f67d80b07d0 2023-10-14T19:14:32.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.941+0000 7f67bf7fe700 1 -- 172.21.15.7:0/353236038 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f67c8009220 con 0x7f67d80b07d0 2023-10-14T19:14:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:32.941 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":133,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:12:21.531996+0000","modified":"2023-10-14T19:12:25.155754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9078":{"gid":9078,"name":"a","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/1294066545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1294066545},{"type":"v1","addr":"172.21.15.7:6835","nonce":1294066545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-14T19:14:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67c4067320 msgr2=0x7f67c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67c4067320 0x7f67c40697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f67d80b21d0 tx=0x7f67cc009040 comp rx=0 tx=0).stop 2023-10-14T19:14:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 msgr2=0x7f67d80c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80c7a80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009160 tx=0x7f67c8016000 comp rx=0 tx=0).stop 2023-10-14T19:14:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 shutdown_connections 2023-10-14T19:14:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f67c4067320 0x7f67c40697d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67d80cf200 0x7f67d8153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67d80b07d0 0x7f67d80c7a80 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 --2- 172.21.15.7:0/353236038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67d80b0ba0 0x7f67d81568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 >> 172.21.15.7:0/353236038 conn(0x7f67d806ce80 msgr2=0x7f67d80690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 shutdown_connections 2023-10-14T19:14:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:32.943+0000 7f67dda8c700 1 -- 172.21.15.7:0/353236038 wait complete. 2023-10-14T19:14:32.946 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 133 2023-10-14T19:14:32.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:14:33.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.075+0000 7f37c8710700 1 Processor -- start 2023-10-14T19:14:33.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.075+0000 7f37c8710700 1 -- start start 2023-10-14T19:14:33.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c8710700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 0x7f37c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c8710700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c015ae40 con 0x7f37c00cde50 2023-10-14T19:14:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c8710700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c015ab60 con 0x7f37c00cd9e0 2023-10-14T19:14:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c8710700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00d13f0 con 0x7f37c00cb5a0 2023-10-14T19:14:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c6cad700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37c00cde50 0x7f37c0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42722/0 (socket says 172.21.15.7:42722) 2023-10-14T19:14:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c6cad700 1 -- 172.21.15.7:0/2882547687 learned_addr learned my addr 172.21.15.7:0/2882547687 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:33.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c64ac700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 0x7f37c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.076+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260398049 0 0) 0x7f37c015ae40 con 0x7f37c00cde50 2023-10-14T19:14:33.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003570 con 0x7f37c00cde50 2023-10-14T19:14:33.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523473178 0 0) 0x7f37c015ab60 con 0x7f37c00cd9e0 2023-10-14T19:14:33.081 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c015ae40 con 0x7f37c00cd9e0 2023-10-14T19:14:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142885972 0 0) 0x7f37a8003570 con 0x7f37c00cde50 2023-10-14T19:14:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 msgr2=0x7f37c00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 0x7f37c00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 >> v1:172.21.15.148:6789/0 conn(0x7f37c00cd9e0 legacy=0x7f37c0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.082 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00ccf00 con 0x7f37c00cde50 2023-10-14T19:14:33.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f37b0001470 con 0x7f37c00cde50 2023-10-14T19:14:33.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 >> v1:172.21.15.7:6789/0 conn(0x7f37c00cde50 legacy=0x7f37c0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a8003c20 0x7f37a8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 0x7f37a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.083 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8004d50 0x7f37a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bbf0 con 0x7f37a8003c20 2023-10-14T19:14:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bd30 con 0x7f37a8004d50 2023-10-14T19:14:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bea0 con 0x7f37c00cb5a0 2023-10-14T19:14:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a8003c20 0x7f37a8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c5cab700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 0x7f37a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c6cad700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8004d50 0x7f37a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 -- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 msgr2=0x7f37a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00cb5a0 0x7f37a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 -- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8004d50 msgr2=0x7f37a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8004d50 0x7f37a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 -- 172.21.15.7:0/2882547687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8003570 con 0x7f37a8003c20 2023-10-14T19:14:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.077+0000 7f37c64ac700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a8003c20 0x7f37a8004010 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f37b80094d0 tx=0x7f37b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cfeef003619d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800ea90 con 0x7f37a8003c20 2023-10-14T19:14:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b800f040 con 0x7f37a8003c20 2023-10-14T19:14:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c54aa700 1 -- 172.21.15.7:0/2882547687 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800ee40 con 0x7f37a8003c20 2023-10-14T19:14:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c8710700 1 -- 172.21.15.7:0/2882547687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a8003c20 msgr2=0x7f37a8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c8710700 1 --2- 172.21.15.7:0/2882547687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a8003c20 0x7f37a8004010 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f37b80094d0 tx=0x7f37b800b040 comp rx=0 tx=0).stop 2023-10-14T19:14:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c6cad700 1 -- 172.21.15.7:0/2882547687 reap_dead start 2023-10-14T19:14:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c8710700 1 -- 172.21.15.7:0/2882547687 shutdown_connections 2023-10-14T19:14:33.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c8710700 1 -- 172.21.15.7:0/2882547687 >> 172.21.15.7:0/2882547687 conn(0x7f37c0070e30 msgr2=0x7f37c00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:33.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c8710700 1 -- 172.21.15.7:0/2882547687 shutdown_connections 2023-10-14T19:14:33.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.078+0000 7f37c8710700 1 -- 172.21.15.7:0/2882547687 wait complete. 2023-10-14T19:14:33.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.079+0000 7f37c8710700 1 Processor -- start 2023-10-14T19:14:33.088 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.079+0000 7f37c8710700 1 -- start start 2023-10-14T19:14:33.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c8710700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8003c20 0x7f37c0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c8710700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00b5bd0 0x7f37c016c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.091 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c8710700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 0x7f37c016d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c8710700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c015dee0 con 0x7f37c016cef0 2023-10-14T19:14:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c8710700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0156850 con 0x7f37a8003c20 2023-10-14T19:14:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c8710700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00c8bc0 con 0x7f37c00b5bd0 2023-10-14T19:14:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c6cad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 0x7f37c016d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c6cad700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 0x7f37c016d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36138/0 (socket says 172.21.15.7:36138) 2023-10-14T19:14:33.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.080+0000 7f37c6cad700 1 -- 172.21.15.7:0/673293121 learned_addr learned my addr 172.21.15.7:0/673293121 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:33.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c64ac700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8003c20 0x7f37c0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c5cab700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00b5bd0 0x7f37c016c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c6cad700 1 -- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00b5bd0 msgr2=0x7f37c016c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.093 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c6cad700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00b5bd0 0x7f37c016c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c6cad700 1 -- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8003c20 msgr2=0x7f37c0156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c6cad700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8003c20 0x7f37c0156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c6cad700 1 -- 172.21.15.7:0/673293121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c015d920 con 0x7f37c016cef0 2023-10-14T19:14:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c5cab700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00b5bd0 0x7f37c016c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c6cad700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 0x7f37c016d390 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f37c00cce10 tx=0x7f37b00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0012590 con 0x7f37c016cef0 2023-10-14T19:14:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b00126f0 con 0x7f37c016cef0 2023-10-14T19:14:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c015dc00 con 0x7f37c016cef0 2023-10-14T19:14:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0012ab0 con 0x7f37c016cef0 2023-10-14T19:14:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.081+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c00c90d0 con 0x7f37c016cef0 2023-10-14T19:14:33.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.082+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c004c3c0 con 0x7f37c016cef0 2023-10-14T19:14:33.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.082+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f37b001d460 con 0x7f37c016cef0 2023-10-14T19:14:33.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.083+0000 7f37be7fc700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37ac067320 0x7f37ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.083+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f37b0084a00 con 0x7f37c016cef0 2023-10-14T19:14:33.096 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.083+0000 7f37c64ac700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37ac067320 0x7f37ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.084+0000 7f37c64ac700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37ac067320 0x7f37ac0697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f37b800afd0 tx=0x7f37b801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.097 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.087+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b0051640 con 0x7f37c016cef0 2023-10-14T19:14:33.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.280+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37c00cd1e0 con 0x7f37c016cef0 2023-10-14T19:14:33.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.281+0000 7f37be7fc700 1 -- 172.21.15.7:0/673293121 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15461 (secure 0 0 0) 0x7f37b0054c60 con 0x7f37c016cef0 2023-10-14T19:14:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:33.282 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":202,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:13:00.145591+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:12:19.972804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-14T19:12:20.504006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.2","mappings":[{"from":0,"to":2}]},{"pgid":"34.11","mappings":[{"from":0,"to":1}]},{"pgid":"34.21","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:14:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37ac067320 msgr2=0x7f37ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37ac067320 0x7f37ac0697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f37b800afd0 tx=0x7f37b801a000 comp rx=0 tx=0).stop 2023-10-14T19:14:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 msgr2=0x7f37c016d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 0x7f37c016d390 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f37c00cce10 tx=0x7f37b00014a0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 shutdown_connections 2023-10-14T19:14:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f37ac067320 0x7f37ac0697d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a8003c20 0x7f37c0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c016cef0 0x7f37c016d390 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 --2- 172.21.15.7:0/673293121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37c00b5bd0 0x7f37c016c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 >> 172.21.15.7:0/673293121 conn(0x7f37c0070e30 msgr2=0x7f37c00c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 shutdown_connections 2023-10-14T19:14:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.284+0000 7f37c8710700 1 -- 172.21.15.7:0/673293121 wait complete. 2023-10-14T19:14:33.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T19:03:03.675297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 33, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T19:12:19.972804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 34, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T19:12:20.504006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '200', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T19:14:33.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T19:14:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.419+0000 7f284eec1700 1 Processor -- start 2023-10-14T19:14:33.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.419+0000 7f284eec1700 1 -- start start 2023-10-14T19:14:33.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284eec1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2848159970 0x7f28480686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284eec1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480c9ab0 0x7f28480c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284eec1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2848068350 con 0x7f28480cbbc0 2023-10-14T19:14:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284eec1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2848067740 con 0x7f2848159970 2023-10-14T19:14:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284eec1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2848067a20 con 0x7f28480c9ab0 2023-10-14T19:14:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284cc5d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2848159970 0x7f28480686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284d45e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480c9ab0 0x7f28480c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f2847fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f28480cbbc0 0x7f28480c93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:51544/0 (socket says 172.21.15.7:51544) 2023-10-14T19:14:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f2847fff700 1 -- 172.21.15.7:0/1373188171 learned_addr learned my addr 172.21.15.7:0/1373188171 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284cc5d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2848159970 0x7f28480686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:60946/0 (socket says 172.21.15.7:60946) 2023-10-14T19:14:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284cc5d700 1 -- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480c9ab0 msgr2=0x7f28480c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284cc5d700 1 --2- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480c9ab0 0x7f28480c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284cc5d700 1 -- 172.21.15.7:0/1373188171 >> v1:172.21.15.148:6789/0 conn(0x7f28480cbbc0 legacy=0x7f28480c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284cc5d700 1 -- 172.21.15.7:0/1373188171 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848067d00 con 0x7f2848159970 2023-10-14T19:14:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f28477fe700 1 -- 172.21.15.7:0/1373188171 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033195130 0 0) 0x7f2848068350 con 0x7f28480cbbc0 2023-10-14T19:14:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.420+0000 7f284d45e700 1 --2- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480c9ab0 0x7f28480c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:14:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284cc5d700 1 --2- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2848159970 0x7f28480686a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f28380098e0 tx=0x7f28380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b870655f545ff67c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f28477fe700 1 -- 172.21.15.7:0/1373188171 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800b640 con 0x7f2848159970 2023-10-14T19:14:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f28477fe700 1 -- 172.21.15.7:0/1373188171 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283800b7a0 con 0x7f2848159970 2023-10-14T19:14:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f28477fe700 1 -- 172.21.15.7:0/1373188171 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800bb40 con 0x7f2848159970 2023-10-14T19:14:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 -- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2848159970 msgr2=0x7f28480686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 --2- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2848159970 0x7f28480686a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f28380098e0 tx=0x7f28380091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 -- 172.21.15.7:0/1373188171 shutdown_connections 2023-10-14T19:14:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 --2- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480c9ab0 0x7f28480c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 --2- 172.21.15.7:0/1373188171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2848159970 0x7f28480686a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 -- 172.21.15.7:0/1373188171 >> 172.21.15.7:0/1373188171 conn(0x7f284806e250 msgr2=0x7f28480cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:33.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 -- 172.21.15.7:0/1373188171 shutdown_connections 2023-10-14T19:14:33.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.421+0000 7f284eec1700 1 -- 172.21.15.7:0/1373188171 wait complete. 2023-10-14T19:14:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.422+0000 7f284eec1700 1 Processor -- start 2023-10-14T19:14:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 -- start start 2023-10-14T19:14:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28480c9ab0 0x7f28480c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480cbbc0 0x7f28480c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 0x7f28480c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28481545a0 con 0x7f2848159970 2023-10-14T19:14:33.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c3730 con 0x7f28480c9ab0 2023-10-14T19:14:33.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.423+0000 7f284eec1700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c74c0 con 0x7f28480cbbc0 2023-10-14T19:14:33.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 0x7f28480c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 0x7f28480c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36148/0 (socket says 172.21.15.7:36148) 2023-10-14T19:14:33.431 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 -- 172.21.15.7:0/2396693590 learned_addr learned my addr 172.21.15.7:0/2396693590 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:33.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f2847fff700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480cbbc0 0x7f28480c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284cc5d700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28480c9ab0 0x7f28480c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 -- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480cbbc0 msgr2=0x7f28480c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480cbbc0 0x7f28480c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.432 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 -- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28480c9ab0 msgr2=0x7f28480c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28480c9ab0 0x7f28480c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 -- 172.21.15.7:0/2396693590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009a20 con 0x7f2848159970 2023-10-14T19:14:33.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284d45e700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 0x7f28480c31f0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f2840009fc0 tx=0x7f284000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000cbd0 con 0x7f2848159970 2023-10-14T19:14:33.433 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000f040 con 0x7f2848159970 2023-10-14T19:14:33.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2838009420 con 0x7f2848159970 2023-10-14T19:14:33.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840014480 con 0x7f2848159970 2023-10-14T19:14:33.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.424+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2848153f50 con 0x7f2848159970 2023-10-14T19:14:33.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.425+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848154710 con 0x7f2848159970 2023-10-14T19:14:33.434 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.426+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2840003020 con 0x7f2848159970 2023-10-14T19:14:33.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.426+0000 7f2844ff9700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2834067320 0x7f28340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.426+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f28400856f0 con 0x7f2848159970 2023-10-14T19:14:33.435 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.426+0000 7f284cc5d700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2834067320 0x7f28340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.427+0000 7f284cc5d700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2834067320 0x7f28340697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f28380091e0 tx=0x7f2838017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.436 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.431+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2840052220 con 0x7f2848159970 2023-10-14T19:14:33.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.621+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f284804c3c0 con 0x7f2848159970 2023-10-14T19:14:33.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.622+0000 7f2844ff9700 1 -- 172.21.15.7:0/2396693590 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v202) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2840055840 con 0x7f2848159970 2023-10-14T19:14:33.622 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-10-14T19:14:33.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2834067320 msgr2=0x7f28340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2834067320 0x7f28340697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f28380091e0 tx=0x7f2838017000 comp rx=0 tx=0).stop 2023-10-14T19:14:33.624 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 msgr2=0x7f28480c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 0x7f28480c31f0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f2840009fc0 tx=0x7f284000b040 comp rx=0 tx=0).stop 2023-10-14T19:14:33.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 shutdown_connections 2023-10-14T19:14:33.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2834067320 0x7f28340697d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28480c9ab0 0x7f28480c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.625 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2848159970 0x7f28480c31f0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 --2- 172.21.15.7:0/2396693590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28480cbbc0 0x7f28480c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 >> 172.21.15.7:0/2396693590 conn(0x7f284806e250 msgr2=0x7f284814bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:33.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 shutdown_connections 2023-10-14T19:14:33.626 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.624+0000 7f284eec1700 1 -- 172.21.15.7:0/2396693590 wait complete. 2023-10-14T19:14:33.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T19:14:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.759+0000 7f1597c85700 1 Processor -- start 2023-10-14T19:14:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.759+0000 7f1597c85700 1 -- start start 2023-10-14T19:14:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1597c85700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 0x7f15900ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1597c85700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159015a750 con 0x7f1590157360 2023-10-14T19:14:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1597c85700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1590068540 con 0x7f159006d280 2023-10-14T19:14:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1597c85700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1590159e40 con 0x7f159015abe0 2023-10-14T19:14:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1595a21700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1590157360 0x7f1590067e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42734/0 (socket says 172.21.15.7:42734) 2023-10-14T19:14:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1595a21700 1 -- 172.21.15.7:0/2666391200 learned_addr learned my addr 172.21.15.7:0/2666391200 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1595220700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 0x7f15900ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459621149 0 0) 0x7f159015a750 con 0x7f1590157360 2023-10-14T19:14:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1578003570 con 0x7f1590157360 2023-10-14T19:14:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220347001 0 0) 0x7f1590068540 con 0x7f159006d280 2023-10-14T19:14:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f159015a750 con 0x7f159006d280 2023-10-14T19:14:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256931904 0 0) 0x7f1578003570 con 0x7f1590157360 2023-10-14T19:14:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 msgr2=0x7f15900ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 0x7f15900ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 >> v1:172.21.15.148:6789/0 conn(0x7f159006d280 legacy=0x7f159015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900687a0 con 0x7f1590157360 2023-10-14T19:14:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f15880017f0 con 0x7f1590157360 2023-10-14T19:14:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 >> v1:172.21.15.7:6789/0 conn(0x7f1590157360 legacy=0x7f1590067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1578003c20 0x7f1578004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 0x7f1578004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1578004d50 0x7f15780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590159e40 con 0x7f1578004d50 2023-10-14T19:14:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157800bb70 con 0x7f1578003c20 2023-10-14T19:14:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157800bd30 con 0x7f159015abe0 2023-10-14T19:14:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1596222700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1578004d50 0x7f15780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.760+0000 7f1595a21700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1578003c20 0x7f1578004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1595220700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 0x7f1578004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 -- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 msgr2=0x7f1578004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f159015abe0 0x7f1578004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 -- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1578003c20 msgr2=0x7f1578004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1578003c20 0x7f1578004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 -- 172.21.15.7:0/2666391200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578003570 con 0x7f1578004d50 2023-10-14T19:14:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1578004d50 0x7f15780051c0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1580001a10 tx=0x7f1580007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b9ffe541b98073 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000c5d0 con 0x7f1578004d50 2023-10-14T19:14:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158000c730 con 0x7f1578004d50 2023-10-14T19:14:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1594a1f700 1 -- 172.21.15.7:0/2666391200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000cad0 con 0x7f1578004d50 2023-10-14T19:14:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1597c85700 1 -- 172.21.15.7:0/2666391200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1578004d50 msgr2=0x7f15780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1597c85700 1 --2- 172.21.15.7:0/2666391200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1578004d50 0x7f15780051c0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1580001a10 tx=0x7f1580007d30 comp rx=0 tx=0).stop 2023-10-14T19:14:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.761+0000 7f1596222700 1 -- 172.21.15.7:0/2666391200 reap_dead start 2023-10-14T19:14:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.762+0000 7f1597c85700 1 -- 172.21.15.7:0/2666391200 shutdown_connections 2023-10-14T19:14:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.762+0000 7f1597c85700 1 -- 172.21.15.7:0/2666391200 >> 172.21.15.7:0/2666391200 conn(0x7f15900ccb50 msgr2=0x7f15900ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.762+0000 7f1597c85700 1 -- 172.21.15.7:0/2666391200 shutdown_connections 2023-10-14T19:14:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.762+0000 7f1597c85700 1 -- 172.21.15.7:0/2666391200 wait complete. 2023-10-14T19:14:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 Processor -- start 2023-10-14T19:14:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 -- start start 2023-10-14T19:14:33.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 0x7f15900ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15900aee30 0x7f15900af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15900b03e0 0x7f1590158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900aff80 con 0x7f15900aea60 2023-10-14T19:14:33.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900b0860 con 0x7f15900aee30 2023-10-14T19:14:33.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.763+0000 7f1597c85700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900ac410 con 0x7f15900b03e0 2023-10-14T19:14:33.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 0x7f15900ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 0x7f15900ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36164/0 (socket says 172.21.15.7:36164) 2023-10-14T19:14:33.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 -- 172.21.15.7:0/3092207777 learned_addr learned my addr 172.21.15.7:0/3092207777 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:33.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595220700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15900aee30 0x7f15900af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1596222700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15900b03e0 0x7f1590158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 -- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15900b03e0 msgr2=0x7f1590158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15900b03e0 0x7f1590158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 -- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15900aee30 msgr2=0x7f15900af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15900aee30 0x7f15900af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 -- 172.21.15.7:0/3092207777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900ac6f0 con 0x7f15900aea60 2023-10-14T19:14:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595220700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15900aee30 0x7f15900af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1595a21700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 0x7f15900ad1d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1588001150 tx=0x7f1588002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800aea0 con 0x7f15900aea60 2023-10-14T19:14:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15880133f0 con 0x7f15900aea60 2023-10-14T19:14:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15900ac9d0 con 0x7f15900aea60 2023-10-14T19:14:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880137d0 con 0x7f15900aea60 2023-10-14T19:14:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.764+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1590158c40 con 0x7f15900aea60 2023-10-14T19:14:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.765+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159004c3c0 con 0x7f15900aea60 2023-10-14T19:14:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.766+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1588013b40 con 0x7f15900aea60 2023-10-14T19:14:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.766+0000 7f158dffb700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f157c067320 0x7f157c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.766+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1588085c40 con 0x7f15900aea60 2023-10-14T19:14:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.766+0000 7f1595220700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f157c067320 0x7f157c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.767+0000 7f1595220700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f157c067320 0x7f157c0697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1584006eb0 tx=0x7f1584008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.770+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1588052880 con 0x7f15900aea60 2023-10-14T19:14:33.963 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.963+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f159015a100 con 0x7f15900aea60 2023-10-14T19:14:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.964+0000 7f158dffb700 1 -- 172.21.15.7:0/3092207777 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v202) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1588055ea0 con 0x7f15900aea60 2023-10-14T19:14:33.964 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-10-14T19:14:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f157c067320 msgr2=0x7f157c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f157c067320 0x7f157c0697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1584006eb0 tx=0x7f1584008040 comp rx=0 tx=0).stop 2023-10-14T19:14:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 msgr2=0x7f15900ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 0x7f15900ad1d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1588001150 tx=0x7f1588002170 comp rx=0 tx=0).stop 2023-10-14T19:14:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 shutdown_connections 2023-10-14T19:14:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f157c067320 0x7f157c0697d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15900b03e0 0x7f1590158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15900aea60 0x7f15900ad1d0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 --2- 172.21.15.7:0/3092207777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15900aee30 0x7f15900af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 >> 172.21.15.7:0/3092207777 conn(0x7f15900ccb50 msgr2=0x7f15900c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 shutdown_connections 2023-10-14T19:14:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:33.966+0000 7f1597c85700 1 -- 172.21.15.7:0/3092207777 wait complete. 2023-10-14T19:14:33.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T19:14:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.101+0000 7fe6c6228700 1 Processor -- start 2023-10-14T19:14:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.101+0000 7fe6c6228700 1 -- start start 2023-10-14T19:14:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6c6228700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6c006dc70 0x7fe6c0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6c6228700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6c006e0e0 0x7fe6c00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6c6228700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c00ccfd0 con 0x7fe6c0159530 2023-10-14T19:14:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6c6228700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c015a3d0 con 0x7fe6c006e0e0 2023-10-14T19:14:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6c6228700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c015a6b0 con 0x7fe6c006dc70 2023-10-14T19:14:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6c006e0e0 0x7fe6c00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6c006e0e0 0x7fe6c00cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36176/0 (socket says 172.21.15.7:36176) 2023-10-14T19:14:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 -- 172.21.15.7:0/4030489586 learned_addr learned my addr 172.21.15.7:0/4030489586 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6beffd700 1 --2- 172.21.15.7:0/4030489586 >> v2:172.21.15.148:3300/0 conn(0x7fe6c006dc70 0x7fe6c0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 -- 172.21.15.7:0/4030489586 >> v2:172.21.15.148:3300/0 conn(0x7fe6c006dc70 msgr2=0x7fe6c0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 --2- 172.21.15.7:0/4030489586 >> v2:172.21.15.148:3300/0 conn(0x7fe6c006dc70 0x7fe6c0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 -- 172.21.15.7:0/4030489586 >> v1:172.21.15.148:6789/0 conn(0x7fe6c0159530 legacy=0x7fe6c00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.102+0000 7fe6bffff700 1 -- 172.21.15.7:0/4030489586 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c015a990 con 0x7fe6c006e0e0 2023-10-14T19:14:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6bffff700 1 --2- 172.21.15.7:0/4030489586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c00cb6f0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b66e0 tx=0x7fe6b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6e9278f8eb0136 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6be7fc700 1 -- 172.21.15.7:0/4030489586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000e070 con 0x7fe6c006e0e0 2023-10-14T19:14:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6be7fc700 1 -- 172.21.15.7:0/4030489586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b000ba10 con 0x7fe6c006e0e0 2023-10-14T19:14:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6be7fc700 1 -- 172.21.15.7:0/4030489586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00092e0 con 0x7fe6c006e0e0 2023-10-14T19:14:34.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 -- 172.21.15.7:0/4030489586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 msgr2=0x7fe6c00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 --2- 172.21.15.7:0/4030489586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c00cb6f0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b66e0 tx=0x7fe6b0009840 comp rx=0 tx=0).stop 2023-10-14T19:14:34.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 -- 172.21.15.7:0/4030489586 shutdown_connections 2023-10-14T19:14:34.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 --2- 172.21.15.7:0/4030489586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c00cb6f0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 --2- 172.21.15.7:0/4030489586 >> v2:172.21.15.148:3300/0 conn(0x7fe6c006dc70 0x7fe6c0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 -- 172.21.15.7:0/4030489586 >> 172.21.15.7:0/4030489586 conn(0x7fe6c00703a0 msgr2=0x7fe6c00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 -- 172.21.15.7:0/4030489586 shutdown_connections 2023-10-14T19:14:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.103+0000 7fe6c6228700 1 -- 172.21.15.7:0/4030489586 wait complete. 2023-10-14T19:14:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.104+0000 7fe6c6228700 1 Processor -- start 2023-10-14T19:14:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 -- start start 2023-10-14T19:14:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6c006dc70 0x7fe6c00c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6beffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c0153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6beffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c0153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36190/0 (socket says 172.21.15.7:36190) 2023-10-14T19:14:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0159530 0x7fe6c00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6beffd700 1 -- 172.21.15.7:0/404614924 learned_addr learned my addr 172.21.15.7:0/404614924 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00c9870 con 0x7fe6c006e0e0 2023-10-14T19:14:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00c87d0 con 0x7fe6c0159530 2023-10-14T19:14:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.105+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00c81a0 con 0x7fe6c006dc70 2023-10-14T19:14:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6bf7fe700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6c006dc70 0x7fe6c00c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6bffff700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0159530 0x7fe6c00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6beffd700 1 -- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6c006dc70 msgr2=0x7fe6c00c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6beffd700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6c006dc70 0x7fe6c00c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6beffd700 1 -- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0159530 msgr2=0x7fe6c00b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6beffd700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0159530 0x7fe6c00b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6beffd700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0009ae0 con 0x7fe6c006e0e0 2023-10-14T19:14:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6bffff700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0159530 0x7fe6c00b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6beffd700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c0153c60 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800d890 tx=0x7fe6a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80125f0 con 0x7fe6c006e0e0 2023-10-14T19:14:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8012750 con 0x7fe6c006e0e0 2023-10-14T19:14:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c00c9a80 con 0x7fe6c006e0e0 2023-10-14T19:14:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8012ad0 con 0x7fe6c006e0e0 2023-10-14T19:14:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.106+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c00c9e10 con 0x7fe6c006e0e0 2023-10-14T19:14:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.107+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c00c8960 con 0x7fe6c006e0e0 2023-10-14T19:14:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.108+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe6a801e460 con 0x7fe6c006e0e0 2023-10-14T19:14:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.108+0000 7fe6b77fe700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6a0067320 0x7fe6a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.108+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fe6a80852d0 con 0x7fe6c006e0e0 2023-10-14T19:14:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.108+0000 7fe6bf7fe700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6a0067320 0x7fe6a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.109+0000 7fe6bf7fe700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6a0067320 0x7fe6a00697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009af0 tx=0x7fe6b8009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.112+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6a8051f10 con 0x7fe6c006e0e0 2023-10-14T19:14:34.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.306+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6c00c9200 con 0x7fe6c006e0e0 2023-10-14T19:14:34.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.306+0000 7fe6b77fe700 1 -- 172.21.15.7:0/404614924 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v202) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6a8055530 con 0x7fe6c006e0e0 2023-10-14T19:14:34.307 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-10-14T19:14:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6a0067320 msgr2=0x7fe6a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6a0067320 0x7fe6a00697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009af0 tx=0x7fe6b8009060 comp rx=0 tx=0).stop 2023-10-14T19:14:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 msgr2=0x7fe6c0153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c0153c60 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800d890 tx=0x7fe6a8008040 comp rx=0 tx=0).stop 2023-10-14T19:14:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 shutdown_connections 2023-10-14T19:14:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe6a0067320 0x7fe6a00697d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0159530 0x7fe6c00b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6c006dc70 0x7fe6c00c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 --2- 172.21.15.7:0/404614924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c006e0e0 0x7fe6c0153c60 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 >> 172.21.15.7:0/404614924 conn(0x7fe6c00703a0 msgr2=0x7fe6c015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 shutdown_connections 2023-10-14T19:14:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.308+0000 7fe6c6228700 1 -- 172.21.15.7:0/404614924 wait complete. 2023-10-14T19:14:34.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:14:34.440 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.440+0000 7f4eb8ec7700 1 Processor -- start 2023-10-14T19:14:34.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.440+0000 7f4eb8ec7700 1 -- start start 2023-10-14T19:14:34.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb8ec7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 0x7f4eb415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb8ec7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb415afd0 con 0x7f4eb415de50 2023-10-14T19:14:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb8ec7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb415b2b0 con 0x7f4eb40cf110 2023-10-14T19:14:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb8ec7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb415b590 con 0x7f4eb4153c30 2023-10-14T19:14:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb2ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4eb415de50 0x7f4eb40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42740/0 (socket says 172.21.15.7:42740) 2023-10-14T19:14:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb2ffd700 1 -- 172.21.15.7:0/3089155142 learned_addr learned my addr 172.21.15.7:0/3089155142 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb37fe700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 0x7f4eb415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731234286 0 0) 0x7f4eb415afd0 con 0x7f4eb415de50 2023-10-14T19:14:34.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.441+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c003570 con 0x7f4eb415de50 2023-10-14T19:14:34.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726136923 0 0) 0x7f4e9c003570 con 0x7f4eb415de50 2023-10-14T19:14:34.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 msgr2=0x7f4eb415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 0x7f4eb415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 >> v1:172.21.15.148:6789/0 conn(0x7f4eb40cf110 legacy=0x7f4eb415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb415b870 con 0x7f4eb415de50 2023-10-14T19:14:34.450 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f4ea8001470 con 0x7f4eb415de50 2023-10-14T19:14:34.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 >> v1:172.21.15.7:6789/0 conn(0x7f4eb415de50 legacy=0x7f4eb40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 0x7f4e9c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e9c004010 0x7f4e9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.451 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb415b590 con 0x7f4e9c004d50 2023-10-14T19:14:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bbf0 con 0x7f4e9c004010 2023-10-14T19:14:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bdb0 con 0x7f4eb4153c30 2023-10-14T19:14:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb37fe700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 0x7f4e9c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb2ffd700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e9c004010 0x7f4e9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 -- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 msgr2=0x7f4e9c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.453 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb4153c30 0x7f4e9c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 -- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e9c004010 msgr2=0x7f4e9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e9c004010 0x7f4e9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 -- 172.21.15.7:0/3089155142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c003570 con 0x7f4e9c004d50 2023-10-14T19:14:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.442+0000 7f4eb3fff700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4eac001f90 tx=0x7f4eac001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dc50d77d0ff484 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac001950 con 0x7f4e9c004d50 2023-10-14T19:14:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00c8b0 con 0x7f4e9c004d50 2023-10-14T19:14:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb27fc700 1 -- 172.21.15.7:0/3089155142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00cc70 con 0x7f4e9c004d50 2023-10-14T19:14:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/3089155142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 msgr2=0x7f4e9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/3089155142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4eac001f90 tx=0x7f4eac001640 comp rx=0 tx=0).stop 2023-10-14T19:14:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb3fff700 1 -- 172.21.15.7:0/3089155142 reap_dead start 2023-10-14T19:14:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/3089155142 shutdown_connections 2023-10-14T19:14:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/3089155142 >> 172.21.15.7:0/3089155142 conn(0x7f4eb40703a0 msgr2=0x7f4eb40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/3089155142 shutdown_connections 2023-10-14T19:14:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.443+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/3089155142 wait complete. 2023-10-14T19:14:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.444+0000 7f4eb8ec7700 1 Processor -- start 2023-10-14T19:14:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.444+0000 7f4eb8ec7700 1 -- start start 2023-10-14T19:14:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb8ec7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4eb40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb8ec7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eb40b5bf0 0x7f4eb40c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb8ec7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb40b3f30 0x7f4eb4141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb8ec7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40c84b0 con 0x7f4e9c004d50 2023-10-14T19:14:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb8ec7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4150e60 con 0x7f4eb40b5bf0 2023-10-14T19:14:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb8ec7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b3810 con 0x7f4eb40b3f30 2023-10-14T19:14:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4eb40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4eb40b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36218/0 (socket says 172.21.15.7:36218) 2023-10-14T19:14:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.445+0000 7f4eb37fe700 1 -- 172.21.15.7:0/245967753 learned_addr learned my addr 172.21.15.7:0/245967753 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb37fe700 1 -- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb40b3f30 msgr2=0x7f4eb4141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb37fe700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb40b3f30 0x7f4eb4141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb37fe700 1 -- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eb40b5bf0 msgr2=0x7f4eb40c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb37fe700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eb40b5bf0 0x7f4eb40c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb37fe700 1 -- 172.21.15.7:0/245967753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40b6180 con 0x7f4e9c004d50 2023-10-14T19:14:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb37fe700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4eb40b32d0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006ac0 tx=0x7f4ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.461 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400fa10 con 0x7f4e9c004d50 2023-10-14T19:14:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400fb70 con 0x7f4e9c004d50 2023-10-14T19:14:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb40c8700 con 0x7f4e9c004d50 2023-10-14T19:14:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4014440 con 0x7f4e9c004d50 2023-10-14T19:14:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.446+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb40ca1b0 con 0x7f4e9c004d50 2023-10-14T19:14:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.447+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb404c3c0 con 0x7f4e9c004d50 2023-10-14T19:14:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.447+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4ea4014870 con 0x7f4e9c004d50 2023-10-14T19:14:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.448+0000 7f4e9b7fe700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ea0067320 0x7f4ea00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.448+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f4ea4018030 con 0x7f4e9c004d50 2023-10-14T19:14:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.448+0000 7f4eb2ffd700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ea0067320 0x7f4ea00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.449+0000 7f4eb2ffd700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ea0067320 0x7f4ea00697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8000e10 tx=0x7f4ea8001e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.452+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ea4052410 con 0x7f4e9c004d50 2023-10-14T19:14:34.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.687+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb40c9890 con 0x7f4e9c004d50 2023-10-14T19:14:34.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.688+0000 7f4e9b7fe700 1 -- 172.21.15.7:0/245967753 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f4ea4055a30 con 0x7f4e9c004d50 2023-10-14T19:14:34.688 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:34.688 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":133,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:12:21.531996+0000","modified":"2023-10-14T19:12:25.155754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9078":{"gid":9078,"name":"a","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/1294066545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1294066545},{"type":"v1","addr":"172.21.15.7:6835","nonce":1294066545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-14T19:14:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.689+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ea0067320 msgr2=0x7f4ea00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.689+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ea0067320 0x7f4ea00697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8000e10 tx=0x7f4ea8001e50 comp rx=0 tx=0).stop 2023-10-14T19:14:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 msgr2=0x7f4eb40b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4eb40b32d0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006ac0 tx=0x7f4ea40091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 shutdown_connections 2023-10-14T19:14:34.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4ea0067320 0x7f4ea00697d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4eb40b3f30 0x7f4eb4141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c004d50 0x7f4eb40b32d0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 --2- 172.21.15.7:0/245967753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eb40b5bf0 0x7f4eb40c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 >> 172.21.15.7:0/245967753 conn(0x7f4eb40703a0 msgr2=0x7f4eb40c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:34.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 shutdown_connections 2023-10-14T19:14:34.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.690+0000 7f4eb8ec7700 1 -- 172.21.15.7:0/245967753 wait complete. 2023-10-14T19:14:34.692 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 133 2023-10-14T19:14:34.702 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:14:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.821+0000 7fbfb5eb0700 1 Processor -- start 2023-10-14T19:14:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.821+0000 7fbfb5eb0700 1 -- start start 2023-10-14T19:14:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfb5eb0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb00cb5a0 0x7fbfb00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfb5eb0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfb00cde50 0x7fbfb0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfb5eb0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb015ae40 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfb5eb0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb00d13f0 con 0x7fbfb00cde50 2023-10-14T19:14:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfb5eb0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb015ab60 con 0x7fbfb00cb5a0 2023-10-14T19:14:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfaffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfb00cde50 0x7fbfb0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfaffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfb00cde50 0x7fbfb0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36228/0 (socket says 172.21.15.7:36228) 2023-10-14T19:14:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.822+0000 7fbfaffff700 1 -- 172.21.15.7:0/467660692 learned_addr learned my addr 172.21.15.7:0/467660692 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:34.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaffff700 1 -- 172.21.15.7:0/467660692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb00cb5a0 msgr2=0x7fbfb00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaf7fe700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb00cb5a0 0x7fbfb00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaffff700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb00cb5a0 0x7fbfb00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.826 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaffff700 1 -- 172.21.15.7:0/467660692 >> v1:172.21.15.148:6789/0 conn(0x7fbfb00cd9e0 legacy=0x7fbfb0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:34.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaffff700 1 -- 172.21.15.7:0/467660692 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00ccf00 con 0x7fbfb00cde50 2023-10-14T19:14:34.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaf7fe700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb00cb5a0 0x7fbfb00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:34.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfaffff700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cde50 0x7fbfb0156e90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009f20 tx=0x7fbfa8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5001f28d1faf9c6c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfae7fc700 1 -- 172.21.15.7:0/467660692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800e070 con 0x7fbfb00cde50 2023-10-14T19:14:34.827 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfae7fc700 1 -- 172.21.15.7:0/467660692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800ba40 con 0x7fbfb00cde50 2023-10-14T19:14:34.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.823+0000 7fbfae7fc700 1 -- 172.21.15.7:0/467660692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80092e0 con 0x7fbfb00cde50 2023-10-14T19:14:34.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/467660692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cde50 msgr2=0x7fbfb0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cde50 0x7fbfb0156e90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009f20 tx=0x7fbfa8009840 comp rx=0 tx=0).stop 2023-10-14T19:14:34.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/467660692 shutdown_connections 2023-10-14T19:14:34.828 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cde50 0x7fbfb0156e90 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/467660692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb00cb5a0 0x7fbfb00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/467660692 >> 172.21.15.7:0/467660692 conn(0x7fbfb0070e30 msgr2=0x7fbfb00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:34.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/467660692 shutdown_connections 2023-10-14T19:14:34.829 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.824+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/467660692 wait complete. 2023-10-14T19:14:34.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.825+0000 7fbfb5eb0700 1 Processor -- start 2023-10-14T19:14:34.832 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.825+0000 7fbfb5eb0700 1 -- start start 2023-10-14T19:14:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb00cb5a0 0x7fbfb0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 0x7fbfb00ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb015b070 0x7fbfb016dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb016ec70 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb015e020 con 0x7fbfb00cb5a0 2023-10-14T19:14:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb015b5e0 con 0x7fbfb015b070 2023-10-14T19:14:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 0x7fbfb00ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 0x7fbfb00ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36244/0 (socket says 172.21.15.7:36244) 2023-10-14T19:14:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 -- 172.21.15.7:0/168761277 learned_addr learned my addr 172.21.15.7:0/168761277 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaf7fe700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb00cb5a0 0x7fbfb0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaffff700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb015b070 0x7fbfb016dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 -- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb015b070 msgr2=0x7fbfb016dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb015b070 0x7fbfb016dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 -- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb00cb5a0 msgr2=0x7fbfb0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb00cb5a0 0x7fbfb0156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 -- 172.21.15.7:0/168761277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8009ae0 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfaeffd700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 0x7fbfb00ca320 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c600 tx=0x7fbfa4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4011590 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4011710 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb015d6f0 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.826+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4011ad0 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.827+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb015dcb0 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.827+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb004c3c0 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.828+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbfa401c460 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.828+0000 7fbf977fe700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf9c067320 0x7fbf9c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.828+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fbfa40849b0 con 0x7fbfb00cd9e0 2023-10-14T19:14:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.829+0000 7fbfaf7fe700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf9c067320 0x7fbf9c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.829+0000 7fbfaf7fe700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf9c067320 0x7fbf9c0697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0006fd0 tx=0x7fbfa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:34.833+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfa40515b0 con 0x7fbfb00cd9e0 2023-10-14T19:14:35.027 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.027+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfb00cd1e0 con 0x7fbfb00cd9e0 2023-10-14T19:14:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.028+0000 7fbf977fe700 1 -- 172.21.15.7:0/168761277 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15461 (secure 0 0 0) 0x7fbfa4054bd0 con 0x7fbfb00cd9e0 2023-10-14T19:14:35.028 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:35.028 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":202,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:13:00.145591+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:12:19.972804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-14T19:12:20.504006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.2","mappings":[{"from":0,"to":2}]},{"pgid":"34.11","mappings":[{"from":0,"to":1}]},{"pgid":"34.21","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:14:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf9c067320 msgr2=0x7fbf9c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf9c067320 0x7fbf9c0697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0006fd0 tx=0x7fbfa0008040 comp rx=0 tx=0).stop 2023-10-14T19:14:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 msgr2=0x7fbfb00ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 0x7fbfb00ca320 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c600 tx=0x7fbfa4007f60 comp rx=0 tx=0).stop 2023-10-14T19:14:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 shutdown_connections 2023-10-14T19:14:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbf9c067320 0x7fbf9c0697d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb00cb5a0 0x7fbfb0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb015b070 0x7fbfb016dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 --2- 172.21.15.7:0/168761277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb00cd9e0 0x7fbfb00ca320 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 >> 172.21.15.7:0/168761277 conn(0x7fbfb0070e30 msgr2=0x7fbfb00b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 shutdown_connections 2023-10-14T19:14:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.030+0000 7fbfb5eb0700 1 -- 172.21.15.7:0/168761277 wait complete. 2023-10-14T19:14:35.043 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:14:35.044 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:14:35.163 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.164+0000 7efe51abd700 1 Processor -- start 2023-10-14T19:14:35.164 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.164+0000 7efe51abd700 1 -- start start 2023-10-14T19:14:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.164+0000 7efe51abd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe4c1597a0 0x7efe4c15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.164+0000 7efe51abd700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c06d840 con 0x7efe4c067fe0 2023-10-14T19:14:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.164+0000 7efe51abd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c15dbc0 con 0x7efe4c159b70 2023-10-14T19:14:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.164+0000 7efe51abd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c15dea0 con 0x7efe4c1597a0 2023-10-14T19:14:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4bfff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efe4c067fe0 0x7efe4c06dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42754/0 (socket says 172.21.15.7:42754) 2023-10-14T19:14:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4bfff700 1 -- 172.21.15.7:0/4214098414 learned_addr learned my addr 172.21.15.7:0/4214098414 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4b7fe700 1 --2- 172.21.15.7:0/4214098414 >> v2:172.21.15.148:3300/0 conn(0x7efe4c1597a0 0x7efe4c15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160493138 0 0) 0x7efe4c06d840 con 0x7efe4c067fe0 2023-10-14T19:14:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe34003570 con 0x7efe4c067fe0 2023-10-14T19:14:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080649972 0 0) 0x7efe34003570 con 0x7efe4c067fe0 2023-10-14T19:14:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 >> v2:172.21.15.148:3300/0 conn(0x7efe4c1597a0 msgr2=0x7efe4c15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 --2- 172.21.15.7:0/4214098414 >> v2:172.21.15.148:3300/0 conn(0x7efe4c1597a0 0x7efe4c15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 >> v1:172.21.15.148:6789/0 conn(0x7efe4c159b70 legacy=0x7efe4c0b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c15e180 con 0x7efe4c067fe0 2023-10-14T19:14:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7efe440017f0 con 0x7efe4c067fe0 2023-10-14T19:14:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 >> v1:172.21.15.7:6789/0 conn(0x7efe4c067fe0 legacy=0x7efe4c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe34003a60 0x7efe34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe340051c0 0x7efe3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c15dea0 con 0x7efe34004810 2023-10-14T19:14:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3400c0d0 con 0x7efe340051c0 2023-10-14T19:14:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3400c290 con 0x7efe34003a60 2023-10-14T19:14:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4affd700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.165+0000 7efe4b7fe700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe34003a60 0x7efe34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4bfff700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe340051c0 0x7efe3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4affd700 1 -- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe34003a60 msgr2=0x7efe34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4affd700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe34003a60 0x7efe34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4affd700 1 -- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe340051c0 msgr2=0x7efe3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4affd700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe340051c0 0x7efe3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4bfff700 1 -- 172.21.15.7:0/4214098414 reap_dead start 2023-10-14T19:14:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4affd700 1 -- 172.21.15.7:0/4214098414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34003570 con 0x7efe34004810 2023-10-14T19:14:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4b7fe700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe34003a60 0x7efe34003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4affd700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe34004c80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7efe400018b0 tx=0x7efe40007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2e97e229339b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40012420 con 0x7efe34004810 2023-10-14T19:14:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe400125a0 con 0x7efe34004810 2023-10-14T19:14:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe4a7fc700 1 -- 172.21.15.7:0/4214098414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40012960 con 0x7efe34004810 2023-10-14T19:14:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe51abd700 1 -- 172.21.15.7:0/4214098414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 msgr2=0x7efe34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe51abd700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe34004c80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7efe400018b0 tx=0x7efe40007d30 comp rx=0 tx=0).stop 2023-10-14T19:14:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe51abd700 1 -- 172.21.15.7:0/4214098414 shutdown_connections 2023-10-14T19:14:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe51abd700 1 --2- 172.21.15.7:0/4214098414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe34004c80 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.166+0000 7efe51abd700 1 -- 172.21.15.7:0/4214098414 >> 172.21.15.7:0/4214098414 conn(0x7efe4c0ce6b0 msgr2=0x7efe4c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.167+0000 7efe51abd700 1 -- 172.21.15.7:0/4214098414 shutdown_connections 2023-10-14T19:14:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.167+0000 7efe51abd700 1 -- 172.21.15.7:0/4214098414 wait complete. 2023-10-14T19:14:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 Processor -- start 2023-10-14T19:14:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 -- start start 2023-10-14T19:14:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe4c169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe4c16dbc0 0x7efe4c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe4c0adad0 0x7efe4c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.179 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0c3800 con 0x7efe34004810 2023-10-14T19:14:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0aec70 con 0x7efe4c16dbc0 2023-10-14T19:14:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.168+0000 7efe51abd700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0ae3d0 con 0x7efe4c0adad0 2023-10-14T19:14:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe4c169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe4c169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36264/0 (socket says 172.21.15.7:36264) 2023-10-14T19:14:35.180 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 -- 172.21.15.7:0/1815987575 learned_addr learned my addr 172.21.15.7:0/1815987575 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4affd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe4c16dbc0 0x7efe4c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4bfff700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe4c0adad0 0x7efe4c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 -- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe4c0adad0 msgr2=0x7efe4c150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe4c0adad0 0x7efe4c150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 -- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe4c16dbc0 msgr2=0x7efe4c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe4c16dbc0 0x7efe4c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 -- 172.21.15.7:0/1815987575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c0ae6b0 con 0x7efe34004810 2023-10-14T19:14:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4bfff700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe4c0adad0 0x7efe4c150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe4b7fe700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe4c169490 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7efe3c011730 tx=0x7efe3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c015670 con 0x7efe34004810 2023-10-14T19:14:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c0157d0 con 0x7efe34004810 2023-10-14T19:14:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c0ae990 con 0x7efe34004810 2023-10-14T19:14:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c015b90 con 0x7efe34004810 2023-10-14T19:14:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.169+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c0adf40 con 0x7efe34004810 2023-10-14T19:14:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.170+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c0c35d0 con 0x7efe34004810 2023-10-14T19:14:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.171+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efe3c013410 con 0x7efe34004810 2023-10-14T19:14:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.171+0000 7efe337fe700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe38067320 0x7efe380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.171+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7efe3c085410 con 0x7efe34004810 2023-10-14T19:14:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.171+0000 7efe4affd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe38067320 0x7efe380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.172+0000 7efe4affd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe38067320 0x7efe380697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efe4c156750 tx=0x7efe40015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.175+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe4c0c35d0 con 0x7efe34004810 2023-10-14T19:14:35.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.412+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe4c0c35d0 con 0x7efe34004810 2023-10-14T19:14:35.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.413+0000 7efe337fe700 1 -- 172.21.15.7:0/1815987575 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) v1 ==== 95+0+4604 (secure 0 0 0) 0x7efe4c0c35d0 con 0x7efe34004810 2023-10-14T19:14:35.413 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:35.413 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":133,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:12:21.531996+0000","modified":"2023-10-14T19:12:25.155754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9078":{"gid":9078,"name":"a","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/1294066545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1294066545},{"type":"v1","addr":"172.21.15.7:6835","nonce":1294066545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-14T19:14:35.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe38067320 msgr2=0x7efe380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe38067320 0x7efe380697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efe4c156750 tx=0x7efe40015000 comp rx=0 tx=0).stop 2023-10-14T19:14:35.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 msgr2=0x7efe4c169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe4c169490 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7efe3c011730 tx=0x7efe3c008040 comp rx=0 tx=0).stop 2023-10-14T19:14:35.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 shutdown_connections 2023-10-14T19:14:35.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efe38067320 0x7efe380697d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe4c0adad0 0x7efe4c150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe34004810 0x7efe4c169490 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 --2- 172.21.15.7:0/1815987575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe4c16dbc0 0x7efe4c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 >> 172.21.15.7:0/1815987575 conn(0x7efe4c0ce6b0 msgr2=0x7efe4c0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:35.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 shutdown_connections 2023-10-14T19:14:35.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.415+0000 7efe51abd700 1 -- 172.21.15.7:0/1815987575 wait complete. 2023-10-14T19:14:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 133 2023-10-14T19:14:35.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:14:35.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.547+0000 7f5a38bb2700 1 Processor -- start 2023-10-14T19:14:35.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.547+0000 7f5a38bb2700 1 -- start start 2023-10-14T19:14:35.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.547+0000 7f5a38bb2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a3415d440 0x7f5a340aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a38bb2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415df20 0x7f5a3406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a38bb2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3415a750 con 0x7f5a3406c6a0 2023-10-14T19:14:35.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a38bb2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3406d080 con 0x7f5a3415d440 2023-10-14T19:14:35.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a38bb2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3415e3a0 con 0x7f5a3415df20 2023-10-14T19:14:35.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a32d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415df20 0x7f5a3406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a3259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a3415d440 0x7f5a340aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a31d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5a3406c6a0 0x7f5a3415d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:51588/0 (socket says 172.21.15.7:51588) 2023-10-14T19:14:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a31d9b700 1 -- 172.21.15.7:0/2139447256 learned_addr learned my addr 172.21.15.7:0/2139447256 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a32d9d700 1 -- 172.21.15.7:0/2139447256 >> v2:172.21.15.148:3300/0 conn(0x7f5a3415d440 msgr2=0x7f5a340aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:35.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a32d9d700 1 --2- 172.21.15.7:0/2139447256 >> v2:172.21.15.148:3300/0 conn(0x7f5a3415d440 0x7f5a340aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a32d9d700 1 -- 172.21.15.7:0/2139447256 >> v1:172.21.15.148:6789/0 conn(0x7f5a3406c6a0 legacy=0x7f5a3415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a32d9d700 1 -- 172.21.15.7:0/2139447256 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34159e40 con 0x7f5a3415df20 2023-10-14T19:14:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.548+0000 7f5a3259c700 1 --2- 172.21.15.7:0/2139447256 >> v2:172.21.15.148:3300/0 conn(0x7f5a3415d440 0x7f5a340aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:14:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a32d9d700 1 --2- 172.21.15.7:0/2139447256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415df20 0x7f5a3406cb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009e60 tx=0x7f5a24009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e604082a90ab21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a3159a700 1 -- 172.21.15.7:0/2139447256 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400e070 con 0x7f5a3415df20 2023-10-14T19:14:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a3159a700 1 -- 172.21.15.7:0/2139447256 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400bb60 con 0x7f5a3415df20 2023-10-14T19:14:35.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a3159a700 1 -- 172.21.15.7:0/2139447256 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24012430 con 0x7f5a3415df20 2023-10-14T19:14:35.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 -- 172.21.15.7:0/2139447256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415df20 msgr2=0x7f5a3406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/2139447256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415df20 0x7f5a3406cb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009e60 tx=0x7f5a24009780 comp rx=0 tx=0).stop 2023-10-14T19:14:35.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 -- 172.21.15.7:0/2139447256 shutdown_connections 2023-10-14T19:14:35.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/2139447256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415df20 0x7f5a3406cb40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/2139447256 >> v2:172.21.15.148:3300/0 conn(0x7f5a3415d440 0x7f5a340aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 -- 172.21.15.7:0/2139447256 >> 172.21.15.7:0/2139447256 conn(0x7f5a3406f190 msgr2=0x7f5a340ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:35.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 -- 172.21.15.7:0/2139447256 shutdown_connections 2023-10-14T19:14:35.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.549+0000 7f5a38bb2700 1 -- 172.21.15.7:0/2139447256 wait complete. 2023-10-14T19:14:35.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.550+0000 7f5a38bb2700 1 Processor -- start 2023-10-14T19:14:35.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 -- start start 2023-10-14T19:14:35.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 0x7f5a3414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415d440 0x7f5a3414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a3415df20 0x7f5a340ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340ad490 con 0x7f5a3406c6a0 2023-10-14T19:14:35.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340ad920 con 0x7f5a3415df20 2023-10-14T19:14:35.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a38bb2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340acb60 con 0x7f5a3415d440 2023-10-14T19:14:35.558 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 0x7f5a3414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 0x7f5a3414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36266/0 (socket says 172.21.15.7:36266) 2023-10-14T19:14:35.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a3259c700 1 -- 172.21.15.7:0/4031903110 learned_addr learned my addr 172.21.15.7:0/4031903110 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:35.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a31d9b700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415d440 0x7f5a3414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.551+0000 7f5a32d9d700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a3415df20 0x7f5a340ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.559 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a3259c700 1 -- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415d440 msgr2=0x7f5a3414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a3259c700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415d440 0x7f5a3414d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a3259c700 1 -- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a3415df20 msgr2=0x7f5a340ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a3259c700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a3415df20 0x7f5a340ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a3259c700 1 -- 172.21.15.7:0/4031903110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009420 con 0x7f5a3406c6a0 2023-10-14T19:14:35.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a3259c700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 0x7f5a3414e8c0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00ec80 tx=0x7f5a2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00c850 con 0x7f5a3406c6a0 2023-10-14T19:14:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00c9b0 con 0x7f5a3406c6a0 2023-10-14T19:14:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a24009a20 con 0x7f5a3406c6a0 2023-10-14T19:14:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00cd30 con 0x7f5a3406c6a0 2023-10-14T19:14:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.552+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a340ad120 con 0x7f5a3406c6a0 2023-10-14T19:14:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.553+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3404c3c0 con 0x7f5a3406c6a0 2023-10-14T19:14:35.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.553+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5a2c013680 con 0x7f5a3406c6a0 2023-10-14T19:14:35.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.554+0000 7f5a2a7fc700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a14067320 0x7f5a140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.554+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f5a2c084f00 con 0x7f5a3406c6a0 2023-10-14T19:14:35.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.554+0000 7f5a31d9b700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a14067320 0x7f5a140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.555+0000 7f5a31d9b700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a14067320 0x7f5a140697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5a34067f90 tx=0x7f5a1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.558+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a2c0555d0 con 0x7f5a3406c6a0 2023-10-14T19:14:35.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.794+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a340af300 con 0x7f5a3406c6a0 2023-10-14T19:14:35.794 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.795+0000 7f5a2a7fc700 1 -- 172.21.15.7:0/4031903110 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f5a2c055160 con 0x7f5a3406c6a0 2023-10-14T19:14:35.795 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:35.795 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":133,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T19:12:21.531996+0000","modified":"2023-10-14T19:12:25.155754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9078":{"gid":9078,"name":"a","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6835/1294066545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":1294066545},{"type":"v1","addr":"172.21.15.7:6835","nonce":1294066545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-14T19:14:35.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a14067320 msgr2=0x7f5a140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a14067320 0x7f5a140697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5a34067f90 tx=0x7f5a1c009040 comp rx=0 tx=0).stop 2023-10-14T19:14:35.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 msgr2=0x7f5a3414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.797 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 0x7f5a3414e8c0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00ec80 tx=0x7f5a2c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 shutdown_connections 2023-10-14T19:14:35.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5a14067320 0x7f5a140697d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a3415df20 0x7f5a340ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.798 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a3406c6a0 0x7f5a3414e8c0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 --2- 172.21.15.7:0/4031903110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a3415d440 0x7f5a3414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 >> 172.21.15.7:0/4031903110 conn(0x7f5a3406f190 msgr2=0x7f5a3415bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 shutdown_connections 2023-10-14T19:14:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.797+0000 7f5a38bb2700 1 -- 172.21.15.7:0/4031903110 wait complete. 2023-10-14T19:14:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 133 2023-10-14T19:14:35.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:14:35.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.928+0000 7f9a029c0700 1 Processor -- start 2023-10-14T19:14:35.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.928+0000 7f9a029c0700 1 -- start start 2023-10-14T19:14:35.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a029c0700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99fc142c00 0x7f99fc06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a029c0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f99fc06bd20 0x7f99fc0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a029c0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc142fd0 0x7f99fc0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a029c0700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0ca480 con 0x7f99fc142c00 2023-10-14T19:14:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a029c0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc15e240 con 0x7f99fc06bd20 2023-10-14T19:14:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a029c0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06b350 con 0x7f99fc142fd0 2023-10-14T19:14:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99fc142c00 0x7f99fc06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f99fc142c00 0x7f99fc06b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36270/0 (socket says 172.21.15.7:36270) 2023-10-14T19:14:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 -- 172.21.15.7:0/1855151650 learned_addr learned my addr 172.21.15.7:0/1855151650 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a021bf700 1 --2- 172.21.15.7:0/1855151650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc142fd0 0x7f99fc0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a011bd700 1 --2- 172.21.15.7:0/1855151650 >> v2:172.21.15.148:3300/0 conn(0x7f99fc06bd20 0x7f99fc0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 -- 172.21.15.7:0/1855151650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc142fd0 msgr2=0x7f99fc0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 --2- 172.21.15.7:0/1855151650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc142fd0 0x7f99fc0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 -- 172.21.15.7:0/1855151650 >> v2:172.21.15.148:3300/0 conn(0x7f99fc06bd20 msgr2=0x7f99fc0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 --2- 172.21.15.7:0/1855151650 >> v2:172.21.15.148:3300/0 conn(0x7f99fc06bd20 0x7f99fc0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a019be700 1 -- 172.21.15.7:0/1855151650 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc15df60 con 0x7f99fc142c00 2023-10-14T19:14:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.929+0000 7f9a011bd700 1 --2- 172.21.15.7:0/1855151650 >> v2:172.21.15.148:3300/0 conn(0x7f99fc06bd20 0x7f99fc0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a019be700 1 --2- 172.21.15.7:0/1855151650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc06b7e0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f99fc06d750 tx=0x7f99f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c59cabe04f1aee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a009bc700 1 -- 172.21.15.7:0/1855151650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4009e70 con 0x7f99fc142c00 2023-10-14T19:14:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a009bc700 1 -- 172.21.15.7:0/1855151650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400b860 con 0x7f99fc142c00 2023-10-14T19:14:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a009bc700 1 -- 172.21.15.7:0/1855151650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400bc00 con 0x7f99fc142c00 2023-10-14T19:14:35.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 -- 172.21.15.7:0/1855151650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 msgr2=0x7f99fc06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 --2- 172.21.15.7:0/1855151650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc06b7e0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f99fc06d750 tx=0x7f99f4009250 comp rx=0 tx=0).stop 2023-10-14T19:14:35.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 -- 172.21.15.7:0/1855151650 shutdown_connections 2023-10-14T19:14:35.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 --2- 172.21.15.7:0/1855151650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc142fd0 0x7f99fc0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 --2- 172.21.15.7:0/1855151650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc06b7e0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 --2- 172.21.15.7:0/1855151650 >> v2:172.21.15.148:3300/0 conn(0x7f99fc06bd20 0x7f99fc0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 -- 172.21.15.7:0/1855151650 >> 172.21.15.7:0/1855151650 conn(0x7f99fc0675a0 msgr2=0x7f99fc0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 -- 172.21.15.7:0/1855151650 shutdown_connections 2023-10-14T19:14:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.930+0000 7f9a029c0700 1 -- 172.21.15.7:0/1855151650 wait complete. 2023-10-14T19:14:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.931+0000 7f9a029c0700 1 Processor -- start 2023-10-14T19:14:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 -- start start 2023-10-14T19:14:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc06bd20 0x7f99fc0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99fc142fd0 0x7f99fc138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0b0ff0 con 0x7f99fc142c00 2023-10-14T19:14:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0b1b40 con 0x7f99fc142fd0 2023-10-14T19:14:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a029c0700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0b1e20 con 0x7f99fc06bd20 2023-10-14T19:14:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a011bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a011bd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc140600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36276/0 (socket says 172.21.15.7:36276) 2023-10-14T19:14:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a011bd700 1 -- 172.21.15.7:0/3522781579 learned_addr learned my addr 172.21.15.7:0/3522781579 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a019be700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc06bd20 0x7f99fc0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.932+0000 7f9a021bf700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99fc142fd0 0x7f99fc138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a011bd700 1 -- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc06bd20 msgr2=0x7f99fc0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a011bd700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc06bd20 0x7f99fc0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a011bd700 1 -- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99fc142fd0 msgr2=0x7f99fc138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a011bd700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99fc142fd0 0x7f99fc138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a011bd700 1 -- 172.21.15.7:0/3522781579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40094f0 con 0x7f99fc142c00 2023-10-14T19:14:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a011bd700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc140600 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e8a0 tx=0x7f99f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0013410 con 0x7f99fc142c00 2023-10-14T19:14:35.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0013570 con 0x7f99fc142c00 2023-10-14T19:14:35.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc0b2100 con 0x7f99fc142c00 2023-10-14T19:14:35.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0013930 con 0x7f99fc142c00 2023-10-14T19:14:35.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.933+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0b2e40 con 0x7f99fc142c00 2023-10-14T19:14:35.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.934+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc0b25a0 con 0x7f99fc142c00 2023-10-14T19:14:35.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.934+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f99f0013ca0 con 0x7f99fc142c00 2023-10-14T19:14:35.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.935+0000 7f99f9ffb700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f99e8067320 0x7f99e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:35.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.935+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f99f0084a80 con 0x7f99fc142c00 2023-10-14T19:14:35.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.935+0000 7f9a019be700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f99e8067320 0x7f99e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:35.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.936+0000 7f9a019be700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f99e8067320 0x7f99e80697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f99fc06d750 tx=0x7f99f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:35.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:35.939+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f00515b0 con 0x7f99fc142c00 2023-10-14T19:14:36.137 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.138+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99fc04c3c0 con 0x7f99fc142c00 2023-10-14T19:14:36.138 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.139+0000 7f99f9ffb700 1 -- 172.21.15.7:0/3522781579 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15461 (secure 0 0 0) 0x7f99f0054bd0 con 0x7f99fc142c00 2023-10-14T19:14:36.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:36.139 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":202,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:13:00.145591+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-14T19:12:19.972804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-14T19:12:20.504006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.2","mappings":[{"from":0,"to":2}]},{"pgid":"34.11","mappings":[{"from":0,"to":1}]},{"pgid":"34.21","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:14:36.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f99e8067320 msgr2=0x7f99e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f99e8067320 0x7f99e80697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f99fc06d750 tx=0x7f99f4017000 comp rx=0 tx=0).stop 2023-10-14T19:14:36.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 msgr2=0x7f99fc140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.141 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc140600 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e8a0 tx=0x7f99f0008040 comp rx=0 tx=0).stop 2023-10-14T19:14:36.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 shutdown_connections 2023-10-14T19:14:36.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f99e8067320 0x7f99e80697d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99fc142fd0 0x7f99fc138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99fc06bd20 0x7f99fc0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.142 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 --2- 172.21.15.7:0/3522781579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99fc142c00 0x7f99fc140600 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 >> 172.21.15.7:0/3522781579 conn(0x7f99fc0675a0 msgr2=0x7f99fc0c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:36.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 shutdown_connections 2023-10-14T19:14:36.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.141+0000 7f9a029c0700 1 -- 172.21.15.7:0/3522781579 wait complete. 2023-10-14T19:14:36.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T19:14:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.274+0000 7f13f701b700 1 Processor -- start 2023-10-14T19:14:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.274+0000 7f13f701b700 1 -- start start 2023-10-14T19:14:36.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f701b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f01599a0 0x7f13f006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f701b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13f006b230 0x7f13f00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f701b700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f00c7f50 con 0x7f13f01595d0 2023-10-14T19:14:36.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f701b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f006bd00 con 0x7f13f006b230 2023-10-14T19:14:36.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f701b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f006b740 con 0x7f13f01599a0 2023-10-14T19:14:36.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f4db7700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f13f01595d0 0x7f13f00675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42770/0 (socket says 172.21.15.7:42770) 2023-10-14T19:14:36.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f4db7700 1 -- 172.21.15.7:0/3140849129 learned_addr learned my addr 172.21.15.7:0/3140849129 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:36.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f55b8700 1 --2- 172.21.15.7:0/3140849129 >> v2:172.21.15.7:3300/0 conn(0x7f13f006b230 0x7f13f00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13ef7fe700 1 -- 172.21.15.7:0/3140849129 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225889780 0 0) 0x7f13f00c7f50 con 0x7f13f01595d0 2023-10-14T19:14:36.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13ef7fe700 1 -- 172.21.15.7:0/3140849129 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13dc003570 con 0x7f13f01595d0 2023-10-14T19:14:36.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13effff700 1 --2- 172.21.15.7:0/3140849129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f01599a0 0x7f13f006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f55b8700 1 -- 172.21.15.7:0/3140849129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f01599a0 msgr2=0x7f13f006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:36.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f55b8700 1 --2- 172.21.15.7:0/3140849129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f01599a0 0x7f13f006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f55b8700 1 -- 172.21.15.7:0/3140849129 >> v1:172.21.15.7:6789/0 conn(0x7f13f01595d0 legacy=0x7f13f00675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f55b8700 1 -- 172.21.15.7:0/3140849129 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f006ba20 con 0x7f13f006b230 2023-10-14T19:14:36.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13f55b8700 1 --2- 172.21.15.7:0/3140849129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f006b230 0x7f13f00c83e0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f13d80098e0 tx=0x7f13d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96485f3e79d4f7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:36.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.275+0000 7f13ef7fe700 1 -- 172.21.15.7:0/3140849129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800b640 con 0x7f13f006b230 2023-10-14T19:14:36.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13ef7fe700 1 -- 172.21.15.7:0/3140849129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800b7a0 con 0x7f13f006b230 2023-10-14T19:14:36.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13ef7fe700 1 -- 172.21.15.7:0/3140849129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800bb40 con 0x7f13f006b230 2023-10-14T19:14:36.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 -- 172.21.15.7:0/3140849129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f006b230 msgr2=0x7f13f00c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 --2- 172.21.15.7:0/3140849129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f006b230 0x7f13f00c83e0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f13d80098e0 tx=0x7f13d80091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 -- 172.21.15.7:0/3140849129 shutdown_connections 2023-10-14T19:14:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 --2- 172.21.15.7:0/3140849129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f006b230 0x7f13f00c83e0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 --2- 172.21.15.7:0/3140849129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f01599a0 0x7f13f006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 -- 172.21.15.7:0/3140849129 >> 172.21.15.7:0/3140849129 conn(0x7f13f00cd400 msgr2=0x7f13f00cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 -- 172.21.15.7:0/3140849129 shutdown_connections 2023-10-14T19:14:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.276+0000 7f13f701b700 1 -- 172.21.15.7:0/3140849129 wait complete. 2023-10-14T19:14:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.277+0000 7f13f701b700 1 Processor -- start 2023-10-14T19:14:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.277+0000 7f13f701b700 1 -- start start 2023-10-14T19:14:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f701b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f006b230 0x7f13f00c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f701b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 0x7f13f01693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f701b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13f01599a0 0x7f13f016a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f701b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f015be80 con 0x7f13f01595d0 2023-10-14T19:14:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f701b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0169c30 con 0x7f13f01599a0 2023-10-14T19:14:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f701b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0169f10 con 0x7f13f006b230 2023-10-14T19:14:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 0x7f13f01693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 0x7f13f01693e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36308/0 (socket says 172.21.15.7:36308) 2023-10-14T19:14:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 -- 172.21.15.7:0/132313333 learned_addr learned my addr 172.21.15.7:0/132313333 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f4db7700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f006b230 0x7f13f00c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13f55b8700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13f01599a0 0x7f13f016a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 -- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f006b230 msgr2=0x7f13f00c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f006b230 0x7f13f00c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 -- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13f01599a0 msgr2=0x7f13f016a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13f01599a0 0x7f13f016a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.278+0000 7f13effff700 1 -- 172.21.15.7:0/132313333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d8009420 con 0x7f13f01595d0 2023-10-14T19:14:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.279+0000 7f13effff700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 0x7f13f01693e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f13e000d860 tx=0x7f13e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.279+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0009610 con 0x7f13f01595d0 2023-10-14T19:14:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.279+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0009770 con 0x7f13f01595d0 2023-10-14T19:14:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.279+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f016a1f0 con 0x7f13f01595d0 2023-10-14T19:14:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.279+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0009b30 con 0x7f13f01595d0 2023-10-14T19:14:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.279+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f0169920 con 0x7f13f01595d0 2023-10-14T19:14:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.280+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f015bff0 con 0x7f13f01595d0 2023-10-14T19:14:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.280+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f13e001e460 con 0x7f13f01595d0 2023-10-14T19:14:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.281+0000 7f13ecff9700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f13d0067320 0x7f13d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.281+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f13e0085280 con 0x7f13f01595d0 2023-10-14T19:14:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.281+0000 7f13f4db7700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f13d0067320 0x7f13d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.281+0000 7f13f4db7700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f13d0067320 0x7f13d00697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005c50 tx=0x7f13e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.285+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13e0051ec0 con 0x7f13f01595d0 2023-10-14T19:14:36.523 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.523+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13f004c3c0 con 0x7f13f01595d0 2023-10-14T19:14:36.523 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-10-14T19:14:36.524+0000 7fde8b446700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T19:14:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.527+0000 7f13ecff9700 1 -- 172.21.15.7:0/132313333 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v134) v1 ==== 161+0+0 (secure 0 0 0) 0x7f13e00554e0 con 0x7f13f01595d0 2023-10-14T19:14:36.528 INFO:tasks.ceph.mds.a.smithi007.stderr: -3252> 2023-10-14T19:12:27.873+0000 7f5b943ee700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T19:14:36.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f13d0067320 msgr2=0x7f13d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f13d0067320 0x7f13d00697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005c50 tx=0x7f13e8009040 comp rx=0 tx=0).stop 2023-10-14T19:14:36.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 msgr2=0x7f13f01693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 0x7f13f01693e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f13e000d860 tx=0x7f13e0008040 comp rx=0 tx=0).stop 2023-10-14T19:14:36.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 shutdown_connections 2023-10-14T19:14:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f13d0067320 0x7f13d00697d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13f01599a0 0x7f13f016a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f13f006b230 0x7f13f00c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 --2- 172.21.15.7:0/132313333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13f01595d0 0x7f13f01693e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 >> 172.21.15.7:0/132313333 conn(0x7f13f00cd400 msgr2=0x7f13f00c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 shutdown_connections 2023-10-14T19:14:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.529+0000 7f13f701b700 1 -- 172.21.15.7:0/132313333 wait complete. 2023-10-14T19:14:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T19:14:36.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T19:14:36.552 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-10-14T19:14:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.665+0000 7f4331e10700 1 Processor -- start 2023-10-14T19:14:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.665+0000 7f4331e10700 1 -- start start 2023-10-14T19:14:36.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4331e10700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f432c157420 0x7f432c0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.668 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4331e10700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f432c06d250 0x7f432c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4331e10700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4331e10700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0ac840 con 0x7f432c157420 2023-10-14T19:14:36.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4331e10700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0b18f0 con 0x7f432c06d250 2023-10-14T19:14:36.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4331e10700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0abf50 con 0x7f432c0ceac0 2023-10-14T19:14:36.669 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4330e0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f432c157420 0x7f432c0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4330e0e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f432c157420 0x7f432c0b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40238/0 (socket says 172.21.15.7:40238) 2023-10-14T19:14:36.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f4330e0e700 1 -- 172.21.15.7:0/755751543 learned_addr learned my addr 172.21.15.7:0/755751543 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:36.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.666+0000 7f432bfff700 1 --2- 172.21.15.7:0/755751543 >> v2:172.21.15.148:3300/0 conn(0x7f432c06d250 0x7f432c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f433160f700 1 --2- 172.21.15.7:0/755751543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.670 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4330e0e700 1 -- 172.21.15.7:0/755751543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 msgr2=0x7f432c0af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:36.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4330e0e700 1 --2- 172.21.15.7:0/755751543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c0af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4330e0e700 1 -- 172.21.15.7:0/755751543 >> v2:172.21.15.148:3300/0 conn(0x7f432c06d250 msgr2=0x7f432c0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:36.671 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4330e0e700 1 --2- 172.21.15.7:0/755751543 >> v2:172.21.15.148:3300/0 conn(0x7f432c06d250 0x7f432c0aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4330e0e700 1 -- 172.21.15.7:0/755751543 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0aea60 con 0x7f432c157420 2023-10-14T19:14:36.674 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4330e0e700 1 --2- 172.21.15.7:0/755751543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c157420 0x7f432c0b13b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f432c06aa90 tx=0x7f4324009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd25350bd6e9dc63 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f432b7fe700 1 -- 172.21.15.7:0/755751543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400e070 con 0x7f432c157420 2023-10-14T19:14:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f432b7fe700 1 -- 172.21.15.7:0/755751543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400ba50 con 0x7f432c157420 2023-10-14T19:14:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f432b7fe700 1 -- 172.21.15.7:0/755751543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240092e0 con 0x7f432c157420 2023-10-14T19:14:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4331e10700 1 -- 172.21.15.7:0/755751543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c157420 msgr2=0x7f432c0b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.667+0000 7f4331e10700 1 --2- 172.21.15.7:0/755751543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c157420 0x7f432c0b13b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f432c06aa90 tx=0x7f4324009840 comp rx=0 tx=0).stop 2023-10-14T19:14:36.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 -- 172.21.15.7:0/755751543 shutdown_connections 2023-10-14T19:14:36.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 --2- 172.21.15.7:0/755751543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 --2- 172.21.15.7:0/755751543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c157420 0x7f432c0b13b0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 --2- 172.21.15.7:0/755751543 >> v2:172.21.15.148:3300/0 conn(0x7f432c06d250 0x7f432c0aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.676 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 -- 172.21.15.7:0/755751543 >> 172.21.15.7:0/755751543 conn(0x7f432c06ce80 msgr2=0x7f432c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:36.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 -- 172.21.15.7:0/755751543 shutdown_connections 2023-10-14T19:14:36.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.668+0000 7f4331e10700 1 -- 172.21.15.7:0/755751543 wait complete. 2023-10-14T19:14:36.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.669+0000 7f4331e10700 1 Processor -- start 2023-10-14T19:14:36.677 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.669+0000 7f4331e10700 1 -- start start 2023-10-14T19:14:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 0x7f432c169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c157420 0x7f432c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c153d70 con 0x7f432c06d250 2023-10-14T19:14:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c153160 con 0x7f432c157420 2023-10-14T19:14:36.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c153440 con 0x7f432c0ceac0 2023-10-14T19:14:36.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 0x7f432c169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 0x7f432c169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40240/0 (socket says 172.21.15.7:40240) 2023-10-14T19:14:36.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 -- 172.21.15.7:0/1367298265 learned_addr learned my addr 172.21.15.7:0/1367298265 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:36.681 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f432bfff700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f433160f700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c157420 0x7f432c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 -- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 msgr2=0x7f432c150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 -- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c157420 msgr2=0x7f432c06e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c157420 0x7f432c06e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 -- 172.21.15.7:0/1367298265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009ae0 con 0x7f432c06d250 2023-10-14T19:14:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4330e0e700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 0x7f432c169b10 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f432c06ad70 tx=0x7f4324018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324008ae0 con 0x7f432c06d250 2023-10-14T19:14:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324008c60 con 0x7f432c06d250 2023-10-14T19:14:36.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c153720 con 0x7f432c06d250 2023-10-14T19:14:36.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324025460 con 0x7f432c06d250 2023-10-14T19:14:36.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.670+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c150650 con 0x7f432c06d250 2023-10-14T19:14:36.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.671+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c04c3c0 con 0x7f432c06d250 2023-10-14T19:14:36.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.672+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4324003040 con 0x7f432c06d250 2023-10-14T19:14:36.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.672+0000 7f4328ff9700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4318067320 0x7f43180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:36.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.672+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f43240868e0 con 0x7f432c06d250 2023-10-14T19:14:36.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.672+0000 7f432bfff700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4318067320 0x7f43180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:36.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.673+0000 7f432bfff700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4318067320 0x7f43180697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f432c0ac730 tx=0x7f4320008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:36.685 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.676+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43240533b0 con 0x7f432c06d250 2023-10-14T19:14:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:36.914+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f432c0ac1f0 con 0x7f432c06d250 2023-10-14T19:14:37.528 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.527+0000 7f4328ff9700 1 -- 172.21.15.7:0/1367298265 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v135) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43240569d0 con 0x7f432c06d250 2023-10-14T19:14:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4318067320 msgr2=0x7f43180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4318067320 0x7f43180697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f432c0ac730 tx=0x7f4320008040 comp rx=0 tx=0).stop 2023-10-14T19:14:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 msgr2=0x7f432c169b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 0x7f432c169b10 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f432c06ad70 tx=0x7f4324018000 comp rx=0 tx=0).stop 2023-10-14T19:14:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 shutdown_connections 2023-10-14T19:14:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f4318067320 0x7f43180697d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c157420 0x7f432c06e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f432c06d250 0x7f432c169b10 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 --2- 172.21.15.7:0/1367298265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f432c0ceac0 0x7f432c150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 >> 172.21.15.7:0/1367298265 conn(0x7f432c06ce80 msgr2=0x7f432c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 shutdown_connections 2023-10-14T19:14:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.530+0000 7f4331e10700 1 -- 172.21.15.7:0/1367298265 wait complete. 2023-10-14T19:14:37.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T19:14:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.713+0000 7fac875f9700 1 Processor -- start 2023-10-14T19:14:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.714+0000 7fac875f9700 1 -- start start 2023-10-14T19:14:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.714+0000 7fac875f9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac801502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.714+0000 7fac875f9700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800ce360 con 0x7fac80150800 2023-10-14T19:14:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.714+0000 7fac875f9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800cb970 con 0x7fac800cd200 2023-10-14T19:14:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.714+0000 7fac875f9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800cda40 con 0x7fac800cd5d0 2023-10-14T19:14:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac85b96700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fac80150800 0x7fac8015a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53162/0 (socket says 172.21.15.7:53162) 2023-10-14T19:14:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac85b96700 1 -- 172.21.15.7:0/4197605113 learned_addr learned my addr 172.21.15.7:0/4197605113 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac84b94700 1 --2- 172.21.15.7:0/4197605113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac801502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111563222 0 0) 0x7fac800ce360 con 0x7fac80150800 2023-10-14T19:14:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac68003570 con 0x7fac80150800 2023-10-14T19:14:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105813316 0 0) 0x7fac800cb970 con 0x7fac800cd200 2023-10-14T19:14:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac800ce360 con 0x7fac800cd200 2023-10-14T19:14:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac84b94700 1 -- 172.21.15.7:0/4197605113 >> v1:172.21.15.148:6789/0 conn(0x7fac800cd200 legacy=0x7fac800caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac84b94700 1 -- 172.21.15.7:0/4197605113 >> v1:172.21.15.7:6789/0 conn(0x7fac80150800 legacy=0x7fac8015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac84b94700 1 -- 172.21.15.7:0/4197605113 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac800cbc50 con 0x7fac800cd5d0 2023-10-14T19:14:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.715+0000 7fac84b94700 1 --2- 172.21.15.7:0/4197605113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac801502c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac74009910 tx=0x7fac740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b0aca5616c4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74011630 con 0x7fac800cd5d0 2023-10-14T19:14:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74011790 con 0x7fac800cd5d0 2023-10-14T19:14:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac7ffff700 1 -- 172.21.15.7:0/4197605113 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74011b30 con 0x7fac800cd5d0 2023-10-14T19:14:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 -- 172.21.15.7:0/4197605113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 msgr2=0x7fac801502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 --2- 172.21.15.7:0/4197605113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac801502c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac74009910 tx=0x7fac740091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 -- 172.21.15.7:0/4197605113 shutdown_connections 2023-10-14T19:14:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 --2- 172.21.15.7:0/4197605113 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac801502c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 -- 172.21.15.7:0/4197605113 >> 172.21.15.7:0/4197605113 conn(0x7fac800999c0 msgr2=0x7fac80070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 -- 172.21.15.7:0/4197605113 shutdown_connections 2023-10-14T19:14:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.716+0000 7fac875f9700 1 -- 172.21.15.7:0/4197605113 wait complete. 2023-10-14T19:14:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.717+0000 7fac875f9700 1 Processor -- start 2023-10-14T19:14:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.717+0000 7fac875f9700 1 -- start start 2023-10-14T19:14:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac875f9700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 0x7fac80152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac875f9700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac8015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac875f9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac80150800 0x7fac8015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac875f9700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac80155640 con 0x7fac800cd200 2023-10-14T19:14:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac875f9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac80152f00 con 0x7fac80150800 2023-10-14T19:14:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac875f9700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac801531e0 con 0x7fac800cd5d0 2023-10-14T19:14:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac85395700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 0x7fac80152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac85395700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 0x7fac80152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40250/0 (socket says 172.21.15.7:40250) 2023-10-14T19:14:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac85395700 1 -- 172.21.15.7:0/1693548545 learned_addr learned my addr 172.21.15.7:0/1693548545 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.718+0000 7fac84b94700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac8015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85b96700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac80150800 0x7fac8015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85395700 1 -- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 msgr2=0x7fac8015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85395700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac8015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85395700 1 -- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac80150800 msgr2=0x7fac8015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85395700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac80150800 0x7fac8015c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85395700 1 -- 172.21.15.7:0/1693548545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74009420 con 0x7fac800cd200 2023-10-14T19:14:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85b96700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac80150800 0x7fac8015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac85395700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 0x7fac80152890 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fac7800cd30 tx=0x7fac78002be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800ab70 con 0x7fac800cd200 2023-10-14T19:14:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800acf0 con 0x7fac800cd200 2023-10-14T19:14:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac801534c0 con 0x7fac800cd200 2023-10-14T19:14:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78012670 con 0x7fac800cd200 2023-10-14T19:14:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.719+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8014f3a0 con 0x7fac800cd200 2023-10-14T19:14:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.720+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8004c3c0 con 0x7fac800cd200 2023-10-14T19:14:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.720+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fac78012a60 con 0x7fac800cd200 2023-10-14T19:14:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.721+0000 7fac7d7fa700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac6c067320 0x7fac6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.721+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5878+0+0 (secure 0 0 0) 0x7fac78085590 con 0x7fac800cd200 2023-10-14T19:14:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.721+0000 7fac84b94700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac6c067320 0x7fac6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.721+0000 7fac84b94700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac6c067320 0x7fac6c0697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fac74009860 tx=0x7fac74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.725+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac78052170 con 0x7fac800cd200 2023-10-14T19:14:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:37.921+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fac800cbf30 con 0x7fac800cd200 2023-10-14T19:14:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.531+0000 7fac7d7fa700 1 -- 172.21.15.7:0/1693548545 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v204) v1 ==== 181+0+0 (secure 0 0 0) 0x7fac7800ae60 con 0x7fac800cd200 2023-10-14T19:14:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac6c067320 msgr2=0x7fac6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac6c067320 0x7fac6c0697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fac74009860 tx=0x7fac74017000 comp rx=0 tx=0).stop 2023-10-14T19:14:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 msgr2=0x7fac80152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 0x7fac80152890 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fac7800cd30 tx=0x7fac78002be0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 shutdown_connections 2023-10-14T19:14:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fac6c067320 0x7fac6c0697d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac80150800 0x7fac8015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac800cd200 0x7fac80152890 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 --2- 172.21.15.7:0/1693548545 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fac800cd5d0 0x7fac8015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 >> 172.21.15.7:0/1693548545 conn(0x7fac800999c0 msgr2=0x7fac8014fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.535+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 shutdown_connections 2023-10-14T19:14:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.536+0000 7fac875f9700 1 -- 172.21.15.7:0/1693548545 wait complete. 2023-10-14T19:14:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-10-14T19:14:38.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T19:14:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.683+0000 7fedbb174700 1 Processor -- start 2023-10-14T19:14:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.683+0000 7fedbb174700 1 -- start start 2023-10-14T19:14:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedbb174700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fedb4159530 0x7fedb40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedbb174700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 0x7fedb4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedbb174700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40ccfd0 con 0x7fedb4159e40 2023-10-14T19:14:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedbb174700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb415a410 con 0x7fedb4159530 2023-10-14T19:14:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedbb174700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415a6f0 con 0x7fedb406dcf0 2023-10-14T19:14:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb9711700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fedb4159e40 0x7fedb40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53178/0 (socket says 172.21.15.7:53178) 2023-10-14T19:14:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb9711700 1 -- 172.21.15.7:0/2846092315 learned_addr learned my addr 172.21.15.7:0/2846092315 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635526464 0 0) 0x7fedb40ccfd0 con 0x7fedb4159e40 2023-10-14T19:14:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb3fff700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 0x7fedb4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2846092315 >> v2:172.21.15.148:3300/0 conn(0x7fedb4159530 0x7fedb40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda0003570 con 0x7fedb4159e40 2023-10-14T19:14:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320251254 0 0) 0x7feda0003570 con 0x7fedb4159e40 2023-10-14T19:14:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 msgr2=0x7fedb4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 0x7fedb4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 >> v2:172.21.15.148:3300/0 conn(0x7fedb4159530 msgr2=0x7fedb40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 --2- 172.21.15.7:0/2846092315 >> v2:172.21.15.148:3300/0 conn(0x7fedb4159530 0x7fedb40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb415a9d0 con 0x7fedb4159e40 2023-10-14T19:14:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7fed9c001470 con 0x7fedb4159e40 2023-10-14T19:14:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 >> v1:172.21.15.7:6789/0 conn(0x7fedb4159e40 legacy=0x7fedb40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7feda0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.684+0000 7fedb37fe700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 0x7feda0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feda0004d50 0x7feda00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415a410 con 0x7feda0003a60 2023-10-14T19:14:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415a6f0 con 0x7feda0004d50 2023-10-14T19:14:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda000ba60 con 0x7fedb406dcf0 2023-10-14T19:14:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7feda0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb9711700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feda0004d50 0x7feda00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb3fff700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 0x7feda0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 -- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 msgr2=0x7feda0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb406dcf0 0x7feda0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 -- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feda0004d50 msgr2=0x7feda00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feda0004d50 0x7feda00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 -- 172.21.15.7:0/2846092315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0003570 con 0x7feda0003a60 2023-10-14T19:14:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7feda0003e70 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fedac009c00 tx=0x7fedac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b76facf12bd6ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00e6b0 con 0x7feda0003a60 2023-10-14T19:14:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00e810 con 0x7feda0003a60 2023-10-14T19:14:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.685+0000 7fedb37fe700 1 -- 172.21.15.7:0/2846092315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00ebd0 con 0x7feda0003a60 2023-10-14T19:14:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedbb174700 1 -- 172.21.15.7:0/2846092315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 msgr2=0x7feda0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedbb174700 1 --2- 172.21.15.7:0/2846092315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7feda0003e70 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fedac009c00 tx=0x7fedac0091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedb9711700 1 -- 172.21.15.7:0/2846092315 reap_dead start 2023-10-14T19:14:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedbb174700 1 -- 172.21.15.7:0/2846092315 shutdown_connections 2023-10-14T19:14:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedbb174700 1 -- 172.21.15.7:0/2846092315 >> 172.21.15.7:0/2846092315 conn(0x7fedb40703a0 msgr2=0x7fedb40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedbb174700 1 -- 172.21.15.7:0/2846092315 shutdown_connections 2023-10-14T19:14:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.686+0000 7fedbb174700 1 -- 172.21.15.7:0/2846092315 wait complete. 2023-10-14T19:14:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.687+0000 7fedbb174700 1 Processor -- start 2023-10-14T19:14:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.687+0000 7fedbb174700 1 -- start start 2023-10-14T19:14:38.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedbb174700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7fedb40b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedbb174700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb4158560 0x7fedb41589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedbb174700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedb4146c80 0x7fedb41470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedbb174700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb416e190 con 0x7feda0003a60 2023-10-14T19:14:38.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedbb174700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb416d2a0 con 0x7fedb4146c80 2023-10-14T19:14:38.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedbb174700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb416d580 con 0x7fedb4158560 2023-10-14T19:14:38.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7fedb40b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7fedb40b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40272/0 (socket says 172.21.15.7:40272) 2023-10-14T19:14:38.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 -- 172.21.15.7:0/2922133526 learned_addr learned my addr 172.21.15.7:0/2922133526 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:38.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb9711700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedb4146c80 0x7fedb41470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.706 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb3fff700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb4158560 0x7fedb41589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 -- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb4158560 msgr2=0x7fedb41589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb4158560 0x7fedb41589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 -- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedb4146c80 msgr2=0x7fedb41470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedb4146c80 0x7fedb41470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 -- 172.21.15.7:0/2922133526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb416d860 con 0x7feda0003a60 2023-10-14T19:14:38.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.688+0000 7fedb8f10700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7fedb40b1da0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7feda0004730 tx=0x7fedac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:38.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.689+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac022070 con 0x7feda0003a60 2023-10-14T19:14:38.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.689+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00e980 con 0x7feda0003a60 2023-10-14T19:14:38.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.689+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb416db40 con 0x7feda0003a60 2023-10-14T19:14:38.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.689+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00e6b0 con 0x7feda0003a60 2023-10-14T19:14:38.708 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.689+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb4147610 con 0x7feda0003a60 2023-10-14T19:14:38.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.690+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40b4860 con 0x7feda0003a60 2023-10-14T19:14:38.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.690+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fedac027680 con 0x7feda0003a60 2023-10-14T19:14:38.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.690+0000 7fedb0ff9700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed94067320 0x7fed940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:38.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.691+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5440+0+0 (secure 0 0 0) 0x7fedac0864a0 con 0x7feda0003a60 2023-10-14T19:14:38.709 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.691+0000 7fedb3fff700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed94067320 0x7fed940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:38.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.691+0000 7fedb3fff700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed94067320 0x7fed940697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fedb40ca890 tx=0x7feda400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:38.710 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.695+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedac0532b0 con 0x7feda0003a60 2023-10-14T19:14:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:38.886+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fedb416e190 con 0x7feda0003a60 2023-10-14T19:14:39.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.536+0000 7fedb0ff9700 1 -- 172.21.15.7:0/2922133526 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v205) v1 ==== 169+0+0 (secure 0 0 0) 0x7fedac0568d0 con 0x7feda0003a60 2023-10-14T19:14:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed94067320 msgr2=0x7fed940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed94067320 0x7fed940697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fedb40ca890 tx=0x7feda400b040 comp rx=0 tx=0).stop 2023-10-14T19:14:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 msgr2=0x7fedb40b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7fedb40b1da0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7feda0004730 tx=0x7fedac01a000 comp rx=0 tx=0).stop 2023-10-14T19:14:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 shutdown_connections 2023-10-14T19:14:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fed94067320 0x7fed940697d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedb4146c80 0x7fedb41470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feda0003a60 0x7fedb40b1da0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 --2- 172.21.15.7:0/2922133526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fedb4158560 0x7fedb41589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 >> 172.21.15.7:0/2922133526 conn(0x7fedb40703a0 msgr2=0x7fedb4154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 shutdown_connections 2023-10-14T19:14:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.542+0000 7fedbb174700 1 -- 172.21.15.7:0/2922133526 wait complete. 2023-10-14T19:14:39.546 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-10-14T19:14:39.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T19:14:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.688+0000 7f27a3147700 1 Processor -- start 2023-10-14T19:14:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.688+0000 7f27a3147700 1 -- start start 2023-10-14T19:14:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a3147700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c153a00 0x7f279c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a3147700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f279c0cea00 0x7f279c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a3147700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c15ac50 con 0x7f279c15de50 2023-10-14T19:14:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a3147700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c15d010 con 0x7f279c0cea00 2023-10-14T19:14:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a3147700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15af60 con 0x7f279c153a00 2023-10-14T19:14:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a2946700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f279c0cea00 0x7f279c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a1944700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f279c15de50 0x7f279c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53188/0 (socket says 172.21.15.7:53188) 2023-10-14T19:14:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a1944700 1 -- 172.21.15.7:0/2746710008 learned_addr learned my addr 172.21.15.7:0/2746710008 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a2145700 1 --2- 172.21.15.7:0/2746710008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c153a00 0x7f279c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a2946700 1 -- 172.21.15.7:0/2746710008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c153a00 msgr2=0x7f279c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a2946700 1 --2- 172.21.15.7:0/2746710008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c153a00 0x7f279c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a2946700 1 -- 172.21.15.7:0/2746710008 >> v1:172.21.15.7:6789/0 conn(0x7f279c15de50 legacy=0x7f279c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.689+0000 7f27a2946700 1 -- 172.21.15.7:0/2746710008 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c15b240 con 0x7f279c0cea00 2023-10-14T19:14:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a2946700 1 --2- 172.21.15.7:0/2746710008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c0cea00 0x7f279c0cee40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f278c009e60 tx=0x7f278c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd6a0df605d3d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a1143700 1 -- 172.21.15.7:0/2746710008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00e070 con 0x7f279c0cea00 2023-10-14T19:14:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a1143700 1 -- 172.21.15.7:0/2746710008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c00bc30 con 0x7f279c0cea00 2023-10-14T19:14:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a1143700 1 -- 172.21.15.7:0/2746710008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c012430 con 0x7f279c0cea00 2023-10-14T19:14:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 -- 172.21.15.7:0/2746710008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c0cea00 msgr2=0x7f279c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 --2- 172.21.15.7:0/2746710008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c0cea00 0x7f279c0cee40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f278c009e60 tx=0x7f278c009780 comp rx=0 tx=0).stop 2023-10-14T19:14:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 -- 172.21.15.7:0/2746710008 shutdown_connections 2023-10-14T19:14:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 --2- 172.21.15.7:0/2746710008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c0cea00 0x7f279c0cee40 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 --2- 172.21.15.7:0/2746710008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c153a00 0x7f279c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 -- 172.21.15.7:0/2746710008 >> 172.21.15.7:0/2746710008 conn(0x7f279c0703a0 msgr2=0x7f279c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 -- 172.21.15.7:0/2746710008 shutdown_connections 2023-10-14T19:14:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.690+0000 7f27a3147700 1 -- 172.21.15.7:0/2746710008 wait complete. 2023-10-14T19:14:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.691+0000 7f27a3147700 1 Processor -- start 2023-10-14T19:14:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 -- start start 2023-10-14T19:14:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279c0cea00 0x7f279c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 0x7f279c0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c15de50 0x7f279c14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0cbf00 con 0x7f279c153a00 2023-10-14T19:14:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0cb5d0 con 0x7f279c0cea00 2023-10-14T19:14:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a3147700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0cb8b0 con 0x7f279c15de50 2023-10-14T19:14:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a1944700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 0x7f279c0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a1944700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 0x7f279c0ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40298/0 (socket says 172.21.15.7:40298) 2023-10-14T19:14:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.692+0000 7f27a1944700 1 -- 172.21.15.7:0/32446493 learned_addr learned my addr 172.21.15.7:0/32446493 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a1944700 1 -- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c15de50 msgr2=0x7f279c14df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a1944700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c15de50 0x7f279c14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a1944700 1 -- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279c0cea00 msgr2=0x7f279c14d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a1944700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279c0cea00 0x7f279c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a1944700 1 -- 172.21.15.7:0/32446493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009a20 con 0x7f279c153a00 2023-10-14T19:14:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a1944700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 0x7f279c0ccd60 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f279000c560 tx=0x7f2790001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790005b30 con 0x7f279c153a00 2023-10-14T19:14:39.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790005cb0 con 0x7f279c153a00 2023-10-14T19:14:39.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c0cbb90 con 0x7f279c153a00 2023-10-14T19:14:39.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790007320 con 0x7f279c153a00 2023-10-14T19:14:39.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.693+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c0cb230 con 0x7f279c153a00 2023-10-14T19:14:39.703 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.694+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c04c3c0 con 0x7f279c153a00 2023-10-14T19:14:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.695+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f279001b3b0 con 0x7f279c153a00 2023-10-14T19:14:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.695+0000 7f279a7fc700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2788067350 0x7f2788069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.695+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2790083f20 con 0x7f279c153a00 2023-10-14T19:14:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.695+0000 7f27a2145700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2788067350 0x7f2788069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.696+0000 7f27a2145700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2788067350 0x7f2788069800 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2794009a60 tx=0x7f2794008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.699+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2790050eb0 con 0x7f279c153a00 2023-10-14T19:14:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.896+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f279c0cc040 con 0x7f279c153a00 2023-10-14T19:14:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.899+0000 7f279a7fc700 1 -- 172.21.15.7:0/32446493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f27900170a0 con 0x7f279c153a00 2023-10-14T19:14:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2788067350 msgr2=0x7f2788069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2788067350 0x7f2788069800 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2794009a60 tx=0x7f2794008040 comp rx=0 tx=0).stop 2023-10-14T19:14:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 msgr2=0x7f279c0ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 0x7f279c0ccd60 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f279000c560 tx=0x7f2790001020 comp rx=0 tx=0).stop 2023-10-14T19:14:39.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 shutdown_connections 2023-10-14T19:14:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2788067350 0x7f2788069800 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279c0cea00 0x7f279c14d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f279c15de50 0x7f279c14df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 --2- 172.21.15.7:0/32446493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c153a00 0x7f279c0ccd60 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:39.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.901+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 >> 172.21.15.7:0/32446493 conn(0x7f279c0703a0 msgr2=0x7f279c0b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.902+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 shutdown_connections 2023-10-14T19:14:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:39.902+0000 7f27a3147700 1 -- 172.21.15.7:0/32446493 wait complete. 2023-10-14T19:14:39.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-14T19:14:40.033 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.033+0000 7f9b8ca4a700 1 Processor -- start 2023-10-14T19:14:40.034 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.033+0000 7f9b8ca4a700 1 -- start start 2023-10-14T19:14:40.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8ca4a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 0x7f9b88156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8ca4a700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815ae40 con 0x7f9b880cb5a0 2023-10-14T19:14:40.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8ca4a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815ab60 con 0x7f9b880cb970 2023-10-14T19:14:40.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8ca4a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ce0f0 con 0x7f9b8815a5d0 2023-10-14T19:14:40.038 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8659c700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9b880cb5a0 0x7f9b880cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53204/0 (socket says 172.21.15.7:53204) 2023-10-14T19:14:40.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8659c700 1 -- 172.21.15.7:0/2637935705 learned_addr learned my addr 172.21.15.7:0/2637935705 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:40.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 0x7f9b88156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299169096 0 0) 0x7f9b8815ae40 con 0x7f9b880cb5a0 2023-10-14T19:14:40.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b74003570 con 0x7f9b880cb5a0 2023-10-14T19:14:40.039 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493261538 0 0) 0x7f9b8815ab60 con 0x7f9b880cb970 2023-10-14T19:14:40.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8815ae40 con 0x7f9b880cb970 2023-10-14T19:14:40.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139405735 0 0) 0x7f9b74003570 con 0x7f9b880cb5a0 2023-10-14T19:14:40.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 msgr2=0x7f9b88156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:40.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 0x7f9b88156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.040 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 >> v1:172.21.15.148:6789/0 conn(0x7f9b880cb970 legacy=0x7f9b88159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880ccf00 con 0x7f9b880cb5a0 2023-10-14T19:14:40.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f9b78001470 con 0x7f9b880cb5a0 2023-10-14T19:14:40.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 >> v1:172.21.15.7:6789/0 conn(0x7f9b880cb5a0 legacy=0x7f9b880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 0x7f9b74003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.041 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004180 0x7f9b74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b74004d50 0x7f9b740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ce0f0 con 0x7f9b74004d50 2023-10-14T19:14:40.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7400bba0 con 0x7f9b74004180 2023-10-14T19:14:40.042 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.034+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7400bd60 con 0x7f9b8815a5d0 2023-10-14T19:14:40.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b74004d50 0x7f9b740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b8659c700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 0x7f9b74003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b85d9b700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004180 0x7f9b74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 -- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 msgr2=0x7f9b74003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:40.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8815a5d0 0x7f9b74003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.043 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 -- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004180 msgr2=0x7f9b74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:40.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004180 0x7f9b74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 -- 172.21.15.7:0/2637935705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74003570 con 0x7f9b74004d50 2023-10-14T19:14:40.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b74004d50 0x7f9b740051c0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000e210 tx=0x7f9b8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6abfa882eecbb77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:40.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000eac0 con 0x7f9b74004d50 2023-10-14T19:14:40.044 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000f040 con 0x7f9b74004d50 2023-10-14T19:14:40.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b8559a700 1 -- 172.21.15.7:0/2637935705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000ee70 con 0x7f9b74004d50 2023-10-14T19:14:40.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.035+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/2637935705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b74004d50 msgr2=0x7f9b740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.036+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/2637935705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b74004d50 0x7f9b740051c0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000e210 tx=0x7f9b8000b040 comp rx=0 tx=0).stop 2023-10-14T19:14:40.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.036+0000 7f9b86d9d700 1 -- 172.21.15.7:0/2637935705 reap_dead start 2023-10-14T19:14:40.045 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.036+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/2637935705 shutdown_connections 2023-10-14T19:14:40.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.036+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/2637935705 >> 172.21.15.7:0/2637935705 conn(0x7f9b88070e30 msgr2=0x7f9b880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:40.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.036+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/2637935705 shutdown_connections 2023-10-14T19:14:40.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.036+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/2637935705 wait complete. 2023-10-14T19:14:40.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 Processor -- start 2023-10-14T19:14:40.046 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 -- start start 2023-10-14T19:14:40.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004d50 0x7f9b88144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b881554d0 0x7f9b88152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 0x7f9b881525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.049 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88155040 con 0x7f9b88155920 2023-10-14T19:14:40.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88154430 con 0x7f9b74004d50 2023-10-14T19:14:40.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.037+0000 7f9b8ca4a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88154710 con 0x7f9b881554d0 2023-10-14T19:14:40.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 0x7f9b881525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 0x7f9b881525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40316/0 (socket says 172.21.15.7:40316) 2023-10-14T19:14:40.050 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 -- 172.21.15.7:0/1659307338 learned_addr learned my addr 172.21.15.7:0/1659307338 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:40.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b85d9b700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b881554d0 0x7f9b88152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b8659c700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004d50 0x7f9b88144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 -- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b881554d0 msgr2=0x7f9b88152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b881554d0 0x7f9b88152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.051 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 -- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004d50 msgr2=0x7f9b88144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004d50 0x7f9b88144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 -- 172.21.15.7:0/1659307338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b881549f0 con 0x7f9b88155920 2023-10-14T19:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b85d9b700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b881554d0 0x7f9b88152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b8659c700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004d50 0x7f9b88144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b86d9d700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 0x7f9b881525a0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000afd0 tx=0x7f9b8001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8001d630 con 0x7f9b88155920 2023-10-14T19:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8001d790 con 0x7f9b88155920 2023-10-14T19:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88154cd0 con 0x7f9b88155920 2023-10-14T19:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8001db90 con 0x7f9b88155920 2023-10-14T19:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.038+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88145530 con 0x7f9b88155920 2023-10-14T19:14:40.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.039+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b881551b0 con 0x7f9b88155920 2023-10-14T19:14:40.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.040+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9b80003040 con 0x7f9b88155920 2023-10-14T19:14:40.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.040+0000 7f9b7e7fc700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9b68067350 0x7f9b68069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:40.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.040+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9b80085ff0 con 0x7f9b88155920 2023-10-14T19:14:40.054 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.040+0000 7f9b8659c700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9b68067350 0x7f9b68069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.041+0000 7f9b8659c700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9b68067350 0x7f9b68069800 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9b78000e10 tx=0x7f9b78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.044+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b80052e70 con 0x7f9b88155920 2023-10-14T19:14:40.317 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.315+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f9b8804c3c0 con 0x7f9b88155920 2023-10-14T19:14:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.539+0000 7f9b7e7fc700 1 -- 172.21.15.7:0/1659307338 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v551) v1 ==== 131+0+0 (secure 0 0 0) 0x7f9b800180c0 con 0x7f9b88155920 2023-10-14T19:14:40.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.541+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9b68067350 msgr2=0x7f9b68069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.541+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9b68067350 0x7f9b68069800 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9b78000e10 tx=0x7f9b78009040 comp rx=0 tx=0).stop 2023-10-14T19:14:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.541+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 msgr2=0x7f9b881525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.541+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 0x7f9b881525a0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000afd0 tx=0x7f9b8001a000 comp rx=0 tx=0).stop 2023-10-14T19:14:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 shutdown_connections 2023-10-14T19:14:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f9b68067350 0x7f9b68069800 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b74004d50 0x7f9b88144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88155920 0x7f9b881525a0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 --2- 172.21.15.7:0/1659307338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b881554d0 0x7f9b88152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 >> 172.21.15.7:0/1659307338 conn(0x7f9b88070e30 msgr2=0x7f9b880b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 shutdown_connections 2023-10-14T19:14:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:40.542+0000 7f9b8ca4a700 1 -- 172.21.15.7:0/1659307338 wait complete. 2023-10-14T19:14:40.556 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used ... ERROR 2023-10-14T19:14:40.556 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.557 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T19:14:40.557 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:14:40.558 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-14T19:14:40.558 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T19:14:40.558 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T19:14:40.559 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-14T19:14:40.559 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-14T19:14:40.559 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-14T19:14:40.560 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-14T19:14:40.560 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-14T19:14:40.561 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-14T19:14:40.561 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-14T19:14:40.561 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-14T19:14:40.562 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T19:14:40.562 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T19:14:40.562 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T19:14:40.563 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T19:14:40.563 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T19:14:40.563 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T19:14:40.564 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T19:14:40.564 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T19:14:40.564 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-14T19:14:40.565 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.565 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-14T19:14:40.565 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.566 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T19:14:40.566 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-14T19:14:40.566 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-14T19:14:40.567 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-14T19:14:40.567 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-14T19:14:40.569 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-14T19:14:40.570 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-14T19:14:40.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-14T19:14:40.570 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-14T19:14:40.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T19:14:40.571 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T19:14:40.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T19:14:40.571 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T19:14:40.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T19:14:40.572 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T19:14:40.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T19:14:40.572 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T19:14:40.572 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-14T19:14:40.573 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.573 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T19:14:40.573 INFO:tasks.cephfs_test_runner:Ran 12 tests in 663.396s 2023-10-14T19:14:40.574 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.574 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T19:14:40.574 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.574 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T19:14:40.575 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:14:40.575 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-14T19:14:40.575 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T19:14:40.576 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T19:14:40.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-14T19:14:40.576 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-14T19:14:40.577 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-14T19:14:40.577 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-14T19:14:40.577 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-14T19:14:40.577 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-14T19:14:40.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-14T19:14:40.578 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-14T19:14:40.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T19:14:40.579 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T19:14:40.579 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T19:14:40.579 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T19:14:40.579 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T19:14:40.580 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T19:14:40.580 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T19:14:40.580 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T19:14:40.580 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-14T19:14:40.581 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.581 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-14T19:14:40.581 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.581 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T19:14:40.582 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-14T19:14:40.582 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-14T19:14:40.582 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-14T19:14:40.582 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-14T19:14:40.583 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-14T19:14:40.583 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-14T19:14:40.583 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-14T19:14:40.583 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-14T19:14:40.584 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T19:14:40.584 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T19:14:40.584 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T19:14:40.584 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T19:14:40.584 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T19:14:40.585 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T19:14:40.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T19:14:40.585 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T19:14:40.585 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-14T19:14:40.586 INFO:tasks.cephfs_test_runner: 2023-10-14T19:14:40.586 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:14:40.649 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7ceded98f2cc4e45b3f3d3d2f6161dd9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-14T19:14:40.651 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T19:14:40.661 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T19:14:40.710 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T19:14:40.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:40.711 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:14:40.731 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T19:14:40.731 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T19:14:40.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:40.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T19:14:40.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:40.814 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T19:14:40.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:40.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-10-14T19:14:40.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:40.992 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-10-14T19:14:41.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-10-14T19:14:41.079 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2023-10-14T19:14:41.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:14:41.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.081 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:14:41.099 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T19:14:41.099 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T19:14:41.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.100 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T19:14:41.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.184 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T19:14:41.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.245 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-14T19:14:41.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.314 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-14T19:14:41.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T19:14:41.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-14T19:14:41.400 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-10-14T19:14:41.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:14:41.402 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T19:14:41.411 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-14T19:14:41.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:14:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.532+0000 7fef80a38700 1 Processor -- start 2023-10-14T19:14:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.532+0000 7fef80a38700 1 -- start start 2023-10-14T19:14:41.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef80a38700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140a70 0x7fef7c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef80a38700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef7c06de50 0x7fef7c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef80a38700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c0c6d50 con 0x7fef7c140e40 2023-10-14T19:14:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef80a38700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c0c7030 con 0x7fef7c06de50 2023-10-14T19:14:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef80a38700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0c7310 con 0x7fef7c140a70 2023-10-14T19:14:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef7c06de50 0x7fef7c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef7c06de50 0x7fef7c0aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40326/0 (socket says 172.21.15.7:40326) 2023-10-14T19:14:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 -- 172.21.15.7:0/2976190235 learned_addr learned my addr 172.21.15.7:0/2976190235 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7ad9d700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140a70 0x7fef7c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 -- 172.21.15.7:0/2976190235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140a70 msgr2=0x7fef7c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140a70 0x7fef7c0c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 -- 172.21.15.7:0/2976190235 >> v1:172.21.15.148:6789/0 conn(0x7fef7c140e40 legacy=0x7fef7c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 -- 172.21.15.7:0/2976190235 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0c75f0 con 0x7fef7c06de50 2023-10-14T19:14:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7ad9d700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140a70 0x7fef7c0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef7b59e700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0aeef0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fef74009f20 tx=0x7fef74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc79532490a0c637 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.533+0000 7fef79d9b700 1 -- 172.21.15.7:0/2976190235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400e070 con 0x7fef7c06de50 2023-10-14T19:14:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef79d9b700 1 -- 172.21.15.7:0/2976190235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400ba40 con 0x7fef7c06de50 2023-10-14T19:14:41.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef79d9b700 1 -- 172.21.15.7:0/2976190235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740092e0 con 0x7fef7c06de50 2023-10-14T19:14:41.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 -- 172.21.15.7:0/2976190235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 msgr2=0x7fef7c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.541 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0aeef0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fef74009f20 tx=0x7fef74009840 comp rx=0 tx=0).stop 2023-10-14T19:14:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 -- 172.21.15.7:0/2976190235 shutdown_connections 2023-10-14T19:14:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0aeef0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 --2- 172.21.15.7:0/2976190235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140a70 0x7fef7c0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 -- 172.21.15.7:0/2976190235 >> 172.21.15.7:0/2976190235 conn(0x7fef7c06d170 msgr2=0x7fef7c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 -- 172.21.15.7:0/2976190235 shutdown_connections 2023-10-14T19:14:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.534+0000 7fef80a38700 1 -- 172.21.15.7:0/2976190235 wait complete. 2023-10-14T19:14:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.535+0000 7fef80a38700 1 Processor -- start 2023-10-14T19:14:41.544 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.535+0000 7fef80a38700 1 -- start start 2023-10-14T19:14:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef80a38700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef80a38700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef7c140a70 0x7fef7c169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef80a38700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140e40 0x7fef7c16b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef80a38700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c16a0c0 con 0x7fef7c06de50 2023-10-14T19:14:41.547 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef80a38700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0cab60 con 0x7fef7c140a70 2023-10-14T19:14:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef80a38700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0ca2c0 con 0x7fef7c140e40 2023-10-14T19:14:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40328/0 (socket says 172.21.15.7:40328) 2023-10-14T19:14:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 -- 172.21.15.7:0/352339132 learned_addr learned my addr 172.21.15.7:0/352339132 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7b59e700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140e40 0x7fef7c16b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7a59c700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef7c140a70 0x7fef7c169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 -- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140e40 msgr2=0x7fef7c16b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140e40 0x7fef7c16b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 -- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef7c140a70 msgr2=0x7fef7c169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef7c140a70 0x7fef7c169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.536+0000 7fef7ad9d700 1 -- 172.21.15.7:0/352339132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009ae0 con 0x7fef7c06de50 2023-10-14T19:14:41.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.537+0000 7fef7ad9d700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0cb730 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c830 tx=0x7fef6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:41.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.537+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c011600 con 0x7fef7c06de50 2023-10-14T19:14:41.551 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.537+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c011760 con 0x7fef7c06de50 2023-10-14T19:14:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.537+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c0ca5a0 con 0x7fef7c06de50 2023-10-14T19:14:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.537+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c011b20 con 0x7fef7c06de50 2023-10-14T19:14:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.537+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c0cbc70 con 0x7fef7c06de50 2023-10-14T19:14:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.538+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c04c3c0 con 0x7fef7c06de50 2023-10-14T19:14:41.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.538+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fef6c00a3e0 con 0x7fef7c06de50 2023-10-14T19:14:41.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.539+0000 7fef62ffd700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef68067320 0x7fef680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.539+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fef6c084f90 con 0x7fef7c06de50 2023-10-14T19:14:41.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.539+0000 7fef7a59c700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef68067320 0x7fef680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.539+0000 7fef7a59c700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef68067320 0x7fef680697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fef7c13fdd0 tx=0x7fef70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:41.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.543+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef6c051e10 con 0x7fef7c06de50 2023-10-14T19:14:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.736+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef7c0cc890 con 0x7fef7c06de50 2023-10-14T19:14:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.737+0000 7fef62ffd700 1 -- 172.21.15.7:0/352339132 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+12223 (secure 0 0 0) 0x7fef6c015090 con 0x7fef7c06de50 2023-10-14T19:14:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:41.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":205,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:14:39.530588+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6835/1294066545":"2023-10-15T19:14:36.523910+0000","172.21.15.7:6833/1294066545":"2023-10-15T19:14:36.523910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:14:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef68067320 msgr2=0x7fef680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef68067320 0x7fef680697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fef7c13fdd0 tx=0x7fef70008040 comp rx=0 tx=0).stop 2023-10-14T19:14:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 msgr2=0x7fef7c0cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0cb730 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c830 tx=0x7fef6c008040 comp rx=0 tx=0).stop 2023-10-14T19:14:41.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 shutdown_connections 2023-10-14T19:14:41.742 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fef68067320 0x7fef680697d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.743 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fef7c140e40 0x7fef7c16b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef7c06de50 0x7fef7c0cb730 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.744 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 --2- 172.21.15.7:0/352339132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef7c140a70 0x7fef7c169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 >> 172.21.15.7:0/352339132 conn(0x7fef7c06d170 msgr2=0x7fef7c13ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:41.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 shutdown_connections 2023-10-14T19:14:41.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.739+0000 7fef80a38700 1 -- 172.21.15.7:0/352339132 wait complete. 2023-10-14T19:14:41.752 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T19:14:41.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:14:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.871+0000 7feede114700 1 Processor -- start 2023-10-14T19:14:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.871+0000 7feede114700 1 -- start start 2023-10-14T19:14:41.879 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feede114700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed80cb5a0 0x7feed80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feede114700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed815ae40 con 0x7feed80cd9e0 2023-10-14T19:14:41.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feede114700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed815ab60 con 0x7feed80cde50 2023-10-14T19:14:41.880 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feede114700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed80d13f0 con 0x7feed80cb5a0 2023-10-14T19:14:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed6ffd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feed80cd9e0 0x7feed8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53216/0 (socket says 172.21.15.7:53216) 2023-10-14T19:14:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed6ffd700 1 -- 172.21.15.7:0/3434550162 learned_addr learned my addr 172.21.15.7:0/3434550162 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed77fe700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed80cb5a0 0x7feed80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757196918 0 0) 0x7feed815ae40 con 0x7feed80cd9e0 2023-10-14T19:14:41.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec4003570 con 0x7feed80cd9e0 2023-10-14T19:14:41.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405257322 0 0) 0x7feed815ab60 con 0x7feed80cde50 2023-10-14T19:14:41.882 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed815ae40 con 0x7feed80cde50 2023-10-14T19:14:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133959505 0 0) 0x7feec4003570 con 0x7feed80cd9e0 2023-10-14T19:14:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed80cb5a0 msgr2=0x7feed80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed80cb5a0 0x7feed80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 >> v1:172.21.15.148:6789/0 conn(0x7feed80cde50 legacy=0x7feed8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80ccf00 con 0x7feed80cd9e0 2023-10-14T19:14:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7feec0001470 con 0x7feed80cd9e0 2023-10-14T19:14:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 >> v1:172.21.15.7:6789/0 conn(0x7feed80cd9e0 legacy=0x7feed8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec4003c20 0x7feec4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feec4004810 0x7feec4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.872+0000 7feed67fc700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feec40051c0 0x7feec400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.885 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec400bff0 con 0x7feec40051c0 2023-10-14T19:14:41.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec400c160 con 0x7feec4003c20 2023-10-14T19:14:41.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec400c320 con 0x7feec4004810 2023-10-14T19:14:41.886 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed77fe700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed80cb5a0 0x7feed80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:14:41.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feec40051c0 0x7feec400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed6ffd700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feec4004810 0x7feec4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed77fe700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec4003c20 0x7feec4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.887 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 -- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feec4004810 msgr2=0x7feec4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feec4004810 0x7feec4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 -- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec4003c20 msgr2=0x7feec4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec4003c20 0x7feec4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 -- 172.21.15.7:0/3434550162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4003570 con 0x7feec40051c0 2023-10-14T19:14:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed77fe700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec4003c20 0x7feec4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed7fff700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feec40051c0 0x7feec400ba60 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7feed0002110 tx=0x7feed00017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1fddb0f9aa7759 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0001ad0 con 0x7feec40051c0 2023-10-14T19:14:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed000c980 con 0x7feec40051c0 2023-10-14T19:14:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.873+0000 7feed67fc700 1 -- 172.21.15.7:0/3434550162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000cd40 con 0x7feec40051c0 2023-10-14T19:14:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feede114700 1 -- 172.21.15.7:0/3434550162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feec40051c0 msgr2=0x7feec400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feede114700 1 --2- 172.21.15.7:0/3434550162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feec40051c0 0x7feec400ba60 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7feed0002110 tx=0x7feed00017c0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feed7fff700 1 -- 172.21.15.7:0/3434550162 reap_dead start 2023-10-14T19:14:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feede114700 1 -- 172.21.15.7:0/3434550162 shutdown_connections 2023-10-14T19:14:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feede114700 1 -- 172.21.15.7:0/3434550162 >> 172.21.15.7:0/3434550162 conn(0x7feed8070e30 msgr2=0x7feed80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feede114700 1 -- 172.21.15.7:0/3434550162 shutdown_connections 2023-10-14T19:14:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.874+0000 7feede114700 1 -- 172.21.15.7:0/3434550162 wait complete. 2023-10-14T19:14:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.875+0000 7feede114700 1 Processor -- start 2023-10-14T19:14:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.875+0000 7feede114700 1 -- start start 2023-10-14T19:14:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed815f9a0 0x7feed815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 0x7feed80af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed8169a30 0x7feed8155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80c7c50 con 0x7feed80c77c0 2023-10-14T19:14:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80c7f30 con 0x7feed8169a30 2023-10-14T19:14:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed80c8210 con 0x7feed815f9a0 2023-10-14T19:14:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 0x7feed80af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 0x7feed80af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40340/0 (socket says 172.21.15.7:40340) 2023-10-14T19:14:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 -- 172.21.15.7:0/3716418622 learned_addr learned my addr 172.21.15.7:0/3716418622 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed77fe700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed815f9a0 0x7feed815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed7fff700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed8169a30 0x7feed8155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 -- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed815f9a0 msgr2=0x7feed815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed815f9a0 0x7feed815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 -- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed8169a30 msgr2=0x7feed8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed8169a30 0x7feed8155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 -- 172.21.15.7:0/3716418622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80c84f0 con 0x7feed80c77c0 2023-10-14T19:14:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feed6ffd700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 0x7feed80af580 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7feec00073c0 tx=0x7feec0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0018030 con 0x7feed80c77c0 2023-10-14T19:14:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0001040 con 0x7feed80c77c0 2023-10-14T19:14:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed80c87d0 con 0x7feed80c77c0 2023-10-14T19:14:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000fb40 con 0x7feed80c77c0 2023-10-14T19:14:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.876+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed8169eb0 con 0x7feed80c77c0 2023-10-14T19:14:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.877+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed80c8a10 con 0x7feed80c77c0 2023-10-14T19:14:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.878+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feec001b070 con 0x7feed80c77c0 2023-10-14T19:14:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.878+0000 7feecf7fe700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feeb8067320 0x7feeb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:41.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.878+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7feec0019070 con 0x7feed80c77c0 2023-10-14T19:14:41.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.878+0000 7feed77fe700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feeb8067320 0x7feeb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:41.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.879+0000 7feed77fe700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feeb8067320 0x7feeb80697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7feed8065120 tx=0x7feec8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:41.882+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feed80c8a10 con 0x7feed80c77c0 2023-10-14T19:14:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.072+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feed80c80a0 con 0x7feeb8067320 2023-10-14T19:14:42.075 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.074+0000 7feecf7fe700 1 -- 172.21.15.7:0/3716418622 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51105 (secure 0 0 0) 0x7feed80c80a0 con 0x7feeb8067320 2023-10-14T19:14:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feeb8067320 msgr2=0x7feeb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feeb8067320 0x7feeb80697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7feed8065120 tx=0x7feec8008040 comp rx=0 tx=0).stop 2023-10-14T19:14:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 msgr2=0x7feed80af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 0x7feed80af580 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7feec00073c0 tx=0x7feec0001df0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 shutdown_connections 2023-10-14T19:14:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7feeb8067320 0x7feeb80697d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed8169a30 0x7feed8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed815f9a0 0x7feed815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 --2- 172.21.15.7:0/3716418622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed80c77c0 0x7feed80af580 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 >> 172.21.15.7:0/3716418622 conn(0x7feed8070e30 msgr2=0x7feed80b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 shutdown_connections 2023-10-14T19:14:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.076+0000 7feede114700 1 -- 172.21.15.7:0/3716418622 wait complete. 2023-10-14T19:14:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:14:42.089 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2023-10-14T19:14:41.789814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440648,"kb_used_data":21384,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534072,"statfs":{"total":773094113280,"available":770594889728,"internally_reserved":0,"allocated":21897216,"data_stored":10484294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001376"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-10-14T19:13:00.231733+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:13:00.231733+0000","last_peered":"2023-10-14T19:13:00.231733+0000","last_clean":"2023-10-14T19:13:00.231733+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:13:00.231733+0000","last_undegraded":"2023-10-14T19:13:00.231733+0000","last_fullsized":"2023-10-14T19:13:00.231733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304492,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067348,"statfs":{"total":96636764160,"available":96324964352,"internally_reserved":0,"allocated":3182592,"data_stored":1752872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":4.2080000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":3.1949999999999998},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53600000000000003,"15min":0.57299999999999995},"min":{"1min":0.50900000000000001,"5min":0.377,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.749,"15min":2.3610000000000002},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.86899999999999999,"15min":4.0679999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.626,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":3.23},"last":0.81699999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.36199999999999999,"15min":0.33500000000000002},"max":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":4.1269999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.69199999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":3.3450000000000002},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":2.4620000000000002},"last":0.496},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":4.5389999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.52900000000000003,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.84699999999999998,"15min":3.4119999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":2.883},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":0.81599999999999995,"15min":2.7130000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.69099999999999995},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.96699999999999997,"15min":5.383},"last":0.56299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.996,"15min":5.7030000000000003},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.67700000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":1.032,"15min":8.0210000000000008},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.67700000000000005},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.204,"15min":8.1890000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308008,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063832,"statfs":{"total":96636764160,"available":96321363968,"internally_reserved":0,"allocated":2588672,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.624},"last":0.377},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.20399999999999999,"15min":0.20300000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.375},"min":{"1min":0.33400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.63200000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47199999999999998,"15min":0.42899999999999999},"min":{"1min":0.39200000000000002,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.39700000000000002},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.86699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.312},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.36899999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.216},"max":{"1min":0.59099999999999997,"5min":0.873,"15min":0.873},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.032},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.373},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.0660000000000001,"15min":1.627},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.004,"15min":1.079},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66200000000000003,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.5880000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308584,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063256,"statfs":{"total":96636764160,"available":96320774144,"internally_reserved":0,"allocated":3178496,"data_stored":1752366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53600000000000003,"5min":0.626,"15min":0.626},"last":0.252},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.36199999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.34300000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.626,"15min":0.64700000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.56899999999999995,"5min":0.627,"15min":0.627},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.92900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.56799999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.97599999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.625},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.95599999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.503,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.88200000000000001,"15min":0.92500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.57599999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.96599999999999997},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29499999999999998,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.22,"15min":0.219},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":11.269},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.38700000000000001,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.221},"max":{"1min":0.53700000000000003,"5min":0.59599999999999997,"15min":11.318},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47199999999999998,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.26900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.997,"15min":0.997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":1.9299999999999999},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":1.9710000000000001},"last":0.503},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64200000000000002,"15min":0.83099999999999996},"min":{"1min":0.48399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.028,"15min":11.379},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.83299999999999996},"min":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.98699999999999999,"15min":11.404},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0389999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.44400000000000001,"15min":0.41399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":2.0009999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":11.351000000000001},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1162018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.70099999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56799999999999995,"5min":0.68999999999999995,"15min":1.0629999999999999},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.438,"15min":0.41599999999999998},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.25900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.81000000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.45200000000000001},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.75600000000000001,"15min":1.1719999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.597},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.499,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.36299999999999999},"max":{"1min":0.86599999999999999,"5min":0.87,"15min":1.214},"last":0.79400000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.133},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89100000000000001,"15min":0.92300000000000004},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.97599999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.51100000000000001,"5min":0.41599999999999998,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.997},"last":0.59799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303916,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067924,"statfs":{"total":96636764160,"available":96325554176,"internally_reserved":0,"allocated":2592768,"data_stored":1165225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70499999999999996,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.46000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.89300000000000002,"15min":5.7830000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":1.2709999999999999,"15min":3.0659999999999998},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":1.589,"15min":1.589},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.378},"max":{"1min":0.71899999999999997,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.442}]},{"osd":5,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47399999999999998,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52700000000000002,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.30199999999999999},"max":{"1min":0.61599999999999999,"5min":1.222,"15min":1.5269999999999999},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.36299999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.67400000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.23000000000000001},"max":{"1min":0.72799999999999998,"5min":1.194,"15min":1.194},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":1.784},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76000000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.876},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63800000000000001,"15min":0.69399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":1.097,"15min":1.097},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.28699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59899999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80600000000000005,"5min":1.234,"15min":1.234},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":1.008,"15min":1.008},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:14:42.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:14:42.214 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.211+0000 7f233973c700 1 Processor -- start 2023-10-14T19:14:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.211+0000 7f233973c700 1 -- start start 2023-10-14T19:14:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f233973c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 0x7f23341579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f233973c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 0x7f2334157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f233973c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2334157510 con 0x7f2334155b70 2023-10-14T19:14:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f233973c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23340ae2f0 con 0x7f23340b0910 2023-10-14T19:14:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f233973c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23340ae5d0 con 0x7f2334156f50 2023-10-14T19:14:42.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23327fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 0x7f23341579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23337fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 0x7f2334157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23327fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 0x7f23341579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:57044/0 (socket says 172.21.15.7:57044) 2023-10-14T19:14:42.217 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f2332ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2334155b70 0x7f23340b0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:58476/0 (socket says 172.21.15.7:58476) 2023-10-14T19:14:42.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f2332ffd700 1 -- 172.21.15.7:0/3382640450 learned_addr learned my addr 172.21.15.7:0/3382640450 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:42.218 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23337fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 0x7f2334157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:34774/0 (socket says 172.21.15.7:34774) 2023-10-14T19:14:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23337fe700 1 -- 172.21.15.7:0/3382640450 >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 msgr2=0x7f23341579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23337fe700 1 --2- 172.21.15.7:0/3382640450 >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 0x7f23341579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23337fe700 1 -- 172.21.15.7:0/3382640450 >> v1:172.21.15.148:6789/0 conn(0x7f2334155b70 legacy=0x7f23340b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23337fe700 1 -- 172.21.15.7:0/3382640450 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23340ae8b0 con 0x7f2334156f50 2023-10-14T19:14:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.212+0000 7f23327fc700 1 --2- 172.21.15.7:0/3382640450 >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 0x7f23341579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:14:42.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f23337fe700 1 --2- 172.21.15.7:0/3382640450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 0x7f2334157ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f232400af70 tx=0x7f232400a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad49df20e49e1b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f2331ffb700 1 -- 172.21.15.7:0/3382640450 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400f070 con 0x7f2334156f50 2023-10-14T19:14:42.221 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f2331ffb700 1 -- 172.21.15.7:0/3382640450 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232400a2e0 con 0x7f2334156f50 2023-10-14T19:14:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f2331ffb700 1 -- 172.21.15.7:0/3382640450 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400cc70 con 0x7f2334156f50 2023-10-14T19:14:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 -- 172.21.15.7:0/3382640450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 msgr2=0x7f2334157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 --2- 172.21.15.7:0/3382640450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 0x7f2334157ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f232400af70 tx=0x7f232400a890 comp rx=0 tx=0).stop 2023-10-14T19:14:42.223 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 -- 172.21.15.7:0/3382640450 shutdown_connections 2023-10-14T19:14:42.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 --2- 172.21.15.7:0/3382640450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2334156f50 0x7f2334157ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 --2- 172.21.15.7:0/3382640450 >> v2:172.21.15.148:3300/0 conn(0x7f23340b0910 0x7f23341579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 -- 172.21.15.7:0/3382640450 >> 172.21.15.7:0/3382640450 conn(0x7f233406d170 msgr2=0x7f23340cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:42.224 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 -- 172.21.15.7:0/3382640450 shutdown_connections 2023-10-14T19:14:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.213+0000 7f233973c700 1 -- 172.21.15.7:0/3382640450 wait complete. 2023-10-14T19:14:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 Processor -- start 2023-10-14T19:14:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 -- start start 2023-10-14T19:14:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23340b0910 0x7f233416a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 0x7f233406b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2334156f50 0x7f23340aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233414ced0 con 0x7f2334155b70 2023-10-14T19:14:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233416aa50 con 0x7f2334156f50 2023-10-14T19:14:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f233973c700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233414e4a0 con 0x7f23340b0910 2023-10-14T19:14:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.215+0000 7f23327fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 0x7f233406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23327fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 0x7f233406b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40356/0 (socket says 172.21.15.7:40356) 2023-10-14T19:14:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23327fc700 1 -- 172.21.15.7:0/101703989 learned_addr learned my addr 172.21.15.7:0/101703989 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2334156f50 0x7f23340aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f2332ffd700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23340b0910 0x7f233416a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 -- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23340b0910 msgr2=0x7f233416a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23340b0910 0x7f233416a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 -- 172.21.15.7:0/101703989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 msgr2=0x7f233406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 0x7f233406b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 -- 172.21.15.7:0/101703989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009420 con 0x7f2334156f50 2023-10-14T19:14:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23327fc700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 0x7f233406b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T19:14:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f23337fe700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2334156f50 0x7f23340aca10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2324016000 tx=0x7f2324019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324009b20 con 0x7f2334156f50 2023-10-14T19:14:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324009ca0 con 0x7f2334156f50 2023-10-14T19:14:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232400ab30 con 0x7f2334156f50 2023-10-14T19:14:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232401d690 con 0x7f2334156f50 2023-10-14T19:14:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.216+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233416d8a0 con 0x7f2334156f50 2023-10-14T19:14:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.217+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233414d040 con 0x7f2334156f50 2023-10-14T19:14:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.218+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f232401da80 con 0x7f2334156f50 2023-10-14T19:14:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.218+0000 7f232affd700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2314067320 0x7f23140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.218+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f23240862c0 con 0x7f2334156f50 2023-10-14T19:14:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.218+0000 7f2332ffd700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2314067320 0x7f23140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.219+0000 7f2332ffd700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2314067320 0x7f23140697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f232c007130 tx=0x7f232c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.223+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2324053240 con 0x7f2334156f50 2023-10-14T19:14:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.409+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f233404c3c0 con 0x7f2314067320 2023-10-14T19:14:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.412+0000 7f232affd700 1 -- 172.21.15.7:0/101703989 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51105 (secure 0 0 0) 0x7f233404c3c0 con 0x7f2314067320 2023-10-14T19:14:42.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2314067320 msgr2=0x7f23140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2314067320 0x7f23140697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f232c007130 tx=0x7f232c007eb0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2334156f50 msgr2=0x7f23340aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2334156f50 0x7f23340aca10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2324016000 tx=0x7f2324019000 comp rx=0 tx=0).stop 2023-10-14T19:14:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 shutdown_connections 2023-10-14T19:14:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2314067320 0x7f23140697d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2334156f50 0x7f23340aca10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23340b0910 0x7f233416a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 --2- 172.21.15.7:0/101703989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2334155b70 0x7f233406b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 >> 172.21.15.7:0/101703989 conn(0x7f233406d170 msgr2=0x7f2334154420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 shutdown_connections 2023-10-14T19:14:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.414+0000 7f233973c700 1 -- 172.21.15.7:0/101703989 wait complete. 2023-10-14T19:14:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:14:42.426 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2023-10-14T19:14:41.789814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440648,"kb_used_data":21384,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534072,"statfs":{"total":773094113280,"available":770594889728,"internally_reserved":0,"allocated":21897216,"data_stored":10484294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001376"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-10-14T19:13:00.231733+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:13:00.231733+0000","last_peered":"2023-10-14T19:13:00.231733+0000","last_clean":"2023-10-14T19:13:00.231733+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:13:00.231733+0000","last_undegraded":"2023-10-14T19:13:00.231733+0000","last_fullsized":"2023-10-14T19:13:00.231733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304492,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067348,"statfs":{"total":96636764160,"available":96324964352,"internally_reserved":0,"allocated":3182592,"data_stored":1752872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":4.2080000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":3.1949999999999998},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53600000000000003,"15min":0.57299999999999995},"min":{"1min":0.50900000000000001,"5min":0.377,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.749,"15min":2.3610000000000002},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.86899999999999999,"15min":4.0679999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.626,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":3.23},"last":0.81699999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.36199999999999999,"15min":0.33500000000000002},"max":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":4.1269999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.69199999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":3.3450000000000002},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":2.4620000000000002},"last":0.496},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":4.5389999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.52900000000000003,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.84699999999999998,"15min":3.4119999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":2.883},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":0.81599999999999995,"15min":2.7130000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.69099999999999995},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.96699999999999997,"15min":5.383},"last":0.56299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.996,"15min":5.7030000000000003},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.67700000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":1.032,"15min":8.0210000000000008},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.67700000000000005},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.204,"15min":8.1890000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308008,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063832,"statfs":{"total":96636764160,"available":96321363968,"internally_reserved":0,"allocated":2588672,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.624},"last":0.377},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.20399999999999999,"15min":0.20300000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.375},"min":{"1min":0.33400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.63200000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47199999999999998,"15min":0.42899999999999999},"min":{"1min":0.39200000000000002,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.39700000000000002},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.86699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.312},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.36899999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.216},"max":{"1min":0.59099999999999997,"5min":0.873,"15min":0.873},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.032},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.373},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.0660000000000001,"15min":1.627},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.004,"15min":1.079},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66200000000000003,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.5880000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308584,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063256,"statfs":{"total":96636764160,"available":96320774144,"internally_reserved":0,"allocated":3178496,"data_stored":1752366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53600000000000003,"5min":0.626,"15min":0.626},"last":0.252},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.36199999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.34300000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.626,"15min":0.64700000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.56899999999999995,"5min":0.627,"15min":0.627},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.92900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.56799999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.97599999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.625},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.95599999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.503,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.88200000000000001,"15min":0.92500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.57599999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.96599999999999997},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29499999999999998,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.22,"15min":0.219},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":11.269},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.38700000000000001,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.221},"max":{"1min":0.53700000000000003,"5min":0.59599999999999997,"15min":11.318},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47199999999999998,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.26900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.997,"15min":0.997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":1.9299999999999999},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":1.9710000000000001},"last":0.503},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64200000000000002,"15min":0.83099999999999996},"min":{"1min":0.48399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.028,"15min":11.379},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.83299999999999996},"min":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.98699999999999999,"15min":11.404},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0389999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.44400000000000001,"15min":0.41399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":2.0009999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":11.351000000000001},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1162018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.70099999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56799999999999995,"5min":0.68999999999999995,"15min":1.0629999999999999},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.438,"15min":0.41599999999999998},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.25900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.81000000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.45200000000000001},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.75600000000000001,"15min":1.1719999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.597},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.499,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.36299999999999999},"max":{"1min":0.86599999999999999,"5min":0.87,"15min":1.214},"last":0.79400000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.133},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89100000000000001,"15min":0.92300000000000004},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.97599999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.51100000000000001,"5min":0.41599999999999998,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.997},"last":0.59799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303916,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067924,"statfs":{"total":96636764160,"available":96325554176,"internally_reserved":0,"allocated":2592768,"data_stored":1165225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70499999999999996,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.46000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.89300000000000002,"15min":5.7830000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":1.2709999999999999,"15min":3.0659999999999998},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":1.589,"15min":1.589},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.378},"max":{"1min":0.71899999999999997,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.442}]},{"osd":5,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47399999999999998,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52700000000000002,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.30199999999999999},"max":{"1min":0.61599999999999999,"5min":1.222,"15min":1.5269999999999999},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.36299999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.67400000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.23000000000000001},"max":{"1min":0.72799999999999998,"5min":1.194,"15min":1.194},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":1.784},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76000000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.876},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63800000000000001,"15min":0.69399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":1.097,"15min":1.097},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.28699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59899999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80600000000000005,"5min":1.234,"15min":1.234},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":1.008,"15min":1.008},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:14:42.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T19:14:42.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:14:42.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.549+0000 7fbfdec71700 1 Processor -- start 2023-10-14T19:14:42.550 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.549+0000 7fbfdec71700 1 -- start start 2023-10-14T19:14:42.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdec71700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd815a7d0 0x7fbfd8158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.552 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdec71700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfd8150c90 0x7fbfd80af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdec71700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd8158c80 con 0x7fbfd81508c0 2023-10-14T19:14:42.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdec71700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd815afc0 con 0x7fbfd8150c90 2023-10-14T19:14:42.553 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdec71700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80af820 con 0x7fbfd815a7d0 2023-10-14T19:14:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdd20e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfd8150c90 0x7fbfd80af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdca0d700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbfd81508c0 0x7fbfd815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53228/0 (socket says 172.21.15.7:53228) 2023-10-14T19:14:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdca0d700 1 -- 172.21.15.7:0/82341641 learned_addr learned my addr 172.21.15.7:0/82341641 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfd7fff700 1 --2- 172.21.15.7:0/82341641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd815a7d0 0x7fbfd8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdd20e700 1 -- 172.21.15.7:0/82341641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd815a7d0 msgr2=0x7fbfd8158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.550+0000 7fbfdd20e700 1 --2- 172.21.15.7:0/82341641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd815a7d0 0x7fbfd8158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.551+0000 7fbfdd20e700 1 -- 172.21.15.7:0/82341641 >> v1:172.21.15.7:6789/0 conn(0x7fbfd81508c0 legacy=0x7fbfd815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.551+0000 7fbfdd20e700 1 -- 172.21.15.7:0/82341641 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8155710 con 0x7fbfd8150c90 2023-10-14T19:14:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.551+0000 7fbfdd20e700 1 --2- 172.21.15.7:0/82341641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd8150c90 0x7fbfd80af2e0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009e60 tx=0x7fbfd0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1064ed5be2a30310 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.551+0000 7fbfd77fe700 1 -- 172.21.15.7:0/82341641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000e070 con 0x7fbfd8150c90 2023-10-14T19:14:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfd77fe700 1 -- 172.21.15.7:0/82341641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd000bc30 con 0x7fbfd8150c90 2023-10-14T19:14:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfd77fe700 1 -- 172.21.15.7:0/82341641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0012430 con 0x7fbfd8150c90 2023-10-14T19:14:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 -- 172.21.15.7:0/82341641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd8150c90 msgr2=0x7fbfd80af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 --2- 172.21.15.7:0/82341641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd8150c90 0x7fbfd80af2e0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009e60 tx=0x7fbfd0009780 comp rx=0 tx=0).stop 2023-10-14T19:14:42.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 -- 172.21.15.7:0/82341641 shutdown_connections 2023-10-14T19:14:42.561 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 --2- 172.21.15.7:0/82341641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd8150c90 0x7fbfd80af2e0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 --2- 172.21.15.7:0/82341641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd815a7d0 0x7fbfd8158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 -- 172.21.15.7:0/82341641 >> 172.21.15.7:0/82341641 conn(0x7fbfd80cded0 msgr2=0x7fbfd806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:42.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 -- 172.21.15.7:0/82341641 shutdown_connections 2023-10-14T19:14:42.562 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.552+0000 7fbfdec71700 1 -- 172.21.15.7:0/82341641 wait complete. 2023-10-14T19:14:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.553+0000 7fbfdec71700 1 Processor -- start 2023-10-14T19:14:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.553+0000 7fbfdec71700 1 -- start start 2023-10-14T19:14:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdec71700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfd81508c0 0x7fbfd8153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdec71700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd8150c90 0x7fbfd806c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdec71700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 0x7fbfd814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdec71700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c65c0 con 0x7fbfd815a7d0 2023-10-14T19:14:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdec71700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8154370 con 0x7fbfd81508c0 2023-10-14T19:14:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdec71700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c6860 con 0x7fbfd8150c90 2023-10-14T19:14:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdd20e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 0x7fbfd814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdd20e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 0x7fbfd814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40384/0 (socket says 172.21.15.7:40384) 2023-10-14T19:14:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdd20e700 1 -- 172.21.15.7:0/3006146713 learned_addr learned my addr 172.21.15.7:0/3006146713 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfdca0d700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfd81508c0 0x7fbfd8153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.554+0000 7fbfd7fff700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd8150c90 0x7fbfd806c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdd20e700 1 -- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd8150c90 msgr2=0x7fbfd806c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdd20e700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd8150c90 0x7fbfd806c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdd20e700 1 -- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfd81508c0 msgr2=0x7fbfd8153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdd20e700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfd81508c0 0x7fbfd8153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdd20e700 1 -- 172.21.15.7:0/3006146713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd0009a20 con 0x7fbfd815a7d0 2023-10-14T19:14:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdd20e700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 0x7fbfd814e660 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0013000 tx=0x7fbfd0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0027470 con 0x7fbfd815a7d0 2023-10-14T19:14:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0027630 con 0x7fbfd815a7d0 2023-10-14T19:14:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd80c6b40 con 0x7fbfd815a7d0 2023-10-14T19:14:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00279f0 con 0x7fbfd815a7d0 2023-10-14T19:14:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.555+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd814f380 con 0x7fbfd815a7d0 2023-10-14T19:14:42.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.556+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd814f570 con 0x7fbfd815a7d0 2023-10-14T19:14:42.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.556+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbfd0024070 con 0x7fbfd815a7d0 2023-10-14T19:14:42.570 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.557+0000 7fbfd4ff9700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbfbc067320 0x7fbfbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.557+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbfd00871b0 con 0x7fbfd815a7d0 2023-10-14T19:14:42.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.557+0000 7fbfdca0d700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbfbc067320 0x7fbfbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.571 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.557+0000 7fbfdca0d700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbfbc067320 0x7fbfbc0697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80cb4f0 tx=0x7fbfcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.572 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.561+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfd814f570 con 0x7fbfd815a7d0 2023-10-14T19:14:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.750+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfd814f570 con 0x7fbfbc067320 2023-10-14T19:14:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.753+0000 7fbfd4ff9700 1 -- 172.21.15.7:0/3006146713 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51105 (secure 0 0 0) 0x7fbfd814f570 con 0x7fbfbc067320 2023-10-14T19:14:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbfbc067320 msgr2=0x7fbfbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbfbc067320 0x7fbfbc0697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80cb4f0 tx=0x7fbfcc009040 comp rx=0 tx=0).stop 2023-10-14T19:14:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 msgr2=0x7fbfd814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 0x7fbfd814e660 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0013000 tx=0x7fbfd0019000 comp rx=0 tx=0).stop 2023-10-14T19:14:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 shutdown_connections 2023-10-14T19:14:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbfbc067320 0x7fbfbc0697d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfd81508c0 0x7fbfd8153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd815a7d0 0x7fbfd814e660 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 --2- 172.21.15.7:0/3006146713 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfd8150c90 0x7fbfd806c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 >> 172.21.15.7:0/3006146713 conn(0x7fbfd80cded0 msgr2=0x7fbfd814fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 shutdown_connections 2023-10-14T19:14:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.755+0000 7fbfdec71700 1 -- 172.21.15.7:0/3006146713 wait complete. 2023-10-14T19:14:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:14:42.767 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2023-10-14T19:14:41.789814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440648,"kb_used_data":21384,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534072,"statfs":{"total":773094113280,"available":770594889728,"internally_reserved":0,"allocated":21897216,"data_stored":10484294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001376"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-10-14T19:13:00.231733+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:13:00.231733+0000","last_peered":"2023-10-14T19:13:00.231733+0000","last_clean":"2023-10-14T19:13:00.231733+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:13:00.231733+0000","last_undegraded":"2023-10-14T19:13:00.231733+0000","last_fullsized":"2023-10-14T19:13:00.231733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304492,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067348,"statfs":{"total":96636764160,"available":96324964352,"internally_reserved":0,"allocated":3182592,"data_stored":1752872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":4.2080000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":3.1949999999999998},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53600000000000003,"15min":0.57299999999999995},"min":{"1min":0.50900000000000001,"5min":0.377,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.749,"15min":2.3610000000000002},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.86899999999999999,"15min":4.0679999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.626,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":3.23},"last":0.81699999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.36199999999999999,"15min":0.33500000000000002},"max":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":4.1269999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.69199999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":3.3450000000000002},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":2.4620000000000002},"last":0.496},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":4.5389999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.52900000000000003,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.84699999999999998,"15min":3.4119999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":2.883},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":0.81599999999999995,"15min":2.7130000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.69099999999999995},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.96699999999999997,"15min":5.383},"last":0.56299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.996,"15min":5.7030000000000003},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.67700000000000005}]},{"osd":2,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":1.032,"15min":8.0210000000000008},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.67700000000000005},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.204,"15min":8.1890000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308008,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063832,"statfs":{"total":96636764160,"available":96321363968,"internally_reserved":0,"allocated":2588672,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.624},"last":0.377},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.20399999999999999,"15min":0.20300000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.375},"min":{"1min":0.33400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.63200000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47199999999999998,"15min":0.42899999999999999},"min":{"1min":0.39200000000000002,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.39700000000000002},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.86699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.312},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.36899999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.216},"max":{"1min":0.59099999999999997,"5min":0.873,"15min":0.873},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.032},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.373},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.0660000000000001,"15min":1.627},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.004,"15min":1.079},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66200000000000003,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.5880000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308584,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063256,"statfs":{"total":96636764160,"available":96320774144,"internally_reserved":0,"allocated":3178496,"data_stored":1752366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53600000000000003,"5min":0.626,"15min":0.626},"last":0.252},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.36199999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.34300000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.626,"15min":0.64700000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.56899999999999995,"5min":0.627,"15min":0.627},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.92900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.56799999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.97599999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.625},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.95599999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.503,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.88200000000000001,"15min":0.92500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.57599999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.96599999999999997},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303924,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067916,"statfs":{"total":96636764160,"available":96325545984,"internally_reserved":0,"allocated":2600960,"data_stored":1165801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29499999999999998,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.22,"15min":0.219},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":2.028},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":11.269},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.38700000000000001,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.221},"max":{"1min":0.53700000000000003,"5min":0.59599999999999997,"15min":11.318},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47199999999999998,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.26900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.997,"15min":0.997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":1.9299999999999999},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":1.9710000000000001},"last":0.503},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64200000000000002,"15min":0.83099999999999996},"min":{"1min":0.48399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.028,"15min":11.379},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.83299999999999996},"min":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.98699999999999999,"15min":11.404},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0389999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.44400000000000001,"15min":0.41399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":2.0009999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":11.351000000000001},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1162018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.70099999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56799999999999995,"5min":0.68999999999999995,"15min":1.0629999999999999},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.438,"15min":0.41599999999999998},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.25900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.81000000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.45200000000000001},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.75600000000000001,"15min":1.1719999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.597},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.499,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.36299999999999999},"max":{"1min":0.86599999999999999,"5min":0.87,"15min":1.214},"last":0.79400000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.133},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89100000000000001,"15min":0.92300000000000004},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.97599999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.51100000000000001,"5min":0.41599999999999998,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.997},"last":0.59799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303916,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067924,"statfs":{"total":96636764160,"available":96325554176,"internally_reserved":0,"allocated":2592768,"data_stored":1165225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70499999999999996,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.46000000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.89300000000000002,"15min":5.7830000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":1.2709999999999999,"15min":3.0659999999999998},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":1.589,"15min":1.589},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.378},"max":{"1min":0.71899999999999997,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.442}]},{"osd":5,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47399999999999998,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52700000000000002,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.30199999999999999},"max":{"1min":0.61599999999999999,"5min":1.222,"15min":1.5269999999999999},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.36299999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.67400000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.23000000000000001},"max":{"1min":0.72799999999999998,"5min":1.194,"15min":1.194},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":1.784},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76000000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.876},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63800000000000001,"15min":0.69399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":1.097,"15min":1.097},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.28699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59899999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80600000000000005,"5min":1.234,"15min":1.234},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":1.008,"15min":1.008},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:14:42.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T19:14:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.888+0000 7efd93af2700 1 Processor -- start 2023-10-14T19:14:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.888+0000 7efd93af2700 1 -- start start 2023-10-14T19:14:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.889+0000 7efd93af2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a7d0 0x7efd8c158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.889+0000 7efd93af2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 0x7efd8c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.889+0000 7efd93af2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c158c80 con 0x7efd8c1508c0 2023-10-14T19:14:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.889+0000 7efd93af2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c15afc0 con 0x7efd8c15a7d0 2023-10-14T19:14:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.889+0000 7efd93af2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0af820 con 0x7efd8c150c90 2023-10-14T19:14:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 0x7efd8c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9108d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a7d0 0x7efd8c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 0x7efd8c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:34810/0 (socket says 172.21.15.7:34810) 2023-10-14T19:14:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9108d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a7d0 0x7efd8c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:57068/0 (socket says 172.21.15.7:57068) 2023-10-14T19:14:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 -- 172.21.15.7:0/4121537396 learned_addr learned my addr 172.21.15.7:0/4121537396 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9188e700 1 --1- 172.21.15.7:0/4121537396 >> v1:172.21.15.148:6789/0 conn(0x7efd8c1508c0 0x7efd8c15a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.7:58478/0 (socket says 172.21.15.7:58478) 2023-10-14T19:14:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 -- 172.21.15.7:0/4121537396 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a7d0 msgr2=0x7efd8c158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 --2- 172.21.15.7:0/4121537396 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a7d0 0x7efd8c158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 -- 172.21.15.7:0/4121537396 >> v1:172.21.15.148:6789/0 conn(0x7efd8c1508c0 legacy=0x7efd8c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 -- 172.21.15.7:0/4121537396 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c155710 con 0x7efd8c150c90 2023-10-14T19:14:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9208f700 1 --2- 172.21.15.7:0/4121537396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 0x7efd8c0af2e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd84009f20 tx=0x7efd84009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed57be4e81c2f3c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9088c700 1 -- 172.21.15.7:0/4121537396 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400e070 con 0x7efd8c150c90 2023-10-14T19:14:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9088c700 1 -- 172.21.15.7:0/4121537396 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400b9d0 con 0x7efd8c150c90 2023-10-14T19:14:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.890+0000 7efd9088c700 1 -- 172.21.15.7:0/4121537396 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840092e0 con 0x7efd8c150c90 2023-10-14T19:14:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 -- 172.21.15.7:0/4121537396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 msgr2=0x7efd8c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 --2- 172.21.15.7:0/4121537396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 0x7efd8c0af2e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd84009f20 tx=0x7efd84009840 comp rx=0 tx=0).stop 2023-10-14T19:14:42.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 -- 172.21.15.7:0/4121537396 shutdown_connections 2023-10-14T19:14:42.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 --2- 172.21.15.7:0/4121537396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c150c90 0x7efd8c0af2e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.899 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 --2- 172.21.15.7:0/4121537396 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a7d0 0x7efd8c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 -- 172.21.15.7:0/4121537396 >> 172.21.15.7:0/4121537396 conn(0x7efd8c0cded0 msgr2=0x7efd8c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 -- 172.21.15.7:0/4121537396 shutdown_connections 2023-10-14T19:14:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.891+0000 7efd93af2700 1 -- 172.21.15.7:0/4121537396 wait complete. 2023-10-14T19:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.892+0000 7efd93af2700 1 Processor -- start 2023-10-14T19:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.892+0000 7efd93af2700 1 -- start start 2023-10-14T19:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd93af2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c1508c0 0x7efd8c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd93af2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 0x7efd8c0c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd93af2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd8c15a7d0 0x7efd8c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd93af2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c6fa0 con 0x7efd8c150c90 2023-10-14T19:14:42.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd93af2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c7280 con 0x7efd8c15a7d0 2023-10-14T19:14:42.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd93af2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c7560 con 0x7efd8c1508c0 2023-10-14T19:14:42.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 0x7efd8c0c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 0x7efd8c0c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40386/0 (socket says 172.21.15.7:40386) 2023-10-14T19:14:42.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 -- 172.21.15.7:0/45176535 learned_addr learned my addr 172.21.15.7:0/45176535 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:42.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9208f700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd8c15a7d0 0x7efd8c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9188e700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c1508c0 0x7efd8c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 -- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c1508c0 msgr2=0x7efd8c06b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c1508c0 0x7efd8c06b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 -- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd8c15a7d0 msgr2=0x7efd8c14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd8c15a7d0 0x7efd8c14fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 -- 172.21.15.7:0/45176535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009ae0 con 0x7efd8c150c90 2023-10-14T19:14:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.893+0000 7efd9108d700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 0x7efd8c0c65c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efd8000ec80 tx=0x7efd800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.894+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80009690 con 0x7efd8c150c90 2023-10-14T19:14:42.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.894+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8000c850 con 0x7efd8c150c90 2023-10-14T19:14:42.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.894+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c0c7840 con 0x7efd8c150c90 2023-10-14T19:14:42.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.894+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000cc10 con 0x7efd8c150c90 2023-10-14T19:14:42.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.894+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c157230 con 0x7efd8c150c90 2023-10-14T19:14:42.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.895+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c04c3c0 con 0x7efd8c150c90 2023-10-14T19:14:42.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.895+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efd80013470 con 0x7efd8c150c90 2023-10-14T19:14:42.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.896+0000 7efd7dffb700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd70067320 0x7efd700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:42.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.896+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efd80084b50 con 0x7efd8c150c90 2023-10-14T19:14:42.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.896+0000 7efd9188e700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd70067320 0x7efd700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:42.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.896+0000 7efd9188e700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd70067320 0x7efd700697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efd88004fd0 tx=0x7efd88007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:42.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:42.900+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd80051ae0 con 0x7efd8c150c90 2023-10-14T19:14:43.094 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.094+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd8c158f60 con 0x7efd8c150c90 2023-10-14T19:14:43.095 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.094+0000 7efd7dffb700 1 -- 172.21.15.7:0/45176535 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+12223 (secure 0 0 0) 0x7efd80017090 con 0x7efd8c150c90 2023-10-14T19:14:43.096 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:43.096 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":205,"fsid":"409612cc-2479-4e31-9e57-8fa34eb20ae0","created":"2023-10-14T19:02:52.011162+0000","modified":"2023-10-14T19:14:39.530588+0000","last_up_change":"2023-10-14T19:03:01.948191+0000","last_in_change":"2023-10-14T19:02:54.411483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T19:03:03.675297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"942cc2af-e672-44bb-89b8-f9b68cee6fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6805","nonce":90947},{"type":"v1","addr":"172.21.15.7:6807","nonce":90947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":90947},{"type":"v1","addr":"172.21.15.7:6810","nonce":90947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":90947},{"type":"v1","addr":"172.21.15.7:6815","nonce":90947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":90947},{"type":"v1","addr":"172.21.15.7:6813","nonce":90947}]},"public_addr":"172.21.15.7:6807/90947","cluster_addr":"172.21.15.7:6810/90947","heartbeat_back_addr":"172.21.15.7:6815/90947","heartbeat_front_addr":"172.21.15.7:6813/90947","state":["exists","up"]},{"osd":1,"uuid":"1d243c76-21f1-47ba-a948-2609db830d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":90946},{"type":"v1","addr":"172.21.15.7:6817","nonce":90946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":90946},{"type":"v1","addr":"172.21.15.7:6819","nonce":90946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":90946},{"type":"v1","addr":"172.21.15.7:6823","nonce":90946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":90946},{"type":"v1","addr":"172.21.15.7:6821","nonce":90946}]},"public_addr":"172.21.15.7:6817/90946","cluster_addr":"172.21.15.7:6819/90946","heartbeat_back_addr":"172.21.15.7:6823/90946","heartbeat_front_addr":"172.21.15.7:6821/90946","state":["exists","up"]},{"osd":2,"uuid":"75461d6c-1c54-48cf-beff-81c9b75e17e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":90945},{"type":"v1","addr":"172.21.15.7:6801","nonce":90945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":90945},{"type":"v1","addr":"172.21.15.7:6803","nonce":90945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6809","nonce":90945},{"type":"v1","addr":"172.21.15.7:6811","nonce":90945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":90945},{"type":"v1","addr":"172.21.15.7:6806","nonce":90945}]},"public_addr":"172.21.15.7:6801/90945","cluster_addr":"172.21.15.7:6803/90945","heartbeat_back_addr":"172.21.15.7:6811/90945","heartbeat_front_addr":"172.21.15.7:6806/90945","state":["exists","up"]},{"osd":3,"uuid":"74248640-1684-49b9-8f38-46aa25877152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":90956},{"type":"v1","addr":"172.21.15.7:6825","nonce":90956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":90956},{"type":"v1","addr":"172.21.15.7:6827","nonce":90956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":90956},{"type":"v1","addr":"172.21.15.7:6831","nonce":90956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":90956},{"type":"v1","addr":"172.21.15.7:6829","nonce":90956}]},"public_addr":"172.21.15.7:6825/90956","cluster_addr":"172.21.15.7:6827/90956","heartbeat_back_addr":"172.21.15.7:6831/90956","heartbeat_front_addr":"172.21.15.7:6829/90956","state":["exists","up"]},{"osd":4,"uuid":"6101231d-58ec-4867-a108-6ca74cbce304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":91106},{"type":"v1","addr":"172.21.15.148:6801","nonce":91106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":91106},{"type":"v1","addr":"172.21.15.148:6803","nonce":91106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":91106},{"type":"v1","addr":"172.21.15.148:6807","nonce":91106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":91106},{"type":"v1","addr":"172.21.15.148:6805","nonce":91106}]},"public_addr":"172.21.15.148:6801/91106","cluster_addr":"172.21.15.148:6803/91106","heartbeat_back_addr":"172.21.15.148:6807/91106","heartbeat_front_addr":"172.21.15.148:6805/91106","state":["exists","up"]},{"osd":5,"uuid":"70cdb79d-3d6d-4284-9841-90031af10c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":91107},{"type":"v1","addr":"172.21.15.148:6809","nonce":91107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":91107},{"type":"v1","addr":"172.21.15.148:6811","nonce":91107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":91107},{"type":"v1","addr":"172.21.15.148:6815","nonce":91107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":91107},{"type":"v1","addr":"172.21.15.148:6813","nonce":91107}]},"public_addr":"172.21.15.148:6809/91107","cluster_addr":"172.21.15.148:6811/91107","heartbeat_back_addr":"172.21.15.148:6815/91107","heartbeat_front_addr":"172.21.15.148:6813/91107","state":["exists","up"]},{"osd":6,"uuid":"76e33f44-085a-4b77-87e5-2cbc8c5c1783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":91145},{"type":"v1","addr":"172.21.15.148:6825","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":91145},{"type":"v1","addr":"172.21.15.148:6827","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":91145},{"type":"v1","addr":"172.21.15.148:6831","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":91145},{"type":"v1","addr":"172.21.15.148:6829","nonce":91145}]},"public_addr":"172.21.15.148:6825/91145","cluster_addr":"172.21.15.148:6827/91145","heartbeat_back_addr":"172.21.15.148:6831/91145","heartbeat_front_addr":"172.21.15.148:6829/91145","state":["exists","up"]},{"osd":7,"uuid":"e6355a8a-7e5d-4807-91f9-eda538dfd32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":91110},{"type":"v1","addr":"172.21.15.148:6817","nonce":91110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":91110},{"type":"v1","addr":"172.21.15.148:6819","nonce":91110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":91110},{"type":"v1","addr":"172.21.15.148:6823","nonce":91110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":91110},{"type":"v1","addr":"172.21.15.148:6821","nonce":91110}]},"public_addr":"172.21.15.148:6817/91110","cluster_addr":"172.21.15.148:6819/91110","heartbeat_back_addr":"172.21.15.148:6823/91110","heartbeat_front_addr":"172.21.15.148:6821/91110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.598008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.540397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.516584+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.564914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.615832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.618047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T19:02:59.672798+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6835/1294066545":"2023-10-15T19:14:36.523910+0000","172.21.15.7:6833/1294066545":"2023-10-15T19:14:36.523910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T19:14:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd70067320 msgr2=0x7efd700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd70067320 0x7efd700697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efd88004fd0 tx=0x7efd88007eb0 comp rx=0 tx=0).stop 2023-10-14T19:14:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 msgr2=0x7efd8c0c65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 0x7efd8c0c65c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efd8000ec80 tx=0x7efd800091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 shutdown_connections 2023-10-14T19:14:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efd70067320 0x7efd700697d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd8c15a7d0 0x7efd8c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c1508c0 0x7efd8c06b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 --2- 172.21.15.7:0/45176535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd8c150c90 0x7efd8c0c65c0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 >> 172.21.15.7:0/45176535 conn(0x7efd8c0cded0 msgr2=0x7efd8c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 shutdown_connections 2023-10-14T19:14:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:43.097+0000 7efd93af2700 1 -- 172.21.15.7:0/45176535 wait complete. 2023-10-14T19:14:44.111 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T19:14:44.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:44.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.248+0000 7fd1d7fff700 1 Processor -- start 2023-10-14T19:14:44.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.248+0000 7fd1d7fff700 1 -- start start 2023-10-14T19:14:44.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d7fff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1d8142ca0 0x7fd1d815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1d80cb450 0x7fd1d80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d7fff700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d815d8d0 con 0x7fd1d8143070 2023-10-14T19:14:44.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d7fff700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d815d2f0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d7fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d80cc630 con 0x7fd1d80cb450 2023-10-14T19:14:44.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1d8142ca0 0x7fd1d815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d67fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd1d8143070 0x7fd1d80cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53230/0 (socket says 172.21.15.7:53230) 2023-10-14T19:14:44.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d6ffd700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1d8142ca0 0x7fd1d815dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40392/0 (socket says 172.21.15.7:40392) 2023-10-14T19:14:44.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d67fc700 1 -- 172.21.15.7:0/3044129765 learned_addr learned my addr 172.21.15.7:0/3044129765 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:44.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.249+0000 7fd1d77fe700 1 --2- 172.21.15.7:0/3044129765 >> v2:172.21.15.148:3300/0 conn(0x7fd1d80cb450 0x7fd1d80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d6ffd700 1 -- 172.21.15.7:0/3044129765 >> v2:172.21.15.148:3300/0 conn(0x7fd1d80cb450 msgr2=0x7fd1d80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:44.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d6ffd700 1 --2- 172.21.15.7:0/3044129765 >> v2:172.21.15.148:3300/0 conn(0x7fd1d80cb450 0x7fd1d80cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d6ffd700 1 -- 172.21.15.7:0/3044129765 >> v1:172.21.15.7:6789/0 conn(0x7fd1d8143070 legacy=0x7fd1d80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d5ffb700 1 -- 172.21.15.7:0/3044129765 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714474733 0 0) 0x7fd1d815d8d0 con 0x7fd1d8143070 2023-10-14T19:14:44.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d6ffd700 1 -- 172.21.15.7:0/3044129765 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d815d560 con 0x7fd1d8142ca0 2023-10-14T19:14:44.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d6ffd700 1 --2- 172.21.15.7:0/3044129765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d815dd60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd1d815d190 tx=0x7fd1d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fded0890b1ea8384 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d5ffb700 1 -- 172.21.15.7:0/3044129765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000b6b0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d5ffb700 1 -- 172.21.15.7:0/3044129765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d000b810 con 0x7fd1d8142ca0 2023-10-14T19:14:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d5ffb700 1 -- 172.21.15.7:0/3044129765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000bbb0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3044129765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 msgr2=0x7fd1d815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d7fff700 1 --2- 172.21.15.7:0/3044129765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d815dd60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd1d815d190 tx=0x7fd1d00091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3044129765 shutdown_connections 2023-10-14T19:14:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.250+0000 7fd1d7fff700 1 --2- 172.21.15.7:0/3044129765 >> v2:172.21.15.148:3300/0 conn(0x7fd1d80cb450 0x7fd1d80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.251+0000 7fd1d7fff700 1 --2- 172.21.15.7:0/3044129765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d815dd60 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.251+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3044129765 >> 172.21.15.7:0/3044129765 conn(0x7fd1d8067c80 msgr2=0x7fd1d8068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.251+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3044129765 shutdown_connections 2023-10-14T19:14:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.251+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3044129765 wait complete. 2023-10-14T19:14:44.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.252+0000 7fd1d7fff700 1 Processor -- start 2023-10-14T19:14:44.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.252+0000 7fd1d7fff700 1 -- start start 2023-10-14T19:14:44.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1d80cb450 0x7fd1d80acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d80ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1d8143070 0x7fd1d815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80b3170 con 0x7fd1d8142ca0 2023-10-14T19:14:44.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d816d0c0 con 0x7fd1d8143070 2023-10-14T19:14:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80b39e0 con 0x7fd1d80cb450 2023-10-14T19:14:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d80ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d80ab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40398/0 (socket says 172.21.15.7:40398) 2023-10-14T19:14:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 -- 172.21.15.7:0/3381550672 learned_addr learned my addr 172.21.15.7:0/3381550672 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d77fe700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1d8143070 0x7fd1d815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 -- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1d80cb450 msgr2=0x7fd1d80acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1d80cb450 0x7fd1d80acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 -- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1d8143070 msgr2=0x7fd1d815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1d8143070 0x7fd1d815c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 -- 172.21.15.7:0/3381550672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0009420 con 0x7fd1d8142ca0 2023-10-14T19:14:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d67fc700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d80ab590 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000c5b0 tx=0x7fd1c0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0005b30 con 0x7fd1d8142ca0 2023-10-14T19:14:44.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0005c90 con 0x7fd1d8142ca0 2023-10-14T19:14:44.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.253+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d80b3cc0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.254+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0007300 con 0x7fd1d8142ca0 2023-10-14T19:14:44.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.254+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d816d380 con 0x7fd1d8142ca0 2023-10-14T19:14:44.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.254+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1d804c3c0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.255+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1c001b3b0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.255+0000 7fd1ceffd700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd1b8067320 0x7fd1b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.255+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd1c00845e0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1ceffd700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7fd1b806d170 0x7fd1b806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 --> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1b806fc50 con 0x7fd1b806d170 2023-10-14T19:14:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1c00848f0 con 0x7fd1d8142ca0 2023-10-14T19:14:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1d6ffd700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd1b8067320 0x7fd1b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1d77fe700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7fd1b806d170 0x7fd1b806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1d77fe700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7fd1b806d170 0x7fd1b806f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.256+0000 7fd1d6ffd700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd1b8067320 0x7fd1b80697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00091e0 tx=0x7fd1d0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.257+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== osd.0 v2:172.21.15.7:6805/90947 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd1b806fc50 con 0x7fd1b806d170 2023-10-14T19:14:44.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 --> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd1d80cb910 con 0x7fd1b806d170 2023-10-14T19:14:44.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1ceffd700 1 -- 172.21.15.7:0/3381550672 <== osd.0 v2:172.21.15.7:6805/90947 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd1d80cb910 con 0x7fd1b806d170 2023-10-14T19:14:44.274 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:44.274 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:44.274 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:44.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7fd1b806d170 msgr2=0x7fd1b806f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:6805/90947,v1:172.21.15.7:6807/90947] conn(0x7fd1b806d170 0x7fd1b806f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd1b8067320 msgr2=0x7fd1b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fd1b8067320 0x7fd1b80697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00091e0 tx=0x7fd1d0017000 comp rx=0 tx=0).stop 2023-10-14T19:14:44.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 msgr2=0x7fd1d80ab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 --2- 172.21.15.7:0/3381550672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1d8142ca0 0x7fd1d80ab590 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000c5b0 tx=0x7fd1c0001070 comp rx=0 tx=0).stop 2023-10-14T19:14:44.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d77fe700 1 -- 172.21.15.7:0/3381550672 reap_dead start 2023-10-14T19:14:44.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 shutdown_connections 2023-10-14T19:14:44.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 >> 172.21.15.7:0/3381550672 conn(0x7fd1d8067c80 msgr2=0x7fd1d806e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 shutdown_connections 2023-10-14T19:14:44.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.271+0000 7fd1d7fff700 1 -- 172.21.15.7:0/3381550672 wait complete. 2023-10-14T19:14:44.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T19:14:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.403+0000 7fa59d78a700 1 Processor -- start 2023-10-14T19:14:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.403+0000 7fa59d78a700 1 -- start start 2023-10-14T19:14:44.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59d78a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa598153c30 0x7fa59815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59d78a700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa59815de50 0x7fa5980cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59d78a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5980cef40 0x7fa59806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59d78a700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59815afd0 con 0x7fa59815de50 2023-10-14T19:14:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59d78a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59815b2b0 con 0x7fa5980cef40 2023-10-14T19:14:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59d78a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59815b590 con 0x7fa598153c30 2023-10-14T19:14:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa59815de50 0x7fa5980cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa597fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa598153c30 0x7fa59815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa59815de50 0x7fa5980cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40400/0 (socket says 172.21.15.7:40400) 2023-10-14T19:14:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa597fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa598153c30 0x7fa59815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:34816/0 (socket says 172.21.15.7:34816) 2023-10-14T19:14:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 -- 172.21.15.7:0/2577329074 learned_addr learned my addr 172.21.15.7:0/2577329074 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa59cf89700 1 --2- 172.21.15.7:0/2577329074 >> v2:172.21.15.148:3300/0 conn(0x7fa5980cef40 0x7fa59806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 -- 172.21.15.7:0/2577329074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa598153c30 msgr2=0x7fa59815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 --2- 172.21.15.7:0/2577329074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa598153c30 0x7fa59815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 -- 172.21.15.7:0/2577329074 >> v2:172.21.15.148:3300/0 conn(0x7fa5980cef40 msgr2=0x7fa59806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:44.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 --2- 172.21.15.7:0/2577329074 >> v2:172.21.15.148:3300/0 conn(0x7fa5980cef40 0x7fa59806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.404+0000 7fa58ffff700 1 -- 172.21.15.7:0/2577329074 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59815b870 con 0x7fa59815de50 2023-10-14T19:14:44.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa58ffff700 1 --2- 172.21.15.7:0/2577329074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa59815de50 0x7fa5980cea00 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fa598071370 tx=0x7fa580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8717e97d4966cb3f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa5977fe700 1 -- 172.21.15.7:0/2577329074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000b640 con 0x7fa59815de50 2023-10-14T19:14:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa5977fe700 1 -- 172.21.15.7:0/2577329074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000b7a0 con 0x7fa59815de50 2023-10-14T19:14:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa5977fe700 1 -- 172.21.15.7:0/2577329074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000bb60 con 0x7fa59815de50 2023-10-14T19:14:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 -- 172.21.15.7:0/2577329074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa59815de50 msgr2=0x7fa5980cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2577329074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa59815de50 0x7fa5980cea00 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fa598071370 tx=0x7fa580009250 comp rx=0 tx=0).stop 2023-10-14T19:14:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 -- 172.21.15.7:0/2577329074 shutdown_connections 2023-10-14T19:14:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2577329074 >> v2:172.21.15.148:3300/0 conn(0x7fa5980cef40 0x7fa59806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2577329074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa598153c30 0x7fa59815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2577329074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa59815de50 0x7fa5980cea00 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 -- 172.21.15.7:0/2577329074 >> 172.21.15.7:0/2577329074 conn(0x7fa5980703a0 msgr2=0x7fa5980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.405+0000 7fa59d78a700 1 -- 172.21.15.7:0/2577329074 shutdown_connections 2023-10-14T19:14:44.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.406+0000 7fa59d78a700 1 -- 172.21.15.7:0/2577329074 wait complete. 2023-10-14T19:14:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 Processor -- start 2023-10-14T19:14:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 -- start start 2023-10-14T19:14:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 0x7fa59813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa598153c30 0x7fa5980b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa59815de50 0x7fa5980b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980c89f0 con 0x7fa5980cef40 2023-10-14T19:14:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980c7de0 con 0x7fa598153c30 2023-10-14T19:14:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.407+0000 7fa59d78a700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980c80c0 con 0x7fa59815de50 2023-10-14T19:14:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 0x7fa59813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 0x7fa59813aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40402/0 (socket says 172.21.15.7:40402) 2023-10-14T19:14:44.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 -- 172.21.15.7:0/2304592224 learned_addr learned my addr 172.21.15.7:0/2304592224 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:44.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa58ffff700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa598153c30 0x7fa5980b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa59cf89700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa59815de50 0x7fa5980b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 -- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa59815de50 msgr2=0x7fa5980b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa59815de50 0x7fa5980b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 -- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa598153c30 msgr2=0x7fa5980b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa598153c30 0x7fa5980b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 -- 172.21.15.7:0/2304592224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800094f0 con 0x7fa5980cef40 2023-10-14T19:14:44.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa59cf89700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa59815de50 0x7fa5980b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:44.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa597fff700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 0x7fa59813aaa0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fa58800ec80 tx=0x7fa5880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800c850 con 0x7fa5980cef40 2023-10-14T19:14:44.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58800c9b0 con 0x7fa5980cef40 2023-10-14T19:14:44.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5980c83a0 con 0x7fa5980cef40 2023-10-14T19:14:44.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800cd50 con 0x7fa5980cef40 2023-10-14T19:14:44.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.408+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59813afe0 con 0x7fa5980cef40 2023-10-14T19:14:44.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.409+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59804c3c0 con 0x7fa5980cef40 2023-10-14T19:14:44.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.410+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa588013680 con 0x7fa5980cef40 2023-10-14T19:14:44.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.410+0000 7fa594ff9700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa578067320 0x7fa5780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.411+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa5880853a0 con 0x7fa5980cef40 2023-10-14T19:14:44.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.411+0000 7fa58ffff700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa578067320 0x7fa5780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.411+0000 7fa58ffff700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa578067320 0x7fa5780697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa598071370 tx=0x7fa580017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.414+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5880523b0 con 0x7fa5980cef40 2023-10-14T19:14:44.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.607+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5980c8b30 con 0x7fa578067320 2023-10-14T19:14:44.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.608+0000 7fa594ff9700 1 -- 172.21.15.7:0/2304592224 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa580000d00 con 0x7fa578067320 2023-10-14T19:14:44.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa578067320 msgr2=0x7fa5780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa578067320 0x7fa5780697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa598071370 tx=0x7fa580017000 comp rx=0 tx=0).stop 2023-10-14T19:14:44.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 msgr2=0x7fa59813aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 0x7fa59813aaa0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fa58800ec80 tx=0x7fa5880091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 shutdown_connections 2023-10-14T19:14:44.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fa578067320 0x7fa5780697d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa59815de50 0x7fa5980b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5980cef40 0x7fa59813aaa0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 --2- 172.21.15.7:0/2304592224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa598153c30 0x7fa5980b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 >> 172.21.15.7:0/2304592224 conn(0x7fa5980703a0 msgr2=0x7fa5980c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 shutdown_connections 2023-10-14T19:14:44.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.610+0000 7fa59d78a700 1 -- 172.21.15.7:0/2304592224 wait complete. 2023-10-14T19:14:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T19:14:44.623 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T19:14:44.623 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:44.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.746+0000 7f2b157d8700 1 Processor -- start 2023-10-14T19:14:44.747 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.746+0000 7f2b157d8700 1 -- start start 2023-10-14T19:14:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b157d8700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b10142ca0 0x7f2b1015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b157d8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2b10143070 0x7f2b100cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b157d8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1015d8d0 con 0x7f2b1015a6f0 2023-10-14T19:14:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b157d8700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1015d2f0 con 0x7f2b10142ca0 2023-10-14T19:14:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b157d8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100cc630 con 0x7f2b10143070 2023-10-14T19:14:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b0ffff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b10142ca0 0x7f2b1015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b14fd7700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b1015a6f0 0x7f2b100cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53242/0 (socket says 172.21.15.7:53242) 2023-10-14T19:14:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b14fd7700 1 -- 172.21.15.7:0/1024994155 learned_addr learned my addr 172.21.15.7:0/1024994155 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b0f7fe700 1 --2- 172.21.15.7:0/1024994155 >> v2:172.21.15.148:3300/0 conn(0x7f2b10143070 0x7f2b100cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b0ffff700 1 -- 172.21.15.7:0/1024994155 >> v2:172.21.15.148:3300/0 conn(0x7f2b10143070 msgr2=0x7f2b100cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b0ffff700 1 --2- 172.21.15.7:0/1024994155 >> v2:172.21.15.148:3300/0 conn(0x7f2b10143070 0x7f2b100cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b0ffff700 1 -- 172.21.15.7:0/1024994155 >> v1:172.21.15.7:6789/0 conn(0x7f2b1015a6f0 legacy=0x7f2b100cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b0ffff700 1 -- 172.21.15.7:0/1024994155 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1015d560 con 0x7f2b10142ca0 2023-10-14T19:14:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.747+0000 7f2b0effd700 1 -- 172.21.15.7:0/1024994155 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465209420 0 0) 0x7f2b1015d8d0 con 0x7f2b1015a6f0 2023-10-14T19:14:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b0ffff700 1 --2- 172.21.15.7:0/1024994155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10142ca0 0x7f2b1015dd60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f2b10068d50 tx=0x7f2b000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147a60648ab3a135 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b0effd700 1 -- 172.21.15.7:0/1024994155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00011630 con 0x7f2b10142ca0 2023-10-14T19:14:44.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b0effd700 1 -- 172.21.15.7:0/1024994155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00011790 con 0x7f2b10142ca0 2023-10-14T19:14:44.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b0effd700 1 -- 172.21.15.7:0/1024994155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00011b30 con 0x7f2b10142ca0 2023-10-14T19:14:44.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 -- 172.21.15.7:0/1024994155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10142ca0 msgr2=0x7f2b1015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 --2- 172.21.15.7:0/1024994155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10142ca0 0x7f2b1015dd60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f2b10068d50 tx=0x7f2b000091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 -- 172.21.15.7:0/1024994155 shutdown_connections 2023-10-14T19:14:44.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 --2- 172.21.15.7:0/1024994155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10142ca0 0x7f2b1015dd60 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 --2- 172.21.15.7:0/1024994155 >> v2:172.21.15.148:3300/0 conn(0x7f2b10143070 0x7f2b100cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 -- 172.21.15.7:0/1024994155 >> 172.21.15.7:0/1024994155 conn(0x7f2b10067c80 msgr2=0x7f2b10068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 -- 172.21.15.7:0/1024994155 shutdown_connections 2023-10-14T19:14:44.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.748+0000 7f2b157d8700 1 -- 172.21.15.7:0/1024994155 wait complete. 2023-10-14T19:14:44.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.750+0000 7f2b157d8700 1 Processor -- start 2023-10-14T19:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.750+0000 7f2b157d8700 1 -- start start 2023-10-14T19:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.750+0000 7f2b157d8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b10142ca0 0x7f2b100b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.750+0000 7f2b157d8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10143070 0x7f2b1016a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.750+0000 7f2b157d8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b1015a6f0 0x7f2b100b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b157d8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100b1430 con 0x7f2b10143070 2023-10-14T19:14:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b157d8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100b40a0 con 0x7f2b10142ca0 2023-10-14T19:14:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b157d8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1016a8c0 con 0x7f2b1015a6f0 2023-10-14T19:14:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10143070 0x7f2b1016a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10143070 0x7f2b1016a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40424/0 (socket says 172.21.15.7:40424) 2023-10-14T19:14:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 -- 172.21.15.7:0/2058951962 learned_addr learned my addr 172.21.15.7:0/2058951962 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0ffff700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b10142ca0 0x7f2b100b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b14fd7700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b1015a6f0 0x7f2b100b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 -- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b1015a6f0 msgr2=0x7f2b100b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b1015a6f0 0x7f2b100b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 -- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b10142ca0 msgr2=0x7f2b100b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b10142ca0 0x7f2b100b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 -- 172.21.15.7:0/2058951962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00009420 con 0x7f2b10143070 2023-10-14T19:14:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b14fd7700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2b1015a6f0 0x7f2b100b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b0f7fe700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10143070 0x7f2b1016a380 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400ec80 tx=0x7f2b040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400c7f0 con 0x7f2b10143070 2023-10-14T19:14:44.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400c950 con 0x7f2b10143070 2023-10-14T19:14:44.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b100b0960 con 0x7f2b10143070 2023-10-14T19:14:44.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400cd10 con 0x7f2b10143070 2023-10-14T19:14:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.751+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b100b3770 con 0x7f2b10143070 2023-10-14T19:14:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.752+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b1004c3c0 con 0x7f2b10143070 2023-10-14T19:14:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2b04013680 con 0x7f2b10143070 2023-10-14T19:14:44.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2af7fff700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2afc067320 0x7f2afc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2b04084ed0 con 0x7f2b10143070 2023-10-14T19:14:44.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2af7fff700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7f2afc06d170 0x7f2afc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 --> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2afc06fc50 con 0x7f2afc06d170 2023-10-14T19:14:44.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b040851e0 con 0x7f2b10143070 2023-10-14T19:14:44.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2b14fd7700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7f2afc06d170 0x7f2afc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.753+0000 7f2b0ffff700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2afc067320 0x7f2afc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.754+0000 7f2b14fd7700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7f2afc06d170 0x7f2afc06f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.754+0000 7f2b0ffff700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2afc067320 0x7f2afc0697d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2b000093f0 tx=0x7f2b00017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.754+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== osd.1 v2:172.21.15.7:6816/90946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2afc06fc50 con 0x7f2afc06d170 2023-10-14T19:14:44.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.768+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 --> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2b100cb910 con 0x7f2afc06d170 2023-10-14T19:14:44.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.768+0000 7f2af7fff700 1 -- 172.21.15.7:0/2058951962 <== osd.1 v2:172.21.15.7:6816/90946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2b100cb910 con 0x7f2afc06d170 2023-10-14T19:14:44.775 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:44.775 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:44.775 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:44.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7f2afc06d170 msgr2=0x7f2afc06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:6816/90946,v1:172.21.15.7:6817/90946] conn(0x7f2afc06d170 0x7f2afc06f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2afc067320 msgr2=0x7f2afc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f2afc067320 0x7f2afc0697d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2b000093f0 tx=0x7f2b00017000 comp rx=0 tx=0).stop 2023-10-14T19:14:44.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10143070 msgr2=0x7f2b1016a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 --2- 172.21.15.7:0/2058951962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10143070 0x7f2b1016a380 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400ec80 tx=0x7f2b040091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.778 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b14fd7700 1 -- 172.21.15.7:0/2058951962 reap_dead start 2023-10-14T19:14:44.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 shutdown_connections 2023-10-14T19:14:44.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 >> 172.21.15.7:0/2058951962 conn(0x7f2b10067c80 msgr2=0x7f2b1006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 shutdown_connections 2023-10-14T19:14:44.779 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.769+0000 7f2b157d8700 1 -- 172.21.15.7:0/2058951962 wait complete. 2023-10-14T19:14:44.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T19:14:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.901+0000 7ff1e946b700 1 Processor -- start 2023-10-14T19:14:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.901+0000 7ff1e946b700 1 -- start start 2023-10-14T19:14:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e946b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1e40703a0 0x7ff1e40c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e946b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e946b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e406c740 con 0x7ff1e4159790 2023-10-14T19:14:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e946b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e406c9b0 con 0x7ff1e40703a0 2023-10-14T19:14:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e946b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e406cc90 con 0x7ff1e40c7570 2023-10-14T19:14:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e37fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e27fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1e40703a0 0x7ff1e40c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e37fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e406d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.7:34836/0 (socket says 172.21.15.7:34836) 2023-10-14T19:14:44.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e37fe700 1 -- 172.21.15.7:0/193276269 learned_addr learned my addr 172.21.15.7:0/193276269 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.902+0000 7ff1e27fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1e40703a0 0x7ff1e40c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.7:57132/0 (socket says 172.21.15.7:57132) 2023-10-14T19:14:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e37fe700 1 -- 172.21.15.7:0/193276269 >> v2:172.21.15.148:3300/0 conn(0x7ff1e40703a0 msgr2=0x7ff1e40c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e37fe700 1 --2- 172.21.15.7:0/193276269 >> v2:172.21.15.148:3300/0 conn(0x7ff1e40703a0 0x7ff1e40c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e37fe700 1 -- 172.21.15.7:0/193276269 >> v1:172.21.15.148:6789/0 conn(0x7ff1e4159790 legacy=0x7ff1e406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e37fe700 1 -- 172.21.15.7:0/193276269 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e406cf70 con 0x7ff1e40c7570 2023-10-14T19:14:44.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e37fe700 1 --2- 172.21.15.7:0/193276269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e406d490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40099b0 tx=0x7ff1d4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac43b0b9ef0301a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e1ffb700 1 -- 172.21.15.7:0/193276269 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4009ea0 con 0x7ff1e40c7570 2023-10-14T19:14:44.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e1ffb700 1 -- 172.21.15.7:0/193276269 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400b860 con 0x7ff1e40c7570 2023-10-14T19:14:44.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.903+0000 7ff1e1ffb700 1 -- 172.21.15.7:0/193276269 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400bc00 con 0x7ff1e40c7570 2023-10-14T19:14:44.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 -- 172.21.15.7:0/193276269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 msgr2=0x7ff1e406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 --2- 172.21.15.7:0/193276269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e406d490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40099b0 tx=0x7ff1d4009250 comp rx=0 tx=0).stop 2023-10-14T19:14:44.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 -- 172.21.15.7:0/193276269 shutdown_connections 2023-10-14T19:14:44.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 --2- 172.21.15.7:0/193276269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e406d490 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 --2- 172.21.15.7:0/193276269 >> v2:172.21.15.148:3300/0 conn(0x7ff1e40703a0 0x7ff1e40c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 -- 172.21.15.7:0/193276269 >> 172.21.15.7:0/193276269 conn(0x7ff1e406ecd0 msgr2=0x7ff1e406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 -- 172.21.15.7:0/193276269 shutdown_connections 2023-10-14T19:14:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.904+0000 7ff1e946b700 1 -- 172.21.15.7:0/193276269 wait complete. 2023-10-14T19:14:44.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.905+0000 7ff1e946b700 1 Processor -- start 2023-10-14T19:14:44.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.905+0000 7ff1e946b700 1 -- start start 2023-10-14T19:14:44.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e946b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1e40703a0 0x7ff1e4153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e946b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e946b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 0x7ff1e415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e946b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4154ed0 con 0x7ff1e4159790 2023-10-14T19:14:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e946b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4154250 con 0x7ff1e40703a0 2023-10-14T19:14:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e946b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4154530 con 0x7ff1e40c7570 2023-10-14T19:14:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 0x7ff1e415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 0x7ff1e415bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40428/0 (socket says 172.21.15.7:40428) 2023-10-14T19:14:44.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 -- 172.21.15.7:0/4148776068 learned_addr learned my addr 172.21.15.7:0/4148776068 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:44.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e27fc700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e2ffd700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1e40703a0 0x7ff1e4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 -- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 msgr2=0x7ff1e415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 -- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1e40703a0 msgr2=0x7ff1e4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:44.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1e40703a0 0x7ff1e4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:44.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 -- 172.21.15.7:0/4148776068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d40094f0 con 0x7ff1e4159790 2023-10-14T19:14:44.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1e37fe700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 0x7ff1e415bf40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff1e406cdd0 tx=0x7ff1d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.906+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4011420 con 0x7ff1e4159790 2023-10-14T19:14:44.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.907+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4011580 con 0x7ff1e4159790 2023-10-14T19:14:44.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.907+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4154810 con 0x7ff1e4159790 2023-10-14T19:14:44.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.907+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4011920 con 0x7ff1e4159790 2023-10-14T19:14:44.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.907+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40c9a30 con 0x7ff1e4159790 2023-10-14T19:14:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.907+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e404c3c0 con 0x7ff1e4159790 2023-10-14T19:14:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.908+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff1d4011c90 con 0x7ff1e4159790 2023-10-14T19:14:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.908+0000 7ff1daffd700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1c4067320 0x7ff1c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.908+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff1d40862a0 con 0x7ff1e4159790 2023-10-14T19:14:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.909+0000 7ff1e2ffd700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1c4067320 0x7ff1c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.909+0000 7ff1e2ffd700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1c4067320 0x7ff1c40697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007fd0 tx=0x7ff1dc0016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:44.913+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d4053230 con 0x7ff1e4159790 2023-10-14T19:14:45.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.106+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1e4070e30 con 0x7ff1c4067320 2023-10-14T19:14:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.106+0000 7ff1daffd700 1 -- 172.21.15.7:0/4148776068 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff1e4070e30 con 0x7ff1c4067320 2023-10-14T19:14:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1c4067320 msgr2=0x7ff1c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1c4067320 0x7ff1c40697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007fd0 tx=0x7ff1dc0016f0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 msgr2=0x7ff1e415bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 0x7ff1e415bf40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff1e406cdd0 tx=0x7ff1d4017000 comp rx=0 tx=0).stop 2023-10-14T19:14:45.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 shutdown_connections 2023-10-14T19:14:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7ff1c4067320 0x7ff1c40697d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1e40703a0 0x7ff1e4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e4159790 0x7ff1e415bf40 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 --2- 172.21.15.7:0/4148776068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1e40c7570 0x7ff1e415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 >> 172.21.15.7:0/4148776068 conn(0x7ff1e406ecd0 msgr2=0x7ff1e40cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 shutdown_connections 2023-10-14T19:14:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.108+0000 7ff1e946b700 1 -- 172.21.15.7:0/4148776068 wait complete. 2023-10-14T19:14:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T19:14:45.121 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T19:14:45.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.245+0000 7fe53898b700 1 Processor -- start 2023-10-14T19:14:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.245+0000 7fe53898b700 1 -- start start 2023-10-14T19:14:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53898b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe534157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53898b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe5340c7b30 0x7fe53406b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53898b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe53406bcc0 0x7fe5340ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53898b700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53406b2f0 con 0x7fe53406bcc0 2023-10-14T19:14:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53898b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53406ace0 con 0x7fe5340c7b30 2023-10-14T19:14:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53898b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c8310 con 0x7fe534156480 2023-10-14T19:14:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe53406bcc0 0x7fe5340ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe53406bcc0 0x7fe5340ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40434/0 (socket says 172.21.15.7:40434) 2023-10-14T19:14:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 -- 172.21.15.7:0/1366045229 learned_addr learned my addr 172.21.15.7:0/1366045229 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe531d9b700 1 --2- 172.21.15.7:0/1366045229 >> v2:172.21.15.148:3300/0 conn(0x7fe5340c7b30 0x7fe53406b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe53259c700 1 --2- 172.21.15.7:0/1366045229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe534157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 -- 172.21.15.7:0/1366045229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 msgr2=0x7fe534157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 --2- 172.21.15.7:0/1366045229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe534157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 -- 172.21.15.7:0/1366045229 >> v2:172.21.15.148:3300/0 conn(0x7fe5340c7b30 msgr2=0x7fe53406b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 --2- 172.21.15.7:0/1366045229 >> v2:172.21.15.148:3300/0 conn(0x7fe5340c7b30 0x7fe53406b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 -- 172.21.15.7:0/1366045229 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340c85f0 con 0x7fe53406bcc0 2023-10-14T19:14:45.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.246+0000 7fe532d9d700 1 --2- 172.21.15.7:0/1366045229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53406bcc0 0x7fe5340ae140 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fe534069900 tx=0x7fe52c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5460e9b67b9d4f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53159a700 1 -- 172.21.15.7:0/1366045229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00e070 con 0x7fe53406bcc0 2023-10-14T19:14:45.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53159a700 1 -- 172.21.15.7:0/1366045229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00ba50 con 0x7fe53406bcc0 2023-10-14T19:14:45.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53159a700 1 -- 172.21.15.7:0/1366045229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0092e0 con 0x7fe53406bcc0 2023-10-14T19:14:45.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 -- 172.21.15.7:0/1366045229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53406bcc0 msgr2=0x7fe5340ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 --2- 172.21.15.7:0/1366045229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53406bcc0 0x7fe5340ae140 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fe534069900 tx=0x7fe52c009840 comp rx=0 tx=0).stop 2023-10-14T19:14:45.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 -- 172.21.15.7:0/1366045229 shutdown_connections 2023-10-14T19:14:45.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 --2- 172.21.15.7:0/1366045229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53406bcc0 0x7fe5340ae140 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 --2- 172.21.15.7:0/1366045229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe534157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 --2- 172.21.15.7:0/1366045229 >> v2:172.21.15.148:3300/0 conn(0x7fe5340c7b30 0x7fe53406b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 -- 172.21.15.7:0/1366045229 >> 172.21.15.7:0/1366045229 conn(0x7fe53406d170 msgr2=0x7fe5340cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 -- 172.21.15.7:0/1366045229 shutdown_connections 2023-10-14T19:14:45.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.247+0000 7fe53898b700 1 -- 172.21.15.7:0/1366045229 wait complete. 2023-10-14T19:14:45.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 Processor -- start 2023-10-14T19:14:45.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 -- start start 2023-10-14T19:14:45.260 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe53406bcc0 0x7fe5340c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5340c7b30 0x7fe534168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe53416cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534148f20 con 0x7fe5340c7b30 2023-10-14T19:14:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c61b0 con 0x7fe53406bcc0 2023-10-14T19:14:45.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe53898b700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5341485f0 con 0x7fe534156480 2023-10-14T19:14:45.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe531d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5340c7b30 0x7fe534168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe531d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5340c7b30 0x7fe534168df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40450/0 (socket says 172.21.15.7:40450) 2023-10-14T19:14:45.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.249+0000 7fe531d9b700 1 -- 172.21.15.7:0/3235681690 learned_addr learned my addr 172.21.15.7:0/3235681690 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:45.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe532d9d700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe53416cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe53259c700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe53406bcc0 0x7fe5340c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe531d9b700 1 -- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 msgr2=0x7fe53416cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe531d9b700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe53416cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe531d9b700 1 -- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe53406bcc0 msgr2=0x7fe5340c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe531d9b700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe53406bcc0 0x7fe5340c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe531d9b700 1 -- 172.21.15.7:0/3235681690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c009ae0 con 0x7fe5340c7b30 2023-10-14T19:14:45.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe532d9d700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe534156480 0x7fe53416cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:45.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe53259c700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe53406bcc0 0x7fe5340c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:45.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe531d9b700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5340c7b30 0x7fe534168df0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d890 tx=0x7fe528008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800b600 con 0x7fe5340c7b30 2023-10-14T19:14:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800b760 con 0x7fe5340c7b30 2023-10-14T19:14:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341488d0 con 0x7fe5340c7b30 2023-10-14T19:14:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800bae0 con 0x7fe5340c7b30 2023-10-14T19:14:45.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.250+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5341493b0 con 0x7fe5340c7b30 2023-10-14T19:14:45.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.251+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe53404c3c0 con 0x7fe5340c7b30 2023-10-14T19:14:45.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.251+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe52801e460 con 0x7fe5340c7b30 2023-10-14T19:14:45.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe5227fc700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe514067320 0x7fe5140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe528085020 con 0x7fe5340c7b30 2023-10-14T19:14:45.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe5227fc700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fe51406d170 0x7fe51406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 --> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe51406fc50 con 0x7fe51406d170 2023-10-14T19:14:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe528087580 con 0x7fe5340c7b30 2023-10-14T19:14:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe53259c700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe514067320 0x7fe5140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.252+0000 7fe532d9d700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fe51406d170 0x7fe51406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.253+0000 7fe532d9d700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fe51406d170 0x7fe51406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.253+0000 7fe53259c700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe514067320 0x7fe5140697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.253+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== osd.2 v2:172.21.15.7:6800/90945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe51406fc50 con 0x7fe51406d170 2023-10-14T19:14:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.267+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 --> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe53406af80 con 0x7fe51406d170 2023-10-14T19:14:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.267+0000 7fe5227fc700 1 -- 172.21.15.7:0/3235681690 <== osd.2 v2:172.21.15.7:6800/90945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe53406af80 con 0x7fe51406d170 2023-10-14T19:14:45.272 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:45.272 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:45.272 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fe51406d170 msgr2=0x7fe51406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:6800/90945,v1:172.21.15.7:6801/90945] conn(0x7fe51406d170 0x7fe51406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe514067320 msgr2=0x7fe5140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fe514067320 0x7fe5140697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524008040 comp rx=0 tx=0).stop 2023-10-14T19:14:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5340c7b30 msgr2=0x7fe534168df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 --2- 172.21.15.7:0/3235681690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5340c7b30 0x7fe534168df0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d890 tx=0x7fe528008040 comp rx=0 tx=0).stop 2023-10-14T19:14:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe532d9d700 1 -- 172.21.15.7:0/3235681690 reap_dead start 2023-10-14T19:14:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 shutdown_connections 2023-10-14T19:14:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 >> 172.21.15.7:0/3235681690 conn(0x7fe53406d170 msgr2=0x7fe53414a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 shutdown_connections 2023-10-14T19:14:45.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.268+0000 7fe53898b700 1 -- 172.21.15.7:0/3235681690 wait complete. 2023-10-14T19:14:45.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T19:14:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.400+0000 7efdd9fb8700 1 Processor -- start 2023-10-14T19:14:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.400+0000 7efdd9fb8700 1 -- start start 2023-10-14T19:14:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd9fb8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efdd4153c30 0x7efdd415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd9fb8700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd415afd0 con 0x7efdd415de50 2023-10-14T19:14:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd9fb8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd415b2b0 con 0x7efdd40cf110 2023-10-14T19:14:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd9fb8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd415b590 con 0x7efdd4153c30 2023-10-14T19:14:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efdd415de50 0x7efdd40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53252/0 (socket says 172.21.15.7:53252) 2023-10-14T19:14:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd3fff700 1 -- 172.21.15.7:0/1474558253 learned_addr learned my addr 172.21.15.7:0/1474558253 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729940139 0 0) 0x7efdd415afd0 con 0x7efdd415de50 2023-10-14T19:14:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc0003570 con 0x7efdd415de50 2023-10-14T19:14:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.401+0000 7efdd8fb6700 1 --2- 172.21.15.7:0/1474558253 >> v2:172.21.15.148:3300/0 conn(0x7efdd4153c30 0x7efdd415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810086834 0 0) 0x7efdc0003570 con 0x7efdd415de50 2023-10-14T19:14:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 >> v2:172.21.15.148:3300/0 conn(0x7efdd4153c30 msgr2=0x7efdd415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 --2- 172.21.15.7:0/1474558253 >> v2:172.21.15.148:3300/0 conn(0x7efdd4153c30 0x7efdd415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 >> v1:172.21.15.148:6789/0 conn(0x7efdd40cf110 legacy=0x7efdd415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd415b870 con 0x7efdd415de50 2023-10-14T19:14:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7efdc40017f0 con 0x7efdd415de50 2023-10-14T19:14:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 >> v1:172.21.15.7:6789/0 conn(0x7efdd415de50 legacy=0x7efdd40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdc0003a60 0x7efdc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdc0004810 0x7efdc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc00051c0 0x7efdc000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd415b590 con 0x7efdc0004810 2023-10-14T19:14:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc000c0d0 con 0x7efdc0003a60 2023-10-14T19:14:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc000c290 con 0x7efdc00051c0 2023-10-14T19:14:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdc0004810 0x7efdc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd8fb6700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdc0003a60 0x7efdc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd97b7700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc00051c0 0x7efdc000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 -- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc00051c0 msgr2=0x7efdc000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc00051c0 0x7efdc000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 -- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdc0003a60 msgr2=0x7efdc0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdc0003a60 0x7efdc0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 -- 172.21.15.7:0/1474558253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0003570 con 0x7efdc0004810 2023-10-14T19:14:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd97b7700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc00051c0 0x7efdc000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd97b7700 1 -- 172.21.15.7:0/1474558253 reap_dead start 2023-10-14T19:14:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.402+0000 7efdd3fff700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdc0004810 0x7efdc0004c80 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7efdc400a900 tx=0x7efdd415e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ccfdc1151de162 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40070d0 con 0x7efdc0004810 2023-10-14T19:14:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4007230 con 0x7efdc0004810 2023-10-14T19:14:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd37fe700 1 -- 172.21.15.7:0/1474558253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40075f0 con 0x7efdc0004810 2023-10-14T19:14:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 -- 172.21.15.7:0/1474558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdc0004810 msgr2=0x7efdc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdc0004810 0x7efdc0004c80 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7efdc400a900 tx=0x7efdd415e2d0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 -- 172.21.15.7:0/1474558253 shutdown_connections 2023-10-14T19:14:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/1474558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdc0004810 0x7efdc0004c80 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 -- 172.21.15.7:0/1474558253 >> 172.21.15.7:0/1474558253 conn(0x7efdd40703a0 msgr2=0x7efdd40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 -- 172.21.15.7:0/1474558253 shutdown_connections 2023-10-14T19:14:45.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.403+0000 7efdd9fb8700 1 -- 172.21.15.7:0/1474558253 wait complete. 2023-10-14T19:14:45.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.404+0000 7efdd9fb8700 1 Processor -- start 2023-10-14T19:14:45.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.404+0000 7efdd9fb8700 1 -- start start 2023-10-14T19:14:45.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd9fb8700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc0004810 0x7efdd4167c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd9fb8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd416aa70 0x7efdd41697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd9fb8700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 0x7efdd40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd9fb8700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd416b600 con 0x7efdd4169cf0 2023-10-14T19:14:45.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd9fb8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd416b8e0 con 0x7efdd416aa70 2023-10-14T19:14:45.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd9fb8700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd416bbc0 con 0x7efdc0004810 2023-10-14T19:14:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd97b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 0x7efdd40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd416aa70 0x7efdd41697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd97b7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 0x7efdd40b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40470/0 (socket says 172.21.15.7:40470) 2023-10-14T19:14:45.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd8fb6700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc0004810 0x7efdd4167c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.405+0000 7efdd97b7700 1 -- 172.21.15.7:0/2274656247 learned_addr learned my addr 172.21.15.7:0/2274656247 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:45.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd97b7700 1 -- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc0004810 msgr2=0x7efdd4167c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd97b7700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc0004810 0x7efdd4167c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd97b7700 1 -- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd416aa70 msgr2=0x7efdd41697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd97b7700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd416aa70 0x7efdd41697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd97b7700 1 -- 172.21.15.7:0/2274656247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd416bea0 con 0x7efdd4169cf0 2023-10-14T19:14:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd97b7700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 0x7efdd40b32d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7efdd4071370 tx=0x7efdbc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00b070 con 0x7efdd4169cf0 2023-10-14T19:14:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc013470 con 0x7efdd4169cf0 2023-10-14T19:14:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd416c180 con 0x7efdd4169cf0 2023-10-14T19:14:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc013830 con 0x7efdd4169cf0 2023-10-14T19:14:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.406+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd416aee0 con 0x7efdd4169cf0 2023-10-14T19:14:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.407+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd415d1f0 con 0x7efdd4169cf0 2023-10-14T19:14:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.407+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efdbc0123d0 con 0x7efdd4169cf0 2023-10-14T19:14:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.408+0000 7efdd0ff9700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efdb4067320 0x7efdb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.408+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efdbc0842e0 con 0x7efdd4169cf0 2023-10-14T19:14:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.408+0000 7efdd8fb6700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efdb4067320 0x7efdb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.408+0000 7efdd8fb6700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efdb4067320 0x7efdb40697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efdcc006f00 tx=0x7efdcc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.412+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdbc051160 con 0x7efdd4169cf0 2023-10-14T19:14:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.606+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7efdd416c370 con 0x7efdb4067320 2023-10-14T19:14:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.607+0000 7efdd0ff9700 1 -- 172.21.15.7:0/2274656247 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efdd416c370 con 0x7efdb4067320 2023-10-14T19:14:45.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efdb4067320 msgr2=0x7efdb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efdb4067320 0x7efdb40697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efdcc006f00 tx=0x7efdcc0091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 msgr2=0x7efdd40b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 0x7efdd40b32d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7efdd4071370 tx=0x7efdbc009040 comp rx=0 tx=0).stop 2023-10-14T19:14:45.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 shutdown_connections 2023-10-14T19:14:45.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7efdb4067320 0x7efdb40697d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd4169cf0 0x7efdd40b32d0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdc0004810 0x7efdd4167c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 --2- 172.21.15.7:0/2274656247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd416aa70 0x7efdd41697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 >> 172.21.15.7:0/2274656247 conn(0x7efdd40703a0 msgr2=0x7efdd4153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 shutdown_connections 2023-10-14T19:14:45.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.609+0000 7efdd9fb8700 1 -- 172.21.15.7:0/2274656247 wait complete. 2023-10-14T19:14:45.614 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T19:14:45.621 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T19:14:45.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.745+0000 7f3cf9286700 1 Processor -- start 2023-10-14T19:14:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.745+0000 7f3cf9286700 1 -- start start 2023-10-14T19:14:45.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf9286700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf9286700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3cf40cd770 0x7f3cf41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf9286700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40cf330 con 0x7f3cf40b04f0 2023-10-14T19:14:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf9286700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf40cdbd0 con 0x7f3cf40cd770 2023-10-14T19:14:45.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf9286700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40cead0 con 0x7f3cf40cb880 2023-10-14T19:14:45.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3cf40cd770 0x7f3cf41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf27fc700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3cf40b04f0 0x7f3cf40cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53258/0 (socket says 172.21.15.7:53258) 2023-10-14T19:14:45.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf27fc700 1 -- 172.21.15.7:0/2718129105 learned_addr learned my addr 172.21.15.7:0/2718129105 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:45.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf2ffd700 1 --2- 172.21.15.7:0/2718129105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf37fe700 1 -- 172.21.15.7:0/2718129105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 msgr2=0x7f3cf40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf37fe700 1 --2- 172.21.15.7:0/2718129105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf37fe700 1 -- 172.21.15.7:0/2718129105 >> v1:172.21.15.7:6789/0 conn(0x7f3cf40b04f0 legacy=0x7f3cf40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf37fe700 1 -- 172.21.15.7:0/2718129105 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40cddd0 con 0x7f3cf40cd770 2023-10-14T19:14:45.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.746+0000 7f3cf1ffb700 1 -- 172.21.15.7:0/2718129105 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855870874 0 0) 0x7f3cf40cf330 con 0x7f3cf40b04f0 2023-10-14T19:14:45.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf37fe700 1 --2- 172.21.15.7:0/2718129105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf41591e0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009e60 tx=0x7f3ce4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1c92accb5159db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf1ffb700 1 -- 172.21.15.7:0/2718129105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400e070 con 0x7f3cf40cd770 2023-10-14T19:14:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf1ffb700 1 -- 172.21.15.7:0/2718129105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400bb60 con 0x7f3cf40cd770 2023-10-14T19:14:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf1ffb700 1 -- 172.21.15.7:0/2718129105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4012430 con 0x7f3cf40cd770 2023-10-14T19:14:45.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 -- 172.21.15.7:0/2718129105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 msgr2=0x7f3cf41591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 --2- 172.21.15.7:0/2718129105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf41591e0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009e60 tx=0x7f3ce4009780 comp rx=0 tx=0).stop 2023-10-14T19:14:45.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 -- 172.21.15.7:0/2718129105 shutdown_connections 2023-10-14T19:14:45.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 --2- 172.21.15.7:0/2718129105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf41591e0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 --2- 172.21.15.7:0/2718129105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 -- 172.21.15.7:0/2718129105 >> 172.21.15.7:0/2718129105 conn(0x7f3cf40703a0 msgr2=0x7f3cf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 -- 172.21.15.7:0/2718129105 shutdown_connections 2023-10-14T19:14:45.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.747+0000 7f3cf9286700 1 -- 172.21.15.7:0/2718129105 wait complete. 2023-10-14T19:14:45.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.748+0000 7f3cf9286700 1 Processor -- start 2023-10-14T19:14:45.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.748+0000 7f3cf9286700 1 -- start start 2023-10-14T19:14:45.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf9286700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cf40b04f0 0x7f3cf40b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf9286700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf9286700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf4157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf9286700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c8690 con 0x7f3cf40cd770 2023-10-14T19:14:45.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf9286700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf4159150 con 0x7f3cf40b04f0 2023-10-14T19:14:45.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf9286700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c94b0 con 0x7f3cf40cb880 2023-10-14T19:14:45.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf4157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf4157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40482/0 (socket says 172.21.15.7:40482) 2023-10-14T19:14:45.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf37fe700 1 -- 172.21.15.7:0/1754800090 learned_addr learned my addr 172.21.15.7:0/1754800090 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:45.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf2ffd700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cf40b04f0 0x7f3cf40b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.749+0000 7f3cf27fc700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf37fe700 1 -- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 msgr2=0x7f3cf40c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf37fe700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3cf40cb880 0x7f3cf40c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf37fe700 1 -- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cf40b04f0 msgr2=0x7f3cf40b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf37fe700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cf40b04f0 0x7f3cf40b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf37fe700 1 -- 172.21.15.7:0/1754800090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009a20 con 0x7f3cf40cd770 2023-10-14T19:14:45.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf37fe700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf4157150 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4012ad0 tx=0x7f3ce4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4027470 con 0x7f3cf40cd770 2023-10-14T19:14:45.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40275d0 con 0x7f3cf40cd770 2023-10-14T19:14:45.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4027990 con 0x7f3cf40cd770 2023-10-14T19:14:45.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf40c88a0 con 0x7f3cf40cd770 2023-10-14T19:14:45.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.750+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf40c8e60 con 0x7f3cf40cd770 2023-10-14T19:14:45.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.751+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3cf404c3c0 con 0x7f3cf40cd770 2023-10-14T19:14:45.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.752+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3ce4024070 con 0x7f3cf40cd770 2023-10-14T19:14:45.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.752+0000 7f3ceaffd700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3cd4067320 0x7f3cd40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.752+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3ce40875d0 con 0x7f3cf40cd770 2023-10-14T19:14:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.752+0000 7f3ceaffd700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f3cd406d170 0x7f3cd406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.752+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 --> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cd406fc50 con 0x7f3cd406d170 2023-10-14T19:14:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.752+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce4087870 con 0x7f3cf40cd770 2023-10-14T19:14:45.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.753+0000 7f3cf27fc700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f3cd406d170 0x7f3cd406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.753+0000 7f3cf2ffd700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3cd4067320 0x7f3cd40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.753+0000 7f3cf27fc700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f3cd406d170 0x7f3cd406f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.753+0000 7f3cf2ffd700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3cd4067320 0x7f3cd40697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009db0 tx=0x7f3cec0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.754+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== osd.3 v2:172.21.15.7:6824/90956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3cd406fc50 con 0x7f3cd406d170 2023-10-14T19:14:45.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.767+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 --> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3cf40ce680 con 0x7f3cd406d170 2023-10-14T19:14:45.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3ceaffd700 1 -- 172.21.15.7:0/1754800090 <== osd.3 v2:172.21.15.7:6824/90956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3cf40ce680 con 0x7f3cd406d170 2023-10-14T19:14:45.770 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:45.771 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:45.771 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f3cd406d170 msgr2=0x7f3cd406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:6824/90956,v1:172.21.15.7:6825/90956] conn(0x7f3cd406d170 0x7f3cd406f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3cd4067320 msgr2=0x7f3cd40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f3cd4067320 0x7f3cd40697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009db0 tx=0x7f3cec0091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 msgr2=0x7f3cf4157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 --2- 172.21.15.7:0/1754800090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf40cd770 0x7f3cf4157150 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4012ad0 tx=0x7f3ce4019000 comp rx=0 tx=0).stop 2023-10-14T19:14:45.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf37fe700 1 -- 172.21.15.7:0/1754800090 reap_dead start 2023-10-14T19:14:45.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 shutdown_connections 2023-10-14T19:14:45.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 >> 172.21.15.7:0/1754800090 conn(0x7f3cf40703a0 msgr2=0x7f3cf40c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 shutdown_connections 2023-10-14T19:14:45.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.768+0000 7f3cf9286700 1 -- 172.21.15.7:0/1754800090 wait complete. 2023-10-14T19:14:45.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T19:14:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.900+0000 7f1429a15700 1 Processor -- start 2023-10-14T19:14:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.900+0000 7f1429a15700 1 -- start start 2023-10-14T19:14:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.901+0000 7f1429a15700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f1424159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.901+0000 7f1429a15700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142415ae40 con 0x7f142415a400 2023-10-14T19:14:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.901+0000 7f1429a15700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142415ab60 con 0x7f14240cb5a0 2023-10-14T19:14:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.901+0000 7f1429a15700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14240ce0f0 con 0x7f14240cb970 2023-10-14T19:14:45.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.901+0000 7f14237fe700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f142415a400 0x7f1424156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53260/0 (socket says 172.21.15.7:53260) 2023-10-14T19:14:45.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.901+0000 7f14237fe700 1 -- 172.21.15.7:0/2383411210 learned_addr learned my addr 172.21.15.7:0/2383411210 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:45.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f14227fc700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f1424159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569588390 0 0) 0x7f142415ae40 con 0x7f142415a400 2023-10-14T19:14:45.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1410003570 con 0x7f142415a400 2023-10-14T19:14:45.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2237133462 0 0) 0x7f1410003570 con 0x7f142415a400 2023-10-14T19:14:45.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 msgr2=0x7f1424159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f1424159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 >> v1:172.21.15.148:6789/0 conn(0x7f14240cb5a0 legacy=0x7f14240cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240ccf00 con 0x7f142415a400 2023-10-14T19:14:45.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f14140017f0 con 0x7f142415a400 2023-10-14T19:14:45.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 >> v1:172.21.15.7:6789/0 conn(0x7f142415a400 legacy=0x7f1424156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410003a90 0x7f1410003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1410004810 0x7f1410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f14100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.914 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240ce0f0 con 0x7f1410004810 2023-10-14T19:14:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141000bb40 con 0x7f1410003a90 2023-10-14T19:14:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141000bd00 con 0x7f14240cb970 2023-10-14T19:14:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f14227fc700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1410004810 0x7f1410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f1422ffd700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410003a90 0x7f1410003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.902+0000 7f14237fe700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f14100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14227fc700 1 -- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 msgr2=0x7f14100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14227fc700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f14100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14227fc700 1 -- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410003a90 msgr2=0x7f1410003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14227fc700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410003a90 0x7f1410003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14227fc700 1 -- 172.21.15.7:0/2383411210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410003570 con 0x7f1410004810 2023-10-14T19:14:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1422ffd700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410003a90 0x7f1410003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14237fe700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14240cb970 0x7f14100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14227fc700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1410004810 0x7f1410004c80 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f140c009c00 tx=0x7f140c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74166378836129a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e710 con 0x7f1410004810 2023-10-14T19:14:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00e870 con 0x7f1410004810 2023-10-14T19:14:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1421ffb700 1 -- 172.21.15.7:0/2383411210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00ec30 con 0x7f1410004810 2023-10-14T19:14:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1429a15700 1 -- 172.21.15.7:0/2383411210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1410004810 msgr2=0x7f1410004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1429a15700 1 --2- 172.21.15.7:0/2383411210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1410004810 0x7f1410004c80 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f140c009c00 tx=0x7f140c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f14237fe700 1 -- 172.21.15.7:0/2383411210 reap_dead start 2023-10-14T19:14:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1429a15700 1 -- 172.21.15.7:0/2383411210 shutdown_connections 2023-10-14T19:14:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.903+0000 7f1429a15700 1 -- 172.21.15.7:0/2383411210 >> 172.21.15.7:0/2383411210 conn(0x7f1424070e30 msgr2=0x7f14240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.904+0000 7f1429a15700 1 -- 172.21.15.7:0/2383411210 shutdown_connections 2023-10-14T19:14:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.904+0000 7f1429a15700 1 -- 172.21.15.7:0/2383411210 wait complete. 2023-10-14T19:14:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 Processor -- start 2023-10-14T19:14:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 -- start start 2023-10-14T19:14:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410004810 0x7f1424156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1424153260 0x7f14240b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 0x7f14240b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240cbde0 con 0x7f14240b6200 2023-10-14T19:14:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240b3810 con 0x7f1410004810 2023-10-14T19:14:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.905+0000 7f1429a15700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14240c8a90 con 0x7f1424153260 2023-10-14T19:14:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 0x7f14240b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 0x7f14240b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40500/0 (socket says 172.21.15.7:40500) 2023-10-14T19:14:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 -- 172.21.15.7:0/1939953059 learned_addr learned my addr 172.21.15.7:0/1939953059 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14227fc700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1424153260 0x7f14240b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f1422ffd700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410004810 0x7f1424156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 -- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1424153260 msgr2=0x7f14240b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1424153260 0x7f14240b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 -- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410004810 msgr2=0x7f1424156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:45.927 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410004810 0x7f1424156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 -- 172.21.15.7:0/1939953059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240c8d70 con 0x7f14240b6200 2023-10-14T19:14:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f14237fe700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 0x7f14240b3e00 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f1414000f80 tx=0x7f14140013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414017bf0 con 0x7f14240b6200 2023-10-14T19:14:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414017d90 con 0x7f14240b6200 2023-10-14T19:14:45.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14240c9050 con 0x7f14240b6200 2023-10-14T19:14:45.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400eba0 con 0x7f14240b6200 2023-10-14T19:14:45.930 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.906+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14240c9610 con 0x7f14240b6200 2023-10-14T19:14:45.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.907+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14240c9800 con 0x7f14240b6200 2023-10-14T19:14:45.933 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.908+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f141401d070 con 0x7f14240b6200 2023-10-14T19:14:45.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.908+0000 7f141affd700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:45.934 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.908+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f141408c7c0 con 0x7f14240b6200 2023-10-14T19:14:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.908+0000 7f1422ffd700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.909+0000 7f1422ffd700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f141c000c00 tx=0x7f141c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:45.912+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1414059860 con 0x7f14240b6200 2023-10-14T19:14:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.105+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f142404c3c0 con 0x7f1404067320 2023-10-14T19:14:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.105+0000 7f141affd700 1 -- 172.21.15.7:0/1939953059 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f142404c3c0 con 0x7f1404067320 2023-10-14T19:14:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 msgr2=0x7f14040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f141c000c00 tx=0x7f141c009040 comp rx=0 tx=0).stop 2023-10-14T19:14:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 msgr2=0x7f14240b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 0x7f14240b3e00 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f1414000f80 tx=0x7f14140013c0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 shutdown_connections 2023-10-14T19:14:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f1404067320 0x7f14040697d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1410004810 0x7f1424156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14240b6200 0x7f14240b3e00 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 --2- 172.21.15.7:0/1939953059 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1424153260 0x7f14240b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 >> 172.21.15.7:0/1939953059 conn(0x7f1424070e30 msgr2=0x7f14240ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 shutdown_connections 2023-10-14T19:14:46.114 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.108+0000 7f1429a15700 1 -- 172.21.15.7:0/1939953059 wait complete. 2023-10-14T19:14:46.114 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T19:14:46.121 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T19:14:46.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.244+0000 7fbc3f739700 1 Processor -- start 2023-10-14T19:14:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.244+0000 7fbc3f739700 1 -- start start 2023-10-14T19:14:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3f739700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc3815de80 0x7fbc38159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3f739700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc3815a300 0x7fbc380c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3f739700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3815d9f0 con 0x7fbc38067e50 2023-10-14T19:14:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3f739700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3815d3c0 con 0x7fbc3815de80 2023-10-14T19:14:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3f739700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3815a8f0 con 0x7fbc3815a300 2023-10-14T19:14:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3ccd4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc3815de80 0x7fbc38159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3d4d5700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbc38067e50 0x7fbc38068220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53266/0 (socket says 172.21.15.7:53266) 2023-10-14T19:14:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.245+0000 7fbc3d4d5700 1 -- 172.21.15.7:0/3074395094 learned_addr learned my addr 172.21.15.7:0/3074395094 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc3dcd6700 1 --2- 172.21.15.7:0/3074395094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc3815a300 0x7fbc380c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc3ccd4700 1 -- 172.21.15.7:0/3074395094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc3815a300 msgr2=0x7fbc380c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc3ccd4700 1 --2- 172.21.15.7:0/3074395094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc3815a300 0x7fbc380c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc3ccd4700 1 -- 172.21.15.7:0/3074395094 >> v1:172.21.15.7:6789/0 conn(0x7fbc38067e50 legacy=0x7fbc38068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc37fff700 1 -- 172.21.15.7:0/3074395094 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770128615 0 0) 0x7fbc3815d9f0 con 0x7fbc38067e50 2023-10-14T19:14:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc3ccd4700 1 -- 172.21.15.7:0/3074395094 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3815abd0 con 0x7fbc3815de80 2023-10-14T19:14:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc3ccd4700 1 --2- 172.21.15.7:0/3074395094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc38159dc0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0098e0 tx=0x7fbc2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b96ce562560065 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc37fff700 1 -- 172.21.15.7:0/3074395094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c009e80 con 0x7fbc3815de80 2023-10-14T19:14:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc37fff700 1 -- 172.21.15.7:0/3074395094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00b860 con 0x7fbc3815de80 2023-10-14T19:14:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.246+0000 7fbc37fff700 1 -- 172.21.15.7:0/3074395094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00bbe0 con 0x7fbc3815de80 2023-10-14T19:14:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 -- 172.21.15.7:0/3074395094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 msgr2=0x7fbc38159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 --2- 172.21.15.7:0/3074395094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc38159dc0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0098e0 tx=0x7fbc2c0091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 -- 172.21.15.7:0/3074395094 shutdown_connections 2023-10-14T19:14:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 --2- 172.21.15.7:0/3074395094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc3815a300 0x7fbc380c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 --2- 172.21.15.7:0/3074395094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc38159dc0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 -- 172.21.15.7:0/3074395094 >> 172.21.15.7:0/3074395094 conn(0x7fbc380ce4a0 msgr2=0x7fbc380ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 -- 172.21.15.7:0/3074395094 shutdown_connections 2023-10-14T19:14:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.247+0000 7fbc3f739700 1 -- 172.21.15.7:0/3074395094 wait complete. 2023-10-14T19:14:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.248+0000 7fbc3f739700 1 Processor -- start 2023-10-14T19:14:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.248+0000 7fbc3f739700 1 -- start start 2023-10-14T19:14:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3f739700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc38067e50 0x7fbc380c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3f739700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc3815a300 0x7fbc380c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3f739700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc381588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3f739700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38144180 con 0x7fbc3815de80 2023-10-14T19:14:46.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3f739700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38155f10 con 0x7fbc3815a300 2023-10-14T19:14:46.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3f739700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380c8390 con 0x7fbc38067e50 2023-10-14T19:14:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc381588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc381588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40506/0 (socket says 172.21.15.7:40506) 2023-10-14T19:14:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 -- 172.21.15.7:0/2045258591 learned_addr learned my addr 172.21.15.7:0/2045258591 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3ccd4700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc3815a300 0x7fbc380c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3d4d5700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc38067e50 0x7fbc380c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 -- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc38067e50 msgr2=0x7fbc380c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc38067e50 0x7fbc380c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 -- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc3815a300 msgr2=0x7fbc380c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc3815a300 0x7fbc380c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 -- 172.21.15.7:0/2045258591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009420 con 0x7fbc3815de80 2023-10-14T19:14:46.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.249+0000 7fbc3dcd6700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc381588a0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fbc28007f20 tx=0x7fbc28009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.250+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800eb90 con 0x7fbc3815de80 2023-10-14T19:14:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.250+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800ed10 con 0x7fbc3815de80 2023-10-14T19:14:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.250+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc38155300 con 0x7fbc3815de80 2023-10-14T19:14:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.250+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28014670 con 0x7fbc3815de80 2023-10-14T19:14:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.250+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc381558c0 con 0x7fbc3815de80 2023-10-14T19:14:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.250+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc3804c3c0 con 0x7fbc3815de80 2023-10-14T19:14:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.251+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbc280149e0 con 0x7fbc3815de80 2023-10-14T19:14:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.251+0000 7fbc357fa700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc24067320 0x7fbc240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbc28085d20 con 0x7fbc3815de80 2023-10-14T19:14:46.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc357fa700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7fbc2406d170 0x7fbc2406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 --> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc2406fc50 con 0x7fbc2406d170 2023-10-14T19:14:46.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc3d4d5700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc24067320 0x7fbc240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.274 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc28086010 con 0x7fbc3815de80 2023-10-14T19:14:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc3ccd4700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7fbc2406d170 0x7fbc2406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc3d4d5700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc24067320 0x7fbc240697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbc30007160 tx=0x7fbc30007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.252+0000 7fbc3ccd4700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7fbc2406d170 0x7fbc2406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.253+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== osd.4 v2:172.21.15.148:6800/91106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbc2406fc50 con 0x7fbc2406d170 2023-10-14T19:14:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 --> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc38068a60 con 0x7fbc2406d170 2023-10-14T19:14:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc357fa700 1 -- 172.21.15.7:0/2045258591 <== osd.4 v2:172.21.15.148:6800/91106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbc38068a60 con 0x7fbc2406d170 2023-10-14T19:14:46.278 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:46.278 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:46.279 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7fbc2406d170 msgr2=0x7fbc2406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6800/91106,v1:172.21.15.148:6801/91106] conn(0x7fbc2406d170 0x7fbc2406f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc24067320 msgr2=0x7fbc240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fbc24067320 0x7fbc240697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbc30007160 tx=0x7fbc30007f50 comp rx=0 tx=0).stop 2023-10-14T19:14:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 msgr2=0x7fbc381588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.267+0000 7fbc3f739700 1 --2- 172.21.15.7:0/2045258591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc3815de80 0x7fbc381588a0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fbc28007f20 tx=0x7fbc28009860 comp rx=0 tx=0).stop 2023-10-14T19:14:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.268+0000 7fbc3dcd6700 1 -- 172.21.15.7:0/2045258591 reap_dead start 2023-10-14T19:14:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.268+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 shutdown_connections 2023-10-14T19:14:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.268+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 >> 172.21.15.7:0/2045258591 conn(0x7fbc380ce4a0 msgr2=0x7fbc3806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.268+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 shutdown_connections 2023-10-14T19:14:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.268+0000 7fbc3f739700 1 -- 172.21.15.7:0/2045258591 wait complete. 2023-10-14T19:14:46.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T19:14:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.403+0000 7f47e9596700 1 Processor -- start 2023-10-14T19:14:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.403+0000 7f47e9596700 1 -- start start 2023-10-14T19:14:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e9596700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47e415de50 0x7f47e40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e9596700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e40cf3c0 con 0x7f47e4153c30 2023-10-14T19:14:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e9596700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e415afd0 con 0x7f47e40cef40 2023-10-14T19:14:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e9596700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e415b2b0 con 0x7f47e415de50 2023-10-14T19:14:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47e415de50 0x7f47e40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e3fff700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f47e4153c30 0x7f47e415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53282/0 (socket says 172.21.15.7:53282) 2023-10-14T19:14:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e3fff700 1 -- 172.21.15.7:0/2690021875 learned_addr learned my addr 172.21.15.7:0/2690021875 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e37fe700 1 -- 172.21.15.7:0/2690021875 >> v1:172.21.15.148:6789/0 conn(0x7f47e40cef40 legacy=0x7f47e415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e37fe700 1 -- 172.21.15.7:0/2690021875 >> v1:172.21.15.7:6789/0 conn(0x7f47e4153c30 legacy=0x7f47e415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e37fe700 1 -- 172.21.15.7:0/2690021875 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e415b590 con 0x7f47e415de50 2023-10-14T19:14:46.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e2ffd700 1 -- 172.21.15.7:0/2690021875 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918592907 0 0) 0x7f47e40cf3c0 con 0x7f47e4153c30 2023-10-14T19:14:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.404+0000 7f47e37fe700 1 --2- 172.21.15.7:0/2690021875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e415de50 0x7f47e40cea00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f47d80098e0 tx=0x7f47d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74ebe83c8436760 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e2ffd700 1 -- 172.21.15.7:0/2690021875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8009e80 con 0x7f47e415de50 2023-10-14T19:14:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e2ffd700 1 -- 172.21.15.7:0/2690021875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800b860 con 0x7f47e415de50 2023-10-14T19:14:46.413 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e2ffd700 1 -- 172.21.15.7:0/2690021875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800bbe0 con 0x7f47e415de50 2023-10-14T19:14:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 -- 172.21.15.7:0/2690021875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e415de50 msgr2=0x7f47e40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 --2- 172.21.15.7:0/2690021875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e415de50 0x7f47e40cea00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f47d80098e0 tx=0x7f47d80091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 -- 172.21.15.7:0/2690021875 shutdown_connections 2023-10-14T19:14:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 --2- 172.21.15.7:0/2690021875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e415de50 0x7f47e40cea00 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 -- 172.21.15.7:0/2690021875 >> 172.21.15.7:0/2690021875 conn(0x7f47e40703a0 msgr2=0x7f47e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 -- 172.21.15.7:0/2690021875 shutdown_connections 2023-10-14T19:14:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.405+0000 7f47e9596700 1 -- 172.21.15.7:0/2690021875 wait complete. 2023-10-14T19:14:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.406+0000 7f47e9596700 1 Processor -- start 2023-10-14T19:14:46.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.406+0000 7f47e9596700 1 -- start start 2023-10-14T19:14:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e9596700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47e40cef40 0x7f47e4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e9596700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 0x7f47e40cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e9596700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f47e415de50 0x7f47e40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e9596700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40c9170 con 0x7f47e4153c30 2023-10-14T19:14:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e9596700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40c8840 con 0x7f47e40cef40 2023-10-14T19:14:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e9596700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40c8b20 con 0x7f47e415de50 2023-10-14T19:14:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 0x7f47e40cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e37fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 0x7f47e40cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40528/0 (socket says 172.21.15.7:40528) 2023-10-14T19:14:46.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e37fe700 1 -- 172.21.15.7:0/32231973 learned_addr learned my addr 172.21.15.7:0/32231973 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:46.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e3fff700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47e40cef40 0x7f47e4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.407+0000 7f47e8d95700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f47e415de50 0x7f47e40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.423 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e37fe700 1 -- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f47e415de50 msgr2=0x7f47e40cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e37fe700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f47e415de50 0x7f47e40cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e37fe700 1 -- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47e40cef40 msgr2=0x7f47e4153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.424 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e37fe700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47e40cef40 0x7f47e4153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e37fe700 1 -- 172.21.15.7:0/32231973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009420 con 0x7f47e4153c30 2023-10-14T19:14:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e37fe700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 0x7f47e40cc0e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f47e406eb00 tx=0x7f47d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d801f070 con 0x7f47e4153c30 2023-10-14T19:14:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8000bc0 con 0x7f47e4153c30 2023-10-14T19:14:46.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e40c8e00 con 0x7f47e4153c30 2023-10-14T19:14:46.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8025420 con 0x7f47e4153c30 2023-10-14T19:14:46.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.408+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e40c97c0 con 0x7f47e4153c30 2023-10-14T19:14:46.426 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.409+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e41535d0 con 0x7f47e4153c30 2023-10-14T19:14:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.409+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f47d8023070 con 0x7f47e4153c30 2023-10-14T19:14:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.410+0000 7f47cbfff700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47d0067320 0x7f47d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.410+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f47d8085e20 con 0x7f47e4153c30 2023-10-14T19:14:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.410+0000 7f47e3fff700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47d0067320 0x7f47d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.410+0000 7f47e3fff700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47d0067320 0x7f47d00697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f47d4007fd0 tx=0x7f47d4007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.414+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d8052df0 con 0x7f47e4153c30 2023-10-14T19:14:46.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.606+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e40c89b0 con 0x7f47d0067320 2023-10-14T19:14:46.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.606+0000 7f47cbfff700 1 -- 172.21.15.7:0/32231973 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47e40c89b0 con 0x7f47d0067320 2023-10-14T19:14:46.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47d0067320 msgr2=0x7f47d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47d0067320 0x7f47d00697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f47d4007fd0 tx=0x7f47d4007d10 comp rx=0 tx=0).stop 2023-10-14T19:14:46.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 msgr2=0x7f47e40cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 0x7f47e40cc0e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f47e406eb00 tx=0x7f47d8017000 comp rx=0 tx=0).stop 2023-10-14T19:14:46.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 shutdown_connections 2023-10-14T19:14:46.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f47d0067320 0x7f47d00697d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47e40cef40 0x7f47e4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f47e415de50 0x7f47e40cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 --2- 172.21.15.7:0/32231973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e4153c30 0x7f47e40cc0e0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 >> 172.21.15.7:0/32231973 conn(0x7f47e40703a0 msgr2=0x7f47e40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 shutdown_connections 2023-10-14T19:14:46.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.608+0000 7f47e9596700 1 -- 172.21.15.7:0/32231973 wait complete. 2023-10-14T19:14:46.613 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T19:14:46.621 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T19:14:46.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:46.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.744+0000 7f37a71a7700 1 Processor -- start 2023-10-14T19:14:46.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.744+0000 7f37a71a7700 1 -- start start 2023-10-14T19:14:46.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a71a7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37a00b24f0 0x7f37a00b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a71a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a0159800 0x7f37a00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a71a7700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a00b0c80 con 0x7f37a00b1d40 2023-10-14T19:14:46.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a71a7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a00d10d0 con 0x7f37a00b24f0 2023-10-14T19:14:46.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a71a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00b0f60 con 0x7f37a0159800 2023-10-14T19:14:46.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a61a5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37a00b24f0 0x7f37a00b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a59a4700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37a00b1d40 0x7f37a01590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50734/0 (socket says 172.21.15.7:50734) 2023-10-14T19:14:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a59a4700 1 -- 172.21.15.7:0/209750930 learned_addr learned my addr 172.21.15.7:0/209750930 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a61a5700 1 -- 172.21.15.7:0/209750930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a0159800 msgr2=0x7f37a00b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a69a6700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a0159800 0x7f37a00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a51a3700 1 -- 172.21.15.7:0/209750930 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642493271 0 0) 0x7f37a00b0c80 con 0x7f37a00b1d40 2023-10-14T19:14:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a61a5700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a0159800 0x7f37a00b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a61a5700 1 -- 172.21.15.7:0/209750930 >> v1:172.21.15.7:6789/0 conn(0x7f37a00b1d40 legacy=0x7f37a01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a61a5700 1 -- 172.21.15.7:0/209750930 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00b1240 con 0x7f37a00b24f0 2023-10-14T19:14:46.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.745+0000 7f37a69a6700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a0159800 0x7f37a00b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:46.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a61a5700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00b24f0 0x7f37a00b0580 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f37980098e0 tx=0x7f37980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4ed055b764ac03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a51a3700 1 -- 172.21.15.7:0/209750930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798009e80 con 0x7f37a00b24f0 2023-10-14T19:14:46.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a51a3700 1 -- 172.21.15.7:0/209750930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379800b860 con 0x7f37a00b24f0 2023-10-14T19:14:46.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a51a3700 1 -- 172.21.15.7:0/209750930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800bbe0 con 0x7f37a00b24f0 2023-10-14T19:14:46.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 -- 172.21.15.7:0/209750930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00b24f0 msgr2=0x7f37a00b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00b24f0 0x7f37a00b0580 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f37980098e0 tx=0x7f37980091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 -- 172.21.15.7:0/209750930 shutdown_connections 2023-10-14T19:14:46.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00b24f0 0x7f37a00b0580 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 --2- 172.21.15.7:0/209750930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a0159800 0x7f37a00b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 -- 172.21.15.7:0/209750930 >> 172.21.15.7:0/209750930 conn(0x7f37a00703a0 msgr2=0x7f37a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 -- 172.21.15.7:0/209750930 shutdown_connections 2023-10-14T19:14:46.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.746+0000 7f37a71a7700 1 -- 172.21.15.7:0/209750930 wait complete. 2023-10-14T19:14:46.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.747+0000 7f37a71a7700 1 Processor -- start 2023-10-14T19:14:46.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 -- start start 2023-10-14T19:14:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a00b1d40 0x7f37a00c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a00b24f0 0x7f37a0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a0159800 0x7f37a0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00c6980 con 0x7f37a0159800 2023-10-14T19:14:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015c2d0 con 0x7f37a00b24f0 2023-10-14T19:14:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a71a7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015b6c0 con 0x7f37a00b1d40 2023-10-14T19:14:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a69a6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a0159800 0x7f37a0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a69a6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a0159800 0x7f37a0152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51724/0 (socket says 172.21.15.7:51724) 2023-10-14T19:14:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.748+0000 7f37a69a6700 1 -- 172.21.15.7:0/521645176 learned_addr learned my addr 172.21.15.7:0/521645176 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a59a4700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a00b24f0 0x7f37a0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a61a5700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a00b1d40 0x7f37a00c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a69a6700 1 -- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a00b1d40 msgr2=0x7f37a00c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a69a6700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37a00b1d40 0x7f37a00c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a69a6700 1 -- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a00b24f0 msgr2=0x7f37a0157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a69a6700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37a00b24f0 0x7f37a0157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a69a6700 1 -- 172.21.15.7:0/521645176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009420 con 0x7f37a0159800 2023-10-14T19:14:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a69a6700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a0159800 0x7f37a0152cc0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f379000a380 tx=0x7f3790007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790015440 con 0x7f37a0159800 2023-10-14T19:14:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900155a0 con 0x7f37a0159800 2023-10-14T19:14:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a015b9a0 con 0x7f37a0159800 2023-10-14T19:14:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790015960 con 0x7f37a0159800 2023-10-14T19:14:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.749+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a015b2d0 con 0x7f37a0159800 2023-10-14T19:14:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.750+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37a004c3c0 con 0x7f37a0159800 2023-10-14T19:14:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.750+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f379000d440 con 0x7f37a0159800 2023-10-14T19:14:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f379e7fc700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f378c067320 0x7f378c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3790085330 con 0x7f37a0159800 2023-10-14T19:14:46.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f379e7fc700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f378c06d170 0x7f378c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 --> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f378c06fc50 con 0x7f378c06d170 2023-10-14T19:14:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3790087980 con 0x7f37a0159800 2023-10-14T19:14:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f37a61a5700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f378c067320 0x7f378c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.751+0000 7f37a59a4700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f378c06d170 0x7f378c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.752+0000 7f37a61a5700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f378c067320 0x7f378c0697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f37980091e0 tx=0x7f3798017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.752+0000 7f37a59a4700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f378c06d170 0x7f378c06f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.752+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== osd.5 v2:172.21.15.148:6808/91107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f378c06fc50 con 0x7f378c06d170 2023-10-14T19:14:46.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 --> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37a00aff80 con 0x7f378c06d170 2023-10-14T19:14:46.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f379e7fc700 1 -- 172.21.15.7:0/521645176 <== osd.5 v2:172.21.15.148:6808/91107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f37a00aff80 con 0x7f378c06d170 2023-10-14T19:14:46.771 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:46.771 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f378c06d170 msgr2=0x7f378c06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6808/91107,v1:172.21.15.148:6809/91107] conn(0x7f378c06d170 0x7f378c06f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f378c067320 msgr2=0x7f378c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.773 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f378c067320 0x7f378c0697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f37980091e0 tx=0x7f3798017000 comp rx=0 tx=0).stop 2023-10-14T19:14:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a0159800 msgr2=0x7f37a0152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 --2- 172.21.15.7:0/521645176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a0159800 0x7f37a0152cc0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f379000a380 tx=0x7f3790007900 comp rx=0 tx=0).stop 2023-10-14T19:14:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a69a6700 1 -- 172.21.15.7:0/521645176 reap_dead start 2023-10-14T19:14:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 shutdown_connections 2023-10-14T19:14:46.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 >> 172.21.15.7:0/521645176 conn(0x7f37a00703a0 msgr2=0x7f37a0155000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 shutdown_connections 2023-10-14T19:14:46.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.767+0000 7f37a71a7700 1 -- 172.21.15.7:0/521645176 wait complete. 2023-10-14T19:14:46.782 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T19:14:46.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.901+0000 7fcdb9598700 1 Processor -- start 2023-10-14T19:14:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.901+0000 7fcdb9598700 1 -- start start 2023-10-14T19:14:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb9598700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcdb40b07d0 0x7fcdb40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb9598700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcdb40b0ba0 0x7fcdb40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb9598700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb415a280 con 0x7fcdb40cf200 2023-10-14T19:14:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb9598700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb406e180 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb9598700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb406d850 con 0x7fcdb40b07d0 2023-10-14T19:14:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcdb40b0ba0 0x7fcdb40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb37fe700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcdb40b0ba0 0x7fcdb40c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51726/0 (socket says 172.21.15.7:51726) 2023-10-14T19:14:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb37fe700 1 -- 172.21.15.7:0/303219980 learned_addr learned my addr 172.21.15.7:0/303219980 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.902+0000 7fcdb2ffd700 1 --2- 172.21.15.7:0/303219980 >> v2:172.21.15.148:3300/0 conn(0x7fcdb40b07d0 0x7fcdb40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb37fe700 1 -- 172.21.15.7:0/303219980 >> v2:172.21.15.148:3300/0 conn(0x7fcdb40b07d0 msgr2=0x7fcdb40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb37fe700 1 --2- 172.21.15.7:0/303219980 >> v2:172.21.15.148:3300/0 conn(0x7fcdb40b07d0 0x7fcdb40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb37fe700 1 -- 172.21.15.7:0/303219980 >> v1:172.21.15.148:6789/0 conn(0x7fcdb40cf200 legacy=0x7fcdb406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb37fe700 1 -- 172.21.15.7:0/303219980 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb406db30 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb2ffd700 1 --2- 172.21.15.7:0/303219980 >> v2:172.21.15.148:3300/0 conn(0x7fcdb40b07d0 0x7fcdb40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:46.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb37fe700 1 --2- 172.21.15.7:0/303219980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40c42c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4064720 tx=0x7fcda4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7540a09af6df7e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb1ffb700 1 -- 172.21.15.7:0/303219980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400e070 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb1ffb700 1 -- 172.21.15.7:0/303219980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400ba50 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb1ffb700 1 -- 172.21.15.7:0/303219980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40092e0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb9598700 1 -- 172.21.15.7:0/303219980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 msgr2=0x7fcdb40c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb9598700 1 --2- 172.21.15.7:0/303219980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40c42c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4064720 tx=0x7fcda4009840 comp rx=0 tx=0).stop 2023-10-14T19:14:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb9598700 1 -- 172.21.15.7:0/303219980 shutdown_connections 2023-10-14T19:14:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb9598700 1 --2- 172.21.15.7:0/303219980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40c42c0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.903+0000 7fcdb9598700 1 --2- 172.21.15.7:0/303219980 >> v2:172.21.15.148:3300/0 conn(0x7fcdb40b07d0 0x7fcdb40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.904+0000 7fcdb9598700 1 -- 172.21.15.7:0/303219980 >> 172.21.15.7:0/303219980 conn(0x7fcdb406ce80 msgr2=0x7fcdb40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.904+0000 7fcdb9598700 1 -- 172.21.15.7:0/303219980 shutdown_connections 2023-10-14T19:14:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.904+0000 7fcdb9598700 1 -- 172.21.15.7:0/303219980 wait complete. 2023-10-14T19:14:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.905+0000 7fcdb9598700 1 Processor -- start 2023-10-14T19:14:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.905+0000 7fcdb9598700 1 -- start start 2023-10-14T19:14:46.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.905+0000 7fcdb9598700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb40b07d0 0x7fcdb416a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb40cf200 0x7fcdb40cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb416aac0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb416d900 con 0x7fcdb40b07d0 2023-10-14T19:14:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4140750 con 0x7fcdb40cf200 2023-10-14T19:14:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51736/0 (socket says 172.21.15.7:51736) 2023-10-14T19:14:46.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 -- 172.21.15.7:0/3996472105 learned_addr learned my addr 172.21.15.7:0/3996472105 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:46.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb2ffd700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb40b07d0 0x7fcdb416a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb37fe700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb40cf200 0x7fcdb40cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 -- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb40cf200 msgr2=0x7fcdb40cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb40cf200 0x7fcdb40cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 -- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb40b07d0 msgr2=0x7fcdb416a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb40b07d0 0x7fcdb416a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 -- 172.21.15.7:0/3996472105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4009ae0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb27fc700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40cdd20 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00c590 tx=0x7fcd9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011590 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0116f0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb4155970 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011ab0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.906+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb416d590 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.907+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb416d110 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.908+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcd9c01b3b0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.908+0000 7fcdaaffd700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd94067320 0x7fcd940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.908+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcd9c083eb0 con 0x7fcdb40b0ba0 2023-10-14T19:14:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.908+0000 7fcdb2ffd700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd94067320 0x7fcd940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.909+0000 7fcdb2ffd700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd94067320 0x7fcd940697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcdac006ea0 tx=0x7fcdac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:46.913+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdb416d110 con 0x7fcdb40b0ba0 2023-10-14T19:14:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.106+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdb416d110 con 0x7fcd94067320 2023-10-14T19:14:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.107+0000 7fcdaaffd700 1 -- 172.21.15.7:0/3996472105 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcdb416d110 con 0x7fcd94067320 2023-10-14T19:14:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd94067320 msgr2=0x7fcd940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd94067320 0x7fcd940697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcdac006ea0 tx=0x7fcdac008040 comp rx=0 tx=0).stop 2023-10-14T19:14:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 msgr2=0x7fcdb40cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40cdd20 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00c590 tx=0x7fcd9c00c950 comp rx=0 tx=0).stop 2023-10-14T19:14:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 shutdown_connections 2023-10-14T19:14:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fcd94067320 0x7fcd940697d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb40b07d0 0x7fcdb416a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb40cf200 0x7fcdb40cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 --2- 172.21.15.7:0/3996472105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdb40b0ba0 0x7fcdb40cdd20 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 >> 172.21.15.7:0/3996472105 conn(0x7fcdb406ce80 msgr2=0x7fcdb40694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 shutdown_connections 2023-10-14T19:14:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.109+0000 7fcdb9598700 1 -- 172.21.15.7:0/3996472105 wait complete. 2023-10-14T19:14:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T19:14:47.121 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T19:14:47.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.245+0000 7f5497851700 1 Processor -- start 2023-10-14T19:14:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.245+0000 7f5497851700 1 -- start start 2023-10-14T19:14:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5497851700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5490067e50 0x7f549015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5497851700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54900c8c70 0x7f54900c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5497851700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549015d9f0 con 0x7f5490068220 2023-10-14T19:14:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5497851700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549015d3c0 con 0x7f5490067e50 2023-10-14T19:14:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5497851700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549015a8f0 con 0x7f54900c8c70 2023-10-14T19:14:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f54955ed700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5490067e50 0x7f549015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5494dec700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5490068220 0x7f5490159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50746/0 (socket says 172.21.15.7:50746) 2023-10-14T19:14:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5494dec700 1 -- 172.21.15.7:0/1708838671 learned_addr learned my addr 172.21.15.7:0/1708838671 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.246+0000 7f5495dee700 1 --2- 172.21.15.7:0/1708838671 >> v2:172.21.15.148:3300/0 conn(0x7f54900c8c70 0x7f54900c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f54955ed700 1 -- 172.21.15.7:0/1708838671 >> v2:172.21.15.148:3300/0 conn(0x7f54900c8c70 msgr2=0x7f54900c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f54955ed700 1 --2- 172.21.15.7:0/1708838671 >> v2:172.21.15.148:3300/0 conn(0x7f54900c8c70 0x7f54900c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f54955ed700 1 -- 172.21.15.7:0/1708838671 >> v1:172.21.15.7:6789/0 conn(0x7f5490068220 legacy=0x7f5490159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f54955ed700 1 -- 172.21.15.7:0/1708838671 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549015abd0 con 0x7f5490067e50 2023-10-14T19:14:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5495dee700 1 --2- 172.21.15.7:0/1708838671 >> v2:172.21.15.148:3300/0 conn(0x7f54900c8c70 0x7f54900c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f54955ed700 1 --2- 172.21.15.7:0/1708838671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5490067e50 0x7f549015de80 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f54900c1da0 tx=0x7f54880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3354a71d27fcdd55 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f548ffff700 1 -- 172.21.15.7:0/1708838671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800b6b0 con 0x7f5490067e50 2023-10-14T19:14:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f548ffff700 1 -- 172.21.15.7:0/1708838671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800b810 con 0x7f5490067e50 2023-10-14T19:14:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f548ffff700 1 -- 172.21.15.7:0/1708838671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800bbb0 con 0x7f5490067e50 2023-10-14T19:14:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5497851700 1 -- 172.21.15.7:0/1708838671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5490067e50 msgr2=0x7f549015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5497851700 1 --2- 172.21.15.7:0/1708838671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5490067e50 0x7f549015de80 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f54900c1da0 tx=0x7f54880091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5497851700 1 -- 172.21.15.7:0/1708838671 shutdown_connections 2023-10-14T19:14:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5497851700 1 --2- 172.21.15.7:0/1708838671 >> v2:172.21.15.148:3300/0 conn(0x7f54900c8c70 0x7f54900c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5497851700 1 --2- 172.21.15.7:0/1708838671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5490067e50 0x7f549015de80 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.247+0000 7f5497851700 1 -- 172.21.15.7:0/1708838671 >> 172.21.15.7:0/1708838671 conn(0x7f54900ce4a0 msgr2=0x7f54900ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.248+0000 7f5497851700 1 -- 172.21.15.7:0/1708838671 shutdown_connections 2023-10-14T19:14:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.248+0000 7f5497851700 1 -- 172.21.15.7:0/1708838671 wait complete. 2023-10-14T19:14:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.249+0000 7f5497851700 1 Processor -- start 2023-10-14T19:14:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.249+0000 7f5497851700 1 -- start start 2023-10-14T19:14:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.249+0000 7f5497851700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5490067e50 0x7f5490148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.249+0000 7f5497851700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5490068220 0x7f5490169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5497851700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54900c8c70 0x7f54900b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5497851700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b1380 con 0x7f54900c8c70 2023-10-14T19:14:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5497851700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549016a2b0 con 0x7f5490067e50 2023-10-14T19:14:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5497851700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549016a590 con 0x7f5490068220 2023-10-14T19:14:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54900c8c70 0x7f54900b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54900c8c70 0x7f54900b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51758/0 (socket says 172.21.15.7:51758) 2023-10-14T19:14:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 -- 172.21.15.7:0/528726701 learned_addr learned my addr 172.21.15.7:0/528726701 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f54955ed700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5490067e50 0x7f5490148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5494dec700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5490068220 0x7f5490169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 -- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5490068220 msgr2=0x7f5490169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5490068220 0x7f5490169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 -- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5490067e50 msgr2=0x7f5490148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5490067e50 0x7f5490148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 -- 172.21.15.7:0/528726701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009420 con 0x7f54900c8c70 2023-10-14T19:14:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5494dec700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5490068220 0x7f5490169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5495dee700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54900c8c70 0x7f54900b3400 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f548000a380 tx=0x7f5480007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480015440 con 0x7f54900c8c70 2023-10-14T19:14:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54800155a0 con 0x7f54900c8c70 2023-10-14T19:14:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480015960 con 0x7f54900c8c70 2023-10-14T19:14:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549016a870 con 0x7f54900c8c70 2023-10-14T19:14:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.250+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900b3940 con 0x7f54900c8c70 2023-10-14T19:14:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.251+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f549004c3c0 con 0x7f54900c8c70 2023-10-14T19:14:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.252+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f548000d440 con 0x7f54900c8c70 2023-10-14T19:14:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.252+0000 7f548d7fa700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f547c067320 0x7f547c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.252+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5480085540 con 0x7f54900c8c70 2023-10-14T19:14:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.252+0000 7f548d7fa700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7f547c06d170 0x7f547c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.252+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 --> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f547c06fc50 con 0x7f547c06d170 2023-10-14T19:14:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.252+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54800879f0 con 0x7f54900c8c70 2023-10-14T19:14:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.253+0000 7f54955ed700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f547c067320 0x7f547c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.253+0000 7f5494dec700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7f547c06d170 0x7f547c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.253+0000 7f54955ed700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f547c067320 0x7f547c0697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f54880093f0 tx=0x7f5488017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.253+0000 7f5494dec700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7f547c06d170 0x7f547c06f580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.254+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== osd.6 v2:172.21.15.148:6824/91145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f547c06fc50 con 0x7f547c06d170 2023-10-14T19:14:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.268+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 --> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f549015d680 con 0x7f547c06d170 2023-10-14T19:14:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.268+0000 7f548d7fa700 1 -- 172.21.15.7:0/528726701 <== osd.6 v2:172.21.15.148:6824/91145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f549015d680 con 0x7f547c06d170 2023-10-14T19:14:47.274 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:47.274 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:47.275 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.268+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7f547c06d170 msgr2=0x7f547c06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.268+0000 7f5497851700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6824/91145,v1:172.21.15.148:6825/91145] conn(0x7f547c06d170 0x7f547c06f580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f547c067320 msgr2=0x7f547c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f547c067320 0x7f547c0697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f54880093f0 tx=0x7f5488017000 comp rx=0 tx=0).stop 2023-10-14T19:14:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54900c8c70 msgr2=0x7f54900b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 --2- 172.21.15.7:0/528726701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54900c8c70 0x7f54900b3400 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f548000a380 tx=0x7f5480007900 comp rx=0 tx=0).stop 2023-10-14T19:14:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5495dee700 1 -- 172.21.15.7:0/528726701 reap_dead start 2023-10-14T19:14:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 shutdown_connections 2023-10-14T19:14:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 >> 172.21.15.7:0/528726701 conn(0x7f54900ce4a0 msgr2=0x7f54900cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 shutdown_connections 2023-10-14T19:14:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.269+0000 7f5497851700 1 -- 172.21.15.7:0/528726701 wait complete. 2023-10-14T19:14:47.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T19:14:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.401+0000 7f5b8359e700 1 Processor -- start 2023-10-14T19:14:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.401+0000 7f5b8359e700 1 -- start start 2023-10-14T19:14:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b8359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b840ccac0 0x7f5b840cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b8359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b840cbe30 0x7f5b840a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b8359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b840cb460 con 0x7f5b8406c8f0 2023-10-14T19:14:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b8359e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b840cb180 con 0x7f5b840ccac0 2023-10-14T19:14:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b8359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8415db00 con 0x7f5b840cbe30 2023-10-14T19:14:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b840ccac0 0x7f5b840cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b840ccac0 0x7f5b840cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51766/0 (socket says 172.21.15.7:51766) 2023-10-14T19:14:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 -- 172.21.15.7:0/3076822515 learned_addr learned my addr 172.21.15.7:0/3076822515 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b82d9d700 1 --2- 172.21.15.7:0/3076822515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b840cbe30 0x7f5b840a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 -- 172.21.15.7:0/3076822515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b840cbe30 msgr2=0x7f5b840a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 --2- 172.21.15.7:0/3076822515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b840cbe30 0x7f5b840a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 -- 172.21.15.7:0/3076822515 >> v1:172.21.15.148:6789/0 conn(0x7f5b8406c8f0 legacy=0x7f5b8415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.402+0000 7f5b81d9b700 1 -- 172.21.15.7:0/3076822515 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8415dde0 con 0x7f5b840ccac0 2023-10-14T19:14:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b81d9b700 1 --2- 172.21.15.7:0/3076822515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b840cb8f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0099b0 tx=0x7f5b6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fd7d5b506f2bf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8159a700 1 -- 172.21.15.7:0/3076822515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00b860 con 0x7f5b840ccac0 2023-10-14T19:14:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8159a700 1 -- 172.21.15.7:0/3076822515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00b9c0 con 0x7f5b840ccac0 2023-10-14T19:14:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8159a700 1 -- 172.21.15.7:0/3076822515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00bd60 con 0x7f5b840ccac0 2023-10-14T19:14:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 -- 172.21.15.7:0/3076822515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 msgr2=0x7f5b840cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3076822515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b840cb8f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0099b0 tx=0x7f5b6c009250 comp rx=0 tx=0).stop 2023-10-14T19:14:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 -- 172.21.15.7:0/3076822515 shutdown_connections 2023-10-14T19:14:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3076822515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b840cbe30 0x7f5b840a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3076822515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b840cb8f0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 -- 172.21.15.7:0/3076822515 >> 172.21.15.7:0/3076822515 conn(0x7f5b8406e280 msgr2=0x7f5b840cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 -- 172.21.15.7:0/3076822515 shutdown_connections 2023-10-14T19:14:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.403+0000 7f5b8359e700 1 -- 172.21.15.7:0/3076822515 wait complete. 2023-10-14T19:14:47.414 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 Processor -- start 2023-10-14T19:14:47.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 -- start start 2023-10-14T19:14:47.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b8406c8f0 0x7f5b840ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b840cbe30 0x7f5b8414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.415 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b8414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c4310 con 0x7f5b840ccac0 2023-10-14T19:14:47.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8416df00 con 0x7f5b840cbe30 2023-10-14T19:14:47.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c4520 con 0x7f5b8406c8f0 2023-10-14T19:14:47.416 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b82d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b8414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b82d9d700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b8414fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51770/0 (socket says 172.21.15.7:51770) 2023-10-14T19:14:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b82d9d700 1 -- 172.21.15.7:0/3208920820 learned_addr learned my addr 172.21.15.7:0/3208920820 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.405+0000 7f5b8259c700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b8406c8f0 0x7f5b840ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b81d9b700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b840cbe30 0x7f5b8414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b82d9d700 1 -- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b8406c8f0 msgr2=0x7f5b840ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b82d9d700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b8406c8f0 0x7f5b840ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b82d9d700 1 -- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b840cbe30 msgr2=0x7f5b8414f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b82d9d700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b840cbe30 0x7f5b8414f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b82d9d700 1 -- 172.21.15.7:0/3208920820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0094f0 con 0x7f5b840ccac0 2023-10-14T19:14:47.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b82d9d700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b8414fcb0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00d890 tx=0x7f5b7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.419 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0125f0 con 0x7f5b840ccac0 2023-10-14T19:14:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c012770 con 0x7f5b840ccac0 2023-10-14T19:14:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b840c4800 con 0x7f5b840ccac0 2023-10-14T19:14:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c012b30 con 0x7f5b840ccac0 2023-10-14T19:14:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.406+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8414d150 con 0x7f5b840ccac0 2023-10-14T19:14:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.407+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b840c4d20 con 0x7f5b840ccac0 2023-10-14T19:14:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.408+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5b7c01e460 con 0x7f5b840ccac0 2023-10-14T19:14:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.408+0000 7f5b7a7fc700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b64067320 0x7f5b640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.408+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5b7c084ec0 con 0x7f5b840ccac0 2023-10-14T19:14:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.408+0000 7f5b8259c700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b64067320 0x7f5b640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.409+0000 7f5b8259c700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b64067320 0x7f5b640697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5b74007fd0 tx=0x7f5b740016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.412+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b840c4d20 con 0x7f5b840ccac0 2023-10-14T19:14:47.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.606+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b8414d310 con 0x7f5b64067320 2023-10-14T19:14:47.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.607+0000 7f5b7a7fc700 1 -- 172.21.15.7:0/3208920820 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5b8414d310 con 0x7f5b64067320 2023-10-14T19:14:47.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b64067320 msgr2=0x7f5b640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b64067320 0x7f5b640697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5b74007fd0 tx=0x7f5b740016f0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 msgr2=0x7f5b8414fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b8414fcb0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00d890 tx=0x7f5b7c008040 comp rx=0 tx=0).stop 2023-10-14T19:14:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 shutdown_connections 2023-10-14T19:14:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5b64067320 0x7f5b640697d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b840ccac0 0x7f5b8414fcb0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5b8406c8f0 0x7f5b840ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 --2- 172.21.15.7:0/3208920820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b840cbe30 0x7f5b8414f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 >> 172.21.15.7:0/3208920820 conn(0x7f5b8406e280 msgr2=0x7f5b8415b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 shutdown_connections 2023-10-14T19:14:47.613 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.609+0000 7f5b8359e700 1 -- 172.21.15.7:0/3208920820 wait complete. 2023-10-14T19:14:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T19:14:47.621 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T19:14:47.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T19:14:47.745 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.744+0000 7f576b292700 1 Processor -- start 2023-10-14T19:14:47.746 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.745+0000 7f576b292700 1 -- start start 2023-10-14T19:14:47.748 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.745+0000 7f576b292700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.745+0000 7f576b292700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57640b04f0 0x7f57640cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.745+0000 7f576b292700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640cf330 con 0x7f57640cd5a0 2023-10-14T19:14:47.749 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.745+0000 7f576b292700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640cead0 con 0x7f57640b04f0 2023-10-14T19:14:47.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.745+0000 7f576b292700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640cddd0 con 0x7f57640cb880 2023-10-14T19:14:47.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57640b04f0 0x7f57640cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.750 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57640b04f0 0x7f57640cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51774/0 (socket says 172.21.15.7:51774) 2023-10-14T19:14:47.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 -- 172.21.15.7:0/3364058904 learned_addr learned my addr 172.21.15.7:0/3364058904 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576902e700 1 --2- 172.21.15.7:0/3364058904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.751 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 -- 172.21.15.7:0/3364058904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 msgr2=0x7f57640cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:47.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 --2- 172.21.15.7:0/3364058904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 -- 172.21.15.7:0/3364058904 >> v1:172.21.15.148:6789/0 conn(0x7f57640cd5a0 legacy=0x7f57641591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.752 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 -- 172.21.15.7:0/3364058904 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640cece0 con 0x7f57640b04f0 2023-10-14T19:14:47.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f576882d700 1 --2- 172.21.15.7:0/3364058904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f57640cd060 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f57580099b0 tx=0x7f5758009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6adde9a47500a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f5763fff700 1 -- 172.21.15.7:0/3364058904 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758009ea0 con 0x7f57640b04f0 2023-10-14T19:14:47.753 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f5763fff700 1 -- 172.21.15.7:0/3364058904 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800b860 con 0x7f57640b04f0 2023-10-14T19:14:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.746+0000 7f5763fff700 1 -- 172.21.15.7:0/3364058904 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800bc00 con 0x7f57640b04f0 2023-10-14T19:14:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 -- 172.21.15.7:0/3364058904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 msgr2=0x7f57640cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 --2- 172.21.15.7:0/3364058904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f57640cd060 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f57580099b0 tx=0x7f5758009250 comp rx=0 tx=0).stop 2023-10-14T19:14:47.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 -- 172.21.15.7:0/3364058904 shutdown_connections 2023-10-14T19:14:47.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 --2- 172.21.15.7:0/3364058904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 --2- 172.21.15.7:0/3364058904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f57640cd060 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.755 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 -- 172.21.15.7:0/3364058904 >> 172.21.15.7:0/3364058904 conn(0x7f57640703a0 msgr2=0x7f57640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 -- 172.21.15.7:0/3364058904 shutdown_connections 2023-10-14T19:14:47.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.747+0000 7f576b292700 1 -- 172.21.15.7:0/3364058904 wait complete. 2023-10-14T19:14:47.756 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.748+0000 7f576b292700 1 Processor -- start 2023-10-14T19:14:47.757 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.748+0000 7f576b292700 1 -- start start 2023-10-14T19:14:47.760 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576b292700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f5764146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576b292700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576b292700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57640cd5a0 0x7f57640c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.761 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576b292700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b60a0 con 0x7f57640b04f0 2023-10-14T19:14:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576b292700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b5c10 con 0x7f57640cd5a0 2023-10-14T19:14:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576b292700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b5000 con 0x7f57640cb880 2023-10-14T19:14:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f5764146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f5764146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51776/0 (socket says 172.21.15.7:51776) 2023-10-14T19:14:47.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 -- 172.21.15.7:0/2185212938 learned_addr learned my addr 172.21.15.7:0/2185212938 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576882d700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.763 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576982f700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57640cd5a0 0x7f57640c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 -- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 msgr2=0x7f57640c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 -- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57640cd5a0 msgr2=0x7f57640c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57640cd5a0 0x7f57640c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576902e700 1 -- 172.21.15.7:0/2185212938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580094f0 con 0x7f57640b04f0 2023-10-14T19:14:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.749+0000 7f576882d700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57640cb880 0x7f57640c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.750+0000 7f576902e700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f5764146fd0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f5754009ef0 tx=0x7f575400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.750+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400cc50 con 0x7f57640b04f0 2023-10-14T19:14:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.750+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400f040 con 0x7f57640b04f0 2023-10-14T19:14:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.750+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754014480 con 0x7f57640b04f0 2023-10-14T19:14:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.750+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57640b52e0 con 0x7f57640b04f0 2023-10-14T19:14:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.750+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57640b58a0 con 0x7f57640b04f0 2023-10-14T19:14:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.751+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f576404c3c0 con 0x7f57640b04f0 2023-10-14T19:14:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.751+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f57540147f0 con 0x7f57640b04f0 2023-10-14T19:14:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.751+0000 7f57617fa700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5750067320 0x7f57500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5754085530 con 0x7f57640b04f0 2023-10-14T19:14:47.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f576882d700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5750067320 0x7f57500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.768 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f57617fa700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7f575006d170 0x7f575006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 --> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f575006fc50 con 0x7f575006d170 2023-10-14T19:14:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5754087a30 con 0x7f57640b04f0 2023-10-14T19:14:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f576982f700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7f575006d170 0x7f575006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f576882d700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5750067320 0x7f57500697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f57580099b0 tx=0x7f5758017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.752+0000 7f576982f700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7f575006d170 0x7f575006f580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.770 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.753+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== osd.7 v2:172.21.15.148:6816/91110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f575006fc50 con 0x7f575006d170 2023-10-14T19:14:47.771 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.767+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 --> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57640ce680 con 0x7f575006d170 2023-10-14T19:14:47.772 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.767+0000 7f57617fa700 1 -- 172.21.15.7:0/2185212938 <== osd.7 v2:172.21.15.148:6816/91110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57640ce680 con 0x7f575006d170 2023-10-14T19:14:47.772 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-10-14T19:14:47.773 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T19:14:47.773 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-10-14T19:14:47.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7f575006d170 msgr2=0x7f575006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.774 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6816/91110,v1:172.21.15.148:6817/91110] conn(0x7f575006d170 0x7f575006f580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5750067320 msgr2=0x7f57500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f5750067320 0x7f57500697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f57580099b0 tx=0x7f5758017000 comp rx=0 tx=0).stop 2023-10-14T19:14:47.775 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 msgr2=0x7f5764146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 --2- 172.21.15.7:0/2185212938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57640b04f0 0x7f5764146fd0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f5754009ef0 tx=0x7f575400b040 comp rx=0 tx=0).stop 2023-10-14T19:14:47.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576982f700 1 -- 172.21.15.7:0/2185212938 reap_dead start 2023-10-14T19:14:47.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 shutdown_connections 2023-10-14T19:14:47.776 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 >> 172.21.15.7:0/2185212938 conn(0x7f57640703a0 msgr2=0x7f576406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 shutdown_connections 2023-10-14T19:14:47.777 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.768+0000 7f576b292700 1 -- 172.21.15.7:0/2185212938 wait complete. 2023-10-14T19:14:47.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T19:14:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.901+0000 7f18072e5700 1 Processor -- start 2023-10-14T19:14:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.901+0000 7f18072e5700 1 -- start start 2023-10-14T19:14:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.902+0000 7f18072e5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1800140e50 0x7f18000af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.902+0000 7f18072e5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f180015b920 0x7f18000cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.902+0000 7f18072e5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1800158000 con 0x7f18000af560 2023-10-14T19:14:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.902+0000 7f18072e5700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cb4d0 con 0x7f1800140e50 2023-10-14T19:14:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.902+0000 7f18072e5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cbd10 con 0x7f180015b920 2023-10-14T19:14:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1800140e50 0x7f18000af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1800140e50 0x7f18000af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51784/0 (socket says 172.21.15.7:51784) 2023-10-14T19:14:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 -- 172.21.15.7:0/2602818354 learned_addr learned my addr 172.21.15.7:0/2602818354 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805882700 1 --2- 172.21.15.7:0/2602818354 >> v2:172.21.15.148:3300/0 conn(0x7f180015b920 0x7f18000cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 -- 172.21.15.7:0/2602818354 >> v2:172.21.15.148:3300/0 conn(0x7f180015b920 msgr2=0x7f18000cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 --2- 172.21.15.7:0/2602818354 >> v2:172.21.15.148:3300/0 conn(0x7f180015b920 0x7f18000cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 -- 172.21.15.7:0/2602818354 >> v1:172.21.15.148:6789/0 conn(0x7f18000af560 legacy=0x7f180015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 -- 172.21.15.7:0/2602818354 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000af9b0 con 0x7f1800140e50 2023-10-14T19:14:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805882700 1 --2- 172.21.15.7:0/2602818354 >> v2:172.21.15.148:3300/0 conn(0x7f180015b920 0x7f18000cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f1805081700 1 --2- 172.21.15.7:0/2602818354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f18000af020 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f180015b140 tx=0x7f17fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c67c0b5cd9d4296 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f17f7fff700 1 -- 172.21.15.7:0/2602818354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00b860 con 0x7f1800140e50 2023-10-14T19:14:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f17f7fff700 1 -- 172.21.15.7:0/2602818354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc00b9c0 con 0x7f1800140e50 2023-10-14T19:14:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.903+0000 7f17f7fff700 1 -- 172.21.15.7:0/2602818354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00bd60 con 0x7f1800140e50 2023-10-14T19:14:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 -- 172.21.15.7:0/2602818354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 msgr2=0x7f18000af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 --2- 172.21.15.7:0/2602818354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f18000af020 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f180015b140 tx=0x7f17fc009250 comp rx=0 tx=0).stop 2023-10-14T19:14:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 -- 172.21.15.7:0/2602818354 shutdown_connections 2023-10-14T19:14:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 --2- 172.21.15.7:0/2602818354 >> v2:172.21.15.148:3300/0 conn(0x7f180015b920 0x7f18000cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 --2- 172.21.15.7:0/2602818354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f18000af020 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 -- 172.21.15.7:0/2602818354 >> 172.21.15.7:0/2602818354 conn(0x7f18000cded0 msgr2=0x7f180006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:47.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 -- 172.21.15.7:0/2602818354 shutdown_connections 2023-10-14T19:14:47.912 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.904+0000 7f18072e5700 1 -- 172.21.15.7:0/2602818354 wait complete. 2023-10-14T19:14:47.915 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.905+0000 7f18072e5700 1 Processor -- start 2023-10-14T19:14:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.905+0000 7f18072e5700 1 -- start start 2023-10-14T19:14:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f18072e5700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18000af560 0x7f18000c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f18072e5700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f1800169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f18072e5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180015b920 0x7f180016a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f18072e5700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000ae490 con 0x7f1800140e50 2023-10-14T19:14:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f18072e5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000ad8c0 con 0x7f180015b920 2023-10-14T19:14:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f18072e5700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000adb60 con 0x7f18000af560 2023-10-14T19:14:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f1800169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f1800169da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51788/0 (socket says 172.21.15.7:51788) 2023-10-14T19:14:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 -- 172.21.15.7:0/3554592722 learned_addr learned my addr 172.21.15.7:0/3554592722 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1805081700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18000af560 0x7f18000c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1805882700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180015b920 0x7f180016a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.919 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 -- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18000af560 msgr2=0x7f18000c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18000af560 0x7f18000c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 -- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180015b920 msgr2=0x7f180016a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180015b920 0x7f180016a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:47.920 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1804880700 1 -- 172.21.15.7:0/3554592722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc0094f0 con 0x7f1800140e50 2023-10-14T19:14:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.906+0000 7f1805081700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18000af560 0x7f18000c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:14:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.907+0000 7f1804880700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f1800169da0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c590 tx=0x7f17f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.921 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.907+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0011590 con 0x7f1800140e50 2023-10-14T19:14:47.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.907+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00116f0 con 0x7f1800140e50 2023-10-14T19:14:47.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.907+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000ade40 con 0x7f1800140e50 2023-10-14T19:14:47.922 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.907+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0011ab0 con 0x7f1800140e50 2023-10-14T19:14:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.907+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18000b30e0 con 0x7f1800140e50 2023-10-14T19:14:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.908+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180004c3c0 con 0x7f1800140e50 2023-10-14T19:14:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.908+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f17f001b3b0 con 0x7f1800140e50 2023-10-14T19:14:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.908+0000 7f17f57fa700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f17e4067320 0x7f17e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.909+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f17f0083f20 con 0x7f1800140e50 2023-10-14T19:14:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.909+0000 7f1805081700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f17e4067320 0x7f17e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.909+0000 7f1805081700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f17e4067320 0x7f17e40697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f180015b140 tx=0x7f17fc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:47.925 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:47.913+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17f0050eb0 con 0x7f1800140e50 2023-10-14T19:14:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.106+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f180015be20 con 0x7f17e4067320 2023-10-14T19:14:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.107+0000 7f17f57fa700 1 -- 172.21.15.7:0/3554592722 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f180015be20 con 0x7f17e4067320 2023-10-14T19:14:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f17e4067320 msgr2=0x7f17e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f17e4067320 0x7f17e40697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f180015b140 tx=0x7f17fc017000 comp rx=0 tx=0).stop 2023-10-14T19:14:48.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 msgr2=0x7f1800169da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f1800169da0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c590 tx=0x7f17f000c950 comp rx=0 tx=0).stop 2023-10-14T19:14:48.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 shutdown_connections 2023-10-14T19:14:48.111 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f17e4067320 0x7f17e40697d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180015b920 0x7f180016a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18000af560 0x7f18000c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.112 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 --2- 172.21.15.7:0/3554592722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1800140e50 0x7f1800169da0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 >> 172.21.15.7:0/3554592722 conn(0x7f18000cded0 msgr2=0x7f180013dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 shutdown_connections 2023-10-14T19:14:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.109+0000 7f18072e5700 1 -- 172.21.15.7:0/3554592722 wait complete. 2023-10-14T19:14:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T19:14:48.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:14:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.241+0000 7f006e9a2700 1 Processor -- start 2023-10-14T19:14:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.241+0000 7f006e9a2700 1 -- start start 2023-10-14T19:14:48.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e9a2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 0x7f006815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e9a2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00680ccac0 0x7f00680cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.246 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e9a2700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00680cb460 con 0x7f00680cbe30 2023-10-14T19:14:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e9a2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00680cb180 con 0x7f00680ccac0 2023-10-14T19:14:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e9a2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006815db00 con 0x7f006806c8f0 2023-10-14T19:14:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e1a1700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00680cbe30 0x7f00680a98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50750/0 (socket says 172.21.15.7:50750) 2023-10-14T19:14:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006e1a1700 1 -- 172.21.15.7:0/1711187117 learned_addr learned my addr 172.21.15.7:0/1711187117 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:14:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006d9a0700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 0x7f006815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006d19f700 1 --2- 172.21.15.7:0/1711187117 >> v2:172.21.15.148:3300/0 conn(0x7f00680ccac0 0x7f00680cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115893175 0 0) 0x7f00680cb460 con 0x7f00680cbe30 2023-10-14T19:14:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0054003570 con 0x7f00680cbe30 2023-10-14T19:14:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 77312304 0 0) 0x7f0054003570 con 0x7f00680cbe30 2023-10-14T19:14:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 msgr2=0x7f006815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 0x7f006815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 >> v2:172.21.15.148:3300/0 conn(0x7f00680ccac0 msgr2=0x7f00680cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 --2- 172.21.15.7:0/1711187117 >> v2:172.21.15.148:3300/0 conn(0x7f00680ccac0 0x7f00680cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006815dde0 con 0x7f00680cbe30 2023-10-14T19:14:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 58483587 0 0) 0x7f00600017f0 con 0x7f00680cbe30 2023-10-14T19:14:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 >> v1:172.21.15.7:6789/0 conn(0x7f00680cbe30 legacy=0x7f00680a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054003a60 0x7f0054003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.242+0000 7f006c99e700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054004810 0x7f0054004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 0x7f00540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680cb180 con 0x7f0054004810 2023-10-14T19:14:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006815db00 con 0x7f0054003a60 2023-10-14T19:14:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005400ba60 con 0x7f006806c8f0 2023-10-14T19:14:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054004810 0x7f0054004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d9a0700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054003a60 0x7f0054003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006e1a1700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 0x7f00540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 -- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 msgr2=0x7f00540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006806c8f0 0x7f00540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 -- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054003a60 msgr2=0x7f0054003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:14:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054003a60 0x7f0054003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 -- 172.21.15.7:0/1711187117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054003570 con 0x7f0054004810 2023-10-14T19:14:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006d19f700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054004810 0x7f0054004c80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f0058009c30 tx=0x7f00580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442937af4b69f219 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800e710 con 0x7f0054004810 2023-10-14T19:14:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800e870 con 0x7f0054004810 2023-10-14T19:14:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.243+0000 7f006c99e700 1 -- 172.21.15.7:0/1711187117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800ec30 con 0x7f0054004810 2023-10-14T19:14:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e9a2700 1 -- 172.21.15.7:0/1711187117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054004810 msgr2=0x7f0054004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1711187117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054004810 0x7f0054004c80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f0058009c30 tx=0x7f00580091a0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e1a1700 1 -- 172.21.15.7:0/1711187117 reap_dead start 2023-10-14T19:14:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e9a2700 1 -- 172.21.15.7:0/1711187117 shutdown_connections 2023-10-14T19:14:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e9a2700 1 -- 172.21.15.7:0/1711187117 >> 172.21.15.7:0/1711187117 conn(0x7f006806e280 msgr2=0x7f00680cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e9a2700 1 -- 172.21.15.7:0/1711187117 shutdown_connections 2023-10-14T19:14:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.244+0000 7f006e9a2700 1 -- 172.21.15.7:0/1711187117 wait complete. 2023-10-14T19:14:48.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.245+0000 7f006e9a2700 1 Processor -- start 2023-10-14T19:14:48.259 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.245+0000 7f006e9a2700 1 -- start start 2023-10-14T19:14:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054004810 0x7f006815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006815b300 0x7f00680c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 0x7f006806af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c6f90 con 0x7f006806ab00 2023-10-14T19:14:48.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006806b4b0 con 0x7f0054004810 2023-10-14T19:14:48.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c60c0 con 0x7f006815b300 2023-10-14T19:14:48.263 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 0x7f006806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 0x7f006806af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51802/0 (socket says 172.21.15.7:51802) 2023-10-14T19:14:48.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 -- 172.21.15.7:0/1261727754 learned_addr learned my addr 172.21.15.7:0/1261727754 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:14:48.264 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006d9a0700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054004810 0x7f006815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006d19f700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006815b300 0x7f00680c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 -- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006815b300 msgr2=0x7f00680c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006815b300 0x7f00680c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 -- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054004810 msgr2=0x7f006815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054004810 0x7f006815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 -- 172.21.15.7:0/1261727754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680acb30 con 0x7f006806ab00 2023-10-14T19:14:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006d9a0700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054004810 0x7f006815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:48.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006d19f700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006815b300 0x7f00680c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T19:14:48.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e1a1700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 0x7f006806af70 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f00680ce340 tx=0x7f0060002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:48.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600017d0 con 0x7f006806ab00 2023-10-14T19:14:48.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006000ad80 con 0x7f006806ab00 2023-10-14T19:14:48.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060013620 con 0x7f006806ab00 2023-10-14T19:14:48.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.246+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006816d950 con 0x7f006806ab00 2023-10-14T19:14:48.268 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.247+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680c65f0 con 0x7f006806ab00 2023-10-14T19:14:48.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.248+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006804c3c0 con 0x7f006806ab00 2023-10-14T19:14:48.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.248+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0060013a10 con 0x7f006806ab00 2023-10-14T19:14:48.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.248+0000 7f005dffb700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f004c067320 0x7f004c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:14:48.269 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.249+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0060085490 con 0x7f006806ab00 2023-10-14T19:14:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.249+0000 7f006d9a0700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f004c067320 0x7f004c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:14:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.249+0000 7f006d9a0700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f004c067320 0x7f004c0697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0064006dc0 tx=0x7f0064008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:14:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.253+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0060052440 con 0x7f006806ab00 2023-10-14T19:14:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.440+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f006815e0c0 con 0x7f004c067320 2023-10-14T19:14:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.443+0000 7f005dffb700 1 -- 172.21.15.7:0/1261727754 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51047 (secure 0 0 0) 0x7f006815e0c0 con 0x7f004c067320 2023-10-14T19:14:48.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:14:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f004c067320 msgr2=0x7f004c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f004c067320 0x7f004c0697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0064006dc0 tx=0x7f0064008040 comp rx=0 tx=0).stop 2023-10-14T19:14:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 msgr2=0x7f006806af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:14:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 0x7f006806af70 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f00680ce340 tx=0x7f0060002210 comp rx=0 tx=0).stop 2023-10-14T19:14:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 shutdown_connections 2023-10-14T19:14:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f004c067320 0x7f004c0697d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0054004810 0x7f006815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f006806ab00 0x7f006806af70 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 --2- 172.21.15.7:0/1261727754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f006815b300 0x7f00680c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:14:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 >> 172.21.15.7:0/1261727754 conn(0x7f006806e280 msgr2=0x7f006815c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:14:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 shutdown_connections 2023-10-14T19:14:48.449 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:14:48.445+0000 7f006e9a2700 1 -- 172.21.15.7:0/1261727754 wait complete. 2023-10-14T19:14:48.449 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:14:48.457 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2023-10-14T19:14:47.791244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2440840,"kb_used_data":21576,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752533880,"statfs":{"total":773094113280,"available":770594693120,"internally_reserved":0,"allocated":22093824,"data_stored":10569616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.258945"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":315,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-10-14T19:14:38.648691+0000","last_change":"2023-10-14T19:03:05.460861+0000","last_active":"2023-10-14T19:14:38.648691+0000","last_peered":"2023-10-14T19:14:38.648691+0000","last_clean":"2023-10-14T19:14:38.648691+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:14:38.648691+0000","last_undegraded":"2023-10-14T19:14:38.648691+0000","last_fullsized":"2023-10-14T19:14:38.648691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T19:03:04.173936+0000","last_clean_scrub_stamp":"2023-10-14T19:03:04.173936+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:17.507521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1763978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":4.2080000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":3.1949999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53600000000000003,"15min":0.57299999999999995},"min":{"1min":0.50900000000000001,"5min":0.377,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.749,"15min":2.3610000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.86899999999999999,"15min":4.0679999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.626,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":3.23},"last":0.629}]},{"osd":3,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.36199999999999999,"15min":0.33500000000000002},"max":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":4.1269999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.69199999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":3.3450000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":2.4620000000000002},"last":0.433},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":4.5389999999999997},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.52900000000000003,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.84699999999999998,"15min":3.4119999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":2.883},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":0.81599999999999995,"15min":2.7130000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.69099999999999995},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.96699999999999997,"15min":5.383},"last":0.63900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.996,"15min":5.7030000000000003},"last":0.51800000000000002}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.42699999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":1.032,"15min":8.0210000000000008},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.67700000000000005},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.204,"15min":8.1890000000000001},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.36799999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51000000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308032,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063808,"statfs":{"total":96636764160,"available":96321339392,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.624},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.20399999999999999,"15min":0.20300000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.375},"min":{"1min":0.33400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.63200000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47199999999999998,"15min":0.42899999999999999},"min":{"1min":0.39200000000000002,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.432}]},{"osd":3,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.39700000000000002},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.86699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.36899999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.216},"max":{"1min":0.59099999999999997,"5min":0.873,"15min":0.873},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.032},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.373},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.0660000000000001,"15min":1.627},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.004,"15min":1.079},"last":0.78000000000000003}]},{"osd":7,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66200000000000003,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.5880000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.82399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308612,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063228,"statfs":{"total":96636764160,"available":96320745472,"internally_reserved":0,"allocated":3207168,"data_stored":1763978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53600000000000003,"5min":0.626,"15min":0.626},"last":0.38},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.36199999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.443}]},{"osd":2,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.34300000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.626,"15min":0.64700000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.56899999999999995,"5min":0.627,"15min":0.627},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.92900000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.56799999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.97599999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.98799999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.625},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.95599999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.497}]},{"osd":7,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.503,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.88200000000000001,"15min":0.92500000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.57599999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.96599999999999997},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29499999999999998,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.22,"15min":0.219},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":2.028},"last":0.26600000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":11.269},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.38700000000000001,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.221},"max":{"1min":0.53700000000000003,"5min":0.59599999999999997,"15min":11.318},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47199999999999998,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.26900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.376}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.997,"15min":0.997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":1.9299999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":1.9710000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64200000000000002,"15min":0.83099999999999996},"min":{"1min":0.48399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.028,"15min":11.379},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.83299999999999996},"min":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.98699999999999999,"15min":11.404},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0389999999999999},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.44400000000000001,"15min":0.41399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":2.0009999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":11.351000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.70099999999999996},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56799999999999995,"5min":0.68999999999999995,"15min":1.0629999999999999},"last":0.501}]},{"osd":2,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.438,"15min":0.41599999999999998},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.25900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.81000000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.45200000000000001},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.75600000000000001,"15min":1.1719999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.597},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.499,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.48999999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.36299999999999999},"max":{"1min":0.86599999999999999,"5min":0.87,"15min":1.214},"last":0.42699999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.133},"last":0.376},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89100000000000001,"15min":0.92300000000000004},"last":0.44}]},{"osd":7,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.97599999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.51100000000000001,"5min":0.41599999999999998,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.997},"last":0.52000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70499999999999996,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.89300000000000002,"15min":5.7830000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":1.2709999999999999,"15min":3.0659999999999998},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":1.589,"15min":1.589},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.378},"max":{"1min":0.71899999999999997,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47399999999999998,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52700000000000002,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.30199999999999999},"max":{"1min":0.61599999999999999,"5min":1.222,"15min":1.5269999999999999},"last":0.38}]},{"osd":6,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.67400000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.47199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.23000000000000001},"max":{"1min":0.72799999999999998,"5min":1.194,"15min":1.194},"last":0.436},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":1.784},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76000000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.876},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63800000000000001,"15min":0.69399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":1.097,"15min":1.097},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.28699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59899999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.38900000000000001}]},{"osd":6,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80600000000000005,"5min":1.234,"15min":1.234},"last":0.58299999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":1.008,"15min":1.008},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:14:48.461 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T19:03:04.173936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=19, tm_min=3, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=19, tm_min=14, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T19:14:48.462 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T19:14:49.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:49.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:08.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T19:15:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.598+0000 7fec333d7700 1 Processor -- start 2023-10-14T19:15:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.598+0000 7fec333d7700 1 -- start start 2023-10-14T19:15:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec333d7700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fec2c153d20 0x7fec2c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec333d7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec333d7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0687b0 con 0x7fec2c15d290 2023-10-14T19:15:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec333d7700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c15e280 con 0x7fec2c153d20 2023-10-14T19:15:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec333d7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c15dfa0 con 0x7fec2c067e00 2023-10-14T19:15:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec323d5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fec2c153d20 0x7fec2c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec323d5700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fec2c153d20 0x7fec2c06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34460/0 (socket says 172.21.15.7:34460) 2023-10-14T19:15:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.599+0000 7fec323d5700 1 -- 172.21.15.7:0/2448427625 learned_addr learned my addr 172.21.15.7:0/2448427625 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:15:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec31bd4700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec323d5700 1 -- 172.21.15.7:0/2448427625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 msgr2=0x7fec2c068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:15:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec323d5700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec323d5700 1 -- 172.21.15.7:0/2448427625 >> v1:172.21.15.148:6789/0 conn(0x7fec2c15d290 legacy=0x7fec2c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec323d5700 1 -- 172.21.15.7:0/2448427625 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c06a5b0 con 0x7fec2c153d20 2023-10-14T19:15:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec31bd4700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec323d5700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c153d20 0x7fec2c06b090 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fec240099b0 tx=0x7fec24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd72dbb5a9a4c631 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec313d3700 1 -- 172.21.15.7:0/2448427625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2400b860 con 0x7fec2c153d20 2023-10-14T19:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec313d3700 1 -- 172.21.15.7:0/2448427625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2400b9c0 con 0x7fec2c153d20 2023-10-14T19:15:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.600+0000 7fec313d3700 1 -- 172.21.15.7:0/2448427625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2400bd60 con 0x7fec2c153d20 2023-10-14T19:15:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 -- 172.21.15.7:0/2448427625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c153d20 msgr2=0x7fec2c06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c153d20 0x7fec2c06b090 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fec240099b0 tx=0x7fec24009250 comp rx=0 tx=0).stop 2023-10-14T19:15:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 -- 172.21.15.7:0/2448427625 shutdown_connections 2023-10-14T19:15:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c153d20 0x7fec2c06b090 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 --2- 172.21.15.7:0/2448427625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 -- 172.21.15.7:0/2448427625 >> 172.21.15.7:0/2448427625 conn(0x7fec2c0cca00 msgr2=0x7fec2c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:15:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 -- 172.21.15.7:0/2448427625 shutdown_connections 2023-10-14T19:15:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.601+0000 7fec333d7700 1 -- 172.21.15.7:0/2448427625 wait complete. 2023-10-14T19:15:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.602+0000 7fec333d7700 1 Processor -- start 2023-10-14T19:15:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.602+0000 7fec333d7700 1 -- start start 2023-10-14T19:15:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec2c153d20 0x7fec2c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 0x7fec2c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c152d60 con 0x7fec2c15d290 2023-10-14T19:15:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c16e190 con 0x7fec2c153d20 2023-10-14T19:15:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0b16a0 con 0x7fec2c067e00 2023-10-14T19:15:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 0x7fec2c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 0x7fec2c157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34476/0 (socket says 172.21.15.7:34476) 2023-10-14T19:15:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 -- 172.21.15.7:0/2036103012 learned_addr learned my addr 172.21.15.7:0/2036103012 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:15:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec323d5700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec31bd4700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec2c153d20 0x7fec2c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 -- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 msgr2=0x7fec2c0cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c0cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 -- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec2c153d20 msgr2=0x7fec2c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec2c153d20 0x7fec2c152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 -- 172.21.15.7:0/2036103012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240094f0 con 0x7fec2c15d290 2023-10-14T19:15:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec32bd6700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 0x7fec2c157b30 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00c840 tx=0x7fec1c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c012630 con 0x7fec2c15d290 2023-10-14T19:15:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c0127b0 con 0x7fec2c15d290 2023-10-14T19:15:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c012b70 con 0x7fec2c15d290 2023-10-14T19:15:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.603+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0b1980 con 0x7fec2c15d290 2023-10-14T19:15:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.604+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0b1f40 con 0x7fec2c15d290 2023-10-14T19:15:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.604+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c0b2160 con 0x7fec2c15d290 2023-10-14T19:15:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.605+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fec1c003030 con 0x7fec2c15d290 2023-10-14T19:15:08.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.605+0000 7fec2a7fc700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec18067320 0x7fec180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.605+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fec1c0848e0 con 0x7fec2c15d290 2023-10-14T19:15:08.622 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.606+0000 7fec323d5700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec18067320 0x7fec180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.606+0000 7fec323d5700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec18067320 0x7fec180697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fec240099b0 tx=0x7fec24017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:08.623 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.610+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec1c051870 con 0x7fec2c15d290 2023-10-14T19:15:08.801 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.800+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 --> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec2c04c3c0 con 0x7fec18067320 2023-10-14T19:15:08.804 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.803+0000 7fec2a7fc700 1 -- 172.21.15.7:0/2036103012 <== mgr.4102 v2:172.21.15.148:6832/90521 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51014 (secure 0 0 0) 0x7fec2c04c3c0 con 0x7fec18067320 2023-10-14T19:15:08.805 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:15:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec18067320 msgr2=0x7fec180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec18067320 0x7fec180697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fec240099b0 tx=0x7fec24017000 comp rx=0 tx=0).stop 2023-10-14T19:15:08.806 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 msgr2=0x7fec2c157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 0x7fec2c157b30 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00c840 tx=0x7fec1c001670 comp rx=0 tx=0).stop 2023-10-14T19:15:08.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 shutdown_connections 2023-10-14T19:15:08.807 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fec18067320 0x7fec180697d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec2c15d290 0x7fec2c157b30 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec2c067e00 0x7fec2c0cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 --2- 172.21.15.7:0/2036103012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec2c153d20 0x7fec2c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.808 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 >> 172.21.15.7:0/2036103012 conn(0x7fec2c0cca00 msgr2=0x7fec2c14f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:15:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 shutdown_connections 2023-10-14T19:15:08.809 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.805+0000 7fec333d7700 1 -- 172.21.15.7:0/2036103012 wait complete. 2023-10-14T19:15:08.810 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-10-14T19:15:08.817 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":561,"stamp":"2023-10-14T19:15:07.795974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2440840,"kb_used_data":21576,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752533880,"statfs":{"total":773094113280,"available":770594693120,"internally_reserved":0,"allocated":22093824,"data_stored":10569616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003037"},"pg_stats":[{"pgid":"1.0","version":"205'119","reported_seq":328,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-10-14T19:14:52.943831+0000","last_change":"2023-10-14T19:14:52.943783+0000","last_active":"2023-10-14T19:14:52.943831+0000","last_peered":"2023-10-14T19:14:52.943831+0000","last_clean":"2023-10-14T19:14:52.943831+0000","last_became_active":"2023-10-14T19:03:05.459906+0000","last_became_peered":"2023-10-14T19:03:05.459906+0000","last_unstale":"2023-10-14T19:14:52.943831+0000","last_undegraded":"2023-10-14T19:14:52.943831+0000","last_fullsized":"2023-10-14T19:14:52.943831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"205'119","last_scrub_stamp":"2023-10-14T19:14:52.943633+0000","last_deep_scrub":"205'119","last_deep_scrub_stamp":"2023-10-14T19:14:52.943633+0000","last_clean_scrub_stamp":"2023-10-14T19:14:52.943633+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:38.285831+0000","scrub_duration":0.0049767600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1763978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":4.2080000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":3.1949999999999998},"last":0.66300000000000003}]},{"osd":1,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.85399999999999998,"15min":3.1480000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53600000000000003,"15min":0.57299999999999995},"min":{"1min":0.50900000000000001,"5min":0.377,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.749,"15min":2.3610000000000002},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.86899999999999999,"15min":4.0679999999999996},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.626,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":3.23},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.36199999999999999,"15min":0.33500000000000002},"max":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":4.1269999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.69199999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":3.3450000000000002},"last":0.75600000000000001}]},{"osd":4,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":2.4620000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":4.5389999999999997},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.52900000000000003,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.84699999999999998,"15min":3.4119999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79100000000000004,"15min":2.883},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Oct 14 19:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":0.81599999999999995,"15min":2.7130000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.69099999999999995},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.96699999999999997,"15min":5.383},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83699999999999997,"15min":5.6820000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.996,"15min":5.7030000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.32500000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":1.3200000000000001,"15min":7.8680000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.75800000000000001,"15min":7.8250000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":1.032,"15min":8.0210000000000008},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":8.0090000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.67700000000000005},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.204,"15min":8.1890000000000001},"last":0.62},{"interface":"front","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.94799999999999995,"15min":8.1120000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86099999999999999,"15min":0.86599999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308032,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063808,"statfs":{"total":96636764160,"available":96321339392,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.624},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.20399999999999999,"15min":0.20300000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.34499999999999997}]},{"osd":2,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.375},"min":{"1min":0.33400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.63200000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47199999999999998,"15min":0.42899999999999999},"min":{"1min":0.39200000000000002,"5min":0.30099999999999999,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.39700000000000002},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.86699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.36899999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.216},"max":{"1min":0.59099999999999997,"5min":0.873,"15min":0.873},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.501},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.032},"last":0.54300000000000004}]},{"osd":5,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.373},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.0660000000000001,"15min":1.627},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.004,"15min":1.079},"last":0.625}]},{"osd":7,"last update":"Sat Oct 14 19:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66200000000000003,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.5880000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64200000000000002,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308612,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063228,"statfs":{"total":96636764160,"available":96320745472,"internally_reserved":0,"allocated":3207168,"data_stored":1763978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53600000000000003,"5min":0.626,"15min":0.626},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.36199999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.34300000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.626,"15min":0.64700000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.56899999999999995,"5min":0.627,"15min":0.627},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.92900000000000005},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.56799999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.97599999999999998},"last":0.80700000000000005}]},{"osd":5,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.98799999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.625},"min":{"1min":0.54500000000000004,"5min":0.432,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.95599999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Oct 14 19:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.503,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.88200000000000001,"15min":0.92500000000000004},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.57599999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.96599999999999997},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29499999999999998,"5min":0.20799999999999999,"15min":0.20300000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.22,"15min":0.219},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":2.028},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.372},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":11.269},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.38700000000000001,"15min":0.55500000000000005},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.221},"max":{"1min":0.53700000000000003,"5min":0.59599999999999997,"15min":11.318},"last":0.442},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47199999999999998,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.26900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.997,"15min":0.997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":1.9299999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":1.9710000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64200000000000002,"15min":0.83099999999999996},"min":{"1min":0.48399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.028,"15min":11.379},"last":0.73299999999999998}]},{"osd":6,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.83299999999999996},"min":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.95399999999999996,"5min":0.98699999999999999,"15min":11.404},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38200000000000001,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0389999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Oct 14 19:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.44400000000000001,"15min":0.41399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":2.0009999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":11.351000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.371},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.70099999999999996},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56799999999999995,"5min":0.68999999999999995,"15min":1.0629999999999999},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.438,"15min":0.41599999999999998},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.25900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.81000000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.45200000000000001},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.75600000000000001,"15min":1.1719999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.597},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.499,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.36299999999999999},"max":{"1min":0.86599999999999999,"5min":0.87,"15min":1.214},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.133},"last":0.505},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89100000000000001,"15min":0.92300000000000004},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Oct 14 19:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.97599999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.51100000000000001,"5min":0.41599999999999998,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.997},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70499999999999996,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.622}]},{"osd":1,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.89300000000000002,"15min":5.7830000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":1.2709999999999999,"15min":3.0659999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":1.5960000000000001,"15min":3.488},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.68200000000000005,"5min":1.589,"15min":1.589},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.378},"max":{"1min":0.71899999999999997,"5min":1.4790000000000001,"15min":3.5230000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47399999999999998,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52700000000000002,"5min":0.93600000000000005,"15min":1.2949999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.30199999999999999},"max":{"1min":0.61599999999999999,"5min":1.222,"15min":1.5269999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.95699999999999996,"15min":3.9729999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Oct 14 19:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.67400000000000004,"5min":1.4610000000000001,"15min":1.4890000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":1.1299999999999999,"15min":3.6259999999999999},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.23000000000000001},"max":{"1min":0.72799999999999998,"5min":1.194,"15min":1.194},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":1.784},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76000000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.62},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.876},"last":0.753},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63800000000000001,"15min":0.69399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":1.097,"15min":1.097},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.28699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59899999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80600000000000005,"5min":1.234,"15min":1.234},"last":0.505}]},{"osd":7,"last update":"Sat Oct 14 19:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":1.008,"15min":1.008},"last":0.56799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T19:15:08.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T19:15:08.939 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.938+0000 7fc3c359e700 1 Processor -- start 2023-10-14T19:15:08.940 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.938+0000 7fc3c359e700 1 -- start start 2023-10-14T19:15:08.942 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.939+0000 7fc3c359e700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3c4159550 0x7fc3c40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.939+0000 7fc3c359e700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40acc00 con 0x7fc3c415dfd0 2023-10-14T19:15:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.939+0000 7fc3c359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40abff0 con 0x7fc3c4159920 2023-10-14T19:15:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.939+0000 7fc3c359e700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40ac2d0 con 0x7fc3c4159550 2023-10-14T19:15:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.939+0000 7fc3c259c700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3c4159550 0x7fc3c40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.939+0000 7fc3c1d9b700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3c415dfd0 0x7fc3c40aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:43498/0 (socket says 172.21.15.7:43498) 2023-10-14T19:15:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c1d9b700 1 -- 172.21.15.7:0/1458848272 learned_addr learned my addr 172.21.15.7:0/1458848272 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:15:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c259c700 1 -- 172.21.15.7:0/1458848272 >> v1:172.21.15.148:6789/0 conn(0x7fc3c4159920 legacy=0x7fc3c40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c259c700 1 -- 172.21.15.7:0/1458848272 >> v1:172.21.15.7:6789/0 conn(0x7fc3c415dfd0 legacy=0x7fc3c40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c259c700 1 -- 172.21.15.7:0/1458848272 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40ac5b0 con 0x7fc3c4159550 2023-10-14T19:15:08.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c159a700 1 -- 172.21.15.7:0/1458848272 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898055322 0 0) 0x7fc3c40acc00 con 0x7fc3c415dfd0 2023-10-14T19:15:08.945 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c259c700 1 --2- 172.21.15.7:0/1458848272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159550 0x7fc3c40ceac0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80098e0 tx=0x7fc3b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1620f814c47acd6c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c159a700 1 -- 172.21.15.7:0/1458848272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8009e80 con 0x7fc3c4159550 2023-10-14T19:15:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c159a700 1 -- 172.21.15.7:0/1458848272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800b860 con 0x7fc3c4159550 2023-10-14T19:15:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.940+0000 7fc3c159a700 1 -- 172.21.15.7:0/1458848272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800bbe0 con 0x7fc3c4159550 2023-10-14T19:15:08.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 -- 172.21.15.7:0/1458848272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159550 msgr2=0x7fc3c40ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 --2- 172.21.15.7:0/1458848272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159550 0x7fc3c40ceac0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80098e0 tx=0x7fc3b80091a0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 -- 172.21.15.7:0/1458848272 shutdown_connections 2023-10-14T19:15:08.947 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 --2- 172.21.15.7:0/1458848272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159550 0x7fc3c40ceac0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 -- 172.21.15.7:0/1458848272 >> 172.21.15.7:0/1458848272 conn(0x7fc3c406ce80 msgr2=0x7fc3c40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:15:08.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 -- 172.21.15.7:0/1458848272 shutdown_connections 2023-10-14T19:15:08.948 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.941+0000 7fc3c359e700 1 -- 172.21.15.7:0/1458848272 wait complete. 2023-10-14T19:15:08.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.942+0000 7fc3c359e700 1 Processor -- start 2023-10-14T19:15:08.949 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.942+0000 7fc3c359e700 1 -- start start 2023-10-14T19:15:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c4159550 0x7fc3c40c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 0x7fc3c40cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3c415dfd0 0x7fc3c4098da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40c8510 con 0x7fc3c4159920 2023-10-14T19:15:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40c7900 con 0x7fc3c4159550 2023-10-14T19:15:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40c7be0 con 0x7fc3c415dfd0 2023-10-14T19:15:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 0x7fc3c40cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 0x7fc3c40cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34496/0 (socket says 172.21.15.7:34496) 2023-10-14T19:15:08.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 -- 172.21.15.7:0/2714736391 learned_addr learned my addr 172.21.15.7:0/2714736391 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:15:08.954 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c259c700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c4159550 0x7fc3c40c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c2d9d700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3c415dfd0 0x7fc3c4098da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 -- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3c415dfd0 msgr2=0x7fc3c4098da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3c415dfd0 0x7fc3c4098da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 -- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c4159550 msgr2=0x7fc3c40c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:08.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c4159550 0x7fc3c40c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:08.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 -- 172.21.15.7:0/2714736391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009420 con 0x7fc3c4159920 2023-10-14T19:15:08.956 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c259c700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c4159550 0x7fc3c40c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:15:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c1d9b700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 0x7fc3c40cbca0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400c810 tx=0x7fc3b4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4005c00 con 0x7fc3c4159920 2023-10-14T19:15:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4005d60 con 0x7fc3c4159920 2023-10-14T19:15:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c40c7ec0 con 0x7fc3c4159920 2023-10-14T19:15:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.943+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4007320 con 0x7fc3c4159920 2023-10-14T19:15:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.944+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c40c75d0 con 0x7fc3c4159920 2023-10-14T19:15:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.944+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c40c86c0 con 0x7fc3c4159920 2023-10-14T19:15:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.945+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc3b401b3b0 con 0x7fc3c4159920 2023-10-14T19:15:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.945+0000 7fc3b27fc700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3a4067320 0x7fc3a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.946+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc3b4083ec0 con 0x7fc3c4159920 2023-10-14T19:15:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.946+0000 7fc3c259c700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3a4067320 0x7fc3a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.946+0000 7fc3c259c700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3a4067320 0x7fc3a40697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80093f0 tx=0x7fc3b8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:08.950+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3c40c86c0 con 0x7fc3c4159920 2023-10-14T19:15:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.142+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc3c404c3c0 con 0x7fc3c4159920 2023-10-14T19:15:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.146+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3b4050e50 con 0x7fc3c4159920 2023-10-14T19:15:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.146+0000 7fc3b27fc700 1 -- 172.21.15.7:0/2714736391 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc3b4017020 con 0x7fc3c4159920 2023-10-14T19:15:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3a4067320 msgr2=0x7fc3a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3a4067320 0x7fc3a40697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80093f0 tx=0x7fc3b8017000 comp rx=0 tx=0).stop 2023-10-14T19:15:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 msgr2=0x7fc3c40cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 0x7fc3c40cbca0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400c810 tx=0x7fc3b4007d90 comp rx=0 tx=0).stop 2023-10-14T19:15:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 shutdown_connections 2023-10-14T19:15:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7fc3a4067320 0x7fc3a40697d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c4159550 0x7fc3c40c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3c415dfd0 0x7fc3c4098da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 --2- 172.21.15.7:0/2714736391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3c4159920 0x7fc3c40cbca0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 >> 172.21.15.7:0/2714736391 conn(0x7fc3c406ce80 msgr2=0x7fc3c40b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:15:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 shutdown_connections 2023-10-14T19:15:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.149+0000 7fc3c359e700 1 -- 172.21.15.7:0/2714736391 wait complete. 2023-10-14T19:15:09.161 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T19:15:09.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T19:15:09.280 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.280+0000 7f7f61cb4700 1 Processor -- start 2023-10-14T19:15:09.281 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.280+0000 7f7f61cb4700 1 -- start start 2023-10-14T19:15:09.283 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f61cb4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f5c0b07d0 0x7f7f5c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:09.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f61cb4700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f5c0b0ba0 0x7f7f5c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:09.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f61cb4700 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c15a280 con 0x7f7f5c0cf200 2023-10-14T19:15:09.284 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f61cb4700 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c06e180 con 0x7f7f5c0b0ba0 2023-10-14T19:15:09.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f61cb4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c06d850 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5bfff700 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f5c0b0ba0 0x7f7f5c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:09.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5affd700 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7f5c0cf200 0x7f7f5c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:43510/0 (socket says 172.21.15.7:43510) 2023-10-14T19:15:09.285 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5affd700 1 -- 172.21.15.7:0/3183899507 learned_addr learned my addr 172.21.15.7:0/3183899507 (peer_addr_for_me v1:172.21.15.7:0/0) 2023-10-14T19:15:09.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5b7fe700 1 --2- 172.21.15.7:0/3183899507 >> v2:172.21.15.148:3300/0 conn(0x7f7f5c0b07d0 0x7f7f5c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:09.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5bfff700 1 -- 172.21.15.7:0/3183899507 >> v2:172.21.15.148:3300/0 conn(0x7f7f5c0b07d0 msgr2=0x7f7f5c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T19:15:09.286 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5bfff700 1 --2- 172.21.15.7:0/3183899507 >> v2:172.21.15.148:3300/0 conn(0x7f7f5c0b07d0 0x7f7f5c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5bfff700 1 -- 172.21.15.7:0/3183899507 >> v1:172.21.15.7:6789/0 conn(0x7f7f5c0cf200 legacy=0x7f7f5c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5bfff700 1 -- 172.21.15.7:0/3183899507 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c06db30 con 0x7f7f5c0b0ba0 2023-10-14T19:15:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5a7fc700 1 -- 172.21.15.7:0/3183899507 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550368378 0 0) 0x7f7f5c15a280 con 0x7f7f5c0cf200 2023-10-14T19:15:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5bfff700 1 --2- 172.21.15.7:0/3183899507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b0ba0 0x7f7f5c0c42c0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c064720 tx=0x7f7f54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2759314a042b542 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.281+0000 7f7f5a7fc700 1 -- 172.21.15.7:0/3183899507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400e070 con 0x7f7f5c0b0ba0 2023-10-14T19:15:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f5a7fc700 1 -- 172.21.15.7:0/3183899507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f5400bc30 con 0x7f7f5c0b0ba0 2023-10-14T19:15:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f5a7fc700 1 -- 172.21.15.7:0/3183899507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54012430 con 0x7f7f5c0b0ba0 2023-10-14T19:15:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 -- 172.21.15.7:0/3183899507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b0ba0 msgr2=0x7f7f5c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/3183899507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b0ba0 0x7f7f5c0c42c0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c064720 tx=0x7f7f54009780 comp rx=0 tx=0).stop 2023-10-14T19:15:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 -- 172.21.15.7:0/3183899507 shutdown_connections 2023-10-14T19:15:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/3183899507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b0ba0 0x7f7f5c0c42c0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/3183899507 >> v2:172.21.15.148:3300/0 conn(0x7f7f5c0b07d0 0x7f7f5c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 -- 172.21.15.7:0/3183899507 >> 172.21.15.7:0/3183899507 conn(0x7f7f5c06ce80 msgr2=0x7f7f5c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:15:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 -- 172.21.15.7:0/3183899507 shutdown_connections 2023-10-14T19:15:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.282+0000 7f7f61cb4700 1 -- 172.21.15.7:0/3183899507 wait complete. 2023-10-14T19:15:09.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.283+0000 7f7f61cb4700 1 Processor -- start 2023-10-14T19:15:09.293 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.283+0000 7f7f61cb4700 1 -- start start 2023-10-14T19:15:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f61cb4700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 0x7f7f5c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f61cb4700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5c0b0ba0 0x7f7f5c144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f61cb4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f5c0cf200 0x7f7f5c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f61cb4700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c1539b0 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f61cb4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c153c90 con 0x7f7f5c0cf200 2023-10-14T19:15:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f61cb4700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c153f70 con 0x7f7f5c0b0ba0 2023-10-14T19:15:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 0x7f7f5c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 0x7f7f5c1533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34520/0 (socket says 172.21.15.7:34520) 2023-10-14T19:15:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 -- 172.21.15.7:0/1146982184 learned_addr learned my addr 172.21.15.7:0/1146982184 (peer_addr_for_me v2:172.21.15.7:0/0) 2023-10-14T19:15:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5affd700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5c0b0ba0 0x7f7f5c144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5bfff700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f5c0cf200 0x7f7f5c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 -- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5c0b0ba0 msgr2=0x7f7f5c144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5c0b0ba0 0x7f7f5c144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 -- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f5c0cf200 msgr2=0x7f7f5c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f5c0cf200 0x7f7f5c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5b7fe700 1 -- 172.21.15.7:0/1146982184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54009a20 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.284+0000 7f7f5affd700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5c0b0ba0 0x7f7f5c144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T19:15:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.285+0000 7f7f5b7fe700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 0x7f7f5c1533c0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00d840 tx=0x7f7f4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.285+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c014620 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.285+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f4c014780 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.285+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c154250 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.285+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c014b60 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.285+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c1589d0 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.286+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c04c3c0 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.286+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7f4c01d400 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.287+0000 7f7f437fe700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f48067320 0x7f7f480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T19:15:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.287+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7f4c0851e0 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.287+0000 7f7f5affd700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f48067320 0x7f7f480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T19:15:09.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.287+0000 7f7f5affd700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f48067320 0x7f7f480697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c1546e0 tx=0x7f7f50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T19:15:09.302 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.291+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f4c0521f0 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.530+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f5c06de10 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.530+0000 7f7f437fe700 1 -- 172.21.15.7:0/1146982184 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+3531 (secure 0 0 0) 0x7f7f4c055810 con 0x7f7f5c0b07d0 2023-10-14T19:15:09.532 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-10-14T19:15:09.532 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":135,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/193911471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":193911471},{"type":"v1","addr":"172.21.15.148:6836","nonce":193911471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1102965366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":1102965366},{"type":"v1","addr":"172.21.15.148:6837","nonce":1102965366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6834/3207621555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3207621555},{"type":"v1","addr":"172.21.15.7:6834","nonce":3207621555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":9342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/4054475172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6833","nonce":4054475172},{"type":"v1","addr":"172.21.15.7:6835","nonce":4054475172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":135}],"filesystems":[]} 2023-10-14T19:15:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f48067320 msgr2=0x7f7f480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f48067320 0x7f7f480697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c1546e0 tx=0x7f7f50009040 comp rx=0 tx=0).stop 2023-10-14T19:15:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 msgr2=0x7f7f5c1533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T19:15:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 0x7f7f5c1533c0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00d840 tx=0x7f7f4c008040 comp rx=0 tx=0).stop 2023-10-14T19:15:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 shutdown_connections 2023-10-14T19:15:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:6832/90521,v1:172.21.15.148:6833/90521] conn(0x7f7f48067320 0x7f7f480697d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f5c0cf200 0x7f7f5c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c0b07d0 0x7f7f5c1533c0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.532+0000 7f7f61cb4700 1 --2- 172.21.15.7:0/1146982184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f5c0b0ba0 0x7f7f5c144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T19:15:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.533+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 >> 172.21.15.7:0/1146982184 conn(0x7f7f5c06ce80 msgr2=0x7f7f5c069550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T19:15:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.533+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 shutdown_connections 2023-10-14T19:15:09.537 INFO:teuthology.orchestra.run.smithi007.stderr:2023-10-14T19:15:09.533+0000 7f7f61cb4700 1 -- 172.21.15.7:0/1146982184 wait complete. 2023-10-14T19:15:09.537 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 135 2023-10-14T19:15:09.545 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T19:15:09.546 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T19:15:09.546 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T19:15:09.547 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.554 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T19:15:09.555 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T19:15:09.555 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.603 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T19:15:09.603 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T19:15:09.604 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.615 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T19:15:09.615 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T19:15:09.615 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.666 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T19:15:09.667 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T19:15:09.667 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T19:15:09.668 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.699 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T19:15:09.699 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T19:15:09.700 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.777 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T19:15:09.777 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T19:15:09.778 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.843 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T19:15:09.843 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T19:15:09.844 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.910 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T19:15:09.910 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T19:15:09.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:09.942 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T19:15:09.943 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T19:15:09.943 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.021 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T19:15:10.021 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T19:15:10.022 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.093 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T19:15:10.093 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T19:15:10.094 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.163 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T19:15:10.163 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T19:15:10.164 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T19:15:10.164 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.188 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T19:15:10.189 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T19:15:10.189 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.231 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T19:15:10.232 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T19:15:10.232 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T19:15:10.233 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.244 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T19:15:10.245 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T19:15:10.245 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.285 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T19:15:10.286 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T19:15:10.286 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T19:15:10.338 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T19:15:10.338 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T19:15:10.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-14T19:15:10.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:15:10.373 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T19:15:10.628 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:15:10.629 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T19:15:10.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:15:10.727 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T19:15:10.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:15:10.790 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T19:15:10.851 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:15:10.851 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T19:15:10.998 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:15:10.998 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T19:15:11.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:15:11.092 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T19:15:11.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:15:11.163 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T19:15:11.265 INFO:tasks.ceph:Archiving mon data... 2023-10-14T19:15:11.267 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/data/mon.a.tgz 2023-10-14T19:15:11.267 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-10-14T19:15:11.284 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.LBBmydqqNU 2023-10-14T19:15:11.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LBBmydqqNU 2023-10-14T19:15:11.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.LBBmydqqNU 2023-10-14T19:15:11.578 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.LBBmydqqNU is 580KB 2023-10-14T19:15:11.649 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.LBBmydqqNU 2023-10-14T19:15:11.664 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/data/mon.b.tgz 2023-10-14T19:15:11.664 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-10-14T19:15:11.683 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.BMP4msJgwR 2023-10-14T19:15:11.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BMP4msJgwR 2023-10-14T19:15:11.866 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.BMP4msJgwR 2023-10-14T19:15:11.949 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.BMP4msJgwR is 588KB 2023-10-14T19:15:12.047 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.BMP4msJgwR 2023-10-14T19:15:12.062 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/data/mon.c.tgz 2023-10-14T19:15:12.062 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-10-14T19:15:12.116 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.OWMA2BZxqP 2023-10-14T19:15:12.117 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OWMA2BZxqP 2023-10-14T19:15:12.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.OWMA2BZxqP 2023-10-14T19:15:12.366 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.OWMA2BZxqP is 588KB 2023-10-14T19:15:12.465 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.OWMA2BZxqP 2023-10-14T19:15:12.479 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T19:15:12.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T19:15:12.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T19:15:12.542 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T19:15:12.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T19:15:12.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T19:15:12.579 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T19:15:12.607 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T19:15:12.613 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T19:15:12.615 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/remote/smithi007/crash 2023-10-14T19:15:12.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T19:15:12.654 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/remote/smithi148/crash 2023-10-14T19:15:12.655 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T19:15:12.680 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T19:15:12.680 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:12.699 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:12.773 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:12.801 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:12.825 INFO:tasks.ceph:Compressing logs... 2023-10-14T19:15:12.826 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T19:15:12.844 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T19:15:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172338.log 2023-10-14T19:15:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160005.log 2023-10-14T19:15:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107914.log /var/log/ceph/ceph-client.admin.172338.log: 2023-10-14T19:15:12.913 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100382.log 2023-10-14T19:15:12.914 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98681.log 2023-10-14T19:15:12.914 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100382.log: /var/log/ceph/ceph-client.1.101936.log 2023-10-14T19:15:12.914 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100382.log.gz 2023-10-14T19:15:12.914 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100762.log 2023-10-14T19:15:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.98681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98681.log.gz 2023-10-14T19:15:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.101936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90926.log 2023-10-14T19:15:12.915 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101936.log.gz 2023-10-14T19:15:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.100762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97526.log 2023-10-14T19:15:12.916 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100762.log.gz 2023-10-14T19:15:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91010.log 2023-10-14T19:15:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.97526.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.90926.log.gz--verbose 2023-10-14T19:15:12.917 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.1.102333.log 2023-10-14T19:15:12.917 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97526.log.gz 2023-10-14T19:15:12.917 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98299.log 2023-10-14T19:15:12.918 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6%/var/log/ceph/ceph-client.1.102333.log: -- replaced with /var/log/ceph/ceph-client.admin.91010.log.gz 2023-10-14T19:15:12.918 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98685.log 2023-10-14T19:15:12.918 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102333.log.gz 2023-10-14T19:15:12.918 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.98299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90714.log 2023-10-14T19:15:12.919 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98299.log.gz 2023-10-14T19:15:12.919 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.98685.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T19:15:12.919 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98685.log.gz 2023-10-14T19:15:12.920 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97518.log 2023-10-14T19:15:12.920 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90714.log.gz 2023-10-14T19:15:12.920 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T19:15:12.920 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.97518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101184.log 2023-10-14T19:15:12.921 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97518.log.gz 2023-10-14T19:15:12.921 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101564.log 2023-10-14T19:15:12.921 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.101184.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T19:15:12.921 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101184.log.gz 2023-10-14T19:15:12.922 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.101564.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T19:15:12.922 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101564.log.gz 2023-10-14T19:15:12.922 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90795.log 2023-10-14T19:15:12.923 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T19:15:12.923 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90795.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T19:15:12.923 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.d.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90795.log.gz 2023-10-14T19:15:12.923 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.4.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T19:15:12.924 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99070.log 2023-10-14T19:15:12.924 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99992.log 2023-10-14T19:15:12.924 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.99070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99070.log.gz 2023-10-14T19:15:12.924 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.99992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99992.log.gz 2023-10-14T19:15:12.925 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97888.log 2023-10-14T19:15:12.925 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T19:15:12.925 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.3.97888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97888.log.gz 93.6% 2023-10-14T19:15:12.926 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T19:15:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101940.log 2023-10-14T19:15:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101568.log 2023-10-14T19:15:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.101940.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T19:15:12.927 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101940.log.gz 2023-10-14T19:15:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.101568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100386.log 2023-10-14T19:15:12.927 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101568.log.gz 2023-10-14T19:15:12.928 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.1.100386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100386.log.gz 2023-10-14T19:15:12.928 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T19:15:12.928 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102731.log 2023-10-14T19:15:12.929 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.102731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102731.log.gz 2023-10-14T19:15:12.929 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T19:15:12.929 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102337.log 2023-10-14T19:15:12.929 INFO:teuthology.orchestra.run.smithi148.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T19:15:12.930 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.102337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102337.log.gz 2023-10-14T19:15:12.930 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90754.log 2023-10-14T19:15:12.930 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90754.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90754.log.gz 2023-10-14T19:15:12.930 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98303.log 2023-10-14T19:15:12.931 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.98303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98303.log.gz 2023-10-14T19:15:12.931 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90838.log 2023-10-14T19:15:12.935 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90838.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90838.log.gz 2023-10-14T19:15:12.935 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102735.log 2023-10-14T19:15:12.936 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.102735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102735.log.gz 2023-10-14T19:15:12.936 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99066.log 2023-10-14T19:15:12.936 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.99066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99066.log.gz 2023-10-14T19:15:12.936 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97884.log 2023-10-14T19:15:12.937 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.3.97884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97884.log.gz 2023-10-14T19:15:12.937 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99988.log 2023-10-14T19:15:12.937 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.99988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99988.log.gz 2023-10-14T19:15:12.938 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100766.log 2023-10-14T19:15:12.938 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.100766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100766.log.gz 2023-10-14T19:15:12.938 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T19:15:12.938 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90880.log 2023-10-14T19:15:12.940 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90880.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90880.log.gz 2023-10-14T19:15:12.940 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101188.log 2023-10-14T19:15:12.952 INFO:teuthology.orchestra.run.smithi148.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T19:15:12.952 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.101188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101188.log.gz 2023-10-14T19:15:12.953 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90967.log 2023-10-14T19:15:12.959 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90967.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90967.log.gz 2023-10-14T19:15:12.959 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99611.log 2023-10-14T19:15:12.959 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.99611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99611.log.gz 2023-10-14T19:15:12.960 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99615.log 2023-10-14T19:15:12.960 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.99615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99615.log.gz 2023-10-14T19:15:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168058.log 2023-10-14T19:15:13.107 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172338.log.gz 2023-10-14T19:15:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107914.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160005.log.gz 2023-10-14T19:15:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98002.log 2023-10-14T19:15:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.168058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99735.log 2023-10-14T19:15:13.108 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168058.log.gz 2023-10-14T19:15:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98002.log: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.107914.log.gz-5 --verbose 2023-10-14T19:15:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.101487.log 2023-10-14T19:15:13.109 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98002.log.gz 2023-10-14T19:15:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.99735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101361.log 2023-10-14T19:15:13.110 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99735.log.gz 2023-10-14T19:15:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163305.log 2023-10-14T19:15:13.110 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101487.log.gz 2023-10-14T19:15:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175480.log 2023-10-14T19:15:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176652.log 2023-10-14T19:15:13.111 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101361.log.gz 2023-10-14T19:15:13.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161189.log 2023-10-14T19:15:13.112 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163305.log.gz 2023-10-14T19:15:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176652.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175480.log.gz 2023-10-14T19:15:13.112 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106206.log 2023-10-14T19:15:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161189.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.176652.log.gz-- 2023-10-14T19:15:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103408.log 2023-10-14T19:15:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161189.log.gzgzip 2023-10-14T19:15:13.113 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.103237.log 2023-10-14T19:15:13.114 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106206.log.gz 2023-10-14T19:15:13.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104100.log 2023-10-14T19:15:13.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.103237.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103408.log.gz 2023-10-14T19:15:13.115 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171556.log 2023-10-14T19:15:13.115 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103237.log.gz 2023-10-14T19:15:13.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162409.log 2023-10-14T19:15:13.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173824.log 2023-10-14T19:15:13.116 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104100.log.gz 2023-10-14T19:15:13.116 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171556.log.gz 2023-10-14T19:15:13.116 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 /var/log/ceph/ceph-client.admin.162409.log: --verbose -- /var/log/ceph/ceph-client.admin.102176.log 2023-10-14T19:15:13.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173824.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-client.admin.98348.log -- replaced with /var/log/ceph/ceph-client.admin.162409.log.gz 2023-10-14T19:15:13.117 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102176.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173824.log.gz 2023-10-14T19:15:13.117 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106712.log 2023-10-14T19:15:13.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98348.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102176.log.gz 2023-10-14T19:15:13.118 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96514.log 2023-10-14T19:15:13.118 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98348.log.gz 2023-10-14T19:15:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105942.log 2023-10-14T19:15:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96514.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106712.log.gz 2023-10-14T19:15:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163713.log 2023-10-14T19:15:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105942.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96514.log.gz 2023-10-14T19:15:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178560.log 2023-10-14T19:15:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163713.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105942.log.gz 2023-10-14T19:15:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180064.log 2023-10-14T19:15:13.121 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163713.log.gz 2023-10-14T19:15:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159614.log 2023-10-14T19:15:13.121 INFO:teuthology.orchestra.run.smithi007.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.178560.log.gz 2023-10-14T19:15:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101823.log 2023-10-14T19:15:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159614.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180064.log.gz 2023-10-14T19:15:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167050.log 2023-10-14T19:15:13.122 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159614.log.gz 2023-10-14T19:15:13.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103366.log 2023-10-14T19:15:13.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103588.log 2023-10-14T19:15:13.123 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101823.log.gz 2023-10-14T19:15:13.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156820.log 2023-10-14T19:15:13.124 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167050.log.gz 2023-10-14T19:15:13.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103588.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103366.log.gz 2023-10-14T19:15:13.125 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169378.log 2023-10-14T19:15:13.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156820.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.103588.log.gz-5 2023-10-14T19:15:13.125 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.104268.log 2023-10-14T19:15:13.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169378.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156820.log.gz 2023-10-14T19:15:13.126 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105816.log 2023-10-14T19:15:13.126 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169378.log.gz 2023-10-14T19:15:13.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106332.log 2023-10-14T19:15:13.127 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104268.log.gz 2023-10-14T19:15:13.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173677.log 2023-10-14T19:15:13.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105816.log.gz 2023-10-14T19:15:13.127 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98936.log 2023-10-14T19:15:13.128 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106332.log.gz 2023-10-14T19:15:13.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173992.log 2023-10-14T19:15:13.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98936.log: gzip -5 88.0%--verbose -- /var/log/ceph/ceph-client.admin.103873.log -- replaced with /var/log/ceph/ceph-client.admin.173677.log.gz 2023-10-14T19:15:13.129 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173992.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.98936.log.gz 2023-10-14T19:15:13.129 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.174661.log 2023-10-14T19:15:13.129 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.173992.log.gz 2023-10-14T19:15:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97071.log 2023-10-14T19:15:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162917.log 2023-10-14T19:15:13.130 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103873.log.gz 2023-10-14T19:15:13.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97071.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174661.log.gz 2023-10-14T19:15:13.131 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156598.log 2023-10-14T19:15:13.131 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97071.log.gz 2023-10-14T19:15:13.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177617.log 2023-10-14T19:15:13.132 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6%/var/log/ceph/ceph-client.admin.156598.log: -- replaced with /var/log/ceph/ceph-client.admin.162917.log.gz 2023-10-14T19:15:13.132 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173205.log 2023-10-14T19:15:13.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177617.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156598.log.gz 2023-10-14T19:15:13.133 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179552.log 2023-10-14T19:15:13.133 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177617.log.gz 2023-10-14T19:15:13.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97155.log 2023-10-14T19:15:13.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170854.log 2023-10-14T19:15:13.134 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.173205.log.gz 2023-10-14T19:15:13.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107980.log 2023-10-14T19:15:13.134 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179552.log.gz 2023-10-14T19:15:13.135 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97155.log.gz 2023-10-14T19:15:13.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104700.log 2023-10-14T19:15:13.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107980.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.170854.log.gz 2023-10-14T19:15:13.136 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99776.log 2023-10-14T19:15:13.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104700.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.107980.log.gz-5 --verbose 2023-10-14T19:15:13.136 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.168225.log 2023-10-14T19:15:13.136 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104700.log.gz 2023-10-14T19:15:13.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175868.log 2023-10-14T19:15:13.137 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99776.log.gz 2023-10-14T19:15:13.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170641.log 2023-10-14T19:15:13.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175868.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168225.log.gz 2023-10-14T19:15:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169628.log 2023-10-14T19:15:13.138 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175868.log.gz 2023-10-14T19:15:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.170641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178873.log 2023-10-14T19:15:13.139 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170641.log.gz 2023-10-14T19:15:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98352.log 2023-10-14T19:15:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169628.log: /var/log/ceph/ceph-client.admin.178873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100180.log 2023-10-14T19:15:13.140 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169628.log.gz 2023-10-14T19:15:13.140 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178873.log.gz 2023-10-14T19:15:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163881.log 2023-10-14T19:15:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98352.log: /var/log/ceph/ceph-client.admin.100180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170645.log 2023-10-14T19:15:13.141 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98352.log.gz 2023-10-14T19:15:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163881.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100180.log.gz 2023-10-14T19:15:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160633.log 2023-10-14T19:15:13.142 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.163881.log.gz 2023-10-14T19:15:13.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.170645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105428.log 2023-10-14T19:15:13.142 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170645.log.gz 2023-10-14T19:15:13.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106569.log 2023-10-14T19:15:13.143 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160633.log.gz 2023-10-14T19:15:13.143 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105428.log: /var/log/ceph/ceph-client.admin.104540.log 2023-10-14T19:15:13.143 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168359.log 2023-10-14T19:15:13.143 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106569.log.gz/var/log/ceph/ceph-client.admin.104540.log: 2023-10-14T19:15:13.144 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98346.log 2023-10-14T19:15:13.144 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.105428.log.gz 2023-10-14T19:15:13.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103282.log 2023-10-14T19:15:13.145 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104540.log.gz 2023-10-14T19:15:13.145 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.168359.log.gz 2023-10-14T19:15:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165042.log 2023-10-14T19:15:13.145 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98346.log.gz 2023-10-14T19:15:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170949.log 2023-10-14T19:15:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172116.log 2023-10-14T19:15:13.146 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103282.log.gz 2023-10-14T19:15:13.147 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165042.log.gz 2023-10-14T19:15:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165318.log 2023-10-14T19:15:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172116.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170949.log.gz 2023-10-14T19:15:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T19:15:13.148 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172116.log.gz 2023-10-14T19:15:13.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175312.log 2023-10-14T19:15:13.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176212.log 2023-10-14T19:15:13.149 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165318.log.gz 2023-10-14T19:15:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179125.log 2023-10-14T19:15:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176212.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175312.log.gz 2023-10-14T19:15:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167218.log 2023-10-14T19:15:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179125.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.176212.log.gz-5 2023-10-14T19:15:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.157343.log 2023-10-14T19:15:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167218.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.179125.log.gz--verbose 2023-10-14T19:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.100895.log 2023-10-14T19:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.167218.log.gz 2023-10-14T19:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176316.log 2023-10-14T19:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100895.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157343.log.gz 2023-10-14T19:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178705.log 2023-10-14T19:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176316.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100895.log.gz 2023-10-14T19:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97197.log 2023-10-14T19:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.176316.log.gz 2023-10-14T19:15:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163629.log 2023-10-14T19:15:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97197.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178705.log.gz 2023-10-14T19:15:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164524.log 2023-10-14T19:15:13.154 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2%/var/log/ceph/ceph-client.admin.163629.log: -- replaced with /var/log/ceph/ceph-client.admin.97197.log.gz 2023-10-14T19:15:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179270.log 2023-10-14T19:15:13.154 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163629.log.gz 2023-10-14T19:15:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164259.log 2023-10-14T19:15:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172210.log 2023-10-14T19:15:13.155 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164524.log.gz 2023-10-14T19:15:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97997.log 2023-10-14T19:15:13.156 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179270.log.gz 2023-10-14T19:15:13.156 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164259.log.gz 2023-10-14T19:15:13.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180148.log 2023-10-14T19:15:13.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97997.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172210.log.gz 2023-10-14T19:15:13.157 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161454.log 2023-10-14T19:15:13.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180148.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97997.log.gz 2023-10-14T19:15:13.157 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102134.log 2023-10-14T19:15:13.158 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9%/var/log/ceph/ceph-client.admin.161454.log: -- replaced with /var/log/ceph/ceph-client.admin.180148.log.gz 2023-10-14T19:15:13.158 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101277.log 2023-10-14T19:15:13.158 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161454.log.gz 2023-10-14T19:15:13.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172072.log 2023-10-14T19:15:13.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108428.log 2023-10-14T19:15:13.159 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102134.log.gz 2023-10-14T19:15:13.159 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101277.log.gz 2023-10-14T19:15:13.160 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161977.log 2023-10-14T19:15:13.160 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172072.log.gz 2023-10-14T19:15:13.160 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101445.log 2023-10-14T19:15:13.160 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161977.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.108428.log.gz--verbose 2023-10-14T19:15:13.161 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.176526.log 2023-10-14T19:15:13.161 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101445.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161977.log.gz 2023-10-14T19:15:13.161 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174034.log 2023-10-14T19:15:13.162 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101445.log.gz 2023-10-14T19:15:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98642.log 2023-10-14T19:15:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174034.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.176526.log.gz--verbose 2023-10-14T19:15:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.101235.log 2023-10-14T19:15:13.163 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3%/var/log/ceph/ceph-client.admin.98642.log: -- replaced with /var/log/ceph/ceph-client.admin.174034.log.gz 2023-10-14T19:15:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171033.log 2023-10-14T19:15:13.163 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98642.log.gz 2023-10-14T19:15:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90678.log 2023-10-14T19:15:13.164 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171033.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101235.log.gz 2023-10-14T19:15:13.164 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179846.log 2023-10-14T19:15:13.164 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171033.log.gz 2023-10-14T19:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.90678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96941.log 2023-10-14T19:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90678.log.gz 2023-10-14T19:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108173.log 2023-10-14T19:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96941.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179846.log.gz 2023-10-14T19:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157385.log 2023-10-14T19:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96941.log.gz 2023-10-14T19:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.108173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97996.log 2023-10-14T19:15:13.167 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108173.log.gz 2023-10-14T19:15:13.167 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170297.log 2023-10-14T19:15:13.167 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106754.log 2023-10-14T19:15:13.167 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157385.log.gz 2023-10-14T19:15:13.168 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97996.log.gz 2023-10-14T19:15:13.168 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98349.log 2023-10-14T19:15:13.168 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170297.log.gz 2023-10-14T19:15:13.169 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164175.log 2023-10-14T19:15:13.169 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98349.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106754.log.gz 2023-10-14T19:15:13.169 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180190.log 2023-10-14T19:15:13.169 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98349.log.gz 2023-10-14T19:15:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180358.log 2023-10-14T19:15:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180190.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164175.log.gz 2023-10-14T19:15:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97992.log 2023-10-14T19:15:13.171 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180190.log.gz 2023-10-14T19:15:13.171 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166179.log 2023-10-14T19:15:13.171 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97992.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180358.log.gz 2023-10-14T19:15:13.171 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174202.log 2023-10-14T19:15:13.172 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166179.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97992.log.gz 2023-10-14T19:15:13.172 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180274.log 2023-10-14T19:15:13.172 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166179.log.gz 2023-10-14T19:15:13.173 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99104.log 2023-10-14T19:15:13.173 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180274.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.174202.log.gz 2023-10-14T19:15:13.173 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167795.log 2023-10-14T19:15:13.173 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180274.log.gz 2023-10-14T19:15:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160218.log 2023-10-14T19:15:13.174 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99104.log.gz 2023-10-14T19:15:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175952.log 2023-10-14T19:15:13.175 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158099.log 2023-10-14T19:15:13.175 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160218.log.gz 2023-10-14T19:15:13.175 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175952.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.167795.log.gz 2023-10-14T19:15:13.175 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160448.log 2023-10-14T19:15:13.176 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172733.log 2023-10-14T19:15:13.176 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158099.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175952.log.gz 2023-10-14T19:15:13.176 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173080.log 2023-10-14T19:15:13.177 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158099.log.gz 2023-10-14T19:15:13.177 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160448.log.gz 2023-10-14T19:15:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174955.log 2023-10-14T19:15:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.173080.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.172733.log.gz 2023-10-14T19:15:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.102894.log 2023-10-14T19:15:13.178 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.173080.log.gz 2023-10-14T19:15:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168589.log 2023-10-14T19:15:13.179 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168757.log 2023-10-14T19:15:13.179 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.174955.log.gz 2023-10-14T19:15:13.179 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168589.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.178519.log 2023-10-14T19:15:13.179 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102894.log.gz 2023-10-14T19:15:13.180 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168589.log.gz 2023-10-14T19:15:13.180 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107018.log 2023-10-14T19:15:13.180 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178519.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168757.log.gz 2023-10-14T19:15:13.181 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164692.log 2023-10-14T19:15:13.181 INFO:teuthology.orchestra.run.smithi007.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.178519.log.gz 2023-10-14T19:15:13.181 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163797.log 2023-10-14T19:15:13.181 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107018.log.gz 2023-10-14T19:15:13.182 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162451.log 2023-10-14T19:15:13.182 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163797.log: gzip 87.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.164692.log.gz-- 2023-10-14T19:15:13.182 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156640.log 2023-10-14T19:15:13.182 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163797.log.gz 2023-10-14T19:15:13.183 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101924.log 2023-10-14T19:15:13.183 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162451.log.gz 2023-10-14T19:15:13.183 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 /var/log/ceph/ceph-client.admin.156640.log: --verbose -- /var/log/ceph/ceph-client.admin.164049.log 2023-10-14T19:15:13.183 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101924.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156640.log.gzgzip 2023-10-14T19:15:13.184 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.104956.log 2023-10-14T19:15:13.184 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101924.log.gz 2023-10-14T19:15:13.184 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159469.log 2023-10-14T19:15:13.185 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104956.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164049.log.gz 2023-10-14T19:15:13.185 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170129.log 2023-10-14T19:15:13.185 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175522.log 2023-10-14T19:15:13.185 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104956.log.gz 2023-10-14T19:15:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159469.log.gz 2023-10-14T19:15:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168505.log 2023-10-14T19:15:13.186 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170129.log.gz 2023-10-14T19:15:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160404.log 2023-10-14T19:15:13.187 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168505.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175522.log.gz 2023-10-14T19:15:13.187 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170686.log 2023-10-14T19:15:13.187 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168505.log.gz 2023-10-14T19:15:13.188 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105858.log 2023-10-14T19:15:13.188 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160404.log.gz/var/log/ceph/ceph-client.admin.170686.log: 2023-10-14T19:15:13.188 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107060.log 2023-10-14T19:15:13.188 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105858.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.170686.log.gz--verbose 2023-10-14T19:15:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.169850.log 2023-10-14T19:15:13.189 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105858.log.gz 2023-10-14T19:15:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156946.log 2023-10-14T19:15:13.190 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107060.log.gz 2023-10-14T19:15:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157734.log 2023-10-14T19:15:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156946.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169850.log.gz 2023-10-14T19:15:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161105.log 2023-10-14T19:15:13.191 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156946.log.gz 2023-10-14T19:15:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105006.log 2023-10-14T19:15:13.191 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157734.log.gz 2023-10-14T19:15:13.192 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102810.log 2023-10-14T19:15:13.192 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171822.log 2023-10-14T19:15:13.192 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161105.log.gz 2023-10-14T19:15:13.193 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105006.log.gz 2023-10-14T19:15:13.193 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163406.log 2023-10-14T19:15:13.193 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102810.log.gz 2023-10-14T19:15:13.194 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156736.log 2023-10-14T19:15:13.194 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163406.log: gzip 89.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.171822.log.gz-- 2023-10-14T19:15:13.194 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159529.log 2023-10-14T19:15:13.194 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156736.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163406.log.gz 2023-10-14T19:15:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162539.log 2023-10-14T19:15:13.195 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156736.log.gz 2023-10-14T19:15:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101109.log 2023-10-14T19:15:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162539.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159529.log.gz 2023-10-14T19:15:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100684.log 2023-10-14T19:15:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162539.log.gz 2023-10-14T19:15:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162495.log 2023-10-14T19:15:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100684.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101109.log.gz 2023-10-14T19:15:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175270.log 2023-10-14T19:15:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162495.log: 89.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.100684.log.gz--verbose 2023-10-14T19:15:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.102008.log 2023-10-14T19:15:13.198 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162495.log.gz 2023-10-14T19:15:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163587.log 2023-10-14T19:15:13.198 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175270.log.gz 2023-10-14T19:15:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100432.log 2023-10-14T19:15:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163587.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102008.log.gz 2023-10-14T19:15:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170339.log 2023-10-14T19:15:13.199 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163587.log.gz 2023-10-14T19:15:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103241.log 2023-10-14T19:15:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170339.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100432.log.gzgzip 2023-10-14T19:15:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.176442.log 2023-10-14T19:15:13.201 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.103241.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.170339.log.gz--verbose -- 2023-10-14T19:15:13.201 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161808.log 2023-10-14T19:15:13.201 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103241.log.gz 2023-10-14T19:15:13.201 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173425.log 2023-10-14T19:15:13.202 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176442.log.gz 2023-10-14T19:15:13.202 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107102.log 2023-10-14T19:15:13.202 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164958.log 2023-10-14T19:15:13.203 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161808.log.gz 2023-10-14T19:15:13.203 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107102.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173425.log.gz 2023-10-14T19:15:13.203 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163001.log 2023-10-14T19:15:13.204 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107102.log.gz 2023-10-14T19:15:13.204 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164133.log 2023-10-14T19:15:13.204 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162367.log 87.1% 2023-10-14T19:15:13.204 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164958.log.gz 2023-10-14T19:15:13.205 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170728.log 2023-10-14T19:15:13.205 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162367.log: 91.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.163001.log.gz 2023-10-14T19:15:13.205 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164133.log.gz 2023-10-14T19:15:13.205 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177170.log 2023-10-14T19:15:13.206 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162367.log.gz 2023-10-14T19:15:13.206 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104478.log 2023-10-14T19:15:13.206 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177170.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170728.log.gz 2023-10-14T19:15:13.206 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161018.log 2023-10-14T19:15:13.207 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174599.log 2023-10-14T19:15:13.207 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177170.log.gz 2023-10-14T19:15:13.207 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104478.log.gz 2023-10-14T19:15:13.207 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.161018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172883.log 2023-10-14T19:15:13.208 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161018.log.gz 2023-10-14T19:15:13.208 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166618.log 2023-10-14T19:15:13.208 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161412.log 2023-10-14T19:15:13.208 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.174599.log.gz 2023-10-14T19:15:13.209 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172883.log.gz 2023-10-14T19:15:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176736.log 2023-10-14T19:15:13.209 INFO:teuthology.orchestra.run.smithi007.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.166618.log.gz 2023-10-14T19:15:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100642.log 2023-10-14T19:15:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176736.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161412.log.gz 2023-10-14T19:15:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165515.log 2023-10-14T19:15:13.211 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176736.log.gz/var/log/ceph/ceph-client.admin.100642.log: 2023-10-14T19:15:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176358.log 2023-10-14T19:15:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.165515.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100642.log.gz 2023-10-14T19:15:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175994.log 2023-10-14T19:15:13.212 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165515.log.gz 2023-10-14T19:15:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98351.log 2023-10-14T19:15:13.212 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9%/var/log/ceph/ceph-client.admin.175994.log: -- replaced with /var/log/ceph/ceph-client.admin.176358.log.gz 2023-10-14T19:15:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T19:15:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98351.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175994.log.gz 2023-10-14T19:15:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108260.log 2023-10-14T19:15:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98351.log.gz 2023-10-14T19:15:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105687.log 2023-10-14T19:15:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100390.log 2023-10-14T19:15:13.214 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108260.log.gz 2023-10-14T19:15:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.105687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106858.log 2023-10-14T19:15:13.215 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105687.log.gz 2023-10-14T19:15:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160507.log 2023-10-14T19:15:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100390.log: /var/log/ceph/ceph-client.admin.106858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100811.log 2023-10-14T19:15:13.216 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100390.log.gz 2023-10-14T19:15:13.216 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106858.log.gz 2023-10-14T19:15:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175438.log 2023-10-14T19:15:13.216 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160507.log.gz 2023-10-14T19:15:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158826.log 2023-10-14T19:15:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100811.log: /var/log/ceph/ceph-client.admin.175438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171640.log 2023-10-14T19:15:13.217 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100811.log.gz 2023-10-14T19:15:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158826.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175438.log.gz 2023-10-14T19:15:13.218 INFO:teuthology.orchestra.run.smithi007.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T19:15:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176568.log 2023-10-14T19:15:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162875.log 2023-10-14T19:15:13.219 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9%/var/log/ceph/ceph-client.admin.171640.log: -- replaced with /var/log/ceph/ceph-client.admin.158826.log.gz 2023-10-14T19:15:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158784.log 2023-10-14T19:15:13.219 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171640.log.gz 2023-10-14T19:15:13.220 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176568.log.gz 2023-10-14T19:15:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159923.log 2023-10-14T19:15:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158784.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162875.log.gz 2023-10-14T19:15:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171598.log 2023-10-14T19:15:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159923.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158784.log.gz 2023-10-14T19:15:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98350.log 2023-10-14T19:15:13.221 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159923.log.gz 2023-10-14T19:15:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178343.log 2023-10-14T19:15:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98350.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171598.log.gz 2023-10-14T19:15:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176128.log 2023-10-14T19:15:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178343.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98350.log.gz 2023-10-14T19:15:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175186.log 2023-10-14T19:15:13.223 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178343.log.gz 2023-10-14T19:15:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105774.log 2023-10-14T19:15:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169544.log 2023-10-14T19:15:13.224 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176128.log.gz 2023-10-14T19:15:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105774.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175186.log.gz 2023-10-14T19:15:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174871.log 2023-10-14T19:15:13.225 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105774.log.gz 2023-10-14T19:15:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171369.log 2023-10-14T19:15:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174871.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169544.log.gz 2023-10-14T19:15:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157610.log 2023-10-14T19:15:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171369.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.174871.log.gz 2023-10-14T19:15:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176086.log 2023-10-14T19:15:13.227 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171369.log.gz 2023-10-14T19:15:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107620.log 2023-10-14T19:15:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176086.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.157610.log.gz--verbose 2023-10-14T19:15:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.178301.log 2023-10-14T19:15:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107620.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176086.log.gz 2023-10-14T19:15:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178915.log 2023-10-14T19:15:13.228 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107620.log.gz 2023-10-14T19:15:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157072.log 2023-10-14T19:15:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180400.log 2023-10-14T19:15:13.229 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.178301.log.gz 2023-10-14T19:15:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157072.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178915.log.gz 2023-10-14T19:15:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98810.log 2023-10-14T19:15:13.230 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157072.log.gz 2023-10-14T19:15:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176484.log 2023-10-14T19:15:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101966.log 2023-10-14T19:15:13.231 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180400.log.gz 2023-10-14T19:15:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176484.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98810.log.gz 2023-10-14T19:15:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173719.log 2023-10-14T19:15:13.231 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176484.log.gz 2023-10-14T19:15:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170812.log 2023-10-14T19:15:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105302.log 88.1% 2023-10-14T19:15:13.232 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101966.log.gz 2023-10-14T19:15:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170812.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173719.log.gz 2023-10-14T19:15:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179228.log 2023-10-14T19:15:13.233 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170812.log.gz 2023-10-14T19:15:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106628.log 2023-10-14T19:15:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103632.log 2023-10-14T19:15:13.234 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105302.log.gz 2023-10-14T19:15:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106628.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179228.log.gz 2023-10-14T19:15:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165690.log 2023-10-14T19:15:13.235 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106628.log.gz 2023-10-14T19:15:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98222.log 2023-10-14T19:15:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165690.log: gzip 87.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.103632.log.gz-- 2023-10-14T19:15:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162019.log 2023-10-14T19:15:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98222.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165690.log.gz 2023-10-14T19:15:13.236 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178260.log 2023-10-14T19:15:13.236 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98222.log.gz 2023-10-14T19:15:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97407.log 2023-10-14T19:15:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.178260.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162019.log.gz 2023-10-14T19:15:13.237 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105732.log 2023-10-14T19:15:13.238 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178260.log.gz 2023-10-14T19:15:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157030.log 2023-10-14T19:15:13.238 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97407.log.gz 2023-10-14T19:15:13.238 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164780.log 2023-10-14T19:15:13.239 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105732.log.gz 2023-10-14T19:15:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100726.log 2023-10-14T19:15:13.239 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159301.log 2023-10-14T19:15:13.240 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157030.log.gz 2023-10-14T19:15:13.240 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164780.log.gz 2023-10-14T19:15:13.240 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180316.log 2023-10-14T19:15:13.240 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100726.log.gz 2023-10-14T19:15:13.241 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174515.log 2023-10-14T19:15:13.241 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105048.log 2023-10-14T19:15:13.241 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159301.log.gz 2023-10-14T19:15:13.242 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180316.log.gz 2023-10-14T19:15:13.242 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173635.log 2023-10-14T19:15:13.242 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174515.log.gz 2023-10-14T19:15:13.243 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162707.log 2023-10-14T19:15:13.243 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107704.log 2023-10-14T19:15:13.243 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105048.log.gz 2023-10-14T19:15:13.243 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173635.log.gz 2023-10-14T19:15:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160319.log 2023-10-14T19:15:13.244 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162707.log.gz 2023-10-14T19:15:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164091.log 2023-10-14T19:15:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170255.log 2023-10-14T19:15:13.245 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107704.log.gz 2023-10-14T19:15:13.245 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160319.log.gz 2023-10-14T19:15:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96899.log 2023-10-14T19:15:13.246 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164091.log.gz 2023-10-14T19:15:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161063.log 2023-10-14T19:15:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159385.log 2023-10-14T19:15:13.247 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170255.log.gz 2023-10-14T19:15:13.247 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96899.log.gz 2023-10-14T19:15:13.247 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177871.log 2023-10-14T19:15:13.247 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161063.log.gz 2023-10-14T19:15:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104184.log 2023-10-14T19:15:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177871.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159385.log.gzgzip 2023-10-14T19:15:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.108218.log 2023-10-14T19:15:13.249 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177871.log.gz 2023-10-14T19:15:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168631.log 2023-10-14T19:15:13.249 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104184.log.gz 2023-10-14T19:15:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172380.log 2023-10-14T19:15:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168631.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.108218.log.gz--verbose 2023-10-14T19:15:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.157469.log 2023-10-14T19:15:13.250 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168631.log.gz 2023-10-14T19:15:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177829.log 2023-10-14T19:15:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172380.log.gz 2023-10-14T19:15:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104394.log 2023-10-14T19:15:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177829.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157469.log.gz 2023-10-14T19:15:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158868.log 2023-10-14T19:15:13.252 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.177829.log.gz 2023-10-14T19:15:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173782.log 2023-10-14T19:15:13.253 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104394.log.gz 2023-10-14T19:15:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:gzip /var/log/ceph/ceph-client.admin.158868.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.177575.log 2023-10-14T19:15:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164566.log 2023-10-14T19:15:13.254 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158868.log.gz 2023-10-14T19:15:13.254 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173782.log.gz 2023-10-14T19:15:13.254 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105176.log 2023-10-14T19:15:13.254 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177575.log.gz 2023-10-14T19:15:13.255 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107408.log 2023-10-14T19:15:13.255 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159572.log 2023-10-14T19:15:13.255 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164566.log.gz 2023-10-14T19:15:13.256 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105176.log.gz 2023-10-14T19:15:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156904.log 2023-10-14T19:15:13.256 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107408.log.gz 2023-10-14T19:15:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107830.log 2023-10-14T19:15:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100516.log 2023-10-14T19:15:13.257 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159572.log.gz 2023-10-14T19:15:13.257 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156904.log.gz 2023-10-14T19:15:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107830.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84687.log 2023-10-14T19:15:13.258 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107830.log.gz 2023-10-14T19:15:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180232.log 2023-10-14T19:15:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.tmp-client.admin.84687.log: gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.100516.log.gz/var/log/ceph/ceph-client.admin.172775.log 2023-10-14T19:15:13.259 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.259 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84687.log.gz 2023-10-14T19:15:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178747.log 2023-10-14T19:15:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172775.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180232.log.gz 2023-10-14T19:15:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177378.log 2023-10-14T19:15:13.260 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172775.log.gz 2023-10-14T19:15:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101151.log 2023-10-14T19:15:13.261 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103789.log 2023-10-14T19:15:13.261 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.178747.log.gz 2023-10-14T19:15:13.261 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101151.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177378.log.gz 2023-10-14T19:15:13.262 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177092.log 2023-10-14T19:15:13.262 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101151.log.gz 2023-10-14T19:15:13.262 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97239.log 2023-10-14T19:15:13.262 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177092.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103789.log.gzgzip 2023-10-14T19:15:13.263 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.99727.log 2023-10-14T19:15:13.263 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98000.log 2023-10-14T19:15:13.263 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177092.log.gz 2023-10-14T19:15:13.264 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97239.log.gz 2023-10-14T19:15:13.264 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.99727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172607.log 2023-10-14T19:15:13.264 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99727.log.gz 2023-10-14T19:15:13.264 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169154.log 2023-10-14T19:15:13.265 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98000.log.gz 2023-10-14T19:15:13.265 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104352.log 2023-10-14T19:15:13.265 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172607.log.gz 2023-10-14T19:15:13.266 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108386.log 2023-10-14T19:15:13.266 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163364.log 2023-10-14T19:15:13.266 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169154.log.gz 2023-10-14T19:15:13.267 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108386.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104352.log.gz 2023-10-14T19:15:13.267 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T19:15:13.267 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108386.log.gz 2023-10-14T19:15:13.267 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167627.log 2023-10-14T19:15:13.268 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170028.log 2023-10-14T19:15:13.268 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163364.log.gz 2023-10-14T19:15:13.268 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.100139.log 2023-10-14T19:15:13.268 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167627.log.gz 2023-10-14T19:15:13.269 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170770.log 2023-10-14T19:15:13.269 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170028.log.gz 2023-10-14T19:15:13.269 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157692.log 2023-10-14T19:15:13.270 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.100139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.100139.log.gz 2023-10-14T19:15:13.270 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103324.log 2023-10-14T19:15:13.270 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170770.log.gz 2023-10-14T19:15:13.270 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165996.log 2023-10-14T19:15:13.271 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157692.log.gz 2023-10-14T19:15:13.271 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162623.log 2023-10-14T19:15:13.271 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103324.log: /var/log/ceph/ceph-client.admin.165996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180543.log 2023-10-14T19:15:13.272 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103324.log.gz 2023-10-14T19:15:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162623.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165996.log.gz 2023-10-14T19:15:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172464.log 2023-10-14T19:15:13.272 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162623.log.gz 2023-10-14T19:15:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107788.log 2023-10-14T19:15:13.273 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180543.log.gz 2023-10-14T19:15:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97663.log 2023-10-14T19:15:13.274 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97659.log 2023-10-14T19:15:13.274 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107788.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172464.log.gz 2023-10-14T19:15:13.274 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97663.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107788.log.gz 2023-10-14T19:15:13.274 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158504.log 2023-10-14T19:15:13.275 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T19:15:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101882.log 2023-10-14T19:15:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97659.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97663.log.gz 2023-10-14T19:15:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158504.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97659.log.gzgzip 2023-10-14T19:15:13.276 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.96857.log 2023-10-14T19:15:13.276 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101882.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158504.log.gz 2023-10-14T19:15:13.276 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104142.log 2023-10-14T19:15:13.277 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96857.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101882.log.gz 2023-10-14T19:15:13.277 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178256.log 2023-10-14T19:15:13.277 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96857.log.gz 2023-10-14T19:15:13.278 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102218.log 2023-10-14T19:15:13.278 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.178256.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104142.log.gz 2023-10-14T19:15:13.278 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157259.log 2023-10-14T19:15:13.278 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178256.log.gz 2023-10-14T19:15:13.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158312.log 2023-10-14T19:15:13.279 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102218.log.gz 2023-10-14T19:15:13.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107324.log 2023-10-14T19:15:13.280 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158312.log: gzip -5 --verbose 87.9%-- -- replaced with /var/log/ceph/ceph-client.admin.157259.log.gz/var/log/ceph/ceph-client.admin.173950.log 2023-10-14T19:15:13.280 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.280 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105260.log 2023-10-14T19:15:13.281 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158312.log.gz 2023-10-14T19:15:13.281 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107324.log.gz 2023-10-14T19:15:13.281 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98558.log 2023-10-14T19:15:13.281 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173950.log.gz 2023-10-14T19:15:13.282 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169944.log 2023-10-14T19:15:13.282 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98558.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105260.log.gz 2023-10-14T19:15:13.282 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100306.log 2023-10-14T19:15:13.282 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98558.log.gz 2023-10-14T19:15:13.283 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107366.log 2023-10-14T19:15:13.283 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169944.log.gz 2023-10-14T19:15:13.283 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157427.log 2023-10-14T19:15:13.284 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173551.log 88.0% 2023-10-14T19:15:13.284 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100306.log.gz 2023-10-14T19:15:13.284 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107366.log.gz 2023-10-14T19:15:13.285 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100264.log 2023-10-14T19:15:13.285 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157427.log.gz 2023-10-14T19:15:13.285 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165774.log 2023-10-14T19:15:13.285 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100264.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173551.log.gz 2023-10-14T19:15:13.286 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97999.log 2023-10-14T19:15:13.286 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100264.log.gz 2023-10-14T19:15:13.286 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166347.log 2023-10-14T19:15:13.287 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165774.log.gz 2023-10-14T19:15:13.287 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98684.log 2023-10-14T19:15:13.287 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166347.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97999.log.gz 2023-10-14T19:15:13.287 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166473.log 2023-10-14T19:15:13.288 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166347.log.gz 2023-10-14T19:15:13.288 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159217.log 2023-10-14T19:15:13.288 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98684.log.gz 2023-10-14T19:15:13.289 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108302.log 2023-10-14T19:15:13.289 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159217.log: gzip -5 --verbose 89.1%-- /var/log/ceph/ceph-client.admin.99020.log -- replaced with /var/log/ceph/ceph-client.admin.166473.log.gz 2023-10-14T19:15:13.289 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.289 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159217.log.gz 2023-10-14T19:15:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178999.log 2023-10-14T19:15:13.290 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108302.log.gz 2023-10-14T19:15:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168141.log 2023-10-14T19:15:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158354.log 2023-10-14T19:15:13.291 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99020.log.gz 2023-10-14T19:15:13.291 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.178999.log.gz 2023-10-14T19:15:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106038.log 2023-10-14T19:15:13.292 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168141.log.gz 2023-10-14T19:15:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162325.log 2023-10-14T19:15:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106038.log: gzip 87.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.158354.log.gz--verbose 2023-10-14T19:15:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.97449.log 2023-10-14T19:15:13.293 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106038.log.gz 2023-10-14T19:15:13.293 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175827.log 2023-10-14T19:15:13.294 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162325.log.gz 2023-10-14T19:15:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98600.log 2023-10-14T19:15:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.175827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158227.log 2023-10-14T19:15:13.295 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97449.log.gz 2023-10-14T19:15:13.295 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175827.log.gz 2023-10-14T19:15:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165598.log 2023-10-14T19:15:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172565.log 2023-10-14T19:15:13.296 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98600.log.gz 2023-10-14T19:15:13.296 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T19:15:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165598.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158227.log.gz 2023-10-14T19:15:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174076.log 2023-10-14T19:15:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172565.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.165598.log.gz--verbose 2023-10-14T19:15:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.171285.log 2023-10-14T19:15:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174076.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172565.log.gz 2023-10-14T19:15:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165168.log 2023-10-14T19:15:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171285.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174076.log.gz 2023-10-14T19:15:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T19:15:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165168.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171285.log.gz 2023-10-14T19:15:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177030.log 2023-10-14T19:15:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.c.log: 89.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.165168.log.gz--verbose 2023-10-14T19:15:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.103747.log 2023-10-14T19:15:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175144.log 2023-10-14T19:15:13.300 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177030.log.gz 2023-10-14T19:15:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176904.log 2023-10-14T19:15:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96807.log 2023-10-14T19:15:13.301 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103747.log.gz 2023-10-14T19:15:13.301 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175144.log.gz 2023-10-14T19:15:13.301 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161748.log 2023-10-14T19:15:13.302 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176904.log.gz 2023-10-14T19:15:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169460.log 2023-10-14T19:15:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162123.log 2023-10-14T19:15:13.302 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96807.log.gz 2023-10-14T19:15:13.303 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161748.log.gz/var/log/ceph/ceph-client.admin.169460.log: 2023-10-14T19:15:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165732.log 2023-10-14T19:15:13.303 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169460.log.gz 2023-10-14T19:15:13.303 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168443.log 2023-10-14T19:15:13.304 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174997.log 2023-10-14T19:15:13.304 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162123.log.gz 2023-10-14T19:15:13.304 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165732.log.gz 2023-10-14T19:15:13.305 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176946.log 2023-10-14T19:15:13.305 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168443.log.gz 2023-10-14T19:15:13.305 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102726.log 2023-10-14T19:15:13.305 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176946.log: gzip -5 88.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.174997.log.gz/var/log/ceph/ceph-client.admin.101193.log 2023-10-14T19:15:13.306 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.306 INFO:teuthology.orchestra.run.smithi007.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.176946.log.gz 2023-10-14T19:15:13.306 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97029.log 2023-10-14T19:15:13.306 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102726.log.gz 2023-10-14T19:15:13.307 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97113.log 2023-10-14T19:15:13.307 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97029.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101193.log.gz 2023-10-14T19:15:13.307 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166095.log 2023-10-14T19:15:13.308 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97029.log.gz 2023-10-14T19:15:13.308 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178385.log 2023-10-14T19:15:13.308 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.97113.log.gz/var/log/ceph/ceph-client.admin.166095.log: 2023-10-14T19:15:13.308 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173866.log 2023-10-14T19:15:13.309 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166095.log.gz 2023-10-14T19:15:13.309 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159259.log 2023-10-14T19:15:13.309 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164441.log 2023-10-14T19:15:13.309 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.178385.log.gz 2023-10-14T19:15:13.310 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173866.log.gz 2023-10-14T19:15:13.310 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175564.log 2023-10-14T19:15:13.310 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159259.log.gz 2023-10-14T19:15:13.311 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158742.log 2023-10-14T19:15:13.311 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175564.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.0.175823.log 2023-10-14T19:15:13.311 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164441.log.gz 2023-10-14T19:15:13.311 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97665.log 2023-10-14T19:15:13.312 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.175564.log.gz 2023-10-14T19:15:13.312 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.175823.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.158742.log.gz 2023-10-14T19:15:13.312 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169902.log 2023-10-14T19:15:13.313 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175823.log.gz 2023-10-14T19:15:13.313 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160362.log 2023-10-14T19:15:13.313 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169902.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97665.log.gz 2023-10-14T19:15:13.313 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168799.log 2023-10-14T19:15:13.314 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1%/var/log/ceph/ceph-client.admin.160362.log: -- replaced with /var/log/ceph/ceph-client.admin.169902.log.gz 2023-10-14T19:15:13.314 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102050.log 2023-10-14T19:15:13.314 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160591.log 2023-10-14T19:15:13.314 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160362.log.gz 2023-10-14T19:15:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102050.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168799.log.gz 2023-10-14T19:15:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165210.log 2023-10-14T19:15:13.315 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102050.log.gz 2023-10-14T19:15:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164301.log 2023-10-14T19:15:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166968.log 2023-10-14T19:15:13.316 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.160591.log.gz 2023-10-14T19:15:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164301.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165210.log.gz 2023-10-14T19:15:13.317 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177955.log 2023-10-14T19:15:13.317 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164301.log.gz 2023-10-14T19:15:13.317 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106374.log 2023-10-14T19:15:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107274.log 2023-10-14T19:15:13.318 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166968.log.gz 2023-10-14T19:15:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106374.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177955.log.gz 2023-10-14T19:15:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172817.log 2023-10-14T19:15:13.319 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106374.log.gz 2023-10-14T19:15:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104618.log 2023-10-14T19:15:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161231.log 2023-10-14T19:15:13.320 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107274.log.gz 2023-10-14T19:15:13.320 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105494.log 2023-10-14T19:15:13.320 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104618.log.gz 2023-10-14T19:15:13.320 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161231.log: 91.0%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.172817.log.gz-- 2023-10-14T19:15:13.321 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166828.log 2023-10-14T19:15:13.321 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161231.log.gz 2023-10-14T19:15:13.321 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160262.log 2023-10-14T19:15:13.321 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166828.log: gzip 89.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.105494.log.gz--verbose 2023-10-14T19:15:13.322 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.160048.log 2023-10-14T19:15:13.322 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160262.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166828.log.gz 2023-10-14T19:15:13.322 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171243.log 2023-10-14T19:15:13.323 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168317.log 2023-10-14T19:15:13.323 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160262.log.gz 2023-10-14T19:15:13.323 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171243.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160048.log.gz 2023-10-14T19:15:13.323 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174473.log 2023-10-14T19:15:13.324 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171243.log.gz 2023-10-14T19:15:13.324 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106290.log 2023-10-14T19:15:13.324 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98852.log 87.9% 2023-10-14T19:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.168317.log.gz 2023-10-14T19:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106290.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174473.log.gz 2023-10-14T19:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103044.log 2023-10-14T19:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106290.log.gz 2023-10-14T19:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178789.log 2023-10-14T19:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166221.log 2023-10-14T19:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98852.log.gz 2023-10-14T19:15:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178789.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103044.log.gz 2023-10-14T19:15:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177703.log 2023-10-14T19:15:13.327 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178789.log.gz 2023-10-14T19:15:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165511.log 2023-10-14T19:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177703.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.102852.log 2023-10-14T19:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166221.log.gz 2023-10-14T19:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.165511.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177703.log.gz 2023-10-14T19:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165511.log.gzgzip 2023-10-14T19:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.179354.log 2023-10-14T19:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106796.log 2023-10-14T19:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175396.log 2023-10-14T19:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102852.log.gz 2023-10-14T19:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162201.log 2023-10-14T19:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179354.log.gz 2023-10-14T19:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106796.log.gz 2023-10-14T19:15:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168883.log 2023-10-14T19:15:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175102.log 88.4% 2023-10-14T19:15:13.331 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.175396.log.gz 2023-10-14T19:15:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168883.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.162201.log.gz 2023-10-14T19:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179720.log 2023-10-14T19:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168883.log.gz 2023-10-14T19:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163755.log 2023-10-14T19:15:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101319.log 2023-10-14T19:15:13.333 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175102.log.gz 2023-10-14T19:15:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163755.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179720.log.gz 2023-10-14T19:15:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177437.log 2023-10-14T19:15:13.334 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.163755.log.gz 2023-10-14T19:15:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174913.log 2023-10-14T19:15:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171744.log 2023-10-14T19:15:13.335 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101319.log.gz 2023-10-14T19:15:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174913.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177437.log.gz 2023-10-14T19:15:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102516.log 2023-10-14T19:15:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171744.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174913.log.gz 2023-10-14T19:15:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172294.log 2023-10-14T19:15:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102516.log: gzip -5 88.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.171744.log.gz/var/log/ceph/ceph-client.admin.169716.log 2023-10-14T19:15:13.336 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.337 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102516.log.gz 2023-10-14T19:15:13.337 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172691.log 2023-10-14T19:15:13.337 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104436.log 2023-10-14T19:15:13.337 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172294.log.gz 2023-10-14T19:15:13.338 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169716.log.gz 2023-10-14T19:15:13.338 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166515.log 2023-10-14T19:15:13.338 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172691.log.gz 2023-10-14T19:15:13.339 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176778.log 2023-10-14T19:15:13.339 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163490.log 2023-10-14T19:15:13.339 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104436.log.gz 2023-10-14T19:15:13.339 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166515.log.gz 2023-10-14T19:15:13.340 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162665.log 2023-10-14T19:15:13.340 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163490.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176778.log.gz 2023-10-14T19:15:13.340 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179312.log 2023-10-14T19:15:13.341 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163490.log.gz 2023-10-14T19:15:13.341 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175630.log 2023-10-14T19:15:13.341 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179312.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162665.log.gz 2023-10-14T19:15:13.341 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103450.log 2023-10-14T19:15:13.342 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179312.log.gz 2023-10-14T19:15:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106248.log 2023-10-14T19:15:13.342 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175630.log.gz 2023-10-14T19:15:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102390.log 2023-10-14T19:15:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104912.log 2023-10-14T19:15:13.343 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103450.log.gz 2023-10-14T19:15:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102390.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106248.log.gz 2023-10-14T19:15:13.344 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157532.log 2023-10-14T19:15:13.344 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102390.log.gz 2023-10-14T19:15:13.344 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165845.log 2023-10-14T19:15:13.345 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157532.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.104912.log.gz--verbose -- 2023-10-14T19:15:13.345 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.100135.log 2023-10-14T19:15:13.345 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165845.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157532.log.gz 2023-10-14T19:15:13.345 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99322.log 2023-10-14T19:15:13.346 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165845.log.gz 2023-10-14T19:15:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.100135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97491.log 2023-10-14T19:15:13.346 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.100135.log.gz 2023-10-14T19:15:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168054.log 2023-10-14T19:15:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97491.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99322.log.gz 2023-10-14T19:15:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T19:15:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.168054.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97491.log.gz 2023-10-14T19:15:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166575.log 2023-10-14T19:15:13.348 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168054.log.gz 2023-10-14T19:15:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160825.log 2023-10-14T19:15:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101741.log 2023-10-14T19:15:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160825.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166575.log.gz 2023-10-14T19:15:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157156.log 2023-10-14T19:15:13.349 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160825.log.gz 2023-10-14T19:15:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159427.log 2023-10-14T19:15:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101741.log: /var/log/ceph/ceph-client.admin.157156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166744.log 2023-10-14T19:15:13.350 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101741.log.gz 2023-10-14T19:15:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159427.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157156.log.gz 2023-10-14T19:15:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174118.log 2023-10-14T19:15:13.351 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159427.log.gz 2023-10-14T19:15:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168547.log 2023-10-14T19:15:13.352 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166744.log.gz 2023-10-14T19:15:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97281.log 2023-10-14T19:15:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174118.log: /var/log/ceph/ceph-client.admin.168547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179762.log 2023-10-14T19:15:13.352 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174118.log.gz 2023-10-14T19:15:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97281.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168547.log.gz 2023-10-14T19:15:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156988.log 2023-10-14T19:15:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159740.log 2023-10-14T19:15:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179762.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97281.log.gz 2023-10-14T19:15:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96985.log 2023-10-14T19:15:13.354 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179762.log.gz 2023-10-14T19:15:13.354 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156988.log.gz 2023-10-14T19:15:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180461.log 2023-10-14T19:15:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159740.log: /var/log/ceph/ceph-client.admin.96985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177294.log 2023-10-14T19:15:13.355 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159740.log.gz 2023-10-14T19:15:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180461.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96985.log.gz 2023-10-14T19:15:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T19:15:13.356 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180461.log.gz 2023-10-14T19:15:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171988.log 2023-10-14T19:15:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102684.log 2023-10-14T19:15:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.1.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177294.log.gz 2023-10-14T19:15:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101655.log 2023-10-14T19:15:13.358 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171988.log.gz 2023-10-14T19:15:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171946.log 2023-10-14T19:15:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176610.log 2023-10-14T19:15:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101655.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102684.log.gz 2023-10-14T19:15:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167398.log 2023-10-14T19:15:13.359 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101655.log.gz 2023-10-14T19:15:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176610.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171946.log.gz 2023-10-14T19:15:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167176.log 2023-10-14T19:15:13.360 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176610.log.gz 2023-10-14T19:15:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171075.log 2023-10-14T19:15:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173383.log 2023-10-14T19:15:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167176.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167398.log.gz 2023-10-14T19:15:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164363.log 2023-10-14T19:15:13.361 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167176.log.gz 2023-10-14T19:15:13.361 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.171075.log.gz 2023-10-14T19:15:13.362 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166660.log 2023-10-14T19:15:13.362 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164363.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173383.log.gz 2023-10-14T19:15:13.362 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179678.log 2023-10-14T19:15:13.363 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179185.log 2023-10-14T19:15:13.363 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164363.log.gz 2023-10-14T19:15:13.363 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179678.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.166660.log.gz-5 2023-10-14T19:15:13.363 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.0.173076.log 2023-10-14T19:15:13.364 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180501.log 2023-10-14T19:15:13.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179185.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179678.log.gz 2023-10-14T19:15:13.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.173076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158697.log 2023-10-14T19:15:13.364 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.173076.log.gz 2023-10-14T19:15:13.365 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179185.log.gz 2023-10-14T19:15:13.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174747.log 2023-10-14T19:15:13.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.158697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.158697.log.gz 2023-10-14T19:15:13.366 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171682.log 2023-10-14T19:15:13.366 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180501.log.gz 2023-10-14T19:15:13.366 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160549.log 2023-10-14T19:15:13.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174747.log: /var/log/ceph/ceph-client.admin.171682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171472.log 2023-10-14T19:15:13.367 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174747.log.gz 2023-10-14T19:15:13.367 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171682.log.gz 2023-10-14T19:15:13.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158396.log 2023-10-14T19:15:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108177.log 89.3% 2023-10-14T19:15:13.368 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160549.log.gz 2023-10-14T19:15:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158396.log: gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.171472.log.gz-- 2023-10-14T19:15:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169586.log 2023-10-14T19:15:13.369 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158396.log.gz 2023-10-14T19:15:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.108177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163671.log 2023-10-14T19:15:13.369 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108177.log.gz 2023-10-14T19:15:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161580.log 2023-10-14T19:15:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169586.log: /var/log/ceph/ceph-client.admin.163671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159091.log 2023-10-14T19:15:13.370 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169586.log.gz 2023-10-14T19:15:13.370 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163671.log.gz 2023-10-14T19:15:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177787.log 2023-10-14T19:15:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168401.log 2023-10-14T19:15:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159091.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161580.log.gz 2023-10-14T19:15:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180106.log 2023-10-14T19:15:13.372 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159091.log.gz 2023-10-14T19:15:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159656.log 2023-10-14T19:15:13.372 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177787.log.gz 2023-10-14T19:15:13.373 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168401.log.gz 2023-10-14T19:15:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172030.log 2023-10-14T19:15:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105691.log 2023-10-14T19:15:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159656.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.180106.log.gz 2023-10-14T19:15:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105218.log 2023-10-14T19:15:13.374 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159656.log.gz 2023-10-14T19:15:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.105691.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172030.log.gz 2023-10-14T19:15:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105386.log 2023-10-14T19:15:13.375 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105691.log.gz 2023-10-14T19:15:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107578.log 2023-10-14T19:15:13.375 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105218.log.gz 2023-10-14T19:15:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101571.log 2023-10-14T19:15:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107578.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105386.log.gz 2023-10-14T19:15:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104784.log 2023-10-14T19:15:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163923.log 2023-10-14T19:15:13.377 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107578.log.gz 2023-10-14T19:15:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104784.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101571.log.gz 2023-10-14T19:15:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168925.log 2023-10-14T19:15:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167526.log 2023-10-14T19:15:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163923.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104784.log.gz 2023-10-14T19:15:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106670.log 2023-10-14T19:15:13.378 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163923.log.gz 2023-10-14T19:15:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169766.log 2023-10-14T19:15:13.379 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168925.log.gz 2023-10-14T19:15:13.379 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167526.log.gz 2023-10-14T19:15:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107536.log 2023-10-14T19:15:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T19:15:13.380 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106670.log.gz/var/log/ceph/ceph-client.admin.169766.log: 2023-10-14T19:15:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158185.log 2023-10-14T19:15:13.381 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169766.log.gz 2023-10-14T19:15:13.381 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107536.log.gz 2023-10-14T19:15:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102092.log 2023-10-14T19:15:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164650.log 2023-10-14T19:15:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158185.log: /var/log/ceph/ceph-client.admin.102092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176694.log 2023-10-14T19:15:13.382 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158185.log.gz 2023-10-14T19:15:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157216.log 2023-10-14T19:15:13.383 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102092.log.gz 2023-10-14T19:15:13.383 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164650.log.gz 2023-10-14T19:15:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176254.log 2023-10-14T19:15:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107230.log 2023-10-14T19:15:13.384 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176694.log.gz 2023-10-14T19:15:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157216.log: /var/log/ceph/ceph-client.admin.176254.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157216.log.gz 2023-10-14T19:15:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107230.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176254.log.gz 2023-10-14T19:15:13.385 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107230.log.gz 2023-10-14T19:15:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165556.log 2023-10-14T19:15:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102936.log 2023-10-14T19:15:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173467.log 2023-10-14T19:15:13.386 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165556.log.gz 2023-10-14T19:15:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100348.log 2023-10-14T19:15:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158057.log 2023-10-14T19:15:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173467.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102936.log.gz 2023-10-14T19:15:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100348.log: gzip -5 89.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.173467.log.gz/var/log/ceph/ceph-client.admin.108344.log 2023-10-14T19:15:13.387 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100348.log.gz 2023-10-14T19:15:13.388 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158057.log.gz 2023-10-14T19:15:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108344.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108344.log.gz 2023-10-14T19:15:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165252.log 2023-10-14T19:15:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168673.log 2023-10-14T19:15:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156862.log 2023-10-14T19:15:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172422.log 2023-10-14T19:15:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168673.log.gz 2023-10-14T19:15:13.390 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.165252.log.gz 2023-10-14T19:15:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172422.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156862.log.gz 2023-10-14T19:15:13.391 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172422.log.gz 2023-10-14T19:15:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167092.log 2023-10-14T19:15:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166890.log 2023-10-14T19:15:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175354.log 2023-10-14T19:15:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157904.log 2023-10-14T19:15:13.392 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.167092.log.gz 2023-10-14T19:15:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167484.log 2023-10-14T19:15:13.392 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166890.log.gz 2023-10-14T19:15:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162791.log 2023-10-14T19:15:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157904.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175354.log.gz 2023-10-14T19:15:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167484.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157904.log.gz 2023-10-14T19:15:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162791.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.167484.log.gz 2023-10-14T19:15:13.394 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162791.log.gz 2023-10-14T19:15:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96737.log 2023-10-14T19:15:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173509.log 2023-10-14T19:15:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160174.log 2023-10-14T19:15:13.395 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96737.log.gz 2023-10-14T19:15:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104742.log 2023-10-14T19:15:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166137.log 2023-10-14T19:15:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160174.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173509.log.gz 2023-10-14T19:15:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104742.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160174.log.gz 2023-10-14T19:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166137.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104742.log.gz 2023-10-14T19:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166137.log.gz 2023-10-14T19:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100222.log 2023-10-14T19:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174160.log 2023-10-14T19:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159343.log 2023-10-14T19:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100222.log.gz 2023-10-14T19:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97664.log 2023-10-14T19:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177525.log 2023-10-14T19:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159343.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174160.log.gz 2023-10-14T19:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169196.log 2023-10-14T19:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159343.log.gz 2023-10-14T19:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177525.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97664.log.gz 2023-10-14T19:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177525.log.gz 2023-10-14T19:15:13.402 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169196.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169196.log.gz 2023-10-14T19:15:13.402 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164872.log 2023-10-14T19:15:13.402 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174389.log 2023-10-14T19:15:13.402 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173593.log 2023-10-14T19:15:13.403 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104226.log 2023-10-14T19:15:13.403 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164872.log.gz 2023-10-14T19:15:13.403 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174389.log.gz 2023-10-14T19:15:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157776.log 2023-10-14T19:15:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167753.log 2023-10-14T19:15:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104226.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173593.log.gz 2023-10-14T19:15:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157776.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104226.log.gz 2023-10-14T19:15:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157776.log.gz 2023-10-14T19:15:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171159.log 2023-10-14T19:15:13.405 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167753.log.gz 2023-10-14T19:15:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164217.log 2023-10-14T19:15:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179972.log 2023-10-14T19:15:13.406 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171159.log.gz 2023-10-14T19:15:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169238.log 2023-10-14T19:15:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106164.log 2023-10-14T19:15:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179972.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164217.log.gz 2023-10-14T19:15:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169238.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179972.log.gz 2023-10-14T19:15:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106164.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169238.log.gz 2023-10-14T19:15:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168841.log 2023-10-14T19:15:13.408 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106164.log.gz 2023-10-14T19:15:13.409 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176400.log 2023-10-14T19:15:13.409 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160132.log 2023-10-14T19:15:13.409 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168841.log.gz 2023-10-14T19:15:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179594.log 2023-10-14T19:15:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177336.log 2023-10-14T19:15:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160132.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176400.log.gz 2023-10-14T19:15:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173121.log 2023-10-14T19:15:13.411 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160132.log.gz 2023-10-14T19:15:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179594.log.gz 2023-10-14T19:15:13.412 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177336.log.gz 2023-10-14T19:15:13.412 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173121.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173121.log.gz 2023-10-14T19:15:13.412 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165126.log 2023-10-14T19:15:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103932.log 2023-10-14T19:15:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177997.log 2023-10-14T19:15:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174304.log 2023-10-14T19:15:13.414 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165126.log.gz 2023-10-14T19:15:13.414 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103932.log.gz 2023-10-14T19:15:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179041.log 2023-10-14T19:15:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165893.log 2023-10-14T19:15:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174304.log: /var/log/ceph/ceph-client.admin.179041.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174304.log.gz 2023-10-14T19:15:13.415 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.177997.log.gz 2023-10-14T19:15:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165893.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179041.log.gz 2023-10-14T19:15:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose 88.6%-- /var/log/ceph/ceph-client.admin.175058.log -- replaced with /var/log/ceph/ceph-client.admin.165893.log.gz 2023-10-14T19:15:13.416 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:13.416 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173163.log 2023-10-14T19:15:13.416 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172649.log 2023-10-14T19:15:13.417 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175058.log.gz 2023-10-14T19:15:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180014.log 2023-10-14T19:15:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159049.log 2023-10-14T19:15:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172649.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173163.log.gz 2023-10-14T19:15:13.418 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.180014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103831.log 2023-10-14T19:15:13.418 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.172649.log.gz 2023-10-14T19:15:13.418 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103546.log 2023-10-14T19:15:13.419 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.180014.log.gz 2023-10-14T19:15:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103831.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159049.log.gz 2023-10-14T19:15:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103546.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103831.log.gz 2023-10-14T19:15:13.419 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103546.log.gz 2023-10-14T19:15:13.420 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107872.log 2023-10-14T19:15:13.420 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161147.log 2023-10-14T19:15:13.420 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162749.log 2023-10-14T19:15:13.421 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169070.log 2023-10-14T19:15:13.421 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107872.log.gz 2023-10-14T19:15:13.421 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161147.log.gz 2023-10-14T19:15:13.421 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162749.log: /var/log/ceph/ceph-client.admin.169070.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162749.log.gz 2023-10-14T19:15:13.422 INFO:teuthology.orchestra.run.smithi007.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.169070.log.gz 2023-10-14T19:15:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162833.log 2023-10-14T19:15:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176170.log 2023-10-14T19:15:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102600.log 2023-10-14T19:15:13.423 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104016.log 2023-10-14T19:15:13.423 INFO:teuthology.orchestra.run.smithi007.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.162833.log.gz 2023-10-14T19:15:13.423 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176170.log.gz 2023-10-14T19:15:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165084.log 2023-10-14T19:15:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100600.log 2023-10-14T19:15:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104016.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102600.log.gz 2023-10-14T19:15:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165084.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104016.log.gz 2023-10-14T19:15:13.425 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100600.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165084.log.gz 2023-10-14T19:15:13.425 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164914.log 2023-10-14T19:15:13.425 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100600.log.gz 2023-10-14T19:15:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174347.log 2023-10-14T19:15:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165935.log 2023-10-14T19:15:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164914.log: /var/log/ceph/ceph-client.admin.174347.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164914.log.gz 2023-10-14T19:15:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165935.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174347.log.gz 2023-10-14T19:15:13.427 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165935.log.gz 2023-10-14T19:15:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158143.log 2023-10-14T19:15:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169502.log 2023-10-14T19:15:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170382.log 2023-10-14T19:15:13.428 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158143.log.gz 2023-10-14T19:15:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169502.log: /var/log/ceph/ceph-client.admin.170382.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169502.log.gz 2023-10-14T19:15:13.428 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.170382.log.gz 2023-10-14T19:15:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171201.log 2023-10-14T19:15:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173339.log 2023-10-14T19:15:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90943.log 2023-10-14T19:15:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158015.log 2023-10-14T19:15:13.430 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171201.log.gz 2023-10-14T19:15:13.430 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173339.log.gz 2023-10-14T19:15:13.430 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.90943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100937.log 2023-10-14T19:15:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157301.log 2023-10-14T19:15:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158015.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90943.log.gz 2023-10-14T19:15:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100937.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158015.log.gz 2023-10-14T19:15:13.432 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6%/var/log/ceph/ceph-client.admin.157301.log: -- replaced with /var/log/ceph/ceph-client.admin.100937.log.gz 2023-10-14T19:15:13.432 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157301.log.gz 2023-10-14T19:15:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179930.log 2023-10-14T19:15:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158910.log 2023-10-14T19:15:13.433 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163264.log 2023-10-14T19:15:13.433 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179930.log.gz 2023-10-14T19:15:13.433 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102474.log 2023-10-14T19:15:13.433 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100979.log 2023-10-14T19:15:13.434 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.163264.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158910.log.gz 2023-10-14T19:15:13.434 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163264.log.gz 2023-10-14T19:15:13.434 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167262.log 2023-10-14T19:15:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100979.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102474.log.gz 2023-10-14T19:15:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167262.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100979.log.gz 2023-10-14T19:15:13.435 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167262.log.gz 2023-10-14T19:15:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T19:15:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107186.log 2023-10-14T19:15:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102558.log 2023-10-14T19:15:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98768.log 2023-10-14T19:15:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102558.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107186.log.gz 2023-10-14T19:15:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98768.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102558.log.gz 2023-10-14T19:15:13.437 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98768.log.gz 2023-10-14T19:15:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105344.log 2023-10-14T19:15:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163839.log 2023-10-14T19:15:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105344.log: /var/log/ceph/ceph-client.admin.163839.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105344.log.gz 2023-10-14T19:15:13.439 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163839.log.gz 2023-10-14T19:15:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178063.log 2023-10-14T19:15:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176988.log 2023-10-14T19:15:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178063.log: /var/log/ceph/ceph-client.admin.176988.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178063.log.gz 2023-10-14T19:15:13.440 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177481.log 2023-10-14T19:15:13.440 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176988.log.gz 2023-10-14T19:15:13.440 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166786.log 2023-10-14T19:15:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177481.log: /var/log/ceph/ceph-client.admin.166786.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177481.log.gz 2023-10-14T19:15:13.441 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166786.log.gz 2023-10-14T19:15:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157114.log 2023-10-14T19:15:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157860.log 2023-10-14T19:15:13.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100474.log 2023-10-14T19:15:13.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157860.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157114.log.gz 2023-10-14T19:15:13.442 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157860.log.gz 2023-10-14T19:15:13.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100474.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100474.log.gz 2023-10-14T19:15:13.443 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161622.log 2023-10-14T19:15:13.443 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162061.log 2023-10-14T19:15:13.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98894.log 2023-10-14T19:15:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162061.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161622.log.gz 2023-10-14T19:15:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98894.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162061.log.gz 2023-10-14T19:15:13.444 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98894.log.gz 2023-10-14T19:15:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106424.log 2023-10-14T19:15:13.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163260.log 2023-10-14T19:15:13.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106424.log: /var/log/ceph/ceph-client.0.163260.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106424.log.gz 2023-10-14T19:15:13.445 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163260.log.gz 2023-10-14T19:15:13.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168985.log 2023-10-14T19:15:13.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169986.log 2023-10-14T19:15:13.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163965.log 2023-10-14T19:15:13.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169986.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168985.log.gz 2023-10-14T19:15:13.447 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169986.log.gz 2023-10-14T19:15:13.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163965.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163965.log.gz 2023-10-14T19:15:13.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102432.log 2023-10-14T19:15:13.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156778.log 2023-10-14T19:15:13.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104826.log 2023-10-14T19:15:13.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102432.log: /var/log/ceph/ceph-client.admin.156778.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102432.log.gz 2023-10-14T19:15:13.448 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156778.log.gz 2023-10-14T19:15:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104826.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104826.log.gz 2023-10-14T19:15:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107662.log 2023-10-14T19:15:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163067.log 2023-10-14T19:15:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161851.log 2023-10-14T19:15:13.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163067.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107662.log.gz 2023-10-14T19:15:13.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161851.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163067.log.gz 2023-10-14T19:15:13.450 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161851.log.gz 2023-10-14T19:15:13.451 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179083.log 2023-10-14T19:15:13.451 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161893.log 2023-10-14T19:15:13.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168183.log 2023-10-14T19:15:13.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161893.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179083.log.gz 2023-10-14T19:15:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168183.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161893.log.gz 2023-10-14T19:15:13.452 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168183.log.gz 2023-10-14T19:15:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164007.log 2023-10-14T19:15:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162283.log 2023-10-14T19:15:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97662.log 2023-10-14T19:15:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162283.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164007.log.gz 2023-10-14T19:15:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97662.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162283.log.gz 2023-10-14T19:15:13.454 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97662.log.gz 2023-10-14T19:15:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175228.log 2023-10-14T19:15:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174557.log 2023-10-14T19:15:13.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107144.log 2023-10-14T19:15:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174557.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175228.log.gz 2023-10-14T19:15:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107144.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174557.log.gz 2023-10-14T19:15:13.455 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107144.log.gz 2023-10-14T19:15:13.456 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172160.log 2023-10-14T19:15:13.456 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179636.log 2023-10-14T19:15:13.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159175.log 2023-10-14T19:15:13.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179636.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172160.log.gz 2023-10-14T19:15:13.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159175.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179636.log.gz 2023-10-14T19:15:13.457 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159175.log.gz 2023-10-14T19:15:13.457 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158952.log 2023-10-14T19:15:13.458 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171327.log 2023-10-14T19:15:13.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158952.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T19:15:13.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171327.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.158952.log.gz 2023-10-14T19:15:13.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.y.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171327.log.gz 2023-10-14T19:15:13.459 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167568.log 2023-10-14T19:15:13.459 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97323.log 2023-10-14T19:15:13.459 INFO:teuthology.orchestra.run.smithi007.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T19:15:13.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167568.log: /var/log/ceph/ceph-client.admin.97323.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167568.log.gz 2023-10-14T19:15:13.460 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97323.log.gz 2023-10-14T19:15:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100768.log 2023-10-14T19:15:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169300.log 2023-10-14T19:15:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160090.log 2023-10-14T19:15:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169300.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100768.log.gz 2023-10-14T19:15:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160090.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169300.log.gz 2023-10-14T19:15:13.462 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160090.log.gz 2023-10-14T19:15:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102768.log 2023-10-14T19:15:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179804.log 2023-10-14T19:15:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102768.log: /var/log/ceph/ceph-client.admin.179804.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102768.log.gz 2023-10-14T19:15:13.463 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179804.log.gz 2023-10-14T19:15:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158701.log 2023-10-14T19:15:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161496.log 2023-10-14T19:15:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.158701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104310.log 2023-10-14T19:15:13.464 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.158701.log.gz 2023-10-14T19:15:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177913.log 2023-10-14T19:15:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104310.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161496.log.gz 2023-10-14T19:15:13.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177913.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104310.log.gz 2023-10-14T19:15:13.465 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177913.log.gz 2023-10-14T19:15:13.465 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161538.log 2023-10-14T19:15:13.466 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177745.log 2023-10-14T19:15:13.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161538.log: /var/log/ceph/ceph-client.admin.177745.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.161538.log.gz 2023-10-14T19:15:13.466 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177745.log.gz 2023-10-14T19:15:13.466 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166431.log 2023-10-14T19:15:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97660.log 2023-10-14T19:15:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164830.log 2023-10-14T19:15:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97660.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166431.log.gz 2023-10-14T19:15:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97660.log.gz 2023-10-14T19:15:13.468 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164830.log.gz 2023-10-14T19:15:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99062.log 2023-10-14T19:15:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166263.log 2023-10-14T19:15:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:gzip /var/log/ceph/ceph-client.admin.99062.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.168715.log 2023-10-14T19:15:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166263.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99062.log.gz 2023-10-14T19:15:13.469 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166263.log.gz 2023-10-14T19:15:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168715.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168715.log.gz 2023-10-14T19:15:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160675.log 2023-10-14T19:15:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161664.log 2023-10-14T19:15:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178427.log 2023-10-14T19:15:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161664.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160675.log.gz 2023-10-14T19:15:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178427.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161664.log.gz 2023-10-14T19:15:13.471 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178427.log.gz 2023-10-14T19:15:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170213.log 2023-10-14T19:15:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166702.log 2023-10-14T19:15:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170070.log 2023-10-14T19:15:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166702.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.170213.log.gz 2023-10-14T19:15:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170070.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166702.log.gz 2023-10-14T19:15:13.473 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170070.log.gz 2023-10-14T19:15:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96688.log 2023-10-14T19:15:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169672.log 2023-10-14T19:15:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98978.log 2023-10-14T19:15:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169672.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96688.log.gz 2023-10-14T19:15:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98978.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169672.log.gz 2023-10-14T19:15:13.474 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98978.log.gz 2023-10-14T19:15:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167306.log 2023-10-14T19:15:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162959.log 2023-10-14T19:15:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176820.log 2023-10-14T19:15:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162959.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.167306.log.gz 2023-10-14T19:15:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176820.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162959.log.gz 2023-10-14T19:15:13.476 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176820.log.gz 2023-10-14T19:15:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174431.log 2023-10-14T19:15:13.477 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172506.log 2023-10-14T19:15:13.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174431.log: /var/log/ceph/ceph-client.admin.172506.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174431.log.gz 2023-10-14T19:15:13.477 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172506.log.gz 2023-10-14T19:15:13.478 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101403.log 2023-10-14T19:15:13.478 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171429.log 2023-10-14T19:15:13.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103974.log 2023-10-14T19:15:13.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171429.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101403.log.gz 2023-10-14T19:15:13.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103974.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171429.log.gz 2023-10-14T19:15:13.479 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103974.log.gz 2023-10-14T19:15:13.479 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103504.log 2023-10-14T19:15:13.479 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163448.log 2023-10-14T19:15:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157965.log 2023-10-14T19:15:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163448.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103504.log.gz 2023-10-14T19:15:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157965.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163448.log.gz 2023-10-14T19:15:13.481 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157965.log.gz 2023-10-14T19:15:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164736.log 2023-10-14T19:15:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167440.log 2023-10-14T19:15:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99188.log 2023-10-14T19:15:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167440.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164736.log.gz 2023-10-14T19:15:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99188.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167440.log.gz 2023-10-14T19:15:13.482 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.99188.log.gz 2023-10-14T19:15:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102260.log 2023-10-14T19:15:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171514.log 2023-10-14T19:15:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176862.log 2023-10-14T19:15:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171514.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102260.log.gz 2023-10-14T19:15:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.176862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171514.log.gz 2023-10-14T19:15:13.484 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176862.log.gz 2023-10-14T19:15:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161022.log 2023-10-14T19:15:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97998.log 2023-10-14T19:15:13.485 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.161022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101529.log 2023-10-14T19:15:13.485 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161022.log.gz 2023-10-14T19:15:13.485 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97998.log: /var/log/ceph/ceph-client.admin.101529.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97998.log.gz 2023-10-14T19:15:13.486 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101529.log.gz 2023-10-14T19:15:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98001.log 2023-10-14T19:15:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106466.log 2023-10-14T19:15:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161328.log 2023-10-14T19:15:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106466.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98001.log.gz 2023-10-14T19:15:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161328.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106466.log.gz 2023-10-14T19:15:13.487 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161328.log.gz 2023-10-14T19:15:13.488 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164608.log 2023-10-14T19:15:13.488 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100853.log 2023-10-14T19:15:13.489 INFO:teuthology.orchestra.run.smithi148.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T19:15:13.490 INFO:teuthology.orchestra.run.smithi148.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T19:15:13.490 INFO:teuthology.orchestra.run.smithi148.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T19:15:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164608.log: /var/log/ceph/ceph-client.admin.100853.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164608.log.gz 2023-10-14T19:15:13.505 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100853.log.gz 2023-10-14T19:15:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98355.log 2023-10-14T19:15:13.506 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168099.log 2023-10-14T19:15:13.506 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179888.log 2023-10-14T19:15:13.506 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168099.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98355.log.gz 2023-10-14T19:15:13.507 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179888.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168099.log.gz 2023-10-14T19:15:13.507 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179888.log.gz 2023-10-14T19:15:13.507 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178831.log 2023-10-14T19:15:13.507 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98726.log 2023-10-14T19:15:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167861.log 2023-10-14T19:15:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98726.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.178831.log.gz 2023-10-14T19:15:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167861.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98726.log.gz 2023-10-14T19:15:13.508 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167861.log.gz 2023-10-14T19:15:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169028.log 2023-10-14T19:15:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102348.log 2023-10-14T19:15:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169028.log: /var/log/ceph/ceph-client.admin.102348.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169028.log.gz 2023-10-14T19:15:13.510 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102348.log.gz 2023-10-14T19:15:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159133.log 2023-10-14T19:15:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171904.log 2023-10-14T19:15:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161370.log 2023-10-14T19:15:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171904.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159133.log.gz 2023-10-14T19:15:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161370.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171904.log.gz 2023-10-14T19:15:13.511 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161370.log.gz 2023-10-14T19:15:13.512 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160717.log 2023-10-14T19:15:13.512 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104058.log 2023-10-14T19:15:13.512 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160717.log: /var/log/ceph/ceph-client.admin.104058.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160717.log.gz 2023-10-14T19:15:13.512 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104058.log.gz 2023-10-14T19:15:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104868.log 2023-10-14T19:15:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97657.log 2023-10-14T19:15:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173247.log 2023-10-14T19:15:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97657.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104868.log.gz 2023-10-14T19:15:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173247.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97657.log.gz 2023-10-14T19:15:13.514 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173247.log.gz 2023-10-14T19:15:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102304.log 2023-10-14T19:15:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107494.log 2023-10-14T19:15:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162581.log 2023-10-14T19:15:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107494.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102304.log.gz 2023-10-14T19:15:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162581.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107494.log.gz 2023-10-14T19:15:13.516 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162581.log.gz 2023-10-14T19:15:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102642.log 2023-10-14T19:15:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174829.log 2023-10-14T19:15:13.517 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171117.log 2023-10-14T19:15:13.517 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174829.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102642.log.gz 2023-10-14T19:15:13.517 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171117.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174829.log.gz 2023-10-14T19:15:13.518 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171117.log.gz 2023-10-14T19:15:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102978.log 2023-10-14T19:15:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106080.log 2023-10-14T19:15:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91071.log 2023-10-14T19:15:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106080.log: /var/log/ceph/ceph-client.admin.91071.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106080.log.gz 2023-10-14T19:15:13.519 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.102978.log.gz 2023-10-14T19:15:13.519 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91071.log.gz 2023-10-14T19:15:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97666.log 2023-10-14T19:15:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165000.log 2023-10-14T19:15:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172252.log 2023-10-14T19:15:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165000.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97666.log.gz 2023-10-14T19:15:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172252.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165000.log.gz 2023-10-14T19:15:13.521 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172252.log.gz 2023-10-14T19:15:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107746.log 2023-10-14T19:15:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170171.log 2023-10-14T19:15:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169808.log 2023-10-14T19:15:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170171.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.107746.log.gz 2023-10-14T19:15:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169808.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170171.log.gz 2023-10-14T19:15:13.523 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169808.log.gz 2023-10-14T19:15:13.523 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161935.log 2023-10-14T19:15:13.523 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106936.log 2023-10-14T19:15:13.524 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161935.log: /var/log/ceph/ceph-client.admin.106936.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161935.log.gz 2023-10-14T19:15:13.524 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106936.log.gz 2023-10-14T19:15:13.524 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97365.log 2023-10-14T19:15:13.524 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177252.log 2023-10-14T19:15:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167356.log 2023-10-14T19:15:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177252.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97365.log.gz 2023-10-14T19:15:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167356.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177252.log.gz 2023-10-14T19:15:13.525 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167356.log.gz 2023-10-14T19:15:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160759.log 2023-10-14T19:15:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105134.log 2023-10-14T19:15:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173908.log 2023-10-14T19:15:13.527 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105134.log: /var/log/ceph/ceph-client.admin.173908.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105134.log.gz 2023-10-14T19:15:13.527 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.160759.log.gz 2023-10-14T19:15:13.527 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173908.log.gz 2023-10-14T19:15:13.527 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105090.log 2023-10-14T19:15:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167669.log 2023-10-14T19:15:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177659.log 2023-10-14T19:15:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167669.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105090.log.gz 2023-10-14T19:15:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.177659.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167669.log.gz 2023-10-14T19:15:13.529 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177659.log.gz 2023-10-14T19:15:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107452.log 2023-10-14T19:15:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158269.log 2023-10-14T19:15:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107452.log: /var/log/ceph/ceph-client.admin.158269.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107452.log.gz 2023-10-14T19:15:13.530 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158269.log.gz 2023-10-14T19:15:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179510.log 2023-10-14T19:15:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157818.log 2023-10-14T19:15:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.179510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159698.log 2023-10-14T19:15:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157818.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179510.log.gz 2023-10-14T19:15:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157818.log.gz 2023-10-14T19:15:13.532 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159698.log.gz 2023-10-14T19:15:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96607.log 2023-10-14T19:15:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175910.log 2023-10-14T19:15:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167134.log 2023-10-14T19:15:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.175910.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96607.log.gz 2023-10-14T19:15:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167134.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175910.log.gz 2023-10-14T19:15:13.533 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167134.log.gz 2023-10-14T19:15:13.534 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158438.log 2023-10-14T19:15:13.534 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170448.log 2023-10-14T19:15:13.534 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106122.log 2023-10-14T19:15:13.534 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170448.log: /var/log/ceph/ceph-client.admin.106122.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170448.log.gz 2023-10-14T19:15:13.535 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.158438.log.gz 2023-10-14T19:15:13.535 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106122.log.gz 2023-10-14T19:15:13.535 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166389.log 2023-10-14T19:15:13.536 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167711.log 2023-10-14T19:15:13.536 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170991.log 2023-10-14T19:15:13.536 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166389.log.gz 2023-10-14T19:15:13.536 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170991.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167711.log.gz 2023-10-14T19:15:13.537 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170991.log.gz 2023-10-14T19:15:13.537 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166305.log 2023-10-14T19:15:13.537 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100558.log 2023-10-14T19:15:13.537 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.166305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101613.log 2023-10-14T19:15:13.538 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100558.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166305.log.gz 2023-10-14T19:15:13.538 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101613.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100558.log.gz 2023-10-14T19:15:13.538 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101613.log.gz 2023-10-14T19:15:13.539 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159782.log 2023-10-14T19:15:13.539 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99146.log 2023-10-14T19:15:13.539 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159782.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T19:15:13.539 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99146.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159782.log.gz 2023-10-14T19:15:13.540 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99146.log.gz 2023-10-14T19:15:13.540 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159845.log 2023-10-14T19:15:13.540 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106526.log 2023-10-14T19:15:13.541 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159845.log: /var/log/ceph/ceph-client.admin.106526.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159845.log.gz 2023-10-14T19:15:13.541 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106526.log.gz 2023-10-14T19:15:13.541 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169112.log 2023-10-14T19:15:13.541 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165640.log 2023-10-14T19:15:13.542 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.169112.log: /var/log/ceph/ceph-client.admin.165640.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.169112.log.gz 2023-10-14T19:15:13.542 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.165640.log.gz 2023-10-14T19:15:13.542 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178957.log 2023-10-14T19:15:13.543 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161706.log 2023-10-14T19:15:13.543 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.178957.log: /var/log/ceph/ceph-client.admin.161706.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178957.log.gz 2023-10-14T19:15:13.543 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161706.log.gz 2023-10-14T19:15:13.543 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105900.log 2023-10-14T19:15:13.544 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174244.log 2023-10-14T19:15:13.544 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105900.log: /var/log/ceph/ceph-client.admin.174244.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105900.log.gz 2023-10-14T19:15:13.544 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174244.log.gz 2023-10-14T19:15:13.597 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T19:15:13.644 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T19:15:13.689 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T19:15:13.720 INFO:teuthology.orchestra.run.smithi148.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T19:15:13.720 INFO:teuthology.orchestra.run.smithi148.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T19:15:13.850 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T19:15:13.852 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-10-14T19:15:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m0.973s 2023-10-14T19:15:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m4.645s 2023-10-14T19:15:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.199s 2023-10-14T19:15:13.881 INFO:teuthology.orchestra.run.smithi007.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T19:15:13.927 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T19:15:13.967 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T19:15:18.301 INFO:teuthology.orchestra.run.smithi007.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T19:15:18.304 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-10-14T19:15:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m5.446s 2023-10-14T19:15:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m9.374s 2023-10-14T19:15:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.696s 2023-10-14T19:15:18.305 INFO:tasks.ceph:Archiving logs... 2023-10-14T19:15:18.305 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/remote/smithi007/log 2023-10-14T19:15:18.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T19:15:20.165 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/remote/smithi148/log 2023-10-14T19:15:20.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T19:15:20.784 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T19:15:20.796 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T19:15:20.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T19:15:20.800 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T19:15:20.879 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T19:15:20.888 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T19:15:20.888 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T19:15:20.891 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T19:15:20.906 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-10-14T19:15:20.906 INFO:teuthology.orchestra.run.smithi148.stderr:bash: ntpq: command not found 2023-10-14T19:15:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:210 Number of sources = 4 2023-10-14T19:15:20.910 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T19:15:20.910 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-10-14T19:15:20.910 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +1081us[+1081us] +/- 72ms 2023-10-14T19:15:20.911 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -362us[ -363us] +/- 62ms 2023-10-14T19:15:20.911 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -586us[ -588us] +/- 79ms 2023-10-14T19:15:20.911 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T19:15:20.913 INFO:teuthology.orchestra.run.smithi148.stdout:210 Number of sources = 4 2023-10-14T19:15:20.913 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T19:15:20.913 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-10-14T19:15:20.914 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +1047us[+1047us] +/- 72ms 2023-10-14T19:15:20.914 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv02.front.sepia.ceph.com 3 6 377 11 -394us[ -381us] +/- 62ms 2023-10-14T19:15:20.914 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -618us[ -605us] +/- 79ms 2023-10-14T19:15:20.914 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T19:15:20.915 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T19:15:20.923 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T19:15:20.924 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T19:15:20.934 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T19:15:21.015 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T19:15:21.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T19:15:21.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:15:21.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T19:15:21.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:15:21.183 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T19:15:21.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T19:15:21.204 INFO:teuthology.task.internal:Duration was 1428.936039 seconds 2023-10-14T19:15:21.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T19:15:21.216 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T19:15:21.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T19:15:21.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T19:15:21.267 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T19:15:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T19:15:21.510 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T19:15:21.511 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2023-10-14T19:15:21.511 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T19:15:21.534 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2023-10-14T19:15:21.534 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T19:15:21.553 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T19:15:21.553 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T19:15:21.577 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T19:15:21.632 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T19:15:21.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T19:15:21.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T19:15:21.748 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T19:15:21.759 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T19:15:21.759 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T19:15:21.786 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T19:15:21.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T19:15:21.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T19:15:21.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T19:15:21.852 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2023-10-14T19:15:21.874 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2023-10-14T19:15:21.888 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T19:15:21.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:15:21.922 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T19:15:21.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T19:15:21.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T19:15:21.957 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T19:15:21.958 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/remote/smithi007 2023-10-14T19:15:21.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T19:15:21.998 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801/remote/smithi148 2023-10-14T19:15:21.998 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T19:15:22.034 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T19:15:22.035 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T19:15:22.037 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T19:15:22.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T19:15:22.095 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T19:15:22.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T19:15:22.107 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T19:15:22.107 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T19:15:22.110 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T19:15:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 19:15 /home/ubuntu/cephtest 2023-10-14T19:15:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: 262149 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 19:15 /home/ubuntu/cephtest 2023-10-14T19:15:22.138 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T19:15:22.150 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T19:15:22.181 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T19:15:22.208 DEBUG:teuthology.nuke:shortname: smithi007 2023-10-14T19:15:22.209 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T19:15:22.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:43:46.834511', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSrqygswVfZqG7JEM590EKL6zyqWL7FCIxqREpoASKF/ctYhAS8olNztrKutEskPm4iqVRXef2yhvWSFIbDF14='} 2023-10-14T19:15:22.239 DEBUG:teuthology.nuke:shortname: smithi148 2023-10-14T19:15:22.239 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T19:15:22.262 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425801', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:43:46.835929', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0hM9VEJyt4NHND840BB2PAXjFUrr1hPb5VcsjvHz7QWnK7eJEa7OV3IpOxovMjNchmTIL1tOVIUSMCCVAT7wk='} 2023-10-14T19:15:22.292 INFO:teuthology.orchestra.console.smithi007:Power off 2023-10-14T19:15:22.293 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T19:15:22.319 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-10-14T19:15:22.319 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T19:15:22.338 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-14T19:15:22.338 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T19:15:22.348 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-14T19:15:22.362 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-14T19:15:22.363 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T19:15:22.386 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-14T19:15:26.350 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T19:15:26.389 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T19:15:26.461 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-14T19:15:26.500 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-14T19:15:30.465 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T19:15:30.502 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T19:15:30.576 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-14T19:15:30.612 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-14T19:15:30.678 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-10-14T19:15:30.713 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-14T19:15:30.818 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1428.9360392093658 failure_reason: 'Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7ceded98f2cc4e45b3f3d3d2f6161dd9 status: fail success: false 2023-10-14T19:15:30.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T19:15:30.905 INFO:teuthology.run:FAIL